2024-04-24T02:04:00.906 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-24T02:04:00.906 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/teuthology-2024-04-23_21:40:02-rgw-squid-distro-default-smithi/7670635 --verbose --owner scheduled_teuthology@teuthology --description rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{centos_latest}} --name teuthology-2024-04-23_21:40:02-rgw-squid-distro-default-smithi -- /home/teuthworker/archive/teuthology-2024-04-23_21:40:02-rgw-squid-distro-default-smithi/7670635/orig.config.yaml 2024-04-24T02:04:00.937 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-24T02:04:01.023 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-23_21:40:02-rgw-squid-distro-default-smithi/7670635 branch: squid description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{centos_latest}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7670635' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-04-23_21:40:02-rgw-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: b98aab6c00f483888c049d0d8e7bc507e115dd86 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: b98aab6c00f483888c049d0d8e7bc507e115dd86 rgw: ec-data-pool: false frontend: beast selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: b98aab6c00f483888c049d0d8e7bc507e115dd86 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 9360 sha1: b98aab6c00f483888c049d0d8e7bc507e115dd86 sleep_before_teardown: 0 subset: 0/1 suite: rgw suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_b98aab6c00f483888c049d0d8e7bc507e115dd86/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: b98aab6c00f483888c049d0d8e7bc507e115dd86 targets: smithi104.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGwtG9kkzPz1OTPhkI7ugiOt3KXAEm8B9YTmY0xsE2Seo45njjttxFXQQ6Qg7CHkNKhpmInrMPcMPDdB9TOfJTY= smithi134.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOh+qNKFEc4dxfDKB6ihDq0rYuatBqXSon1ACmd1T1PerUt3zh6hWsx1UaD901Pi1u5dqqYNVjdVEvbcQDtVwok= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-23_21:40:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-24T02:04:01.023 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_b98aab6c00f483888c049d0d8e7bc507e115dd86/qa; will attempt to use it 2024-04-24T02:04:01.024 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_b98aab6c00f483888c049d0d8e7bc507e115dd86/qa/tasks 2024-04-24T02:04:01.024 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-24T02:04:01.026 INFO:teuthology.task.internal:Checking packages... 2024-04-24T02:04:01.049 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b98aab6c00f483888c049d0d8e7bc507e115dd86' 2024-04-24T02:04:01.049 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-24T02:04:01.049 INFO:teuthology.packaging:ref: None 2024-04-24T02:04:01.049 INFO:teuthology.packaging:tag: None 2024-04-24T02:04:01.049 INFO:teuthology.packaging:branch: squid 2024-04-24T02:04:01.049 INFO:teuthology.packaging:sha1: b98aab6c00f483888c049d0d8e7bc507e115dd86 2024-04-24T02:04:01.049 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-04-24T02:04:01.263 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2424.gb98aab6c 2024-04-24T02:04:01.264 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-24T02:04:01.271 INFO:teuthology.task.internal:no buildpackages task found 2024-04-24T02:04:01.272 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-24T02:04:01.351 INFO:teuthology.task.internal:Saving configuration 2024-04-24T02:04:01.363 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-24T02:04:01.398 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-24T02:04:01.422 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi104.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-23_21:40:02-rgw-squid-distro-default-smithi/7670635', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-24 01:59:01.752544', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGwtG9kkzPz1OTPhkI7ugiOt3KXAEm8B9YTmY0xsE2Seo45njjttxFXQQ6Qg7CHkNKhpmInrMPcMPDdB9TOfJTY='} 2024-04-24T02:04:01.442 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-23_21:40:02-rgw-squid-distro-default-smithi/7670635', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-24 01:59:01.753944', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOh+qNKFEc4dxfDKB6ihDq0rYuatBqXSon1ACmd1T1PerUt3zh6hWsx1UaD901Pi1u5dqqYNVjdVEvbcQDtVwok='} 2024-04-24T02:04:01.442 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-24T02:04:01.449 INFO:teuthology.task.internal:roles: ubuntu@smithi104.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-04-24T02:04:01.449 INFO:teuthology.task.internal:roles: ubuntu@smithi134.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-04-24T02:04:01.449 INFO:teuthology.run_tasks:Running task console_log... 2024-04-24T02:04:01.540 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6516d7ee50>, signals=[15]) 2024-04-24T02:04:01.540 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-24T02:04:01.546 INFO:teuthology.task.internal:Opening connections... 2024-04-24T02:04:01.546 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi104.front.sepia.ceph.com 2024-04-24T02:04:01.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T02:04:01.623 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi134.front.sepia.ceph.com 2024-04-24T02:04:01.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T02:04:01.698 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-24T02:04:01.705 DEBUG:teuthology.orchestra.run.smithi104:> uname -m 2024-04-24T02:04:01.723 INFO:teuthology.orchestra.run.smithi104.stdout:x86_64 2024-04-24T02:04:01.723 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release 2024-04-24T02:04:01.780 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="CentOS Stream" 2024-04-24T02:04:01.780 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="9" 2024-04-24T02:04:01.781 INFO:teuthology.orchestra.run.smithi104.stdout:ID="centos" 2024-04-24T02:04:01.781 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE="rhel fedora" 2024-04-24T02:04:01.781 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="9" 2024-04-24T02:04:01.781 INFO:teuthology.orchestra.run.smithi104.stdout:PLATFORM_ID="platform:el9" 2024-04-24T02:04:01.781 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-24T02:04:01.781 INFO:teuthology.orchestra.run.smithi104.stdout:ANSI_COLOR="0;31" 2024-04-24T02:04:01.781 INFO:teuthology.orchestra.run.smithi104.stdout:LOGO="fedora-logo-icon" 2024-04-24T02:04:01.781 INFO:teuthology.orchestra.run.smithi104.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-24T02:04:01.781 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://centos.org/" 2024-04-24T02:04:01.781 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-24T02:04:01.781 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-24T02:04:01.781 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-24T02:04:01.782 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server 2024-04-24T02:04:01.809 DEBUG:teuthology.orchestra.run.smithi134:> uname -m 2024-04-24T02:04:01.827 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2024-04-24T02:04:01.827 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2024-04-24T02:04:01.884 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="CentOS Stream" 2024-04-24T02:04:01.884 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="9" 2024-04-24T02:04:01.884 INFO:teuthology.orchestra.run.smithi134.stdout:ID="centos" 2024-04-24T02:04:01.884 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="rhel fedora" 2024-04-24T02:04:01.884 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="9" 2024-04-24T02:04:01.884 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el9" 2024-04-24T02:04:01.884 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-24T02:04:01.884 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31" 2024-04-24T02:04:01.885 INFO:teuthology.orchestra.run.smithi134.stdout:LOGO="fedora-logo-icon" 2024-04-24T02:04:01.885 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-24T02:04:01.885 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://centos.org/" 2024-04-24T02:04:01.885 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-24T02:04:01.885 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-24T02:04:01.885 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-24T02:04:01.885 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2024-04-24T02:04:01.908 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-24T02:04:01.922 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-24T02:04:01.949 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-24T02:04:01.949 DEBUG:teuthology.orchestra.run.smithi104:> test '!' -e /home/ubuntu/cephtest 2024-04-24T02:04:01.952 DEBUG:teuthology.orchestra.run.smithi134:> test '!' -e /home/ubuntu/cephtest 2024-04-24T02:04:01.967 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-24T02:04:01.973 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-24T02:04:01.974 DEBUG:teuthology.orchestra.run.smithi104:> test -z $(ls -A /var/lib/ceph) 2024-04-24T02:04:02.009 DEBUG:teuthology.orchestra.run.smithi134:> test -z $(ls -A /var/lib/ceph) 2024-04-24T02:04:02.101 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-24T02:04:02.155 INFO:teuthology.run_tasks:Running task kernel... 2024-04-24T02:04:02.169 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-24T02:04:02.169 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-24T02:04:02.170 DEBUG:teuthology.orchestra.run.smithi104:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-24T02:04:02.170 DEBUG:teuthology.orchestra.run.smithi134:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-24T02:04:02.186 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T02:04:02.186 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2024-04-24T02:04:02.187 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T02:04:02.187 DEBUG:teuthology.orchestra.run.smithi104:> uname -r 2024-04-24T02:04:02.243 INFO:teuthology.orchestra.run.smithi134.stdout:5.14.0-437.el9.x86_64 2024-04-24T02:04:02.243 INFO:teuthology.task.kernel:Running kernel on smithi134: 5.14.0-437.el9.x86_64 2024-04-24T02:04:02.243 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum install -y kernel 2024-04-24T02:04:02.244 INFO:teuthology.orchestra.run.smithi104.stdout:5.14.0-437.el9.x86_64 2024-04-24T02:04:02.244 INFO:teuthology.task.kernel:Running kernel on smithi104: 5.14.0-437.el9.x86_64 2024-04-24T02:04:02.244 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum install -y kernel 2024-04-24T02:04:04.635 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.0 MB 00:00 2024-04-24T02:04:08.952 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - AppStream 5.9 MB/s | 19 MB 00:03 2024-04-24T02:04:13.524 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - BaseOS 859 kB/s | 8.0 MB 00:09 2024-04-24T02:04:13.802 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - CRB 5.1 MB/s | 6.2 MB 00:01 2024-04-24T02:04:16.731 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - Extras packages 11 kB/s | 16 kB 00:01 2024-04-24T02:04:18.365 INFO:teuthology.orchestra.run.smithi134.stdout:Extra Packages for Enterprise Linux 14 MB/s | 21 MB 00:01 2024-04-24T02:04:23.363 INFO:teuthology.orchestra.run.smithi134.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-04-24T02:04:25.227 INFO:teuthology.orchestra.run.smithi134.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-24T02:04:25.227 INFO:teuthology.orchestra.run.smithi134.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-24T02:04:25.308 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-24T02:04:25.309 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-04-24T02:04:25.309 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-24T02:04:25.437 DEBUG:teuthology.orchestra.run.smithi134:> echo no | sudo yum reinstall kernel || true 2024-04-24T02:04:25.938 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:00:02 ago on Wed 24 Apr 2024 02:04:23 AM UTC. 2024-04-24T02:04:26.057 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-24T02:04:26.069 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:04:26.069 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2024-04-24T02:04:26.069 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:04:26.069 INFO:teuthology.orchestra.run.smithi134.stdout:Reinstalling: 2024-04-24T02:04:26.069 INFO:teuthology.orchestra.run.smithi134.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-24T02:04:26.069 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:04:26.069 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-04-24T02:04:26.069 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:04:26.069 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:04:26.070 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 255 k 2024-04-24T02:04:26.070 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 0 2024-04-24T02:04:26.070 INFO:teuthology.orchestra.run.smithi134.stderr:Operation aborted. 2024-04-24T02:04:26.131 INFO:teuthology.orchestra.run.smithi134.stdout:Is this ok [y/N]: 2024-04-24T02:04:26.131 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum reinstall -y kernel || true 2024-04-24T02:04:26.620 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:00:03 ago on Wed 24 Apr 2024 02:04:23 AM UTC. 2024-04-24T02:04:26.735 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-24T02:04:26.736 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:04:26.736 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2024-04-24T02:04:26.736 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:04:26.736 INFO:teuthology.orchestra.run.smithi134.stdout:Reinstalling: 2024-04-24T02:04:26.736 INFO:teuthology.orchestra.run.smithi134.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-24T02:04:26.736 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:04:26.736 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-04-24T02:04:26.737 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:04:26.737 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:04:26.737 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 255 k 2024-04-24T02:04:26.737 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 0 2024-04-24T02:04:26.737 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-04-24T02:04:27.973 INFO:teuthology.orchestra.run.smithi134.stdout:kernel-5.14.0-437.el9.x86_64.rpm 269 kB/s | 255 kB 00:00 2024-04-24T02:04:27.973 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-04-24T02:04:27.973 INFO:teuthology.orchestra.run.smithi134.stdout:Total 206 kB/s | 255 kB 00:01 2024-04-24T02:04:27.993 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-04-24T02:04:28.185 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-04-24T02:04:28.185 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-04-24T02:04:28.190 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-04-24T02:04:28.190 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-04-24T02:04:28.321 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-04-24T02:04:28.391 INFO:teuthology.orchestra.run.smithi134.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-24T02:04:28.391 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-24T02:04:29.140 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-24T02:04:29.140 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-24T02:04:29.809 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-24T02:04:29.809 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:04:29.809 INFO:teuthology.orchestra.run.smithi134.stdout:Reinstalled: 2024-04-24T02:04:29.809 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-24T02:04:29.809 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:04:29.809 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-24T02:04:29.992 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q kernel | sort -rV | head -n 1 2024-04-24T02:04:30.039 INFO:teuthology.orchestra.run.smithi134.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-24T02:04:30.039 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-24T02:04:30.039 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-24T02:04:30.039 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-04-24T02:04:30.039 DEBUG:teuthology.orchestra.run.smithi134:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-24T02:04:30.065 INFO:teuthology.orchestra.run.smithi134.stdout:ttyS1 2024-04-24T02:04:30.087 DEBUG:teuthology.parallel:result is None 2024-04-24T02:04:36.904 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - AppStream 872 kB/s | 19 MB 00:22 2024-04-24T02:04:41.379 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - CRB 6.7 MB/s | 6.2 MB 00:00 2024-04-24T02:04:42.931 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 16 kB 00:00 2024-04-24T02:04:44.258 INFO:teuthology.orchestra.run.smithi104.stdout:Extra Packages for Enterprise Linux 17 MB/s | 21 MB 00:01 2024-04-24T02:04:49.230 INFO:teuthology.orchestra.run.smithi104.stdout:lab-extras 38 kB/s | 1.7 kB 00:00 2024-04-24T02:04:51.053 INFO:teuthology.orchestra.run.smithi104.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-24T02:04:51.053 INFO:teuthology.orchestra.run.smithi104.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-24T02:04:51.140 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-04-24T02:04:51.141 INFO:teuthology.orchestra.run.smithi104.stdout:Nothing to do. 2024-04-24T02:04:51.141 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-04-24T02:04:51.255 DEBUG:teuthology.orchestra.run.smithi104:> echo no | sudo yum reinstall kernel || true 2024-04-24T02:04:51.750 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:00:02 ago on Wed 24 Apr 2024 02:04:49 AM UTC. 2024-04-24T02:04:51.870 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-04-24T02:04:51.881 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:04:51.881 INFO:teuthology.orchestra.run.smithi104.stdout: Package Architecture Version Repository Size 2024-04-24T02:04:51.881 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:04:51.881 INFO:teuthology.orchestra.run.smithi104.stdout:Reinstalling: 2024-04-24T02:04:51.881 INFO:teuthology.orchestra.run.smithi104.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-24T02:04:51.881 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:04:51.881 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-04-24T02:04:51.881 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:04:51.881 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:04:51.881 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 255 k 2024-04-24T02:04:51.881 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 0 2024-04-24T02:04:51.881 INFO:teuthology.orchestra.run.smithi104.stderr:Operation aborted. 2024-04-24T02:04:51.939 INFO:teuthology.orchestra.run.smithi104.stdout:Is this ok [y/N]: 2024-04-24T02:04:51.939 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum reinstall -y kernel || true 2024-04-24T02:04:52.429 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:00:03 ago on Wed 24 Apr 2024 02:04:49 AM UTC. 2024-04-24T02:04:52.544 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-04-24T02:04:52.544 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:04:52.544 INFO:teuthology.orchestra.run.smithi104.stdout: Package Architecture Version Repository Size 2024-04-24T02:04:52.544 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:04:52.545 INFO:teuthology.orchestra.run.smithi104.stdout:Reinstalling: 2024-04-24T02:04:52.545 INFO:teuthology.orchestra.run.smithi104.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-24T02:04:52.545 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:04:52.545 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-04-24T02:04:52.545 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:04:52.545 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:04:52.545 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 255 k 2024-04-24T02:04:52.545 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 0 2024-04-24T02:04:52.545 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-04-24T02:04:52.932 INFO:teuthology.orchestra.run.smithi104.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.0 MB/s | 255 kB 00:00 2024-04-24T02:04:52.933 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-04-24T02:04:52.933 INFO:teuthology.orchestra.run.smithi104.stdout:Total 658 kB/s | 255 kB 00:00 2024-04-24T02:04:52.949 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-04-24T02:04:53.141 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-04-24T02:04:53.141 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-04-24T02:04:53.146 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-04-24T02:04:53.147 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-04-24T02:04:53.284 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-04-24T02:04:53.341 INFO:teuthology.orchestra.run.smithi104.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-24T02:04:53.342 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-24T02:04:53.968 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-24T02:04:53.968 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-24T02:04:54.691 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-24T02:04:54.691 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:04:54.691 INFO:teuthology.orchestra.run.smithi104.stdout:Reinstalled: 2024-04-24T02:04:54.691 INFO:teuthology.orchestra.run.smithi104.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-24T02:04:54.691 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:04:54.691 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-04-24T02:04:54.879 DEBUG:teuthology.orchestra.run.smithi104:> rpm -q kernel | sort -rV | head -n 1 2024-04-24T02:04:54.925 INFO:teuthology.orchestra.run.smithi104.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-24T02:04:54.926 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-24T02:04:54.926 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-24T02:04:54.926 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-24T02:04:54.926 DEBUG:teuthology.orchestra.run.smithi104:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-24T02:04:54.958 INFO:teuthology.orchestra.run.smithi104.stdout:ttyS1 2024-04-24T02:04:54.984 DEBUG:teuthology.parallel:result is None 2024-04-24T02:04:54.984 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-24T02:04:54.994 INFO:teuthology.task.internal:Creating test directory... 2024-04-24T02:04:54.995 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-24T02:04:55.027 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-24T02:04:55.046 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-24T02:04:55.053 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-24T02:04:55.115 INFO:teuthology.task.internal:Creating archive directory... 2024-04-24T02:04:55.116 DEBUG:teuthology.orchestra.run.smithi104:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-24T02:04:55.118 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-24T02:04:55.230 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-24T02:04:55.237 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-24T02:04:55.237 DEBUG:teuthology.orchestra.run.smithi104:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-24T02:04:55.240 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-24T02:04:55.271 INFO:teuthology.orchestra.run.smithi104.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-24T02:04:55.280 INFO:teuthology.orchestra.run.smithi104.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-24T02:04:55.288 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-24T02:04:55.300 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-24T02:04:55.301 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-24T02:04:55.309 INFO:teuthology.task.internal:Configuring sudo... 2024-04-24T02:04:55.309 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-24T02:04:55.324 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-24T02:04:55.351 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-24T02:04:55.360 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-24T02:04:55.360 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-24T02:04:55.388 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-24T02:04:55.408 DEBUG:teuthology.orchestra.run.smithi104:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-24T02:04:55.477 DEBUG:teuthology.orchestra.run.smithi104:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-24T02:04:55.535 DEBUG:teuthology.orchestra.run.smithi104:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-24T02:04:55.617 DEBUG:teuthology.orchestra.run.smithi104:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-24T02:04:55.654 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-24T02:04:55.655 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-24T02:04:55.718 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-24T02:04:55.762 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-24T02:04:55.813 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-24T02:04:55.897 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-24T02:04:55.938 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-24T02:04:55.938 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-24T02:04:56.004 DEBUG:teuthology.orchestra.run.smithi104:> sudo service rsyslog restart 2024-04-24T02:04:56.006 DEBUG:teuthology.orchestra.run.smithi134:> sudo service rsyslog restart 2024-04-24T02:04:56.035 INFO:teuthology.orchestra.run.smithi104.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-24T02:04:56.092 INFO:teuthology.orchestra.run.smithi134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-24T02:04:56.576 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-24T02:04:56.585 INFO:teuthology.task.internal:Starting timer... 2024-04-24T02:04:56.585 INFO:teuthology.run_tasks:Running task pcp... 2024-04-24T02:04:56.646 INFO:teuthology.run_tasks:Running task selinux... 2024-04-24T02:04:56.688 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-24T02:04:56.689 DEBUG:teuthology.orchestra.run.smithi104:> sudo service auditd rotate 2024-04-24T02:04:56.752 INFO:teuthology.orchestra.run.smithi104.stdout:Rotating logs: 2024-04-24T02:04:56.754 DEBUG:teuthology.orchestra.run.smithi134:> sudo service auditd rotate 2024-04-24T02:04:56.827 INFO:teuthology.orchestra.run.smithi134.stdout:Rotating logs: 2024-04-24T02:04:56.829 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-24T02:04:56.829 DEBUG:teuthology.orchestra.run.smithi104:> /usr/sbin/getenforce 2024-04-24T02:04:56.851 INFO:teuthology.orchestra.run.smithi104.stdout:Permissive 2024-04-24T02:04:56.851 DEBUG:teuthology.orchestra.run.smithi134:> /usr/sbin/getenforce 2024-04-24T02:04:56.870 INFO:teuthology.orchestra.run.smithi134.stdout:Permissive 2024-04-24T02:04:56.870 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi104.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi134.front.sepia.ceph.com': 'permissive'} 2024-04-24T02:04:56.871 DEBUG:teuthology.orchestra.run.smithi104:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-24T02:04:56.914 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T02:04:56.915 DEBUG:teuthology.orchestra.run.smithi134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-24T02:04:56.941 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T02:04:56.941 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-24T02:04:56.941 DEBUG:teuthology.orchestra.run.smithi104:> sudo /usr/sbin/setenforce permissive 2024-04-24T02:04:56.995 DEBUG:teuthology.orchestra.run.smithi134:> sudo /usr/sbin/setenforce permissive 2024-04-24T02:04:57.020 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-24T02:04:57.030 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-24T02:04:57.046 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-24T02:04:57.047 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi104.front.sepia.ceph.com,smithi134.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-24T02:08:24.824 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi104.front.sepia.ceph.com'), Remote(name='ubuntu@smithi134.front.sepia.ceph.com')] 2024-04-24T02:08:24.825 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-04-24T02:08:24.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T02:08:24.902 DEBUG:teuthology.orchestra.run.smithi104:> true 2024-04-24T02:08:24.982 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-04-24T02:08:24.982 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-04-24T02:08:24.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T02:08:25.058 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-04-24T02:08:25.138 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-04-24T02:08:25.138 INFO:teuthology.run_tasks:Running task clock... 2024-04-24T02:08:25.148 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-24T02:08:25.148 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-24T02:08:25.149 DEBUG:teuthology.orchestra.run.smithi104:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-24T02:08:25.151 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-24T02:08:25.151 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-24T02:08:25.177 INFO:teuthology.orchestra.run.smithi104.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-24T02:08:25.191 INFO:teuthology.orchestra.run.smithi104.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-24T02:08:25.207 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-24T02:08:25.218 INFO:teuthology.orchestra.run.smithi104.stderr:sudo: ntpd: command not found 2024-04-24T02:08:25.221 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-24T02:08:25.226 INFO:teuthology.orchestra.run.smithi104.stdout:506 Cannot talk to daemon 2024-04-24T02:08:25.239 INFO:teuthology.orchestra.run.smithi104.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-24T02:08:25.244 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: ntpd: command not found 2024-04-24T02:08:25.253 INFO:teuthology.orchestra.run.smithi104.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-24T02:08:25.254 INFO:teuthology.orchestra.run.smithi134.stdout:506 Cannot talk to daemon 2024-04-24T02:08:25.268 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-24T02:08:25.280 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-24T02:08:25.317 INFO:teuthology.orchestra.run.smithi104.stderr:bash: line 1: ntpq: command not found 2024-04-24T02:08:25.320 INFO:teuthology.orchestra.run.smithi104.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-24T02:08:25.320 INFO:teuthology.orchestra.run.smithi104.stdout:=============================================================================== 2024-04-24T02:08:25.320 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T02:08:25.320 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T02:08:25.320 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T02:08:25.320 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T02:08:25.335 INFO:teuthology.orchestra.run.smithi134.stderr:bash: line 1: ntpq: command not found 2024-04-24T02:08:25.338 INFO:teuthology.orchestra.run.smithi134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-24T02:08:25.338 INFO:teuthology.orchestra.run.smithi134.stdout:=============================================================================== 2024-04-24T02:08:25.338 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T02:08:25.338 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T02:08:25.338 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T02:08:25.338 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T02:08:25.339 INFO:teuthology.run_tasks:Running task install... 2024-04-24T02:08:25.347 DEBUG:teuthology.task.install:project ceph 2024-04-24T02:08:25.347 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b98aab6c00f483888c049d0d8e7bc507e115dd86'}} 2024-04-24T02:08:25.347 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'b98aab6c00f483888c049d0d8e7bc507e115dd86'} 2024-04-24T02:08:25.348 INFO:teuthology.task.install:Using flavor: default 2024-04-24T02:08:25.353 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-24T02:08:25.353 INFO:teuthology.task.install:extra packages: [] 2024-04-24T02:08:25.354 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b98aab6c00f483888c049d0d8e7bc507e115dd86', 'tag': None, 'wait_for_package': False} 2024-04-24T02:08:25.354 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b98aab6c00f483888c049d0d8e7bc507e115dd86 2024-04-24T02:08:25.356 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b98aab6c00f483888c049d0d8e7bc507e115dd86', 'tag': None, 'wait_for_package': False} 2024-04-24T02:08:25.356 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b98aab6c00f483888c049d0d8e7bc507e115dd86 2024-04-24T02:08:25.500 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/b98aab6c00f483888c049d0d8e7bc507e115dd86/centos/9/flavors/default/ 2024-04-24T02:08:25.500 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2424.gb98aab6c 2024-04-24T02:08:25.585 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/b98aab6c00f483888c049d0d8e7bc507e115dd86/centos/9/flavors/default/ 2024-04-24T02:08:25.586 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2424.gb98aab6c 2024-04-24T02:08:25.611 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/b98aab6c00f483888c049d0d8e7bc507e115dd86/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/b98aab6c00f483888c049d0d8e7bc507e115dd86/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/b98aab6c00f483888c049d0d8e7bc507e115dd86/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-24T02:08:25.611 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-24T02:08:25.611 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-24T02:08:25.643 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-24T02:08:25.644 DEBUG:teuthology.orchestra.run.smithi134:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b98aab6c00f483888c049d0d8e7bc507e115dd86/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-24T02:08:25.694 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/b98aab6c00f483888c049d0d8e7bc507e115dd86/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/b98aab6c00f483888c049d0d8e7bc507e115dd86/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/b98aab6c00f483888c049d0d8e7bc507e115dd86/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-24T02:08:25.694 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-24T02:08:25.694 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-24T02:08:25.707 DEBUG:teuthology.orchestra.run.smithi134:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-24T02:08:25.719 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-24T02:08:25.719 DEBUG:teuthology.orchestra.run.smithi104:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b98aab6c00f483888c049d0d8e7bc507e115dd86/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-24T02:08:25.779 DEBUG:teuthology.orchestra.run.smithi134:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-24T02:08:25.784 DEBUG:teuthology.orchestra.run.smithi104:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-24T02:08:25.842 INFO:teuthology.orchestra.run.smithi134.stdout:check_obsoletes = 1 2024-04-24T02:08:25.844 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum clean all 2024-04-24T02:08:25.857 DEBUG:teuthology.orchestra.run.smithi104:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-24T02:08:25.920 INFO:teuthology.orchestra.run.smithi104.stdout:check_obsoletes = 1 2024-04-24T02:08:25.921 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum clean all 2024-04-24T02:08:26.071 INFO:teuthology.orchestra.run.smithi134.stdout:48 files removed 2024-04-24T02:08:26.098 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-radosgw 2024-04-24T02:08:26.144 INFO:teuthology.orchestra.run.smithi104.stdout:48 files removed 2024-04-24T02:08:26.170 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install ceph-radosgw 2024-04-24T02:08:26.813 INFO:teuthology.orchestra.run.smithi104.stdout:ceph packages for x86_64 215 kB/s | 83 kB 00:00 2024-04-24T02:08:26.842 INFO:teuthology.orchestra.run.smithi134.stdout:ceph packages for x86_64 171 kB/s | 83 kB 00:00 2024-04-24T02:08:27.172 INFO:teuthology.orchestra.run.smithi104.stdout:ceph noarch packages 37 kB/s | 11 kB 00:00 2024-04-24T02:08:27.201 INFO:teuthology.orchestra.run.smithi134.stdout:ceph noarch packages 37 kB/s | 11 kB 00:00 2024-04-24T02:08:27.581 INFO:teuthology.orchestra.run.smithi104.stdout:ceph source packages 5.0 kB/s | 1.9 kB 00:00 2024-04-24T02:08:27.610 INFO:teuthology.orchestra.run.smithi134.stdout:ceph source packages 5.0 kB/s | 1.9 kB 00:00 2024-04-24T02:08:29.077 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - BaseOS 5.6 MB/s | 8.0 MB 00:01 2024-04-24T02:08:36.530 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - BaseOS 924 kB/s | 8.0 MB 00:08 2024-04-24T02:08:40.089 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - AppStream 7.6 MB/s | 19 MB 00:02 2024-04-24T02:08:44.923 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - CRB 4.9 MB/s | 6.2 MB 00:01 2024-04-24T02:08:46.482 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - Extras packages 37 kB/s | 16 kB 00:00 2024-04-24T02:08:47.508 INFO:teuthology.orchestra.run.smithi104.stdout:Extra Packages for Enterprise Linux 23 MB/s | 21 MB 00:00 2024-04-24T02:08:52.284 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - AppStream 880 kB/s | 19 MB 00:22 2024-04-24T02:08:52.540 INFO:teuthology.orchestra.run.smithi104.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-04-24T02:08:54.673 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-04-24T02:08:54.676 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:08:54.676 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repository Size 2024-04-24T02:08:54.676 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:08:54.676 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-04-24T02:08:54.676 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-radosgw x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 10 M 2024-04-24T02:08:54.676 INFO:teuthology.orchestra.run.smithi104.stdout:Upgrading: 2024-04-24T02:08:54.676 INFO:teuthology.orchestra.run.smithi104.stdout: librados2 x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 3.4 M 2024-04-24T02:08:54.676 INFO:teuthology.orchestra.run.smithi104.stdout: librbd1 x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 3.1 M 2024-04-24T02:08:54.677 INFO:teuthology.orchestra.run.smithi104.stdout:Installing dependencies: 2024-04-24T02:08:54.677 INFO:teuthology.orchestra.run.smithi104.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-24T02:08:54.677 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-base x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 5.4 M 2024-04-24T02:08:54.677 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-common x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 21 M 2024-04-24T02:08:54.677 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-selinux x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 25 k 2024-04-24T02:08:54.677 INFO:teuthology.orchestra.run.smithi104.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-24T02:08:54.677 INFO:teuthology.orchestra.run.smithi104.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-24T02:08:54.677 INFO:teuthology.orchestra.run.smithi104.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-24T02:08:54.677 INFO:teuthology.orchestra.run.smithi104.stdout: libcephfs2 x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 745 k 2024-04-24T02:08:54.677 INFO:teuthology.orchestra.run.smithi104.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-24T02:08:54.677 INFO:teuthology.orchestra.run.smithi104.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-24T02:08:54.677 INFO:teuthology.orchestra.run.smithi104.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-24T02:08:54.677 INFO:teuthology.orchestra.run.smithi104.stdout: libradosstriper1 x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 501 k 2024-04-24T02:08:54.678 INFO:teuthology.orchestra.run.smithi104.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-24T02:08:54.678 INFO:teuthology.orchestra.run.smithi104.stdout: librgw2 x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 5.3 M 2024-04-24T02:08:54.678 INFO:teuthology.orchestra.run.smithi104.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-24T02:08:54.678 INFO:teuthology.orchestra.run.smithi104.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-24T02:08:54.678 INFO:teuthology.orchestra.run.smithi104.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-24T02:08:54.678 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-argparse x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 45 k 2024-04-24T02:08:54.678 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-common x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 133 k 2024-04-24T02:08:54.678 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cephfs x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 162 k 2024-04-24T02:08:54.678 INFO:teuthology.orchestra.run.smithi104.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-24T02:08:54.678 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rados x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 321 k 2024-04-24T02:08:54.678 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rbd x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 299 k 2024-04-24T02:08:54.678 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rgw x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 99 k 2024-04-24T02:08:54.678 INFO:teuthology.orchestra.run.smithi104.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-24T02:08:54.679 INFO:teuthology.orchestra.run.smithi104.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-24T02:08:54.679 INFO:teuthology.orchestra.run.smithi104.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-24T02:08:54.679 INFO:teuthology.orchestra.run.smithi104.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-24T02:08:54.679 INFO:teuthology.orchestra.run.smithi104.stdout:Installing weak dependencies: 2024-04-24T02:08:54.679 INFO:teuthology.orchestra.run.smithi104.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-24T02:08:54.679 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:08:54.679 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-04-24T02:08:54.679 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:08:54.679 INFO:teuthology.orchestra.run.smithi104.stdout:Install 30 Packages 2024-04-24T02:08:54.679 INFO:teuthology.orchestra.run.smithi104.stdout:Upgrade 2 Packages 2024-04-24T02:08:54.679 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:08:54.680 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 60 M 2024-04-24T02:08:54.680 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-04-24T02:08:56.141 INFO:teuthology.orchestra.run.smithi104.stdout:(1/32): ceph-base-19.0.0-2424.gb98aab6c.el9.x86 5.7 MB/s | 5.4 MB 00:00 2024-04-24T02:08:56.258 INFO:teuthology.orchestra.run.smithi104.stdout:(2/32): ceph-selinux-19.0.0-2424.gb98aab6c.el9. 216 kB/s | 25 kB 00:00 2024-04-24T02:08:56.642 INFO:teuthology.orchestra.run.smithi104.stdout:(3/32): libcephfs2-19.0.0-2424.gb98aab6c.el9.x8 1.9 MB/s | 745 kB 00:00 2024-04-24T02:08:56.808 INFO:teuthology.orchestra.run.smithi104.stdout:(4/32): ceph-radosgw-19.0.0-2424.gb98aab6c.el9. 6.3 MB/s | 10 MB 00:01 2024-04-24T02:08:56.834 INFO:teuthology.orchestra.run.smithi104.stdout:(5/32): libradosstriper1-19.0.0-2424.gb98aab6c. 2.6 MB/s | 501 kB 00:00 2024-04-24T02:08:57.267 INFO:teuthology.orchestra.run.smithi104.stdout:(6/32): ceph-common-19.0.0-2424.gb98aab6c.el9.x 10 MB/s | 21 MB 00:02 2024-04-24T02:08:57.301 INFO:teuthology.orchestra.run.smithi104.stdout:(7/32): python3-ceph-argparse-19.0.0-2424.gb98a 97 kB/s | 45 kB 00:00 2024-04-24T02:08:57.334 INFO:teuthology.orchestra.run.smithi104.stdout:(8/32): python3-ceph-common-19.0.0-2424.gb98aab 1.9 MB/s | 133 kB 00:00 2024-04-24T02:08:57.385 INFO:teuthology.orchestra.run.smithi104.stdout:(9/32): python3-cephfs-19.0.0-2424.gb98aab6c.el 1.9 MB/s | 162 kB 00:00 2024-04-24T02:08:57.410 INFO:teuthology.orchestra.run.smithi104.stdout:(10/32): python3-rados-19.0.0-2424.gb98aab6c.el 4.2 MB/s | 321 kB 00:00 2024-04-24T02:08:57.477 INFO:teuthology.orchestra.run.smithi104.stdout:(11/32): python3-rbd-19.0.0-2424.gb98aab6c.el9. 3.2 MB/s | 299 kB 00:00 2024-04-24T02:08:57.502 INFO:teuthology.orchestra.run.smithi104.stdout:(12/32): python3-rgw-19.0.0-2424.gb98aab6c.el9. 1.1 MB/s | 99 kB 00:00 2024-04-24T02:08:57.652 INFO:teuthology.orchestra.run.smithi104.stdout:(13/32): librgw2-19.0.0-2424.gb98aab6c.el9.x86_ 6.3 MB/s | 5.3 MB 00:00 2024-04-24T02:08:57.761 INFO:teuthology.orchestra.run.smithi104.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 376 kB/s | 107 kB 00:00 2024-04-24T02:08:57.786 INFO:teuthology.orchestra.run.smithi104.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 339 kB/s | 45 kB 00:00 2024-04-24T02:08:57.811 INFO:teuthology.orchestra.run.smithi104.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 518 kB/s | 160 kB 00:00 2024-04-24T02:08:57.862 INFO:teuthology.orchestra.run.smithi104.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 845 kB/s | 42 kB 00:00 2024-04-24T02:08:57.904 INFO:teuthology.orchestra.run.smithi104.stdout:(18/32): librdkafka-1.6.1-102.el9.x86_64.rpm 4.5 MB/s | 662 kB 00:00 2024-04-24T02:08:57.929 INFO:teuthology.orchestra.run.smithi104.stdout:(19/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.0 MB/s | 292 kB 00:00 2024-04-24T02:08:57.954 INFO:teuthology.orchestra.run.smithi104.stdout:(20/32): qatlib-24.02.0-1.el9.x86_64.rpm 2.3 MB/s | 221 kB 00:00 2024-04-24T02:08:57.979 INFO:teuthology.orchestra.run.smithi104.stdout:(21/32): qatlib-service-24.02.0-1.el9.x86_64.rp 476 kB/s | 36 kB 00:00 2024-04-24T02:08:58.005 INFO:teuthology.orchestra.run.smithi104.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 629 kB/s | 47 kB 00:00 2024-04-24T02:08:58.188 INFO:teuthology.orchestra.run.smithi104.stdout:(23/32): libarrow-doc-9.0.0-10.el9.noarch.rpm 197 kB/s | 26 kB 00:00 2024-04-24T02:08:58.230 INFO:teuthology.orchestra.run.smithi104.stdout:(24/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.1 MB/s | 309 kB 00:00 2024-04-24T02:08:58.255 INFO:teuthology.orchestra.run.smithi104.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 729 kB/s | 49 kB 00:00 2024-04-24T02:08:58.281 INFO:teuthology.orchestra.run.smithi104.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-04-24T02:08:58.339 INFO:teuthology.orchestra.run.smithi104.stdout:(27/32): re2-20211101-3.el9.x86_64.rpm 3.2 MB/s | 192 kB 00:00 2024-04-24T02:08:58.448 INFO:teuthology.orchestra.run.smithi104.stdout:(28/32): parquet-libs-9.0.0-10.el9.x86_64.rpm 4.3 MB/s | 838 kB 00:00 2024-04-24T02:08:58.665 INFO:teuthology.orchestra.run.smithi104.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 4.9 MB/s | 1.6 MB 00:00 2024-04-24T02:08:58.874 INFO:teuthology.orchestra.run.smithi104.stdout:(30/32): librados2-19.0.0-2424.gb98aab6c.el9.x8 8.0 MB/s | 3.4 MB 00:00 2024-04-24T02:08:58.999 INFO:teuthology.orchestra.run.smithi104.stdout:(31/32): libarrow-9.0.0-10.el9.x86_64.rpm 4.3 MB/s | 4.4 MB 00:01 2024-04-24T02:08:59.082 INFO:teuthology.orchestra.run.smithi104.stdout:(32/32): librbd1-19.0.0-2424.gb98aab6c.el9.x86_ 7.5 MB/s | 3.1 MB 00:00 2024-04-24T02:08:59.087 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-04-24T02:08:59.087 INFO:teuthology.orchestra.run.smithi104.stdout:Total 14 MB/s | 60 MB 00:04 2024-04-24T02:08:59.183 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-04-24T02:08:59.219 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-04-24T02:08:59.220 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-04-24T02:08:59.684 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-04-24T02:08:59.684 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-04-24T02:09:01.177 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-04-24T02:09:01.266 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-04-24T02:09:01.295 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-04-24T02:09:01.320 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-04-24T02:09:01.343 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-04-24T02:09:01.367 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-04-24T02:09:01.526 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-04-24T02:09:01.590 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-04-24T02:09:01.917 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-04-24T02:09:02.031 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : librados2-2:19.0.0-2424.gb98aab6c.el9.x86_64 7/34 2024-04-24T02:09:02.121 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librados2-2:19.0.0-2424.gb98aab6c.el9.x86_64 7/34 2024-04-24T02:09:02.209 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-rados-2:19.0.0-2424.gb98aab6c.el9.x86_64 8/34 2024-04-24T02:09:02.240 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libcephfs2-2:19.0.0-2424.gb98aab6c.el9.x86_64 9/34 2024-04-24T02:09:02.303 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libcephfs2-2:19.0.0-2424.gb98aab6c.el9.x86_64 9/34 2024-04-24T02:09:02.331 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-04-24T02:09:02.366 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-ceph-argparse-2:19.0.0-2424.gb98aab6c.el9. 11/34 2024-04-24T02:09:02.435 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cephfs-2:19.0.0-2424.gb98aab6c.el9.x86_64 12/34 2024-04-24T02:09:02.459 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libradosstriper1-2:19.0.0-2424.gb98aab6c.el9.x86_6 13/34 2024-04-24T02:09:02.523 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2424.gb98aab6c.el9.x86_6 13/34 2024-04-24T02:09:02.557 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-04-24T02:09:02.665 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-04-24T02:09:02.740 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 16/34 2024-04-24T02:09:02.907 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-04-24T02:09:02.932 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-04-24T02:09:02.977 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 19/34 2024-04-24T02:09:03.010 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-04-24T02:09:03.320 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-04-24T02:09:03.364 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : librbd1-2:19.0.0-2424.gb98aab6c.el9.x86_64 22/34 2024-04-24T02:09:03.438 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librbd1-2:19.0.0-2424.gb98aab6c.el9.x86_64 22/34 2024-04-24T02:09:03.469 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-rbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 23/34 2024-04-24T02:09:03.504 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-04-24T02:09:03.973 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 25/34 2024-04-24T02:09:04.000 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : librgw2-2:19.0.0-2424.gb98aab6c.el9.x86_64 26/34 2024-04-24T02:09:04.054 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librgw2-2:19.0.0-2424.gb98aab6c.el9.x86_64 26/34 2024-04-24T02:09:04.124 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-rgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 27/34 2024-04-24T02:09:04.154 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-ceph-common-2:19.0.0-2424.gb98aab6c.el9.x8 28/34 2024-04-24T02:09:04.317 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - CRB 750 kB/s | 6.2 MB 00:08 2024-04-24T02:09:06.421 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-common-2:19.0.0-2424.gb98aab6c.el9.x86_64 29/34 2024-04-24T02:09:06.475 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-common-2:19.0.0-2424.gb98aab6c.el9.x86_64 29/34 2024-04-24T02:09:07.012 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-common-2:19.0.0-2424.gb98aab6c.el9.x86_64 29/34 2024-04-24T02:09:07.045 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-base-2:19.0.0-2424.gb98aab6c.el9.x86_64 30/34 2024-04-24T02:09:07.140 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-base-2:19.0.0-2424.gb98aab6c.el9.x86_64 30/34 2024-04-24T02:09:07.140 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-24T02:09:07.140 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-24T02:09:07.140 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:09:07.171 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-selinux-2:19.0.0-2424.gb98aab6c.el9.x86_64 31/34 2024-04-24T02:09:07.670 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - Extras packages 7.3 kB/s | 16 kB 00:02 2024-04-24T02:09:09.472 INFO:teuthology.orchestra.run.smithi134.stdout:Extra Packages for Enterprise Linux 12 MB/s | 21 MB 00:01 2024-04-24T02:09:14.494 INFO:teuthology.orchestra.run.smithi134.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-04-24T02:09:16.593 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2424.gb98aab6c.el9.x86_64 31/34 2024-04-24T02:09:16.593 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /sys 2024-04-24T02:09:16.593 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /proc 2024-04-24T02:09:16.593 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /mnt 2024-04-24T02:09:16.593 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /var/tmp 2024-04-24T02:09:16.593 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /home 2024-04-24T02:09:16.593 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /root 2024-04-24T02:09:16.593 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /tmp 2024-04-24T02:09:16.593 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:09:16.670 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-24T02:09:16.672 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:09:16.672 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-04-24T02:09:16.672 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:09:16.673 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-04-24T02:09:16.673 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 10 M 2024-04-24T02:09:16.673 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrading: 2024-04-24T02:09:16.673 INFO:teuthology.orchestra.run.smithi134.stdout: librados2 x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 3.4 M 2024-04-24T02:09:16.673 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1 x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 3.1 M 2024-04-24T02:09:16.673 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-04-24T02:09:16.673 INFO:teuthology.orchestra.run.smithi134.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-24T02:09:16.673 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 5.4 M 2024-04-24T02:09:16.673 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 21 M 2024-04-24T02:09:16.673 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 25 k 2024-04-24T02:09:16.673 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-24T02:09:16.673 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-24T02:09:16.673 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-24T02:09:16.673 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2 x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 745 k 2024-04-24T02:09:16.674 INFO:teuthology.orchestra.run.smithi134.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-24T02:09:16.674 INFO:teuthology.orchestra.run.smithi134.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-24T02:09:16.674 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-24T02:09:16.674 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1 x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 501 k 2024-04-24T02:09:16.674 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-24T02:09:16.674 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2 x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 5.3 M 2024-04-24T02:09:16.674 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-24T02:09:16.674 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-24T02:09:16.674 INFO:teuthology.orchestra.run.smithi134.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-24T02:09:16.674 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 45 k 2024-04-24T02:09:16.674 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 133 k 2024-04-24T02:09:16.674 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 162 k 2024-04-24T02:09:16.674 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-24T02:09:16.674 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 321 k 2024-04-24T02:09:16.675 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 299 k 2024-04-24T02:09:16.675 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 99 k 2024-04-24T02:09:16.675 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-24T02:09:16.675 INFO:teuthology.orchestra.run.smithi134.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-24T02:09:16.675 INFO:teuthology.orchestra.run.smithi134.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-24T02:09:16.675 INFO:teuthology.orchestra.run.smithi134.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-24T02:09:16.675 INFO:teuthology.orchestra.run.smithi134.stdout:Installing weak dependencies: 2024-04-24T02:09:16.675 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-24T02:09:16.675 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:09:16.675 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-04-24T02:09:16.675 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:09:16.675 INFO:teuthology.orchestra.run.smithi134.stdout:Install 30 Packages 2024-04-24T02:09:16.675 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrade 2 Packages 2024-04-24T02:09:16.675 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:09:16.676 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 60 M 2024-04-24T02:09:16.676 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-04-24T02:09:17.528 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-radosgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 32/34 2024-04-24T02:09:17.556 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 32/34 2024-04-24T02:09:17.556 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T02:09:17.556 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-24T02:09:17.556 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-24T02:09:17.556 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-24T02:09:17.557 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:09:17.558 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-24T02:09:17.647 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-24T02:09:17.648 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-24T02:09:18.387 INFO:teuthology.orchestra.run.smithi134.stdout:(1/32): ceph-common-19.0.0-2424.gb98aab6c.el9.x 15 MB/s | 21 MB 00:01 2024-04-24T02:09:18.437 INFO:teuthology.orchestra.run.smithi134.stdout:(2/32): ceph-selinux-19.0.0-2424.gb98aab6c.el9. 508 kB/s | 25 kB 00:00 2024-04-24T02:09:18.512 INFO:teuthology.orchestra.run.smithi134.stdout:(3/32): ceph-base-19.0.0-2424.gb98aab6c.el9.x86 3.4 MB/s | 5.4 MB 00:01 2024-04-24T02:09:18.546 INFO:teuthology.orchestra.run.smithi134.stdout:(4/32): libcephfs2-19.0.0-2424.gb98aab6c.el9.x8 6.7 MB/s | 745 kB 00:00 2024-04-24T02:09:18.596 INFO:teuthology.orchestra.run.smithi134.stdout:(5/32): libradosstriper1-19.0.0-2424.gb98aab6c. 5.9 MB/s | 501 kB 00:00 2024-04-24T02:09:18.696 INFO:teuthology.orchestra.run.smithi134.stdout:(6/32): python3-ceph-argparse-19.0.0-2424.gb98a 451 kB/s | 45 kB 00:00 2024-04-24T02:09:18.797 INFO:teuthology.orchestra.run.smithi134.stdout:(7/32): python3-ceph-common-19.0.0-2424.gb98aab 1.3 MB/s | 133 kB 00:00 2024-04-24T02:09:18.826 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-24T02:09:18.827 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-base-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/34 2024-04-24T02:09:18.827 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-common-2:19.0.0-2424.gb98aab6c.el9.x86_64 2/34 2024-04-24T02:09:18.827 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-radosgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 3/34 2024-04-24T02:09:18.827 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-selinux-2:19.0.0-2424.gb98aab6c.el9.x86_64 4/34 2024-04-24T02:09:18.827 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libcephfs2-2:19.0.0-2424.gb98aab6c.el9.x86_64 5/34 2024-04-24T02:09:18.827 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libradosstriper1-2:19.0.0-2424.gb98aab6c.el9.x86_6 6/34 2024-04-24T02:09:18.827 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librgw2-2:19.0.0-2424.gb98aab6c.el9.x86_64 7/34 2024-04-24T02:09:18.827 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2424.gb98aab6c.el9. 8/34 2024-04-24T02:09:18.827 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-ceph-common-2:19.0.0-2424.gb98aab6c.el9.x8 9/34 2024-04-24T02:09:18.827 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cephfs-2:19.0.0-2424.gb98aab6c.el9.x86_64 10/34 2024-04-24T02:09:18.827 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-rados-2:19.0.0-2424.gb98aab6c.el9.x86_64 11/34 2024-04-24T02:09:18.827 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-rbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 12/34 2024-04-24T02:09:18.827 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-rgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 13/34 2024-04-24T02:09:18.827 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-04-24T02:09:18.828 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-04-24T02:09:18.828 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-04-24T02:09:18.828 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-04-24T02:09:18.828 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-04-24T02:09:18.828 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-04-24T02:09:18.828 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-04-24T02:09:18.828 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-04-24T02:09:18.828 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-04-24T02:09:18.828 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-04-24T02:09:18.828 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 24/34 2024-04-24T02:09:18.828 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 25/34 2024-04-24T02:09:18.828 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-04-24T02:09:18.828 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-04-24T02:09:18.828 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 28/34 2024-04-24T02:09:18.828 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-04-24T02:09:18.828 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-04-24T02:09:18.829 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librados2-2:19.0.0-2424.gb98aab6c.el9.x86_64 31/34 2024-04-24T02:09:18.829 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-04-24T02:09:18.829 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librbd1-2:19.0.0-2424.gb98aab6c.el9.x86_64 33/34 2024-04-24T02:09:18.872 INFO:teuthology.orchestra.run.smithi134.stdout:(8/32): librgw2-19.0.0-2424.gb98aab6c.el9.x86_6 16 MB/s | 5.3 MB 00:00 2024-04-24T02:09:18.899 INFO:teuthology.orchestra.run.smithi134.stdout:(9/32): python3-cephfs-19.0.0-2424.gb98aab6c.el 1.5 MB/s | 162 kB 00:00 2024-04-24T02:09:18.925 INFO:teuthology.orchestra.run.smithi134.stdout:(10/32): python3-rados-19.0.0-2424.gb98aab6c.el 6.0 MB/s | 321 kB 00:00 2024-04-24T02:09:18.983 INFO:teuthology.orchestra.run.smithi134.stdout:(11/32): python3-rbd-19.0.0-2424.gb98aab6c.el9. 3.5 MB/s | 299 kB 00:00 2024-04-24T02:09:19.008 INFO:teuthology.orchestra.run.smithi134.stdout:(12/32): python3-rgw-19.0.0-2424.gb98aab6c.el9. 1.2 MB/s | 99 kB 00:00 2024-04-24T02:09:19.100 INFO:teuthology.orchestra.run.smithi134.stdout:(13/32): boost-program-options-1.75.0-8.el9.x86 915 kB/s | 107 kB 00:00 2024-04-24T02:09:19.142 INFO:teuthology.orchestra.run.smithi134.stdout:(14/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-04-24T02:09:19.167 INFO:teuthology.orchestra.run.smithi134.stdout:(15/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.0 MB/s | 160 kB 00:00 2024-04-24T02:09:19.285 INFO:teuthology.orchestra.run.smithi134.stdout:(16/32): ceph-radosgw-19.0.0-2424.gb98aab6c.el9 4.4 MB/s | 10 MB 00:02 2024-04-24T02:09:19.310 INFO:teuthology.orchestra.run.smithi134.stdout:(17/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.0 MB/s | 292 kB 00:00 2024-04-24T02:09:19.343 INFO:teuthology.orchestra.run.smithi134.stdout:(18/32): librdkafka-1.6.1-102.el9.x86_64.rpm 3.2 MB/s | 662 kB 00:00 2024-04-24T02:09:19.369 INFO:teuthology.orchestra.run.smithi134.stdout:(19/32): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-04-24T02:09:19.402 INFO:teuthology.orchestra.run.smithi134.stdout:(20/32): python3-prettytable-0.7.2-27.el9.noarc 361 kB/s | 42 kB 00:00 2024-04-24T02:09:19.428 INFO:teuthology.orchestra.run.smithi134.stdout:(21/32): qatlib-service-24.02.0-1.el9.x86_64.rp 428 kB/s | 36 kB 00:00 2024-04-24T02:09:19.453 INFO:teuthology.orchestra.run.smithi134.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 565 kB/s | 47 kB 00:00 2024-04-24T02:09:19.642 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-04-24T02:09:19.642 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:09:19.642 INFO:teuthology.orchestra.run.smithi104.stdout:Upgraded: 2024-04-24T02:09:19.642 INFO:teuthology.orchestra.run.smithi104.stdout: librados2-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:09:19.642 INFO:teuthology.orchestra.run.smithi104.stdout: librbd1-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:09:19.642 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-04-24T02:09:19.642 INFO:teuthology.orchestra.run.smithi104.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-24T02:09:19.642 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-base-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:09:19.642 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-common-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:09:19.642 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-radosgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:09:19.642 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-selinux-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:09:19.642 INFO:teuthology.orchestra.run.smithi104.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-24T02:09:19.643 INFO:teuthology.orchestra.run.smithi104.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-24T02:09:19.643 INFO:teuthology.orchestra.run.smithi104.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-24T02:09:19.643 INFO:teuthology.orchestra.run.smithi104.stdout: libcephfs2-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:09:19.643 INFO:teuthology.orchestra.run.smithi104.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-24T02:09:19.643 INFO:teuthology.orchestra.run.smithi104.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-24T02:09:19.643 INFO:teuthology.orchestra.run.smithi104.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-24T02:09:19.643 INFO:teuthology.orchestra.run.smithi104.stdout: libradosstriper1-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:09:19.643 INFO:teuthology.orchestra.run.smithi104.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-24T02:09:19.643 INFO:teuthology.orchestra.run.smithi104.stdout: librgw2-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:09:19.643 INFO:teuthology.orchestra.run.smithi104.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-24T02:09:19.643 INFO:teuthology.orchestra.run.smithi104.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-24T02:09:19.643 INFO:teuthology.orchestra.run.smithi104.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-24T02:09:19.643 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-argparse-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:09:19.643 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-common-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:09:19.644 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cephfs-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:09:19.644 INFO:teuthology.orchestra.run.smithi104.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-24T02:09:19.644 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rados-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:09:19.644 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:09:19.644 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:09:19.644 INFO:teuthology.orchestra.run.smithi104.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-24T02:09:19.644 INFO:teuthology.orchestra.run.smithi104.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-24T02:09:19.644 INFO:teuthology.orchestra.run.smithi104.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-24T02:09:19.644 INFO:teuthology.orchestra.run.smithi104.stdout: re2-1:20211101-3.el9.x86_64 2024-04-24T02:09:19.644 INFO:teuthology.orchestra.run.smithi104.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-24T02:09:19.644 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:09:19.644 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-04-24T02:09:19.728 INFO:teuthology.orchestra.run.smithi134.stdout:(23/32): libarrow-doc-9.0.0-10.el9.noarch.rpm 94 kB/s | 26 kB 00:00 2024-04-24T02:09:19.778 INFO:teuthology.orchestra.run.smithi134.stdout:(24/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 822 kB/s | 309 kB 00:00 2024-04-24T02:09:19.804 INFO:teuthology.orchestra.run.smithi134.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 645 kB/s | 49 kB 00:00 2024-04-24T02:09:19.829 INFO:teuthology.orchestra.run.smithi134.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-04-24T02:09:19.888 INFO:teuthology.orchestra.run.smithi134.stdout:(27/32): parquet-libs-9.0.0-10.el9.x86_64.rpm 9.9 MB/s | 838 kB 00:00 2024-04-24T02:09:19.923 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install ceph-test 2024-04-24T02:09:19.955 INFO:teuthology.orchestra.run.smithi134.stdout:(28/32): libarrow-9.0.0-10.el9.x86_64.rpm 8.4 MB/s | 4.4 MB 00:00 2024-04-24T02:09:19.980 INFO:teuthology.orchestra.run.smithi134.stdout:(29/32): re2-20211101-3.el9.x86_64.rpm 1.3 MB/s | 192 kB 00:00 2024-04-24T02:09:20.022 INFO:teuthology.orchestra.run.smithi134.stdout:(30/32): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-04-24T02:09:20.230 INFO:teuthology.orchestra.run.smithi134.stdout:(31/32): librbd1-19.0.0-2424.gb98aab6c.el9.x86_ 13 MB/s | 3.1 MB 00:00 2024-04-24T02:09:20.450 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:00:28 ago on Wed 24 Apr 2024 02:08:52 AM UTC. 2024-04-24T02:09:20.530 INFO:teuthology.orchestra.run.smithi134.stdout:(32/32): librados2-19.0.0-2424.gb98aab6c.el9.x8 6.2 MB/s | 3.4 MB 00:00 2024-04-24T02:09:20.536 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-04-24T02:09:20.536 INFO:teuthology.orchestra.run.smithi134.stdout:Total 15 MB/s | 60 MB 00:03 2024-04-24T02:09:20.572 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-04-24T02:09:20.572 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:09:20.572 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repository Size 2024-04-24T02:09:20.572 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:09:20.573 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-04-24T02:09:20.573 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-test x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 48 M 2024-04-24T02:09:20.573 INFO:teuthology.orchestra.run.smithi104.stdout:Installing dependencies: 2024-04-24T02:09:20.573 INFO:teuthology.orchestra.run.smithi104.stdout: libcephsqlite x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 163 k 2024-04-24T02:09:20.573 INFO:teuthology.orchestra.run.smithi104.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-24T02:09:20.573 INFO:teuthology.orchestra.run.smithi104.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-24T02:09:20.573 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:09:20.573 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-04-24T02:09:20.573 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:09:20.573 INFO:teuthology.orchestra.run.smithi104.stdout:Install 4 Packages 2024-04-24T02:09:20.573 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:09:20.574 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 49 M 2024-04-24T02:09:20.574 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 207 M 2024-04-24T02:09:20.574 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-04-24T02:09:20.633 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-04-24T02:09:20.669 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-04-24T02:09:20.669 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-04-24T02:09:21.137 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-04-24T02:09:21.138 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-04-24T02:09:21.240 INFO:teuthology.orchestra.run.smithi104.stdout:(1/4): libcephsqlite-19.0.0-2424.gb98aab6c.el9. 415 kB/s | 163 kB 00:00 2024-04-24T02:09:21.442 INFO:teuthology.orchestra.run.smithi104.stdout:(2/4): socat-1.7.4.1-5.el9.x86_64.rpm 512 kB/s | 305 kB 00:00 2024-04-24T02:09:21.610 INFO:teuthology.orchestra.run.smithi104.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 172 kB/s | 64 kB 00:00 2024-04-24T02:09:22.594 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-04-24T02:09:22.698 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-04-24T02:09:22.730 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-04-24T02:09:22.753 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-04-24T02:09:22.775 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-04-24T02:09:22.798 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-04-24T02:09:22.992 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-04-24T02:09:23.046 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-04-24T02:09:23.423 INFO:teuthology.orchestra.run.smithi104.stdout:(4/4): ceph-test-19.0.0-2424.gb98aab6c.el9.x86_ 19 MB/s | 48 MB 00:02 2024-04-24T02:09:23.424 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-04-24T02:09:23.425 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-04-24T02:09:23.425 INFO:teuthology.orchestra.run.smithi104.stdout:Total 17 MB/s | 49 MB 00:02 2024-04-24T02:09:23.451 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-04-24T02:09:23.471 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librados2-2:19.0.0-2424.gb98aab6c.el9.x86_64 7/34 2024-04-24T02:09:23.471 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-04-24T02:09:23.471 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-04-24T02:09:23.546 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-2:19.0.0-2424.gb98aab6c.el9.x86_64 7/34 2024-04-24T02:09:23.632 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rados-2:19.0.0-2424.gb98aab6c.el9.x86_64 8/34 2024-04-24T02:09:23.655 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs2-2:19.0.0-2424.gb98aab6c.el9.x86_64 9/34 2024-04-24T02:09:23.718 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephfs2-2:19.0.0-2424.gb98aab6c.el9.x86_64 9/34 2024-04-24T02:09:23.746 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-04-24T02:09:23.790 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-argparse-2:19.0.0-2424.gb98aab6c.el9. 11/34 2024-04-24T02:09:23.835 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-04-24T02:09:23.836 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-04-24T02:09:23.858 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cephfs-2:19.0.0-2424.gb98aab6c.el9.x86_64 12/34 2024-04-24T02:09:23.883 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libradosstriper1-2:19.0.0-2424.gb98aab6c.el9.x86_6 13/34 2024-04-24T02:09:23.930 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2424.gb98aab6c.el9.x86_6 13/34 2024-04-24T02:09:23.964 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-04-24T02:09:24.071 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-04-24T02:09:24.098 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 16/34 2024-04-24T02:09:24.138 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-04-24T02:09:24.164 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-04-24T02:09:24.193 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 19/34 2024-04-24T02:09:24.225 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-04-24T02:09:24.353 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-04-24T02:09:24.431 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-04-24T02:09:24.481 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-04-24T02:09:24.508 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libcephsqlite-2:19.0.0-2424.gb98aab6c.el9.x86_64 3/4 2024-04-24T02:09:24.540 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-04-24T02:09:24.581 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librbd1-2:19.0.0-2424.gb98aab6c.el9.x86_64 22/34 2024-04-24T02:09:24.671 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-2:19.0.0-2424.gb98aab6c.el9.x86_64 22/34 2024-04-24T02:09:24.702 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 23/34 2024-04-24T02:09:24.737 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-04-24T02:09:25.218 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 25/34 2024-04-24T02:09:25.383 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librgw2-2:19.0.0-2424.gb98aab6c.el9.x86_64 26/34 2024-04-24T02:09:25.438 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librgw2-2:19.0.0-2424.gb98aab6c.el9.x86_64 26/34 2024-04-24T02:09:25.516 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 27/34 2024-04-24T02:09:25.552 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-common-2:19.0.0-2424.gb98aab6c.el9.x8 28/34 2024-04-24T02:09:27.784 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:19.0.0-2424.gb98aab6c.el9.x86_64 29/34 2024-04-24T02:09:27.923 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-common-2:19.0.0-2424.gb98aab6c.el9.x86_64 29/34 2024-04-24T02:09:28.471 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:19.0.0-2424.gb98aab6c.el9.x86_64 29/34 2024-04-24T02:09:28.510 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-base-2:19.0.0-2424.gb98aab6c.el9.x86_64 30/34 2024-04-24T02:09:28.602 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-base-2:19.0.0-2424.gb98aab6c.el9.x86_64 30/34 2024-04-24T02:09:28.602 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-24T02:09:28.602 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-24T02:09:28.602 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:09:28.636 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-selinux-2:19.0.0-2424.gb98aab6c.el9.x86_64 31/34 2024-04-24T02:09:29.019 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2424.gb98aab6c.el9.x86_64 3/4 2024-04-24T02:09:29.312 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-test-2:19.0.0-2424.gb98aab6c.el9.x86_64 4/4 2024-04-24T02:09:31.651 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-test-2:19.0.0-2424.gb98aab6c.el9.x86_64 4/4 2024-04-24T02:09:31.651 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-test-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/4 2024-04-24T02:09:31.651 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libcephsqlite-2:19.0.0-2424.gb98aab6c.el9.x86_64 2/4 2024-04-24T02:09:31.651 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-04-24T02:09:31.907 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-04-24T02:09:31.907 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:09:31.908 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-04-24T02:09:31.908 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-test-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:09:31.908 INFO:teuthology.orchestra.run.smithi104.stdout: libcephsqlite-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:09:31.908 INFO:teuthology.orchestra.run.smithi104.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-24T02:09:31.908 INFO:teuthology.orchestra.run.smithi104.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-24T02:09:31.908 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:09:31.908 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-04-24T02:09:32.168 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install ceph 2024-04-24T02:09:32.693 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:00:40 ago on Wed 24 Apr 2024 02:08:52 AM UTC. 2024-04-24T02:09:32.828 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-04-24T02:09:32.831 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:09:32.831 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repository Size 2024-04-24T02:09:32.831 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:09:32.831 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-04-24T02:09:32.831 INFO:teuthology.orchestra.run.smithi104.stdout: ceph x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 6.6 k 2024-04-24T02:09:32.831 INFO:teuthology.orchestra.run.smithi104.stdout:Installing dependencies: 2024-04-24T02:09:32.831 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mds x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 2.4 M 2024-04-24T02:09:32.831 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 1.5 M 2024-04-24T02:09:32.831 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 249 k 2024-04-24T02:09:32.831 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mon x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 4.7 M 2024-04-24T02:09:32.831 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-osd x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 17 M 2024-04-24T02:09:32.831 INFO:teuthology.orchestra.run.smithi104.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-24T02:09:32.832 INFO:teuthology.orchestra.run.smithi104.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-24T02:09:32.832 INFO:teuthology.orchestra.run.smithi104.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-24T02:09:32.832 INFO:teuthology.orchestra.run.smithi104.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-24T02:09:32.832 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-24T02:09:32.832 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-24T02:09:32.832 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-24T02:09:32.832 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-24T02:09:32.832 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-24T02:09:32.832 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-24T02:09:32.832 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-collections 2024-04-24T02:09:32.832 INFO:teuthology.orchestra.run.smithi104.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-04-24T02:09:32.832 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-24T02:09:32.832 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-24T02:09:32.833 INFO:teuthology.orchestra.run.smithi104.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-24T02:09:32.833 INFO:teuthology.orchestra.run.smithi104.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-24T02:09:32.833 INFO:teuthology.orchestra.run.smithi104.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-24T02:09:32.833 INFO:teuthology.orchestra.run.smithi104.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-24T02:09:32.833 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-24T02:09:32.833 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-24T02:09:32.833 INFO:teuthology.orchestra.run.smithi104.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-24T02:09:32.833 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-24T02:09:32.833 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-24T02:09:32.833 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-24T02:09:32.833 INFO:teuthology.orchestra.run.smithi104.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-24T02:09:32.833 INFO:teuthology.orchestra.run.smithi104.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-24T02:09:32.833 INFO:teuthology.orchestra.run.smithi104.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-24T02:09:32.833 INFO:teuthology.orchestra.run.smithi104.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-24T02:09:32.833 INFO:teuthology.orchestra.run.smithi104.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-24T02:09:32.834 INFO:teuthology.orchestra.run.smithi104.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-24T02:09:32.834 INFO:teuthology.orchestra.run.smithi104.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-24T02:09:32.834 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:09:32.834 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-04-24T02:09:32.834 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:09:32.834 INFO:teuthology.orchestra.run.smithi104.stdout:Install 36 Packages 2024-04-24T02:09:32.834 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:09:32.835 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 30 M 2024-04-24T02:09:32.835 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 107 M 2024-04-24T02:09:32.835 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-04-24T02:09:33.764 INFO:teuthology.orchestra.run.smithi104.stdout:(1/36): ceph-19.0.0-2424.gb98aab6c.el9.x86_64.r 25 kB/s | 6.6 kB 00:00 2024-04-24T02:09:33.856 INFO:teuthology.orchestra.run.smithi104.stdout:(2/36): ceph-mgr-19.0.0-2424.gb98aab6c.el9.x86_ 4.2 MB/s | 1.5 MB 00:00 2024-04-24T02:09:34.698 INFO:teuthology.orchestra.run.smithi104.stdout:(3/36): ceph-mds-19.0.0-2424.gb98aab6c.el9.x86_ 2.0 MB/s | 2.4 MB 00:01 2024-04-24T02:09:34.882 INFO:teuthology.orchestra.run.smithi104.stdout:(4/36): ceph-osd-19.0.0-2424.gb98aab6c.el9.x86_ 16 MB/s | 17 MB 00:01 2024-04-24T02:09:34.940 INFO:teuthology.orchestra.run.smithi104.stdout:(5/36): ceph-mon-19.0.0-2424.gb98aab6c.el9.x86_ 4.0 MB/s | 4.7 MB 00:01 2024-04-24T02:09:34.965 INFO:teuthology.orchestra.run.smithi104.stdout:(6/36): ceph-mgr-modules-core-19.0.0-2424.gb98a 931 kB/s | 249 kB 00:00 2024-04-24T02:09:35.724 INFO:teuthology.orchestra.run.smithi104.stdout:(7/36): python3-ply-3.11-14.el9.noarch.rpm 140 kB/s | 106 kB 00:00 2024-04-24T02:09:35.858 INFO:teuthology.orchestra.run.smithi104.stdout:(8/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 260 kB/s | 253 kB 00:00 2024-04-24T02:09:36.483 INFO:teuthology.orchestra.run.smithi104.stdout:(9/36): python3-pycparser-2.20-6.el9.noarch.rpm 178 kB/s | 135 kB 00:00 2024-04-24T02:09:36.624 INFO:teuthology.orchestra.run.smithi104.stdout:(10/36): python3-requests-2.25.1-8.el9.noarch.r 163 kB/s | 125 kB 00:00 2024-04-24T02:09:36.883 INFO:teuthology.orchestra.run.smithi104.stdout:(11/36): lua-5.4.4-4.el9.x86_64.rpm 730 kB/s | 188 kB 00:00 2024-04-24T02:09:37.000 INFO:teuthology.orchestra.run.smithi104.stdout:(12/36): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-04-24T02:09:37.051 INFO:teuthology.orchestra.run.smithi104.stdout:(13/36): python3-cryptography-36.0.1-4.el9.x86_ 595 kB/s | 1.2 MB 00:02 2024-04-24T02:09:37.101 INFO:teuthology.orchestra.run.smithi104.stdout:(14/36): python3-markupsafe-1.1.1-12.el9.x86_64 347 kB/s | 35 kB 00:00 2024-04-24T02:09:37.159 INFO:teuthology.orchestra.run.smithi104.stdout:(15/36): python3-pytz-2021.1-5.el9.noarch.rpm 471 kB/s | 51 kB 00:00 2024-04-24T02:09:37.360 INFO:teuthology.orchestra.run.smithi104.stdout:(16/36): python3-urllib3-1.26.5-5.el9.noarch.rp 245 kB/s | 215 kB 00:00 2024-04-24T02:09:37.384 INFO:teuthology.orchestra.run.smithi104.stdout:(17/36): python3-toml-0.10.2-6.el9.noarch.rpm 147 kB/s | 42 kB 00:00 2024-04-24T02:09:37.727 INFO:teuthology.orchestra.run.smithi104.stdout:(18/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 138 kB/s | 43 kB 00:00 2024-04-24T02:09:37.752 INFO:teuthology.orchestra.run.smithi104.stdout:(19/36): lua-devel-5.4.4-4.el9.x86_64.rpm 38 kB/s | 22 kB 00:00 2024-04-24T02:09:37.885 INFO:teuthology.orchestra.run.smithi104.stdout:(20/36): luarocks-3.9.2-1.el9.noarch.rpm 287 kB/s | 151 kB 00:00 2024-04-24T02:09:37.986 INFO:teuthology.orchestra.run.smithi104.stdout:(21/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 666 kB/s | 172 kB 00:00 2024-04-24T02:09:37.999 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2424.gb98aab6c.el9.x86_64 31/34 2024-04-24T02:09:37.999 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /sys 2024-04-24T02:09:37.999 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /proc 2024-04-24T02:09:37.999 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /mnt 2024-04-24T02:09:37.999 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /var/tmp 2024-04-24T02:09:37.999 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /home 2024-04-24T02:09:37.999 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /root 2024-04-24T02:09:37.999 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /tmp 2024-04-24T02:09:37.999 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:09:38.011 INFO:teuthology.orchestra.run.smithi104.stdout:(22/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 85 kB/s | 11 kB 00:00 2024-04-24T02:09:38.102 INFO:teuthology.orchestra.run.smithi104.stdout:(23/36): python3-jaraco-classes-3.2.1-5.el9.noa 151 kB/s | 18 kB 00:00 2024-04-24T02:09:38.128 INFO:teuthology.orchestra.run.smithi104.stdout:(24/36): python3-jaraco-collections-3.0.0-8.el9 198 kB/s | 23 kB 00:00 2024-04-24T02:09:38.220 INFO:teuthology.orchestra.run.smithi104.stdout:(25/36): python3-jaraco-functools-3.5.0-2.el9.n 166 kB/s | 19 kB 00:00 2024-04-24T02:09:38.245 INFO:teuthology.orchestra.run.smithi104.stdout:(26/36): python3-jaraco-text-3.2.0-6.el9.noarch 168 kB/s | 20 kB 00:00 2024-04-24T02:09:38.345 INFO:teuthology.orchestra.run.smithi104.stdout:(27/36): python3-logutils-0.3.5-21.el9.noarch.r 370 kB/s | 46 kB 00:00 2024-04-24T02:09:38.371 INFO:teuthology.orchestra.run.smithi104.stdout:(28/36): python3-more-itertools-8.12.0-2.el9.no 629 kB/s | 79 kB 00:00 2024-04-24T02:09:38.438 INFO:teuthology.orchestra.run.smithi104.stdout:(29/36): python3-cherrypy-18.6.1-2.el9.noarch.r 523 kB/s | 358 kB 00:00 2024-04-24T02:09:38.463 INFO:teuthology.orchestra.run.smithi104.stdout:(30/36): python3-portend-3.1.0-2.el9.noarch.rpm 179 kB/s | 16 kB 00:00 2024-04-24T02:09:38.546 INFO:teuthology.orchestra.run.smithi104.stdout:(31/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 829 kB/s | 90 kB 00:00 2024-04-24T02:09:38.588 INFO:teuthology.orchestra.run.smithi104.stdout:(32/36): python3-tempora-5.0.0-2.el9.noarch.rpm 286 kB/s | 36 kB 00:00 2024-04-24T02:09:38.647 INFO:teuthology.orchestra.run.smithi104.stdout:(33/36): python3-pecan-1.4.2-3.el9.noarch.rpm 904 kB/s | 272 kB 00:00 2024-04-24T02:09:38.764 INFO:teuthology.orchestra.run.smithi104.stdout:(34/36): python3-zc-lockfile-2.0-10.el9.noarch. 171 kB/s | 20 kB 00:00 2024-04-24T02:09:38.814 INFO:teuthology.orchestra.run.smithi104.stdout:(35/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 1.9 MB/s | 427 kB 00:00 2024-04-24T02:09:38.856 INFO:teuthology.orchestra.run.smithi104.stdout:(36/36): python3-webob-1.8.7-6.el9.noarch.rpm 743 kB/s | 230 kB 00:00 2024-04-24T02:09:38.858 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-04-24T02:09:38.859 INFO:teuthology.orchestra.run.smithi104.stdout:Total 5.0 MB/s | 30 MB 00:06 2024-04-24T02:09:38.960 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-radosgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 32/34 2024-04-24T02:09:38.985 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 32/34 2024-04-24T02:09:38.985 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T02:09:38.985 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-24T02:09:38.985 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-24T02:09:38.985 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-24T02:09:38.985 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:09:38.987 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-24T02:09:38.997 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-04-24T02:09:39.037 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-04-24T02:09:39.037 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-04-24T02:09:39.071 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-24T02:09:39.071 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-24T02:09:39.331 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-04-24T02:09:39.332 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-04-24T02:09:40.272 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-24T02:09:40.272 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-base-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/34 2024-04-24T02:09:40.272 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-common-2:19.0.0-2424.gb98aab6c.el9.x86_64 2/34 2024-04-24T02:09:40.272 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-radosgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 3/34 2024-04-24T02:09:40.272 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-selinux-2:19.0.0-2424.gb98aab6c.el9.x86_64 4/34 2024-04-24T02:09:40.272 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs2-2:19.0.0-2424.gb98aab6c.el9.x86_64 5/34 2024-04-24T02:09:40.273 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libradosstriper1-2:19.0.0-2424.gb98aab6c.el9.x86_6 6/34 2024-04-24T02:09:40.273 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librgw2-2:19.0.0-2424.gb98aab6c.el9.x86_64 7/34 2024-04-24T02:09:40.273 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2424.gb98aab6c.el9. 8/34 2024-04-24T02:09:40.273 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-common-2:19.0.0-2424.gb98aab6c.el9.x8 9/34 2024-04-24T02:09:40.273 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cephfs-2:19.0.0-2424.gb98aab6c.el9.x86_64 10/34 2024-04-24T02:09:40.273 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rados-2:19.0.0-2424.gb98aab6c.el9.x86_64 11/34 2024-04-24T02:09:40.273 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 12/34 2024-04-24T02:09:40.273 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 13/34 2024-04-24T02:09:40.273 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-04-24T02:09:40.273 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-04-24T02:09:40.273 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-04-24T02:09:40.273 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-04-24T02:09:40.274 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-04-24T02:09:40.274 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-04-24T02:09:40.274 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-04-24T02:09:40.274 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-04-24T02:09:40.274 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-04-24T02:09:40.274 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-04-24T02:09:40.274 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 24/34 2024-04-24T02:09:40.274 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 25/34 2024-04-24T02:09:40.274 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-04-24T02:09:40.274 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-04-24T02:09:40.274 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 28/34 2024-04-24T02:09:40.274 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-04-24T02:09:40.275 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-04-24T02:09:40.275 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-2:19.0.0-2424.gb98aab6c.el9.x86_64 31/34 2024-04-24T02:09:40.275 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-04-24T02:09:40.275 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-2:19.0.0-2424.gb98aab6c.el9.x86_64 33/34 2024-04-24T02:09:40.581 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-04-24T02:09:40.633 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-04-24T02:09:40.666 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-04-24T02:09:40.694 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-04-24T02:09:40.766 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-04-24T02:09:40.818 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-04-24T02:09:40.850 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-04-24T02:09:40.943 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-04-24T02:09:41.020 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-04-24T02:09:41.028 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-04-24T02:09:41.028 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:09:41.028 INFO:teuthology.orchestra.run.smithi134.stdout:Upgraded: 2024-04-24T02:09:41.029 INFO:teuthology.orchestra.run.smithi134.stdout: librados2-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:09:41.029 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:09:41.029 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-04-24T02:09:41.029 INFO:teuthology.orchestra.run.smithi134.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-24T02:09:41.029 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:09:41.029 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:09:41.029 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:09:41.029 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:09:41.029 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-24T02:09:41.029 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-24T02:09:41.029 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-24T02:09:41.029 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:09:41.029 INFO:teuthology.orchestra.run.smithi134.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-24T02:09:41.029 INFO:teuthology.orchestra.run.smithi134.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-24T02:09:41.030 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-24T02:09:41.030 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:09:41.030 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-24T02:09:41.030 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:09:41.030 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-24T02:09:41.030 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-24T02:09:41.030 INFO:teuthology.orchestra.run.smithi134.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-24T02:09:41.030 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:09:41.030 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:09:41.030 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:09:41.030 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-24T02:09:41.030 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:09:41.030 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:09:41.030 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:09:41.031 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-24T02:09:41.031 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-24T02:09:41.031 INFO:teuthology.orchestra.run.smithi134.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-24T02:09:41.031 INFO:teuthology.orchestra.run.smithi134.stdout: re2-1:20211101-3.el9.x86_64 2024-04-24T02:09:41.031 INFO:teuthology.orchestra.run.smithi134.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-24T02:09:41.031 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:09:41.031 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-24T02:09:41.061 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-04-24T02:09:41.096 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-04-24T02:09:41.126 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/36 2024-04-24T02:09:41.161 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/36 2024-04-24T02:09:41.194 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/36 2024-04-24T02:09:41.234 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/36 2024-04-24T02:09:41.278 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/36 2024-04-24T02:09:41.312 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/36 2024-04-24T02:09:41.350 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/36 2024-04-24T02:09:41.359 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-test 2024-04-24T02:09:41.423 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/36 2024-04-24T02:09:41.569 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 19/36 2024-04-24T02:09:41.650 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 20/36 2024-04-24T02:09:41.703 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 21/36 2024-04-24T02:09:41.741 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 22/36 2024-04-24T02:09:41.790 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-ply-3.11-14.el9.noarch 23/36 2024-04-24T02:09:41.854 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 24/36 2024-04-24T02:09:41.889 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:00:27 ago on Wed 24 Apr 2024 02:09:14 AM UTC. 2024-04-24T02:09:42.013 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-24T02:09:42.013 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:09:42.013 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-04-24T02:09:42.013 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:09:42.014 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-04-24T02:09:42.014 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 48 M 2024-04-24T02:09:42.014 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-04-24T02:09:42.014 INFO:teuthology.orchestra.run.smithi134.stdout: libcephsqlite x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 163 k 2024-04-24T02:09:42.014 INFO:teuthology.orchestra.run.smithi134.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-24T02:09:42.014 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-24T02:09:42.014 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:09:42.014 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-04-24T02:09:42.014 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:09:42.014 INFO:teuthology.orchestra.run.smithi134.stdout:Install 4 Packages 2024-04-24T02:09:42.014 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:09:42.015 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 49 M 2024-04-24T02:09:42.015 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 207 M 2024-04-24T02:09:42.015 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-04-24T02:09:42.049 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 25/36 2024-04-24T02:09:42.104 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 26/36 2024-04-24T02:09:42.182 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 27/36 2024-04-24T02:09:42.270 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 28/36 2024-04-24T02:09:42.311 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 29/36 2024-04-24T02:09:42.372 INFO:teuthology.orchestra.run.smithi134.stdout:(1/4): socat-1.7.4.1-5.el9.x86_64.rpm 1.5 MB/s | 305 kB 00:00 2024-04-24T02:09:42.427 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 30/36 2024-04-24T02:09:42.431 INFO:teuthology.orchestra.run.smithi134.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-04-24T02:09:42.566 INFO:teuthology.orchestra.run.smithi134.stdout:(3/4): libcephsqlite-19.0.0-2424.gb98aab6c.el9. 414 kB/s | 163 kB 00:00 2024-04-24T02:09:42.602 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2424.gb98aab6c.el9. 31/36 2024-04-24T02:09:42.629 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-2:19.0.0-2424.gb98aab6c.el9.x86_64 32/36 2024-04-24T02:09:42.654 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2424.gb98aab6c.el9.x86_64 32/36 2024-04-24T02:09:42.654 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T02:09:42.654 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-24T02:09:42.654 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-24T02:09:42.654 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-24T02:09:42.654 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:09:44.105 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-osd-2:19.0.0-2424.gb98aab6c.el9.x86_64 33/36 2024-04-24T02:09:44.132 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-osd-2:19.0.0-2424.gb98aab6c.el9.x86_64 33/36 2024-04-24T02:09:44.132 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T02:09:44.132 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-24T02:09:44.132 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-24T02:09:44.132 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-24T02:09:44.133 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:09:44.566 INFO:teuthology.orchestra.run.smithi134.stdout:(4/4): ceph-test-19.0.0-2424.gb98aab6c.el9.x86_ 20 MB/s | 48 MB 00:02 2024-04-24T02:09:44.569 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-04-24T02:09:44.569 INFO:teuthology.orchestra.run.smithi134.stdout:Total 19 MB/s | 49 MB 00:02 2024-04-24T02:09:44.572 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mon-2:19.0.0-2424.gb98aab6c.el9.x86_64 34/36 2024-04-24T02:09:44.594 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mon-2:19.0.0-2424.gb98aab6c.el9.x86_64 34/36 2024-04-24T02:09:44.594 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T02:09:44.595 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-24T02:09:44.595 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-24T02:09:44.595 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-24T02:09:44.595 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:09:44.596 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-04-24T02:09:44.616 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-04-24T02:09:44.616 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-04-24T02:09:44.823 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mds-2:19.0.0-2424.gb98aab6c.el9.x86_64 35/36 2024-04-24T02:09:44.845 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mds-2:19.0.0-2424.gb98aab6c.el9.x86_64 35/36 2024-04-24T02:09:44.846 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T02:09:44.846 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-24T02:09:44.846 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-24T02:09:44.846 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-24T02:09:44.846 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:09:44.926 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-2:19.0.0-2424.gb98aab6c.el9.x86_64 36/36 2024-04-24T02:09:44.981 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-04-24T02:09:44.982 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-04-24T02:09:45.496 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-04-24T02:09:45.584 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-04-24T02:09:45.623 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-04-24T02:09:45.643 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephsqlite-2:19.0.0-2424.gb98aab6c.el9.x86_64 3/4 2024-04-24T02:09:46.708 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-2:19.0.0-2424.gb98aab6c.el9.x86_64 36/36 2024-04-24T02:09:46.708 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/36 2024-04-24T02:09:46.708 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mds-2:19.0.0-2424.gb98aab6c.el9.x86_64 2/36 2024-04-24T02:09:46.708 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-2:19.0.0-2424.gb98aab6c.el9.x86_64 3/36 2024-04-24T02:09:46.708 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mon-2:19.0.0-2424.gb98aab6c.el9.x86_64 4/36 2024-04-24T02:09:46.708 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-osd-2:19.0.0-2424.gb98aab6c.el9.x86_64 5/36 2024-04-24T02:09:46.708 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2424.gb98aab6c.el9. 6/36 2024-04-24T02:09:46.709 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/36 2024-04-24T02:09:46.709 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/36 2024-04-24T02:09:46.709 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/36 2024-04-24T02:09:46.709 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/36 2024-04-24T02:09:46.709 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/36 2024-04-24T02:09:46.709 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/36 2024-04-24T02:09:46.709 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/36 2024-04-24T02:09:46.709 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/36 2024-04-24T02:09:46.709 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/36 2024-04-24T02:09:46.709 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/36 2024-04-24T02:09:46.709 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/36 2024-04-24T02:09:46.709 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-04-24T02:09:46.709 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-04-24T02:09:46.709 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-04-24T02:09:46.709 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-04-24T02:09:46.710 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-04-24T02:09:46.710 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-04-24T02:09:46.710 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-04-24T02:09:46.710 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-04-24T02:09:46.710 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-04-24T02:09:46.710 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-04-24T02:09:46.710 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-04-24T02:09:46.710 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-04-24T02:09:46.710 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-04-24T02:09:46.710 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-04-24T02:09:46.710 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-04-24T02:09:46.710 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-04-24T02:09:46.710 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-04-24T02:09:46.710 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-04-24T02:09:47.592 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-04-24T02:09:47.592 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:09:47.592 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-04-24T02:09:47.592 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:09:47.592 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mds-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:09:47.592 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:09:47.592 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-modules-core-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T02:09:47.593 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mon-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:09:47.593 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-osd-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:09:47.593 INFO:teuthology.orchestra.run.smithi104.stdout: lua-5.4.4-4.el9.x86_64 2024-04-24T02:09:47.593 INFO:teuthology.orchestra.run.smithi104.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-24T02:09:47.593 INFO:teuthology.orchestra.run.smithi104.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-24T02:09:47.593 INFO:teuthology.orchestra.run.smithi104.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-24T02:09:47.593 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-24T02:09:47.593 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-24T02:09:47.593 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-24T02:09:47.593 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-24T02:09:47.593 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-24T02:09:47.593 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-24T02:09:47.593 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-24T02:09:47.594 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-24T02:09:47.594 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-24T02:09:47.594 INFO:teuthology.orchestra.run.smithi104.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-24T02:09:47.594 INFO:teuthology.orchestra.run.smithi104.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-24T02:09:47.594 INFO:teuthology.orchestra.run.smithi104.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-24T02:09:47.594 INFO:teuthology.orchestra.run.smithi104.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-24T02:09:47.594 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-24T02:09:47.594 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ply-3.11-14.el9.noarch 2024-04-24T02:09:47.594 INFO:teuthology.orchestra.run.smithi104.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-24T02:09:47.594 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-24T02:09:47.594 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-24T02:09:47.594 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-24T02:09:47.594 INFO:teuthology.orchestra.run.smithi104.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-24T02:09:47.594 INFO:teuthology.orchestra.run.smithi104.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-24T02:09:47.595 INFO:teuthology.orchestra.run.smithi104.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-24T02:09:47.595 INFO:teuthology.orchestra.run.smithi104.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-24T02:09:47.595 INFO:teuthology.orchestra.run.smithi104.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-24T02:09:47.595 INFO:teuthology.orchestra.run.smithi104.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-24T02:09:47.595 INFO:teuthology.orchestra.run.smithi104.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-24T02:09:47.595 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:09:47.595 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-04-24T02:09:47.934 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install ceph-base 2024-04-24T02:09:48.442 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:00:56 ago on Wed 24 Apr 2024 02:08:52 AM UTC. 2024-04-24T02:09:48.519 INFO:teuthology.orchestra.run.smithi104.stdout:Package ceph-base-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T02:09:48.560 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-04-24T02:09:48.561 INFO:teuthology.orchestra.run.smithi104.stdout:Nothing to do. 2024-04-24T02:09:48.561 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-04-24T02:09:48.622 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install cephadm 2024-04-24T02:09:49.116 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:00:57 ago on Wed 24 Apr 2024 02:08:52 AM UTC. 2024-04-24T02:09:49.233 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-04-24T02:09:49.234 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:09:49.234 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repository Size 2024-04-24T02:09:49.234 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:09:49.235 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-04-24T02:09:49.235 INFO:teuthology.orchestra.run.smithi104.stdout: cephadm noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 762 k 2024-04-24T02:09:49.235 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:09:49.235 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-04-24T02:09:49.235 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:09:49.235 INFO:teuthology.orchestra.run.smithi104.stdout:Install 1 Package 2024-04-24T02:09:49.235 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:09:49.235 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 762 k 2024-04-24T02:09:49.235 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 768 k 2024-04-24T02:09:49.235 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-04-24T02:09:49.696 INFO:teuthology.orchestra.run.smithi104.stdout:cephadm-19.0.0-2424.gb98aab6c.el9.noarch.rpm 1.6 MB/s | 762 kB 00:00 2024-04-24T02:09:49.696 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-04-24T02:09:49.697 INFO:teuthology.orchestra.run.smithi104.stdout:Total 1.6 MB/s | 762 kB 00:00 2024-04-24T02:09:49.697 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-04-24T02:09:49.702 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-04-24T02:09:49.702 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-04-24T02:09:49.708 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-04-24T02:09:49.708 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-04-24T02:09:49.782 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-04-24T02:09:50.248 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 1/1 2024-04-24T02:09:50.257 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2424.gb98aab6c.el9.x86_64 3/4 2024-04-24T02:09:50.339 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 1/1 2024-04-24T02:09:50.352 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-test-2:19.0.0-2424.gb98aab6c.el9.x86_64 4/4 2024-04-24T02:09:50.682 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 1/1 2024-04-24T02:09:50.938 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 1/1 2024-04-24T02:09:50.938 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:09:50.938 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-04-24T02:09:50.938 INFO:teuthology.orchestra.run.smithi104.stdout: cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T02:09:50.938 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:09:50.938 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-04-24T02:09:51.147 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install ceph-immutable-object-cache 2024-04-24T02:09:51.657 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:00:59 ago on Wed 24 Apr 2024 02:08:52 AM UTC. 2024-04-24T02:09:51.778 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-04-24T02:09:51.779 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:09:51.779 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repo Size 2024-04-24T02:09:51.779 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:09:51.779 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-04-24T02:09:51.779 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 145 k 2024-04-24T02:09:51.779 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:09:51.779 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-04-24T02:09:51.779 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:09:51.779 INFO:teuthology.orchestra.run.smithi104.stdout:Install 1 Package 2024-04-24T02:09:51.779 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:09:51.780 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 145 k 2024-04-24T02:09:51.780 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 435 k 2024-04-24T02:09:51.780 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-04-24T02:09:52.009 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-immutable-object-cache-19.0.0-2424.gb98aab 631 kB/s | 145 kB 00:00 2024-04-24T02:09:52.010 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-04-24T02:09:52.010 INFO:teuthology.orchestra.run.smithi104.stdout:Total 626 kB/s | 145 kB 00:00 2024-04-24T02:09:52.011 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-04-24T02:09:52.018 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-04-24T02:09:52.018 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-04-24T02:09:52.074 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-04-24T02:09:52.075 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-04-24T02:09:52.226 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-04-24T02:09:52.311 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2424.gb98aab6c. 1/1 2024-04-24T02:09:52.335 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2424.gb98aab6c. 1/1 2024-04-24T02:09:52.335 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T02:09:52.335 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-24T02:09:52.335 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:09:52.806 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-test-2:19.0.0-2424.gb98aab6c.el9.x86_64 4/4 2024-04-24T02:09:52.806 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-test-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/4 2024-04-24T02:09:52.806 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephsqlite-2:19.0.0-2424.gb98aab6c.el9.x86_64 2/4 2024-04-24T02:09:52.806 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-04-24T02:09:53.085 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-04-24T02:09:53.085 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:09:53.085 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-04-24T02:09:53.085 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:09:53.085 INFO:teuthology.orchestra.run.smithi134.stdout: libcephsqlite-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:09:53.085 INFO:teuthology.orchestra.run.smithi134.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-24T02:09:53.085 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-24T02:09:53.085 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:09:53.085 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-24T02:09:53.263 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2424.gb98aab6c. 1/1 2024-04-24T02:09:53.263 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:09:53.263 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-04-24T02:09:53.263 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-immutable-object-cache-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:09:53.263 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:09:53.263 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-04-24T02:09:53.360 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph 2024-04-24T02:09:53.486 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install ceph-mgr 2024-04-24T02:09:53.865 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:00:39 ago on Wed 24 Apr 2024 02:09:14 AM UTC. 2024-04-24T02:09:53.991 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-24T02:09:53.993 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:09:53.993 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-04-24T02:09:53.993 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:09:53.993 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-04-24T02:09:53.993 INFO:teuthology.orchestra.run.smithi134.stdout: ceph x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 6.6 k 2024-04-24T02:09:53.993 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-04-24T02:09:53.993 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 2.4 M 2024-04-24T02:09:53.994 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 1.5 M 2024-04-24T02:09:53.994 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 249 k 2024-04-24T02:09:53.994 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 4.7 M 2024-04-24T02:09:53.994 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 17 M 2024-04-24T02:09:53.994 INFO:teuthology.orchestra.run.smithi134.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-24T02:09:53.994 INFO:teuthology.orchestra.run.smithi134.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-24T02:09:53.994 INFO:teuthology.orchestra.run.smithi134.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-24T02:09:53.994 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-24T02:09:53.994 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-24T02:09:53.994 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-24T02:09:53.994 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-24T02:09:53.994 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-24T02:09:53.994 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-24T02:09:53.995 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-24T02:09:53.995 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-collections 2024-04-24T02:09:53.995 INFO:teuthology.orchestra.run.smithi134.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-04-24T02:09:53.995 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-24T02:09:53.995 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-24T02:09:53.995 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-24T02:09:53.995 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-24T02:09:53.995 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-24T02:09:53.995 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-24T02:09:53.995 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-24T02:09:53.995 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-24T02:09:53.995 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-24T02:09:53.996 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-24T02:09:53.996 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-24T02:09:53.996 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-24T02:09:53.996 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-24T02:09:53.996 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-24T02:09:53.996 INFO:teuthology.orchestra.run.smithi134.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-24T02:09:53.996 INFO:teuthology.orchestra.run.smithi134.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-24T02:09:53.996 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-24T02:09:53.996 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-24T02:09:53.996 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-24T02:09:53.996 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:09:53.996 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-04-24T02:09:53.997 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:09:53.997 INFO:teuthology.orchestra.run.smithi134.stdout:Install 36 Packages 2024-04-24T02:09:53.997 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:09:53.997 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 30 M 2024-04-24T02:09:53.997 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 107 M 2024-04-24T02:09:53.997 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-04-24T02:09:54.001 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:01:02 ago on Wed 24 Apr 2024 02:08:52 AM UTC. 2024-04-24T02:09:54.083 INFO:teuthology.orchestra.run.smithi104.stdout:Package ceph-mgr-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T02:09:54.126 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-04-24T02:09:54.127 INFO:teuthology.orchestra.run.smithi104.stdout:Nothing to do. 2024-04-24T02:09:54.127 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-04-24T02:09:54.192 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install ceph-mgr-dashboard 2024-04-24T02:09:54.694 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:01:02 ago on Wed 24 Apr 2024 02:08:52 AM UTC. 2024-04-24T02:09:54.814 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-04-24T02:09:54.815 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:09:54.815 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repository Size 2024-04-24T02:09:54.815 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:09:54.815 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-04-24T02:09:54.815 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 3.5 M 2024-04-24T02:09:54.815 INFO:teuthology.orchestra.run.smithi104.stdout:Installing dependencies: 2024-04-24T02:09:54.815 INFO:teuthology.orchestra.run.smithi104.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-24T02:09:54.815 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 32 k 2024-04-24T02:09:54.815 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 15 k 2024-04-24T02:09:54.815 INFO:teuthology.orchestra.run.smithi104.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-24T02:09:54.816 INFO:teuthology.orchestra.run.smithi104.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-24T02:09:54.816 INFO:teuthology.orchestra.run.smithi104.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-24T02:09:54.816 INFO:teuthology.orchestra.run.smithi104.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-24T02:09:54.816 INFO:teuthology.orchestra.run.smithi104.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-24T02:09:54.816 INFO:teuthology.orchestra.run.smithi104.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-24T02:09:54.816 INFO:teuthology.orchestra.run.smithi104.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-24T02:09:54.816 INFO:teuthology.orchestra.run.smithi104.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-24T02:09:54.816 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:09:54.816 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-04-24T02:09:54.816 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:09:54.816 INFO:teuthology.orchestra.run.smithi104.stdout:Install 12 Packages 2024-04-24T02:09:54.816 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:09:54.817 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 8.6 M 2024-04-24T02:09:54.817 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 103 M 2024-04-24T02:09:54.817 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-04-24T02:09:54.850 INFO:teuthology.orchestra.run.smithi134.stdout:(1/36): ceph-19.0.0-2424.gb98aab6c.el9.x86_64.r 30 kB/s | 6.6 kB 00:00 2024-04-24T02:09:55.201 INFO:teuthology.orchestra.run.smithi134.stdout:(2/36): ceph-mds-19.0.0-2424.gb98aab6c.el9.x86_ 4.2 MB/s | 2.4 MB 00:00 2024-04-24T02:09:55.242 INFO:teuthology.orchestra.run.smithi134.stdout:(3/36): ceph-mgr-19.0.0-2424.gb98aab6c.el9.x86_ 2.5 MB/s | 1.5 MB 00:00 2024-04-24T02:09:55.351 INFO:teuthology.orchestra.run.smithi134.stdout:(4/36): ceph-mgr-modules-core-19.0.0-2424.gb98a 2.2 MB/s | 249 kB 00:00 2024-04-24T02:09:55.543 INFO:teuthology.orchestra.run.smithi134.stdout:(5/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.3 MB/s | 253 kB 00:00 2024-04-24T02:09:55.685 INFO:teuthology.orchestra.run.smithi134.stdout:(6/36): ceph-mon-19.0.0-2424.gb98aab6c.el9.x86_ 5.6 MB/s | 4.7 MB 00:00 2024-04-24T02:09:55.827 INFO:teuthology.orchestra.run.smithi134.stdout:(7/36): python3-ply-3.11-14.el9.noarch.rpm 752 kB/s | 106 kB 00:00 2024-04-24T02:09:55.829 INFO:teuthology.orchestra.run.smithi104.stdout:(1/12): ceph-grafana-dashboards-19.0.0-2424.gb9 156 kB/s | 32 kB 00:00 2024-04-24T02:09:55.861 INFO:teuthology.orchestra.run.smithi134.stdout:(8/36): python3-cryptography-36.0.1-4.el9.x86_6 3.9 MB/s | 1.2 MB 00:00 2024-04-24T02:09:55.894 INFO:teuthology.orchestra.run.smithi134.stdout:(9/36): python3-pycparser-2.20-6.el9.noarch.rpm 2.0 MB/s | 135 kB 00:00 2024-04-24T02:09:55.919 INFO:teuthology.orchestra.run.smithi134.stdout:(10/36): python3-requests-2.25.1-8.el9.noarch.r 2.1 MB/s | 125 kB 00:00 2024-04-24T02:09:55.944 INFO:teuthology.orchestra.run.smithi134.stdout:(11/36): python3-urllib3-1.26.5-5.el9.noarch.rp 4.2 MB/s | 215 kB 00:00 2024-04-24T02:09:55.954 INFO:teuthology.orchestra.run.smithi104.stdout:(2/12): ceph-prometheus-alerts-19.0.0-2424.gb98 47 kB/s | 15 kB 00:00 2024-04-24T02:09:55.986 INFO:teuthology.orchestra.run.smithi134.stdout:(12/36): lua-5.4.4-4.el9.x86_64.rpm 2.8 MB/s | 188 kB 00:00 2024-04-24T02:09:56.012 INFO:teuthology.orchestra.run.smithi134.stdout:(13/36): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-04-24T02:09:56.037 INFO:teuthology.orchestra.run.smithi134.stdout:(14/36): python3-markupsafe-1.1.1-12.el9.x86_64 692 kB/s | 35 kB 00:00 2024-04-24T02:09:56.062 INFO:teuthology.orchestra.run.smithi134.stdout:(15/36): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-04-24T02:09:56.071 INFO:teuthology.orchestra.run.smithi104.stdout:(3/12): protobuf-3.14.0-13.el9.x86_64.rpm 4.2 MB/s | 1.0 MB 00:00 2024-04-24T02:09:56.087 INFO:teuthology.orchestra.run.smithi134.stdout:(16/36): python3-toml-0.10.2-6.el9.noarch.rpm 829 kB/s | 42 kB 00:00 2024-04-24T02:09:56.138 INFO:teuthology.orchestra.run.smithi104.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.4 MB/s | 269 kB 00:00 2024-04-24T02:09:56.257 INFO:teuthology.orchestra.run.smithi104.stdout:(5/12): protobuf-compiler-3.14.0-13.el9.x86_64. 4.6 MB/s | 863 kB 00:00 2024-04-24T02:09:56.257 INFO:teuthology.orchestra.run.smithi134.stdout:(17/36): ceph-osd-19.0.0-2424.gb98aab6c.el9.x86 16 MB/s | 17 MB 00:01 2024-04-24T02:09:56.371 INFO:teuthology.orchestra.run.smithi134.stdout:(18/36): lua-devel-5.4.4-4.el9.x86_64.rpm 72 kB/s | 22 kB 00:00 2024-04-24T02:09:56.372 INFO:teuthology.orchestra.run.smithi104.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 166 kB/s | 19 kB 00:00 2024-04-24T02:09:56.406 INFO:teuthology.orchestra.run.smithi104.stdout:(7/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 2.0 MB/s | 548 kB 00:00 2024-04-24T02:09:56.448 INFO:teuthology.orchestra.run.smithi104.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 3.4 MB/s | 144 kB 00:00 2024-04-24T02:09:56.481 INFO:teuthology.orchestra.run.smithi104.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 921 kB/s | 31 kB 00:00 2024-04-24T02:09:56.531 INFO:teuthology.orchestra.run.smithi104.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 3.7 MB/s | 188 kB 00:00 2024-04-24T02:09:56.565 INFO:teuthology.orchestra.run.smithi104.stdout:(11/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 11 MB/s | 2.0 MB 00:00 2024-04-24T02:09:56.605 INFO:teuthology.orchestra.run.smithi134.stdout:(19/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 124 kB/s | 43 kB 00:00 2024-04-24T02:09:56.630 INFO:teuthology.orchestra.run.smithi134.stdout:(20/36): luarocks-3.9.2-1.el9.noarch.rpm 278 kB/s | 151 kB 00:00 2024-04-24T02:09:56.822 INFO:teuthology.orchestra.run.smithi134.stdout:(21/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 56 kB/s | 11 kB 00:00 2024-04-24T02:09:56.873 INFO:teuthology.orchestra.run.smithi134.stdout:(22/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 343 kB/s | 172 kB 00:00 2024-04-24T02:09:56.990 INFO:teuthology.orchestra.run.smithi104.stdout:(12/12): ceph-mgr-dashboard-19.0.0-2424.gb98aab 2.6 MB/s | 3.5 MB 00:01 2024-04-24T02:09:56.994 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-04-24T02:09:56.994 INFO:teuthology.orchestra.run.smithi104.stdout:Total 4.0 MB/s | 8.6 MB 00:02 2024-04-24T02:09:57.041 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-04-24T02:09:57.058 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-04-24T02:09:57.058 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-04-24T02:09:57.089 INFO:teuthology.orchestra.run.smithi134.stdout:(23/36): python3-jaraco-classes-3.2.1-5.el9.noa 66 kB/s | 18 kB 00:00 2024-04-24T02:09:57.115 INFO:teuthology.orchestra.run.smithi134.stdout:(24/36): python3-cherrypy-18.6.1-2.el9.noarch.r 704 kB/s | 358 kB 00:00 2024-04-24T02:09:57.140 INFO:teuthology.orchestra.run.smithi134.stdout:(25/36): python3-jaraco-collections-3.0.0-8.el9 87 kB/s | 23 kB 00:00 2024-04-24T02:09:57.213 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-04-24T02:09:57.214 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-04-24T02:09:57.357 INFO:teuthology.orchestra.run.smithi134.stdout:(26/36): python3-jaraco-functools-3.5.0-2.el9.n 73 kB/s | 19 kB 00:00 2024-04-24T02:09:57.382 INFO:teuthology.orchestra.run.smithi134.stdout:(27/36): python3-jaraco-text-3.2.0-6.el9.noarch 74 kB/s | 20 kB 00:00 2024-04-24T02:09:57.483 INFO:teuthology.orchestra.run.smithi134.stdout:(28/36): python3-logutils-0.3.5-21.el9.noarch.r 135 kB/s | 46 kB 00:00 2024-04-24T02:09:57.699 INFO:teuthology.orchestra.run.smithi134.stdout:(29/36): python3-more-itertools-8.12.0-2.el9.no 230 kB/s | 79 kB 00:00 2024-04-24T02:09:57.734 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-04-24T02:09:57.750 INFO:teuthology.orchestra.run.smithi134.stdout:(30/36): python3-portend-3.1.0-2.el9.noarch.rpm 62 kB/s | 16 kB 00:00 2024-04-24T02:09:57.815 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-04-24T02:09:57.850 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-04-24T02:09:57.896 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-04-24T02:09:57.916 INFO:teuthology.orchestra.run.smithi134.stdout:(31/36): python3-pecan-1.4.2-3.el9.noarch.rpm 510 kB/s | 272 kB 00:00 2024-04-24T02:09:57.927 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-04-24T02:09:58.002 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-04-24T02:09:58.017 INFO:teuthology.orchestra.run.smithi134.stdout:(32/36): python3-tempora-5.0.0-2.el9.noarch.rpm 134 kB/s | 36 kB 00:00 2024-04-24T02:09:58.042 INFO:teuthology.orchestra.run.smithi134.stdout:(33/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 263 kB/s | 90 kB 00:00 2024-04-24T02:09:58.136 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-04-24T02:09:58.222 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-04-24T02:09:58.266 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-04-24T02:09:58.294 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-04-24T02:09:58.309 INFO:teuthology.orchestra.run.smithi134.stdout:(34/36): python3-zc-lockfile-2.0-10.el9.noarch. 75 kB/s | 20 kB 00:00 2024-04-24T02:09:58.325 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2424.gb98aab6c.el9 10/12 2024-04-24T02:09:58.442 INFO:teuthology.orchestra.run.smithi134.stdout:(35/36): python3-webob-1.8.7-6.el9.noarch.rpm 437 kB/s | 230 kB 00:00 2024-04-24T02:09:58.601 INFO:teuthology.orchestra.run.smithi134.stdout:(36/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 732 kB/s | 427 kB 00:00 2024-04-24T02:09:58.605 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-04-24T02:09:58.605 INFO:teuthology.orchestra.run.smithi134.stdout:Total 6.5 MB/s | 30 MB 00:04 2024-04-24T02:09:58.744 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-04-24T02:09:58.784 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-04-24T02:09:58.784 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-04-24T02:09:59.078 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-04-24T02:09:59.081 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-04-24T02:09:59.371 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2424.gb98aab6c.el 11/12 2024-04-24T02:09:59.410 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2424.gb98aab6c.el9.noa 12/12 2024-04-24T02:10:00.360 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-04-24T02:10:00.420 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-04-24T02:10:00.454 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-04-24T02:10:00.490 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-04-24T02:10:00.561 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-04-24T02:10:00.605 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-04-24T02:10:00.638 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-04-24T02:10:00.728 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-04-24T02:10:00.740 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2424.gb98aab6c.el9.noa 12/12 2024-04-24T02:10:00.740 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2424.gb98aab6c.el 1/12 2024-04-24T02:10:00.740 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2424.gb98aab6c.el9.noa 2/12 2024-04-24T02:10:00.740 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2424.gb98aab6c.el9 3/12 2024-04-24T02:10:00.741 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-04-24T02:10:00.741 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-04-24T02:10:00.741 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-04-24T02:10:00.741 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-04-24T02:10:00.741 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-04-24T02:10:00.741 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-04-24T02:10:00.741 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-04-24T02:10:00.741 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-04-24T02:10:00.798 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-04-24T02:10:00.848 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-04-24T02:10:00.883 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-04-24T02:10:00.922 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/36 2024-04-24T02:10:00.956 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/36 2024-04-24T02:10:00.989 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/36 2024-04-24T02:10:01.030 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/36 2024-04-24T02:10:01.054 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-04-24T02:10:01.054 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:10:01.054 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-04-24T02:10:01.054 INFO:teuthology.orchestra.run.smithi104.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-24T02:10:01.054 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-grafana-dashboards-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T02:10:01.054 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-dashboard-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T02:10:01.054 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-prometheus-alerts-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T02:10:01.054 INFO:teuthology.orchestra.run.smithi104.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-24T02:10:01.054 INFO:teuthology.orchestra.run.smithi104.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-24T02:10:01.055 INFO:teuthology.orchestra.run.smithi104.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-24T02:10:01.055 INFO:teuthology.orchestra.run.smithi104.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-24T02:10:01.055 INFO:teuthology.orchestra.run.smithi104.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-24T02:10:01.055 INFO:teuthology.orchestra.run.smithi104.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-24T02:10:01.055 INFO:teuthology.orchestra.run.smithi104.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-24T02:10:01.055 INFO:teuthology.orchestra.run.smithi104.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-24T02:10:01.055 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:10:01.055 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-04-24T02:10:01.064 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/36 2024-04-24T02:10:01.099 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/36 2024-04-24T02:10:01.137 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/36 2024-04-24T02:10:01.210 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/36 2024-04-24T02:10:01.290 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-24T02:10:01.364 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 19/36 2024-04-24T02:10:01.445 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 20/36 2024-04-24T02:10:01.498 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 21/36 2024-04-24T02:10:01.537 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 22/36 2024-04-24T02:10:01.585 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ply-3.11-14.el9.noarch 23/36 2024-04-24T02:10:01.641 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 24/36 2024-04-24T02:10:01.796 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:01:09 ago on Wed 24 Apr 2024 02:08:52 AM UTC. 2024-04-24T02:10:01.824 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 25/36 2024-04-24T02:10:01.874 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 26/36 2024-04-24T02:10:01.918 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-04-24T02:10:01.919 INFO:teuthology.orchestra.run.smithi104.stdout:======================================================================================= 2024-04-24T02:10:01.919 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repository Size 2024-04-24T02:10:01.919 INFO:teuthology.orchestra.run.smithi104.stdout:======================================================================================= 2024-04-24T02:10:01.919 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-04-24T02:10:01.919 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 7.4 M 2024-04-24T02:10:01.919 INFO:teuthology.orchestra.run.smithi104.stdout:Installing dependencies: 2024-04-24T02:10:01.919 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-24T02:10:01.920 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-24T02:10:01.920 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-24T02:10:01.920 INFO:teuthology.orchestra.run.smithi104.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-24T02:10:01.920 INFO:teuthology.orchestra.run.smithi104.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-24T02:10:01.920 INFO:teuthology.orchestra.run.smithi104.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-24T02:10:01.920 INFO:teuthology.orchestra.run.smithi104.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-24T02:10:01.920 INFO:teuthology.orchestra.run.smithi104.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-24T02:10:01.920 INFO:teuthology.orchestra.run.smithi104.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-24T02:10:01.920 INFO:teuthology.orchestra.run.smithi104.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-24T02:10:01.920 INFO:teuthology.orchestra.run.smithi104.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-24T02:10:01.920 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:10:01.920 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-04-24T02:10:01.920 INFO:teuthology.orchestra.run.smithi104.stdout:======================================================================================= 2024-04-24T02:10:01.921 INFO:teuthology.orchestra.run.smithi104.stdout:Install 12 Packages 2024-04-24T02:10:01.921 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:10:01.921 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 38 M 2024-04-24T02:10:01.921 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 209 M 2024-04-24T02:10:01.921 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-04-24T02:10:01.943 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 27/36 2024-04-24T02:10:02.031 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 28/36 2024-04-24T02:10:02.065 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 29/36 2024-04-24T02:10:02.181 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 30/36 2024-04-24T02:10:02.297 INFO:teuthology.orchestra.run.smithi104.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 816 kB/s | 195 kB 00:00 2024-04-24T02:10:02.346 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2424.gb98aab6c.el9. 31/36 2024-04-24T02:10:02.356 INFO:teuthology.orchestra.run.smithi104.stdout:(2/12): libgfortran-11.4.1-3.el9.x86_64.rpm 2.6 MB/s | 803 kB 00:00 2024-04-24T02:10:02.375 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-2:19.0.0-2424.gb98aab6c.el9.x86_64 32/36 2024-04-24T02:10:02.400 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2424.gb98aab6c.el9.x86_64 32/36 2024-04-24T02:10:02.401 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T02:10:02.401 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-24T02:10:02.401 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-24T02:10:02.401 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-24T02:10:02.401 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:10:02.414 INFO:teuthology.orchestra.run.smithi104.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 280 kB/s | 33 kB 00:00 2024-04-24T02:10:02.506 INFO:teuthology.orchestra.run.smithi104.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 198 kB/s | 18 kB 00:00 2024-04-24T02:10:02.565 INFO:teuthology.orchestra.run.smithi104.stdout:(5/12): openblas-0.3.21-2.el9.x86_64.rpm 603 kB/s | 35 kB 00:00 2024-04-24T02:10:02.657 INFO:teuthology.orchestra.run.smithi104.stdout:(6/12): ceph-mgr-diskprediction-local-19.0.0-24 12 MB/s | 7.4 MB 00:00 2024-04-24T02:10:02.715 INFO:teuthology.orchestra.run.smithi104.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 8.3 MB/s | 3.0 MB 00:00 2024-04-24T02:10:02.866 INFO:teuthology.orchestra.run.smithi104.stdout:(8/12): python3-devel-3.9.18-3.el9.x86_64.rpm 1.1 MB/s | 244 kB 00:00 2024-04-24T02:10:02.958 INFO:teuthology.orchestra.run.smithi104.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.7 MB/s | 250 kB 00:00 2024-04-24T02:10:03.033 INFO:teuthology.orchestra.run.smithi104.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 16 MB/s | 5.1 MB 00:00 2024-04-24T02:10:03.100 INFO:teuthology.orchestra.run.smithi104.stdout:(11/12): openblas-openmp-0.3.21-2.el9.x86_64.rp 8.9 MB/s | 4.7 MB 00:00 2024-04-24T02:10:03.834 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-osd-2:19.0.0-2424.gb98aab6c.el9.x86_64 33/36 2024-04-24T02:10:03.860 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-osd-2:19.0.0-2424.gb98aab6c.el9.x86_64 33/36 2024-04-24T02:10:03.861 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T02:10:03.861 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-24T02:10:03.861 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-24T02:10:03.861 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-24T02:10:03.861 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:10:03.900 INFO:teuthology.orchestra.run.smithi104.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 17 MB/s | 16 MB 00:00 2024-04-24T02:10:03.901 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-04-24T02:10:03.901 INFO:teuthology.orchestra.run.smithi104.stdout:Total 19 MB/s | 38 MB 00:01 2024-04-24T02:10:04.253 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-04-24T02:10:04.279 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-04-24T02:10:04.279 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-04-24T02:10:04.302 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mon-2:19.0.0-2424.gb98aab6c.el9.x86_64 34/36 2024-04-24T02:10:04.325 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mon-2:19.0.0-2424.gb98aab6c.el9.x86_64 34/36 2024-04-24T02:10:04.325 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T02:10:04.325 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-24T02:10:04.325 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-24T02:10:04.325 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-24T02:10:04.326 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:10:04.552 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mds-2:19.0.0-2424.gb98aab6c.el9.x86_64 35/36 2024-04-24T02:10:04.575 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mds-2:19.0.0-2424.gb98aab6c.el9.x86_64 35/36 2024-04-24T02:10:04.575 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T02:10:04.575 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-24T02:10:04.575 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-24T02:10:04.575 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-24T02:10:04.575 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:10:04.639 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-2:19.0.0-2424.gb98aab6c.el9.x86_64 36/36 2024-04-24T02:10:04.687 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-04-24T02:10:04.688 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-04-24T02:10:05.523 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-04-24T02:10:05.579 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-04-24T02:10:05.623 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-04-24T02:10:05.722 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-04-24T02:10:05.757 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-04-24T02:10:05.935 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-24T02:10:05.973 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-24T02:10:06.049 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-24T02:10:06.232 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-2:19.0.0-2424.gb98aab6c.el9.x86_64 36/36 2024-04-24T02:10:06.232 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/36 2024-04-24T02:10:06.232 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mds-2:19.0.0-2424.gb98aab6c.el9.x86_64 2/36 2024-04-24T02:10:06.232 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-2:19.0.0-2424.gb98aab6c.el9.x86_64 3/36 2024-04-24T02:10:06.232 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mon-2:19.0.0-2424.gb98aab6c.el9.x86_64 4/36 2024-04-24T02:10:06.233 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-osd-2:19.0.0-2424.gb98aab6c.el9.x86_64 5/36 2024-04-24T02:10:06.233 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2424.gb98aab6c.el9. 6/36 2024-04-24T02:10:06.233 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/36 2024-04-24T02:10:06.233 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/36 2024-04-24T02:10:06.233 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/36 2024-04-24T02:10:06.233 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/36 2024-04-24T02:10:06.233 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/36 2024-04-24T02:10:06.233 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/36 2024-04-24T02:10:06.233 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/36 2024-04-24T02:10:06.233 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/36 2024-04-24T02:10:06.233 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/36 2024-04-24T02:10:06.233 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/36 2024-04-24T02:10:06.233 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/36 2024-04-24T02:10:06.233 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-04-24T02:10:06.234 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-04-24T02:10:06.234 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-04-24T02:10:06.234 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-04-24T02:10:06.234 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-04-24T02:10:06.234 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-04-24T02:10:06.234 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-04-24T02:10:06.234 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-04-24T02:10:06.234 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-04-24T02:10:06.234 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-04-24T02:10:06.234 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-04-24T02:10:06.234 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-04-24T02:10:06.234 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-04-24T02:10:06.234 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-04-24T02:10:06.234 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-04-24T02:10:06.235 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-04-24T02:10:06.235 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-04-24T02:10:06.235 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-04-24T02:10:06.695 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-24T02:10:06.820 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-24T02:10:07.120 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-04-24T02:10:07.120 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:10:07.120 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-04-24T02:10:07.120 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:10:07.120 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:10:07.120 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:10:07.120 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T02:10:07.121 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:10:07.121 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:10:07.121 INFO:teuthology.orchestra.run.smithi134.stdout: lua-5.4.4-4.el9.x86_64 2024-04-24T02:10:07.121 INFO:teuthology.orchestra.run.smithi134.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-24T02:10:07.121 INFO:teuthology.orchestra.run.smithi134.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-24T02:10:07.121 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-24T02:10:07.121 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-24T02:10:07.121 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-24T02:10:07.121 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-24T02:10:07.121 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-24T02:10:07.121 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-24T02:10:07.121 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-24T02:10:07.121 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-24T02:10:07.122 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-24T02:10:07.122 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-24T02:10:07.122 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-24T02:10:07.122 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-24T02:10:07.122 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-24T02:10:07.122 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-24T02:10:07.122 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-24T02:10:07.122 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ply-3.11-14.el9.noarch 2024-04-24T02:10:07.122 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-24T02:10:07.122 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-24T02:10:07.123 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-24T02:10:07.123 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-24T02:10:07.123 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-24T02:10:07.123 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-24T02:10:07.123 INFO:teuthology.orchestra.run.smithi134.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-24T02:10:07.123 INFO:teuthology.orchestra.run.smithi134.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-24T02:10:07.123 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-24T02:10:07.123 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-24T02:10:07.123 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-24T02:10:07.123 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:10:07.123 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-24T02:10:07.474 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-base 2024-04-24T02:10:07.987 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:00:53 ago on Wed 24 Apr 2024 02:09:14 AM UTC. 2024-04-24T02:10:08.044 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-24T02:10:08.065 INFO:teuthology.orchestra.run.smithi134.stdout:Package ceph-base-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T02:10:08.105 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-24T02:10:08.106 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-04-24T02:10:08.106 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-24T02:10:08.191 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install cephadm 2024-04-24T02:10:08.691 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:00:54 ago on Wed 24 Apr 2024 02:09:14 AM UTC. 2024-04-24T02:10:08.812 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-24T02:10:08.826 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:10:08.827 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-04-24T02:10:08.827 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:10:08.827 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-04-24T02:10:08.827 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 762 k 2024-04-24T02:10:08.827 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:10:08.827 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-04-24T02:10:08.827 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:10:08.827 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-04-24T02:10:08.827 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:10:08.827 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 762 k 2024-04-24T02:10:08.827 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 768 k 2024-04-24T02:10:08.827 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-04-24T02:10:09.086 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-24T02:10:09.122 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2424.gb98aa 12/12 2024-04-24T02:10:09.252 INFO:teuthology.orchestra.run.smithi134.stdout:cephadm-19.0.0-2424.gb98aab6c.el9.noarch.rpm 1.7 MB/s | 762 kB 00:00 2024-04-24T02:10:09.253 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-04-24T02:10:09.253 INFO:teuthology.orchestra.run.smithi134.stdout:Total 1.7 MB/s | 762 kB 00:00 2024-04-24T02:10:09.253 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-04-24T02:10:09.258 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-04-24T02:10:09.258 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-04-24T02:10:09.264 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-04-24T02:10:09.265 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-04-24T02:10:09.334 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-04-24T02:10:09.819 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 1/1 2024-04-24T02:10:09.913 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 1/1 2024-04-24T02:10:10.238 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 1/1 2024-04-24T02:10:10.458 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 1/1 2024-04-24T02:10:10.458 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:10:10.458 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-04-24T02:10:10.458 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T02:10:10.458 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:10:10.458 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-24T02:10:10.692 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-immutable-object-cache 2024-04-24T02:10:11.211 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:00:57 ago on Wed 24 Apr 2024 02:09:14 AM UTC. 2024-04-24T02:10:11.334 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-24T02:10:11.334 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:10:11.335 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repo Size 2024-04-24T02:10:11.335 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:10:11.335 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-04-24T02:10:11.335 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 145 k 2024-04-24T02:10:11.335 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:10:11.335 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-04-24T02:10:11.335 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:10:11.335 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-04-24T02:10:11.335 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:10:11.335 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 145 k 2024-04-24T02:10:11.335 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 435 k 2024-04-24T02:10:11.335 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-04-24T02:10:11.550 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-immutable-object-cache-19.0.0-2424.gb98aab 675 kB/s | 145 kB 00:00 2024-04-24T02:10:11.550 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-04-24T02:10:11.551 INFO:teuthology.orchestra.run.smithi134.stdout:Total 670 kB/s | 145 kB 00:00 2024-04-24T02:10:11.551 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-04-24T02:10:11.558 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-04-24T02:10:11.558 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-04-24T02:10:11.560 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2424.gb98aa 12/12 2024-04-24T02:10:11.560 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2424.gb98aa 1/12 2024-04-24T02:10:11.560 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-24T02:10:11.560 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-04-24T02:10:11.561 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-04-24T02:10:11.561 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-04-24T02:10:11.561 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-04-24T02:10:11.561 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-04-24T02:10:11.561 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-04-24T02:10:11.561 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-04-24T02:10:11.561 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-04-24T02:10:11.561 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-04-24T02:10:11.615 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-04-24T02:10:11.615 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-04-24T02:10:11.760 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-04-24T02:10:11.826 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2424.gb98aab6c. 1/1 2024-04-24T02:10:11.850 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2424.gb98aab6c. 1/1 2024-04-24T02:10:11.850 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T02:10:11.851 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-24T02:10:11.851 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:10:11.935 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-04-24T02:10:11.936 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:10:11.936 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-04-24T02:10:11.936 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T02:10:11.936 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-24T02:10:11.936 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-24T02:10:11.936 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-24T02:10:11.936 INFO:teuthology.orchestra.run.smithi104.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-24T02:10:11.936 INFO:teuthology.orchestra.run.smithi104.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-24T02:10:11.936 INFO:teuthology.orchestra.run.smithi104.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-24T02:10:11.936 INFO:teuthology.orchestra.run.smithi104.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-24T02:10:11.936 INFO:teuthology.orchestra.run.smithi104.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-24T02:10:11.936 INFO:teuthology.orchestra.run.smithi104.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-24T02:10:11.936 INFO:teuthology.orchestra.run.smithi104.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-24T02:10:11.937 INFO:teuthology.orchestra.run.smithi104.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-24T02:10:11.937 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:10:11.937 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-04-24T02:10:12.279 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install ceph-mgr-rook 2024-04-24T02:10:12.681 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2424.gb98aab6c. 1/1 2024-04-24T02:10:12.681 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:10:12.681 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-04-24T02:10:12.681 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:10:12.681 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:10:12.681 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-24T02:10:12.797 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:01:20 ago on Wed 24 Apr 2024 02:08:52 AM UTC. 2024-04-24T02:10:12.901 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr 2024-04-24T02:10:12.918 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-04-24T02:10:12.922 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:10:12.922 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repository Size 2024-04-24T02:10:12.922 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:10:12.922 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-04-24T02:10:12.922 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-rook noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 49 k 2024-04-24T02:10:12.922 INFO:teuthology.orchestra.run.smithi104.stdout:Installing dependencies: 2024-04-24T02:10:12.922 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-24T02:10:12.922 INFO:teuthology.orchestra.run.smithi104.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-24T02:10:12.922 INFO:teuthology.orchestra.run.smithi104.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-24T02:10:12.922 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-24T02:10:12.923 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-24T02:10:12.923 INFO:teuthology.orchestra.run.smithi104.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-24T02:10:12.923 INFO:teuthology.orchestra.run.smithi104.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-24T02:10:12.923 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-24T02:10:12.923 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-24T02:10:12.923 INFO:teuthology.orchestra.run.smithi104.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-24T02:10:12.923 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-24T02:10:12.923 INFO:teuthology.orchestra.run.smithi104.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-24T02:10:12.923 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:10:12.923 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-04-24T02:10:12.923 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:10:12.923 INFO:teuthology.orchestra.run.smithi104.stdout:Install 13 Packages 2024-04-24T02:10:12.923 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:10:12.923 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 2.2 M 2024-04-24T02:10:12.923 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 26 M 2024-04-24T02:10:12.924 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-04-24T02:10:13.180 INFO:teuthology.orchestra.run.smithi104.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 193 kB/s | 19 kB 00:00 2024-04-24T02:10:13.205 INFO:teuthology.orchestra.run.smithi104.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 206 kB/s | 26 kB 00:00 2024-04-24T02:10:13.322 INFO:teuthology.orchestra.run.smithi104.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.5 MB/s | 222 kB 00:00 2024-04-24T02:10:13.355 INFO:teuthology.orchestra.run.smithi104.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.0 MB/s | 159 kB 00:00 2024-04-24T02:10:13.406 INFO:teuthology.orchestra.run.smithi104.stdout:(5/13): ceph-mgr-rook-19.0.0-2424.gb98aab6c.el9 151 kB/s | 49 kB 00:00 2024-04-24T02:10:13.407 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:00:59 ago on Wed 24 Apr 2024 02:09:14 AM UTC. 2024-04-24T02:10:13.431 INFO:teuthology.orchestra.run.smithi104.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 712 kB/s | 54 kB 00:00 2024-04-24T02:10:13.465 INFO:teuthology.orchestra.run.smithi104.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.9 MB/s | 279 kB 00:00 2024-04-24T02:10:13.485 INFO:teuthology.orchestra.run.smithi134.stdout:Package ceph-mgr-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T02:10:13.526 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-24T02:10:13.527 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-04-24T02:10:13.527 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-24T02:10:13.605 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr-dashboard 2024-04-24T02:10:13.765 INFO:teuthology.orchestra.run.smithi104.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 45 kB/s | 15 kB 00:00 2024-04-24T02:10:13.781 INFO:teuthology.orchestra.run.smithi104.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 86 kB/s | 32 kB 00:00 2024-04-24T02:10:13.932 INFO:teuthology.orchestra.run.smithi104.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 393 kB/s | 59 kB 00:00 2024-04-24T02:10:13.965 INFO:teuthology.orchestra.run.smithi104.stdout:(11/13): python3-google-auth-2.29.0-1.el9.noarc 410 kB/s | 206 kB 00:00 2024-04-24T02:10:14.065 INFO:teuthology.orchestra.run.smithi104.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 673 kB/s | 90 kB 00:00 2024-04-24T02:10:14.108 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:00 ago on Wed 24 Apr 2024 02:09:14 AM UTC. 2024-04-24T02:10:14.207 INFO:teuthology.orchestra.run.smithi104.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 2.3 MB/s | 1.0 MB 00:00 2024-04-24T02:10:14.210 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-04-24T02:10:14.210 INFO:teuthology.orchestra.run.smithi104.stdout:Total 1.7 MB/s | 2.2 MB 00:01 2024-04-24T02:10:14.231 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-24T02:10:14.232 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:10:14.233 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-04-24T02:10:14.233 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:10:14.233 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-04-24T02:10:14.233 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 3.5 M 2024-04-24T02:10:14.233 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-04-24T02:10:14.233 INFO:teuthology.orchestra.run.smithi134.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-24T02:10:14.233 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 32 k 2024-04-24T02:10:14.233 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 15 k 2024-04-24T02:10:14.233 INFO:teuthology.orchestra.run.smithi134.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-24T02:10:14.233 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-24T02:10:14.233 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-24T02:10:14.233 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-24T02:10:14.233 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-24T02:10:14.234 INFO:teuthology.orchestra.run.smithi134.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-24T02:10:14.234 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-24T02:10:14.234 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-24T02:10:14.234 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:10:14.234 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-04-24T02:10:14.234 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:10:14.234 INFO:teuthology.orchestra.run.smithi134.stdout:Install 12 Packages 2024-04-24T02:10:14.234 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:10:14.235 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 8.6 M 2024-04-24T02:10:14.235 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 103 M 2024-04-24T02:10:14.235 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-04-24T02:10:14.272 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-04-24T02:10:14.287 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-04-24T02:10:14.287 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-04-24T02:10:14.371 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-04-24T02:10:14.371 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-04-24T02:10:14.868 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-04-24T02:10:15.022 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-24T02:10:15.075 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-24T02:10:15.078 INFO:teuthology.orchestra.run.smithi134.stdout:(1/12): ceph-prometheus-alerts-19.0.0-2424.gb98 52 kB/s | 15 kB 00:00 2024-04-24T02:10:15.103 INFO:teuthology.orchestra.run.smithi134.stdout:(2/12): ceph-grafana-dashboards-19.0.0-2424.gb9 100 kB/s | 32 kB 00:00 2024-04-24T02:10:15.139 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-24T02:10:15.176 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-24T02:10:15.217 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-24T02:10:15.237 INFO:teuthology.orchestra.run.smithi134.stdout:(3/12): ceph-mgr-dashboard-19.0.0-2424.gb98aab6 7.8 MB/s | 3.5 MB 00:00 2024-04-24T02:10:15.312 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-24T02:10:15.414 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-04-24T02:10:15.469 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-24T02:10:15.571 INFO:teuthology.orchestra.run.smithi134.stdout:(4/12): protobuf-compiler-3.14.0-13.el9.x86_64. 2.5 MB/s | 863 kB 00:00 2024-04-24T02:10:15.829 INFO:teuthology.orchestra.run.smithi134.stdout:(5/12): python3-protobuf-3.14.0-13.el9.noarch.r 371 kB/s | 269 kB 00:00 2024-04-24T02:10:15.871 INFO:teuthology.orchestra.run.smithi134.stdout:(6/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 1.8 MB/s | 548 kB 00:00 2024-04-24T02:10:15.963 INFO:teuthology.orchestra.run.smithi134.stdout:(7/12): grpc-data-1.46.7-10.el9.noarch.rpm 145 kB/s | 19 kB 00:00 2024-04-24T02:10:16.013 INFO:teuthology.orchestra.run.smithi134.stdout:(8/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 14 MB/s | 2.0 MB 00:00 2024-04-24T02:10:16.047 INFO:teuthology.orchestra.run.smithi134.stdout:(9/12): protobuf-3.14.0-13.el9.x86_64.rpm 1.0 MB/s | 1.0 MB 00:00 2024-04-24T02:10:16.072 INFO:teuthology.orchestra.run.smithi134.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 525 kB/s | 31 kB 00:00 2024-04-24T02:10:16.131 INFO:teuthology.orchestra.run.smithi134.stdout:(11/12): python3-grpcio-tools-1.46.7-10.el9.x86 863 kB/s | 144 kB 00:00 2024-04-24T02:10:16.192 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-24T02:10:16.233 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-24T02:10:16.267 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-24T02:10:16.273 INFO:teuthology.orchestra.run.smithi134.stdout:(12/12): python3-routes-2.5.1-5.el9.noarch.rpm 837 kB/s | 188 kB 00:00 2024-04-24T02:10:16.274 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-04-24T02:10:16.274 INFO:teuthology.orchestra.run.smithi134.stdout:Total 4.2 MB/s | 8.6 MB 00:02 2024-04-24T02:10:16.315 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-24T02:10:16.326 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-04-24T02:10:16.344 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-04-24T02:10:16.344 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-04-24T02:10:16.345 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-rook-2:19.0.0-2424.gb98aab6c.el9.noarch 13/13 2024-04-24T02:10:16.500 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-04-24T02:10:16.500 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-04-24T02:10:17.018 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-04-24T02:10:17.063 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2424.gb98aab6c.el9.noarch 13/13 2024-04-24T02:10:17.063 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2424.gb98aab6c.el9.noarch 1/13 2024-04-24T02:10:17.063 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-24T02:10:17.063 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-24T02:10:17.063 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-24T02:10:17.063 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-24T02:10:17.063 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-24T02:10:17.063 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-24T02:10:17.063 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-24T02:10:17.063 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-24T02:10:17.064 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-04-24T02:10:17.064 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-24T02:10:17.064 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-24T02:10:17.098 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-04-24T02:10:17.133 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-04-24T02:10:17.181 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-04-24T02:10:17.210 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-04-24T02:10:17.287 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-04-24T02:10:17.401 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-24T02:10:17.401 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:10:17.401 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-04-24T02:10:17.401 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-rook-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T02:10:17.401 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-24T02:10:17.401 INFO:teuthology.orchestra.run.smithi104.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-24T02:10:17.401 INFO:teuthology.orchestra.run.smithi104.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-24T02:10:17.401 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-24T02:10:17.401 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-24T02:10:17.401 INFO:teuthology.orchestra.run.smithi104.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-24T02:10:17.401 INFO:teuthology.orchestra.run.smithi104.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-24T02:10:17.401 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-24T02:10:17.402 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-24T02:10:17.402 INFO:teuthology.orchestra.run.smithi104.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-24T02:10:17.402 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-24T02:10:17.402 INFO:teuthology.orchestra.run.smithi104.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-24T02:10:17.402 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:10:17.402 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-04-24T02:10:17.418 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-04-24T02:10:17.513 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-04-24T02:10:17.557 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-04-24T02:10:17.585 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-04-24T02:10:17.616 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2424.gb98aab6c.el9 10/12 2024-04-24T02:10:17.639 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install ceph-mgr-cephadm 2024-04-24T02:10:18.154 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:01:26 ago on Wed 24 Apr 2024 02:08:52 AM UTC. 2024-04-24T02:10:18.274 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-04-24T02:10:18.275 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:10:18.275 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repository Size 2024-04-24T02:10:18.275 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:10:18.275 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-04-24T02:10:18.275 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 141 k 2024-04-24T02:10:18.275 INFO:teuthology.orchestra.run.smithi104.stdout:Installing dependencies: 2024-04-24T02:10:18.275 INFO:teuthology.orchestra.run.smithi104.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-24T02:10:18.275 INFO:teuthology.orchestra.run.smithi104.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-24T02:10:18.275 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-24T02:10:18.275 INFO:teuthology.orchestra.run.smithi104.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-24T02:10:18.276 INFO:teuthology.orchestra.run.smithi104.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-24T02:10:18.276 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:10:18.276 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-04-24T02:10:18.276 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:10:18.276 INFO:teuthology.orchestra.run.smithi104.stdout:Install 6 Packages 2024-04-24T02:10:18.276 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:10:18.277 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 7.0 M 2024-04-24T02:10:18.277 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 33 M 2024-04-24T02:10:18.277 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-04-24T02:10:18.664 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2424.gb98aab6c.el 11/12 2024-04-24T02:10:18.693 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2424.gb98aab6c.el9.noa 12/12 2024-04-24T02:10:19.258 INFO:teuthology.orchestra.run.smithi104.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.2 MB/s | 248 kB 00:00 2024-04-24T02:10:19.384 INFO:teuthology.orchestra.run.smithi104.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 6.0 MB 00:00 2024-04-24T02:10:19.642 INFO:teuthology.orchestra.run.smithi104.stdout:(3/6): ceph-mgr-cephadm-19.0.0-2424.gb98aab6c.e 238 kB/s | 141 kB 00:00 2024-04-24T02:10:19.867 INFO:teuthology.orchestra.run.smithi104.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 119 kB/s | 58 kB 00:00 2024-04-24T02:10:20.004 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2424.gb98aab6c.el9.noa 12/12 2024-04-24T02:10:20.004 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2424.gb98aab6c.el 1/12 2024-04-24T02:10:20.004 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2424.gb98aab6c.el9.noa 2/12 2024-04-24T02:10:20.004 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2424.gb98aab6c.el9 3/12 2024-04-24T02:10:20.004 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-04-24T02:10:20.005 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-04-24T02:10:20.005 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-04-24T02:10:20.005 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-04-24T02:10:20.005 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-04-24T02:10:20.005 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-04-24T02:10:20.005 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-04-24T02:10:20.005 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-04-24T02:10:20.109 INFO:teuthology.orchestra.run.smithi104.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 109 kB/s | 51 kB 00:00 2024-04-24T02:10:20.159 INFO:teuthology.orchestra.run.smithi104.stdout:(6/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 609 kB/s | 548 kB 00:00 2024-04-24T02:10:20.162 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-04-24T02:10:20.163 INFO:teuthology.orchestra.run.smithi104.stdout:Total 3.7 MB/s | 7.0 MB 00:01 2024-04-24T02:10:20.232 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-04-24T02:10:20.243 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-04-24T02:10:20.243 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-04-24T02:10:20.299 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-04-24T02:10:20.299 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:10:20.299 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-04-24T02:10:20.299 INFO:teuthology.orchestra.run.smithi134.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-24T02:10:20.299 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T02:10:20.299 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T02:10:20.299 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T02:10:20.300 INFO:teuthology.orchestra.run.smithi134.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-24T02:10:20.300 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-24T02:10:20.300 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-24T02:10:20.300 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-24T02:10:20.300 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-24T02:10:20.300 INFO:teuthology.orchestra.run.smithi134.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-24T02:10:20.300 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-24T02:10:20.300 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-24T02:10:20.300 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:10:20.300 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-24T02:10:20.339 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-04-24T02:10:20.339 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-04-24T02:10:20.552 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-24T02:10:20.662 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-04-24T02:10:20.827 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-24T02:10:20.870 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-24T02:10:21.062 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:07 ago on Wed 24 Apr 2024 02:09:14 AM UTC. 2024-04-24T02:10:21.185 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-24T02:10:21.186 INFO:teuthology.orchestra.run.smithi134.stdout:======================================================================================= 2024-04-24T02:10:21.186 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-04-24T02:10:21.186 INFO:teuthology.orchestra.run.smithi134.stdout:======================================================================================= 2024-04-24T02:10:21.187 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-04-24T02:10:21.187 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 7.4 M 2024-04-24T02:10:21.187 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-04-24T02:10:21.187 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-24T02:10:21.187 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-24T02:10:21.187 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-24T02:10:21.187 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-24T02:10:21.187 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-24T02:10:21.187 INFO:teuthology.orchestra.run.smithi134.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-24T02:10:21.187 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-24T02:10:21.187 INFO:teuthology.orchestra.run.smithi134.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-24T02:10:21.187 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-24T02:10:21.187 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-24T02:10:21.188 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-24T02:10:21.188 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:10:21.188 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-04-24T02:10:21.188 INFO:teuthology.orchestra.run.smithi134.stdout:======================================================================================= 2024-04-24T02:10:21.188 INFO:teuthology.orchestra.run.smithi134.stdout:Install 12 Packages 2024-04-24T02:10:21.188 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:10:21.189 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 38 M 2024-04-24T02:10:21.189 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 209 M 2024-04-24T02:10:21.189 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-04-24T02:10:21.404 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-24T02:10:21.488 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-24T02:10:21.554 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-24T02:10:21.582 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 6/6 2024-04-24T02:10:22.321 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 6/6 2024-04-24T02:10:22.321 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 1/6 2024-04-24T02:10:22.321 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-24T02:10:22.321 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-24T02:10:22.321 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-24T02:10:22.321 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-24T02:10:22.489 INFO:teuthology.orchestra.run.smithi134.stdout:(1/12): ceph-mgr-diskprediction-local-19.0.0-24 9.8 MB/s | 7.4 MB 00:00 2024-04-24T02:10:22.582 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-24T02:10:22.583 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:10:22.583 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-04-24T02:10:22.583 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T02:10:22.583 INFO:teuthology.orchestra.run.smithi104.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-24T02:10:22.583 INFO:teuthology.orchestra.run.smithi104.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-24T02:10:22.583 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-24T02:10:22.583 INFO:teuthology.orchestra.run.smithi104.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-24T02:10:22.583 INFO:teuthology.orchestra.run.smithi104.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-24T02:10:22.583 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:10:22.583 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-04-24T02:10:22.598 INFO:teuthology.orchestra.run.smithi134.stdout:(2/12): libquadmath-11.4.1-3.el9.x86_64.rpm 225 kB/s | 195 kB 00:00 2024-04-24T02:10:22.756 INFO:teuthology.orchestra.run.smithi134.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 123 kB/s | 33 kB 00:00 2024-04-24T02:10:22.808 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install ceph-fuse 2024-04-24T02:10:22.848 INFO:teuthology.orchestra.run.smithi134.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 198 kB/s | 18 kB 00:00 2024-04-24T02:10:22.941 INFO:teuthology.orchestra.run.smithi134.stdout:(5/12): openblas-0.3.21-2.el9.x86_64.rpm 384 kB/s | 35 kB 00:00 2024-04-24T02:10:23.316 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:01:31 ago on Wed 24 Apr 2024 02:08:52 AM UTC. 2024-04-24T02:10:23.399 INFO:teuthology.orchestra.run.smithi134.stdout:(6/12): libgfortran-11.4.1-3.el9.x86_64.rpm 481 kB/s | 803 kB 00:01 2024-04-24T02:10:23.435 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-04-24T02:10:23.436 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:10:23.436 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repository Size 2024-04-24T02:10:23.436 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:10:23.436 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-04-24T02:10:23.436 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-fuse x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 889 k 2024-04-24T02:10:23.436 INFO:teuthology.orchestra.run.smithi104.stdout:Installing dependencies: 2024-04-24T02:10:23.436 INFO:teuthology.orchestra.run.smithi104.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-24T02:10:23.436 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:10:23.436 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-04-24T02:10:23.436 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:10:23.436 INFO:teuthology.orchestra.run.smithi104.stdout:Install 2 Packages 2024-04-24T02:10:23.437 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:10:23.437 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 969 k 2024-04-24T02:10:23.437 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 2.8 M 2024-04-24T02:10:23.437 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-04-24T02:10:23.649 INFO:teuthology.orchestra.run.smithi134.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.8 MB/s | 3.0 MB 00:01 2024-04-24T02:10:23.852 INFO:teuthology.orchestra.run.smithi104.stdout:(1/2): ceph-fuse-19.0.0-2424.gb98aab6c.el9.x86_ 2.8 MB/s | 889 kB 00:00 2024-04-24T02:10:24.024 INFO:teuthology.orchestra.run.smithi134.stdout:(8/12): python3-devel-3.9.18-3.el9.x86_64.rpm 391 kB/s | 244 kB 00:00 2024-04-24T02:10:24.208 INFO:teuthology.orchestra.run.smithi134.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 1.3 MB/s | 250 kB 00:00 2024-04-24T02:10:24.238 INFO:teuthology.orchestra.run.smithi104.stdout:(2/2): fuse-2.9.9-15.el9.x86_64.rpm 116 kB/s | 80 kB 00:00 2024-04-24T02:10:24.238 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-04-24T02:10:24.239 INFO:teuthology.orchestra.run.smithi104.stdout:Total 1.2 MB/s | 969 kB 00:00 2024-04-24T02:10:24.250 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-04-24T02:10:24.272 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-04-24T02:10:24.272 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-04-24T02:10:24.350 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-04-24T02:10:24.350 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-04-24T02:10:24.441 INFO:teuthology.orchestra.run.smithi134.stdout:(10/12): openblas-openmp-0.3.21-2.el9.x86_64.rp 3.2 MB/s | 4.7 MB 00:01 2024-04-24T02:10:24.530 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-04-24T02:10:24.672 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-24T02:10:24.735 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 2/2 2024-04-24T02:10:25.432 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 2/2 2024-04-24T02:10:25.432 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/2 2024-04-24T02:10:25.707 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-24T02:10:25.707 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:10:25.707 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-04-24T02:10:25.708 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-24T02:10:25.708 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:10:25.708 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-04-24T02:10:25.948 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install ceph-volume 2024-04-24T02:10:26.466 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:01:34 ago on Wed 24 Apr 2024 02:08:52 AM UTC. 2024-04-24T02:10:26.589 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-04-24T02:10:26.590 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:10:26.590 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repository Size 2024-04-24T02:10:26.590 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:10:26.590 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-04-24T02:10:26.590 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-volume noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 264 k 2024-04-24T02:10:26.590 INFO:teuthology.orchestra.run.smithi104.stdout:Installing dependencies: 2024-04-24T02:10:26.591 INFO:teuthology.orchestra.run.smithi104.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-24T02:10:26.591 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:10:26.591 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-04-24T02:10:26.591 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:10:26.591 INFO:teuthology.orchestra.run.smithi104.stdout:Install 2 Packages 2024-04-24T02:10:26.591 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:10:26.592 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 341 k 2024-04-24T02:10:26.592 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 1.5 M 2024-04-24T02:10:26.592 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-04-24T02:10:26.834 INFO:teuthology.orchestra.run.smithi104.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 444 kB/s | 77 kB 00:00 2024-04-24T02:10:26.901 INFO:teuthology.orchestra.run.smithi104.stdout:(2/2): ceph-volume-19.0.0-2424.gb98aab6c.el9.no 1.1 MB/s | 264 kB 00:00 2024-04-24T02:10:26.902 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-04-24T02:10:26.902 INFO:teuthology.orchestra.run.smithi104.stdout:Total 1.1 MB/s | 341 kB 00:00 2024-04-24T02:10:26.913 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-04-24T02:10:26.922 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-04-24T02:10:26.923 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-04-24T02:10:26.948 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-04-24T02:10:26.949 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-04-24T02:10:27.091 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-04-24T02:10:27.260 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-04-24T02:10:27.295 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-volume-2:19.0.0-2424.gb98aab6c.el9.noarch 2/2 2024-04-24T02:10:27.310 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-volume-2:19.0.0-2424.gb98aab6c.el9.noarch 2/2 2024-04-24T02:10:27.310 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T02:10:27.310 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-24T02:10:27.310 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:10:28.016 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-volume-2:19.0.0-2424.gb98aab6c.el9.noarch 1/2 2024-04-24T02:10:28.091 INFO:teuthology.orchestra.run.smithi134.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 1.1 MB/s | 5.1 MB 00:04 2024-04-24T02:10:28.307 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-04-24T02:10:28.307 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:10:28.307 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-04-24T02:10:28.307 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-volume-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T02:10:28.308 INFO:teuthology.orchestra.run.smithi104.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-24T02:10:28.308 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:10:28.308 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-04-24T02:10:28.617 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install librados-devel 2024-04-24T02:10:29.138 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:01:37 ago on Wed 24 Apr 2024 02:08:52 AM UTC. 2024-04-24T02:10:29.262 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-04-24T02:10:29.263 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:10:29.263 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repo Size 2024-04-24T02:10:29.263 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:10:29.263 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-04-24T02:10:29.263 INFO:teuthology.orchestra.run.smithi104.stdout: librados-devel x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 127 k 2024-04-24T02:10:29.263 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:10:29.263 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-04-24T02:10:29.264 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:10:29.264 INFO:teuthology.orchestra.run.smithi104.stdout:Install 1 Package 2024-04-24T02:10:29.264 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:10:29.264 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 127 k 2024-04-24T02:10:29.264 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 456 k 2024-04-24T02:10:29.264 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-04-24T02:10:29.465 INFO:teuthology.orchestra.run.smithi104.stdout:librados-devel-19.0.0-2424.gb98aab6c.el9.x86_64 631 kB/s | 127 kB 00:00 2024-04-24T02:10:29.465 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-04-24T02:10:29.466 INFO:teuthology.orchestra.run.smithi104.stdout:Total 627 kB/s | 127 kB 00:00 2024-04-24T02:10:29.466 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-04-24T02:10:29.471 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-04-24T02:10:29.471 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-04-24T02:10:29.535 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-04-24T02:10:29.535 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-04-24T02:10:29.692 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-04-24T02:10:29.794 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : librados-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T02:10:30.213 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librados-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T02:10:30.455 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librados-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T02:10:30.455 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:10:30.455 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-04-24T02:10:30.455 INFO:teuthology.orchestra.run.smithi104.stdout: librados-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:10:30.455 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:10:30.455 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-04-24T02:10:30.682 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install libcephfs2 2024-04-24T02:10:31.200 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:01:39 ago on Wed 24 Apr 2024 02:08:52 AM UTC. 2024-04-24T02:10:31.280 INFO:teuthology.orchestra.run.smithi104.stdout:Package libcephfs2-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T02:10:31.322 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-04-24T02:10:31.323 INFO:teuthology.orchestra.run.smithi104.stdout:Nothing to do. 2024-04-24T02:10:31.323 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-04-24T02:10:31.405 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install libcephfs-devel 2024-04-24T02:10:31.927 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:01:39 ago on Wed 24 Apr 2024 02:08:52 AM UTC. 2024-04-24T02:10:32.047 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-04-24T02:10:32.048 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:10:32.048 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repo Size 2024-04-24T02:10:32.048 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:10:32.048 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-04-24T02:10:32.048 INFO:teuthology.orchestra.run.smithi104.stdout: libcephfs-devel x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 32 k 2024-04-24T02:10:32.048 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:10:32.048 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-04-24T02:10:32.048 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:10:32.048 INFO:teuthology.orchestra.run.smithi104.stdout:Install 1 Package 2024-04-24T02:10:32.049 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:10:32.049 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 32 k 2024-04-24T02:10:32.049 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 142 k 2024-04-24T02:10:32.049 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-04-24T02:10:32.293 INFO:teuthology.orchestra.run.smithi104.stdout:libcephfs-devel-19.0.0-2424.gb98aab6c.el9.x86_6 130 kB/s | 32 kB 00:00 2024-04-24T02:10:32.293 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-04-24T02:10:32.294 INFO:teuthology.orchestra.run.smithi104.stdout:Total 129 kB/s | 32 kB 00:00 2024-04-24T02:10:32.294 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-04-24T02:10:32.297 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-04-24T02:10:32.297 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-04-24T02:10:32.300 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-04-24T02:10:32.300 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-04-24T02:10:32.388 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-04-24T02:10:32.505 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libcephfs-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T02:10:32.850 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T02:10:33.062 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libcephfs-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T02:10:33.062 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:10:33.062 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-04-24T02:10:33.062 INFO:teuthology.orchestra.run.smithi104.stdout: libcephfs-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:10:33.062 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:10:33.062 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-04-24T02:10:33.232 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install librados2 2024-04-24T02:10:33.737 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:01:41 ago on Wed 24 Apr 2024 02:08:52 AM UTC. 2024-04-24T02:10:33.817 INFO:teuthology.orchestra.run.smithi104.stdout:Package librados2-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T02:10:33.859 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-04-24T02:10:33.860 INFO:teuthology.orchestra.run.smithi104.stdout:Nothing to do. 2024-04-24T02:10:33.860 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-04-24T02:10:33.925 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install librbd1 2024-04-24T02:10:34.436 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:01:42 ago on Wed 24 Apr 2024 02:08:52 AM UTC. 2024-04-24T02:10:34.515 INFO:teuthology.orchestra.run.smithi104.stdout:Package librbd1-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T02:10:34.554 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-04-24T02:10:34.555 INFO:teuthology.orchestra.run.smithi104.stdout:Nothing to do. 2024-04-24T02:10:34.556 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-04-24T02:10:34.621 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install python3-rados 2024-04-24T02:10:35.132 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:01:43 ago on Wed 24 Apr 2024 02:08:52 AM UTC. 2024-04-24T02:10:35.212 INFO:teuthology.orchestra.run.smithi104.stdout:Package python3-rados-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T02:10:35.253 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-04-24T02:10:35.254 INFO:teuthology.orchestra.run.smithi104.stdout:Nothing to do. 2024-04-24T02:10:35.254 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-04-24T02:10:35.325 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install python3-rgw 2024-04-24T02:10:35.836 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:01:43 ago on Wed 24 Apr 2024 02:08:52 AM UTC. 2024-04-24T02:10:35.915 INFO:teuthology.orchestra.run.smithi104.stdout:Package python3-rgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T02:10:35.958 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-04-24T02:10:35.959 INFO:teuthology.orchestra.run.smithi104.stdout:Nothing to do. 2024-04-24T02:10:35.959 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-04-24T02:10:36.021 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install python3-cephfs 2024-04-24T02:10:36.532 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:01:44 ago on Wed 24 Apr 2024 02:08:52 AM UTC. 2024-04-24T02:10:36.611 INFO:teuthology.orchestra.run.smithi104.stdout:Package python3-cephfs-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T02:10:36.651 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-04-24T02:10:36.652 INFO:teuthology.orchestra.run.smithi104.stdout:Nothing to do. 2024-04-24T02:10:36.652 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-04-24T02:10:36.716 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install python3-rbd 2024-04-24T02:10:37.225 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:01:45 ago on Wed 24 Apr 2024 02:08:52 AM UTC. 2024-04-24T02:10:37.304 INFO:teuthology.orchestra.run.smithi104.stdout:Package python3-rbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T02:10:37.345 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-04-24T02:10:37.346 INFO:teuthology.orchestra.run.smithi104.stdout:Nothing to do. 2024-04-24T02:10:37.346 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-04-24T02:10:37.407 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install rbd-fuse 2024-04-24T02:10:37.916 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:01:45 ago on Wed 24 Apr 2024 02:08:52 AM UTC. 2024-04-24T02:10:38.036 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-04-24T02:10:38.037 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:10:38.037 INFO:teuthology.orchestra.run.smithi104.stdout: Package Architecture Version Repository Size 2024-04-24T02:10:38.037 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:10:38.037 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-04-24T02:10:38.038 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-fuse x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 86 k 2024-04-24T02:10:38.038 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:10:38.038 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-04-24T02:10:38.038 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:10:38.038 INFO:teuthology.orchestra.run.smithi104.stdout:Install 1 Package 2024-04-24T02:10:38.038 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:10:38.038 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 86 k 2024-04-24T02:10:38.038 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 231 k 2024-04-24T02:10:38.038 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-04-24T02:10:38.250 INFO:teuthology.orchestra.run.smithi104.stdout:rbd-fuse-19.0.0-2424.gb98aab6c.el9.x86_64.rpm 412 kB/s | 86 kB 00:00 2024-04-24T02:10:38.250 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-04-24T02:10:38.250 INFO:teuthology.orchestra.run.smithi104.stdout:Total 409 kB/s | 86 kB 00:00 2024-04-24T02:10:38.250 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-04-24T02:10:38.254 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-04-24T02:10:38.254 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-04-24T02:10:38.315 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-04-24T02:10:38.315 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-04-24T02:10:38.459 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-04-24T02:10:38.567 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : rbd-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T02:10:38.910 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: rbd-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T02:10:38.923 INFO:teuthology.orchestra.run.smithi134.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 1.1 MB/s | 16 MB 00:14 2024-04-24T02:10:38.925 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-04-24T02:10:38.925 INFO:teuthology.orchestra.run.smithi134.stdout:Total 2.1 MB/s | 38 MB 00:17 2024-04-24T02:10:39.187 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : rbd-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T02:10:39.187 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:10:39.187 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-04-24T02:10:39.188 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:10:39.188 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:10:39.188 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-04-24T02:10:39.280 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-04-24T02:10:39.307 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-04-24T02:10:39.307 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-04-24T02:10:39.420 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install rbd-mirror 2024-04-24T02:10:39.717 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-04-24T02:10:39.717 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-04-24T02:10:39.941 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:01:47 ago on Wed 24 Apr 2024 02:08:52 AM UTC. 2024-04-24T02:10:40.070 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-04-24T02:10:40.070 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:10:40.070 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repo Size 2024-04-24T02:10:40.070 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:10:40.070 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-04-24T02:10:40.071 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-mirror x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 3.1 M 2024-04-24T02:10:40.071 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:10:40.071 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-04-24T02:10:40.071 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:10:40.071 INFO:teuthology.orchestra.run.smithi104.stdout:Install 1 Package 2024-04-24T02:10:40.071 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:10:40.072 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 3.1 M 2024-04-24T02:10:40.072 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 13 M 2024-04-24T02:10:40.072 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-04-24T02:10:40.545 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-04-24T02:10:40.612 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-04-24T02:10:40.616 INFO:teuthology.orchestra.run.smithi104.stdout:rbd-mirror-19.0.0-2424.gb98aab6c.el9.x86_64.rpm 5.7 MB/s | 3.1 MB 00:00 2024-04-24T02:10:40.617 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-04-24T02:10:40.617 INFO:teuthology.orchestra.run.smithi104.stdout:Total 5.7 MB/s | 3.1 MB 00:00 2024-04-24T02:10:40.617 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-04-24T02:10:40.626 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-04-24T02:10:40.626 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-04-24T02:10:40.663 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-04-24T02:10:40.711 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-04-24T02:10:40.711 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-04-24T02:10:40.763 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-04-24T02:10:40.807 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-04-24T02:10:40.986 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-24T02:10:41.022 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-24T02:10:41.098 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-24T02:10:41.157 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-04-24T02:10:41.317 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : rbd-mirror-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T02:10:41.343 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T02:10:41.343 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T02:10:41.343 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-24T02:10:41.343 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-24T02:10:41.343 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-24T02:10:41.344 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:10:41.751 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-24T02:10:41.877 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-24T02:10:42.343 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : rbd-mirror-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T02:10:42.343 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:10:42.343 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-04-24T02:10:42.343 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-mirror-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:10:42.343 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:10:42.343 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-04-24T02:10:42.583 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install rbd-nbd 2024-04-24T02:10:43.098 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-24T02:10:43.114 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:01:51 ago on Wed 24 Apr 2024 02:08:52 AM UTC. 2024-04-24T02:10:43.238 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-04-24T02:10:43.239 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:10:43.239 INFO:teuthology.orchestra.run.smithi104.stdout: Package Architecture Version Repository Size 2024-04-24T02:10:43.239 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:10:43.239 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-04-24T02:10:43.239 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-nbd x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 170 k 2024-04-24T02:10:43.239 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:10:43.239 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-04-24T02:10:43.240 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-24T02:10:43.240 INFO:teuthology.orchestra.run.smithi104.stdout:Install 1 Package 2024-04-24T02:10:43.240 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:10:43.240 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 170 k 2024-04-24T02:10:43.240 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 494 k 2024-04-24T02:10:43.240 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-04-24T02:10:43.594 INFO:teuthology.orchestra.run.smithi104.stdout:rbd-nbd-19.0.0-2424.gb98aab6c.el9.x86_64.rpm 481 kB/s | 170 kB 00:00 2024-04-24T02:10:43.595 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-04-24T02:10:43.595 INFO:teuthology.orchestra.run.smithi104.stdout:Total 479 kB/s | 170 kB 00:00 2024-04-24T02:10:43.595 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-04-24T02:10:43.603 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-04-24T02:10:43.603 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-04-24T02:10:43.667 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-04-24T02:10:43.667 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-04-24T02:10:43.818 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-04-24T02:10:43.924 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : rbd-nbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T02:10:44.158 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-24T02:10:44.188 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2424.gb98aa 12/12 2024-04-24T02:10:44.327 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: rbd-nbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T02:10:44.570 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : rbd-nbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T02:10:44.570 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:10:44.570 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-04-24T02:10:44.570 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-nbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:10:44.570 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:10:44.570 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-04-24T02:10:44.787 DEBUG:teuthology.parallel:result is None 2024-04-24T02:10:46.470 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2424.gb98aa 12/12 2024-04-24T02:10:46.470 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2424.gb98aa 1/12 2024-04-24T02:10:46.470 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-24T02:10:46.470 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-04-24T02:10:46.470 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-04-24T02:10:46.470 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-04-24T02:10:46.470 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-04-24T02:10:46.470 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-04-24T02:10:46.470 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-04-24T02:10:46.471 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-04-24T02:10:46.471 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-04-24T02:10:46.471 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-04-24T02:10:46.828 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-04-24T02:10:46.828 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:10:46.828 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-04-24T02:10:46.828 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T02:10:46.828 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-24T02:10:46.828 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-24T02:10:46.828 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-24T02:10:46.828 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-24T02:10:46.828 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-24T02:10:46.829 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-24T02:10:46.829 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-24T02:10:46.829 INFO:teuthology.orchestra.run.smithi134.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-24T02:10:46.829 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-24T02:10:46.829 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-24T02:10:46.829 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-24T02:10:46.829 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:10:46.829 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-24T02:10:47.230 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr-rook 2024-04-24T02:10:47.747 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:33 ago on Wed 24 Apr 2024 02:09:14 AM UTC. 2024-04-24T02:10:47.868 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-24T02:10:47.869 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:10:47.869 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-04-24T02:10:47.869 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:10:47.869 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-04-24T02:10:47.869 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 49 k 2024-04-24T02:10:47.869 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-04-24T02:10:47.869 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-24T02:10:47.869 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-24T02:10:47.870 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-24T02:10:47.870 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-24T02:10:47.870 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-24T02:10:47.870 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-24T02:10:47.870 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-24T02:10:47.870 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-24T02:10:47.870 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-24T02:10:47.870 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-24T02:10:47.870 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-24T02:10:47.870 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-24T02:10:47.870 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:10:47.870 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-04-24T02:10:47.870 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:10:47.870 INFO:teuthology.orchestra.run.smithi134.stdout:Install 13 Packages 2024-04-24T02:10:47.871 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:10:47.871 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 2.2 M 2024-04-24T02:10:47.871 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 26 M 2024-04-24T02:10:47.871 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-04-24T02:10:48.524 INFO:teuthology.orchestra.run.smithi134.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 134 kB/s | 19 kB 00:00 2024-04-24T02:10:48.549 INFO:teuthology.orchestra.run.smithi134.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 153 kB/s | 26 kB 00:00 2024-04-24T02:10:48.574 INFO:teuthology.orchestra.run.smithi134.stdout:(3/13): ceph-mgr-rook-19.0.0-2424.gb98aab6c.el9 255 kB/s | 49 kB 00:00 2024-04-24T02:10:48.675 INFO:teuthology.orchestra.run.smithi134.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.4 MB/s | 222 kB 00:00 2024-04-24T02:10:48.700 INFO:teuthology.orchestra.run.smithi134.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.0 MB/s | 159 kB 00:00 2024-04-24T02:10:48.725 INFO:teuthology.orchestra.run.smithi134.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-04-24T02:10:48.901 INFO:teuthology.orchestra.run.smithi134.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 161 kB/s | 32 kB 00:00 2024-04-24T02:10:48.926 INFO:teuthology.orchestra.run.smithi134.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 85 kB/s | 15 kB 00:00 2024-04-24T02:10:48.952 INFO:teuthology.orchestra.run.smithi134.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 740 kB/s | 279 kB 00:00 2024-04-24T02:10:49.018 INFO:teuthology.orchestra.run.smithi134.stdout:(10/13): python3-google-auth-2.29.0-1.el9.noarc 1.7 MB/s | 206 kB 00:00 2024-04-24T02:10:49.060 INFO:teuthology.orchestra.run.smithi134.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 2.1 MB/s | 90 kB 00:00 2024-04-24T02:10:49.160 INFO:teuthology.orchestra.run.smithi134.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 283 kB/s | 59 kB 00:00 2024-04-24T02:10:49.227 INFO:teuthology.orchestra.run.smithi134.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 3.4 MB/s | 1.0 MB 00:00 2024-04-24T02:10:49.230 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-04-24T02:10:49.230 INFO:teuthology.orchestra.run.smithi134.stdout:Total 1.6 MB/s | 2.2 MB 00:01 2024-04-24T02:10:49.292 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-04-24T02:10:49.307 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-04-24T02:10:49.307 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-04-24T02:10:49.392 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-04-24T02:10:49.394 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-04-24T02:10:49.895 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-04-24T02:10:50.058 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-24T02:10:50.112 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-24T02:10:50.168 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-24T02:10:50.205 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-24T02:10:50.246 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-24T02:10:50.340 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-24T02:10:50.457 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-04-24T02:10:50.514 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-24T02:10:51.230 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-24T02:10:51.279 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-24T02:10:51.313 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-24T02:10:51.361 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-24T02:10:51.382 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-rook-2:19.0.0-2424.gb98aab6c.el9.noarch 13/13 2024-04-24T02:10:52.118 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2424.gb98aab6c.el9.noarch 13/13 2024-04-24T02:10:52.118 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2424.gb98aab6c.el9.noarch 1/13 2024-04-24T02:10:52.118 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-24T02:10:52.118 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-24T02:10:52.119 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-24T02:10:52.119 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-24T02:10:52.119 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-24T02:10:52.119 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-24T02:10:52.119 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-24T02:10:52.119 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-24T02:10:52.119 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-04-24T02:10:52.119 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-24T02:10:52.119 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-24T02:10:52.428 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-24T02:10:52.428 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:10:52.428 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-04-24T02:10:52.429 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T02:10:52.429 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-24T02:10:52.429 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-24T02:10:52.429 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-24T02:10:52.429 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-24T02:10:52.429 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-24T02:10:52.429 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-24T02:10:52.429 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-24T02:10:52.429 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-24T02:10:52.429 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-24T02:10:52.429 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-24T02:10:52.429 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-24T02:10:52.429 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-24T02:10:52.429 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:10:52.430 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-24T02:10:52.690 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr-cephadm 2024-04-24T02:10:53.211 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:39 ago on Wed 24 Apr 2024 02:09:14 AM UTC. 2024-04-24T02:10:53.329 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-24T02:10:53.330 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:10:53.330 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-04-24T02:10:53.330 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:10:53.330 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-04-24T02:10:53.330 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 141 k 2024-04-24T02:10:53.331 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-04-24T02:10:53.331 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-24T02:10:53.331 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-24T02:10:53.331 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-24T02:10:53.331 INFO:teuthology.orchestra.run.smithi134.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-24T02:10:53.331 INFO:teuthology.orchestra.run.smithi134.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-24T02:10:53.331 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:10:53.331 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-04-24T02:10:53.331 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:10:53.331 INFO:teuthology.orchestra.run.smithi134.stdout:Install 6 Packages 2024-04-24T02:10:53.331 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:10:53.332 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 7.0 M 2024-04-24T02:10:53.332 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 33 M 2024-04-24T02:10:53.332 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-04-24T02:10:54.114 INFO:teuthology.orchestra.run.smithi134.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.6 MB/s | 248 kB 00:00 2024-04-24T02:10:54.181 INFO:teuthology.orchestra.run.smithi134.stdout:(2/6): ceph-mgr-cephadm-19.0.0-2424.gb98aab6c.e 661 kB/s | 141 kB 00:00 2024-04-24T02:10:54.273 INFO:teuthology.orchestra.run.smithi134.stdout:(3/6): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 6.0 MB 00:00 2024-04-24T02:10:54.365 INFO:teuthology.orchestra.run.smithi134.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 314 kB/s | 58 kB 00:00 2024-04-24T02:10:54.390 INFO:teuthology.orchestra.run.smithi134.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 437 kB/s | 51 kB 00:00 2024-04-24T02:10:54.432 INFO:teuthology.orchestra.run.smithi134.stdout:(6/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 1.7 MB/s | 548 kB 00:00 2024-04-24T02:10:54.432 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-04-24T02:10:54.433 INFO:teuthology.orchestra.run.smithi134.stdout:Total 6.3 MB/s | 7.0 MB 00:01 2024-04-24T02:10:54.503 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-04-24T02:10:54.514 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-04-24T02:10:54.515 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-04-24T02:10:54.610 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-04-24T02:10:54.610 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-04-24T02:10:54.923 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-04-24T02:10:55.088 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-24T02:10:55.142 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-24T02:10:55.656 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-24T02:10:55.745 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-24T02:10:55.808 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-24T02:10:55.838 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 6/6 2024-04-24T02:10:56.635 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 6/6 2024-04-24T02:10:56.636 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 1/6 2024-04-24T02:10:56.636 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-24T02:10:56.636 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-24T02:10:56.636 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-24T02:10:56.636 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-24T02:10:56.874 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-24T02:10:56.874 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:10:56.874 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-04-24T02:10:56.875 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T02:10:56.875 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-24T02:10:56.875 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-24T02:10:56.875 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-24T02:10:56.875 INFO:teuthology.orchestra.run.smithi134.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-24T02:10:56.875 INFO:teuthology.orchestra.run.smithi134.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-24T02:10:56.875 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:10:56.875 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-24T02:10:57.129 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-fuse 2024-04-24T02:10:57.640 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:43 ago on Wed 24 Apr 2024 02:09:14 AM UTC. 2024-04-24T02:10:57.760 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-24T02:10:57.761 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:10:57.761 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-04-24T02:10:57.761 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:10:57.761 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-04-24T02:10:57.761 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 889 k 2024-04-24T02:10:57.761 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-04-24T02:10:57.761 INFO:teuthology.orchestra.run.smithi134.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-24T02:10:57.761 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:10:57.762 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-04-24T02:10:57.762 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:10:57.762 INFO:teuthology.orchestra.run.smithi134.stdout:Install 2 Packages 2024-04-24T02:10:57.762 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:10:57.762 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 969 k 2024-04-24T02:10:57.763 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 2.8 M 2024-04-24T02:10:57.763 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-04-24T02:10:58.118 INFO:teuthology.orchestra.run.smithi134.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 482 kB/s | 80 kB 00:00 2024-04-24T02:10:58.243 INFO:teuthology.orchestra.run.smithi134.stdout:(2/2): ceph-fuse-19.0.0-2424.gb98aab6c.el9.x86_ 3.0 MB/s | 889 kB 00:00 2024-04-24T02:10:58.243 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-04-24T02:10:58.243 INFO:teuthology.orchestra.run.smithi134.stdout:Total 2.0 MB/s | 969 kB 00:00 2024-04-24T02:10:58.255 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-04-24T02:10:58.276 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-04-24T02:10:58.276 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-04-24T02:10:58.354 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-04-24T02:10:58.354 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-04-24T02:10:58.541 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-04-24T02:10:58.678 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-24T02:10:58.749 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 2/2 2024-04-24T02:10:59.388 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 2/2 2024-04-24T02:10:59.388 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/2 2024-04-24T02:10:59.627 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-24T02:10:59.627 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:10:59.627 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-04-24T02:10:59.627 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-24T02:10:59.628 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:10:59.628 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-24T02:10:59.922 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-volume 2024-04-24T02:11:00.441 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:46 ago on Wed 24 Apr 2024 02:09:14 AM UTC. 2024-04-24T02:11:00.564 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-24T02:11:00.565 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:11:00.565 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-04-24T02:11:00.565 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:11:00.565 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-04-24T02:11:00.565 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-volume noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 264 k 2024-04-24T02:11:00.565 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-04-24T02:11:00.565 INFO:teuthology.orchestra.run.smithi134.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-24T02:11:00.566 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:00.566 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-04-24T02:11:00.566 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:11:00.566 INFO:teuthology.orchestra.run.smithi134.stdout:Install 2 Packages 2024-04-24T02:11:00.566 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:00.567 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 341 k 2024-04-24T02:11:00.567 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 1.5 M 2024-04-24T02:11:00.567 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-04-24T02:11:01.373 INFO:teuthology.orchestra.run.smithi134.stdout:(1/2): ceph-volume-19.0.0-2424.gb98aab6c.el9.no 553 kB/s | 264 kB 00:00 2024-04-24T02:11:01.398 INFO:teuthology.orchestra.run.smithi134.stdout:(2/2): python3-packaging-20.9-5.el9.noarch.rpm 154 kB/s | 77 kB 00:00 2024-04-24T02:11:01.399 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-04-24T02:11:01.399 INFO:teuthology.orchestra.run.smithi134.stdout:Total 409 kB/s | 341 kB 00:00 2024-04-24T02:11:01.412 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-04-24T02:11:01.421 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-04-24T02:11:01.421 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-04-24T02:11:01.448 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-04-24T02:11:01.448 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-04-24T02:11:01.594 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-04-24T02:11:01.772 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-04-24T02:11:01.801 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-volume-2:19.0.0-2424.gb98aab6c.el9.noarch 2/2 2024-04-24T02:11:01.816 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-volume-2:19.0.0-2424.gb98aab6c.el9.noarch 2/2 2024-04-24T02:11:01.817 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T02:11:01.817 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-24T02:11:01.817 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:02.492 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-volume-2:19.0.0-2424.gb98aab6c.el9.noarch 1/2 2024-04-24T02:11:02.790 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-04-24T02:11:02.791 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:02.791 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-04-24T02:11:02.791 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-volume-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T02:11:02.791 INFO:teuthology.orchestra.run.smithi134.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-24T02:11:02.791 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:02.791 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-24T02:11:03.128 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install librados-devel 2024-04-24T02:11:03.650 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:49 ago on Wed 24 Apr 2024 02:09:14 AM UTC. 2024-04-24T02:11:03.774 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-24T02:11:03.775 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:11:03.775 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repo Size 2024-04-24T02:11:03.775 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:11:03.775 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-04-24T02:11:03.775 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 127 k 2024-04-24T02:11:03.775 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:03.776 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-04-24T02:11:03.776 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:11:03.776 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-04-24T02:11:03.776 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:03.776 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 127 k 2024-04-24T02:11:03.776 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 456 k 2024-04-24T02:11:03.776 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-04-24T02:11:04.272 INFO:teuthology.orchestra.run.smithi134.stdout:librados-devel-19.0.0-2424.gb98aab6c.el9.x86_64 256 kB/s | 127 kB 00:00 2024-04-24T02:11:04.273 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-04-24T02:11:04.273 INFO:teuthology.orchestra.run.smithi134.stdout:Total 255 kB/s | 127 kB 00:00 2024-04-24T02:11:04.274 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-04-24T02:11:04.279 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-04-24T02:11:04.279 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-04-24T02:11:04.344 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-04-24T02:11:04.344 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-04-24T02:11:04.494 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-04-24T02:11:04.610 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librados-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T02:11:05.015 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T02:11:05.230 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T02:11:05.230 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:05.230 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-04-24T02:11:05.230 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:11:05.231 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:05.231 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-24T02:11:05.478 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install libcephfs2 2024-04-24T02:11:05.991 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:51 ago on Wed 24 Apr 2024 02:09:14 AM UTC. 2024-04-24T02:11:06.070 INFO:teuthology.orchestra.run.smithi134.stdout:Package libcephfs2-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T02:11:06.111 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-24T02:11:06.111 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-04-24T02:11:06.112 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-24T02:11:06.188 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install libcephfs-devel 2024-04-24T02:11:06.707 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:52 ago on Wed 24 Apr 2024 02:09:14 AM UTC. 2024-04-24T02:11:06.827 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-24T02:11:06.828 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:11:06.828 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repo Size 2024-04-24T02:11:06.828 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:11:06.828 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-04-24T02:11:06.828 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 32 k 2024-04-24T02:11:06.828 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:06.828 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-04-24T02:11:06.828 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:11:06.828 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-04-24T02:11:06.828 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:06.828 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 32 k 2024-04-24T02:11:06.829 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 142 k 2024-04-24T02:11:06.829 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-04-24T02:11:07.001 INFO:teuthology.orchestra.run.smithi134.stdout:libcephfs-devel-19.0.0-2424.gb98aab6c.el9.x86_6 183 kB/s | 32 kB 00:00 2024-04-24T02:11:07.002 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-04-24T02:11:07.002 INFO:teuthology.orchestra.run.smithi134.stdout:Total 182 kB/s | 32 kB 00:00 2024-04-24T02:11:07.002 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-04-24T02:11:07.006 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-04-24T02:11:07.006 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-04-24T02:11:07.008 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-04-24T02:11:07.008 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-04-24T02:11:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-04-24T02:11:07.197 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T02:11:07.567 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T02:11:07.775 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T02:11:07.775 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:07.775 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-04-24T02:11:07.775 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:11:07.775 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:07.775 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-24T02:11:07.979 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install librados2 2024-04-24T02:11:08.490 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:54 ago on Wed 24 Apr 2024 02:09:14 AM UTC. 2024-04-24T02:11:08.569 INFO:teuthology.orchestra.run.smithi134.stdout:Package librados2-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T02:11:08.611 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-24T02:11:08.612 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-04-24T02:11:08.612 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-24T02:11:08.691 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install librbd1 2024-04-24T02:11:09.205 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:55 ago on Wed 24 Apr 2024 02:09:14 AM UTC. 2024-04-24T02:11:09.286 INFO:teuthology.orchestra.run.smithi134.stdout:Package librbd1-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T02:11:09.327 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-24T02:11:09.328 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-04-24T02:11:09.328 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-24T02:11:09.407 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install python3-rados 2024-04-24T02:11:09.918 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:55 ago on Wed 24 Apr 2024 02:09:14 AM UTC. 2024-04-24T02:11:09.998 INFO:teuthology.orchestra.run.smithi134.stdout:Package python3-rados-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T02:11:10.039 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-24T02:11:10.040 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-04-24T02:11:10.040 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-24T02:11:10.124 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install python3-rgw 2024-04-24T02:11:10.637 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:56 ago on Wed 24 Apr 2024 02:09:14 AM UTC. 2024-04-24T02:11:10.717 INFO:teuthology.orchestra.run.smithi134.stdout:Package python3-rgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T02:11:10.757 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-24T02:11:10.758 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-04-24T02:11:10.758 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-24T02:11:10.840 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install python3-cephfs 2024-04-24T02:11:11.355 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:57 ago on Wed 24 Apr 2024 02:09:14 AM UTC. 2024-04-24T02:11:11.435 INFO:teuthology.orchestra.run.smithi134.stdout:Package python3-cephfs-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T02:11:11.475 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-24T02:11:11.476 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-04-24T02:11:11.476 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-24T02:11:11.557 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install python3-rbd 2024-04-24T02:11:12.064 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:58 ago on Wed 24 Apr 2024 02:09:14 AM UTC. 2024-04-24T02:11:12.143 INFO:teuthology.orchestra.run.smithi134.stdout:Package python3-rbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T02:11:12.185 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-24T02:11:12.186 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-04-24T02:11:12.186 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-24T02:11:12.273 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install rbd-fuse 2024-04-24T02:11:12.784 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:58 ago on Wed 24 Apr 2024 02:09:14 AM UTC. 2024-04-24T02:11:12.902 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-24T02:11:12.903 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:11:12.903 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2024-04-24T02:11:12.903 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:11:12.903 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-04-24T02:11:12.904 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 86 k 2024-04-24T02:11:12.904 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:12.904 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-04-24T02:11:12.904 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:11:12.904 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-04-24T02:11:12.904 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:12.904 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 86 k 2024-04-24T02:11:12.904 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 231 k 2024-04-24T02:11:12.904 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-04-24T02:11:13.105 INFO:teuthology.orchestra.run.smithi134.stdout:rbd-fuse-19.0.0-2424.gb98aab6c.el9.x86_64.rpm 427 kB/s | 86 kB 00:00 2024-04-24T02:11:13.105 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-04-24T02:11:13.105 INFO:teuthology.orchestra.run.smithi134.stdout:Total 424 kB/s | 86 kB 00:00 2024-04-24T02:11:13.106 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-04-24T02:11:13.113 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-04-24T02:11:13.113 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-04-24T02:11:13.175 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-04-24T02:11:13.175 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-04-24T02:11:13.321 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-04-24T02:11:13.426 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T02:11:13.772 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: rbd-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T02:11:14.010 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T02:11:14.010 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:14.010 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-04-24T02:11:14.010 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:11:14.010 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:14.010 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-24T02:11:14.297 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install rbd-mirror 2024-04-24T02:11:14.810 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:00 ago on Wed 24 Apr 2024 02:09:14 AM UTC. 2024-04-24T02:11:14.932 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-24T02:11:14.933 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:11:14.933 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repo Size 2024-04-24T02:11:14.933 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:11:14.933 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-04-24T02:11:14.933 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 3.1 M 2024-04-24T02:11:14.933 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:14.933 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-04-24T02:11:14.933 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:11:14.933 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-04-24T02:11:14.933 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:14.934 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 3.1 M 2024-04-24T02:11:14.934 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 13 M 2024-04-24T02:11:14.934 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-04-24T02:11:15.584 INFO:teuthology.orchestra.run.smithi134.stdout:rbd-mirror-19.0.0-2424.gb98aab6c.el9.x86_64.rpm 4.8 MB/s | 3.1 MB 00:00 2024-04-24T02:11:15.585 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-04-24T02:11:15.585 INFO:teuthology.orchestra.run.smithi134.stdout:Total 4.7 MB/s | 3.1 MB 00:00 2024-04-24T02:11:15.585 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-04-24T02:11:15.594 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-04-24T02:11:15.594 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-04-24T02:11:15.676 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-04-24T02:11:15.676 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-04-24T02:11:16.105 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-04-24T02:11:16.176 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-mirror-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T02:11:16.200 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T02:11:16.201 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T02:11:16.201 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-24T02:11:16.201 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-24T02:11:16.201 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-24T02:11:16.201 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:17.216 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-mirror-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T02:11:17.216 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:17.216 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-04-24T02:11:17.216 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:11:17.217 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:17.217 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-24T02:11:17.470 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install rbd-nbd 2024-04-24T02:11:17.994 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:03 ago on Wed 24 Apr 2024 02:09:14 AM UTC. 2024-04-24T02:11:18.117 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-24T02:11:18.118 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:11:18.118 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2024-04-24T02:11:18.118 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:11:18.118 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-04-24T02:11:18.118 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 170 k 2024-04-24T02:11:18.118 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:18.118 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-04-24T02:11:18.118 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-24T02:11:18.118 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-04-24T02:11:18.118 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:18.118 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 170 k 2024-04-24T02:11:18.118 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 494 k 2024-04-24T02:11:18.118 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-04-24T02:11:18.713 INFO:teuthology.orchestra.run.smithi134.stdout:rbd-nbd-19.0.0-2424.gb98aab6c.el9.x86_64.rpm 286 kB/s | 170 kB 00:00 2024-04-24T02:11:18.714 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-04-24T02:11:18.714 INFO:teuthology.orchestra.run.smithi134.stdout:Total 285 kB/s | 170 kB 00:00 2024-04-24T02:11:18.714 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-04-24T02:11:18.722 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-04-24T02:11:18.722 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-04-24T02:11:18.787 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-04-24T02:11:18.788 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-04-24T02:11:18.936 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-04-24T02:11:19.043 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-nbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T02:11:19.461 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: rbd-nbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T02:11:19.712 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-nbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T02:11:19.712 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:19.713 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-04-24T02:11:19.713 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T02:11:19.713 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:19.713 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-24T02:11:19.942 DEBUG:teuthology.parallel:result is None 2024-04-24T02:11:19.943 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b98aab6c00f483888c049d0d8e7bc507e115dd86 2024-04-24T02:11:20.083 DEBUG:teuthology.orchestra.run.smithi104:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-24T02:11:20.108 INFO:teuthology.orchestra.run.smithi104.stdout:19.0.0-2424.gb98aab6c.el9 2024-04-24T02:11:20.108 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2424.gb98aab6c.el9 2024-04-24T02:11:20.109 INFO:teuthology.task.install:The correct ceph version 19.0.0-2424.gb98aab6c is installed. 2024-04-24T02:11:20.110 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b98aab6c00f483888c049d0d8e7bc507e115dd86 2024-04-24T02:11:20.331 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-24T02:11:20.352 INFO:teuthology.orchestra.run.smithi134.stdout:19.0.0-2424.gb98aab6c.el9 2024-04-24T02:11:20.353 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2424.gb98aab6c.el9 2024-04-24T02:11:20.353 INFO:teuthology.task.install:The correct ceph version 19.0.0-2424.gb98aab6c is installed. 2024-04-24T02:11:20.354 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-24T02:11:20.355 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-24T02:11:20.355 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-24T02:11:20.384 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-24T02:11:20.384 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-24T02:11:20.418 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-24T02:11:20.419 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-24T02:11:20.419 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/usr/bin/daemon-helper 2024-04-24T02:11:20.450 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-24T02:11:20.516 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-24T02:11:20.516 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/daemon-helper 2024-04-24T02:11:20.541 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-24T02:11:20.604 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-24T02:11:20.604 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-24T02:11:20.605 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-24T02:11:20.629 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-24T02:11:20.702 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-24T02:11:20.702 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-24T02:11:20.727 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-24T02:11:20.791 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-24T02:11:20.791 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-24T02:11:20.791 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/usr/bin/stdin-killer 2024-04-24T02:11:20.815 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-24T02:11:20.877 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-24T02:11:20.877 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/stdin-killer 2024-04-24T02:11:20.901 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-24T02:11:20.966 INFO:teuthology.run_tasks:Running task ceph... 2024-04-24T02:11:21.051 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-24T02:11:21.051 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 777 /var/log/ceph 2024-04-24T02:11:21.054 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 777 /var/log/ceph 2024-04-24T02:11:21.077 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-24T02:11:21.077 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-24T02:11:21.118 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-24T02:11:21.141 INFO:tasks.ceph:Creating extra log directories... 2024-04-24T02:11:21.141 DEBUG:teuthology.orchestra.run.smithi104:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-24T02:11:21.182 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-24T02:11:21.213 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-24T02:11:21.213 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-24T02:11:21.213 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-23_21:40:02-rgw-squid-distro-default-smithi/7670635', 'branch': 'squid', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{centos_latest}}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7670635', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-04-23_21:40:02-rgw-squid-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'b98aab6c00f483888c049d0d8e7bc507e115dd86'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b98aab6c00f483888c049d0d8e7bc507e115dd86'}}, 'rgw': {'ec-data-pool': False, 'frontend': 'beast'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'b98aab6c00f483888c049d0d8e7bc507e115dd86'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 9360, 'sha1': 'b98aab6c00f483888c049d0d8e7bc507e115dd86', 'sleep_before_teardown': 0, 'subset': '0/1', 'suite': 'rgw', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_b98aab6c00f483888c049d0d8e7bc507e115dd86/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'b98aab6c00f483888c049d0d8e7bc507e115dd86', 'targets': {'smithi104.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGwtG9kkzPz1OTPhkI7ugiOt3KXAEm8B9YTmY0xsE2Seo45njjttxFXQQ6Qg7CHkNKhpmInrMPcMPDdB9TOfJTY=', 'smithi134.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOh+qNKFEc4dxfDKB6ihDq0rYuatBqXSon1ACmd1T1PerUt3zh6hWsx1UaD901Pi1u5dqqYNVjdVEvbcQDtVwok='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'b98aab6c00f483888c049d0d8e7bc507e115dd86', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-23_21:40:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-24T02:11:21.214 DEBUG:teuthology.orchestra.run.smithi104:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-24T02:11:21.246 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-24T02:11:21.260 DEBUG:teuthology.orchestra.run.smithi104:> sudo install -d -m0777 -- /var/run/ceph 2024-04-24T02:11:21.301 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m0777 -- /var/run/ceph 2024-04-24T02:11:21.325 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-24T02:11:21.325 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/scratch_devs of=/dev/stdout 2024-04-24T02:11:21.378 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-24T02:11:21.378 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_1 2024-04-24T02:11:21.432 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-24T02:11:21.432 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T02:11:21.432 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-04-24T02:11:21.432 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T02:11:21.432 INFO:teuthology.orchestra.run.smithi104.stdout:Context: system_u:object_r:device_t:s0 2024-04-24T02:11:21.432 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-04-24 02:10:41.626200040 +0000 2024-04-24T02:11:21.432 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-04-24 02:08:06.150503986 +0000 2024-04-24T02:11:21.432 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-04-24 02:08:06.150503986 +0000 2024-04-24T02:11:21.432 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: 2024-04-24 02:08:06.150503986 +0000 2024-04-24T02:11:21.433 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-24T02:11:21.493 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-04-24T02:11:21.493 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-04-24T02:11:21.493 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.000184365 s, 2.8 MB/s 2024-04-24T02:11:21.494 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-24T02:11:21.550 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_2 2024-04-24T02:11:21.604 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-24T02:11:21.604 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T02:11:21.604 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-04-24T02:11:21.604 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T02:11:21.604 INFO:teuthology.orchestra.run.smithi104.stdout:Context: system_u:object_r:device_t:s0 2024-04-24T02:11:21.604 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-04-24 02:10:41.626200040 +0000 2024-04-24T02:11:21.604 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-04-24 02:08:06.486500023 +0000 2024-04-24T02:11:21.604 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-04-24 02:08:06.486500023 +0000 2024-04-24T02:11:21.604 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: 2024-04-24 02:08:06.486500023 +0000 2024-04-24T02:11:21.604 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-24T02:11:21.665 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-04-24T02:11:21.665 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-04-24T02:11:21.665 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.000197778 s, 2.6 MB/s 2024-04-24T02:11:21.666 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-24T02:11:21.721 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_3 2024-04-24T02:11:21.776 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-24T02:11:21.776 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T02:11:21.776 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-04-24T02:11:21.776 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T02:11:21.776 INFO:teuthology.orchestra.run.smithi104.stdout:Context: system_u:object_r:device_t:s0 2024-04-24T02:11:21.776 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-04-24 02:10:41.627200029 +0000 2024-04-24T02:11:21.776 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-04-24 02:08:06.824496037 +0000 2024-04-24T02:11:21.776 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-04-24 02:08:06.824496037 +0000 2024-04-24T02:11:21.776 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: 2024-04-24 02:08:06.824496037 +0000 2024-04-24T02:11:21.777 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-24T02:11:21.837 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-04-24T02:11:21.837 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-04-24T02:11:21.837 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.000179097 s, 2.9 MB/s 2024-04-24T02:11:21.839 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-24T02:11:21.895 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_4 2024-04-24T02:11:21.949 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-24T02:11:21.949 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T02:11:21.950 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-04-24T02:11:21.950 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T02:11:21.950 INFO:teuthology.orchestra.run.smithi104.stdout:Context: system_u:object_r:device_t:s0 2024-04-24T02:11:21.950 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-04-24 02:10:41.627200029 +0000 2024-04-24T02:11:21.950 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-04-24 02:08:07.156492122 +0000 2024-04-24T02:11:21.950 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-04-24 02:08:07.156492122 +0000 2024-04-24T02:11:21.950 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: 2024-04-24 02:08:07.156492122 +0000 2024-04-24T02:11:21.950 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-24T02:11:22.012 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-04-24T02:11:22.012 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-04-24T02:11:22.012 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.000237917 s, 2.2 MB/s 2024-04-24T02:11:22.013 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-24T02:11:22.069 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-24T02:11:22.069 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-24T02:11:22.069 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/scratch_devs of=/dev/stdout 2024-04-24T02:11:22.085 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-24T02:11:22.085 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_1 2024-04-24T02:11:22.139 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-24T02:11:22.139 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T02:11:22.139 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-04-24T02:11:22.140 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T02:11:22.140 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-04-24T02:11:22.140 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-04-24 02:11:16.449954770 +0000 2024-04-24T02:11:22.140 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-04-24 02:08:06.153013345 +0000 2024-04-24T02:11:22.140 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-04-24 02:08:06.153013345 +0000 2024-04-24T02:11:22.140 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-04-24 02:08:06.153013345 +0000 2024-04-24T02:11:22.140 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-24T02:11:22.202 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-04-24T02:11:22.202 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-04-24T02:11:22.202 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000193314 s, 2.6 MB/s 2024-04-24T02:11:22.203 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-24T02:11:22.259 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_2 2024-04-24T02:11:22.315 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-24T02:11:22.315 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T02:11:22.315 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-04-24T02:11:22.315 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T02:11:22.315 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-04-24T02:11:22.315 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-04-24 02:11:16.449954770 +0000 2024-04-24T02:11:22.315 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-04-24 02:08:06.494005272 +0000 2024-04-24T02:11:22.315 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-04-24 02:08:06.494005272 +0000 2024-04-24T02:11:22.315 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-04-24 02:08:06.494005272 +0000 2024-04-24T02:11:22.316 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-24T02:11:22.377 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-04-24T02:11:22.378 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-04-24T02:11:22.378 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000173129 s, 3.0 MB/s 2024-04-24T02:11:22.379 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-24T02:11:22.434 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_3 2024-04-24T02:11:22.488 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-24T02:11:22.488 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T02:11:22.488 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-24T02:11:22.488 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T02:11:22.488 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-04-24T02:11:22.488 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-04-24 02:11:16.449954770 +0000 2024-04-24T02:11:22.489 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-04-24 02:08:06.839997080 +0000 2024-04-24T02:11:22.489 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-04-24 02:08:06.839997080 +0000 2024-04-24T02:11:22.489 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-04-24 02:08:06.839997080 +0000 2024-04-24T02:11:22.489 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-24T02:11:22.550 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-04-24T02:11:22.550 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-04-24T02:11:22.550 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000212614 s, 2.4 MB/s 2024-04-24T02:11:22.551 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-24T02:11:22.607 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_4 2024-04-24T02:11:22.661 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-24T02:11:22.661 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T02:11:22.661 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-04-24T02:11:22.662 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T02:11:22.662 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-04-24T02:11:22.662 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-04-24 02:11:16.450954747 +0000 2024-04-24T02:11:22.662 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-04-24 02:08:07.177989077 +0000 2024-04-24T02:11:22.662 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-04-24 02:08:07.177989077 +0000 2024-04-24T02:11:22.662 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-04-24 02:08:07.177989077 +0000 2024-04-24T02:11:22.662 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-24T02:11:22.723 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-04-24T02:11:22.723 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-04-24T02:11:22.723 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000207717 s, 2.5 MB/s 2024-04-24T02:11:22.724 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-24T02:11:22.780 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-04-24T02:11:22.781 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi104.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi134.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-04-24T02:11:22.781 INFO:tasks.ceph:Generating config... 2024-04-24T02:11:22.782 INFO:tasks.ceph:[client] debug ms = 1 2024-04-24T02:11:22.782 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-04-24T02:11:22.782 INFO:tasks.ceph:[client] debug rgw = 20 2024-04-24T02:11:22.782 INFO:tasks.ceph:[client] setgroup = ceph 2024-04-24T02:11:22.782 INFO:tasks.ceph:[client] setuser = ceph 2024-04-24T02:11:22.782 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-24T02:11:22.782 INFO:tasks.ceph:[osd] debug objclass = 20 2024-04-24T02:11:22.782 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-24T02:11:22.782 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-24T02:11:22.783 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-24T02:11:22.783 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-24T02:11:22.783 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-24T02:11:22.783 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-24T02:11:22.783 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-24T02:11:22.783 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-24T02:11:22.783 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-24T02:11:22.783 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-24T02:11:22.783 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-24T02:11:22.783 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-24T02:11:22.783 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-24T02:11:22.783 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-24T02:11:22.783 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-24T02:11:22.783 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-24T02:11:22.784 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-24T02:11:22.784 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-24T02:11:22.784 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-24T02:11:22.784 INFO:tasks.ceph:Setting up mon.a... 2024-04-24T02:11:22.784 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-24T02:11:22.836 INFO:teuthology.orchestra.run.smithi104.stdout:creating /etc/ceph/ceph.keyring 2024-04-24T02:11:22.839 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-24T02:11:22.879 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-24T02:11:22.944 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.104')] 2024-04-24T02:11:22.944 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.104'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-04-24T02:11:22.945 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-24T02:11:22.946 DEBUG:teuthology.orchestra.run.smithi104:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-24T02:11:22.998 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.104 --print /home/ubuntu/cephtest/ceph.monmap 2024-04-24T02:11:23.076 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:11:23.076 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:11:23.077 INFO:teuthology.orchestra.run.smithi104.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-24T02:11:23.077 INFO:teuthology.orchestra.run.smithi104.stdout:monmaptool: generated fsid b09461c3-8f3e-4967-89da-98f6945a4445 2024-04-24T02:11:23.077 INFO:teuthology.orchestra.run.smithi104.stdout:setting min_mon_release = quincy 2024-04-24T02:11:23.077 INFO:teuthology.orchestra.run.smithi104.stdout:epoch 0 2024-04-24T02:11:23.077 INFO:teuthology.orchestra.run.smithi104.stdout:fsid b09461c3-8f3e-4967-89da-98f6945a4445 2024-04-24T02:11:23.077 INFO:teuthology.orchestra.run.smithi104.stdout:last_changed 2024-04-24T02:11:23.077104+0000 2024-04-24T02:11:23.077 INFO:teuthology.orchestra.run.smithi104.stdout:created 2024-04-24T02:11:23.077104+0000 2024-04-24T02:11:23.077 INFO:teuthology.orchestra.run.smithi104.stdout:min_mon_release 17 (quincy) 2024-04-24T02:11:23.078 INFO:teuthology.orchestra.run.smithi104.stdout:election_strategy: 1 2024-04-24T02:11:23.078 INFO:teuthology.orchestra.run.smithi104.stdout:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-24T02:11:23.078 INFO:teuthology.orchestra.run.smithi104.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-04-24T02:11:23.079 DEBUG:teuthology.orchestra.run.smithi104:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-24T02:11:23.133 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID b09461c3-8f3e-4967-89da-98f6945a4445... 2024-04-24T02:11:23.134 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-24T02:11:23.175 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-24T02:11:23.212 INFO:teuthology.orchestra.run.smithi104.stdout:[global] 2024-04-24T02:11:23.212 INFO:teuthology.orchestra.run.smithi104.stdout: chdir = "" 2024-04-24T02:11:23.212 INFO:teuthology.orchestra.run.smithi104.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-24T02:11:23.212 INFO:teuthology.orchestra.run.smithi104.stdout: auth supported = cephx 2024-04-24T02:11:23.212 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:11:23.212 INFO:teuthology.orchestra.run.smithi104.stdout: filestore xattr use omap = true 2024-04-24T02:11:23.212 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:11:23.212 INFO:teuthology.orchestra.run.smithi104.stdout: mon clock drift allowed = 1.000 2024-04-24T02:11:23.212 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:11:23.212 INFO:teuthology.orchestra.run.smithi104.stdout: osd crush chooseleaf type = 0 2024-04-24T02:11:23.213 INFO:teuthology.orchestra.run.smithi104.stdout: auth debug = true 2024-04-24T02:11:23.213 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:11:23.213 INFO:teuthology.orchestra.run.smithi104.stdout: ms die on old message = true 2024-04-24T02:11:23.213 INFO:teuthology.orchestra.run.smithi104.stdout: ms die on bug = true 2024-04-24T02:11:23.213 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:11:23.213 INFO:teuthology.orchestra.run.smithi104.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-24T02:11:23.213 INFO:teuthology.orchestra.run.smithi104.stdout: mon pg warn max object skew = 0 2024-04-24T02:11:23.213 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:11:23.213 INFO:teuthology.orchestra.run.smithi104.stdout: # disable pg_autoscaler by default for new pools 2024-04-24T02:11:23.213 INFO:teuthology.orchestra.run.smithi104.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-24T02:11:23.213 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:11:23.213 INFO:teuthology.orchestra.run.smithi104.stdout: osd pool default size = 2 2024-04-24T02:11:23.213 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:11:23.213 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd allow primary affinity = true 2024-04-24T02:11:23.213 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd allow pg remap = true 2024-04-24T02:11:23.213 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on legacy crush tunables = false 2024-04-24T02:11:23.214 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on crush straw calc version zero = false 2024-04-24T02:11:23.214 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on no sortbitwise = false 2024-04-24T02:11:23.214 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on osd down out interval zero = false 2024-04-24T02:11:23.214 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on too few osds = false 2024-04-24T02:11:23.214 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-24T02:11:23.214 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-24T02:11:23.214 INFO:teuthology.orchestra.run.smithi104.stdout: mon_allow_pool_size_one = true 2024-04-24T02:11:23.214 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:11:23.214 INFO:teuthology.orchestra.run.smithi104.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-24T02:11:23.214 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:11:23.214 INFO:teuthology.orchestra.run.smithi104.stdout: osd default data pool replay window = 5 2024-04-24T02:11:23.214 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:11:23.214 INFO:teuthology.orchestra.run.smithi104.stdout: mon allow pool delete = true 2024-04-24T02:11:23.214 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:11:23.215 INFO:teuthology.orchestra.run.smithi104.stdout: mon cluster log file level = debug 2024-04-24T02:11:23.215 INFO:teuthology.orchestra.run.smithi104.stdout: debug asserts on shutdown = true 2024-04-24T02:11:23.215 INFO:teuthology.orchestra.run.smithi104.stdout: mon health detail to clog = false 2024-04-24T02:11:23.215 INFO:teuthology.orchestra.run.smithi104.stdout: mon host = 172.21.15.104 2024-04-24T02:11:23.215 INFO:teuthology.orchestra.run.smithi104.stdout: fsid = b09461c3-8f3e-4967-89da-98f6945a4445 2024-04-24T02:11:23.215 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:11:23.215 INFO:teuthology.orchestra.run.smithi104.stdout:[osd] 2024-04-24T02:11:23.215 INFO:teuthology.orchestra.run.smithi104.stdout: osd journal size = 100 2024-04-24T02:11:23.215 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:11:23.215 INFO:teuthology.orchestra.run.smithi104.stdout: osd scrub load threshold = 5.0 2024-04-24T02:11:23.215 INFO:teuthology.orchestra.run.smithi104.stdout: osd scrub max interval = 600 2024-04-24T02:11:23.215 INFO:teuthology.orchestra.run.smithi104.stdout: osd mclock profile = high_recovery_ops 2024-04-24T02:11:23.215 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:11:23.215 INFO:teuthology.orchestra.run.smithi104.stdout: osd recover clone overlap = true 2024-04-24T02:11:23.215 INFO:teuthology.orchestra.run.smithi104.stdout: osd recovery max chunk = 1048576 2024-04-24T02:11:23.215 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:11:23.216 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug shutdown = true 2024-04-24T02:11:23.216 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug op order = true 2024-04-24T02:11:23.216 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug verify stray on activate = true 2024-04-24T02:11:23.216 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug trim objects = true 2024-04-24T02:11:23.216 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:11:23.216 INFO:teuthology.orchestra.run.smithi104.stdout: osd open classes on start = true 2024-04-24T02:11:23.216 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug pg log writeout = true 2024-04-24T02:11:23.216 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:11:23.216 INFO:teuthology.orchestra.run.smithi104.stdout: osd deep scrub update digest min age = 30 2024-04-24T02:11:23.216 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:11:23.216 INFO:teuthology.orchestra.run.smithi104.stdout: osd map max advance = 10 2024-04-24T02:11:23.216 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:11:23.216 INFO:teuthology.orchestra.run.smithi104.stdout: journal zero on create = true 2024-04-24T02:11:23.216 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:11:23.217 INFO:teuthology.orchestra.run.smithi104.stdout: filestore ondisk finisher threads = 3 2024-04-24T02:11:23.217 INFO:teuthology.orchestra.run.smithi104.stdout: filestore apply finisher threads = 3 2024-04-24T02:11:23.217 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:11:23.217 INFO:teuthology.orchestra.run.smithi104.stdout: bdev debug aio = true 2024-04-24T02:11:23.217 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug misdirected ops = true 2024-04-24T02:11:23.217 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2024-04-24T02:11:23.217 INFO:teuthology.orchestra.run.smithi104.stdout: debug objclass = 20 2024-04-24T02:11:23.217 INFO:teuthology.orchestra.run.smithi104.stdout: bdev async discard = True 2024-04-24T02:11:23.217 INFO:teuthology.orchestra.run.smithi104.stdout: bdev enable discard = True 2024-04-24T02:11:23.217 INFO:teuthology.orchestra.run.smithi104.stdout: bluestore allocator = bitmap 2024-04-24T02:11:23.217 INFO:teuthology.orchestra.run.smithi104.stdout: bluestore block size = 96636764160 2024-04-24T02:11:23.217 INFO:teuthology.orchestra.run.smithi104.stdout: bluestore fsck on mount = True 2024-04-24T02:11:23.217 INFO:teuthology.orchestra.run.smithi104.stdout: debug bluefs = 1/20 2024-04-24T02:11:23.217 INFO:teuthology.orchestra.run.smithi104.stdout: debug bluestore = 1/20 2024-04-24T02:11:23.217 INFO:teuthology.orchestra.run.smithi104.stdout: debug osd = 20 2024-04-24T02:11:23.217 INFO:teuthology.orchestra.run.smithi104.stdout: debug rocksdb = 4/10 2024-04-24T02:11:23.218 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd backfillfull_ratio = 0.85 2024-04-24T02:11:23.218 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd full ratio = 0.9 2024-04-24T02:11:23.218 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd nearfull ratio = 0.8 2024-04-24T02:11:23.218 INFO:teuthology.orchestra.run.smithi104.stdout: osd failsafe full ratio = 0.95 2024-04-24T02:11:23.218 INFO:teuthology.orchestra.run.smithi104.stdout: osd objectstore = bluestore 2024-04-24T02:11:23.218 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:11:23.218 INFO:teuthology.orchestra.run.smithi104.stdout:[mgr] 2024-04-24T02:11:23.218 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2024-04-24T02:11:23.218 INFO:teuthology.orchestra.run.smithi104.stdout: debug mgr = 20 2024-04-24T02:11:23.218 INFO:teuthology.orchestra.run.smithi104.stdout: debug mon = 20 2024-04-24T02:11:23.218 INFO:teuthology.orchestra.run.smithi104.stdout: debug auth = 20 2024-04-24T02:11:23.218 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min pgs per osd = 4 2024-04-24T02:11:23.218 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min bytes per osd = 10 2024-04-24T02:11:23.218 INFO:teuthology.orchestra.run.smithi104.stdout: mgr/telemetry/nag = false 2024-04-24T02:11:23.219 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:11:23.219 INFO:teuthology.orchestra.run.smithi104.stdout:[mon] 2024-04-24T02:11:23.219 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2024-04-24T02:11:23.219 INFO:teuthology.orchestra.run.smithi104.stdout: debug mon = 20 2024-04-24T02:11:23.219 INFO:teuthology.orchestra.run.smithi104.stdout: debug paxos = 20 2024-04-24T02:11:23.219 INFO:teuthology.orchestra.run.smithi104.stdout: debug auth = 20 2024-04-24T02:11:23.219 INFO:teuthology.orchestra.run.smithi104.stdout: mon data avail warn = 5 2024-04-24T02:11:23.219 INFO:teuthology.orchestra.run.smithi104.stdout: mon mgr mkfs grace = 240 2024-04-24T02:11:23.219 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min pgs per osd = 4 2024-04-24T02:11:23.219 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd reporter subtree level = osd 2024-04-24T02:11:23.219 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd prime pg temp = true 2024-04-24T02:11:23.219 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min bytes per osd = 10 2024-04-24T02:11:23.219 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:11:23.219 INFO:teuthology.orchestra.run.smithi104.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-24T02:11:23.220 INFO:teuthology.orchestra.run.smithi104.stdout: auth mon ticket ttl = 660 # 11m 2024-04-24T02:11:23.220 INFO:teuthology.orchestra.run.smithi104.stdout: auth service ticket ttl = 240 # 4m 2024-04-24T02:11:23.220 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:11:23.220 INFO:teuthology.orchestra.run.smithi104.stdout: # don't complain about insecure global_id in the test suite 2024-04-24T02:11:23.220 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-24T02:11:23.220 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-24T02:11:23.220 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:11:23.220 INFO:teuthology.orchestra.run.smithi104.stdout: # 1m isn't quite enough 2024-04-24T02:11:23.220 INFO:teuthology.orchestra.run.smithi104.stdout: mon_down_mkfs_grace = 2m 2024-04-24T02:11:23.220 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:11:23.220 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_filestore_osds = false 2024-04-24T02:11:23.220 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:11:23.220 INFO:teuthology.orchestra.run.smithi104.stdout:[client] 2024-04-24T02:11:23.220 INFO:teuthology.orchestra.run.smithi104.stdout: rgw cache enabled = true 2024-04-24T02:11:23.220 INFO:teuthology.orchestra.run.smithi104.stdout: rgw enable ops log = true 2024-04-24T02:11:23.221 INFO:teuthology.orchestra.run.smithi104.stdout: rgw enable usage log = true 2024-04-24T02:11:23.221 INFO:teuthology.orchestra.run.smithi104.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-24T02:11:23.221 INFO:teuthology.orchestra.run.smithi104.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-24T02:11:23.221 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2024-04-24T02:11:23.221 INFO:teuthology.orchestra.run.smithi104.stdout: rgw gc obj min wait = 15 2024-04-24T02:11:23.221 INFO:teuthology.orchestra.run.smithi104.stdout: debug rgw = 20 2024-04-24T02:11:23.221 INFO:teuthology.orchestra.run.smithi104.stdout: setgroup = ceph 2024-04-24T02:11:23.221 INFO:teuthology.orchestra.run.smithi104.stdout: setuser = ceph 2024-04-24T02:11:23.221 INFO:teuthology.orchestra.run.smithi104.stdout:[mon.a] 2024-04-24T02:11:23.221 INFO:teuthology.orchestra.run.smithi134.stdout:[global] 2024-04-24T02:11:23.221 INFO:teuthology.orchestra.run.smithi134.stdout: chdir = "" 2024-04-24T02:11:23.222 INFO:teuthology.orchestra.run.smithi134.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-24T02:11:23.222 INFO:teuthology.orchestra.run.smithi134.stdout: auth supported = cephx 2024-04-24T02:11:23.222 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:23.222 INFO:teuthology.orchestra.run.smithi134.stdout: filestore xattr use omap = true 2024-04-24T02:11:23.222 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:23.222 INFO:teuthology.orchestra.run.smithi134.stdout: mon clock drift allowed = 1.000 2024-04-24T02:11:23.222 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:23.222 INFO:teuthology.orchestra.run.smithi134.stdout: osd crush chooseleaf type = 0 2024-04-24T02:11:23.222 INFO:teuthology.orchestra.run.smithi134.stdout: auth debug = true 2024-04-24T02:11:23.222 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:23.222 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on old message = true 2024-04-24T02:11:23.222 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on bug = true 2024-04-24T02:11:23.222 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:23.222 INFO:teuthology.orchestra.run.smithi134.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-24T02:11:23.223 INFO:teuthology.orchestra.run.smithi134.stdout: mon pg warn max object skew = 0 2024-04-24T02:11:23.223 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:23.223 INFO:teuthology.orchestra.run.smithi134.stdout: # disable pg_autoscaler by default for new pools 2024-04-24T02:11:23.223 INFO:teuthology.orchestra.run.smithi134.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-24T02:11:23.223 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:23.223 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default size = 2 2024-04-24T02:11:23.223 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:23.223 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow primary affinity = true 2024-04-24T02:11:23.223 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow pg remap = true 2024-04-24T02:11:23.223 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on legacy crush tunables = false 2024-04-24T02:11:23.223 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on crush straw calc version zero = false 2024-04-24T02:11:23.223 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on no sortbitwise = false 2024-04-24T02:11:23.223 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on osd down out interval zero = false 2024-04-24T02:11:23.223 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on too few osds = false 2024-04-24T02:11:23.223 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-24T02:11:23.224 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-24T02:11:23.224 INFO:teuthology.orchestra.run.smithi134.stdout: mon_allow_pool_size_one = true 2024-04-24T02:11:23.224 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:23.224 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-24T02:11:23.224 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:23.224 INFO:teuthology.orchestra.run.smithi134.stdout: osd default data pool replay window = 5 2024-04-24T02:11:23.224 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:23.224 INFO:teuthology.orchestra.run.smithi134.stdout: mon allow pool delete = true 2024-04-24T02:11:23.224 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:23.224 INFO:teuthology.orchestra.run.smithi134.stdout: mon cluster log file level = debug 2024-04-24T02:11:23.224 INFO:teuthology.orchestra.run.smithi134.stdout: debug asserts on shutdown = true 2024-04-24T02:11:23.224 INFO:teuthology.orchestra.run.smithi134.stdout: mon health detail to clog = false 2024-04-24T02:11:23.225 INFO:teuthology.orchestra.run.smithi134.stdout: mon host = 172.21.15.104 2024-04-24T02:11:23.225 INFO:teuthology.orchestra.run.smithi134.stdout: fsid = b09461c3-8f3e-4967-89da-98f6945a4445 2024-04-24T02:11:23.225 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:23.225 INFO:teuthology.orchestra.run.smithi134.stdout:[osd] 2024-04-24T02:11:23.225 INFO:teuthology.orchestra.run.smithi134.stdout: osd journal size = 100 2024-04-24T02:11:23.225 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:23.225 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub load threshold = 5.0 2024-04-24T02:11:23.225 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub max interval = 600 2024-04-24T02:11:23.225 INFO:teuthology.orchestra.run.smithi134.stdout: osd mclock profile = high_recovery_ops 2024-04-24T02:11:23.225 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:23.225 INFO:teuthology.orchestra.run.smithi134.stdout: osd recover clone overlap = true 2024-04-24T02:11:23.225 INFO:teuthology.orchestra.run.smithi134.stdout: osd recovery max chunk = 1048576 2024-04-24T02:11:23.225 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:23.225 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug shutdown = true 2024-04-24T02:11:23.226 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug op order = true 2024-04-24T02:11:23.226 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug verify stray on activate = true 2024-04-24T02:11:23.226 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug trim objects = true 2024-04-24T02:11:23.226 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:23.226 INFO:teuthology.orchestra.run.smithi134.stdout: osd open classes on start = true 2024-04-24T02:11:23.226 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug pg log writeout = true 2024-04-24T02:11:23.226 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:23.226 INFO:teuthology.orchestra.run.smithi134.stdout: osd deep scrub update digest min age = 30 2024-04-24T02:11:23.226 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:23.226 INFO:teuthology.orchestra.run.smithi134.stdout: osd map max advance = 10 2024-04-24T02:11:23.226 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:23.226 INFO:teuthology.orchestra.run.smithi134.stdout: journal zero on create = true 2024-04-24T02:11:23.226 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:23.227 INFO:teuthology.orchestra.run.smithi134.stdout: filestore ondisk finisher threads = 3 2024-04-24T02:11:23.227 INFO:teuthology.orchestra.run.smithi134.stdout: filestore apply finisher threads = 3 2024-04-24T02:11:23.227 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:23.227 INFO:teuthology.orchestra.run.smithi134.stdout: bdev debug aio = true 2024-04-24T02:11:23.227 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug misdirected ops = true 2024-04-24T02:11:23.227 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-04-24T02:11:23.227 INFO:teuthology.orchestra.run.smithi134.stdout: debug objclass = 20 2024-04-24T02:11:23.227 INFO:teuthology.orchestra.run.smithi134.stdout: bdev async discard = True 2024-04-24T02:11:23.227 INFO:teuthology.orchestra.run.smithi134.stdout: bdev enable discard = True 2024-04-24T02:11:23.227 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore allocator = bitmap 2024-04-24T02:11:23.227 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore block size = 96636764160 2024-04-24T02:11:23.227 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore fsck on mount = True 2024-04-24T02:11:23.227 INFO:teuthology.orchestra.run.smithi134.stdout: debug bluefs = 1/20 2024-04-24T02:11:23.227 INFO:teuthology.orchestra.run.smithi134.stdout: debug bluestore = 1/20 2024-04-24T02:11:23.228 INFO:teuthology.orchestra.run.smithi134.stdout: debug osd = 20 2024-04-24T02:11:23.228 INFO:teuthology.orchestra.run.smithi134.stdout: debug rocksdb = 4/10 2024-04-24T02:11:23.228 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd backfillfull_ratio = 0.85 2024-04-24T02:11:23.228 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd full ratio = 0.9 2024-04-24T02:11:23.228 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd nearfull ratio = 0.8 2024-04-24T02:11:23.228 INFO:teuthology.orchestra.run.smithi134.stdout: osd failsafe full ratio = 0.95 2024-04-24T02:11:23.228 INFO:teuthology.orchestra.run.smithi134.stdout: osd objectstore = bluestore 2024-04-24T02:11:23.228 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:23.228 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr] 2024-04-24T02:11:23.228 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-04-24T02:11:23.228 INFO:teuthology.orchestra.run.smithi134.stdout: debug mgr = 20 2024-04-24T02:11:23.229 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2024-04-24T02:11:23.229 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2024-04-24T02:11:23.229 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2024-04-24T02:11:23.229 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2024-04-24T02:11:23.229 INFO:teuthology.orchestra.run.smithi134.stdout: mgr/telemetry/nag = false 2024-04-24T02:11:23.229 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:23.229 INFO:teuthology.orchestra.run.smithi134.stdout:[mon] 2024-04-24T02:11:23.229 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-04-24T02:11:23.229 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2024-04-24T02:11:23.229 INFO:teuthology.orchestra.run.smithi134.stdout: debug paxos = 20 2024-04-24T02:11:23.229 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2024-04-24T02:11:23.229 INFO:teuthology.orchestra.run.smithi134.stdout: mon data avail warn = 5 2024-04-24T02:11:23.229 INFO:teuthology.orchestra.run.smithi134.stdout: mon mgr mkfs grace = 240 2024-04-24T02:11:23.229 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2024-04-24T02:11:23.230 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd reporter subtree level = osd 2024-04-24T02:11:23.230 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd prime pg temp = true 2024-04-24T02:11:23.230 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2024-04-24T02:11:23.230 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:23.230 INFO:teuthology.orchestra.run.smithi134.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-24T02:11:23.230 INFO:teuthology.orchestra.run.smithi134.stdout: auth mon ticket ttl = 660 # 11m 2024-04-24T02:11:23.230 INFO:teuthology.orchestra.run.smithi134.stdout: auth service ticket ttl = 240 # 4m 2024-04-24T02:11:23.230 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:23.230 INFO:teuthology.orchestra.run.smithi134.stdout: # don't complain about insecure global_id in the test suite 2024-04-24T02:11:23.230 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-24T02:11:23.230 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-24T02:11:23.230 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:23.231 INFO:teuthology.orchestra.run.smithi134.stdout: # 1m isn't quite enough 2024-04-24T02:11:23.231 INFO:teuthology.orchestra.run.smithi134.stdout: mon_down_mkfs_grace = 2m 2024-04-24T02:11:23.231 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:23.231 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_filestore_osds = false 2024-04-24T02:11:23.231 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-24T02:11:23.231 INFO:teuthology.orchestra.run.smithi134.stdout:[client] 2024-04-24T02:11:23.231 INFO:teuthology.orchestra.run.smithi134.stdout: rgw cache enabled = true 2024-04-24T02:11:23.231 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable ops log = true 2024-04-24T02:11:23.231 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable usage log = true 2024-04-24T02:11:23.231 INFO:teuthology.orchestra.run.smithi134.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-24T02:11:23.231 INFO:teuthology.orchestra.run.smithi134.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-24T02:11:23.231 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-04-24T02:11:23.231 INFO:teuthology.orchestra.run.smithi134.stdout: rgw gc obj min wait = 15 2024-04-24T02:11:23.232 INFO:teuthology.orchestra.run.smithi134.stdout: debug rgw = 20 2024-04-24T02:11:23.232 INFO:teuthology.orchestra.run.smithi134.stdout: setgroup = ceph 2024-04-24T02:11:23.232 INFO:teuthology.orchestra.run.smithi134.stdout: setuser = ceph 2024-04-24T02:11:23.232 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.a] 2024-04-24T02:11:23.233 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-24T02:11:23.233 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-24T02:11:23.325 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-24T02:11:23.325 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-24T02:11:23.325 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-24T02:11:23.340 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-24T02:11:23.340 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-24T02:11:23.394 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi104.front.sepia.ceph.com 2024-04-24T02:11:23.394 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-24T02:11:23.394 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-24T02:11:23.394 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-24T02:11:23.466 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-24T02:11:23.466 DEBUG:teuthology.orchestra.run.smithi104:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-24T02:11:23.520 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi134.front.sepia.ceph.com 2024-04-24T02:11:23.521 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-24T02:11:23.521 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-24T02:11:23.521 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-24T02:11:23.554 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-24T02:11:23.555 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-24T02:11:23.610 INFO:tasks.ceph:Setting up mon nodes... 2024-04-24T02:11:23.610 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-24T02:11:23.610 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-24T02:11:23.718 INFO:teuthology.orchestra.run.smithi134.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-24T02:11:23.721 INFO:tasks.ceph:Setting up mds nodes... 2024-04-24T02:11:23.721 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-24T02:11:23.721 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-24T02:11:23.761 INFO:teuthology.orchestra.run.smithi134.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-24T02:11:23.772 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-24T02:11:23.772 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi104.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi134.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-04-24T02:11:23.773 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-24T02:11:23.796 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-24T02:11:23.796 INFO:tasks.ceph:role: osd.0 2024-04-24T02:11:23.796 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi104.front.sepia.ceph.com 2024-04-24T02:11:23.797 DEBUG:teuthology.orchestra.run.smithi104:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-24T02:11:23.868 INFO:teuthology.orchestra.run.smithi104.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T02:11:23.868 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T02:11:23.868 INFO:teuthology.orchestra.run.smithi104.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T02:11:23.868 INFO:teuthology.orchestra.run.smithi104.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-24T02:11:23.868 INFO:teuthology.orchestra.run.smithi104.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T02:11:23.868 INFO:teuthology.orchestra.run.smithi104.stdout: = sunit=0 swidth=0 blks 2024-04-24T02:11:23.868 INFO:teuthology.orchestra.run.smithi104.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T02:11:23.869 INFO:teuthology.orchestra.run.smithi104.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-24T02:11:23.869 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T02:11:23.869 INFO:teuthology.orchestra.run.smithi104.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T02:11:24.379 INFO:teuthology.orchestra.run.smithi104.stdout:Discarding blocks...Done. 2024-04-24T02:11:24.381 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi104.front.sepia.ceph.com -o noatime 2024-04-24T02:11:24.381 DEBUG:teuthology.orchestra.run.smithi104:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-24T02:11:24.500 DEBUG:teuthology.orchestra.run.smithi104:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-24T02:11:24.531 DEBUG:teuthology.orchestra.run.smithi104:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T02:11:24.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:24.623+0000 7f5fd2a21640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-24T02:11:24.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:24.627+0000 7f5fd2a21640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-24T02:11:24.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:24.627+0000 7f5fd2a21640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-24T02:11:24.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:24.627+0000 7f5fd2a21640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-24T02:11:24.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:24.627+0000 7f5fd2a21640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-24T02:11:24.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:24.635+0000 7f5fd2a21640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-24T02:11:27.483 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-24T02:11:27.511 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-24T02:11:27.540 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-04-24T02:11:27.540 INFO:tasks.ceph:role: osd.1 2024-04-24T02:11:27.540 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi134.front.sepia.ceph.com 2024-04-24T02:11:27.540 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-24T02:11:27.614 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T02:11:27.614 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T02:11:27.614 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T02:11:27.614 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-24T02:11:27.614 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T02:11:27.614 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-04-24T02:11:27.614 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T02:11:27.614 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-24T02:11:27.614 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T02:11:27.615 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T02:11:28.110 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-04-24T02:11:28.114 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-04-24T02:11:28.114 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-04-24T02:11:28.247 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-24T02:11:28.281 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-24T02:11:28.347 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-04-24T02:11:28.347 INFO:tasks.ceph:role: osd.2 2024-04-24T02:11:28.347 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi134.front.sepia.ceph.com 2024-04-24T02:11:28.347 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-24T02:11:28.421 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T02:11:28.421 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T02:11:28.421 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T02:11:28.421 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-24T02:11:28.421 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T02:11:28.421 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-04-24T02:11:28.421 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T02:11:28.421 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-24T02:11:28.421 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T02:11:28.421 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T02:11:28.876 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-04-24T02:11:28.878 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-04-24T02:11:28.878 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-04-24T02:11:28.980 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-24T02:11:29.010 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-24T02:11:29.075 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-04-24T02:11:29.075 INFO:tasks.ceph:role: osd.3 2024-04-24T02:11:29.076 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi134.front.sepia.ceph.com 2024-04-24T02:11:29.076 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-24T02:11:29.148 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T02:11:29.148 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T02:11:29.149 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T02:11:29.149 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-24T02:11:29.149 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T02:11:29.149 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-04-24T02:11:29.149 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T02:11:29.149 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-24T02:11:29.149 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T02:11:29.149 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T02:11:29.639 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-04-24T02:11:29.642 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-04-24T02:11:29.642 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-04-24T02:11:29.790 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-24T02:11:29.823 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T02:11:29.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:29.916+0000 7f60a3820640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-24T02:11:29.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:29.919+0000 7f60a3820640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-24T02:11:29.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:29.919+0000 7f60a3820640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-24T02:11:29.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:29.919+0000 7f60a3820640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-24T02:11:29.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:29.919+0000 7f60a3820640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-24T02:11:29.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:29.929+0000 7f60a3820640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-24T02:11:32.778 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-24T02:11:32.805 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T02:11:32.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:32.889+0000 7fdd38c25640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-24T02:11:32.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:32.890+0000 7fdd38c25640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-24T02:11:32.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:32.890+0000 7fdd38c25640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-24T02:11:32.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:32.890+0000 7fdd38c25640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-24T02:11:32.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:32.890+0000 7fdd38c25640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-24T02:11:32.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:32.890+0000 7fdd38c25640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-24T02:11:35.734 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-24T02:11:35.761 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T02:11:35.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:35.846+0000 7f3e8d618640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-24T02:11:35.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:35.846+0000 7f3e8d618640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-24T02:11:35.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:35.846+0000 7f3e8d618640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-24T02:11:35.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:35.846+0000 7f3e8d618640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-24T02:11:35.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:35.846+0000 7f3e8d618640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-24T02:11:35.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:35.847+0000 7f3e8d618640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-24T02:11:38.695 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-24T02:11:38.720 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-24T02:11:38.720 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-24T02:11:38.720 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-24T02:11:38.748 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-24T02:11:38.748 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-24T02:11:38.783 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-24T02:11:38.783 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-24T02:11:38.846 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-24T02:11:38.846 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-24T02:11:38.909 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-24T02:11:38.909 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-24T02:11:38.972 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-24T02:11:38.973 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-24T02:11:39.028 INFO:tasks.ceph:Adding keys to all mons... 2024-04-24T02:11:39.028 DEBUG:teuthology.orchestra.run.smithi104:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-24T02:11:39.054 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.0] 2024-04-24T02:11:39.054 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQBMaihmRYYzJRAA75MOtWfco4me5v/JiFb9hg== 2024-04-24T02:11:39.054 INFO:teuthology.orchestra.run.smithi104.stdout:[mgr.x] 2024-04-24T02:11:39.054 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQBLaihmUkLcKhAAFfm0NUGD36ckK9EAHyyDZw== 2024-04-24T02:11:39.054 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.1] 2024-04-24T02:11:39.054 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQBRaihmxdO7NhAANUMk3I0CQEsE+Zy2ts3R8A== 2024-04-24T02:11:39.055 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.2] 2024-04-24T02:11:39.055 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQBUaihm/HYeNRAAWCFksBwPuWnLCa6UtlSpsw== 2024-04-24T02:11:39.055 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.3] 2024-04-24T02:11:39.055 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQBXaihmVfmBMhAAcL68Jr7y1gmDO9tJ2P4Iyw== 2024-04-24T02:11:39.055 INFO:teuthology.orchestra.run.smithi104.stdout:[client.0] 2024-04-24T02:11:39.055 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQBLaihm25ZhLRAAyXGi3iOn6BVynb5/ZJsgTA== 2024-04-24T02:11:39.056 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T02:11:39.151 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-24T02:11:39.202 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T02:11:39.251 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T02:11:39.299 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T02:11:39.347 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-24T02:11:39.398 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-24T02:11:39.398 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-24T02:11:39.421 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-24T02:11:39.516 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-24T02:11:39.539 DEBUG:teuthology.orchestra.run.smithi104:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-24T02:11:39.593 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-24T02:11:39.594 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-24T02:11:39.594 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-24T02:11:39.636 INFO:tasks.ceph.mon.a:Started 2024-04-24T02:11:39.636 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-24T02:11:39.636 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-24T02:11:39.636 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-24T02:11:39.639 INFO:tasks.ceph.mgr.x:Started 2024-04-24T02:11:39.639 INFO:tasks.ceph:Setting crush tunables to default 2024-04-24T02:11:39.639 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph osd crush tunables default 2024-04-24T02:11:39.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.734+0000 7fbf93ad2640 1 Processor -- start 2024-04-24T02:11:39.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.735+0000 7fbf93ad2640 1 -- start start 2024-04-24T02:11:39.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.735+0000 7fbf93ad2640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fbf8c12ecc0 0x7fbf8c0921e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:39.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.735+0000 7fbf93ad2640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf8c06df20 con 0x7fbf8c12e8e0 2024-04-24T02:11:39.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.735+0000 7fbf93ad2640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fbf8c092b80 con 0x7fbf8c12ecc0 2024-04-24T02:11:39.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.735+0000 7fbf9106d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fbf8c12ecc0 0x7fbf8c0921e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:39.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.735+0000 7fbf9186e640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fbf8c12e8e0 0x7fbf8c091ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:39004/0 (socket says 172.21.15.104:39004) 2024-04-24T02:11:39.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.735+0000 7fbf9186e640 1 -- 172.21.15.104:0/283938495 learned_addr learned my addr 172.21.15.104:0/283938495 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-04-24T02:11:39.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.735+0000 7fbf9106d640 1 -- 172.21.15.104:0/283938495 >> v2:172.21.15.104:3300/0 conn(0x7fbf8c12ecc0 msgr2=0x7fbf8c0921e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-24T02:11:39.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.735+0000 7fbf9106d640 1 -- 172.21.15.104:0/283938495 >> v2:172.21.15.104:3300/0 conn(0x7fbf8c12ecc0 msgr2=0x7fbf8c0921e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-24T02:11:39.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.735+0000 7fbf9106d640 1 --2- 172.21.15.104:0/283938495 >> v2:172.21.15.104:3300/0 conn(0x7fbf8c12ecc0 0x7fbf8c0921e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-24T02:11:39.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.735+0000 7fbf9106d640 1 --2- 172.21.15.104:0/283938495 >> v2:172.21.15.104:3300/0 conn(0x7fbf8c12ecc0 0x7fbf8c0921e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-24T02:11:39.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.737+0000 7fbf9086c640 1 -- 172.21.15.104:0/283938495 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2250740320 0 0) 0x7fbf8c06df20 con 0x7fbf8c12e8e0 2024-04-24T02:11:39.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.737+0000 7fbf9086c640 1 -- 172.21.15.104:0/283938495 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf78003520 con 0x7fbf8c12e8e0 2024-04-24T02:11:39.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.737+0000 7fbf9086c640 1 -- 172.21.15.104:0/283938495 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2649215645 0 0) 0x7fbf78003520 con 0x7fbf8c12e8e0 2024-04-24T02:11:39.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.737+0000 7fbf9086c640 1 -- 172.21.15.104:0/283938495 >> v2:172.21.15.104:3300/0 conn(0x7fbf8c12ecc0 msgr2=0x7fbf8c0921e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-24T02:11:39.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.737+0000 7fbf9086c640 1 --2- 172.21.15.104:0/283938495 >> v2:172.21.15.104:3300/0 conn(0x7fbf8c12ecc0 0x7fbf8c0921e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:39.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.737+0000 7fbf9086c640 1 -- 172.21.15.104:0/283938495 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf8c12e4a0 con 0x7fbf8c12e8e0 2024-04-24T02:11:39.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.737+0000 7fbf9086c640 1 -- 172.21.15.104:0/283938495 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 1653354873 0 0) 0x7fbf880015a0 con 0x7fbf8c12e8e0 2024-04-24T02:11:39.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.737+0000 7fbf9086c640 1 -- 172.21.15.104:0/283938495 >> v1:172.21.15.104:6789/0 conn(0x7fbf8c12e8e0 legacy=0x7fbf8c091ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:39.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.737+0000 7fbf9086c640 1 --2- 172.21.15.104:0/283938495 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf780039b0 0x7fbf78003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:39.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.737+0000 7fbf9086c640 1 -- 172.21.15.104:0/283938495 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fbf8c092b80 con 0x7fbf780039b0 2024-04-24T02:11:39.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.737+0000 7fbf9186e640 1 --2- 172.21.15.104:0/283938495 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf780039b0 0x7fbf78003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:39.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.738+0000 7fbf9186e640 1 -- 172.21.15.104:0/283938495 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf78003520 con 0x7fbf780039b0 2024-04-24T02:11:39.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.739+0000 7fbf9186e640 1 --2- 172.21.15.104:0/283938495 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf780039b0 0x7fbf78003db0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fbf8800c0e0 tx=0x7fbf78005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33a5b4e03975e2ac server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:39.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.740+0000 7fbf9086c640 1 -- 172.21.15.104:0/283938495 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf88007c80 con 0x7fbf780039b0 2024-04-24T02:11:39.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.740+0000 7fbf9086c640 1 -- 172.21.15.104:0/283938495 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf88030070 con 0x7fbf780039b0 2024-04-24T02:11:39.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.740+0000 7fbf9086c640 1 -- 172.21.15.104:0/283938495 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf8802cc70 con 0x7fbf780039b0 2024-04-24T02:11:39.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.740+0000 7fbf93ad2640 1 -- 172.21.15.104:0/283938495 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf780039b0 msgr2=0x7fbf78003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:39.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.740+0000 7fbf93ad2640 1 --2- 172.21.15.104:0/283938495 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf780039b0 0x7fbf78003db0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fbf8800c0e0 tx=0x7fbf78005830 comp rx=0 tx=0).stop 2024-04-24T02:11:39.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.740+0000 7fbf93ad2640 1 -- 172.21.15.104:0/283938495 shutdown_connections 2024-04-24T02:11:39.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.740+0000 7fbf93ad2640 1 --2- 172.21.15.104:0/283938495 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf780039b0 0x7fbf78003db0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:39.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.740+0000 7fbf93ad2640 1 --2- 172.21.15.104:0/283938495 >> v2:172.21.15.104:3300/0 conn(0x7fbf8c12ecc0 0x7fbf8c0921e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:39.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.740+0000 7fbf93ad2640 1 -- 172.21.15.104:0/283938495 >> 172.21.15.104:0/283938495 conn(0x7fbf8c09fe10 msgr2=0x7fbf8c0903b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:39.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.740+0000 7fbf93ad2640 1 -- 172.21.15.104:0/283938495 shutdown_connections 2024-04-24T02:11:39.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.740+0000 7fbf93ad2640 1 -- 172.21.15.104:0/283938495 wait complete. 2024-04-24T02:11:39.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.741+0000 7fbf93ad2640 1 Processor -- start 2024-04-24T02:11:39.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.741+0000 7fbf93ad2640 1 -- start start 2024-04-24T02:11:39.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.742+0000 7fbf93ad2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf780039b0 0x7fbf8c128e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:39.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.742+0000 7fbf93ad2640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fbf8c06dc10 con 0x7fbf780039b0 2024-04-24T02:11:39.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.742+0000 7fbf9186e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf780039b0 0x7fbf8c128e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:39.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.742+0000 7fbf9186e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf780039b0 0x7fbf8c128e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39478/0 (socket says 172.21.15.104:39478) 2024-04-24T02:11:39.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.742+0000 7fbf9186e640 1 -- 172.21.15.104:0/3192958552 learned_addr learned my addr 172.21.15.104:0/3192958552 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:11:39.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.742+0000 7fbf9186e640 1 -- 172.21.15.104:0/3192958552 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf8c072c50 con 0x7fbf780039b0 2024-04-24T02:11:39.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.742+0000 7fbf9186e640 1 --2- 172.21.15.104:0/3192958552 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf780039b0 0x7fbf8c128e60 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fbf88000f60 tx=0x7fbf8c0936a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:39.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.742+0000 7fbf827fc640 1 -- 172.21.15.104:0/3192958552 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf88046070 con 0x7fbf780039b0 2024-04-24T02:11:39.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.742+0000 7fbf827fc640 1 -- 172.21.15.104:0/3192958552 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf88001060 con 0x7fbf780039b0 2024-04-24T02:11:39.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.742+0000 7fbf93ad2640 1 -- 172.21.15.104:0/3192958552 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf8c091460 con 0x7fbf780039b0 2024-04-24T02:11:39.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.742+0000 7fbf827fc640 1 -- 172.21.15.104:0/3192958552 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf88004d70 con 0x7fbf780039b0 2024-04-24T02:11:39.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.742+0000 7fbf93ad2640 1 -- 172.21.15.104:0/3192958552 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf8c1293a0 con 0x7fbf780039b0 2024-04-24T02:11:39.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.742+0000 7fbf827fc640 1 -- 172.21.15.104:0/3192958552 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbf88049070 con 0x7fbf780039b0 2024-04-24T02:11:39.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.742+0000 7fbf827fc640 1 -- 172.21.15.104:0/3192958552 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fbf88041bb0 con 0x7fbf780039b0 2024-04-24T02:11:39.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.743+0000 7fbf93ad2640 1 -- 172.21.15.104:0/3192958552 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf8c062da0 con 0x7fbf780039b0 2024-04-24T02:11:39.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.745+0000 7fbf827fc640 1 -- 172.21.15.104:0/3192958552 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fbf88007070 con 0x7fbf780039b0 2024-04-24T02:11:39.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.808+0000 7fbf93ad2640 1 -- 172.21.15.104:0/3192958552 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fbf8c073430 con 0x7fbf780039b0 2024-04-24T02:11:39.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.808+0000 7fbf827fc640 1 -- 172.21.15.104:0/3192958552 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fbf88007250 con 0x7fbf780039b0 2024-04-24T02:11:39.809 INFO:teuthology.orchestra.run.smithi104.stderr:adjusted tunables profile to default 2024-04-24T02:11:39.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.809+0000 7fbf93ad2640 1 -- 172.21.15.104:0/3192958552 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf780039b0 msgr2=0x7fbf8c128e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:39.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.809+0000 7fbf93ad2640 1 --2- 172.21.15.104:0/3192958552 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf780039b0 0x7fbf8c128e60 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fbf88000f60 tx=0x7fbf8c0936a0 comp rx=0 tx=0).stop 2024-04-24T02:11:39.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.810+0000 7fbf93ad2640 1 -- 172.21.15.104:0/3192958552 shutdown_connections 2024-04-24T02:11:39.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.810+0000 7fbf93ad2640 1 --2- 172.21.15.104:0/3192958552 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf780039b0 0x7fbf8c128e60 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:39.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.810+0000 7fbf93ad2640 1 -- 172.21.15.104:0/3192958552 >> 172.21.15.104:0/3192958552 conn(0x7fbf8c09fe10 msgr2=0x7fbf8c127670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:39.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.810+0000 7fbf93ad2640 1 -- 172.21.15.104:0/3192958552 shutdown_connections 2024-04-24T02:11:39.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:39.810+0000 7fbf93ad2640 1 -- 172.21.15.104:0/3192958552 wait complete. 2024-04-24T02:11:39.821 INFO:tasks.ceph:check_enable_crimson: False 2024-04-24T02:11:39.821 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-24T02:11:39.822 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-24T02:11:39.822 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-24T02:11:39.845 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-24T02:11:39.845 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-24T02:11:39.868 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-24T02:11:39.869 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-24T02:11:39.932 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-24T02:11:39.932 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-24T02:11:39.996 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 505e5915-b411-48c8-b47f-9805fabd0c6e 0 2024-04-24T02:11:40.023 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-24T02:11:40.021+0000 7fdab0041040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-24T02:11:40.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.118+0000 7f45ddc93640 1 Processor -- start 2024-04-24T02:11:40.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.118+0000 7f45ddc93640 1 -- start start 2024-04-24T02:11:40.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.119+0000 7f45ddc93640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f45d806f1f0 0x7f45d806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:40.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.119+0000 7f45ddc93640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45d8121890 con 0x7f45d806fb10 2024-04-24T02:11:40.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.119+0000 7f45ddc93640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f45d8122a70 con 0x7f45d806f1f0 2024-04-24T02:11:40.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.119+0000 7f45d77fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f45d806f1f0 0x7f45d806f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:40.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.119+0000 7f45d77fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f45d806f1f0 0x7f45d806f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:53466/0 (socket says 172.21.15.134:53466) 2024-04-24T02:11:40.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.119+0000 7f45d77fe640 1 -- 172.21.15.134:0/2879529708 learned_addr learned my addr 172.21.15.134:0/2879529708 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:11:40.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.119+0000 7f45cffff640 1 --1- 172.21.15.134:0/2879529708 >> v1:172.21.15.104:6789/0 conn(0x7f45d806fb10 0x7f45d81200e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:42202/0 (socket says 172.21.15.134:42202) 2024-04-24T02:11:40.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.119+0000 7f45d77fe640 1 -- 172.21.15.134:0/2879529708 >> v1:172.21.15.104:6789/0 conn(0x7f45d806fb10 legacy=0x7f45d81200e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:40.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.119+0000 7f45d6ffd640 1 -- 172.21.15.134:0/2879529708 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2102773027 0 0) 0x7f45d8121890 con 0x7f45d806fb10 2024-04-24T02:11:40.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.119+0000 7f45d77fe640 1 -- 172.21.15.134:0/2879529708 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45d8122c20 con 0x7f45d806f1f0 2024-04-24T02:11:40.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.120+0000 7f45d77fe640 1 --2- 172.21.15.134:0/2879529708 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f45d806f1f0 0x7f45d806f5d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f45c80097f0 tx=0x7f45c802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6bfe283e4637cbe server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:40.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.120+0000 7f45d6ffd640 1 -- 172.21.15.134:0/2879529708 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45c8035020 con 0x7f45d806f1f0 2024-04-24T02:11:40.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.120+0000 7f45d6ffd640 1 -- 172.21.15.134:0/2879529708 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45c80317a0 con 0x7f45d806f1f0 2024-04-24T02:11:40.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.120+0000 7f45d6ffd640 1 -- 172.21.15.134:0/2879529708 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45c8031aa0 con 0x7f45d806f1f0 2024-04-24T02:11:40.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.121+0000 7f45ddc93640 1 -- 172.21.15.134:0/2879529708 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f45d806f1f0 msgr2=0x7f45d806f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:40.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.121+0000 7f45ddc93640 1 --2- 172.21.15.134:0/2879529708 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f45d806f1f0 0x7f45d806f5d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f45c80097f0 tx=0x7f45c802b910 comp rx=0 tx=0).stop 2024-04-24T02:11:40.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.121+0000 7f45ddc93640 1 -- 172.21.15.134:0/2879529708 shutdown_connections 2024-04-24T02:11:40.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.121+0000 7f45ddc93640 1 --2- 172.21.15.134:0/2879529708 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f45d806f1f0 0x7f45d806f5d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:40.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.121+0000 7f45ddc93640 1 -- 172.21.15.134:0/2879529708 >> 172.21.15.134:0/2879529708 conn(0x7f45d806e700 msgr2=0x7f45d810fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:40.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.121+0000 7f45ddc93640 1 -- 172.21.15.134:0/2879529708 shutdown_connections 2024-04-24T02:11:40.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.121+0000 7f45ddc93640 1 -- 172.21.15.134:0/2879529708 wait complete. 2024-04-24T02:11:40.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.122+0000 7f45ddc93640 1 Processor -- start 2024-04-24T02:11:40.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.122+0000 7f45ddc93640 1 -- start start 2024-04-24T02:11:40.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.122+0000 7f45ddc93640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f45d806f1f0 0x7f45d81aac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:40.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.122+0000 7f45ddc93640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f45d8121f80 con 0x7f45d806f1f0 2024-04-24T02:11:40.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.122+0000 7f45d77fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f45d806f1f0 0x7f45d81aac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:40.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.122+0000 7f45d77fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f45d806f1f0 0x7f45d81aac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:53482/0 (socket says 172.21.15.134:53482) 2024-04-24T02:11:40.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.122+0000 7f45d77fe640 1 -- 172.21.15.134:0/1013293175 learned_addr learned my addr 172.21.15.134:0/1013293175 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:11:40.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.122+0000 7f45d77fe640 1 -- 172.21.15.134:0/1013293175 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45d81ab240 con 0x7f45d806f1f0 2024-04-24T02:11:40.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.122+0000 7f45d77fe640 1 --2- 172.21.15.134:0/1013293175 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f45d806f1f0 0x7f45d81aac70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f45c80097f0 tx=0x7f45c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:40.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.123+0000 7f45d4ff9640 1 -- 172.21.15.134:0/1013293175 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45c803ad00 con 0x7f45d806f1f0 2024-04-24T02:11:40.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.123+0000 7f45d4ff9640 1 -- 172.21.15.134:0/1013293175 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45c80443f0 con 0x7f45d806f1f0 2024-04-24T02:11:40.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.123+0000 7f45ddc93640 1 -- 172.21.15.134:0/1013293175 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45d81ab4d0 con 0x7f45d806f1f0 2024-04-24T02:11:40.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.123+0000 7f45d4ff9640 1 -- 172.21.15.134:0/1013293175 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45c80446d0 con 0x7f45d806f1f0 2024-04-24T02:11:40.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.123+0000 7f45ddc93640 1 -- 172.21.15.134:0/1013293175 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45d81ab700 con 0x7f45d806f1f0 2024-04-24T02:11:40.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.123+0000 7f45d4ff9640 1 -- 172.21.15.134:0/1013293175 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f45c804b060 con 0x7f45d806f1f0 2024-04-24T02:11:40.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.123+0000 7f45d4ff9640 1 -- 172.21.15.134:0/1013293175 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f45c804d940 con 0x7f45d806f1f0 2024-04-24T02:11:40.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.124+0000 7f45ddc93640 1 -- 172.21.15.134:0/1013293175 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45d8062da0 con 0x7f45d806f1f0 2024-04-24T02:11:40.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.126+0000 7f45d4ff9640 1 -- 172.21.15.134:0/1013293175 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f45c803f070 con 0x7f45d806f1f0 2024-04-24T02:11:40.182 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-24T02:11:40.181+0000 7fdab0041040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-24T02:11:40.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.198+0000 7f45ddc93640 1 -- 172.21.15.134:0/1013293175 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd new", "uuid": "505e5915-b411-48c8-b47f-9805fabd0c6e", "id": 0} v 0) -- 0x7f45d806fb10 con 0x7f45d806f1f0 2024-04-24T02:11:40.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.200+0000 7f45d4ff9640 1 -- 172.21.15.134:0/1013293175 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "505e5915-b411-48c8-b47f-9805fabd0c6e", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f45c804d450 con 0x7f45d806f1f0 2024-04-24T02:11:40.201 INFO:teuthology.orchestra.run.smithi134.stdout:0 2024-04-24T02:11:40.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.201+0000 7f45ddc93640 1 -- 172.21.15.134:0/1013293175 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f45d806f1f0 msgr2=0x7f45d81aac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:40.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.201+0000 7f45ddc93640 1 --2- 172.21.15.134:0/1013293175 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f45d806f1f0 0x7f45d81aac70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f45c80097f0 tx=0x7f45c80046c0 comp rx=0 tx=0).stop 2024-04-24T02:11:40.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.201+0000 7f45ddc93640 1 -- 172.21.15.134:0/1013293175 shutdown_connections 2024-04-24T02:11:40.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.201+0000 7f45ddc93640 1 --2- 172.21.15.134:0/1013293175 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f45d806f1f0 0x7f45d81aac70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:40.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.201+0000 7f45ddc93640 1 -- 172.21.15.134:0/1013293175 >> 172.21.15.134:0/1013293175 conn(0x7f45d806e700 msgr2=0x7f45d810ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:40.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.201+0000 7f45ddc93640 1 -- 172.21.15.134:0/1013293175 shutdown_connections 2024-04-24T02:11:40.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.201+0000 7f45ddc93640 1 -- 172.21.15.134:0/1013293175 wait complete. 2024-04-24T02:11:40.213 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 707422f1-aa99-41be-8312-caf9e6b35b46 1 2024-04-24T02:11:40.239 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-24T02:11:40.238+0000 7fdab0041040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-24T02:11:40.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.308+0000 7f04dcf70640 1 Processor -- start 2024-04-24T02:11:40.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.308+0000 7f04dcf70640 1 -- start start 2024-04-24T02:11:40.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.308+0000 7f04dcf70640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f04d811aaf0 0x7f04d811cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:40.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.308+0000 7f04dcf70640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04d811d420 con 0x7f04d8116c40 2024-04-24T02:11:40.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.308+0000 7f04dcf70640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f04d811e600 con 0x7f04d811aaf0 2024-04-24T02:11:40.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.309+0000 7f04d5d9b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f04d811aaf0 0x7f04d811cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:40.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.309+0000 7f04d5d9b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f04d811aaf0 0x7f04d811cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:53490/0 (socket says 172.21.15.134:53490) 2024-04-24T02:11:40.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.309+0000 7f04d5d9b640 1 -- 172.21.15.134:0/3398618075 learned_addr learned my addr 172.21.15.134:0/3398618075 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:11:40.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.309+0000 7f04d5d9b640 1 -- 172.21.15.134:0/3398618075 >> v1:172.21.15.104:6789/0 conn(0x7f04d8116c40 legacy=0x7f04d8117020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:40.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.309+0000 7f04d5d9b640 1 -- 172.21.15.134:0/3398618075 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04d811e7b0 con 0x7f04d811aaf0 2024-04-24T02:11:40.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.310+0000 7f04d5d9b640 1 --2- 172.21.15.134:0/3398618075 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04d811aaf0 0x7f04d811cee0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f04c00097f0 tx=0x7f04c002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af35fc85c5d651a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:40.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.310+0000 7f04d559a640 1 -- 172.21.15.134:0/3398618075 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04c0035020 con 0x7f04d811aaf0 2024-04-24T02:11:40.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.310+0000 7f04d559a640 1 -- 172.21.15.134:0/3398618075 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04c00317a0 con 0x7f04d811aaf0 2024-04-24T02:11:40.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.310+0000 7f04d559a640 1 -- 172.21.15.134:0/3398618075 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04c0031aa0 con 0x7f04d811aaf0 2024-04-24T02:11:40.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.310+0000 7f04dcf70640 1 -- 172.21.15.134:0/3398618075 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04d811aaf0 msgr2=0x7f04d811cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:40.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.310+0000 7f04dcf70640 1 --2- 172.21.15.134:0/3398618075 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04d811aaf0 0x7f04d811cee0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f04c00097f0 tx=0x7f04c002b910 comp rx=0 tx=0).stop 2024-04-24T02:11:40.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.310+0000 7f04dcf70640 1 -- 172.21.15.134:0/3398618075 shutdown_connections 2024-04-24T02:11:40.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.310+0000 7f04dcf70640 1 --2- 172.21.15.134:0/3398618075 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04d811aaf0 0x7f04d811cee0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:40.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.310+0000 7f04dcf70640 1 -- 172.21.15.134:0/3398618075 >> 172.21.15.134:0/3398618075 conn(0x7f04d806e700 msgr2=0x7f04d810fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:40.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.310+0000 7f04dcf70640 1 -- 172.21.15.134:0/3398618075 shutdown_connections 2024-04-24T02:11:40.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.310+0000 7f04dcf70640 1 -- 172.21.15.134:0/3398618075 wait complete. 2024-04-24T02:11:40.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.311+0000 7f04dcf70640 1 Processor -- start 2024-04-24T02:11:40.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.311+0000 7f04dcf70640 1 -- start start 2024-04-24T02:11:40.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.311+0000 7f04dcf70640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04d8116c40 0x7f04d81a6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:40.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.311+0000 7f04dcf70640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f04d811dad0 con 0x7f04d8116c40 2024-04-24T02:11:40.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.312+0000 7f04d659c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04d8116c40 0x7f04d81a6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:40.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.312+0000 7f04d659c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04d8116c40 0x7f04d81a6980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:53504/0 (socket says 172.21.15.134:53504) 2024-04-24T02:11:40.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.312+0000 7f04d659c640 1 -- 172.21.15.134:0/2719959971 learned_addr learned my addr 172.21.15.134:0/2719959971 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:11:40.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.312+0000 7f04d659c640 1 -- 172.21.15.134:0/2719959971 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04d81a6ec0 con 0x7f04d8116c40 2024-04-24T02:11:40.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.312+0000 7f04d659c640 1 --2- 172.21.15.134:0/2719959971 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04d8116c40 0x7f04d81a6980 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f04c800c450 tx=0x7f04c800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:40.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.312+0000 7f04ceffd640 1 -- 172.21.15.134:0/2719959971 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04c8017070 con 0x7f04d8116c40 2024-04-24T02:11:40.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.312+0000 7f04ceffd640 1 -- 172.21.15.134:0/2719959971 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04c8005220 con 0x7f04d8116c40 2024-04-24T02:11:40.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.312+0000 7f04ceffd640 1 -- 172.21.15.134:0/2719959971 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04c80035f0 con 0x7f04d8116c40 2024-04-24T02:11:40.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.312+0000 7f04dcf70640 1 -- 172.21.15.134:0/2719959971 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04d81a71b0 con 0x7f04d8116c40 2024-04-24T02:11:40.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.312+0000 7f04dcf70640 1 -- 172.21.15.134:0/2719959971 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04d81ab260 con 0x7f04d8116c40 2024-04-24T02:11:40.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.313+0000 7f04ceffd640 1 -- 172.21.15.134:0/2719959971 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f04c801a070 con 0x7f04d8116c40 2024-04-24T02:11:40.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.313+0000 7f04ceffd640 1 -- 172.21.15.134:0/2719959971 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f04c8003790 con 0x7f04d8116c40 2024-04-24T02:11:40.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.313+0000 7f04dcf70640 1 -- 172.21.15.134:0/2719959971 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04d8062da0 con 0x7f04d8116c40 2024-04-24T02:11:40.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.316+0000 7f04ceffd640 1 -- 172.21.15.134:0/2719959971 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f04c8006df0 con 0x7f04d8116c40 2024-04-24T02:11:40.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.388+0000 7f04dcf70640 1 -- 172.21.15.134:0/2719959971 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd new", "uuid": "707422f1-aa99-41be-8312-caf9e6b35b46", "id": 1} v 0) -- 0x7f04d81a73e0 con 0x7f04d8116c40 2024-04-24T02:11:40.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.389+0000 7f04ceffd640 1 -- 172.21.15.134:0/2719959971 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "707422f1-aa99-41be-8312-caf9e6b35b46", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f04c8006830 con 0x7f04d8116c40 2024-04-24T02:11:40.390 INFO:teuthology.orchestra.run.smithi134.stdout:1 2024-04-24T02:11:40.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.390+0000 7f04dcf70640 1 -- 172.21.15.134:0/2719959971 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04d8116c40 msgr2=0x7f04d81a6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:40.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.390+0000 7f04dcf70640 1 --2- 172.21.15.134:0/2719959971 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04d8116c40 0x7f04d81a6980 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f04c800c450 tx=0x7f04c800c910 comp rx=0 tx=0).stop 2024-04-24T02:11:40.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.390+0000 7f04dcf70640 1 -- 172.21.15.134:0/2719959971 shutdown_connections 2024-04-24T02:11:40.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.390+0000 7f04dcf70640 1 --2- 172.21.15.134:0/2719959971 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04d8116c40 0x7f04d81a6980 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:40.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.390+0000 7f04dcf70640 1 -- 172.21.15.134:0/2719959971 >> 172.21.15.134:0/2719959971 conn(0x7f04d806e700 msgr2=0x7f04d811b770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:40.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.390+0000 7f04dcf70640 1 -- 172.21.15.134:0/2719959971 shutdown_connections 2024-04-24T02:11:40.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.390+0000 7f04dcf70640 1 -- 172.21.15.134:0/2719959971 wait complete. 2024-04-24T02:11:40.402 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 745c40cd-2485-4701-ab89-5b349ab2198b 2 2024-04-24T02:11:40.493 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-24T02:11:40.492+0000 7fdab0041040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-24T02:11:40.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.538+0000 7fa282ac8640 1 Processor -- start 2024-04-24T02:11:40.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.538+0000 7fa282ac8640 1 -- start start 2024-04-24T02:11:40.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.538+0000 7fa282ac8640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa27c1108c0 0x7fa27c06b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:40.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.538+0000 7fa282ac8640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa27c06c3e0 con 0x7fa27c06bf30 2024-04-24T02:11:40.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.538+0000 7fa282ac8640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fa27c110df0 con 0x7fa27c1108c0 2024-04-24T02:11:40.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.538+0000 7fa280864640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa27c1108c0 0x7fa27c06b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:40.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.538+0000 7fa27bfff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fa27c06bf30 0x7fa27c11c3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:42220/0 (socket says 172.21.15.134:42220) 2024-04-24T02:11:40.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.538+0000 7fa280864640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa27c1108c0 0x7fa27c06b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:53516/0 (socket says 172.21.15.134:53516) 2024-04-24T02:11:40.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.538+0000 7fa27bfff640 1 -- 172.21.15.134:0/1569486315 learned_addr learned my addr 172.21.15.134:0/1569486315 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:11:40.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.539+0000 7fa280864640 1 -- 172.21.15.134:0/1569486315 >> v1:172.21.15.104:6789/0 conn(0x7fa27c06bf30 legacy=0x7fa27c11c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:40.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.539+0000 7fa280864640 1 -- 172.21.15.134:0/1569486315 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa27c06c5b0 con 0x7fa27c1108c0 2024-04-24T02:11:40.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.539+0000 7fa280864640 1 --2- 172.21.15.134:0/1569486315 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa27c1108c0 0x7fa27c06b9f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa270009720 tx=0x7fa27002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b36cb89e7ffd80d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:40.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.540+0000 7fa27b7fe640 1 -- 172.21.15.134:0/1569486315 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2700316d0 con 0x7fa27c1108c0 2024-04-24T02:11:40.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.540+0000 7fa27b7fe640 1 -- 172.21.15.134:0/1569486315 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa270037070 con 0x7fa27c1108c0 2024-04-24T02:11:40.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.540+0000 7fa27b7fe640 1 -- 172.21.15.134:0/1569486315 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2700319c0 con 0x7fa27c1108c0 2024-04-24T02:11:40.542 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-24T02:11:40.540+0000 7fdab0041040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-24T02:11:40.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.540+0000 7fa282ac8640 1 -- 172.21.15.134:0/1569486315 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa27c1108c0 msgr2=0x7fa27c06b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:40.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.540+0000 7fa282ac8640 1 --2- 172.21.15.134:0/1569486315 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa27c1108c0 0x7fa27c06b9f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa270009720 tx=0x7fa27002b840 comp rx=0 tx=0).stop 2024-04-24T02:11:40.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.540+0000 7fa282ac8640 1 -- 172.21.15.134:0/1569486315 shutdown_connections 2024-04-24T02:11:40.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.540+0000 7fa282ac8640 1 --2- 172.21.15.134:0/1569486315 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa27c1108c0 0x7fa27c06b9f0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:40.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.540+0000 7fa282ac8640 1 -- 172.21.15.134:0/1569486315 >> 172.21.15.134:0/1569486315 conn(0x7fa27c070090 msgr2=0x7fa27c0724b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:40.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.540+0000 7fa282ac8640 1 -- 172.21.15.134:0/1569486315 shutdown_connections 2024-04-24T02:11:40.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.540+0000 7fa282ac8640 1 -- 172.21.15.134:0/1569486315 wait complete. 2024-04-24T02:11:40.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.541+0000 7fa282ac8640 1 Processor -- start 2024-04-24T02:11:40.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.541+0000 7fa282ac8640 1 -- start start 2024-04-24T02:11:40.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.541+0000 7fa282ac8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa27c06bf30 0x7fa27c1ac360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:40.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.541+0000 7fa282ac8640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa27c11de80 con 0x7fa27c06bf30 2024-04-24T02:11:40.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.542+0000 7fa280864640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa27c06bf30 0x7fa27c1ac360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:40.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.542+0000 7fa280864640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa27c06bf30 0x7fa27c1ac360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:53532/0 (socket says 172.21.15.134:53532) 2024-04-24T02:11:40.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.542+0000 7fa280864640 1 -- 172.21.15.134:0/3134154565 learned_addr learned my addr 172.21.15.134:0/3134154565 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:11:40.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.542+0000 7fa280864640 1 -- 172.21.15.134:0/3134154565 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa27c1ac930 con 0x7fa27c06bf30 2024-04-24T02:11:40.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.542+0000 7fa280864640 1 --2- 172.21.15.134:0/3134154565 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa27c06bf30 0x7fa27c1ac360 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa270034040 tx=0x7fa2700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:40.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.542+0000 7fa2797fa640 1 -- 172.21.15.134:0/3134154565 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa270032770 con 0x7fa27c06bf30 2024-04-24T02:11:40.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.542+0000 7fa2797fa640 1 -- 172.21.15.134:0/3134154565 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa270032910 con 0x7fa27c06bf30 2024-04-24T02:11:40.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.542+0000 7fa282ac8640 1 -- 172.21.15.134:0/3134154565 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa27c1acb60 con 0x7fa27c06bf30 2024-04-24T02:11:40.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.542+0000 7fa2797fa640 1 -- 172.21.15.134:0/3134154565 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa270032c30 con 0x7fa27c06bf30 2024-04-24T02:11:40.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.542+0000 7fa282ac8640 1 -- 172.21.15.134:0/3134154565 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa27c1a6470 con 0x7fa27c06bf30 2024-04-24T02:11:40.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.542+0000 7fa2797fa640 1 -- 172.21.15.134:0/3134154565 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa27004c060 con 0x7fa27c06bf30 2024-04-24T02:11:40.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.543+0000 7fa2797fa640 1 -- 172.21.15.134:0/3134154565 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fa27002f050 con 0x7fa27c06bf30 2024-04-24T02:11:40.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.543+0000 7fa282ac8640 1 -- 172.21.15.134:0/3134154565 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa27c062da0 con 0x7fa27c06bf30 2024-04-24T02:11:40.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.545+0000 7fa2797fa640 1 -- 172.21.15.134:0/3134154565 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fa270040070 con 0x7fa27c06bf30 2024-04-24T02:11:40.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.617+0000 7fa282ac8640 1 -- 172.21.15.134:0/3134154565 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd new", "uuid": "745c40cd-2485-4701-ab89-5b349ab2198b", "id": 2} v 0) -- 0x7fa27c1108c0 con 0x7fa27c06bf30 2024-04-24T02:11:40.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.618+0000 7fa2797fa640 1 -- 172.21.15.134:0/3134154565 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "745c40cd-2485-4701-ab89-5b349ab2198b", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fa270052020 con 0x7fa27c06bf30 2024-04-24T02:11:40.620 INFO:teuthology.orchestra.run.smithi134.stdout:2 2024-04-24T02:11:40.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.619+0000 7fa282ac8640 1 -- 172.21.15.134:0/3134154565 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa27c06bf30 msgr2=0x7fa27c1ac360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:40.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.619+0000 7fa282ac8640 1 --2- 172.21.15.134:0/3134154565 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa27c06bf30 0x7fa27c1ac360 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa270034040 tx=0x7fa2700046c0 comp rx=0 tx=0).stop 2024-04-24T02:11:40.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.619+0000 7fa282ac8640 1 -- 172.21.15.134:0/3134154565 shutdown_connections 2024-04-24T02:11:40.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.619+0000 7fa282ac8640 1 --2- 172.21.15.134:0/3134154565 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa27c06bf30 0x7fa27c1ac360 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:40.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.619+0000 7fa282ac8640 1 -- 172.21.15.134:0/3134154565 >> 172.21.15.134:0/3134154565 conn(0x7fa27c070090 msgr2=0x7fa27c119a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:40.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.619+0000 7fa282ac8640 1 -- 172.21.15.134:0/3134154565 shutdown_connections 2024-04-24T02:11:40.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.619+0000 7fa282ac8640 1 -- 172.21.15.134:0/3134154565 wait complete. 2024-04-24T02:11:40.631 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 271174d0-434d-424e-9d20-fd0e2b1dac16 3 2024-04-24T02:11:40.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.727+0000 7fe66a180640 1 Processor -- start 2024-04-24T02:11:40.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.728+0000 7fe66a180640 1 -- start start 2024-04-24T02:11:40.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.728+0000 7fe66a180640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe6641149a0 0x7fe664114d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:40.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.728+0000 7fe66a180640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6641153e0 con 0x7fe66410f8f0 2024-04-24T02:11:40.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.728+0000 7fe66a180640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fe664110490 con 0x7fe6641149a0 2024-04-24T02:11:40.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.728+0000 7fe6637fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe6641149a0 0x7fe664114d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:40.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.728+0000 7fe6637fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe6641149a0 0x7fe664114d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:53546/0 (socket says 172.21.15.134:53546) 2024-04-24T02:11:40.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.728+0000 7fe6637fe640 1 -- 172.21.15.134:0/856324650 learned_addr learned my addr 172.21.15.134:0/856324650 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:11:40.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.728+0000 7fe662ffd640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fe66410f8f0 0x7fe66410fd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:42230/0 (socket says 172.21.15.134:42230) 2024-04-24T02:11:40.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.728+0000 7fe6637fe640 1 -- 172.21.15.134:0/856324650 >> v1:172.21.15.104:6789/0 conn(0x7fe66410f8f0 legacy=0x7fe66410fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:40.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.728+0000 7fe6637fe640 1 -- 172.21.15.134:0/856324650 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe664110640 con 0x7fe6641149a0 2024-04-24T02:11:40.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.729+0000 7fe6637fe640 1 --2- 172.21.15.134:0/856324650 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6641149a0 0x7fe664114d80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe6580097f0 tx=0x7fe65802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=366e9695d307047e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:40.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.729+0000 7fe6627fc640 1 -- 172.21.15.134:0/856324650 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe658035020 con 0x7fe6641149a0 2024-04-24T02:11:40.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.729+0000 7fe6627fc640 1 -- 172.21.15.134:0/856324650 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6580317a0 con 0x7fe6641149a0 2024-04-24T02:11:40.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.729+0000 7fe6627fc640 1 -- 172.21.15.134:0/856324650 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe658031aa0 con 0x7fe6641149a0 2024-04-24T02:11:40.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.730+0000 7fe66a180640 1 -- 172.21.15.134:0/856324650 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6641149a0 msgr2=0x7fe664114d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:40.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.730+0000 7fe66a180640 1 --2- 172.21.15.134:0/856324650 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6641149a0 0x7fe664114d80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe6580097f0 tx=0x7fe65802b910 comp rx=0 tx=0).stop 2024-04-24T02:11:40.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.730+0000 7fe66a180640 1 -- 172.21.15.134:0/856324650 shutdown_connections 2024-04-24T02:11:40.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.730+0000 7fe66a180640 1 --2- 172.21.15.134:0/856324650 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6641149a0 0x7fe664114d80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:40.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.730+0000 7fe66a180640 1 -- 172.21.15.134:0/856324650 >> 172.21.15.134:0/856324650 conn(0x7fe664070e80 msgr2=0x7fe6640732a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:40.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.730+0000 7fe66a180640 1 -- 172.21.15.134:0/856324650 shutdown_connections 2024-04-24T02:11:40.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.730+0000 7fe66a180640 1 -- 172.21.15.134:0/856324650 wait complete. 2024-04-24T02:11:40.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.731+0000 7fe66a180640 1 Processor -- start 2024-04-24T02:11:40.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.731+0000 7fe66a180640 1 -- start start 2024-04-24T02:11:40.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.731+0000 7fe66a180640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe66410f8f0 0x7fe66406cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:40.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.731+0000 7fe66a180640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe66411bd20 con 0x7fe66410f8f0 2024-04-24T02:11:40.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.731+0000 7fe6637fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe66410f8f0 0x7fe66406cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:40.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.731+0000 7fe6637fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe66410f8f0 0x7fe66406cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:53556/0 (socket says 172.21.15.134:53556) 2024-04-24T02:11:40.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.731+0000 7fe6637fe640 1 -- 172.21.15.134:0/620134117 learned_addr learned my addr 172.21.15.134:0/620134117 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:11:40.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.731+0000 7fe6637fe640 1 -- 172.21.15.134:0/620134117 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe66406d110 con 0x7fe66410f8f0 2024-04-24T02:11:40.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.732+0000 7fe6637fe640 1 --2- 172.21.15.134:0/620134117 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe66410f8f0 0x7fe66406cbd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe6580097f0 tx=0x7fe6580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:40.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.732+0000 7fe64bfff640 1 -- 172.21.15.134:0/620134117 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe65803ad00 con 0x7fe66410f8f0 2024-04-24T02:11:40.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.732+0000 7fe64bfff640 1 -- 172.21.15.134:0/620134117 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6580443f0 con 0x7fe66410f8f0 2024-04-24T02:11:40.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.732+0000 7fe66a180640 1 -- 172.21.15.134:0/620134117 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe66406d340 con 0x7fe66410f8f0 2024-04-24T02:11:40.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.732+0000 7fe64bfff640 1 -- 172.21.15.134:0/620134117 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6580446d0 con 0x7fe66410f8f0 2024-04-24T02:11:40.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.732+0000 7fe66a180640 1 -- 172.21.15.134:0/620134117 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe66406d7d0 con 0x7fe66410f8f0 2024-04-24T02:11:40.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.732+0000 7fe64bfff640 1 -- 172.21.15.134:0/620134117 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe65804b060 con 0x7fe66410f8f0 2024-04-24T02:11:40.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.732+0000 7fe64bfff640 1 -- 172.21.15.134:0/620134117 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fe6580303c0 con 0x7fe66410f8f0 2024-04-24T02:11:40.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.733+0000 7fe66a180640 1 -- 172.21.15.134:0/620134117 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe664062da0 con 0x7fe66410f8f0 2024-04-24T02:11:40.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.735+0000 7fe64bfff640 1 -- 172.21.15.134:0/620134117 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fe65803f070 con 0x7fe66410f8f0 2024-04-24T02:11:40.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.807+0000 7fe66a180640 1 -- 172.21.15.134:0/620134117 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd new", "uuid": "271174d0-434d-424e-9d20-fd0e2b1dac16", "id": 3} v 0) -- 0x7fe664118fb0 con 0x7fe66410f8f0 2024-04-24T02:11:40.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.811+0000 7fe64bfff640 1 -- 172.21.15.134:0/620134117 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "271174d0-434d-424e-9d20-fd0e2b1dac16", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fe65804d450 con 0x7fe66410f8f0 2024-04-24T02:11:40.812 INFO:teuthology.orchestra.run.smithi134.stdout:3 2024-04-24T02:11:40.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.812+0000 7fe66a180640 1 -- 172.21.15.134:0/620134117 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe66410f8f0 msgr2=0x7fe66406cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:40.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.812+0000 7fe66a180640 1 --2- 172.21.15.134:0/620134117 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe66410f8f0 0x7fe66406cbd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe6580097f0 tx=0x7fe6580046c0 comp rx=0 tx=0).stop 2024-04-24T02:11:40.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.812+0000 7fe66a180640 1 -- 172.21.15.134:0/620134117 shutdown_connections 2024-04-24T02:11:40.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.812+0000 7fe66a180640 1 --2- 172.21.15.134:0/620134117 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe66410f8f0 0x7fe66406cbd0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:40.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.812+0000 7fe66a180640 1 -- 172.21.15.134:0/620134117 >> 172.21.15.134:0/620134117 conn(0x7fe664070e80 msgr2=0x7fe6641136e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:40.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.812+0000 7fe66a180640 1 -- 172.21.15.134:0/620134117 shutdown_connections 2024-04-24T02:11:40.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:11:40.812+0000 7fe66a180640 1 -- 172.21.15.134:0/620134117 wait complete. 2024-04-24T02:11:40.823 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-24T02:11:40.824 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-24T02:11:40.826 INFO:tasks.ceph.osd.0:Started 2024-04-24T02:11:40.827 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-24T02:11:40.827 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-24T02:11:40.829 INFO:tasks.ceph.osd.1:Started 2024-04-24T02:11:40.829 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-24T02:11:40.829 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-24T02:11:40.831 INFO:tasks.ceph.osd.2:Started 2024-04-24T02:11:40.831 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-24T02:11:40.831 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-24T02:11:40.834 INFO:tasks.ceph.osd.3:Started 2024-04-24T02:11:40.834 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T02:11:40.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:40.938+0000 7fc30b997640 1 Processor -- start 2024-04-24T02:11:40.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:40.938+0000 7fc30b997640 1 -- start start 2024-04-24T02:11:40.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:40.939+0000 7fc30b997640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fc30406f260 0x7fc30406f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:40.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:40.939+0000 7fc30b997640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc30406fff0 con 0x7fc30406fb80 2024-04-24T02:11:40.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:40.939+0000 7fc30b997640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fc304070bc0 con 0x7fc30406f260 2024-04-24T02:11:40.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:40.939+0000 7fc309733640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fc30406f260 0x7fc30406f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:40.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:40.939+0000 7fc308f32640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fc30406fb80 0x7fc30412e540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:39026/0 (socket says 172.21.15.104:39026) 2024-04-24T02:11:40.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:40.939+0000 7fc308f32640 1 -- 172.21.15.104:0/4034123370 learned_addr learned my addr 172.21.15.104:0/4034123370 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-04-24T02:11:40.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:40.939+0000 7fc309733640 1 -- 172.21.15.104:0/4034123370 >> v1:172.21.15.104:6789/0 conn(0x7fc30406fb80 legacy=0x7fc30412e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:40.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:40.939+0000 7fc309733640 1 -- 172.21.15.104:0/4034123370 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc30412ec50 con 0x7fc30406f260 2024-04-24T02:11:40.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:40.939+0000 7fc2f7fff640 1 -- 172.21.15.104:0/4034123370 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3996978859 0 0) 0x7fc30406fff0 con 0x7fc30406fb80 2024-04-24T02:11:40.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:40.940+0000 7fc309733640 1 --2- 172.21.15.104:0/4034123370 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc30406f260 0x7fc30406f640 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc300009720 tx=0x7fc30002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88666a2a55f08598 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:40.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:40.940+0000 7fc2f7fff640 1 -- 172.21.15.104:0/4034123370 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3000316d0 con 0x7fc30406f260 2024-04-24T02:11:40.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:40.940+0000 7fc2f7fff640 1 -- 172.21.15.104:0/4034123370 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc300037070 con 0x7fc30406f260 2024-04-24T02:11:40.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:40.940+0000 7fc2f7fff640 1 -- 172.21.15.104:0/4034123370 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3000319c0 con 0x7fc30406f260 2024-04-24T02:11:40.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:40.940+0000 7fc30b997640 1 -- 172.21.15.104:0/4034123370 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc30406f260 msgr2=0x7fc30406f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:40.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:40.940+0000 7fc30b997640 1 --2- 172.21.15.104:0/4034123370 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc30406f260 0x7fc30406f640 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc300009720 tx=0x7fc30002b840 comp rx=0 tx=0).stop 2024-04-24T02:11:40.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:40.940+0000 7fc30b997640 1 -- 172.21.15.104:0/4034123370 shutdown_connections 2024-04-24T02:11:40.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:40.940+0000 7fc30b997640 1 --2- 172.21.15.104:0/4034123370 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc30406f260 0x7fc30406f640 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:40.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:40.940+0000 7fc30b997640 1 -- 172.21.15.104:0/4034123370 >> 172.21.15.104:0/4034123370 conn(0x7fc30409e170 msgr2=0x7fc30406d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:40.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:40.940+0000 7fc30b997640 1 -- 172.21.15.104:0/4034123370 shutdown_connections 2024-04-24T02:11:40.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:40.940+0000 7fc30b997640 1 -- 172.21.15.104:0/4034123370 wait complete. 2024-04-24T02:11:40.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:40.941+0000 7fc30b997640 1 Processor -- start 2024-04-24T02:11:40.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:40.941+0000 7fc30b997640 1 -- start start 2024-04-24T02:11:40.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:40.942+0000 7fc30b997640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc30406f260 0x7fc304118520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:40.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:40.942+0000 7fc30b997640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc30412f400 con 0x7fc30406f260 2024-04-24T02:11:40.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:40.942+0000 7fc309733640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc30406f260 0x7fc304118520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:40.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:40.942+0000 7fc309733640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc30406f260 0x7fc304118520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39496/0 (socket says 172.21.15.104:39496) 2024-04-24T02:11:40.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:40.942+0000 7fc309733640 1 -- 172.21.15.104:0/3690495034 learned_addr learned my addr 172.21.15.104:0/3690495034 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:11:40.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:40.942+0000 7fc309733640 1 -- 172.21.15.104:0/3690495034 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc30411a280 con 0x7fc30406f260 2024-04-24T02:11:40.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:40.942+0000 7fc309733640 1 --2- 172.21.15.104:0/3690495034 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc30406f260 0x7fc304118520 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc300034040 tx=0x7fc3000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:40.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:40.942+0000 7fc2f5ffb640 1 -- 172.21.15.104:0/3690495034 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc300032640 con 0x7fc30406f260 2024-04-24T02:11:40.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:40.942+0000 7fc2f5ffb640 1 -- 172.21.15.104:0/3690495034 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3000327e0 con 0x7fc30406f260 2024-04-24T02:11:40.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:40.942+0000 7fc30b997640 1 -- 172.21.15.104:0/3690495034 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc304072cd0 con 0x7fc30406f260 2024-04-24T02:11:40.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:40.942+0000 7fc2f5ffb640 1 -- 172.21.15.104:0/3690495034 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc300032ac0 con 0x7fc30406f260 2024-04-24T02:11:40.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:40.943+0000 7fc30b997640 1 -- 172.21.15.104:0/3690495034 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc304118a60 con 0x7fc30406f260 2024-04-24T02:11:40.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:40.943+0000 7fc2f5ffb640 1 -- 172.21.15.104:0/3690495034 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc30004c060 con 0x7fc30406f260 2024-04-24T02:11:40.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:40.943+0000 7fc2f5ffb640 1 -- 172.21.15.104:0/3690495034 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fc30002f050 con 0x7fc30406f260 2024-04-24T02:11:40.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:40.943+0000 7fc30b997640 1 -- 172.21.15.104:0/3690495034 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3040a18a0 con 0x7fc30406f260 2024-04-24T02:11:40.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:40.945+0000 7fc2f5ffb640 1 -- 172.21.15.104:0/3690495034 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fc3040a18a0 con 0x7fc30406f260 2024-04-24T02:11:41.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:41.003+0000 7fc30b997640 1 -- 172.21.15.104:0/3690495034 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc304119de0 con 0x7fc30406f260 2024-04-24T02:11:41.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:41.004+0000 7fc2f5ffb640 1 -- 172.21.15.104:0/3690495034 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7fc300040070 con 0x7fc30406f260 2024-04-24T02:11:41.005 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:11:41.005 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":6,"fsid":"b09461c3-8f3e-4967-89da-98f6945a4445","created":"2024-04-24T02:11:39.732268+0000","modified":"2024-04-24T02:11:40.809349+0000","last_up_change":"0.000000","last_in_change":"2024-04-24T02:11:40.809349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"505e5915-b411-48c8-b47f-9805fabd0c6e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"707422f1-aa99-41be-8312-caf9e6b35b46","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"745c40cd-2485-4701-ab89-5b349ab2198b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"271174d0-434d-424e-9d20-fd0e2b1dac16","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T02:11:41.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:41.005+0000 7fc30b997640 1 -- 172.21.15.104:0/3690495034 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc30406f260 msgr2=0x7fc304118520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:41.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:41.005+0000 7fc30b997640 1 --2- 172.21.15.104:0/3690495034 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc30406f260 0x7fc304118520 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc300034040 tx=0x7fc3000046c0 comp rx=0 tx=0).stop 2024-04-24T02:11:41.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:41.005+0000 7fc30b997640 1 -- 172.21.15.104:0/3690495034 shutdown_connections 2024-04-24T02:11:41.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:41.005+0000 7fc30b997640 1 --2- 172.21.15.104:0/3690495034 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc30406f260 0x7fc304118520 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:41.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:41.005+0000 7fc30b997640 1 -- 172.21.15.104:0/3690495034 >> 172.21.15.104:0/3690495034 conn(0x7fc30409e170 msgr2=0x7fc30409e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:41.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:41.005+0000 7fc30b997640 1 -- 172.21.15.104:0/3690495034 shutdown_connections 2024-04-24T02:11:41.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:41.005+0000 7fc30b997640 1 -- 172.21.15.104:0/3690495034 wait complete. 2024-04-24T02:11:41.016 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-24T02:11:41.016 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-24T02:11:41.270 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-24T02:11:41.269+0000 7fdab0041040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-24T02:11:41.356 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-24T02:11:41.355+0000 7fdab0041040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-24T02:11:41.398 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-24T02:11:41.397+0000 7fdab0041040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-24T02:11:41.418 INFO:tasks.ceph.osd.0.smithi104.stderr:2024-04-24T02:11:41.417+0000 7fb05a4a4640 -1 Falling back to public interface 2024-04-24T02:11:41.420 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-24T02:11:41.442 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-24T02:11:41.440+0000 7f3334e03640 -1 Falling back to public interface 2024-04-24T02:11:41.442 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-04-24T02:11:41.440+0000 7f2014e14640 -1 Falling back to public interface 2024-04-24T02:11:41.442 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-04-24T02:11:41.440+0000 7fdbdd5b8640 -1 Falling back to public interface 2024-04-24T02:11:41.443 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-24T02:11:41.441+0000 7f3333db2640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2024-04-24T02:11:41.443 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-04-24T02:11:41.441+0000 7fdbdc567640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2024-04-24T02:11:41.443 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-24T02:11:41.441+0000 7f3333db2640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6801/0: (98) Address already in use 2024-04-24T02:11:41.444 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-04-24T02:11:41.441+0000 7f2013799640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6801/0: (98) Address already in use 2024-04-24T02:11:41.444 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-24T02:11:41.441+0000 7f3333db2640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6802/0: (98) Address already in use 2024-04-24T02:11:41.444 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-24T02:11:41.441+0000 7f3333db2640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6803/0: (98) Address already in use 2024-04-24T02:11:41.444 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-24T02:11:41.441+0000 7f3333db2640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6808/0: (98) Address already in use 2024-04-24T02:11:41.507 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:41.506+0000 7fa923ba4640 1 Processor -- start 2024-04-24T02:11:41.508 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:41.506+0000 7fa923ba4640 1 -- start start 2024-04-24T02:11:41.508 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:41.507+0000 7fa923ba4640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa91c06e6c0 0x7fa91c133680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:41.508 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:41.507+0000 7fa923ba4640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa91c0a0b10 con 0x7fa91c06dbd0 2024-04-24T02:11:41.508 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:41.507+0000 7fa923ba4640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fa91c0728c0 con 0x7fa91c06e6c0 2024-04-24T02:11:41.508 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:41.507+0000 7fa92113f640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa91c06e6c0 0x7fa91c133680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:41.508 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:41.507+0000 7fa921940640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fa91c06dbd0 0x7fa91c06dfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:39038/0 (socket says 172.21.15.104:39038) 2024-04-24T02:11:41.508 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:41.507+0000 7fa921940640 1 -- 172.21.15.104:0/2891651053 learned_addr learned my addr 172.21.15.104:0/2891651053 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-04-24T02:11:41.509 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:41.507+0000 7fa92113f640 1 -- 172.21.15.104:0/2891651053 >> v1:172.21.15.104:6789/0 conn(0x7fa91c06dbd0 legacy=0x7fa91c06dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:41.509 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:41.507+0000 7fa92093e640 1 -- 172.21.15.104:0/2891651053 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4026880478 0 0) 0x7fa918001490 con 0x7fa91c06dbd0 2024-04-24T02:11:41.510 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:41.507+0000 7fa92113f640 1 -- 172.21.15.104:0/2891651053 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa91c06fad0 con 0x7fa91c06e6c0 2024-04-24T02:11:41.510 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:41.508+0000 7fa92113f640 1 --2- 172.21.15.104:0/2891651053 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa91c06e6c0 0x7fa91c133680 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa90c009720 tx=0x7fa90c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49d8e6dc56d6a1f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:41.510 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:41.508+0000 7fa92093e640 1 -- 172.21.15.104:0/2891651053 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa90c035020 con 0x7fa91c06e6c0 2024-04-24T02:11:41.510 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:41.508+0000 7fa92093e640 1 -- 172.21.15.104:0/2891651053 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa90c031760 con 0x7fa91c06e6c0 2024-04-24T02:11:41.510 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:41.508+0000 7fa92093e640 1 -- 172.21.15.104:0/2891651053 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa90c031a60 con 0x7fa91c06e6c0 2024-04-24T02:11:41.510 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:41.508+0000 7fa923ba4640 1 -- 172.21.15.104:0/2891651053 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa91c06e6c0 msgr2=0x7fa91c133680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:41.510 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:41.508+0000 7fa923ba4640 1 --2- 172.21.15.104:0/2891651053 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa91c06e6c0 0x7fa91c133680 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa90c009720 tx=0x7fa90c02b8d0 comp rx=0 tx=0).stop 2024-04-24T02:11:41.510 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:41.508+0000 7fa923ba4640 1 -- 172.21.15.104:0/2891651053 shutdown_connections 2024-04-24T02:11:41.510 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:41.508+0000 7fa923ba4640 1 --2- 172.21.15.104:0/2891651053 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa91c06e6c0 0x7fa91c133680 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:41.510 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:41.508+0000 7fa923ba4640 1 -- 172.21.15.104:0/2891651053 >> 172.21.15.104:0/2891651053 conn(0x7fa91c09ec50 msgr2=0x7fa91c09f060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:41.510 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:41.509+0000 7fa923ba4640 1 -- 172.21.15.104:0/2891651053 shutdown_connections 2024-04-24T02:11:41.510 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:41.509+0000 7fa923ba4640 1 -- 172.21.15.104:0/2891651053 wait complete. 2024-04-24T02:11:41.513 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:41.509+0000 7fa923ba4640 1 Processor -- start 2024-04-24T02:11:41.513 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:41.509+0000 7fa923ba4640 1 -- start start 2024-04-24T02:11:41.513 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:41.510+0000 7fa923ba4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa91c06dbd0 0x7fa91c127db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:41.513 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:41.510+0000 7fa923ba4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa91c133bc0 con 0x7fa91c06dbd0 2024-04-24T02:11:41.513 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:41.510+0000 7fa921940640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa91c06dbd0 0x7fa91c127db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:41.513 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:41.510+0000 7fa921940640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa91c06dbd0 0x7fa91c127db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39506/0 (socket says 172.21.15.104:39506) 2024-04-24T02:11:41.513 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:41.510+0000 7fa921940640 1 -- 172.21.15.104:0/571259776 learned_addr learned my addr 172.21.15.104:0/571259776 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:11:41.513 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:41.510+0000 7fa921940640 1 -- 172.21.15.104:0/571259776 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa91c129cf0 con 0x7fa91c06dbd0 2024-04-24T02:11:41.513 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:41.510+0000 7fa921940640 1 --2- 172.21.15.104:0/571259776 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa91c06dbd0 0x7fa91c127db0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa91800c790 tx=0x7fa91800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:41.513 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:41.510+0000 7fa9127fc640 1 -- 172.21.15.104:0/571259776 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa918018070 con 0x7fa91c06dbd0 2024-04-24T02:11:41.513 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:41.510+0000 7fa9127fc640 1 -- 172.21.15.104:0/571259776 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa918004d70 con 0x7fa91c06dbd0 2024-04-24T02:11:41.513 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:41.510+0000 7fa923ba4640 1 -- 172.21.15.104:0/571259776 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa91c12b840 con 0x7fa91c06dbd0 2024-04-24T02:11:41.514 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:41.510+0000 7fa9127fc640 1 -- 172.21.15.104:0/571259776 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa91800a7f0 con 0x7fa91c06dbd0 2024-04-24T02:11:41.514 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:41.510+0000 7fa923ba4640 1 -- 172.21.15.104:0/571259776 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa91c1282f0 con 0x7fa91c06dbd0 2024-04-24T02:11:41.514 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:41.510+0000 7fa9127fc640 1 -- 172.21.15.104:0/571259776 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa91801b070 con 0x7fa91c06dbd0 2024-04-24T02:11:41.514 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:41.510+0000 7fa9127fc640 1 -- 172.21.15.104:0/571259776 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fa9180078f0 con 0x7fa91c06dbd0 2024-04-24T02:11:41.514 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:41.511+0000 7fa923ba4640 1 -- 172.21.15.104:0/571259776 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa91c0737f0 con 0x7fa91c06dbd0 2024-04-24T02:11:41.514 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:41.513+0000 7fa9127fc640 1 -- 172.21.15.104:0/571259776 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fa918022070 con 0x7fa91c06dbd0 2024-04-24T02:11:41.566 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-24T02:11:41.565+0000 7fdab0041040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-24T02:11:41.572 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:41.571+0000 7fa923ba4640 1 -- 172.21.15.104:0/571259776 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa91c12a4e0 con 0x7fa91c06dbd0 2024-04-24T02:11:41.572 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:41.571+0000 7fa9127fc640 1 -- 172.21.15.104:0/571259776 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7fa91c0a0b10 con 0x7fa91c06dbd0 2024-04-24T02:11:41.572 INFO:teuthology.misc.health.smithi104.stdout: 2024-04-24T02:11:41.572 INFO:teuthology.misc.health.smithi104.stdout:{"epoch":6,"fsid":"b09461c3-8f3e-4967-89da-98f6945a4445","created":"2024-04-24T02:11:39.732268+0000","modified":"2024-04-24T02:11:40.809349+0000","last_up_change":"0.000000","last_in_change":"2024-04-24T02:11:40.809349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"505e5915-b411-48c8-b47f-9805fabd0c6e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"707422f1-aa99-41be-8312-caf9e6b35b46","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"745c40cd-2485-4701-ab89-5b349ab2198b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"271174d0-434d-424e-9d20-fd0e2b1dac16","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T02:11:41.574 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:41.572+0000 7fa923ba4640 1 -- 172.21.15.104:0/571259776 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa91c06dbd0 msgr2=0x7fa91c127db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:41.574 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:41.572+0000 7fa923ba4640 1 --2- 172.21.15.104:0/571259776 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa91c06dbd0 0x7fa91c127db0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa91800c790 tx=0x7fa91800cc50 comp rx=0 tx=0).stop 2024-04-24T02:11:41.574 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:41.572+0000 7fa923ba4640 1 -- 172.21.15.104:0/571259776 shutdown_connections 2024-04-24T02:11:41.574 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:41.572+0000 7fa923ba4640 1 --2- 172.21.15.104:0/571259776 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa91c06dbd0 0x7fa91c127db0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:41.575 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:41.572+0000 7fa923ba4640 1 -- 172.21.15.104:0/571259776 >> 172.21.15.104:0/571259776 conn(0x7fa91c09ec50 msgr2=0x7fa91c12e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:41.575 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:41.572+0000 7fa923ba4640 1 -- 172.21.15.104:0/571259776 shutdown_connections 2024-04-24T02:11:41.575 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:41.572+0000 7fa923ba4640 1 -- 172.21.15.104:0/571259776 wait complete. 2024-04-24T02:11:41.582 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-04-24T02:11:41.622 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-24T02:11:41.620+0000 7fdab0041040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-24T02:11:41.673 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-24T02:11:41.672+0000 7fdab0041040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-24T02:11:41.786 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-24T02:11:41.785+0000 7fdab0041040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-24T02:11:42.163 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-24T02:11:42.162+0000 7fdab0041040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-24T02:11:42.418 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-24T02:11:42.417+0000 7fdab0041040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-24T02:11:42.469 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-24T02:11:42.468+0000 7fdab0041040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-24T02:11:42.585 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-24T02:11:42.584+0000 7fdab0041040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-24T02:11:42.862 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-24T02:11:42.861+0000 7fdab0041040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-24T02:11:42.909 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-24T02:11:42.908+0000 7fdab0041040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-24T02:11:43.063 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-24T02:11:43.061+0000 7fdab0041040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-24T02:11:43.199 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-24T02:11:43.198+0000 7fdab0041040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-24T02:11:43.247 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-24T02:11:43.246+0000 7fdab0041040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-24T02:11:43.316 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-24T02:11:43.314+0000 7fdab0041040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-24T02:11:43.360 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-24T02:11:43.359+0000 7fdab0041040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-24T02:11:43.833 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-24T02:11:43.831+0000 7fdab0041040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-24T02:11:43.951 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-24T02:11:43.950+0000 7fdab0041040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-24T02:11:44.848 INFO:tasks.ceph.osd.0.smithi104.stderr:2024-04-24T02:11:44.847+0000 7fb05a4a4640 -1 osd.0 0 log_to_monitors true 2024-04-24T02:11:44.960 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-04-24T02:11:44.960+0000 7fda50d73640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-04-24T02:11:45.008 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-04-24T02:11:45.007+0000 7f2014e14640 -1 osd.2 0 log_to_monitors true 2024-04-24T02:11:45.014 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-04-24T02:11:45.014+0000 7fdbdd5b8640 -1 osd.3 0 log_to_monitors true 2024-04-24T02:11:45.022 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-24T02:11:45.022+0000 7f3334e03640 -1 osd.1 0 log_to_monitors true 2024-04-24T02:11:46.886 INFO:tasks.ceph.osd.0.smithi104.stderr:2024-04-24T02:11:46.886+0000 7fb05744f640 -1 osd.0 0 waiting for initial osdmap 2024-04-24T02:11:46.897 INFO:tasks.ceph.osd.0.smithi104.stderr:2024-04-24T02:11:46.896+0000 7fb04e249640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T02:11:47.987 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-24T02:11:48.087 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.086+0000 7f6e03c2e640 1 Processor -- start 2024-04-24T02:11:48.087 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.086+0000 7f6e03c2e640 1 -- start start 2024-04-24T02:11:48.088 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.086+0000 7f6e03c2e640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6dfc1275d0 0x7f6dfc1279b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:48.088 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.086+0000 7f6e03c2e640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6dfc127110 con 0x7f6dfc12a670 2024-04-24T02:11:48.088 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.086+0000 7f6e03c2e640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f6dfc09c5e0 con 0x7f6dfc1275d0 2024-04-24T02:11:48.088 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.087+0000 7f6e019ca640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6dfc1275d0 0x7f6dfc1279b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:48.088 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.087+0000 7f6e011c9640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f6dfc12a670 0x7f6dfc12aa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:39046/0 (socket says 172.21.15.104:39046) 2024-04-24T02:11:48.088 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.087+0000 7f6e011c9640 1 -- 172.21.15.104:0/1274106994 learned_addr learned my addr 172.21.15.104:0/1274106994 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-04-24T02:11:48.088 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.087+0000 7f6e019ca640 1 -- 172.21.15.104:0/1274106994 >> v1:172.21.15.104:6789/0 conn(0x7f6dfc12a670 legacy=0x7f6dfc12aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:48.088 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.087+0000 7f6e019ca640 1 -- 172.21.15.104:0/1274106994 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dfc1273b0 con 0x7f6dfc1275d0 2024-04-24T02:11:48.089 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.087+0000 7f6e009c8640 1 -- 172.21.15.104:0/1274106994 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 668556876 0 0) 0x7f6dfc127110 con 0x7f6dfc12a670 2024-04-24T02:11:48.091 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.088+0000 7f6e019ca640 1 --2- 172.21.15.104:0/1274106994 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6dfc1275d0 0x7f6dfc1279b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6df8009720 tx=0x7f6df802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdb6d8ec67df903f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:48.091 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.088+0000 7f6e009c8640 1 -- 172.21.15.104:0/1274106994 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6df8035020 con 0x7f6dfc1275d0 2024-04-24T02:11:48.091 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.088+0000 7f6e009c8640 1 -- 172.21.15.104:0/1274106994 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6df8031760 con 0x7f6dfc1275d0 2024-04-24T02:11:48.091 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.088+0000 7f6e009c8640 1 -- 172.21.15.104:0/1274106994 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6df8031a60 con 0x7f6dfc1275d0 2024-04-24T02:11:48.091 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.088+0000 7f6e03c2e640 1 -- 172.21.15.104:0/1274106994 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6dfc1275d0 msgr2=0x7f6dfc1279b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:48.092 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.088+0000 7f6e03c2e640 1 --2- 172.21.15.104:0/1274106994 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6dfc1275d0 0x7f6dfc1279b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6df8009720 tx=0x7f6df802b8d0 comp rx=0 tx=0).stop 2024-04-24T02:11:48.092 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.088+0000 7f6e03c2e640 1 -- 172.21.15.104:0/1274106994 shutdown_connections 2024-04-24T02:11:48.092 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.088+0000 7f6e03c2e640 1 --2- 172.21.15.104:0/1274106994 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6dfc1275d0 0x7f6dfc1279b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:48.092 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.088+0000 7f6e03c2e640 1 -- 172.21.15.104:0/1274106994 >> 172.21.15.104:0/1274106994 conn(0x7f6dfc09a840 msgr2=0x7f6dfc09ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:48.092 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.088+0000 7f6e03c2e640 1 -- 172.21.15.104:0/1274106994 shutdown_connections 2024-04-24T02:11:48.092 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.089+0000 7f6e03c2e640 1 -- 172.21.15.104:0/1274106994 wait complete. 2024-04-24T02:11:48.092 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.089+0000 7f6e03c2e640 1 Processor -- start 2024-04-24T02:11:48.092 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.089+0000 7f6e03c2e640 1 -- start start 2024-04-24T02:11:48.092 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.090+0000 7f6e03c2e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6dfc1275d0 0x7f6dfc1c2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:48.092 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.090+0000 7f6e03c2e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f6dfc06f5f0 con 0x7f6dfc1275d0 2024-04-24T02:11:48.092 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.090+0000 7f6e019ca640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6dfc1275d0 0x7f6dfc1c2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:48.092 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.090+0000 7f6e019ca640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6dfc1275d0 0x7f6dfc1c2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39524/0 (socket says 172.21.15.104:39524) 2024-04-24T02:11:48.092 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.090+0000 7f6e019ca640 1 -- 172.21.15.104:0/335570195 learned_addr learned my addr 172.21.15.104:0/335570195 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:11:48.092 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.090+0000 7f6e019ca640 1 -- 172.21.15.104:0/335570195 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dfc131b70 con 0x7f6dfc1275d0 2024-04-24T02:11:48.093 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.090+0000 7f6e019ca640 1 --2- 172.21.15.104:0/335570195 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6dfc1275d0 0x7f6dfc1c2c60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6df8009720 tx=0x7f6df80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:48.093 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.090+0000 7f6df27fc640 1 -- 172.21.15.104:0/335570195 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6df803cc30 con 0x7f6dfc1275d0 2024-04-24T02:11:48.093 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.090+0000 7f6df27fc640 1 -- 172.21.15.104:0/335570195 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6df803cdd0 con 0x7f6dfc1275d0 2024-04-24T02:11:48.093 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.090+0000 7f6df27fc640 1 -- 172.21.15.104:0/335570195 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6df8004160 con 0x7f6dfc1275d0 2024-04-24T02:11:48.093 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.090+0000 7f6e03c2e640 1 -- 172.21.15.104:0/335570195 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dfc08a1b0 con 0x7f6dfc1275d0 2024-04-24T02:11:48.093 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.090+0000 7f6e03c2e640 1 -- 172.21.15.104:0/335570195 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dfc08a5f0 con 0x7f6dfc1275d0 2024-04-24T02:11:48.094 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.091+0000 7f6df27fc640 1 -- 172.21.15.104:0/335570195 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 4) ==== 45507+0+0 (secure 0 0 0) 0x7f6df8038020 con 0x7f6dfc1275d0 2024-04-24T02:11:48.094 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.091+0000 7f6df27fc640 1 --2- 172.21.15.104:0/335570195 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6de0037fd0 0x7f6de003a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:48.094 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.091+0000 7f6df27fc640 1 -- 172.21.15.104:0/335570195 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1903+0+0 (secure 0 0 0) 0x7f6df806ce00 con 0x7f6dfc1275d0 2024-04-24T02:11:48.094 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.091+0000 7f6e03c2e640 1 -- 172.21.15.104:0/335570195 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dfc0737f0 con 0x7f6dfc1275d0 2024-04-24T02:11:48.094 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.092+0000 7f6e011c9640 1 --2- 172.21.15.104:0/335570195 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6de0037fd0 0x7f6de003a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:48.094 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.092+0000 7f6e011c9640 1 --2- 172.21.15.104:0/335570195 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6de0037fd0 0x7f6de003a490 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6dec000c00 tx=0x7f6dec007970 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:48.097 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.096+0000 7f6df27fc640 1 -- 172.21.15.104:0/335570195 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f6df8041070 con 0x7f6dfc1275d0 2024-04-24T02:11:48.269 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.268+0000 7f6e03c2e640 1 -- 172.21.15.104:0/335570195 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6dfc062da0 con 0x7f6dfc1275d0 2024-04-24T02:11:48.270 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.269+0000 7f6df27fc640 1 -- 172.21.15.104:0/335570195 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+4685 (secure 0 0 0) 0x7f6df8003610 con 0x7f6dfc1275d0 2024-04-24T02:11:48.270 INFO:teuthology.misc.health.smithi104.stdout: 2024-04-24T02:11:48.270 INFO:teuthology.misc.health.smithi104.stdout:{"epoch":10,"fsid":"b09461c3-8f3e-4967-89da-98f6945a4445","created":"2024-04-24T02:11:39.732268+0000","modified":"2024-04-24T02:11:48.018099+0000","last_up_change":"2024-04-24T02:11:47.013038+0000","last_in_change":"2024-04-24T02:11:40.809349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"505e5915-b411-48c8-b47f-9805fabd0c6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":2419146313},{"type":"v1","addr":"172.21.15.104:6801","nonce":2419146313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":2419146313},{"type":"v1","addr":"172.21.15.104:6803","nonce":2419146313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":2419146313},{"type":"v1","addr":"172.21.15.104:6807","nonce":2419146313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":2419146313},{"type":"v1","addr":"172.21.15.104:6805","nonce":2419146313}]},"public_addr":"172.21.15.104:6801/2419146313","cluster_addr":"172.21.15.104:6803/2419146313","heartbeat_back_addr":"172.21.15.104:6807/2419146313","heartbeat_front_addr":"172.21.15.104:6805/2419146313","state":["exists","up"]},{"osd":1,"uuid":"707422f1-aa99-41be-8312-caf9e6b35b46","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"745c40cd-2485-4701-ab89-5b349ab2198b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"271174d0-434d-424e-9d20-fd0e2b1dac16","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T02:11:45.883353+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T02:11:48.272 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.271+0000 7f6e03c2e640 1 -- 172.21.15.104:0/335570195 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6de0037fd0 msgr2=0x7f6de003a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:48.272 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.271+0000 7f6e03c2e640 1 --2- 172.21.15.104:0/335570195 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6de0037fd0 0x7f6de003a490 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6dec000c00 tx=0x7f6dec007970 comp rx=0 tx=0).stop 2024-04-24T02:11:48.272 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.271+0000 7f6e03c2e640 1 -- 172.21.15.104:0/335570195 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6dfc1275d0 msgr2=0x7f6dfc1c2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:48.272 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.271+0000 7f6e03c2e640 1 --2- 172.21.15.104:0/335570195 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6dfc1275d0 0x7f6dfc1c2c60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6df8009720 tx=0x7f6df80046c0 comp rx=0 tx=0).stop 2024-04-24T02:11:48.272 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.271+0000 7f6e03c2e640 1 -- 172.21.15.104:0/335570195 shutdown_connections 2024-04-24T02:11:48.272 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.271+0000 7f6e03c2e640 1 --2- 172.21.15.104:0/335570195 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6de0037fd0 0x7f6de003a490 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:48.273 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.271+0000 7f6e03c2e640 1 --2- 172.21.15.104:0/335570195 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6dfc1275d0 0x7f6dfc1c2c60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:48.273 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.271+0000 7f6e03c2e640 1 -- 172.21.15.104:0/335570195 >> 172.21.15.104:0/335570195 conn(0x7f6dfc09a840 msgr2=0x7f6dfc06d820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:48.273 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.271+0000 7f6e03c2e640 1 -- 172.21.15.104:0/335570195 shutdown_connections 2024-04-24T02:11:48.273 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:48.271+0000 7f6e03c2e640 1 -- 172.21.15.104:0/335570195 wait complete. 2024-04-24T02:11:48.281 DEBUG:teuthology.misc:1 of 4 OSDs are up 2024-04-24T02:11:48.689 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-04-24T02:11:48.689+0000 7fdbd8d2b640 -1 osd.3 0 waiting for initial osdmap 2024-04-24T02:11:48.691 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-24T02:11:48.691+0000 7f3330576640 -1 osd.1 0 waiting for initial osdmap 2024-04-24T02:11:48.706 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-04-24T02:11:48.706+0000 7fdbd135d640 -1 osd.3 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T02:11:48.707 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-24T02:11:48.707+0000 7f3328ba8640 -1 osd.1 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T02:11:48.718 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-04-24T02:11:48.718+0000 7f200ff5d640 -1 osd.2 0 waiting for initial osdmap 2024-04-24T02:11:48.730 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-04-24T02:11:48.730+0000 7f200858f640 -1 osd.2 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T02:11:54.685 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-24T02:11:54.785 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.783+0000 7fc96b040640 1 Processor -- start 2024-04-24T02:11:54.785 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.783+0000 7fc96b040640 1 -- start start 2024-04-24T02:11:54.785 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.784+0000 7fc96b040640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fc96406fcb0 0x7fc964130490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:54.785 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.784+0000 7fc96b040640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc96409c5e0 con 0x7fc96406f1c0 2024-04-24T02:11:54.786 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.784+0000 7fc96b040640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fc964070b50 con 0x7fc96406fcb0 2024-04-24T02:11:54.786 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.784+0000 7fc963fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fc96406fcb0 0x7fc964130490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:54.786 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.784+0000 7fc968ddc640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fc96406f1c0 0x7fc96406f5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:46760/0 (socket says 172.21.15.104:46760) 2024-04-24T02:11:54.786 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.784+0000 7fc963fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fc96406fcb0 0x7fc964130490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53618/0 (socket says 172.21.15.104:53618) 2024-04-24T02:11:54.786 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.784+0000 7fc968ddc640 1 -- 172.21.15.104:0/503825152 learned_addr learned my addr 172.21.15.104:0/503825152 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-04-24T02:11:54.786 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.784+0000 7fc963fff640 1 -- 172.21.15.104:0/503825152 >> v1:172.21.15.104:6789/0 conn(0x7fc96406f1c0 legacy=0x7fc96406f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:54.786 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.784+0000 7fc963fff640 1 -- 172.21.15.104:0/503825152 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9640727e0 con 0x7fc96406fcb0 2024-04-24T02:11:54.789 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.785+0000 7fc963fff640 1 --2- 172.21.15.104:0/503825152 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc96406fcb0 0x7fc964130490 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc958009720 tx=0x7fc95802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a2dda01a7d17e17 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:54.789 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.785+0000 7fc9637fe640 1 -- 172.21.15.104:0/503825152 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9580316d0 con 0x7fc96406fcb0 2024-04-24T02:11:54.789 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.785+0000 7fc9637fe640 1 -- 172.21.15.104:0/503825152 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc958037070 con 0x7fc96406fcb0 2024-04-24T02:11:54.789 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.785+0000 7fc9637fe640 1 -- 172.21.15.104:0/503825152 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9580319c0 con 0x7fc96406fcb0 2024-04-24T02:11:54.789 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.786+0000 7fc96b040640 1 -- 172.21.15.104:0/503825152 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc96406fcb0 msgr2=0x7fc964130490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:54.789 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.786+0000 7fc96b040640 1 --2- 172.21.15.104:0/503825152 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc96406fcb0 0x7fc964130490 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc958009720 tx=0x7fc95802b840 comp rx=0 tx=0).stop 2024-04-24T02:11:54.789 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.786+0000 7fc96b040640 1 -- 172.21.15.104:0/503825152 shutdown_connections 2024-04-24T02:11:54.789 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.786+0000 7fc96b040640 1 --2- 172.21.15.104:0/503825152 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc96406fcb0 0x7fc964130490 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:54.789 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.786+0000 7fc96b040640 1 -- 172.21.15.104:0/503825152 >> 172.21.15.104:0/503825152 conn(0x7fc96409a840 msgr2=0x7fc96409ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:54.789 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.786+0000 7fc96b040640 1 -- 172.21.15.104:0/503825152 shutdown_connections 2024-04-24T02:11:54.789 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.786+0000 7fc96b040640 1 -- 172.21.15.104:0/503825152 wait complete. 2024-04-24T02:11:54.789 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.786+0000 7fc96b040640 1 Processor -- start 2024-04-24T02:11:54.789 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.786+0000 7fc96b040640 1 -- start start 2024-04-24T02:11:54.790 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.787+0000 7fc96b040640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc96406f1c0 0x7fc9640956a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:54.790 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.787+0000 7fc96b040640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc964130b50 con 0x7fc96406f1c0 2024-04-24T02:11:54.790 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.787+0000 7fc968ddc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc96406f1c0 0x7fc9640956a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:54.790 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.787+0000 7fc968ddc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc96406f1c0 0x7fc9640956a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53620/0 (socket says 172.21.15.104:53620) 2024-04-24T02:11:54.790 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.787+0000 7fc968ddc640 1 -- 172.21.15.104:0/371950229 learned_addr learned my addr 172.21.15.104:0/371950229 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:11:54.790 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.787+0000 7fc968ddc640 1 -- 172.21.15.104:0/371950229 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9641273b0 con 0x7fc96406f1c0 2024-04-24T02:11:54.790 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.787+0000 7fc968ddc640 1 --2- 172.21.15.104:0/371950229 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc96406f1c0 0x7fc9640956a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc95400c4a0 tx=0x7fc95400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:54.790 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.788+0000 7fc9617fa640 1 -- 172.21.15.104:0/371950229 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc954017070 con 0x7fc96406f1c0 2024-04-24T02:11:54.790 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.788+0000 7fc9617fa640 1 -- 172.21.15.104:0/371950229 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc954005c10 con 0x7fc96406f1c0 2024-04-24T02:11:54.790 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.788+0000 7fc96b040640 1 -- 172.21.15.104:0/371950229 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc964126f10 con 0x7fc96406f1c0 2024-04-24T02:11:54.790 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.788+0000 7fc9617fa640 1 -- 172.21.15.104:0/371950229 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc954007070 con 0x7fc96406f1c0 2024-04-24T02:11:54.790 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.788+0000 7fc96b040640 1 -- 172.21.15.104:0/371950229 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc964128220 con 0x7fc96406f1c0 2024-04-24T02:11:54.791 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.788+0000 7fc9617fa640 1 -- 172.21.15.104:0/371950229 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc95401a070 con 0x7fc96406f1c0 2024-04-24T02:11:54.791 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.789+0000 7fc9617fa640 1 --2- 172.21.15.104:0/371950229 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc950038060 0x7fc95003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:54.791 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.789+0000 7fc96b040640 1 -- 172.21.15.104:0/371950229 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9640737f0 con 0x7fc96406f1c0 2024-04-24T02:11:54.791 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.789+0000 7fc9617fa640 1 -- 172.21.15.104:0/371950229 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3129+0+0 (secure 0 0 0) 0x7fc95404a0a0 con 0x7fc96406f1c0 2024-04-24T02:11:54.791 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.789+0000 7fc963fff640 1 --2- 172.21.15.104:0/371950229 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc950038060 0x7fc95003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:54.792 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.790+0000 7fc963fff640 1 --2- 172.21.15.104:0/371950229 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc950038060 0x7fc95003a520 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc958036000 tx=0x7fc958008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:54.794 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.794+0000 7fc9617fa640 1 -- 172.21.15.104:0/371950229 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7fc964128220 con 0x7fc96406f1c0 2024-04-24T02:11:54.972 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.972+0000 7fc96b040640 1 -- 172.21.15.104:0/371950229 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc964089fd0 con 0x7fc96406f1c0 2024-04-24T02:11:54.973 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.972+0000 7fc9617fa640 1 -- 172.21.15.104:0/371950229 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+7990 (secure 0 0 0) 0x7fc95401b3b0 con 0x7fc96406f1c0 2024-04-24T02:11:54.973 INFO:teuthology.misc.health.smithi104.stdout: 2024-04-24T02:11:54.973 INFO:teuthology.misc.health.smithi104.stdout:{"epoch":14,"fsid":"b09461c3-8f3e-4967-89da-98f6945a4445","created":"2024-04-24T02:11:39.732268+0000","modified":"2024-04-24T02:11:52.703231+0000","last_up_change":"2024-04-24T02:11:49.695976+0000","last_in_change":"2024-04-24T02:11:40.809349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T02:11:49.987861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"505e5915-b411-48c8-b47f-9805fabd0c6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":2419146313},{"type":"v1","addr":"172.21.15.104:6801","nonce":2419146313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":2419146313},{"type":"v1","addr":"172.21.15.104:6803","nonce":2419146313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":2419146313},{"type":"v1","addr":"172.21.15.104:6807","nonce":2419146313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":2419146313},{"type":"v1","addr":"172.21.15.104:6805","nonce":2419146313}]},"public_addr":"172.21.15.104:6801/2419146313","cluster_addr":"172.21.15.104:6803/2419146313","heartbeat_back_addr":"172.21.15.104:6807/2419146313","heartbeat_front_addr":"172.21.15.104:6805/2419146313","state":["exists","up"]},{"osd":1,"uuid":"707422f1-aa99-41be-8312-caf9e6b35b46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1487076214},{"type":"v1","addr":"172.21.15.134:6809","nonce":1487076214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1487076214},{"type":"v1","addr":"172.21.15.134:6815","nonce":1487076214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1487076214},{"type":"v1","addr":"172.21.15.134:6823","nonce":1487076214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1487076214},{"type":"v1","addr":"172.21.15.134:6821","nonce":1487076214}]},"public_addr":"172.21.15.134:6809/1487076214","cluster_addr":"172.21.15.134:6815/1487076214","heartbeat_back_addr":"172.21.15.134:6823/1487076214","heartbeat_front_addr":"172.21.15.134:6821/1487076214","state":["exists","up"]},{"osd":2,"uuid":"745c40cd-2485-4701-ab89-5b349ab2198b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":214480313},{"type":"v1","addr":"172.21.15.134:6802","nonce":214480313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6805","nonce":214480313},{"type":"v1","addr":"172.21.15.134:6807","nonce":214480313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":214480313},{"type":"v1","addr":"172.21.15.134:6819","nonce":214480313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":214480313},{"type":"v1","addr":"172.21.15.134:6813","nonce":214480313}]},"public_addr":"172.21.15.134:6802/214480313","cluster_addr":"172.21.15.134:6807/214480313","heartbeat_back_addr":"172.21.15.134:6819/214480313","heartbeat_front_addr":"172.21.15.134:6813/214480313","state":["exists","up"]},{"osd":3,"uuid":"271174d0-434d-424e-9d20-fd0e2b1dac16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6801","nonce":3585115521},{"type":"v1","addr":"172.21.15.134:6803","nonce":3585115521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3585115521},{"type":"v1","addr":"172.21.15.134:6808","nonce":3585115521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":3585115521},{"type":"v1","addr":"172.21.15.134:6820","nonce":3585115521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":3585115521},{"type":"v1","addr":"172.21.15.134:6814","nonce":3585115521}]},"public_addr":"172.21.15.134:6803/3585115521","cluster_addr":"172.21.15.134:6808/3585115521","heartbeat_back_addr":"172.21.15.134:6820/3585115521","heartbeat_front_addr":"172.21.15.134:6814/3585115521","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T02:11:45.883353+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T02:11:45.977825+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T02:11:46.030798+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T02:11:46.006726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T02:11:54.976 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.975+0000 7fc96b040640 1 -- 172.21.15.104:0/371950229 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc950038060 msgr2=0x7fc95003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:54.976 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.975+0000 7fc96b040640 1 --2- 172.21.15.104:0/371950229 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc950038060 0x7fc95003a520 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc958036000 tx=0x7fc958008030 comp rx=0 tx=0).stop 2024-04-24T02:11:54.976 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.975+0000 7fc96b040640 1 -- 172.21.15.104:0/371950229 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc96406f1c0 msgr2=0x7fc9640956a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:54.976 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.975+0000 7fc96b040640 1 --2- 172.21.15.104:0/371950229 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc96406f1c0 0x7fc9640956a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc95400c4a0 tx=0x7fc95400c960 comp rx=0 tx=0).stop 2024-04-24T02:11:54.976 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.975+0000 7fc96b040640 1 -- 172.21.15.104:0/371950229 shutdown_connections 2024-04-24T02:11:54.976 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.975+0000 7fc96b040640 1 --2- 172.21.15.104:0/371950229 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc950038060 0x7fc95003a520 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:54.976 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.975+0000 7fc96b040640 1 --2- 172.21.15.104:0/371950229 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc96406f1c0 0x7fc9640956a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:54.976 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.975+0000 7fc96b040640 1 -- 172.21.15.104:0/371950229 >> 172.21.15.104:0/371950229 conn(0x7fc96409a840 msgr2=0x7fc96412d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:54.977 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.975+0000 7fc96b040640 1 -- 172.21.15.104:0/371950229 shutdown_connections 2024-04-24T02:11:54.977 INFO:teuthology.misc.health.smithi104.stderr:2024-04-24T02:11:54.975+0000 7fc96b040640 1 -- 172.21.15.104:0/371950229 wait complete. 2024-04-24T02:11:54.985 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-04-24T02:11:54.986 INFO:tasks.ceph:Creating RBD pool 2024-04-24T02:11:54.986 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-24T02:11:55.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.081+0000 7f1bfea6a640 1 Processor -- start 2024-04-24T02:11:55.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.081+0000 7f1bfea6a640 1 -- start start 2024-04-24T02:11:55.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.081+0000 7f1bfea6a640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f1bf8127cb0 0x7f1bf8128090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:55.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.081+0000 7f1bfea6a640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bf8128a00 con 0x7f1bf81285d0 2024-04-24T02:11:55.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.081+0000 7f1bfea6a640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f1bf8127b00 con 0x7f1bf8127cb0 2024-04-24T02:11:55.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.082+0000 7f1bfc806640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f1bf8127cb0 0x7f1bf8128090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:55.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.082+0000 7f1bf7fff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f1bf81285d0 0x7f1bf806e530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:46774/0 (socket says 172.21.15.104:46774) 2024-04-24T02:11:55.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.082+0000 7f1bf7fff640 1 -- 172.21.15.104:0/955057 learned_addr learned my addr 172.21.15.104:0/955057 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-04-24T02:11:55.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.082+0000 7f1bfc806640 1 -- 172.21.15.104:0/955057 >> v1:172.21.15.104:6789/0 conn(0x7f1bf81285d0 legacy=0x7f1bf806e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:55.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.082+0000 7f1bfc806640 1 -- 172.21.15.104:0/955057 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bf8098800 con 0x7f1bf8127cb0 2024-04-24T02:11:55.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.082+0000 7f1bfc806640 1 --2- 172.21.15.104:0/955057 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1bf8127cb0 0x7f1bf8128090 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1bec009750 tx=0x7f1bec02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=714a4782c2127152 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:55.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.083+0000 7f1bf77fe640 1 -- 172.21.15.104:0/955057 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bec0316d0 con 0x7f1bf8127cb0 2024-04-24T02:11:55.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.083+0000 7f1bf77fe640 1 -- 172.21.15.104:0/955057 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bec037070 con 0x7f1bf8127cb0 2024-04-24T02:11:55.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.083+0000 7f1bf77fe640 1 -- 172.21.15.104:0/955057 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bec0319c0 con 0x7f1bf8127cb0 2024-04-24T02:11:55.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.083+0000 7f1bfea6a640 1 -- 172.21.15.104:0/955057 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1bf8127cb0 msgr2=0x7f1bf8128090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:55.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.083+0000 7f1bfea6a640 1 --2- 172.21.15.104:0/955057 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1bf8127cb0 0x7f1bf8128090 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1bec009750 tx=0x7f1bec02b840 comp rx=0 tx=0).stop 2024-04-24T02:11:55.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.083+0000 7f1bfea6a640 1 -- 172.21.15.104:0/955057 shutdown_connections 2024-04-24T02:11:55.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.083+0000 7f1bfea6a640 1 --2- 172.21.15.104:0/955057 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1bf8127cb0 0x7f1bf8128090 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:55.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.083+0000 7f1bfea6a640 1 -- 172.21.15.104:0/955057 >> 172.21.15.104:0/955057 conn(0x7f1bf8099680 msgr2=0x7f1bf8099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:55.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.083+0000 7f1bfea6a640 1 -- 172.21.15.104:0/955057 shutdown_connections 2024-04-24T02:11:55.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.083+0000 7f1bfea6a640 1 -- 172.21.15.104:0/955057 wait complete. 2024-04-24T02:11:55.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.084+0000 7f1bfea6a640 1 Processor -- start 2024-04-24T02:11:55.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.084+0000 7f1bfea6a640 1 -- start start 2024-04-24T02:11:55.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.084+0000 7f1bfea6a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1bf8127cb0 0x7f1bf808ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:55.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.084+0000 7f1bfea6a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf80701f0 con 0x7f1bf8127cb0 2024-04-24T02:11:55.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.085+0000 7f1bfc806640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1bf8127cb0 0x7f1bf808ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:55.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.085+0000 7f1bfc806640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1bf8127cb0 0x7f1bf808ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53634/0 (socket says 172.21.15.104:53634) 2024-04-24T02:11:55.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.085+0000 7f1bfc806640 1 -- 172.21.15.104:0/1280214655 learned_addr learned my addr 172.21.15.104:0/1280214655 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:11:55.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.085+0000 7f1bfc806640 1 -- 172.21.15.104:0/1280214655 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bf808df70 con 0x7f1bf8127cb0 2024-04-24T02:11:55.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.085+0000 7f1bfc806640 1 --2- 172.21.15.104:0/1280214655 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1bf8127cb0 0x7f1bf808ccc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1bec02b880 tx=0x7f1bec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:55.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.085+0000 7f1bf57fa640 1 -- 172.21.15.104:0/1280214655 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bec032770 con 0x7f1bf8127cb0 2024-04-24T02:11:55.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.085+0000 7f1bf57fa640 1 -- 172.21.15.104:0/1280214655 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bec032910 con 0x7f1bf8127cb0 2024-04-24T02:11:55.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.085+0000 7f1bfea6a640 1 -- 172.21.15.104:0/1280214655 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bf806de20 con 0x7f1bf8127cb0 2024-04-24T02:11:55.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.085+0000 7f1bf57fa640 1 -- 172.21.15.104:0/1280214655 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bec032c10 con 0x7f1bf8127cb0 2024-04-24T02:11:55.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.085+0000 7f1bfea6a640 1 -- 172.21.15.104:0/1280214655 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bf808f2b0 con 0x7f1bf8127cb0 2024-04-24T02:11:55.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.086+0000 7f1bf57fa640 1 -- 172.21.15.104:0/1280214655 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1bec04c060 con 0x7f1bf8127cb0 2024-04-24T02:11:55.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.086+0000 7f1bf57fa640 1 --2- 172.21.15.104:0/1280214655 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1bdc038060 0x7f1bdc03a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:55.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.086+0000 7f1bfea6a640 1 -- 172.21.15.104:0/1280214655 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bf8062da0 con 0x7f1bf8127cb0 2024-04-24T02:11:55.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.086+0000 7f1bf57fa640 1 -- 172.21.15.104:0/1280214655 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3129+0+0 (secure 0 0 0) 0x7f1bec02f050 con 0x7f1bf8127cb0 2024-04-24T02:11:55.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.087+0000 7f1bf7fff640 1 --2- 172.21.15.104:0/1280214655 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1bdc038060 0x7f1bdc03a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:55.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.087+0000 7f1bf7fff640 1 --2- 172.21.15.104:0/1280214655 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1bdc038060 0x7f1bdc03a520 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1be4007fd0 tx=0x7f1be4007ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:55.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.091+0000 7f1bf57fa640 1 -- 172.21.15.104:0/1280214655 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f1bf806de20 con 0x7f1bf8127cb0 2024-04-24T02:11:55.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.264+0000 7f1bfea6a640 1 -- 172.21.15.104:0/1280214655 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f1bf806c170 con 0x7f1bf8127cb0 2024-04-24T02:11:55.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.713+0000 7f1bf57fa640 1 -- 172.21.15.104:0/1280214655 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v15) ==== 109+0+0 (secure 0 0 0) 0x7f1bf808df70 con 0x7f1bf8127cb0 2024-04-24T02:11:55.715 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'rbd' created 2024-04-24T02:11:55.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.716+0000 7f1bfea6a640 1 -- 172.21.15.104:0/1280214655 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1bdc038060 msgr2=0x7f1bdc03a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:55.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.716+0000 7f1bfea6a640 1 --2- 172.21.15.104:0/1280214655 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1bdc038060 0x7f1bdc03a520 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1be4007fd0 tx=0x7f1be4007ac0 comp rx=0 tx=0).stop 2024-04-24T02:11:55.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.716+0000 7f1bfea6a640 1 -- 172.21.15.104:0/1280214655 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1bf8127cb0 msgr2=0x7f1bf808ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:55.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.716+0000 7f1bfea6a640 1 --2- 172.21.15.104:0/1280214655 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1bf8127cb0 0x7f1bf808ccc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1bec02b880 tx=0x7f1bec0046c0 comp rx=0 tx=0).stop 2024-04-24T02:11:55.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.716+0000 7f1bfea6a640 1 -- 172.21.15.104:0/1280214655 shutdown_connections 2024-04-24T02:11:55.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.716+0000 7f1bfea6a640 1 --2- 172.21.15.104:0/1280214655 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1bdc038060 0x7f1bdc03a520 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:55.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.716+0000 7f1bfea6a640 1 --2- 172.21.15.104:0/1280214655 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1bf8127cb0 0x7f1bf808ccc0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:55.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.716+0000 7f1bfea6a640 1 -- 172.21.15.104:0/1280214655 >> 172.21.15.104:0/1280214655 conn(0x7f1bf8099680 msgr2=0x7f1bf809a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:55.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.716+0000 7f1bfea6a640 1 -- 172.21.15.104:0/1280214655 shutdown_connections 2024-04-24T02:11:55.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.716+0000 7f1bfea6a640 1 -- 172.21.15.104:0/1280214655 wait complete. 2024-04-24T02:11:55.728 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-24T02:11:55.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.826+0000 7f3d122fb640 1 Processor -- start 2024-04-24T02:11:55.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.826+0000 7f3d122fb640 1 -- start start 2024-04-24T02:11:55.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.826+0000 7f3d122fb640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f3d0c12b3d0 0x7f3d0c12b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:55.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.826+0000 7f3d122fb640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d0c06eac0 con 0x7f3d0c0701f0 2024-04-24T02:11:55.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.826+0000 7f3d122fb640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f3d0c12af80 con 0x7f3d0c12b3d0 2024-04-24T02:11:55.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.826+0000 7f3d0bfff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f3d0c12b3d0 0x7f3d0c12b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:55.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.826+0000 7f3d0bfff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f3d0c12b3d0 0x7f3d0c12b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53644/0 (socket says 172.21.15.104:53644) 2024-04-24T02:11:55.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.826+0000 7f3d0b7fe640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f3d0c0701f0 0x7f3d0c070630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:46782/0 (socket says 172.21.15.104:46782) 2024-04-24T02:11:55.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.826+0000 7f3d0bfff640 1 -- 172.21.15.104:0/4096647647 learned_addr learned my addr 172.21.15.104:0/4096647647 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:11:55.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.827+0000 7f3d0bfff640 1 -- 172.21.15.104:0/4096647647 >> v1:172.21.15.104:6789/0 conn(0x7f3d0c0701f0 legacy=0x7f3d0c070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:55.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.827+0000 7f3d0bfff640 1 -- 172.21.15.104:0/4096647647 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d0c12b1b0 con 0x7f3d0c12b3d0 2024-04-24T02:11:55.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.827+0000 7f3d0affd640 1 -- 172.21.15.104:0/4096647647 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 805194924 0 0) 0x7f3d0c06eac0 con 0x7f3d0c0701f0 2024-04-24T02:11:55.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.827+0000 7f3d0bfff640 1 --2- 172.21.15.104:0/4096647647 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d0c12b3d0 0x7f3d0c12b7b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3d000097f0 tx=0x7f3d0002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e18a75c50c61d5b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:55.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.828+0000 7f3d0affd640 1 -- 172.21.15.104:0/4096647647 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d00035020 con 0x7f3d0c12b3d0 2024-04-24T02:11:55.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.828+0000 7f3d0affd640 1 -- 172.21.15.104:0/4096647647 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d000317a0 con 0x7f3d0c12b3d0 2024-04-24T02:11:55.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.828+0000 7f3d0affd640 1 -- 172.21.15.104:0/4096647647 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d00031aa0 con 0x7f3d0c12b3d0 2024-04-24T02:11:55.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.828+0000 7f3d122fb640 1 -- 172.21.15.104:0/4096647647 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d0c12b3d0 msgr2=0x7f3d0c12b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:55.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.828+0000 7f3d122fb640 1 --2- 172.21.15.104:0/4096647647 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d0c12b3d0 0x7f3d0c12b7b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3d000097f0 tx=0x7f3d0002b910 comp rx=0 tx=0).stop 2024-04-24T02:11:55.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.828+0000 7f3d122fb640 1 -- 172.21.15.104:0/4096647647 shutdown_connections 2024-04-24T02:11:55.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.828+0000 7f3d122fb640 1 --2- 172.21.15.104:0/4096647647 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d0c12b3d0 0x7f3d0c12b7b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:55.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.828+0000 7f3d122fb640 1 -- 172.21.15.104:0/4096647647 >> 172.21.15.104:0/4096647647 conn(0x7f3d0c099510 msgr2=0x7f3d0c099920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:55.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.828+0000 7f3d122fb640 1 -- 172.21.15.104:0/4096647647 shutdown_connections 2024-04-24T02:11:55.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.828+0000 7f3d122fb640 1 -- 172.21.15.104:0/4096647647 wait complete. 2024-04-24T02:11:55.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.829+0000 7f3d122fb640 1 Processor -- start 2024-04-24T02:11:55.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.829+0000 7f3d122fb640 1 -- start start 2024-04-24T02:11:55.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.830+0000 7f3d122fb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d0c0701f0 0x7f3d0c112e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:55.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.830+0000 7f3d122fb640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0c072480 con 0x7f3d0c0701f0 2024-04-24T02:11:55.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.830+0000 7f3d0bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d0c0701f0 0x7f3d0c112e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:55.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.830+0000 7f3d0bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d0c0701f0 0x7f3d0c112e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53650/0 (socket says 172.21.15.104:53650) 2024-04-24T02:11:55.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.830+0000 7f3d0bfff640 1 -- 172.21.15.104:0/4073518596 learned_addr learned my addr 172.21.15.104:0/4073518596 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:11:55.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.830+0000 7f3d0bfff640 1 -- 172.21.15.104:0/4073518596 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d0c1149e0 con 0x7f3d0c0701f0 2024-04-24T02:11:55.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.830+0000 7f3d0bfff640 1 --2- 172.21.15.104:0/4073518596 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d0c0701f0 0x7f3d0c112e70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3d0002b950 tx=0x7f3d000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:55.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.830+0000 7f3d08ff9640 1 -- 172.21.15.104:0/4073518596 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d0003ad00 con 0x7f3d0c0701f0 2024-04-24T02:11:55.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.830+0000 7f3d08ff9640 1 -- 172.21.15.104:0/4073518596 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d000443f0 con 0x7f3d0c0701f0 2024-04-24T02:11:55.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.830+0000 7f3d122fb640 1 -- 172.21.15.104:0/4073518596 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d0c115a50 con 0x7f3d0c0701f0 2024-04-24T02:11:55.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.830+0000 7f3d08ff9640 1 -- 172.21.15.104:0/4073518596 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d00044710 con 0x7f3d0c0701f0 2024-04-24T02:11:55.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.830+0000 7f3d122fb640 1 -- 172.21.15.104:0/4073518596 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d0c121b50 con 0x7f3d0c0701f0 2024-04-24T02:11:55.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.831+0000 7f3d08ff9640 1 -- 172.21.15.104:0/4073518596 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3d0004b060 con 0x7f3d0c0701f0 2024-04-24T02:11:55.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.831+0000 7f3d122fb640 1 -- 172.21.15.104:0/4073518596 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d0c121de0 con 0x7f3d0c0701f0 2024-04-24T02:11:55.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.831+0000 7f3d08ff9640 1 --2- 172.21.15.104:0/4073518596 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3cf8038060 0x7f3cf803a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:55.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.831+0000 7f3d08ff9640 1 -- 172.21.15.104:0/4073518596 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3471+0+0 (secure 0 0 0) 0x7f3d0006d110 con 0x7f3d0c0701f0 2024-04-24T02:11:55.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.832+0000 7f3d0b7fe640 1 --2- 172.21.15.104:0/4073518596 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3cf8038060 0x7f3cf803a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:55.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.832+0000 7f3d0b7fe640 1 --2- 172.21.15.104:0/4073518596 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3cf8038060 0x7f3cf803a520 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc000c00 tx=0x7f3cfc007910 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:55.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:55.836+0000 7f3d08ff9640 1 -- 172.21.15.104:0/4073518596 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f3d0003f070 con 0x7f3d0c0701f0 2024-04-24T02:11:56.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.007+0000 7f3d122fb640 1 -- 172.21.15.104:0/4073518596 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) -- 0x7f3d0c062da0 con 0x7f3d0c0701f0 2024-04-24T02:11:56.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.716+0000 7f3d08ff9640 1 -- 172.21.15.104:0/4073518596 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v16) ==== 173+0+0 (secure 0 0 0) 0x7f3d000433a0 con 0x7f3d0c0701f0 2024-04-24T02:11:56.717 INFO:teuthology.orchestra.run.smithi104.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-24T02:11:56.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.719+0000 7f3d122fb640 1 -- 172.21.15.104:0/4073518596 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3cf8038060 msgr2=0x7f3cf803a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:56.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.719+0000 7f3d122fb640 1 --2- 172.21.15.104:0/4073518596 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3cf8038060 0x7f3cf803a520 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc000c00 tx=0x7f3cfc007910 comp rx=0 tx=0).stop 2024-04-24T02:11:56.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.719+0000 7f3d122fb640 1 -- 172.21.15.104:0/4073518596 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d0c0701f0 msgr2=0x7f3d0c112e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:56.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.719+0000 7f3d122fb640 1 --2- 172.21.15.104:0/4073518596 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d0c0701f0 0x7f3d0c112e70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3d0002b950 tx=0x7f3d000046c0 comp rx=0 tx=0).stop 2024-04-24T02:11:56.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.719+0000 7f3d122fb640 1 -- 172.21.15.104:0/4073518596 shutdown_connections 2024-04-24T02:11:56.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.719+0000 7f3d122fb640 1 --2- 172.21.15.104:0/4073518596 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3cf8038060 0x7f3cf803a520 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:56.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.719+0000 7f3d122fb640 1 --2- 172.21.15.104:0/4073518596 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d0c0701f0 0x7f3d0c112e70 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:56.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.719+0000 7f3d122fb640 1 -- 172.21.15.104:0/4073518596 >> 172.21.15.104:0/4073518596 conn(0x7f3d0c099510 msgr2=0x7f3d0c09b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:56.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.719+0000 7f3d122fb640 1 -- 172.21.15.104:0/4073518596 shutdown_connections 2024-04-24T02:11:56.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.719+0000 7f3d122fb640 1 -- 172.21.15.104:0/4073518596 wait complete. 2024-04-24T02:11:56.733 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-24T02:11:56.733 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-24T02:11:56.733 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-24T02:11:56.733 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-24T02:11:56.734 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-24T02:11:56.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.830+0000 7f9db96f2640 1 Processor -- start 2024-04-24T02:11:56.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.830+0000 7f9db96f2640 1 -- start start 2024-04-24T02:11:56.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.830+0000 7f9db96f2640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f9db41316b0 0x7f9db4133aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:56.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.830+0000 7f9db96f2640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9db4071220 con 0x7f9db406e850 2024-04-24T02:11:56.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.830+0000 7f9db96f2640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f9db406fb20 con 0x7f9db41316b0 2024-04-24T02:11:56.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.831+0000 7f9db27fc640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f9db41316b0 0x7f9db4133aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:56.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.831+0000 7f9db2ffd640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f9db406e850 0x7f9db406ec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:46784/0 (socket says 172.21.15.104:46784) 2024-04-24T02:11:56.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.831+0000 7f9db2ffd640 1 -- 172.21.15.104:0/3318144109 learned_addr learned my addr 172.21.15.104:0/3318144109 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-04-24T02:11:56.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.831+0000 7f9db27fc640 1 -- 172.21.15.104:0/3318144109 >> v1:172.21.15.104:6789/0 conn(0x7f9db406e850 legacy=0x7f9db406ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:56.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.831+0000 7f9db1ffb640 1 -- 172.21.15.104:0/3318144109 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2890873697 0 0) 0x7f9da4001490 con 0x7f9db406e850 2024-04-24T02:11:56.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.831+0000 7f9db27fc640 1 -- 172.21.15.104:0/3318144109 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9db406f8b0 con 0x7f9db41316b0 2024-04-24T02:11:56.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.832+0000 7f9db27fc640 1 --2- 172.21.15.104:0/3318144109 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9db41316b0 0x7f9db4133aa0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9da8009720 tx=0x7f9da802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaa19ba80560b2c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:56.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.832+0000 7f9db1ffb640 1 -- 172.21.15.104:0/3318144109 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9da80316d0 con 0x7f9db41316b0 2024-04-24T02:11:56.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.832+0000 7f9db1ffb640 1 -- 172.21.15.104:0/3318144109 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9da8037070 con 0x7f9db41316b0 2024-04-24T02:11:56.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.832+0000 7f9db1ffb640 1 -- 172.21.15.104:0/3318144109 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9da80319c0 con 0x7f9db41316b0 2024-04-24T02:11:56.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.832+0000 7f9db96f2640 1 -- 172.21.15.104:0/3318144109 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9db41316b0 msgr2=0x7f9db4133aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:56.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.832+0000 7f9db96f2640 1 --2- 172.21.15.104:0/3318144109 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9db41316b0 0x7f9db4133aa0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9da8009720 tx=0x7f9da802b840 comp rx=0 tx=0).stop 2024-04-24T02:11:56.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.832+0000 7f9db96f2640 1 -- 172.21.15.104:0/3318144109 shutdown_connections 2024-04-24T02:11:56.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.832+0000 7f9db96f2640 1 --2- 172.21.15.104:0/3318144109 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9db41316b0 0x7f9db4133aa0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:56.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.832+0000 7f9db96f2640 1 -- 172.21.15.104:0/3318144109 >> 172.21.15.104:0/3318144109 conn(0x7f9db409d750 msgr2=0x7f9db409db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:56.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.832+0000 7f9db96f2640 1 -- 172.21.15.104:0/3318144109 shutdown_connections 2024-04-24T02:11:56.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.832+0000 7f9db96f2640 1 -- 172.21.15.104:0/3318144109 wait complete. 2024-04-24T02:11:56.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.833+0000 7f9db96f2640 1 Processor -- start 2024-04-24T02:11:56.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.833+0000 7f9db96f2640 1 -- start start 2024-04-24T02:11:56.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.834+0000 7f9db96f2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9db406e850 0x7f9db411a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:56.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.834+0000 7f9db96f2640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9db406f340 con 0x7f9db406e850 2024-04-24T02:11:56.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.834+0000 7f9db2ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9db406e850 0x7f9db411a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:56.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.834+0000 7f9db2ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9db406e850 0x7f9db411a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53676/0 (socket says 172.21.15.104:53676) 2024-04-24T02:11:56.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.834+0000 7f9db2ffd640 1 -- 172.21.15.104:0/4277834558 learned_addr learned my addr 172.21.15.104:0/4277834558 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:11:56.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.834+0000 7f9db2ffd640 1 -- 172.21.15.104:0/4277834558 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9db411c3a0 con 0x7f9db406e850 2024-04-24T02:11:56.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.834+0000 7f9db2ffd640 1 --2- 172.21.15.104:0/4277834558 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9db406e850 0x7f9db411a380 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9da400c790 tx=0x7f9da400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:56.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.834+0000 7f9d9b7fe640 1 -- 172.21.15.104:0/4277834558 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9da4018070 con 0x7f9db406e850 2024-04-24T02:11:56.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.834+0000 7f9d9b7fe640 1 -- 172.21.15.104:0/4277834558 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9da4004d70 con 0x7f9db406e850 2024-04-24T02:11:56.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.834+0000 7f9d9b7fe640 1 -- 172.21.15.104:0/4277834558 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9da400a7f0 con 0x7f9db406e850 2024-04-24T02:11:56.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.834+0000 7f9db96f2640 1 -- 172.21.15.104:0/4277834558 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9db411dbe0 con 0x7f9db406e850 2024-04-24T02:11:56.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.834+0000 7f9db96f2640 1 -- 172.21.15.104:0/4277834558 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9db411aaa0 con 0x7f9db406e850 2024-04-24T02:11:56.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.835+0000 7f9d9b7fe640 1 -- 172.21.15.104:0/4277834558 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9da401b070 con 0x7f9db406e850 2024-04-24T02:11:56.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.835+0000 7f9d9b7fe640 1 --2- 172.21.15.104:0/4277834558 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9da0038060 0x7f9da003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:56.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.835+0000 7f9db96f2640 1 -- 172.21.15.104:0/4277834558 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9db411bf00 con 0x7f9db406e850 2024-04-24T02:11:56.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.835+0000 7f9d9b7fe640 1 -- 172.21.15.104:0/4277834558 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3482+0+0 (secure 0 0 0) 0x7f9da404a670 con 0x7f9db406e850 2024-04-24T02:11:56.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.836+0000 7f9db27fc640 1 --2- 172.21.15.104:0/4277834558 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9da0038060 0x7f9da003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:56.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.836+0000 7f9db27fc640 1 --2- 172.21.15.104:0/4277834558 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9da0038060 0x7f9da003a520 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9da8009720 tx=0x7f9da8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:56.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:56.840+0000 7f9d9b7fe640 1 -- 172.21.15.104:0/4277834558 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f9db4071220 con 0x7f9db406e850 2024-04-24T02:11:57.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.059+0000 7f9db96f2640 1 -- 172.21.15.104:0/4277834558 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f9db4062da0 con 0x7f9db406e850 2024-04-24T02:11:57.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.061+0000 7f9d9b7fe640 1 -- 172.21.15.104:0/4277834558 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+87206 (secure 0 0 0) 0x7f9da40374c0 con 0x7f9db406e850 2024-04-24T02:11:57.063 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:11:57.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.063+0000 7f9db96f2640 1 -- 172.21.15.104:0/4277834558 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9da0038060 msgr2=0x7f9da003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:57.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.063+0000 7f9db96f2640 1 --2- 172.21.15.104:0/4277834558 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9da0038060 0x7f9da003a520 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9da8009720 tx=0x7f9da8008030 comp rx=0 tx=0).stop 2024-04-24T02:11:57.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.063+0000 7f9db96f2640 1 -- 172.21.15.104:0/4277834558 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9db406e850 msgr2=0x7f9db411a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:57.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.063+0000 7f9db96f2640 1 --2- 172.21.15.104:0/4277834558 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9db406e850 0x7f9db411a380 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9da400c790 tx=0x7f9da400cc50 comp rx=0 tx=0).stop 2024-04-24T02:11:57.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.063+0000 7f9db96f2640 1 -- 172.21.15.104:0/4277834558 shutdown_connections 2024-04-24T02:11:57.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.063+0000 7f9db96f2640 1 --2- 172.21.15.104:0/4277834558 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9da0038060 0x7f9da003a520 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:57.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.063+0000 7f9db96f2640 1 --2- 172.21.15.104:0/4277834558 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9db406e850 0x7f9db411a380 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:57.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.063+0000 7f9db96f2640 1 -- 172.21.15.104:0/4277834558 >> 172.21.15.104:0/4277834558 conn(0x7f9db409d750 msgr2=0x7f9db409f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:57.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.063+0000 7f9db96f2640 1 -- 172.21.15.104:0/4277834558 shutdown_connections 2024-04-24T02:11:57.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.063+0000 7f9db96f2640 1 -- 172.21.15.104:0/4277834558 wait complete. 2024-04-24T02:11:57.074 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":3655027977},{"type":"v1","addr":"172.21.15.134:6825","nonce":3655027977}]},"active_addr":"172.21.15.134:6825/3655027977","active_change":"2024-04-24T02:11:43.953141+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.134:0","nonce":239955735}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.134:0","nonce":1215343311}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.134:0","nonce":1780198883}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.134:0","nonce":1843457313}]}]} 2024-04-24T02:11:57.076 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-24T02:11:57.077 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-24T02:11:57.077 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T02:11:57.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.171+0000 7f425d7ab640 1 Processor -- start 2024-04-24T02:11:57.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.171+0000 7f425d7ab640 1 -- start start 2024-04-24T02:11:57.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.171+0000 7f425d7ab640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f425806f260 0x7f425806f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:57.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.172+0000 7f425d7ab640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f425806fff0 con 0x7f425806fb80 2024-04-24T02:11:57.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.172+0000 7f425d7ab640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f4258070bc0 con 0x7f425806f260 2024-04-24T02:11:57.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.172+0000 7f4256ffd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f425806f260 0x7f425806f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:57.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.172+0000 7f42567fc640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f425806fb80 0x7f425812e540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:46794/0 (socket says 172.21.15.104:46794) 2024-04-24T02:11:57.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.172+0000 7f42567fc640 1 -- 172.21.15.104:0/1804887779 learned_addr learned my addr 172.21.15.104:0/1804887779 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-04-24T02:11:57.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.172+0000 7f4256ffd640 1 -- 172.21.15.104:0/1804887779 >> v1:172.21.15.104:6789/0 conn(0x7f425806fb80 legacy=0x7f425812e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:57.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.172+0000 7f4256ffd640 1 -- 172.21.15.104:0/1804887779 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f425812ec50 con 0x7f425806f260 2024-04-24T02:11:57.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.173+0000 7f4256ffd640 1 --2- 172.21.15.104:0/1804887779 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f425806f260 0x7f425806f640 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4248009d90 tx=0x7f424802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46d85b09b1217c83 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:57.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.173+0000 7f4255ffb640 1 -- 172.21.15.104:0/1804887779 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4248039070 con 0x7f425806f260 2024-04-24T02:11:57.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.173+0000 7f4255ffb640 1 -- 172.21.15.104:0/1804887779 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f424802cb10 con 0x7f425806f260 2024-04-24T02:11:57.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.173+0000 7f4255ffb640 1 -- 172.21.15.104:0/1804887779 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f424802ce10 con 0x7f425806f260 2024-04-24T02:11:57.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.173+0000 7f425d7ab640 1 -- 172.21.15.104:0/1804887779 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f425806f260 msgr2=0x7f425806f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:57.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.173+0000 7f425d7ab640 1 --2- 172.21.15.104:0/1804887779 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f425806f260 0x7f425806f640 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4248009d90 tx=0x7f424802beb0 comp rx=0 tx=0).stop 2024-04-24T02:11:57.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.173+0000 7f425d7ab640 1 -- 172.21.15.104:0/1804887779 shutdown_connections 2024-04-24T02:11:57.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.173+0000 7f425d7ab640 1 --2- 172.21.15.104:0/1804887779 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f425806f260 0x7f425806f640 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:57.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.173+0000 7f425d7ab640 1 -- 172.21.15.104:0/1804887779 >> 172.21.15.104:0/1804887779 conn(0x7f425809e170 msgr2=0x7f425806d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:57.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.173+0000 7f425d7ab640 1 -- 172.21.15.104:0/1804887779 shutdown_connections 2024-04-24T02:11:57.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.173+0000 7f425d7ab640 1 -- 172.21.15.104:0/1804887779 wait complete. 2024-04-24T02:11:57.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.174+0000 7f425d7ab640 1 Processor -- start 2024-04-24T02:11:57.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.174+0000 7f425d7ab640 1 -- start start 2024-04-24T02:11:57.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.175+0000 7f425d7ab640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f425806f260 0x7f42581174f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:57.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.175+0000 7f425d7ab640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f425812f400 con 0x7f425806f260 2024-04-24T02:11:57.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.175+0000 7f4256ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f425806f260 0x7f42581174f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:57.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.175+0000 7f4256ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f425806f260 0x7f42581174f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53700/0 (socket says 172.21.15.104:53700) 2024-04-24T02:11:57.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.175+0000 7f4256ffd640 1 -- 172.21.15.104:0/3195317527 learned_addr learned my addr 172.21.15.104:0/3195317527 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:11:57.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.175+0000 7f4256ffd640 1 -- 172.21.15.104:0/3195317527 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4258119ce0 con 0x7f425806f260 2024-04-24T02:11:57.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.175+0000 7f4256ffd640 1 --2- 172.21.15.104:0/3195317527 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f425806f260 0x7f42581174f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4248037040 tx=0x7f4248004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:57.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.175+0000 7f423f7fe640 1 -- 172.21.15.104:0/3195317527 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4248039050 con 0x7f425806f260 2024-04-24T02:11:57.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.175+0000 7f423f7fe640 1 -- 172.21.15.104:0/3195317527 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4248045070 con 0x7f425806f260 2024-04-24T02:11:57.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.175+0000 7f425d7ab640 1 -- 172.21.15.104:0/3195317527 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f425811aa40 con 0x7f425806f260 2024-04-24T02:11:57.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.175+0000 7f423f7fe640 1 -- 172.21.15.104:0/3195317527 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f424803e8b0 con 0x7f425806f260 2024-04-24T02:11:57.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.175+0000 7f425d7ab640 1 -- 172.21.15.104:0/3195317527 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f425811a3a0 con 0x7f425806f260 2024-04-24T02:11:57.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.176+0000 7f423f7fe640 1 -- 172.21.15.104:0/3195317527 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f424803ea50 con 0x7f425806f260 2024-04-24T02:11:57.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.176+0000 7f423f7fe640 1 --2- 172.21.15.104:0/3195317527 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4244038060 0x7f424403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:57.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.176+0000 7f423f7fe640 1 -- 172.21.15.104:0/3195317527 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3482+0+0 (secure 0 0 0) 0x7f424806df30 con 0x7f425806f260 2024-04-24T02:11:57.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.176+0000 7f425d7ab640 1 -- 172.21.15.104:0/3195317527 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42580a18a0 con 0x7f425806f260 2024-04-24T02:11:57.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.176+0000 7f42567fc640 1 --2- 172.21.15.104:0/3195317527 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4244038060 0x7f424403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:57.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.177+0000 7f42567fc640 1 --2- 172.21.15.104:0/3195317527 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4244038060 0x7f424403a520 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f424c000f60 tx=0x7f424c007a80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:57.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.181+0000 7f423f7fe640 1 -- 172.21.15.104:0/3195317527 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f42580a18a0 con 0x7f425806f260 2024-04-24T02:11:57.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.357+0000 7f425d7ab640 1 -- 172.21.15.104:0/3195317527 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f42581347f0 con 0x7f425806f260 2024-04-24T02:11:57.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.357+0000 7f423f7fe640 1 -- 172.21.15.104:0/3195317527 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+9771 (secure 0 0 0) 0x7f4258119ce0 con 0x7f425806f260 2024-04-24T02:11:57.358 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:11:57.359 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":16,"fsid":"b09461c3-8f3e-4967-89da-98f6945a4445","created":"2024-04-24T02:11:39.732268+0000","modified":"2024-04-24T02:11:56.714873+0000","last_up_change":"2024-04-24T02:11:49.695976+0000","last_in_change":"2024-04-24T02:11:40.809349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T02:11:49.987861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-24T02:11:55.282567+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"505e5915-b411-48c8-b47f-9805fabd0c6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":2419146313},{"type":"v1","addr":"172.21.15.104:6801","nonce":2419146313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":2419146313},{"type":"v1","addr":"172.21.15.104:6803","nonce":2419146313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":2419146313},{"type":"v1","addr":"172.21.15.104:6807","nonce":2419146313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":2419146313},{"type":"v1","addr":"172.21.15.104:6805","nonce":2419146313}]},"public_addr":"172.21.15.104:6801/2419146313","cluster_addr":"172.21.15.104:6803/2419146313","heartbeat_back_addr":"172.21.15.104:6807/2419146313","heartbeat_front_addr":"172.21.15.104:6805/2419146313","state":["exists","up"]},{"osd":1,"uuid":"707422f1-aa99-41be-8312-caf9e6b35b46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1487076214},{"type":"v1","addr":"172.21.15.134:6809","nonce":1487076214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1487076214},{"type":"v1","addr":"172.21.15.134:6815","nonce":1487076214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1487076214},{"type":"v1","addr":"172.21.15.134:6823","nonce":1487076214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1487076214},{"type":"v1","addr":"172.21.15.134:6821","nonce":1487076214}]},"public_addr":"172.21.15.134:6809/1487076214","cluster_addr":"172.21.15.134:6815/1487076214","heartbeat_back_addr":"172.21.15.134:6823/1487076214","heartbeat_front_addr":"172.21.15.134:6821/1487076214","state":["exists","up"]},{"osd":2,"uuid":"745c40cd-2485-4701-ab89-5b349ab2198b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":214480313},{"type":"v1","addr":"172.21.15.134:6802","nonce":214480313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6805","nonce":214480313},{"type":"v1","addr":"172.21.15.134:6807","nonce":214480313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":214480313},{"type":"v1","addr":"172.21.15.134:6819","nonce":214480313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":214480313},{"type":"v1","addr":"172.21.15.134:6813","nonce":214480313}]},"public_addr":"172.21.15.134:6802/214480313","cluster_addr":"172.21.15.134:6807/214480313","heartbeat_back_addr":"172.21.15.134:6819/214480313","heartbeat_front_addr":"172.21.15.134:6813/214480313","state":["exists","up"]},{"osd":3,"uuid":"271174d0-434d-424e-9d20-fd0e2b1dac16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6801","nonce":3585115521},{"type":"v1","addr":"172.21.15.134:6803","nonce":3585115521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3585115521},{"type":"v1","addr":"172.21.15.134:6808","nonce":3585115521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":3585115521},{"type":"v1","addr":"172.21.15.134:6820","nonce":3585115521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":3585115521},{"type":"v1","addr":"172.21.15.134:6814","nonce":3585115521}]},"public_addr":"172.21.15.134:6803/3585115521","cluster_addr":"172.21.15.134:6808/3585115521","heartbeat_back_addr":"172.21.15.134:6820/3585115521","heartbeat_front_addr":"172.21.15.134:6814/3585115521","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T02:11:45.883353+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T02:11:45.977825+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T02:11:46.030798+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T02:11:46.006726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T02:11:57.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.359+0000 7f425d7ab640 1 -- 172.21.15.104:0/3195317527 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4244038060 msgr2=0x7f424403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:57.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.359+0000 7f425d7ab640 1 --2- 172.21.15.104:0/3195317527 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4244038060 0x7f424403a520 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f424c000f60 tx=0x7f424c007a80 comp rx=0 tx=0).stop 2024-04-24T02:11:57.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.359+0000 7f425d7ab640 1 -- 172.21.15.104:0/3195317527 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f425806f260 msgr2=0x7f42581174f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:57.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.359+0000 7f425d7ab640 1 --2- 172.21.15.104:0/3195317527 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f425806f260 0x7f42581174f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4248037040 tx=0x7f4248004a40 comp rx=0 tx=0).stop 2024-04-24T02:11:57.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.359+0000 7f425d7ab640 1 -- 172.21.15.104:0/3195317527 shutdown_connections 2024-04-24T02:11:57.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.359+0000 7f425d7ab640 1 --2- 172.21.15.104:0/3195317527 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4244038060 0x7f424403a520 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:57.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.359+0000 7f425d7ab640 1 --2- 172.21.15.104:0/3195317527 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f425806f260 0x7f42581174f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:57.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.359+0000 7f425d7ab640 1 -- 172.21.15.104:0/3195317527 >> 172.21.15.104:0/3195317527 conn(0x7f425809e170 msgr2=0x7f425812b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:57.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.360+0000 7f425d7ab640 1 -- 172.21.15.104:0/3195317527 shutdown_connections 2024-04-24T02:11:57.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.360+0000 7f425d7ab640 1 -- 172.21.15.104:0/3195317527 wait complete. 2024-04-24T02:11:57.371 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-24T02:11:57.372 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T02:11:57.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.466+0000 7fbcab7bd640 1 Processor -- start 2024-04-24T02:11:57.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.466+0000 7fbcab7bd640 1 -- start start 2024-04-24T02:11:57.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.466+0000 7fbcab7bd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fbca4127ce0 0x7fbca41280c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:57.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.466+0000 7fbcab7bd640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbca4127b00 con 0x7fbca4070100 2024-04-24T02:11:57.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.466+0000 7fbcab7bd640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fbca40708e0 con 0x7fbca4127ce0 2024-04-24T02:11:57.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.466+0000 7fbca9559640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fbca4127ce0 0x7fbca41280c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:57.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.466+0000 7fbca8d58640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fbca4070100 0x7fbca412b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:46804/0 (socket says 172.21.15.104:46804) 2024-04-24T02:11:57.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.466+0000 7fbca9559640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fbca4127ce0 0x7fbca41280c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53716/0 (socket says 172.21.15.104:53716) 2024-04-24T02:11:57.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.466+0000 7fbca8d58640 1 -- 172.21.15.104:0/1320391183 learned_addr learned my addr 172.21.15.104:0/1320391183 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-04-24T02:11:57.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.467+0000 7fbca9559640 1 -- 172.21.15.104:0/1320391183 >> v1:172.21.15.104:6789/0 conn(0x7fbca4070100 legacy=0x7fbca412b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:57.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.467+0000 7fbca9559640 1 -- 172.21.15.104:0/1320391183 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbca4098800 con 0x7fbca4127ce0 2024-04-24T02:11:57.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.467+0000 7fbca9559640 1 --2- 172.21.15.104:0/1320391183 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbca4127ce0 0x7fbca41280c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbca0009720 tx=0x7fbca002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd856926ad64cad server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:57.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.467+0000 7fbc9bfff640 1 -- 172.21.15.104:0/1320391183 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbca00316d0 con 0x7fbca4127ce0 2024-04-24T02:11:57.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.467+0000 7fbc9bfff640 1 -- 172.21.15.104:0/1320391183 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbca0037070 con 0x7fbca4127ce0 2024-04-24T02:11:57.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.467+0000 7fbc9bfff640 1 -- 172.21.15.104:0/1320391183 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbca00319c0 con 0x7fbca4127ce0 2024-04-24T02:11:57.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.468+0000 7fbcab7bd640 1 -- 172.21.15.104:0/1320391183 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbca4127ce0 msgr2=0x7fbca41280c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:57.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.468+0000 7fbcab7bd640 1 --2- 172.21.15.104:0/1320391183 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbca4127ce0 0x7fbca41280c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbca0009720 tx=0x7fbca002b840 comp rx=0 tx=0).stop 2024-04-24T02:11:57.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.468+0000 7fbcab7bd640 1 -- 172.21.15.104:0/1320391183 shutdown_connections 2024-04-24T02:11:57.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.468+0000 7fbcab7bd640 1 --2- 172.21.15.104:0/1320391183 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbca4127ce0 0x7fbca41280c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:57.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.468+0000 7fbcab7bd640 1 -- 172.21.15.104:0/1320391183 >> 172.21.15.104:0/1320391183 conn(0x7fbca4099680 msgr2=0x7fbca4099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:57.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.468+0000 7fbcab7bd640 1 -- 172.21.15.104:0/1320391183 shutdown_connections 2024-04-24T02:11:57.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.468+0000 7fbcab7bd640 1 -- 172.21.15.104:0/1320391183 wait complete. 2024-04-24T02:11:57.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.469+0000 7fbcab7bd640 1 Processor -- start 2024-04-24T02:11:57.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.469+0000 7fbcab7bd640 1 -- start start 2024-04-24T02:11:57.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.469+0000 7fbcab7bd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbca4070100 0x7fbca41c1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:57.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.469+0000 7fbcab7bd640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fbca4128780 con 0x7fbca4070100 2024-04-24T02:11:57.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.469+0000 7fbca9559640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbca4070100 0x7fbca41c1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:57.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.469+0000 7fbca9559640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbca4070100 0x7fbca41c1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53718/0 (socket says 172.21.15.104:53718) 2024-04-24T02:11:57.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.469+0000 7fbca9559640 1 -- 172.21.15.104:0/3694883383 learned_addr learned my addr 172.21.15.104:0/3694883383 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:11:57.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.470+0000 7fbca9559640 1 -- 172.21.15.104:0/3694883383 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbca408df40 con 0x7fbca4070100 2024-04-24T02:11:57.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.470+0000 7fbca9559640 1 --2- 172.21.15.104:0/3694883383 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbca4070100 0x7fbca41c1170 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbca0009720 tx=0x7fbca00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:57.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.470+0000 7fbc99ffb640 1 -- 172.21.15.104:0/3694883383 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbca0032770 con 0x7fbca4070100 2024-04-24T02:11:57.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.470+0000 7fbc99ffb640 1 -- 172.21.15.104:0/3694883383 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbca0032910 con 0x7fbca4070100 2024-04-24T02:11:57.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.470+0000 7fbcab7bd640 1 -- 172.21.15.104:0/3694883383 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbca408e6e0 con 0x7fbca4070100 2024-04-24T02:11:57.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.470+0000 7fbc99ffb640 1 -- 172.21.15.104:0/3694883383 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbca0032bf0 con 0x7fbca4070100 2024-04-24T02:11:57.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.470+0000 7fbcab7bd640 1 -- 172.21.15.104:0/3694883383 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbca41c16b0 con 0x7fbca4070100 2024-04-24T02:11:57.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.471+0000 7fbc99ffb640 1 -- 172.21.15.104:0/3694883383 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbca004d3f0 con 0x7fbca4070100 2024-04-24T02:11:57.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.471+0000 7fbcab7bd640 1 -- 172.21.15.104:0/3694883383 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbca4071750 con 0x7fbca4070100 2024-04-24T02:11:57.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.471+0000 7fbc99ffb640 1 --2- 172.21.15.104:0/3694883383 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fbc88038060 0x7fbc8803a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:57.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.471+0000 7fbc99ffb640 1 -- 172.21.15.104:0/3694883383 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3482+0+0 (secure 0 0 0) 0x7fbca002f050 con 0x7fbca4070100 2024-04-24T02:11:57.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.471+0000 7fbca8d58640 1 --2- 172.21.15.104:0/3694883383 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fbc88038060 0x7fbc8803a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:57.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.472+0000 7fbca8d58640 1 --2- 172.21.15.104:0/3694883383 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fbc88038060 0x7fbc8803a520 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbc94007fd0 tx=0x7fbc94007ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:57.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.476+0000 7fbc99ffb640 1 -- 172.21.15.104:0/3694883383 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7fbca4071750 con 0x7fbca4070100 2024-04-24T02:11:57.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.651+0000 7fbcab7bd640 1 -- 172.21.15.104:0/3694883383 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbca408ee30 con 0x7fbca4070100 2024-04-24T02:11:57.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.652+0000 7fbc99ffb640 1 -- 172.21.15.104:0/3694883383 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+9771 (secure 0 0 0) 0x7fbca408df40 con 0x7fbca4070100 2024-04-24T02:11:57.653 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:11:57.653 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":16,"fsid":"b09461c3-8f3e-4967-89da-98f6945a4445","created":"2024-04-24T02:11:39.732268+0000","modified":"2024-04-24T02:11:56.714873+0000","last_up_change":"2024-04-24T02:11:49.695976+0000","last_in_change":"2024-04-24T02:11:40.809349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T02:11:49.987861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-24T02:11:55.282567+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"505e5915-b411-48c8-b47f-9805fabd0c6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":2419146313},{"type":"v1","addr":"172.21.15.104:6801","nonce":2419146313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":2419146313},{"type":"v1","addr":"172.21.15.104:6803","nonce":2419146313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":2419146313},{"type":"v1","addr":"172.21.15.104:6807","nonce":2419146313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":2419146313},{"type":"v1","addr":"172.21.15.104:6805","nonce":2419146313}]},"public_addr":"172.21.15.104:6801/2419146313","cluster_addr":"172.21.15.104:6803/2419146313","heartbeat_back_addr":"172.21.15.104:6807/2419146313","heartbeat_front_addr":"172.21.15.104:6805/2419146313","state":["exists","up"]},{"osd":1,"uuid":"707422f1-aa99-41be-8312-caf9e6b35b46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1487076214},{"type":"v1","addr":"172.21.15.134:6809","nonce":1487076214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1487076214},{"type":"v1","addr":"172.21.15.134:6815","nonce":1487076214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1487076214},{"type":"v1","addr":"172.21.15.134:6823","nonce":1487076214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1487076214},{"type":"v1","addr":"172.21.15.134:6821","nonce":1487076214}]},"public_addr":"172.21.15.134:6809/1487076214","cluster_addr":"172.21.15.134:6815/1487076214","heartbeat_back_addr":"172.21.15.134:6823/1487076214","heartbeat_front_addr":"172.21.15.134:6821/1487076214","state":["exists","up"]},{"osd":2,"uuid":"745c40cd-2485-4701-ab89-5b349ab2198b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":214480313},{"type":"v1","addr":"172.21.15.134:6802","nonce":214480313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6805","nonce":214480313},{"type":"v1","addr":"172.21.15.134:6807","nonce":214480313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":214480313},{"type":"v1","addr":"172.21.15.134:6819","nonce":214480313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":214480313},{"type":"v1","addr":"172.21.15.134:6813","nonce":214480313}]},"public_addr":"172.21.15.134:6802/214480313","cluster_addr":"172.21.15.134:6807/214480313","heartbeat_back_addr":"172.21.15.134:6819/214480313","heartbeat_front_addr":"172.21.15.134:6813/214480313","state":["exists","up"]},{"osd":3,"uuid":"271174d0-434d-424e-9d20-fd0e2b1dac16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6801","nonce":3585115521},{"type":"v1","addr":"172.21.15.134:6803","nonce":3585115521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3585115521},{"type":"v1","addr":"172.21.15.134:6808","nonce":3585115521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":3585115521},{"type":"v1","addr":"172.21.15.134:6820","nonce":3585115521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":3585115521},{"type":"v1","addr":"172.21.15.134:6814","nonce":3585115521}]},"public_addr":"172.21.15.134:6803/3585115521","cluster_addr":"172.21.15.134:6808/3585115521","heartbeat_back_addr":"172.21.15.134:6820/3585115521","heartbeat_front_addr":"172.21.15.134:6814/3585115521","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T02:11:45.883353+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T02:11:45.977825+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T02:11:46.030798+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T02:11:46.006726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T02:11:57.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.654+0000 7fbcab7bd640 1 -- 172.21.15.104:0/3694883383 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fbc88038060 msgr2=0x7fbc8803a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:57.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.654+0000 7fbcab7bd640 1 --2- 172.21.15.104:0/3694883383 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fbc88038060 0x7fbc8803a520 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbc94007fd0 tx=0x7fbc94007ac0 comp rx=0 tx=0).stop 2024-04-24T02:11:57.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.654+0000 7fbcab7bd640 1 -- 172.21.15.104:0/3694883383 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbca4070100 msgr2=0x7fbca41c1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:57.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.654+0000 7fbcab7bd640 1 --2- 172.21.15.104:0/3694883383 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbca4070100 0x7fbca41c1170 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbca0009720 tx=0x7fbca00046c0 comp rx=0 tx=0).stop 2024-04-24T02:11:57.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.654+0000 7fbcab7bd640 1 -- 172.21.15.104:0/3694883383 shutdown_connections 2024-04-24T02:11:57.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.654+0000 7fbcab7bd640 1 --2- 172.21.15.104:0/3694883383 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fbc88038060 0x7fbc8803a520 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:57.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.654+0000 7fbcab7bd640 1 --2- 172.21.15.104:0/3694883383 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbca4070100 0x7fbca41c1170 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:57.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.654+0000 7fbcab7bd640 1 -- 172.21.15.104:0/3694883383 >> 172.21.15.104:0/3694883383 conn(0x7fbca4099680 msgr2=0x7fbca4124de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:57.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.655+0000 7fbcab7bd640 1 -- 172.21.15.104:0/3694883383 shutdown_connections 2024-04-24T02:11:57.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.655+0000 7fbcab7bd640 1 -- 172.21.15.104:0/3694883383 wait complete. 2024-04-24T02:11:57.667 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-24T02:11:57.667 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-24T02:11:57.667 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-24T02:11:57.668 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-24T02:11:57.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.767+0000 7fe36068f640 1 Processor -- start 2024-04-24T02:11:57.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.767+0000 7ff763dbd640 1 Processor -- start 2024-04-24T02:11:57.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.767+0000 7fe36068f640 1 -- start start 2024-04-24T02:11:57.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.767+0000 7f796c321640 1 Processor -- start 2024-04-24T02:11:57.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.767+0000 7f796c321640 1 -- start start 2024-04-24T02:11:57.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.767+0000 7f39654ba640 1 Processor -- start 2024-04-24T02:11:57.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.767+0000 7f39654ba640 1 -- start start 2024-04-24T02:11:57.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.768+0000 7ff763dbd640 1 -- start start 2024-04-24T02:11:57.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.768+0000 7fe36068f640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe35806d7c0 0x7fe358133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:57.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.768+0000 7fe36068f640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe35806f7f0 con 0x7fe35806ccd0 2024-04-24T02:11:57.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.768+0000 7fe36068f640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fe35806eaf0 con 0x7fe35806d7c0 2024-04-24T02:11:57.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.768+0000 7f39654ba640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f396006dde0 0x7f396006e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:57.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.768+0000 7f39654ba640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3960072aa0 con 0x7f396006e700 2024-04-24T02:11:57.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.768+0000 7f39654ba640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f396006ff10 con 0x7f396006dde0 2024-04-24T02:11:57.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.768+0000 7ff763dbd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff75c12dae0 0x7ff75c12fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:57.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.768+0000 7ff763dbd640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff75c06f0f0 con 0x7ff75c06d690 2024-04-24T02:11:57.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.768+0000 7ff763dbd640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7ff75c071a60 con 0x7ff75c12dae0 2024-04-24T02:11:57.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.768+0000 7f796c321640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f7964093bc0 0x7f7964094850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:57.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.768+0000 7fe35dc2a640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe35806d7c0 0x7fe358133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:57.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.768+0000 7ff761358640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff75c12dae0 0x7ff75c12fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:57.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.768+0000 7fe35dc2a640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe35806d7c0 0x7fe358133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53738/0 (socket says 172.21.15.104:53738) 2024-04-24T02:11:57.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.768+0000 7ff761358640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff75c12dae0 0x7ff75c12fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53740/0 (socket says 172.21.15.104:53740) 2024-04-24T02:11:57.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.768+0000 7fe35dc2a640 1 -- 172.21.15.104:0/3212497992 learned_addr learned my addr 172.21.15.104:0/3212497992 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:11:57.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.768+0000 7ff761358640 1 -- 172.21.15.104:0/1293660797 learned_addr learned my addr 172.21.15.104:0/1293660797 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:11:57.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.768+0000 7f796c321640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7964096b30 con 0x7f7964094d90 2024-04-24T02:11:57.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.768+0000 7f796c321640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f7964096700 con 0x7f7964093bc0 2024-04-24T02:11:57.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.768+0000 7f395effd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f396006dde0 0x7f396006e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:57.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.768+0000 7f395effd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f396006dde0 0x7f396006e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53732/0 (socket says 172.21.15.104:53732) 2024-04-24T02:11:57.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.768+0000 7f395effd640 1 -- 172.21.15.104:0/3078285246 learned_addr learned my addr 172.21.15.104:0/3078285246 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:11:57.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.768+0000 7f796a0bd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f7964093bc0 0x7f7964094850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:57.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.768+0000 7f796a0bd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f7964093bc0 0x7f7964094850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53742/0 (socket says 172.21.15.104:53742) 2024-04-24T02:11:57.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.769+0000 7ff761358640 1 -- 172.21.15.104:0/1293660797 >> v1:172.21.15.104:6789/0 conn(0x7ff75c06d690 legacy=0x7ff75c06da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T02:11:57.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.769+0000 7f796a0bd640 1 -- 172.21.15.104:0/499487366 learned_addr learned my addr 172.21.15.104:0/499487366 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:11:57.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.769+0000 7ff761358640 1 -- 172.21.15.104:0/1293660797 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff75c06f8b0 con 0x7ff75c12dae0 2024-04-24T02:11:57.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.769+0000 7fe35dc2a640 1 -- 172.21.15.104:0/3212497992 >> v1:172.21.15.104:6789/0 conn(0x7fe35806ccd0 legacy=0x7fe35806d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T02:11:57.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.769+0000 7fe35dc2a640 1 -- 172.21.15.104:0/3212497992 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3580722f0 con 0x7fe35806d7c0 2024-04-24T02:11:57.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.769+0000 7f395effd640 1 -- 172.21.15.104:0/3078285246 >> v1:172.21.15.104:6789/0 conn(0x7f396006e700 legacy=0x7f396012d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:57.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.769+0000 7f395effd640 1 -- 172.21.15.104:0/3078285246 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3960099f80 con 0x7f396006dde0 2024-04-24T02:11:57.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.769+0000 7f796a0bd640 1 -- 172.21.15.104:0/499487366 >> v1:172.21.15.104:6789/0 conn(0x7f7964094d90 legacy=0x7f7964133060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:57.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.769+0000 7f79690bb640 1 -- 172.21.15.104:0/499487366 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1473980775 0 0) 0x7f7964096b30 con 0x7f7964094d90 2024-04-24T02:11:57.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.769+0000 7f796a0bd640 1 -- 172.21.15.104:0/499487366 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7964095a80 con 0x7f7964093bc0 2024-04-24T02:11:57.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.770+0000 7fe35dc2a640 1 --2- 172.21.15.104:0/3212497992 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe35806d7c0 0x7fe358133a30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe3480097f0 tx=0x7fe34802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9f17110cca92dd6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:57.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.770+0000 7ff761358640 1 --2- 172.21.15.104:0/1293660797 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff75c12dae0 0x7ff75c12fed0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff74c00ba90 tx=0x7ff74c02e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ec59962629d155f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:57.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.770+0000 7f395effd640 1 --2- 172.21.15.104:0/3078285246 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f396006dde0 0x7f396006e1c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f39500097f0 tx=0x7f395002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ebfd24c6c124d95 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:57.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.770+0000 7fe35d429640 1 -- 172.21.15.104:0/3212497992 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe34802e070 con 0x7fe35806d7c0 2024-04-24T02:11:57.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.770+0000 7ff760b57640 1 -- 172.21.15.104:0/1293660797 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff74c03b070 con 0x7ff75c12dae0 2024-04-24T02:11:57.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.770+0000 7f796a0bd640 1 --2- 172.21.15.104:0/499487366 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7964093bc0 0x7f7964094850 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f79600097f0 tx=0x7f796002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abf9db99119b82d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:57.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.770+0000 7fe35d429640 1 -- 172.21.15.104:0/3212497992 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe348037070 con 0x7fe35806d7c0 2024-04-24T02:11:57.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.770+0000 7fe35d429640 1 -- 172.21.15.104:0/3212497992 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe348031730 con 0x7fe35806d7c0 2024-04-24T02:11:57.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.770+0000 7ff760b57640 1 -- 172.21.15.104:0/1293660797 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff74c02ed30 con 0x7ff75c12dae0 2024-04-24T02:11:57.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.770+0000 7ff760b57640 1 -- 172.21.15.104:0/1293660797 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff74c03b070 con 0x7ff75c12dae0 2024-04-24T02:11:57.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.770+0000 7f395dffb640 1 -- 172.21.15.104:0/3078285246 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3950035020 con 0x7f396006dde0 2024-04-24T02:11:57.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.770+0000 7f395dffb640 1 -- 172.21.15.104:0/3078285246 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39500317a0 con 0x7f396006dde0 2024-04-24T02:11:57.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.770+0000 7f395dffb640 1 -- 172.21.15.104:0/3078285246 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3950031aa0 con 0x7f396006dde0 2024-04-24T02:11:57.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.770+0000 7f79690bb640 1 -- 172.21.15.104:0/499487366 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7960035020 con 0x7f7964093bc0 2024-04-24T02:11:57.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.770+0000 7f79690bb640 1 -- 172.21.15.104:0/499487366 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79600317a0 con 0x7f7964093bc0 2024-04-24T02:11:57.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.770+0000 7f79690bb640 1 -- 172.21.15.104:0/499487366 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7960031aa0 con 0x7f7964093bc0 2024-04-24T02:11:57.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.771+0000 7fe36068f640 1 -- 172.21.15.104:0/3212497992 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe35806d7c0 msgr2=0x7fe358133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:57.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.771+0000 7fe36068f640 1 --2- 172.21.15.104:0/3212497992 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe35806d7c0 0x7fe358133a30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe3480097f0 tx=0x7fe34802b880 comp rx=0 tx=0).stop 2024-04-24T02:11:57.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.771+0000 7ff763dbd640 1 -- 172.21.15.104:0/1293660797 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff75c12dae0 msgr2=0x7ff75c12fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:57.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.771+0000 7ff763dbd640 1 --2- 172.21.15.104:0/1293660797 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff75c12dae0 0x7ff75c12fed0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff74c00ba90 tx=0x7ff74c02e050 comp rx=0 tx=0).stop 2024-04-24T02:11:57.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.771+0000 7fe36068f640 1 -- 172.21.15.104:0/3212497992 shutdown_connections 2024-04-24T02:11:57.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.771+0000 7fe36068f640 1 --2- 172.21.15.104:0/3212497992 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe35806d7c0 0x7fe358133a30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:57.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.771+0000 7fe36068f640 1 -- 172.21.15.104:0/3212497992 >> 172.21.15.104:0/3212497992 conn(0x7fe35809b780 msgr2=0x7fe35809bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:57.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.771+0000 7ff763dbd640 1 -- 172.21.15.104:0/1293660797 shutdown_connections 2024-04-24T02:11:57.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.771+0000 7ff763dbd640 1 --2- 172.21.15.104:0/1293660797 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff75c12dae0 0x7ff75c12fed0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:57.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.771+0000 7ff763dbd640 1 -- 172.21.15.104:0/1293660797 >> 172.21.15.104:0/1293660797 conn(0x7ff75c099680 msgr2=0x7ff75c099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:57.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.771+0000 7fe36068f640 1 -- 172.21.15.104:0/3212497992 shutdown_connections 2024-04-24T02:11:57.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.771+0000 7fe36068f640 1 -- 172.21.15.104:0/3212497992 wait complete. 2024-04-24T02:11:57.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.771+0000 7f796c321640 1 -- 172.21.15.104:0/499487366 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7964093bc0 msgr2=0x7f7964094850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:57.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.771+0000 7f796c321640 1 --2- 172.21.15.104:0/499487366 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7964093bc0 0x7f7964094850 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f79600097f0 tx=0x7f796002b910 comp rx=0 tx=0).stop 2024-04-24T02:11:57.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.771+0000 7f39654ba640 1 -- 172.21.15.104:0/3078285246 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f396006dde0 msgr2=0x7f396006e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:57.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.771+0000 7f39654ba640 1 --2- 172.21.15.104:0/3078285246 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f396006dde0 0x7f396006e1c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f39500097f0 tx=0x7f395002b910 comp rx=0 tx=0).stop 2024-04-24T02:11:57.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.771+0000 7ff763dbd640 1 -- 172.21.15.104:0/1293660797 shutdown_connections 2024-04-24T02:11:57.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.771+0000 7ff763dbd640 1 -- 172.21.15.104:0/1293660797 wait complete. 2024-04-24T02:11:57.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.771+0000 7f39654ba640 1 -- 172.21.15.104:0/3078285246 shutdown_connections 2024-04-24T02:11:57.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.771+0000 7f39654ba640 1 --2- 172.21.15.104:0/3078285246 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f396006dde0 0x7f396006e1c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:57.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.771+0000 7f39654ba640 1 -- 172.21.15.104:0/3078285246 >> 172.21.15.104:0/3078285246 conn(0x7f396009b320 msgr2=0x7f396009b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:57.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.771+0000 7f796c321640 1 -- 172.21.15.104:0/499487366 shutdown_connections 2024-04-24T02:11:57.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.771+0000 7f796c321640 1 --2- 172.21.15.104:0/499487366 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7964093bc0 0x7f7964094850 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:57.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.771+0000 7f796c321640 1 -- 172.21.15.104:0/499487366 >> 172.21.15.104:0/499487366 conn(0x7f796409b1d0 msgr2=0x7f796409b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:57.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.771+0000 7f796c321640 1 -- 172.21.15.104:0/499487366 shutdown_connections 2024-04-24T02:11:57.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.771+0000 7f39654ba640 1 -- 172.21.15.104:0/3078285246 shutdown_connections 2024-04-24T02:11:57.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.771+0000 7f796c321640 1 -- 172.21.15.104:0/499487366 wait complete. 2024-04-24T02:11:57.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.771+0000 7f39654ba640 1 -- 172.21.15.104:0/3078285246 wait complete. 2024-04-24T02:11:57.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.772+0000 7ff763dbd640 1 Processor -- start 2024-04-24T02:11:57.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.772+0000 7ff763dbd640 1 -- start start 2024-04-24T02:11:57.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.772+0000 7fe36068f640 1 Processor -- start 2024-04-24T02:11:57.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.772+0000 7fe36068f640 1 -- start start 2024-04-24T02:11:57.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.772+0000 7f796c321640 1 Processor -- start 2024-04-24T02:11:57.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.772+0000 7f796c321640 1 -- start start 2024-04-24T02:11:57.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.772+0000 7f39654ba640 1 Processor -- start 2024-04-24T02:11:57.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.772+0000 7f39654ba640 1 -- start start 2024-04-24T02:11:57.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.772+0000 7ff763dbd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff75c06d690 0x7ff75c1bef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:57.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.772+0000 7ff763dbd640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff75c06e180 con 0x7ff75c06d690 2024-04-24T02:11:57.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.772+0000 7fe36068f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe35806ccd0 0x7fe358122940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:57.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.772+0000 7fe36068f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe35806fb00 con 0x7fe35806ccd0 2024-04-24T02:11:57.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.772+0000 7f796c321640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7964093bc0 0x7f79641bf900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:57.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.773+0000 7f796c321640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f79640951b0 con 0x7f7964093bc0 2024-04-24T02:11:57.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.773+0000 7ff761b59640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff75c06d690 0x7ff75c1bef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:57.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.773+0000 7ff761b59640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff75c06d690 0x7ff75c1bef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53752/0 (socket says 172.21.15.104:53752) 2024-04-24T02:11:57.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.773+0000 7fe35e42b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe35806ccd0 0x7fe358122940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:57.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.773+0000 7ff761b59640 1 -- 172.21.15.104:0/1754618339 learned_addr learned my addr 172.21.15.104:0/1754618339 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:11:57.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.773+0000 7f796a0bd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7964093bc0 0x7f79641bf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:57.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.773+0000 7f796a0bd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7964093bc0 0x7f79641bf900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53770/0 (socket says 172.21.15.104:53770) 2024-04-24T02:11:57.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.773+0000 7f796a0bd640 1 -- 172.21.15.104:0/1953131306 learned_addr learned my addr 172.21.15.104:0/1953131306 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:11:57.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.773+0000 7fe35e42b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe35806ccd0 0x7fe358122940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53766/0 (socket says 172.21.15.104:53766) 2024-04-24T02:11:57.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.773+0000 7fe35e42b640 1 -- 172.21.15.104:0/1589146616 learned_addr learned my addr 172.21.15.104:0/1589146616 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:11:57.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.773+0000 7fe35e42b640 1 -- 172.21.15.104:0/1589146616 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe358096420 con 0x7fe35806ccd0 2024-04-24T02:11:57.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.773+0000 7f39654ba640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f396006dde0 0x7f39601c2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:57.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.773+0000 7f39654ba640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f396006f000 con 0x7f396006dde0 2024-04-24T02:11:57.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.773+0000 7ff761b59640 1 -- 172.21.15.104:0/1754618339 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff75c08aea0 con 0x7ff75c06d690 2024-04-24T02:11:57.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.773+0000 7f395effd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f396006dde0 0x7f39601c2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:57.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.773+0000 7f796a0bd640 1 -- 172.21.15.104:0/1953131306 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79641aab90 con 0x7f7964093bc0 2024-04-24T02:11:57.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.773+0000 7f395effd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f396006dde0 0x7f39601c2e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53786/0 (socket says 172.21.15.104:53786) 2024-04-24T02:11:57.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.773+0000 7f395effd640 1 -- 172.21.15.104:0/1815120082 learned_addr learned my addr 172.21.15.104:0/1815120082 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:11:57.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.773+0000 7fe35e42b640 1 --2- 172.21.15.104:0/1589146616 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe35806ccd0 0x7fe358122940 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe35400c3b0 tx=0x7fe35400c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:57.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.773+0000 7ff761b59640 1 --2- 172.21.15.104:0/1754618339 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff75c06d690 0x7ff75c1bef00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff75800c3d0 tx=0x7ff75800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:57.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.773+0000 7f796a0bd640 1 --2- 172.21.15.104:0/1953131306 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7964093bc0 0x7f79641bf900 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f79600090b0 tx=0x7f79600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:57.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.773+0000 7fe34effd640 1 -- 172.21.15.104:0/1589146616 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3540116c0 con 0x7fe35806ccd0 2024-04-24T02:11:57.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.773+0000 7fe36068f640 1 -- 172.21.15.104:0/1589146616 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe358123d50 con 0x7fe35806ccd0 2024-04-24T02:11:57.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.773+0000 7fe34effd640 1 -- 172.21.15.104:0/1589146616 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe354017070 con 0x7fe35806ccd0 2024-04-24T02:11:57.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.773+0000 7fe34effd640 1 -- 172.21.15.104:0/1589146616 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3540119d0 con 0x7fe35806ccd0 2024-04-24T02:11:57.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.773+0000 7fe36068f640 1 -- 172.21.15.104:0/1589146616 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3581243d0 con 0x7fe35806ccd0 2024-04-24T02:11:57.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.774+0000 7ff7527fc640 1 -- 172.21.15.104:0/1754618339 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff758007150 con 0x7ff75c06d690 2024-04-24T02:11:57.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.773+0000 7f795affd640 1 -- 172.21.15.104:0/1953131306 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f796003acb0 con 0x7f7964093bc0 2024-04-24T02:11:57.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.774+0000 7f795affd640 1 -- 172.21.15.104:0/1953131306 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f796003ae50 con 0x7f7964093bc0 2024-04-24T02:11:57.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.774+0000 7f795affd640 1 -- 172.21.15.104:0/1953131306 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7960044560 con 0x7f7964093bc0 2024-04-24T02:11:57.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.774+0000 7ff7527fc640 1 -- 172.21.15.104:0/1754618339 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff758007310 con 0x7ff75c06d690 2024-04-24T02:11:57.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.774+0000 7ff763dbd640 1 -- 172.21.15.104:0/1754618339 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff75c08a6c0 con 0x7ff75c06d690 2024-04-24T02:11:57.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.773+0000 7f395effd640 1 -- 172.21.15.104:0/1815120082 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3960122890 con 0x7f396006dde0 2024-04-24T02:11:57.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.774+0000 7f395effd640 1 --2- 172.21.15.104:0/1815120082 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f396006dde0 0x7f39601c2e90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f39500097f0 tx=0x7f39500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:57.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.774+0000 7ff763dbd640 1 -- 172.21.15.104:0/1754618339 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff75c1bf440 con 0x7ff75c06d690 2024-04-24T02:11:57.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.774+0000 7ff7527fc640 1 -- 172.21.15.104:0/1754618339 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff758007630 con 0x7ff75c06d690 2024-04-24T02:11:57.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.774+0000 7f39477fe640 1 -- 172.21.15.104:0/1815120082 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f395003acb0 con 0x7f396006dde0 2024-04-24T02:11:57.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.774+0000 7f39654ba640 1 -- 172.21.15.104:0/1815120082 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39601b6190 con 0x7f396006dde0 2024-04-24T02:11:57.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.774+0000 7f39654ba640 1 -- 172.21.15.104:0/1815120082 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3960122b30 con 0x7f396006dde0 2024-04-24T02:11:57.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.774+0000 7fe36068f640 1 -- 172.21.15.104:0/1589146616 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe358062da0 con 0x7fe35806ccd0 2024-04-24T02:11:57.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.774+0000 7f796c321640 1 -- 172.21.15.104:0/1953131306 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79641a9150 con 0x7f7964093bc0 2024-04-24T02:11:57.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.774+0000 7f796c321640 1 -- 172.21.15.104:0/1953131306 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79641aae30 con 0x7f7964093bc0 2024-04-24T02:11:57.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.775+0000 7ff763dbd640 1 -- 172.21.15.104:0/1754618339 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff744000f80 con 0x7ff75c06d690 2024-04-24T02:11:57.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.775+0000 7f39477fe640 1 -- 172.21.15.104:0/1815120082 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f395003ae50 con 0x7f396006dde0 2024-04-24T02:11:57.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.775+0000 7f39477fe640 1 -- 172.21.15.104:0/1815120082 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3950031730 con 0x7f396006dde0 2024-04-24T02:11:57.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.775+0000 7ff7527fc640 1 -- 172.21.15.104:0/1754618339 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff758019020 con 0x7ff75c06d690 2024-04-24T02:11:57.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.775+0000 7fe34effd640 1 -- 172.21.15.104:0/1589146616 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe354011b70 con 0x7fe35806ccd0 2024-04-24T02:11:57.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.775+0000 7fe34effd640 1 --2- 172.21.15.104:0/1589146616 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe33c038060 0x7fe33c03a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:57.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.775+0000 7fe34effd640 1 -- 172.21.15.104:0/1589146616 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7fe35404aaf0 con 0x7fe35806ccd0 2024-04-24T02:11:57.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.775+0000 7ff7527fc640 1 --2- 172.21.15.104:0/1754618339 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7ff740038060 0x7ff74003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:57.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.775+0000 7f796c321640 1 -- 172.21.15.104:0/1953131306 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f79641a89a0 con 0x7f7964093bc0 2024-04-24T02:11:57.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.775+0000 7ff7527fc640 1 -- 172.21.15.104:0/1754618339 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7ff758017020 con 0x7ff75c06d690 2024-04-24T02:11:57.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.775+0000 7ff7527fc640 1 --2- 172.21.15.104:0/1754618339 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7ff74003d7e0 0x7ff74003fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:57.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.775+0000 7ff7527fc640 1 -- 172.21.15.104:0/1754618339 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff7400402f0 con 0x7ff74003d7e0 2024-04-24T02:11:57.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.776+0000 7ff761358640 1 --2- 172.21.15.104:0/1754618339 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7ff740038060 0x7ff74003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:57.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.776+0000 7ff76235a640 1 --2- 172.21.15.104:0/1754618339 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7ff74003d7e0 0x7ff74003fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:57.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.775+0000 7f39654ba640 1 -- 172.21.15.104:0/1815120082 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3960062da0 con 0x7f396006dde0 2024-04-24T02:11:57.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.776+0000 7ff7527fc640 1 -- 172.21.15.104:0/1754618339 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7ff758051050 con 0x7ff75c06d690 2024-04-24T02:11:57.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.776+0000 7f39477fe640 1 -- 172.21.15.104:0/1815120082 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f395004b060 con 0x7f396006dde0 2024-04-24T02:11:57.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.776+0000 7f39477fe640 1 --2- 172.21.15.104:0/1815120082 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f394c0380b0 0x7f394c03a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:57.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.776+0000 7fe34effd640 1 --2- 172.21.15.104:0/1589146616 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fe33c03d7e0 0x7fe33c03fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:57.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.776+0000 7fe34effd640 1 -- 172.21.15.104:0/1589146616 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe35401fec0 con 0x7fe33c03d7e0 2024-04-24T02:11:57.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.776+0000 7fe35dc2a640 1 --2- 172.21.15.104:0/1589146616 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe33c038060 0x7fe33c03a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:57.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.776+0000 7fe35ec2c640 1 --2- 172.21.15.104:0/1589146616 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fe33c03d7e0 0x7fe33c03fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:57.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.776+0000 7f39477fe640 1 -- 172.21.15.104:0/1815120082 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7f395006d1b0 con 0x7f396006dde0 2024-04-24T02:11:57.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.776+0000 7f795affd640 1 -- 172.21.15.104:0/1953131306 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f796004b060 con 0x7f7964093bc0 2024-04-24T02:11:57.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.776+0000 7f39477fe640 1 --2- 172.21.15.104:0/1815120082 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x7f394c03d830 0x7f394c03fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:57.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.776+0000 7f39477fe640 1 -- 172.21.15.104:0/1815120082 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3950032e50 con 0x7f394c03d830 2024-04-24T02:11:57.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.776+0000 7f39477fe640 1 -- 172.21.15.104:0/1815120082 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f3950074050 con 0x7f396006dde0 2024-04-24T02:11:57.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.776+0000 7fe34effd640 1 -- 172.21.15.104:0/1589146616 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fe35401cd00 con 0x7fe35806ccd0 2024-04-24T02:11:57.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.776+0000 7f395e7fc640 1 --2- 172.21.15.104:0/1815120082 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f394c0380b0 0x7f394c03a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:57.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.776+0000 7ff76235a640 1 --2- 172.21.15.104:0/1754618339 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7ff74003d7e0 0x7ff74003fc20 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:57.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.776+0000 7fe35ec2c640 1 --2- 172.21.15.104:0/1589146616 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fe33c03d7e0 0x7fe33c03fc20 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:57.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.776+0000 7ff761358640 1 --2- 172.21.15.104:0/1754618339 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7ff740038060 0x7ff74003a520 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff74c038000 tx=0x7ff74c032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:57.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.776+0000 7fe35dc2a640 1 --2- 172.21.15.104:0/1589146616 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe33c038060 0x7fe33c03a520 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe348036000 tx=0x7fe348008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:57.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.776+0000 7f395f7fe640 1 --2- 172.21.15.104:0/1815120082 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x7f394c03d830 0x7f394c03fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:57.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.776+0000 7f795affd640 1 --2- 172.21.15.104:0/1953131306 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f79480380b0 0x7f794803a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:57.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.776+0000 7f795affd640 1 -- 172.21.15.104:0/1953131306 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7f796006d1b0 con 0x7f7964093bc0 2024-04-24T02:11:57.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.777+0000 7f795affd640 1 --2- 172.21.15.104:0/1953131306 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x7f794803d830 0x7f794803fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:57.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.777+0000 7f795affd640 1 -- 172.21.15.104:0/1953131306 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f796004ee50 con 0x7f794803d830 2024-04-24T02:11:57.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.777+0000 7f795affd640 1 -- 172.21.15.104:0/1953131306 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f7960074050 con 0x7f7964093bc0 2024-04-24T02:11:57.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.777+0000 7f79698bc640 1 --2- 172.21.15.104:0/1953131306 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f79480380b0 0x7f794803a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:57.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.777+0000 7f796a8be640 1 --2- 172.21.15.104:0/1953131306 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x7f794803d830 0x7f794803fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:57.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.777+0000 7f395f7fe640 1 --2- 172.21.15.104:0/1815120082 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x7f394c03d830 0x7f394c03fc70 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:57.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.777+0000 7f395e7fc640 1 --2- 172.21.15.104:0/1815120082 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f394c0380b0 0x7f394c03a570 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3954000f60 tx=0x7f3954007a30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:57.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.777+0000 7f79698bc640 1 --2- 172.21.15.104:0/1953131306 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f79480380b0 0x7f794803a570 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7954001640 tx=0x7f7954007950 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:57.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.777+0000 7fe34effd640 1 -- 172.21.15.104:0/1589146616 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe35401fec0 con 0x7fe33c03d7e0 2024-04-24T02:11:57.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.777+0000 7f796a8be640 1 --2- 172.21.15.104:0/1953131306 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x7f794803d830 0x7f794803fc70 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:57.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.777+0000 7ff7527fc640 1 -- 172.21.15.104:0/1754618339 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff7400402f0 con 0x7ff74003d7e0 2024-04-24T02:11:57.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.778+0000 7f39477fe640 1 -- 172.21.15.104:0/1815120082 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3950032e50 con 0x7f394c03d830 2024-04-24T02:11:57.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.778+0000 7f795affd640 1 -- 172.21.15.104:0/1953131306 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f796004ee50 con 0x7f794803d830 2024-04-24T02:11:57.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.792+0000 7ff763dbd640 1 -- 172.21.15.104:0/1754618339 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff744002c70 con 0x7ff74003d7e0 2024-04-24T02:11:57.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.791+0000 7fe36068f640 1 -- 172.21.15.104:0/1589146616 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe358099f00 con 0x7fe33c03d7e0 2024-04-24T02:11:57.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.792+0000 7fe34effd640 1 -- 172.21.15.104:0/1589146616 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe358099f00 con 0x7fe33c03d7e0 2024-04-24T02:11:57.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.792+0000 7f39654ba640 1 -- 172.21.15.104:0/1815120082 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f396009d310 con 0x7f394c03d830 2024-04-24T02:11:57.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.792+0000 7fe36068f640 1 -- 172.21.15.104:0/1589146616 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fe33c03d7e0 msgr2=0x7fe33c03fc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:57.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.792+0000 7fe36068f640 1 --2- 172.21.15.104:0/1589146616 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fe33c03d7e0 0x7fe33c03fc20 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:57.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.792+0000 7ff7527fc640 1 -- 172.21.15.104:0/1754618339 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff744002c70 con 0x7ff74003d7e0 2024-04-24T02:11:57.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.792+0000 7f39477fe640 1 -- 172.21.15.104:0/1815120082 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f396009d310 con 0x7f394c03d830 2024-04-24T02:11:57.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.792+0000 7fe36068f640 1 -- 172.21.15.104:0/1589146616 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe33c038060 msgr2=0x7fe33c03a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:57.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.792+0000 7fe36068f640 1 --2- 172.21.15.104:0/1589146616 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe33c038060 0x7fe33c03a520 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe348036000 tx=0x7fe348008030 comp rx=0 tx=0).stop 2024-04-24T02:11:57.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.792+0000 7fe36068f640 1 -- 172.21.15.104:0/1589146616 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe35806ccd0 msgr2=0x7fe358122940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:57.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.792+0000 7fe36068f640 1 --2- 172.21.15.104:0/1589146616 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe35806ccd0 0x7fe358122940 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe35400c3b0 tx=0x7fe35400c870 comp rx=0 tx=0).stop 2024-04-24T02:11:57.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.792+0000 7fe36068f640 1 -- 172.21.15.104:0/1589146616 shutdown_connections 2024-04-24T02:11:57.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.792+0000 7fe36068f640 1 --2- 172.21.15.104:0/1589146616 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fe33c03d7e0 0x7fe33c03fc20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:57.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.792+0000 7fe36068f640 1 --2- 172.21.15.104:0/1589146616 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe33c038060 0x7fe33c03a520 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:57.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.792+0000 7fe36068f640 1 --2- 172.21.15.104:0/1589146616 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe35806ccd0 0x7fe358122940 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:57.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.792+0000 7fe36068f640 1 -- 172.21.15.104:0/1589146616 >> 172.21.15.104:0/1589146616 conn(0x7fe35809b780 msgr2=0x7fe358132c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:57.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.792+0000 7ff763dbd640 1 -- 172.21.15.104:0/1754618339 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7ff74003d7e0 msgr2=0x7ff74003fc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:57.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.792+0000 7ff763dbd640 1 --2- 172.21.15.104:0/1754618339 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7ff74003d7e0 0x7ff74003fc20 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:57.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.792+0000 7f796c321640 1 -- 172.21.15.104:0/1953131306 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7964062da0 con 0x7f794803d830 2024-04-24T02:11:57.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.792+0000 7fe36068f640 1 -- 172.21.15.104:0/1589146616 shutdown_connections 2024-04-24T02:11:57.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.792+0000 7fe36068f640 1 -- 172.21.15.104:0/1589146616 wait complete. 2024-04-24T02:11:57.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.793+0000 7f39654ba640 1 -- 172.21.15.104:0/1815120082 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x7f394c03d830 msgr2=0x7f394c03fc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:57.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.793+0000 7f39654ba640 1 --2- 172.21.15.104:0/1815120082 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x7f394c03d830 0x7f394c03fc70 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:57.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.793+0000 7ff763dbd640 1 -- 172.21.15.104:0/1754618339 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7ff740038060 msgr2=0x7ff74003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:57.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.793+0000 7ff763dbd640 1 --2- 172.21.15.104:0/1754618339 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7ff740038060 0x7ff74003a520 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff74c038000 tx=0x7ff74c032000 comp rx=0 tx=0).stop 2024-04-24T02:11:57.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.793+0000 7ff763dbd640 1 -- 172.21.15.104:0/1754618339 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff75c06d690 msgr2=0x7ff75c1bef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:57.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.793+0000 7ff763dbd640 1 --2- 172.21.15.104:0/1754618339 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff75c06d690 0x7ff75c1bef00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff75800c3d0 tx=0x7ff75800c890 comp rx=0 tx=0).stop 2024-04-24T02:11:57.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.793+0000 7f39654ba640 1 -- 172.21.15.104:0/1815120082 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f394c0380b0 msgr2=0x7f394c03a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:57.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.793+0000 7ff763dbd640 1 -- 172.21.15.104:0/1754618339 shutdown_connections 2024-04-24T02:11:57.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.793+0000 7ff763dbd640 1 --2- 172.21.15.104:0/1754618339 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7ff74003d7e0 0x7ff74003fc20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:57.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.793+0000 7f39654ba640 1 --2- 172.21.15.104:0/1815120082 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f394c0380b0 0x7f394c03a570 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3954000f60 tx=0x7f3954007a30 comp rx=0 tx=0).stop 2024-04-24T02:11:57.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.793+0000 7ff763dbd640 1 --2- 172.21.15.104:0/1754618339 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7ff740038060 0x7ff74003a520 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:57.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.793+0000 7ff763dbd640 1 --2- 172.21.15.104:0/1754618339 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff75c06d690 0x7ff75c1bef00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:57.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.793+0000 7ff763dbd640 1 -- 172.21.15.104:0/1754618339 >> 172.21.15.104:0/1754618339 conn(0x7ff75c099680 msgr2=0x7ff75c09a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:57.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.793+0000 7ff763dbd640 1 -- 172.21.15.104:0/1754618339 shutdown_connections 2024-04-24T02:11:57.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.793+0000 7f39654ba640 1 -- 172.21.15.104:0/1815120082 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f396006dde0 msgr2=0x7f39601c2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:57.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.793+0000 7f39654ba640 1 --2- 172.21.15.104:0/1815120082 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f396006dde0 0x7f39601c2e90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f39500097f0 tx=0x7f39500046c0 comp rx=0 tx=0).stop 2024-04-24T02:11:57.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.793+0000 7f795affd640 1 -- 172.21.15.104:0/1953131306 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7964062da0 con 0x7f794803d830 2024-04-24T02:11:57.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.793+0000 7ff763dbd640 1 -- 172.21.15.104:0/1754618339 wait complete. 2024-04-24T02:11:57.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.793+0000 7f39654ba640 1 -- 172.21.15.104:0/1815120082 shutdown_connections 2024-04-24T02:11:57.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.793+0000 7f39654ba640 1 --2- 172.21.15.104:0/1815120082 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x7f394c03d830 0x7f394c03fc70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:57.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.793+0000 7f39654ba640 1 --2- 172.21.15.104:0/1815120082 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f394c0380b0 0x7f394c03a570 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:57.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.793+0000 7f39654ba640 1 --2- 172.21.15.104:0/1815120082 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f396006dde0 0x7f39601c2e90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:57.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.793+0000 7f39654ba640 1 -- 172.21.15.104:0/1815120082 >> 172.21.15.104:0/1815120082 conn(0x7f396009b320 msgr2=0x7f39600713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:57.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.793+0000 7f39654ba640 1 -- 172.21.15.104:0/1815120082 shutdown_connections 2024-04-24T02:11:57.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.793+0000 7f39654ba640 1 -- 172.21.15.104:0/1815120082 wait complete. 2024-04-24T02:11:57.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.793+0000 7f796c321640 1 -- 172.21.15.104:0/1953131306 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x7f794803d830 msgr2=0x7f794803fc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:57.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.793+0000 7f796c321640 1 --2- 172.21.15.104:0/1953131306 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x7f794803d830 0x7f794803fc70 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:57.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.793+0000 7f796c321640 1 -- 172.21.15.104:0/1953131306 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f79480380b0 msgr2=0x7f794803a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:57.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.793+0000 7f796c321640 1 --2- 172.21.15.104:0/1953131306 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f79480380b0 0x7f794803a570 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7954001640 tx=0x7f7954007950 comp rx=0 tx=0).stop 2024-04-24T02:11:57.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.793+0000 7f796c321640 1 -- 172.21.15.104:0/1953131306 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7964093bc0 msgr2=0x7f79641bf900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:57.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.793+0000 7f796c321640 1 --2- 172.21.15.104:0/1953131306 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7964093bc0 0x7f79641bf900 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f79600090b0 tx=0x7f79600046c0 comp rx=0 tx=0).stop 2024-04-24T02:11:57.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.793+0000 7f796c321640 1 -- 172.21.15.104:0/1953131306 shutdown_connections 2024-04-24T02:11:57.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.793+0000 7f796c321640 1 --2- 172.21.15.104:0/1953131306 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f79480380b0 0x7f794803a570 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:57.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.793+0000 7f796c321640 1 --2- 172.21.15.104:0/1953131306 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x7f794803d830 0x7f794803fc70 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:57.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.794+0000 7f796c321640 1 --2- 172.21.15.104:0/1953131306 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7964093bc0 0x7f79641bf900 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:57.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.794+0000 7f796c321640 1 -- 172.21.15.104:0/1953131306 >> 172.21.15.104:0/1953131306 conn(0x7f796409b1d0 msgr2=0x7f7964070e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:57.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.794+0000 7f796c321640 1 -- 172.21.15.104:0/1953131306 shutdown_connections 2024-04-24T02:11:57.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.794+0000 7f796c321640 1 -- 172.21.15.104:0/1953131306 wait complete. 2024-04-24T02:11:57.825 INFO:teuthology.orchestra.run.smithi104.stdout:47244640260 2024-04-24T02:11:57.825 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-24T02:11:57.826 INFO:teuthology.orchestra.run.smithi104.stdout:47244640262 2024-04-24T02:11:57.826 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-24T02:11:57.827 INFO:teuthology.orchestra.run.smithi104.stdout:38654705669 2024-04-24T02:11:57.827 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-24T02:11:57.828 INFO:teuthology.orchestra.run.smithi104.stdout:47244640262 2024-04-24T02:11:57.828 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-24T02:11:57.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.967+0000 7f5d7333b640 1 Processor -- start 2024-04-24T02:11:57.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.967+0000 7fe0a9bd4640 1 Processor -- start 2024-04-24T02:11:57.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.967+0000 7fe0a9bd4640 1 -- start start 2024-04-24T02:11:57.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.967+0000 7f2049d9f640 1 Processor -- start 2024-04-24T02:11:57.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.967+0000 7f2049d9f640 1 -- start start 2024-04-24T02:11:57.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.967+0000 7fe376dfb640 1 Processor -- start 2024-04-24T02:11:57.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.967+0000 7f5d7333b640 1 -- start start 2024-04-24T02:11:57.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.967+0000 7fe376dfb640 1 -- start start 2024-04-24T02:11:57.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.967+0000 7fe0a9bd4640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe0a412f0a0 0x7fe0a4133ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:57.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.967+0000 7fe0a9bd4640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0a406dde0 con 0x7fe0a412e5b0 2024-04-24T02:11:57.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.967+0000 7fe0a9bd4640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fe0a4070280 con 0x7fe0a412f0a0 2024-04-24T02:11:57.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.967+0000 7f2049d9f640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f204406fd50 0x7f2044133860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:57.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.967+0000 7f2049d9f640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2044133da0 con 0x7f204406f260 2024-04-24T02:11:57.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.967+0000 7f2049d9f640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f2044070bc0 con 0x7f204406fd50 2024-04-24T02:11:57.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.968+0000 7f5d7333b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f5d6c127ff0 0x7f5d6c1283d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:57.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.968+0000 7f5d7333b640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d6c06fd80 con 0x7f5d6c070410 2024-04-24T02:11:57.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.968+0000 7f2042ffd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f204406fd50 0x7f2044133860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:57.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.968+0000 7f2042ffd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f204406fd50 0x7f2044133860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53814/0 (socket says 172.21.15.104:53814) 2024-04-24T02:11:57.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.968+0000 7f2042ffd640 1 -- 172.21.15.104:0/1399042301 learned_addr learned my addr 172.21.15.104:0/1399042301 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:11:57.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.968+0000 7f5d7333b640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f5d6c070d90 con 0x7f5d6c127ff0 2024-04-24T02:11:57.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.968+0000 7fe0a37fe640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fe0a412e5b0 0x7fe0a412e990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:46838/0 (socket says 172.21.15.104:46838) 2024-04-24T02:11:57.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.968+0000 7fe0a37fe640 1 -- 172.21.15.104:0/2338473546 learned_addr learned my addr 172.21.15.104:0/2338473546 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-04-24T02:11:57.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.968+0000 7fe376dfb640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe370070ae0 0x7fe370131860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:57.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.968+0000 7fe376dfb640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe370071f20 con 0x7fe37006fff0 2024-04-24T02:11:57.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.968+0000 7fe376dfb640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fe370072780 con 0x7fe370070ae0 2024-04-24T02:11:57.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.968+0000 7fe374b97640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fe37006fff0 0x7fe3700703d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:46870/0 (socket says 172.21.15.104:46870) 2024-04-24T02:11:57.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.968+0000 7fe374b97640 1 -- 172.21.15.104:0/2652135316 learned_addr learned my addr 172.21.15.104:0/2652135316 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-04-24T02:11:57.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.968+0000 7fe0a2ffd640 1 --2- 172.21.15.104:0/2338473546 >> v2:172.21.15.104:3300/0 conn(0x7fe0a412f0a0 0x7fe0a4133ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:57.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.968+0000 7f5d708d6640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f5d6c070410 0x7f5d6c12b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:46858/0 (socket says 172.21.15.104:46858) 2024-04-24T02:11:57.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.968+0000 7f5d708d6640 1 -- 172.21.15.104:0/511484104 learned_addr learned my addr 172.21.15.104:0/511484104 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-04-24T02:11:57.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.968+0000 7f5d710d7640 1 --2- 172.21.15.104:0/511484104 >> v2:172.21.15.104:3300/0 conn(0x7f5d6c127ff0 0x7f5d6c1283d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:57.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.968+0000 7f2042ffd640 1 -- 172.21.15.104:0/1399042301 >> v1:172.21.15.104:6789/0 conn(0x7f204406f260 legacy=0x7f204406f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:57.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.968+0000 7f2042ffd640 1 -- 172.21.15.104:0/1399042301 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2044134f80 con 0x7f204406fd50 2024-04-24T02:11:57.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.968+0000 7fe0a27fc640 1 -- 172.21.15.104:0/2338473546 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4089094970 0 0) 0x7fe0a406dde0 con 0x7fe0a412e5b0 2024-04-24T02:11:57.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.968+0000 7fe0a27fc640 1 -- 172.21.15.104:0/2338473546 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe08c003520 con 0x7fe0a412e5b0 2024-04-24T02:11:57.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.968+0000 7fe0a2ffd640 1 -- 172.21.15.104:0/2338473546 >> v1:172.21.15.104:6789/0 conn(0x7fe0a412e5b0 legacy=0x7fe0a412e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:57.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.968+0000 7fe0a2ffd640 1 -- 172.21.15.104:0/2338473546 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0a406f6d0 con 0x7fe0a412f0a0 2024-04-24T02:11:57.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.968+0000 7fe36ffff640 1 --2- 172.21.15.104:0/2652135316 >> v2:172.21.15.104:3300/0 conn(0x7fe370070ae0 0x7fe370131860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:57.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.968+0000 7fe36f7fe640 1 -- 172.21.15.104:0/2652135316 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3113335007 0 0) 0x7fe370071f20 con 0x7fe37006fff0 2024-04-24T02:11:57.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.968+0000 7f5d710d7640 1 -- 172.21.15.104:0/511484104 >> v1:172.21.15.104:6789/0 conn(0x7f5d6c070410 legacy=0x7f5d6c12b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:57.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.968+0000 7fe36f7fe640 1 -- 172.21.15.104:0/2652135316 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe360003520 con 0x7fe37006fff0 2024-04-24T02:11:57.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.968+0000 7f5d710d7640 1 -- 172.21.15.104:0/511484104 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d6c127d70 con 0x7f5d6c127ff0 2024-04-24T02:11:57.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.969+0000 7fe36ffff640 1 -- 172.21.15.104:0/2652135316 >> v1:172.21.15.104:6789/0 conn(0x7fe37006fff0 legacy=0x7fe3700703d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:57.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.969+0000 7fe36f7fe640 1 -- 172.21.15.104:0/2652135316 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2373424538 0 0) 0x7fe360003520 con 0x7fe37006fff0 2024-04-24T02:11:57.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.969+0000 7fe36ffff640 1 -- 172.21.15.104:0/2652135316 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3700714c0 con 0x7fe370070ae0 2024-04-24T02:11:57.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.969+0000 7f2042ffd640 1 --2- 172.21.15.104:0/1399042301 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f204406fd50 0x7f2044133860 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f20380097f0 tx=0x7f203802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74ea5d05395a7443 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:57.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.969+0000 7fe0a2ffd640 1 --2- 172.21.15.104:0/2338473546 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe0a412f0a0 0x7fe0a4133ae0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe098009720 tx=0x7fe09802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=879064b71349187f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:57.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.969+0000 7f20427fc640 1 -- 172.21.15.104:0/1399042301 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2038035020 con 0x7f204406fd50 2024-04-24T02:11:57.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.969+0000 7f20427fc640 1 -- 172.21.15.104:0/1399042301 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20380317a0 con 0x7f204406fd50 2024-04-24T02:11:57.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.969+0000 7f20427fc640 1 -- 172.21.15.104:0/1399042301 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2038031aa0 con 0x7f204406fd50 2024-04-24T02:11:57.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.969+0000 7f5d710d7640 1 --2- 172.21.15.104:0/511484104 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d6c127ff0 0x7f5d6c1283d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5d68009720 tx=0x7f5d6802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1953923015f72d81 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:57.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.969+0000 7fe0a27fc640 1 -- 172.21.15.104:0/2338473546 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0980316d0 con 0x7fe0a412f0a0 2024-04-24T02:11:57.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.970+0000 7fe0a27fc640 1 -- 172.21.15.104:0/2338473546 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe098037070 con 0x7fe0a412f0a0 2024-04-24T02:11:57.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.970+0000 7fe0a27fc640 1 -- 172.21.15.104:0/2338473546 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0980319c0 con 0x7fe0a412f0a0 2024-04-24T02:11:57.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.970+0000 7f5d63fff640 1 -- 172.21.15.104:0/511484104 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d68035020 con 0x7f5d6c127ff0 2024-04-24T02:11:57.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.970+0000 7f5d63fff640 1 -- 172.21.15.104:0/511484104 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d68031760 con 0x7f5d6c127ff0 2024-04-24T02:11:57.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.970+0000 7f5d63fff640 1 -- 172.21.15.104:0/511484104 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d68031a60 con 0x7f5d6c127ff0 2024-04-24T02:11:57.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.970+0000 7fe36ffff640 1 --2- 172.21.15.104:0/2652135316 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe370070ae0 0x7fe370131860 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe35c009750 tx=0x7fe35c02b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=404c90a7c428cf78 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:57.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.970+0000 7fe36f7fe640 1 -- 172.21.15.104:0/2652135316 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe35c037070 con 0x7fe370070ae0 2024-04-24T02:11:57.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.970+0000 7fe36f7fe640 1 -- 172.21.15.104:0/2652135316 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe35c030510 con 0x7fe370070ae0 2024-04-24T02:11:57.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.970+0000 7fe36f7fe640 1 -- 172.21.15.104:0/2652135316 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3640015a0 con 0x7fe370070ae0 2024-04-24T02:11:57.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.970+0000 7f2049d9f640 1 -- 172.21.15.104:0/1399042301 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f204406fd50 msgr2=0x7f2044133860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:57.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.970+0000 7f2049d9f640 1 --2- 172.21.15.104:0/1399042301 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f204406fd50 0x7f2044133860 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f20380097f0 tx=0x7f203802b910 comp rx=0 tx=0).stop 2024-04-24T02:11:57.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.970+0000 7f2049d9f640 1 -- 172.21.15.104:0/1399042301 shutdown_connections 2024-04-24T02:11:57.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.970+0000 7f2049d9f640 1 --2- 172.21.15.104:0/1399042301 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f204406fd50 0x7f2044133860 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:57.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.970+0000 7f2049d9f640 1 -- 172.21.15.104:0/1399042301 >> 172.21.15.104:0/1399042301 conn(0x7f204409e170 msgr2=0x7f204406d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:57.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.970+0000 7f5d7333b640 1 -- 172.21.15.104:0/511484104 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d6c127ff0 msgr2=0x7f5d6c1283d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:57.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.970+0000 7f5d7333b640 1 --2- 172.21.15.104:0/511484104 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d6c127ff0 0x7f5d6c1283d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5d68009720 tx=0x7f5d6802b8d0 comp rx=0 tx=0).stop 2024-04-24T02:11:57.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.970+0000 7f2049d9f640 1 -- 172.21.15.104:0/1399042301 shutdown_connections 2024-04-24T02:11:57.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.970+0000 7f5d7333b640 1 -- 172.21.15.104:0/511484104 shutdown_connections 2024-04-24T02:11:57.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.970+0000 7f5d7333b640 1 --2- 172.21.15.104:0/511484104 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d6c127ff0 0x7f5d6c1283d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:57.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.970+0000 7f5d7333b640 1 -- 172.21.15.104:0/511484104 >> 172.21.15.104:0/511484104 conn(0x7f5d6c09d950 msgr2=0x7f5d6c09dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:57.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.970+0000 7f2049d9f640 1 -- 172.21.15.104:0/1399042301 wait complete. 2024-04-24T02:11:57.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.970+0000 7fe0a9bd4640 1 -- 172.21.15.104:0/2338473546 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe0a412f0a0 msgr2=0x7fe0a4133ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:57.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.970+0000 7fe0a9bd4640 1 --2- 172.21.15.104:0/2338473546 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe0a412f0a0 0x7fe0a4133ae0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe098009720 tx=0x7fe09802b840 comp rx=0 tx=0).stop 2024-04-24T02:11:57.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.971+0000 7fe0a9bd4640 1 -- 172.21.15.104:0/2338473546 shutdown_connections 2024-04-24T02:11:57.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.971+0000 7fe0a9bd4640 1 --2- 172.21.15.104:0/2338473546 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe0a412f0a0 0x7fe0a4133ae0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:57.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.971+0000 7fe0a9bd4640 1 -- 172.21.15.104:0/2338473546 >> 172.21.15.104:0/2338473546 conn(0x7fe0a409c7f0 msgr2=0x7fe0a409cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:57.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.971+0000 7f5d7333b640 1 -- 172.21.15.104:0/511484104 shutdown_connections 2024-04-24T02:11:57.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.971+0000 7fe0a9bd4640 1 -- 172.21.15.104:0/2338473546 shutdown_connections 2024-04-24T02:11:57.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.971+0000 7f5d7333b640 1 -- 172.21.15.104:0/511484104 wait complete. 2024-04-24T02:11:57.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.971+0000 7fe0a9bd4640 1 -- 172.21.15.104:0/2338473546 wait complete. 2024-04-24T02:11:57.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.971+0000 7fe376dfb640 1 -- 172.21.15.104:0/2652135316 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe370070ae0 msgr2=0x7fe370131860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:57.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.971+0000 7fe376dfb640 1 --2- 172.21.15.104:0/2652135316 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe370070ae0 0x7fe370131860 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe35c009750 tx=0x7fe35c02b710 comp rx=0 tx=0).stop 2024-04-24T02:11:57.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.971+0000 7fe376dfb640 1 -- 172.21.15.104:0/2652135316 shutdown_connections 2024-04-24T02:11:57.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.971+0000 7fe376dfb640 1 --2- 172.21.15.104:0/2652135316 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe370070ae0 0x7fe370131860 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:57.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.971+0000 7fe376dfb640 1 -- 172.21.15.104:0/2652135316 >> 172.21.15.104:0/2652135316 conn(0x7fe37009b840 msgr2=0x7fe37009bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:57.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.971+0000 7fe376dfb640 1 -- 172.21.15.104:0/2652135316 shutdown_connections 2024-04-24T02:11:57.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.971+0000 7fe376dfb640 1 -- 172.21.15.104:0/2652135316 wait complete. 2024-04-24T02:11:57.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.971+0000 7f2049d9f640 1 Processor -- start 2024-04-24T02:11:57.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.972+0000 7fe0a9bd4640 1 Processor -- start 2024-04-24T02:11:57.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.972+0000 7f5d7333b640 1 Processor -- start 2024-04-24T02:11:57.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.972+0000 7f2049d9f640 1 -- start start 2024-04-24T02:11:57.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.972+0000 7f5d7333b640 1 -- start start 2024-04-24T02:11:57.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.972+0000 7fe0a9bd4640 1 -- start start 2024-04-24T02:11:57.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.972+0000 7f2049d9f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f204406f260 0x7f2044122300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:57.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.972+0000 7f2049d9f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2044134300 con 0x7f204406f260 2024-04-24T02:11:57.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.972+0000 7f5d7333b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d6c070410 0x7f5d6c12c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:57.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.972+0000 7f5d7333b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f5d6c12b710 con 0x7f5d6c070410 2024-04-24T02:11:57.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.972+0000 7fe376dfb640 1 Processor -- start 2024-04-24T02:11:57.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.972+0000 7f20437fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f204406f260 0x7f2044122300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:57.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.972+0000 7f20437fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f204406f260 0x7f2044122300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53838/0 (socket says 172.21.15.104:53838) 2024-04-24T02:11:57.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.972+0000 7f20437fe640 1 -- 172.21.15.104:0/3943013809 learned_addr learned my addr 172.21.15.104:0/3943013809 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:11:57.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.972+0000 7fe0a9bd4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe0a412e5b0 0x7fe0a412ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:57.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.972+0000 7f5d710d7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d6c070410 0x7f5d6c12c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:57.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.972+0000 7fe0a9bd4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a409b860 con 0x7fe0a412e5b0 2024-04-24T02:11:57.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.972+0000 7f5d710d7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d6c070410 0x7f5d6c12c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53840/0 (socket says 172.21.15.104:53840) 2024-04-24T02:11:57.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.972+0000 7f5d710d7640 1 -- 172.21.15.104:0/2958563953 learned_addr learned my addr 172.21.15.104:0/2958563953 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:11:57.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.972+0000 7fe0a37fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe0a412e5b0 0x7fe0a412ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:57.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.972+0000 7fe0a37fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe0a412e5b0 0x7fe0a412ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53846/0 (socket says 172.21.15.104:53846) 2024-04-24T02:11:57.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.972+0000 7fe0a37fe640 1 -- 172.21.15.104:0/1366357783 learned_addr learned my addr 172.21.15.104:0/1366357783 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:11:57.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.972+0000 7fe376dfb640 1 -- start start 2024-04-24T02:11:57.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.972+0000 7f20437fe640 1 -- 172.21.15.104:0/3943013809 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f204412e440 con 0x7f204406f260 2024-04-24T02:11:57.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.973+0000 7fe0a37fe640 1 -- 172.21.15.104:0/1366357783 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0a411cb80 con 0x7fe0a412e5b0 2024-04-24T02:11:57.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.973+0000 7f20437fe640 1 --2- 172.21.15.104:0/3943013809 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f204406f260 0x7f2044122300 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f203400c450 tx=0x7f203400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:57.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.973+0000 7f5d710d7640 1 -- 172.21.15.104:0/2958563953 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d6c132ff0 con 0x7f5d6c070410 2024-04-24T02:11:57.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.973+0000 7fe0a37fe640 1 --2- 172.21.15.104:0/1366357783 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe0a412e5b0 0x7fe0a412ab90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe09400c480 tx=0x7fe09400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:57.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.973+0000 7f202bfff640 1 -- 172.21.15.104:0/3943013809 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2034017070 con 0x7f204406f260 2024-04-24T02:11:57.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.973+0000 7f202bfff640 1 -- 172.21.15.104:0/3943013809 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2034005220 con 0x7f204406f260 2024-04-24T02:11:57.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.973+0000 7f202bfff640 1 -- 172.21.15.104:0/3943013809 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20340035f0 con 0x7f204406f260 2024-04-24T02:11:57.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.973+0000 7fe08bfff640 1 -- 172.21.15.104:0/1366357783 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe094017070 con 0x7fe0a412e5b0 2024-04-24T02:11:57.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.973+0000 7fe0a9bd4640 1 -- 172.21.15.104:0/1366357783 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0a4133600 con 0x7fe0a412e5b0 2024-04-24T02:11:57.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.973+0000 7fe08bfff640 1 -- 172.21.15.104:0/1366357783 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe094005c10 con 0x7fe0a412e5b0 2024-04-24T02:11:57.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.973+0000 7fe08bfff640 1 -- 172.21.15.104:0/1366357783 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe094007070 con 0x7fe0a412e5b0 2024-04-24T02:11:57.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.973+0000 7fe0a9bd4640 1 -- 172.21.15.104:0/1366357783 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0a411d9f0 con 0x7fe0a412e5b0 2024-04-24T02:11:57.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.973+0000 7f2049d9f640 1 -- 172.21.15.104:0/3943013809 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f204412ea10 con 0x7f204406f260 2024-04-24T02:11:57.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.973+0000 7f2049d9f640 1 -- 172.21.15.104:0/3943013809 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f204412f730 con 0x7f204406f260 2024-04-24T02:11:57.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.973+0000 7f5d710d7640 1 --2- 172.21.15.104:0/2958563953 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d6c070410 0x7f5d6c12c8b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5d68009840 tx=0x7f5d680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:57.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.973+0000 7fe376dfb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe37006fff0 0x7fe3701a84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:57.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.973+0000 7fe376dfb640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe370071a70 con 0x7fe37006fff0 2024-04-24T02:11:57.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.974+0000 7fe374b97640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe37006fff0 0x7fe3701a84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:57.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.974+0000 7fe374b97640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe37006fff0 0x7fe3701a84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53860/0 (socket says 172.21.15.104:53860) 2024-04-24T02:11:57.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.974+0000 7fe374b97640 1 -- 172.21.15.104:0/1324839422 learned_addr learned my addr 172.21.15.104:0/1324839422 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:11:57.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.974+0000 7fe374b97640 1 -- 172.21.15.104:0/1324839422 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe37019eda0 con 0x7fe37006fff0 2024-04-24T02:11:57.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.974+0000 7f5d61ffb640 1 -- 172.21.15.104:0/2958563953 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d6803b930 con 0x7f5d6c070410 2024-04-24T02:11:57.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.974+0000 7f5d61ffb640 1 -- 172.21.15.104:0/2958563953 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d6803bb10 con 0x7f5d6c070410 2024-04-24T02:11:57.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.974+0000 7f5d61ffb640 1 -- 172.21.15.104:0/2958563953 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d6803be30 con 0x7f5d6c070410 2024-04-24T02:11:57.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.974+0000 7fe374b97640 1 --2- 172.21.15.104:0/1324839422 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe37006fff0 0x7fe3701a84f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe36400c6d0 tx=0x7fe36400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:57.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.974+0000 7fe0a9bd4640 1 -- 172.21.15.104:0/1366357783 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0a4062da0 con 0x7fe0a412e5b0 2024-04-24T02:11:57.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.974+0000 7f202bfff640 1 -- 172.21.15.104:0/3943013809 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f203401a070 con 0x7f204406f260 2024-04-24T02:11:57.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.974+0000 7fe08bfff640 1 -- 172.21.15.104:0/1366357783 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe09401a070 con 0x7fe0a412e5b0 2024-04-24T02:11:57.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.974+0000 7f202bfff640 1 --2- 172.21.15.104:0/3943013809 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f2030038100 0x7f203003a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:58.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.975+0000 7f5d7333b640 1 -- 172.21.15.104:0/2958563953 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d6c12e620 con 0x7f5d6c070410 2024-04-24T02:11:58.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.975+0000 7fe08bfff640 1 --2- 172.21.15.104:0/1366357783 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe090038060 0x7fe09003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:58.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.975+0000 7fe08bfff640 1 -- 172.21.15.104:0/1366357783 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7fe09404a280 con 0x7fe0a412e5b0 2024-04-24T02:11:58.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.974+0000 7f202bfff640 1 -- 172.21.15.104:0/3943013809 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7f203404a2a0 con 0x7f204406f260 2024-04-24T02:11:58.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.975+0000 7f2049d9f640 1 -- 172.21.15.104:0/3943013809 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20440a18a0 con 0x7f204406f260 2024-04-24T02:11:58.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.975+0000 7f5d7333b640 1 -- 172.21.15.104:0/2958563953 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d6c12f340 con 0x7f5d6c070410 2024-04-24T02:11:58.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.975+0000 7fe0a2ffd640 1 --2- 172.21.15.104:0/1366357783 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe090038060 0x7fe09003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:58.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.975+0000 7f2042ffd640 1 --2- 172.21.15.104:0/3943013809 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f2030038100 0x7f203003a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:58.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.975+0000 7fe36d7fa640 1 -- 172.21.15.104:0/1324839422 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3640058d0 con 0x7fe37006fff0 2024-04-24T02:11:58.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.975+0000 7fe36d7fa640 1 -- 172.21.15.104:0/1324839422 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe364005a90 con 0x7fe37006fff0 2024-04-24T02:11:58.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.975+0000 7fe36d7fa640 1 -- 172.21.15.104:0/1324839422 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe364005db0 con 0x7fe37006fff0 2024-04-24T02:11:58.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.975+0000 7fe376dfb640 1 -- 172.21.15.104:0/1324839422 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3701a9cd0 con 0x7fe37006fff0 2024-04-24T02:11:58.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.975+0000 7f2042ffd640 1 --2- 172.21.15.104:0/3943013809 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f2030038100 0x7f203003a5c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f20380097f0 tx=0x7f2038008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:58.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.975+0000 7fe376dfb640 1 -- 172.21.15.104:0/1324839422 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3701a8a30 con 0x7fe37006fff0 2024-04-24T02:11:58.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.976+0000 7fe0a2ffd640 1 --2- 172.21.15.104:0/1366357783 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe090038060 0x7fe09003a520 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe098036000 tx=0x7fe098008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:58.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.976+0000 7f5d7333b640 1 -- 172.21.15.104:0/2958563953 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d6c09df10 con 0x7f5d6c070410 2024-04-24T02:11:58.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.976+0000 7fe376dfb640 1 -- 172.21.15.104:0/1324839422 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe370062da0 con 0x7fe37006fff0 2024-04-24T02:11:58.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.979+0000 7fe08bfff640 1 -- 172.21.15.104:0/1366357783 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7fe09401a9a0 con 0x7fe0a412e5b0 2024-04-24T02:11:58.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.980+0000 7f5d61ffb640 1 -- 172.21.15.104:0/2958563953 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5d6804c060 con 0x7f5d6c070410 2024-04-24T02:11:58.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.980+0000 7f5d61ffb640 1 --2- 172.21.15.104:0/2958563953 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5d500380b0 0x7f5d5003a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:58.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.980+0000 7fe36d7fa640 1 -- 172.21.15.104:0/1324839422 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe364007070 con 0x7fe37006fff0 2024-04-24T02:11:58.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.980+0000 7f5d708d6640 1 --2- 172.21.15.104:0/2958563953 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5d500380b0 0x7f5d5003a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:58.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.981+0000 7fe36d7fa640 1 --2- 172.21.15.104:0/1324839422 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe354038060 0x7fe35403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:58.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.981+0000 7f5d708d6640 1 --2- 172.21.15.104:0/2958563953 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5d500380b0 0x7f5d5003a570 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c007fd0 tx=0x7f5d5c007ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:58.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.981+0000 7fe36ffff640 1 --2- 172.21.15.104:0/1324839422 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe354038060 0x7fe35403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:58.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.981+0000 7fe36ffff640 1 --2- 172.21.15.104:0/1324839422 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe354038060 0x7fe35403a520 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe35c034000 tx=0x7fe35c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:58.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.985+0000 7f5d61ffb640 1 -- 172.21.15.104:0/2958563953 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7f5d68031710 con 0x7f5d6c070410 2024-04-24T02:11:58.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.985+0000 7fe36d7fa640 1 -- 172.21.15.104:0/1324839422 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7fe3640125c0 con 0x7fe37006fff0 2024-04-24T02:11:58.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.985+0000 7f202bfff640 1 -- 172.21.15.104:0/3943013809 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f20440a18a0 con 0x7f204406f260 2024-04-24T02:11:58.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.989+0000 7f5d61ffb640 1 -- 172.21.15.104:0/2958563953 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f5d6c09df10 con 0x7f5d6c070410 2024-04-24T02:11:58.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:57.993+0000 7fe36d7fa640 1 -- 172.21.15.104:0/1324839422 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7fe36400a660 con 0x7fe37006fff0 2024-04-24T02:11:58.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:58.167+0000 7f2049d9f640 1 -- 172.21.15.104:0/3943013809 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f2044062da0 con 0x7f204406f260 2024-04-24T02:11:58.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:58.167+0000 7f202bfff640 1 -- 172.21.15.104:0/3943013809 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f203401ac60 con 0x7f204406f260 2024-04-24T02:11:58.168 INFO:teuthology.orchestra.run.smithi104.stdout:47244640261 2024-04-24T02:11:58.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:58.169+0000 7f2049d9f640 1 -- 172.21.15.104:0/3943013809 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f2030038100 msgr2=0x7f203003a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:58.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:58.169+0000 7f2049d9f640 1 --2- 172.21.15.104:0/3943013809 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f2030038100 0x7f203003a5c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f20380097f0 tx=0x7f2038008030 comp rx=0 tx=0).stop 2024-04-24T02:11:58.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:58.169+0000 7f2049d9f640 1 -- 172.21.15.104:0/3943013809 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f204406f260 msgr2=0x7f2044122300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:58.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:58.169+0000 7f2049d9f640 1 --2- 172.21.15.104:0/3943013809 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f204406f260 0x7f2044122300 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f203400c450 tx=0x7f203400c910 comp rx=0 tx=0).stop 2024-04-24T02:11:58.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:58.169+0000 7f2049d9f640 1 -- 172.21.15.104:0/3943013809 shutdown_connections 2024-04-24T02:11:58.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:58.169+0000 7f2049d9f640 1 --2- 172.21.15.104:0/3943013809 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f2030038100 0x7f203003a5c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:58.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:58.169+0000 7f2049d9f640 1 --2- 172.21.15.104:0/3943013809 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f204406f260 0x7f2044122300 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:58.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:58.169+0000 7f2049d9f640 1 -- 172.21.15.104:0/3943013809 >> 172.21.15.104:0/3943013809 conn(0x7f204409e170 msgr2=0x7f2044128870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:58.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:58.169+0000 7f2049d9f640 1 -- 172.21.15.104:0/3943013809 shutdown_connections 2024-04-24T02:11:58.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:58.169+0000 7f2049d9f640 1 -- 172.21.15.104:0/3943013809 wait complete. 2024-04-24T02:11:58.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:58.176+0000 7fe376dfb640 1 -- 172.21.15.104:0/1324839422 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fe370074160 con 0x7fe37006fff0 2024-04-24T02:11:58.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:58.177+0000 7fe36d7fa640 1 -- 172.21.15.104:0/1324839422 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe364007540 con 0x7fe37006fff0 2024-04-24T02:11:58.178 INFO:teuthology.orchestra.run.smithi104.stdout:47244640259 2024-04-24T02:11:58.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:58.179+0000 7fe376dfb640 1 -- 172.21.15.104:0/1324839422 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe354038060 msgr2=0x7fe35403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:58.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:58.179+0000 7fe376dfb640 1 --2- 172.21.15.104:0/1324839422 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe354038060 0x7fe35403a520 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe35c034000 tx=0x7fe35c008030 comp rx=0 tx=0).stop 2024-04-24T02:11:58.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:58.179+0000 7fe376dfb640 1 -- 172.21.15.104:0/1324839422 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe37006fff0 msgr2=0x7fe3701a84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:58.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:58.179+0000 7fe376dfb640 1 --2- 172.21.15.104:0/1324839422 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe37006fff0 0x7fe3701a84f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe36400c6d0 tx=0x7fe36400cb90 comp rx=0 tx=0).stop 2024-04-24T02:11:58.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:58.179+0000 7fe376dfb640 1 -- 172.21.15.104:0/1324839422 shutdown_connections 2024-04-24T02:11:58.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:58.179+0000 7fe376dfb640 1 --2- 172.21.15.104:0/1324839422 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe354038060 0x7fe35403a520 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:58.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:58.179+0000 7fe376dfb640 1 --2- 172.21.15.104:0/1324839422 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe37006fff0 0x7fe3701a84f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:58.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:58.179+0000 7fe376dfb640 1 -- 172.21.15.104:0/1324839422 >> 172.21.15.104:0/1324839422 conn(0x7fe37009b840 msgr2=0x7fe3700999d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:58.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:58.179+0000 7fe376dfb640 1 -- 172.21.15.104:0/1324839422 shutdown_connections 2024-04-24T02:11:58.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:58.179+0000 7fe376dfb640 1 -- 172.21.15.104:0/1324839422 wait complete. 2024-04-24T02:11:58.182 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640261 for osd.3 2024-04-24T02:11:58.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:58.185+0000 7fe0a9bd4640 1 -- 172.21.15.104:0/1366357783 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fe0a409be00 con 0x7fe0a412e5b0 2024-04-24T02:11:58.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:58.186+0000 7fe08bfff640 1 -- 172.21.15.104:0/1366357783 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe09401b730 con 0x7fe0a412e5b0 2024-04-24T02:11:58.187 INFO:teuthology.orchestra.run.smithi104.stdout:38654705668 2024-04-24T02:11:58.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:58.188+0000 7fe0a9bd4640 1 -- 172.21.15.104:0/1366357783 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe090038060 msgr2=0x7fe09003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:58.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:58.188+0000 7fe0a9bd4640 1 --2- 172.21.15.104:0/1366357783 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe090038060 0x7fe09003a520 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe098036000 tx=0x7fe098008030 comp rx=0 tx=0).stop 2024-04-24T02:11:58.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:58.188+0000 7fe0a9bd4640 1 -- 172.21.15.104:0/1366357783 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe0a412e5b0 msgr2=0x7fe0a412ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:58.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:58.188+0000 7fe0a9bd4640 1 --2- 172.21.15.104:0/1366357783 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe0a412e5b0 0x7fe0a412ab90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe09400c480 tx=0x7fe09400c940 comp rx=0 tx=0).stop 2024-04-24T02:11:58.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:58.188+0000 7fe0a9bd4640 1 -- 172.21.15.104:0/1366357783 shutdown_connections 2024-04-24T02:11:58.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:58.188+0000 7fe0a9bd4640 1 --2- 172.21.15.104:0/1366357783 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe090038060 0x7fe09003a520 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:58.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:58.188+0000 7fe0a9bd4640 1 --2- 172.21.15.104:0/1366357783 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe0a412e5b0 0x7fe0a412ab90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:58.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:58.188+0000 7fe0a9bd4640 1 -- 172.21.15.104:0/1366357783 >> 172.21.15.104:0/1366357783 conn(0x7fe0a409c7f0 msgr2=0x7fe0a4070fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:58.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:58.188+0000 7fe0a9bd4640 1 -- 172.21.15.104:0/1366357783 shutdown_connections 2024-04-24T02:11:58.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:58.188+0000 7fe0a9bd4640 1 -- 172.21.15.104:0/1366357783 wait complete. 2024-04-24T02:11:58.191 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640259 for osd.2 2024-04-24T02:11:58.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:58.194+0000 7f5d7333b640 1 -- 172.21.15.104:0/2958563953 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f5d6c12f5c0 con 0x7f5d6c070410 2024-04-24T02:11:58.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:58.195+0000 7f5d61ffb640 1 -- 172.21.15.104:0/2958563953 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5d68040070 con 0x7f5d6c070410 2024-04-24T02:11:58.195 INFO:teuthology.orchestra.run.smithi104.stdout:47244640261 2024-04-24T02:11:58.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:58.197+0000 7f5d7333b640 1 -- 172.21.15.104:0/2958563953 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5d500380b0 msgr2=0x7f5d5003a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:58.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:58.197+0000 7f5d7333b640 1 --2- 172.21.15.104:0/2958563953 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5d500380b0 0x7f5d5003a570 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c007fd0 tx=0x7f5d5c007ac0 comp rx=0 tx=0).stop 2024-04-24T02:11:58.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:58.197+0000 7f5d7333b640 1 -- 172.21.15.104:0/2958563953 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d6c070410 msgr2=0x7f5d6c12c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:58.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:58.197+0000 7f5d7333b640 1 --2- 172.21.15.104:0/2958563953 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d6c070410 0x7f5d6c12c8b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5d68009840 tx=0x7f5d680046c0 comp rx=0 tx=0).stop 2024-04-24T02:11:58.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:58.197+0000 7f5d7333b640 1 -- 172.21.15.104:0/2958563953 shutdown_connections 2024-04-24T02:11:58.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:58.197+0000 7f5d7333b640 1 --2- 172.21.15.104:0/2958563953 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5d500380b0 0x7f5d5003a570 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:58.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:58.197+0000 7f5d7333b640 1 --2- 172.21.15.104:0/2958563953 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d6c070410 0x7f5d6c12c8b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:58.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:58.197+0000 7f5d7333b640 1 -- 172.21.15.104:0/2958563953 >> 172.21.15.104:0/2958563953 conn(0x7f5d6c09d950 msgr2=0x7f5d6c12ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:58.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:58.197+0000 7f5d7333b640 1 -- 172.21.15.104:0/2958563953 shutdown_connections 2024-04-24T02:11:58.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:58.197+0000 7f5d7333b640 1 -- 172.21.15.104:0/2958563953 wait complete. 2024-04-24T02:11:58.200 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.0 2024-04-24T02:11:58.208 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640261 for osd.1 2024-04-24T02:11:59.183 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-24T02:11:59.191 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-24T02:11:59.200 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-24T02:11:59.209 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-24T02:11:59.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.295+0000 7f85a39e6640 1 Processor -- start 2024-04-24T02:11:59.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.296+0000 7f85a39e6640 1 -- start start 2024-04-24T02:11:59.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.296+0000 7f85a39e6640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f859c06fd50 0x7f859c133860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:59.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.296+0000 7f85a39e6640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f859c133da0 con 0x7f859c06f260 2024-04-24T02:11:59.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.296+0000 7f85a39e6640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f859c070bc0 con 0x7f859c06fd50 2024-04-24T02:11:59.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.296+0000 7f85a0f81640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f859c06fd50 0x7f859c133860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:59.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.296+0000 7f85a1782640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f859c06f260 0x7f859c06f640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:46878/0 (socket says 172.21.15.104:46878) 2024-04-24T02:11:59.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.296+0000 7f85a1782640 1 -- 172.21.15.104:0/3115588393 learned_addr learned my addr 172.21.15.104:0/3115588393 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-04-24T02:11:59.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.297+0000 7f85a0f81640 1 -- 172.21.15.104:0/3115588393 >> v1:172.21.15.104:6789/0 conn(0x7f859c06f260 legacy=0x7f859c06f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:59.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.297+0000 7f8593fff640 1 -- 172.21.15.104:0/3115588393 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 781892528 0 0) 0x7f859c133da0 con 0x7f859c06f260 2024-04-24T02:11:59.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.297+0000 7f85a0f81640 1 -- 172.21.15.104:0/3115588393 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f859c134f80 con 0x7f859c06fd50 2024-04-24T02:11:59.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.298+0000 7f85a0f81640 1 --2- 172.21.15.104:0/3115588393 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f859c06fd50 0x7f859c133860 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f858c009720 tx=0x7f858c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9277cf6125c2f6d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:59.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.298+0000 7f8593fff640 1 -- 172.21.15.104:0/3115588393 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f858c0316d0 con 0x7f859c06fd50 2024-04-24T02:11:59.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.298+0000 7f8593fff640 1 -- 172.21.15.104:0/3115588393 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f858c037070 con 0x7f859c06fd50 2024-04-24T02:11:59.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.298+0000 7f8593fff640 1 -- 172.21.15.104:0/3115588393 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f858c0319c0 con 0x7f859c06fd50 2024-04-24T02:11:59.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.299+0000 7f85a39e6640 1 -- 172.21.15.104:0/3115588393 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f859c06fd50 msgr2=0x7f859c133860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:59.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.299+0000 7f85a39e6640 1 --2- 172.21.15.104:0/3115588393 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f859c06fd50 0x7f859c133860 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f858c009720 tx=0x7f858c02b840 comp rx=0 tx=0).stop 2024-04-24T02:11:59.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.299+0000 7f85a39e6640 1 -- 172.21.15.104:0/3115588393 shutdown_connections 2024-04-24T02:11:59.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.299+0000 7f85a39e6640 1 --2- 172.21.15.104:0/3115588393 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f859c06fd50 0x7f859c133860 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:59.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.299+0000 7f85a39e6640 1 -- 172.21.15.104:0/3115588393 >> 172.21.15.104:0/3115588393 conn(0x7f859c09e170 msgr2=0x7f859c06d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:59.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.299+0000 7f85a39e6640 1 -- 172.21.15.104:0/3115588393 shutdown_connections 2024-04-24T02:11:59.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.299+0000 7f85a39e6640 1 -- 172.21.15.104:0/3115588393 wait complete. 2024-04-24T02:11:59.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.300+0000 7f85a39e6640 1 Processor -- start 2024-04-24T02:11:59.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.300+0000 7f85a39e6640 1 -- start start 2024-04-24T02:11:59.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.300+0000 7f85a39e6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f859c06f260 0x7f859c124320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:59.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.300+0000 7f85a39e6640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f859c134300 con 0x7f859c06f260 2024-04-24T02:11:59.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.300+0000 7f85a1782640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f859c06f260 0x7f859c124320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:59.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.300+0000 7f85a1782640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f859c06f260 0x7f859c124320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53888/0 (socket says 172.21.15.104:53888) 2024-04-24T02:11:59.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.300+0000 7f85a1782640 1 -- 172.21.15.104:0/4265415507 learned_addr learned my addr 172.21.15.104:0/4265415507 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:11:59.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.301+0000 7f85a1782640 1 -- 172.21.15.104:0/4265415507 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f859c130bf0 con 0x7f859c06f260 2024-04-24T02:11:59.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.301+0000 7f85a1782640 1 --2- 172.21.15.104:0/4265415507 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f859c06f260 0x7f859c124320 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f859800c420 tx=0x7f859800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:59.303 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.301+0000 7f8591ffb640 1 -- 172.21.15.104:0/4265415507 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8598018070 con 0x7f859c06f260 2024-04-24T02:11:59.303 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.301+0000 7f8591ffb640 1 -- 172.21.15.104:0/4265415507 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85980074d0 con 0x7f859c06f260 2024-04-24T02:11:59.303 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.301+0000 7f85a39e6640 1 -- 172.21.15.104:0/4265415507 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f859c1333a0 con 0x7f859c06f260 2024-04-24T02:11:59.303 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.301+0000 7f8591ffb640 1 -- 172.21.15.104:0/4265415507 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8598004950 con 0x7f859c06f260 2024-04-24T02:11:59.303 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.301+0000 7f85a39e6640 1 -- 172.21.15.104:0/4265415507 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f859c1315d0 con 0x7f859c06f260 2024-04-24T02:11:59.304 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.303+0000 7f8591ffb640 1 -- 172.21.15.104:0/4265415507 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f859801b070 con 0x7f859c06f260 2024-04-24T02:11:59.304 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.303+0000 7f85a39e6640 1 -- 172.21.15.104:0/4265415507 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f859c0a18a0 con 0x7f859c06f260 2024-04-24T02:11:59.304 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.303+0000 7f8591ffb640 1 --2- 172.21.15.104:0/4265415507 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8580038060 0x7f858003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:59.304 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.303+0000 7f8591ffb640 1 -- 172.21.15.104:0/4265415507 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7f859804a290 con 0x7f859c06f260 2024-04-24T02:11:59.304 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.303+0000 7f85a0f81640 1 --2- 172.21.15.104:0/4265415507 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8580038060 0x7f858003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:59.305 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.304+0000 7f85a0f81640 1 --2- 172.21.15.104:0/4265415507 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8580038060 0x7f858003a520 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f858c009720 tx=0x7f858c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:59.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.312+0000 7f8591ffb640 1 -- 172.21.15.104:0/4265415507 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f859c0a18a0 con 0x7f859c06f260 2024-04-24T02:11:59.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.334+0000 7f9a2366d640 1 Processor -- start 2024-04-24T02:11:59.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.334+0000 7fe5f00c8640 1 Processor -- start 2024-04-24T02:11:59.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.334+0000 7f9a2366d640 1 -- start start 2024-04-24T02:11:59.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.334+0000 7fe5f00c8640 1 -- start start 2024-04-24T02:11:59.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.335+0000 7f9a2366d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f9a1c128c20 0x7f9a1c129000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:59.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.335+0000 7fe5f00c8640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe5e806d690 0x7fe5e806da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:59.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.335+0000 7f9a2366d640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a1c071940 con 0x7f9a1c071160 2024-04-24T02:11:59.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.335+0000 7fe5f00c8640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5e806f0f0 con 0x7fe5e806dfb0 2024-04-24T02:11:59.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.335+0000 7fe5f00c8640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fe5e8071a60 con 0x7fe5e806d690 2024-04-24T02:11:59.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.335+0000 7f9a2366d640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f9a1c09d520 con 0x7f9a1c128c20 2024-04-24T02:11:59.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.335+0000 7fe5ede64640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe5e806d690 0x7fe5e806da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:59.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.335+0000 7f9a21409640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f9a1c128c20 0x7f9a1c129000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:59.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.335+0000 7fe5ede64640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe5e806d690 0x7fe5e806da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53898/0 (socket says 172.21.15.104:53898) 2024-04-24T02:11:59.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.335+0000 7fe5ed663640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fe5e806dfb0 0x7fe5e8070620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:46888/0 (socket says 172.21.15.104:46888) 2024-04-24T02:11:59.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.335+0000 7fe5ede64640 1 -- 172.21.15.104:0/3722917728 learned_addr learned my addr 172.21.15.104:0/3722917728 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:11:59.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.335+0000 7f9a21409640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f9a1c128c20 0x7f9a1c129000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53892/0 (socket says 172.21.15.104:53892) 2024-04-24T02:11:59.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.335+0000 7f9a21409640 1 -- 172.21.15.104:0/3545107877 learned_addr learned my addr 172.21.15.104:0/3545107877 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:11:59.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.335+0000 7f9a21409640 1 -- 172.21.15.104:0/3545107877 >> v1:172.21.15.104:6789/0 conn(0x7f9a1c071160 legacy=0x7f9a1c097060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T02:11:59.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.335+0000 7fe5ede64640 1 -- 172.21.15.104:0/3722917728 >> v1:172.21.15.104:6789/0 conn(0x7fe5e806dfb0 legacy=0x7fe5e8070620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:59.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.335+0000 7fe5ede64640 1 -- 172.21.15.104:0/3722917728 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5e806f8b0 con 0x7fe5e806d690 2024-04-24T02:11:59.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.335+0000 7f9a21409640 1 -- 172.21.15.104:0/3545107877 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a1c072020 con 0x7f9a1c128c20 2024-04-24T02:11:59.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.336+0000 7fe5ede64640 1 --2- 172.21.15.104:0/3722917728 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5e806d690 0x7fe5e806da70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe5e40097f0 tx=0x7fe5e402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63eeb38388dddd43 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:59.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.337+0000 7f9a21409640 1 --2- 172.21.15.104:0/3545107877 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a1c128c20 0x7f9a1c129000 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9a180097f0 tx=0x7f9a1802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dd1ff6b74692dff server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:59.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.337+0000 7fe5ece62640 1 -- 172.21.15.104:0/3722917728 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5e4035020 con 0x7fe5e806d690 2024-04-24T02:11:59.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.337+0000 7fe5ece62640 1 -- 172.21.15.104:0/3722917728 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5e40317a0 con 0x7fe5e806d690 2024-04-24T02:11:59.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.337+0000 7fe5ece62640 1 -- 172.21.15.104:0/3722917728 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5e4031aa0 con 0x7fe5e806d690 2024-04-24T02:11:59.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.337+0000 7f9a13fff640 1 -- 172.21.15.104:0/3545107877 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a18034070 con 0x7f9a1c128c20 2024-04-24T02:11:59.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.337+0000 7f9a13fff640 1 -- 172.21.15.104:0/3545107877 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a18030790 con 0x7f9a1c128c20 2024-04-24T02:11:59.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.337+0000 7f9a13fff640 1 -- 172.21.15.104:0/3545107877 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a18030a90 con 0x7f9a1c128c20 2024-04-24T02:11:59.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.337+0000 7f04b2938640 1 Processor -- start 2024-04-24T02:11:59.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.337+0000 7f04b2938640 1 -- start start 2024-04-24T02:11:59.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.337+0000 7fe5f00c8640 1 -- 172.21.15.104:0/3722917728 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5e806d690 msgr2=0x7fe5e806da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:59.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.337+0000 7fe5f00c8640 1 --2- 172.21.15.104:0/3722917728 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5e806d690 0x7fe5e806da70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe5e40097f0 tx=0x7fe5e402b910 comp rx=0 tx=0).stop 2024-04-24T02:11:59.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.337+0000 7fe5f00c8640 1 -- 172.21.15.104:0/3722917728 shutdown_connections 2024-04-24T02:11:59.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.337+0000 7fe5f00c8640 1 --2- 172.21.15.104:0/3722917728 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5e806d690 0x7fe5e806da70 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:59.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.337+0000 7fe5f00c8640 1 -- 172.21.15.104:0/3722917728 >> 172.21.15.104:0/3722917728 conn(0x7fe5e8099680 msgr2=0x7fe5e8099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:59.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.338+0000 7fe5f00c8640 1 -- 172.21.15.104:0/3722917728 shutdown_connections 2024-04-24T02:11:59.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.338+0000 7fe5f00c8640 1 -- 172.21.15.104:0/3722917728 wait complete. 2024-04-24T02:11:59.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.338+0000 7f9a2366d640 1 -- 172.21.15.104:0/3545107877 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a1c128c20 msgr2=0x7f9a1c129000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:59.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.338+0000 7f9a2366d640 1 --2- 172.21.15.104:0/3545107877 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a1c128c20 0x7f9a1c129000 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9a180097f0 tx=0x7f9a1802b9a0 comp rx=0 tx=0).stop 2024-04-24T02:11:59.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.338+0000 7f9a2366d640 1 -- 172.21.15.104:0/3545107877 shutdown_connections 2024-04-24T02:11:59.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.338+0000 7f9a2366d640 1 --2- 172.21.15.104:0/3545107877 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a1c128c20 0x7f9a1c129000 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:59.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.338+0000 7f04b2938640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f04ac06e8d0 0x7f04ac133900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:59.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.338+0000 7f9a2366d640 1 -- 172.21.15.104:0/3545107877 >> 172.21.15.104:0/3545107877 conn(0x7f9a1c09b780 msgr2=0x7f9a1c09bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:59.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.338+0000 7f04b2938640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04ac09b7d0 con 0x7f04ac06dde0 2024-04-24T02:11:59.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.338+0000 7f04b2938640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f04ac06fbb0 con 0x7f04ac06e8d0 2024-04-24T02:11:59.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.338+0000 7f9a2366d640 1 -- 172.21.15.104:0/3545107877 shutdown_connections 2024-04-24T02:11:59.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.338+0000 7f04ab7fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f04ac06e8d0 0x7f04ac133900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:59.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.338+0000 7f04ab7fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f04ac06e8d0 0x7f04ac133900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53914/0 (socket says 172.21.15.104:53914) 2024-04-24T02:11:59.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.338+0000 7f9a2366d640 1 -- 172.21.15.104:0/3545107877 wait complete. 2024-04-24T02:11:59.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.338+0000 7f04ab7fe640 1 -- 172.21.15.104:0/593217605 learned_addr learned my addr 172.21.15.104:0/593217605 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:11:59.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.338+0000 7f04ab7fe640 1 -- 172.21.15.104:0/593217605 >> v1:172.21.15.104:6789/0 conn(0x7f04ac06dde0 legacy=0x7f04ac06e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T02:11:59.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.338+0000 7f04ab7fe640 1 -- 172.21.15.104:0/593217605 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04ac06f550 con 0x7f04ac06e8d0 2024-04-24T02:11:59.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.339+0000 7fe5f00c8640 1 Processor -- start 2024-04-24T02:11:59.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.339+0000 7fe5f00c8640 1 -- start start 2024-04-24T02:11:59.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.339+0000 7f9a2366d640 1 Processor -- start 2024-04-24T02:11:59.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.339+0000 7f9a2366d640 1 -- start start 2024-04-24T02:11:59.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.339+0000 7fe5f00c8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5e806d690 0x7fe5e81c2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:59.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.339+0000 7f04ab7fe640 1 --2- 172.21.15.104:0/593217605 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04ac06e8d0 0x7f04ac133900 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f04a00097f0 tx=0x7f04a002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c5f7d2510a6c949 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:59.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.339+0000 7fe5f00c8640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e8070050 con 0x7fe5e806d690 2024-04-24T02:11:59.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.339+0000 7fe5ede64640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5e806d690 0x7fe5e81c2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:59.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.339+0000 7fe5ede64640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5e806d690 0x7fe5e81c2e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53930/0 (socket says 172.21.15.104:53930) 2024-04-24T02:11:59.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.339+0000 7f9a2366d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a1c071160 0x7f9a1c06e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:59.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.339+0000 7f9a2366d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9a1c1298d0 con 0x7f9a1c071160 2024-04-24T02:11:59.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.339+0000 7fe5ede64640 1 -- 172.21.15.104:0/79373672 learned_addr learned my addr 172.21.15.104:0/79373672 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:11:59.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.339+0000 7f04aaffd640 1 -- 172.21.15.104:0/593217605 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04a002e070 con 0x7f04ac06e8d0 2024-04-24T02:11:59.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.340+0000 7f9a21409640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a1c071160 0x7f9a1c06e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:59.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.339+0000 7f04aaffd640 1 -- 172.21.15.104:0/593217605 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04a0037070 con 0x7f04ac06e8d0 2024-04-24T02:11:59.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.339+0000 7f04aaffd640 1 -- 172.21.15.104:0/593217605 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04a0031730 con 0x7f04ac06e8d0 2024-04-24T02:11:59.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.340+0000 7f9a21409640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a1c071160 0x7f9a1c06e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53932/0 (socket says 172.21.15.104:53932) 2024-04-24T02:11:59.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.340+0000 7fe5ede64640 1 -- 172.21.15.104:0/79373672 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5e8095b90 con 0x7fe5e806d690 2024-04-24T02:11:59.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.340+0000 7f9a21409640 1 -- 172.21.15.104:0/2898929541 learned_addr learned my addr 172.21.15.104:0/2898929541 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:11:59.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.340+0000 7f9a21409640 1 -- 172.21.15.104:0/2898929541 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a1c092290 con 0x7f9a1c071160 2024-04-24T02:11:59.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.340+0000 7fe5ede64640 1 --2- 172.21.15.104:0/79373672 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5e806d690 0x7fe5e81c2e40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe5e40090b0 tx=0x7fe5e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:59.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.340+0000 7f9a21409640 1 --2- 172.21.15.104:0/2898929541 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a1c071160 0x7f9a1c06e8e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9a180097f0 tx=0x7f9a18004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:59.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.340+0000 7fe5de7fc640 1 -- 172.21.15.104:0/79373672 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5e403acb0 con 0x7fe5e806d690 2024-04-24T02:11:59.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.340+0000 7f04b2938640 1 -- 172.21.15.104:0/593217605 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04ac06e8d0 msgr2=0x7f04ac133900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:59.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.340+0000 7f04b2938640 1 --2- 172.21.15.104:0/593217605 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04ac06e8d0 0x7f04ac133900 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f04a00097f0 tx=0x7f04a002b880 comp rx=0 tx=0).stop 2024-04-24T02:11:59.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.340+0000 7fe5de7fc640 1 -- 172.21.15.104:0/79373672 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5e403ae50 con 0x7fe5e806d690 2024-04-24T02:11:59.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.340+0000 7fe5f00c8640 1 -- 172.21.15.104:0/79373672 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5e81aaaf0 con 0x7fe5e806d690 2024-04-24T02:11:59.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.340+0000 7fe5de7fc640 1 -- 172.21.15.104:0/79373672 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5e403acb0 con 0x7fe5e806d690 2024-04-24T02:11:59.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.340+0000 7f9a11ffb640 1 -- 172.21.15.104:0/2898929541 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a18048070 con 0x7f9a1c071160 2024-04-24T02:11:59.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.340+0000 7fe5f00c8640 1 -- 172.21.15.104:0/79373672 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5e808bb80 con 0x7fe5e806d690 2024-04-24T02:11:59.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.340+0000 7f9a11ffb640 1 -- 172.21.15.104:0/2898929541 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a18039ce0 con 0x7f9a1c071160 2024-04-24T02:11:59.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.340+0000 7f9a11ffb640 1 -- 172.21.15.104:0/2898929541 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a18034040 con 0x7f9a1c071160 2024-04-24T02:11:59.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.341+0000 7f04b2938640 1 -- 172.21.15.104:0/593217605 shutdown_connections 2024-04-24T02:11:59.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.341+0000 7f04b2938640 1 --2- 172.21.15.104:0/593217605 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04ac06e8d0 0x7f04ac133900 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:59.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.341+0000 7f04b2938640 1 -- 172.21.15.104:0/593217605 >> 172.21.15.104:0/593217605 conn(0x7f04ac09c900 msgr2=0x7f04ac09cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:59.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.340+0000 7f9a2366d640 1 -- 172.21.15.104:0/2898929541 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a1c093250 con 0x7f9a1c071160 2024-04-24T02:11:59.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.341+0000 7f04b2938640 1 -- 172.21.15.104:0/593217605 shutdown_connections 2024-04-24T02:11:59.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.340+0000 7f9a2366d640 1 -- 172.21.15.104:0/2898929541 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a1c093690 con 0x7f9a1c071160 2024-04-24T02:11:59.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.341+0000 7f04b2938640 1 -- 172.21.15.104:0/593217605 wait complete. 2024-04-24T02:11:59.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.342+0000 7fe5f00c8640 1 -- 172.21.15.104:0/79373672 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5e8062da0 con 0x7fe5e806d690 2024-04-24T02:11:59.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.342+0000 7fe5de7fc640 1 -- 172.21.15.104:0/79373672 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe5e404b060 con 0x7fe5e806d690 2024-04-24T02:11:59.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.342+0000 7f9a11ffb640 1 -- 172.21.15.104:0/2898929541 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9a1804b070 con 0x7f9a1c071160 2024-04-24T02:11:59.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.342+0000 7f9a11ffb640 1 --2- 172.21.15.104:0/2898929541 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9a000380b0 0x7f9a0003a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:59.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.342+0000 7fe5de7fc640 1 --2- 172.21.15.104:0/79373672 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe5cc0383a0 0x7fe5cc03a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:59.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.342+0000 7f9a2366d640 1 -- 172.21.15.104:0/2898929541 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a1c0995e0 con 0x7f9a1c071160 2024-04-24T02:11:59.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.342+0000 7f9a11ffb640 1 -- 172.21.15.104:0/2898929541 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7f9a18040050 con 0x7f9a1c071160 2024-04-24T02:11:59.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.342+0000 7fe5de7fc640 1 -- 172.21.15.104:0/79373672 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7fe5e406cc50 con 0x7fe5e806d690 2024-04-24T02:11:59.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.342+0000 7f04b2938640 1 Processor -- start 2024-04-24T02:11:59.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.342+0000 7fe5ed663640 1 --2- 172.21.15.104:0/79373672 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe5cc0383a0 0x7fe5cc03a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:59.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.343+0000 7f04b2938640 1 -- start start 2024-04-24T02:11:59.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.342+0000 7f9a20c08640 1 --2- 172.21.15.104:0/2898929541 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9a000380b0 0x7f9a0003a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:59.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.343+0000 7f9a20c08640 1 --2- 172.21.15.104:0/2898929541 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9a000380b0 0x7f9a0003a570 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c000f60 tx=0x7f9a0c007a30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:59.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.343+0000 7fe5ed663640 1 --2- 172.21.15.104:0/79373672 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe5cc0383a0 0x7fe5cc03a860 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe5e806e400 tx=0x7fe5d8007a20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:59.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.343+0000 7f04b2938640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04ac06dde0 0x7f04ac11e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:59.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.343+0000 7f04b2938640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f04ac06f310 con 0x7f04ac06dde0 2024-04-24T02:11:59.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.343+0000 7f04abfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04ac06dde0 0x7f04ac11e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:59.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.343+0000 7f04abfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04ac06dde0 0x7f04ac11e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53944/0 (socket says 172.21.15.104:53944) 2024-04-24T02:11:59.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.343+0000 7f04abfff640 1 -- 172.21.15.104:0/576714678 learned_addr learned my addr 172.21.15.104:0/576714678 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:11:59.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.344+0000 7f04abfff640 1 -- 172.21.15.104:0/576714678 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04ac11f730 con 0x7f04ac06dde0 2024-04-24T02:11:59.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.344+0000 7f04abfff640 1 --2- 172.21.15.104:0/576714678 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04ac06dde0 0x7f04ac11e5f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f049c00c3b0 tx=0x7f049c00c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:59.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.347+0000 7fe5de7fc640 1 -- 172.21.15.104:0/79373672 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7fe5e403f070 con 0x7fe5e806d690 2024-04-24T02:11:59.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.352+0000 7f04a8ff9640 1 -- 172.21.15.104:0/576714678 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f049c0116c0 con 0x7f04ac06dde0 2024-04-24T02:11:59.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.352+0000 7f04a8ff9640 1 -- 172.21.15.104:0/576714678 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f049c017070 con 0x7f04ac06dde0 2024-04-24T02:11:59.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.352+0000 7f04b2938640 1 -- 172.21.15.104:0/576714678 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04ac1217a0 con 0x7f04ac06dde0 2024-04-24T02:11:59.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.352+0000 7f04a8ff9640 1 -- 172.21.15.104:0/576714678 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f049c0119d0 con 0x7f04ac06dde0 2024-04-24T02:11:59.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.352+0000 7f9a11ffb640 1 -- 172.21.15.104:0/2898929541 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f9a1c0995e0 con 0x7f9a1c071160 2024-04-24T02:11:59.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.352+0000 7f04b2938640 1 -- 172.21.15.104:0/576714678 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04ac11ff00 con 0x7f04ac06dde0 2024-04-24T02:11:59.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.353+0000 7f04a8ff9640 1 -- 172.21.15.104:0/576714678 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f049c011b70 con 0x7f04ac06dde0 2024-04-24T02:11:59.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.353+0000 7f04a8ff9640 1 --2- 172.21.15.104:0/576714678 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f04980380b0 0x7f049803a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:59.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.353+0000 7f04a8ff9640 1 -- 172.21.15.104:0/576714678 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7f049c04acd0 con 0x7f04ac06dde0 2024-04-24T02:11:59.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.353+0000 7f04b2938640 1 -- 172.21.15.104:0/576714678 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04ac120ec0 con 0x7f04ac06dde0 2024-04-24T02:11:59.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.354+0000 7f04ab7fe640 1 --2- 172.21.15.104:0/576714678 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f04980380b0 0x7f049803a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:59.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.354+0000 7f04ab7fe640 1 --2- 172.21.15.104:0/576714678 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f04980380b0 0x7f049803a570 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f04a0036000 tx=0x7f04a0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:59.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.358+0000 7f04a8ff9640 1 -- 172.21.15.104:0/576714678 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f04ac1217a0 con 0x7f04ac06dde0 2024-04-24T02:11:59.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.498+0000 7f85a39e6640 1 -- 172.21.15.104:0/4265415507 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f859c062da0 con 0x7f859c06f260 2024-04-24T02:11:59.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.499+0000 7f8591ffb640 1 -- 172.21.15.104:0/4265415507 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f85980119b0 con 0x7f859c06f260 2024-04-24T02:11:59.500 INFO:teuthology.orchestra.run.smithi104.stdout:47244640262 2024-04-24T02:11:59.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.502+0000 7f85a39e6640 1 -- 172.21.15.104:0/4265415507 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8580038060 msgr2=0x7f858003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:59.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.502+0000 7f85a39e6640 1 --2- 172.21.15.104:0/4265415507 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8580038060 0x7f858003a520 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f858c009720 tx=0x7f858c008030 comp rx=0 tx=0).stop 2024-04-24T02:11:59.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.502+0000 7f85a39e6640 1 -- 172.21.15.104:0/4265415507 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f859c06f260 msgr2=0x7f859c124320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:59.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.502+0000 7f85a39e6640 1 --2- 172.21.15.104:0/4265415507 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f859c06f260 0x7f859c124320 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f859800c420 tx=0x7f859800c8e0 comp rx=0 tx=0).stop 2024-04-24T02:11:59.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.502+0000 7f85a39e6640 1 -- 172.21.15.104:0/4265415507 shutdown_connections 2024-04-24T02:11:59.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.502+0000 7f85a39e6640 1 --2- 172.21.15.104:0/4265415507 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8580038060 0x7f858003a520 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:59.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.502+0000 7f85a39e6640 1 --2- 172.21.15.104:0/4265415507 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f859c06f260 0x7f859c124320 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:59.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.502+0000 7f85a39e6640 1 -- 172.21.15.104:0/4265415507 >> 172.21.15.104:0/4265415507 conn(0x7f859c09e170 msgr2=0x7f859c09e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:59.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.502+0000 7f85a39e6640 1 -- 172.21.15.104:0/4265415507 shutdown_connections 2024-04-24T02:11:59.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.502+0000 7f85a39e6640 1 -- 172.21.15.104:0/4265415507 wait complete. 2024-04-24T02:11:59.517 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640262 for osd.3 2024-04-24T02:11:59.518 DEBUG:teuthology.parallel:result is None 2024-04-24T02:11:59.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.536+0000 7f9a2366d640 1 -- 172.21.15.104:0/2898929541 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f9a1c062da0 con 0x7f9a1c071160 2024-04-24T02:11:59.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.536+0000 7f9a11ffb640 1 -- 172.21.15.104:0/2898929541 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9a1804c8d0 con 0x7f9a1c071160 2024-04-24T02:11:59.537 INFO:teuthology.orchestra.run.smithi104.stdout:47244640260 2024-04-24T02:11:59.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.538+0000 7f9a2366d640 1 -- 172.21.15.104:0/2898929541 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9a000380b0 msgr2=0x7f9a0003a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:59.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.538+0000 7f9a2366d640 1 --2- 172.21.15.104:0/2898929541 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9a000380b0 0x7f9a0003a570 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c000f60 tx=0x7f9a0c007a30 comp rx=0 tx=0).stop 2024-04-24T02:11:59.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.538+0000 7f9a2366d640 1 -- 172.21.15.104:0/2898929541 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a1c071160 msgr2=0x7f9a1c06e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:59.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.538+0000 7f9a2366d640 1 --2- 172.21.15.104:0/2898929541 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a1c071160 0x7f9a1c06e8e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9a180097f0 tx=0x7f9a18004730 comp rx=0 tx=0).stop 2024-04-24T02:11:59.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.538+0000 7f9a2366d640 1 -- 172.21.15.104:0/2898929541 shutdown_connections 2024-04-24T02:11:59.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.538+0000 7f9a2366d640 1 --2- 172.21.15.104:0/2898929541 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9a000380b0 0x7f9a0003a570 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:59.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.538+0000 7f9a2366d640 1 --2- 172.21.15.104:0/2898929541 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a1c071160 0x7f9a1c06e8e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:59.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.538+0000 7f9a2366d640 1 -- 172.21.15.104:0/2898929541 >> 172.21.15.104:0/2898929541 conn(0x7f9a1c09b780 msgr2=0x7f9a1c127280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:59.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.539+0000 7f9a2366d640 1 -- 172.21.15.104:0/2898929541 shutdown_connections 2024-04-24T02:11:59.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.539+0000 7f9a2366d640 1 -- 172.21.15.104:0/2898929541 wait complete. 2024-04-24T02:11:59.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.541+0000 7f04b2938640 1 -- 172.21.15.104:0/576714678 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f04ac062da0 con 0x7f04ac06dde0 2024-04-24T02:11:59.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.542+0000 7f04a8ff9640 1 -- 172.21.15.104:0/576714678 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f049c01a360 con 0x7f04ac06dde0 2024-04-24T02:11:59.543 INFO:teuthology.orchestra.run.smithi104.stdout:47244640262 2024-04-24T02:11:59.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.545+0000 7fe5f00c8640 1 -- 172.21.15.104:0/79373672 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fe5e81aad20 con 0x7fe5e806d690 2024-04-24T02:11:59.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.545+0000 7fe5de7fc640 1 -- 172.21.15.104:0/79373672 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe5e404be10 con 0x7fe5e806d690 2024-04-24T02:11:59.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.545+0000 7f04b2938640 1 -- 172.21.15.104:0/576714678 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f04980380b0 msgr2=0x7f049803a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:59.546 INFO:teuthology.orchestra.run.smithi104.stdout:38654705669 2024-04-24T02:11:59.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.545+0000 7f04b2938640 1 --2- 172.21.15.104:0/576714678 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f04980380b0 0x7f049803a570 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f04a0036000 tx=0x7f04a0008030 comp rx=0 tx=0).stop 2024-04-24T02:11:59.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.545+0000 7f04b2938640 1 -- 172.21.15.104:0/576714678 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04ac06dde0 msgr2=0x7f04ac11e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:59.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.545+0000 7f04b2938640 1 --2- 172.21.15.104:0/576714678 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04ac06dde0 0x7f04ac11e5f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f049c00c3b0 tx=0x7f049c00c870 comp rx=0 tx=0).stop 2024-04-24T02:11:59.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.545+0000 7f04b2938640 1 -- 172.21.15.104:0/576714678 shutdown_connections 2024-04-24T02:11:59.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.545+0000 7f04b2938640 1 --2- 172.21.15.104:0/576714678 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f04980380b0 0x7f049803a570 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:59.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.545+0000 7f04b2938640 1 --2- 172.21.15.104:0/576714678 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04ac06dde0 0x7f04ac11e5f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:59.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.545+0000 7f04b2938640 1 -- 172.21.15.104:0/576714678 >> 172.21.15.104:0/576714678 conn(0x7f04ac09c900 msgr2=0x7f04ac071060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:59.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.545+0000 7f04b2938640 1 -- 172.21.15.104:0/576714678 shutdown_connections 2024-04-24T02:11:59.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.545+0000 7f04b2938640 1 -- 172.21.15.104:0/576714678 wait complete. 2024-04-24T02:11:59.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.547+0000 7fe5f00c8640 1 -- 172.21.15.104:0/79373672 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe5cc0383a0 msgr2=0x7fe5cc03a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:59.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.547+0000 7fe5f00c8640 1 --2- 172.21.15.104:0/79373672 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe5cc0383a0 0x7fe5cc03a860 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe5e806e400 tx=0x7fe5d8007a20 comp rx=0 tx=0).stop 2024-04-24T02:11:59.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.547+0000 7fe5f00c8640 1 -- 172.21.15.104:0/79373672 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5e806d690 msgr2=0x7fe5e81c2e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:59.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.547+0000 7fe5f00c8640 1 --2- 172.21.15.104:0/79373672 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5e806d690 0x7fe5e81c2e40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe5e40090b0 tx=0x7fe5e40046c0 comp rx=0 tx=0).stop 2024-04-24T02:11:59.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.547+0000 7fe5f00c8640 1 -- 172.21.15.104:0/79373672 shutdown_connections 2024-04-24T02:11:59.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.547+0000 7fe5f00c8640 1 --2- 172.21.15.104:0/79373672 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe5cc0383a0 0x7fe5cc03a860 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:59.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.547+0000 7fe5f00c8640 1 --2- 172.21.15.104:0/79373672 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5e806d690 0x7fe5e81c2e40 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:59.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.547+0000 7fe5f00c8640 1 -- 172.21.15.104:0/79373672 >> 172.21.15.104:0/79373672 conn(0x7fe5e8099680 msgr2=0x7fe5e808e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:59.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.547+0000 7fe5f00c8640 1 -- 172.21.15.104:0/79373672 shutdown_connections 2024-04-24T02:11:59.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.547+0000 7fe5f00c8640 1 -- 172.21.15.104:0/79373672 wait complete. 2024-04-24T02:11:59.553 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640260 for osd.2 2024-04-24T02:11:59.554 DEBUG:teuthology.parallel:result is None 2024-04-24T02:11:59.560 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.0 2024-04-24T02:11:59.560 DEBUG:teuthology.parallel:result is None 2024-04-24T02:11:59.561 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640262 for osd.1 2024-04-24T02:11:59.561 DEBUG:teuthology.parallel:result is None 2024-04-24T02:11:59.561 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-24T02:11:59.561 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T02:11:59.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.695+0000 7fe6d47b6640 1 Processor -- start 2024-04-24T02:11:59.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.695+0000 7fe6d47b6640 1 -- start start 2024-04-24T02:11:59.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.695+0000 7fe6d47b6640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe6cc096430 0x7fe6cc096810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:59.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.695+0000 7fe6d47b6640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6cc098800 con 0x7fe6cc071090 2024-04-24T02:11:59.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.695+0000 7fe6d47b6640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fe6cc071930 con 0x7fe6cc096430 2024-04-24T02:11:59.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.695+0000 7fe6d2552640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe6cc096430 0x7fe6cc096810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:59.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.695+0000 7fe6d1d51640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fe6cc071090 0x7fe6cc06d420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:40796/0 (socket says 172.21.15.104:40796) 2024-04-24T02:11:59.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.696+0000 7fe6d1d51640 1 -- 172.21.15.104:0/577820892 learned_addr learned my addr 172.21.15.104:0/577820892 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-04-24T02:11:59.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.696+0000 7fe6d2552640 1 -- 172.21.15.104:0/577820892 >> v1:172.21.15.104:6789/0 conn(0x7fe6cc071090 legacy=0x7fe6cc06d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:59.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.696+0000 7fe6d2552640 1 -- 172.21.15.104:0/577820892 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6cc071f50 con 0x7fe6cc096430 2024-04-24T02:11:59.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.696+0000 7fe6d1550640 1 -- 172.21.15.104:0/577820892 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 988294763 0 0) 0x7fe6cc098800 con 0x7fe6cc071090 2024-04-24T02:11:59.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.696+0000 7fe6d2552640 1 --2- 172.21.15.104:0/577820892 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6cc096430 0x7fe6cc096810 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe6c8009720 tx=0x7fe6c802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4153850d9f3ba802 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:59.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.697+0000 7fe6d1550640 1 -- 172.21.15.104:0/577820892 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6c80316d0 con 0x7fe6cc096430 2024-04-24T02:11:59.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.697+0000 7fe6d1550640 1 -- 172.21.15.104:0/577820892 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6c8037070 con 0x7fe6cc096430 2024-04-24T02:11:59.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.697+0000 7fe6d1550640 1 -- 172.21.15.104:0/577820892 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6c80319c0 con 0x7fe6cc096430 2024-04-24T02:11:59.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.697+0000 7fe6d47b6640 1 -- 172.21.15.104:0/577820892 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6cc096430 msgr2=0x7fe6cc096810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:59.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.697+0000 7fe6d47b6640 1 --2- 172.21.15.104:0/577820892 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6cc096430 0x7fe6cc096810 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe6c8009720 tx=0x7fe6c802b840 comp rx=0 tx=0).stop 2024-04-24T02:11:59.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.697+0000 7fe6d47b6640 1 -- 172.21.15.104:0/577820892 shutdown_connections 2024-04-24T02:11:59.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.697+0000 7fe6d47b6640 1 --2- 172.21.15.104:0/577820892 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6cc096430 0x7fe6cc096810 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:59.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.697+0000 7fe6d47b6640 1 -- 172.21.15.104:0/577820892 >> 172.21.15.104:0/577820892 conn(0x7fe6cc099680 msgr2=0x7fe6cc099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:59.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.697+0000 7fe6d47b6640 1 -- 172.21.15.104:0/577820892 shutdown_connections 2024-04-24T02:11:59.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.697+0000 7fe6d47b6640 1 -- 172.21.15.104:0/577820892 wait complete. 2024-04-24T02:11:59.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.698+0000 7fe6d47b6640 1 Processor -- start 2024-04-24T02:11:59.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.698+0000 7fe6d47b6640 1 -- start start 2024-04-24T02:11:59.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.698+0000 7fe6d47b6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6cc071090 0x7fe6cc089f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:59.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.698+0000 7fe6d47b6640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe6cc096d50 con 0x7fe6cc071090 2024-04-24T02:11:59.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.698+0000 7fe6d2552640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6cc071090 0x7fe6cc089f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:59.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.699+0000 7fe6d2552640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6cc071090 0x7fe6cc089f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33446/0 (socket says 172.21.15.104:33446) 2024-04-24T02:11:59.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.699+0000 7fe6d2552640 1 -- 172.21.15.104:0/3730285536 learned_addr learned my addr 172.21.15.104:0/3730285536 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:11:59.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.699+0000 7fe6d2552640 1 -- 172.21.15.104:0/3730285536 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6cc1261d0 con 0x7fe6cc071090 2024-04-24T02:11:59.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.699+0000 7fe6d2552640 1 --2- 172.21.15.104:0/3730285536 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6cc071090 0x7fe6cc089f90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe6c8034040 tx=0x7fe6c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:59.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.699+0000 7fe6c2ffd640 1 -- 172.21.15.104:0/3730285536 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6c8032770 con 0x7fe6cc071090 2024-04-24T02:11:59.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.699+0000 7fe6c2ffd640 1 -- 172.21.15.104:0/3730285536 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6c8032910 con 0x7fe6cc071090 2024-04-24T02:11:59.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.699+0000 7fe6c2ffd640 1 -- 172.21.15.104:0/3730285536 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6c8032c30 con 0x7fe6cc071090 2024-04-24T02:11:59.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.699+0000 7fe6d47b6640 1 -- 172.21.15.104:0/3730285536 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6cc095eb0 con 0x7fe6cc071090 2024-04-24T02:11:59.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.699+0000 7fe6d47b6640 1 -- 172.21.15.104:0/3730285536 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6cc08c230 con 0x7fe6cc071090 2024-04-24T02:11:59.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.700+0000 7fe6c2ffd640 1 -- 172.21.15.104:0/3730285536 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe6c804c060 con 0x7fe6cc071090 2024-04-24T02:11:59.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.700+0000 7fe6d47b6640 1 -- 172.21.15.104:0/3730285536 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6cc062da0 con 0x7fe6cc071090 2024-04-24T02:11:59.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.700+0000 7fe6c2ffd640 1 --2- 172.21.15.104:0/3730285536 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe6b0038060 0x7fe6b003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:59.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.700+0000 7fe6c2ffd640 1 -- 172.21.15.104:0/3730285536 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7fe6c802f050 con 0x7fe6cc071090 2024-04-24T02:11:59.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.700+0000 7fe6d1d51640 1 --2- 172.21.15.104:0/3730285536 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe6b0038060 0x7fe6b003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:59.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.701+0000 7fe6d1d51640 1 --2- 172.21.15.104:0/3730285536 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe6b0038060 0x7fe6b003a520 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc000c00 tx=0x7fe6bc007910 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:59.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.705+0000 7fe6c2ffd640 1 -- 172.21.15.104:0/3730285536 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7fe6c8040070 con 0x7fe6cc071090 2024-04-24T02:11:59.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.875+0000 7fe6d47b6640 1 -- 172.21.15.104:0/3730285536 --> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe6cc129010 con 0x7fe6b0038060 2024-04-24T02:11:59.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.876+0000 7fe6c2ffd640 1 -- 172.21.15.104:0/3730285536 <== mgr.4101 v2:172.21.15.134:6824/3655027977 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31838 (secure 0 0 0) 0x7fe6bc0070d0 con 0x7fe6b0038060 2024-04-24T02:11:59.878 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:11:59.878 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-04-24T02:11:59.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.878+0000 7fe6d47b6640 1 -- 172.21.15.104:0/3730285536 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe6b0038060 msgr2=0x7fe6b003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:59.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.878+0000 7fe6d47b6640 1 --2- 172.21.15.104:0/3730285536 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe6b0038060 0x7fe6b003a520 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc000c00 tx=0x7fe6bc007910 comp rx=0 tx=0).stop 2024-04-24T02:11:59.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.878+0000 7fe6d47b6640 1 -- 172.21.15.104:0/3730285536 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6cc071090 msgr2=0x7fe6cc089f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:59.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.878+0000 7fe6d47b6640 1 --2- 172.21.15.104:0/3730285536 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6cc071090 0x7fe6cc089f90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe6c8034040 tx=0x7fe6c80046c0 comp rx=0 tx=0).stop 2024-04-24T02:11:59.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.878+0000 7fe6d47b6640 1 -- 172.21.15.104:0/3730285536 shutdown_connections 2024-04-24T02:11:59.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.878+0000 7fe6d47b6640 1 --2- 172.21.15.104:0/3730285536 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe6b0038060 0x7fe6b003a520 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:59.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.878+0000 7fe6d47b6640 1 --2- 172.21.15.104:0/3730285536 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6cc071090 0x7fe6cc089f90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:59.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.878+0000 7fe6d47b6640 1 -- 172.21.15.104:0/3730285536 >> 172.21.15.104:0/3730285536 conn(0x7fe6cc099680 msgr2=0x7fe6cc128590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:59.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.878+0000 7fe6d47b6640 1 -- 172.21.15.104:0/3730285536 shutdown_connections 2024-04-24T02:11:59.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.878+0000 7fe6d47b6640 1 -- 172.21.15.104:0/3730285536 wait complete. 2024-04-24T02:11:59.890 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-04-24T02:11:57.959679+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":110348,"kb_used_data":1696,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377377012,"statfs":{"total":386547056640,"available":386434060288,"internally_reserved":0,"allocated":1736704,"data_stored":1343012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":110618390},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.244568"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-24T02:11:57.002708+0000","last_change":"2024-04-24T02:11:57.000530+0000","last_active":"2024-04-24T02:11:57.002708+0000","last_peered":"2024-04-24T02:11:57.002708+0000","last_clean":"2024-04-24T02:11:57.002708+0000","last_became_active":"2024-04-24T02:11:57.000197+0000","last_became_peered":"2024-04-24T02:11:57.000197+0000","last_unstale":"2024-04-24T02:11:57.002708+0000","last_undegraded":"2024-04-24T02:11:57.002708+0000","last_fullsized":"2024-04-24T02:11:57.002708+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:26:21.834708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-24T02:11:56.724433+0000","last_change":"2024-04-24T02:11:56.723499+0000","last_active":"2024-04-24T02:11:56.724433+0000","last_peered":"2024-04-24T02:11:56.724433+0000","last_clean":"2024-04-24T02:11:56.724433+0000","last_became_active":"2024-04-24T02:11:56.723277+0000","last_became_peered":"2024-04-24T02:11:56.723277+0000","last_unstale":"2024-04-24T02:11:56.724433+0000","last_undegraded":"2024-04-24T02:11:56.724433+0000","last_fullsized":"2024-04-24T02:11:56.724433+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:43:06.540150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-24T02:11:56.724906+0000","last_change":"2024-04-24T02:11:56.724046+0000","last_active":"2024-04-24T02:11:56.724906+0000","last_peered":"2024-04-24T02:11:56.724906+0000","last_clean":"2024-04-24T02:11:56.724906+0000","last_became_active":"2024-04-24T02:11:56.723673+0000","last_became_peered":"2024-04-24T02:11:56.723673+0000","last_unstale":"2024-04-24T02:11:56.724906+0000","last_undegraded":"2024-04-24T02:11:56.724906+0000","last_fullsized":"2024-04-24T02:11:56.724906+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:33:29.340510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-24T02:11:56.724796+0000","last_change":"2024-04-24T02:11:56.723976+0000","last_active":"2024-04-24T02:11:56.724796+0000","last_peered":"2024-04-24T02:11:56.724796+0000","last_clean":"2024-04-24T02:11:56.724796+0000","last_became_active":"2024-04-24T02:11:56.723697+0000","last_became_peered":"2024-04-24T02:11:56.723697+0000","last_unstale":"2024-04-24T02:11:56.724796+0000","last_undegraded":"2024-04-24T02:11:56.724796+0000","last_fullsized":"2024-04-24T02:11:56.724796+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:25:53.516885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-24T02:11:56.724811+0000","last_change":"2024-04-24T02:11:56.723425+0000","last_active":"2024-04-24T02:11:56.724811+0000","last_peered":"2024-04-24T02:11:56.724811+0000","last_clean":"2024-04-24T02:11:56.724811+0000","last_became_active":"2024-04-24T02:11:56.723125+0000","last_became_peered":"2024-04-24T02:11:56.723125+0000","last_unstale":"2024-04-24T02:11:56.724811+0000","last_undegraded":"2024-04-24T02:11:56.724811+0000","last_fullsized":"2024-04-24T02:11:56.724811+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:59:38.052249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-24T02:11:56.724882+0000","last_change":"2024-04-24T02:11:56.724010+0000","last_active":"2024-04-24T02:11:56.724882+0000","last_peered":"2024-04-24T02:11:56.724882+0000","last_clean":"2024-04-24T02:11:56.724882+0000","last_became_active":"2024-04-24T02:11:56.723497+0000","last_became_peered":"2024-04-24T02:11:56.723497+0000","last_unstale":"2024-04-24T02:11:56.724882+0000","last_undegraded":"2024-04-24T02:11:56.724882+0000","last_fullsized":"2024-04-24T02:11:56.724882+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:56:43.763010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-24T02:11:56.725183+0000","last_change":"2024-04-24T02:11:56.724008+0000","last_active":"2024-04-24T02:11:56.725183+0000","last_peered":"2024-04-24T02:11:56.725183+0000","last_clean":"2024-04-24T02:11:56.725183+0000","last_became_active":"2024-04-24T02:11:56.723682+0000","last_became_peered":"2024-04-24T02:11:56.723682+0000","last_unstale":"2024-04-24T02:11:56.725183+0000","last_undegraded":"2024-04-24T02:11:56.725183+0000","last_fullsized":"2024-04-24T02:11:56.725183+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:26:11.265014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-24T02:11:56.725212+0000","last_change":"2024-04-24T02:11:56.724372+0000","last_active":"2024-04-24T02:11:56.725212+0000","last_peered":"2024-04-24T02:11:56.725212+0000","last_clean":"2024-04-24T02:11:56.725212+0000","last_became_active":"2024-04-24T02:11:56.723925+0000","last_became_peered":"2024-04-24T02:11:56.723925+0000","last_unstale":"2024-04-24T02:11:56.725212+0000","last_undegraded":"2024-04-24T02:11:56.725212+0000","last_fullsized":"2024-04-24T02:11:56.725212+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:04:41.965681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":168,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-24T02:11:57.719631+0000","last_change":"2024-04-24T02:11:51.990441+0000","last_active":"2024-04-24T02:11:57.719631+0000","last_peered":"2024-04-24T02:11:57.719631+0000","last_clean":"2024-04-24T02:11:57.719631+0000","last_became_active":"2024-04-24T02:11:51.989479+0000","last_became_peered":"2024-04-24T02:11:51.989479+0000","last_unstale":"2024-04-24T02:11:57.719631+0000","last_undegraded":"2024-04-24T02:11:57.719631+0000","last_fullsized":"2024-04-24T02:11:57.719631+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:50.697037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:50.697037+0000","last_clean_scrub_stamp":"2024-04-24T02:11:50.697037+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:59:33.037844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640262,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":139264,"data_stored":41580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640260,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":733184,"data_stored":631948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640262,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28296,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343544,"statfs":{"total":96636764160,"available":96607789056,"internally_reserved":0,"allocated":724992,"data_stored":627904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":139264,"data_stored":41580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T02:11:59.891 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T02:11:59.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.986+0000 7f142955b640 1 Processor -- start 2024-04-24T02:11:59.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.986+0000 7f142955b640 1 -- start start 2024-04-24T02:11:59.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.986+0000 7f142955b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f142406e2c0 0x7f1424133640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:59.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.986+0000 7f142955b640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14240a08a0 con 0x7f142406d7d0 2024-04-24T02:11:59.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.986+0000 7f142955b640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f142406f6d0 con 0x7f142406e2c0 2024-04-24T02:11:59.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.986+0000 7f141bfff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f142406e2c0 0x7f1424133640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:59.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.986+0000 7f1422ffd640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f142406d7d0 0x7f142406dbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:40808/0 (socket says 172.21.15.104:40808) 2024-04-24T02:11:59.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.986+0000 7f1422ffd640 1 -- 172.21.15.104:0/113114203 learned_addr learned my addr 172.21.15.104:0/113114203 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-04-24T02:11:59.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.987+0000 7f141bfff640 1 -- 172.21.15.104:0/113114203 >> v1:172.21.15.104:6789/0 conn(0x7f142406d7d0 legacy=0x7f142406dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:59.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.987+0000 7f141bfff640 1 -- 172.21.15.104:0/113114203 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f142406faa0 con 0x7f142406e2c0 2024-04-24T02:11:59.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.987+0000 7f14227fc640 1 -- 172.21.15.104:0/113114203 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 100814031 0 0) 0x7f14240a08a0 con 0x7f142406d7d0 2024-04-24T02:11:59.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.987+0000 7f141bfff640 1 --2- 172.21.15.104:0/113114203 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f142406e2c0 0x7f1424133640 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f140c009750 tx=0x7f140c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d170d864495d61e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:59.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.988+0000 7f14227fc640 1 -- 172.21.15.104:0/113114203 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f140c035020 con 0x7f142406e2c0 2024-04-24T02:11:59.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.988+0000 7f14227fc640 1 -- 172.21.15.104:0/113114203 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f140c031760 con 0x7f142406e2c0 2024-04-24T02:11:59.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.988+0000 7f14227fc640 1 -- 172.21.15.104:0/113114203 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f140c031a60 con 0x7f142406e2c0 2024-04-24T02:11:59.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.988+0000 7f142955b640 1 -- 172.21.15.104:0/113114203 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f142406e2c0 msgr2=0x7f1424133640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:11:59.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.988+0000 7f142955b640 1 --2- 172.21.15.104:0/113114203 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f142406e2c0 0x7f1424133640 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f140c009750 tx=0x7f140c02b8d0 comp rx=0 tx=0).stop 2024-04-24T02:11:59.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.988+0000 7f142955b640 1 -- 172.21.15.104:0/113114203 shutdown_connections 2024-04-24T02:11:59.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.988+0000 7f142955b640 1 --2- 172.21.15.104:0/113114203 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f142406e2c0 0x7f1424133640 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:11:59.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.988+0000 7f142955b640 1 -- 172.21.15.104:0/113114203 >> 172.21.15.104:0/113114203 conn(0x7f142409ea70 msgr2=0x7f142409ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:11:59.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.988+0000 7f142955b640 1 -- 172.21.15.104:0/113114203 shutdown_connections 2024-04-24T02:11:59.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.988+0000 7f142955b640 1 -- 172.21.15.104:0/113114203 wait complete. 2024-04-24T02:11:59.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.989+0000 7f142955b640 1 Processor -- start 2024-04-24T02:11:59.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.989+0000 7f142955b640 1 -- start start 2024-04-24T02:11:59.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.989+0000 7f142955b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f142406d7d0 0x7f142409a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:59.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.989+0000 7f142955b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f1424133f10 con 0x7f142406d7d0 2024-04-24T02:11:59.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.989+0000 7f1422ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f142406d7d0 0x7f142409a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:59.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.989+0000 7f1422ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f142406d7d0 0x7f142409a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33470/0 (socket says 172.21.15.104:33470) 2024-04-24T02:11:59.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.989+0000 7f1422ffd640 1 -- 172.21.15.104:0/2773343607 learned_addr learned my addr 172.21.15.104:0/2773343607 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:11:59.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.990+0000 7f1422ffd640 1 -- 172.21.15.104:0/2773343607 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1424129b00 con 0x7f142406d7d0 2024-04-24T02:11:59.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.990+0000 7f1422ffd640 1 --2- 172.21.15.104:0/2773343607 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f142406d7d0 0x7f142409a6d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f141400c420 tx=0x7f141400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:59.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.990+0000 7f141b7fe640 1 -- 172.21.15.104:0/2773343607 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1414018070 con 0x7f142406d7d0 2024-04-24T02:11:59.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.990+0000 7f141b7fe640 1 -- 172.21.15.104:0/2773343607 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14140074d0 con 0x7f142406d7d0 2024-04-24T02:11:59.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.990+0000 7f142955b640 1 -- 172.21.15.104:0/2773343607 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1424071c60 con 0x7f142406d7d0 2024-04-24T02:11:59.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.990+0000 7f141b7fe640 1 -- 172.21.15.104:0/2773343607 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1414004950 con 0x7f142406d7d0 2024-04-24T02:11:59.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.990+0000 7f142955b640 1 -- 172.21.15.104:0/2773343607 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f142412a4e0 con 0x7f142406d7d0 2024-04-24T02:11:59.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.991+0000 7f141b7fe640 1 -- 172.21.15.104:0/2773343607 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f141401b070 con 0x7f142406d7d0 2024-04-24T02:11:59.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.991+0000 7f142955b640 1 -- 172.21.15.104:0/2773343607 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f142409c1f0 con 0x7f142406d7d0 2024-04-24T02:11:59.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.991+0000 7f141b7fe640 1 --2- 172.21.15.104:0/2773343607 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1404038060 0x7f140403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:11:59.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.991+0000 7f141b7fe640 1 -- 172.21.15.104:0/2773343607 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7f141404a2d0 con 0x7f142406d7d0 2024-04-24T02:11:59.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.991+0000 7f141bfff640 1 --2- 172.21.15.104:0/2773343607 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1404038060 0x7f140403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:11:59.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.992+0000 7f141bfff640 1 --2- 172.21.15.104:0/2773343607 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1404038060 0x7f140403a520 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f140c036000 tx=0x7f140c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:11:59.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:11:59.996+0000 7f141b7fe640 1 -- 172.21.15.104:0/2773343607 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f142409c1f0 con 0x7f142406d7d0 2024-04-24T02:12:00.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.164+0000 7f142955b640 1 -- 172.21.15.104:0/2773343607 --> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1424062da0 con 0x7f1404038060 2024-04-24T02:12:00.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.166+0000 7f141b7fe640 1 -- 172.21.15.104:0/2773343607 <== mgr.4101 v2:172.21.15.134:6824/3655027977 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31838 (secure 0 0 0) 0x7f1424062da0 con 0x7f1404038060 2024-04-24T02:12:00.167 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:12:00.167 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-04-24T02:12:00.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.168+0000 7f142955b640 1 -- 172.21.15.104:0/2773343607 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1404038060 msgr2=0x7f140403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:00.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.168+0000 7f142955b640 1 --2- 172.21.15.104:0/2773343607 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1404038060 0x7f140403a520 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f140c036000 tx=0x7f140c008030 comp rx=0 tx=0).stop 2024-04-24T02:12:00.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.168+0000 7f142955b640 1 -- 172.21.15.104:0/2773343607 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f142406d7d0 msgr2=0x7f142409a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:00.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.168+0000 7f142955b640 1 --2- 172.21.15.104:0/2773343607 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f142406d7d0 0x7f142409a6d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f141400c420 tx=0x7f141400c8e0 comp rx=0 tx=0).stop 2024-04-24T02:12:00.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.168+0000 7f142955b640 1 -- 172.21.15.104:0/2773343607 shutdown_connections 2024-04-24T02:12:00.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.168+0000 7f142955b640 1 --2- 172.21.15.104:0/2773343607 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1404038060 0x7f140403a520 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:00.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.168+0000 7f142955b640 1 --2- 172.21.15.104:0/2773343607 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f142406d7d0 0x7f142409a6d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:00.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.168+0000 7f142955b640 1 -- 172.21.15.104:0/2773343607 >> 172.21.15.104:0/2773343607 conn(0x7f142409ea70 msgr2=0x7f142409c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:00.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.168+0000 7f142955b640 1 -- 172.21.15.104:0/2773343607 shutdown_connections 2024-04-24T02:12:00.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.168+0000 7f142955b640 1 -- 172.21.15.104:0/2773343607 wait complete. 2024-04-24T02:12:00.179 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-04-24T02:11:59.960080+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":110348,"kb_used_data":1696,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377377012,"statfs":{"total":386547056640,"available":386434060288,"internally_reserved":0,"allocated":1736704,"data_stored":1343012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":110618390},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.244968"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-24T02:11:57.002708+0000","last_change":"2024-04-24T02:11:57.000530+0000","last_active":"2024-04-24T02:11:57.002708+0000","last_peered":"2024-04-24T02:11:57.002708+0000","last_clean":"2024-04-24T02:11:57.002708+0000","last_became_active":"2024-04-24T02:11:57.000197+0000","last_became_peered":"2024-04-24T02:11:57.000197+0000","last_unstale":"2024-04-24T02:11:57.002708+0000","last_undegraded":"2024-04-24T02:11:57.002708+0000","last_fullsized":"2024-04-24T02:11:57.002708+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:26:21.834708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-24T02:11:56.724433+0000","last_change":"2024-04-24T02:11:56.723499+0000","last_active":"2024-04-24T02:11:56.724433+0000","last_peered":"2024-04-24T02:11:56.724433+0000","last_clean":"2024-04-24T02:11:56.724433+0000","last_became_active":"2024-04-24T02:11:56.723277+0000","last_became_peered":"2024-04-24T02:11:56.723277+0000","last_unstale":"2024-04-24T02:11:56.724433+0000","last_undegraded":"2024-04-24T02:11:56.724433+0000","last_fullsized":"2024-04-24T02:11:56.724433+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:43:06.540150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-24T02:11:56.724906+0000","last_change":"2024-04-24T02:11:56.724046+0000","last_active":"2024-04-24T02:11:56.724906+0000","last_peered":"2024-04-24T02:11:56.724906+0000","last_clean":"2024-04-24T02:11:56.724906+0000","last_became_active":"2024-04-24T02:11:56.723673+0000","last_became_peered":"2024-04-24T02:11:56.723673+0000","last_unstale":"2024-04-24T02:11:56.724906+0000","last_undegraded":"2024-04-24T02:11:56.724906+0000","last_fullsized":"2024-04-24T02:11:56.724906+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:33:29.340510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-24T02:11:56.724796+0000","last_change":"2024-04-24T02:11:56.723976+0000","last_active":"2024-04-24T02:11:56.724796+0000","last_peered":"2024-04-24T02:11:56.724796+0000","last_clean":"2024-04-24T02:11:56.724796+0000","last_became_active":"2024-04-24T02:11:56.723697+0000","last_became_peered":"2024-04-24T02:11:56.723697+0000","last_unstale":"2024-04-24T02:11:56.724796+0000","last_undegraded":"2024-04-24T02:11:56.724796+0000","last_fullsized":"2024-04-24T02:11:56.724796+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:25:53.516885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-24T02:11:56.724811+0000","last_change":"2024-04-24T02:11:56.723425+0000","last_active":"2024-04-24T02:11:56.724811+0000","last_peered":"2024-04-24T02:11:56.724811+0000","last_clean":"2024-04-24T02:11:56.724811+0000","last_became_active":"2024-04-24T02:11:56.723125+0000","last_became_peered":"2024-04-24T02:11:56.723125+0000","last_unstale":"2024-04-24T02:11:56.724811+0000","last_undegraded":"2024-04-24T02:11:56.724811+0000","last_fullsized":"2024-04-24T02:11:56.724811+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:59:38.052249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-24T02:11:56.724882+0000","last_change":"2024-04-24T02:11:56.724010+0000","last_active":"2024-04-24T02:11:56.724882+0000","last_peered":"2024-04-24T02:11:56.724882+0000","last_clean":"2024-04-24T02:11:56.724882+0000","last_became_active":"2024-04-24T02:11:56.723497+0000","last_became_peered":"2024-04-24T02:11:56.723497+0000","last_unstale":"2024-04-24T02:11:56.724882+0000","last_undegraded":"2024-04-24T02:11:56.724882+0000","last_fullsized":"2024-04-24T02:11:56.724882+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:56:43.763010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-24T02:11:56.725183+0000","last_change":"2024-04-24T02:11:56.724008+0000","last_active":"2024-04-24T02:11:56.725183+0000","last_peered":"2024-04-24T02:11:56.725183+0000","last_clean":"2024-04-24T02:11:56.725183+0000","last_became_active":"2024-04-24T02:11:56.723682+0000","last_became_peered":"2024-04-24T02:11:56.723682+0000","last_unstale":"2024-04-24T02:11:56.725183+0000","last_undegraded":"2024-04-24T02:11:56.725183+0000","last_fullsized":"2024-04-24T02:11:56.725183+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:26:11.265014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-24T02:11:56.725212+0000","last_change":"2024-04-24T02:11:56.724372+0000","last_active":"2024-04-24T02:11:56.725212+0000","last_peered":"2024-04-24T02:11:56.725212+0000","last_clean":"2024-04-24T02:11:56.725212+0000","last_became_active":"2024-04-24T02:11:56.723925+0000","last_became_peered":"2024-04-24T02:11:56.723925+0000","last_unstale":"2024-04-24T02:11:56.725212+0000","last_undegraded":"2024-04-24T02:11:56.725212+0000","last_fullsized":"2024-04-24T02:11:56.725212+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:04:41.965681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":168,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-24T02:11:57.719631+0000","last_change":"2024-04-24T02:11:51.990441+0000","last_active":"2024-04-24T02:11:57.719631+0000","last_peered":"2024-04-24T02:11:57.719631+0000","last_clean":"2024-04-24T02:11:57.719631+0000","last_became_active":"2024-04-24T02:11:51.989479+0000","last_became_peered":"2024-04-24T02:11:51.989479+0000","last_unstale":"2024-04-24T02:11:57.719631+0000","last_undegraded":"2024-04-24T02:11:57.719631+0000","last_fullsized":"2024-04-24T02:11:57.719631+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:50.697037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:50.697037+0000","last_clean_scrub_stamp":"2024-04-24T02:11:50.697037+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:59:33.037844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640262,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":139264,"data_stored":41580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640260,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":733184,"data_stored":631948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640262,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28296,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343544,"statfs":{"total":96636764160,"available":96607789056,"internally_reserved":0,"allocated":724992,"data_stored":627904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":139264,"data_stored":41580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T02:12:00.180 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-24T02:12:00.180 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-24T02:12:00.181 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-24T02:12:00.181 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-24T02:12:00.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.275+0000 7f6997df4640 1 Processor -- start 2024-04-24T02:12:00.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.275+0000 7f6997df4640 1 -- start start 2024-04-24T02:12:00.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.275+0000 7f6997df4640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f69901287d0 0x7f6990130360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:00.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.275+0000 7f6997df4640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6990127b00 con 0x7f6990127ce0 2024-04-24T02:12:00.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.275+0000 7f6997df4640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f69900708e0 con 0x7f69901287d0 2024-04-24T02:12:00.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.275+0000 7f699538f640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f69901287d0 0x7f6990130360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:00.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.275+0000 7f6995b90640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f6990127ce0 0x7f69901280c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:40812/0 (socket says 172.21.15.104:40812) 2024-04-24T02:12:00.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.275+0000 7f6995b90640 1 -- 172.21.15.104:0/1269527541 learned_addr learned my addr 172.21.15.104:0/1269527541 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-04-24T02:12:00.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.276+0000 7f699538f640 1 -- 172.21.15.104:0/1269527541 >> v1:172.21.15.104:6789/0 conn(0x7f6990127ce0 legacy=0x7f69901280c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:00.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.276+0000 7f699538f640 1 -- 172.21.15.104:0/1269527541 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6990098800 con 0x7f69901287d0 2024-04-24T02:12:00.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.276+0000 7f6994b8e640 1 -- 172.21.15.104:0/1269527541 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3684160679 0 0) 0x7f698c001110 con 0x7f6990127ce0 2024-04-24T02:12:00.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.276+0000 7f699538f640 1 --2- 172.21.15.104:0/1269527541 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69901287d0 0x7f6990130360 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6980009750 tx=0x7f698002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16d1abd5638a4546 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:00.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.276+0000 7f6994b8e640 1 -- 172.21.15.104:0/1269527541 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69800316d0 con 0x7f69901287d0 2024-04-24T02:12:00.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.276+0000 7f6994b8e640 1 -- 172.21.15.104:0/1269527541 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6980037070 con 0x7f69901287d0 2024-04-24T02:12:00.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.277+0000 7f6994b8e640 1 -- 172.21.15.104:0/1269527541 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69800319c0 con 0x7f69901287d0 2024-04-24T02:12:00.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.277+0000 7f6997df4640 1 -- 172.21.15.104:0/1269527541 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69901287d0 msgr2=0x7f6990130360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:00.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.277+0000 7f6997df4640 1 --2- 172.21.15.104:0/1269527541 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69901287d0 0x7f6990130360 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6980009750 tx=0x7f698002b840 comp rx=0 tx=0).stop 2024-04-24T02:12:00.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.277+0000 7f6997df4640 1 -- 172.21.15.104:0/1269527541 shutdown_connections 2024-04-24T02:12:00.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.277+0000 7f6997df4640 1 --2- 172.21.15.104:0/1269527541 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69901287d0 0x7f6990130360 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:00.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.277+0000 7f6997df4640 1 -- 172.21.15.104:0/1269527541 >> 172.21.15.104:0/1269527541 conn(0x7f6990099680 msgr2=0x7f6990099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:00.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.277+0000 7f6997df4640 1 -- 172.21.15.104:0/1269527541 shutdown_connections 2024-04-24T02:12:00.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.277+0000 7f6997df4640 1 -- 172.21.15.104:0/1269527541 wait complete. 2024-04-24T02:12:00.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.278+0000 7f6997df4640 1 Processor -- start 2024-04-24T02:12:00.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.278+0000 7f6997df4640 1 -- start start 2024-04-24T02:12:00.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.278+0000 7f6997df4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6990127ce0 0x7f69901229b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:00.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.278+0000 7f6997df4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f699006faa0 con 0x7f6990127ce0 2024-04-24T02:12:00.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.278+0000 7f6995b90640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6990127ce0 0x7f69901229b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:00.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.278+0000 7f6995b90640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6990127ce0 0x7f69901229b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33486/0 (socket says 172.21.15.104:33486) 2024-04-24T02:12:00.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.278+0000 7f6995b90640 1 -- 172.21.15.104:0/255854052 learned_addr learned my addr 172.21.15.104:0/255854052 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:12:00.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.279+0000 7f6995b90640 1 -- 172.21.15.104:0/255854052 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6990124900 con 0x7f6990127ce0 2024-04-24T02:12:00.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.279+0000 7f6995b90640 1 --2- 172.21.15.104:0/255854052 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6990127ce0 0x7f69901229b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f698c00c700 tx=0x7f698c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:00.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.279+0000 7f69867fc640 1 -- 172.21.15.104:0/255854052 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f698c018070 con 0x7f6990127ce0 2024-04-24T02:12:00.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.279+0000 7f69867fc640 1 -- 172.21.15.104:0/255854052 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f698c0070d0 con 0x7f6990127ce0 2024-04-24T02:12:00.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.279+0000 7f69867fc640 1 -- 172.21.15.104:0/255854052 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f698c0073f0 con 0x7f6990127ce0 2024-04-24T02:12:00.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.279+0000 7f6997df4640 1 -- 172.21.15.104:0/255854052 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f699008a270 con 0x7f6990127ce0 2024-04-24T02:12:00.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.279+0000 7f6997df4640 1 -- 172.21.15.104:0/255854052 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69901230d0 con 0x7f6990127ce0 2024-04-24T02:12:00.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.280+0000 7f69867fc640 1 -- 172.21.15.104:0/255854052 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f698c01b070 con 0x7f6990127ce0 2024-04-24T02:12:00.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.280+0000 7f6997df4640 1 -- 172.21.15.104:0/255854052 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6990062da0 con 0x7f6990127ce0 2024-04-24T02:12:00.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.280+0000 7f69867fc640 1 --2- 172.21.15.104:0/255854052 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6974038060 0x7f697403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:00.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.280+0000 7f69867fc640 1 -- 172.21.15.104:0/255854052 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7f698c04a2c0 con 0x7f6990127ce0 2024-04-24T02:12:00.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.280+0000 7f699538f640 1 --2- 172.21.15.104:0/255854052 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6974038060 0x7f697403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:00.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.281+0000 7f699538f640 1 --2- 172.21.15.104:0/255854052 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6974038060 0x7f697403a520 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6980036000 tx=0x7f6980008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:00.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.284+0000 7f69867fc640 1 -- 172.21.15.104:0/255854052 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f6990127b00 con 0x7f6990127ce0 2024-04-24T02:12:00.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.490+0000 7f6997df4640 1 -- 172.21.15.104:0/255854052 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f699009c340 con 0x7f6990127ce0 2024-04-24T02:12:00.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.491+0000 7f69867fc640 1 -- 172.21.15.104:0/255854052 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f698c00a660 con 0x7f6990127ce0 2024-04-24T02:12:00.492 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:12:00.492 INFO:teuthology.orchestra.run.smithi104.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-24T02:12:00.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.493+0000 7f6997df4640 1 -- 172.21.15.104:0/255854052 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6974038060 msgr2=0x7f697403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:00.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.493+0000 7f6997df4640 1 --2- 172.21.15.104:0/255854052 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6974038060 0x7f697403a520 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6980036000 tx=0x7f6980008030 comp rx=0 tx=0).stop 2024-04-24T02:12:00.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.493+0000 7f6997df4640 1 -- 172.21.15.104:0/255854052 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6990127ce0 msgr2=0x7f69901229b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:00.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.493+0000 7f6997df4640 1 --2- 172.21.15.104:0/255854052 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6990127ce0 0x7f69901229b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f698c00c700 tx=0x7f698c00cbc0 comp rx=0 tx=0).stop 2024-04-24T02:12:00.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.493+0000 7f6997df4640 1 -- 172.21.15.104:0/255854052 shutdown_connections 2024-04-24T02:12:00.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.493+0000 7f6997df4640 1 --2- 172.21.15.104:0/255854052 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6974038060 0x7f697403a520 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:00.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.493+0000 7f6997df4640 1 --2- 172.21.15.104:0/255854052 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6990127ce0 0x7f69901229b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:00.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.493+0000 7f6997df4640 1 -- 172.21.15.104:0/255854052 >> 172.21.15.104:0/255854052 conn(0x7f6990099680 msgr2=0x7f699009b110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:00.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.493+0000 7f6997df4640 1 -- 172.21.15.104:0/255854052 shutdown_connections 2024-04-24T02:12:00.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:12:00.493+0000 7f6997df4640 1 -- 172.21.15.104:0/255854052 wait complete. 2024-04-24T02:12:00.504 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-24T02:12:00.505 INFO:teuthology.run_tasks:Running task rgw... 2024-04-24T02:12:00.519 DEBUG:tasks.rgw:config is {'client.0': None} 2024-04-24T02:12:00.519 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-04-24T02:12:00.519 INFO:tasks.rgw:Creating data pools 2024-04-24T02:12:00.519 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-04-24T02:12:00.520 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-04-24T02:12:00.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:00.626+0000 7f23b5ccf640 1 Processor -- start 2024-04-24T02:12:00.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:00.626+0000 7f23b5ccf640 1 -- start start 2024-04-24T02:12:00.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:00.626+0000 7f23b5ccf640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f23b0118960 0x7f23b011ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:00.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:00.626+0000 7f23b5ccf640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23b010eb40 con 0x7f23b010dfc0 2024-04-24T02:12:00.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:00.626+0000 7f23b5ccf640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f23b011c2a0 con 0x7f23b0118960 2024-04-24T02:12:00.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:00.626+0000 7f23aeffd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f23b0118960 0x7f23b011ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:00.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:00.626+0000 7f23af7fe640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f23b010dfc0 0x7f23b010e3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:45302/0 (socket says 172.21.15.134:45302) 2024-04-24T02:12:00.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:00.626+0000 7f23aeffd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f23b0118960 0x7f23b011ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:50682/0 (socket says 172.21.15.134:50682) 2024-04-24T02:12:00.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:00.626+0000 7f23af7fe640 1 -- 172.21.15.134:0/4217057666 learned_addr learned my addr 172.21.15.134:0/4217057666 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:12:00.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:00.627+0000 7f23aeffd640 1 -- 172.21.15.134:0/4217057666 >> v1:172.21.15.104:6789/0 conn(0x7f23b010dfc0 legacy=0x7f23b010e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:00.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:00.627+0000 7f23ae7fc640 1 -- 172.21.15.134:0/4217057666 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3579206602 0 0) 0x7f23b010eb40 con 0x7f23b010dfc0 2024-04-24T02:12:00.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:00.627+0000 7f23aeffd640 1 -- 172.21.15.134:0/4217057666 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23b011c420 con 0x7f23b0118960 2024-04-24T02:12:00.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:00.628+0000 7f23aeffd640 1 --2- 172.21.15.134:0/4217057666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23b0118960 0x7f23b011ad50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f23a4009720 tx=0x7f23a402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f31025f6861be836 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:00.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:00.628+0000 7f23ae7fc640 1 -- 172.21.15.134:0/4217057666 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23a40316d0 con 0x7f23b0118960 2024-04-24T02:12:00.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:00.628+0000 7f23ae7fc640 1 -- 172.21.15.134:0/4217057666 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23a4037070 con 0x7f23b0118960 2024-04-24T02:12:00.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:00.628+0000 7f23ae7fc640 1 -- 172.21.15.134:0/4217057666 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23a40319c0 con 0x7f23b0118960 2024-04-24T02:12:00.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:00.628+0000 7f23b5ccf640 1 -- 172.21.15.134:0/4217057666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23b0118960 msgr2=0x7f23b011ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:00.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:00.628+0000 7f23b5ccf640 1 --2- 172.21.15.134:0/4217057666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23b0118960 0x7f23b011ad50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f23a4009720 tx=0x7f23a402b840 comp rx=0 tx=0).stop 2024-04-24T02:12:00.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:00.628+0000 7f23b5ccf640 1 -- 172.21.15.134:0/4217057666 shutdown_connections 2024-04-24T02:12:00.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:00.628+0000 7f23b5ccf640 1 --2- 172.21.15.134:0/4217057666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23b0118960 0x7f23b011ad50 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:00.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:00.628+0000 7f23b5ccf640 1 -- 172.21.15.134:0/4217057666 >> 172.21.15.134:0/4217057666 conn(0x7f23b006f2b0 msgr2=0x7f23b00716d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:00.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:00.628+0000 7f23b5ccf640 1 -- 172.21.15.134:0/4217057666 shutdown_connections 2024-04-24T02:12:00.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:00.628+0000 7f23b5ccf640 1 -- 172.21.15.134:0/4217057666 wait complete. 2024-04-24T02:12:00.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:00.629+0000 7f23b5ccf640 1 Processor -- start 2024-04-24T02:12:00.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:00.629+0000 7f23b5ccf640 1 -- start start 2024-04-24T02:12:00.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:00.629+0000 7f23b5ccf640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23b010dfc0 0x7f23b01aa010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:00.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:00.629+0000 7f23b5ccf640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f23b011b7b0 con 0x7f23b010dfc0 2024-04-24T02:12:00.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:00.630+0000 7f23af7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23b010dfc0 0x7f23b01aa010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:00.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:00.630+0000 7f23af7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23b010dfc0 0x7f23b01aa010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:50686/0 (socket says 172.21.15.134:50686) 2024-04-24T02:12:00.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:00.630+0000 7f23af7fe640 1 -- 172.21.15.134:0/260503253 learned_addr learned my addr 172.21.15.134:0/260503253 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:00.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:00.630+0000 7f23af7fe640 1 -- 172.21.15.134:0/260503253 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23b01aa5e0 con 0x7f23b010dfc0 2024-04-24T02:12:00.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:00.630+0000 7f23af7fe640 1 --2- 172.21.15.134:0/260503253 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23b010dfc0 0x7f23b01aa010 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f23a000c3e0 tx=0x7f23a000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:00.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:00.630+0000 7f2397fff640 1 -- 172.21.15.134:0/260503253 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23a0007410 con 0x7f23b010dfc0 2024-04-24T02:12:00.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:00.630+0000 7f2397fff640 1 -- 172.21.15.134:0/260503253 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23a00075d0 con 0x7f23b010dfc0 2024-04-24T02:12:00.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:00.630+0000 7f23b5ccf640 1 -- 172.21.15.134:0/260503253 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23b01aa870 con 0x7f23b010dfc0 2024-04-24T02:12:00.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:00.630+0000 7f2397fff640 1 -- 172.21.15.134:0/260503253 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23a0004950 con 0x7f23b010dfc0 2024-04-24T02:12:00.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:00.630+0000 7f23b5ccf640 1 -- 172.21.15.134:0/260503253 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23b01a42d0 con 0x7f23b010dfc0 2024-04-24T02:12:00.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:00.631+0000 7f2397fff640 1 -- 172.21.15.134:0/260503253 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f23a0011070 con 0x7f23b010dfc0 2024-04-24T02:12:00.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:00.631+0000 7f2397fff640 1 --2- 172.21.15.134:0/260503253 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f239c038010 0x7f239c03a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:00.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:00.631+0000 7f23b5ccf640 1 -- 172.21.15.134:0/260503253 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23b0062da0 con 0x7f23b010dfc0 2024-04-24T02:12:00.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:00.631+0000 7f2397fff640 1 -- 172.21.15.134:0/260503253 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7f23a004aba0 con 0x7f23b010dfc0 2024-04-24T02:12:00.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:00.632+0000 7f23aeffd640 1 --2- 172.21.15.134:0/260503253 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f239c038010 0x7f239c03a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:00.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:00.632+0000 7f23aeffd640 1 --2- 172.21.15.134:0/260503253 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f239c038010 0x7f239c03a4d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f23a4036000 tx=0x7f23a4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:00.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:00.636+0000 7f2397fff640 1 -- 172.21.15.134:0/260503253 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f23a0004b50 con 0x7f23b010dfc0 2024-04-24T02:12:00.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:00.810+0000 7f23b5ccf640 1 -- 172.21.15.134:0/260503253 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7f23b01aaaa0 con 0x7f23b010dfc0 2024-04-24T02:12:01.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.728+0000 7f2397fff640 1 -- 172.21.15.134:0/260503253 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.data' created v18) ==== 167+0+0 (secure 0 0 0) 0x7f23a001cbc0 con 0x7f23b010dfc0 2024-04-24T02:12:01.729 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'default.rgw.buckets.data' created 2024-04-24T02:12:01.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.731+0000 7f23b5ccf640 1 -- 172.21.15.134:0/260503253 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f239c038010 msgr2=0x7f239c03a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:01.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.731+0000 7f23b5ccf640 1 --2- 172.21.15.134:0/260503253 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f239c038010 0x7f239c03a4d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f23a4036000 tx=0x7f23a4008030 comp rx=0 tx=0).stop 2024-04-24T02:12:01.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.731+0000 7f23b5ccf640 1 -- 172.21.15.134:0/260503253 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23b010dfc0 msgr2=0x7f23b01aa010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:01.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.731+0000 7f23b5ccf640 1 --2- 172.21.15.134:0/260503253 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23b010dfc0 0x7f23b01aa010 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f23a000c3e0 tx=0x7f23a000c8a0 comp rx=0 tx=0).stop 2024-04-24T02:12:01.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.732+0000 7f23b5ccf640 1 -- 172.21.15.134:0/260503253 shutdown_connections 2024-04-24T02:12:01.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.732+0000 7f23b5ccf640 1 --2- 172.21.15.134:0/260503253 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f239c038010 0x7f239c03a4d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:01.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.732+0000 7f23b5ccf640 1 --2- 172.21.15.134:0/260503253 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23b010dfc0 0x7f23b01aa010 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:01.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.732+0000 7f23b5ccf640 1 -- 172.21.15.134:0/260503253 >> 172.21.15.134:0/260503253 conn(0x7f23b006f2b0 msgr2=0x7f23b0071400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:01.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.732+0000 7f23b5ccf640 1 -- 172.21.15.134:0/260503253 shutdown_connections 2024-04-24T02:12:01.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.732+0000 7f23b5ccf640 1 -- 172.21.15.134:0/260503253 wait complete. 2024-04-24T02:12:01.749 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-04-24T02:12:01.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.846+0000 7faeb92e6640 1 Processor -- start 2024-04-24T02:12:01.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.846+0000 7faeb92e6640 1 -- start start 2024-04-24T02:12:01.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.847+0000 7faeb92e6640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7faeb4117580 0x7faeb4119970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:01.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.847+0000 7faeb92e6640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faeb4119f70 con 0x7faeb4113880 2024-04-24T02:12:01.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.847+0000 7faeb92e6640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7faeb411b170 con 0x7faeb4117580 2024-04-24T02:12:01.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.847+0000 7faeb27fc640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7faeb4117580 0x7faeb4119970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:01.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.847+0000 7faeb2ffd640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7faeb4113880 0x7faeb4113c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:45310/0 (socket says 172.21.15.134:45310) 2024-04-24T02:12:01.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.847+0000 7faeb2ffd640 1 -- 172.21.15.134:0/2668383398 learned_addr learned my addr 172.21.15.134:0/2668383398 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:12:01.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.847+0000 7faeb27fc640 1 -- 172.21.15.134:0/2668383398 >> v1:172.21.15.104:6789/0 conn(0x7faeb4113880 legacy=0x7faeb4113c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:01.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.847+0000 7faeb27fc640 1 -- 172.21.15.134:0/2668383398 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeb411b320 con 0x7faeb4117580 2024-04-24T02:12:01.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.848+0000 7faeb27fc640 1 --2- 172.21.15.134:0/2668383398 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faeb4117580 0x7faeb4119970 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7faea8009720 tx=0x7faea802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca7755a417550d93 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:01.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.848+0000 7faeb1ffb640 1 -- 172.21.15.134:0/2668383398 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faea80316d0 con 0x7faeb4117580 2024-04-24T02:12:01.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.848+0000 7faeb1ffb640 1 -- 172.21.15.134:0/2668383398 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faea8037070 con 0x7faeb4117580 2024-04-24T02:12:01.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.848+0000 7faeb1ffb640 1 -- 172.21.15.134:0/2668383398 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faea80319c0 con 0x7faeb4117580 2024-04-24T02:12:01.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.849+0000 7faeb92e6640 1 -- 172.21.15.134:0/2668383398 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faeb4117580 msgr2=0x7faeb4119970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:01.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.849+0000 7faeb92e6640 1 --2- 172.21.15.134:0/2668383398 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faeb4117580 0x7faeb4119970 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7faea8009720 tx=0x7faea802b840 comp rx=0 tx=0).stop 2024-04-24T02:12:01.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.849+0000 7faeb92e6640 1 -- 172.21.15.134:0/2668383398 shutdown_connections 2024-04-24T02:12:01.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.849+0000 7faeb92e6640 1 --2- 172.21.15.134:0/2668383398 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faeb4117580 0x7faeb4119970 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:01.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.849+0000 7faeb92e6640 1 -- 172.21.15.134:0/2668383398 >> 172.21.15.134:0/2668383398 conn(0x7faeb406f7a0 msgr2=0x7faeb4071bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:01.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.849+0000 7faeb92e6640 1 -- 172.21.15.134:0/2668383398 shutdown_connections 2024-04-24T02:12:01.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.849+0000 7faeb92e6640 1 -- 172.21.15.134:0/2668383398 wait complete. 2024-04-24T02:12:01.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.849+0000 7faeb92e6640 1 Processor -- start 2024-04-24T02:12:01.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.850+0000 7faeb92e6640 1 -- start start 2024-04-24T02:12:01.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.850+0000 7faeb92e6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faeb4113880 0x7faeb41a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:01.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.850+0000 7faeb92e6640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7faeb411a620 con 0x7faeb4113880 2024-04-24T02:12:01.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.850+0000 7faeb2ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faeb4113880 0x7faeb41a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:01.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.850+0000 7faeb2ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faeb4113880 0x7faeb41a5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:50712/0 (socket says 172.21.15.134:50712) 2024-04-24T02:12:01.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.850+0000 7faeb2ffd640 1 -- 172.21.15.134:0/1973218831 learned_addr learned my addr 172.21.15.134:0/1973218831 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:01.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.850+0000 7faeb2ffd640 1 -- 172.21.15.134:0/1973218831 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeb41a5750 con 0x7faeb4113880 2024-04-24T02:12:01.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.850+0000 7faeb2ffd640 1 --2- 172.21.15.134:0/1973218831 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faeb4113880 0x7faeb41a5210 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7faea400c340 tx=0x7faea4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:01.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.850+0000 7fae9b7fe640 1 -- 172.21.15.134:0/1973218831 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faea4005c10 con 0x7faeb4113880 2024-04-24T02:12:01.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.851+0000 7fae9b7fe640 1 -- 172.21.15.134:0/1973218831 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faea4005db0 con 0x7faeb4113880 2024-04-24T02:12:01.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.851+0000 7fae9b7fe640 1 -- 172.21.15.134:0/1973218831 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faea4004930 con 0x7faeb4113880 2024-04-24T02:12:01.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.851+0000 7faeb92e6640 1 -- 172.21.15.134:0/1973218831 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faeb41a5980 con 0x7faeb4113880 2024-04-24T02:12:01.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.851+0000 7faeb92e6640 1 -- 172.21.15.134:0/1973218831 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faeb41a5ed0 con 0x7faeb4113880 2024-04-24T02:12:01.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.852+0000 7faeb92e6640 1 -- 172.21.15.134:0/1973218831 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faeb4062da0 con 0x7faeb4113880 2024-04-24T02:12:01.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.852+0000 7fae9b7fe640 1 -- 172.21.15.134:0/1973218831 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7faea401a020 con 0x7faeb4113880 2024-04-24T02:12:01.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.852+0000 7fae9b7fe640 1 --2- 172.21.15.134:0/1973218831 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7faea0038010 0x7faea003a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:01.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.852+0000 7fae9b7fe640 1 -- 172.21.15.134:0/1973218831 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3845+0+0 (secure 0 0 0) 0x7faea404a8b0 con 0x7faeb4113880 2024-04-24T02:12:01.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.852+0000 7faeb27fc640 1 --2- 172.21.15.134:0/1973218831 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7faea0038010 0x7faea003a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:01.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.852+0000 7faeb27fc640 1 --2- 172.21.15.134:0/1973218831 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7faea0038010 0x7faea003a4d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7faea8036000 tx=0x7faea8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:01.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:01.857+0000 7fae9b7fe640 1 -- 172.21.15.134:0/1973218831 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7faea40127f0 con 0x7faeb4113880 2024-04-24T02:12:02.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.032+0000 7faeb92e6640 1 -- 172.21.15.134:0/1973218831 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) -- 0x7faeb4117580 con 0x7faeb4113880 2024-04-24T02:12:02.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.731+0000 7fae9b7fe640 1 -- 172.21.15.134:0/1973218831 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v19) ==== 185+0+0 (secure 0 0 0) 0x7faea4012a50 con 0x7faeb4113880 2024-04-24T02:12:02.733 INFO:teuthology.orchestra.run.smithi134.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-04-24T02:12:02.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.734+0000 7faeb92e6640 1 -- 172.21.15.134:0/1973218831 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7faea0038010 msgr2=0x7faea003a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:02.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.734+0000 7faeb92e6640 1 --2- 172.21.15.134:0/1973218831 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7faea0038010 0x7faea003a4d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7faea8036000 tx=0x7faea8008030 comp rx=0 tx=0).stop 2024-04-24T02:12:02.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.734+0000 7faeb92e6640 1 -- 172.21.15.134:0/1973218831 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faeb4113880 msgr2=0x7faeb41a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:02.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.734+0000 7faeb92e6640 1 --2- 172.21.15.134:0/1973218831 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faeb4113880 0x7faeb41a5210 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7faea400c340 tx=0x7faea4001e70 comp rx=0 tx=0).stop 2024-04-24T02:12:02.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.734+0000 7faeb92e6640 1 -- 172.21.15.134:0/1973218831 shutdown_connections 2024-04-24T02:12:02.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.735+0000 7faeb92e6640 1 --2- 172.21.15.134:0/1973218831 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7faea0038010 0x7faea003a4d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:02.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.735+0000 7faeb92e6640 1 --2- 172.21.15.134:0/1973218831 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faeb4113880 0x7faeb41a5210 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:02.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.735+0000 7faeb92e6640 1 -- 172.21.15.134:0/1973218831 >> 172.21.15.134:0/1973218831 conn(0x7faeb406f7a0 msgr2=0x7faeb4118150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:02.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.735+0000 7faeb92e6640 1 -- 172.21.15.134:0/1973218831 shutdown_connections 2024-04-24T02:12:02.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.735+0000 7faeb92e6640 1 -- 172.21.15.134:0/1973218831 wait complete. 2024-04-24T02:12:02.758 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-04-24T02:12:02.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.855+0000 7f592ffdb640 1 Processor -- start 2024-04-24T02:12:02.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.855+0000 7f592ffdb640 1 -- start start 2024-04-24T02:12:02.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.855+0000 7f592ffdb640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f592810dfc0 0x7f592810e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:02.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.855+0000 7f592ffdb640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f592811b110 con 0x7f592810e8e0 2024-04-24T02:12:02.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.855+0000 7f592ffdb640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f592811c2f0 con 0x7f592810dfc0 2024-04-24T02:12:02.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.856+0000 7f592dd77640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f592810dfc0 0x7f592810e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:02.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.856+0000 7f592d576640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f592810e8e0 0x7f5928119960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:45316/0 (socket says 172.21.15.134:45316) 2024-04-24T02:12:02.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.856+0000 7f592d576640 1 -- 172.21.15.134:0/2339630812 learned_addr learned my addr 172.21.15.134:0/2339630812 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:12:02.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.856+0000 7f592dd77640 1 -- 172.21.15.134:0/2339630812 >> v1:172.21.15.104:6789/0 conn(0x7f592810e8e0 legacy=0x7f5928119960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:02.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.856+0000 7f592dd77640 1 -- 172.21.15.134:0/2339630812 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f592811c470 con 0x7f592810dfc0 2024-04-24T02:12:02.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.857+0000 7f592dd77640 1 --2- 172.21.15.134:0/2339630812 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f592810dfc0 0x7f592810e3a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5924009720 tx=0x7f592402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf4d1299bcceffef server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:02.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.857+0000 7f592cd75640 1 -- 172.21.15.134:0/2339630812 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59240316d0 con 0x7f592810dfc0 2024-04-24T02:12:02.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.857+0000 7f592cd75640 1 -- 172.21.15.134:0/2339630812 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5924037070 con 0x7f592810dfc0 2024-04-24T02:12:02.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.857+0000 7f592cd75640 1 -- 172.21.15.134:0/2339630812 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59240319c0 con 0x7f592810dfc0 2024-04-24T02:12:02.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.857+0000 7f592ffdb640 1 -- 172.21.15.134:0/2339630812 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f592810dfc0 msgr2=0x7f592810e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:02.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.857+0000 7f592ffdb640 1 --2- 172.21.15.134:0/2339630812 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f592810dfc0 0x7f592810e3a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5924009720 tx=0x7f592402b840 comp rx=0 tx=0).stop 2024-04-24T02:12:02.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.857+0000 7f592ffdb640 1 -- 172.21.15.134:0/2339630812 shutdown_connections 2024-04-24T02:12:02.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.857+0000 7f592ffdb640 1 --2- 172.21.15.134:0/2339630812 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f592810dfc0 0x7f592810e3a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:02.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.857+0000 7f592ffdb640 1 -- 172.21.15.134:0/2339630812 >> 172.21.15.134:0/2339630812 conn(0x7f592806f2b0 msgr2=0x7f59280716d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:02.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.858+0000 7f592ffdb640 1 -- 172.21.15.134:0/2339630812 shutdown_connections 2024-04-24T02:12:02.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.858+0000 7f592ffdb640 1 -- 172.21.15.134:0/2339630812 wait complete. 2024-04-24T02:12:02.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.858+0000 7f592ffdb640 1 Processor -- start 2024-04-24T02:12:02.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.858+0000 7f592ffdb640 1 -- start start 2024-04-24T02:12:02.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.858+0000 7f592ffdb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f592810dfc0 0x7f592810f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:02.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.858+0000 7f592ffdb640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f592811b800 con 0x7f592810dfc0 2024-04-24T02:12:02.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.859+0000 7f592dd77640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f592810dfc0 0x7f592810f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:02.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.859+0000 7f592dd77640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f592810dfc0 0x7f592810f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:50734/0 (socket says 172.21.15.134:50734) 2024-04-24T02:12:02.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.859+0000 7f592dd77640 1 -- 172.21.15.134:0/2067240765 learned_addr learned my addr 172.21.15.134:0/2067240765 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:02.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.859+0000 7f592dd77640 1 -- 172.21.15.134:0/2067240765 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f592810fd00 con 0x7f592810dfc0 2024-04-24T02:12:02.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.859+0000 7f592dd77640 1 --2- 172.21.15.134:0/2067240765 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f592810dfc0 0x7f592810f7c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f592402b880 tx=0x7f59240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:02.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.859+0000 7f591e7fc640 1 -- 172.21.15.134:0/2067240765 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5924032770 con 0x7f592810dfc0 2024-04-24T02:12:02.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.859+0000 7f592ffdb640 1 -- 172.21.15.134:0/2067240765 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f592810ff30 con 0x7f592810dfc0 2024-04-24T02:12:02.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.859+0000 7f591e7fc640 1 -- 172.21.15.134:0/2067240765 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5924032910 con 0x7f592810dfc0 2024-04-24T02:12:02.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.859+0000 7f592ffdb640 1 -- 172.21.15.134:0/2067240765 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5928110420 con 0x7f592810dfc0 2024-04-24T02:12:02.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.859+0000 7f591e7fc640 1 -- 172.21.15.134:0/2067240765 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5924032ac0 con 0x7f592810dfc0 2024-04-24T02:12:02.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.860+0000 7f592ffdb640 1 -- 172.21.15.134:0/2067240765 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5928062da0 con 0x7f592810dfc0 2024-04-24T02:12:02.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.860+0000 7f591e7fc640 1 -- 172.21.15.134:0/2067240765 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f592404c060 con 0x7f592810dfc0 2024-04-24T02:12:02.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.860+0000 7f591e7fc640 1 --2- 172.21.15.134:0/2067240765 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f590c038010 0x7f590c03a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:02.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.860+0000 7f591e7fc640 1 -- 172.21.15.134:0/2067240765 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3856+0+0 (secure 0 0 0) 0x7f592402f050 con 0x7f592810dfc0 2024-04-24T02:12:02.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.860+0000 7f592d576640 1 --2- 172.21.15.134:0/2067240765 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f590c038010 0x7f590c03a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:02.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.861+0000 7f592d576640 1 --2- 172.21.15.134:0/2067240765 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f590c038010 0x7f590c03a4d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f592810ed30 tx=0x7f5918007a80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:02.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:02.865+0000 7f591e7fc640 1 -- 172.21.15.134:0/2067240765 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f5924040070 con 0x7f592810dfc0 2024-04-24T02:12:03.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.041+0000 7f592ffdb640 1 -- 172.21.15.134:0/2067240765 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7f592810e8e0 con 0x7f592810dfc0 2024-04-24T02:12:03.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.733+0000 7f591e7fc640 1 -- 172.21.15.134:0/2067240765 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v20) ==== 169+0+0 (secure 0 0 0) 0x7f592403b7f0 con 0x7f592810dfc0 2024-04-24T02:12:03.734 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'default.rgw.buckets.index' created 2024-04-24T02:12:03.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.737+0000 7f592ffdb640 1 -- 172.21.15.134:0/2067240765 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f590c038010 msgr2=0x7f590c03a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:03.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.737+0000 7f592ffdb640 1 --2- 172.21.15.134:0/2067240765 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f590c038010 0x7f590c03a4d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f592810ed30 tx=0x7f5918007a80 comp rx=0 tx=0).stop 2024-04-24T02:12:03.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.737+0000 7f592ffdb640 1 -- 172.21.15.134:0/2067240765 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f592810dfc0 msgr2=0x7f592810f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:03.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.737+0000 7f592ffdb640 1 --2- 172.21.15.134:0/2067240765 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f592810dfc0 0x7f592810f7c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f592402b880 tx=0x7f59240046c0 comp rx=0 tx=0).stop 2024-04-24T02:12:03.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.738+0000 7f592ffdb640 1 -- 172.21.15.134:0/2067240765 shutdown_connections 2024-04-24T02:12:03.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.738+0000 7f592ffdb640 1 --2- 172.21.15.134:0/2067240765 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f590c038010 0x7f590c03a4d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:03.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.738+0000 7f592ffdb640 1 --2- 172.21.15.134:0/2067240765 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f592810dfc0 0x7f592810f7c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:03.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.738+0000 7f592ffdb640 1 -- 172.21.15.134:0/2067240765 >> 172.21.15.134:0/2067240765 conn(0x7f592806f2b0 msgr2=0x7f592811a940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:03.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.738+0000 7f592ffdb640 1 -- 172.21.15.134:0/2067240765 shutdown_connections 2024-04-24T02:12:03.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.738+0000 7f592ffdb640 1 -- 172.21.15.134:0/2067240765 wait complete. 2024-04-24T02:12:03.760 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-04-24T02:12:03.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.860+0000 7fa0fd19d640 1 Processor -- start 2024-04-24T02:12:03.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.860+0000 7fa0fd19d640 1 -- start start 2024-04-24T02:12:03.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.860+0000 7fa0fd19d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa0f810dd50 0x7fa0f810e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:03.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.860+0000 7fa0fd19d640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0f811b080 con 0x7fa0f810e670 2024-04-24T02:12:03.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.860+0000 7fa0fd19d640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fa0f810ebd0 con 0x7fa0f810dd50 2024-04-24T02:12:03.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.860+0000 7fa0f7fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa0f810dd50 0x7fa0f810e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:03.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.860+0000 7fa0f7fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa0f810dd50 0x7fa0f810e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:50738/0 (socket says 172.21.15.134:50738) 2024-04-24T02:12:03.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.860+0000 7fa0f7fff640 1 -- 172.21.15.134:0/4276828706 learned_addr learned my addr 172.21.15.134:0/4276828706 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:03.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.860+0000 7fa0f77fe640 1 --1- 172.21.15.134:0/4276828706 >> v1:172.21.15.104:6789/0 conn(0x7fa0f810e670 0x7fa0f8119960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:45328/0 (socket says 172.21.15.134:45328) 2024-04-24T02:12:03.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.861+0000 7fa0f7fff640 1 -- 172.21.15.134:0/4276828706 >> v1:172.21.15.104:6789/0 conn(0x7fa0f810e670 legacy=0x7fa0f8119960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:03.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.861+0000 7fa0f7fff640 1 -- 172.21.15.134:0/4276828706 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0f811c290 con 0x7fa0f810dd50 2024-04-24T02:12:03.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.861+0000 7fa0f7fff640 1 --2- 172.21.15.134:0/4276828706 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0f810dd50 0x7fa0f810e130 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa0e80097f0 tx=0x7fa0e802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=105fd86bc77425ab server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:03.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.862+0000 7fa0f6ffd640 1 -- 172.21.15.134:0/4276828706 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0e8035020 con 0x7fa0f810dd50 2024-04-24T02:12:03.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.862+0000 7fa0f6ffd640 1 -- 172.21.15.134:0/4276828706 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0e80317a0 con 0x7fa0f810dd50 2024-04-24T02:12:03.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.862+0000 7fa0f6ffd640 1 -- 172.21.15.134:0/4276828706 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0e8031aa0 con 0x7fa0f810dd50 2024-04-24T02:12:03.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.862+0000 7fa0fd19d640 1 -- 172.21.15.134:0/4276828706 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0f810dd50 msgr2=0x7fa0f810e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:03.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.862+0000 7fa0fd19d640 1 --2- 172.21.15.134:0/4276828706 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0f810dd50 0x7fa0f810e130 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa0e80097f0 tx=0x7fa0e802b910 comp rx=0 tx=0).stop 2024-04-24T02:12:03.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.862+0000 7fa0fd19d640 1 -- 172.21.15.134:0/4276828706 shutdown_connections 2024-04-24T02:12:03.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.862+0000 7fa0fd19d640 1 --2- 172.21.15.134:0/4276828706 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0f810dd50 0x7fa0f810e130 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:03.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.862+0000 7fa0fd19d640 1 -- 172.21.15.134:0/4276828706 >> 172.21.15.134:0/4276828706 conn(0x7fa0f806f400 msgr2=0x7fa0f8071820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:03.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.862+0000 7fa0fd19d640 1 -- 172.21.15.134:0/4276828706 shutdown_connections 2024-04-24T02:12:03.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.862+0000 7fa0fd19d640 1 -- 172.21.15.134:0/4276828706 wait complete. 2024-04-24T02:12:03.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.863+0000 7fa0fd19d640 1 Processor -- start 2024-04-24T02:12:03.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.863+0000 7fa0fd19d640 1 -- start start 2024-04-24T02:12:03.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.863+0000 7fa0fd19d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0f810dd50 0x7fa0f81aa060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:03.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.863+0000 7fa0fd19d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa0f811b770 con 0x7fa0f810dd50 2024-04-24T02:12:03.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.863+0000 7fa0f7fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0f810dd50 0x7fa0f81aa060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:03.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.863+0000 7fa0f7fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0f810dd50 0x7fa0f81aa060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:50744/0 (socket says 172.21.15.134:50744) 2024-04-24T02:12:03.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.863+0000 7fa0f7fff640 1 -- 172.21.15.134:0/1828178207 learned_addr learned my addr 172.21.15.134:0/1828178207 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:03.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.864+0000 7fa0f7fff640 1 -- 172.21.15.134:0/1828178207 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0f81aa630 con 0x7fa0f810dd50 2024-04-24T02:12:03.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.864+0000 7fa0f7fff640 1 --2- 172.21.15.134:0/1828178207 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0f810dd50 0x7fa0f81aa060 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa0e80090b0 tx=0x7fa0e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:03.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.864+0000 7fa0f4ff9640 1 -- 172.21.15.134:0/1828178207 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0e8049070 con 0x7fa0f810dd50 2024-04-24T02:12:03.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.864+0000 7fa0f4ff9640 1 -- 172.21.15.134:0/1828178207 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0e8031a80 con 0x7fa0f810dd50 2024-04-24T02:12:03.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.864+0000 7fa0fd19d640 1 -- 172.21.15.134:0/1828178207 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0f81aa860 con 0x7fa0f810dd50 2024-04-24T02:12:03.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.864+0000 7fa0f4ff9640 1 -- 172.21.15.134:0/1828178207 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0e8044550 con 0x7fa0f810dd50 2024-04-24T02:12:03.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.864+0000 7fa0fd19d640 1 -- 172.21.15.134:0/1828178207 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0f81a40f0 con 0x7fa0f810dd50 2024-04-24T02:12:03.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.865+0000 7fa0fd19d640 1 -- 172.21.15.134:0/1828178207 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0f8062da0 con 0x7fa0f810dd50 2024-04-24T02:12:03.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.865+0000 7fa0f4ff9640 1 -- 172.21.15.134:0/1828178207 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa0e804c070 con 0x7fa0f810dd50 2024-04-24T02:12:03.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.865+0000 7fa0f4ff9640 1 --2- 172.21.15.134:0/1828178207 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa0e4038010 0x7fa0e403a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:03.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.865+0000 7fa0f4ff9640 1 -- 172.21.15.134:0/1828178207 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4220+0+0 (secure 0 0 0) 0x7fa0e806d760 con 0x7fa0f810dd50 2024-04-24T02:12:03.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.865+0000 7fa0f77fe640 1 --2- 172.21.15.134:0/1828178207 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa0e4038010 0x7fa0e403a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:03.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.866+0000 7fa0f77fe640 1 --2- 172.21.15.134:0/1828178207 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa0e4038010 0x7fa0e403a4d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec000f60 tx=0x7fa0ec007a80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:03.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:03.871+0000 7fa0f4ff9640 1 -- 172.21.15.134:0/1828178207 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7fa0e803f070 con 0x7fa0f810dd50 2024-04-24T02:12:04.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:04.044+0000 7fa0fd19d640 1 -- 172.21.15.134:0/1828178207 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) -- 0x7fa0f810e670 con 0x7fa0f810dd50 2024-04-24T02:12:04.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:04.738+0000 7fa0f4ff9640 1 -- 172.21.15.134:0/1828178207 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v21) ==== 187+0+0 (secure 0 0 0) 0x7fa0e8031710 con 0x7fa0f810dd50 2024-04-24T02:12:04.740 INFO:teuthology.orchestra.run.smithi134.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-04-24T02:12:04.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:04.742+0000 7fa0fd19d640 1 -- 172.21.15.134:0/1828178207 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa0e4038010 msgr2=0x7fa0e403a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:04.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:04.742+0000 7fa0fd19d640 1 --2- 172.21.15.134:0/1828178207 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa0e4038010 0x7fa0e403a4d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec000f60 tx=0x7fa0ec007a80 comp rx=0 tx=0).stop 2024-04-24T02:12:04.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:04.742+0000 7fa0fd19d640 1 -- 172.21.15.134:0/1828178207 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0f810dd50 msgr2=0x7fa0f81aa060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:04.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:04.742+0000 7fa0fd19d640 1 --2- 172.21.15.134:0/1828178207 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0f810dd50 0x7fa0f81aa060 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa0e80090b0 tx=0x7fa0e80046c0 comp rx=0 tx=0).stop 2024-04-24T02:12:04.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:04.742+0000 7fa0fd19d640 1 -- 172.21.15.134:0/1828178207 shutdown_connections 2024-04-24T02:12:04.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:04.742+0000 7fa0fd19d640 1 --2- 172.21.15.134:0/1828178207 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa0e4038010 0x7fa0e403a4d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:04.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:04.742+0000 7fa0fd19d640 1 --2- 172.21.15.134:0/1828178207 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0f810dd50 0x7fa0f81aa060 secure :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa0e80090b0 tx=0x7fa0e80046c0 comp rx=0 tx=0).stop 2024-04-24T02:12:04.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:04.742+0000 7fa0fd19d640 1 -- 172.21.15.134:0/1828178207 >> 172.21.15.134:0/1828178207 conn(0x7fa0f806f400 msgr2=0x7fa0f811a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:04.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:04.745+0000 7fa0fd19d640 1 -- 172.21.15.134:0/1828178207 shutdown_connections 2024-04-24T02:12:04.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:04.747+0000 7fa0fd19d640 1 -- 172.21.15.134:0/1828178207 wait complete. 2024-04-24T02:12:04.770 DEBUG:tasks.rgw:Pools created 2024-04-24T02:12:04.771 INFO:tasks.rgw:Starting rgw... 2024-04-24T02:12:04.771 INFO:tasks.rgw:rgw client.0 config is {} 2024-04-24T02:12:04.771 INFO:tasks.rgw:Using beast as radosgw frontend 2024-04-24T02:12:04.771 DEBUG:teuthology.orchestra.run.smithi134:> sudo echo -n http://smithi134.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-04-24T02:12:04.796 INFO:teuthology.orchestra.run.smithi134.stdout:http://smithi134.front.sepia.ceph.com:80 2024-04-24T02:12:04.796 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-04-24T02:12:04.859 INFO:tasks.rgw.client.0:Restarting daemon 2024-04-24T02:12:04.859 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-04-24T02:12:04.901 INFO:tasks.rgw.client.0:Started 2024-04-24T02:12:04.901 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi134.front.sepia.ceph.com:80/ 2024-04-24T02:12:04.901 DEBUG:teuthology.orchestra.run.smithi134:> curl http://smithi134.front.sepia.ceph.com:80/ 2024-04-24T02:12:04.929 INFO:teuthology.orchestra.run.smithi134.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-24T02:12:04.930 INFO:teuthology.orchestra.run.smithi134.stderr: Dload Upload Total Spent Left Speed 2024-04-24T02:12:04.931 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-24T02:12:04.932 INFO:teuthology.orchestra.run.smithi134.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-24T02:12:04.932 INFO:teuthology.orchestra.run.smithi134.stderr:curl: (7) Failed to connect to smithi134.front.sepia.ceph.com port 80: Connection refused 2024-04-24T02:12:05.932 DEBUG:teuthology.orchestra.run.smithi134:> curl http://smithi134.front.sepia.ceph.com:80/ 2024-04-24T02:12:05.955 INFO:teuthology.orchestra.run.smithi134.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-24T02:12:05.955 INFO:teuthology.orchestra.run.smithi134.stderr: Dload Upload Total Spent Left Speed 2024-04-24T02:12:05.956 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-24T02:12:05.956 INFO:teuthology.orchestra.run.smithi134.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-24T02:12:05.957 INFO:teuthology.orchestra.run.smithi134.stderr:curl: (7) Failed to connect to smithi134.front.sepia.ceph.com port 80: Connection refused 2024-04-24T02:12:07.957 DEBUG:teuthology.orchestra.run.smithi134:> curl http://smithi134.front.sepia.ceph.com:80/ 2024-04-24T02:12:07.979 INFO:teuthology.orchestra.run.smithi134.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-24T02:12:07.979 INFO:teuthology.orchestra.run.smithi134.stderr: Dload Upload Total Spent Left Speed 2024-04-24T02:12:07.981 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-24T02:12:07.981 INFO:teuthology.orchestra.run.smithi134.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-24T02:12:07.981 INFO:teuthology.orchestra.run.smithi134.stderr:curl: (7) Failed to connect to smithi134.front.sepia.ceph.com port 80: Connection refused 2024-04-24T02:12:11.982 DEBUG:teuthology.orchestra.run.smithi134:> curl http://smithi134.front.sepia.ceph.com:80/ 2024-04-24T02:12:12.005 INFO:teuthology.orchestra.run.smithi134.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-24T02:12:12.005 INFO:teuthology.orchestra.run.smithi134.stderr: Dload Upload Total Spent Left Speed 2024-04-24T02:12:12.006 INFO:teuthology.orchestra.run.smithi134.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-24T02:12:12.007 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-24T02:12:12.007 INFO:teuthology.orchestra.run.smithi134.stderr:curl: (7) Failed to connect to smithi134.front.sepia.ceph.com port 80: Connection refused 2024-04-24T02:12:13.846 INFO:tasks.rgw.client.0.smithi134.stdout:2024-04-24T02:12:13.844+0000 7f7518122880 -1 LDAP not started since no server URIs were provided in the configuration. 2024-04-24T02:12:20.008 DEBUG:teuthology.orchestra.run.smithi134:> curl http://smithi134.front.sepia.ceph.com:80/ 2024-04-24T02:12:20.032 INFO:teuthology.orchestra.run.smithi134.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-24T02:12:20.032 INFO:teuthology.orchestra.run.smithi134.stderr: Dload Upload Total Spent Left Speed 2024-04-24T02:12:20.034 INFO:teuthology.orchestra.run.smithi134.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 93500 0 --:--:-- --:--:-- --:--:-- 93500 2024-04-24T02:12:20.034 INFO:teuthology.orchestra.run.smithi134.stdout:anonymous 2024-04-24T02:12:20.036 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-04-24T02:12:20.115 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-04-24T02:12:20.115 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-04-24T02:12:20.116 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-04-24T02:12:20.116 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-04-24T02:12:20.163 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:20.163 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:20.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.162+0000 7f67da5a2800 1 Processor -- start 2024-04-24T02:12:20.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.162+0000 7f67da5a2800 1 -- start start 2024-04-24T02:12:20.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.162+0000 7f67da5a2800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55c2bd7ac290 0x55c2bd7b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.162+0000 7f67da5a2800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c2bd66ad40 con 0x55c2bd7aa750 2024-04-24T02:12:20.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.162+0000 7f67da5a2800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55c2bd63d4d0 con 0x55c2bd7ac290 2024-04-24T02:12:20.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.163+0000 7f67cffff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55c2bd7ac290 0x55c2bd7b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.163+0000 7f67d80a1640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55c2bd7aa750 0x55c2bd7aab70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:43108/0 (socket says 172.21.15.134:43108) 2024-04-24T02:12:20.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.163+0000 7f67cffff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55c2bd7ac290 0x55c2bd7b4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45086/0 (socket says 172.21.15.134:45086) 2024-04-24T02:12:20.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.163+0000 7f67d80a1640 1 -- 172.21.15.134:0/1898703315 learned_addr learned my addr 172.21.15.134:0/1898703315 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:12:20.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.163+0000 7f67cffff640 1 -- 172.21.15.134:0/1898703315 >> v1:172.21.15.104:6789/0 conn(0x55c2bd7aa750 legacy=0x55c2bd7aab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.163+0000 7f67cffff640 1 -- 172.21.15.134:0/1898703315 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2bd669590 con 0x55c2bd7ac290 2024-04-24T02:12:20.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.165+0000 7f67cffff640 1 --2- 172.21.15.134:0/1898703315 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2bd7ac290 0x55c2bd7b4d90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f67c000a470 tx=0x7f67c001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5601ec31586cf9a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.165+0000 7f67d78a0640 1 -- 172.21.15.134:0/1898703315 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67c0057070 con 0x55c2bd7ac290 2024-04-24T02:12:20.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.165+0000 7f67d78a0640 1 -- 172.21.15.134:0/1898703315 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67c0052440 con 0x55c2bd7ac290 2024-04-24T02:12:20.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.165+0000 7f67d78a0640 1 -- 172.21.15.134:0/1898703315 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67c0052740 con 0x55c2bd7ac290 2024-04-24T02:12:20.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.166+0000 7f67da5a2800 1 -- 172.21.15.134:0/1898703315 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2bd7ac290 msgr2=0x55c2bd7b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.166+0000 7f67da5a2800 1 --2- 172.21.15.134:0/1898703315 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2bd7ac290 0x55c2bd7b4d90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f67c000a470 tx=0x7f67c001ce90 comp rx=0 tx=0).stop 2024-04-24T02:12:20.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.166+0000 7f67da5a2800 1 -- 172.21.15.134:0/1898703315 shutdown_connections 2024-04-24T02:12:20.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.166+0000 7f67da5a2800 1 --2- 172.21.15.134:0/1898703315 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2bd7ac290 0x55c2bd7b4d90 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.166+0000 7f67da5a2800 1 -- 172.21.15.134:0/1898703315 >> 172.21.15.134:0/1898703315 conn(0x55c2bd7a6370 msgr2=0x55c2bd7a8790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:20.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.166+0000 7f67da5a2800 1 -- 172.21.15.134:0/1898703315 shutdown_connections 2024-04-24T02:12:20.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.166+0000 7f67da5a2800 1 -- 172.21.15.134:0/1898703315 wait complete. 2024-04-24T02:12:20.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.179+0000 7f67da5a2800 1 Processor -- start 2024-04-24T02:12:20.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.179+0000 7f67da5a2800 1 -- start start 2024-04-24T02:12:20.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.179+0000 7f67da5a2800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2bd7aa750 0x55c2bd89f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.179+0000 7f67da5a2800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c2bd6f73b0 con 0x55c2bd7aa750 2024-04-24T02:12:20.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.180+0000 7f67d80a1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2bd7aa750 0x55c2bd89f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.180+0000 7f67d80a1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2bd7aa750 0x55c2bd89f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45088/0 (socket says 172.21.15.134:45088) 2024-04-24T02:12:20.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.180+0000 7f67d80a1640 1 -- 172.21.15.134:0/2875773516 learned_addr learned my addr 172.21.15.134:0/2875773516 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:20.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.180+0000 7f67d80a1640 1 -- 172.21.15.134:0/2875773516 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2bd89faa0 con 0x55c2bd7aa750 2024-04-24T02:12:20.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.180+0000 7f67d80a1640 1 --2- 172.21.15.134:0/2875773516 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2bd7aa750 0x55c2bd89f4d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f67c8001de0 tx=0x7f67c800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e1e251621b2a325 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.180+0000 7f66c660c640 1 -- 172.21.15.134:0/2875773516 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67c8012020 con 0x55c2bd7aa750 2024-04-24T02:12:20.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.180+0000 7f66c660c640 1 -- 172.21.15.134:0/2875773516 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67c800e5a0 con 0x55c2bd7aa750 2024-04-24T02:12:20.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.180+0000 7f66c660c640 1 -- 172.21.15.134:0/2875773516 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67c800e8c0 con 0x55c2bd7aa750 2024-04-24T02:12:20.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.181+0000 7f67da5a2800 1 -- 172.21.15.134:0/2875773516 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2bd7aa750 msgr2=0x55c2bd89f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.181+0000 7f67da5a2800 1 --2- 172.21.15.134:0/2875773516 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2bd7aa750 0x55c2bd89f4d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f67c8001de0 tx=0x7f67c800b6c0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.181+0000 7f67da5a2800 1 -- 172.21.15.134:0/2875773516 shutdown_connections 2024-04-24T02:12:20.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.181+0000 7f67da5a2800 1 --2- 172.21.15.134:0/2875773516 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2bd7aa750 0x55c2bd89f4d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.181+0000 7f67da5a2800 1 -- 172.21.15.134:0/2875773516 >> 172.21.15.134:0/2875773516 conn(0x55c2bd7a6370 msgr2=0x55c2bd89adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:20.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.181+0000 7f67da5a2800 1 -- 172.21.15.134:0/2875773516 shutdown_connections 2024-04-24T02:12:20.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.181+0000 7f67da5a2800 1 -- 172.21.15.134:0/2875773516 wait complete. 2024-04-24T02:12:20.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.181+0000 7f67da5a2800 1 Processor -- start 2024-04-24T02:12:20.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.182+0000 7f67da5a2800 1 -- start start 2024-04-24T02:12:20.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.182+0000 7f67da5a2800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2bd7aa750 0x55c2bd8a7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.182+0000 7f67da5a2800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c2bd7b75b0 con 0x55c2bd7aa750 2024-04-24T02:12:20.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.182+0000 7f67d80a1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2bd7aa750 0x55c2bd8a7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.182+0000 7f67d80a1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2bd7aa750 0x55c2bd8a7000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45098/0 (socket says 172.21.15.134:45098) 2024-04-24T02:12:20.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.182+0000 7f67d80a1640 1 -- 172.21.15.134:0/3973505274 learned_addr learned my addr 172.21.15.134:0/3973505274 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:20.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.182+0000 7f67d80a1640 1 -- 172.21.15.134:0/3973505274 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2bd8a7540 con 0x55c2bd7aa750 2024-04-24T02:12:20.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.182+0000 7f67d80a1640 1 --2- 172.21.15.134:0/3973505274 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2bd7aa750 0x55c2bd8a7000 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f67c8001de0 tx=0x7f67c8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.183+0000 7f66c4e09640 1 -- 172.21.15.134:0/3973505274 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67c8012030 con 0x55c2bd7aa750 2024-04-24T02:12:20.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.183+0000 7f66c4e09640 1 -- 172.21.15.134:0/3973505274 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67c801a7a0 con 0x55c2bd7aa750 2024-04-24T02:12:20.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.183+0000 7f67da5a2800 1 -- 172.21.15.134:0/3973505274 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c2bd8a77d0 con 0x55c2bd7aa750 2024-04-24T02:12:20.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.183+0000 7f66c4e09640 1 -- 172.21.15.134:0/3973505274 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67c801aac0 con 0x55c2bd7aa750 2024-04-24T02:12:20.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.183+0000 7f67da5a2800 1 -- 172.21.15.134:0/3973505274 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2bd8aa480 con 0x55c2bd7aa750 2024-04-24T02:12:20.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.183+0000 7f66c4e09640 1 -- 172.21.15.134:0/3973505274 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f67c8015020 con 0x55c2bd7aa750 2024-04-24T02:12:20.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.184+0000 7f66c4e09640 1 --2- 172.21.15.134:0/3973505274 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f66c0036900 0x7f66c0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.184+0000 7f66c4e09640 1 -- 172.21.15.134:0/3973505274 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f67c8020070 con 0x55c2bd7aa750 2024-04-24T02:12:20.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.184+0000 7f67cffff640 1 --2- 172.21.15.134:0/3973505274 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f66c0036900 0x7f66c0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.184+0000 7f67da5a2800 1 --2- 172.21.15.134:0/3973505274 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c2bd7ac290 0x55c2bd8ae240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.184+0000 7f67da5a2800 1 -- 172.21.15.134:0/3973505274 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8ae780 con 0x55c2bd7ac290 2024-04-24T02:12:20.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.184+0000 7f67d88a2640 1 --2- 172.21.15.134:0/3973505274 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c2bd7ac290 0x55c2bd8ae240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.184+0000 7f67cffff640 1 --2- 172.21.15.134:0/3973505274 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f66c0036900 0x7f66c0038dc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f67c0054000 tx=0x7f67c004e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.184+0000 7f67d88a2640 1 --2- 172.21.15.134:0/3973505274 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c2bd7ac290 0x55c2bd8ae240 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.185+0000 7f67d88a2640 1 -- 172.21.15.134:0/3973505274 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f67d000a4a0 con 0x55c2bd7ac290 2024-04-24T02:12:20.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.185+0000 7f67da5a2800 1 -- 172.21.15.134:0/3973505274 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8ab7f0 con 0x55c2bd7ac290 2024-04-24T02:12:20.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.185+0000 7f67d88a2640 1 -- 172.21.15.134:0/3973505274 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f67d000a4a0 con 0x55c2bd7ac290 2024-04-24T02:12:20.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.185+0000 7f67da5a2800 1 -- 172.21.15.134:0/3973505274 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8b05a0 con 0x55c2bd7ac290 2024-04-24T02:12:20.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.185+0000 7f67d88a2640 1 -- 172.21.15.134:0/3973505274 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f67d000a4a0 con 0x55c2bd7ac290 2024-04-24T02:12:20.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.185+0000 7f67da5a2800 1 -- 172.21.15.134:0/3973505274 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8af8e0 con 0x55c2bd7ac290 2024-04-24T02:12:20.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.185+0000 7f67d88a2640 1 -- 172.21.15.134:0/3973505274 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f67d000a4a0 con 0x55c2bd7ac290 2024-04-24T02:12:20.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.186+0000 7f67da5a2800 1 -- 172.21.15.134:0/3973505274 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8afd30 con 0x55c2bd7ac290 2024-04-24T02:12:20.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.186+0000 7f67d88a2640 1 -- 172.21.15.134:0/3973505274 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f67d000a4a0 con 0x55c2bd7ac290 2024-04-24T02:12:20.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.186+0000 7f67da5a2800 1 Processor -- start 2024-04-24T02:12:20.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.186+0000 7f67da5a2800 1 -- start start 2024-04-24T02:12:20.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.186+0000 7f67da5a2800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2bd8bf370 0x55c2bd8bf790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.186+0000 7f67da5a2800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c2bd69d6b0 con 0x55c2bd8bf370 2024-04-24T02:12:20.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.187+0000 7f67cffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2bd8bf370 0x55c2bd8bf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.187+0000 7f67cffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2bd8bf370 0x55c2bd8bf790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45106/0 (socket says 172.21.15.134:45106) 2024-04-24T02:12:20.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.187+0000 7f67cffff640 1 -- 172.21.15.134:0/1010077426 learned_addr learned my addr 172.21.15.134:0/1010077426 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:20.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.187+0000 7f67cffff640 1 -- 172.21.15.134:0/1010077426 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2bd8bfcd0 con 0x55c2bd8bf370 2024-04-24T02:12:20.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.187+0000 7f67cffff640 1 --2- 172.21.15.134:0/1010077426 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2bd8bf370 0x55c2bd8bf790 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f67c0044840 tx=0x7f67c0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.188+0000 7f66bdffb640 1 -- 172.21.15.134:0/1010077426 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67c006f070 con 0x55c2bd8bf370 2024-04-24T02:12:20.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.188+0000 7f66bdffb640 1 -- 172.21.15.134:0/1010077426 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67c0058040 con 0x55c2bd8bf370 2024-04-24T02:12:20.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.188+0000 7f67da5a2800 1 -- 172.21.15.134:0/1010077426 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c2bd8c0740 con 0x55c2bd8bf370 2024-04-24T02:12:20.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.188+0000 7f66bdffb640 1 -- 172.21.15.134:0/1010077426 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67c0057050 con 0x55c2bd8bf370 2024-04-24T02:12:20.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.188+0000 7f67da5a2800 1 -- 172.21.15.134:0/1010077426 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2bd8c0be0 con 0x55c2bd8bf370 2024-04-24T02:12:20.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.188+0000 7f66bdffb640 1 -- 172.21.15.134:0/1010077426 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f67c0072070 con 0x55c2bd8bf370 2024-04-24T02:12:20.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.189+0000 7f66bdffb640 1 --2- 172.21.15.134:0/1010077426 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f66b0036900 0x7f66b0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.189+0000 7f66bdffb640 1 -- 172.21.15.134:0/1010077426 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f67c008f6c0 con 0x55c2bd8bf370 2024-04-24T02:12:20.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.189+0000 7f67d88a2640 1 --2- 172.21.15.134:0/1010077426 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f66b0036900 0x7f66b0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.189+0000 7f67da5a2800 1 Processor -- start 2024-04-24T02:12:20.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.189+0000 7f67d88a2640 1 --2- 172.21.15.134:0/1010077426 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f66b0036900 0x7f66b0038dc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x55c2bd8af400 tx=0x7f67d0005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.189+0000 7f67da5a2800 1 -- start start 2024-04-24T02:12:20.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.189+0000 7f67da5a2800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2bd8cc5f0 0x55c2bd8cca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.189+0000 7f67da5a2800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c2bd89fe20 con 0x55c2bd8cc5f0 2024-04-24T02:12:20.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.189+0000 7f67cffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2bd8cc5f0 0x55c2bd8cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.189+0000 7f67cffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2bd8cc5f0 0x55c2bd8cca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45122/0 (socket says 172.21.15.134:45122) 2024-04-24T02:12:20.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.189+0000 7f67cffff640 1 -- 172.21.15.134:0/818251195 learned_addr learned my addr 172.21.15.134:0/818251195 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:20.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.190+0000 7f67cffff640 1 -- 172.21.15.134:0/818251195 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2bd8ccfe0 con 0x55c2bd8cc5f0 2024-04-24T02:12:20.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.190+0000 7f67cffff640 1 --2- 172.21.15.134:0/818251195 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2bd8cc5f0 0x55c2bd8cca10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f67c008dc60 tx=0x7f67c0069ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94d66c9c3f91def4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.190+0000 7f66b77fe640 1 -- 172.21.15.134:0/818251195 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67c008b020 con 0x55c2bd8cc5f0 2024-04-24T02:12:20.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.190+0000 7f66b77fe640 1 -- 172.21.15.134:0/818251195 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67c005d3e0 con 0x55c2bd8cc5f0 2024-04-24T02:12:20.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.190+0000 7f66b77fe640 1 -- 172.21.15.134:0/818251195 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67c005cc80 con 0x55c2bd8cc5f0 2024-04-24T02:12:20.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.191+0000 7f67da5a2800 1 -- 172.21.15.134:0/818251195 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2bd8cc5f0 msgr2=0x55c2bd8cca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.191+0000 7f67da5a2800 1 --2- 172.21.15.134:0/818251195 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2bd8cc5f0 0x55c2bd8cca10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f67c008dc60 tx=0x7f67c0069ce0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.191+0000 7f67da5a2800 1 -- 172.21.15.134:0/818251195 shutdown_connections 2024-04-24T02:12:20.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.191+0000 7f67da5a2800 1 --2- 172.21.15.134:0/818251195 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2bd8cc5f0 0x55c2bd8cca10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.191+0000 7f67da5a2800 1 -- 172.21.15.134:0/818251195 >> 172.21.15.134:0/818251195 conn(0x55c2bd8c8950 msgr2=0x55c2bd8c69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:20.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.191+0000 7f67da5a2800 1 -- 172.21.15.134:0/818251195 shutdown_connections 2024-04-24T02:12:20.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.191+0000 7f67da5a2800 1 -- 172.21.15.134:0/818251195 wait complete. 2024-04-24T02:12:20.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.191+0000 7f67da5a2800 1 Processor -- start 2024-04-24T02:12:20.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.191+0000 7f67da5a2800 1 -- start start 2024-04-24T02:12:20.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.191+0000 7f67da5a2800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2bd8cc5f0 0x55c2bd8d3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.191+0000 7f67da5a2800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c2bd8cd750 con 0x55c2bd8cc5f0 2024-04-24T02:12:20.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.191+0000 7f67cffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2bd8cc5f0 0x55c2bd8d3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.191+0000 7f67cffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2bd8cc5f0 0x55c2bd8d3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45136/0 (socket says 172.21.15.134:45136) 2024-04-24T02:12:20.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.191+0000 7f67cffff640 1 -- 172.21.15.134:0/24860932 learned_addr learned my addr 172.21.15.134:0/24860932 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:20.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.192+0000 7f67cffff640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2bd8d41d0 con 0x55c2bd8cc5f0 2024-04-24T02:12:20.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.192+0000 7f67cffff640 1 --2- 172.21.15.134:0/24860932 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2bd8cc5f0 0x55c2bd8d3c90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f67c008cbd0 tx=0x7f67c008dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.192+0000 7f66b5ffb640 1 -- 172.21.15.134:0/24860932 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67c005da90 con 0x55c2bd8cc5f0 2024-04-24T02:12:20.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.192+0000 7f66b5ffb640 1 -- 172.21.15.134:0/24860932 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67c0094070 con 0x55c2bd8cc5f0 2024-04-24T02:12:20.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.192+0000 7f66b5ffb640 1 -- 172.21.15.134:0/24860932 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67c005fda0 con 0x55c2bd8cc5f0 2024-04-24T02:12:20.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.192+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c2bd8d4460 con 0x55c2bd8cc5f0 2024-04-24T02:12:20.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.192+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2bd8d7110 con 0x55c2bd8cc5f0 2024-04-24T02:12:20.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.193+0000 7f66b5ffb640 1 -- 172.21.15.134:0/24860932 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f67c008fa10 con 0x55c2bd8cc5f0 2024-04-24T02:12:20.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.193+0000 7f67da5a2800 20 rados->read ofs=0 len=0 2024-04-24T02:12:20.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.193+0000 7f66b5ffb640 1 --2- 172.21.15.134:0/24860932 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f66a8036950 0x7f66a8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.193+0000 7f66b5ffb640 1 -- 172.21.15.134:0/24860932 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f67c0077120 con 0x55c2bd8cc5f0 2024-04-24T02:12:20.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.193+0000 7f67d88a2640 1 --2- 172.21.15.134:0/24860932 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f66a8036950 0x7f66a8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.194+0000 7f67da5a2800 1 --2- 172.21.15.134:0/24860932 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c2bd8df740 0x55c2bd8e1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.194+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e2320 con 0x55c2bd8df740 2024-04-24T02:12:20.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.194+0000 7f67d80a1640 1 --2- 172.21.15.134:0/24860932 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c2bd8df740 0x55c2bd8e1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.194+0000 7f67d88a2640 1 --2- 172.21.15.134:0/24860932 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f66a8036950 0x7f66a8038e10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x55c2bd8ab760 tx=0x7f67d001f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.194+0000 7f67d80a1640 1 --2- 172.21.15.134:0/24860932 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c2bd8df740 0x55c2bd8e1bd0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.194+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f67c8024980 con 0x55c2bd8df740 2024-04-24T02:12:20.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.194+0000 7f67da5a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:20.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.194+0000 7f67da5a2800 20 realm 2024-04-24T02:12:20.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.194+0000 7f67da5a2800 20 rados->read ofs=0 len=0 2024-04-24T02:12:20.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.194+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e2730 con 0x55c2bd8df740 2024-04-24T02:12:20.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.194+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f67c8024980 con 0x55c2bd8df740 2024-04-24T02:12:20.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.194+0000 7f67da5a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:20.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.194+0000 7f67da5a2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:20.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.194+0000 7f67da5a2800 20 rados->read ofs=0 len=0 2024-04-24T02:12:20.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.195+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e3000 con 0x55c2bd8df740 2024-04-24T02:12:20.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.195+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f67c8024980 con 0x55c2bd8df740 2024-04-24T02:12:20.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.195+0000 7f67da5a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:20.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.195+0000 7f67da5a2800 20 rados->read ofs=0 len=0 2024-04-24T02:12:20.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.195+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e33a0 con 0x55c2bd8df740 2024-04-24T02:12:20.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.195+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f67c8024980 con 0x55c2bd8df740 2024-04-24T02:12:20.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.195+0000 7f67da5a2800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:20.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.195+0000 7f67da5a2800 20 rados->read ofs=0 len=0 2024-04-24T02:12:20.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.195+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e3800 con 0x55c2bd8df740 2024-04-24T02:12:20.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.195+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f67c8024980 con 0x55c2bd8df740 2024-04-24T02:12:20.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.195+0000 7f67da5a2800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:20.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.195+0000 7f67da5a2800 20 searching for the correct realm 2024-04-24T02:12:20.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.195+0000 7f67da5a2800 1 --2- 172.21.15.134:0/24860932 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55c2bd8e5850 0x55c2bd8e7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.195+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e82f0 con 0x55c2bd8e5850 2024-04-24T02:12:20.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.196+0000 7f67cffff640 1 --2- 172.21.15.134:0/24860932 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55c2bd8e5850 0x55c2bd8e7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.196+0000 7f67cffff640 1 --2- 172.21.15.134:0/24860932 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55c2bd8e5850 0x55c2bd8e7c40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.196+0000 7f67cffff640 1 -- 172.21.15.134:0/24860932 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c0086070 con 0x55c2bd8e5850 2024-04-24T02:12:20.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.196+0000 7f67cffff640 1 --2- 172.21.15.134:0/24860932 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f67c0074060 0x7f67c00748a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.196+0000 7f67cffff640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e82f0 con 0x7f67c0074060 2024-04-24T02:12:20.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.196+0000 7f67d88a2640 1 --2- 172.21.15.134:0/24860932 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f67c0074060 0x7f67c00748a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.197+0000 7f67d88a2640 1 --2- 172.21.15.134:0/24860932 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f67c0074060 0x7f67c00748a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.197+0000 7f67d88a2640 1 -- 172.21.15.134:0/24860932 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67d001f070 con 0x7f67c0074060 2024-04-24T02:12:20.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.197+0000 7f67d88a2640 1 --2- 172.21.15.134:0/24860932 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f67d0031040 0x7f67d0032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.197+0000 7f67d88a2640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e82f0 con 0x7f67d0031040 2024-04-24T02:12:20.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.197+0000 7f67d80a1640 1 --2- 172.21.15.134:0/24860932 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f67d0031040 0x7f67d0032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.198+0000 7f67d80a1640 1 --2- 172.21.15.134:0/24860932 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f67d0031040 0x7f67d0032940 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.198+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c8024980 con 0x7f67d0031040 2024-04-24T02:12:20.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.198+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e82f0 con 0x55c2bd8df740 2024-04-24T02:12:20.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.198+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c8024980 con 0x55c2bd8df740 2024-04-24T02:12:20.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.198+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e82f0 con 0x55c2bd8df740 2024-04-24T02:12:20.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.198+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f67c8024980 con 0x55c2bd8df740 2024-04-24T02:12:20.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.198+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e82f0 con 0x7f67d0031040 2024-04-24T02:12:20.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.199+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c8024980 con 0x7f67d0031040 2024-04-24T02:12:20.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.199+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e82f0 con 0x7f67d0031040 2024-04-24T02:12:20.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.199+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c8024980 con 0x7f67d0031040 2024-04-24T02:12:20.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.199+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e82f0 con 0x7f67c0074060 2024-04-24T02:12:20.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.199+0000 7f67d88a2640 1 -- 172.21.15.134:0/24860932 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67d001f070 con 0x7f67c0074060 2024-04-24T02:12:20.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.199+0000 7f67d88a2640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e82f0 con 0x55c2bd8e5850 2024-04-24T02:12:20.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.200+0000 7f67cffff640 1 -- 172.21.15.134:0/24860932 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c0086070 con 0x55c2bd8e5850 2024-04-24T02:12:20.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.200+0000 7f67cffff640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e82f0 con 0x55c2bd8df740 2024-04-24T02:12:20.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.200+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c8024980 con 0x55c2bd8df740 2024-04-24T02:12:20.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.200+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e82f0 con 0x7f67d0031040 2024-04-24T02:12:20.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.200+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c8024980 con 0x7f67d0031040 2024-04-24T02:12:20.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.200+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e82f0 con 0x55c2bd8df740 2024-04-24T02:12:20.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.200+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c8024980 con 0x55c2bd8df740 2024-04-24T02:12:20.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.200+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e82f0 con 0x7f67c0074060 2024-04-24T02:12:20.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.201+0000 7f67d88a2640 1 -- 172.21.15.134:0/24860932 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f67d001f070 con 0x7f67c0074060 2024-04-24T02:12:20.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.201+0000 7f67d88a2640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e82f0 con 0x55c2bd8e5850 2024-04-24T02:12:20.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.201+0000 7f67cffff640 1 -- 172.21.15.134:0/24860932 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c0086070 con 0x55c2bd8e5850 2024-04-24T02:12:20.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.201+0000 7f67cffff640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e82f0 con 0x55c2bd8e5850 2024-04-24T02:12:20.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.201+0000 7f67cffff640 1 -- 172.21.15.134:0/24860932 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c0086070 con 0x55c2bd8e5850 2024-04-24T02:12:20.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.201+0000 7f67cffff640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e82f0 con 0x7f67d0031040 2024-04-24T02:12:20.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.202+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c8024980 con 0x7f67d0031040 2024-04-24T02:12:20.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.202+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e82f0 con 0x55c2bd8e5850 2024-04-24T02:12:20.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.202+0000 7f67cffff640 1 -- 172.21.15.134:0/24860932 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c0086070 con 0x55c2bd8e5850 2024-04-24T02:12:20.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.202+0000 7f67cffff640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e82f0 con 0x55c2bd8e5850 2024-04-24T02:12:20.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.202+0000 7f67cffff640 1 -- 172.21.15.134:0/24860932 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c0086070 con 0x55c2bd8e5850 2024-04-24T02:12:20.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.202+0000 7f67cffff640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e82f0 con 0x55c2bd8df740 2024-04-24T02:12:20.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.202+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c8024980 con 0x55c2bd8df740 2024-04-24T02:12:20.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.202+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e82f0 con 0x55c2bd8df740 2024-04-24T02:12:20.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.202+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v23'2 uv2 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f67c8024980 con 0x55c2bd8df740 2024-04-24T02:12:20.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.202+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e82f0 con 0x7f67d0031040 2024-04-24T02:12:20.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.203+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c8024980 con 0x7f67d0031040 2024-04-24T02:12:20.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.203+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e82f0 con 0x55c2bd8e5850 2024-04-24T02:12:20.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.203+0000 7f67cffff640 1 -- 172.21.15.134:0/24860932 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c0086070 con 0x55c2bd8e5850 2024-04-24T02:12:20.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.203+0000 7f67cffff640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e82f0 con 0x7f67c0074060 2024-04-24T02:12:20.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.203+0000 7f67d88a2640 1 -- 172.21.15.134:0/24860932 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67d001f070 con 0x7f67c0074060 2024-04-24T02:12:20.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.203+0000 7f67d88a2640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e82f0 con 0x55c2bd8df740 2024-04-24T02:12:20.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.204+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c8024980 con 0x55c2bd8df740 2024-04-24T02:12:20.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.204+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e82f0 con 0x7f67d0031040 2024-04-24T02:12:20.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.204+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c8024980 con 0x7f67d0031040 2024-04-24T02:12:20.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.204+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e82f0 con 0x55c2bd8e5850 2024-04-24T02:12:20.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.204+0000 7f67cffff640 1 -- 172.21.15.134:0/24860932 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c0086070 con 0x55c2bd8e5850 2024-04-24T02:12:20.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.204+0000 7f67cffff640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e82f0 con 0x7f67d0031040 2024-04-24T02:12:20.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.204+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c8024980 con 0x7f67d0031040 2024-04-24T02:12:20.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.205+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e82f0 con 0x7f67c0074060 2024-04-24T02:12:20.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.205+0000 7f67d88a2640 1 -- 172.21.15.134:0/24860932 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67d001f070 con 0x7f67c0074060 2024-04-24T02:12:20.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.205+0000 7f67d88a2640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e82f0 con 0x55c2bd8e5850 2024-04-24T02:12:20.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.205+0000 7f67cffff640 1 -- 172.21.15.134:0/24860932 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c0086070 con 0x55c2bd8e5850 2024-04-24T02:12:20.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.205+0000 7f67cffff640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e82f0 con 0x7f67d0031040 2024-04-24T02:12:20.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.205+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c8024980 con 0x7f67d0031040 2024-04-24T02:12:20.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.205+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e82f0 con 0x55c2bd8df740 2024-04-24T02:12:20.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.206+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f67c8024980 con 0x55c2bd8df740 2024-04-24T02:12:20.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.206+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e82f0 con 0x7f67c0074060 2024-04-24T02:12:20.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.206+0000 7f67d88a2640 1 -- 172.21.15.134:0/24860932 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67d001f070 con 0x7f67c0074060 2024-04-24T02:12:20.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.206+0000 7f67da5a2800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:20.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.206+0000 7f67da5a2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:20.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.206+0000 7f67da5a2800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:20.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.206+0000 7f67da5a2800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:20.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.206+0000 7f67da5a2800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:20.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.206+0000 7f67da5a2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:20.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.206+0000 7f67da5a2800 20 rados->read ofs=0 len=0 2024-04-24T02:12:20.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.206+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e42d0 con 0x55c2bd8df740 2024-04-24T02:12:20.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.206+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f67c8024980 con 0x55c2bd8df740 2024-04-24T02:12:20.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.206+0000 7f67da5a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:20.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.206+0000 7f67da5a2800 20 rados->read ofs=0 len=0 2024-04-24T02:12:20.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.206+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e4b70 con 0x55c2bd8df740 2024-04-24T02:12:20.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.206+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f67c8024980 con 0x55c2bd8df740 2024-04-24T02:12:20.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.206+0000 7f67da5a2800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:20.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.206+0000 7f67da5a2800 20 rados->read ofs=0 len=0 2024-04-24T02:12:20.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.206+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e3f10 con 0x55c2bd8df740 2024-04-24T02:12:20.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.207+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f67c8024980 con 0x55c2bd8df740 2024-04-24T02:12:20.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.207+0000 7f67da5a2800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:20.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.207+0000 7f67da5a2800 20 zone default found 2024-04-24T02:12:20.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.207+0000 7f67da5a2800 4 Realm: () 2024-04-24T02:12:20.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.207+0000 7f67da5a2800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:20.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.207+0000 7f67da5a2800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:20.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.207+0000 7f67da5a2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:20.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.207+0000 7f67da5a2800 20 zonegroup default 2024-04-24T02:12:20.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.207+0000 7f67da5a2800 20 rados->read ofs=0 len=0 2024-04-24T02:12:20.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.207+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e8770 con 0x7f67d0031040 2024-04-24T02:12:20.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.207+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f67c8024980 con 0x7f67d0031040 2024-04-24T02:12:20.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.207+0000 7f67da5a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:20.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.207+0000 7f67da5a2800 20 rados->read ofs=0 len=0 2024-04-24T02:12:20.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.207+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8ea600 con 0x55c2bd8e5850 2024-04-24T02:12:20.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.207+0000 7f67cffff640 1 -- 172.21.15.134:0/24860932 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f67c0086070 con 0x55c2bd8e5850 2024-04-24T02:12:20.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.207+0000 7f67da5a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:20.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.207+0000 7f67da5a2800 20 rados->read ofs=0 len=0 2024-04-24T02:12:20.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.207+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8ea9a0 con 0x55c2bd8e5850 2024-04-24T02:12:20.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.208+0000 7f67cffff640 1 -- 172.21.15.134:0/24860932 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f67c0086070 con 0x55c2bd8e5850 2024-04-24T02:12:20.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.208+0000 7f67da5a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:20.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.208+0000 7f67da5a2800 20 started sync module instance, tier type = 2024-04-24T02:12:20.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.208+0000 7f67da5a2800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:20.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.208+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e9a40 con 0x7f67c0074060 2024-04-24T02:12:20.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.209+0000 7f67d88a2640 1 -- 172.21.15.134:0/24860932 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67d0040040 con 0x7f67c0074060 2024-04-24T02:12:20.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.209+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94294892256816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8ea250 con 0x7f67c0074060 2024-04-24T02:12:20.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.209+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8eb810 con 0x55c2bd8df740 2024-04-24T02:12:20.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.210+0000 7f67d88a2640 1 -- 172.21.15.134:0/24860932 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94294892256816] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67d0040040 con 0x7f67c0074060 2024-04-24T02:12:20.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.210+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67c8024980 con 0x55c2bd8df740 2024-04-24T02:12:20.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.210+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94294892262240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8ebc30 con 0x55c2bd8df740 2024-04-24T02:12:20.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.210+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8ec5f0 con 0x55c2bd8e5850 2024-04-24T02:12:20.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.212+0000 7f67cffff640 1 -- 172.21.15.134:0/24860932 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67c0086070 con 0x55c2bd8e5850 2024-04-24T02:12:20.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.212+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94294892265792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8ece90 con 0x55c2bd8e5850 2024-04-24T02:12:20.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.212+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8ed910 con 0x7f67c0074060 2024-04-24T02:12:20.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.213+0000 7f67d88a2640 1 -- 172.21.15.134:0/24860932 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67d0040040 con 0x7f67c0074060 2024-04-24T02:12:20.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.213+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94294892270592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8ee1b0 con 0x7f67c0074060 2024-04-24T02:12:20.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.213+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8eecb0 con 0x55c2bd8df740 2024-04-24T02:12:20.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.214+0000 7f67d88a2640 1 -- 172.21.15.134:0/24860932 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94294892270592] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67d0040040 con 0x7f67c0074060 2024-04-24T02:12:20.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.215+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94294892262240] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67c8024980 con 0x55c2bd8df740 2024-04-24T02:12:20.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.218+0000 7f67cffff640 1 -- 172.21.15.134:0/24860932 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94294892265792] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67c0086070 con 0x55c2bd8e5850 2024-04-24T02:12:20.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.218+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67c8024980 con 0x55c2bd8df740 2024-04-24T02:12:20.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.218+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94294892268000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8eb780 con 0x55c2bd8df740 2024-04-24T02:12:20.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.218+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8ee1b0 con 0x7f67d0031040 2024-04-24T02:12:20.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.220+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67c8024980 con 0x7f67d0031040 2024-04-24T02:12:20.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.220+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94294892272896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8ee120 con 0x7f67d0031040 2024-04-24T02:12:20.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.220+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8efb90 con 0x7f67d0031040 2024-04-24T02:12:20.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.220+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94294892268000] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67c8024980 con 0x55c2bd8df740 2024-04-24T02:12:20.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.221+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94294892272896] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67c8024980 con 0x7f67d0031040 2024-04-24T02:12:20.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.222+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(56 notify.6 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67c8024980 con 0x7f67d0031040 2024-04-24T02:12:20.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.222+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94294892277792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8ef670 con 0x7f67d0031040 2024-04-24T02:12:20.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.222+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8f0040 con 0x7f67d0031040 2024-04-24T02:12:20.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.223+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(58 notify.7 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67c8024980 con 0x7f67d0031040 2024-04-24T02:12:20.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.223+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94294892280720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8f0460 con 0x7f67d0031040 2024-04-24T02:12:20.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.223+0000 7f67da5a2800 20 add_watcher() i=0 2024-04-24T02:12:20.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.223+0000 7f67da5a2800 20 add_watcher() i=1 2024-04-24T02:12:20.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.223+0000 7f67da5a2800 20 add_watcher() i=2 2024-04-24T02:12:20.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.223+0000 7f67da5a2800 20 add_watcher() i=3 2024-04-24T02:12:20.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.223+0000 7f67da5a2800 20 add_watcher() i=4 2024-04-24T02:12:20.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.223+0000 7f67da5a2800 20 add_watcher() i=5 2024-04-24T02:12:20.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.223+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94294892277792] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67c8024980 con 0x7f67d0031040 2024-04-24T02:12:20.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.223+0000 7f67da5a2800 20 add_watcher() i=6 2024-04-24T02:12:20.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.224+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94294892280720] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67c8024980 con 0x7f67d0031040 2024-04-24T02:12:20.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.224+0000 7f67da5a2800 20 add_watcher() i=7 2024-04-24T02:12:20.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.224+0000 7f67da5a2800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:20.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.224+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8ee7a0 con 0x55c2bd8df740 2024-04-24T02:12:20.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.225+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f67c8024980 con 0x55c2bd8df740 2024-04-24T02:12:20.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.225+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94294892275616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8f0970 con 0x55c2bd8df740 2024-04-24T02:12:20.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.226+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94294892275616] v30'30 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f67c8024980 con 0x55c2bd8df740 2024-04-24T02:12:20.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.226+0000 7f668e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:20.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.226+0000 7f67da5a2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:20.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.226+0000 7f67da5a2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:20.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.226+0000 7f67da5a2800 5 note: GC not initialized 2024-04-24T02:12:20.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.226+0000 7f668d7e2640 20 reqs_thread_entry: start 2024-04-24T02:12:20.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.226+0000 7f67da5a2800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:20.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.226+0000 7f67da5a2800 20 Filter name: none 2024-04-24T02:12:20.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.226+0000 7f65feffd640 20 reqs_thread_entry: start 2024-04-24T02:12:20.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.227+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd925ff0 con 0x55c2bd8e5850 2024-04-24T02:12:20.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.227+0000 7f67cffff640 1 -- 172.21.15.134:0/24860932 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c0086070 con 0x55c2bd8e5850 2024-04-24T02:12:20.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.227+0000 7f67cffff640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd925ff0 con 0x55c2bd8e5850 2024-04-24T02:12:20.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.227+0000 7f67cffff640 1 -- 172.21.15.134:0/24860932 <== osd.3 v2:172.21.15.134:6801/3585115521 15 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c0086070 con 0x55c2bd8e5850 2024-04-24T02:12:20.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.227+0000 7f67cffff640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd925ff0 con 0x55c2bd8df740 2024-04-24T02:12:20.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.227+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c8024980 con 0x55c2bd8df740 2024-04-24T02:12:20.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.227+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e4b70 con 0x55c2bd8df740 2024-04-24T02:12:20.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.228+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c8024980 con 0x55c2bd8df740 2024-04-24T02:12:20.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.228+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e4b70 con 0x7f67c0074060 2024-04-24T02:12:20.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.228+0000 7f67d88a2640 1 -- 172.21.15.134:0/24860932 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67d0040040 con 0x7f67c0074060 2024-04-24T02:12:20.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.228+0000 7f67d88a2640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e9a40 con 0x55c2bd8e5850 2024-04-24T02:12:20.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.228+0000 7f67cffff640 1 -- 172.21.15.134:0/24860932 <== osd.3 v2:172.21.15.134:6801/3585115521 16 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c0086070 con 0x55c2bd8e5850 2024-04-24T02:12:20.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.228+0000 7f67cffff640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e9a40 con 0x55c2bd8df740 2024-04-24T02:12:20.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.229+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c8024980 con 0x55c2bd8df740 2024-04-24T02:12:20.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.229+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e9a40 con 0x55c2bd8e5850 2024-04-24T02:12:20.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.229+0000 7f67cffff640 1 -- 172.21.15.134:0/24860932 <== osd.3 v2:172.21.15.134:6801/3585115521 17 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c0086070 con 0x55c2bd8e5850 2024-04-24T02:12:20.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.229+0000 7f67cffff640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e9a40 con 0x7f67c0074060 2024-04-24T02:12:20.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.229+0000 7f67d88a2640 1 -- 172.21.15.134:0/24860932 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67d0040040 con 0x7f67c0074060 2024-04-24T02:12:20.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.229+0000 7f67d88a2640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e9a40 con 0x55c2bd8e5850 2024-04-24T02:12:20.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.229+0000 7f67cffff640 1 -- 172.21.15.134:0/24860932 <== osd.3 v2:172.21.15.134:6801/3585115521 18 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c0086070 con 0x55c2bd8e5850 2024-04-24T02:12:20.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.229+0000 7f67cffff640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e9a40 con 0x55c2bd8df740 2024-04-24T02:12:20.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.229+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c8024980 con 0x55c2bd8df740 2024-04-24T02:12:20.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.229+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e9a40 con 0x7f67d0031040 2024-04-24T02:12:20.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.230+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c8024980 con 0x7f67d0031040 2024-04-24T02:12:20.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.230+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e9a40 con 0x7f67d0031040 2024-04-24T02:12:20.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.230+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(74 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c8024980 con 0x7f67d0031040 2024-04-24T02:12:20.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.230+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e9a40 con 0x55c2bd8e5850 2024-04-24T02:12:20.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.231+0000 7f67cffff640 1 -- 172.21.15.134:0/24860932 <== osd.3 v2:172.21.15.134:6801/3585115521 19 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c0086070 con 0x55c2bd8e5850 2024-04-24T02:12:20.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.231+0000 7f67cffff640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e9a40 con 0x7f67d0031040 2024-04-24T02:12:20.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.231+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(76 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c8024980 con 0x7f67d0031040 2024-04-24T02:12:20.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.231+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e9a40 con 0x7f67d0031040 2024-04-24T02:12:20.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.231+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.0 v2:172.21.15.104:6800/2419146313 20 ==== osd_op_reply(77 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c8024980 con 0x7f67d0031040 2024-04-24T02:12:20.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.231+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e9a40 con 0x7f67d0031040 2024-04-24T02:12:20.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.232+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.0 v2:172.21.15.104:6800/2419146313 21 ==== osd_op_reply(78 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c8024980 con 0x7f67d0031040 2024-04-24T02:12:20.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.232+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e9a40 con 0x55c2bd8e5850 2024-04-24T02:12:20.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.232+0000 7f67cffff640 1 -- 172.21.15.134:0/24860932 <== osd.3 v2:172.21.15.134:6801/3585115521 20 ==== osd_op_reply(79 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c0086070 con 0x55c2bd8e5850 2024-04-24T02:12:20.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.232+0000 7f67cffff640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e9a40 con 0x7f67c0074060 2024-04-24T02:12:20.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.232+0000 7f67d88a2640 1 -- 172.21.15.134:0/24860932 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(80 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67d0040040 con 0x7f67c0074060 2024-04-24T02:12:20.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.232+0000 7f67d88a2640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e9a40 con 0x55c2bd8df740 2024-04-24T02:12:20.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.232+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(81 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c8024980 con 0x55c2bd8df740 2024-04-24T02:12:20.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.232+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e9a40 con 0x55c2bd8df740 2024-04-24T02:12:20.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.233+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(82 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c8024980 con 0x55c2bd8df740 2024-04-24T02:12:20.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.233+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e9a40 con 0x55c2bd8e5850 2024-04-24T02:12:20.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.233+0000 7f67cffff640 1 -- 172.21.15.134:0/24860932 <== osd.3 v2:172.21.15.134:6801/3585115521 21 ==== osd_op_reply(83 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c0086070 con 0x55c2bd8e5850 2024-04-24T02:12:20.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.233+0000 7f67cffff640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e9a40 con 0x7f67c0074060 2024-04-24T02:12:20.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.233+0000 7f67d88a2640 1 -- 172.21.15.134:0/24860932 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(84 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67d0040040 con 0x7f67c0074060 2024-04-24T02:12:20.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.233+0000 7f67d88a2640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e9a40 con 0x7f67d0031040 2024-04-24T02:12:20.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.233+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.0 v2:172.21.15.104:6800/2419146313 22 ==== osd_op_reply(85 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c8024980 con 0x7f67d0031040 2024-04-24T02:12:20.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.233+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e9a40 con 0x55c2bd8df740 2024-04-24T02:12:20.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.234+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(86 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c8024980 con 0x55c2bd8df740 2024-04-24T02:12:20.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.234+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e9a40 con 0x7f67d0031040 2024-04-24T02:12:20.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.234+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.0 v2:172.21.15.104:6800/2419146313 23 ==== osd_op_reply(87 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c8024980 con 0x7f67d0031040 2024-04-24T02:12:20.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.234+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e9a40 con 0x55c2bd8e5850 2024-04-24T02:12:20.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.234+0000 7f67cffff640 1 -- 172.21.15.134:0/24860932 <== osd.3 v2:172.21.15.134:6801/3585115521 22 ==== osd_op_reply(88 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c0086070 con 0x55c2bd8e5850 2024-04-24T02:12:20.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.234+0000 7f67cffff640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e9a40 con 0x7f67c0074060 2024-04-24T02:12:20.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.234+0000 7f67d88a2640 1 -- 172.21.15.134:0/24860932 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(89 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67d0040040 con 0x7f67c0074060 2024-04-24T02:12:20.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.234+0000 7f67d88a2640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e9a40 con 0x7f67d0031040 2024-04-24T02:12:20.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.235+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.0 v2:172.21.15.104:6800/2419146313 24 ==== osd_op_reply(90 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c8024980 con 0x7f67d0031040 2024-04-24T02:12:20.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.235+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e9a40 con 0x55c2bd8df740 2024-04-24T02:12:20.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.235+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.1 v2:172.21.15.134:6804/1487076214 30 ==== osd_op_reply(91 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c8024980 con 0x55c2bd8df740 2024-04-24T02:12:20.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.235+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e9a40 con 0x55c2bd8e5850 2024-04-24T02:12:20.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.236+0000 7f67cffff640 1 -- 172.21.15.134:0/24860932 <== osd.3 v2:172.21.15.134:6801/3585115521 23 ==== osd_op_reply(92 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67c0086070 con 0x55c2bd8e5850 2024-04-24T02:12:20.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.236+0000 7f67cffff640 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e9a40 con 0x7f67c0074060 2024-04-24T02:12:20.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.236+0000 7f67d88a2640 1 -- 172.21.15.134:0/24860932 <== osd.2 v2:172.21.15.134:6800/214480313 16 ==== osd_op_reply(93 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67d0040040 con 0x7f67c0074060 2024-04-24T02:12:20.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.237+0000 7f668e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:20.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.237+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94294892275616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e4b70 con 0x55c2bd8df740 2024-04-24T02:12:20.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.238+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.1 v2:172.21.15.134:6804/1487076214 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94294892275616] v30'31 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f67c8024980 con 0x55c2bd8df740 2024-04-24T02:12:20.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.238+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94294892256816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd925fb0 con 0x7f67c0074060 2024-04-24T02:12:20.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.239+0000 7f67d88a2640 1 -- 172.21.15.134:0/24860932 <== osd.2 v2:172.21.15.134:6800/214480313 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94294892256816] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67d0040040 con 0x7f67c0074060 2024-04-24T02:12:20.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.239+0000 7f67da5a2800 20 remove_watcher() i=0 2024-04-24T02:12:20.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.239+0000 7f67da5a2800 2 removed watcher, disabling cache 2024-04-24T02:12:20.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.239+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94294892262240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e9e30 con 0x55c2bd8df740 2024-04-24T02:12:20.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.240+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.1 v2:172.21.15.134:6804/1487076214 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94294892262240] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67c8024980 con 0x55c2bd8df740 2024-04-24T02:12:20.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.240+0000 7f67da5a2800 20 remove_watcher() i=1 2024-04-24T02:12:20.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.240+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94294892265792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8e9e30 con 0x55c2bd8e5850 2024-04-24T02:12:20.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.242+0000 7f67cffff640 1 -- 172.21.15.134:0/24860932 <== osd.3 v2:172.21.15.134:6801/3585115521 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94294892265792] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67c0086070 con 0x55c2bd8e5850 2024-04-24T02:12:20.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.242+0000 7f67da5a2800 20 remove_watcher() i=2 2024-04-24T02:12:20.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.242+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94294892270592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8ec140 con 0x7f67c0074060 2024-04-24T02:12:20.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.243+0000 7f67d88a2640 1 -- 172.21.15.134:0/24860932 <== osd.2 v2:172.21.15.134:6800/214480313 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94294892270592] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67d0040040 con 0x7f67c0074060 2024-04-24T02:12:20.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.243+0000 7f67da5a2800 20 remove_watcher() i=3 2024-04-24T02:12:20.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.243+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94294892268000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8ec140 con 0x55c2bd8df740 2024-04-24T02:12:20.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.244+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.1 v2:172.21.15.134:6804/1487076214 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94294892268000] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67c8024980 con 0x55c2bd8df740 2024-04-24T02:12:20.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.244+0000 7f67da5a2800 20 remove_watcher() i=4 2024-04-24T02:12:20.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.244+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94294892272896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8ec9e0 con 0x7f67d0031040 2024-04-24T02:12:20.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.245+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.0 v2:172.21.15.104:6800/2419146313 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94294892272896] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67c8024980 con 0x7f67d0031040 2024-04-24T02:12:20.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.245+0000 7f67da5a2800 20 remove_watcher() i=5 2024-04-24T02:12:20.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.245+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94294892277792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8ec140 con 0x7f67d0031040 2024-04-24T02:12:20.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.246+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.0 v2:172.21.15.104:6800/2419146313 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94294892277792] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67c8024980 con 0x7f67d0031040 2024-04-24T02:12:20.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.246+0000 7f67da5a2800 20 remove_watcher() i=6 2024-04-24T02:12:20.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.246+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94294892280720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2bd8edd00 con 0x7f67d0031040 2024-04-24T02:12:20.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.247+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 <== osd.0 v2:172.21.15.104:6800/2419146313 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94294892280720] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67c8024980 con 0x7f67d0031040 2024-04-24T02:12:20.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.247+0000 7f67da5a2800 20 remove_watcher() i=7 2024-04-24T02:12:20.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.247+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f67d0031040 msgr2=0x7f67d0032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.247+0000 7f67da5a2800 1 --2- 172.21.15.134:0/24860932 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f67d0031040 0x7f67d0032940 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.247+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c2bd8df740 msgr2=0x55c2bd8e1bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.247+0000 7f67da5a2800 1 --2- 172.21.15.134:0/24860932 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c2bd8df740 0x55c2bd8e1bd0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.247+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f67c0074060 msgr2=0x7f67c00748a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.247+0000 7f67da5a2800 1 --2- 172.21.15.134:0/24860932 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f67c0074060 0x7f67c00748a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.247+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55c2bd8e5850 msgr2=0x55c2bd8e7c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.247+0000 7f67da5a2800 1 --2- 172.21.15.134:0/24860932 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55c2bd8e5850 0x55c2bd8e7c40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.247+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f66a8036950 msgr2=0x7f66a8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.247+0000 7f67da5a2800 1 --2- 172.21.15.134:0/24860932 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f66a8036950 0x7f66a8038e10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x55c2bd8ab760 tx=0x7f67d001f000 comp rx=0 tx=0).stop 2024-04-24T02:12:20.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.247+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2bd8cc5f0 msgr2=0x55c2bd8d3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.247+0000 7f67da5a2800 1 --2- 172.21.15.134:0/24860932 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2bd8cc5f0 0x55c2bd8d3c90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f67c008cbd0 tx=0x7f67c008dbf0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.247+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 reap_dead start 2024-04-24T02:12:20.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.247+0000 7f67d80a1640 1 -- 172.21.15.134:0/24860932 reap_dead start 2024-04-24T02:12:20.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.247+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 shutdown_connections 2024-04-24T02:12:20.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.247+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 >> 172.21.15.134:0/24860932 conn(0x55c2bd8c8950 msgr2=0x55c2bd8c5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:20.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.247+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 shutdown_connections 2024-04-24T02:12:20.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.247+0000 7f67da5a2800 1 -- 172.21.15.134:0/24860932 wait complete. 2024-04-24T02:12:20.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.248+0000 7f67da5a2800 1 -- 172.21.15.134:0/1010077426 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f66b0036900 msgr2=0x7f66b0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.248+0000 7f67da5a2800 1 --2- 172.21.15.134:0/1010077426 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f66b0036900 0x7f66b0038dc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x55c2bd8af400 tx=0x7f67d0005840 comp rx=0 tx=0).stop 2024-04-24T02:12:20.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.248+0000 7f67da5a2800 1 -- 172.21.15.134:0/1010077426 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2bd8bf370 msgr2=0x55c2bd8bf790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.248+0000 7f67da5a2800 1 --2- 172.21.15.134:0/1010077426 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2bd8bf370 0x55c2bd8bf790 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f67c0044840 tx=0x7f67c0002fb0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.248+0000 7f67da5a2800 1 -- 172.21.15.134:0/1010077426 shutdown_connections 2024-04-24T02:12:20.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.248+0000 7f67da5a2800 1 --2- 172.21.15.134:0/1010077426 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f66b0036900 0x7f66b0038dc0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.248+0000 7f67da5a2800 1 --2- 172.21.15.134:0/1010077426 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2bd8bf370 0x55c2bd8bf790 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.248+0000 7f67da5a2800 1 -- 172.21.15.134:0/1010077426 >> 172.21.15.134:0/1010077426 conn(0x55c2bd8b3410 msgr2=0x55c2bd8b3810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:20.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.248+0000 7f67da5a2800 1 -- 172.21.15.134:0/1010077426 shutdown_connections 2024-04-24T02:12:20.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.248+0000 7f67da5a2800 1 -- 172.21.15.134:0/1010077426 wait complete. 2024-04-24T02:12:20.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.248+0000 7f67da5a2800 1 -- 172.21.15.134:0/3973505274 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c2bd7ac290 msgr2=0x55c2bd8ae240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.248+0000 7f67da5a2800 1 --2- 172.21.15.134:0/3973505274 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c2bd7ac290 0x55c2bd8ae240 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.248+0000 7f67da5a2800 1 -- 172.21.15.134:0/3973505274 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f66c0036900 msgr2=0x7f66c0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.248+0000 7f67da5a2800 1 --2- 172.21.15.134:0/3973505274 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f66c0036900 0x7f66c0038dc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f67c0054000 tx=0x7f67c004e000 comp rx=0 tx=0).stop 2024-04-24T02:12:20.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.248+0000 7f67da5a2800 1 -- 172.21.15.134:0/3973505274 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2bd7aa750 msgr2=0x55c2bd8a7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.248+0000 7f67da5a2800 1 --2- 172.21.15.134:0/3973505274 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2bd7aa750 0x55c2bd8a7000 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f67c8001de0 tx=0x7f67c8000ed0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.248+0000 7f67da5a2800 1 -- 172.21.15.134:0/3973505274 shutdown_connections 2024-04-24T02:12:20.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.248+0000 7f67da5a2800 1 --2- 172.21.15.134:0/3973505274 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c2bd7ac290 0x55c2bd8ae240 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.248+0000 7f67da5a2800 1 --2- 172.21.15.134:0/3973505274 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f66c0036900 0x7f66c0038dc0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.248+0000 7f67da5a2800 1 --2- 172.21.15.134:0/3973505274 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2bd7aa750 0x55c2bd8a7000 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.248+0000 7f67da5a2800 1 -- 172.21.15.134:0/3973505274 >> 172.21.15.134:0/3973505274 conn(0x55c2bd7a6370 msgr2=0x55c2bd899670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:20.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.248+0000 7f67da5a2800 1 -- 172.21.15.134:0/3973505274 shutdown_connections 2024-04-24T02:12:20.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.248+0000 7f67da5a2800 1 -- 172.21.15.134:0/3973505274 wait complete. 2024-04-24T02:12:20.399 INFO:teuthology.orchestra.run.smithi134.stdout:[] 2024-04-24T02:12:20.399 DEBUG:tasks.util.rgw: json result: [] 2024-04-24T02:12:20.400 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-04-24T02:12:20.400 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-04-24T02:12:20.400 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-04-24T02:12:20.443 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:20.443 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:20.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.442+0000 7f34d130a800 1 Processor -- start 2024-04-24T02:12:20.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.442+0000 7f34d130a800 1 -- start start 2024-04-24T02:12:20.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.442+0000 7f34d130a800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x564e830561b0 0x564e830585a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.443+0000 7f34d130a800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564e82f11d40 con 0x564e83051d20 2024-04-24T02:12:20.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.443+0000 7f34d130a800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x564e82ee44d0 con 0x564e830561b0 2024-04-24T02:12:20.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.443+0000 7f34c6608640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x564e830561b0 0x564e830585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.443+0000 7f34c6608640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x564e830561b0 0x564e830585a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45152/0 (socket says 172.21.15.134:45152) 2024-04-24T02:12:20.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.443+0000 7f34c6608640 1 -- 172.21.15.134:0/2250113563 learned_addr learned my addr 172.21.15.134:0/2250113563 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:20.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.443+0000 7f34c6608640 1 -- 172.21.15.134:0/2250113563 >> v1:172.21.15.104:6789/0 conn(0x564e83051d20 legacy=0x564e83052140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.443+0000 7f34c6608640 1 -- 172.21.15.134:0/2250113563 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e82f10590 con 0x564e830561b0 2024-04-24T02:12:20.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.445+0000 7f34c6608640 1 --2- 172.21.15.134:0/2250113563 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564e830561b0 0x564e830585a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f34b800a520 tx=0x7f34b801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75b554c5d0cd52a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.445+0000 7f34ce608640 1 -- 172.21.15.134:0/2250113563 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34b8057070 con 0x564e830561b0 2024-04-24T02:12:20.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.445+0000 7f34ce608640 1 -- 172.21.15.134:0/2250113563 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34b8052570 con 0x564e830561b0 2024-04-24T02:12:20.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.445+0000 7f34ce608640 1 -- 172.21.15.134:0/2250113563 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34b804ae60 con 0x564e830561b0 2024-04-24T02:12:20.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.446+0000 7f34d130a800 1 -- 172.21.15.134:0/2250113563 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564e830561b0 msgr2=0x564e830585a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.446+0000 7f34d130a800 1 --2- 172.21.15.134:0/2250113563 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564e830561b0 0x564e830585a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f34b800a520 tx=0x7f34b801d010 comp rx=0 tx=0).stop 2024-04-24T02:12:20.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.446+0000 7f34d130a800 1 -- 172.21.15.134:0/2250113563 shutdown_connections 2024-04-24T02:12:20.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.446+0000 7f34d130a800 1 --2- 172.21.15.134:0/2250113563 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564e830561b0 0x564e830585a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.446+0000 7f34d130a800 1 -- 172.21.15.134:0/2250113563 >> 172.21.15.134:0/2250113563 conn(0x564e8304d380 msgr2=0x564e8304f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:20.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.446+0000 7f34d130a800 1 -- 172.21.15.134:0/2250113563 shutdown_connections 2024-04-24T02:12:20.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.446+0000 7f34d130a800 1 -- 172.21.15.134:0/2250113563 wait complete. 2024-04-24T02:12:20.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.457+0000 7f34d130a800 1 Processor -- start 2024-04-24T02:12:20.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.457+0000 7f34d130a800 1 -- start start 2024-04-24T02:12:20.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.457+0000 7f34d130a800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564e83051d20 0x564e83142fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.458+0000 7f34d130a800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x564e82f9e3c0 con 0x564e83051d20 2024-04-24T02:12:20.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.458+0000 7f34cee09640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564e83051d20 0x564e83142fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.458+0000 7f34cee09640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564e83051d20 0x564e83142fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45166/0 (socket says 172.21.15.134:45166) 2024-04-24T02:12:20.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.458+0000 7f34cee09640 1 -- 172.21.15.134:0/359820952 learned_addr learned my addr 172.21.15.134:0/359820952 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:20.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.458+0000 7f34cee09640 1 -- 172.21.15.134:0/359820952 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e831435a0 con 0x564e83051d20 2024-04-24T02:12:20.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.458+0000 7f34cee09640 1 --2- 172.21.15.134:0/359820952 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564e83051d20 0x564e83142fd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f34c0001d50 tx=0x7f34c000b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=471187d60395155b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.458+0000 7f33bce09640 1 -- 172.21.15.134:0/359820952 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34c000f400 con 0x564e83051d20 2024-04-24T02:12:20.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.458+0000 7f33bce09640 1 -- 172.21.15.134:0/359820952 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34c000f5a0 con 0x564e83051d20 2024-04-24T02:12:20.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.458+0000 7f33bce09640 1 -- 172.21.15.134:0/359820952 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34c000f7d0 con 0x564e83051d20 2024-04-24T02:12:20.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.459+0000 7f34d130a800 1 -- 172.21.15.134:0/359820952 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564e83051d20 msgr2=0x564e83142fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.459+0000 7f34d130a800 1 --2- 172.21.15.134:0/359820952 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564e83051d20 0x564e83142fd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f34c0001d50 tx=0x7f34c000b5b0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.459+0000 7f34d130a800 1 -- 172.21.15.134:0/359820952 shutdown_connections 2024-04-24T02:12:20.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.459+0000 7f34d130a800 1 --2- 172.21.15.134:0/359820952 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564e83051d20 0x564e83142fd0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.459+0000 7f34d130a800 1 -- 172.21.15.134:0/359820952 >> 172.21.15.134:0/359820952 conn(0x564e8304d380 msgr2=0x564e8313e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:20.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.459+0000 7f34d130a800 1 -- 172.21.15.134:0/359820952 shutdown_connections 2024-04-24T02:12:20.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.459+0000 7f34d130a800 1 -- 172.21.15.134:0/359820952 wait complete. 2024-04-24T02:12:20.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.459+0000 7f34d130a800 1 Processor -- start 2024-04-24T02:12:20.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.460+0000 7f34d130a800 1 -- start start 2024-04-24T02:12:20.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.460+0000 7f34d130a800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564e83051d20 0x564e82fc6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.460+0000 7f34d130a800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x564e83058e70 con 0x564e83051d20 2024-04-24T02:12:20.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.460+0000 7f34cee09640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564e83051d20 0x564e82fc6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.460+0000 7f34cee09640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564e83051d20 0x564e82fc6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45168/0 (socket says 172.21.15.134:45168) 2024-04-24T02:12:20.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.460+0000 7f34cee09640 1 -- 172.21.15.134:0/3940313924 learned_addr learned my addr 172.21.15.134:0/3940313924 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:20.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.460+0000 7f34cee09640 1 -- 172.21.15.134:0/3940313924 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e8314e920 con 0x564e83051d20 2024-04-24T02:12:20.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.460+0000 7f34cee09640 1 --2- 172.21.15.134:0/3940313924 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564e83051d20 0x564e82fc6030 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x564e83143d60 tx=0x7f34c0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.461+0000 7f33bb606640 1 -- 172.21.15.134:0/3940313924 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34c001a7c0 con 0x564e83051d20 2024-04-24T02:12:20.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.461+0000 7f33bb606640 1 -- 172.21.15.134:0/3940313924 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34c001a960 con 0x564e83051d20 2024-04-24T02:12:20.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.461+0000 7f33bb606640 1 -- 172.21.15.134:0/3940313924 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34c001ac60 con 0x564e83051d20 2024-04-24T02:12:20.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.461+0000 7f34d130a800 1 -- 172.21.15.134:0/3940313924 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564e8314eaf0 con 0x564e83051d20 2024-04-24T02:12:20.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.461+0000 7f34d130a800 1 -- 172.21.15.134:0/3940313924 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e8314f010 con 0x564e83051d20 2024-04-24T02:12:20.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.462+0000 7f33bb606640 1 -- 172.21.15.134:0/3940313924 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f34c0017070 con 0x564e83051d20 2024-04-24T02:12:20.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.462+0000 7f33bb606640 1 --2- 172.21.15.134:0/3940313924 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f33b4036900 0x7f33b4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.462+0000 7f33bb606640 1 -- 172.21.15.134:0/3940313924 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f34c0015020 con 0x564e83051d20 2024-04-24T02:12:20.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.462+0000 7f34c6608640 1 --2- 172.21.15.134:0/3940313924 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f33b4036900 0x7f33b4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.462+0000 7f34d130a800 1 --2- 172.21.15.134:0/3940313924 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x564e830561b0 0x564e83152e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.462+0000 7f34d130a800 1 -- 172.21.15.134:0/3940313924 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564e83153470 con 0x564e830561b0 2024-04-24T02:12:20.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.462+0000 7f34cf60a640 1 --2- 172.21.15.134:0/3940313924 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x564e830561b0 0x564e83152e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.462+0000 7f34c6608640 1 --2- 172.21.15.134:0/3940313924 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f33b4036900 0x7f33b4038dc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f34b8054000 tx=0x7f34b804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.462+0000 7f34cf60a640 1 --2- 172.21.15.134:0/3940313924 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x564e830561b0 0x564e83152e50 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.462+0000 7f34cf60a640 1 -- 172.21.15.134:0/3940313924 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f34c800a4a0 con 0x564e830561b0 2024-04-24T02:12:20.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.463+0000 7f34d130a800 1 -- 172.21.15.134:0/3940313924 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564e831503e0 con 0x564e830561b0 2024-04-24T02:12:20.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.463+0000 7f34cf60a640 1 -- 172.21.15.134:0/3940313924 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f34c800a4a0 con 0x564e830561b0 2024-04-24T02:12:20.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.463+0000 7f34d130a800 1 -- 172.21.15.134:0/3940313924 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564e83155290 con 0x564e830561b0 2024-04-24T02:12:20.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.463+0000 7f34cf60a640 1 -- 172.21.15.134:0/3940313924 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f34c800a4a0 con 0x564e830561b0 2024-04-24T02:12:20.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.463+0000 7f34d130a800 1 -- 172.21.15.134:0/3940313924 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564e831545d0 con 0x564e830561b0 2024-04-24T02:12:20.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.463+0000 7f34cf60a640 1 -- 172.21.15.134:0/3940313924 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f34c800a4a0 con 0x564e830561b0 2024-04-24T02:12:20.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.463+0000 7f34d130a800 1 -- 172.21.15.134:0/3940313924 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564e831549f0 con 0x564e830561b0 2024-04-24T02:12:20.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.464+0000 7f34cf60a640 1 -- 172.21.15.134:0/3940313924 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f34c800a4a0 con 0x564e830561b0 2024-04-24T02:12:20.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.464+0000 7f34d130a800 1 Processor -- start 2024-04-24T02:12:20.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.464+0000 7f34d130a800 1 -- start start 2024-04-24T02:12:20.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.464+0000 7f34d130a800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564e83164020 0x564e83164440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.464+0000 7f34d130a800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x564e82f446b0 con 0x564e83164020 2024-04-24T02:12:20.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.464+0000 7f34c6608640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564e83164020 0x564e83164440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.464+0000 7f34c6608640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564e83164020 0x564e83164440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45172/0 (socket says 172.21.15.134:45172) 2024-04-24T02:12:20.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.464+0000 7f34c6608640 1 -- 172.21.15.134:0/3349996615 learned_addr learned my addr 172.21.15.134:0/3349996615 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:20.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.465+0000 7f34c6608640 1 -- 172.21.15.134:0/3349996615 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e83164980 con 0x564e83164020 2024-04-24T02:12:20.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.465+0000 7f34c6608640 1 --2- 172.21.15.134:0/3349996615 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564e83164020 0x564e83164440 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f34b8000c00 tx=0x7f34b8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.465+0000 7f33b8e01640 1 -- 172.21.15.134:0/3349996615 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34b8057040 con 0x564e83164020 2024-04-24T02:12:20.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.465+0000 7f33b8e01640 1 -- 172.21.15.134:0/3349996615 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34b805d650 con 0x564e83164020 2024-04-24T02:12:20.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.465+0000 7f34d130a800 1 -- 172.21.15.134:0/3349996615 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564e831653f0 con 0x564e83164020 2024-04-24T02:12:20.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.465+0000 7f33b8e01640 1 -- 172.21.15.134:0/3349996615 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34b805d930 con 0x564e83164020 2024-04-24T02:12:20.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.465+0000 7f34d130a800 1 -- 172.21.15.134:0/3349996615 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e83165890 con 0x564e83164020 2024-04-24T02:12:20.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.466+0000 7f33b8e01640 1 -- 172.21.15.134:0/3349996615 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f34b8067070 con 0x564e83164020 2024-04-24T02:12:20.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.466+0000 7f33b8e01640 1 --2- 172.21.15.134:0/3349996615 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f33a8036900 0x7f33a8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.466+0000 7f33b8e01640 1 -- 172.21.15.134:0/3349996615 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f34b808f5a0 con 0x564e83164020 2024-04-24T02:12:20.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.466+0000 7f34cf60a640 1 --2- 172.21.15.134:0/3349996615 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f33a8036900 0x7f33a8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.466+0000 7f34d130a800 1 Processor -- start 2024-04-24T02:12:20.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.467+0000 7f34cf60a640 1 --2- 172.21.15.134:0/3349996615 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f33a8036900 0x7f33a8038dc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x564e83154970 tx=0x7f34c8005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.467+0000 7f34d130a800 1 -- start start 2024-04-24T02:12:20.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.467+0000 7f34d130a800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564e83171260 0x564e83171680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.467+0000 7f34d130a800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x564e83143920 con 0x564e83171260 2024-04-24T02:12:20.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.467+0000 7f34c6608640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564e83171260 0x564e83171680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.467+0000 7f34c6608640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564e83171260 0x564e83171680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45178/0 (socket says 172.21.15.134:45178) 2024-04-24T02:12:20.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.467+0000 7f34c6608640 1 -- 172.21.15.134:0/778526638 learned_addr learned my addr 172.21.15.134:0/778526638 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:20.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.467+0000 7f34c6608640 1 -- 172.21.15.134:0/778526638 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e83171c50 con 0x564e83171260 2024-04-24T02:12:20.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.468+0000 7f34c6608640 1 --2- 172.21.15.134:0/778526638 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564e83171260 0x564e83171680 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f34b808db70 tx=0x7f34b8071a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94c554867b4da686 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.468+0000 7f33b27fc640 1 -- 172.21.15.134:0/778526638 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34b8000ed0 con 0x564e83171260 2024-04-24T02:12:20.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.468+0000 7f33b27fc640 1 -- 172.21.15.134:0/778526638 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34b8068c50 con 0x564e83171260 2024-04-24T02:12:20.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.468+0000 7f33b27fc640 1 -- 172.21.15.134:0/778526638 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34b8001070 con 0x564e83171260 2024-04-24T02:12:20.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.468+0000 7f34d130a800 1 -- 172.21.15.134:0/778526638 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564e83171260 msgr2=0x564e83171680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.468+0000 7f34d130a800 1 --2- 172.21.15.134:0/778526638 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564e83171260 0x564e83171680 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f34b808db70 tx=0x7f34b8071a90 comp rx=0 tx=0).stop 2024-04-24T02:12:20.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.468+0000 7f34d130a800 1 -- 172.21.15.134:0/778526638 shutdown_connections 2024-04-24T02:12:20.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.468+0000 7f34d130a800 1 --2- 172.21.15.134:0/778526638 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564e83171260 0x564e83171680 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.468+0000 7f34d130a800 1 -- 172.21.15.134:0/778526638 >> 172.21.15.134:0/778526638 conn(0x564e8316d5c0 msgr2=0x564e8316b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:20.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.468+0000 7f34d130a800 1 -- 172.21.15.134:0/778526638 shutdown_connections 2024-04-24T02:12:20.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.468+0000 7f34d130a800 1 -- 172.21.15.134:0/778526638 wait complete. 2024-04-24T02:12:20.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.468+0000 7f34d130a800 1 Processor -- start 2024-04-24T02:12:20.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.468+0000 7f34d130a800 1 -- start start 2024-04-24T02:12:20.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.469+0000 7f34d130a800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564e83171260 0x564e831788c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.469+0000 7f34d130a800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x564e831723c0 con 0x564e83171260 2024-04-24T02:12:20.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.469+0000 7f34c6608640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564e83171260 0x564e831788c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.469+0000 7f34c6608640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564e83171260 0x564e831788c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45188/0 (socket says 172.21.15.134:45188) 2024-04-24T02:12:20.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.469+0000 7f34c6608640 1 -- 172.21.15.134:0/2932129922 learned_addr learned my addr 172.21.15.134:0/2932129922 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:20.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.469+0000 7f34c6608640 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e83178e00 con 0x564e83171260 2024-04-24T02:12:20.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.469+0000 7f34c6608640 1 --2- 172.21.15.134:0/2932129922 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564e83171260 0x564e831788c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f34b805cec0 tx=0x7f34b808dad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.470+0000 7f33b0ff9640 1 -- 172.21.15.134:0/2932129922 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34b8067840 con 0x564e83171260 2024-04-24T02:12:20.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.470+0000 7f33b0ff9640 1 -- 172.21.15.134:0/2932129922 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34b8093030 con 0x564e83171260 2024-04-24T02:12:20.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.470+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564e83179090 con 0x564e83171260 2024-04-24T02:12:20.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.470+0000 7f33b0ff9640 1 -- 172.21.15.134:0/2932129922 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34b808c6b0 con 0x564e83171260 2024-04-24T02:12:20.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.470+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e8317bd40 con 0x564e83171260 2024-04-24T02:12:20.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.470+0000 7f33b0ff9640 1 -- 172.21.15.134:0/2932129922 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f34b808f940 con 0x564e83171260 2024-04-24T02:12:20.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.471+0000 7f33b0ff9640 1 --2- 172.21.15.134:0/2932129922 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3398036900 0x7f3398038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.471+0000 7f33b0ff9640 1 -- 172.21.15.134:0/2932129922 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f34b8099ad0 con 0x564e83171260 2024-04-24T02:12:20.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.471+0000 7f34cf60a640 1 --2- 172.21.15.134:0/2932129922 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3398036900 0x7f3398038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.471+0000 7f34d130a800 20 rados->read ofs=0 len=0 2024-04-24T02:12:20.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.471+0000 7f34d130a800 1 --2- 172.21.15.134:0/2932129922 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x564e83184400 0x564e831868c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.471+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564e83187010 con 0x564e83184400 2024-04-24T02:12:20.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.471+0000 7f34cee09640 1 --2- 172.21.15.134:0/2932129922 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x564e83184400 0x564e831868c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.471+0000 7f34cf60a640 1 --2- 172.21.15.134:0/2932129922 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3398036900 0x7f3398038dc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x564e831540f0 tx=0x7f34c801f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.471+0000 7f34cee09640 1 --2- 172.21.15.134:0/2932129922 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x564e83184400 0x564e831868c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.472+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f34c002e070 con 0x564e83184400 2024-04-24T02:12:20.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.472+0000 7f34d130a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:20.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.472+0000 7f34d130a800 20 realm 2024-04-24T02:12:20.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.472+0000 7f34d130a800 20 rados->read ofs=0 len=0 2024-04-24T02:12:20.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.472+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564e83187420 con 0x564e83184400 2024-04-24T02:12:20.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.472+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f34c002e070 con 0x564e83184400 2024-04-24T02:12:20.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.472+0000 7f34d130a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:20.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.472+0000 7f34d130a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:20.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.472+0000 7f34d130a800 20 rados->read ofs=0 len=0 2024-04-24T02:12:20.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.472+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564e83187cf0 con 0x564e83184400 2024-04-24T02:12:20.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.472+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f34c002e070 con 0x564e83184400 2024-04-24T02:12:20.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.472+0000 7f34d130a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:20.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.472+0000 7f34d130a800 20 rados->read ofs=0 len=0 2024-04-24T02:12:20.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.472+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564e83188090 con 0x564e83184400 2024-04-24T02:12:20.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.472+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f34c002e070 con 0x564e83184400 2024-04-24T02:12:20.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.472+0000 7f34d130a800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:20.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.472+0000 7f34d130a800 20 rados->read ofs=0 len=0 2024-04-24T02:12:20.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.472+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564e831888e0 con 0x564e83184400 2024-04-24T02:12:20.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.473+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f34c002e070 con 0x564e83184400 2024-04-24T02:12:20.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.473+0000 7f34d130a800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:20.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.473+0000 7f34d130a800 20 searching for the correct realm 2024-04-24T02:12:20.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.473+0000 7f34d130a800 1 --2- 172.21.15.134:0/2932129922 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x564e8318a650 0x564e8318ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.473+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564e8318d050 con 0x564e8318a650 2024-04-24T02:12:20.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.473+0000 7f34c6608640 1 --2- 172.21.15.134:0/2932129922 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x564e8318a650 0x564e8318ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.473+0000 7f34c6608640 1 --2- 172.21.15.134:0/2932129922 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x564e8318a650 0x564e8318ca40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.473+0000 7f34c6608640 1 -- 172.21.15.134:0/2932129922 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34b8066030 con 0x564e8318a650 2024-04-24T02:12:20.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.473+0000 7f34c6608640 1 --2- 172.21.15.134:0/2932129922 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f34b8086050 0x7f34b80706a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.473+0000 7f34c6608640 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564e8318d050 con 0x7f34b8086050 2024-04-24T02:12:20.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.473+0000 7f34cf60a640 1 --2- 172.21.15.134:0/2932129922 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f34b8086050 0x7f34b80706a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.474+0000 7f34cf60a640 1 --2- 172.21.15.134:0/2932129922 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f34b8086050 0x7f34b80706a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.474+0000 7f34cf60a640 1 -- 172.21.15.134:0/2932129922 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34c801f070 con 0x7f34b8086050 2024-04-24T02:12:20.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.474+0000 7f34cf60a640 1 --2- 172.21.15.134:0/2932129922 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f34c8031040 0x7f34c8032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.474+0000 7f34cf60a640 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564e8318d050 con 0x7f34c8031040 2024-04-24T02:12:20.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.474+0000 7f34cee09640 1 --2- 172.21.15.134:0/2932129922 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f34c8031040 0x7f34c8032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.475+0000 7f34cee09640 1 --2- 172.21.15.134:0/2932129922 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f34c8031040 0x7f34c8032940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.475+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34c002e070 con 0x7f34c8031040 2024-04-24T02:12:20.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.475+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564e8318d050 con 0x564e83184400 2024-04-24T02:12:20.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.475+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34c002e070 con 0x564e83184400 2024-04-24T02:12:20.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.475+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564e8318d050 con 0x564e83184400 2024-04-24T02:12:20.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.475+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f34c002e070 con 0x564e83184400 2024-04-24T02:12:20.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.475+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564e8318d050 con 0x7f34c8031040 2024-04-24T02:12:20.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.476+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34c002e070 con 0x7f34c8031040 2024-04-24T02:12:20.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.476+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564e8318d050 con 0x7f34c8031040 2024-04-24T02:12:20.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.476+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34c002e070 con 0x7f34c8031040 2024-04-24T02:12:20.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.476+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564e8318d050 con 0x7f34b8086050 2024-04-24T02:12:20.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.476+0000 7f34cf60a640 1 -- 172.21.15.134:0/2932129922 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34c801f070 con 0x7f34b8086050 2024-04-24T02:12:20.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.476+0000 7f34cf60a640 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564e8318d050 con 0x564e8318a650 2024-04-24T02:12:20.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.476+0000 7f34c6608640 1 -- 172.21.15.134:0/2932129922 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34b8066030 con 0x564e8318a650 2024-04-24T02:12:20.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.476+0000 7f34c6608640 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564e8318d050 con 0x564e83184400 2024-04-24T02:12:20.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.477+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34c002e070 con 0x564e83184400 2024-04-24T02:12:20.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.477+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564e8318d050 con 0x7f34c8031040 2024-04-24T02:12:20.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.477+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34c002e070 con 0x7f34c8031040 2024-04-24T02:12:20.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.477+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564e8318d050 con 0x564e83184400 2024-04-24T02:12:20.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.477+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34c002e070 con 0x564e83184400 2024-04-24T02:12:20.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.477+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564e8318d050 con 0x7f34b8086050 2024-04-24T02:12:20.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.477+0000 7f34cf60a640 1 -- 172.21.15.134:0/2932129922 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f34c801f070 con 0x7f34b8086050 2024-04-24T02:12:20.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.477+0000 7f34cf60a640 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564e8318d050 con 0x564e8318a650 2024-04-24T02:12:20.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.478+0000 7f34c6608640 1 -- 172.21.15.134:0/2932129922 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34b8066030 con 0x564e8318a650 2024-04-24T02:12:20.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.478+0000 7f34c6608640 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564e8318d050 con 0x564e8318a650 2024-04-24T02:12:20.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.478+0000 7f34c6608640 1 -- 172.21.15.134:0/2932129922 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34b8066030 con 0x564e8318a650 2024-04-24T02:12:20.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.478+0000 7f34c6608640 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564e8318d050 con 0x7f34c8031040 2024-04-24T02:12:20.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.478+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34c002e070 con 0x7f34c8031040 2024-04-24T02:12:20.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.478+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564e8318d050 con 0x564e8318a650 2024-04-24T02:12:20.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.479+0000 7f34c6608640 1 -- 172.21.15.134:0/2932129922 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34b8066030 con 0x564e8318a650 2024-04-24T02:12:20.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.479+0000 7f34c6608640 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564e8318d050 con 0x564e8318a650 2024-04-24T02:12:20.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.479+0000 7f34c6608640 1 -- 172.21.15.134:0/2932129922 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34b8066030 con 0x564e8318a650 2024-04-24T02:12:20.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.479+0000 7f34c6608640 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564e8318d050 con 0x564e83184400 2024-04-24T02:12:20.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.479+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34c002e070 con 0x564e83184400 2024-04-24T02:12:20.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.479+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564e8318d050 con 0x564e83184400 2024-04-24T02:12:20.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.479+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v23'2 uv2 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f34c002e070 con 0x564e83184400 2024-04-24T02:12:20.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.479+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564e8318d050 con 0x7f34c8031040 2024-04-24T02:12:20.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.480+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34c002e070 con 0x7f34c8031040 2024-04-24T02:12:20.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.480+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564e8318d050 con 0x564e8318a650 2024-04-24T02:12:20.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.480+0000 7f34c6608640 1 -- 172.21.15.134:0/2932129922 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34b8066030 con 0x564e8318a650 2024-04-24T02:12:20.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.480+0000 7f34c6608640 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564e8318d050 con 0x7f34b8086050 2024-04-24T02:12:20.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.480+0000 7f34cf60a640 1 -- 172.21.15.134:0/2932129922 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34c801f070 con 0x7f34b8086050 2024-04-24T02:12:20.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.480+0000 7f34cf60a640 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564e8318d050 con 0x564e83184400 2024-04-24T02:12:20.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.480+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34c002e070 con 0x564e83184400 2024-04-24T02:12:20.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.480+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564e8318d050 con 0x7f34c8031040 2024-04-24T02:12:20.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.481+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34c002e070 con 0x7f34c8031040 2024-04-24T02:12:20.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.481+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564e8318d050 con 0x564e8318a650 2024-04-24T02:12:20.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.481+0000 7f34c6608640 1 -- 172.21.15.134:0/2932129922 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34b8066030 con 0x564e8318a650 2024-04-24T02:12:20.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.481+0000 7f34c6608640 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564e8318d050 con 0x7f34c8031040 2024-04-24T02:12:20.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.481+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34c002e070 con 0x7f34c8031040 2024-04-24T02:12:20.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.481+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564e8318d050 con 0x7f34b8086050 2024-04-24T02:12:20.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.481+0000 7f34cf60a640 1 -- 172.21.15.134:0/2932129922 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34c801f070 con 0x7f34b8086050 2024-04-24T02:12:20.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.481+0000 7f34cf60a640 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564e8318d050 con 0x564e8318a650 2024-04-24T02:12:20.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.482+0000 7f34c6608640 1 -- 172.21.15.134:0/2932129922 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34b8066030 con 0x564e8318a650 2024-04-24T02:12:20.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.482+0000 7f34c6608640 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564e8318d050 con 0x7f34c8031040 2024-04-24T02:12:20.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.482+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34c002e070 con 0x7f34c8031040 2024-04-24T02:12:20.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.482+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564e8318d050 con 0x564e83184400 2024-04-24T02:12:20.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.482+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f34c002e070 con 0x564e83184400 2024-04-24T02:12:20.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.482+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564e8318d050 con 0x7f34b8086050 2024-04-24T02:12:20.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.483+0000 7f34cf60a640 1 -- 172.21.15.134:0/2932129922 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34c801f070 con 0x7f34b8086050 2024-04-24T02:12:20.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.483+0000 7f34d130a800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:20.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.483+0000 7f34d130a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:20.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.483+0000 7f34d130a800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:20.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.483+0000 7f34d130a800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:20.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.483+0000 7f34d130a800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:20.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.483+0000 7f34d130a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:20.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.483+0000 7f34d130a800 20 rados->read ofs=0 len=0 2024-04-24T02:12:20.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.483+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564e83189290 con 0x564e83184400 2024-04-24T02:12:20.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.483+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f34c002e070 con 0x564e83184400 2024-04-24T02:12:20.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.483+0000 7f34d130a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:20.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.483+0000 7f34d130a800 20 rados->read ofs=0 len=0 2024-04-24T02:12:20.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.483+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564e83189b30 con 0x564e83184400 2024-04-24T02:12:20.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.483+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f34c002e070 con 0x564e83184400 2024-04-24T02:12:20.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.483+0000 7f34d130a800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:20.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.483+0000 7f34d130a800 20 rados->read ofs=0 len=0 2024-04-24T02:12:20.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.483+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564e8318d4b0 con 0x564e83184400 2024-04-24T02:12:20.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.483+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f34c002e070 con 0x564e83184400 2024-04-24T02:12:20.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.483+0000 7f34d130a800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:20.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.483+0000 7f34d130a800 20 zone default found 2024-04-24T02:12:20.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.483+0000 7f34d130a800 4 Realm: () 2024-04-24T02:12:20.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.483+0000 7f34d130a800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:20.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.483+0000 7f34d130a800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:20.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.483+0000 7f34d130a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:20.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.483+0000 7f34d130a800 20 zonegroup default 2024-04-24T02:12:20.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.483+0000 7f34d130a800 20 rados->read ofs=0 len=0 2024-04-24T02:12:20.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.483+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564e8318d960 con 0x7f34c8031040 2024-04-24T02:12:20.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.484+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f34c002e070 con 0x7f34c8031040 2024-04-24T02:12:20.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.484+0000 7f34d130a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:20.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.484+0000 7f34d130a800 20 rados->read ofs=0 len=0 2024-04-24T02:12:20.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.484+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564e8318f340 con 0x564e8318a650 2024-04-24T02:12:20.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.484+0000 7f34c6608640 1 -- 172.21.15.134:0/2932129922 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f34b8066030 con 0x564e8318a650 2024-04-24T02:12:20.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.484+0000 7f34d130a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:20.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.484+0000 7f34d130a800 20 rados->read ofs=0 len=0 2024-04-24T02:12:20.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.484+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564e8318f730 con 0x564e8318a650 2024-04-24T02:12:20.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.484+0000 7f34c6608640 1 -- 172.21.15.134:0/2932129922 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f34b8066030 con 0x564e8318a650 2024-04-24T02:12:20.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.484+0000 7f34d130a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:20.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.484+0000 7f34d130a800 20 started sync module instance, tier type = 2024-04-24T02:12:20.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.484+0000 7f34d130a800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:20.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.484+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e8318e7d0 con 0x7f34b8086050 2024-04-24T02:12:20.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.485+0000 7f34cf60a640 1 -- 172.21.15.134:0/2932129922 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34c801f070 con 0x7f34b8086050 2024-04-24T02:12:20.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.485+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94895206886336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e8318e430 con 0x7f34b8086050 2024-04-24T02:12:20.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.485+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e83190660 con 0x564e83184400 2024-04-24T02:12:20.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.486+0000 7f34cf60a640 1 -- 172.21.15.134:0/2932129922 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94895206886336] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34c801f070 con 0x7f34b8086050 2024-04-24T02:12:20.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.487+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34c002e070 con 0x564e83184400 2024-04-24T02:12:20.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.487+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94895206890384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e83190660 con 0x564e83184400 2024-04-24T02:12:20.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.487+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e83191020 con 0x564e8318a650 2024-04-24T02:12:20.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.488+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94895206890384] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34c002e070 con 0x564e83184400 2024-04-24T02:12:20.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.489+0000 7f34c6608640 1 -- 172.21.15.134:0/2932129922 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34b8066030 con 0x564e8318a650 2024-04-24T02:12:20.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.489+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94895206891952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e831905d0 con 0x564e8318a650 2024-04-24T02:12:20.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.489+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e83191e90 con 0x7f34b8086050 2024-04-24T02:12:20.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.490+0000 7f34cf60a640 1 -- 172.21.15.134:0/2932129922 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34c801f070 con 0x7f34b8086050 2024-04-24T02:12:20.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.490+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94895206898656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e83192730 con 0x7f34b8086050 2024-04-24T02:12:20.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.490+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e83193200 con 0x564e83184400 2024-04-24T02:12:20.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.490+0000 7f34c6608640 1 -- 172.21.15.134:0/2932129922 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94895206891952] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34b8066030 con 0x564e8318a650 2024-04-24T02:12:20.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.491+0000 7f34cf60a640 1 -- 172.21.15.134:0/2932129922 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94895206898656] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34c801f070 con 0x7f34b8086050 2024-04-24T02:12:20.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.491+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34c002e070 con 0x564e83184400 2024-04-24T02:12:20.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.491+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94895206903024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e83192280 con 0x564e83184400 2024-04-24T02:12:20.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.491+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e83193ad0 con 0x7f34c8031040 2024-04-24T02:12:20.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.492+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34c002e070 con 0x7f34c8031040 2024-04-24T02:12:20.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.492+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94895206905072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e83193dc0 con 0x7f34c8031040 2024-04-24T02:12:20.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.492+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e83194670 con 0x7f34c8031040 2024-04-24T02:12:20.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.492+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94895206903024] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34c002e070 con 0x564e83184400 2024-04-24T02:12:20.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.494+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(56 notify.6 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34c002e070 con 0x7f34c8031040 2024-04-24T02:12:20.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.494+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94895206896576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e83194850 con 0x7f34c8031040 2024-04-24T02:12:20.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.494+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e831950a0 con 0x7f34c8031040 2024-04-24T02:12:20.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.494+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94895206905072] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34c002e070 con 0x7f34c8031040 2024-04-24T02:12:20.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.495+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(58 notify.7 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34c002e070 con 0x7f34c8031040 2024-04-24T02:12:20.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.495+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94895206910032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e83195120 con 0x7f34c8031040 2024-04-24T02:12:20.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.495+0000 7f34d130a800 20 add_watcher() i=0 2024-04-24T02:12:20.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.495+0000 7f34d130a800 20 add_watcher() i=1 2024-04-24T02:12:20.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.495+0000 7f34d130a800 20 add_watcher() i=2 2024-04-24T02:12:20.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.495+0000 7f34d130a800 20 add_watcher() i=3 2024-04-24T02:12:20.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.495+0000 7f34d130a800 20 add_watcher() i=4 2024-04-24T02:12:20.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.495+0000 7f34d130a800 20 add_watcher() i=5 2024-04-24T02:12:20.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.495+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94895206896576] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34c002e070 con 0x7f34c8031040 2024-04-24T02:12:20.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.495+0000 7f34d130a800 20 add_watcher() i=6 2024-04-24T02:12:20.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.496+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94895206910032] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34c002e070 con 0x7f34c8031040 2024-04-24T02:12:20.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.496+0000 7f34d130a800 20 add_watcher() i=7 2024-04-24T02:12:20.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.496+0000 7f34d130a800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:20.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.496+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564e83198150 con 0x564e83184400 2024-04-24T02:12:20.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.496+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f34c002e070 con 0x564e83184400 2024-04-24T02:12:20.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.496+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94895206911088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e83195540 con 0x564e83184400 2024-04-24T02:12:20.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.497+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94895206911088] v30'32 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f34c002e070 con 0x564e83184400 2024-04-24T02:12:20.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.497+0000 7f33857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:20.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.497+0000 7f34d130a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:20.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.497+0000 7f34d130a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:20.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.498+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e831a08c0 con 0x564e83184400 2024-04-24T02:12:20.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.499+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'40 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f34c002e070 con 0x564e83184400 2024-04-24T02:12:20.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.499+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e831a0f90 con 0x7f34c8031040 2024-04-24T02:12:20.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.500+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f34c002e070 con 0x7f34c8031040 2024-04-24T02:12:20.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.500+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e831a0f90 con 0x564e8318a650 2024-04-24T02:12:20.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.501+0000 7f34c6608640 1 -- 172.21.15.134:0/2932129922 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f34b8066030 con 0x564e8318a650 2024-04-24T02:12:20.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.501+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e831a1330 con 0x564e83184400 2024-04-24T02:12:20.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.502+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'33 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f34c002e070 con 0x564e83184400 2024-04-24T02:12:20.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.502+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e831a0090 con 0x7f34b8086050 2024-04-24T02:12:20.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.503+0000 7f34cf60a640 1 -- 172.21.15.134:0/2932129922 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'26 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f34c801f070 con 0x7f34b8086050 2024-04-24T02:12:20.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.503+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e831a0090 con 0x564e8318a650 2024-04-24T02:12:20.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.504+0000 7f34c6608640 1 -- 172.21.15.134:0/2932129922 <== osd.3 v2:172.21.15.134:6801/3585115521 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'27 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f34b8066030 con 0x564e8318a650 2024-04-24T02:12:20.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.504+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e831a1c20 con 0x564e83184400 2024-04-24T02:12:20.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.506+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f34c002e070 con 0x564e83184400 2024-04-24T02:12:20.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.506+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e831a1c20 con 0x7f34c8031040 2024-04-24T02:12:20.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.507+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'20 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f34c002e070 con 0x7f34c8031040 2024-04-24T02:12:20.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.507+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e831a1c20 con 0x7f34b8086050 2024-04-24T02:12:20.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.508+0000 7f34cf60a640 1 -- 172.21.15.134:0/2932129922 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f34c801f070 con 0x7f34b8086050 2024-04-24T02:12:20.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.508+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e831a21b0 con 0x564e8318a650 2024-04-24T02:12:20.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.509+0000 7f34c6608640 1 -- 172.21.15.134:0/2932129922 <== osd.3 v2:172.21.15.134:6801/3585115521 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f34b8066030 con 0x564e8318a650 2024-04-24T02:12:20.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.509+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e831a2550 con 0x7f34b8086050 2024-04-24T02:12:20.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.510+0000 7f34cf60a640 1 -- 172.21.15.134:0/2932129922 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'27 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34c801f070 con 0x7f34b8086050 2024-04-24T02:12:20.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.510+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e831a2ac0 con 0x7f34c8031040 2024-04-24T02:12:20.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.511+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34c002e070 con 0x7f34c8031040 2024-04-24T02:12:20.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.511+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e831a2ac0 con 0x7f34b8086050 2024-04-24T02:12:20.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.512+0000 7f34cf60a640 1 -- 172.21.15.134:0/2932129922 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'16 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34c801f070 con 0x7f34b8086050 2024-04-24T02:12:20.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.512+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e831a2f70 con 0x7f34c8031040 2024-04-24T02:12:20.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.515+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.0 v2:172.21.15.104:6800/2419146313 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'31 uv16 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34c002e070 con 0x7f34c8031040 2024-04-24T02:12:20.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.515+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e831a2f70 con 0x564e83184400 2024-04-24T02:12:20.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.517+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'34 uv16 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34c002e070 con 0x564e83184400 2024-04-24T02:12:20.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.517+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e831a2f70 con 0x564e8318a650 2024-04-24T02:12:20.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.520+0000 7f34c6608640 1 -- 172.21.15.134:0/2932129922 <== osd.3 v2:172.21.15.134:6801/3585115521 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'20 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34b8066030 con 0x564e8318a650 2024-04-24T02:12:20.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.520+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e831a2f70 con 0x7f34b8086050 2024-04-24T02:12:20.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.523+0000 7f34cf60a640 1 -- 172.21.15.134:0/2932129922 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'28 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34c801f070 con 0x7f34b8086050 2024-04-24T02:12:20.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.523+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e831a2f70 con 0x564e8318a650 2024-04-24T02:12:20.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.526+0000 7f34c6608640 1 -- 172.21.15.134:0/2932129922 <== osd.3 v2:172.21.15.134:6801/3585115521 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'22 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34b8066030 con 0x564e8318a650 2024-04-24T02:12:20.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.526+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e831a2f70 con 0x564e83184400 2024-04-24T02:12:20.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.527+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34c002e070 con 0x564e83184400 2024-04-24T02:12:20.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.527+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e831a2f70 con 0x564e83184400 2024-04-24T02:12:20.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.529+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'35 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34c002e070 con 0x564e83184400 2024-04-24T02:12:20.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.529+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e831a2f70 con 0x564e8318a650 2024-04-24T02:12:20.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.531+0000 7f34c6608640 1 -- 172.21.15.134:0/2932129922 <== osd.3 v2:172.21.15.134:6801/3585115521 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'21 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34b8066030 con 0x564e8318a650 2024-04-24T02:12:20.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.531+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e831a2f70 con 0x7f34b8086050 2024-04-24T02:12:20.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.532+0000 7f34cf60a640 1 -- 172.21.15.134:0/2932129922 <== osd.2 v2:172.21.15.134:6800/214480313 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'26 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34c801f070 con 0x7f34b8086050 2024-04-24T02:12:20.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.532+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e831a2f70 con 0x564e8318a650 2024-04-24T02:12:20.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.535+0000 7f34c6608640 1 -- 172.21.15.134:0/2932129922 <== osd.3 v2:172.21.15.134:6801/3585115521 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34b8066030 con 0x564e8318a650 2024-04-24T02:12:20.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.535+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e831a2f70 con 0x564e8318a650 2024-04-24T02:12:20.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.536+0000 7f34c6608640 1 -- 172.21.15.134:0/2932129922 <== osd.3 v2:172.21.15.134:6801/3585115521 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'28 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34b8066030 con 0x564e8318a650 2024-04-24T02:12:20.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.536+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e831a2f70 con 0x564e8318a650 2024-04-24T02:12:20.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.538+0000 7f34c6608640 1 -- 172.21.15.134:0/2932129922 <== osd.3 v2:172.21.15.134:6801/3585115521 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34b8066030 con 0x564e8318a650 2024-04-24T02:12:20.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.538+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e831a2f70 con 0x564e8318a650 2024-04-24T02:12:20.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.541+0000 7f34c6608640 1 -- 172.21.15.134:0/2932129922 <== osd.3 v2:172.21.15.134:6801/3585115521 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'28 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34b8066030 con 0x564e8318a650 2024-04-24T02:12:20.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.541+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e831a2f70 con 0x7f34c8031040 2024-04-24T02:12:20.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.542+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.0 v2:172.21.15.104:6800/2419146313 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'18 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34c002e070 con 0x7f34c8031040 2024-04-24T02:12:20.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.542+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e831a2f70 con 0x564e8318a650 2024-04-24T02:12:20.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.543+0000 7f34c6608640 1 -- 172.21.15.134:0/2932129922 <== osd.3 v2:172.21.15.134:6801/3585115521 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'22 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34b8066030 con 0x564e8318a650 2024-04-24T02:12:20.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.543+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e831a2f70 con 0x7f34c8031040 2024-04-24T02:12:20.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.544+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.0 v2:172.21.15.104:6800/2419146313 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'21 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34c002e070 con 0x7f34c8031040 2024-04-24T02:12:20.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.544+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e831a2f70 con 0x564e8318a650 2024-04-24T02:12:20.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.546+0000 7f34c6608640 1 -- 172.21.15.134:0/2932129922 <== osd.3 v2:172.21.15.134:6801/3585115521 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34b8066030 con 0x564e8318a650 2024-04-24T02:12:20.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.546+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e831a2f70 con 0x7f34c8031040 2024-04-24T02:12:20.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.547+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.0 v2:172.21.15.104:6800/2419146313 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'32 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34c002e070 con 0x7f34c8031040 2024-04-24T02:12:20.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.547+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e831a2f70 con 0x7f34b8086050 2024-04-24T02:12:20.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.548+0000 7f34cf60a640 1 -- 172.21.15.134:0/2932129922 <== osd.2 v2:172.21.15.134:6800/214480313 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34c801f070 con 0x7f34b8086050 2024-04-24T02:12:20.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.548+0000 7f32fffff640 20 reqs_thread_entry: start 2024-04-24T02:12:20.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.548+0000 7f34d130a800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:20.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.548+0000 7f34d130a800 20 Filter name: none 2024-04-24T02:12:20.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.548+0000 7f32fdffb640 20 reqs_thread_entry: start 2024-04-24T02:12:20.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.548+0000 7f34d130a800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-04-24T02:12:20.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.548+0000 7f34d130a800 20 rados->read ofs=0 len=0 2024-04-24T02:12:20.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.548+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564e831cdce0 con 0x7f34b8086050 2024-04-24T02:12:20.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.549+0000 7f34cf60a640 1 -- 172.21.15.134:0/2932129922 <== osd.2 v2:172.21.15.134:6800/214480313 18 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f34c801f070 con 0x7f34b8086050 2024-04-24T02:12:20.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.549+0000 7f34d130a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:20.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.549+0000 7f34d130a800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-04-24T02:12:20.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.549+0000 7f34d130a800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-04-24T02:12:20.551 INFO:teuthology.orchestra.run.smithi134.stderr:could not remove user: unable to remove user, user does not exist 2024-04-24T02:12:20.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.549+0000 7f33857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:20.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.549+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94895206911088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e8319f440 con 0x564e83184400 2024-04-24T02:12:20.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.551+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94895206911088] v30'36 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f34c002e070 con 0x564e83184400 2024-04-24T02:12:20.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.551+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94895206886336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e8319f440 con 0x7f34b8086050 2024-04-24T02:12:20.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.551+0000 7f34cf60a640 1 -- 172.21.15.134:0/2932129922 <== osd.2 v2:172.21.15.134:6800/214480313 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94895206886336] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34c801f070 con 0x7f34b8086050 2024-04-24T02:12:20.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.552+0000 7f34d130a800 20 remove_watcher() i=0 2024-04-24T02:12:20.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.552+0000 7f34d130a800 2 removed watcher, disabling cache 2024-04-24T02:12:20.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.552+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94895206890384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e8318ebc0 con 0x564e83184400 2024-04-24T02:12:20.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.553+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.1 v2:172.21.15.134:6804/1487076214 30 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94895206890384] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34c002e070 con 0x564e83184400 2024-04-24T02:12:20.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.553+0000 7f34d130a800 20 remove_watcher() i=1 2024-04-24T02:12:20.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.553+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94895206891952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e8318ebc0 con 0x564e8318a650 2024-04-24T02:12:20.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.554+0000 7f34c6608640 1 -- 172.21.15.134:0/2932129922 <== osd.3 v2:172.21.15.134:6801/3585115521 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94895206891952] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34b8066030 con 0x564e8318a650 2024-04-24T02:12:20.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.554+0000 7f34d130a800 20 remove_watcher() i=2 2024-04-24T02:12:20.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.554+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94895206898656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e831901b0 con 0x7f34b8086050 2024-04-24T02:12:20.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.555+0000 7f34cf60a640 1 -- 172.21.15.134:0/2932129922 <== osd.2 v2:172.21.15.134:6800/214480313 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94895206898656] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34c801f070 con 0x7f34b8086050 2024-04-24T02:12:20.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.555+0000 7f34d130a800 20 remove_watcher() i=3 2024-04-24T02:12:20.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.555+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94895206903024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e831901b0 con 0x564e83184400 2024-04-24T02:12:20.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.557+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.1 v2:172.21.15.134:6804/1487076214 31 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94895206903024] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34c002e070 con 0x564e83184400 2024-04-24T02:12:20.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.557+0000 7f34d130a800 20 remove_watcher() i=4 2024-04-24T02:12:20.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.557+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94895206905072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e83192cf0 con 0x7f34c8031040 2024-04-24T02:12:20.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.558+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.0 v2:172.21.15.104:6800/2419146313 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94895206905072] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34c002e070 con 0x7f34c8031040 2024-04-24T02:12:20.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.558+0000 7f34d130a800 20 remove_watcher() i=5 2024-04-24T02:12:20.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.558+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94895206896576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e831901b0 con 0x7f34c8031040 2024-04-24T02:12:20.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.560+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.0 v2:172.21.15.104:6800/2419146313 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94895206896576] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34c002e070 con 0x7f34c8031040 2024-04-24T02:12:20.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.560+0000 7f34d130a800 20 remove_watcher() i=6 2024-04-24T02:12:20.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.560+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94895206910032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564e831934f0 con 0x7f34c8031040 2024-04-24T02:12:20.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.561+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 <== osd.0 v2:172.21.15.104:6800/2419146313 26 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94895206910032] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34c002e070 con 0x7f34c8031040 2024-04-24T02:12:20.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.561+0000 7f34d130a800 20 remove_watcher() i=7 2024-04-24T02:12:20.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.561+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f34c8031040 msgr2=0x7f34c8032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.561+0000 7f34d130a800 1 --2- 172.21.15.134:0/2932129922 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f34c8031040 0x7f34c8032940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.561+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x564e83184400 msgr2=0x564e831868c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.561+0000 7f34d130a800 1 --2- 172.21.15.134:0/2932129922 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x564e83184400 0x564e831868c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.561+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f34b8086050 msgr2=0x7f34b80706a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.561+0000 7f34d130a800 1 --2- 172.21.15.134:0/2932129922 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f34b8086050 0x7f34b80706a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.561+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x564e8318a650 msgr2=0x564e8318ca40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.561+0000 7f34d130a800 1 --2- 172.21.15.134:0/2932129922 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x564e8318a650 0x564e8318ca40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.561+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3398036900 msgr2=0x7f3398038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.561+0000 7f34d130a800 1 --2- 172.21.15.134:0/2932129922 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3398036900 0x7f3398038dc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x564e831540f0 tx=0x7f34c801f000 comp rx=0 tx=0).stop 2024-04-24T02:12:20.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.561+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564e83171260 msgr2=0x564e831788c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.561+0000 7f34cee09640 1 -- 172.21.15.134:0/2932129922 reap_dead start 2024-04-24T02:12:20.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.561+0000 7f34d130a800 1 --2- 172.21.15.134:0/2932129922 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564e83171260 0x564e831788c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f34b805cec0 tx=0x7f34b808dad0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.561+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 shutdown_connections 2024-04-24T02:12:20.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.561+0000 7f34d130a800 1 --2- 172.21.15.134:0/2932129922 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564e83171260 0x564e831788c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.561+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 >> 172.21.15.134:0/2932129922 conn(0x564e8316d5c0 msgr2=0x564e8316ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:20.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.561+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 shutdown_connections 2024-04-24T02:12:20.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.561+0000 7f34d130a800 1 -- 172.21.15.134:0/2932129922 wait complete. 2024-04-24T02:12:20.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.562+0000 7f34d130a800 1 -- 172.21.15.134:0/3349996615 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f33a8036900 msgr2=0x7f33a8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.562+0000 7f34d130a800 1 --2- 172.21.15.134:0/3349996615 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f33a8036900 0x7f33a8038dc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x564e83154970 tx=0x7f34c8005840 comp rx=0 tx=0).stop 2024-04-24T02:12:20.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.562+0000 7f34d130a800 1 -- 172.21.15.134:0/3349996615 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564e83164020 msgr2=0x564e83164440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.562+0000 7f34d130a800 1 --2- 172.21.15.134:0/3349996615 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564e83164020 0x564e83164440 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f34b8000c00 tx=0x7f34b8002fb0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.562+0000 7f34d130a800 1 -- 172.21.15.134:0/3349996615 shutdown_connections 2024-04-24T02:12:20.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.562+0000 7f34d130a800 1 --2- 172.21.15.134:0/3349996615 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f33a8036900 0x7f33a8038dc0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.562+0000 7f34d130a800 1 --2- 172.21.15.134:0/3349996615 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564e83164020 0x564e83164440 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.562+0000 7f34d130a800 1 -- 172.21.15.134:0/3349996615 >> 172.21.15.134:0/3349996615 conn(0x564e831580c0 msgr2=0x564e831584c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:20.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.562+0000 7f34d130a800 1 -- 172.21.15.134:0/3349996615 shutdown_connections 2024-04-24T02:12:20.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.562+0000 7f34d130a800 1 -- 172.21.15.134:0/3349996615 wait complete. 2024-04-24T02:12:20.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.562+0000 7f34d130a800 1 -- 172.21.15.134:0/3940313924 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x564e830561b0 msgr2=0x564e83152e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.562+0000 7f34d130a800 1 --2- 172.21.15.134:0/3940313924 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x564e830561b0 0x564e83152e50 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.562+0000 7f34d130a800 1 -- 172.21.15.134:0/3940313924 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f33b4036900 msgr2=0x7f33b4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.562+0000 7f34d130a800 1 --2- 172.21.15.134:0/3940313924 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f33b4036900 0x7f33b4038dc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f34b8054000 tx=0x7f34b804e000 comp rx=0 tx=0).stop 2024-04-24T02:12:20.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.562+0000 7f34d130a800 1 -- 172.21.15.134:0/3940313924 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564e83051d20 msgr2=0x564e82fc6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.562+0000 7f34d130a800 1 --2- 172.21.15.134:0/3940313924 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564e83051d20 0x564e82fc6030 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x564e83143d60 tx=0x7f34c0000ed0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.562+0000 7f34d130a800 1 -- 172.21.15.134:0/3940313924 shutdown_connections 2024-04-24T02:12:20.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.562+0000 7f34d130a800 1 --2- 172.21.15.134:0/3940313924 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x564e830561b0 0x564e83152e50 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.562+0000 7f34d130a800 1 --2- 172.21.15.134:0/3940313924 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f33b4036900 0x7f33b4038dc0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.562+0000 7f34d130a800 1 --2- 172.21.15.134:0/3940313924 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564e83051d20 0x564e82fc6030 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.562+0000 7f34d130a800 1 -- 172.21.15.134:0/3940313924 >> 172.21.15.134:0/3940313924 conn(0x564e8304d380 msgr2=0x564e8313d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:20.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.562+0000 7f34d130a800 1 -- 172.21.15.134:0/3940313924 shutdown_connections 2024-04-24T02:12:20.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.562+0000 7f34d130a800 1 -- 172.21.15.134:0/3940313924 wait complete. 2024-04-24T02:12:20.571 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-04-24T02:12:20.571 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-04-24T02:12:20.572 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-04-24T02:12:20.572 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-04-24T02:12:20.655 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:20.655 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:20.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.654+0000 7fbbb6d3f800 1 Processor -- start 2024-04-24T02:12:20.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.654+0000 7fbbb6d3f800 1 -- start start 2024-04-24T02:12:20.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.654+0000 7fbbb6d3f800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5563cb19d330 0x5563cb19f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.654+0000 7fbbb6d3f800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5563cb057d40 con 0x5563cb198f90 2024-04-24T02:12:20.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.654+0000 7fbbb6d3f800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x5563cb02a4d0 con 0x5563cb19d330 2024-04-24T02:12:20.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.655+0000 7fbbb229a640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5563cb19d330 0x5563cb19f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.655+0000 7fbbb229a640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5563cb19d330 0x5563cb19f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45200/0 (socket says 172.21.15.134:45200) 2024-04-24T02:12:20.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.655+0000 7fbbb2a9b640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x5563cb198f90 0x5563cb1993b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:43122/0 (socket says 172.21.15.134:43122) 2024-04-24T02:12:20.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.655+0000 7fbbb229a640 1 -- 172.21.15.134:0/3770238953 learned_addr learned my addr 172.21.15.134:0/3770238953 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:20.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.655+0000 7fbbb229a640 1 -- 172.21.15.134:0/3770238953 >> v1:172.21.15.104:6789/0 conn(0x5563cb198f90 legacy=0x5563cb1993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.655+0000 7fbbb229a640 1 -- 172.21.15.134:0/3770238953 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563cb056590 con 0x5563cb19d330 2024-04-24T02:12:20.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.657+0000 7fbbb229a640 1 --2- 172.21.15.134:0/3770238953 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563cb19d330 0x5563cb19f720 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbba800a520 tx=0x7fbba801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2146a57c451aef46 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.657+0000 7fbbb1a99640 1 -- 172.21.15.134:0/3770238953 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbba8057070 con 0x5563cb19d330 2024-04-24T02:12:20.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.657+0000 7fbbb1a99640 1 -- 172.21.15.134:0/3770238953 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbba8052570 con 0x5563cb19d330 2024-04-24T02:12:20.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.657+0000 7fbbb1a99640 1 -- 172.21.15.134:0/3770238953 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbba804ae60 con 0x5563cb19d330 2024-04-24T02:12:20.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.657+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3770238953 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563cb19d330 msgr2=0x5563cb19f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.657+0000 7fbbb6d3f800 1 --2- 172.21.15.134:0/3770238953 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563cb19d330 0x5563cb19f720 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbba800a520 tx=0x7fbba801d010 comp rx=0 tx=0).stop 2024-04-24T02:12:20.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.657+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3770238953 shutdown_connections 2024-04-24T02:12:20.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.657+0000 7fbbb6d3f800 1 --2- 172.21.15.134:0/3770238953 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563cb19d330 0x5563cb19f720 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.657+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3770238953 >> 172.21.15.134:0/3770238953 conn(0x5563cb194530 msgr2=0x5563cb196950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:20.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.658+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3770238953 shutdown_connections 2024-04-24T02:12:20.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.658+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3770238953 wait complete. 2024-04-24T02:12:20.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.669+0000 7fbbb6d3f800 1 Processor -- start 2024-04-24T02:12:20.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.669+0000 7fbbb6d3f800 1 -- start start 2024-04-24T02:12:20.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.669+0000 7fbbb6d3f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563cb198f90 0x5563cb10e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.669+0000 7fbbb6d3f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5563cb0e43c0 con 0x5563cb198f90 2024-04-24T02:12:20.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.670+0000 7fbbb2a9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563cb198f90 0x5563cb10e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.670+0000 7fbbb2a9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563cb198f90 0x5563cb10e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45206/0 (socket says 172.21.15.134:45206) 2024-04-24T02:12:20.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.670+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/1169503453 learned_addr learned my addr 172.21.15.134:0/1169503453 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:20.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.670+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/1169503453 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563cb10cf60 con 0x5563cb198f90 2024-04-24T02:12:20.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.670+0000 7fbbb2a9b640 1 --2- 172.21.15.134:0/1169503453 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563cb198f90 0x5563cb10e9a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbba400b230 tx=0x7fbba400b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b415dbaa3dbc84b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.670+0000 7fbaa0e09640 1 -- 172.21.15.134:0/1169503453 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbba400e5c0 con 0x5563cb198f90 2024-04-24T02:12:20.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.670+0000 7fbaa0e09640 1 -- 172.21.15.134:0/1169503453 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbba4006070 con 0x5563cb198f90 2024-04-24T02:12:20.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.670+0000 7fbaa0e09640 1 -- 172.21.15.134:0/1169503453 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbba400e890 con 0x5563cb198f90 2024-04-24T02:12:20.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.671+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/1169503453 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563cb198f90 msgr2=0x5563cb10e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.671+0000 7fbbb6d3f800 1 --2- 172.21.15.134:0/1169503453 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563cb198f90 0x5563cb10e9a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbba400b230 tx=0x7fbba400b6f0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.671+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/1169503453 shutdown_connections 2024-04-24T02:12:20.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.671+0000 7fbbb6d3f800 1 --2- 172.21.15.134:0/1169503453 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563cb198f90 0x5563cb10e9a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.671+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/1169503453 >> 172.21.15.134:0/1169503453 conn(0x5563cb194530 msgr2=0x5563cb285a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:20.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.671+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/1169503453 shutdown_connections 2024-04-24T02:12:20.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.671+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/1169503453 wait complete. 2024-04-24T02:12:20.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.671+0000 7fbbb6d3f800 1 Processor -- start 2024-04-24T02:12:20.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.671+0000 7fbbb6d3f800 1 -- start start 2024-04-24T02:12:20.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.672+0000 7fbbb6d3f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563cb198f90 0x5563cb293ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.672+0000 7fbbb6d3f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5563cb19fff0 con 0x5563cb198f90 2024-04-24T02:12:20.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.672+0000 7fbbb2a9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563cb198f90 0x5563cb293ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.672+0000 7fbbb2a9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563cb198f90 0x5563cb293ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45214/0 (socket says 172.21.15.134:45214) 2024-04-24T02:12:20.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.672+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/1886858518 learned_addr learned my addr 172.21.15.134:0/1886858518 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:20.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.672+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/1886858518 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563cb294420 con 0x5563cb198f90 2024-04-24T02:12:20.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.672+0000 7fbbb2a9b640 1 --2- 172.21.15.134:0/1886858518 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563cb198f90 0x5563cb293ee0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbba4000fd0 tx=0x7fbba4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.673+0000 7fba9f606640 1 -- 172.21.15.134:0/1886858518 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbba400f8d0 con 0x5563cb198f90 2024-04-24T02:12:20.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.673+0000 7fba9f606640 1 -- 172.21.15.134:0/1886858518 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbba400fa90 con 0x5563cb198f90 2024-04-24T02:12:20.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.673+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/1886858518 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5563cb2946b0 con 0x5563cb198f90 2024-04-24T02:12:20.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.673+0000 7fba9f606640 1 -- 172.21.15.134:0/1886858518 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbba400fdb0 con 0x5563cb198f90 2024-04-24T02:12:20.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.673+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/1886858518 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563cb297310 con 0x5563cb198f90 2024-04-24T02:12:20.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.674+0000 7fba9f606640 1 -- 172.21.15.134:0/1886858518 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbba4017070 con 0x5563cb198f90 2024-04-24T02:12:20.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.674+0000 7fba9f606640 1 --2- 172.21.15.134:0/1886858518 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fba98036950 0x7fba98038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.674+0000 7fba9f606640 1 -- 172.21.15.134:0/1886858518 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fbba4015020 con 0x5563cb198f90 2024-04-24T02:12:20.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.674+0000 7fbbb229a640 1 --2- 172.21.15.134:0/1886858518 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fba98036950 0x7fba98038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.674+0000 7fbbb6d3f800 1 --2- 172.21.15.134:0/1886858518 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5563cb19d330 0x5563cb29b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.674+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/1886858518 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563cb29b660 con 0x5563cb19d330 2024-04-24T02:12:20.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.674+0000 7fbbb329c640 1 --2- 172.21.15.134:0/1886858518 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5563cb19d330 0x5563cb29b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.674+0000 7fbbb229a640 1 --2- 172.21.15.134:0/1886858518 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fba98036950 0x7fba98038e10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbba8054000 tx=0x7fbba804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.674+0000 7fbbb329c640 1 --2- 172.21.15.134:0/1886858518 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5563cb19d330 0x5563cb29b0d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.675+0000 7fbbb329c640 1 -- 172.21.15.134:0/1886858518 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbbac00a4a0 con 0x5563cb19d330 2024-04-24T02:12:20.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.675+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/1886858518 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2986a0 con 0x5563cb19d330 2024-04-24T02:12:20.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.675+0000 7fbbb329c640 1 -- 172.21.15.134:0/1886858518 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbbac00a4a0 con 0x5563cb19d330 2024-04-24T02:12:20.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.675+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/1886858518 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563cb29d480 con 0x5563cb19d330 2024-04-24T02:12:20.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.675+0000 7fbbb329c640 1 -- 172.21.15.134:0/1886858518 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbbac00a4a0 con 0x5563cb19d330 2024-04-24T02:12:20.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.675+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/1886858518 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563cb29c7c0 con 0x5563cb19d330 2024-04-24T02:12:20.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.676+0000 7fbbb329c640 1 -- 172.21.15.134:0/1886858518 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbbac00a4a0 con 0x5563cb19d330 2024-04-24T02:12:20.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.676+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/1886858518 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563cb29cc10 con 0x5563cb19d330 2024-04-24T02:12:20.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.676+0000 7fbbb329c640 1 -- 172.21.15.134:0/1886858518 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbbac00a4a0 con 0x5563cb19d330 2024-04-24T02:12:20.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.676+0000 7fbbb6d3f800 1 Processor -- start 2024-04-24T02:12:20.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.676+0000 7fbbb6d3f800 1 -- start start 2024-04-24T02:12:20.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.676+0000 7fbbb6d3f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563cb2ac250 0x5563cb2ac670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.676+0000 7fbbb6d3f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5563cb08a6b0 con 0x5563cb2ac250 2024-04-24T02:12:20.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.677+0000 7fbbb229a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563cb2ac250 0x5563cb2ac670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.677+0000 7fbbb229a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563cb2ac250 0x5563cb2ac670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45216/0 (socket says 172.21.15.134:45216) 2024-04-24T02:12:20.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.677+0000 7fbbb229a640 1 -- 172.21.15.134:0/350076205 learned_addr learned my addr 172.21.15.134:0/350076205 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:20.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.677+0000 7fbbb229a640 1 -- 172.21.15.134:0/350076205 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563cb2acbb0 con 0x5563cb2ac250 2024-04-24T02:12:20.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.677+0000 7fbbb229a640 1 --2- 172.21.15.134:0/350076205 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563cb2ac250 0x5563cb2ac670 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbba8000c00 tx=0x7fbba8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.677+0000 7fba9ce01640 1 -- 172.21.15.134:0/350076205 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbba8057040 con 0x5563cb2ac250 2024-04-24T02:12:20.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.677+0000 7fba9ce01640 1 -- 172.21.15.134:0/350076205 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbba805d650 con 0x5563cb2ac250 2024-04-24T02:12:20.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.677+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/350076205 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5563cb2ad620 con 0x5563cb2ac250 2024-04-24T02:12:20.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.677+0000 7fba9ce01640 1 -- 172.21.15.134:0/350076205 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbba805d930 con 0x5563cb2ac250 2024-04-24T02:12:20.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.677+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/350076205 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563cb2adac0 con 0x5563cb2ac250 2024-04-24T02:12:20.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.678+0000 7fba9ce01640 1 -- 172.21.15.134:0/350076205 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbba8067070 con 0x5563cb2ac250 2024-04-24T02:12:20.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.678+0000 7fba9ce01640 1 --2- 172.21.15.134:0/350076205 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fba8c036950 0x7fba8c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.678+0000 7fba9ce01640 1 -- 172.21.15.134:0/350076205 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fbba808f640 con 0x5563cb2ac250 2024-04-24T02:12:20.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.678+0000 7fbbb329c640 1 --2- 172.21.15.134:0/350076205 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fba8c036950 0x7fba8c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.679+0000 7fbbb6d3f800 1 Processor -- start 2024-04-24T02:12:20.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.679+0000 7fbbb6d3f800 1 -- start start 2024-04-24T02:12:20.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.679+0000 7fbbb329c640 1 --2- 172.21.15.134:0/350076205 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fba8c036950 0x7fba8c038e10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x5563cb29c2e0 tx=0x7fbbac005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.679+0000 7fbbb6d3f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563cb2b9490 0x5563cb2b98b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.679+0000 7fbbb6d3f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5563cb10d2e0 con 0x5563cb2b9490 2024-04-24T02:12:20.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.679+0000 7fbbb229a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563cb2b9490 0x5563cb2b98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.679+0000 7fbbb229a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563cb2b9490 0x5563cb2b98b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45222/0 (socket says 172.21.15.134:45222) 2024-04-24T02:12:20.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.679+0000 7fbbb229a640 1 -- 172.21.15.134:0/344947847 learned_addr learned my addr 172.21.15.134:0/344947847 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:20.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.679+0000 7fbbb229a640 1 -- 172.21.15.134:0/344947847 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563cb2b9e80 con 0x5563cb2b9490 2024-04-24T02:12:20.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.680+0000 7fbbb229a640 1 --2- 172.21.15.134:0/344947847 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563cb2b9490 0x5563cb2b98b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbba808db50 tx=0x7fbba8067cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6b5655c83505a6e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.680+0000 7fba967fc640 1 -- 172.21.15.134:0/344947847 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbba8071400 con 0x5563cb2b9490 2024-04-24T02:12:20.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.680+0000 7fba967fc640 1 -- 172.21.15.134:0/344947847 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbba8067360 con 0x5563cb2b9490 2024-04-24T02:12:20.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.680+0000 7fba967fc640 1 -- 172.21.15.134:0/344947847 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbba80715a0 con 0x5563cb2b9490 2024-04-24T02:12:20.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.680+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/344947847 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563cb2b9490 msgr2=0x5563cb2b98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.680+0000 7fbbb6d3f800 1 --2- 172.21.15.134:0/344947847 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563cb2b9490 0x5563cb2b98b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbba808db50 tx=0x7fbba8067cf0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.680+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/344947847 shutdown_connections 2024-04-24T02:12:20.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.680+0000 7fbbb6d3f800 1 --2- 172.21.15.134:0/344947847 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563cb2b9490 0x5563cb2b98b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.680+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/344947847 >> 172.21.15.134:0/344947847 conn(0x5563cb2b57f0 msgr2=0x5563cb2b3850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:20.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.680+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/344947847 shutdown_connections 2024-04-24T02:12:20.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.680+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/344947847 wait complete. 2024-04-24T02:12:20.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.680+0000 7fbbb6d3f800 1 Processor -- start 2024-04-24T02:12:20.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.681+0000 7fbbb6d3f800 1 -- start start 2024-04-24T02:12:20.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.681+0000 7fbbb6d3f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563cb2b9490 0x5563cb2c0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.681+0000 7fbbb6d3f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5563cb2ba5f0 con 0x5563cb2b9490 2024-04-24T02:12:20.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.681+0000 7fbbb229a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563cb2b9490 0x5563cb2c0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.681+0000 7fbbb229a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563cb2b9490 0x5563cb2c0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45226/0 (socket says 172.21.15.134:45226) 2024-04-24T02:12:20.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.681+0000 7fbbb229a640 1 -- 172.21.15.134:0/3353741066 learned_addr learned my addr 172.21.15.134:0/3353741066 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:20.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.681+0000 7fbbb229a640 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563cb2c1030 con 0x5563cb2b9490 2024-04-24T02:12:20.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.681+0000 7fbbb229a640 1 --2- 172.21.15.134:0/3353741066 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563cb2b9490 0x5563cb2c0af0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbba8006540 tx=0x7fbba808dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.681+0000 7fba94ff9640 1 -- 172.21.15.134:0/3353741066 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbba808f070 con 0x5563cb2b9490 2024-04-24T02:12:20.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.682+0000 7fba94ff9640 1 -- 172.21.15.134:0/3353741066 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbba8093030 con 0x5563cb2b9490 2024-04-24T02:12:20.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.682+0000 7fba94ff9640 1 -- 172.21.15.134:0/3353741066 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbba808f340 con 0x5563cb2b9490 2024-04-24T02:12:20.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.682+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5563cb2c12c0 con 0x5563cb2b9490 2024-04-24T02:12:20.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.682+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563cb2c3f70 con 0x5563cb2b9490 2024-04-24T02:12:20.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.682+0000 7fba94ff9640 1 -- 172.21.15.134:0/3353741066 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbba808f890 con 0x5563cb2b9490 2024-04-24T02:12:20.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.682+0000 7fba94ff9640 1 --2- 172.21.15.134:0/3353741066 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fba7c0368b0 0x7fba7c038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.682+0000 7fba94ff9640 1 -- 172.21.15.134:0/3353741066 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fbba8099ad0 con 0x5563cb2b9490 2024-04-24T02:12:20.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.683+0000 7fbbb329c640 1 --2- 172.21.15.134:0/3353741066 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fba7c0368b0 0x7fba7c038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.683+0000 7fbbb6d3f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:20.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.683+0000 7fbbb6d3f800 1 --2- 172.21.15.134:0/3353741066 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5563cb2cc5e0 0x5563cb2ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.683+0000 7fbbb329c640 1 --2- 172.21.15.134:0/3353741066 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fba7c0368b0 0x7fba7c038d70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x5563cb294d00 tx=0x7fbbac01f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.683+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2cf1f0 con 0x5563cb2cc5e0 2024-04-24T02:12:20.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.683+0000 7fbbb2a9b640 1 --2- 172.21.15.134:0/3353741066 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5563cb2cc5e0 0x5563cb2ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.683+0000 7fbbb2a9b640 1 --2- 172.21.15.134:0/3353741066 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5563cb2cc5e0 0x5563cb2ceaa0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.684+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbba402e070 con 0x5563cb2cc5e0 2024-04-24T02:12:20.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.684+0000 7fbbb6d3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:20.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.684+0000 7fbbb6d3f800 20 realm 2024-04-24T02:12:20.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.684+0000 7fbbb6d3f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:20.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.684+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2cf600 con 0x5563cb2cc5e0 2024-04-24T02:12:20.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.684+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbba402e070 con 0x5563cb2cc5e0 2024-04-24T02:12:20.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.684+0000 7fbbb6d3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:20.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.684+0000 7fbbb6d3f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:20.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.684+0000 7fbbb6d3f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:20.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.684+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2cfed0 con 0x5563cb2cc5e0 2024-04-24T02:12:20.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.684+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbba402e070 con 0x5563cb2cc5e0 2024-04-24T02:12:20.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.684+0000 7fbbb6d3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:20.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.684+0000 7fbbb6d3f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:20.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.684+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d0270 con 0x5563cb2cc5e0 2024-04-24T02:12:20.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.684+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbba402e070 con 0x5563cb2cc5e0 2024-04-24T02:12:20.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.684+0000 7fbbb6d3f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:20.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.684+0000 7fbbb6d3f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:20.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.684+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d0ac0 con 0x5563cb2cc5e0 2024-04-24T02:12:20.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.684+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbba402e070 con 0x5563cb2cc5e0 2024-04-24T02:12:20.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.684+0000 7fbbb6d3f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:20.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.685+0000 7fbbb6d3f800 20 searching for the correct realm 2024-04-24T02:12:20.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.685+0000 7fbbb6d3f800 1 --2- 172.21.15.134:0/3353741066 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5563cb2d2830 0x5563cb2d4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.685+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d5200 con 0x5563cb2d2830 2024-04-24T02:12:20.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.685+0000 7fbbb229a640 1 --2- 172.21.15.134:0/3353741066 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5563cb2d2830 0x5563cb2d4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.685+0000 7fbbb229a640 1 --2- 172.21.15.134:0/3353741066 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5563cb2d2830 0x5563cb2d4c20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.685+0000 7fbbb229a640 1 -- 172.21.15.134:0/3353741066 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba8066030 con 0x5563cb2d2830 2024-04-24T02:12:20.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.685+0000 7fbbb229a640 1 --2- 172.21.15.134:0/3353741066 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fbba8086050 0x7fbba8007900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.685+0000 7fbbb229a640 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d5200 con 0x7fbba8086050 2024-04-24T02:12:20.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.686+0000 7fbbb329c640 1 --2- 172.21.15.134:0/3353741066 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fbba8086050 0x7fbba8007900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.686+0000 7fbbb329c640 1 --2- 172.21.15.134:0/3353741066 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fbba8086050 0x7fbba8007900 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.686+0000 7fbbb329c640 1 -- 172.21.15.134:0/3353741066 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbac01f070 con 0x7fbba8086050 2024-04-24T02:12:20.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.686+0000 7fbbb329c640 1 --2- 172.21.15.134:0/3353741066 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fbbac031040 0x7fbbac032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.686+0000 7fbbb329c640 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d5200 con 0x7fbbac031040 2024-04-24T02:12:20.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.686+0000 7fbbb2a9b640 1 --2- 172.21.15.134:0/3353741066 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fbbac031040 0x7fbbac032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.687+0000 7fbbb2a9b640 1 --2- 172.21.15.134:0/3353741066 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fbbac031040 0x7fbbac032940 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.687+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba402e070 con 0x7fbbac031040 2024-04-24T02:12:20.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.687+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d5200 con 0x5563cb2cc5e0 2024-04-24T02:12:20.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.687+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba402e070 con 0x5563cb2cc5e0 2024-04-24T02:12:20.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.687+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d5200 con 0x5563cb2cc5e0 2024-04-24T02:12:20.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.687+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbba402e070 con 0x5563cb2cc5e0 2024-04-24T02:12:20.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.687+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d5200 con 0x7fbbac031040 2024-04-24T02:12:20.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.688+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba402e070 con 0x7fbbac031040 2024-04-24T02:12:20.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.688+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d5200 con 0x7fbbac031040 2024-04-24T02:12:20.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.688+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba402e070 con 0x7fbbac031040 2024-04-24T02:12:20.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.688+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d5200 con 0x7fbba8086050 2024-04-24T02:12:20.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.688+0000 7fbbb329c640 1 -- 172.21.15.134:0/3353741066 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbac01f070 con 0x7fbba8086050 2024-04-24T02:12:20.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.688+0000 7fbbb329c640 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d5200 con 0x5563cb2d2830 2024-04-24T02:12:20.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.688+0000 7fbbb229a640 1 -- 172.21.15.134:0/3353741066 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba8066030 con 0x5563cb2d2830 2024-04-24T02:12:20.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.688+0000 7fbbb229a640 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d5200 con 0x5563cb2cc5e0 2024-04-24T02:12:20.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.689+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba402e070 con 0x5563cb2cc5e0 2024-04-24T02:12:20.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.689+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d5200 con 0x7fbbac031040 2024-04-24T02:12:20.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.689+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba402e070 con 0x7fbbac031040 2024-04-24T02:12:20.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.689+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d5200 con 0x5563cb2cc5e0 2024-04-24T02:12:20.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.689+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba402e070 con 0x5563cb2cc5e0 2024-04-24T02:12:20.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.689+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d5200 con 0x7fbba8086050 2024-04-24T02:12:20.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.689+0000 7fbbb329c640 1 -- 172.21.15.134:0/3353741066 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbbac01f070 con 0x7fbba8086050 2024-04-24T02:12:20.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.689+0000 7fbbb329c640 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d5200 con 0x5563cb2d2830 2024-04-24T02:12:20.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.690+0000 7fbbb229a640 1 -- 172.21.15.134:0/3353741066 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba8066030 con 0x5563cb2d2830 2024-04-24T02:12:20.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.690+0000 7fbbb229a640 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d5200 con 0x5563cb2d2830 2024-04-24T02:12:20.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.690+0000 7fbbb229a640 1 -- 172.21.15.134:0/3353741066 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba8066030 con 0x5563cb2d2830 2024-04-24T02:12:20.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.690+0000 7fbbb229a640 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d5200 con 0x7fbbac031040 2024-04-24T02:12:20.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.690+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba402e070 con 0x7fbbac031040 2024-04-24T02:12:20.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.690+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d5200 con 0x5563cb2d2830 2024-04-24T02:12:20.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.691+0000 7fbbb229a640 1 -- 172.21.15.134:0/3353741066 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba8066030 con 0x5563cb2d2830 2024-04-24T02:12:20.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.691+0000 7fbbb229a640 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d5200 con 0x5563cb2d2830 2024-04-24T02:12:20.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.691+0000 7fbbb229a640 1 -- 172.21.15.134:0/3353741066 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba8066030 con 0x5563cb2d2830 2024-04-24T02:12:20.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.691+0000 7fbbb229a640 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d5200 con 0x5563cb2cc5e0 2024-04-24T02:12:20.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.691+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba402e070 con 0x5563cb2cc5e0 2024-04-24T02:12:20.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.691+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d5200 con 0x5563cb2cc5e0 2024-04-24T02:12:20.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.691+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v23'2 uv2 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fbba402e070 con 0x5563cb2cc5e0 2024-04-24T02:12:20.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.691+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d5200 con 0x7fbbac031040 2024-04-24T02:12:20.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.692+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba402e070 con 0x7fbbac031040 2024-04-24T02:12:20.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.692+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d5200 con 0x5563cb2d2830 2024-04-24T02:12:20.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.692+0000 7fbbb229a640 1 -- 172.21.15.134:0/3353741066 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba8066030 con 0x5563cb2d2830 2024-04-24T02:12:20.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.692+0000 7fbbb229a640 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d5200 con 0x7fbba8086050 2024-04-24T02:12:20.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.692+0000 7fbbb329c640 1 -- 172.21.15.134:0/3353741066 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbac01f070 con 0x7fbba8086050 2024-04-24T02:12:20.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.692+0000 7fbbb329c640 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d5200 con 0x5563cb2cc5e0 2024-04-24T02:12:20.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.692+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba402e070 con 0x5563cb2cc5e0 2024-04-24T02:12:20.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.692+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d5200 con 0x7fbbac031040 2024-04-24T02:12:20.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.693+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba402e070 con 0x7fbbac031040 2024-04-24T02:12:20.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.693+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d5200 con 0x5563cb2d2830 2024-04-24T02:12:20.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.693+0000 7fbbb229a640 1 -- 172.21.15.134:0/3353741066 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba8066030 con 0x5563cb2d2830 2024-04-24T02:12:20.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.693+0000 7fbbb229a640 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d5200 con 0x7fbbac031040 2024-04-24T02:12:20.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.693+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba402e070 con 0x7fbbac031040 2024-04-24T02:12:20.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.693+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d5200 con 0x7fbba8086050 2024-04-24T02:12:20.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.693+0000 7fbbb329c640 1 -- 172.21.15.134:0/3353741066 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbac01f070 con 0x7fbba8086050 2024-04-24T02:12:20.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.694+0000 7fbbb329c640 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d5200 con 0x5563cb2d2830 2024-04-24T02:12:20.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.694+0000 7fbbb229a640 1 -- 172.21.15.134:0/3353741066 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba8066030 con 0x5563cb2d2830 2024-04-24T02:12:20.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.694+0000 7fbbb229a640 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d5200 con 0x7fbbac031040 2024-04-24T02:12:20.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.694+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba402e070 con 0x7fbbac031040 2024-04-24T02:12:20.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.694+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d5200 con 0x5563cb2cc5e0 2024-04-24T02:12:20.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.694+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbba402e070 con 0x5563cb2cc5e0 2024-04-24T02:12:20.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.694+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d5200 con 0x7fbba8086050 2024-04-24T02:12:20.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.695+0000 7fbbb329c640 1 -- 172.21.15.134:0/3353741066 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbac01f070 con 0x7fbba8086050 2024-04-24T02:12:20.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.695+0000 7fbbb6d3f800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:20.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.695+0000 7fbbb6d3f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:20.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.695+0000 7fbbb6d3f800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:20.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.695+0000 7fbbb6d3f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:20.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.695+0000 7fbbb6d3f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:20.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.695+0000 7fbbb6d3f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:20.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.695+0000 7fbbb6d3f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:20.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.695+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d1440 con 0x5563cb2cc5e0 2024-04-24T02:12:20.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.695+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbba402e070 con 0x5563cb2cc5e0 2024-04-24T02:12:20.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.695+0000 7fbbb6d3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:20.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.695+0000 7fbbb6d3f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:20.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.695+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d1ce0 con 0x5563cb2cc5e0 2024-04-24T02:12:20.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.695+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbba402e070 con 0x5563cb2cc5e0 2024-04-24T02:12:20.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.695+0000 7fbbb6d3f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:20.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.695+0000 7fbbb6d3f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:20.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.695+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d5680 con 0x5563cb2cc5e0 2024-04-24T02:12:20.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.695+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbba402e070 con 0x5563cb2cc5e0 2024-04-24T02:12:20.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.695+0000 7fbbb6d3f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:20.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.695+0000 7fbbb6d3f800 20 zone default found 2024-04-24T02:12:20.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.695+0000 7fbbb6d3f800 4 Realm: () 2024-04-24T02:12:20.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.695+0000 7fbbb6d3f800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:20.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.695+0000 7fbbb6d3f800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:20.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.695+0000 7fbbb6d3f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:20.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.695+0000 7fbbb6d3f800 20 zonegroup default 2024-04-24T02:12:20.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.695+0000 7fbbb6d3f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:20.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.695+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d1940 con 0x7fbbac031040 2024-04-24T02:12:20.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.696+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbba402e070 con 0x7fbbac031040 2024-04-24T02:12:20.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.696+0000 7fbbb6d3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:20.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.696+0000 7fbbb6d3f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:20.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.696+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d7590 con 0x5563cb2d2830 2024-04-24T02:12:20.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.696+0000 7fbbb229a640 1 -- 172.21.15.134:0/3353741066 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbba8066030 con 0x5563cb2d2830 2024-04-24T02:12:20.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.696+0000 7fbbb6d3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:20.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.696+0000 7fbbb6d3f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:20.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.696+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d7930 con 0x5563cb2d2830 2024-04-24T02:12:20.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.696+0000 7fbbb229a640 1 -- 172.21.15.134:0/3353741066 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbba8066030 con 0x5563cb2d2830 2024-04-24T02:12:20.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.696+0000 7fbbb6d3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:20.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.696+0000 7fbbb6d3f800 20 started sync module instance, tier type = 2024-04-24T02:12:20.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.696+0000 7fbbb6d3f800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:20.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.696+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d6a30 con 0x7fbba8086050 2024-04-24T02:12:20.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.697+0000 7fbbb329c640 1 -- 172.21.15.134:0/3353741066 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbac040040 con 0x7fbba8086050 2024-04-24T02:12:20.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.697+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93887098875424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d8240 con 0x7fbba8086050 2024-04-24T02:12:20.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.697+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d8a90 con 0x5563cb2cc5e0 2024-04-24T02:12:20.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.698+0000 7fbbb329c640 1 -- 172.21.15.134:0/3353741066 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93887098875424] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbac040040 con 0x7fbba8086050 2024-04-24T02:12:20.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.699+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbba402e070 con 0x5563cb2cc5e0 2024-04-24T02:12:20.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.699+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93887098879376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d87c0 con 0x5563cb2cc5e0 2024-04-24T02:12:20.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.699+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d92b0 con 0x5563cb2d2830 2024-04-24T02:12:20.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.704+0000 7fbbb229a640 1 -- 172.21.15.134:0/3353741066 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbba8066030 con 0x5563cb2d2830 2024-04-24T02:12:20.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.704+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93887098879376] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbba402e070 con 0x5563cb2cc5e0 2024-04-24T02:12:20.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.704+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93887098883456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d96a0 con 0x5563cb2d2830 2024-04-24T02:12:20.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.704+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2da0c0 con 0x7fbba8086050 2024-04-24T02:12:20.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.705+0000 7fbbb329c640 1 -- 172.21.15.134:0/3353741066 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbac040040 con 0x7fbba8086050 2024-04-24T02:12:20.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.705+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93887098887088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2da960 con 0x7fbba8086050 2024-04-24T02:12:20.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.705+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2db440 con 0x5563cb2cc5e0 2024-04-24T02:12:20.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.705+0000 7fbbb229a640 1 -- 172.21.15.134:0/3353741066 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93887098883456] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbba8066030 con 0x5563cb2d2830 2024-04-24T02:12:20.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.708+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbba402e070 con 0x5563cb2cc5e0 2024-04-24T02:12:20.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.708+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93887098892112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2db440 con 0x5563cb2cc5e0 2024-04-24T02:12:20.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.708+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2dbe90 con 0x7fbbac031040 2024-04-24T02:12:20.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.708+0000 7fbbb329c640 1 -- 172.21.15.134:0/3353741066 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93887098887088] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbac040040 con 0x7fbba8086050 2024-04-24T02:12:20.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.709+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbba402e070 con 0x7fbbac031040 2024-04-24T02:12:20.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.709+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93887098889392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2dbe50 con 0x7fbbac031040 2024-04-24T02:12:20.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.709+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2dc8a0 con 0x7fbbac031040 2024-04-24T02:12:20.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.709+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93887098892112] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbba402e070 con 0x5563cb2cc5e0 2024-04-24T02:12:20.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.711+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93887098889392] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbba402e070 con 0x7fbbac031040 2024-04-24T02:12:20.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.713+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(56 notify.6 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbba402e070 con 0x7fbbac031040 2024-04-24T02:12:20.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.713+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93887098894752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2dbdc0 con 0x7fbbac031040 2024-04-24T02:12:20.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.713+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2dcd50 con 0x7fbbac031040 2024-04-24T02:12:20.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.715+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93887098894752] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbba402e070 con 0x7fbbac031040 2024-04-24T02:12:20.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.715+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(58 notify.7 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbba402e070 con 0x7fbbac031040 2024-04-24T02:12:20.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.715+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93887098897392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2dccc0 con 0x7fbbac031040 2024-04-24T02:12:20.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.715+0000 7fbbb6d3f800 20 add_watcher() i=0 2024-04-24T02:12:20.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.715+0000 7fbbb6d3f800 20 add_watcher() i=1 2024-04-24T02:12:20.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.715+0000 7fbbb6d3f800 20 add_watcher() i=2 2024-04-24T02:12:20.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.715+0000 7fbbb6d3f800 20 add_watcher() i=3 2024-04-24T02:12:20.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.715+0000 7fbbb6d3f800 20 add_watcher() i=4 2024-04-24T02:12:20.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.715+0000 7fbbb6d3f800 20 add_watcher() i=5 2024-04-24T02:12:20.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.715+0000 7fbbb6d3f800 20 add_watcher() i=6 2024-04-24T02:12:20.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.716+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93887098897392] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbba402e070 con 0x7fbbac031040 2024-04-24T02:12:20.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.716+0000 7fbbb6d3f800 20 add_watcher() i=7 2024-04-24T02:12:20.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.716+0000 7fbbb6d3f800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:20.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.716+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2e00f0 con 0x5563cb2cc5e0 2024-04-24T02:12:20.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.716+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbba402e070 con 0x5563cb2cc5e0 2024-04-24T02:12:20.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.716+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93887098898912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2dd610 con 0x5563cb2cc5e0 2024-04-24T02:12:20.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.718+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93887098898912] v30'37 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbba402e070 con 0x5563cb2cc5e0 2024-04-24T02:12:20.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.719+0000 7fba697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:20.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.719+0000 7fbbb6d3f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:20.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.719+0000 7fbbb6d3f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:20.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.719+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2dfdc0 con 0x5563cb2cc5e0 2024-04-24T02:12:20.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.720+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'41 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbba402e070 con 0x5563cb2cc5e0 2024-04-24T02:12:20.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.720+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2e9140 con 0x7fbbac031040 2024-04-24T02:12:20.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.721+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbba402e070 con 0x7fbbac031040 2024-04-24T02:12:20.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.721+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2e9140 con 0x5563cb2d2830 2024-04-24T02:12:20.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.724+0000 7fbbb229a640 1 -- 172.21.15.134:0/3353741066 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbba8066030 con 0x5563cb2d2830 2024-04-24T02:12:20.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.724+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2e94e0 con 0x5563cb2cc5e0 2024-04-24T02:12:20.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.727+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'38 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbba402e070 con 0x5563cb2cc5e0 2024-04-24T02:12:20.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.727+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2e94e0 con 0x7fbba8086050 2024-04-24T02:12:20.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.729+0000 7fbbb329c640 1 -- 172.21.15.134:0/3353741066 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'29 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbbac040040 con 0x7fbba8086050 2024-04-24T02:12:20.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.729+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2e9a50 con 0x5563cb2d2830 2024-04-24T02:12:20.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.732+0000 7fbbb229a640 1 -- 172.21.15.134:0/3353741066 <== osd.3 v2:172.21.15.134:6801/3585115521 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'29 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbba8066030 con 0x5563cb2d2830 2024-04-24T02:12:20.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.732+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2e9e50 con 0x5563cb2cc5e0 2024-04-24T02:12:20.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.733+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbba402e070 con 0x5563cb2cc5e0 2024-04-24T02:12:20.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.733+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2e9e50 con 0x7fbbac031040 2024-04-24T02:12:20.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.734+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'22 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbba402e070 con 0x7fbbac031040 2024-04-24T02:12:20.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.734+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2e9e50 con 0x7fbba8086050 2024-04-24T02:12:20.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.735+0000 7fbbb329c640 1 -- 172.21.15.134:0/3353741066 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbbac040040 con 0x7fbba8086050 2024-04-24T02:12:20.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.736+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2ea480 con 0x5563cb2d2830 2024-04-24T02:12:20.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.738+0000 7fbbb229a640 1 -- 172.21.15.134:0/3353741066 <== osd.3 v2:172.21.15.134:6801/3585115521 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbba8066030 con 0x5563cb2d2830 2024-04-24T02:12:20.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.738+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2ea820 con 0x7fbba8086050 2024-04-24T02:12:20.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.740+0000 7fbbb329c640 1 -- 172.21.15.134:0/3353741066 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'30 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbac040040 con 0x7fbba8086050 2024-04-24T02:12:20.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.740+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2ead90 con 0x7fbbac031040 2024-04-24T02:12:20.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.742+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbba402e070 con 0x7fbbac031040 2024-04-24T02:12:20.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.742+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2ead90 con 0x7fbba8086050 2024-04-24T02:12:20.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.743+0000 7fbbb329c640 1 -- 172.21.15.134:0/3353741066 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'17 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbac040040 con 0x7fbba8086050 2024-04-24T02:12:20.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.743+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2eb190 con 0x7fbbac031040 2024-04-24T02:12:20.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.746+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.0 v2:172.21.15.104:6800/2419146313 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'33 uv16 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbba402e070 con 0x7fbbac031040 2024-04-24T02:12:20.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.746+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2eb190 con 0x5563cb2cc5e0 2024-04-24T02:12:20.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.748+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'39 uv16 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbba402e070 con 0x5563cb2cc5e0 2024-04-24T02:12:20.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.749+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2eb190 con 0x5563cb2d2830 2024-04-24T02:12:20.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.751+0000 7fbbb229a640 1 -- 172.21.15.134:0/3353741066 <== osd.3 v2:172.21.15.134:6801/3585115521 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'23 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbba8066030 con 0x5563cb2d2830 2024-04-24T02:12:20.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.751+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2eb190 con 0x7fbba8086050 2024-04-24T02:12:20.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.752+0000 7fbbb329c640 1 -- 172.21.15.134:0/3353741066 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'31 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbac040040 con 0x7fbba8086050 2024-04-24T02:12:20.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.752+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2eb190 con 0x5563cb2d2830 2024-04-24T02:12:20.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.754+0000 7fbbb229a640 1 -- 172.21.15.134:0/3353741066 <== osd.3 v2:172.21.15.134:6801/3585115521 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'23 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbba8066030 con 0x5563cb2d2830 2024-04-24T02:12:20.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.754+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2eb190 con 0x5563cb2cc5e0 2024-04-24T02:12:20.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.757+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbba402e070 con 0x5563cb2cc5e0 2024-04-24T02:12:20.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.757+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2eb190 con 0x5563cb2cc5e0 2024-04-24T02:12:20.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.760+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'40 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbba402e070 con 0x5563cb2cc5e0 2024-04-24T02:12:20.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.760+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2eb190 con 0x5563cb2d2830 2024-04-24T02:12:20.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.763+0000 7fbbb229a640 1 -- 172.21.15.134:0/3353741066 <== osd.3 v2:172.21.15.134:6801/3585115521 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'24 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbba8066030 con 0x5563cb2d2830 2024-04-24T02:12:20.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.763+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2eb190 con 0x7fbba8086050 2024-04-24T02:12:20.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.764+0000 7fbbb329c640 1 -- 172.21.15.134:0/3353741066 <== osd.2 v2:172.21.15.134:6800/214480313 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'27 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbac040040 con 0x7fbba8086050 2024-04-24T02:12:20.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.764+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2eb190 con 0x5563cb2d2830 2024-04-24T02:12:20.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.765+0000 7fbbb229a640 1 -- 172.21.15.134:0/3353741066 <== osd.3 v2:172.21.15.134:6801/3585115521 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbba8066030 con 0x5563cb2d2830 2024-04-24T02:12:20.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.765+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2eb190 con 0x5563cb2d2830 2024-04-24T02:12:20.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.768+0000 7fbbb229a640 1 -- 172.21.15.134:0/3353741066 <== osd.3 v2:172.21.15.134:6801/3585115521 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'29 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbba8066030 con 0x5563cb2d2830 2024-04-24T02:12:20.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.768+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2eb190 con 0x5563cb2d2830 2024-04-24T02:12:20.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.769+0000 7fbbb229a640 1 -- 172.21.15.134:0/3353741066 <== osd.3 v2:172.21.15.134:6801/3585115521 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbba8066030 con 0x5563cb2d2830 2024-04-24T02:12:20.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.769+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2eb190 con 0x5563cb2d2830 2024-04-24T02:12:20.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.770+0000 7fbbb229a640 1 -- 172.21.15.134:0/3353741066 <== osd.3 v2:172.21.15.134:6801/3585115521 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'30 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbba8066030 con 0x5563cb2d2830 2024-04-24T02:12:20.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.770+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2eb190 con 0x7fbbac031040 2024-04-24T02:12:20.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.771+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.0 v2:172.21.15.104:6800/2419146313 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'19 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbba402e070 con 0x7fbbac031040 2024-04-24T02:12:20.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.771+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2eb190 con 0x5563cb2d2830 2024-04-24T02:12:20.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.772+0000 7fbbb229a640 1 -- 172.21.15.134:0/3353741066 <== osd.3 v2:172.21.15.134:6801/3585115521 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'23 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbba8066030 con 0x5563cb2d2830 2024-04-24T02:12:20.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.772+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2eb190 con 0x7fbbac031040 2024-04-24T02:12:20.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.773+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.0 v2:172.21.15.104:6800/2419146313 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'23 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbba402e070 con 0x7fbbac031040 2024-04-24T02:12:20.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.773+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2eb190 con 0x5563cb2d2830 2024-04-24T02:12:20.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.774+0000 7fbbb229a640 1 -- 172.21.15.134:0/3353741066 <== osd.3 v2:172.21.15.134:6801/3585115521 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbba8066030 con 0x5563cb2d2830 2024-04-24T02:12:20.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.774+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2eb190 con 0x7fbbac031040 2024-04-24T02:12:20.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.775+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.0 v2:172.21.15.104:6800/2419146313 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'34 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbba402e070 con 0x7fbbac031040 2024-04-24T02:12:20.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.775+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2eb190 con 0x7fbba8086050 2024-04-24T02:12:20.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.777+0000 7fbbb329c640 1 -- 172.21.15.134:0/3353741066 <== osd.2 v2:172.21.15.134:6800/214480313 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbac040040 con 0x7fbba8086050 2024-04-24T02:12:20.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.777+0000 7fb9e3fff640 20 reqs_thread_entry: start 2024-04-24T02:12:20.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.777+0000 7fbbb6d3f800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:20.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.777+0000 7fbbb6d3f800 20 Filter name: none 2024-04-24T02:12:20.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.777+0000 7fb9e1ffb640 20 reqs_thread_entry: start 2024-04-24T02:12:20.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.777+0000 7fbbb6d3f800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-04-24T02:12:20.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.777+0000 7fbbb6d3f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:20.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.777+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563cb315ea0 con 0x7fbbac031040 2024-04-24T02:12:20.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.777+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.0 v2:172.21.15.104:6800/2419146313 24 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fbba402e070 con 0x7fbbac031040 2024-04-24T02:12:20.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.777+0000 7fbbb6d3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:20.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.777+0000 7fbbb6d3f800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-04-24T02:12:20.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.777+0000 7fbbb6d3f800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-04-24T02:12:20.780 INFO:teuthology.orchestra.run.smithi134.stderr:could not remove user: unable to remove user, user does not exist 2024-04-24T02:12:20.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.778+0000 7fba697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:20.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.778+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93887098898912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2e8460 con 0x5563cb2cc5e0 2024-04-24T02:12:20.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.779+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 93887098898912] v30'41 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbba402e070 con 0x5563cb2cc5e0 2024-04-24T02:12:20.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.779+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93887098875424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2e8460 con 0x7fbba8086050 2024-04-24T02:12:20.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.780+0000 7fbbb329c640 1 -- 172.21.15.134:0/3353741066 <== osd.2 v2:172.21.15.134:6800/214480313 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 93887098875424] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbac040040 con 0x7fbba8086050 2024-04-24T02:12:20.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.780+0000 7fbbb6d3f800 20 remove_watcher() i=0 2024-04-24T02:12:20.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.780+0000 7fbbb6d3f800 2 removed watcher, disabling cache 2024-04-24T02:12:20.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.780+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93887098879376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d6e20 con 0x5563cb2cc5e0 2024-04-24T02:12:20.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.781+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.1 v2:172.21.15.134:6804/1487076214 30 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 93887098879376] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbba402e070 con 0x5563cb2cc5e0 2024-04-24T02:12:20.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.781+0000 7fbbb6d3f800 20 remove_watcher() i=1 2024-04-24T02:12:20.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.781+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93887098883456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d7d90 con 0x5563cb2d2830 2024-04-24T02:12:20.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.782+0000 7fbbb229a640 1 -- 172.21.15.134:0/3353741066 <== osd.3 v2:172.21.15.134:6801/3585115521 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 93887098883456] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbba8066030 con 0x5563cb2d2830 2024-04-24T02:12:20.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.782+0000 7fbbb6d3f800 20 remove_watcher() i=2 2024-04-24T02:12:20.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.783+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93887098887088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d7d90 con 0x7fbba8086050 2024-04-24T02:12:20.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.783+0000 7fbbb329c640 1 -- 172.21.15.134:0/3353741066 <== osd.2 v2:172.21.15.134:6800/214480313 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 93887098887088] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbac040040 con 0x7fbba8086050 2024-04-24T02:12:20.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.783+0000 7fbbb6d3f800 20 remove_watcher() i=3 2024-04-24T02:12:20.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.783+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93887098892112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d7d90 con 0x5563cb2cc5e0 2024-04-24T02:12:20.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.784+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.1 v2:172.21.15.134:6804/1487076214 31 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 93887098892112] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbba402e070 con 0x5563cb2cc5e0 2024-04-24T02:12:20.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.784+0000 7fbbb6d3f800 20 remove_watcher() i=4 2024-04-24T02:12:20.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.784+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93887098889392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2daf50 con 0x7fbbac031040 2024-04-24T02:12:20.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.786+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.0 v2:172.21.15.104:6800/2419146313 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 93887098889392] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbba402e070 con 0x7fbbac031040 2024-04-24T02:12:20.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.786+0000 7fbbb6d3f800 20 remove_watcher() i=5 2024-04-24T02:12:20.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.786+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93887098894752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2d7d90 con 0x7fbbac031040 2024-04-24T02:12:20.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.787+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.0 v2:172.21.15.104:6800/2419146313 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 93887098894752] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbba402e070 con 0x7fbbac031040 2024-04-24T02:12:20.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.787+0000 7fbbb6d3f800 20 remove_watcher() i=6 2024-04-24T02:12:20.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.787+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93887098897392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563cb2da4b0 con 0x7fbbac031040 2024-04-24T02:12:20.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.788+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 <== osd.0 v2:172.21.15.104:6800/2419146313 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 93887098897392] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbba402e070 con 0x7fbbac031040 2024-04-24T02:12:20.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.788+0000 7fbbb6d3f800 20 remove_watcher() i=7 2024-04-24T02:12:20.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.788+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fbbac031040 msgr2=0x7fbbac032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.788+0000 7fbbb6d3f800 1 --2- 172.21.15.134:0/3353741066 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fbbac031040 0x7fbbac032940 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.788+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5563cb2cc5e0 msgr2=0x5563cb2ceaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.788+0000 7fbbb6d3f800 1 --2- 172.21.15.134:0/3353741066 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5563cb2cc5e0 0x5563cb2ceaa0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.788+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fbba8086050 msgr2=0x7fbba8007900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.788+0000 7fbbb6d3f800 1 --2- 172.21.15.134:0/3353741066 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fbba8086050 0x7fbba8007900 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.788+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5563cb2d2830 msgr2=0x5563cb2d4c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.788+0000 7fbbb6d3f800 1 --2- 172.21.15.134:0/3353741066 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5563cb2d2830 0x5563cb2d4c20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.788+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fba7c0368b0 msgr2=0x7fba7c038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.788+0000 7fbbb6d3f800 1 --2- 172.21.15.134:0/3353741066 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fba7c0368b0 0x7fba7c038d70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x5563cb294d00 tx=0x7fbbac01f000 comp rx=0 tx=0).stop 2024-04-24T02:12:20.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.788+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563cb2b9490 msgr2=0x5563cb2c0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.788+0000 7fbbb2a9b640 1 -- 172.21.15.134:0/3353741066 reap_dead start 2024-04-24T02:12:20.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.788+0000 7fbbb6d3f800 1 --2- 172.21.15.134:0/3353741066 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563cb2b9490 0x5563cb2c0af0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbba8006540 tx=0x7fbba808dab0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.788+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 shutdown_connections 2024-04-24T02:12:20.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.788+0000 7fbbb6d3f800 1 --2- 172.21.15.134:0/3353741066 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563cb2b9490 0x5563cb2c0af0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.788+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 >> 172.21.15.134:0/3353741066 conn(0x5563cb2b57f0 msgr2=0x5563cb2b2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:20.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.788+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 shutdown_connections 2024-04-24T02:12:20.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.788+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/3353741066 wait complete. 2024-04-24T02:12:20.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.789+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/350076205 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fba8c036950 msgr2=0x7fba8c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.789+0000 7fbbb6d3f800 1 --2- 172.21.15.134:0/350076205 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fba8c036950 0x7fba8c038e10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x5563cb29c2e0 tx=0x7fbbac005840 comp rx=0 tx=0).stop 2024-04-24T02:12:20.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.789+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/350076205 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563cb2ac250 msgr2=0x5563cb2ac670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.789+0000 7fbbb6d3f800 1 --2- 172.21.15.134:0/350076205 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563cb2ac250 0x5563cb2ac670 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbba8000c00 tx=0x7fbba8002fb0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.789+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/350076205 shutdown_connections 2024-04-24T02:12:20.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.789+0000 7fbbb6d3f800 1 --2- 172.21.15.134:0/350076205 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fba8c036950 0x7fba8c038e10 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.789+0000 7fbbb6d3f800 1 --2- 172.21.15.134:0/350076205 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563cb2ac250 0x5563cb2ac670 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.789+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/350076205 >> 172.21.15.134:0/350076205 conn(0x5563cb2a02f0 msgr2=0x5563cb2a06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:20.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.789+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/350076205 shutdown_connections 2024-04-24T02:12:20.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.789+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/350076205 wait complete. 2024-04-24T02:12:20.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.789+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/1886858518 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5563cb19d330 msgr2=0x5563cb29b0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.789+0000 7fbbb6d3f800 1 --2- 172.21.15.134:0/1886858518 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5563cb19d330 0x5563cb29b0d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.789+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/1886858518 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fba98036950 msgr2=0x7fba98038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.789+0000 7fbbb6d3f800 1 --2- 172.21.15.134:0/1886858518 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fba98036950 0x7fba98038e10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbba8054000 tx=0x7fbba804e000 comp rx=0 tx=0).stop 2024-04-24T02:12:20.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.789+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/1886858518 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563cb198f90 msgr2=0x5563cb293ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.789+0000 7fbbb6d3f800 1 --2- 172.21.15.134:0/1886858518 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563cb198f90 0x5563cb293ee0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbba4000fd0 tx=0x7fbba4000ed0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.789+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/1886858518 shutdown_connections 2024-04-24T02:12:20.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.789+0000 7fbbb6d3f800 1 --2- 172.21.15.134:0/1886858518 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5563cb19d330 0x5563cb29b0d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.789+0000 7fbbb6d3f800 1 --2- 172.21.15.134:0/1886858518 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fba98036950 0x7fba98038e10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.789+0000 7fbbb6d3f800 1 --2- 172.21.15.134:0/1886858518 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563cb198f90 0x5563cb293ee0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.789+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/1886858518 >> 172.21.15.134:0/1886858518 conn(0x5563cb194530 msgr2=0x5563cb10d840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:20.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.789+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/1886858518 shutdown_connections 2024-04-24T02:12:20.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.789+0000 7fbbb6d3f800 1 -- 172.21.15.134:0/1886858518 wait complete. 2024-04-24T02:12:20.799 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-04-24T02:12:20.800 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-04-24T02:12:20.800 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-04-24T02:12:20.800 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-04-24T02:12:20.883 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:20.883 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:20.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.882+0000 7f174ec05800 1 Processor -- start 2024-04-24T02:12:20.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.882+0000 7f174ec05800 1 -- start start 2024-04-24T02:12:20.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.882+0000 7f174ec05800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55e51d1a2280 0x55e51d1aad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.882+0000 7f174ec05800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e51d060d40 con 0x55e51d1a0740 2024-04-24T02:12:20.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.882+0000 7f174ec05800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55e51d0334d0 con 0x55e51d1a2280 2024-04-24T02:12:20.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.883+0000 7f174c704640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55e51d1a0740 0x55e51d1a0b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:43124/0 (socket says 172.21.15.134:43124) 2024-04-24T02:12:20.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.883+0000 7f174c704640 1 -- 172.21.15.134:0/1878253963 learned_addr learned my addr 172.21.15.134:0/1878253963 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:12:20.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.883+0000 7f174bf03640 1 --2- 172.21.15.134:0/1878253963 >> v2:172.21.15.104:3300/0 conn(0x55e51d1a2280 0x55e51d1aad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.883+0000 7f174b702640 1 -- 172.21.15.134:0/1878253963 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3651799825 0 0) 0x55e51d060d40 con 0x55e51d1a0740 2024-04-24T02:12:20.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.883+0000 7f174b702640 1 -- 172.21.15.134:0/1878253963 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1734001e10 con 0x55e51d1a0740 2024-04-24T02:12:20.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.883+0000 7f174bf03640 1 -- 172.21.15.134:0/1878253963 >> v1:172.21.15.104:6789/0 conn(0x55e51d1a0740 legacy=0x55e51d1a0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.883+0000 7f174bf03640 1 -- 172.21.15.134:0/1878253963 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e51d05f590 con 0x55e51d1a2280 2024-04-24T02:12:20.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.885+0000 7f174bf03640 1 --2- 172.21.15.134:0/1878253963 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d1a2280 0x55e51d1aad80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f174000a470 tx=0x7f174001cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f3202e97bf4b26c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.885+0000 7f174b702640 1 -- 172.21.15.134:0/1878253963 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1740057070 con 0x55e51d1a2280 2024-04-24T02:12:20.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.885+0000 7f174b702640 1 -- 172.21.15.134:0/1878253963 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f174004acd0 con 0x55e51d1a2280 2024-04-24T02:12:20.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.885+0000 7f174b702640 1 -- 172.21.15.134:0/1878253963 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1740052440 con 0x55e51d1a2280 2024-04-24T02:12:20.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.886+0000 7f174ec05800 1 -- 172.21.15.134:0/1878253963 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d1a2280 msgr2=0x55e51d1aad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.886+0000 7f174ec05800 1 --2- 172.21.15.134:0/1878253963 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d1a2280 0x55e51d1aad80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f174000a470 tx=0x7f174001cdb0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.886+0000 7f174ec05800 1 -- 172.21.15.134:0/1878253963 shutdown_connections 2024-04-24T02:12:20.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.886+0000 7f174ec05800 1 --2- 172.21.15.134:0/1878253963 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d1a2280 0x55e51d1aad80 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.886+0000 7f174ec05800 1 -- 172.21.15.134:0/1878253963 >> 172.21.15.134:0/1878253963 conn(0x55e51d19c380 msgr2=0x55e51d19e7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:20.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.886+0000 7f174ec05800 1 -- 172.21.15.134:0/1878253963 shutdown_connections 2024-04-24T02:12:20.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.886+0000 7f174ec05800 1 -- 172.21.15.134:0/1878253963 wait complete. 2024-04-24T02:12:20.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.897+0000 7f174ec05800 1 Processor -- start 2024-04-24T02:12:20.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.897+0000 7f174ec05800 1 -- start start 2024-04-24T02:12:20.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.897+0000 7f174ec05800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d1a0740 0x55e51d2953d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.897+0000 7f174ec05800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e51d0ed3c0 con 0x55e51d1a0740 2024-04-24T02:12:20.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.898+0000 7f174c704640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d1a0740 0x55e51d2953d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.898+0000 7f174c704640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d1a0740 0x55e51d2953d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45246/0 (socket says 172.21.15.134:45246) 2024-04-24T02:12:20.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.898+0000 7f174c704640 1 -- 172.21.15.134:0/2884244681 learned_addr learned my addr 172.21.15.134:0/2884244681 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:20.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.898+0000 7f174c704640 1 -- 172.21.15.134:0/2884244681 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e51d2959a0 con 0x55e51d1a0740 2024-04-24T02:12:20.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.898+0000 7f174c704640 1 --2- 172.21.15.134:0/2884244681 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d1a0740 0x55e51d2953d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f173c001de0 tx=0x7f173c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d7b15a281a8d58d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.898+0000 7f163a60c640 1 -- 172.21.15.134:0/2884244681 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f173c012020 con 0x55e51d1a0740 2024-04-24T02:12:20.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.898+0000 7f163a60c640 1 -- 172.21.15.134:0/2884244681 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f173c00e5a0 con 0x55e51d1a0740 2024-04-24T02:12:20.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.898+0000 7f163a60c640 1 -- 172.21.15.134:0/2884244681 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f173c00e900 con 0x55e51d1a0740 2024-04-24T02:12:20.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.899+0000 7f174ec05800 1 -- 172.21.15.134:0/2884244681 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d1a0740 msgr2=0x55e51d2953d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.899+0000 7f174ec05800 1 --2- 172.21.15.134:0/2884244681 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d1a0740 0x55e51d2953d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f173c001de0 tx=0x7f173c00b6c0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.899+0000 7f174ec05800 1 -- 172.21.15.134:0/2884244681 shutdown_connections 2024-04-24T02:12:20.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.899+0000 7f174ec05800 1 --2- 172.21.15.134:0/2884244681 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d1a0740 0x55e51d2953d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.899+0000 7f174ec05800 1 -- 172.21.15.134:0/2884244681 >> 172.21.15.134:0/2884244681 conn(0x55e51d19c380 msgr2=0x55e51d290cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:20.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.899+0000 7f174ec05800 1 -- 172.21.15.134:0/2884244681 shutdown_connections 2024-04-24T02:12:20.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.899+0000 7f174ec05800 1 -- 172.21.15.134:0/2884244681 wait complete. 2024-04-24T02:12:20.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.899+0000 7f174ec05800 1 Processor -- start 2024-04-24T02:12:20.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.899+0000 7f174ec05800 1 -- start start 2024-04-24T02:12:20.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.899+0000 7f174ec05800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d1a0740 0x55e51d29cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.899+0000 7f174ec05800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e51d1ad5a0 con 0x55e51d1a0740 2024-04-24T02:12:20.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.900+0000 7f174c704640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d1a0740 0x55e51d29cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.900+0000 7f174c704640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d1a0740 0x55e51d29cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45248/0 (socket says 172.21.15.134:45248) 2024-04-24T02:12:20.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.900+0000 7f174c704640 1 -- 172.21.15.134:0/305449484 learned_addr learned my addr 172.21.15.134:0/305449484 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:20.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.900+0000 7f174c704640 1 -- 172.21.15.134:0/305449484 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e51d29d440 con 0x55e51d1a0740 2024-04-24T02:12:20.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.900+0000 7f174c704640 1 --2- 172.21.15.134:0/305449484 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d1a0740 0x55e51d29cf00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f173c00c010 tx=0x7f173c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.900+0000 7f1638e09640 1 -- 172.21.15.134:0/305449484 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f173c012030 con 0x55e51d1a0740 2024-04-24T02:12:20.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.900+0000 7f174ec05800 1 -- 172.21.15.134:0/305449484 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e51d29d6d0 con 0x55e51d1a0740 2024-04-24T02:12:20.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.900+0000 7f1638e09640 1 -- 172.21.15.134:0/305449484 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f173c01a7a0 con 0x55e51d1a0740 2024-04-24T02:12:20.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.900+0000 7f174ec05800 1 -- 172.21.15.134:0/305449484 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e51d2a0380 con 0x55e51d1a0740 2024-04-24T02:12:20.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.900+0000 7f1638e09640 1 -- 172.21.15.134:0/305449484 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f173c01a950 con 0x55e51d1a0740 2024-04-24T02:12:20.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.901+0000 7f1638e09640 1 -- 172.21.15.134:0/305449484 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f173c015020 con 0x55e51d1a0740 2024-04-24T02:12:20.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.901+0000 7f1638e09640 1 --2- 172.21.15.134:0/305449484 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1634036950 0x7f1634038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.901+0000 7f1638e09640 1 -- 172.21.15.134:0/305449484 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f173c020030 con 0x55e51d1a0740 2024-04-24T02:12:20.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.901+0000 7f174bf03640 1 --2- 172.21.15.134:0/305449484 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1634036950 0x7f1634038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.902+0000 7f174ec05800 1 --2- 172.21.15.134:0/305449484 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e51d1a2280 0x55e51d2a4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.902+0000 7f174ec05800 1 -- 172.21.15.134:0/305449484 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2a46c0 con 0x55e51d1a2280 2024-04-24T02:12:20.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.902+0000 7f174cf05640 1 --2- 172.21.15.134:0/305449484 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e51d1a2280 0x55e51d2a4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.902+0000 7f174bf03640 1 --2- 172.21.15.134:0/305449484 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1634036950 0x7f1634038e10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1740054000 tx=0x7f174004e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.902+0000 7f174cf05640 1 --2- 172.21.15.134:0/305449484 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e51d1a2280 0x55e51d2a4140 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.902+0000 7f174cf05640 1 -- 172.21.15.134:0/305449484 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f174400a4a0 con 0x55e51d1a2280 2024-04-24T02:12:20.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.902+0000 7f174ec05800 1 -- 172.21.15.134:0/305449484 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2a1710 con 0x55e51d1a2280 2024-04-24T02:12:20.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.902+0000 7f174cf05640 1 -- 172.21.15.134:0/305449484 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f174400a4a0 con 0x55e51d1a2280 2024-04-24T02:12:20.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.902+0000 7f174ec05800 1 -- 172.21.15.134:0/305449484 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2a6500 con 0x55e51d1a2280 2024-04-24T02:12:20.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.903+0000 7f174cf05640 1 -- 172.21.15.134:0/305449484 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f174400a4a0 con 0x55e51d1a2280 2024-04-24T02:12:20.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.903+0000 7f174ec05800 1 -- 172.21.15.134:0/305449484 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2a5840 con 0x55e51d1a2280 2024-04-24T02:12:20.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.903+0000 7f174cf05640 1 -- 172.21.15.134:0/305449484 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f174400a4a0 con 0x55e51d1a2280 2024-04-24T02:12:20.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.903+0000 7f174ec05800 1 -- 172.21.15.134:0/305449484 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2a5c90 con 0x55e51d1a2280 2024-04-24T02:12:20.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.903+0000 7f174cf05640 1 -- 172.21.15.134:0/305449484 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f174400a4a0 con 0x55e51d1a2280 2024-04-24T02:12:20.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.904+0000 7f174ec05800 1 Processor -- start 2024-04-24T02:12:20.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.904+0000 7f174ec05800 1 -- start start 2024-04-24T02:12:20.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.904+0000 7f174ec05800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d2b52d0 0x55e51d2b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.904+0000 7f174ec05800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e51d0936b0 con 0x55e51d2b52d0 2024-04-24T02:12:20.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.904+0000 7f174bf03640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d2b52d0 0x55e51d2b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.904+0000 7f174bf03640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d2b52d0 0x55e51d2b56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45262/0 (socket says 172.21.15.134:45262) 2024-04-24T02:12:20.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.904+0000 7f174bf03640 1 -- 172.21.15.134:0/512163502 learned_addr learned my addr 172.21.15.134:0/512163502 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:20.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.904+0000 7f174bf03640 1 -- 172.21.15.134:0/512163502 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e51d2b5c30 con 0x55e51d2b52d0 2024-04-24T02:12:20.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.904+0000 7f174bf03640 1 --2- 172.21.15.134:0/512163502 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d2b52d0 0x55e51d2b56f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f174004aca0 tx=0x7f1740002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.905+0000 7f1631ffb640 1 -- 172.21.15.134:0/512163502 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1740057040 con 0x55e51d2b52d0 2024-04-24T02:12:20.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.905+0000 7f1631ffb640 1 -- 172.21.15.134:0/512163502 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f174005dda0 con 0x55e51d2b52d0 2024-04-24T02:12:20.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.905+0000 7f174ec05800 1 -- 172.21.15.134:0/512163502 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e51d2b66a0 con 0x55e51d2b52d0 2024-04-24T02:12:20.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.905+0000 7f1631ffb640 1 -- 172.21.15.134:0/512163502 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1740052570 con 0x55e51d2b52d0 2024-04-24T02:12:20.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.905+0000 7f174ec05800 1 -- 172.21.15.134:0/512163502 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e51d2b6b40 con 0x55e51d2b52d0 2024-04-24T02:12:20.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.905+0000 7f1631ffb640 1 -- 172.21.15.134:0/512163502 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f174006f030 con 0x55e51d2b52d0 2024-04-24T02:12:20.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.905+0000 7f1631ffb640 1 --2- 172.21.15.134:0/512163502 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1624036950 0x7f1624038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.906+0000 7f1631ffb640 1 -- 172.21.15.134:0/512163502 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f174006d070 con 0x55e51d2b52d0 2024-04-24T02:12:20.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.906+0000 7f174cf05640 1 --2- 172.21.15.134:0/512163502 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1624036950 0x7f1624038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.906+0000 7f174ec05800 1 Processor -- start 2024-04-24T02:12:20.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.906+0000 7f174cf05640 1 --2- 172.21.15.134:0/512163502 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1624036950 0x7f1624038e10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x55e51d2a5360 tx=0x7f1744005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.906+0000 7f174ec05800 1 -- start start 2024-04-24T02:12:20.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.906+0000 7f174ec05800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d2c24b0 0x55e51d2c28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.906+0000 7f174ec05800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e51d295d20 con 0x55e51d2c24b0 2024-04-24T02:12:20.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.906+0000 7f174bf03640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d2c24b0 0x55e51d2c28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.906+0000 7f174bf03640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d2c24b0 0x55e51d2c28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45270/0 (socket says 172.21.15.134:45270) 2024-04-24T02:12:20.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.906+0000 7f174bf03640 1 -- 172.21.15.134:0/359102075 learned_addr learned my addr 172.21.15.134:0/359102075 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:20.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.907+0000 7f174bf03640 1 -- 172.21.15.134:0/359102075 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e51d2c2ea0 con 0x55e51d2c24b0 2024-04-24T02:12:20.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.907+0000 7f174bf03640 1 --2- 172.21.15.134:0/359102075 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d2c24b0 0x55e51d2c28d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f174008d950 tx=0x7f174008f220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbb6e11e78130fc4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.907+0000 7f162b7fe640 1 -- 172.21.15.134:0/359102075 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f174007f070 con 0x55e51d2c24b0 2024-04-24T02:12:20.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.907+0000 7f162b7fe640 1 -- 172.21.15.134:0/359102075 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1740071540 con 0x55e51d2c24b0 2024-04-24T02:12:20.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.907+0000 7f162b7fe640 1 -- 172.21.15.134:0/359102075 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1740052d60 con 0x55e51d2c24b0 2024-04-24T02:12:20.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.907+0000 7f174ec05800 1 -- 172.21.15.134:0/359102075 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d2c24b0 msgr2=0x55e51d2c28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.907+0000 7f174ec05800 1 --2- 172.21.15.134:0/359102075 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d2c24b0 0x55e51d2c28d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f174008d950 tx=0x7f174008f220 comp rx=0 tx=0).stop 2024-04-24T02:12:20.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.907+0000 7f174ec05800 1 -- 172.21.15.134:0/359102075 shutdown_connections 2024-04-24T02:12:20.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.907+0000 7f174ec05800 1 --2- 172.21.15.134:0/359102075 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d2c24b0 0x55e51d2c28d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.907+0000 7f174ec05800 1 -- 172.21.15.134:0/359102075 >> 172.21.15.134:0/359102075 conn(0x55e51d2be810 msgr2=0x55e51d2bc870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:20.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.907+0000 7f174ec05800 1 -- 172.21.15.134:0/359102075 shutdown_connections 2024-04-24T02:12:20.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.907+0000 7f174ec05800 1 -- 172.21.15.134:0/359102075 wait complete. 2024-04-24T02:12:20.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.908+0000 7f174ec05800 1 Processor -- start 2024-04-24T02:12:20.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.908+0000 7f174ec05800 1 -- start start 2024-04-24T02:12:20.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.908+0000 7f174ec05800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d2c24b0 0x55e51d2c9b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.908+0000 7f174ec05800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e51d2c3610 con 0x55e51d2c24b0 2024-04-24T02:12:20.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.908+0000 7f174bf03640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d2c24b0 0x55e51d2c9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.908+0000 7f174bf03640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d2c24b0 0x55e51d2c9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45272/0 (socket says 172.21.15.134:45272) 2024-04-24T02:12:20.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.908+0000 7f174bf03640 1 -- 172.21.15.134:0/1224214597 learned_addr learned my addr 172.21.15.134:0/1224214597 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:20.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.908+0000 7f174bf03640 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e51d2ca060 con 0x55e51d2c24b0 2024-04-24T02:12:20.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.908+0000 7f174bf03640 1 --2- 172.21.15.134:0/1224214597 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d2c24b0 0x55e51d2c9b20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1740071f90 tx=0x7f174008d8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.908+0000 7f1629ffb640 1 -- 172.21.15.134:0/1224214597 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f174007f040 con 0x55e51d2c24b0 2024-04-24T02:12:20.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.909+0000 7f1629ffb640 1 -- 172.21.15.134:0/1224214597 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1740009410 con 0x55e51d2c24b0 2024-04-24T02:12:20.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.909+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e51d2ca2f0 con 0x55e51d2c24b0 2024-04-24T02:12:20.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.909+0000 7f1629ffb640 1 -- 172.21.15.134:0/1224214597 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1740070740 con 0x55e51d2c24b0 2024-04-24T02:12:20.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.909+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e51d2ccfa0 con 0x55e51d2c24b0 2024-04-24T02:12:20.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.909+0000 7f1629ffb640 1 -- 172.21.15.134:0/1224214597 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1740096020 con 0x55e51d2c24b0 2024-04-24T02:12:20.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.909+0000 7f1629ffb640 1 --2- 172.21.15.134:0/1224214597 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f161c036950 0x7f161c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.909+0000 7f1629ffb640 1 -- 172.21.15.134:0/1224214597 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f1740094020 con 0x55e51d2c24b0 2024-04-24T02:12:20.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.910+0000 7f174cf05640 1 --2- 172.21.15.134:0/1224214597 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f161c036950 0x7f161c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.910+0000 7f174cf05640 1 --2- 172.21.15.134:0/1224214597 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f161c036950 0x7f161c038e10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x55e51d2a1660 tx=0x7f174401f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.910+0000 7f174ec05800 20 rados->read ofs=0 len=0 2024-04-24T02:12:20.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.910+0000 7f174ec05800 1 --2- 172.21.15.134:0/1224214597 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e51d2d5690 0x55e51d2d7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.910+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2d82a0 con 0x55e51d2d5690 2024-04-24T02:12:20.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.910+0000 7f174c704640 1 --2- 172.21.15.134:0/1224214597 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e51d2d5690 0x55e51d2d7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.910+0000 7f174c704640 1 --2- 172.21.15.134:0/1224214597 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e51d2d5690 0x55e51d2d7b50 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.911+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f173c040040 con 0x55e51d2d5690 2024-04-24T02:12:20.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.911+0000 7f174ec05800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:20.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.911+0000 7f174ec05800 20 realm 2024-04-24T02:12:20.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.911+0000 7f174ec05800 20 rados->read ofs=0 len=0 2024-04-24T02:12:20.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.911+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2d86b0 con 0x55e51d2d5690 2024-04-24T02:12:20.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.911+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f173c040040 con 0x55e51d2d5690 2024-04-24T02:12:20.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.911+0000 7f174ec05800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:20.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.911+0000 7f174ec05800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:20.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.911+0000 7f174ec05800 20 rados->read ofs=0 len=0 2024-04-24T02:12:20.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.911+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2d8f80 con 0x55e51d2d5690 2024-04-24T02:12:20.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.911+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f173c040040 con 0x55e51d2d5690 2024-04-24T02:12:20.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.911+0000 7f174ec05800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:20.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.911+0000 7f174ec05800 20 rados->read ofs=0 len=0 2024-04-24T02:12:20.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.911+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2d9320 con 0x55e51d2d5690 2024-04-24T02:12:20.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.911+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f173c040040 con 0x55e51d2d5690 2024-04-24T02:12:20.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.911+0000 7f174ec05800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:20.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.911+0000 7f174ec05800 20 rados->read ofs=0 len=0 2024-04-24T02:12:20.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.911+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2d9b70 con 0x55e51d2d5690 2024-04-24T02:12:20.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.911+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f173c040040 con 0x55e51d2d5690 2024-04-24T02:12:20.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.911+0000 7f174ec05800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:20.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.911+0000 7f174ec05800 20 searching for the correct realm 2024-04-24T02:12:20.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.912+0000 7f174ec05800 1 --2- 172.21.15.134:0/1224214597 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55e51d2db8e0 0x55e51d2ddcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.912+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2de2b0 con 0x55e51d2db8e0 2024-04-24T02:12:20.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.912+0000 7f174bf03640 1 --2- 172.21.15.134:0/1224214597 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55e51d2db8e0 0x55e51d2ddcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.912+0000 7f174bf03640 1 --2- 172.21.15.134:0/1224214597 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55e51d2db8e0 0x55e51d2ddcd0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.912+0000 7f174bf03640 1 -- 172.21.15.134:0/1224214597 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f174005a040 con 0x55e51d2db8e0 2024-04-24T02:12:20.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.912+0000 7f174bf03640 1 --2- 172.21.15.134:0/1224214597 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f1740070b70 0x7f174007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.912+0000 7f174bf03640 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2de2b0 con 0x7f1740070b70 2024-04-24T02:12:20.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.912+0000 7f174cf05640 1 --2- 172.21.15.134:0/1224214597 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f1740070b70 0x7f174007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.913+0000 7f174cf05640 1 --2- 172.21.15.134:0/1224214597 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f1740070b70 0x7f174007a430 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.913+0000 7f174cf05640 1 -- 172.21.15.134:0/1224214597 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f174401f070 con 0x7f1740070b70 2024-04-24T02:12:20.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.913+0000 7f174cf05640 1 --2- 172.21.15.134:0/1224214597 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f1744031040 0x7f1744032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:20.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.913+0000 7f174cf05640 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2de2b0 con 0x7f1744031040 2024-04-24T02:12:20.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.913+0000 7f174c704640 1 --2- 172.21.15.134:0/1224214597 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f1744031040 0x7f1744032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:20.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.914+0000 7f174c704640 1 --2- 172.21.15.134:0/1224214597 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f1744031040 0x7f1744032940 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:20.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.914+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f173c040040 con 0x7f1744031040 2024-04-24T02:12:20.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.914+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2de2b0 con 0x55e51d2d5690 2024-04-24T02:12:20.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.914+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f173c040040 con 0x55e51d2d5690 2024-04-24T02:12:20.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.914+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2de2b0 con 0x55e51d2d5690 2024-04-24T02:12:20.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.914+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f173c040040 con 0x55e51d2d5690 2024-04-24T02:12:20.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.914+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f173c03d080 con 0x7f1744031040 2024-04-24T02:12:20.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.914+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f173c040040 con 0x7f1744031040 2024-04-24T02:12:20.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.914+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f173c03d080 con 0x7f1744031040 2024-04-24T02:12:20.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.915+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f173c040040 con 0x7f1744031040 2024-04-24T02:12:20.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.915+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f173c03d080 con 0x7f1740070b70 2024-04-24T02:12:20.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.915+0000 7f174cf05640 1 -- 172.21.15.134:0/1224214597 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f174401f070 con 0x7f1740070b70 2024-04-24T02:12:20.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.915+0000 7f174cf05640 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f173c03d080 con 0x55e51d2db8e0 2024-04-24T02:12:20.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.915+0000 7f174bf03640 1 -- 172.21.15.134:0/1224214597 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f174005a040 con 0x55e51d2db8e0 2024-04-24T02:12:20.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.915+0000 7f174bf03640 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f173c03d080 con 0x55e51d2d5690 2024-04-24T02:12:20.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.915+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f173c040040 con 0x55e51d2d5690 2024-04-24T02:12:20.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.915+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f173c03d080 con 0x7f1744031040 2024-04-24T02:12:20.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.916+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f173c040040 con 0x7f1744031040 2024-04-24T02:12:20.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.916+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f173c03d080 con 0x55e51d2d5690 2024-04-24T02:12:20.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.916+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f173c040040 con 0x55e51d2d5690 2024-04-24T02:12:20.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.916+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f173c03d080 con 0x7f1740070b70 2024-04-24T02:12:20.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.916+0000 7f174cf05640 1 -- 172.21.15.134:0/1224214597 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f174401f070 con 0x7f1740070b70 2024-04-24T02:12:20.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.916+0000 7f174cf05640 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f173c03d080 con 0x55e51d2db8e0 2024-04-24T02:12:20.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.916+0000 7f174bf03640 1 -- 172.21.15.134:0/1224214597 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f174005a040 con 0x55e51d2db8e0 2024-04-24T02:12:20.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.916+0000 7f174bf03640 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f173c03d080 con 0x55e51d2db8e0 2024-04-24T02:12:20.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.917+0000 7f174bf03640 1 -- 172.21.15.134:0/1224214597 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f174005a040 con 0x55e51d2db8e0 2024-04-24T02:12:20.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.917+0000 7f174bf03640 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f173c03d080 con 0x7f1744031040 2024-04-24T02:12:20.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.917+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f173c040040 con 0x7f1744031040 2024-04-24T02:12:20.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.917+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f173c03d080 con 0x55e51d2db8e0 2024-04-24T02:12:20.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.917+0000 7f174bf03640 1 -- 172.21.15.134:0/1224214597 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f174005a040 con 0x55e51d2db8e0 2024-04-24T02:12:20.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.917+0000 7f174bf03640 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f173c03d080 con 0x55e51d2db8e0 2024-04-24T02:12:20.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.917+0000 7f174bf03640 1 -- 172.21.15.134:0/1224214597 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f174005a040 con 0x55e51d2db8e0 2024-04-24T02:12:20.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.917+0000 7f174bf03640 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f173c03d080 con 0x55e51d2d5690 2024-04-24T02:12:20.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.917+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f173c040040 con 0x55e51d2d5690 2024-04-24T02:12:20.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.917+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f173c03d080 con 0x55e51d2d5690 2024-04-24T02:12:20.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.918+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v23'2 uv2 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f173c040040 con 0x55e51d2d5690 2024-04-24T02:12:20.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.918+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f173c03d080 con 0x7f1744031040 2024-04-24T02:12:20.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.918+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f173c040040 con 0x7f1744031040 2024-04-24T02:12:20.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.918+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f173c03d080 con 0x55e51d2db8e0 2024-04-24T02:12:20.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.918+0000 7f174bf03640 1 -- 172.21.15.134:0/1224214597 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f174005a040 con 0x55e51d2db8e0 2024-04-24T02:12:20.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.918+0000 7f174bf03640 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f173c03d080 con 0x7f1740070b70 2024-04-24T02:12:20.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.918+0000 7f174cf05640 1 -- 172.21.15.134:0/1224214597 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f174401f070 con 0x7f1740070b70 2024-04-24T02:12:20.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.918+0000 7f174cf05640 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f173c03d080 con 0x55e51d2d5690 2024-04-24T02:12:20.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.919+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f173c040040 con 0x55e51d2d5690 2024-04-24T02:12:20.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.919+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f173c03d080 con 0x7f1744031040 2024-04-24T02:12:20.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.919+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f173c040040 con 0x7f1744031040 2024-04-24T02:12:20.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.919+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f173c03d080 con 0x55e51d2db8e0 2024-04-24T02:12:20.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.919+0000 7f174bf03640 1 -- 172.21.15.134:0/1224214597 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f174005a040 con 0x55e51d2db8e0 2024-04-24T02:12:20.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.919+0000 7f174bf03640 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f173c03d080 con 0x7f1744031040 2024-04-24T02:12:20.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.920+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f173c040040 con 0x7f1744031040 2024-04-24T02:12:20.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.920+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f173c03d080 con 0x7f1740070b70 2024-04-24T02:12:20.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.920+0000 7f174cf05640 1 -- 172.21.15.134:0/1224214597 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f174401f070 con 0x7f1740070b70 2024-04-24T02:12:20.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.920+0000 7f174cf05640 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f173c03d080 con 0x55e51d2db8e0 2024-04-24T02:12:20.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.920+0000 7f174bf03640 1 -- 172.21.15.134:0/1224214597 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f174005a040 con 0x55e51d2db8e0 2024-04-24T02:12:20.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.920+0000 7f174bf03640 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f173c03d080 con 0x7f1744031040 2024-04-24T02:12:20.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.920+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f173c040040 con 0x7f1744031040 2024-04-24T02:12:20.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.920+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f173c03d080 con 0x55e51d2d5690 2024-04-24T02:12:20.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.920+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f173c040040 con 0x55e51d2d5690 2024-04-24T02:12:20.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.921+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f173c03d080 con 0x7f1740070b70 2024-04-24T02:12:20.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.921+0000 7f174cf05640 1 -- 172.21.15.134:0/1224214597 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f174401f070 con 0x7f1740070b70 2024-04-24T02:12:20.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.921+0000 7f174ec05800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:20.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.921+0000 7f174ec05800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:20.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.921+0000 7f174ec05800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:20.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.921+0000 7f174ec05800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:20.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.921+0000 7f174ec05800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:20.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.921+0000 7f174ec05800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:20.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.921+0000 7f174ec05800 20 rados->read ofs=0 len=0 2024-04-24T02:12:20.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.921+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2da520 con 0x55e51d2d5690 2024-04-24T02:12:20.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.921+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f173c040040 con 0x55e51d2d5690 2024-04-24T02:12:20.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.921+0000 7f174ec05800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:20.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.921+0000 7f174ec05800 20 rados->read ofs=0 len=0 2024-04-24T02:12:20.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.921+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2dadc0 con 0x55e51d2d5690 2024-04-24T02:12:20.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.921+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f173c040040 con 0x55e51d2d5690 2024-04-24T02:12:20.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.921+0000 7f174ec05800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:20.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.921+0000 7f174ec05800 20 rados->read ofs=0 len=0 2024-04-24T02:12:20.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.921+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2dadc0 con 0x55e51d2d5690 2024-04-24T02:12:20.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.921+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f173c040040 con 0x55e51d2d5690 2024-04-24T02:12:20.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.921+0000 7f174ec05800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:20.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.921+0000 7f174ec05800 20 zone default found 2024-04-24T02:12:20.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.921+0000 7f174ec05800 4 Realm: () 2024-04-24T02:12:20.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.921+0000 7f174ec05800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:20.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.921+0000 7f174ec05800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:20.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.921+0000 7f174ec05800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:20.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.921+0000 7f174ec05800 20 zonegroup default 2024-04-24T02:12:20.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.921+0000 7f174ec05800 20 rados->read ofs=0 len=0 2024-04-24T02:12:20.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.921+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2de730 con 0x7f1744031040 2024-04-24T02:12:20.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.922+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f173c040040 con 0x7f1744031040 2024-04-24T02:12:20.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.922+0000 7f174ec05800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:20.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.922+0000 7f174ec05800 20 rados->read ofs=0 len=0 2024-04-24T02:12:20.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.922+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2e01a0 con 0x55e51d2db8e0 2024-04-24T02:12:20.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.922+0000 7f174bf03640 1 -- 172.21.15.134:0/1224214597 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f174005a040 con 0x55e51d2db8e0 2024-04-24T02:12:20.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.922+0000 7f174ec05800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:20.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.922+0000 7f174ec05800 20 rados->read ofs=0 len=0 2024-04-24T02:12:20.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.922+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2e06b0 con 0x55e51d2db8e0 2024-04-24T02:12:20.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.922+0000 7f174bf03640 1 -- 172.21.15.134:0/1224214597 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f174005a040 con 0x55e51d2db8e0 2024-04-24T02:12:20.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.922+0000 7f174ec05800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:20.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.922+0000 7f174ec05800 20 started sync module instance, tier type = 2024-04-24T02:12:20.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.922+0000 7f174ec05800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:20.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.922+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2df5b0 con 0x7f1740070b70 2024-04-24T02:12:20.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.923+0000 7f174cf05640 1 -- 172.21.15.134:0/1224214597 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f174401f070 con 0x7f1740070b70 2024-04-24T02:12:20.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.923+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94442525424032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2dfdc0 con 0x7f1740070b70 2024-04-24T02:12:20.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.924+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2e15e0 con 0x55e51d2d5690 2024-04-24T02:12:20.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.925+0000 7f174cf05640 1 -- 172.21.15.134:0/1224214597 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94442525424032] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f174401f070 con 0x7f1740070b70 2024-04-24T02:12:20.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.925+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f173c040040 con 0x55e51d2d5690 2024-04-24T02:12:20.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.925+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94442525430064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2e1a00 con 0x55e51d2d5690 2024-04-24T02:12:20.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.925+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2e23c0 con 0x55e51d2db8e0 2024-04-24T02:12:20.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.926+0000 7f174bf03640 1 -- 172.21.15.134:0/1224214597 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f174005a040 con 0x55e51d2db8e0 2024-04-24T02:12:20.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.926+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94442525433616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2e2c60 con 0x55e51d2db8e0 2024-04-24T02:12:20.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.926+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2e3700 con 0x7f1740070b70 2024-04-24T02:12:20.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.926+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94442525430064] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f173c040040 con 0x55e51d2d5690 2024-04-24T02:12:20.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.927+0000 7f174bf03640 1 -- 172.21.15.134:0/1224214597 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94442525433616] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f174005a040 con 0x55e51d2db8e0 2024-04-24T02:12:20.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.927+0000 7f174cf05640 1 -- 172.21.15.134:0/1224214597 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f174401f070 con 0x7f1740070b70 2024-04-24T02:12:20.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.927+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94442525435824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2e1550 con 0x7f1740070b70 2024-04-24T02:12:20.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.927+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2e4110 con 0x55e51d2d5690 2024-04-24T02:12:20.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.928+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f173c040040 con 0x55e51d2d5690 2024-04-24T02:12:20.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.928+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94442525441120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2e4530 con 0x55e51d2d5690 2024-04-24T02:12:20.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.928+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2e4b90 con 0x7f1744031040 2024-04-24T02:12:20.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.928+0000 7f174cf05640 1 -- 172.21.15.134:0/1224214597 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94442525435824] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f174401f070 con 0x7f1740070b70 2024-04-24T02:12:20.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.929+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94442525441120] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f173c040040 con 0x55e51d2d5690 2024-04-24T02:12:20.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.929+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f173c040040 con 0x7f1744031040 2024-04-24T02:12:20.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.929+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94442525442176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2e46a0 con 0x7f1744031040 2024-04-24T02:12:20.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.929+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2e46a0 con 0x7f1744031040 2024-04-24T02:12:20.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.930+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94442525442176] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f173c040040 con 0x7f1744031040 2024-04-24T02:12:20.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.931+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(56 notify.6 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f173c040040 con 0x7f1744031040 2024-04-24T02:12:20.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.931+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94442525438416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2e5410 con 0x7f1744031040 2024-04-24T02:12:20.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.931+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2e5dd0 con 0x7f1744031040 2024-04-24T02:12:20.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.932+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(58 notify.7 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f173c040040 con 0x7f1744031040 2024-04-24T02:12:20.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.932+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94442525448480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2e6230 con 0x7f1744031040 2024-04-24T02:12:20.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.932+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94442525438416] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f173c040040 con 0x7f1744031040 2024-04-24T02:12:20.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.932+0000 7f174ec05800 20 add_watcher() i=0 2024-04-24T02:12:20.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.932+0000 7f174ec05800 20 add_watcher() i=1 2024-04-24T02:12:20.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.932+0000 7f174ec05800 20 add_watcher() i=2 2024-04-24T02:12:20.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.932+0000 7f174ec05800 20 add_watcher() i=3 2024-04-24T02:12:20.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.932+0000 7f174ec05800 20 add_watcher() i=4 2024-04-24T02:12:20.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.932+0000 7f174ec05800 20 add_watcher() i=5 2024-04-24T02:12:20.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.932+0000 7f174ec05800 20 add_watcher() i=6 2024-04-24T02:12:20.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.933+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94442525448480] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f173c040040 con 0x7f1744031040 2024-04-24T02:12:20.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.933+0000 7f174ec05800 20 add_watcher() i=7 2024-04-24T02:12:20.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.933+0000 7f174ec05800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:20.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.933+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2e6230 con 0x55e51d2d5690 2024-04-24T02:12:20.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.934+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f173c040040 con 0x55e51d2d5690 2024-04-24T02:12:20.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.934+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94442525449536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2e6230 con 0x55e51d2d5690 2024-04-24T02:12:20.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.935+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94442525449536] v30'42 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f173c040040 con 0x55e51d2d5690 2024-04-24T02:12:20.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.935+0000 7f16027e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:20.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.935+0000 7f174ec05800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:20.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.935+0000 7f174ec05800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:20.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.935+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2f1c20 con 0x55e51d2d5690 2024-04-24T02:12:20.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.936+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'42 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f173c040040 con 0x55e51d2d5690 2024-04-24T02:12:20.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.936+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2f22f0 con 0x7f1744031040 2024-04-24T02:12:20.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.937+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f173c040040 con 0x7f1744031040 2024-04-24T02:12:20.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.937+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2f22f0 con 0x55e51d2db8e0 2024-04-24T02:12:20.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.938+0000 7f174bf03640 1 -- 172.21.15.134:0/1224214597 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f174005a040 con 0x55e51d2db8e0 2024-04-24T02:12:20.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.938+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2f22f0 con 0x55e51d2d5690 2024-04-24T02:12:20.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.939+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'43 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f173c040040 con 0x55e51d2d5690 2024-04-24T02:12:20.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.939+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2f23a0 con 0x7f1740070b70 2024-04-24T02:12:20.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.940+0000 7f174cf05640 1 -- 172.21.15.134:0/1224214597 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'32 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f174401f070 con 0x7f1740070b70 2024-04-24T02:12:20.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.940+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2f29f0 con 0x55e51d2db8e0 2024-04-24T02:12:20.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.941+0000 7f174bf03640 1 -- 172.21.15.134:0/1224214597 <== osd.3 v2:172.21.15.134:6801/3585115521 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'31 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f174005a040 con 0x55e51d2db8e0 2024-04-24T02:12:20.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.941+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2f29f0 con 0x55e51d2d5690 2024-04-24T02:12:20.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.942+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f173c040040 con 0x55e51d2d5690 2024-04-24T02:12:20.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.942+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2f29f0 con 0x7f1744031040 2024-04-24T02:12:20.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.943+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'24 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f173c040040 con 0x7f1744031040 2024-04-24T02:12:20.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.943+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2f29f0 con 0x7f1740070b70 2024-04-24T02:12:20.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.944+0000 7f174cf05640 1 -- 172.21.15.134:0/1224214597 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f174401f070 con 0x7f1740070b70 2024-04-24T02:12:20.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.944+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2f3020 con 0x55e51d2db8e0 2024-04-24T02:12:20.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.945+0000 7f174bf03640 1 -- 172.21.15.134:0/1224214597 <== osd.3 v2:172.21.15.134:6801/3585115521 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f174005a040 con 0x55e51d2db8e0 2024-04-24T02:12:20.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.945+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2f3020 con 0x7f1740070b70 2024-04-24T02:12:20.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.946+0000 7f174cf05640 1 -- 172.21.15.134:0/1224214597 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'33 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f174401f070 con 0x7f1740070b70 2024-04-24T02:12:20.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.946+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2f3590 con 0x7f1744031040 2024-04-24T02:12:20.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.948+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f173c040040 con 0x7f1744031040 2024-04-24T02:12:20.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.948+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2f3590 con 0x7f1740070b70 2024-04-24T02:12:20.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.949+0000 7f174cf05640 1 -- 172.21.15.134:0/1224214597 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'18 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f174401f070 con 0x7f1740070b70 2024-04-24T02:12:20.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.949+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2f3a40 con 0x7f1744031040 2024-04-24T02:12:20.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.950+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.0 v2:172.21.15.104:6800/2419146313 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'35 uv16 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f173c040040 con 0x7f1744031040 2024-04-24T02:12:20.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.950+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2f3a40 con 0x55e51d2d5690 2024-04-24T02:12:20.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.951+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'44 uv16 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f173c040040 con 0x55e51d2d5690 2024-04-24T02:12:20.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.951+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2f3a40 con 0x55e51d2db8e0 2024-04-24T02:12:20.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.952+0000 7f174bf03640 1 -- 172.21.15.134:0/1224214597 <== osd.3 v2:172.21.15.134:6801/3585115521 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'26 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f174005a040 con 0x55e51d2db8e0 2024-04-24T02:12:20.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.952+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2f3a40 con 0x7f1740070b70 2024-04-24T02:12:20.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.953+0000 7f174cf05640 1 -- 172.21.15.134:0/1224214597 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'34 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f174401f070 con 0x7f1740070b70 2024-04-24T02:12:20.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.953+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2f3a40 con 0x55e51d2db8e0 2024-04-24T02:12:20.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.954+0000 7f174bf03640 1 -- 172.21.15.134:0/1224214597 <== osd.3 v2:172.21.15.134:6801/3585115521 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'24 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f174005a040 con 0x55e51d2db8e0 2024-04-24T02:12:20.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.954+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2f3a40 con 0x55e51d2d5690 2024-04-24T02:12:20.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.955+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f173c040040 con 0x55e51d2d5690 2024-04-24T02:12:20.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.955+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2f3a40 con 0x55e51d2d5690 2024-04-24T02:12:20.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.956+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'45 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f173c040040 con 0x55e51d2d5690 2024-04-24T02:12:20.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.956+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2f3a40 con 0x55e51d2db8e0 2024-04-24T02:12:20.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.957+0000 7f174bf03640 1 -- 172.21.15.134:0/1224214597 <== osd.3 v2:172.21.15.134:6801/3585115521 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'27 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f174005a040 con 0x55e51d2db8e0 2024-04-24T02:12:20.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.957+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2f3a40 con 0x7f1740070b70 2024-04-24T02:12:20.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.958+0000 7f174cf05640 1 -- 172.21.15.134:0/1224214597 <== osd.2 v2:172.21.15.134:6800/214480313 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'28 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f174401f070 con 0x7f1740070b70 2024-04-24T02:12:20.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.958+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2f3a40 con 0x55e51d2db8e0 2024-04-24T02:12:20.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.959+0000 7f174bf03640 1 -- 172.21.15.134:0/1224214597 <== osd.3 v2:172.21.15.134:6801/3585115521 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f174005a040 con 0x55e51d2db8e0 2024-04-24T02:12:20.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.959+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2f3a40 con 0x55e51d2db8e0 2024-04-24T02:12:20.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.960+0000 7f174bf03640 1 -- 172.21.15.134:0/1224214597 <== osd.3 v2:172.21.15.134:6801/3585115521 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'30 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f174005a040 con 0x55e51d2db8e0 2024-04-24T02:12:20.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.960+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2f3a40 con 0x55e51d2db8e0 2024-04-24T02:12:20.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.961+0000 7f174bf03640 1 -- 172.21.15.134:0/1224214597 <== osd.3 v2:172.21.15.134:6801/3585115521 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f174005a040 con 0x55e51d2db8e0 2024-04-24T02:12:20.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.961+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2f3a40 con 0x55e51d2db8e0 2024-04-24T02:12:20.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.962+0000 7f174bf03640 1 -- 172.21.15.134:0/1224214597 <== osd.3 v2:172.21.15.134:6801/3585115521 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'32 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f174005a040 con 0x55e51d2db8e0 2024-04-24T02:12:20.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.962+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2f3a40 con 0x7f1744031040 2024-04-24T02:12:20.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.963+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.0 v2:172.21.15.104:6800/2419146313 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'20 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f173c040040 con 0x7f1744031040 2024-04-24T02:12:20.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.963+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2f3a40 con 0x55e51d2db8e0 2024-04-24T02:12:20.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.964+0000 7f174bf03640 1 -- 172.21.15.134:0/1224214597 <== osd.3 v2:172.21.15.134:6801/3585115521 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'24 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f174005a040 con 0x55e51d2db8e0 2024-04-24T02:12:20.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.964+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2f3a40 con 0x7f1744031040 2024-04-24T02:12:20.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.966+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.0 v2:172.21.15.104:6800/2419146313 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'25 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f173c040040 con 0x7f1744031040 2024-04-24T02:12:20.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.966+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2f3a40 con 0x55e51d2db8e0 2024-04-24T02:12:20.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.967+0000 7f174bf03640 1 -- 172.21.15.134:0/1224214597 <== osd.3 v2:172.21.15.134:6801/3585115521 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'28 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f174005a040 con 0x55e51d2db8e0 2024-04-24T02:12:20.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.967+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2f3a40 con 0x7f1744031040 2024-04-24T02:12:20.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.968+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.0 v2:172.21.15.104:6800/2419146313 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'36 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f173c040040 con 0x7f1744031040 2024-04-24T02:12:20.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.968+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2f3a40 con 0x7f1740070b70 2024-04-24T02:12:20.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.969+0000 7f174cf05640 1 -- 172.21.15.134:0/1224214597 <== osd.2 v2:172.21.15.134:6800/214480313 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f174401f070 con 0x7f1740070b70 2024-04-24T02:12:20.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.969+0000 7f16017e2640 20 reqs_thread_entry: start 2024-04-24T02:12:20.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.969+0000 7f174ec05800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:20.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.969+0000 7f174ec05800 20 Filter name: none 2024-04-24T02:12:20.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.969+0000 7f1572ffd640 20 reqs_thread_entry: start 2024-04-24T02:12:20.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.969+0000 7f174ec05800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-24T02:12:20.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.970+0000 7f174ec05800 20 rados->read ofs=0 len=0 2024-04-24T02:12:20.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.970+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e51d31ea00 con 0x7f1744031040 2024-04-24T02:12:20.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.970+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.0 v2:172.21.15.104:6800/2419146313 24 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f173c040040 con 0x7f1744031040 2024-04-24T02:12:20.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.970+0000 7f174ec05800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:20.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.970+0000 7f174ec05800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-04-24T02:12:20.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.970+0000 7f174ec05800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-24T02:12:20.983 INFO:teuthology.orchestra.run.smithi134.stderr:could not remove user: unable to remove user, user does not exist 2024-04-24T02:12:20.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.971+0000 7f16027e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:20.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.971+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94442525449536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2ef560 con 0x55e51d2d5690 2024-04-24T02:12:20.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.972+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94442525449536] v30'46 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f173c040040 con 0x55e51d2d5690 2024-04-24T02:12:20.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.972+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94442525424032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2ef560 con 0x7f1740070b70 2024-04-24T02:12:20.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.973+0000 7f174cf05640 1 -- 172.21.15.134:0/1224214597 <== osd.2 v2:172.21.15.134:6800/214480313 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94442525424032] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f174401f070 con 0x7f1740070b70 2024-04-24T02:12:20.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.973+0000 7f174ec05800 20 remove_watcher() i=0 2024-04-24T02:12:20.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.973+0000 7f174ec05800 2 removed watcher, disabling cache 2024-04-24T02:12:20.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.973+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94442525430064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2df9a0 con 0x55e51d2d5690 2024-04-24T02:12:20.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.974+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.1 v2:172.21.15.134:6804/1487076214 30 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94442525430064] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f173c040040 con 0x55e51d2d5690 2024-04-24T02:12:20.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.974+0000 7f174ec05800 20 remove_watcher() i=1 2024-04-24T02:12:20.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.974+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94442525433616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2df9a0 con 0x55e51d2db8e0 2024-04-24T02:12:20.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.976+0000 7f174bf03640 1 -- 172.21.15.134:0/1224214597 <== osd.3 v2:172.21.15.134:6801/3585115521 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94442525433616] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f174005a040 con 0x55e51d2db8e0 2024-04-24T02:12:20.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.976+0000 7f174ec05800 20 remove_watcher() i=2 2024-04-24T02:12:20.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.976+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94442525435824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2e1f10 con 0x7f1740070b70 2024-04-24T02:12:20.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.977+0000 7f174cf05640 1 -- 172.21.15.134:0/1224214597 <== osd.2 v2:172.21.15.134:6800/214480313 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94442525435824] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f174401f070 con 0x7f1740070b70 2024-04-24T02:12:20.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.977+0000 7f174ec05800 20 remove_watcher() i=3 2024-04-24T02:12:20.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.977+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94442525441120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2df9a0 con 0x55e51d2d5690 2024-04-24T02:12:20.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.978+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.1 v2:172.21.15.134:6804/1487076214 31 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94442525441120] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f173c040040 con 0x55e51d2d5690 2024-04-24T02:12:20.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.978+0000 7f174ec05800 20 remove_watcher() i=4 2024-04-24T02:12:20.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.978+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94442525442176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2e27b0 con 0x7f1744031040 2024-04-24T02:12:20.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.979+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.0 v2:172.21.15.104:6800/2419146313 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94442525442176] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f173c040040 con 0x7f1744031040 2024-04-24T02:12:20.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.979+0000 7f174ec05800 20 remove_watcher() i=5 2024-04-24T02:12:20.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.979+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94442525438416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2e1f10 con 0x7f1744031040 2024-04-24T02:12:20.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.981+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.0 v2:172.21.15.104:6800/2419146313 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94442525438416] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f173c040040 con 0x7f1744031040 2024-04-24T02:12:20.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.981+0000 7f174ec05800 20 remove_watcher() i=6 2024-04-24T02:12:20.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.981+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94442525448480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d2df9a0 con 0x7f1744031040 2024-04-24T02:12:20.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.983+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 <== osd.0 v2:172.21.15.104:6800/2419146313 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94442525448480] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f173c040040 con 0x7f1744031040 2024-04-24T02:12:20.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.983+0000 7f174ec05800 20 remove_watcher() i=7 2024-04-24T02:12:20.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.983+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f1744031040 msgr2=0x7f1744032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.983+0000 7f174ec05800 1 --2- 172.21.15.134:0/1224214597 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f1744031040 0x7f1744032940 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.983+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e51d2d5690 msgr2=0x55e51d2d7b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.983+0000 7f174ec05800 1 --2- 172.21.15.134:0/1224214597 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e51d2d5690 0x55e51d2d7b50 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.983+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f1740070b70 msgr2=0x7f174007a430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.983+0000 7f174ec05800 1 --2- 172.21.15.134:0/1224214597 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f1740070b70 0x7f174007a430 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.983+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55e51d2db8e0 msgr2=0x55e51d2ddcd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.983+0000 7f174ec05800 1 --2- 172.21.15.134:0/1224214597 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55e51d2db8e0 0x55e51d2ddcd0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.983+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f161c036950 msgr2=0x7f161c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.983+0000 7f174ec05800 1 --2- 172.21.15.134:0/1224214597 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f161c036950 0x7f161c038e10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x55e51d2a1660 tx=0x7f174401f000 comp rx=0 tx=0).stop 2024-04-24T02:12:20.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.983+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d2c24b0 msgr2=0x55e51d2c9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.983+0000 7f174c704640 1 -- 172.21.15.134:0/1224214597 reap_dead start 2024-04-24T02:12:20.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.983+0000 7f174ec05800 1 --2- 172.21.15.134:0/1224214597 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d2c24b0 0x55e51d2c9b20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1740071f90 tx=0x7f174008d8b0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.983+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 shutdown_connections 2024-04-24T02:12:20.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.983+0000 7f174ec05800 1 --2- 172.21.15.134:0/1224214597 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d2c24b0 0x55e51d2c9b20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.983+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 >> 172.21.15.134:0/1224214597 conn(0x55e51d2be810 msgr2=0x55e51d2bbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:20.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.983+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 shutdown_connections 2024-04-24T02:12:20.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.983+0000 7f174ec05800 1 -- 172.21.15.134:0/1224214597 wait complete. 2024-04-24T02:12:20.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.983+0000 7f174ec05800 1 -- 172.21.15.134:0/512163502 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1624036950 msgr2=0x7f1624038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.983+0000 7f174ec05800 1 --2- 172.21.15.134:0/512163502 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1624036950 0x7f1624038e10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x55e51d2a5360 tx=0x7f1744005840 comp rx=0 tx=0).stop 2024-04-24T02:12:20.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.983+0000 7f174ec05800 1 -- 172.21.15.134:0/512163502 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d2b52d0 msgr2=0x55e51d2b56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.983+0000 7f174ec05800 1 --2- 172.21.15.134:0/512163502 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d2b52d0 0x55e51d2b56f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f174004aca0 tx=0x7f1740002fb0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.983+0000 7f174ec05800 1 -- 172.21.15.134:0/512163502 shutdown_connections 2024-04-24T02:12:20.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.983+0000 7f174ec05800 1 --2- 172.21.15.134:0/512163502 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1624036950 0x7f1624038e10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.983+0000 7f174ec05800 1 --2- 172.21.15.134:0/512163502 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d2b52d0 0x55e51d2b56f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.983+0000 7f174ec05800 1 -- 172.21.15.134:0/512163502 >> 172.21.15.134:0/512163502 conn(0x55e51d2a9370 msgr2=0x55e51d2a9770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:20.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.983+0000 7f174ec05800 1 -- 172.21.15.134:0/512163502 shutdown_connections 2024-04-24T02:12:20.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.983+0000 7f174ec05800 1 -- 172.21.15.134:0/512163502 wait complete. 2024-04-24T02:12:20.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.984+0000 7f174ec05800 1 -- 172.21.15.134:0/305449484 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e51d1a2280 msgr2=0x55e51d2a4140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.984+0000 7f174ec05800 1 --2- 172.21.15.134:0/305449484 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e51d1a2280 0x55e51d2a4140 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.984+0000 7f174ec05800 1 -- 172.21.15.134:0/305449484 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1634036950 msgr2=0x7f1634038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.984+0000 7f174ec05800 1 --2- 172.21.15.134:0/305449484 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1634036950 0x7f1634038e10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1740054000 tx=0x7f174004e000 comp rx=0 tx=0).stop 2024-04-24T02:12:20.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.984+0000 7f174ec05800 1 -- 172.21.15.134:0/305449484 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d1a0740 msgr2=0x55e51d29cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:20.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.984+0000 7f174ec05800 1 --2- 172.21.15.134:0/305449484 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d1a0740 0x55e51d29cf00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f173c00c010 tx=0x7f173c000ed0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.984+0000 7f174ec05800 1 -- 172.21.15.134:0/305449484 shutdown_connections 2024-04-24T02:12:20.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.984+0000 7f174ec05800 1 --2- 172.21.15.134:0/305449484 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e51d1a2280 0x55e51d2a4140 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.984+0000 7f174ec05800 1 --2- 172.21.15.134:0/305449484 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1634036950 0x7f1634038e10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.984+0000 7f174ec05800 1 --2- 172.21.15.134:0/305449484 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d1a0740 0x55e51d29cf00 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:20.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.984+0000 7f174ec05800 1 -- 172.21.15.134:0/305449484 >> 172.21.15.134:0/305449484 conn(0x55e51d19c380 msgr2=0x55e51d28f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:20.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.984+0000 7f174ec05800 1 -- 172.21.15.134:0/305449484 shutdown_connections 2024-04-24T02:12:20.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:20.984+0000 7f174ec05800 1 -- 172.21.15.134:0/305449484 wait complete. 2024-04-24T02:12:20.993 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-04-24T02:12:20.993 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-04-24T02:12:20.993 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-04-24T02:12:20.994 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-04-24T02:12:21.076 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:21.076 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:21.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.075+0000 7f8980b31800 1 Processor -- start 2024-04-24T02:12:21.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.075+0000 7f8980b31800 1 -- start start 2024-04-24T02:12:21.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.075+0000 7f8980b31800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55991e660780 0x55991e660ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.075+0000 7f8980b31800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55991e520d40 con 0x55991e6610e0 2024-04-24T02:12:21.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.075+0000 7f8980b31800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55991e4f34d0 con 0x55991e660780 2024-04-24T02:12:21.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.076+0000 7f897c82f640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55991e660780 0x55991e660ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.076+0000 7f897c82f640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55991e660780 0x55991e660ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45282/0 (socket says 172.21.15.134:45282) 2024-04-24T02:12:21.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.076+0000 7f897c82f640 1 -- 172.21.15.134:0/984175272 learned_addr learned my addr 172.21.15.134:0/984175272 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:21.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.076+0000 7f897402e640 1 --1- 172.21.15.134:0/984175272 >> v1:172.21.15.104:6789/0 conn(0x55991e6610e0 0x55991e661590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:43136/0 (socket says 172.21.15.134:43136) 2024-04-24T02:12:21.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.076+0000 7f897c82f640 1 -- 172.21.15.134:0/984175272 >> v1:172.21.15.104:6789/0 conn(0x55991e6610e0 legacy=0x55991e661590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.076+0000 7f897c82f640 1 -- 172.21.15.134:0/984175272 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55991e51f590 con 0x55991e660780 2024-04-24T02:12:21.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.078+0000 7f897c82f640 1 --2- 172.21.15.134:0/984175272 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55991e660780 0x55991e660ba0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f896c00a520 tx=0x7f896c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e320a676dca27cdd server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.078+0000 7f8977fff640 1 -- 172.21.15.134:0/984175272 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f896c057070 con 0x55991e660780 2024-04-24T02:12:21.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.078+0000 7f8977fff640 1 -- 172.21.15.134:0/984175272 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f896c052570 con 0x55991e660780 2024-04-24T02:12:21.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.078+0000 7f8977fff640 1 -- 172.21.15.134:0/984175272 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f896c052870 con 0x55991e660780 2024-04-24T02:12:21.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.079+0000 7f8980b31800 1 -- 172.21.15.134:0/984175272 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55991e660780 msgr2=0x55991e660ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.079+0000 7f8980b31800 1 --2- 172.21.15.134:0/984175272 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55991e660780 0x55991e660ba0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f896c00a520 tx=0x7f896c01d010 comp rx=0 tx=0).stop 2024-04-24T02:12:21.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.079+0000 7f8980b31800 1 -- 172.21.15.134:0/984175272 shutdown_connections 2024-04-24T02:12:21.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.079+0000 7f8980b31800 1 --2- 172.21.15.134:0/984175272 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55991e660780 0x55991e660ba0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.079+0000 7f8980b31800 1 -- 172.21.15.134:0/984175272 >> 172.21.15.134:0/984175272 conn(0x55991e65c320 msgr2=0x55991e65e740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:21.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.079+0000 7f8980b31800 1 -- 172.21.15.134:0/984175272 shutdown_connections 2024-04-24T02:12:21.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.079+0000 7f8980b31800 1 -- 172.21.15.134:0/984175272 wait complete. 2024-04-24T02:12:21.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.090+0000 7f8980b31800 1 Processor -- start 2024-04-24T02:12:21.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.090+0000 7f8980b31800 1 -- start start 2024-04-24T02:12:21.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.090+0000 7f8980b31800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55991e660780 0x55991e755330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.090+0000 7f8980b31800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55991e5ad3c0 con 0x55991e660780 2024-04-24T02:12:21.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.091+0000 7f897c82f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55991e660780 0x55991e755330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.091+0000 7f897c82f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55991e660780 0x55991e755330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45290/0 (socket says 172.21.15.134:45290) 2024-04-24T02:12:21.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.091+0000 7f897c82f640 1 -- 172.21.15.134:0/2066550432 learned_addr learned my addr 172.21.15.134:0/2066550432 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:21.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.091+0000 7f897c82f640 1 -- 172.21.15.134:0/2066550432 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55991e755900 con 0x55991e660780 2024-04-24T02:12:21.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.091+0000 7f897c82f640 1 --2- 172.21.15.134:0/2066550432 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55991e660780 0x55991e755330 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f896c01d050 tx=0x7f896c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef5be50236c4003c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.091+0000 7f886ae0d640 1 -- 172.21.15.134:0/2066550432 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f896c057040 con 0x55991e660780 2024-04-24T02:12:21.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.091+0000 7f886ae0d640 1 -- 172.21.15.134:0/2066550432 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f896c052850 con 0x55991e660780 2024-04-24T02:12:21.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.091+0000 7f886ae0d640 1 -- 172.21.15.134:0/2066550432 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f896c052b70 con 0x55991e660780 2024-04-24T02:12:21.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.092+0000 7f8980b31800 1 -- 172.21.15.134:0/2066550432 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55991e660780 msgr2=0x55991e755330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.092+0000 7f8980b31800 1 --2- 172.21.15.134:0/2066550432 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55991e660780 0x55991e755330 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f896c01d050 tx=0x7f896c04c000 comp rx=0 tx=0).stop 2024-04-24T02:12:21.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.092+0000 7f8980b31800 1 -- 172.21.15.134:0/2066550432 shutdown_connections 2024-04-24T02:12:21.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.092+0000 7f8980b31800 1 --2- 172.21.15.134:0/2066550432 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55991e660780 0x55991e755330 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.092+0000 7f8980b31800 1 -- 172.21.15.134:0/2066550432 >> 172.21.15.134:0/2066550432 conn(0x55991e65c320 msgr2=0x55991e750c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:21.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.092+0000 7f8980b31800 1 -- 172.21.15.134:0/2066550432 shutdown_connections 2024-04-24T02:12:21.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.092+0000 7f8980b31800 1 -- 172.21.15.134:0/2066550432 wait complete. 2024-04-24T02:12:21.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.092+0000 7f8980b31800 1 Processor -- start 2024-04-24T02:12:21.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.092+0000 7f8980b31800 1 -- start start 2024-04-24T02:12:21.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.093+0000 7f8980b31800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55991e660780 0x55991e75ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.093+0000 7f8980b31800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55991e661f40 con 0x55991e660780 2024-04-24T02:12:21.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.093+0000 7f897c82f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55991e660780 0x55991e75ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.093+0000 7f897c82f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55991e660780 0x55991e75ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45300/0 (socket says 172.21.15.134:45300) 2024-04-24T02:12:21.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.093+0000 7f897c82f640 1 -- 172.21.15.134:0/961196253 learned_addr learned my addr 172.21.15.134:0/961196253 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:21.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.093+0000 7f897c82f640 1 -- 172.21.15.134:0/961196253 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55991e75d3b0 con 0x55991e660780 2024-04-24T02:12:21.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.093+0000 7f897c82f640 1 --2- 172.21.15.134:0/961196253 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55991e660780 0x55991e75ce70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f896c01cfe0 tx=0x7f896c003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.093+0000 7f886960a640 1 -- 172.21.15.134:0/961196253 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f896c073070 con 0x55991e660780 2024-04-24T02:12:21.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.093+0000 7f8980b31800 1 -- 172.21.15.134:0/961196253 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55991e75d640 con 0x55991e660780 2024-04-24T02:12:21.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.093+0000 7f886960a640 1 -- 172.21.15.134:0/961196253 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f896c05d650 con 0x55991e660780 2024-04-24T02:12:21.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.094+0000 7f8980b31800 1 -- 172.21.15.134:0/961196253 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55991e760250 con 0x55991e660780 2024-04-24T02:12:21.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.094+0000 7f886960a640 1 -- 172.21.15.134:0/961196253 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f896c057070 con 0x55991e660780 2024-04-24T02:12:21.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.094+0000 7f886960a640 1 -- 172.21.15.134:0/961196253 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f896c076070 con 0x55991e660780 2024-04-24T02:12:21.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.095+0000 7f886960a640 1 --2- 172.21.15.134:0/961196253 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8864036900 0x7f8864038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.095+0000 7f886960a640 1 -- 172.21.15.134:0/961196253 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f896c08dbe0 con 0x55991e660780 2024-04-24T02:12:21.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.095+0000 7f897402e640 1 --2- 172.21.15.134:0/961196253 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8864036900 0x7f8864038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.095+0000 7f8980b31800 1 --2- 172.21.15.134:0/961196253 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55991e6610e0 0x55991e764010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.095+0000 7f8980b31800 1 -- 172.21.15.134:0/961196253 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55991e764590 con 0x55991e6610e0 2024-04-24T02:12:21.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.095+0000 7f897d030640 1 --2- 172.21.15.134:0/961196253 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55991e6610e0 0x55991e764010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.095+0000 7f897402e640 1 --2- 172.21.15.134:0/961196253 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8864036900 0x7f8864038dc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8964001e40 tx=0x7f89640013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.095+0000 7f897d030640 1 --2- 172.21.15.134:0/961196253 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55991e6610e0 0x55991e764010 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.095+0000 7f897d030640 1 -- 172.21.15.134:0/961196253 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f897800a4a0 con 0x55991e6610e0 2024-04-24T02:12:21.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.095+0000 7f8980b31800 1 -- 172.21.15.134:0/961196253 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55991e764e60 con 0x55991e6610e0 2024-04-24T02:12:21.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.096+0000 7f897d030640 1 -- 172.21.15.134:0/961196253 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f897800a4a0 con 0x55991e6610e0 2024-04-24T02:12:21.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.096+0000 7f8980b31800 1 -- 172.21.15.134:0/961196253 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55991e766210 con 0x55991e6610e0 2024-04-24T02:12:21.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.096+0000 7f897d030640 1 -- 172.21.15.134:0/961196253 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f897800a4a0 con 0x55991e6610e0 2024-04-24T02:12:21.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.096+0000 7f8980b31800 1 -- 172.21.15.134:0/961196253 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55991e7656b0 con 0x55991e6610e0 2024-04-24T02:12:21.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.096+0000 7f897d030640 1 -- 172.21.15.134:0/961196253 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f897800a4a0 con 0x55991e6610e0 2024-04-24T02:12:21.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.096+0000 7f8980b31800 1 -- 172.21.15.134:0/961196253 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55991e765b00 con 0x55991e6610e0 2024-04-24T02:12:21.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.097+0000 7f897d030640 1 -- 172.21.15.134:0/961196253 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f897800a4a0 con 0x55991e6610e0 2024-04-24T02:12:21.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.097+0000 7f8980b31800 1 Processor -- start 2024-04-24T02:12:21.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.097+0000 7f8980b31800 1 -- start start 2024-04-24T02:12:21.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.097+0000 7f8980b31800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55991e7751b0 0x55991e7755d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.097+0000 7f8980b31800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55991e5536b0 con 0x55991e7751b0 2024-04-24T02:12:21.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.097+0000 7f897402e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55991e7751b0 0x55991e7755d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.097+0000 7f897402e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55991e7751b0 0x55991e7755d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45302/0 (socket says 172.21.15.134:45302) 2024-04-24T02:12:21.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.097+0000 7f897402e640 1 -- 172.21.15.134:0/4095448328 learned_addr learned my addr 172.21.15.134:0/4095448328 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:21.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.098+0000 7f897402e640 1 -- 172.21.15.134:0/4095448328 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55991e775b10 con 0x55991e7751b0 2024-04-24T02:12:21.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.098+0000 7f897402e640 1 --2- 172.21.15.134:0/4095448328 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55991e7751b0 0x55991e7755d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f896400e630 tx=0x7f896400ea30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.098+0000 7f88627fc640 1 -- 172.21.15.134:0/4095448328 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8964022070 con 0x55991e7751b0 2024-04-24T02:12:21.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.098+0000 7f88627fc640 1 -- 172.21.15.134:0/4095448328 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f896400d520 con 0x55991e7751b0 2024-04-24T02:12:21.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.098+0000 7f88627fc640 1 -- 172.21.15.134:0/4095448328 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f896400d840 con 0x55991e7751b0 2024-04-24T02:12:21.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.098+0000 7f8980b31800 1 -- 172.21.15.134:0/4095448328 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55991e776580 con 0x55991e7751b0 2024-04-24T02:12:21.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.098+0000 7f8980b31800 1 -- 172.21.15.134:0/4095448328 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55991e776a80 con 0x55991e7751b0 2024-04-24T02:12:21.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.099+0000 7f88627fc640 1 -- 172.21.15.134:0/4095448328 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8964025070 con 0x55991e7751b0 2024-04-24T02:12:21.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.099+0000 7f88627fc640 1 --2- 172.21.15.134:0/4095448328 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8854036950 0x7f8854038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.099+0000 7f88627fc640 1 -- 172.21.15.134:0/4095448328 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f896404dcc0 con 0x55991e7751b0 2024-04-24T02:12:21.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.099+0000 7f897d030640 1 --2- 172.21.15.134:0/4095448328 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8854036950 0x7f8854038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.099+0000 7f8980b31800 1 Processor -- start 2024-04-24T02:12:21.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.099+0000 7f8980b31800 1 -- start start 2024-04-24T02:12:21.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.099+0000 7f897d030640 1 --2- 172.21.15.134:0/4095448328 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8854036950 0x7f8854038e10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x55991e761710 tx=0x7f8978005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.099+0000 7f8980b31800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55991e7824b0 0x55991e7828d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.099+0000 7f8980b31800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55991e755bc0 con 0x55991e7824b0 2024-04-24T02:12:21.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.100+0000 7f897402e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55991e7824b0 0x55991e7828d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.100+0000 7f897402e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55991e7824b0 0x55991e7828d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45304/0 (socket says 172.21.15.134:45304) 2024-04-24T02:12:21.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.100+0000 7f897402e640 1 -- 172.21.15.134:0/2458297885 learned_addr learned my addr 172.21.15.134:0/2458297885 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:21.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.100+0000 7f897402e640 1 -- 172.21.15.134:0/2458297885 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55991e782ea0 con 0x55991e7824b0 2024-04-24T02:12:21.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.100+0000 7f897402e640 1 --2- 172.21.15.134:0/2458297885 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55991e7824b0 0x55991e7828d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f896404c1a0 tx=0x7f8964025f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d044f4e1fd41d573 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.100+0000 7f8853fff640 1 -- 172.21.15.134:0/2458297885 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89640263b0 con 0x55991e7824b0 2024-04-24T02:12:21.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.100+0000 7f8853fff640 1 -- 172.21.15.134:0/2458297885 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8964040130 con 0x55991e7824b0 2024-04-24T02:12:21.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.100+0000 7f8853fff640 1 -- 172.21.15.134:0/2458297885 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8964026550 con 0x55991e7824b0 2024-04-24T02:12:21.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.101+0000 7f8980b31800 1 -- 172.21.15.134:0/2458297885 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55991e7824b0 msgr2=0x55991e7828d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.101+0000 7f8980b31800 1 --2- 172.21.15.134:0/2458297885 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55991e7824b0 0x55991e7828d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f896404c1a0 tx=0x7f8964025f90 comp rx=0 tx=0).stop 2024-04-24T02:12:21.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.101+0000 7f8980b31800 1 -- 172.21.15.134:0/2458297885 shutdown_connections 2024-04-24T02:12:21.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.101+0000 7f8980b31800 1 --2- 172.21.15.134:0/2458297885 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55991e7824b0 0x55991e7828d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.101+0000 7f8980b31800 1 -- 172.21.15.134:0/2458297885 >> 172.21.15.134:0/2458297885 conn(0x55991e77e810 msgr2=0x55991e77c870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:21.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.101+0000 7f8980b31800 1 -- 172.21.15.134:0/2458297885 shutdown_connections 2024-04-24T02:12:21.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.101+0000 7f8980b31800 1 -- 172.21.15.134:0/2458297885 wait complete. 2024-04-24T02:12:21.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.101+0000 7f8980b31800 1 Processor -- start 2024-04-24T02:12:21.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.101+0000 7f8980b31800 1 -- start start 2024-04-24T02:12:21.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.101+0000 7f8980b31800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55991e7824b0 0x55991e789af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.101+0000 7f8980b31800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55991e783610 con 0x55991e7824b0 2024-04-24T02:12:21.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.101+0000 7f897402e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55991e7824b0 0x55991e789af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.101+0000 7f897402e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55991e7824b0 0x55991e789af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45306/0 (socket says 172.21.15.134:45306) 2024-04-24T02:12:21.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.101+0000 7f897402e640 1 -- 172.21.15.134:0/4060334358 learned_addr learned my addr 172.21.15.134:0/4060334358 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:21.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.102+0000 7f897402e640 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55991e78a030 con 0x55991e7824b0 2024-04-24T02:12:21.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.102+0000 7f897402e640 1 --2- 172.21.15.134:0/4060334358 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55991e7824b0 0x55991e789af0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f896404c1a0 tx=0x7f896404c130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.102+0000 7f88527fc640 1 -- 172.21.15.134:0/4060334358 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8964036070 con 0x55991e7824b0 2024-04-24T02:12:21.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.102+0000 7f88527fc640 1 -- 172.21.15.134:0/4060334358 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89640243f0 con 0x55991e7824b0 2024-04-24T02:12:21.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.102+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55991e78a030 con 0x55991e7824b0 2024-04-24T02:12:21.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.102+0000 7f88527fc640 1 -- 172.21.15.134:0/4060334358 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8964024710 con 0x55991e7824b0 2024-04-24T02:12:21.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.102+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55991e78a030 con 0x55991e7824b0 2024-04-24T02:12:21.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.103+0000 7f88527fc640 1 -- 172.21.15.134:0/4060334358 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f896401a530 con 0x55991e7824b0 2024-04-24T02:12:21.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.103+0000 7f88527fc640 1 --2- 172.21.15.134:0/4060334358 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8848036950 0x7f8848038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.103+0000 7f88527fc640 1 -- 172.21.15.134:0/4060334358 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f896401d150 con 0x55991e7824b0 2024-04-24T02:12:21.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.103+0000 7f897d030640 1 --2- 172.21.15.134:0/4060334358 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8848036950 0x7f8848038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.103+0000 7f897d030640 1 --2- 172.21.15.134:0/4060334358 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8848036950 0x7f8848038e10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x55991e761530 tx=0x7f897801f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.103+0000 7f8980b31800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.103+0000 7f8980b31800 1 --2- 172.21.15.134:0/4060334358 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55991e7951e0 0x55991e7976a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.103+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55991e797df0 con 0x55991e7951e0 2024-04-24T02:12:21.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.103+0000 7f897c82f640 1 --2- 172.21.15.134:0/4060334358 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55991e7951e0 0x55991e7976a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.104+0000 7f897c82f640 1 --2- 172.21.15.134:0/4060334358 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55991e7951e0 0x55991e7976a0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.104+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f896c075030 con 0x55991e7951e0 2024-04-24T02:12:21.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.104+0000 7f8980b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:21.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.104+0000 7f8980b31800 20 realm 2024-04-24T02:12:21.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.104+0000 7f8980b31800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.104+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55991e798200 con 0x55991e7951e0 2024-04-24T02:12:21.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.104+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f896c075030 con 0x55991e7951e0 2024-04-24T02:12:21.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.104+0000 7f8980b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:21.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.104+0000 7f8980b31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:21.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.104+0000 7f8980b31800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.104+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55991e798ad0 con 0x55991e7951e0 2024-04-24T02:12:21.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.104+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f896c075030 con 0x55991e7951e0 2024-04-24T02:12:21.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.104+0000 7f8980b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:21.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.104+0000 7f8980b31800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.104+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55991e798e70 con 0x55991e7951e0 2024-04-24T02:12:21.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.105+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f896c075030 con 0x55991e7951e0 2024-04-24T02:12:21.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.105+0000 7f8980b31800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:21.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.105+0000 7f8980b31800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.105+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55991e7996c0 con 0x55991e7951e0 2024-04-24T02:12:21.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.105+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f896c075030 con 0x55991e7951e0 2024-04-24T02:12:21.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.105+0000 7f8980b31800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:21.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.105+0000 7f8980b31800 20 searching for the correct realm 2024-04-24T02:12:21.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.105+0000 7f8980b31800 1 --2- 172.21.15.134:0/4060334358 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55991e79b430 0x55991e79d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.105+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55991e79de50 con 0x55991e79b430 2024-04-24T02:12:21.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.105+0000 7f897402e640 1 --2- 172.21.15.134:0/4060334358 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55991e79b430 0x55991e79d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.105+0000 7f897402e640 1 --2- 172.21.15.134:0/4060334358 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55991e79b430 0x55991e79d820 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.106+0000 7f897402e640 1 -- 172.21.15.134:0/4060334358 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8964024030 con 0x55991e79b430 2024-04-24T02:12:21.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.106+0000 7f897402e640 1 --2- 172.21.15.134:0/4060334358 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f8964027060 0x7f89640278a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.106+0000 7f897402e640 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55991e79de50 con 0x7f8964027060 2024-04-24T02:12:21.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.106+0000 7f897d030640 1 --2- 172.21.15.134:0/4060334358 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f8964027060 0x7f89640278a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.106+0000 7f897d030640 1 --2- 172.21.15.134:0/4060334358 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f8964027060 0x7f89640278a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.106+0000 7f897d030640 1 -- 172.21.15.134:0/4060334358 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f897801f070 con 0x7f8964027060 2024-04-24T02:12:21.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.106+0000 7f897d030640 1 --2- 172.21.15.134:0/4060334358 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f8978031040 0x7f8978032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.106+0000 7f897d030640 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55991e79de50 con 0x7f8978031040 2024-04-24T02:12:21.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.107+0000 7f897c82f640 1 --2- 172.21.15.134:0/4060334358 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f8978031040 0x7f8978032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.107+0000 7f897c82f640 1 --2- 172.21.15.134:0/4060334358 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f8978031040 0x7f8978032430 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.107+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f896c075030 con 0x7f8978031040 2024-04-24T02:12:21.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.107+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55991e79de50 con 0x55991e7951e0 2024-04-24T02:12:21.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.107+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f896c075030 con 0x55991e7951e0 2024-04-24T02:12:21.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.107+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55991e79de50 con 0x55991e7951e0 2024-04-24T02:12:21.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.108+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f896c075030 con 0x55991e7951e0 2024-04-24T02:12:21.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.108+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55991e79de50 con 0x7f8978031040 2024-04-24T02:12:21.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.108+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f896c075030 con 0x7f8978031040 2024-04-24T02:12:21.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.108+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55991e79de50 con 0x7f8978031040 2024-04-24T02:12:21.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.108+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f896c075030 con 0x7f8978031040 2024-04-24T02:12:21.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.108+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55991e79de50 con 0x7f8964027060 2024-04-24T02:12:21.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.108+0000 7f897d030640 1 -- 172.21.15.134:0/4060334358 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f897801f070 con 0x7f8964027060 2024-04-24T02:12:21.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.108+0000 7f897d030640 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55991e79de50 con 0x55991e79b430 2024-04-24T02:12:21.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.109+0000 7f897402e640 1 -- 172.21.15.134:0/4060334358 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f896405c040 con 0x55991e79b430 2024-04-24T02:12:21.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.109+0000 7f897402e640 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55991e79de50 con 0x55991e7951e0 2024-04-24T02:12:21.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.109+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f896c075030 con 0x55991e7951e0 2024-04-24T02:12:21.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.109+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55991e79de50 con 0x7f8978031040 2024-04-24T02:12:21.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.109+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f896c075030 con 0x7f8978031040 2024-04-24T02:12:21.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.109+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55991e79de50 con 0x55991e7951e0 2024-04-24T02:12:21.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.109+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f896c075030 con 0x55991e7951e0 2024-04-24T02:12:21.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.109+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55991e79de50 con 0x7f8964027060 2024-04-24T02:12:21.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.110+0000 7f897d030640 1 -- 172.21.15.134:0/4060334358 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f897801f070 con 0x7f8964027060 2024-04-24T02:12:21.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.110+0000 7f897d030640 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55991e79de50 con 0x55991e79b430 2024-04-24T02:12:21.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.110+0000 7f897402e640 1 -- 172.21.15.134:0/4060334358 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f896405c040 con 0x55991e79b430 2024-04-24T02:12:21.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.110+0000 7f897402e640 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55991e79de50 con 0x55991e79b430 2024-04-24T02:12:21.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.110+0000 7f897402e640 1 -- 172.21.15.134:0/4060334358 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f896405c040 con 0x55991e79b430 2024-04-24T02:12:21.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.110+0000 7f897402e640 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55991e79de50 con 0x7f8978031040 2024-04-24T02:12:21.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.110+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f896c075030 con 0x7f8978031040 2024-04-24T02:12:21.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.110+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55991e79de50 con 0x55991e79b430 2024-04-24T02:12:21.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.111+0000 7f897402e640 1 -- 172.21.15.134:0/4060334358 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f896405c040 con 0x55991e79b430 2024-04-24T02:12:21.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.111+0000 7f897402e640 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55991e79de50 con 0x55991e79b430 2024-04-24T02:12:21.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.111+0000 7f897402e640 1 -- 172.21.15.134:0/4060334358 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f896405c040 con 0x55991e79b430 2024-04-24T02:12:21.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.111+0000 7f897402e640 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55991e79de50 con 0x55991e7951e0 2024-04-24T02:12:21.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.111+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f896c075030 con 0x55991e7951e0 2024-04-24T02:12:21.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.111+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55991e79de50 con 0x55991e7951e0 2024-04-24T02:12:21.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.111+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v23'2 uv2 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f896c075030 con 0x55991e7951e0 2024-04-24T02:12:21.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.111+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55991e79de50 con 0x7f8978031040 2024-04-24T02:12:21.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.111+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f896c075030 con 0x7f8978031040 2024-04-24T02:12:21.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.111+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55991e79de50 con 0x55991e79b430 2024-04-24T02:12:21.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.112+0000 7f897402e640 1 -- 172.21.15.134:0/4060334358 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f896405c040 con 0x55991e79b430 2024-04-24T02:12:21.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.112+0000 7f897402e640 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55991e79de50 con 0x7f8964027060 2024-04-24T02:12:21.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.112+0000 7f897d030640 1 -- 172.21.15.134:0/4060334358 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f897801f070 con 0x7f8964027060 2024-04-24T02:12:21.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.112+0000 7f897d030640 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55991e79de50 con 0x55991e7951e0 2024-04-24T02:12:21.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.112+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f896c075030 con 0x55991e7951e0 2024-04-24T02:12:21.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.112+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55991e79de50 con 0x7f8978031040 2024-04-24T02:12:21.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.112+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f896c075030 con 0x7f8978031040 2024-04-24T02:12:21.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.112+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55991e79de50 con 0x55991e79b430 2024-04-24T02:12:21.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.113+0000 7f897402e640 1 -- 172.21.15.134:0/4060334358 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f896405c040 con 0x55991e79b430 2024-04-24T02:12:21.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.113+0000 7f897402e640 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55991e79de50 con 0x7f8978031040 2024-04-24T02:12:21.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.113+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f896c075030 con 0x7f8978031040 2024-04-24T02:12:21.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.113+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55991e79de50 con 0x7f8964027060 2024-04-24T02:12:21.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.113+0000 7f897d030640 1 -- 172.21.15.134:0/4060334358 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f897801f070 con 0x7f8964027060 2024-04-24T02:12:21.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.113+0000 7f897d030640 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55991e79de50 con 0x55991e79b430 2024-04-24T02:12:21.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.113+0000 7f897402e640 1 -- 172.21.15.134:0/4060334358 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f896405c040 con 0x55991e79b430 2024-04-24T02:12:21.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.113+0000 7f897402e640 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55991e79de50 con 0x7f8978031040 2024-04-24T02:12:21.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.114+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f896c075030 con 0x7f8978031040 2024-04-24T02:12:21.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.114+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55991e79de50 con 0x55991e7951e0 2024-04-24T02:12:21.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.114+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f896c075030 con 0x55991e7951e0 2024-04-24T02:12:21.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.114+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55991e79de50 con 0x7f8964027060 2024-04-24T02:12:21.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.114+0000 7f897d030640 1 -- 172.21.15.134:0/4060334358 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f897801f070 con 0x7f8964027060 2024-04-24T02:12:21.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.114+0000 7f8980b31800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:21.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.114+0000 7f8980b31800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:21.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.114+0000 7f8980b31800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:21.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.114+0000 7f8980b31800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:21.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.114+0000 7f8980b31800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:21.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.114+0000 7f8980b31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:21.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.114+0000 7f8980b31800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.114+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55991e79a040 con 0x55991e7951e0 2024-04-24T02:12:21.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.114+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f896c075030 con 0x55991e7951e0 2024-04-24T02:12:21.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.114+0000 7f8980b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:21.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.114+0000 7f8980b31800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.114+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55991e79a8e0 con 0x55991e7951e0 2024-04-24T02:12:21.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.115+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f896c075030 con 0x55991e7951e0 2024-04-24T02:12:21.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.115+0000 7f8980b31800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:21.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.115+0000 7f8980b31800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.115+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55991e79e2d0 con 0x55991e7951e0 2024-04-24T02:12:21.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.115+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f896c075030 con 0x55991e7951e0 2024-04-24T02:12:21.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.115+0000 7f8980b31800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:21.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.115+0000 7f8980b31800 20 zone default found 2024-04-24T02:12:21.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.115+0000 7f8980b31800 4 Realm: () 2024-04-24T02:12:21.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.115+0000 7f8980b31800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:21.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.115+0000 7f8980b31800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:21.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.115+0000 7f8980b31800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:21.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.115+0000 7f8980b31800 20 zonegroup default 2024-04-24T02:12:21.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.115+0000 7f8980b31800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.115+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55991e79a540 con 0x7f8978031040 2024-04-24T02:12:21.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.115+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f896c075030 con 0x7f8978031040 2024-04-24T02:12:21.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.115+0000 7f8980b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:21.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.115+0000 7f8980b31800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.115+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55991e7a01b0 con 0x55991e79b430 2024-04-24T02:12:21.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.116+0000 7f897402e640 1 -- 172.21.15.134:0/4060334358 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f896405c040 con 0x55991e79b430 2024-04-24T02:12:21.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.116+0000 7f8980b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:21.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.116+0000 7f8980b31800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.116+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55991e7a0550 con 0x55991e79b430 2024-04-24T02:12:21.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.116+0000 7f897402e640 1 -- 172.21.15.134:0/4060334358 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f896405c040 con 0x55991e79b430 2024-04-24T02:12:21.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.116+0000 7f8980b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:21.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.116+0000 7f8980b31800 20 started sync module instance, tier type = 2024-04-24T02:12:21.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.116+0000 7f8980b31800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:21.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.116+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e79f650 con 0x7f8964027060 2024-04-24T02:12:21.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.117+0000 7f897d030640 1 -- 172.21.15.134:0/4060334358 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8978040040 con 0x7f8964027060 2024-04-24T02:12:21.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.117+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94116129667696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7a0e30 con 0x7f8964027060 2024-04-24T02:12:21.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.117+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7a1680 con 0x55991e7951e0 2024-04-24T02:12:21.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.118+0000 7f897d030640 1 -- 172.21.15.134:0/4060334358 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94116129667696] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8978040040 con 0x7f8964027060 2024-04-24T02:12:21.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.118+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f896c075030 con 0x55991e7951e0 2024-04-24T02:12:21.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.118+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94116129671552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7a1330 con 0x55991e7951e0 2024-04-24T02:12:21.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.118+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7a1e50 con 0x55991e79b430 2024-04-24T02:12:21.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.121+0000 7f897402e640 1 -- 172.21.15.134:0/4060334358 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f896405c040 con 0x55991e79b430 2024-04-24T02:12:21.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.121+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94116129671552] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f896c075030 con 0x55991e7951e0 2024-04-24T02:12:21.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.121+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94116129675552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7a26f0 con 0x55991e79b430 2024-04-24T02:12:21.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.121+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7a0e20 con 0x7f8964027060 2024-04-24T02:12:21.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.121+0000 7f897d030640 1 -- 172.21.15.134:0/4060334358 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8978040040 con 0x7f8964027060 2024-04-24T02:12:21.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.122+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94116129680512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7a3550 con 0x7f8964027060 2024-04-24T02:12:21.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.122+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7a3fa0 con 0x55991e7951e0 2024-04-24T02:12:21.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.122+0000 7f897402e640 1 -- 172.21.15.134:0/4060334358 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94116129675552] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f896405c040 con 0x55991e79b430 2024-04-24T02:12:21.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.123+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f896c075030 con 0x55991e7951e0 2024-04-24T02:12:21.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.123+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94116129684112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7a3f60 con 0x55991e7951e0 2024-04-24T02:12:21.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.123+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7a4a50 con 0x7f8978031040 2024-04-24T02:12:21.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.123+0000 7f897d030640 1 -- 172.21.15.134:0/4060334358 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94116129680512] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8978040040 con 0x7f8964027060 2024-04-24T02:12:21.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.124+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94116129684112] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f896c075030 con 0x55991e7951e0 2024-04-24T02:12:21.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.126+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f896c075030 con 0x7f8978031040 2024-04-24T02:12:21.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.126+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94116129677888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7a4a50 con 0x7f8978031040 2024-04-24T02:12:21.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.126+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7a52f0 con 0x7f8978031040 2024-04-24T02:12:21.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.129+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94116129677888] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f896c075030 con 0x7f8978031040 2024-04-24T02:12:21.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.132+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(56 notify.6 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f896c075030 con 0x7f8978031040 2024-04-24T02:12:21.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.132+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94116129681568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7a4a50 con 0x7f8978031040 2024-04-24T02:12:21.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.132+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7a5910 con 0x7f8978031040 2024-04-24T02:12:21.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.135+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(58 notify.7 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f896c075030 con 0x7f8978031040 2024-04-24T02:12:21.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.135+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94116129690720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7a5d30 con 0x7f8978031040 2024-04-24T02:12:21.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.135+0000 7f8980b31800 20 add_watcher() i=0 2024-04-24T02:12:21.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.135+0000 7f8980b31800 20 add_watcher() i=1 2024-04-24T02:12:21.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.135+0000 7f8980b31800 20 add_watcher() i=2 2024-04-24T02:12:21.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.135+0000 7f8980b31800 20 add_watcher() i=3 2024-04-24T02:12:21.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.135+0000 7f8980b31800 20 add_watcher() i=4 2024-04-24T02:12:21.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.135+0000 7f8980b31800 20 add_watcher() i=5 2024-04-24T02:12:21.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.135+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94116129681568] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f896c075030 con 0x7f8978031040 2024-04-24T02:12:21.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.135+0000 7f8980b31800 20 add_watcher() i=6 2024-04-24T02:12:21.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.135+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94116129690720] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f896c075030 con 0x7f8978031040 2024-04-24T02:12:21.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.135+0000 7f8980b31800 20 add_watcher() i=7 2024-04-24T02:12:21.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.135+0000 7f8980b31800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:21.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.136+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55991e7a5d30 con 0x55991e7951e0 2024-04-24T02:12:21.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.136+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f896c075030 con 0x55991e7951e0 2024-04-24T02:12:21.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.136+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94116129691776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7a5ca0 con 0x55991e7951e0 2024-04-24T02:12:21.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.137+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94116129691776] v30'47 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f896c075030 con 0x55991e7951e0 2024-04-24T02:12:21.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.137+0000 7f8832fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:21.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.137+0000 7f8980b31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:21.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.137+0000 7f8980b31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:21.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.137+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7b16c0 con 0x55991e7951e0 2024-04-24T02:12:21.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.138+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'43 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f896c075030 con 0x55991e7951e0 2024-04-24T02:12:21.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.138+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7b1d10 con 0x7f8978031040 2024-04-24T02:12:21.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.139+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f896c075030 con 0x7f8978031040 2024-04-24T02:12:21.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.139+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7b1d10 con 0x55991e79b430 2024-04-24T02:12:21.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.140+0000 7f897402e640 1 -- 172.21.15.134:0/4060334358 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f896405c040 con 0x55991e79b430 2024-04-24T02:12:21.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.140+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7b2130 con 0x55991e7951e0 2024-04-24T02:12:21.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.141+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'48 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f896c075030 con 0x55991e7951e0 2024-04-24T02:12:21.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.141+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7b20e0 con 0x7f8964027060 2024-04-24T02:12:21.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.144+0000 7f897d030640 1 -- 172.21.15.134:0/4060334358 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'35 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8978040040 con 0x7f8964027060 2024-04-24T02:12:21.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.144+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7b26b0 con 0x55991e79b430 2024-04-24T02:12:21.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.145+0000 7f897402e640 1 -- 172.21.15.134:0/4060334358 <== osd.3 v2:172.21.15.134:6801/3585115521 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'33 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f896405c040 con 0x55991e79b430 2024-04-24T02:12:21.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.145+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7b2740 con 0x55991e7951e0 2024-04-24T02:12:21.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.147+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f896c075030 con 0x55991e7951e0 2024-04-24T02:12:21.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.147+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7b2740 con 0x7f8978031040 2024-04-24T02:12:21.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.148+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'26 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f896c075030 con 0x7f8978031040 2024-04-24T02:12:21.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.148+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7b2740 con 0x7f8964027060 2024-04-24T02:12:21.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.149+0000 7f897d030640 1 -- 172.21.15.134:0/4060334358 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8978040040 con 0x7f8964027060 2024-04-24T02:12:21.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.150+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7b2d90 con 0x55991e79b430 2024-04-24T02:12:21.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.150+0000 7f897402e640 1 -- 172.21.15.134:0/4060334358 <== osd.3 v2:172.21.15.134:6801/3585115521 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f896405c040 con 0x55991e79b430 2024-04-24T02:12:21.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.150+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7b2d90 con 0x7f8964027060 2024-04-24T02:12:21.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.151+0000 7f897d030640 1 -- 172.21.15.134:0/4060334358 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'36 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8978040040 con 0x7f8964027060 2024-04-24T02:12:21.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.151+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7b3360 con 0x7f8978031040 2024-04-24T02:12:21.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.153+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f896c075030 con 0x7f8978031040 2024-04-24T02:12:21.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.153+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7b3360 con 0x7f8964027060 2024-04-24T02:12:21.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.154+0000 7f897d030640 1 -- 172.21.15.134:0/4060334358 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'19 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8978040040 con 0x7f8964027060 2024-04-24T02:12:21.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.154+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7b3810 con 0x7f8978031040 2024-04-24T02:12:21.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.155+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.0 v2:172.21.15.104:6800/2419146313 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'37 uv16 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f896c075030 con 0x7f8978031040 2024-04-24T02:12:21.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.155+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7b3810 con 0x55991e7951e0 2024-04-24T02:12:21.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.156+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'49 uv16 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f896c075030 con 0x55991e7951e0 2024-04-24T02:12:21.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.156+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7b3810 con 0x55991e79b430 2024-04-24T02:12:21.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.159+0000 7f897402e640 1 -- 172.21.15.134:0/4060334358 <== osd.3 v2:172.21.15.134:6801/3585115521 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'29 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f896405c040 con 0x55991e79b430 2024-04-24T02:12:21.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.159+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7b3810 con 0x7f8964027060 2024-04-24T02:12:21.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.161+0000 7f897d030640 1 -- 172.21.15.134:0/4060334358 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'37 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8978040040 con 0x7f8964027060 2024-04-24T02:12:21.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.162+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7b3810 con 0x55991e79b430 2024-04-24T02:12:21.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.164+0000 7f897402e640 1 -- 172.21.15.134:0/4060334358 <== osd.3 v2:172.21.15.134:6801/3585115521 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'25 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f896405c040 con 0x55991e79b430 2024-04-24T02:12:21.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.164+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7b3810 con 0x55991e7951e0 2024-04-24T02:12:21.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.167+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f896c075030 con 0x55991e7951e0 2024-04-24T02:12:21.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.167+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7b3810 con 0x55991e7951e0 2024-04-24T02:12:21.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.170+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'50 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f896c075030 con 0x55991e7951e0 2024-04-24T02:12:21.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.170+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7b3810 con 0x55991e79b430 2024-04-24T02:12:21.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.173+0000 7f897402e640 1 -- 172.21.15.134:0/4060334358 <== osd.3 v2:172.21.15.134:6801/3585115521 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'30 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f896405c040 con 0x55991e79b430 2024-04-24T02:12:21.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.173+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7b3810 con 0x7f8964027060 2024-04-24T02:12:21.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.174+0000 7f897d030640 1 -- 172.21.15.134:0/4060334358 <== osd.2 v2:172.21.15.134:6800/214480313 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'29 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8978040040 con 0x7f8964027060 2024-04-24T02:12:21.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.174+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7b3810 con 0x55991e79b430 2024-04-24T02:12:21.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.175+0000 7f897402e640 1 -- 172.21.15.134:0/4060334358 <== osd.3 v2:172.21.15.134:6801/3585115521 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f896405c040 con 0x55991e79b430 2024-04-24T02:12:21.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.175+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7b3810 con 0x55991e79b430 2024-04-24T02:12:21.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.178+0000 7f897402e640 1 -- 172.21.15.134:0/4060334358 <== osd.3 v2:172.21.15.134:6801/3585115521 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'31 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f896405c040 con 0x55991e79b430 2024-04-24T02:12:21.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.178+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7b3810 con 0x55991e79b430 2024-04-24T02:12:21.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.181+0000 7f897402e640 1 -- 172.21.15.134:0/4060334358 <== osd.3 v2:172.21.15.134:6801/3585115521 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f896405c040 con 0x55991e79b430 2024-04-24T02:12:21.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.181+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7b3810 con 0x55991e79b430 2024-04-24T02:12:21.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.183+0000 7f897402e640 1 -- 172.21.15.134:0/4060334358 <== osd.3 v2:172.21.15.134:6801/3585115521 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'34 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f896405c040 con 0x55991e79b430 2024-04-24T02:12:21.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.183+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7b3810 con 0x7f8978031040 2024-04-24T02:12:21.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.186+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.0 v2:172.21.15.104:6800/2419146313 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'21 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f896c075030 con 0x7f8978031040 2024-04-24T02:12:21.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.186+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7b3810 con 0x55991e79b430 2024-04-24T02:12:21.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.189+0000 7f897402e640 1 -- 172.21.15.134:0/4060334358 <== osd.3 v2:172.21.15.134:6801/3585115521 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'25 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f896405c040 con 0x55991e79b430 2024-04-24T02:12:21.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.189+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7b3810 con 0x7f8978031040 2024-04-24T02:12:21.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.191+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.0 v2:172.21.15.104:6800/2419146313 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'27 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f896c075030 con 0x7f8978031040 2024-04-24T02:12:21.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.191+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7b3810 con 0x55991e79b430 2024-04-24T02:12:21.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.193+0000 7f897402e640 1 -- 172.21.15.134:0/4060334358 <== osd.3 v2:172.21.15.134:6801/3585115521 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'31 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f896405c040 con 0x55991e79b430 2024-04-24T02:12:21.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.193+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7b3810 con 0x7f8978031040 2024-04-24T02:12:21.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.194+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.0 v2:172.21.15.104:6800/2419146313 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'38 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f896c075030 con 0x7f8978031040 2024-04-24T02:12:21.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.194+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7b3810 con 0x7f8964027060 2024-04-24T02:12:21.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.195+0000 7f897d030640 1 -- 172.21.15.134:0/4060334358 <== osd.2 v2:172.21.15.134:6800/214480313 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8978040040 con 0x7f8964027060 2024-04-24T02:12:21.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.195+0000 7f8831fe3640 20 reqs_thread_entry: start 2024-04-24T02:12:21.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.195+0000 7f8980b31800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:21.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.195+0000 7f8980b31800 20 Filter name: none 2024-04-24T02:12:21.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.195+0000 7f87a37fe640 20 reqs_thread_entry: start 2024-04-24T02:12:21.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.195+0000 7f8980b31800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T02:12:21.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.195+0000 7f8980b31800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.195+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55991e7de520 con 0x55991e7951e0 2024-04-24T02:12:21.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.195+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f896c075030 con 0x55991e7951e0 2024-04-24T02:12:21.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.196+0000 7f8980b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:21.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.196+0000 7f8980b31800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-04-24T02:12:21.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.196+0000 7f8980b31800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:21.200 INFO:teuthology.orchestra.run.smithi134.stderr:could not remove user: unable to remove user, user does not exist 2024-04-24T02:12:21.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.196+0000 7f8832fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:21.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.196+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94116129691776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7dcce0 con 0x55991e7951e0 2024-04-24T02:12:21.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.197+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.1 v2:172.21.15.134:6804/1487076214 30 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94116129691776] v30'51 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f896c075030 con 0x55991e7951e0 2024-04-24T02:12:21.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.197+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94116129667696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7a5880 con 0x7f8964027060 2024-04-24T02:12:21.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.200+0000 7f897d030640 1 -- 172.21.15.134:0/4060334358 <== osd.2 v2:172.21.15.134:6800/214480313 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94116129667696] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8978040040 con 0x7f8964027060 2024-04-24T02:12:21.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.200+0000 7f8980b31800 20 remove_watcher() i=0 2024-04-24T02:12:21.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.200+0000 7f8980b31800 2 removed watcher, disabling cache 2024-04-24T02:12:21.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.200+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94116129671552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7a5880 con 0x55991e7951e0 2024-04-24T02:12:21.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.201+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.1 v2:172.21.15.134:6804/1487076214 31 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94116129671552] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f896c075030 con 0x55991e7951e0 2024-04-24T02:12:21.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.201+0000 7f8980b31800 20 remove_watcher() i=1 2024-04-24T02:12:21.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.201+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94116129675552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7a5880 con 0x55991e79b430 2024-04-24T02:12:21.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.202+0000 7f897402e640 1 -- 172.21.15.134:0/4060334358 <== osd.3 v2:172.21.15.134:6801/3585115521 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94116129675552] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f896405c040 con 0x55991e79b430 2024-04-24T02:12:21.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.202+0000 7f8980b31800 20 remove_watcher() i=2 2024-04-24T02:12:21.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.202+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94116129680512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7a5880 con 0x7f8964027060 2024-04-24T02:12:21.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.203+0000 7f897d030640 1 -- 172.21.15.134:0/4060334358 <== osd.2 v2:172.21.15.134:6800/214480313 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94116129680512] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8978040040 con 0x7f8964027060 2024-04-24T02:12:21.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.203+0000 7f8980b31800 20 remove_watcher() i=3 2024-04-24T02:12:21.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.203+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94116129684112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7a2c80 con 0x55991e7951e0 2024-04-24T02:12:21.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.205+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.1 v2:172.21.15.134:6804/1487076214 32 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94116129684112] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f896c075030 con 0x55991e7951e0 2024-04-24T02:12:21.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.205+0000 7f8980b31800 20 remove_watcher() i=4 2024-04-24T02:12:21.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.205+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94116129677888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7a5880 con 0x7f8978031040 2024-04-24T02:12:21.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.206+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.0 v2:172.21.15.104:6800/2419146313 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94116129677888] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f896c075030 con 0x7f8978031040 2024-04-24T02:12:21.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.206+0000 7f8980b31800 20 remove_watcher() i=5 2024-04-24T02:12:21.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.206+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94116129681568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7a3a90 con 0x7f8978031040 2024-04-24T02:12:21.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.207+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.0 v2:172.21.15.104:6800/2419146313 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94116129681568] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f896c075030 con 0x7f8978031040 2024-04-24T02:12:21.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.207+0000 7f8980b31800 20 remove_watcher() i=6 2024-04-24T02:12:21.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.207+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94116129690720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55991e7a5880 con 0x7f8978031040 2024-04-24T02:12:21.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.208+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 <== osd.0 v2:172.21.15.104:6800/2419146313 26 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94116129690720] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f896c075030 con 0x7f8978031040 2024-04-24T02:12:21.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.208+0000 7f8980b31800 20 remove_watcher() i=7 2024-04-24T02:12:21.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.209+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f8978031040 msgr2=0x7f8978032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.209+0000 7f8980b31800 1 --2- 172.21.15.134:0/4060334358 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f8978031040 0x7f8978032430 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.209+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55991e7951e0 msgr2=0x55991e7976a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.209+0000 7f8980b31800 1 --2- 172.21.15.134:0/4060334358 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55991e7951e0 0x55991e7976a0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.209+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f8964027060 msgr2=0x7f89640278a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.209+0000 7f8980b31800 1 --2- 172.21.15.134:0/4060334358 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f8964027060 0x7f89640278a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.209+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55991e79b430 msgr2=0x55991e79d820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.209+0000 7f8980b31800 1 --2- 172.21.15.134:0/4060334358 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55991e79b430 0x55991e79d820 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.209+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8848036950 msgr2=0x7f8848038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.209+0000 7f8980b31800 1 --2- 172.21.15.134:0/4060334358 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8848036950 0x7f8848038e10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x55991e761530 tx=0x7f897801f000 comp rx=0 tx=0).stop 2024-04-24T02:12:21.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.209+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55991e7824b0 msgr2=0x55991e789af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.209+0000 7f897c82f640 1 -- 172.21.15.134:0/4060334358 reap_dead start 2024-04-24T02:12:21.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.209+0000 7f8980b31800 1 --2- 172.21.15.134:0/4060334358 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55991e7824b0 0x55991e789af0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f896404c1a0 tx=0x7f896404c130 comp rx=0 tx=0).stop 2024-04-24T02:12:21.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.209+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 shutdown_connections 2024-04-24T02:12:21.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.209+0000 7f8980b31800 1 --2- 172.21.15.134:0/4060334358 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55991e7824b0 0x55991e789af0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.209+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 >> 172.21.15.134:0/4060334358 conn(0x55991e77e810 msgr2=0x55991e77be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:21.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.209+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 shutdown_connections 2024-04-24T02:12:21.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.209+0000 7f8980b31800 1 -- 172.21.15.134:0/4060334358 wait complete. 2024-04-24T02:12:21.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.209+0000 7f8980b31800 1 -- 172.21.15.134:0/4095448328 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8854036950 msgr2=0x7f8854038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.209+0000 7f8980b31800 1 --2- 172.21.15.134:0/4095448328 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8854036950 0x7f8854038e10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x55991e761710 tx=0x7f8978005840 comp rx=0 tx=0).stop 2024-04-24T02:12:21.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.209+0000 7f8980b31800 1 -- 172.21.15.134:0/4095448328 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55991e7751b0 msgr2=0x55991e7755d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.209+0000 7f8980b31800 1 --2- 172.21.15.134:0/4095448328 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55991e7751b0 0x55991e7755d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f896400e630 tx=0x7f896400ea30 comp rx=0 tx=0).stop 2024-04-24T02:12:21.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.209+0000 7f8980b31800 1 -- 172.21.15.134:0/4095448328 shutdown_connections 2024-04-24T02:12:21.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.209+0000 7f8980b31800 1 --2- 172.21.15.134:0/4095448328 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8854036950 0x7f8854038e10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.209+0000 7f8980b31800 1 --2- 172.21.15.134:0/4095448328 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55991e7751b0 0x55991e7755d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.209+0000 7f8980b31800 1 -- 172.21.15.134:0/4095448328 >> 172.21.15.134:0/4095448328 conn(0x55991e769250 msgr2=0x55991e769650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:21.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.209+0000 7f8980b31800 1 -- 172.21.15.134:0/4095448328 shutdown_connections 2024-04-24T02:12:21.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.209+0000 7f8980b31800 1 -- 172.21.15.134:0/4095448328 wait complete. 2024-04-24T02:12:21.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.210+0000 7f8980b31800 1 -- 172.21.15.134:0/961196253 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55991e6610e0 msgr2=0x55991e764010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.210+0000 7f8980b31800 1 --2- 172.21.15.134:0/961196253 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55991e6610e0 0x55991e764010 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.210+0000 7f8980b31800 1 -- 172.21.15.134:0/961196253 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8864036900 msgr2=0x7f8864038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.210+0000 7f8980b31800 1 --2- 172.21.15.134:0/961196253 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8864036900 0x7f8864038dc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8964001e40 tx=0x7f89640013a0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.210+0000 7f8980b31800 1 -- 172.21.15.134:0/961196253 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55991e660780 msgr2=0x55991e75ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.210+0000 7f8980b31800 1 --2- 172.21.15.134:0/961196253 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55991e660780 0x55991e75ce70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f896c01cfe0 tx=0x7f896c003020 comp rx=0 tx=0).stop 2024-04-24T02:12:21.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.210+0000 7f8980b31800 1 -- 172.21.15.134:0/961196253 shutdown_connections 2024-04-24T02:12:21.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.210+0000 7f8980b31800 1 --2- 172.21.15.134:0/961196253 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55991e6610e0 0x55991e764010 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.210+0000 7f8980b31800 1 --2- 172.21.15.134:0/961196253 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8864036900 0x7f8864038dc0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.210+0000 7f8980b31800 1 --2- 172.21.15.134:0/961196253 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55991e660780 0x55991e75ce70 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.210+0000 7f8980b31800 1 -- 172.21.15.134:0/961196253 >> 172.21.15.134:0/961196253 conn(0x55991e65c320 msgr2=0x55991e74f470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:21.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.210+0000 7f8980b31800 1 -- 172.21.15.134:0/961196253 shutdown_connections 2024-04-24T02:12:21.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.210+0000 7f8980b31800 1 -- 172.21.15.134:0/961196253 wait complete. 2024-04-24T02:12:21.218 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-04-24T02:12:21.219 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-04-24T02:12:21.219 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-04-24T02:12:21.219 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-04-24T02:12:21.304 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:21.304 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:21.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.303+0000 7f5510346800 1 Processor -- start 2024-04-24T02:12:21.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.303+0000 7f5510346800 1 -- start start 2024-04-24T02:12:21.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.303+0000 7f5510346800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x556558c38540 0x556558c3a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.304+0000 7f5510346800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556558af2d40 con 0x556558c34a30 2024-04-24T02:12:21.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.304+0000 7f5510346800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x556558ac54d0 con 0x556558c38540 2024-04-24T02:12:21.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.304+0000 7f550d64b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x556558c38540 0x556558c3a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.304+0000 7f550de4c640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x556558c34a30 0x556558c36e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:43152/0 (socket says 172.21.15.134:43152) 2024-04-24T02:12:21.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.304+0000 7f550de4c640 1 -- 172.21.15.134:0/3374828498 learned_addr learned my addr 172.21.15.134:0/3374828498 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:12:21.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.304+0000 7f550d64b640 1 --2- 172.21.15.134:0/3374828498 >> v2:172.21.15.104:3300/0 conn(0x556558c38540 0x556558c3a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45320/0 (socket says 172.21.15.134:45320) 2024-04-24T02:12:21.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.304+0000 7f550d64b640 1 -- 172.21.15.134:0/3374828498 >> v1:172.21.15.104:6789/0 conn(0x556558c34a30 legacy=0x556558c36e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.304+0000 7f550d64b640 1 -- 172.21.15.134:0/3374828498 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556558af1590 con 0x556558c38540 2024-04-24T02:12:21.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.304+0000 7f550ce4a640 1 -- 172.21.15.134:0/3374828498 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3464433958 0 0) 0x556558af2d40 con 0x556558c34a30 2024-04-24T02:12:21.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.306+0000 7f550d64b640 1 --2- 172.21.15.134:0/3374828498 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556558c38540 0x556558c3a930 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f550400a470 tx=0x7f550401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e730ef5adeb5b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.306+0000 7f550ce4a640 1 -- 172.21.15.134:0/3374828498 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5504057070 con 0x556558c38540 2024-04-24T02:12:21.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.306+0000 7f550ce4a640 1 -- 172.21.15.134:0/3374828498 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5504052570 con 0x556558c38540 2024-04-24T02:12:21.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.306+0000 7f550ce4a640 1 -- 172.21.15.134:0/3374828498 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5504052870 con 0x556558c38540 2024-04-24T02:12:21.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.307+0000 7f5510346800 1 -- 172.21.15.134:0/3374828498 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556558c38540 msgr2=0x556558c3a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.307+0000 7f5510346800 1 --2- 172.21.15.134:0/3374828498 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556558c38540 0x556558c3a930 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f550400a470 tx=0x7f550401ce90 comp rx=0 tx=0).stop 2024-04-24T02:12:21.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.307+0000 7f5510346800 1 -- 172.21.15.134:0/3374828498 shutdown_connections 2024-04-24T02:12:21.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.307+0000 7f5510346800 1 --2- 172.21.15.134:0/3374828498 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556558c38540 0x556558c3a930 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.307+0000 7f5510346800 1 -- 172.21.15.134:0/3374828498 >> 172.21.15.134:0/3374828498 conn(0x556558c2e380 msgr2=0x556558c307c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:21.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.307+0000 7f5510346800 1 -- 172.21.15.134:0/3374828498 shutdown_connections 2024-04-24T02:12:21.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.307+0000 7f5510346800 1 -- 172.21.15.134:0/3374828498 wait complete. 2024-04-24T02:12:21.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.318+0000 7f5510346800 1 Processor -- start 2024-04-24T02:12:21.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.318+0000 7f5510346800 1 -- start start 2024-04-24T02:12:21.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.318+0000 7f5510346800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556558c34a30 0x556558c34370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.318+0000 7f5510346800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556558b7f3e0 con 0x556558c34a30 2024-04-24T02:12:21.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.319+0000 7f550de4c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556558c34a30 0x556558c34370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.319+0000 7f550de4c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556558c34a30 0x556558c34370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45328/0 (socket says 172.21.15.134:45328) 2024-04-24T02:12:21.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.319+0000 7f550de4c640 1 -- 172.21.15.134:0/633578106 learned_addr learned my addr 172.21.15.134:0/633578106 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:21.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.319+0000 7f550de4c640 1 -- 172.21.15.134:0/633578106 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556558c32930 con 0x556558c34a30 2024-04-24T02:12:21.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.319+0000 7f550de4c640 1 --2- 172.21.15.134:0/633578106 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556558c34a30 0x556558c34370 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f550000b210 tx=0x7f550000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7582d17c69050445 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.319+0000 7f53fbe07640 1 -- 172.21.15.134:0/633578106 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5500008070 con 0x556558c34a30 2024-04-24T02:12:21.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.319+0000 7f53fbe07640 1 -- 172.21.15.134:0/633578106 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f550000d500 con 0x556558c34a30 2024-04-24T02:12:21.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.319+0000 7f53fbe07640 1 -- 172.21.15.134:0/633578106 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f550000d840 con 0x556558c34a30 2024-04-24T02:12:21.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.320+0000 7f5510346800 1 -- 172.21.15.134:0/633578106 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556558c34a30 msgr2=0x556558c34370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.320+0000 7f5510346800 1 --2- 172.21.15.134:0/633578106 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556558c34a30 0x556558c34370 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f550000b210 tx=0x7f550000b6d0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.320+0000 7f5510346800 1 -- 172.21.15.134:0/633578106 shutdown_connections 2024-04-24T02:12:21.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.320+0000 7f5510346800 1 --2- 172.21.15.134:0/633578106 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556558c34a30 0x556558c34370 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.320+0000 7f5510346800 1 -- 172.21.15.134:0/633578106 >> 172.21.15.134:0/633578106 conn(0x556558c2e380 msgr2=0x556558d20990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:21.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.320+0000 7f5510346800 1 -- 172.21.15.134:0/633578106 shutdown_connections 2024-04-24T02:12:21.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.320+0000 7f5510346800 1 -- 172.21.15.134:0/633578106 wait complete. 2024-04-24T02:12:21.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.320+0000 7f5510346800 1 Processor -- start 2024-04-24T02:12:21.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.320+0000 7f5510346800 1 -- start start 2024-04-24T02:12:21.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.320+0000 7f5510346800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556558c34a30 0x556558d2edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.320+0000 7f5510346800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556558c3d180 con 0x556558c34a30 2024-04-24T02:12:21.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.321+0000 7f550de4c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556558c34a30 0x556558d2edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.321+0000 7f550de4c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556558c34a30 0x556558d2edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45332/0 (socket says 172.21.15.134:45332) 2024-04-24T02:12:21.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.321+0000 7f550de4c640 1 -- 172.21.15.134:0/829394658 learned_addr learned my addr 172.21.15.134:0/829394658 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:21.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.321+0000 7f550de4c640 1 -- 172.21.15.134:0/829394658 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556558d2f330 con 0x556558c34a30 2024-04-24T02:12:21.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.321+0000 7f550de4c640 1 --2- 172.21.15.134:0/829394658 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556558c34a30 0x556558d2edf0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f550000b210 tx=0x7f5500000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.321+0000 7f53fa604640 1 -- 172.21.15.134:0/829394658 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f550000f950 con 0x556558c34a30 2024-04-24T02:12:21.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.321+0000 7f53fa604640 1 -- 172.21.15.134:0/829394658 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f550000faf0 con 0x556558c34a30 2024-04-24T02:12:21.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.321+0000 7f53fa604640 1 -- 172.21.15.134:0/829394658 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f550000fdd0 con 0x556558c34a30 2024-04-24T02:12:21.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.321+0000 7f5510346800 1 -- 172.21.15.134:0/829394658 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556558d2f5c0 con 0x556558c34a30 2024-04-24T02:12:21.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.321+0000 7f5510346800 1 -- 172.21.15.134:0/829394658 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556558d32270 con 0x556558c34a30 2024-04-24T02:12:21.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.322+0000 7f5510346800 1 Processor -- start 2024-04-24T02:12:21.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.322+0000 7f5510346800 1 -- start start 2024-04-24T02:12:21.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.322+0000 7f5510346800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556558d3c6a0 0x556558d3cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.322+0000 7f5510346800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556558b256b0 con 0x556558d3c6a0 2024-04-24T02:12:21.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.322+0000 7f53fa604640 1 -- 172.21.15.134:0/829394658 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5500017040 con 0x556558c34a30 2024-04-24T02:12:21.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.322+0000 7f53fa604640 1 --2- 172.21.15.134:0/829394658 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f53f40368b0 0x7f53f4038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.322+0000 7f550e64d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556558d3c6a0 0x556558d3cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.322+0000 7f53fa604640 1 -- 172.21.15.134:0/829394658 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f5500015020 con 0x556558c34a30 2024-04-24T02:12:21.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.322+0000 7f550e64d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556558d3c6a0 0x556558d3cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45338/0 (socket says 172.21.15.134:45338) 2024-04-24T02:12:21.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.322+0000 7f550e64d640 1 -- 172.21.15.134:0/539657191 learned_addr learned my addr 172.21.15.134:0/539657191 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:21.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.322+0000 7f550de4c640 1 --2- 172.21.15.134:0/829394658 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f53f40368b0 0x7f53f4038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.323+0000 7f550e64d640 1 -- 172.21.15.134:0/539657191 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556558d3d000 con 0x556558d3c6a0 2024-04-24T02:12:21.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.323+0000 7f550de4c640 1 --2- 172.21.15.134:0/829394658 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f53f40368b0 0x7f53f4038d70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f550001b5b0 tx=0x7f5500034040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.323+0000 7f550e64d640 1 --2- 172.21.15.134:0/539657191 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556558d3c6a0 0x556558d3cac0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f550800a430 tx=0x7f550800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb7429f3210f8ef4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.323+0000 7f53f3fff640 1 -- 172.21.15.134:0/539657191 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5508015070 con 0x556558d3c6a0 2024-04-24T02:12:21.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.323+0000 7f53f3fff640 1 -- 172.21.15.134:0/539657191 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5508001670 con 0x556558d3c6a0 2024-04-24T02:12:21.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.323+0000 7f53f3fff640 1 -- 172.21.15.134:0/539657191 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5508001990 con 0x556558d3c6a0 2024-04-24T02:12:21.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.323+0000 7f5510346800 1 -- 172.21.15.134:0/539657191 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556558d3c6a0 msgr2=0x556558d3cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.323+0000 7f5510346800 1 --2- 172.21.15.134:0/539657191 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556558d3c6a0 0x556558d3cac0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f550800a430 tx=0x7f550800a8f0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.323+0000 7f5510346800 1 -- 172.21.15.134:0/539657191 shutdown_connections 2024-04-24T02:12:21.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.323+0000 7f5510346800 1 --2- 172.21.15.134:0/539657191 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556558d3c6a0 0x556558d3cac0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.323+0000 7f5510346800 1 -- 172.21.15.134:0/539657191 >> 172.21.15.134:0/539657191 conn(0x556558c38540 msgr2=0x556558d39140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:21.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.323+0000 7f5510346800 1 -- 172.21.15.134:0/539657191 shutdown_connections 2024-04-24T02:12:21.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.323+0000 7f5510346800 1 -- 172.21.15.134:0/539657191 wait complete. 2024-04-24T02:12:21.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.324+0000 7f5510346800 1 Processor -- start 2024-04-24T02:12:21.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.324+0000 7f5510346800 1 -- start start 2024-04-24T02:12:21.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.324+0000 7f5510346800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556558d3c6a0 0x556558d43c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.324+0000 7f5510346800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556558d3d990 con 0x556558d3c6a0 2024-04-24T02:12:21.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.324+0000 7f550e64d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556558d3c6a0 0x556558d43c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.324+0000 7f550e64d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556558d3c6a0 0x556558d43c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45346/0 (socket says 172.21.15.134:45346) 2024-04-24T02:12:21.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.324+0000 7f550e64d640 1 -- 172.21.15.134:0/3440436151 learned_addr learned my addr 172.21.15.134:0/3440436151 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:21.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.324+0000 7f550e64d640 1 -- 172.21.15.134:0/3440436151 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556558d44170 con 0x556558d3c6a0 2024-04-24T02:12:21.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.325+0000 7f550e64d640 1 --2- 172.21.15.134:0/3440436151 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556558d3c6a0 0x556558d43c30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f550800a930 tx=0x7f5508003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.325+0000 7f53f27fc640 1 -- 172.21.15.134:0/3440436151 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5508020020 con 0x556558d3c6a0 2024-04-24T02:12:21.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.325+0000 7f53f27fc640 1 -- 172.21.15.134:0/3440436151 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55080108b0 con 0x556558d3c6a0 2024-04-24T02:12:21.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.325+0000 7f53f27fc640 1 -- 172.21.15.134:0/3440436151 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5508015040 con 0x556558d3c6a0 2024-04-24T02:12:21.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.325+0000 7f5510346800 1 -- 172.21.15.134:0/3440436151 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556558d44400 con 0x556558d3c6a0 2024-04-24T02:12:21.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.325+0000 7f5510346800 1 -- 172.21.15.134:0/3440436151 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556558d470b0 con 0x556558d3c6a0 2024-04-24T02:12:21.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.325+0000 7f53f27fc640 1 -- 172.21.15.134:0/3440436151 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5508023020 con 0x556558d3c6a0 2024-04-24T02:12:21.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.326+0000 7f53f27fc640 1 --2- 172.21.15.134:0/3440436151 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f53e8036950 0x7f53e8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.326+0000 7f53f27fc640 1 -- 172.21.15.134:0/3440436151 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f550804bd90 con 0x556558d3c6a0 2024-04-24T02:12:21.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.326+0000 7f550d64b640 1 --2- 172.21.15.134:0/3440436151 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f53e8036950 0x7f53e8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.326+0000 7f5510346800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:21.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.326+0000 7f5510346800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:21.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.326+0000 7f550d64b640 1 --2- 172.21.15.134:0/3440436151 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f53e8036950 0x7f53e8038e10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5504054000 tx=0x7f550404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.326+0000 7f5510346800 1 Processor -- start 2024-04-24T02:12:21.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.326+0000 7f5510346800 1 -- start start 2024-04-24T02:12:21.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.326+0000 7f5510346800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556558d5e2b0 0x556558d5e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.326+0000 7f5510346800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556558c32cb0 con 0x556558d5e2b0 2024-04-24T02:12:21.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.327+0000 7f550de4c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556558d5e2b0 0x556558d5e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.327+0000 7f550de4c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556558d5e2b0 0x556558d5e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45354/0 (socket says 172.21.15.134:45354) 2024-04-24T02:12:21.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.327+0000 7f550de4c640 1 -- 172.21.15.134:0/2364334450 learned_addr learned my addr 172.21.15.134:0/2364334450 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:21.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.327+0000 7f550de4c640 1 -- 172.21.15.134:0/2364334450 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556558d5ec10 con 0x556558d5e2b0 2024-04-24T02:12:21.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.327+0000 7f550de4c640 1 --2- 172.21.15.134:0/2364334450 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556558d5e2b0 0x556558d5e6d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f550001cb10 tx=0x7f5500018850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.327+0000 7f53d27e4640 1 -- 172.21.15.134:0/2364334450 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f550001ce00 con 0x556558d5e2b0 2024-04-24T02:12:21.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.327+0000 7f53d27e4640 1 -- 172.21.15.134:0/2364334450 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5500019470 con 0x556558d5e2b0 2024-04-24T02:12:21.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.327+0000 7f5510346800 1 -- 172.21.15.134:0/2364334450 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556558d5f680 con 0x556558d5e2b0 2024-04-24T02:12:21.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.327+0000 7f53d27e4640 1 -- 172.21.15.134:0/2364334450 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5500019750 con 0x556558d5e2b0 2024-04-24T02:12:21.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.327+0000 7f5510346800 1 -- 172.21.15.134:0/2364334450 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556558d5fb80 con 0x556558d5e2b0 2024-04-24T02:12:21.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.328+0000 7f53d27e4640 1 -- 172.21.15.134:0/2364334450 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f550004c5b0 con 0x556558d5e2b0 2024-04-24T02:12:21.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.328+0000 7f53d27e4640 1 --2- 172.21.15.134:0/2364334450 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5350036900 0x7f5350038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.328+0000 7f53d27e4640 1 -- 172.21.15.134:0/2364334450 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f5500049ab0 con 0x556558d5e2b0 2024-04-24T02:12:21.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.328+0000 7f550d64b640 1 --2- 172.21.15.134:0/2364334450 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5350036900 0x7f5350038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.328+0000 7f550d64b640 1 --2- 172.21.15.134:0/2364334450 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5350036900 0x7f5350038dc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f550401ced0 tx=0x7f5504005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.328+0000 7f5343fff640 20 reqs_thread_entry: start 2024-04-24T02:12:21.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.329+0000 7f5510346800 1 --2- 172.21.15.134:0/829394658 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556558d6bec0 0x556558d6e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.329+0000 7f5510346800 1 -- 172.21.15.134:0/829394658 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556558d6ea20 con 0x556558d6bec0 2024-04-24T02:12:21.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.329+0000 7f550e64d640 1 --2- 172.21.15.134:0/829394658 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556558d6bec0 0x556558d6e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.329+0000 7f550e64d640 1 --2- 172.21.15.134:0/829394658 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556558d6bec0 0x556558d6e350 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.329+0000 7f550e64d640 1 -- 172.21.15.134:0/829394658 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5508010d70 con 0x556558d6bec0 2024-04-24T02:12:21.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.329+0000 7f5510346800 1 -- 172.21.15.134:0/829394658 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556558d70330 con 0x556558d6bec0 2024-04-24T02:12:21.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.330+0000 7f550e64d640 1 -- 172.21.15.134:0/829394658 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5508010d70 con 0x556558d6bec0 2024-04-24T02:12:21.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.330+0000 7f5510346800 1 -- 172.21.15.134:0/829394658 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556558d74ea0 con 0x556558d6bec0 2024-04-24T02:12:21.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.331+0000 7f550e64d640 1 -- 172.21.15.134:0/829394658 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [stat,call,call,writefull 0~993] v30'3 uv3 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f5508010d70 con 0x556558d6bec0 2024-04-24T02:12:21.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.332+0000 7f5510346800 1 -- 172.21.15.134:0/3440436151 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f53e8036950 msgr2=0x7f53e8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.332+0000 7f5510346800 1 --2- 172.21.15.134:0/3440436151 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f53e8036950 0x7f53e8038e10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5504054000 tx=0x7f550404e000 comp rx=0 tx=0).stop 2024-04-24T02:12:21.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.332+0000 7f5510346800 1 -- 172.21.15.134:0/3440436151 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556558d3c6a0 msgr2=0x556558d43c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.332+0000 7f5510346800 1 --2- 172.21.15.134:0/3440436151 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556558d3c6a0 0x556558d43c30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f550800a930 tx=0x7f5508003370 comp rx=0 tx=0).stop 2024-04-24T02:12:21.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.332+0000 7f5510346800 1 -- 172.21.15.134:0/3440436151 shutdown_connections 2024-04-24T02:12:21.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.332+0000 7f5510346800 1 --2- 172.21.15.134:0/3440436151 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f53e8036950 0x7f53e8038e10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.332+0000 7f5510346800 1 --2- 172.21.15.134:0/3440436151 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556558d3c6a0 0x556558d43c30 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.332+0000 7f5510346800 1 -- 172.21.15.134:0/3440436151 >> 172.21.15.134:0/3440436151 conn(0x556558c38540 msgr2=0x556558d36780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:21.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.332+0000 7f5510346800 1 -- 172.21.15.134:0/3440436151 shutdown_connections 2024-04-24T02:12:21.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.332+0000 7f5510346800 1 -- 172.21.15.134:0/3440436151 wait complete. 2024-04-24T02:12:21.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.332+0000 7f5510346800 1 -- 172.21.15.134:0/2364334450 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5350036900 msgr2=0x7f5350038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.332+0000 7f5510346800 1 --2- 172.21.15.134:0/2364334450 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5350036900 0x7f5350038dc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f550401ced0 tx=0x7f5504005a00 comp rx=0 tx=0).stop 2024-04-24T02:12:21.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.332+0000 7f5510346800 1 -- 172.21.15.134:0/2364334450 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556558d5e2b0 msgr2=0x556558d5e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.332+0000 7f5510346800 1 --2- 172.21.15.134:0/2364334450 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556558d5e2b0 0x556558d5e6d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f550001cb10 tx=0x7f5500018850 comp rx=0 tx=0).stop 2024-04-24T02:12:21.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.332+0000 7f5510346800 1 -- 172.21.15.134:0/2364334450 shutdown_connections 2024-04-24T02:12:21.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.332+0000 7f5510346800 1 --2- 172.21.15.134:0/2364334450 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5350036900 0x7f5350038dc0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.332+0000 7f5510346800 1 --2- 172.21.15.134:0/2364334450 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556558d5e2b0 0x556558d5e6d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.332+0000 7f5510346800 1 -- 172.21.15.134:0/2364334450 >> 172.21.15.134:0/2364334450 conn(0x556558d52d60 msgr2=0x556558d53780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:21.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.332+0000 7f5510346800 1 -- 172.21.15.134:0/2364334450 shutdown_connections 2024-04-24T02:12:21.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.332+0000 7f5510346800 1 -- 172.21.15.134:0/2364334450 wait complete. 2024-04-24T02:12:21.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.332+0000 7f5510346800 1 -- 172.21.15.134:0/829394658 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556558d6bec0 msgr2=0x556558d6e350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.332+0000 7f5510346800 1 --2- 172.21.15.134:0/829394658 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556558d6bec0 0x556558d6e350 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.332+0000 7f5510346800 1 -- 172.21.15.134:0/829394658 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f53f40368b0 msgr2=0x7f53f4038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.332+0000 7f5510346800 1 --2- 172.21.15.134:0/829394658 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f53f40368b0 0x7f53f4038d70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f550001b5b0 tx=0x7f5500034040 comp rx=0 tx=0).stop 2024-04-24T02:12:21.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.332+0000 7f5510346800 1 -- 172.21.15.134:0/829394658 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556558c34a30 msgr2=0x556558d2edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.332+0000 7f5510346800 1 --2- 172.21.15.134:0/829394658 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556558c34a30 0x556558d2edf0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f550000b210 tx=0x7f5500000ed0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.333+0000 7f5510346800 1 -- 172.21.15.134:0/829394658 shutdown_connections 2024-04-24T02:12:21.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.333+0000 7f5510346800 1 --2- 172.21.15.134:0/829394658 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556558d6bec0 0x556558d6e350 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.333+0000 7f5510346800 1 --2- 172.21.15.134:0/829394658 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f53f40368b0 0x7f53f4038d70 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.333+0000 7f5510346800 1 --2- 172.21.15.134:0/829394658 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556558c34a30 0x556558d2edf0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.333+0000 7f5510346800 1 -- 172.21.15.134:0/829394658 >> 172.21.15.134:0/829394658 conn(0x556558c2e380 msgr2=0x556558c33210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:21.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.333+0000 7f5510346800 1 -- 172.21.15.134:0/829394658 shutdown_connections 2024-04-24T02:12:21.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.333+0000 7f5510346800 1 -- 172.21.15.134:0/829394658 wait complete. 2024-04-24T02:12:21.343 INFO:teuthology.orchestra.run.smithi134.stdout:{"id":"582e5324-1512-4fe8-bc69-2f28bbcfaf89","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-04-24T02:12:21.343 DEBUG:tasks.util.rgw: json result: {'id': '582e5324-1512-4fe8-bc69-2f28bbcfaf89', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-04-24T02:12:21.345 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-04-24T02:12:21.345 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-04-24T02:12:21.345 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-04-24T02:12:21.386 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:21.386 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:21.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.385+0000 7f0c9db2f800 1 Processor -- start 2024-04-24T02:12:21.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.385+0000 7f0c9db2f800 1 -- start start 2024-04-24T02:12:21.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.386+0000 7f0c9db2f800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55bb2e584470 0x55bb2e586860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.386+0000 7f0c9db2f800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bb2e43ed40 con 0x55bb2e580960 2024-04-24T02:12:21.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.386+0000 7f0c9db2f800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55bb2e4114d0 con 0x55bb2e584470 2024-04-24T02:12:21.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.386+0000 7f0c93fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55bb2e584470 0x55bb2e586860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.386+0000 7f0c93fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55bb2e584470 0x55bb2e586860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45370/0 (socket says 172.21.15.134:45370) 2024-04-24T02:12:21.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.386+0000 7f0c998c5640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55bb2e580960 0x55bb2e582d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:43168/0 (socket says 172.21.15.134:43168) 2024-04-24T02:12:21.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.386+0000 7f0c93fff640 1 -- 172.21.15.134:0/437902131 learned_addr learned my addr 172.21.15.134:0/437902131 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:21.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.386+0000 7f0c93fff640 1 -- 172.21.15.134:0/437902131 >> v1:172.21.15.104:6789/0 conn(0x55bb2e580960 legacy=0x55bb2e582d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.386+0000 7f0c93fff640 1 -- 172.21.15.134:0/437902131 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb2e43d590 con 0x55bb2e584470 2024-04-24T02:12:21.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.388+0000 7f0c93fff640 1 --2- 172.21.15.134:0/437902131 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb2e584470 0x55bb2e586860 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0c8400a520 tx=0x7f0c8401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5d06e1796989091 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.388+0000 7f0c990c4640 1 -- 172.21.15.134:0/437902131 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c84057070 con 0x55bb2e584470 2024-04-24T02:12:21.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.388+0000 7f0c990c4640 1 -- 172.21.15.134:0/437902131 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c84052570 con 0x55bb2e584470 2024-04-24T02:12:21.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.388+0000 7f0c990c4640 1 -- 172.21.15.134:0/437902131 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c8404ae60 con 0x55bb2e584470 2024-04-24T02:12:21.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.388+0000 7f0c9db2f800 1 -- 172.21.15.134:0/437902131 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb2e584470 msgr2=0x55bb2e586860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.388+0000 7f0c9db2f800 1 --2- 172.21.15.134:0/437902131 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb2e584470 0x55bb2e586860 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0c8400a520 tx=0x7f0c8401d010 comp rx=0 tx=0).stop 2024-04-24T02:12:21.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.389+0000 7f0c9db2f800 1 -- 172.21.15.134:0/437902131 shutdown_connections 2024-04-24T02:12:21.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.389+0000 7f0c9db2f800 1 --2- 172.21.15.134:0/437902131 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb2e584470 0x55bb2e586860 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.389+0000 7f0c9db2f800 1 -- 172.21.15.134:0/437902131 >> 172.21.15.134:0/437902131 conn(0x55bb2e57a310 msgr2=0x55bb2e57c730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:21.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.389+0000 7f0c9db2f800 1 -- 172.21.15.134:0/437902131 shutdown_connections 2024-04-24T02:12:21.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.389+0000 7f0c9db2f800 1 -- 172.21.15.134:0/437902131 wait complete. 2024-04-24T02:12:21.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.400+0000 7f0c9db2f800 1 Processor -- start 2024-04-24T02:12:21.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.400+0000 7f0c9db2f800 1 -- start start 2024-04-24T02:12:21.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.400+0000 7f0c9db2f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb2e580960 0x55bb2e671110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.400+0000 7f0c9db2f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55bb2e4cb3b0 con 0x55bb2e580960 2024-04-24T02:12:21.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.401+0000 7f0c998c5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb2e580960 0x55bb2e671110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.401+0000 7f0c998c5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb2e580960 0x55bb2e671110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45384/0 (socket says 172.21.15.134:45384) 2024-04-24T02:12:21.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.401+0000 7f0c998c5640 1 -- 172.21.15.134:0/441677552 learned_addr learned my addr 172.21.15.134:0/441677552 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:21.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.401+0000 7f0c998c5640 1 -- 172.21.15.134:0/441677552 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb2e6716e0 con 0x55bb2e580960 2024-04-24T02:12:21.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.401+0000 7f0c998c5640 1 --2- 172.21.15.134:0/441677552 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb2e580960 0x55bb2e671110 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c001e90 tx=0x7f0c8c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb8772012480d88c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.401+0000 7f0b87e07640 1 -- 172.21.15.134:0/441677552 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c8c00e5c0 con 0x55bb2e580960 2024-04-24T02:12:21.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.401+0000 7f0b87e07640 1 -- 172.21.15.134:0/441677552 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c8c006070 con 0x55bb2e580960 2024-04-24T02:12:21.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.401+0000 7f0b87e07640 1 -- 172.21.15.134:0/441677552 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c8c00e890 con 0x55bb2e580960 2024-04-24T02:12:21.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.402+0000 7f0c9db2f800 1 -- 172.21.15.134:0/441677552 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb2e580960 msgr2=0x55bb2e671110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.402+0000 7f0c9db2f800 1 --2- 172.21.15.134:0/441677552 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb2e580960 0x55bb2e671110 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c001e90 tx=0x7f0c8c00b6c0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.402+0000 7f0c9db2f800 1 -- 172.21.15.134:0/441677552 shutdown_connections 2024-04-24T02:12:21.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.402+0000 7f0c9db2f800 1 --2- 172.21.15.134:0/441677552 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb2e580960 0x55bb2e671110 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.402+0000 7f0c9db2f800 1 -- 172.21.15.134:0/441677552 >> 172.21.15.134:0/441677552 conn(0x55bb2e57a310 msgr2=0x55bb2e66ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:21.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.402+0000 7f0c9db2f800 1 -- 172.21.15.134:0/441677552 shutdown_connections 2024-04-24T02:12:21.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.402+0000 7f0c9db2f800 1 -- 172.21.15.134:0/441677552 wait complete. 2024-04-24T02:12:21.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.402+0000 7f0c9db2f800 1 Processor -- start 2024-04-24T02:12:21.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.402+0000 7f0c9db2f800 1 -- start start 2024-04-24T02:12:21.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.403+0000 7f0c9db2f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb2e584470 0x55bb2e5802a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.403+0000 7f0c9db2f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55bb2e5890b0 con 0x55bb2e584470 2024-04-24T02:12:21.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.403+0000 7f0c998c5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb2e584470 0x55bb2e5802a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.403+0000 7f0c998c5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb2e584470 0x55bb2e5802a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45390/0 (socket says 172.21.15.134:45390) 2024-04-24T02:12:21.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.403+0000 7f0c998c5640 1 -- 172.21.15.134:0/3593260864 learned_addr learned my addr 172.21.15.134:0/3593260864 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:21.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.403+0000 7f0c998c5640 1 -- 172.21.15.134:0/3593260864 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb2e57e990 con 0x55bb2e584470 2024-04-24T02:12:21.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.403+0000 7f0c998c5640 1 --2- 172.21.15.134:0/3593260864 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb2e584470 0x55bb2e5802a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c001ed0 tx=0x7f0c8c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.403+0000 7f0b86604640 1 -- 172.21.15.134:0/3593260864 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c8c01a7c0 con 0x55bb2e584470 2024-04-24T02:12:21.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.403+0000 7f0b86604640 1 -- 172.21.15.134:0/3593260864 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c8c01a980 con 0x55bb2e584470 2024-04-24T02:12:21.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.403+0000 7f0c9db2f800 1 -- 172.21.15.134:0/3593260864 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bb2e57ec20 con 0x55bb2e584470 2024-04-24T02:12:21.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.403+0000 7f0b86604640 1 -- 172.21.15.134:0/3593260864 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c8c01aca0 con 0x55bb2e584470 2024-04-24T02:12:21.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.403+0000 7f0c9db2f800 1 -- 172.21.15.134:0/3593260864 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb2e57f140 con 0x55bb2e584470 2024-04-24T02:12:21.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.404+0000 7f0b86604640 1 -- 172.21.15.134:0/3593260864 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0c8c017070 con 0x55bb2e584470 2024-04-24T02:12:21.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.404+0000 7f0b86604640 1 --2- 172.21.15.134:0/3593260864 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0b80036900 0x7f0b80038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.404+0000 7f0b86604640 1 -- 172.21.15.134:0/3593260864 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f0c8c015020 con 0x55bb2e584470 2024-04-24T02:12:21.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.404+0000 7f0c93fff640 1 --2- 172.21.15.134:0/3593260864 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0b80036900 0x7f0b80038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.404+0000 7f0c9db2f800 1 --2- 172.21.15.134:0/3593260864 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55bb2e680270 0x55bb2e682660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.405+0000 7f0c9db2f800 1 -- 172.21.15.134:0/3593260864 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e682c40 con 0x55bb2e680270 2024-04-24T02:12:21.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.405+0000 7f0c9a0c6640 1 --2- 172.21.15.134:0/3593260864 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55bb2e680270 0x55bb2e682660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.405+0000 7f0c93fff640 1 --2- 172.21.15.134:0/3593260864 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0b80036900 0x7f0b80038dc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0c84054000 tx=0x7f0c8404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.405+0000 7f0c9a0c6640 1 --2- 172.21.15.134:0/3593260864 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55bb2e680270 0x55bb2e682660 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.405+0000 7f0c9a0c6640 1 -- 172.21.15.134:0/3593260864 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c9400a4a0 con 0x55bb2e680270 2024-04-24T02:12:21.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.405+0000 7f0c9db2f800 1 -- 172.21.15.134:0/3593260864 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e683520 con 0x55bb2e680270 2024-04-24T02:12:21.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.405+0000 7f0c9a0c6640 1 -- 172.21.15.134:0/3593260864 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0c9400a4a0 con 0x55bb2e680270 2024-04-24T02:12:21.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.406+0000 7f0c9db2f800 1 -- 172.21.15.134:0/3593260864 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e684910 con 0x55bb2e680270 2024-04-24T02:12:21.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.406+0000 7f0c9a0c6640 1 -- 172.21.15.134:0/3593260864 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0c9400a4a0 con 0x55bb2e680270 2024-04-24T02:12:21.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.406+0000 7f0c9db2f800 1 -- 172.21.15.134:0/3593260864 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e683d70 con 0x55bb2e680270 2024-04-24T02:12:21.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.406+0000 7f0c9a0c6640 1 -- 172.21.15.134:0/3593260864 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0c9400a4a0 con 0x55bb2e680270 2024-04-24T02:12:21.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.406+0000 7f0c9db2f800 1 -- 172.21.15.134:0/3593260864 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e684150 con 0x55bb2e680270 2024-04-24T02:12:21.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.406+0000 7f0c9a0c6640 1 -- 172.21.15.134:0/3593260864 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0c9400a4a0 con 0x55bb2e680270 2024-04-24T02:12:21.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.407+0000 7f0c9db2f800 1 Processor -- start 2024-04-24T02:12:21.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.407+0000 7f0c9db2f800 1 -- start start 2024-04-24T02:12:21.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.407+0000 7f0c9db2f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb2e693a40 0x55bb2e693e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.407+0000 7f0c9db2f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55bb2e5807e0 con 0x55bb2e693a40 2024-04-24T02:12:21.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.407+0000 7f0c93fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb2e693a40 0x55bb2e693e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.407+0000 7f0c93fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb2e693a40 0x55bb2e693e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45406/0 (socket says 172.21.15.134:45406) 2024-04-24T02:12:21.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.407+0000 7f0c93fff640 1 -- 172.21.15.134:0/2611861065 learned_addr learned my addr 172.21.15.134:0/2611861065 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:21.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.408+0000 7f0c93fff640 1 -- 172.21.15.134:0/2611861065 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb2e6943a0 con 0x55bb2e693a40 2024-04-24T02:12:21.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.408+0000 7f0c93fff640 1 --2- 172.21.15.134:0/2611861065 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb2e693a40 0x55bb2e693e60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0c84000c00 tx=0x7f0c84002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.408+0000 7f0b7f7fe640 1 -- 172.21.15.134:0/2611861065 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c84057040 con 0x55bb2e693a40 2024-04-24T02:12:21.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.408+0000 7f0b7f7fe640 1 -- 172.21.15.134:0/2611861065 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c8405d650 con 0x55bb2e693a40 2024-04-24T02:12:21.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.408+0000 7f0b7f7fe640 1 -- 172.21.15.134:0/2611861065 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c8405d930 con 0x55bb2e693a40 2024-04-24T02:12:21.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.408+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2611861065 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bb2e694e10 con 0x55bb2e693a40 2024-04-24T02:12:21.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.408+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2611861065 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb2e6952b0 con 0x55bb2e693a40 2024-04-24T02:12:21.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.409+0000 7f0b7f7fe640 1 -- 172.21.15.134:0/2611861065 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0c84067070 con 0x55bb2e693a40 2024-04-24T02:12:21.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.409+0000 7f0b7f7fe640 1 --2- 172.21.15.134:0/2611861065 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0b74036950 0x7f0b74038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.409+0000 7f0b7f7fe640 1 -- 172.21.15.134:0/2611861065 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f0c8408f580 con 0x55bb2e693a40 2024-04-24T02:12:21.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.409+0000 7f0c9a0c6640 1 --2- 172.21.15.134:0/2611861065 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0b74036950 0x7f0b74038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.409+0000 7f0c9db2f800 1 Processor -- start 2024-04-24T02:12:21.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.409+0000 7f0c9a0c6640 1 --2- 172.21.15.134:0/2611861065 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0b74036950 0x7f0b74038e10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x55bb2e57f780 tx=0x7f0c94005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.409+0000 7f0c9db2f800 1 -- start start 2024-04-24T02:12:21.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.409+0000 7f0c9db2f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb2e6a0c80 0x55bb2e6a10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.409+0000 7f0c9db2f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55bb2e4716b0 con 0x55bb2e6a0c80 2024-04-24T02:12:21.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.410+0000 7f0c93fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb2e6a0c80 0x55bb2e6a10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.410+0000 7f0c93fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb2e6a0c80 0x55bb2e6a10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45410/0 (socket says 172.21.15.134:45410) 2024-04-24T02:12:21.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.410+0000 7f0c93fff640 1 -- 172.21.15.134:0/2226461621 learned_addr learned my addr 172.21.15.134:0/2226461621 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:21.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.410+0000 7f0c93fff640 1 -- 172.21.15.134:0/2226461621 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb2e6a1670 con 0x55bb2e6a0c80 2024-04-24T02:12:21.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.410+0000 7f0c93fff640 1 --2- 172.21.15.134:0/2226461621 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb2e6a0c80 0x55bb2e6a10a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0c8408db50 tx=0x7f0c84067cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b816e972f01dc29 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.410+0000 7f0b7d7fa640 1 -- 172.21.15.134:0/2226461621 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c84067360 con 0x55bb2e6a0c80 2024-04-24T02:12:21.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.410+0000 7f0b7d7fa640 1 -- 172.21.15.134:0/2226461621 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c8405dcb0 con 0x55bb2e6a0c80 2024-04-24T02:12:21.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.410+0000 7f0b7d7fa640 1 -- 172.21.15.134:0/2226461621 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c84067500 con 0x55bb2e6a0c80 2024-04-24T02:12:21.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.411+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2226461621 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb2e6a0c80 msgr2=0x55bb2e6a10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.411+0000 7f0c9db2f800 1 --2- 172.21.15.134:0/2226461621 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb2e6a0c80 0x55bb2e6a10a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0c8408db50 tx=0x7f0c84067cf0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.411+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2226461621 shutdown_connections 2024-04-24T02:12:21.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.411+0000 7f0c9db2f800 1 --2- 172.21.15.134:0/2226461621 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb2e6a0c80 0x55bb2e6a10a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.411+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2226461621 >> 172.21.15.134:0/2226461621 conn(0x55bb2e69cfe0 msgr2=0x55bb2e69b040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:21.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.411+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2226461621 shutdown_connections 2024-04-24T02:12:21.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.411+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2226461621 wait complete. 2024-04-24T02:12:21.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.411+0000 7f0c9db2f800 1 Processor -- start 2024-04-24T02:12:21.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.411+0000 7f0c9db2f800 1 -- start start 2024-04-24T02:12:21.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.411+0000 7f0c9db2f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb2e6a0c80 0x55bb2e6a8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.411+0000 7f0c9db2f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55bb2e6a1c60 con 0x55bb2e6a0c80 2024-04-24T02:12:21.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.411+0000 7f0c93fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb2e6a0c80 0x55bb2e6a8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.411+0000 7f0c93fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb2e6a0c80 0x55bb2e6a8180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45426/0 (socket says 172.21.15.134:45426) 2024-04-24T02:12:21.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.411+0000 7f0c93fff640 1 -- 172.21.15.134:0/2218096277 learned_addr learned my addr 172.21.15.134:0/2218096277 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:21.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.412+0000 7f0c93fff640 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb2e6a86c0 con 0x55bb2e6a0c80 2024-04-24T02:12:21.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.412+0000 7f0c93fff640 1 --2- 172.21.15.134:0/2218096277 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb2e6a0c80 0x55bb2e6a8180 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0c84006540 tx=0x7f0c8408dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.412+0000 7f0b6b7fe640 1 -- 172.21.15.134:0/2218096277 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c8405de60 con 0x55bb2e6a0c80 2024-04-24T02:12:21.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.412+0000 7f0b6b7fe640 1 -- 172.21.15.134:0/2218096277 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c84093030 con 0x55bb2e6a0c80 2024-04-24T02:12:21.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.412+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bb2e6a8950 con 0x55bb2e6a0c80 2024-04-24T02:12:21.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.412+0000 7f0b6b7fe640 1 -- 172.21.15.134:0/2218096277 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c8408f8a0 con 0x55bb2e6a0c80 2024-04-24T02:12:21.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.412+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb2e6ab600 con 0x55bb2e6a0c80 2024-04-24T02:12:21.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.413+0000 7f0b6b7fe640 1 -- 172.21.15.134:0/2218096277 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0c8408fa40 con 0x55bb2e6a0c80 2024-04-24T02:12:21.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.413+0000 7f0b6b7fe640 1 --2- 172.21.15.134:0/2218096277 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0b64036900 0x7f0b64038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.413+0000 7f0b6b7fe640 1 -- 172.21.15.134:0/2218096277 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f0c84099ad0 con 0x55bb2e6a0c80 2024-04-24T02:12:21.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.413+0000 7f0c9a0c6640 1 --2- 172.21.15.134:0/2218096277 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0b64036900 0x7f0b64038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.413+0000 7f0c9db2f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.413+0000 7f0c9db2f800 1 --2- 172.21.15.134:0/2218096277 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55bb2e6b3bb0 0x55bb2e6b6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.413+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6b67c0 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.413+0000 7f0c998c5640 1 --2- 172.21.15.134:0/2218096277 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55bb2e6b3bb0 0x55bb2e6b6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.413+0000 7f0c9a0c6640 1 --2- 172.21.15.134:0/2218096277 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0b64036900 0x7f0b64038dc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x55bb2e57f750 tx=0x7f0c9401f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.413+0000 7f0c998c5640 1 --2- 172.21.15.134:0/2218096277 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55bb2e6b3bb0 0x55bb2e6b6070 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.414+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c8c02e070 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.414+0000 7f0c9db2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:21.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.414+0000 7f0c9db2f800 20 realm 2024-04-24T02:12:21.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.414+0000 7f0c9db2f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.414+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6b6bd0 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.414+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c8c02e070 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.414+0000 7f0c9db2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:21.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.414+0000 7f0c9db2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:21.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.414+0000 7f0c9db2f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.414+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6b7470 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.414+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c8c02e070 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.414+0000 7f0c9db2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:21.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.414+0000 7f0c9db2f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.414+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6b7810 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.414+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0c8c02e070 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.414+0000 7f0c9db2f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:21.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.414+0000 7f0c9db2f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.414+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6b70c0 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.415+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0c8c02e070 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.415+0000 7f0c9db2f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:21.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.415+0000 7f0c9db2f800 20 searching for the correct realm 2024-04-24T02:12:21.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.415+0000 7f0c9db2f800 1 --2- 172.21.15.134:0/2218096277 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55bb2e6b9cb0 0x55bb2e6bc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.415+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6bc7d0 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.415+0000 7f0c93fff640 1 --2- 172.21.15.134:0/2218096277 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55bb2e6b9cb0 0x55bb2e6bc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.415+0000 7f0c93fff640 1 --2- 172.21.15.134:0/2218096277 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55bb2e6b9cb0 0x55bb2e6bc100 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.415+0000 7f0c93fff640 1 -- 172.21.15.134:0/2218096277 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8409f070 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.415+0000 7f0c93fff640 1 --2- 172.21.15.134:0/2218096277 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f0c84086050 0x7f0c84007900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.415+0000 7f0c93fff640 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6bc7d0 con 0x7f0c84086050 2024-04-24T02:12:21.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.416+0000 7f0c9a0c6640 1 --2- 172.21.15.134:0/2218096277 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f0c84086050 0x7f0c84007900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.416+0000 7f0c9a0c6640 1 --2- 172.21.15.134:0/2218096277 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f0c84086050 0x7f0c84007900 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.416+0000 7f0c9a0c6640 1 -- 172.21.15.134:0/2218096277 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c9401f070 con 0x7f0c84086050 2024-04-24T02:12:21.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.416+0000 7f0c9a0c6640 1 --2- 172.21.15.134:0/2218096277 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f0c94031040 0x7f0c94032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.416+0000 7f0c9a0c6640 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6bc7d0 con 0x7f0c94031040 2024-04-24T02:12:21.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.416+0000 7f0c998c5640 1 --2- 172.21.15.134:0/2218096277 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f0c94031040 0x7f0c94032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.417+0000 7f0c998c5640 1 --2- 172.21.15.134:0/2218096277 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f0c94031040 0x7f0c94032940 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.417+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8c02e070 con 0x7f0c94031040 2024-04-24T02:12:21.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.417+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6bc7d0 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.417+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8c02e070 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.417+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6bc7d0 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.417+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0c8c02e070 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.417+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6bc7d0 con 0x7f0c94031040 2024-04-24T02:12:21.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.418+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8c02e070 con 0x7f0c94031040 2024-04-24T02:12:21.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.418+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6bc7d0 con 0x7f0c94031040 2024-04-24T02:12:21.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.418+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8c02e070 con 0x7f0c94031040 2024-04-24T02:12:21.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.418+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6bc7d0 con 0x7f0c84086050 2024-04-24T02:12:21.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.418+0000 7f0c9a0c6640 1 -- 172.21.15.134:0/2218096277 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c9401f070 con 0x7f0c84086050 2024-04-24T02:12:21.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.418+0000 7f0c9a0c6640 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6bc7d0 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.418+0000 7f0c93fff640 1 -- 172.21.15.134:0/2218096277 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8409f070 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.418+0000 7f0c93fff640 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6bc7d0 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.419+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8c02e070 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.419+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6bc7d0 con 0x7f0c94031040 2024-04-24T02:12:21.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.419+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8c02e070 con 0x7f0c94031040 2024-04-24T02:12:21.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.419+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6bc7d0 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.419+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8c02e070 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.419+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6bc7d0 con 0x7f0c84086050 2024-04-24T02:12:21.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.419+0000 7f0c9a0c6640 1 -- 172.21.15.134:0/2218096277 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0c9401f070 con 0x7f0c84086050 2024-04-24T02:12:21.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.419+0000 7f0c9a0c6640 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6bc7d0 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.420+0000 7f0c93fff640 1 -- 172.21.15.134:0/2218096277 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8409f070 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.420+0000 7f0c93fff640 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6bc7d0 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.420+0000 7f0c93fff640 1 -- 172.21.15.134:0/2218096277 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8409f070 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.420+0000 7f0c93fff640 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6bc7d0 con 0x7f0c94031040 2024-04-24T02:12:21.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.420+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8c02e070 con 0x7f0c94031040 2024-04-24T02:12:21.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.420+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6bc7d0 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.420+0000 7f0c93fff640 1 -- 172.21.15.134:0/2218096277 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8409f070 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.420+0000 7f0c93fff640 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6bc7d0 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.421+0000 7f0c93fff640 1 -- 172.21.15.134:0/2218096277 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8409f070 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.421+0000 7f0c93fff640 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6bc7d0 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.421+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8c02e070 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.421+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6bc7d0 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.421+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f0c8c02e070 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.421+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f0c8c057090 con 0x7f0c94031040 2024-04-24T02:12:21.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.421+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8c02e070 con 0x7f0c94031040 2024-04-24T02:12:21.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.421+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f0c8c057090 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.422+0000 7f0c93fff640 1 -- 172.21.15.134:0/2218096277 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8409f070 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.422+0000 7f0c93fff640 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f0c8c057090 con 0x7f0c84086050 2024-04-24T02:12:21.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.422+0000 7f0c9a0c6640 1 -- 172.21.15.134:0/2218096277 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c9401f070 con 0x7f0c84086050 2024-04-24T02:12:21.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.422+0000 7f0c9a0c6640 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f0c8c057090 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.422+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8c02e070 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.422+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f0c8c057090 con 0x7f0c94031040 2024-04-24T02:12:21.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.422+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8c02e070 con 0x7f0c94031040 2024-04-24T02:12:21.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.422+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f0c8c057090 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.423+0000 7f0c93fff640 1 -- 172.21.15.134:0/2218096277 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8409f070 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.423+0000 7f0c93fff640 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f0c8c057090 con 0x7f0c94031040 2024-04-24T02:12:21.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.423+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8c02e070 con 0x7f0c94031040 2024-04-24T02:12:21.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.423+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f0c8c057090 con 0x7f0c84086050 2024-04-24T02:12:21.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.423+0000 7f0c9a0c6640 1 -- 172.21.15.134:0/2218096277 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c9401f070 con 0x7f0c84086050 2024-04-24T02:12:21.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.423+0000 7f0c9a0c6640 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f0c8c057090 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.423+0000 7f0c93fff640 1 -- 172.21.15.134:0/2218096277 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8409f070 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.423+0000 7f0c93fff640 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f0c8c057090 con 0x7f0c94031040 2024-04-24T02:12:21.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.424+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8c02e070 con 0x7f0c94031040 2024-04-24T02:12:21.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.424+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f0c8c057090 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.424+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0c8c02e070 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.424+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f0c8c057090 con 0x7f0c84086050 2024-04-24T02:12:21.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.424+0000 7f0c9a0c6640 1 -- 172.21.15.134:0/2218096277 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c9401f070 con 0x7f0c84086050 2024-04-24T02:12:21.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.424+0000 7f0c9db2f800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:21.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.424+0000 7f0c9db2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:21.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.424+0000 7f0c9db2f800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:21.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.424+0000 7f0c9db2f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:21.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.424+0000 7f0c9db2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:21.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.424+0000 7f0c9db2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:21.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.424+0000 7f0c9db2f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.424+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6b8700 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.424+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c8c02e070 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.424+0000 7f0c9db2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:21.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.424+0000 7f0c9db2f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.424+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6b8fa0 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.424+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0c8c02e070 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.424+0000 7f0c9db2f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:21.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.424+0000 7f0c9db2f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.424+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6b8340 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.425+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0c8c02e070 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.425+0000 7f0c9db2f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:21.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.425+0000 7f0c9db2f800 20 zone default found 2024-04-24T02:12:21.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.425+0000 7f0c9db2f800 4 Realm: () 2024-04-24T02:12:21.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.425+0000 7f0c9db2f800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:21.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.425+0000 7f0c9db2f800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:21.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.425+0000 7f0c9db2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:21.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.425+0000 7f0c9db2f800 20 zonegroup default 2024-04-24T02:12:21.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.425+0000 7f0c9db2f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.425+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6bcc50 con 0x7f0c94031040 2024-04-24T02:12:21.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.425+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0c8c02e070 con 0x7f0c94031040 2024-04-24T02:12:21.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.425+0000 7f0c9db2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:21.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.425+0000 7f0c9db2f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.425+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6beae0 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.425+0000 7f0c93fff640 1 -- 172.21.15.134:0/2218096277 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0c8409f070 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.425+0000 7f0c9db2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:21.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.425+0000 7f0c9db2f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.425+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6bee80 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.426+0000 7f0c93fff640 1 -- 172.21.15.134:0/2218096277 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0c8409f070 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.426+0000 7f0c9db2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:21.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.426+0000 7f0c9db2f800 20 started sync module instance, tier type = 2024-04-24T02:12:21.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.426+0000 7f0c9db2f800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:21.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.426+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6bdf20 con 0x7f0c84086050 2024-04-24T02:12:21.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.427+0000 7f0c9a0c6640 1 -- 172.21.15.134:0/2218096277 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c94040040 con 0x7f0c84086050 2024-04-24T02:12:21.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.427+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94262426067776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6bdb80 con 0x7f0c84086050 2024-04-24T02:12:21.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.427+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6bfb80 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.429+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c8c02e070 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.429+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94262426072784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6bfb30 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.429+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6c0b50 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.429+0000 7f0c9a0c6640 1 -- 172.21.15.134:0/2218096277 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94262426067776] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c94040040 con 0x7f0c84086050 2024-04-24T02:12:21.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.432+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94262426072784] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c8c02e070 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.432+0000 7f0c93fff640 1 -- 172.21.15.134:0/2218096277 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c8409f070 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.432+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94262426074992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6bf220 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.432+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6c13f0 con 0x7f0c84086050 2024-04-24T02:12:21.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.435+0000 7f0c93fff640 1 -- 172.21.15.134:0/2218096277 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94262426074992] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c8409f070 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.435+0000 7f0c9a0c6640 1 -- 172.21.15.134:0/2218096277 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c94040040 con 0x7f0c84086050 2024-04-24T02:12:21.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.435+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94262426079040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6c1360 con 0x7f0c84086050 2024-04-24T02:12:21.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.435+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6c22b0 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.436+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c8c02e070 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.436+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94262426082816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6c26d0 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.436+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6c3170 con 0x7f0c94031040 2024-04-24T02:12:21.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.436+0000 7f0c9a0c6640 1 -- 172.21.15.134:0/2218096277 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94262426079040] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c94040040 con 0x7f0c84086050 2024-04-24T02:12:21.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.437+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c8c02e070 con 0x7f0c94031040 2024-04-24T02:12:21.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.437+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94262426086464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6c3130 con 0x7f0c94031040 2024-04-24T02:12:21.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.437+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6c3ba0 con 0x7f0c94031040 2024-04-24T02:12:21.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.437+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94262426082816] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c8c02e070 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.438+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94262426086464] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c8c02e070 con 0x7f0c94031040 2024-04-24T02:12:21.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.438+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(56 notify.6 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c8c02e070 con 0x7f0c94031040 2024-04-24T02:12:21.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.438+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94262426081248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6c2220 con 0x7f0c94031040 2024-04-24T02:12:21.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.438+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6c4050 con 0x7f0c94031040 2024-04-24T02:12:21.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.439+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94262426081248] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c8c02e070 con 0x7f0c94031040 2024-04-24T02:12:21.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.439+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(58 notify.7 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c8c02e070 con 0x7f0c94031040 2024-04-24T02:12:21.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.439+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94262426089168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6c4050 con 0x7f0c94031040 2024-04-24T02:12:21.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.439+0000 7f0c9db2f800 20 add_watcher() i=0 2024-04-24T02:12:21.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.439+0000 7f0c9db2f800 20 add_watcher() i=1 2024-04-24T02:12:21.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.439+0000 7f0c9db2f800 20 add_watcher() i=2 2024-04-24T02:12:21.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.439+0000 7f0c9db2f800 20 add_watcher() i=3 2024-04-24T02:12:21.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.439+0000 7f0c9db2f800 20 add_watcher() i=4 2024-04-24T02:12:21.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.439+0000 7f0c9db2f800 20 add_watcher() i=5 2024-04-24T02:12:21.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.439+0000 7f0c9db2f800 20 add_watcher() i=6 2024-04-24T02:12:21.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.440+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94262426089168] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c8c02e070 con 0x7f0c94031040 2024-04-24T02:12:21.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.440+0000 7f0c9db2f800 20 add_watcher() i=7 2024-04-24T02:12:21.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.440+0000 7f0c9db2f800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:21.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.440+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6c73a0 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.440+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0c8c02e070 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.440+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94262426103216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6c41c0 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.441+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94262426103216] v30'52 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0c8c02e070 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.441+0000 7f0b4b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:21.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.441+0000 7f0c9db2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:21.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.441+0000 7f0c9db2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:21.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.441+0000 7f0c9db2f800 5 note: GC not initialized 2024-04-24T02:12:21.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.441+0000 7f0b4a7fc640 20 reqs_thread_entry: start 2024-04-24T02:12:21.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.442+0000 7f0c9db2f800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:21.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.442+0000 7f0c9db2f800 20 Filter name: none 2024-04-24T02:12:21.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.442+0000 7f0abbfff640 20 reqs_thread_entry: start 2024-04-24T02:12:21.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.442+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6facf0 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.442+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0c8c02e070 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.442+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6facf0 con 0x7f0c84086050 2024-04-24T02:12:21.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.442+0000 7f0c9a0c6640 1 -- 172.21.15.134:0/2218096277 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0c94040040 con 0x7f0c84086050 2024-04-24T02:12:21.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.442+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6facf0 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.442+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0c8c02e070 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.442+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6facb0 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.443+0000 7f0c93fff640 1 -- 172.21.15.134:0/2218096277 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0c8409f070 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.443+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6fb230 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.443+0000 7f0c93fff640 1 -- 172.21.15.134:0/2218096277 <== osd.3 v2:172.21.15.134:6801/3585115521 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0c8409f070 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.443+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6fb640 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.443+0000 7f0c93fff640 1 -- 172.21.15.134:0/2218096277 <== osd.3 v2:172.21.15.134:6801/3585115521 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0c8409f070 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.443+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6fb640 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.443+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0c8c02e070 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.443+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6fb640 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.443+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0c8c02e070 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.443+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6fb640 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.444+0000 7f0c93fff640 1 -- 172.21.15.134:0/2218096277 <== osd.3 v2:172.21.15.134:6801/3585115521 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0c8409f070 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.444+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6fb5f0 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.444+0000 7f0c93fff640 1 -- 172.21.15.134:0/2218096277 <== osd.3 v2:172.21.15.134:6801/3585115521 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0c8409f070 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.444+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6fb610 con 0x7f0c94031040 2024-04-24T02:12:21.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.444+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0c8c02e070 con 0x7f0c94031040 2024-04-24T02:12:21.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.444+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6fb5d0 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.444+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0c8c02e070 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.444+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6fb5d0 con 0x7f0c84086050 2024-04-24T02:12:21.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.445+0000 7f0c9a0c6640 1 -- 172.21.15.134:0/2218096277 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0c94040040 con 0x7f0c84086050 2024-04-24T02:12:21.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.445+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6fb5d0 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.445+0000 7f0c93fff640 1 -- 172.21.15.134:0/2218096277 <== osd.3 v2:172.21.15.134:6801/3585115521 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0c8409f070 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.445+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6fb5d0 con 0x7f0c94031040 2024-04-24T02:12:21.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.445+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0c8c02e070 con 0x7f0c94031040 2024-04-24T02:12:21.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.445+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6fb5d0 con 0x7f0c94031040 2024-04-24T02:12:21.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.446+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0c8c02e070 con 0x7f0c94031040 2024-04-24T02:12:21.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.446+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6fb5d0 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.446+0000 7f0c93fff640 1 -- 172.21.15.134:0/2218096277 <== osd.3 v2:172.21.15.134:6801/3585115521 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0c8409f070 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.446+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6fb5d0 con 0x7f0c94031040 2024-04-24T02:12:21.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.446+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.0 v2:172.21.15.104:6800/2419146313 20 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0c8c02e070 con 0x7f0c94031040 2024-04-24T02:12:21.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.446+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6fb5d0 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.446+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0c8c02e070 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.446+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6fb5d0 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.446+0000 7f0c93fff640 1 -- 172.21.15.134:0/2218096277 <== osd.3 v2:172.21.15.134:6801/3585115521 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0c8409f070 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.446+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6fb5d0 con 0x7f0c94031040 2024-04-24T02:12:21.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.447+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.0 v2:172.21.15.104:6800/2419146313 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0c8c02e070 con 0x7f0c94031040 2024-04-24T02:12:21.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.447+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6fb5d0 con 0x7f0c84086050 2024-04-24T02:12:21.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.447+0000 7f0c9a0c6640 1 -- 172.21.15.134:0/2218096277 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0c94040040 con 0x7f0c84086050 2024-04-24T02:12:21.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.447+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6fb5d0 con 0x7f0c94031040 2024-04-24T02:12:21.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.448+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.0 v2:172.21.15.104:6800/2419146313 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0c8c02e070 con 0x7f0c94031040 2024-04-24T02:12:21.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.448+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6fb5d0 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.448+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0c8c02e070 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.448+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6fb5d0 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.448+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.1 v2:172.21.15.134:6804/1487076214 30 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0c8c02e070 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.448+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6fb5d0 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.448+0000 7f0c93fff640 1 -- 172.21.15.134:0/2218096277 <== osd.3 v2:172.21.15.134:6801/3585115521 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0c8409f070 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.448+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6fb5d0 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.448+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.1 v2:172.21.15.134:6804/1487076214 31 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0c8c02e070 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.448+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6fb5d0 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.449+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.1 v2:172.21.15.134:6804/1487076214 32 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0c8c02e070 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.449+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6fb5d0 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.449+0000 7f0c93fff640 1 -- 172.21.15.134:0/2218096277 <== osd.3 v2:172.21.15.134:6801/3585115521 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0c8409f070 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.449+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6fb5d0 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.449+0000 7f0c93fff640 1 -- 172.21.15.134:0/2218096277 <== osd.3 v2:172.21.15.134:6801/3585115521 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0c8409f070 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.449+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6fb5d0 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.449+0000 7f0c93fff640 1 -- 172.21.15.134:0/2218096277 <== osd.3 v2:172.21.15.134:6801/3585115521 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0c8409f070 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.449+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6fb5d0 con 0x7f0c94031040 2024-04-24T02:12:21.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.449+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.0 v2:172.21.15.104:6800/2419146313 23 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0c8c02e070 con 0x7f0c94031040 2024-04-24T02:12:21.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.450+0000 7f0b4b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:21.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.450+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94262426103216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6fb5d0 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.451+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.1 v2:172.21.15.134:6804/1487076214 33 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94262426103216] v30'53 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0c8c02e070 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.451+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94262426067776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6fb5d0 con 0x7f0c84086050 2024-04-24T02:12:21.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.452+0000 7f0c9a0c6640 1 -- 172.21.15.134:0/2218096277 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94262426067776] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c94040040 con 0x7f0c84086050 2024-04-24T02:12:21.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.452+0000 7f0c9db2f800 20 remove_watcher() i=0 2024-04-24T02:12:21.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.452+0000 7f0c9db2f800 2 removed watcher, disabling cache 2024-04-24T02:12:21.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.452+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94262426072784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6fb5d0 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.453+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.1 v2:172.21.15.134:6804/1487076214 34 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94262426072784] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c8c02e070 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.453+0000 7f0c9db2f800 20 remove_watcher() i=1 2024-04-24T02:12:21.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.453+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94262426074992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6fb5d0 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.455+0000 7f0c93fff640 1 -- 172.21.15.134:0/2218096277 <== osd.3 v2:172.21.15.134:6801/3585115521 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94262426074992] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c8409f070 con 0x55bb2e6b9cb0 2024-04-24T02:12:21.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.455+0000 7f0c9db2f800 20 remove_watcher() i=2 2024-04-24T02:12:21.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.455+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94262426079040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6fb5d0 con 0x7f0c84086050 2024-04-24T02:12:21.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.456+0000 7f0c9a0c6640 1 -- 172.21.15.134:0/2218096277 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94262426079040] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c94040040 con 0x7f0c84086050 2024-04-24T02:12:21.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.456+0000 7f0c9db2f800 20 remove_watcher() i=3 2024-04-24T02:12:21.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.456+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94262426082816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6fb5d0 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.457+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.1 v2:172.21.15.134:6804/1487076214 35 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94262426082816] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c8c02e070 con 0x55bb2e6b3bb0 2024-04-24T02:12:21.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.457+0000 7f0c9db2f800 20 remove_watcher() i=4 2024-04-24T02:12:21.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.457+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94262426086464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6fb5d0 con 0x7f0c94031040 2024-04-24T02:12:21.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.458+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.0 v2:172.21.15.104:6800/2419146313 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94262426086464] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c8c02e070 con 0x7f0c94031040 2024-04-24T02:12:21.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.458+0000 7f0c9db2f800 20 remove_watcher() i=5 2024-04-24T02:12:21.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.458+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94262426081248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6fb5d0 con 0x7f0c94031040 2024-04-24T02:12:21.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.459+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.0 v2:172.21.15.104:6800/2419146313 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94262426081248] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c8c02e070 con 0x7f0c94031040 2024-04-24T02:12:21.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.459+0000 7f0c9db2f800 20 remove_watcher() i=6 2024-04-24T02:12:21.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.459+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94262426089168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb2e6fb5d0 con 0x7f0c94031040 2024-04-24T02:12:21.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.460+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 <== osd.0 v2:172.21.15.104:6800/2419146313 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94262426089168] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c8c02e070 con 0x7f0c94031040 2024-04-24T02:12:21.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.460+0000 7f0c9db2f800 20 remove_watcher() i=7 2024-04-24T02:12:21.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.460+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f0c94031040 msgr2=0x7f0c94032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.460+0000 7f0c9db2f800 1 --2- 172.21.15.134:0/2218096277 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f0c94031040 0x7f0c94032940 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.460+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55bb2e6b3bb0 msgr2=0x55bb2e6b6070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.460+0000 7f0c9db2f800 1 --2- 172.21.15.134:0/2218096277 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55bb2e6b3bb0 0x55bb2e6b6070 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.460+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f0c84086050 msgr2=0x7f0c84007900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.460+0000 7f0c9db2f800 1 --2- 172.21.15.134:0/2218096277 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f0c84086050 0x7f0c84007900 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.460+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55bb2e6b9cb0 msgr2=0x55bb2e6bc100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.460+0000 7f0c9db2f800 1 --2- 172.21.15.134:0/2218096277 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55bb2e6b9cb0 0x55bb2e6bc100 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.460+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0b64036900 msgr2=0x7f0b64038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.460+0000 7f0c9db2f800 1 --2- 172.21.15.134:0/2218096277 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0b64036900 0x7f0b64038dc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x55bb2e57f750 tx=0x7f0c9401f000 comp rx=0 tx=0).stop 2024-04-24T02:12:21.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.460+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb2e6a0c80 msgr2=0x55bb2e6a8180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.460+0000 7f0c9db2f800 1 --2- 172.21.15.134:0/2218096277 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb2e6a0c80 0x55bb2e6a8180 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0c84006540 tx=0x7f0c8408dab0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.460+0000 7f0c998c5640 1 -- 172.21.15.134:0/2218096277 reap_dead start 2024-04-24T02:12:21.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.460+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 shutdown_connections 2024-04-24T02:12:21.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.460+0000 7f0c9db2f800 1 --2- 172.21.15.134:0/2218096277 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb2e6a0c80 0x55bb2e6a8180 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.460+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 >> 172.21.15.134:0/2218096277 conn(0x55bb2e69cfe0 msgr2=0x55bb2e69a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:21.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.460+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 shutdown_connections 2024-04-24T02:12:21.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.460+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2218096277 wait complete. 2024-04-24T02:12:21.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.461+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2611861065 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0b74036950 msgr2=0x7f0b74038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.461+0000 7f0c9db2f800 1 --2- 172.21.15.134:0/2611861065 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0b74036950 0x7f0b74038e10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x55bb2e57f780 tx=0x7f0c94005840 comp rx=0 tx=0).stop 2024-04-24T02:12:21.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.461+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2611861065 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb2e693a40 msgr2=0x55bb2e693e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.461+0000 7f0c9db2f800 1 --2- 172.21.15.134:0/2611861065 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb2e693a40 0x55bb2e693e60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0c84000c00 tx=0x7f0c84002fb0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.461+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2611861065 shutdown_connections 2024-04-24T02:12:21.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.461+0000 7f0c9db2f800 1 --2- 172.21.15.134:0/2611861065 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0b74036950 0x7f0b74038e10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.461+0000 7f0c9db2f800 1 --2- 172.21.15.134:0/2611861065 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb2e693a40 0x55bb2e693e60 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.461+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2611861065 >> 172.21.15.134:0/2611861065 conn(0x55bb2e687ae0 msgr2=0x55bb2e687ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:21.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.461+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2611861065 shutdown_connections 2024-04-24T02:12:21.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.461+0000 7f0c9db2f800 1 -- 172.21.15.134:0/2611861065 wait complete. 2024-04-24T02:12:21.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.461+0000 7f0c9db2f800 1 -- 172.21.15.134:0/3593260864 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55bb2e680270 msgr2=0x55bb2e682660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.461+0000 7f0c9db2f800 1 --2- 172.21.15.134:0/3593260864 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55bb2e680270 0x55bb2e682660 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.461+0000 7f0c9db2f800 1 -- 172.21.15.134:0/3593260864 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0b80036900 msgr2=0x7f0b80038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.461+0000 7f0c9db2f800 1 --2- 172.21.15.134:0/3593260864 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0b80036900 0x7f0b80038dc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0c84054000 tx=0x7f0c8404e000 comp rx=0 tx=0).stop 2024-04-24T02:12:21.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.461+0000 7f0c9db2f800 1 -- 172.21.15.134:0/3593260864 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb2e584470 msgr2=0x55bb2e5802a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.461+0000 7f0c9db2f800 1 --2- 172.21.15.134:0/3593260864 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb2e584470 0x55bb2e5802a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c001ed0 tx=0x7f0c8c000ed0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.461+0000 7f0c9db2f800 1 -- 172.21.15.134:0/3593260864 shutdown_connections 2024-04-24T02:12:21.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.461+0000 7f0c9db2f800 1 --2- 172.21.15.134:0/3593260864 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55bb2e680270 0x55bb2e682660 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.461+0000 7f0c9db2f800 1 --2- 172.21.15.134:0/3593260864 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0b80036900 0x7f0b80038dc0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.461+0000 7f0c9db2f800 1 --2- 172.21.15.134:0/3593260864 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb2e584470 0x55bb2e5802a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.461+0000 7f0c9db2f800 1 -- 172.21.15.134:0/3593260864 >> 172.21.15.134:0/3593260864 conn(0x55bb2e57a310 msgr2=0x55bb2e66b230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:21.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.461+0000 7f0c9db2f800 1 -- 172.21.15.134:0/3593260864 shutdown_connections 2024-04-24T02:12:21.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.461+0000 7f0c9db2f800 1 -- 172.21.15.134:0/3593260864 wait complete. 2024-04-24T02:12:21.472 INFO:teuthology.orchestra.run.smithi134.stdout:{"entries":[],"summary":[]} 2024-04-24T02:12:21.472 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-04-24T02:12:21.472 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-24T02:12:21.472 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-24T02:12:21.473 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-24T02:12:21.555 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:21.555 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:21.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.555+0000 7f3d95c98800 1 Processor -- start 2024-04-24T02:12:21.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.555+0000 7f3d95c98800 1 -- start start 2024-04-24T02:12:21.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.555+0000 7f3d95c98800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55c3fd7c3390 0x55c3fd7c37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.555+0000 7f3d95c98800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c3fd681d40 con 0x55c3fd7c3cf0 2024-04-24T02:12:21.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.555+0000 7f3d95c98800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55c3fd6544d0 con 0x55c3fd7c3390 2024-04-24T02:12:21.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.555+0000 7f3d9379e640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55c3fd7c3390 0x55c3fd7c37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.555+0000 7f3d92f9d640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55c3fd7c3cf0 0x55c3fd7ca600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:43178/0 (socket says 172.21.15.134:43178) 2024-04-24T02:12:21.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.555+0000 7f3d92f9d640 1 -- 172.21.15.134:0/108354148 learned_addr learned my addr 172.21.15.134:0/108354148 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:12:21.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.555+0000 7f3d9379e640 1 -- 172.21.15.134:0/108354148 >> v1:172.21.15.104:6789/0 conn(0x55c3fd7c3cf0 legacy=0x55c3fd7ca600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.555+0000 7f3d9279c640 1 -- 172.21.15.134:0/108354148 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2389107577 0 0) 0x55c3fd681d40 con 0x55c3fd7c3cf0 2024-04-24T02:12:21.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.555+0000 7f3d9379e640 1 -- 172.21.15.134:0/108354148 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3fd680590 con 0x55c3fd7c3390 2024-04-24T02:12:21.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.557+0000 7f3d9379e640 1 --2- 172.21.15.134:0/108354148 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3fd7c3390 0x55c3fd7c37b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3d8400a470 tx=0x7f3d8401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f263e976b15cea85 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.557+0000 7f3d9279c640 1 -- 172.21.15.134:0/108354148 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d84057070 con 0x55c3fd7c3390 2024-04-24T02:12:21.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.557+0000 7f3d9279c640 1 -- 172.21.15.134:0/108354148 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d84052570 con 0x55c3fd7c3390 2024-04-24T02:12:21.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.557+0000 7f3d9279c640 1 -- 172.21.15.134:0/108354148 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d84052870 con 0x55c3fd7c3390 2024-04-24T02:12:21.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.558+0000 7f3d95c98800 1 -- 172.21.15.134:0/108354148 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3fd7c3390 msgr2=0x55c3fd7c37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.558+0000 7f3d95c98800 1 --2- 172.21.15.134:0/108354148 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3fd7c3390 0x55c3fd7c37b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3d8400a470 tx=0x7f3d8401ce90 comp rx=0 tx=0).stop 2024-04-24T02:12:21.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.558+0000 7f3d95c98800 1 -- 172.21.15.134:0/108354148 shutdown_connections 2024-04-24T02:12:21.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.558+0000 7f3d95c98800 1 --2- 172.21.15.134:0/108354148 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3fd7c3390 0x55c3fd7c37b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.558+0000 7f3d95c98800 1 -- 172.21.15.134:0/108354148 >> 172.21.15.134:0/108354148 conn(0x55c3fd7bcb00 msgr2=0x55c3fd7bef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:21.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.558+0000 7f3d95c98800 1 -- 172.21.15.134:0/108354148 shutdown_connections 2024-04-24T02:12:21.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.558+0000 7f3d95c98800 1 -- 172.21.15.134:0/108354148 wait complete. 2024-04-24T02:12:21.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.569+0000 7f3d95c98800 1 Processor -- start 2024-04-24T02:12:21.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.570+0000 7f3d95c98800 1 -- start start 2024-04-24T02:12:21.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.570+0000 7f3d95c98800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3fd7c3390 0x55c3fd8b6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.570+0000 7f3d95c98800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c3fd70e3c0 con 0x55c3fd7c3390 2024-04-24T02:12:21.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.570+0000 7f3d9379e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3fd7c3390 0x55c3fd8b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.570+0000 7f3d9379e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3fd7c3390 0x55c3fd8b6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45448/0 (socket says 172.21.15.134:45448) 2024-04-24T02:12:21.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.570+0000 7f3d9379e640 1 -- 172.21.15.134:0/2384266097 learned_addr learned my addr 172.21.15.134:0/2384266097 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:21.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.570+0000 7f3d9379e640 1 -- 172.21.15.134:0/2384266097 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3fd8b6600 con 0x55c3fd7c3390 2024-04-24T02:12:21.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.571+0000 7f3d9379e640 1 --2- 172.21.15.134:0/2384266097 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3fd7c3390 0x55c3fd8b6030 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3d84055040 tx=0x7f3d8404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0dcd6ea21d2a03f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.571+0000 7f3c8160a640 1 -- 172.21.15.134:0/2384266097 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d84063070 con 0x55c3fd7c3390 2024-04-24T02:12:21.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.571+0000 7f3c8160a640 1 -- 172.21.15.134:0/2384266097 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d84058040 con 0x55c3fd7c3390 2024-04-24T02:12:21.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.571+0000 7f3c8160a640 1 -- 172.21.15.134:0/2384266097 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d84057070 con 0x55c3fd7c3390 2024-04-24T02:12:21.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.571+0000 7f3d95c98800 1 -- 172.21.15.134:0/2384266097 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3fd7c3390 msgr2=0x55c3fd8b6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.571+0000 7f3d95c98800 1 --2- 172.21.15.134:0/2384266097 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3fd7c3390 0x55c3fd8b6030 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3d84055040 tx=0x7f3d8404c000 comp rx=0 tx=0).stop 2024-04-24T02:12:21.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.571+0000 7f3d95c98800 1 -- 172.21.15.134:0/2384266097 shutdown_connections 2024-04-24T02:12:21.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.571+0000 7f3d95c98800 1 --2- 172.21.15.134:0/2384266097 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3fd7c3390 0x55c3fd8b6030 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.571+0000 7f3d95c98800 1 -- 172.21.15.134:0/2384266097 >> 172.21.15.134:0/2384266097 conn(0x55c3fd7bcb00 msgr2=0x55c3fd8b1950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:21.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.571+0000 7f3d95c98800 1 -- 172.21.15.134:0/2384266097 shutdown_connections 2024-04-24T02:12:21.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.571+0000 7f3d95c98800 1 -- 172.21.15.134:0/2384266097 wait complete. 2024-04-24T02:12:21.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.572+0000 7f3d95c98800 1 Processor -- start 2024-04-24T02:12:21.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.572+0000 7f3d95c98800 1 -- start start 2024-04-24T02:12:21.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.572+0000 7f3d95c98800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3fd7c3390 0x55c3fd8bdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.572+0000 7f3d95c98800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c3fd7cc0d0 con 0x55c3fd7c3390 2024-04-24T02:12:21.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.572+0000 7f3d9379e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3fd7c3390 0x55c3fd8bdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.572+0000 7f3d9379e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3fd7c3390 0x55c3fd8bdbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45460/0 (socket says 172.21.15.134:45460) 2024-04-24T02:12:21.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.572+0000 7f3d9379e640 1 -- 172.21.15.134:0/237771124 learned_addr learned my addr 172.21.15.134:0/237771124 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:21.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.572+0000 7f3d9379e640 1 -- 172.21.15.134:0/237771124 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3fd8be100 con 0x55c3fd7c3390 2024-04-24T02:12:21.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.573+0000 7f3d9379e640 1 --2- 172.21.15.134:0/237771124 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3fd7c3390 0x55c3fd8bdbc0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3d84061040 tx=0x7f3d84002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.573+0000 7f3c7fe07640 1 -- 172.21.15.134:0/237771124 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d84063030 con 0x55c3fd7c3390 2024-04-24T02:12:21.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.573+0000 7f3c7fe07640 1 -- 172.21.15.134:0/237771124 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d84052d90 con 0x55c3fd7c3390 2024-04-24T02:12:21.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.573+0000 7f3d95c98800 1 -- 172.21.15.134:0/237771124 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c3fd8be390 con 0x55c3fd7c3390 2024-04-24T02:12:21.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.573+0000 7f3c7fe07640 1 -- 172.21.15.134:0/237771124 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d8405e5b0 con 0x55c3fd7c3390 2024-04-24T02:12:21.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.573+0000 7f3d95c98800 1 -- 172.21.15.134:0/237771124 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3fd8c0ff0 con 0x55c3fd7c3390 2024-04-24T02:12:21.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.574+0000 7f3c7fe07640 1 -- 172.21.15.134:0/237771124 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3d8405e750 con 0x55c3fd7c3390 2024-04-24T02:12:21.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.574+0000 7f3c7fe07640 1 --2- 172.21.15.134:0/237771124 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3c78036950 0x7f3c78038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.574+0000 7f3c7fe07640 1 -- 172.21.15.134:0/237771124 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f3d84064070 con 0x55c3fd7c3390 2024-04-24T02:12:21.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.574+0000 7f3d92f9d640 1 --2- 172.21.15.134:0/237771124 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3c78036950 0x7f3c78038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.574+0000 7f3d95c98800 1 --2- 172.21.15.134:0/237771124 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c3fd7c3cf0 0x55c3fd8c4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.574+0000 7f3d95c98800 1 -- 172.21.15.134:0/237771124 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd8c52f0 con 0x55c3fd7c3cf0 2024-04-24T02:12:21.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.574+0000 7f3d93f9f640 1 --2- 172.21.15.134:0/237771124 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c3fd7c3cf0 0x55c3fd8c4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.574+0000 7f3d92f9d640 1 --2- 172.21.15.134:0/237771124 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3c78036950 0x7f3c78038e10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3d88000c00 tx=0x7f3d880013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.574+0000 7f3d93f9f640 1 --2- 172.21.15.134:0/237771124 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c3fd7c3cf0 0x55c3fd8c4db0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.575+0000 7f3d93f9f640 1 -- 172.21.15.134:0/237771124 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3d8c00a4a0 con 0x55c3fd7c3cf0 2024-04-24T02:12:21.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.575+0000 7f3d95c98800 1 -- 172.21.15.134:0/237771124 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd8c2360 con 0x55c3fd7c3cf0 2024-04-24T02:12:21.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.575+0000 7f3d93f9f640 1 -- 172.21.15.134:0/237771124 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3d8c00a4a0 con 0x55c3fd7c3cf0 2024-04-24T02:12:21.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.575+0000 7f3d95c98800 1 -- 172.21.15.134:0/237771124 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd8c70d0 con 0x55c3fd7c3cf0 2024-04-24T02:12:21.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.575+0000 7f3d93f9f640 1 -- 172.21.15.134:0/237771124 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3d8c00a4a0 con 0x55c3fd7c3cf0 2024-04-24T02:12:21.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.575+0000 7f3d95c98800 1 -- 172.21.15.134:0/237771124 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd8c6410 con 0x55c3fd7c3cf0 2024-04-24T02:12:21.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.576+0000 7f3d93f9f640 1 -- 172.21.15.134:0/237771124 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3d8c00a4a0 con 0x55c3fd7c3cf0 2024-04-24T02:12:21.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.576+0000 7f3d95c98800 1 -- 172.21.15.134:0/237771124 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd8c6830 con 0x55c3fd7c3cf0 2024-04-24T02:12:21.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.576+0000 7f3d93f9f640 1 -- 172.21.15.134:0/237771124 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3d8c00a4a0 con 0x55c3fd7c3cf0 2024-04-24T02:12:21.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.576+0000 7f3d95c98800 1 Processor -- start 2024-04-24T02:12:21.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.576+0000 7f3d95c98800 1 -- start start 2024-04-24T02:12:21.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.576+0000 7f3d95c98800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3fd8d5e80 0x55c3fd8d62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.576+0000 7f3d95c98800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c3fd6b46b0 con 0x55c3fd8d5e80 2024-04-24T02:12:21.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.577+0000 7f3d92f9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3fd8d5e80 0x55c3fd8d62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.577+0000 7f3d92f9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3fd8d5e80 0x55c3fd8d62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45464/0 (socket says 172.21.15.134:45464) 2024-04-24T02:12:21.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.577+0000 7f3d92f9d640 1 -- 172.21.15.134:0/2534504640 learned_addr learned my addr 172.21.15.134:0/2534504640 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:21.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.577+0000 7f3d92f9d640 1 -- 172.21.15.134:0/2534504640 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3fd8d67e0 con 0x55c3fd8d5e80 2024-04-24T02:12:21.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.577+0000 7f3d92f9d640 1 --2- 172.21.15.134:0/2534504640 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3fd8d5e80 0x55c3fd8d62a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3d8800e610 tx=0x7f3d8800ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.577+0000 7f3c7d602640 1 -- 172.21.15.134:0/2534504640 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d88022070 con 0x55c3fd8d5e80 2024-04-24T02:12:21.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.577+0000 7f3c7d602640 1 -- 172.21.15.134:0/2534504640 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d88009050 con 0x55c3fd8d5e80 2024-04-24T02:12:21.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.577+0000 7f3d95c98800 1 -- 172.21.15.134:0/2534504640 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c3fd8d7250 con 0x55c3fd8d5e80 2024-04-24T02:12:21.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.577+0000 7f3c7d602640 1 -- 172.21.15.134:0/2534504640 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d8800d500 con 0x55c3fd8d5e80 2024-04-24T02:12:21.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.577+0000 7f3d95c98800 1 -- 172.21.15.134:0/2534504640 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3fd8d7750 con 0x55c3fd8d5e80 2024-04-24T02:12:21.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.578+0000 7f3c7d602640 1 -- 172.21.15.134:0/2534504640 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3d88025070 con 0x55c3fd8d5e80 2024-04-24T02:12:21.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.578+0000 7f3c7d602640 1 --2- 172.21.15.134:0/2534504640 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3c6c036950 0x7f3c6c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.578+0000 7f3c7d602640 1 -- 172.21.15.134:0/2534504640 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f3d8804d9d0 con 0x55c3fd8d5e80 2024-04-24T02:12:21.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.578+0000 7f3d93f9f640 1 --2- 172.21.15.134:0/2534504640 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3c6c036950 0x7f3c6c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.578+0000 7f3d95c98800 1 Processor -- start 2024-04-24T02:12:21.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.578+0000 7f3d95c98800 1 -- start start 2024-04-24T02:12:21.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.578+0000 7f3d93f9f640 1 --2- 172.21.15.134:0/2534504640 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3c6c036950 0x7f3c6c038e10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x55c3fd8c67b0 tx=0x7f3d8c005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.578+0000 7f3d95c98800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3fd8e32b0 0x55c3fd8e36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.578+0000 7f3d95c98800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c3fd8b68c0 con 0x55c3fd8e32b0 2024-04-24T02:12:21.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.579+0000 7f3d92f9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3fd8e32b0 0x55c3fd8e36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.579+0000 7f3d92f9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3fd8e32b0 0x55c3fd8e36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45474/0 (socket says 172.21.15.134:45474) 2024-04-24T02:12:21.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.579+0000 7f3d92f9d640 1 -- 172.21.15.134:0/3818068874 learned_addr learned my addr 172.21.15.134:0/3818068874 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:21.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.579+0000 7f3d92f9d640 1 -- 172.21.15.134:0/3818068874 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3fd8e3c80 con 0x55c3fd8e32b0 2024-04-24T02:12:21.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.579+0000 7f3d92f9d640 1 --2- 172.21.15.134:0/3818068874 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3fd8e32b0 0x55c3fd8e36b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3d8800dfd0 tx=0x7f3d88024e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99e093ece69f72e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.579+0000 7f3c76ffd640 1 -- 172.21.15.134:0/3818068874 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d8804a030 con 0x55c3fd8e32b0 2024-04-24T02:12:21.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.579+0000 7f3c76ffd640 1 -- 172.21.15.134:0/3818068874 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d88025e30 con 0x55c3fd8e32b0 2024-04-24T02:12:21.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.579+0000 7f3c76ffd640 1 -- 172.21.15.134:0/3818068874 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d8801ac20 con 0x55c3fd8e32b0 2024-04-24T02:12:21.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.580+0000 7f3d95c98800 1 -- 172.21.15.134:0/3818068874 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3fd8e32b0 msgr2=0x55c3fd8e36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.580+0000 7f3d95c98800 1 --2- 172.21.15.134:0/3818068874 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3fd8e32b0 0x55c3fd8e36b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3d8800dfd0 tx=0x7f3d88024e90 comp rx=0 tx=0).stop 2024-04-24T02:12:21.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.580+0000 7f3d95c98800 1 -- 172.21.15.134:0/3818068874 shutdown_connections 2024-04-24T02:12:21.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.580+0000 7f3d95c98800 1 --2- 172.21.15.134:0/3818068874 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3fd8e32b0 0x55c3fd8e36b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.580+0000 7f3d95c98800 1 -- 172.21.15.134:0/3818068874 >> 172.21.15.134:0/3818068874 conn(0x55c3fd8df580 msgr2=0x55c3fd8dd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:21.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.580+0000 7f3d95c98800 1 -- 172.21.15.134:0/3818068874 shutdown_connections 2024-04-24T02:12:21.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.580+0000 7f3d95c98800 1 -- 172.21.15.134:0/3818068874 wait complete. 2024-04-24T02:12:21.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.580+0000 7f3d95c98800 1 Processor -- start 2024-04-24T02:12:21.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.580+0000 7f3d95c98800 1 -- start start 2024-04-24T02:12:21.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.580+0000 7f3d95c98800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3fd8e32b0 0x55c3fd8ea8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.580+0000 7f3d95c98800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c3fd8e4430 con 0x55c3fd8e32b0 2024-04-24T02:12:21.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.580+0000 7f3d92f9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3fd8e32b0 0x55c3fd8ea8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.580+0000 7f3d92f9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3fd8e32b0 0x55c3fd8ea8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45480/0 (socket says 172.21.15.134:45480) 2024-04-24T02:12:21.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.580+0000 7f3d92f9d640 1 -- 172.21.15.134:0/933686724 learned_addr learned my addr 172.21.15.134:0/933686724 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:21.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.581+0000 7f3d92f9d640 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3fd8eae30 con 0x55c3fd8e32b0 2024-04-24T02:12:21.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.581+0000 7f3d92f9d640 1 --2- 172.21.15.134:0/933686724 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3fd8e32b0 0x55c3fd8ea8f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3d8804add0 tx=0x7f3d8804be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.581+0000 7f3c757fa640 1 -- 172.21.15.134:0/933686724 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d8804a050 con 0x55c3fd8e32b0 2024-04-24T02:12:21.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.581+0000 7f3c757fa640 1 -- 172.21.15.134:0/933686724 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d8804d7a0 con 0x55c3fd8e32b0 2024-04-24T02:12:21.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.581+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c3fd8eb0c0 con 0x55c3fd8e32b0 2024-04-24T02:12:21.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.581+0000 7f3c757fa640 1 -- 172.21.15.134:0/933686724 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d880256c0 con 0x55c3fd8e32b0 2024-04-24T02:12:21.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.581+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3fd8edd70 con 0x55c3fd8e32b0 2024-04-24T02:12:21.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.582+0000 7f3c757fa640 1 -- 172.21.15.134:0/933686724 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3d8804d070 con 0x55c3fd8e32b0 2024-04-24T02:12:21.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.582+0000 7f3c757fa640 1 --2- 172.21.15.134:0/933686724 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3c5c036950 0x7f3c5c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.582+0000 7f3c757fa640 1 -- 172.21.15.134:0/933686724 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f3d88036ae0 con 0x55c3fd8e32b0 2024-04-24T02:12:21.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.582+0000 7f3d93f9f640 1 --2- 172.21.15.134:0/933686724 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3c5c036950 0x7f3c5c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.582+0000 7f3d95c98800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.582+0000 7f3d95c98800 1 --2- 172.21.15.134:0/933686724 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c3fd8f63f0 0x55c3fd8f88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.582+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd8f9000 con 0x55c3fd8f63f0 2024-04-24T02:12:21.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.582+0000 7f3d9379e640 1 --2- 172.21.15.134:0/933686724 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c3fd8f63f0 0x55c3fd8f88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.582+0000 7f3d93f9f640 1 --2- 172.21.15.134:0/933686724 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3c5c036950 0x7f3c5c038e10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x55c3fd8c5f30 tx=0x7f3d8c01f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.582+0000 7f3d9379e640 1 --2- 172.21.15.134:0/933686724 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c3fd8f63f0 0x55c3fd8f88b0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.583+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3d84070020 con 0x55c3fd8f63f0 2024-04-24T02:12:21.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.583+0000 7f3d95c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:21.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.583+0000 7f3d95c98800 20 realm 2024-04-24T02:12:21.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.583+0000 7f3d95c98800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.583+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd8f9410 con 0x55c3fd8f63f0 2024-04-24T02:12:21.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.583+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3d84070020 con 0x55c3fd8f63f0 2024-04-24T02:12:21.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.583+0000 7f3d95c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:21.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.583+0000 7f3d95c98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:21.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.583+0000 7f3d95c98800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.583+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd8f9ce0 con 0x55c3fd8f63f0 2024-04-24T02:12:21.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.583+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3d84070020 con 0x55c3fd8f63f0 2024-04-24T02:12:21.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.583+0000 7f3d95c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:21.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.583+0000 7f3d95c98800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.583+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd8fa080 con 0x55c3fd8f63f0 2024-04-24T02:12:21.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.583+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3d84070020 con 0x55c3fd8f63f0 2024-04-24T02:12:21.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.583+0000 7f3d95c98800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:21.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.583+0000 7f3d95c98800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.583+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd8fa4e0 con 0x55c3fd8f63f0 2024-04-24T02:12:21.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.584+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3d84070020 con 0x55c3fd8f63f0 2024-04-24T02:12:21.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.584+0000 7f3d95c98800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:21.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.584+0000 7f3d95c98800 20 searching for the correct realm 2024-04-24T02:12:21.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.584+0000 7f3d95c98800 1 --2- 172.21.15.134:0/933686724 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55c3fd8fc530 0x55c3fd8fe920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.584+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd8fefd0 con 0x55c3fd8fc530 2024-04-24T02:12:21.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.584+0000 7f3d92f9d640 1 --2- 172.21.15.134:0/933686724 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55c3fd8fc530 0x55c3fd8fe920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.584+0000 7f3d92f9d640 1 --2- 172.21.15.134:0/933686724 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55c3fd8fc530 0x55c3fd8fe920 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.585+0000 7f3d92f9d640 1 -- 172.21.15.134:0/933686724 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d88024030 con 0x55c3fd8fc530 2024-04-24T02:12:21.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.585+0000 7f3d92f9d640 1 --2- 172.21.15.134:0/933686724 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f3d8804dc20 0x7f3d88041670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.585+0000 7f3d92f9d640 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd8fefd0 con 0x7f3d8804dc20 2024-04-24T02:12:21.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.585+0000 7f3d93f9f640 1 --2- 172.21.15.134:0/933686724 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f3d8804dc20 0x7f3d88041670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.585+0000 7f3d93f9f640 1 --2- 172.21.15.134:0/933686724 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f3d8804dc20 0x7f3d88041670 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.585+0000 7f3d93f9f640 1 -- 172.21.15.134:0/933686724 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d8c01f070 con 0x7f3d8804dc20 2024-04-24T02:12:21.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.585+0000 7f3d93f9f640 1 --2- 172.21.15.134:0/933686724 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f3d8c031040 0x7f3d8c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.585+0000 7f3d93f9f640 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd8fefd0 con 0x7f3d8c031040 2024-04-24T02:12:21.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.585+0000 7f3d9379e640 1 --2- 172.21.15.134:0/933686724 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f3d8c031040 0x7f3d8c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.586+0000 7f3d9379e640 1 --2- 172.21.15.134:0/933686724 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f3d8c031040 0x7f3d8c032940 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.586+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d84070020 con 0x7f3d8c031040 2024-04-24T02:12:21.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.586+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd8fefd0 con 0x55c3fd8f63f0 2024-04-24T02:12:21.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.586+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d84070020 con 0x55c3fd8f63f0 2024-04-24T02:12:21.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.586+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd8fefd0 con 0x55c3fd8f63f0 2024-04-24T02:12:21.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.586+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3d84070020 con 0x55c3fd8f63f0 2024-04-24T02:12:21.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.586+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd8fefd0 con 0x7f3d8c031040 2024-04-24T02:12:21.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.587+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d84070020 con 0x7f3d8c031040 2024-04-24T02:12:21.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.587+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd8fefd0 con 0x7f3d8c031040 2024-04-24T02:12:21.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.587+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d84070020 con 0x7f3d8c031040 2024-04-24T02:12:21.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.587+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd8fefd0 con 0x7f3d8804dc20 2024-04-24T02:12:21.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.587+0000 7f3d93f9f640 1 -- 172.21.15.134:0/933686724 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d8c01f070 con 0x7f3d8804dc20 2024-04-24T02:12:21.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.587+0000 7f3d93f9f640 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd8fefd0 con 0x55c3fd8fc530 2024-04-24T02:12:21.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.587+0000 7f3d92f9d640 1 -- 172.21.15.134:0/933686724 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d88024030 con 0x55c3fd8fc530 2024-04-24T02:12:21.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.587+0000 7f3d92f9d640 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd8fefd0 con 0x55c3fd8f63f0 2024-04-24T02:12:21.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.587+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d84070020 con 0x55c3fd8f63f0 2024-04-24T02:12:21.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.587+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd8fefd0 con 0x7f3d8c031040 2024-04-24T02:12:21.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.588+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d84070020 con 0x7f3d8c031040 2024-04-24T02:12:21.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.588+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd8fefd0 con 0x55c3fd8f63f0 2024-04-24T02:12:21.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.588+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d84070020 con 0x55c3fd8f63f0 2024-04-24T02:12:21.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.588+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd8fefd0 con 0x7f3d8804dc20 2024-04-24T02:12:21.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.588+0000 7f3d93f9f640 1 -- 172.21.15.134:0/933686724 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3d8c01f070 con 0x7f3d8804dc20 2024-04-24T02:12:21.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.588+0000 7f3d93f9f640 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd8fefd0 con 0x55c3fd8fc530 2024-04-24T02:12:21.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.588+0000 7f3d92f9d640 1 -- 172.21.15.134:0/933686724 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d88024030 con 0x55c3fd8fc530 2024-04-24T02:12:21.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.588+0000 7f3d92f9d640 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd8fefd0 con 0x55c3fd8fc530 2024-04-24T02:12:21.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.589+0000 7f3d92f9d640 1 -- 172.21.15.134:0/933686724 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d88024030 con 0x55c3fd8fc530 2024-04-24T02:12:21.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.589+0000 7f3d92f9d640 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd8fefd0 con 0x7f3d8c031040 2024-04-24T02:12:21.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.589+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d84070020 con 0x7f3d8c031040 2024-04-24T02:12:21.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.589+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd8fefd0 con 0x55c3fd8fc530 2024-04-24T02:12:21.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.589+0000 7f3d92f9d640 1 -- 172.21.15.134:0/933686724 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d88024030 con 0x55c3fd8fc530 2024-04-24T02:12:21.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.589+0000 7f3d92f9d640 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd8fefd0 con 0x55c3fd8fc530 2024-04-24T02:12:21.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.589+0000 7f3d92f9d640 1 -- 172.21.15.134:0/933686724 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d88024030 con 0x55c3fd8fc530 2024-04-24T02:12:21.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.589+0000 7f3d92f9d640 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd8fefd0 con 0x55c3fd8f63f0 2024-04-24T02:12:21.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.590+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d84070020 con 0x55c3fd8f63f0 2024-04-24T02:12:21.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.590+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd8fefd0 con 0x55c3fd8f63f0 2024-04-24T02:12:21.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.590+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f3d84070020 con 0x55c3fd8f63f0 2024-04-24T02:12:21.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.590+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd8fefd0 con 0x7f3d8c031040 2024-04-24T02:12:21.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.590+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d84070020 con 0x7f3d8c031040 2024-04-24T02:12:21.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.590+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd8fefd0 con 0x55c3fd8fc530 2024-04-24T02:12:21.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.590+0000 7f3d92f9d640 1 -- 172.21.15.134:0/933686724 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d88024030 con 0x55c3fd8fc530 2024-04-24T02:12:21.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.590+0000 7f3d92f9d640 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd8fefd0 con 0x7f3d8804dc20 2024-04-24T02:12:21.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.591+0000 7f3d93f9f640 1 -- 172.21.15.134:0/933686724 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d8c01f070 con 0x7f3d8804dc20 2024-04-24T02:12:21.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.591+0000 7f3d93f9f640 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd8fefd0 con 0x55c3fd8f63f0 2024-04-24T02:12:21.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.591+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d84070020 con 0x55c3fd8f63f0 2024-04-24T02:12:21.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.591+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd8fefd0 con 0x7f3d8c031040 2024-04-24T02:12:21.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.591+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d84070020 con 0x7f3d8c031040 2024-04-24T02:12:21.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.591+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd8fefd0 con 0x55c3fd8fc530 2024-04-24T02:12:21.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.591+0000 7f3d92f9d640 1 -- 172.21.15.134:0/933686724 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d88024030 con 0x55c3fd8fc530 2024-04-24T02:12:21.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.591+0000 7f3d92f9d640 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd8fefd0 con 0x7f3d8c031040 2024-04-24T02:12:21.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.592+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d84070020 con 0x7f3d8c031040 2024-04-24T02:12:21.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.592+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd8fefd0 con 0x7f3d8804dc20 2024-04-24T02:12:21.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.592+0000 7f3d93f9f640 1 -- 172.21.15.134:0/933686724 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d8c01f070 con 0x7f3d8804dc20 2024-04-24T02:12:21.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.592+0000 7f3d93f9f640 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd8fefd0 con 0x55c3fd8fc530 2024-04-24T02:12:21.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.592+0000 7f3d92f9d640 1 -- 172.21.15.134:0/933686724 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d88024030 con 0x55c3fd8fc530 2024-04-24T02:12:21.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.592+0000 7f3d92f9d640 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd8fefd0 con 0x7f3d8c031040 2024-04-24T02:12:21.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.592+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d84070020 con 0x7f3d8c031040 2024-04-24T02:12:21.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.592+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd8fefd0 con 0x55c3fd8f63f0 2024-04-24T02:12:21.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.593+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3d84070020 con 0x55c3fd8f63f0 2024-04-24T02:12:21.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.593+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd8fefd0 con 0x7f3d8804dc20 2024-04-24T02:12:21.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.593+0000 7f3d93f9f640 1 -- 172.21.15.134:0/933686724 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d8c01f070 con 0x7f3d8804dc20 2024-04-24T02:12:21.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.593+0000 7f3d95c98800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:21.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.593+0000 7f3d95c98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:21.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.593+0000 7f3d95c98800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:21.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.593+0000 7f3d95c98800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:21.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.593+0000 7f3d95c98800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:21.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.593+0000 7f3d95c98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:21.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.593+0000 7f3d95c98800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.593+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd8faf80 con 0x55c3fd8f63f0 2024-04-24T02:12:21.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.593+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3d84070020 con 0x55c3fd8f63f0 2024-04-24T02:12:21.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.593+0000 7f3d95c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:21.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.593+0000 7f3d95c98800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.593+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd8fb820 con 0x55c3fd8f63f0 2024-04-24T02:12:21.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.594+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3d84070020 con 0x55c3fd8f63f0 2024-04-24T02:12:21.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.594+0000 7f3d95c98800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:21.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.594+0000 7f3d95c98800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.594+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd8fabc0 con 0x55c3fd8f63f0 2024-04-24T02:12:21.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.594+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3d84070020 con 0x55c3fd8f63f0 2024-04-24T02:12:21.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.594+0000 7f3d95c98800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:21.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.594+0000 7f3d95c98800 20 zone default found 2024-04-24T02:12:21.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.594+0000 7f3d95c98800 4 Realm: () 2024-04-24T02:12:21.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.594+0000 7f3d95c98800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:21.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.594+0000 7f3d95c98800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:21.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.594+0000 7f3d95c98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:21.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.594+0000 7f3d95c98800 20 zonegroup default 2024-04-24T02:12:21.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.594+0000 7f3d95c98800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.594+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd8ff430 con 0x7f3d8c031040 2024-04-24T02:12:21.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.594+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3d84070020 con 0x7f3d8c031040 2024-04-24T02:12:21.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.594+0000 7f3d95c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:21.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.594+0000 7f3d95c98800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.594+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd9012c0 con 0x55c3fd8fc530 2024-04-24T02:12:21.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.595+0000 7f3d92f9d640 1 -- 172.21.15.134:0/933686724 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3d88024030 con 0x55c3fd8fc530 2024-04-24T02:12:21.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.595+0000 7f3d95c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:21.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.595+0000 7f3d95c98800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.595+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd901660 con 0x55c3fd8fc530 2024-04-24T02:12:21.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.595+0000 7f3d92f9d640 1 -- 172.21.15.134:0/933686724 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3d88024030 con 0x55c3fd8fc530 2024-04-24T02:12:21.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.595+0000 7f3d95c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:21.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.595+0000 7f3d95c98800 20 started sync module instance, tier type = 2024-04-24T02:12:21.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.595+0000 7f3d95c98800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:21.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.595+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd900700 con 0x7f3d8804dc20 2024-04-24T02:12:21.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.596+0000 7f3d93f9f640 1 -- 172.21.15.134:0/933686724 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d8c040040 con 0x7f3d8804dc20 2024-04-24T02:12:21.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.596+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94300261059360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd900360 con 0x7f3d8804dc20 2024-04-24T02:12:21.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.596+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd9023c0 con 0x55c3fd8f63f0 2024-04-24T02:12:21.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.597+0000 7f3d93f9f640 1 -- 172.21.15.134:0/933686724 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94300261059360] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d8c040040 con 0x7f3d8804dc20 2024-04-24T02:12:21.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.597+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d84070020 con 0x55c3fd8f63f0 2024-04-24T02:12:21.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.597+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94300261063168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd902380 con 0x55c3fd8f63f0 2024-04-24T02:12:21.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.597+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd902e50 con 0x55c3fd8fc530 2024-04-24T02:12:21.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.598+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94300261063168] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d84070020 con 0x55c3fd8f63f0 2024-04-24T02:12:21.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.598+0000 7f3d92f9d640 1 -- 172.21.15.134:0/933686724 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d88024030 con 0x55c3fd8fc530 2024-04-24T02:12:21.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.598+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94300261067040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd903240 con 0x55c3fd8fc530 2024-04-24T02:12:21.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.598+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd903c60 con 0x7f3d8804dc20 2024-04-24T02:12:21.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.599+0000 7f3d93f9f640 1 -- 172.21.15.134:0/933686724 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d8c040040 con 0x7f3d8804dc20 2024-04-24T02:12:21.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.599+0000 7f3d92f9d640 1 -- 172.21.15.134:0/933686724 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94300261067040] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d88024030 con 0x55c3fd8fc530 2024-04-24T02:12:21.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.599+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94300261070672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd904050 con 0x7f3d8804dc20 2024-04-24T02:12:21.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.599+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd904a80 con 0x55c3fd8f63f0 2024-04-24T02:12:21.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.600+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d84070020 con 0x55c3fd8f63f0 2024-04-24T02:12:21.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.600+0000 7f3d93f9f640 1 -- 172.21.15.134:0/933686724 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94300261070672] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d8c040040 con 0x7f3d8804dc20 2024-04-24T02:12:21.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.600+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94300261074320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd9049b0 con 0x55c3fd8f63f0 2024-04-24T02:12:21.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.600+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd9054c0 con 0x7f3d8c031040 2024-04-24T02:12:21.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.603+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d84070020 con 0x7f3d8c031040 2024-04-24T02:12:21.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.603+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94300261077008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd905430 con 0x7f3d8c031040 2024-04-24T02:12:21.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.603+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd906420 con 0x7f3d8c031040 2024-04-24T02:12:21.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.604+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94300261074320] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d84070020 con 0x55c3fd8f63f0 2024-04-24T02:12:21.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.604+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94300261077008] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d84070020 con 0x7f3d8c031040 2024-04-24T02:12:21.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.604+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(56 notify.6 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d84070020 con 0x7f3d8c031040 2024-04-24T02:12:21.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.604+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94300261079216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd905f00 con 0x7f3d8c031040 2024-04-24T02:12:21.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.604+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd9068d0 con 0x7f3d8c031040 2024-04-24T02:12:21.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.606+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94300261079216] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d84070020 con 0x7f3d8c031040 2024-04-24T02:12:21.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.606+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(58 notify.7 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d84070020 con 0x7f3d8c031040 2024-04-24T02:12:21.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.606+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94300261064224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd9068d0 con 0x7f3d8c031040 2024-04-24T02:12:21.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.606+0000 7f3d95c98800 20 add_watcher() i=0 2024-04-24T02:12:21.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.606+0000 7f3d95c98800 20 add_watcher() i=1 2024-04-24T02:12:21.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.606+0000 7f3d95c98800 20 add_watcher() i=2 2024-04-24T02:12:21.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.606+0000 7f3d95c98800 20 add_watcher() i=3 2024-04-24T02:12:21.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.606+0000 7f3d95c98800 20 add_watcher() i=4 2024-04-24T02:12:21.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.606+0000 7f3d95c98800 20 add_watcher() i=5 2024-04-24T02:12:21.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.606+0000 7f3d95c98800 20 add_watcher() i=6 2024-04-24T02:12:21.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.607+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94300261064224] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d84070020 con 0x7f3d8c031040 2024-04-24T02:12:21.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.607+0000 7f3d95c98800 20 add_watcher() i=7 2024-04-24T02:12:21.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.607+0000 7f3d95c98800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:21.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.607+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd909cd0 con 0x55c3fd8f63f0 2024-04-24T02:12:21.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.607+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3d84070020 con 0x55c3fd8f63f0 2024-04-24T02:12:21.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.607+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94300261082608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd907220 con 0x55c3fd8f63f0 2024-04-24T02:12:21.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.608+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94300261082608] v30'54 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3d84070020 con 0x55c3fd8f63f0 2024-04-24T02:12:21.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.608+0000 7f3c49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:21.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.608+0000 7f3d95c98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:21.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.608+0000 7f3d95c98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:21.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.608+0000 7f3d95c98800 5 note: GC not initialized 2024-04-24T02:12:21.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.609+0000 7f3c48fe1640 20 reqs_thread_entry: start 2024-04-24T02:12:21.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.609+0000 7f3d95c98800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:21.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.609+0000 7f3d95c98800 20 Filter name: none 2024-04-24T02:12:21.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.609+0000 7f3bc27fc640 20 reqs_thread_entry: start 2024-04-24T02:12:21.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.609+0000 7f3d95c98800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.609+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd93cb30 con 0x55c3fd8f63f0 2024-04-24T02:12:21.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.609+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f3d84070020 con 0x55c3fd8f63f0 2024-04-24T02:12:21.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.609+0000 7f3d95c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:21.621 INFO:teuthology.orchestra.run.smithi134.stderr:could not fetch user info: no user info saved 2024-04-24T02:12:21.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.610+0000 7f3c49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:21.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.610+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94300261082608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd93caf0 con 0x55c3fd8f63f0 2024-04-24T02:12:21.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.611+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94300261082608] v30'55 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3d84070020 con 0x55c3fd8f63f0 2024-04-24T02:12:21.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.611+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94300261059360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd93caf0 con 0x7f3d8804dc20 2024-04-24T02:12:21.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.612+0000 7f3d93f9f640 1 -- 172.21.15.134:0/933686724 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94300261059360] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d8c040040 con 0x7f3d8804dc20 2024-04-24T02:12:21.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.612+0000 7f3d95c98800 20 remove_watcher() i=0 2024-04-24T02:12:21.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.612+0000 7f3d95c98800 2 removed watcher, disabling cache 2024-04-24T02:12:21.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.612+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94300261063168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd93caf0 con 0x55c3fd8f63f0 2024-04-24T02:12:21.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.613+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94300261063168] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d84070020 con 0x55c3fd8f63f0 2024-04-24T02:12:21.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.613+0000 7f3d95c98800 20 remove_watcher() i=1 2024-04-24T02:12:21.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.613+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94300261067040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd93caf0 con 0x55c3fd8fc530 2024-04-24T02:12:21.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.614+0000 7f3d92f9d640 1 -- 172.21.15.134:0/933686724 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94300261067040] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d88024030 con 0x55c3fd8fc530 2024-04-24T02:12:21.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.614+0000 7f3d95c98800 20 remove_watcher() i=2 2024-04-24T02:12:21.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.614+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94300261070672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd902920 con 0x7f3d8804dc20 2024-04-24T02:12:21.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.615+0000 7f3d93f9f640 1 -- 172.21.15.134:0/933686724 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94300261070672] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d8c040040 con 0x7f3d8804dc20 2024-04-24T02:12:21.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.615+0000 7f3d95c98800 20 remove_watcher() i=3 2024-04-24T02:12:21.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.615+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94300261074320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd901a00 con 0x55c3fd8f63f0 2024-04-24T02:12:21.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.616+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94300261074320] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d84070020 con 0x55c3fd8f63f0 2024-04-24T02:12:21.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.616+0000 7f3d95c98800 20 remove_watcher() i=4 2024-04-24T02:12:21.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.616+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94300261077008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd901a00 con 0x7f3d8c031040 2024-04-24T02:12:21.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.617+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94300261077008] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d84070020 con 0x7f3d8c031040 2024-04-24T02:12:21.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.617+0000 7f3d95c98800 20 remove_watcher() i=5 2024-04-24T02:12:21.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.617+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94300261079216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd905010 con 0x7f3d8c031040 2024-04-24T02:12:21.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.618+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94300261079216] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d84070020 con 0x7f3d8c031040 2024-04-24T02:12:21.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.618+0000 7f3d95c98800 20 remove_watcher() i=6 2024-04-24T02:12:21.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.618+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94300261064224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3fd901a00 con 0x7f3d8c031040 2024-04-24T02:12:21.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.618+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94300261064224] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d84070020 con 0x7f3d8c031040 2024-04-24T02:12:21.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.618+0000 7f3d95c98800 20 remove_watcher() i=7 2024-04-24T02:12:21.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.619+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f3d8c031040 msgr2=0x7f3d8c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.619+0000 7f3d95c98800 1 --2- 172.21.15.134:0/933686724 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f3d8c031040 0x7f3d8c032940 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.619+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c3fd8f63f0 msgr2=0x55c3fd8f88b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.619+0000 7f3d95c98800 1 --2- 172.21.15.134:0/933686724 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c3fd8f63f0 0x55c3fd8f88b0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.619+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f3d8804dc20 msgr2=0x7f3d88041670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.619+0000 7f3d95c98800 1 --2- 172.21.15.134:0/933686724 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f3d8804dc20 0x7f3d88041670 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.619+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55c3fd8fc530 msgr2=0x55c3fd8fe920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.619+0000 7f3d95c98800 1 --2- 172.21.15.134:0/933686724 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55c3fd8fc530 0x55c3fd8fe920 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.619+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3c5c036950 msgr2=0x7f3c5c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.619+0000 7f3d95c98800 1 --2- 172.21.15.134:0/933686724 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3c5c036950 0x7f3c5c038e10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x55c3fd8c5f30 tx=0x7f3d8c01f000 comp rx=0 tx=0).stop 2024-04-24T02:12:21.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.619+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3fd8e32b0 msgr2=0x55c3fd8ea8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.619+0000 7f3d9379e640 1 -- 172.21.15.134:0/933686724 reap_dead start 2024-04-24T02:12:21.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.619+0000 7f3d95c98800 1 --2- 172.21.15.134:0/933686724 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3fd8e32b0 0x55c3fd8ea8f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3d8804add0 tx=0x7f3d8804be40 comp rx=0 tx=0).stop 2024-04-24T02:12:21.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.619+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 shutdown_connections 2024-04-24T02:12:21.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.619+0000 7f3d95c98800 1 --2- 172.21.15.134:0/933686724 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3fd8e32b0 0x55c3fd8ea8f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.619+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 >> 172.21.15.134:0/933686724 conn(0x55c3fd8df580 msgr2=0x55c3fd8dcbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:21.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.619+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 shutdown_connections 2024-04-24T02:12:21.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.619+0000 7f3d95c98800 1 -- 172.21.15.134:0/933686724 wait complete. 2024-04-24T02:12:21.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.619+0000 7f3d95c98800 1 -- 172.21.15.134:0/2534504640 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3c6c036950 msgr2=0x7f3c6c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.619+0000 7f3d95c98800 1 --2- 172.21.15.134:0/2534504640 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3c6c036950 0x7f3c6c038e10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x55c3fd8c67b0 tx=0x7f3d8c005840 comp rx=0 tx=0).stop 2024-04-24T02:12:21.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.619+0000 7f3d95c98800 1 -- 172.21.15.134:0/2534504640 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3fd8d5e80 msgr2=0x55c3fd8d62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.619+0000 7f3d95c98800 1 --2- 172.21.15.134:0/2534504640 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3fd8d5e80 0x55c3fd8d62a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3d8800e610 tx=0x7f3d8800ff90 comp rx=0 tx=0).stop 2024-04-24T02:12:21.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.619+0000 7f3d95c98800 1 -- 172.21.15.134:0/2534504640 shutdown_connections 2024-04-24T02:12:21.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.619+0000 7f3d95c98800 1 --2- 172.21.15.134:0/2534504640 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3c6c036950 0x7f3c6c038e10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.619+0000 7f3d95c98800 1 --2- 172.21.15.134:0/2534504640 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3fd8d5e80 0x55c3fd8d62a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.619+0000 7f3d95c98800 1 -- 172.21.15.134:0/2534504640 >> 172.21.15.134:0/2534504640 conn(0x55c3fd8c9f20 msgr2=0x55c3fd8ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:21.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.619+0000 7f3d95c98800 1 -- 172.21.15.134:0/2534504640 shutdown_connections 2024-04-24T02:12:21.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.619+0000 7f3d95c98800 1 -- 172.21.15.134:0/2534504640 wait complete. 2024-04-24T02:12:21.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.620+0000 7f3d95c98800 1 -- 172.21.15.134:0/237771124 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c3fd7c3cf0 msgr2=0x55c3fd8c4db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.620+0000 7f3d95c98800 1 --2- 172.21.15.134:0/237771124 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c3fd7c3cf0 0x55c3fd8c4db0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.620+0000 7f3d95c98800 1 -- 172.21.15.134:0/237771124 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3c78036950 msgr2=0x7f3c78038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.620+0000 7f3d95c98800 1 --2- 172.21.15.134:0/237771124 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3c78036950 0x7f3c78038e10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3d88000c00 tx=0x7f3d880013b0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.620+0000 7f3d95c98800 1 -- 172.21.15.134:0/237771124 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3fd7c3390 msgr2=0x55c3fd8bdbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.620+0000 7f3d95c98800 1 --2- 172.21.15.134:0/237771124 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3fd7c3390 0x55c3fd8bdbc0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3d84061040 tx=0x7f3d84002fb0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.620+0000 7f3d95c98800 1 -- 172.21.15.134:0/237771124 shutdown_connections 2024-04-24T02:12:21.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.620+0000 7f3d95c98800 1 --2- 172.21.15.134:0/237771124 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c3fd7c3cf0 0x55c3fd8c4db0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.620+0000 7f3d95c98800 1 --2- 172.21.15.134:0/237771124 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3c78036950 0x7f3c78038e10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.620+0000 7f3d95c98800 1 --2- 172.21.15.134:0/237771124 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3fd7c3390 0x55c3fd8bdbc0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.620+0000 7f3d95c98800 1 -- 172.21.15.134:0/237771124 >> 172.21.15.134:0/237771124 conn(0x55c3fd7bcb00 msgr2=0x55c3fd8b0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:21.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.620+0000 7f3d95c98800 1 -- 172.21.15.134:0/237771124 shutdown_connections 2024-04-24T02:12:21.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.620+0000 7f3d95c98800 1 -- 172.21.15.134:0/237771124 wait complete. 2024-04-24T02:12:21.631 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-24T02:12:21.632 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-04-24T02:12:21.632 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-04-24T02:12:21.632 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-04-24T02:12:21.725 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:21.725 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:21.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.724+0000 7f983e72f800 1 Processor -- start 2024-04-24T02:12:21.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.724+0000 7f983e72f800 1 -- start start 2024-04-24T02:12:21.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.724+0000 7f983e72f800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55940aee8a60 0x55940aee7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.724+0000 7f983e72f800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55940ae31d40 con 0x55940aee7550 2024-04-24T02:12:21.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.725+0000 7f983e72f800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55940ae044d0 con 0x55940aee8a60 2024-04-24T02:12:21.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.725+0000 7f983a3ae640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55940aee8a60 0x55940aee7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.725+0000 7f9831bad640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55940aee7550 0x55940af7adc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:43188/0 (socket says 172.21.15.134:43188) 2024-04-24T02:12:21.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.725+0000 7f9831bad640 1 -- 172.21.15.134:0/3494817388 learned_addr learned my addr 172.21.15.134:0/3494817388 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:12:21.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.725+0000 7f983a3ae640 1 -- 172.21.15.134:0/3494817388 >> v1:172.21.15.104:6789/0 conn(0x55940aee7550 legacy=0x55940af7adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.725+0000 7f983a3ae640 1 -- 172.21.15.134:0/3494817388 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55940ae30590 con 0x55940aee8a60 2024-04-24T02:12:21.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.727+0000 7f983a3ae640 1 --2- 172.21.15.134:0/3494817388 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55940aee8a60 0x55940aee7010 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f982c00a470 tx=0x7f982c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49a771e279af251f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.727+0000 7f9839bad640 1 -- 172.21.15.134:0/3494817388 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f982c057070 con 0x55940aee8a60 2024-04-24T02:12:21.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.727+0000 7f9839bad640 1 -- 172.21.15.134:0/3494817388 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f982c052570 con 0x55940aee8a60 2024-04-24T02:12:21.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.727+0000 7f9839bad640 1 -- 172.21.15.134:0/3494817388 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f982c052870 con 0x55940aee8a60 2024-04-24T02:12:21.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.728+0000 7f983e72f800 1 -- 172.21.15.134:0/3494817388 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55940aee8a60 msgr2=0x55940aee7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.728+0000 7f983e72f800 1 --2- 172.21.15.134:0/3494817388 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55940aee8a60 0x55940aee7010 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f982c00a470 tx=0x7f982c01ce90 comp rx=0 tx=0).stop 2024-04-24T02:12:21.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.728+0000 7f983e72f800 1 -- 172.21.15.134:0/3494817388 shutdown_connections 2024-04-24T02:12:21.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.728+0000 7f983e72f800 1 --2- 172.21.15.134:0/3494817388 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55940aee8a60 0x55940aee7010 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.728+0000 7f983e72f800 1 -- 172.21.15.134:0/3494817388 >> 172.21.15.134:0/3494817388 conn(0x55940af6e4d0 msgr2=0x55940af708f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:21.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.728+0000 7f983e72f800 1 -- 172.21.15.134:0/3494817388 shutdown_connections 2024-04-24T02:12:21.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.728+0000 7f983e72f800 1 -- 172.21.15.134:0/3494817388 wait complete. 2024-04-24T02:12:21.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.739+0000 7f983e72f800 1 Processor -- start 2024-04-24T02:12:21.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.739+0000 7f983e72f800 1 -- start start 2024-04-24T02:12:21.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.740+0000 7f983e72f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55940aee7550 0x55940b066870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.740+0000 7f983e72f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55940aebe360 con 0x55940aee7550 2024-04-24T02:12:21.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.740+0000 7f983a3ae640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55940aee7550 0x55940b066870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.740+0000 7f983a3ae640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55940aee7550 0x55940b066870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45496/0 (socket says 172.21.15.134:45496) 2024-04-24T02:12:21.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.740+0000 7f983a3ae640 1 -- 172.21.15.134:0/3114115781 learned_addr learned my addr 172.21.15.134:0/3114115781 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:21.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.740+0000 7f983a3ae640 1 -- 172.21.15.134:0/3114115781 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55940b066e40 con 0x55940aee7550 2024-04-24T02:12:21.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.740+0000 7f983a3ae640 1 --2- 172.21.15.134:0/3114115781 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55940aee7550 0x55940b066870 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f982c000c00 tx=0x7f982c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d8ad509f5280f9f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.740+0000 7f9728608640 1 -- 172.21.15.134:0/3114115781 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f982c057070 con 0x55940aee7550 2024-04-24T02:12:21.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.740+0000 7f9728608640 1 -- 172.21.15.134:0/3114115781 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f982c063070 con 0x55940aee7550 2024-04-24T02:12:21.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.740+0000 7f9728608640 1 -- 172.21.15.134:0/3114115781 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f982c052720 con 0x55940aee7550 2024-04-24T02:12:21.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.741+0000 7f983e72f800 1 -- 172.21.15.134:0/3114115781 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55940aee7550 msgr2=0x55940b066870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.741+0000 7f983e72f800 1 --2- 172.21.15.134:0/3114115781 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55940aee7550 0x55940b066870 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f982c000c00 tx=0x7f982c04c000 comp rx=0 tx=0).stop 2024-04-24T02:12:21.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.741+0000 7f983e72f800 1 -- 172.21.15.134:0/3114115781 shutdown_connections 2024-04-24T02:12:21.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.741+0000 7f983e72f800 1 --2- 172.21.15.134:0/3114115781 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55940aee7550 0x55940b066870 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.741+0000 7f983e72f800 1 -- 172.21.15.134:0/3114115781 >> 172.21.15.134:0/3114115781 conn(0x55940af6e4d0 msgr2=0x55940b062190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:21.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.741+0000 7f983e72f800 1 -- 172.21.15.134:0/3114115781 shutdown_connections 2024-04-24T02:12:21.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.741+0000 7f983e72f800 1 -- 172.21.15.134:0/3114115781 wait complete. 2024-04-24T02:12:21.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.742+0000 7f983e72f800 1 Processor -- start 2024-04-24T02:12:21.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.742+0000 7f983e72f800 1 -- start start 2024-04-24T02:12:21.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.742+0000 7f983e72f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55940aee7550 0x55940b06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.742+0000 7f983e72f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55940af7e790 con 0x55940aee7550 2024-04-24T02:12:21.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.742+0000 7f983a3ae640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55940aee7550 0x55940b06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.742+0000 7f983a3ae640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55940aee7550 0x55940b06e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45510/0 (socket says 172.21.15.134:45510) 2024-04-24T02:12:21.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.742+0000 7f983a3ae640 1 -- 172.21.15.134:0/1644769069 learned_addr learned my addr 172.21.15.134:0/1644769069 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:21.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.742+0000 7f983a3ae640 1 -- 172.21.15.134:0/1644769069 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55940b06e860 con 0x55940aee7550 2024-04-24T02:12:21.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.742+0000 7f983a3ae640 1 --2- 172.21.15.134:0/1644769069 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55940aee7550 0x55940b06e320 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f982c000c00 tx=0x7f982c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.743+0000 7f9726e05640 1 -- 172.21.15.134:0/1644769069 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f982c052c70 con 0x55940aee7550 2024-04-24T02:12:21.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.743+0000 7f9726e05640 1 -- 172.21.15.134:0/1644769069 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f982c06c070 con 0x55940aee7550 2024-04-24T02:12:21.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.743+0000 7f983e72f800 1 -- 172.21.15.134:0/1644769069 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55940b06eaf0 con 0x55940aee7550 2024-04-24T02:12:21.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.743+0000 7f9726e05640 1 -- 172.21.15.134:0/1644769069 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f982c05e480 con 0x55940aee7550 2024-04-24T02:12:21.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.743+0000 7f983e72f800 1 -- 172.21.15.134:0/1644769069 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55940b0717a0 con 0x55940aee7550 2024-04-24T02:12:21.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.743+0000 7f9726e05640 1 -- 172.21.15.134:0/1644769069 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f982c06e030 con 0x55940aee7550 2024-04-24T02:12:21.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.744+0000 7f9726e05640 1 --2- 172.21.15.134:0/1644769069 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f97200369a0 0x7f9720038e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.744+0000 7f9726e05640 1 -- 172.21.15.134:0/1644769069 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f982c08e100 con 0x55940aee7550 2024-04-24T02:12:21.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.744+0000 7f9831bad640 1 --2- 172.21.15.134:0/1644769069 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f97200369a0 0x7f9720038e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.744+0000 7f983e72f800 1 --2- 172.21.15.134:0/1644769069 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55940aee8a60 0x55940b075560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.744+0000 7f983e72f800 1 -- 172.21.15.134:0/1644769069 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55940b075ae0 con 0x55940aee8a60 2024-04-24T02:12:21.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.744+0000 7f983abaf640 1 --2- 172.21.15.134:0/1644769069 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55940aee8a60 0x55940b075560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.744+0000 7f9831bad640 1 --2- 172.21.15.134:0/1644769069 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f97200369a0 0x7f9720038e60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9824000f60 tx=0x7f98240012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.744+0000 7f983abaf640 1 --2- 172.21.15.134:0/1644769069 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55940aee8a60 0x55940b075560 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.744+0000 7f983abaf640 1 -- 172.21.15.134:0/1644769069 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f983400a4a0 con 0x55940aee8a60 2024-04-24T02:12:21.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.744+0000 7f983e72f800 1 -- 172.21.15.134:0/1644769069 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55940b072b10 con 0x55940aee8a60 2024-04-24T02:12:21.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.745+0000 7f983abaf640 1 -- 172.21.15.134:0/1644769069 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f983400a4a0 con 0x55940aee8a60 2024-04-24T02:12:21.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.745+0000 7f983e72f800 1 -- 172.21.15.134:0/1644769069 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55940b0778e0 con 0x55940aee8a60 2024-04-24T02:12:21.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.745+0000 7f983abaf640 1 -- 172.21.15.134:0/1644769069 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f983400a4a0 con 0x55940aee8a60 2024-04-24T02:12:21.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.745+0000 7f983e72f800 1 -- 172.21.15.134:0/1644769069 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55940b076c20 con 0x55940aee8a60 2024-04-24T02:12:21.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.745+0000 7f983abaf640 1 -- 172.21.15.134:0/1644769069 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f983400a4a0 con 0x55940aee8a60 2024-04-24T02:12:21.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.745+0000 7f983e72f800 1 -- 172.21.15.134:0/1644769069 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55940b077040 con 0x55940aee8a60 2024-04-24T02:12:21.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.746+0000 7f983abaf640 1 -- 172.21.15.134:0/1644769069 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f983400a4a0 con 0x55940aee8a60 2024-04-24T02:12:21.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.746+0000 7f983e72f800 1 Processor -- start 2024-04-24T02:12:21.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.746+0000 7f983e72f800 1 -- start start 2024-04-24T02:12:21.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.746+0000 7f983e72f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55940b0866d0 0x55940b086af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.746+0000 7f983e72f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55940ae646b0 con 0x55940b0866d0 2024-04-24T02:12:21.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.746+0000 7f9831bad640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55940b0866d0 0x55940b086af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.746+0000 7f9831bad640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55940b0866d0 0x55940b086af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45520/0 (socket says 172.21.15.134:45520) 2024-04-24T02:12:21.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.746+0000 7f9831bad640 1 -- 172.21.15.134:0/13982909 learned_addr learned my addr 172.21.15.134:0/13982909 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:21.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.747+0000 7f9831bad640 1 -- 172.21.15.134:0/13982909 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55940b087030 con 0x55940b0866d0 2024-04-24T02:12:21.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.747+0000 7f9831bad640 1 --2- 172.21.15.134:0/13982909 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55940b0866d0 0x55940b086af0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9824001ed0 tx=0x7f982400d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.747+0000 7f971ffff640 1 -- 172.21.15.134:0/13982909 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f982401b550 con 0x55940b0866d0 2024-04-24T02:12:21.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.747+0000 7f971ffff640 1 -- 172.21.15.134:0/13982909 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f982401b6f0 con 0x55940b0866d0 2024-04-24T02:12:21.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.747+0000 7f983e72f800 1 -- 172.21.15.134:0/13982909 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55940b087aa0 con 0x55940b0866d0 2024-04-24T02:12:21.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.747+0000 7f971ffff640 1 -- 172.21.15.134:0/13982909 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f982401b9d0 con 0x55940b0866d0 2024-04-24T02:12:21.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.747+0000 7f983e72f800 1 -- 172.21.15.134:0/13982909 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55940b087fa0 con 0x55940b0866d0 2024-04-24T02:12:21.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.748+0000 7f971ffff640 1 -- 172.21.15.134:0/13982909 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9824023020 con 0x55940b0866d0 2024-04-24T02:12:21.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.748+0000 7f971ffff640 1 --2- 172.21.15.134:0/13982909 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9714036950 0x7f9714038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.748+0000 7f971ffff640 1 -- 172.21.15.134:0/13982909 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f9824021020 con 0x55940b0866d0 2024-04-24T02:12:21.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.748+0000 7f983abaf640 1 --2- 172.21.15.134:0/13982909 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9714036950 0x7f9714038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.748+0000 7f983e72f800 1 Processor -- start 2024-04-24T02:12:21.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.748+0000 7f983e72f800 1 -- start start 2024-04-24T02:12:21.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.748+0000 7f983abaf640 1 --2- 172.21.15.134:0/13982909 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9714036950 0x7f9714038e10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x55940b076fc0 tx=0x7f9834005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.748+0000 7f983e72f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55940b093a10 0x55940b093e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.749+0000 7f983e72f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55940b067100 con 0x55940b093a10 2024-04-24T02:12:21.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.749+0000 7f9831bad640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55940b093a10 0x55940b093e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.749+0000 7f9831bad640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55940b093a10 0x55940b093e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45528/0 (socket says 172.21.15.134:45528) 2024-04-24T02:12:21.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.749+0000 7f9831bad640 1 -- 172.21.15.134:0/3516074215 learned_addr learned my addr 172.21.15.134:0/3516074215 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:21.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.749+0000 7f9831bad640 1 -- 172.21.15.134:0/3516074215 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55940b094400 con 0x55940b093a10 2024-04-24T02:12:21.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.749+0000 7f9831bad640 1 --2- 172.21.15.134:0/3516074215 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55940b093a10 0x55940b093e30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f982404ce10 tx=0x7f9824019ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a571af5f7f9d4700 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.749+0000 7f971dffb640 1 -- 172.21.15.134:0/3516074215 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98240258e0 con 0x55940b093a10 2024-04-24T02:12:21.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.749+0000 7f971dffb640 1 -- 172.21.15.134:0/3516074215 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9824025410 con 0x55940b093a10 2024-04-24T02:12:21.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.749+0000 7f971dffb640 1 -- 172.21.15.134:0/3516074215 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9824025a80 con 0x55940b093a10 2024-04-24T02:12:21.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.750+0000 7f983e72f800 1 -- 172.21.15.134:0/3516074215 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55940b093a10 msgr2=0x55940b093e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.750+0000 7f983e72f800 1 --2- 172.21.15.134:0/3516074215 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55940b093a10 0x55940b093e30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f982404ce10 tx=0x7f9824019ce0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.750+0000 7f983e72f800 1 -- 172.21.15.134:0/3516074215 shutdown_connections 2024-04-24T02:12:21.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.750+0000 7f983e72f800 1 --2- 172.21.15.134:0/3516074215 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55940b093a10 0x55940b093e30 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.750+0000 7f983e72f800 1 -- 172.21.15.134:0/3516074215 >> 172.21.15.134:0/3516074215 conn(0x55940b08fd70 msgr2=0x55940b08ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:21.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.750+0000 7f983e72f800 1 -- 172.21.15.134:0/3516074215 shutdown_connections 2024-04-24T02:12:21.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.750+0000 7f983e72f800 1 -- 172.21.15.134:0/3516074215 wait complete. 2024-04-24T02:12:21.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.750+0000 7f983e72f800 1 Processor -- start 2024-04-24T02:12:21.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.750+0000 7f983e72f800 1 -- start start 2024-04-24T02:12:21.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.750+0000 7f983e72f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55940b093a10 0x55940b09b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.750+0000 7f983e72f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55940b094b70 con 0x55940b093a10 2024-04-24T02:12:21.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.750+0000 7f9831bad640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55940b093a10 0x55940b09b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.750+0000 7f9831bad640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55940b093a10 0x55940b09b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45530/0 (socket says 172.21.15.134:45530) 2024-04-24T02:12:21.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.750+0000 7f9831bad640 1 -- 172.21.15.134:0/1576337072 learned_addr learned my addr 172.21.15.134:0/1576337072 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:21.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.750+0000 7f9831bad640 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55940b09b610 con 0x55940b093a10 2024-04-24T02:12:21.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.751+0000 7f9831bad640 1 --2- 172.21.15.134:0/1576337072 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55940b093a10 0x55940b09b0d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9824019f50 tx=0x7f982404cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.751+0000 7f970bfff640 1 -- 172.21.15.134:0/1576337072 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f982400cc60 con 0x55940b093a10 2024-04-24T02:12:21.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.751+0000 7f970bfff640 1 -- 172.21.15.134:0/1576337072 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f982400ce00 con 0x55940b093a10 2024-04-24T02:12:21.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.751+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55940b09b8a0 con 0x55940b093a10 2024-04-24T02:12:21.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.751+0000 7f970bfff640 1 -- 172.21.15.134:0/1576337072 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9824024370 con 0x55940b093a10 2024-04-24T02:12:21.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.751+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55940b09b8a0 con 0x55940b093a10 2024-04-24T02:12:21.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.751+0000 7f970bfff640 1 -- 172.21.15.134:0/1576337072 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f98240245d0 con 0x55940b093a10 2024-04-24T02:12:21.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.752+0000 7f970bfff640 1 --2- 172.21.15.134:0/1576337072 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9704036900 0x7f9704038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.752+0000 7f970bfff640 1 -- 172.21.15.134:0/1576337072 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f982403aab0 con 0x55940b093a10 2024-04-24T02:12:21.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.752+0000 7f983abaf640 1 --2- 172.21.15.134:0/1576337072 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9704036900 0x7f9704038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.752+0000 7f983abaf640 1 --2- 172.21.15.134:0/1576337072 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9704036900 0x7f9704038dc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x55940b076740 tx=0x7f983401f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.752+0000 7f983e72f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.752+0000 7f983e72f800 1 --2- 172.21.15.134:0/1576337072 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55940b0a6a00 0x55940b0a8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.752+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55940b0a9610 con 0x55940b0a6a00 2024-04-24T02:12:21.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.752+0000 7f983a3ae640 1 --2- 172.21.15.134:0/1576337072 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55940b0a6a00 0x55940b0a8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.753+0000 7f983a3ae640 1 --2- 172.21.15.134:0/1576337072 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55940b0a6a00 0x55940b0a8ec0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.753+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f982c070410 con 0x55940b0a6a00 2024-04-24T02:12:21.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.753+0000 7f983e72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:21.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.753+0000 7f983e72f800 20 realm 2024-04-24T02:12:21.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.753+0000 7f983e72f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.753+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55940b0a9a20 con 0x55940b0a6a00 2024-04-24T02:12:21.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.753+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f982c070410 con 0x55940b0a6a00 2024-04-24T02:12:21.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.753+0000 7f983e72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:21.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.753+0000 7f983e72f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:21.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.753+0000 7f983e72f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.753+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55940b0aa2f0 con 0x55940b0a6a00 2024-04-24T02:12:21.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.753+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f982c070410 con 0x55940b0a6a00 2024-04-24T02:12:21.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.753+0000 7f983e72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:21.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.753+0000 7f983e72f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.753+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55940b0aa690 con 0x55940b0a6a00 2024-04-24T02:12:21.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.754+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f982c070410 con 0x55940b0a6a00 2024-04-24T02:12:21.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.754+0000 7f983e72f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:21.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.754+0000 7f983e72f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.754+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55940b0aaee0 con 0x55940b0a6a00 2024-04-24T02:12:21.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.754+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f982c070410 con 0x55940b0a6a00 2024-04-24T02:12:21.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.754+0000 7f983e72f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:21.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.754+0000 7f983e72f800 20 searching for the correct realm 2024-04-24T02:12:21.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.754+0000 7f983e72f800 1 --2- 172.21.15.134:0/1576337072 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55940b0acc50 0x55940b0af040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.754+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55940b0af620 con 0x55940b0acc50 2024-04-24T02:12:21.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.754+0000 7f9831bad640 1 --2- 172.21.15.134:0/1576337072 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55940b0acc50 0x55940b0af040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.754+0000 7f9831bad640 1 --2- 172.21.15.134:0/1576337072 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55940b0acc50 0x55940b0af040 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.755+0000 7f9831bad640 1 -- 172.21.15.134:0/1576337072 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9824009050 con 0x55940b0acc50 2024-04-24T02:12:21.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.755+0000 7f9831bad640 1 --2- 172.21.15.134:0/1576337072 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f98240234d0 0x7f9824044670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.755+0000 7f9831bad640 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55940b0af620 con 0x7f98240234d0 2024-04-24T02:12:21.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.755+0000 7f983abaf640 1 --2- 172.21.15.134:0/1576337072 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f98240234d0 0x7f9824044670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.755+0000 7f983abaf640 1 --2- 172.21.15.134:0/1576337072 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f98240234d0 0x7f9824044670 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.755+0000 7f983abaf640 1 -- 172.21.15.134:0/1576337072 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f983401f070 con 0x7f98240234d0 2024-04-24T02:12:21.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.755+0000 7f983abaf640 1 --2- 172.21.15.134:0/1576337072 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f9834031040 0x7f9834032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.755+0000 7f983abaf640 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55940b0af620 con 0x7f9834031040 2024-04-24T02:12:21.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.755+0000 7f983a3ae640 1 --2- 172.21.15.134:0/1576337072 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f9834031040 0x7f9834032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.756+0000 7f983a3ae640 1 --2- 172.21.15.134:0/1576337072 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f9834031040 0x7f9834032940 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.756+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f982c070410 con 0x7f9834031040 2024-04-24T02:12:21.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.756+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55940b0af620 con 0x55940b0a6a00 2024-04-24T02:12:21.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.756+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f982c070410 con 0x55940b0a6a00 2024-04-24T02:12:21.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.756+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55940b0af620 con 0x55940b0a6a00 2024-04-24T02:12:21.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.757+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f982c070410 con 0x55940b0a6a00 2024-04-24T02:12:21.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.757+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55940b0af620 con 0x7f9834031040 2024-04-24T02:12:21.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.757+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f982c070410 con 0x7f9834031040 2024-04-24T02:12:21.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.757+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55940b0af620 con 0x7f9834031040 2024-04-24T02:12:21.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.757+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f982c070410 con 0x7f9834031040 2024-04-24T02:12:21.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.757+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55940b0af620 con 0x7f98240234d0 2024-04-24T02:12:21.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.757+0000 7f983abaf640 1 -- 172.21.15.134:0/1576337072 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f983401f070 con 0x7f98240234d0 2024-04-24T02:12:21.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.757+0000 7f983abaf640 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55940b0af620 con 0x55940b0acc50 2024-04-24T02:12:21.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.758+0000 7f9831bad640 1 -- 172.21.15.134:0/1576337072 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9824009050 con 0x55940b0acc50 2024-04-24T02:12:21.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.758+0000 7f9831bad640 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55940b0af620 con 0x55940b0a6a00 2024-04-24T02:12:21.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.758+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f982c070410 con 0x55940b0a6a00 2024-04-24T02:12:21.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.758+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55940b0af620 con 0x7f9834031040 2024-04-24T02:12:21.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.758+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f982c070410 con 0x7f9834031040 2024-04-24T02:12:21.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.758+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55940b0af620 con 0x55940b0a6a00 2024-04-24T02:12:21.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.758+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f982c070410 con 0x55940b0a6a00 2024-04-24T02:12:21.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.758+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55940b0af620 con 0x7f98240234d0 2024-04-24T02:12:21.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.759+0000 7f983abaf640 1 -- 172.21.15.134:0/1576337072 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f983401f070 con 0x7f98240234d0 2024-04-24T02:12:21.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.759+0000 7f983abaf640 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55940b0af620 con 0x55940b0acc50 2024-04-24T02:12:21.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.759+0000 7f9831bad640 1 -- 172.21.15.134:0/1576337072 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9824009050 con 0x55940b0acc50 2024-04-24T02:12:21.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.759+0000 7f9831bad640 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55940b0af620 con 0x55940b0acc50 2024-04-24T02:12:21.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.759+0000 7f9831bad640 1 -- 172.21.15.134:0/1576337072 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9824009050 con 0x55940b0acc50 2024-04-24T02:12:21.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.759+0000 7f9831bad640 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55940b0af620 con 0x7f9834031040 2024-04-24T02:12:21.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.759+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f982c070410 con 0x7f9834031040 2024-04-24T02:12:21.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.759+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55940b0af620 con 0x55940b0acc50 2024-04-24T02:12:21.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.759+0000 7f9831bad640 1 -- 172.21.15.134:0/1576337072 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9824009050 con 0x55940b0acc50 2024-04-24T02:12:21.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.759+0000 7f9831bad640 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55940b0af620 con 0x55940b0acc50 2024-04-24T02:12:21.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.760+0000 7f9831bad640 1 -- 172.21.15.134:0/1576337072 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9824009050 con 0x55940b0acc50 2024-04-24T02:12:21.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.760+0000 7f9831bad640 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55940b0af620 con 0x55940b0a6a00 2024-04-24T02:12:21.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.760+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f982c070410 con 0x55940b0a6a00 2024-04-24T02:12:21.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.760+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55940b0af620 con 0x55940b0a6a00 2024-04-24T02:12:21.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.760+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f982c070410 con 0x55940b0a6a00 2024-04-24T02:12:21.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.760+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55940b0af620 con 0x7f9834031040 2024-04-24T02:12:21.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.760+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f982c070410 con 0x7f9834031040 2024-04-24T02:12:21.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.760+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55940b0af620 con 0x55940b0acc50 2024-04-24T02:12:21.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.761+0000 7f9831bad640 1 -- 172.21.15.134:0/1576337072 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9824009050 con 0x55940b0acc50 2024-04-24T02:12:21.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.761+0000 7f9831bad640 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55940b0af620 con 0x7f98240234d0 2024-04-24T02:12:21.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.761+0000 7f983abaf640 1 -- 172.21.15.134:0/1576337072 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f983401f070 con 0x7f98240234d0 2024-04-24T02:12:21.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.761+0000 7f983abaf640 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55940b0af620 con 0x55940b0a6a00 2024-04-24T02:12:21.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.761+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f982c070410 con 0x55940b0a6a00 2024-04-24T02:12:21.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.761+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55940b0af620 con 0x7f9834031040 2024-04-24T02:12:21.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.761+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f982c070410 con 0x7f9834031040 2024-04-24T02:12:21.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.761+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55940b0af620 con 0x55940b0acc50 2024-04-24T02:12:21.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.762+0000 7f9831bad640 1 -- 172.21.15.134:0/1576337072 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9824009050 con 0x55940b0acc50 2024-04-24T02:12:21.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.762+0000 7f9831bad640 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55940b0af620 con 0x7f9834031040 2024-04-24T02:12:21.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.762+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f982c070410 con 0x7f9834031040 2024-04-24T02:12:21.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.762+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55940b0af620 con 0x7f98240234d0 2024-04-24T02:12:21.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.762+0000 7f983abaf640 1 -- 172.21.15.134:0/1576337072 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f983401f070 con 0x7f98240234d0 2024-04-24T02:12:21.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.762+0000 7f983abaf640 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55940b0af620 con 0x55940b0acc50 2024-04-24T02:12:21.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.762+0000 7f9831bad640 1 -- 172.21.15.134:0/1576337072 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9824009050 con 0x55940b0acc50 2024-04-24T02:12:21.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.762+0000 7f9831bad640 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55940b0af620 con 0x7f9834031040 2024-04-24T02:12:21.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.763+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f982c070410 con 0x7f9834031040 2024-04-24T02:12:21.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.763+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55940b0af620 con 0x55940b0a6a00 2024-04-24T02:12:21.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.763+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f982c070410 con 0x55940b0a6a00 2024-04-24T02:12:21.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.763+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55940b0af620 con 0x7f98240234d0 2024-04-24T02:12:21.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.763+0000 7f983abaf640 1 -- 172.21.15.134:0/1576337072 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f983401f070 con 0x7f98240234d0 2024-04-24T02:12:21.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.763+0000 7f983e72f800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:21.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.763+0000 7f983e72f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:21.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.763+0000 7f983e72f800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:21.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.763+0000 7f983e72f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:21.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.763+0000 7f983e72f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:21.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.763+0000 7f983e72f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:21.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.763+0000 7f983e72f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.763+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55940b0ab860 con 0x55940b0a6a00 2024-04-24T02:12:21.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.763+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f982c070410 con 0x55940b0a6a00 2024-04-24T02:12:21.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.763+0000 7f983e72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:21.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.763+0000 7f983e72f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.763+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55940b0ac100 con 0x55940b0a6a00 2024-04-24T02:12:21.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.763+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f982c070410 con 0x55940b0a6a00 2024-04-24T02:12:21.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.763+0000 7f983e72f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:21.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.763+0000 7f983e72f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.763+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55940b0afaa0 con 0x55940b0a6a00 2024-04-24T02:12:21.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.764+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f982c070410 con 0x55940b0a6a00 2024-04-24T02:12:21.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.764+0000 7f983e72f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:21.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.764+0000 7f983e72f800 20 zone default found 2024-04-24T02:12:21.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.764+0000 7f983e72f800 4 Realm: () 2024-04-24T02:12:21.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.764+0000 7f983e72f800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:21.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.764+0000 7f983e72f800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:21.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.764+0000 7f983e72f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:21.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.764+0000 7f983e72f800 20 zonegroup default 2024-04-24T02:12:21.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.764+0000 7f983e72f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.764+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55940b0abd50 con 0x7f9834031040 2024-04-24T02:12:21.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.764+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f982c070410 con 0x7f9834031040 2024-04-24T02:12:21.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.764+0000 7f983e72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:21.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.764+0000 7f983e72f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.764+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55940b0b1e80 con 0x55940b0acc50 2024-04-24T02:12:21.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.764+0000 7f9831bad640 1 -- 172.21.15.134:0/1576337072 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9824009050 con 0x55940b0acc50 2024-04-24T02:12:21.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.764+0000 7f983e72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:21.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.764+0000 7f983e72f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.764+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55940b0b2220 con 0x55940b0acc50 2024-04-24T02:12:21.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.765+0000 7f9831bad640 1 -- 172.21.15.134:0/1576337072 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9824009050 con 0x55940b0acc50 2024-04-24T02:12:21.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.765+0000 7f983e72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:21.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.765+0000 7f983e72f800 20 started sync module instance, tier type = 2024-04-24T02:12:21.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.765+0000 7f983e72f800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:21.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.765+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55940b0b12c0 con 0x7f98240234d0 2024-04-24T02:12:21.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.766+0000 7f983abaf640 1 -- 172.21.15.134:0/1576337072 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9834040040 con 0x7f98240234d0 2024-04-24T02:12:21.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.766+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94094328796848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55940b0b1ad0 con 0x7f98240234d0 2024-04-24T02:12:21.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.766+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55940b0b2fa0 con 0x55940b0a6a00 2024-04-24T02:12:21.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.767+0000 7f983abaf640 1 -- 172.21.15.134:0/1576337072 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94094328796848] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9834040040 con 0x7f98240234d0 2024-04-24T02:12:21.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.767+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f982c070410 con 0x55940b0a6a00 2024-04-24T02:12:21.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.767+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94094328800704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55940b0b3390 con 0x55940b0a6a00 2024-04-24T02:12:21.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.767+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55940b0b3dd0 con 0x55940b0acc50 2024-04-24T02:12:21.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.768+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94094328800704] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f982c070410 con 0x55940b0a6a00 2024-04-24T02:12:21.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.768+0000 7f9831bad640 1 -- 172.21.15.134:0/1576337072 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9824009050 con 0x55940b0acc50 2024-04-24T02:12:21.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.768+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94094328805536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55940b0b4170 con 0x55940b0acc50 2024-04-24T02:12:21.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.768+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55940b0b4bc0 con 0x7f98240234d0 2024-04-24T02:12:21.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.769+0000 7f9831bad640 1 -- 172.21.15.134:0/1576337072 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94094328805536] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9824009050 con 0x55940b0acc50 2024-04-24T02:12:21.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.769+0000 7f983abaf640 1 -- 172.21.15.134:0/1576337072 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9834040040 con 0x7f98240234d0 2024-04-24T02:12:21.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.769+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94094328809136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55940b0b4fe0 con 0x7f98240234d0 2024-04-24T02:12:21.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.769+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55940b0b5a20 con 0x55940b0a6a00 2024-04-24T02:12:21.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.770+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f982c070410 con 0x55940b0a6a00 2024-04-24T02:12:21.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.770+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94094328812784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55940b0b59e0 con 0x55940b0a6a00 2024-04-24T02:12:21.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.770+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55940b0b69d0 con 0x7f9834031040 2024-04-24T02:12:21.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.771+0000 7f983abaf640 1 -- 172.21.15.134:0/1576337072 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94094328809136] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9834040040 con 0x7f98240234d0 2024-04-24T02:12:21.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.771+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94094328812784] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f982c070410 con 0x55940b0a6a00 2024-04-24T02:12:21.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.771+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f982c070410 con 0x7f9834031040 2024-04-24T02:12:21.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.771+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94094328816864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55940b0b69d0 con 0x7f9834031040 2024-04-24T02:12:21.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.771+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55940b0b6df0 con 0x7f9834031040 2024-04-24T02:12:21.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.772+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94094328816864] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f982c070410 con 0x7f9834031040 2024-04-24T02:12:21.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.772+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(56 notify.6 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f982c070410 con 0x7f9834031040 2024-04-24T02:12:21.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.772+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94094328815024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55940b0b2ae0 con 0x7f9834031040 2024-04-24T02:12:21.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.772+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55940b0b77e0 con 0x7f9834031040 2024-04-24T02:12:21.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.773+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(58 notify.7 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f982c070410 con 0x7f9834031040 2024-04-24T02:12:21.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.773+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94094328820400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55940b0b7fb0 con 0x7f9834031040 2024-04-24T02:12:21.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.773+0000 7f983e72f800 20 add_watcher() i=0 2024-04-24T02:12:21.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.773+0000 7f983e72f800 20 add_watcher() i=1 2024-04-24T02:12:21.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.773+0000 7f983e72f800 20 add_watcher() i=2 2024-04-24T02:12:21.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.773+0000 7f983e72f800 20 add_watcher() i=3 2024-04-24T02:12:21.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.773+0000 7f983e72f800 20 add_watcher() i=4 2024-04-24T02:12:21.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.773+0000 7f983e72f800 20 add_watcher() i=5 2024-04-24T02:12:21.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.773+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94094328815024] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f982c070410 con 0x7f9834031040 2024-04-24T02:12:21.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.773+0000 7f983e72f800 20 add_watcher() i=6 2024-04-24T02:12:21.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.774+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94094328820400] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f982c070410 con 0x7f9834031040 2024-04-24T02:12:21.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.774+0000 7f983e72f800 20 add_watcher() i=7 2024-04-24T02:12:21.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.774+0000 7f983e72f800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:21.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.774+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55940b0b6bb0 con 0x55940b0a6a00 2024-04-24T02:12:21.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.774+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f982c070410 con 0x55940b0a6a00 2024-04-24T02:12:21.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.774+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94094328818608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55940b0b84f0 con 0x55940b0a6a00 2024-04-24T02:12:21.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.775+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94094328818608] v30'56 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f982c070410 con 0x55940b0a6a00 2024-04-24T02:12:21.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.775+0000 7f96f0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:21.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.775+0000 7f983e72f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:21.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.775+0000 7f983e72f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:21.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.776+0000 7f983e72f800 5 note: GC not initialized 2024-04-24T02:12:21.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.776+0000 7f966b7fe640 20 reqs_thread_entry: start 2024-04-24T02:12:21.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.776+0000 7f983e72f800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:21.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.776+0000 7f983e72f800 20 Filter name: none 2024-04-24T02:12:21.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.776+0000 7f96697fa640 20 reqs_thread_entry: start 2024-04-24T02:12:21.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.776+0000 7f983e72f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T02:12:21.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.776+0000 7f983e72f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.776+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55940b0ee3e0 con 0x55940b0a6a00 2024-04-24T02:12:21.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.776+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f982c070410 con 0x55940b0a6a00 2024-04-24T02:12:21.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.776+0000 7f983e72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:21.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.776+0000 7f983e72f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-04-24T02:12:21.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.776+0000 7f983e72f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:21.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.776+0000 7f983e72f800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-04-24T02:12:21.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.776+0000 7f983e72f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.776+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55940b0ecb80 con 0x55940b0a6a00 2024-04-24T02:12:21.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.776+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f982c070410 con 0x55940b0a6a00 2024-04-24T02:12:21.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.777+0000 7f983e72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:21.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.777+0000 7f983e72f800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-04-24T02:12:21.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.777+0000 7f983e72f800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-04-24T02:12:21.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.777+0000 7f983e72f800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-04-24T02:12:21.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.777+0000 7f983e72f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.777+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55940b0ecf70 con 0x7f9834031040 2024-04-24T02:12:21.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.777+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f982c070410 con 0x7f9834031040 2024-04-24T02:12:21.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.777+0000 7f983e72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:21.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.777+0000 7f983e72f800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-04-24T02:12:21.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.777+0000 7f983e72f800 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-04-24T02:12:21.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.777+0000 7f983e72f800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-04-24T02:12:21.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.777+0000 7f983e72f800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-04-24T02:12:21.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.777+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55940b0edec0 con 0x55940b0a6a00 2024-04-24T02:12:21.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.778+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~391] v30'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f982c070410 con 0x55940b0a6a00 2024-04-24T02:12:21.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.778+0000 7f983e72f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T02:12:21.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.778+0000 7f983e72f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:21.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.778+0000 7f983e72f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-24T02:12:21.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.778+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 94094329041840 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55940b0f1e60 con 0x55940b0a6a00 2024-04-24T02:12:21.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.778+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== watch-notify(notify (1) cookie 94094328812784 notify 128849018880 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55940b0ed160 con 0x55940b0a6a00 2024-04-24T02:12:21.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.778+0000 7f971dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018880 cookie 94094328812784 notifier 4285 bl.length()=567 2024-04-24T02:12:21.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.778+0000 7f971dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T02:12:21.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.778+0000 7f971dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:21.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.778+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(66 notify.4 [notify cookie 94094329041840 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f982c070410 con 0x55940b0a6a00 2024-04-24T02:12:21.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.778+0000 7f971dffb640 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f9700003ea0 con 0x55940b0a6a00 2024-04-24T02:12:21.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.779+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f982c070410 con 0x55940b0a6a00 2024-04-24T02:12:21.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.779+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== watch-notify(notify_complete (2) cookie 94094329041840 notify 128849018880 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f982c094040 con 0x55940b0a6a00 2024-04-24T02:12:21.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.779+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55940b0ed330 con 0x55940b0a6a00 2024-04-24T02:12:21.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.780+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.1 v2:172.21.15.134:6804/1487076214 30 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f982c070410 con 0x55940b0a6a00 2024-04-24T02:12:21.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.780+0000 7f983e72f800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-04-24T02:12:21.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.780+0000 7f983e72f800 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-04-24T02:12:21.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.780+0000 7f983e72f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-04-24T02:12:21.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.780+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94094329041712 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55940b0f1e60 con 0x7f98240234d0 2024-04-24T02:12:21.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.780+0000 7f983abaf640 1 -- 172.21.15.134:0/1576337072 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== watch-notify(notify (1) cookie 94094328809136 notify 128849018880 ret 0) ==== 211+0+0 (crc 0 0 0) 0x7f98340247c0 con 0x7f98240234d0 2024-04-24T02:12:21.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.780+0000 7f971dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018880 cookie 94094328809136 notifier 4285 bl.length()=169 2024-04-24T02:12:21.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.780+0000 7f971dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-04-24T02:12:21.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.780+0000 7f971dffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-04-24T02:12:21.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.780+0000 7f983abaf640 1 -- 172.21.15.134:0/1576337072 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(69 notify.3 [notify cookie 94094329041712 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9834040040 con 0x7f98240234d0 2024-04-24T02:12:21.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.780+0000 7f971dffb640 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f9700003ea0 con 0x7f98240234d0 2024-04-24T02:12:21.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.781+0000 7f983abaf640 1 -- 172.21.15.134:0/1576337072 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== watch-notify(notify_complete (2) cookie 94094329041712 notify 128849018880 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f9834024a60 con 0x7f98240234d0 2024-04-24T02:12:21.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.781+0000 7f983abaf640 1 -- 172.21.15.134:0/1576337072 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9834040040 con 0x7f98240234d0 2024-04-24T02:12:21.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.781+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55940b0efe10 con 0x7f9834031040 2024-04-24T02:12:21.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.782+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f982c070410 con 0x7f9834031040 2024-04-24T02:12:21.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.782+0000 7f983e72f800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-04-24T02:12:21.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.782+0000 7f983e72f800 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-04-24T02:12:21.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.782+0000 7f983e72f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-04-24T02:12:21.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.782+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 94094329051488 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55940b0f1370 con 0x7f98240234d0 2024-04-24T02:12:21.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.782+0000 7f983abaf640 1 -- 172.21.15.134:0/1576337072 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== watch-notify(notify (1) cookie 94094328809136 notify 128849018881 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f9834024a60 con 0x7f98240234d0 2024-04-24T02:12:21.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.782+0000 7f971d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018881 cookie 94094328809136 notifier 4285 bl.length()=177 2024-04-24T02:12:21.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.782+0000 7f971d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-04-24T02:12:21.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.782+0000 7f983abaf640 1 -- 172.21.15.134:0/1576337072 <== osd.2 v2:172.21.15.134:6800/214480313 16 ==== osd_op_reply(72 notify.3 [notify cookie 94094329051488 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9834040040 con 0x7f98240234d0 2024-04-24T02:12:21.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.782+0000 7f971d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-04-24T02:12:21.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.782+0000 7f971d7fa640 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f9670003400 con 0x7f98240234d0 2024-04-24T02:12:21.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.782+0000 7f983abaf640 1 -- 172.21.15.134:0/1576337072 <== osd.2 v2:172.21.15.134:6800/214480313 17 ==== watch-notify(notify_complete (2) cookie 94094329051488 notify 128849018881 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f9834043420 con 0x7f98240234d0 2024-04-24T02:12:21.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.782+0000 7f983abaf640 1 -- 172.21.15.134:0/1576337072 <== osd.2 v2:172.21.15.134:6800/214480313 18 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9834040040 con 0x7f98240234d0 2024-04-24T02:12:21.799 INFO:teuthology.orchestra.run.smithi134.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T02:12:21.778798Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T02:12:21.778786Z","tags":[],"group_ids":[]} 2024-04-24T02:12:21.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.783+0000 7f96f0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:21.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.783+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94094328818608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55940b0f1370 con 0x55940b0a6a00 2024-04-24T02:12:21.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.784+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.1 v2:172.21.15.134:6804/1487076214 31 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 94094328818608] v30'57 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f982c070410 con 0x55940b0a6a00 2024-04-24T02:12:21.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.784+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94094328796848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55940b0f1370 con 0x7f98240234d0 2024-04-24T02:12:21.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.785+0000 7f983abaf640 1 -- 172.21.15.134:0/1576337072 <== osd.2 v2:172.21.15.134:6800/214480313 19 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 94094328796848] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9834040040 con 0x7f98240234d0 2024-04-24T02:12:21.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.785+0000 7f983e72f800 20 remove_watcher() i=0 2024-04-24T02:12:21.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.785+0000 7f983e72f800 2 removed watcher, disabling cache 2024-04-24T02:12:21.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.785+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94094328800704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55940b0f1370 con 0x55940b0a6a00 2024-04-24T02:12:21.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.786+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.1 v2:172.21.15.134:6804/1487076214 32 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 94094328800704] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f982c070410 con 0x55940b0a6a00 2024-04-24T02:12:21.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.786+0000 7f983e72f800 20 remove_watcher() i=1 2024-04-24T02:12:21.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.786+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94094328805536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55940b0f1370 con 0x55940b0acc50 2024-04-24T02:12:21.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.787+0000 7f9831bad640 1 -- 172.21.15.134:0/1576337072 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 94094328805536] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9824009050 con 0x55940b0acc50 2024-04-24T02:12:21.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.787+0000 7f983e72f800 20 remove_watcher() i=2 2024-04-24T02:12:21.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.787+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94094328809136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55940b0b25c0 con 0x7f98240234d0 2024-04-24T02:12:21.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.788+0000 7f983abaf640 1 -- 172.21.15.134:0/1576337072 <== osd.2 v2:172.21.15.134:6800/214480313 20 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 94094328809136] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9834040040 con 0x7f98240234d0 2024-04-24T02:12:21.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.788+0000 7f983e72f800 20 remove_watcher() i=3 2024-04-24T02:12:21.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.788+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94094328812784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55940b0b38a0 con 0x55940b0a6a00 2024-04-24T02:12:21.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.789+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.1 v2:172.21.15.134:6804/1487076214 33 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 94094328812784] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f982c070410 con 0x55940b0a6a00 2024-04-24T02:12:21.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.789+0000 7f983e72f800 20 remove_watcher() i=4 2024-04-24T02:12:21.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.789+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94094328816864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55940b0b46b0 con 0x7f9834031040 2024-04-24T02:12:21.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.790+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 94094328816864] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f982c070410 con 0x7f9834031040 2024-04-24T02:12:21.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.790+0000 7f983e72f800 20 remove_watcher() i=5 2024-04-24T02:12:21.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.790+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94094328815024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55940b0b25c0 con 0x7f9834031040 2024-04-24T02:12:21.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.791+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.0 v2:172.21.15.104:6800/2419146313 20 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 94094328815024] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f982c070410 con 0x7f9834031040 2024-04-24T02:12:21.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.791+0000 7f983e72f800 20 remove_watcher() i=6 2024-04-24T02:12:21.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.791+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94094328820400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55940b0b38a0 con 0x7f9834031040 2024-04-24T02:12:21.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.792+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 <== osd.0 v2:172.21.15.104:6800/2419146313 21 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 94094328820400] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f982c070410 con 0x7f9834031040 2024-04-24T02:12:21.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.792+0000 7f983e72f800 20 remove_watcher() i=7 2024-04-24T02:12:21.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.792+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f9834031040 msgr2=0x7f9834032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.792+0000 7f983e72f800 1 --2- 172.21.15.134:0/1576337072 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f9834031040 0x7f9834032940 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.792+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55940b0a6a00 msgr2=0x55940b0a8ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.792+0000 7f983e72f800 1 --2- 172.21.15.134:0/1576337072 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55940b0a6a00 0x55940b0a8ec0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.792+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f98240234d0 msgr2=0x7f9824044670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.792+0000 7f983e72f800 1 --2- 172.21.15.134:0/1576337072 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f98240234d0 0x7f9824044670 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.792+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55940b0acc50 msgr2=0x55940b0af040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.792+0000 7f983e72f800 1 --2- 172.21.15.134:0/1576337072 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55940b0acc50 0x55940b0af040 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.793+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9704036900 msgr2=0x7f9704038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.793+0000 7f983e72f800 1 --2- 172.21.15.134:0/1576337072 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9704036900 0x7f9704038dc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x55940b076740 tx=0x7f983401f000 comp rx=0 tx=0).stop 2024-04-24T02:12:21.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.793+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55940b093a10 msgr2=0x55940b09b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.793+0000 7f983a3ae640 1 -- 172.21.15.134:0/1576337072 reap_dead start 2024-04-24T02:12:21.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.793+0000 7f983e72f800 1 --2- 172.21.15.134:0/1576337072 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55940b093a10 0x55940b09b0d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9824019f50 tx=0x7f982404cda0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.793+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 shutdown_connections 2024-04-24T02:12:21.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.793+0000 7f983e72f800 1 --2- 172.21.15.134:0/1576337072 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55940b093a10 0x55940b09b0d0 secure :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9824019f50 tx=0x7f982404cda0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.793+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 >> 172.21.15.134:0/1576337072 conn(0x55940b08fd70 msgr2=0x55940b08d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:21.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.793+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 shutdown_connections 2024-04-24T02:12:21.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.793+0000 7f983e72f800 1 -- 172.21.15.134:0/1576337072 wait complete. 2024-04-24T02:12:21.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.793+0000 7f983e72f800 1 -- 172.21.15.134:0/13982909 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9714036950 msgr2=0x7f9714038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.793+0000 7f983e72f800 1 --2- 172.21.15.134:0/13982909 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9714036950 0x7f9714038e10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x55940b076fc0 tx=0x7f9834005840 comp rx=0 tx=0).stop 2024-04-24T02:12:21.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.793+0000 7f983e72f800 1 -- 172.21.15.134:0/13982909 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55940b0866d0 msgr2=0x55940b086af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.793+0000 7f983e72f800 1 --2- 172.21.15.134:0/13982909 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55940b0866d0 0x55940b086af0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9824001ed0 tx=0x7f982400d7a0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.793+0000 7f983e72f800 1 -- 172.21.15.134:0/13982909 shutdown_connections 2024-04-24T02:12:21.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.793+0000 7f983e72f800 1 --2- 172.21.15.134:0/13982909 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9714036950 0x7f9714038e10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.793+0000 7f983e72f800 1 --2- 172.21.15.134:0/13982909 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55940b0866d0 0x55940b086af0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.793+0000 7f983e72f800 1 -- 172.21.15.134:0/13982909 >> 172.21.15.134:0/13982909 conn(0x55940b07a770 msgr2=0x55940b07ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:21.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.793+0000 7f983e72f800 1 -- 172.21.15.134:0/13982909 shutdown_connections 2024-04-24T02:12:21.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.793+0000 7f983e72f800 1 -- 172.21.15.134:0/13982909 wait complete. 2024-04-24T02:12:21.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.793+0000 7f983e72f800 1 -- 172.21.15.134:0/1644769069 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55940aee8a60 msgr2=0x55940b075560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.793+0000 7f983e72f800 1 --2- 172.21.15.134:0/1644769069 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55940aee8a60 0x55940b075560 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.793+0000 7f983e72f800 1 -- 172.21.15.134:0/1644769069 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f97200369a0 msgr2=0x7f9720038e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.793+0000 7f983e72f800 1 --2- 172.21.15.134:0/1644769069 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f97200369a0 0x7f9720038e60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9824000f60 tx=0x7f98240012b0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.793+0000 7f983e72f800 1 -- 172.21.15.134:0/1644769069 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55940aee7550 msgr2=0x55940b06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.793+0000 7f983e72f800 1 --2- 172.21.15.134:0/1644769069 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55940aee7550 0x55940b06e320 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f982c000c00 tx=0x7f982c002fb0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.794+0000 7f983e72f800 1 -- 172.21.15.134:0/1644769069 shutdown_connections 2024-04-24T02:12:21.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.794+0000 7f983e72f800 1 --2- 172.21.15.134:0/1644769069 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55940aee8a60 0x55940b075560 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.794+0000 7f983e72f800 1 --2- 172.21.15.134:0/1644769069 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f97200369a0 0x7f9720038e60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.794+0000 7f983e72f800 1 --2- 172.21.15.134:0/1644769069 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55940aee7550 0x55940b06e320 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.794+0000 7f983e72f800 1 -- 172.21.15.134:0/1644769069 >> 172.21.15.134:0/1644769069 conn(0x55940af6e4d0 msgr2=0x55940b060990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:21.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.794+0000 7f983e72f800 1 -- 172.21.15.134:0/1644769069 shutdown_connections 2024-04-24T02:12:21.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.794+0000 7f983e72f800 1 -- 172.21.15.134:0/1644769069 wait complete. 2024-04-24T02:12:21.810 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T02:12:21.778798Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:12:21.778786Z', 'tags': [], 'group_ids': []} 2024-04-24T02:12:21.811 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-04-24T02:12:21.811 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-04-24T02:12:21.811 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-04-24T02:12:21.857 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:21.857 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:21.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.857+0000 7f11810df800 1 Processor -- start 2024-04-24T02:12:21.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.857+0000 7f11810df800 1 -- start start 2024-04-24T02:12:21.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.857+0000 7f11810df800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55f0b68408d0 0x55f0b6842cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.857+0000 7f11810df800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f0b66fed40 con 0x55f0b6843200 2024-04-24T02:12:21.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.857+0000 7f11810df800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55f0b66d14d0 con 0x55f0b68408d0 2024-04-24T02:12:21.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.857+0000 7f117ebe5640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55f0b68408d0 0x55f0b6842cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.857+0000 7f11763e4640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55f0b6843200 0x55f0b68455f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:43198/0 (socket says 172.21.15.134:43198) 2024-04-24T02:12:21.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.857+0000 7f11763e4640 1 -- 172.21.15.134:0/3312290068 learned_addr learned my addr 172.21.15.134:0/3312290068 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:12:21.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.857+0000 7f117ebe5640 1 -- 172.21.15.134:0/3312290068 >> v1:172.21.15.104:6789/0 conn(0x55f0b6843200 legacy=0x55f0b68455f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.857+0000 7f117e3e4640 1 -- 172.21.15.134:0/3312290068 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 766953196 0 0) 0x55f0b66fed40 con 0x55f0b6843200 2024-04-24T02:12:21.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.857+0000 7f117ebe5640 1 -- 172.21.15.134:0/3312290068 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0b66fd590 con 0x55f0b68408d0 2024-04-24T02:12:21.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.859+0000 7f117ebe5640 1 --2- 172.21.15.134:0/3312290068 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f0b68408d0 0x55f0b6842cc0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f117000a470 tx=0x7f117001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2463e38ca25154bd server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.859+0000 7f117e3e4640 1 -- 172.21.15.134:0/3312290068 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1170057070 con 0x55f0b68408d0 2024-04-24T02:12:21.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.859+0000 7f117e3e4640 1 -- 172.21.15.134:0/3312290068 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1170052570 con 0x55f0b68408d0 2024-04-24T02:12:21.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.859+0000 7f117e3e4640 1 -- 172.21.15.134:0/3312290068 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1170052870 con 0x55f0b68408d0 2024-04-24T02:12:21.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.860+0000 7f11810df800 1 -- 172.21.15.134:0/3312290068 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f0b68408d0 msgr2=0x55f0b6842cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.860+0000 7f11810df800 1 --2- 172.21.15.134:0/3312290068 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f0b68408d0 0x55f0b6842cc0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f117000a470 tx=0x7f117001ce90 comp rx=0 tx=0).stop 2024-04-24T02:12:21.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.860+0000 7f11810df800 1 -- 172.21.15.134:0/3312290068 shutdown_connections 2024-04-24T02:12:21.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.860+0000 7f11810df800 1 --2- 172.21.15.134:0/3312290068 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f0b68408d0 0x55f0b6842cc0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.860+0000 7f11810df800 1 -- 172.21.15.134:0/3312290068 >> 172.21.15.134:0/3312290068 conn(0x55f0b683a3a0 msgr2=0x55f0b683c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:21.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.860+0000 7f11810df800 1 -- 172.21.15.134:0/3312290068 shutdown_connections 2024-04-24T02:12:21.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.860+0000 7f11810df800 1 -- 172.21.15.134:0/3312290068 wait complete. 2024-04-24T02:12:21.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.871+0000 7f11810df800 1 Processor -- start 2024-04-24T02:12:21.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.871+0000 7f11810df800 1 -- start start 2024-04-24T02:12:21.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.872+0000 7f11810df800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f0b68408d0 0x55f0b6840210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.872+0000 7f11810df800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55f0b678b3e0 con 0x55f0b68408d0 2024-04-24T02:12:21.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.872+0000 7f117ebe5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f0b68408d0 0x55f0b6840210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.872+0000 7f117ebe5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f0b68408d0 0x55f0b6840210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45548/0 (socket says 172.21.15.134:45548) 2024-04-24T02:12:21.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.872+0000 7f117ebe5640 1 -- 172.21.15.134:0/3699878057 learned_addr learned my addr 172.21.15.134:0/3699878057 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:21.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.872+0000 7f117ebe5640 1 -- 172.21.15.134:0/3699878057 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0b683e7d0 con 0x55f0b68408d0 2024-04-24T02:12:21.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.872+0000 7f117ebe5640 1 --2- 172.21.15.134:0/3699878057 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f0b68408d0 0x55f0b6840210 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1170055040 tx=0x7f117004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d637a50465aa7b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.872+0000 7f106ce09640 1 -- 172.21.15.134:0/3699878057 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1170063070 con 0x55f0b68408d0 2024-04-24T02:12:21.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.872+0000 7f106ce09640 1 -- 172.21.15.134:0/3699878057 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1170058040 con 0x55f0b68408d0 2024-04-24T02:12:21.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.872+0000 7f106ce09640 1 -- 172.21.15.134:0/3699878057 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1170057070 con 0x55f0b68408d0 2024-04-24T02:12:21.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.873+0000 7f11810df800 1 -- 172.21.15.134:0/3699878057 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f0b68408d0 msgr2=0x55f0b6840210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.873+0000 7f11810df800 1 --2- 172.21.15.134:0/3699878057 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f0b68408d0 0x55f0b6840210 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1170055040 tx=0x7f117004c000 comp rx=0 tx=0).stop 2024-04-24T02:12:21.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.873+0000 7f11810df800 1 -- 172.21.15.134:0/3699878057 shutdown_connections 2024-04-24T02:12:21.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.873+0000 7f11810df800 1 --2- 172.21.15.134:0/3699878057 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f0b68408d0 0x55f0b6840210 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.873+0000 7f11810df800 1 -- 172.21.15.134:0/3699878057 >> 172.21.15.134:0/3699878057 conn(0x55f0b683a3a0 msgr2=0x55f0b692c770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:21.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.873+0000 7f11810df800 1 -- 172.21.15.134:0/3699878057 shutdown_connections 2024-04-24T02:12:21.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.873+0000 7f11810df800 1 -- 172.21.15.134:0/3699878057 wait complete. 2024-04-24T02:12:21.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.873+0000 7f11810df800 1 Processor -- start 2024-04-24T02:12:21.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.874+0000 7f11810df800 1 -- start start 2024-04-24T02:12:21.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.874+0000 7f11810df800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f0b68408d0 0x55f0b693ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.874+0000 7f11810df800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55f0b6847010 con 0x55f0b68408d0 2024-04-24T02:12:21.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.874+0000 7f117ebe5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f0b68408d0 0x55f0b693ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.874+0000 7f117ebe5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f0b68408d0 0x55f0b693ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45564/0 (socket says 172.21.15.134:45564) 2024-04-24T02:12:21.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.874+0000 7f117ebe5640 1 -- 172.21.15.134:0/1639268769 learned_addr learned my addr 172.21.15.134:0/1639268769 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:21.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.874+0000 7f117ebe5640 1 -- 172.21.15.134:0/1639268769 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0b693b080 con 0x55f0b68408d0 2024-04-24T02:12:21.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.874+0000 7f117ebe5640 1 --2- 172.21.15.134:0/1639268769 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f0b68408d0 0x55f0b693ab40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1170061040 tx=0x7f1170002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.874+0000 7f106b606640 1 -- 172.21.15.134:0/1639268769 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1170063030 con 0x55f0b68408d0 2024-04-24T02:12:21.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.874+0000 7f106b606640 1 -- 172.21.15.134:0/1639268769 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1170052d90 con 0x55f0b68408d0 2024-04-24T02:12:21.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.874+0000 7f11810df800 1 -- 172.21.15.134:0/1639268769 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f0b693b310 con 0x55f0b68408d0 2024-04-24T02:12:21.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.874+0000 7f106b606640 1 -- 172.21.15.134:0/1639268769 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f117005e5b0 con 0x55f0b68408d0 2024-04-24T02:12:21.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.874+0000 7f11810df800 1 -- 172.21.15.134:0/1639268769 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0b693dfc0 con 0x55f0b68408d0 2024-04-24T02:12:21.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.875+0000 7f106b606640 1 -- 172.21.15.134:0/1639268769 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f117005e750 con 0x55f0b68408d0 2024-04-24T02:12:21.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.875+0000 7f106b606640 1 --2- 172.21.15.134:0/1639268769 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1064036950 0x7f1064038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.875+0000 7f106b606640 1 -- 172.21.15.134:0/1639268769 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f1170064070 con 0x55f0b68408d0 2024-04-24T02:12:21.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.875+0000 7f11763e4640 1 --2- 172.21.15.134:0/1639268769 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1064036950 0x7f1064038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.876+0000 7f11810df800 1 --2- 172.21.15.134:0/1639268769 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f0b6843200 0x55f0b6941d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.876+0000 7f11810df800 1 -- 172.21.15.134:0/1639268769 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f0b69422c0 con 0x55f0b6843200 2024-04-24T02:12:21.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.876+0000 7f117f3e6640 1 --2- 172.21.15.134:0/1639268769 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f0b6843200 0x55f0b6941d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.876+0000 7f11763e4640 1 --2- 172.21.15.134:0/1639268769 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1064036950 0x7f1064038e10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1168000c00 tx=0x7f11680013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.876+0000 7f117f3e6640 1 --2- 172.21.15.134:0/1639268769 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f0b6843200 0x55f0b6941d80 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.876+0000 7f117f3e6640 1 -- 172.21.15.134:0/1639268769 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f117800a4a0 con 0x55f0b6843200 2024-04-24T02:12:21.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.876+0000 7f11810df800 1 -- 172.21.15.134:0/1639268769 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f0b693f330 con 0x55f0b6843200 2024-04-24T02:12:21.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.877+0000 7f117f3e6640 1 -- 172.21.15.134:0/1639268769 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f117800a4a0 con 0x55f0b6843200 2024-04-24T02:12:21.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.877+0000 7f11810df800 1 -- 172.21.15.134:0/1639268769 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f0b69440a0 con 0x55f0b6843200 2024-04-24T02:12:21.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.877+0000 7f117f3e6640 1 -- 172.21.15.134:0/1639268769 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f117800a4a0 con 0x55f0b6843200 2024-04-24T02:12:21.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.877+0000 7f11810df800 1 -- 172.21.15.134:0/1639268769 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f0b69433e0 con 0x55f0b6843200 2024-04-24T02:12:21.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.877+0000 7f117f3e6640 1 -- 172.21.15.134:0/1639268769 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f117800a4a0 con 0x55f0b6843200 2024-04-24T02:12:21.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.877+0000 7f11810df800 1 -- 172.21.15.134:0/1639268769 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f0b6943800 con 0x55f0b6843200 2024-04-24T02:12:21.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.877+0000 7f117f3e6640 1 -- 172.21.15.134:0/1639268769 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f117800a4a0 con 0x55f0b6843200 2024-04-24T02:12:21.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.878+0000 7f11810df800 1 Processor -- start 2024-04-24T02:12:21.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.878+0000 7f11810df800 1 -- start start 2024-04-24T02:12:21.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.878+0000 7f11810df800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f0b6952eb0 0x55f0b69532d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.878+0000 7f11810df800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55f0b67316b0 con 0x55f0b6952eb0 2024-04-24T02:12:21.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.878+0000 7f11763e4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f0b6952eb0 0x55f0b69532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.878+0000 7f11763e4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f0b6952eb0 0x55f0b69532d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45580/0 (socket says 172.21.15.134:45580) 2024-04-24T02:12:21.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.878+0000 7f11763e4640 1 -- 172.21.15.134:0/3883610963 learned_addr learned my addr 172.21.15.134:0/3883610963 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:21.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.878+0000 7f11763e4640 1 -- 172.21.15.134:0/3883610963 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0b6953810 con 0x55f0b6952eb0 2024-04-24T02:12:21.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.879+0000 7f11763e4640 1 --2- 172.21.15.134:0/3883610963 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f0b6952eb0 0x55f0b69532d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f116800e610 tx=0x7f116800ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.879+0000 7f1068e01640 1 -- 172.21.15.134:0/3883610963 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1168022070 con 0x55f0b6952eb0 2024-04-24T02:12:21.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.879+0000 7f1068e01640 1 -- 172.21.15.134:0/3883610963 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1168009050 con 0x55f0b6952eb0 2024-04-24T02:12:21.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.879+0000 7f11810df800 1 -- 172.21.15.134:0/3883610963 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f0b6954280 con 0x55f0b6952eb0 2024-04-24T02:12:21.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.879+0000 7f1068e01640 1 -- 172.21.15.134:0/3883610963 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f116800d500 con 0x55f0b6952eb0 2024-04-24T02:12:21.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.879+0000 7f11810df800 1 -- 172.21.15.134:0/3883610963 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0b6954780 con 0x55f0b6952eb0 2024-04-24T02:12:21.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.879+0000 7f1068e01640 1 -- 172.21.15.134:0/3883610963 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1168025070 con 0x55f0b6952eb0 2024-04-24T02:12:21.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.880+0000 7f1068e01640 1 --2- 172.21.15.134:0/3883610963 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1058036950 0x7f1058038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.880+0000 7f1068e01640 1 -- 172.21.15.134:0/3883610963 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f116804d9e0 con 0x55f0b6952eb0 2024-04-24T02:12:21.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.880+0000 7f117f3e6640 1 --2- 172.21.15.134:0/3883610963 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1058036950 0x7f1058038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.880+0000 7f11810df800 1 Processor -- start 2024-04-24T02:12:21.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.880+0000 7f117f3e6640 1 --2- 172.21.15.134:0/3883610963 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1058036950 0x7f1058038e10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x55f0b6943780 tx=0x7f1178005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.880+0000 7f11810df800 1 -- start start 2024-04-24T02:12:21.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.880+0000 7f11810df800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f0b69601f0 0x55f0b6960610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.880+0000 7f11810df800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55f0b683ea90 con 0x55f0b69601f0 2024-04-24T02:12:21.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.880+0000 7f11763e4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f0b69601f0 0x55f0b6960610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.880+0000 7f11763e4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f0b69601f0 0x55f0b6960610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45586/0 (socket says 172.21.15.134:45586) 2024-04-24T02:12:21.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.880+0000 7f11763e4640 1 -- 172.21.15.134:0/1382331859 learned_addr learned my addr 172.21.15.134:0/1382331859 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:21.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.881+0000 7f11763e4640 1 -- 172.21.15.134:0/1382331859 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0b6960be0 con 0x55f0b69601f0 2024-04-24T02:12:21.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.881+0000 7f11763e4640 1 --2- 172.21.15.134:0/1382331859 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f0b69601f0 0x55f0b6960610 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1168026fd0 tx=0x7f1168024eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41b5bd8dfe89bf0c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.881+0000 7f10627fc640 1 -- 172.21.15.134:0/1382331859 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f116804a030 con 0x55f0b69601f0 2024-04-24T02:12:21.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.881+0000 7f10627fc640 1 -- 172.21.15.134:0/1382331859 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1168025e30 con 0x55f0b69601f0 2024-04-24T02:12:21.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.881+0000 7f10627fc640 1 -- 172.21.15.134:0/1382331859 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f116801ad50 con 0x55f0b69601f0 2024-04-24T02:12:21.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.881+0000 7f11810df800 1 -- 172.21.15.134:0/1382331859 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f0b69601f0 msgr2=0x55f0b6960610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.881+0000 7f11810df800 1 --2- 172.21.15.134:0/1382331859 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f0b69601f0 0x55f0b6960610 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1168026fd0 tx=0x7f1168024eb0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.881+0000 7f11810df800 1 -- 172.21.15.134:0/1382331859 shutdown_connections 2024-04-24T02:12:21.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.881+0000 7f11810df800 1 --2- 172.21.15.134:0/1382331859 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f0b69601f0 0x55f0b6960610 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.881+0000 7f11810df800 1 -- 172.21.15.134:0/1382331859 >> 172.21.15.134:0/1382331859 conn(0x55f0b695c550 msgr2=0x55f0b695a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:21.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.881+0000 7f11810df800 1 -- 172.21.15.134:0/1382331859 shutdown_connections 2024-04-24T02:12:21.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.881+0000 7f11810df800 1 -- 172.21.15.134:0/1382331859 wait complete. 2024-04-24T02:12:21.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.882+0000 7f11810df800 1 Processor -- start 2024-04-24T02:12:21.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.882+0000 7f11810df800 1 -- start start 2024-04-24T02:12:21.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.882+0000 7f11810df800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f0b69601f0 0x55f0b6967850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.882+0000 7f11810df800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55f0b6961350 con 0x55f0b69601f0 2024-04-24T02:12:21.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.882+0000 7f11763e4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f0b69601f0 0x55f0b6967850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.882+0000 7f11763e4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f0b69601f0 0x55f0b6967850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45596/0 (socket says 172.21.15.134:45596) 2024-04-24T02:12:21.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.882+0000 7f11763e4640 1 -- 172.21.15.134:0/405753298 learned_addr learned my addr 172.21.15.134:0/405753298 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:21.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.882+0000 7f11763e4640 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0b6967d90 con 0x55f0b69601f0 2024-04-24T02:12:21.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.882+0000 7f11763e4640 1 --2- 172.21.15.134:0/405753298 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f0b69601f0 0x55f0b6967850 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1168026fd0 tx=0x7f116804be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.882+0000 7f1060ff9640 1 -- 172.21.15.134:0/405753298 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f116804a050 con 0x55f0b69601f0 2024-04-24T02:12:21.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.882+0000 7f1060ff9640 1 -- 172.21.15.134:0/405753298 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1168025360 con 0x55f0b69601f0 2024-04-24T02:12:21.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.882+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f0b6968020 con 0x55f0b69601f0 2024-04-24T02:12:21.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.883+0000 7f1060ff9640 1 -- 172.21.15.134:0/405753298 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1168025680 con 0x55f0b69601f0 2024-04-24T02:12:21.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.883+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0b696acd0 con 0x55f0b69601f0 2024-04-24T02:12:21.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.883+0000 7f1060ff9640 1 -- 172.21.15.134:0/405753298 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f116800d6a0 con 0x55f0b69601f0 2024-04-24T02:12:21.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.883+0000 7f1060ff9640 1 --2- 172.21.15.134:0/405753298 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1048036950 0x7f1048038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.883+0000 7f1060ff9640 1 -- 172.21.15.134:0/405753298 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f1168036ae0 con 0x55f0b69601f0 2024-04-24T02:12:21.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.883+0000 7f117f3e6640 1 --2- 172.21.15.134:0/405753298 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1048036950 0x7f1048038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.884+0000 7f117f3e6640 1 --2- 172.21.15.134:0/405753298 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1048036950 0x7f1048038e10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x55f0b6942f00 tx=0x7f117801f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.884+0000 7f11810df800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.884+0000 7f11810df800 1 --2- 172.21.15.134:0/405753298 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f0b69733a0 0x55f0b6975860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.884+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f0b6975fb0 con 0x55f0b69733a0 2024-04-24T02:12:21.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.884+0000 7f117ebe5640 1 --2- 172.21.15.134:0/405753298 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f0b69733a0 0x55f0b6975860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.884+0000 7f117ebe5640 1 --2- 172.21.15.134:0/405753298 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f0b69733a0 0x55f0b6975860 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.884+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1170070020 con 0x55f0b69733a0 2024-04-24T02:12:21.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.884+0000 7f11810df800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:21.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.884+0000 7f11810df800 20 realm 2024-04-24T02:12:21.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.884+0000 7f11810df800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.885+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f0b69763c0 con 0x55f0b69733a0 2024-04-24T02:12:21.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.885+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1170070020 con 0x55f0b69733a0 2024-04-24T02:12:21.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.885+0000 7f11810df800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:21.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.885+0000 7f11810df800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:21.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.885+0000 7f11810df800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.885+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f0b6976c90 con 0x55f0b69733a0 2024-04-24T02:12:21.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.885+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1170070020 con 0x55f0b69733a0 2024-04-24T02:12:21.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.885+0000 7f11810df800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:21.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.885+0000 7f11810df800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.885+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f0b6977030 con 0x55f0b69733a0 2024-04-24T02:12:21.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.885+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1170070020 con 0x55f0b69733a0 2024-04-24T02:12:21.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.885+0000 7f11810df800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:21.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.885+0000 7f11810df800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.885+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f0b6977880 con 0x55f0b69733a0 2024-04-24T02:12:21.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.885+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1170070020 con 0x55f0b69733a0 2024-04-24T02:12:21.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.885+0000 7f11810df800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:21.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.885+0000 7f11810df800 20 searching for the correct realm 2024-04-24T02:12:21.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.885+0000 7f11810df800 1 --2- 172.21.15.134:0/405753298 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55f0b69795f0 0x55f0b697b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.885+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f0b697bfc0 con 0x55f0b69795f0 2024-04-24T02:12:21.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.885+0000 7f11763e4640 1 --2- 172.21.15.134:0/405753298 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55f0b69795f0 0x55f0b697b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.886+0000 7f11763e4640 1 --2- 172.21.15.134:0/405753298 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55f0b69795f0 0x55f0b697b9e0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.886+0000 7f11763e4640 1 -- 172.21.15.134:0/405753298 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1168024030 con 0x55f0b69795f0 2024-04-24T02:12:21.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.886+0000 7f11763e4640 1 --2- 172.21.15.134:0/405753298 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f1168027060 0x7f116803b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.886+0000 7f11763e4640 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f0b697bfc0 con 0x7f1168027060 2024-04-24T02:12:21.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.886+0000 7f117f3e6640 1 --2- 172.21.15.134:0/405753298 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f1168027060 0x7f116803b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.887+0000 7f117f3e6640 1 --2- 172.21.15.134:0/405753298 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f1168027060 0x7f116803b630 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.887+0000 7f117f3e6640 1 -- 172.21.15.134:0/405753298 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f117801f070 con 0x7f1168027060 2024-04-24T02:12:21.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.887+0000 7f117f3e6640 1 --2- 172.21.15.134:0/405753298 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f1178031040 0x7f1178032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.887+0000 7f117f3e6640 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f0b697bfc0 con 0x7f1178031040 2024-04-24T02:12:21.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.887+0000 7f117ebe5640 1 --2- 172.21.15.134:0/405753298 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f1178031040 0x7f1178032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.887+0000 7f117ebe5640 1 --2- 172.21.15.134:0/405753298 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f1178031040 0x7f1178032940 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.887+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1170070020 con 0x7f1178031040 2024-04-24T02:12:21.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.887+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f0b697bfc0 con 0x55f0b69733a0 2024-04-24T02:12:21.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.888+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1170070020 con 0x55f0b69733a0 2024-04-24T02:12:21.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.888+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f0b697bfc0 con 0x55f0b69733a0 2024-04-24T02:12:21.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.888+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1170070020 con 0x55f0b69733a0 2024-04-24T02:12:21.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.888+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f0b697bfc0 con 0x7f1178031040 2024-04-24T02:12:21.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.888+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1170070020 con 0x7f1178031040 2024-04-24T02:12:21.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.888+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f0b697bfc0 con 0x7f1178031040 2024-04-24T02:12:21.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.888+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1170070020 con 0x7f1178031040 2024-04-24T02:12:21.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.888+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f0b697bfc0 con 0x7f1168027060 2024-04-24T02:12:21.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.889+0000 7f117f3e6640 1 -- 172.21.15.134:0/405753298 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f117801f070 con 0x7f1168027060 2024-04-24T02:12:21.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.889+0000 7f117f3e6640 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f0b697bfc0 con 0x55f0b69795f0 2024-04-24T02:12:21.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.889+0000 7f11763e4640 1 -- 172.21.15.134:0/405753298 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1168024030 con 0x55f0b69795f0 2024-04-24T02:12:21.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.889+0000 7f11763e4640 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f0b697bfc0 con 0x55f0b69733a0 2024-04-24T02:12:21.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.889+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1170070020 con 0x55f0b69733a0 2024-04-24T02:12:21.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.889+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f0b697bfc0 con 0x7f1178031040 2024-04-24T02:12:21.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.889+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1170070020 con 0x7f1178031040 2024-04-24T02:12:21.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.889+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f0b697bfc0 con 0x55f0b69733a0 2024-04-24T02:12:21.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.890+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1170070020 con 0x55f0b69733a0 2024-04-24T02:12:21.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.890+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f0b697bfc0 con 0x7f1168027060 2024-04-24T02:12:21.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.890+0000 7f117f3e6640 1 -- 172.21.15.134:0/405753298 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f117801f070 con 0x7f1168027060 2024-04-24T02:12:21.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.890+0000 7f117f3e6640 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f0b697bfc0 con 0x55f0b69795f0 2024-04-24T02:12:21.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.890+0000 7f11763e4640 1 -- 172.21.15.134:0/405753298 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1168024030 con 0x55f0b69795f0 2024-04-24T02:12:21.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.890+0000 7f11763e4640 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f0b697bfc0 con 0x55f0b69795f0 2024-04-24T02:12:21.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.890+0000 7f11763e4640 1 -- 172.21.15.134:0/405753298 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1168024030 con 0x55f0b69795f0 2024-04-24T02:12:21.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.890+0000 7f11763e4640 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f0b697bfc0 con 0x7f1178031040 2024-04-24T02:12:21.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.890+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1170070020 con 0x7f1178031040 2024-04-24T02:12:21.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.891+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f0b697bfc0 con 0x55f0b69795f0 2024-04-24T02:12:21.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.891+0000 7f11763e4640 1 -- 172.21.15.134:0/405753298 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1168024030 con 0x55f0b69795f0 2024-04-24T02:12:21.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.891+0000 7f11763e4640 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f0b697bfc0 con 0x55f0b69795f0 2024-04-24T02:12:21.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.891+0000 7f11763e4640 1 -- 172.21.15.134:0/405753298 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1168024030 con 0x55f0b69795f0 2024-04-24T02:12:21.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.891+0000 7f11763e4640 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f0b697bfc0 con 0x55f0b69733a0 2024-04-24T02:12:21.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.891+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1170070020 con 0x55f0b69733a0 2024-04-24T02:12:21.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.891+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f0b697bfc0 con 0x55f0b69733a0 2024-04-24T02:12:21.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.891+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f1170070020 con 0x55f0b69733a0 2024-04-24T02:12:21.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.891+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f0b697bfc0 con 0x7f1178031040 2024-04-24T02:12:21.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.892+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1170070020 con 0x7f1178031040 2024-04-24T02:12:21.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.892+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f0b697bfc0 con 0x55f0b69795f0 2024-04-24T02:12:21.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.892+0000 7f11763e4640 1 -- 172.21.15.134:0/405753298 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1168024030 con 0x55f0b69795f0 2024-04-24T02:12:21.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.892+0000 7f11763e4640 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f0b697bfc0 con 0x7f1168027060 2024-04-24T02:12:21.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.892+0000 7f117f3e6640 1 -- 172.21.15.134:0/405753298 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f117801f070 con 0x7f1168027060 2024-04-24T02:12:21.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.892+0000 7f117f3e6640 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f0b697bfc0 con 0x55f0b69733a0 2024-04-24T02:12:21.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.892+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1170070020 con 0x55f0b69733a0 2024-04-24T02:12:21.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.892+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f0b697bfc0 con 0x7f1178031040 2024-04-24T02:12:21.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.893+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1170070020 con 0x7f1178031040 2024-04-24T02:12:21.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.893+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f0b697bfc0 con 0x55f0b69795f0 2024-04-24T02:12:21.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.893+0000 7f11763e4640 1 -- 172.21.15.134:0/405753298 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1168024030 con 0x55f0b69795f0 2024-04-24T02:12:21.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.893+0000 7f11763e4640 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f0b697bfc0 con 0x7f1178031040 2024-04-24T02:12:21.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.893+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1170070020 con 0x7f1178031040 2024-04-24T02:12:21.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.893+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f0b697bfc0 con 0x7f1168027060 2024-04-24T02:12:21.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.893+0000 7f117f3e6640 1 -- 172.21.15.134:0/405753298 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f117801f070 con 0x7f1168027060 2024-04-24T02:12:21.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.893+0000 7f117f3e6640 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f0b697bfc0 con 0x55f0b69795f0 2024-04-24T02:12:21.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.894+0000 7f11763e4640 1 -- 172.21.15.134:0/405753298 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1168024030 con 0x55f0b69795f0 2024-04-24T02:12:21.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.894+0000 7f11763e4640 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f0b697bfc0 con 0x7f1178031040 2024-04-24T02:12:21.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.894+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1170070020 con 0x7f1178031040 2024-04-24T02:12:21.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.894+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f0b697bfc0 con 0x55f0b69733a0 2024-04-24T02:12:21.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.894+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1170070020 con 0x55f0b69733a0 2024-04-24T02:12:21.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.894+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f0b697bfc0 con 0x7f1168027060 2024-04-24T02:12:21.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.894+0000 7f117f3e6640 1 -- 172.21.15.134:0/405753298 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f117801f070 con 0x7f1168027060 2024-04-24T02:12:21.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.895+0000 7f11810df800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:21.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.895+0000 7f11810df800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:21.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.895+0000 7f11810df800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:21.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.895+0000 7f11810df800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:21.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.895+0000 7f11810df800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:21.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.895+0000 7f11810df800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:21.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.895+0000 7f11810df800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.895+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f0b6978200 con 0x55f0b69733a0 2024-04-24T02:12:21.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.895+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1170070020 con 0x55f0b69733a0 2024-04-24T02:12:21.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.895+0000 7f11810df800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:21.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.895+0000 7f11810df800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.895+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f0b6978aa0 con 0x55f0b69733a0 2024-04-24T02:12:21.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.895+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1170070020 con 0x55f0b69733a0 2024-04-24T02:12:21.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.895+0000 7f11810df800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:21.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.895+0000 7f11810df800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.895+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f0b697c440 con 0x55f0b69733a0 2024-04-24T02:12:21.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.895+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1170070020 con 0x55f0b69733a0 2024-04-24T02:12:21.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.895+0000 7f11810df800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:21.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.895+0000 7f11810df800 20 zone default found 2024-04-24T02:12:21.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.895+0000 7f11810df800 4 Realm: () 2024-04-24T02:12:21.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.895+0000 7f11810df800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:21.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.895+0000 7f11810df800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:21.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.895+0000 7f11810df800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:21.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.895+0000 7f11810df800 20 zonegroup default 2024-04-24T02:12:21.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.895+0000 7f11810df800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.895+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f0b6978700 con 0x7f1178031040 2024-04-24T02:12:21.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.896+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1170070020 con 0x7f1178031040 2024-04-24T02:12:21.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.896+0000 7f11810df800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:21.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.896+0000 7f11810df800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.896+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f0b697e350 con 0x55f0b69795f0 2024-04-24T02:12:21.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.896+0000 7f11763e4640 1 -- 172.21.15.134:0/405753298 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1168024030 con 0x55f0b69795f0 2024-04-24T02:12:21.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.896+0000 7f11810df800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:21.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.896+0000 7f11810df800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.896+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f0b697e760 con 0x55f0b69795f0 2024-04-24T02:12:21.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.896+0000 7f11763e4640 1 -- 172.21.15.134:0/405753298 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1168024030 con 0x55f0b69795f0 2024-04-24T02:12:21.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.896+0000 7f11810df800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:21.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.896+0000 7f11810df800 20 started sync module instance, tier type = 2024-04-24T02:12:21.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.896+0000 7f11810df800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:21.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.896+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f0b697d7f0 con 0x7f1168027060 2024-04-24T02:12:21.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.897+0000 7f117f3e6640 1 -- 172.21.15.134:0/405753298 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1178040040 con 0x7f1168027060 2024-04-24T02:12:21.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.897+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94492343917536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f0b697f070 con 0x7f1168027060 2024-04-24T02:12:21.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.897+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f0b697f8c0 con 0x55f0b69733a0 2024-04-24T02:12:21.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.898+0000 7f117f3e6640 1 -- 172.21.15.134:0/405753298 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94492343917536] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1178040040 con 0x7f1168027060 2024-04-24T02:12:21.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.899+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1170070020 con 0x55f0b69733a0 2024-04-24T02:12:21.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.899+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94492343921600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f0b697f550 con 0x55f0b69733a0 2024-04-24T02:12:21.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.899+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f0b6980070 con 0x55f0b69795f0 2024-04-24T02:12:21.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.900+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94492343921600] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1170070020 con 0x55f0b69733a0 2024-04-24T02:12:21.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.900+0000 7f11763e4640 1 -- 172.21.15.134:0/405753298 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1168024030 con 0x55f0b69795f0 2024-04-24T02:12:21.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.900+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94492343925568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f0b6980460 con 0x55f0b69795f0 2024-04-24T02:12:21.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.900+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f0b6980e60 con 0x7f1168027060 2024-04-24T02:12:21.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.901+0000 7f11763e4640 1 -- 172.21.15.134:0/405753298 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94492343925568] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1168024030 con 0x55f0b69795f0 2024-04-24T02:12:21.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.901+0000 7f117f3e6640 1 -- 172.21.15.134:0/405753298 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1178040040 con 0x7f1168027060 2024-04-24T02:12:21.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.901+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94492343922656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f0b6981250 con 0x7f1168027060 2024-04-24T02:12:21.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.901+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f0b6981c90 con 0x55f0b69733a0 2024-04-24T02:12:21.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.902+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1170070020 con 0x55f0b69733a0 2024-04-24T02:12:21.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.902+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94492343932768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f0b6981c50 con 0x55f0b69733a0 2024-04-24T02:12:21.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.902+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f0b6982c50 con 0x7f1178031040 2024-04-24T02:12:21.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.902+0000 7f117f3e6640 1 -- 172.21.15.134:0/405753298 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94492343922656] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1178040040 con 0x7f1168027060 2024-04-24T02:12:21.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.903+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1170070020 con 0x7f1178031040 2024-04-24T02:12:21.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.903+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94492343932768] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1170070020 con 0x55f0b69733a0 2024-04-24T02:12:21.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.903+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94492343936896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f0b6982c50 con 0x7f1178031040 2024-04-24T02:12:21.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.903+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f0b6981ff0 con 0x7f1178031040 2024-04-24T02:12:21.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.904+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94492343936896] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1170070020 con 0x7f1178031040 2024-04-24T02:12:21.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.904+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(56 notify.6 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1170070020 con 0x7f1178031040 2024-04-24T02:12:21.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.904+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94492343929200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f0b69831b0 con 0x7f1178031040 2024-04-24T02:12:21.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.904+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f0b6983b70 con 0x7f1178031040 2024-04-24T02:12:21.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.905+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(58 notify.7 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1170070020 con 0x7f1178031040 2024-04-24T02:12:21.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.905+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94492343929200] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1170070020 con 0x7f1178031040 2024-04-24T02:12:21.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.905+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94492343940800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f0b6983f90 con 0x7f1178031040 2024-04-24T02:12:21.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.905+0000 7f11810df800 20 add_watcher() i=0 2024-04-24T02:12:21.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.905+0000 7f11810df800 20 add_watcher() i=1 2024-04-24T02:12:21.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.905+0000 7f11810df800 20 add_watcher() i=2 2024-04-24T02:12:21.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.905+0000 7f11810df800 20 add_watcher() i=3 2024-04-24T02:12:21.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.905+0000 7f11810df800 20 add_watcher() i=4 2024-04-24T02:12:21.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.905+0000 7f11810df800 20 add_watcher() i=5 2024-04-24T02:12:21.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.905+0000 7f11810df800 20 add_watcher() i=6 2024-04-24T02:12:21.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.906+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94492343940800] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1170070020 con 0x7f1178031040 2024-04-24T02:12:21.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.906+0000 7f11810df800 20 add_watcher() i=7 2024-04-24T02:12:21.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.906+0000 7f11810df800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:21.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.906+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f0b6986fc0 con 0x55f0b69733a0 2024-04-24T02:12:21.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.906+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1170070020 con 0x55f0b69733a0 2024-04-24T02:12:21.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.906+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94492343941856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f0b69843e0 con 0x55f0b69733a0 2024-04-24T02:12:21.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.907+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94492343941856] v30'58 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1170070020 con 0x55f0b69733a0 2024-04-24T02:12:21.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.907+0000 7f10357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:21.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.907+0000 7f11810df800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:21.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.907+0000 7f11810df800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:21.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.907+0000 7f11810df800 5 note: GC not initialized 2024-04-24T02:12:21.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.908+0000 7f0faffff640 20 reqs_thread_entry: start 2024-04-24T02:12:21.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.908+0000 7f11810df800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:21.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.908+0000 7f11810df800 20 Filter name: none 2024-04-24T02:12:21.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.908+0000 7f0fadffb640 20 reqs_thread_entry: start 2024-04-24T02:12:21.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.908+0000 7f11810df800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-24T02:12:21.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.908+0000 7f11810df800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.908+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f0b69ba2a0 con 0x7f1178031040 2024-04-24T02:12:21.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.908+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f1170070020 con 0x7f1178031040 2024-04-24T02:12:21.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.908+0000 7f11810df800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:21.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.908+0000 7f11810df800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-04-24T02:12:21.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.908+0000 7f11810df800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-24T02:12:21.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.908+0000 7f11810df800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-04-24T02:12:21.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.908+0000 7f11810df800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.909+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f0b69b8a40 con 0x55f0b69733a0 2024-04-24T02:12:21.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.909+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) ==== 197+0+23 (crc 0 0 0) 0x7f1170070020 con 0x55f0b69733a0 2024-04-24T02:12:21.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.909+0000 7f11810df800 20 rados_obj.operate() r=0 bl.length=7 2024-04-24T02:12:21.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.909+0000 7f11810df800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-04-24T02:12:21.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.909+0000 7f11810df800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-04-24T02:12:21.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.909+0000 7f11810df800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T02:12:21.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.909+0000 7f11810df800 20 rados->read ofs=0 len=0 2024-04-24T02:12:21.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.909+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f0b69b8e30 con 0x55f0b69733a0 2024-04-24T02:12:21.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.910+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(64 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f1170070020 con 0x55f0b69733a0 2024-04-24T02:12:21.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.910+0000 7f11810df800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T02:12:21.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.910+0000 7f11810df800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T02:12:21.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.910+0000 7f11810df800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:21.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.910+0000 7f11810df800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:12:21.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.910+0000 7f11810df800 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-04-24T02:12:21.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.910+0000 7f11810df800 20 get_user_info_from_index found 0 xattrs 2024-04-24T02:12:21.931 INFO:teuthology.orchestra.run.smithi134.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-04-24T02:12:21.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.910+0000 7f10357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:21.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.910+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94492343941856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f0b696f2b0 con 0x55f0b69733a0 2024-04-24T02:12:21.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.911+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94492343941856] v30'59 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1170070020 con 0x55f0b69733a0 2024-04-24T02:12:21.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.911+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94492343917536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f0b6983ae0 con 0x7f1168027060 2024-04-24T02:12:21.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.912+0000 7f117f3e6640 1 -- 172.21.15.134:0/405753298 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94492343917536] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1178040040 con 0x7f1168027060 2024-04-24T02:12:21.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.912+0000 7f11810df800 20 remove_watcher() i=0 2024-04-24T02:12:21.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.912+0000 7f11810df800 2 removed watcher, disabling cache 2024-04-24T02:12:21.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.912+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94492343921600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f0b6983ae0 con 0x55f0b69733a0 2024-04-24T02:12:21.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.914+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94492343921600] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1170070020 con 0x55f0b69733a0 2024-04-24T02:12:21.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.914+0000 7f11810df800 20 remove_watcher() i=1 2024-04-24T02:12:21.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.914+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94492343925568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f0b6983ae0 con 0x55f0b69795f0 2024-04-24T02:12:21.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.915+0000 7f11763e4640 1 -- 172.21.15.134:0/405753298 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94492343925568] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1168024030 con 0x55f0b69795f0 2024-04-24T02:12:21.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.915+0000 7f11810df800 20 remove_watcher() i=2 2024-04-24T02:12:21.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.915+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94492343922656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f0b697fb40 con 0x7f1168027060 2024-04-24T02:12:21.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.915+0000 7f117f3e6640 1 -- 172.21.15.134:0/405753298 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94492343922656] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1178040040 con 0x7f1168027060 2024-04-24T02:12:21.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.916+0000 7f11810df800 20 remove_watcher() i=3 2024-04-24T02:12:21.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.916+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94492343932768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f0b697fb40 con 0x55f0b69733a0 2024-04-24T02:12:21.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.916+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94492343932768] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1170070020 con 0x55f0b69733a0 2024-04-24T02:12:21.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.916+0000 7f11810df800 20 remove_watcher() i=4 2024-04-24T02:12:21.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.917+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94492343936896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f0b697fb40 con 0x7f1178031040 2024-04-24T02:12:21.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.917+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94492343936896] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1170070020 con 0x7f1178031040 2024-04-24T02:12:21.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.917+0000 7f11810df800 20 remove_watcher() i=5 2024-04-24T02:12:21.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.917+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94492343929200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f0b6982780 con 0x7f1178031040 2024-04-24T02:12:21.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.919+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94492343929200] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1170070020 con 0x7f1178031040 2024-04-24T02:12:21.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.919+0000 7f11810df800 20 remove_watcher() i=6 2024-04-24T02:12:21.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.919+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94492343940800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f0b6982780 con 0x7f1178031040 2024-04-24T02:12:21.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.919+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 <== osd.0 v2:172.21.15.104:6800/2419146313 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94492343940800] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1170070020 con 0x7f1178031040 2024-04-24T02:12:21.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.919+0000 7f11810df800 20 remove_watcher() i=7 2024-04-24T02:12:21.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.920+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f1178031040 msgr2=0x7f1178032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.920+0000 7f11810df800 1 --2- 172.21.15.134:0/405753298 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f1178031040 0x7f1178032940 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.920+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f0b69733a0 msgr2=0x55f0b6975860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.920+0000 7f11810df800 1 --2- 172.21.15.134:0/405753298 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f0b69733a0 0x55f0b6975860 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.920+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f1168027060 msgr2=0x7f116803b630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.920+0000 7f11810df800 1 --2- 172.21.15.134:0/405753298 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f1168027060 0x7f116803b630 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.920+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55f0b69795f0 msgr2=0x55f0b697b9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.920+0000 7f11810df800 1 --2- 172.21.15.134:0/405753298 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55f0b69795f0 0x55f0b697b9e0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.920+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1048036950 msgr2=0x7f1048038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.920+0000 7f11810df800 1 --2- 172.21.15.134:0/405753298 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1048036950 0x7f1048038e10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x55f0b6942f00 tx=0x7f117801f000 comp rx=0 tx=0).stop 2024-04-24T02:12:21.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.920+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f0b69601f0 msgr2=0x55f0b6967850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.920+0000 7f11810df800 1 --2- 172.21.15.134:0/405753298 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f0b69601f0 0x55f0b6967850 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1168026fd0 tx=0x7f116804be50 comp rx=0 tx=0).stop 2024-04-24T02:12:21.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.920+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 reap_dead start 2024-04-24T02:12:21.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.920+0000 7f117ebe5640 1 -- 172.21.15.134:0/405753298 reap_dead start 2024-04-24T02:12:21.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.920+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 shutdown_connections 2024-04-24T02:12:21.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.920+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 >> 172.21.15.134:0/405753298 conn(0x55f0b695c550 msgr2=0x55f0b6959bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:21.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.920+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 shutdown_connections 2024-04-24T02:12:21.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.920+0000 7f11810df800 1 -- 172.21.15.134:0/405753298 wait complete. 2024-04-24T02:12:21.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.920+0000 7f11810df800 1 -- 172.21.15.134:0/3883610963 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1058036950 msgr2=0x7f1058038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.920+0000 7f11810df800 1 --2- 172.21.15.134:0/3883610963 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1058036950 0x7f1058038e10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x55f0b6943780 tx=0x7f1178005840 comp rx=0 tx=0).stop 2024-04-24T02:12:21.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.920+0000 7f11810df800 1 -- 172.21.15.134:0/3883610963 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f0b6952eb0 msgr2=0x55f0b69532d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.920+0000 7f11810df800 1 --2- 172.21.15.134:0/3883610963 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f0b6952eb0 0x55f0b69532d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f116800e610 tx=0x7f116800ff90 comp rx=0 tx=0).stop 2024-04-24T02:12:21.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.920+0000 7f11810df800 1 -- 172.21.15.134:0/3883610963 shutdown_connections 2024-04-24T02:12:21.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.920+0000 7f11810df800 1 --2- 172.21.15.134:0/3883610963 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1058036950 0x7f1058038e10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.920+0000 7f11810df800 1 --2- 172.21.15.134:0/3883610963 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f0b6952eb0 0x55f0b69532d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.920+0000 7f11810df800 1 -- 172.21.15.134:0/3883610963 >> 172.21.15.134:0/3883610963 conn(0x55f0b6946f50 msgr2=0x55f0b6947350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:21.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.920+0000 7f11810df800 1 -- 172.21.15.134:0/3883610963 shutdown_connections 2024-04-24T02:12:21.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.920+0000 7f11810df800 1 -- 172.21.15.134:0/3883610963 wait complete. 2024-04-24T02:12:21.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.921+0000 7f11810df800 1 -- 172.21.15.134:0/1639268769 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f0b6843200 msgr2=0x55f0b6941d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.921+0000 7f11810df800 1 --2- 172.21.15.134:0/1639268769 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f0b6843200 0x55f0b6941d80 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.921+0000 7f11810df800 1 -- 172.21.15.134:0/1639268769 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1064036950 msgr2=0x7f1064038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.921+0000 7f11810df800 1 --2- 172.21.15.134:0/1639268769 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1064036950 0x7f1064038e10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1168000c00 tx=0x7f11680013b0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.921+0000 7f11810df800 1 -- 172.21.15.134:0/1639268769 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f0b68408d0 msgr2=0x55f0b693ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.921+0000 7f11810df800 1 --2- 172.21.15.134:0/1639268769 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f0b68408d0 0x55f0b693ab40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1170061040 tx=0x7f1170002fb0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.921+0000 7f11810df800 1 -- 172.21.15.134:0/1639268769 shutdown_connections 2024-04-24T02:12:21.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.921+0000 7f11810df800 1 --2- 172.21.15.134:0/1639268769 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f0b6843200 0x55f0b6941d80 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.921+0000 7f11810df800 1 --2- 172.21.15.134:0/1639268769 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1064036950 0x7f1064038e10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.921+0000 7f11810df800 1 --2- 172.21.15.134:0/1639268769 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f0b68408d0 0x55f0b693ab40 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.921+0000 7f11810df800 1 -- 172.21.15.134:0/1639268769 >> 172.21.15.134:0/1639268769 conn(0x55f0b683a3a0 msgr2=0x55f0b683eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:21.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.921+0000 7f11810df800 1 -- 172.21.15.134:0/1639268769 shutdown_connections 2024-04-24T02:12:21.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.921+0000 7f11810df800 1 -- 172.21.15.134:0/1639268769 wait complete. 2024-04-24T02:12:21.937 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-04-24T02:12:21.938 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-24T02:12:21.938 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-24T02:12:21.938 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-24T02:12:21.981 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:21.981 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:21.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.980+0000 7fa72331f800 1 Processor -- start 2024-04-24T02:12:21.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.980+0000 7fa72331f800 1 -- start start 2024-04-24T02:12:21.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.980+0000 7fa72331f800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55e5672a72c0 0x55e5672afdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.980+0000 7fa72331f800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e567165d40 con 0x55e5672a5780 2024-04-24T02:12:21.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.980+0000 7fa72331f800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55e5671384d0 con 0x55e5672a72c0 2024-04-24T02:12:21.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.981+0000 7fa71e7e6640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55e5672a72c0 0x55e5672afdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.981+0000 7fa71efe7640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55e5672a5780 0x55e5672a5ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:43212/0 (socket says 172.21.15.134:43212) 2024-04-24T02:12:21.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.981+0000 7fa71e7e6640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55e5672a72c0 0x55e5672afdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45602/0 (socket says 172.21.15.134:45602) 2024-04-24T02:12:21.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.981+0000 7fa71efe7640 1 -- 172.21.15.134:0/1710963203 learned_addr learned my addr 172.21.15.134:0/1710963203 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:12:21.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.981+0000 7fa71e7e6640 1 -- 172.21.15.134:0/1710963203 >> v1:172.21.15.104:6789/0 conn(0x55e5672a5780 legacy=0x55e5672a5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.981+0000 7fa71dfe5640 1 -- 172.21.15.134:0/1710963203 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 174354200 0 0) 0x55e567165d40 con 0x55e5672a5780 2024-04-24T02:12:21.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.981+0000 7fa71e7e6640 1 -- 172.21.15.134:0/1710963203 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e567164590 con 0x55e5672a72c0 2024-04-24T02:12:21.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.983+0000 7fa71e7e6640 1 --2- 172.21.15.134:0/1710963203 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5672a72c0 0x55e5672afdc0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa71400a470 tx=0x7fa71401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=532c233120c59b13 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:21.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.983+0000 7fa71dfe5640 1 -- 172.21.15.134:0/1710963203 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa714057070 con 0x55e5672a72c0 2024-04-24T02:12:21.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.983+0000 7fa71dfe5640 1 -- 172.21.15.134:0/1710963203 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa71404adc0 con 0x55e5672a72c0 2024-04-24T02:12:21.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.983+0000 7fa71dfe5640 1 -- 172.21.15.134:0/1710963203 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa714052590 con 0x55e5672a72c0 2024-04-24T02:12:21.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.983+0000 7fa72331f800 1 -- 172.21.15.134:0/1710963203 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5672a72c0 msgr2=0x55e5672afdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:21.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.983+0000 7fa72331f800 1 --2- 172.21.15.134:0/1710963203 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5672a72c0 0x55e5672afdc0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa71400a470 tx=0x7fa71401ce90 comp rx=0 tx=0).stop 2024-04-24T02:12:21.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.983+0000 7fa72331f800 1 -- 172.21.15.134:0/1710963203 shutdown_connections 2024-04-24T02:12:21.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.983+0000 7fa72331f800 1 --2- 172.21.15.134:0/1710963203 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5672a72c0 0x55e5672afdc0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:21.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.983+0000 7fa72331f800 1 -- 172.21.15.134:0/1710963203 >> 172.21.15.134:0/1710963203 conn(0x55e5672a1320 msgr2=0x55e5672a3740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:21.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.983+0000 7fa72331f800 1 -- 172.21.15.134:0/1710963203 shutdown_connections 2024-04-24T02:12:21.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.983+0000 7fa72331f800 1 -- 172.21.15.134:0/1710963203 wait complete. 2024-04-24T02:12:21.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.995+0000 7fa72331f800 1 Processor -- start 2024-04-24T02:12:21.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.995+0000 7fa72331f800 1 -- start start 2024-04-24T02:12:21.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.995+0000 7fa72331f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5672a5780 0x55e56739a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:21.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.995+0000 7fa72331f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e5671f23c0 con 0x55e5672a5780 2024-04-24T02:12:21.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.996+0000 7fa71efe7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5672a5780 0x55e56739a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:21.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.996+0000 7fa71efe7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5672a5780 0x55e56739a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45604/0 (socket says 172.21.15.134:45604) 2024-04-24T02:12:21.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.996+0000 7fa71efe7640 1 -- 172.21.15.134:0/3625352978 learned_addr learned my addr 172.21.15.134:0/3625352978 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:21.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.996+0000 7fa71efe7640 1 -- 172.21.15.134:0/3625352978 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e56739aa30 con 0x55e5672a5780 2024-04-24T02:12:22.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.996+0000 7fa71efe7640 1 --2- 172.21.15.134:0/3625352978 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5672a5780 0x55e56739a460 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa71000b210 tx=0x7fa71000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d8a5e3f583a1ccf server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.996+0000 7fa60ce09640 1 -- 172.21.15.134:0/3625352978 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa710008070 con 0x55e5672a5780 2024-04-24T02:12:22.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.996+0000 7fa60ce09640 1 -- 172.21.15.134:0/3625352978 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa71000d500 con 0x55e5672a5780 2024-04-24T02:12:22.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.996+0000 7fa60ce09640 1 -- 172.21.15.134:0/3625352978 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa71000d840 con 0x55e5672a5780 2024-04-24T02:12:22.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.997+0000 7fa72331f800 1 -- 172.21.15.134:0/3625352978 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5672a5780 msgr2=0x55e56739a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.997+0000 7fa72331f800 1 --2- 172.21.15.134:0/3625352978 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5672a5780 0x55e56739a460 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa71000b210 tx=0x7fa71000b6d0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.997+0000 7fa72331f800 1 -- 172.21.15.134:0/3625352978 shutdown_connections 2024-04-24T02:12:22.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.997+0000 7fa72331f800 1 --2- 172.21.15.134:0/3625352978 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5672a5780 0x55e56739a460 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.997+0000 7fa72331f800 1 -- 172.21.15.134:0/3625352978 >> 172.21.15.134:0/3625352978 conn(0x55e5672a1320 msgr2=0x55e567395d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:22.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.997+0000 7fa72331f800 1 -- 172.21.15.134:0/3625352978 shutdown_connections 2024-04-24T02:12:22.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.997+0000 7fa72331f800 1 -- 172.21.15.134:0/3625352978 wait complete. 2024-04-24T02:12:22.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.997+0000 7fa72331f800 1 Processor -- start 2024-04-24T02:12:22.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.997+0000 7fa72331f800 1 -- start start 2024-04-24T02:12:22.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.997+0000 7fa72331f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5672a5780 0x55e5673a2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.997+0000 7fa72331f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e5672b25e0 con 0x55e5672a5780 2024-04-24T02:12:22.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.998+0000 7fa71efe7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5672a5780 0x55e5673a2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.998+0000 7fa71efe7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5672a5780 0x55e5673a2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45620/0 (socket says 172.21.15.134:45620) 2024-04-24T02:12:22.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.998+0000 7fa71efe7640 1 -- 172.21.15.134:0/3652342838 learned_addr learned my addr 172.21.15.134:0/3652342838 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:22.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.998+0000 7fa71efe7640 1 -- 172.21.15.134:0/3652342838 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5673a2540 con 0x55e5672a5780 2024-04-24T02:12:22.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.998+0000 7fa71efe7640 1 --2- 172.21.15.134:0/3652342838 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5672a5780 0x55e5673a2000 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa71000b210 tx=0x7fa710000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.998+0000 7fa60b606640 1 -- 172.21.15.134:0/3652342838 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa71000f950 con 0x55e5672a5780 2024-04-24T02:12:22.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.998+0000 7fa60b606640 1 -- 172.21.15.134:0/3652342838 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa71000faf0 con 0x55e5672a5780 2024-04-24T02:12:22.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.998+0000 7fa72331f800 1 -- 172.21.15.134:0/3652342838 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e5673a27d0 con 0x55e5672a5780 2024-04-24T02:12:22.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.998+0000 7fa60b606640 1 -- 172.21.15.134:0/3652342838 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa71000fdd0 con 0x55e5672a5780 2024-04-24T02:12:22.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.998+0000 7fa72331f800 1 -- 172.21.15.134:0/3652342838 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5673a5480 con 0x55e5672a5780 2024-04-24T02:12:22.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.999+0000 7fa60b606640 1 -- 172.21.15.134:0/3652342838 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa710017040 con 0x55e5672a5780 2024-04-24T02:12:22.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.999+0000 7fa60b606640 1 --2- 172.21.15.134:0/3652342838 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa604036900 0x7fa604038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.999+0000 7fa60b606640 1 -- 172.21.15.134:0/3652342838 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fa710015020 con 0x55e5672a5780 2024-04-24T02:12:22.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.999+0000 7fa71e7e6640 1 --2- 172.21.15.134:0/3652342838 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa604036900 0x7fa604038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.999+0000 7fa72331f800 1 --2- 172.21.15.134:0/3652342838 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e5672a72c0 0x55e5673a9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.999+0000 7fa72331f800 1 -- 172.21.15.134:0/3652342838 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e5673a9780 con 0x55e5672a72c0 2024-04-24T02:12:22.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:21.999+0000 7fa71f7e8640 1 --2- 172.21.15.134:0/3652342838 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e5672a72c0 0x55e5673a9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.000+0000 7fa71e7e6640 1 --2- 172.21.15.134:0/3652342838 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa604036900 0x7fa604038dc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa714054000 tx=0x7fa71404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.000+0000 7fa71f7e8640 1 --2- 172.21.15.134:0/3652342838 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e5672a72c0 0x55e5673a9240 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.000+0000 7fa71f7e8640 1 -- 172.21.15.134:0/3652342838 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa71800a4a0 con 0x55e5672a72c0 2024-04-24T02:12:22.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.000+0000 7fa72331f800 1 -- 172.21.15.134:0/3652342838 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e5673a67f0 con 0x55e5672a72c0 2024-04-24T02:12:22.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.000+0000 7fa71f7e8640 1 -- 172.21.15.134:0/3652342838 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa71800a4a0 con 0x55e5672a72c0 2024-04-24T02:12:22.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.000+0000 7fa72331f800 1 -- 172.21.15.134:0/3652342838 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e5673ab510 con 0x55e5672a72c0 2024-04-24T02:12:22.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.001+0000 7fa71f7e8640 1 -- 172.21.15.134:0/3652342838 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa71800a4a0 con 0x55e5672a72c0 2024-04-24T02:12:22.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.001+0000 7fa72331f800 1 -- 172.21.15.134:0/3652342838 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e5673aa850 con 0x55e5672a72c0 2024-04-24T02:12:22.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.001+0000 7fa71f7e8640 1 -- 172.21.15.134:0/3652342838 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa71800a4a0 con 0x55e5672a72c0 2024-04-24T02:12:22.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.001+0000 7fa72331f800 1 -- 172.21.15.134:0/3652342838 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e5673aaca0 con 0x55e5672a72c0 2024-04-24T02:12:22.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.001+0000 7fa71f7e8640 1 -- 172.21.15.134:0/3652342838 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa71800a4a0 con 0x55e5672a72c0 2024-04-24T02:12:22.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.002+0000 7fa72331f800 1 Processor -- start 2024-04-24T02:12:22.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.002+0000 7fa72331f800 1 -- start start 2024-04-24T02:12:22.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.002+0000 7fa72331f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5673ba2e0 0x55e5673ba700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.002+0000 7fa72331f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e5671986b0 con 0x55e5673ba2e0 2024-04-24T02:12:22.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.002+0000 7fa71e7e6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5673ba2e0 0x55e5673ba700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.002+0000 7fa71e7e6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5673ba2e0 0x55e5673ba700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45634/0 (socket says 172.21.15.134:45634) 2024-04-24T02:12:22.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.002+0000 7fa71e7e6640 1 -- 172.21.15.134:0/1731834293 learned_addr learned my addr 172.21.15.134:0/1731834293 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:22.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.002+0000 7fa71e7e6640 1 -- 172.21.15.134:0/1731834293 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5673bac40 con 0x55e5673ba2e0 2024-04-24T02:12:22.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.003+0000 7fa71e7e6640 1 --2- 172.21.15.134:0/1731834293 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5673ba2e0 0x55e5673ba700 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa714044730 tx=0x7fa714002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.003+0000 7fa608e01640 1 -- 172.21.15.134:0/1731834293 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa71406d070 con 0x55e5673ba2e0 2024-04-24T02:12:22.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.003+0000 7fa608e01640 1 -- 172.21.15.134:0/1731834293 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa71405dda0 con 0x55e5673ba2e0 2024-04-24T02:12:22.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.003+0000 7fa72331f800 1 -- 172.21.15.134:0/1731834293 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e5673bb6b0 con 0x55e5673ba2e0 2024-04-24T02:12:22.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.003+0000 7fa608e01640 1 -- 172.21.15.134:0/1731834293 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa714057040 con 0x55e5673ba2e0 2024-04-24T02:12:22.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.003+0000 7fa72331f800 1 -- 172.21.15.134:0/1731834293 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5673bbb50 con 0x55e5673ba2e0 2024-04-24T02:12:22.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.003+0000 7fa608e01640 1 -- 172.21.15.134:0/1731834293 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa714070070 con 0x55e5673ba2e0 2024-04-24T02:12:22.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.004+0000 7fa608e01640 1 --2- 172.21.15.134:0/1731834293 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa5f8036950 0x7fa5f8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.004+0000 7fa608e01640 1 -- 172.21.15.134:0/1731834293 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fa71408f0a0 con 0x55e5673ba2e0 2024-04-24T02:12:22.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.004+0000 7fa71f7e8640 1 --2- 172.21.15.134:0/1731834293 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa5f8036950 0x7fa5f8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.004+0000 7fa72331f800 1 Processor -- start 2024-04-24T02:12:22.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.004+0000 7fa72331f800 1 -- start start 2024-04-24T02:12:22.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.004+0000 7fa71f7e8640 1 --2- 172.21.15.134:0/1731834293 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa5f8036950 0x7fa5f8038e10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x55e5673aa370 tx=0x7fa718005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.004+0000 7fa72331f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5673c7520 0x55e5673c7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.004+0000 7fa72331f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e56739adb0 con 0x55e5673c7520 2024-04-24T02:12:22.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.004+0000 7fa71e7e6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5673c7520 0x55e5673c7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.004+0000 7fa71e7e6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5673c7520 0x55e5673c7940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45644/0 (socket says 172.21.15.134:45644) 2024-04-24T02:12:22.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.004+0000 7fa71e7e6640 1 -- 172.21.15.134:0/2946772914 learned_addr learned my addr 172.21.15.134:0/2946772914 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:22.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.005+0000 7fa71e7e6640 1 -- 172.21.15.134:0/2946772914 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5673c7f10 con 0x55e5673c7520 2024-04-24T02:12:22.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.005+0000 7fa71e7e6640 1 --2- 172.21.15.134:0/2946772914 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5673c7520 0x55e5673c7940 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa71408d580 tx=0x7fa71405be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62c27ea613361d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.005+0000 7fa6027fc640 1 -- 172.21.15.134:0/2946772914 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa714052dc0 con 0x55e5673c7520 2024-04-24T02:12:22.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.005+0000 7fa6027fc640 1 -- 172.21.15.134:0/2946772914 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa71408c150 con 0x55e5673c7520 2024-04-24T02:12:22.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.005+0000 7fa6027fc640 1 -- 172.21.15.134:0/2946772914 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa71408dac0 con 0x55e5673c7520 2024-04-24T02:12:22.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.005+0000 7fa72331f800 1 -- 172.21.15.134:0/2946772914 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5673c7520 msgr2=0x55e5673c7940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.005+0000 7fa72331f800 1 --2- 172.21.15.134:0/2946772914 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5673c7520 0x55e5673c7940 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa71408d580 tx=0x7fa71405be90 comp rx=0 tx=0).stop 2024-04-24T02:12:22.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.005+0000 7fa72331f800 1 -- 172.21.15.134:0/2946772914 shutdown_connections 2024-04-24T02:12:22.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.005+0000 7fa72331f800 1 --2- 172.21.15.134:0/2946772914 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5673c7520 0x55e5673c7940 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.005+0000 7fa72331f800 1 -- 172.21.15.134:0/2946772914 >> 172.21.15.134:0/2946772914 conn(0x55e5673c3880 msgr2=0x55e5673c18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:22.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.005+0000 7fa72331f800 1 -- 172.21.15.134:0/2946772914 shutdown_connections 2024-04-24T02:12:22.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.005+0000 7fa72331f800 1 -- 172.21.15.134:0/2946772914 wait complete. 2024-04-24T02:12:22.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.006+0000 7fa72331f800 1 Processor -- start 2024-04-24T02:12:22.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.006+0000 7fa72331f800 1 -- start start 2024-04-24T02:12:22.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.006+0000 7fa72331f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5673c7520 0x55e5673ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.006+0000 7fa72331f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e5673c8680 con 0x55e5673c7520 2024-04-24T02:12:22.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.006+0000 7fa71e7e6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5673c7520 0x55e5673ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.006+0000 7fa71e7e6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5673c7520 0x55e5673ceb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45656/0 (socket says 172.21.15.134:45656) 2024-04-24T02:12:22.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.006+0000 7fa71e7e6640 1 -- 172.21.15.134:0/3403622018 learned_addr learned my addr 172.21.15.134:0/3403622018 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:22.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.006+0000 7fa71e7e6640 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5673cf090 con 0x55e5673c7520 2024-04-24T02:12:22.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.006+0000 7fa71e7e6640 1 --2- 172.21.15.134:0/3403622018 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5673c7520 0x55e5673ceb50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa71405bed0 tx=0x7fa71408d510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.006+0000 7fa600ff9640 1 -- 172.21.15.134:0/3403622018 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa714096070 con 0x55e5673c7520 2024-04-24T02:12:22.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.006+0000 7fa600ff9640 1 -- 172.21.15.134:0/3403622018 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa71408dd10 con 0x55e5673c7520 2024-04-24T02:12:22.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.006+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e5673cf320 con 0x55e5673c7520 2024-04-24T02:12:22.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.006+0000 7fa600ff9640 1 -- 172.21.15.134:0/3403622018 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa714052570 con 0x55e5673c7520 2024-04-24T02:12:22.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.007+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5673d1fd0 con 0x55e5673c7520 2024-04-24T02:12:22.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.007+0000 7fa600ff9640 1 -- 172.21.15.134:0/3403622018 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa714099070 con 0x55e5673c7520 2024-04-24T02:12:22.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.007+0000 7fa600ff9640 1 --2- 172.21.15.134:0/3403622018 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa5e8036950 0x7fa5e8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.007+0000 7fa600ff9640 1 -- 172.21.15.134:0/3403622018 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fa714087050 con 0x55e5673c7520 2024-04-24T02:12:22.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.007+0000 7fa71f7e8640 1 --2- 172.21.15.134:0/3403622018 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa5e8036950 0x7fa5e8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.008+0000 7fa72331f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.008+0000 7fa72331f800 1 --2- 172.21.15.134:0/3403622018 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e5673da590 0x55e5673dca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.008+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e5673dd1a0 con 0x55e5673da590 2024-04-24T02:12:22.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.008+0000 7fa71efe7640 1 --2- 172.21.15.134:0/3403622018 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e5673da590 0x55e5673dca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.008+0000 7fa71f7e8640 1 --2- 172.21.15.134:0/3403622018 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa5e8036950 0x7fa5e8038e10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x55e5673a6760 tx=0x7fa71801f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.008+0000 7fa71efe7640 1 --2- 172.21.15.134:0/3403622018 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e5673da590 0x55e5673dca50 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.008+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa71002d070 con 0x55e5673da590 2024-04-24T02:12:22.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.008+0000 7fa72331f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:22.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.008+0000 7fa72331f800 20 realm 2024-04-24T02:12:22.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.008+0000 7fa72331f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.008+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e5673dd5b0 con 0x55e5673da590 2024-04-24T02:12:22.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.009+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa71002d070 con 0x55e5673da590 2024-04-24T02:12:22.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.009+0000 7fa72331f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:22.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.009+0000 7fa72331f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:22.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.009+0000 7fa72331f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.009+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e5673dde80 con 0x55e5673da590 2024-04-24T02:12:22.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.009+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa71002d070 con 0x55e5673da590 2024-04-24T02:12:22.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.009+0000 7fa72331f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:22.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.009+0000 7fa72331f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.009+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e5673de220 con 0x55e5673da590 2024-04-24T02:12:22.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.009+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa71002d070 con 0x55e5673da590 2024-04-24T02:12:22.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.009+0000 7fa72331f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:22.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.009+0000 7fa72331f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.009+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e5673de680 con 0x55e5673da590 2024-04-24T02:12:22.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.009+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa71002d070 con 0x55e5673da590 2024-04-24T02:12:22.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.009+0000 7fa72331f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:22.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.009+0000 7fa72331f800 20 searching for the correct realm 2024-04-24T02:12:22.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.009+0000 7fa72331f800 1 --2- 172.21.15.134:0/3403622018 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55e5673e06d0 0x55e5673e2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.009+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e3170 con 0x55e5673e06d0 2024-04-24T02:12:22.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.010+0000 7fa71e7e6640 1 --2- 172.21.15.134:0/3403622018 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55e5673e06d0 0x55e5673e2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.010+0000 7fa71e7e6640 1 --2- 172.21.15.134:0/3403622018 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55e5673e06d0 0x55e5673e2ac0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.010+0000 7fa71e7e6640 1 -- 172.21.15.134:0/3403622018 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa714098030 con 0x55e5673e06d0 2024-04-24T02:12:22.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.010+0000 7fa71e7e6640 1 --2- 172.21.15.134:0/3403622018 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fa71409b060 0x7fa7140728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.010+0000 7fa71e7e6640 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e3170 con 0x7fa71409b060 2024-04-24T02:12:22.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.010+0000 7fa71f7e8640 1 --2- 172.21.15.134:0/3403622018 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fa71409b060 0x7fa7140728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.011+0000 7fa71f7e8640 1 --2- 172.21.15.134:0/3403622018 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fa71409b060 0x7fa7140728a0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.011+0000 7fa71f7e8640 1 -- 172.21.15.134:0/3403622018 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa71801f070 con 0x7fa71409b060 2024-04-24T02:12:22.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.011+0000 7fa71f7e8640 1 --2- 172.21.15.134:0/3403622018 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fa718031040 0x7fa718032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.011+0000 7fa71f7e8640 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e3170 con 0x7fa718031040 2024-04-24T02:12:22.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.011+0000 7fa71efe7640 1 --2- 172.21.15.134:0/3403622018 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fa718031040 0x7fa718032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.011+0000 7fa71efe7640 1 --2- 172.21.15.134:0/3403622018 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fa718031040 0x7fa718032940 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.012+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa710048040 con 0x7fa718031040 2024-04-24T02:12:22.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.012+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e3170 con 0x55e5673da590 2024-04-24T02:12:22.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.012+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa710048040 con 0x55e5673da590 2024-04-24T02:12:22.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.012+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e3170 con 0x55e5673da590 2024-04-24T02:12:22.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.012+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa710048040 con 0x55e5673da590 2024-04-24T02:12:22.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.012+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e3170 con 0x7fa718031040 2024-04-24T02:12:22.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.012+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa710048040 con 0x7fa718031040 2024-04-24T02:12:22.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.012+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e3170 con 0x7fa718031040 2024-04-24T02:12:22.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.013+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa710048040 con 0x7fa718031040 2024-04-24T02:12:22.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.013+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e3170 con 0x7fa71409b060 2024-04-24T02:12:22.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.013+0000 7fa71f7e8640 1 -- 172.21.15.134:0/3403622018 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa71801f070 con 0x7fa71409b060 2024-04-24T02:12:22.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.013+0000 7fa71f7e8640 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e3170 con 0x55e5673e06d0 2024-04-24T02:12:22.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.013+0000 7fa71e7e6640 1 -- 172.21.15.134:0/3403622018 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa714098030 con 0x55e5673e06d0 2024-04-24T02:12:22.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.013+0000 7fa71e7e6640 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e3170 con 0x55e5673da590 2024-04-24T02:12:22.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.013+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa710048040 con 0x55e5673da590 2024-04-24T02:12:22.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.013+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e3170 con 0x7fa718031040 2024-04-24T02:12:22.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.013+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa710048040 con 0x7fa718031040 2024-04-24T02:12:22.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.013+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e3170 con 0x55e5673da590 2024-04-24T02:12:22.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.014+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa710048040 con 0x55e5673da590 2024-04-24T02:12:22.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.014+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e3170 con 0x7fa71409b060 2024-04-24T02:12:22.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.014+0000 7fa71f7e8640 1 -- 172.21.15.134:0/3403622018 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa71801f070 con 0x7fa71409b060 2024-04-24T02:12:22.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.014+0000 7fa71f7e8640 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e3170 con 0x55e5673e06d0 2024-04-24T02:12:22.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.014+0000 7fa71e7e6640 1 -- 172.21.15.134:0/3403622018 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa714098030 con 0x55e5673e06d0 2024-04-24T02:12:22.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.014+0000 7fa71e7e6640 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e3170 con 0x55e5673e06d0 2024-04-24T02:12:22.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.014+0000 7fa71e7e6640 1 -- 172.21.15.134:0/3403622018 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa714098030 con 0x55e5673e06d0 2024-04-24T02:12:22.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.014+0000 7fa71e7e6640 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e3170 con 0x7fa718031040 2024-04-24T02:12:22.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.015+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa710048040 con 0x7fa718031040 2024-04-24T02:12:22.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.015+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e3170 con 0x55e5673e06d0 2024-04-24T02:12:22.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.015+0000 7fa71e7e6640 1 -- 172.21.15.134:0/3403622018 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa714098030 con 0x55e5673e06d0 2024-04-24T02:12:22.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.015+0000 7fa71e7e6640 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e3170 con 0x55e5673e06d0 2024-04-24T02:12:22.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.015+0000 7fa71e7e6640 1 -- 172.21.15.134:0/3403622018 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa714098030 con 0x55e5673e06d0 2024-04-24T02:12:22.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.015+0000 7fa71e7e6640 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e3170 con 0x55e5673da590 2024-04-24T02:12:22.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.015+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa710048040 con 0x55e5673da590 2024-04-24T02:12:22.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.015+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e3170 con 0x55e5673da590 2024-04-24T02:12:22.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.015+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fa710048040 con 0x55e5673da590 2024-04-24T02:12:22.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.015+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e3170 con 0x7fa718031040 2024-04-24T02:12:22.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.016+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa710048040 con 0x7fa718031040 2024-04-24T02:12:22.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.016+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e3170 con 0x55e5673e06d0 2024-04-24T02:12:22.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.016+0000 7fa71e7e6640 1 -- 172.21.15.134:0/3403622018 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa714098030 con 0x55e5673e06d0 2024-04-24T02:12:22.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.016+0000 7fa71e7e6640 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e3170 con 0x7fa71409b060 2024-04-24T02:12:22.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.016+0000 7fa71f7e8640 1 -- 172.21.15.134:0/3403622018 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa71801f070 con 0x7fa71409b060 2024-04-24T02:12:22.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.016+0000 7fa71f7e8640 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e3170 con 0x55e5673da590 2024-04-24T02:12:22.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.016+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa710048040 con 0x55e5673da590 2024-04-24T02:12:22.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.016+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e3170 con 0x7fa718031040 2024-04-24T02:12:22.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.017+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa710048040 con 0x7fa718031040 2024-04-24T02:12:22.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.017+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e3170 con 0x55e5673e06d0 2024-04-24T02:12:22.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.017+0000 7fa71e7e6640 1 -- 172.21.15.134:0/3403622018 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa714098030 con 0x55e5673e06d0 2024-04-24T02:12:22.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.017+0000 7fa71e7e6640 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e3170 con 0x7fa718031040 2024-04-24T02:12:22.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.017+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa710048040 con 0x7fa718031040 2024-04-24T02:12:22.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.017+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e3170 con 0x7fa71409b060 2024-04-24T02:12:22.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.017+0000 7fa71f7e8640 1 -- 172.21.15.134:0/3403622018 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa71801f070 con 0x7fa71409b060 2024-04-24T02:12:22.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.017+0000 7fa71f7e8640 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e3170 con 0x55e5673e06d0 2024-04-24T02:12:22.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.018+0000 7fa71e7e6640 1 -- 172.21.15.134:0/3403622018 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa714098030 con 0x55e5673e06d0 2024-04-24T02:12:22.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.018+0000 7fa71e7e6640 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e3170 con 0x7fa718031040 2024-04-24T02:12:22.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.018+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa710048040 con 0x7fa718031040 2024-04-24T02:12:22.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.018+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e3170 con 0x55e5673da590 2024-04-24T02:12:22.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.018+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa710048040 con 0x55e5673da590 2024-04-24T02:12:22.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.018+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e3170 con 0x7fa71409b060 2024-04-24T02:12:22.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.018+0000 7fa71f7e8640 1 -- 172.21.15.134:0/3403622018 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa71801f070 con 0x7fa71409b060 2024-04-24T02:12:22.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.018+0000 7fa72331f800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:22.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.018+0000 7fa72331f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:22.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.018+0000 7fa72331f800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:22.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.018+0000 7fa72331f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:22.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.018+0000 7fa72331f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:22.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.018+0000 7fa72331f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:22.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.018+0000 7fa72331f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.018+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e5673df150 con 0x55e5673da590 2024-04-24T02:12:22.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.019+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa710048040 con 0x55e5673da590 2024-04-24T02:12:22.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.019+0000 7fa72331f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:22.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.019+0000 7fa72331f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.019+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e5673df9f0 con 0x55e5673da590 2024-04-24T02:12:22.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.019+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa710048040 con 0x55e5673da590 2024-04-24T02:12:22.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.019+0000 7fa72331f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:22.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.019+0000 7fa72331f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.019+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e5673ded90 con 0x55e5673da590 2024-04-24T02:12:22.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.019+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa710048040 con 0x55e5673da590 2024-04-24T02:12:22.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.019+0000 7fa72331f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:22.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.019+0000 7fa72331f800 20 zone default found 2024-04-24T02:12:22.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.019+0000 7fa72331f800 4 Realm: () 2024-04-24T02:12:22.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.019+0000 7fa72331f800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:22.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.019+0000 7fa72331f800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:22.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.019+0000 7fa72331f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:22.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.019+0000 7fa72331f800 20 zonegroup default 2024-04-24T02:12:22.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.019+0000 7fa72331f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.019+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e35f0 con 0x7fa718031040 2024-04-24T02:12:22.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.019+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa710048040 con 0x7fa718031040 2024-04-24T02:12:22.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.019+0000 7fa72331f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:22.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.020+0000 7fa72331f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.020+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e5480 con 0x55e5673e06d0 2024-04-24T02:12:22.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.020+0000 7fa71e7e6640 1 -- 172.21.15.134:0/3403622018 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa714098030 con 0x55e5673e06d0 2024-04-24T02:12:22.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.020+0000 7fa72331f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:22.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.020+0000 7fa72331f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.020+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e5820 con 0x55e5673e06d0 2024-04-24T02:12:22.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.020+0000 7fa71e7e6640 1 -- 172.21.15.134:0/3403622018 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa714098030 con 0x55e5673e06d0 2024-04-24T02:12:22.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.020+0000 7fa72331f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:22.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.020+0000 7fa72331f800 20 started sync module instance, tier type = 2024-04-24T02:12:22.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.020+0000 7fa72331f800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:22.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.020+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e4910 con 0x7fa71409b060 2024-04-24T02:12:22.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.021+0000 7fa71f7e8640 1 -- 172.21.15.134:0/3403622018 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa718040040 con 0x7fa71409b060 2024-04-24T02:12:22.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.021+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94443768007984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e4570 con 0x7fa71409b060 2024-04-24T02:12:22.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.021+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e66e0 con 0x55e5673da590 2024-04-24T02:12:22.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.022+0000 7fa71f7e8640 1 -- 172.21.15.134:0/3403622018 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94443768007984] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa718040040 con 0x7fa71409b060 2024-04-24T02:12:22.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.022+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa710048040 con 0x55e5673da590 2024-04-24T02:12:22.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.022+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94443768011792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e66e0 con 0x55e5673da590 2024-04-24T02:12:22.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.022+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e70a0 con 0x55e5673e06d0 2024-04-24T02:12:22.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.023+0000 7fa71e7e6640 1 -- 172.21.15.134:0/3403622018 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa714098030 con 0x55e5673e06d0 2024-04-24T02:12:22.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.023+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94443768015856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e7940 con 0x55e5673e06d0 2024-04-24T02:12:22.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.023+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e83e0 con 0x7fa71409b060 2024-04-24T02:12:22.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.024+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94443768011792] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa710048040 con 0x55e5673da590 2024-04-24T02:12:22.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.024+0000 7fa71e7e6640 1 -- 172.21.15.134:0/3403622018 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94443768015856] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa714098030 con 0x55e5673e06d0 2024-04-24T02:12:22.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.025+0000 7fa71f7e8640 1 -- 172.21.15.134:0/3403622018 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa718040040 con 0x7fa71409b060 2024-04-24T02:12:22.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.025+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94443768018064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e6230 con 0x7fa71409b060 2024-04-24T02:12:22.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.025+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e8df0 con 0x55e5673da590 2024-04-24T02:12:22.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.026+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa710048040 con 0x55e5673da590 2024-04-24T02:12:22.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.026+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94443768023360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e9210 con 0x55e5673da590 2024-04-24T02:12:22.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.026+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e9c30 con 0x7fa718031040 2024-04-24T02:12:22.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.026+0000 7fa71f7e8640 1 -- 172.21.15.134:0/3403622018 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94443768018064] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa718040040 con 0x7fa71409b060 2024-04-24T02:12:22.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.027+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa710048040 con 0x7fa718031040 2024-04-24T02:12:22.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.027+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94443768026912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e9bf0 con 0x7fa718031040 2024-04-24T02:12:22.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.027+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e5673ea640 con 0x7fa718031040 2024-04-24T02:12:22.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.027+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94443768023360] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa710048040 con 0x55e5673da590 2024-04-24T02:12:22.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.027+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94443768026912] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa710048040 con 0x7fa718031040 2024-04-24T02:12:22.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.028+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(56 notify.6 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa710048040 con 0x7fa718031040 2024-04-24T02:12:22.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.028+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94443768020656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e5673ea190 con 0x7fa718031040 2024-04-24T02:12:22.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.028+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e5673eab50 con 0x7fa718031040 2024-04-24T02:12:22.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.029+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(58 notify.7 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa710048040 con 0x7fa718031040 2024-04-24T02:12:22.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.029+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94443768020656] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa710048040 con 0x7fa718031040 2024-04-24T02:12:22.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.029+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94443768030880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e5673eaf70 con 0x7fa718031040 2024-04-24T02:12:22.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.029+0000 7fa72331f800 20 add_watcher() i=0 2024-04-24T02:12:22.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.029+0000 7fa72331f800 20 add_watcher() i=1 2024-04-24T02:12:22.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.029+0000 7fa72331f800 20 add_watcher() i=2 2024-04-24T02:12:22.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.029+0000 7fa72331f800 20 add_watcher() i=3 2024-04-24T02:12:22.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.029+0000 7fa72331f800 20 add_watcher() i=4 2024-04-24T02:12:22.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.029+0000 7fa72331f800 20 add_watcher() i=5 2024-04-24T02:12:22.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.029+0000 7fa72331f800 20 add_watcher() i=6 2024-04-24T02:12:22.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.029+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94443768030880] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa710048040 con 0x7fa718031040 2024-04-24T02:12:22.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.029+0000 7fa72331f800 20 add_watcher() i=7 2024-04-24T02:12:22.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.029+0000 7fa72331f800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:22.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.030+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e5673edfa0 con 0x55e5673da590 2024-04-24T02:12:22.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.030+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa710048040 con 0x55e5673da590 2024-04-24T02:12:22.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.030+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94443768031936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e5673eb3c0 con 0x55e5673da590 2024-04-24T02:12:22.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.031+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94443768031936] v30'60 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa710048040 con 0x55e5673da590 2024-04-24T02:12:22.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.032+0000 7fa5d57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:22.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.032+0000 7fa72331f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:22.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.032+0000 7fa72331f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:22.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.032+0000 7fa72331f800 5 note: GC not initialized 2024-04-24T02:12:22.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.032+0000 7fa54ffff640 20 reqs_thread_entry: start 2024-04-24T02:12:22.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.032+0000 7fa72331f800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:22.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.032+0000 7fa72331f800 20 Filter name: none 2024-04-24T02:12:22.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.032+0000 7fa54dffb640 20 reqs_thread_entry: start 2024-04-24T02:12:22.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.032+0000 7fa72331f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.032+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e567420db0 con 0x55e5673da590 2024-04-24T02:12:22.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.032+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa710048040 con 0x55e5673da590 2024-04-24T02:12:22.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.032+0000 7fa72331f800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T02:12:22.046 INFO:teuthology.orchestra.run.smithi134.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T02:12:21.778798Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T02:12:21.778786Z","tags":[],"group_ids":[]} 2024-04-24T02:12:22.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.033+0000 7fa5d57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:22.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.033+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94443768031936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e56741fd00 con 0x55e5673da590 2024-04-24T02:12:22.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.034+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94443768031936] v30'61 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa710048040 con 0x55e5673da590 2024-04-24T02:12:22.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.034+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94443768007984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e5673eaac0 con 0x7fa71409b060 2024-04-24T02:12:22.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.035+0000 7fa71f7e8640 1 -- 172.21.15.134:0/3403622018 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94443768007984] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa718040040 con 0x7fa71409b060 2024-04-24T02:12:22.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.035+0000 7fa72331f800 20 remove_watcher() i=0 2024-04-24T02:12:22.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.035+0000 7fa72331f800 2 removed watcher, disabling cache 2024-04-24T02:12:22.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.035+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94443768011792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e5673eaac0 con 0x55e5673da590 2024-04-24T02:12:22.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.036+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94443768011792] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa710048040 con 0x55e5673da590 2024-04-24T02:12:22.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.036+0000 7fa72331f800 20 remove_watcher() i=1 2024-04-24T02:12:22.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.036+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94443768015856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e5673eaac0 con 0x55e5673e06d0 2024-04-24T02:12:22.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.037+0000 7fa71e7e6640 1 -- 172.21.15.134:0/3403622018 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94443768015856] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa714098030 con 0x55e5673e06d0 2024-04-24T02:12:22.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.037+0000 7fa72331f800 20 remove_watcher() i=2 2024-04-24T02:12:22.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.037+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94443768018064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e6bf0 con 0x7fa71409b060 2024-04-24T02:12:22.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.038+0000 7fa71f7e8640 1 -- 172.21.15.134:0/3403622018 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94443768018064] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa718040040 con 0x7fa71409b060 2024-04-24T02:12:22.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.038+0000 7fa72331f800 20 remove_watcher() i=3 2024-04-24T02:12:22.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.038+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94443768023360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e7490 con 0x55e5673da590 2024-04-24T02:12:22.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.039+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94443768023360] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa710048040 con 0x55e5673da590 2024-04-24T02:12:22.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.039+0000 7fa72331f800 20 remove_watcher() i=4 2024-04-24T02:12:22.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.039+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94443768026912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e6bf0 con 0x7fa718031040 2024-04-24T02:12:22.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.040+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94443768026912] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa710048040 con 0x7fa718031040 2024-04-24T02:12:22.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.040+0000 7fa72331f800 20 remove_watcher() i=5 2024-04-24T02:12:22.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.040+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94443768020656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e9720 con 0x7fa718031040 2024-04-24T02:12:22.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.041+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94443768020656] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa710048040 con 0x7fa718031040 2024-04-24T02:12:22.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.041+0000 7fa72331f800 20 remove_watcher() i=6 2024-04-24T02:12:22.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.041+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94443768030880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e5673e6bf0 con 0x7fa718031040 2024-04-24T02:12:22.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.042+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94443768030880] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa710048040 con 0x7fa718031040 2024-04-24T02:12:22.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.042+0000 7fa72331f800 20 remove_watcher() i=7 2024-04-24T02:12:22.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.042+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fa718031040 msgr2=0x7fa718032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.042+0000 7fa72331f800 1 --2- 172.21.15.134:0/3403622018 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fa718031040 0x7fa718032940 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.042+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e5673da590 msgr2=0x55e5673dca50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.042+0000 7fa72331f800 1 --2- 172.21.15.134:0/3403622018 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e5673da590 0x55e5673dca50 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.042+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fa71409b060 msgr2=0x7fa7140728a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.042+0000 7fa72331f800 1 --2- 172.21.15.134:0/3403622018 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fa71409b060 0x7fa7140728a0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.042+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55e5673e06d0 msgr2=0x55e5673e2ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.042+0000 7fa72331f800 1 --2- 172.21.15.134:0/3403622018 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55e5673e06d0 0x55e5673e2ac0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.042+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa5e8036950 msgr2=0x7fa5e8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.042+0000 7fa72331f800 1 --2- 172.21.15.134:0/3403622018 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa5e8036950 0x7fa5e8038e10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x55e5673a6760 tx=0x7fa71801f000 comp rx=0 tx=0).stop 2024-04-24T02:12:22.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.042+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5673c7520 msgr2=0x55e5673ceb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.042+0000 7fa71efe7640 1 -- 172.21.15.134:0/3403622018 reap_dead start 2024-04-24T02:12:22.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.042+0000 7fa72331f800 1 --2- 172.21.15.134:0/3403622018 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5673c7520 0x55e5673ceb50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa71405bed0 tx=0x7fa71408d510 comp rx=0 tx=0).stop 2024-04-24T02:12:22.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.043+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 shutdown_connections 2024-04-24T02:12:22.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.043+0000 7fa72331f800 1 --2- 172.21.15.134:0/3403622018 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5673c7520 0x55e5673ceb50 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.043+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 >> 172.21.15.134:0/3403622018 conn(0x55e5673c3880 msgr2=0x55e5673c0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:22.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.043+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 shutdown_connections 2024-04-24T02:12:22.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.043+0000 7fa72331f800 1 -- 172.21.15.134:0/3403622018 wait complete. 2024-04-24T02:12:22.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.043+0000 7fa72331f800 1 -- 172.21.15.134:0/1731834293 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa5f8036950 msgr2=0x7fa5f8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.043+0000 7fa72331f800 1 --2- 172.21.15.134:0/1731834293 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa5f8036950 0x7fa5f8038e10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x55e5673aa370 tx=0x7fa718005840 comp rx=0 tx=0).stop 2024-04-24T02:12:22.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.043+0000 7fa72331f800 1 -- 172.21.15.134:0/1731834293 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5673ba2e0 msgr2=0x55e5673ba700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.043+0000 7fa72331f800 1 --2- 172.21.15.134:0/1731834293 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5673ba2e0 0x55e5673ba700 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa714044730 tx=0x7fa714002fb0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.043+0000 7fa72331f800 1 -- 172.21.15.134:0/1731834293 shutdown_connections 2024-04-24T02:12:22.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.043+0000 7fa72331f800 1 --2- 172.21.15.134:0/1731834293 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa5f8036950 0x7fa5f8038e10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.043+0000 7fa72331f800 1 --2- 172.21.15.134:0/1731834293 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5673ba2e0 0x55e5673ba700 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.043+0000 7fa72331f800 1 -- 172.21.15.134:0/1731834293 >> 172.21.15.134:0/1731834293 conn(0x55e5673ae380 msgr2=0x55e5673ae780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:22.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.043+0000 7fa72331f800 1 -- 172.21.15.134:0/1731834293 shutdown_connections 2024-04-24T02:12:22.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.043+0000 7fa72331f800 1 -- 172.21.15.134:0/1731834293 wait complete. 2024-04-24T02:12:22.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.043+0000 7fa72331f800 1 -- 172.21.15.134:0/3652342838 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e5672a72c0 msgr2=0x55e5673a9240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.043+0000 7fa72331f800 1 --2- 172.21.15.134:0/3652342838 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e5672a72c0 0x55e5673a9240 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.043+0000 7fa72331f800 1 -- 172.21.15.134:0/3652342838 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa604036900 msgr2=0x7fa604038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.043+0000 7fa72331f800 1 --2- 172.21.15.134:0/3652342838 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa604036900 0x7fa604038dc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa714054000 tx=0x7fa71404e000 comp rx=0 tx=0).stop 2024-04-24T02:12:22.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.043+0000 7fa72331f800 1 -- 172.21.15.134:0/3652342838 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5672a5780 msgr2=0x55e5673a2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.043+0000 7fa72331f800 1 --2- 172.21.15.134:0/3652342838 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5672a5780 0x55e5673a2000 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa71000b210 tx=0x7fa710000ed0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.043+0000 7fa72331f800 1 -- 172.21.15.134:0/3652342838 shutdown_connections 2024-04-24T02:12:22.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.043+0000 7fa72331f800 1 --2- 172.21.15.134:0/3652342838 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e5672a72c0 0x55e5673a9240 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.043+0000 7fa72331f800 1 --2- 172.21.15.134:0/3652342838 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa604036900 0x7fa604038dc0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.043+0000 7fa72331f800 1 --2- 172.21.15.134:0/3652342838 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5672a5780 0x55e5673a2000 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.043+0000 7fa72331f800 1 -- 172.21.15.134:0/3652342838 >> 172.21.15.134:0/3652342838 conn(0x55e5672a1320 msgr2=0x55e5673945a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:22.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.044+0000 7fa72331f800 1 -- 172.21.15.134:0/3652342838 shutdown_connections 2024-04-24T02:12:22.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.044+0000 7fa72331f800 1 -- 172.21.15.134:0/3652342838 wait complete. 2024-04-24T02:12:22.056 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T02:12:21.778798Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:12:21.778786Z', 'tags': [], 'group_ids': []} 2024-04-24T02:12:22.057 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-04-24T02:12:22.057 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-04-24T02:12:22.057 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-04-24T02:12:22.140 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:22.140 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:22.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.139+0000 7f95b622f800 1 Processor -- start 2024-04-24T02:12:22.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.139+0000 7f95b622f800 1 -- start start 2024-04-24T02:12:22.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.139+0000 7f95b622f800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x560c391d4ed0 0x560c391d52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.139+0000 7f95b622f800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560c39093d40 con 0x560c391d6130 2024-04-24T02:12:22.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.139+0000 7f95b622f800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x560c390664d0 con 0x560c391d4ed0 2024-04-24T02:12:22.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.140+0000 7f95b15c0640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x560c391d4ed0 0x560c391d52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.140+0000 7f95b15c0640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x560c391d4ed0 0x560c391d52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45662/0 (socket says 172.21.15.134:45662) 2024-04-24T02:12:22.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.140+0000 7f95b15c0640 1 -- 172.21.15.134:0/2069670467 learned_addr learned my addr 172.21.15.134:0/2069670467 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:22.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.140+0000 7f95b0dbf640 1 -- 172.21.15.134:0/2069670467 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2061189604 0 0) 0x560c39093d40 con 0x560c391d6130 2024-04-24T02:12:22.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.140+0000 7f95b0dbf640 1 -- 172.21.15.134:0/2069670467 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95a0001e10 con 0x560c391d6130 2024-04-24T02:12:22.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.140+0000 7f95b15c0640 1 -- 172.21.15.134:0/2069670467 >> v1:172.21.15.104:6789/0 conn(0x560c391d6130 legacy=0x560c391d65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.140+0000 7f95b15c0640 1 -- 172.21.15.134:0/2069670467 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c39092590 con 0x560c391d4ed0 2024-04-24T02:12:22.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.142+0000 7f95b15c0640 1 --2- 172.21.15.134:0/2069670467 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c391d4ed0 0x560c391d52f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f95a400a520 tx=0x7f95a401cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b112c83b4be71686 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.142+0000 7f95b0dbf640 1 -- 172.21.15.134:0/2069670467 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95a4057070 con 0x560c391d4ed0 2024-04-24T02:12:22.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.142+0000 7f95b0dbf640 1 -- 172.21.15.134:0/2069670467 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95a4052570 con 0x560c391d4ed0 2024-04-24T02:12:22.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.142+0000 7f95b0dbf640 1 -- 172.21.15.134:0/2069670467 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95a4052870 con 0x560c391d4ed0 2024-04-24T02:12:22.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.142+0000 7f95b622f800 1 -- 172.21.15.134:0/2069670467 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c391d4ed0 msgr2=0x560c391d52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.142+0000 7f95b622f800 1 --2- 172.21.15.134:0/2069670467 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c391d4ed0 0x560c391d52f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f95a400a520 tx=0x7f95a401cf30 comp rx=0 tx=0).stop 2024-04-24T02:12:22.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.142+0000 7f95b622f800 1 -- 172.21.15.134:0/2069670467 shutdown_connections 2024-04-24T02:12:22.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.142+0000 7f95b622f800 1 --2- 172.21.15.134:0/2069670467 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c391d4ed0 0x560c391d52f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.142+0000 7f95b622f800 1 -- 172.21.15.134:0/2069670467 >> 172.21.15.134:0/2069670467 conn(0x560c391d04d0 msgr2=0x560c391d28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:22.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.142+0000 7f95b622f800 1 -- 172.21.15.134:0/2069670467 shutdown_connections 2024-04-24T02:12:22.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.142+0000 7f95b622f800 1 -- 172.21.15.134:0/2069670467 wait complete. 2024-04-24T02:12:22.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.154+0000 7f95b622f800 1 Processor -- start 2024-04-24T02:12:22.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.154+0000 7f95b622f800 1 -- start start 2024-04-24T02:12:22.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.154+0000 7f95b622f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c391d4ed0 0x560c392c6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.154+0000 7f95b622f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560c391203c0 con 0x560c391d4ed0 2024-04-24T02:12:22.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.154+0000 7f95b15c0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c391d4ed0 0x560c392c6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.154+0000 7f95b15c0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c391d4ed0 0x560c392c6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45668/0 (socket says 172.21.15.134:45668) 2024-04-24T02:12:22.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.154+0000 7f95b15c0640 1 -- 172.21.15.134:0/3267284598 learned_addr learned my addr 172.21.15.134:0/3267284598 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:22.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.155+0000 7f95b15c0640 1 -- 172.21.15.134:0/3267284598 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c392c6930 con 0x560c391d4ed0 2024-04-24T02:12:22.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.155+0000 7f95b15c0640 1 --2- 172.21.15.134:0/3267284598 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c391d4ed0 0x560c392c6360 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f95a4000c00 tx=0x7f95a404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df751bed052810db server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.155+0000 7f949f606640 1 -- 172.21.15.134:0/3267284598 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95a4057040 con 0x560c391d4ed0 2024-04-24T02:12:22.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.155+0000 7f949f606640 1 -- 172.21.15.134:0/3267284598 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95a4052850 con 0x560c391d4ed0 2024-04-24T02:12:22.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.155+0000 7f949f606640 1 -- 172.21.15.134:0/3267284598 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95a4052b50 con 0x560c391d4ed0 2024-04-24T02:12:22.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.156+0000 7f95b622f800 1 -- 172.21.15.134:0/3267284598 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c391d4ed0 msgr2=0x560c392c6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.156+0000 7f95b622f800 1 --2- 172.21.15.134:0/3267284598 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c391d4ed0 0x560c392c6360 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f95a4000c00 tx=0x7f95a404c000 comp rx=0 tx=0).stop 2024-04-24T02:12:22.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.156+0000 7f95b622f800 1 -- 172.21.15.134:0/3267284598 shutdown_connections 2024-04-24T02:12:22.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.156+0000 7f95b622f800 1 --2- 172.21.15.134:0/3267284598 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c391d4ed0 0x560c392c6360 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.156+0000 7f95b622f800 1 -- 172.21.15.134:0/3267284598 >> 172.21.15.134:0/3267284598 conn(0x560c391d04d0 msgr2=0x560c392c1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:22.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.156+0000 7f95b622f800 1 -- 172.21.15.134:0/3267284598 shutdown_connections 2024-04-24T02:12:22.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.156+0000 7f95b622f800 1 -- 172.21.15.134:0/3267284598 wait complete. 2024-04-24T02:12:22.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.156+0000 7f95b622f800 1 Processor -- start 2024-04-24T02:12:22.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.156+0000 7f95b622f800 1 -- start start 2024-04-24T02:12:22.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.156+0000 7f95b622f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c391d4ed0 0x560c392cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.156+0000 7f95b622f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560c391de5a0 con 0x560c391d4ed0 2024-04-24T02:12:22.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.156+0000 7f95b15c0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c391d4ed0 0x560c392cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.156+0000 7f95b15c0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c391d4ed0 0x560c392cdea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45676/0 (socket says 172.21.15.134:45676) 2024-04-24T02:12:22.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.156+0000 7f95b15c0640 1 -- 172.21.15.134:0/231592485 learned_addr learned my addr 172.21.15.134:0/231592485 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:22.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.157+0000 7f95b15c0640 1 -- 172.21.15.134:0/231592485 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c392ce3e0 con 0x560c391d4ed0 2024-04-24T02:12:22.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.157+0000 7f95b15c0640 1 --2- 172.21.15.134:0/231592485 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c391d4ed0 0x560c392cdea0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f95a4052540 tx=0x7f95a4003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.157+0000 7f949de03640 1 -- 172.21.15.134:0/231592485 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95a4073070 con 0x560c391d4ed0 2024-04-24T02:12:22.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.157+0000 7f949de03640 1 -- 172.21.15.134:0/231592485 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95a405d440 con 0x560c391d4ed0 2024-04-24T02:12:22.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.157+0000 7f95b622f800 1 -- 172.21.15.134:0/231592485 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560c392ce670 con 0x560c391d4ed0 2024-04-24T02:12:22.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.157+0000 7f949de03640 1 -- 172.21.15.134:0/231592485 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95a4057070 con 0x560c391d4ed0 2024-04-24T02:12:22.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.157+0000 7f95b622f800 1 -- 172.21.15.134:0/231592485 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c392d1280 con 0x560c391d4ed0 2024-04-24T02:12:22.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.158+0000 7f949de03640 1 -- 172.21.15.134:0/231592485 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f95a4076070 con 0x560c391d4ed0 2024-04-24T02:12:22.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.158+0000 7f949de03640 1 --2- 172.21.15.134:0/231592485 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9498036950 0x7f9498038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.158+0000 7f949de03640 1 -- 172.21.15.134:0/231592485 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f95a408d940 con 0x560c391d4ed0 2024-04-24T02:12:22.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.158+0000 7f95a8dbf640 1 --2- 172.21.15.134:0/231592485 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9498036950 0x7f9498038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.158+0000 7f95b622f800 1 --2- 172.21.15.134:0/231592485 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560c391d6130 0x560c392d5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.158+0000 7f95b622f800 1 -- 172.21.15.134:0/231592485 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c392d5580 con 0x560c391d6130 2024-04-24T02:12:22.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.158+0000 7f95b1dc1640 1 --2- 172.21.15.134:0/231592485 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560c391d6130 0x560c392d5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.158+0000 7f95a8dbf640 1 --2- 172.21.15.134:0/231592485 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9498036950 0x7f9498038e10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f959c001e30 tx=0x7f959c0013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.159+0000 7f95b1dc1640 1 --2- 172.21.15.134:0/231592485 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560c391d6130 0x560c392d5040 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.159+0000 7f95b1dc1640 1 -- 172.21.15.134:0/231592485 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f95ac00a4a0 con 0x560c391d6130 2024-04-24T02:12:22.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.159+0000 7f95b622f800 1 -- 172.21.15.134:0/231592485 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c392d2610 con 0x560c391d6130 2024-04-24T02:12:22.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.159+0000 7f95b1dc1640 1 -- 172.21.15.134:0/231592485 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f95ac00a4a0 con 0x560c391d6130 2024-04-24T02:12:22.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.159+0000 7f95b622f800 1 -- 172.21.15.134:0/231592485 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c392d7380 con 0x560c391d6130 2024-04-24T02:12:22.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.159+0000 7f95b1dc1640 1 -- 172.21.15.134:0/231592485 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f95ac00a4a0 con 0x560c391d6130 2024-04-24T02:12:22.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.159+0000 7f95b622f800 1 -- 172.21.15.134:0/231592485 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c392d66c0 con 0x560c391d6130 2024-04-24T02:12:22.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.160+0000 7f95b1dc1640 1 -- 172.21.15.134:0/231592485 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f95ac00a4a0 con 0x560c391d6130 2024-04-24T02:12:22.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.160+0000 7f95b622f800 1 -- 172.21.15.134:0/231592485 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c392d6b10 con 0x560c391d6130 2024-04-24T02:12:22.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.160+0000 7f95b1dc1640 1 -- 172.21.15.134:0/231592485 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f95ac00a4a0 con 0x560c391d6130 2024-04-24T02:12:22.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.160+0000 7f95b622f800 1 Processor -- start 2024-04-24T02:12:22.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.160+0000 7f95b622f800 1 -- start start 2024-04-24T02:12:22.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.160+0000 7f95b622f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c3914a370 0x560c391487e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.160+0000 7f95b622f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560c390c66b0 con 0x560c3914a370 2024-04-24T02:12:22.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.161+0000 7f95a8dbf640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c3914a370 0x560c391487e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.161+0000 7f95a8dbf640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c3914a370 0x560c391487e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45692/0 (socket says 172.21.15.134:45692) 2024-04-24T02:12:22.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.161+0000 7f95a8dbf640 1 -- 172.21.15.134:0/909468378 learned_addr learned my addr 172.21.15.134:0/909468378 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:22.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.161+0000 7f95a8dbf640 1 -- 172.21.15.134:0/909468378 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c39148d20 con 0x560c3914a370 2024-04-24T02:12:22.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.161+0000 7f95a8dbf640 1 --2- 172.21.15.134:0/909468378 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c3914a370 0x560c391487e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f959c00be20 tx=0x7f959c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.161+0000 7f9496ffd640 1 -- 172.21.15.134:0/909468378 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f959c01c540 con 0x560c3914a370 2024-04-24T02:12:22.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.161+0000 7f9496ffd640 1 -- 172.21.15.134:0/909468378 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f959c017050 con 0x560c3914a370 2024-04-24T02:12:22.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.161+0000 7f95b622f800 1 -- 172.21.15.134:0/909468378 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560c39148fb0 con 0x560c3914a370 2024-04-24T02:12:22.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.161+0000 7f9496ffd640 1 -- 172.21.15.134:0/909468378 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f959c01c870 con 0x560c3914a370 2024-04-24T02:12:22.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.161+0000 7f95b622f800 1 -- 172.21.15.134:0/909468378 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c391494b0 con 0x560c3914a370 2024-04-24T02:12:22.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.162+0000 7f9496ffd640 1 -- 172.21.15.134:0/909468378 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f959c00e070 con 0x560c3914a370 2024-04-24T02:12:22.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.162+0000 7f9496ffd640 1 --2- 172.21.15.134:0/909468378 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9488036950 0x7f9488038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.162+0000 7f9496ffd640 1 -- 172.21.15.134:0/909468378 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f959c04e0f0 con 0x560c3914a370 2024-04-24T02:12:22.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.162+0000 7f95b1dc1640 1 --2- 172.21.15.134:0/909468378 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9488036950 0x7f9488038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.163+0000 7f95b622f800 1 Processor -- start 2024-04-24T02:12:22.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.163+0000 7f95b1dc1640 1 --2- 172.21.15.134:0/909468378 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9488036950 0x7f9488038e10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x560c392d61e0 tx=0x7f95ac005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.163+0000 7f95b622f800 1 -- start start 2024-04-24T02:12:22.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.163+0000 7f95b622f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c392f5630 0x560c392f5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.163+0000 7f95b622f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560c392c6bf0 con 0x560c392f5630 2024-04-24T02:12:22.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.163+0000 7f95a8dbf640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c392f5630 0x560c392f5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.163+0000 7f95a8dbf640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c392f5630 0x560c392f5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45708/0 (socket says 172.21.15.134:45708) 2024-04-24T02:12:22.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.163+0000 7f95a8dbf640 1 -- 172.21.15.134:0/2638894594 learned_addr learned my addr 172.21.15.134:0/2638894594 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:22.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.163+0000 7f95a8dbf640 1 -- 172.21.15.134:0/2638894594 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c392f6020 con 0x560c392f5630 2024-04-24T02:12:22.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.163+0000 7f95a8dbf640 1 --2- 172.21.15.134:0/2638894594 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c392f5630 0x560c392f5a50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f959c00bff0 tx=0x7f959c0233f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9791d94e725e6335 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.164+0000 7f9494ff9640 1 -- 172.21.15.134:0/2638894594 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f959c04b190 con 0x560c392f5630 2024-04-24T02:12:22.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.164+0000 7f9494ff9640 1 -- 172.21.15.134:0/2638894594 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f959c023d90 con 0x560c392f5630 2024-04-24T02:12:22.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.164+0000 7f9494ff9640 1 -- 172.21.15.134:0/2638894594 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f959c025a50 con 0x560c392f5630 2024-04-24T02:12:22.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.164+0000 7f95b622f800 1 -- 172.21.15.134:0/2638894594 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c392f5630 msgr2=0x560c392f5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.164+0000 7f95b622f800 1 --2- 172.21.15.134:0/2638894594 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c392f5630 0x560c392f5a50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f959c00bff0 tx=0x7f959c0233f0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.164+0000 7f95b622f800 1 -- 172.21.15.134:0/2638894594 shutdown_connections 2024-04-24T02:12:22.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.164+0000 7f95b622f800 1 --2- 172.21.15.134:0/2638894594 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c392f5630 0x560c392f5a50 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.164+0000 7f95b622f800 1 -- 172.21.15.134:0/2638894594 >> 172.21.15.134:0/2638894594 conn(0x560c392f1990 msgr2=0x560c392ef9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:22.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.164+0000 7f95b622f800 1 -- 172.21.15.134:0/2638894594 shutdown_connections 2024-04-24T02:12:22.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.164+0000 7f95b622f800 1 -- 172.21.15.134:0/2638894594 wait complete. 2024-04-24T02:12:22.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.164+0000 7f95b622f800 1 Processor -- start 2024-04-24T02:12:22.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.164+0000 7f95b622f800 1 -- start start 2024-04-24T02:12:22.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.164+0000 7f95b622f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c392f5630 0x560c392fcc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.164+0000 7f95b622f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560c392f6790 con 0x560c392f5630 2024-04-24T02:12:22.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.165+0000 7f95a8dbf640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c392f5630 0x560c392fcc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.165+0000 7f95a8dbf640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c392f5630 0x560c392fcc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45724/0 (socket says 172.21.15.134:45724) 2024-04-24T02:12:22.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.165+0000 7f95a8dbf640 1 -- 172.21.15.134:0/1821960007 learned_addr learned my addr 172.21.15.134:0/1821960007 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:22.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.165+0000 7f95a8dbf640 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c392fd1a0 con 0x560c392f5630 2024-04-24T02:12:22.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.165+0000 7f95a8dbf640 1 --2- 172.21.15.134:0/1821960007 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c392f5630 0x560c392fcc60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f959c0234c0 tx=0x7f959c04c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.165+0000 7f9486ffd640 1 -- 172.21.15.134:0/1821960007 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f959c032020 con 0x560c392f5630 2024-04-24T02:12:22.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.165+0000 7f9486ffd640 1 -- 172.21.15.134:0/1821960007 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f959c01a310 con 0x560c392f5630 2024-04-24T02:12:22.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.165+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560c392fd430 con 0x560c392f5630 2024-04-24T02:12:22.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.165+0000 7f9486ffd640 1 -- 172.21.15.134:0/1821960007 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f959c045040 con 0x560c392f5630 2024-04-24T02:12:22.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.165+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c393000e0 con 0x560c392f5630 2024-04-24T02:12:22.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.166+0000 7f9486ffd640 1 -- 172.21.15.134:0/1821960007 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f959c035020 con 0x560c392f5630 2024-04-24T02:12:22.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.166+0000 7f9486ffd640 1 --2- 172.21.15.134:0/1821960007 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f947c036950 0x7f947c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.166+0000 7f9486ffd640 1 -- 172.21.15.134:0/1821960007 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f959c038ad0 con 0x560c392f5630 2024-04-24T02:12:22.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.166+0000 7f95b1dc1640 1 --2- 172.21.15.134:0/1821960007 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f947c036950 0x7f947c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.167+0000 7f95b622f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.167+0000 7f95b1dc1640 1 --2- 172.21.15.134:0/1821960007 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f947c036950 0x7f947c038e10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x560c392cf020 tx=0x7f95ac01f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.167+0000 7f95b622f800 1 --2- 172.21.15.134:0/1821960007 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560c39308790 0x560c3930ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.167+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c3930b3a0 con 0x560c39308790 2024-04-24T02:12:22.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.167+0000 7f95b15c0640 1 --2- 172.21.15.134:0/1821960007 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560c39308790 0x560c3930ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.167+0000 7f95b15c0640 1 --2- 172.21.15.134:0/1821960007 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560c39308790 0x560c3930ac50 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.167+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f95a4075030 con 0x560c39308790 2024-04-24T02:12:22.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.167+0000 7f95b622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:22.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.167+0000 7f95b622f800 20 realm 2024-04-24T02:12:22.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.167+0000 7f95b622f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.167+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c3930b7b0 con 0x560c39308790 2024-04-24T02:12:22.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.168+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f95a4075030 con 0x560c39308790 2024-04-24T02:12:22.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.168+0000 7f95b622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:22.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.168+0000 7f95b622f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:22.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.168+0000 7f95b622f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.168+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c3930c080 con 0x560c39308790 2024-04-24T02:12:22.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.168+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f95a4075030 con 0x560c39308790 2024-04-24T02:12:22.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.168+0000 7f95b622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:22.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.168+0000 7f95b622f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.168+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c3930c420 con 0x560c39308790 2024-04-24T02:12:22.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.168+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f95a4075030 con 0x560c39308790 2024-04-24T02:12:22.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.168+0000 7f95b622f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:22.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.168+0000 7f95b622f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.168+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c3930cc70 con 0x560c39308790 2024-04-24T02:12:22.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.168+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f95a4075030 con 0x560c39308790 2024-04-24T02:12:22.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.168+0000 7f95b622f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:22.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.168+0000 7f95b622f800 20 searching for the correct realm 2024-04-24T02:12:22.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.168+0000 7f95b622f800 1 --2- 172.21.15.134:0/1821960007 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x560c3930e9e0 0x560c39310dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.168+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c39311360 con 0x560c3930e9e0 2024-04-24T02:12:22.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.168+0000 7f95a8dbf640 1 --2- 172.21.15.134:0/1821960007 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x560c3930e9e0 0x560c39310dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.169+0000 7f95a8dbf640 1 --2- 172.21.15.134:0/1821960007 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x560c3930e9e0 0x560c39310dd0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.169+0000 7f95a8dbf640 1 -- 172.21.15.134:0/1821960007 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f959c038d70 con 0x560c3930e9e0 2024-04-24T02:12:22.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.169+0000 7f95a8dbf640 1 --2- 172.21.15.134:0/1821960007 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f959c037020 0x7f959c03e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.169+0000 7f95a8dbf640 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c39311360 con 0x7f959c037020 2024-04-24T02:12:22.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.169+0000 7f95b1dc1640 1 --2- 172.21.15.134:0/1821960007 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f959c037020 0x7f959c03e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.169+0000 7f95b1dc1640 1 --2- 172.21.15.134:0/1821960007 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f959c037020 0x7f959c03e0a0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.170+0000 7f95b1dc1640 1 -- 172.21.15.134:0/1821960007 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95ac01f070 con 0x7f959c037020 2024-04-24T02:12:22.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.170+0000 7f95b1dc1640 1 --2- 172.21.15.134:0/1821960007 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f95ac031040 0x7f95ac032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.170+0000 7f95b1dc1640 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c39311360 con 0x7f95ac031040 2024-04-24T02:12:22.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.170+0000 7f95b15c0640 1 --2- 172.21.15.134:0/1821960007 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f95ac031040 0x7f95ac032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.170+0000 7f95b15c0640 1 --2- 172.21.15.134:0/1821960007 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f95ac031040 0x7f95ac032940 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.171+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95a4075030 con 0x7f95ac031040 2024-04-24T02:12:22.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.171+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c39311360 con 0x560c39308790 2024-04-24T02:12:22.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.171+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95a4075030 con 0x560c39308790 2024-04-24T02:12:22.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.171+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c39311360 con 0x560c39308790 2024-04-24T02:12:22.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.171+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f95a4075030 con 0x560c39308790 2024-04-24T02:12:22.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.171+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c39311360 con 0x7f95ac031040 2024-04-24T02:12:22.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.171+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95a4075030 con 0x7f95ac031040 2024-04-24T02:12:22.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.171+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c39311360 con 0x7f95ac031040 2024-04-24T02:12:22.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.172+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95a4075030 con 0x7f95ac031040 2024-04-24T02:12:22.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.172+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c39311360 con 0x7f959c037020 2024-04-24T02:12:22.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.172+0000 7f95b1dc1640 1 -- 172.21.15.134:0/1821960007 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95ac01f070 con 0x7f959c037020 2024-04-24T02:12:22.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.172+0000 7f95b1dc1640 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c39311360 con 0x560c3930e9e0 2024-04-24T02:12:22.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.172+0000 7f95a8dbf640 1 -- 172.21.15.134:0/1821960007 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f959c05b040 con 0x560c3930e9e0 2024-04-24T02:12:22.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.172+0000 7f95a8dbf640 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c39311360 con 0x560c39308790 2024-04-24T02:12:22.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.172+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95a4075030 con 0x560c39308790 2024-04-24T02:12:22.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.172+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c39311360 con 0x7f95ac031040 2024-04-24T02:12:22.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.172+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95a4075030 con 0x7f95ac031040 2024-04-24T02:12:22.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.172+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c39311360 con 0x560c39308790 2024-04-24T02:12:22.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.173+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95a4075030 con 0x560c39308790 2024-04-24T02:12:22.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.173+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c39311360 con 0x7f959c037020 2024-04-24T02:12:22.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.173+0000 7f95b1dc1640 1 -- 172.21.15.134:0/1821960007 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f95ac01f070 con 0x7f959c037020 2024-04-24T02:12:22.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.173+0000 7f95b1dc1640 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c39311360 con 0x560c3930e9e0 2024-04-24T02:12:22.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.173+0000 7f95a8dbf640 1 -- 172.21.15.134:0/1821960007 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f959c05b040 con 0x560c3930e9e0 2024-04-24T02:12:22.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.173+0000 7f95a8dbf640 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c39311360 con 0x560c3930e9e0 2024-04-24T02:12:22.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.173+0000 7f95a8dbf640 1 -- 172.21.15.134:0/1821960007 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f959c05b040 con 0x560c3930e9e0 2024-04-24T02:12:22.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.173+0000 7f95a8dbf640 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c39311360 con 0x7f95ac031040 2024-04-24T02:12:22.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.174+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95a4075030 con 0x7f95ac031040 2024-04-24T02:12:22.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.174+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c39311360 con 0x560c3930e9e0 2024-04-24T02:12:22.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.174+0000 7f95a8dbf640 1 -- 172.21.15.134:0/1821960007 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f959c05b040 con 0x560c3930e9e0 2024-04-24T02:12:22.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.174+0000 7f95a8dbf640 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c39311360 con 0x560c3930e9e0 2024-04-24T02:12:22.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.174+0000 7f95a8dbf640 1 -- 172.21.15.134:0/1821960007 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f959c05b040 con 0x560c3930e9e0 2024-04-24T02:12:22.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.174+0000 7f95a8dbf640 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c39311360 con 0x560c39308790 2024-04-24T02:12:22.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.175+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95a4075030 con 0x560c39308790 2024-04-24T02:12:22.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.175+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c39311360 con 0x560c39308790 2024-04-24T02:12:22.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.175+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f95a4075030 con 0x560c39308790 2024-04-24T02:12:22.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.175+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c39311360 con 0x7f95ac031040 2024-04-24T02:12:22.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.175+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95a4075030 con 0x7f95ac031040 2024-04-24T02:12:22.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.175+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c39311360 con 0x560c3930e9e0 2024-04-24T02:12:22.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.175+0000 7f95a8dbf640 1 -- 172.21.15.134:0/1821960007 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f959c05b040 con 0x560c3930e9e0 2024-04-24T02:12:22.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.175+0000 7f95a8dbf640 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c39311360 con 0x7f959c037020 2024-04-24T02:12:22.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.176+0000 7f95b1dc1640 1 -- 172.21.15.134:0/1821960007 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95ac01f070 con 0x7f959c037020 2024-04-24T02:12:22.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.176+0000 7f95b1dc1640 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c39311360 con 0x560c39308790 2024-04-24T02:12:22.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.176+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95a4075030 con 0x560c39308790 2024-04-24T02:12:22.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.176+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c39311360 con 0x7f95ac031040 2024-04-24T02:12:22.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.176+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95a4075030 con 0x7f95ac031040 2024-04-24T02:12:22.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.176+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c39311360 con 0x560c3930e9e0 2024-04-24T02:12:22.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.177+0000 7f95a8dbf640 1 -- 172.21.15.134:0/1821960007 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f959c05b040 con 0x560c3930e9e0 2024-04-24T02:12:22.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.177+0000 7f95a8dbf640 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c39311360 con 0x7f95ac031040 2024-04-24T02:12:22.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.177+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95a4075030 con 0x7f95ac031040 2024-04-24T02:12:22.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.177+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c39311360 con 0x7f959c037020 2024-04-24T02:12:22.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.177+0000 7f95b1dc1640 1 -- 172.21.15.134:0/1821960007 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95ac01f070 con 0x7f959c037020 2024-04-24T02:12:22.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.177+0000 7f95b1dc1640 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c39311360 con 0x560c3930e9e0 2024-04-24T02:12:22.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.177+0000 7f95a8dbf640 1 -- 172.21.15.134:0/1821960007 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f959c05b040 con 0x560c3930e9e0 2024-04-24T02:12:22.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.177+0000 7f95a8dbf640 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c39311360 con 0x7f95ac031040 2024-04-24T02:12:22.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.178+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95a4075030 con 0x7f95ac031040 2024-04-24T02:12:22.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.178+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c39311360 con 0x560c39308790 2024-04-24T02:12:22.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.178+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f95a4075030 con 0x560c39308790 2024-04-24T02:12:22.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.178+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560c39311360 con 0x7f959c037020 2024-04-24T02:12:22.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.178+0000 7f95b1dc1640 1 -- 172.21.15.134:0/1821960007 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95ac01f070 con 0x7f959c037020 2024-04-24T02:12:22.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.178+0000 7f95b622f800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:22.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.178+0000 7f95b622f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:22.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.178+0000 7f95b622f800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:22.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.178+0000 7f95b622f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:22.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.178+0000 7f95b622f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:22.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.178+0000 7f95b622f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:22.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.178+0000 7f95b622f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.178+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c3930d620 con 0x560c39308790 2024-04-24T02:12:22.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.178+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f95a4075030 con 0x560c39308790 2024-04-24T02:12:22.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.178+0000 7f95b622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:22.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.178+0000 7f95b622f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.178+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c3930dec0 con 0x560c39308790 2024-04-24T02:12:22.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.179+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f95a4075030 con 0x560c39308790 2024-04-24T02:12:22.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.179+0000 7f95b622f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:22.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.179+0000 7f95b622f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.179+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c393117e0 con 0x560c39308790 2024-04-24T02:12:22.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.179+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f95a4075030 con 0x560c39308790 2024-04-24T02:12:22.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.179+0000 7f95b622f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:22.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.179+0000 7f95b622f800 20 zone default found 2024-04-24T02:12:22.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.179+0000 7f95b622f800 4 Realm: () 2024-04-24T02:12:22.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.179+0000 7f95b622f800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:22.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.179+0000 7f95b622f800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:22.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.179+0000 7f95b622f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:22.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.179+0000 7f95b622f800 20 zonegroup default 2024-04-24T02:12:22.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.179+0000 7f95b622f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.179+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c39311c90 con 0x7f95ac031040 2024-04-24T02:12:22.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.179+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f95a4075030 con 0x7f95ac031040 2024-04-24T02:12:22.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.180+0000 7f95b622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:22.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.180+0000 7f95b622f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.180+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c39313670 con 0x560c3930e9e0 2024-04-24T02:12:22.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.180+0000 7f95a8dbf640 1 -- 172.21.15.134:0/1821960007 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f959c05b040 con 0x560c3930e9e0 2024-04-24T02:12:22.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.180+0000 7f95b622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:22.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.180+0000 7f95b622f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.180+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c39313b10 con 0x560c3930e9e0 2024-04-24T02:12:22.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.180+0000 7f95a8dbf640 1 -- 172.21.15.134:0/1821960007 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f959c05b040 con 0x560c3930e9e0 2024-04-24T02:12:22.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.180+0000 7f95b622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:22.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.180+0000 7f95b622f800 20 started sync module instance, tier type = 2024-04-24T02:12:22.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.180+0000 7f95b622f800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:22.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.180+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c39312b00 con 0x7f959c037020 2024-04-24T02:12:22.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.181+0000 7f95b1dc1640 1 -- 172.21.15.134:0/1821960007 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95ac040040 con 0x7f959c037020 2024-04-24T02:12:22.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.181+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94610499120880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c39314420 con 0x7f959c037020 2024-04-24T02:12:22.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.181+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c39314c70 con 0x560c39308790 2024-04-24T02:12:22.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.182+0000 7f95b1dc1640 1 -- 172.21.15.134:0/1821960007 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94610499120880] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95ac040040 con 0x7f959c037020 2024-04-24T02:12:22.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.182+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95a4075030 con 0x560c39308790 2024-04-24T02:12:22.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.182+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94610499125104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c393148c0 con 0x560c39308790 2024-04-24T02:12:22.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.182+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c393153e0 con 0x560c3930e9e0 2024-04-24T02:12:22.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.183+0000 7f95a8dbf640 1 -- 172.21.15.134:0/1821960007 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f959c05b040 con 0x560c3930e9e0 2024-04-24T02:12:22.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.183+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94610499129008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c39315c80 con 0x560c3930e9e0 2024-04-24T02:12:22.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.183+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c39316730 con 0x7f959c037020 2024-04-24T02:12:22.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.184+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94610499125104] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95a4075030 con 0x560c39308790 2024-04-24T02:12:22.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.184+0000 7f95a8dbf640 1 -- 172.21.15.134:0/1821960007 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94610499129008] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f959c05b040 con 0x560c3930e9e0 2024-04-24T02:12:22.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.184+0000 7f95b1dc1640 1 -- 172.21.15.134:0/1821960007 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95ac040040 con 0x7f959c037020 2024-04-24T02:12:22.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.184+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94610499131344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c39316210 con 0x7f959c037020 2024-04-24T02:12:22.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.184+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c39316fd0 con 0x560c39308790 2024-04-24T02:12:22.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.185+0000 7f95b1dc1640 1 -- 172.21.15.134:0/1821960007 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94610499131344] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95ac040040 con 0x7f959c037020 2024-04-24T02:12:22.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.185+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95a4075030 con 0x560c39308790 2024-04-24T02:12:22.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.185+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94610499126160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c39316fd0 con 0x560c39308790 2024-04-24T02:12:22.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.185+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c39317a50 con 0x7f95ac031040 2024-04-24T02:12:22.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.186+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95a4075030 con 0x7f95ac031040 2024-04-24T02:12:22.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.186+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94610499138912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c39317980 con 0x7f95ac031040 2024-04-24T02:12:22.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.186+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c39318980 con 0x7f95ac031040 2024-04-24T02:12:22.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.186+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94610499126160] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95a4075030 con 0x560c39308790 2024-04-24T02:12:22.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.187+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94610499138912] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95a4075030 con 0x7f95ac031040 2024-04-24T02:12:22.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.187+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(56 notify.6 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95a4075030 con 0x7f95ac031040 2024-04-24T02:12:22.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.187+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94610499141184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c39318490 con 0x7f95ac031040 2024-04-24T02:12:22.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.188+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c39318e50 con 0x7f95ac031040 2024-04-24T02:12:22.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.188+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94610499141184] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95a4075030 con 0x7f95ac031040 2024-04-24T02:12:22.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.188+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(58 notify.7 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95a4075030 con 0x7f95ac031040 2024-04-24T02:12:22.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.188+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94610499136288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c39318e50 con 0x7f95ac031040 2024-04-24T02:12:22.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.188+0000 7f95b622f800 20 add_watcher() i=0 2024-04-24T02:12:22.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.188+0000 7f95b622f800 20 add_watcher() i=1 2024-04-24T02:12:22.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.188+0000 7f95b622f800 20 add_watcher() i=2 2024-04-24T02:12:22.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.188+0000 7f95b622f800 20 add_watcher() i=3 2024-04-24T02:12:22.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.188+0000 7f95b622f800 20 add_watcher() i=4 2024-04-24T02:12:22.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.188+0000 7f95b622f800 20 add_watcher() i=5 2024-04-24T02:12:22.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.188+0000 7f95b622f800 20 add_watcher() i=6 2024-04-24T02:12:22.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.189+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94610499136288] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95a4075030 con 0x7f95ac031040 2024-04-24T02:12:22.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.189+0000 7f95b622f800 20 add_watcher() i=7 2024-04-24T02:12:22.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.189+0000 7f95b622f800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:22.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.189+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c3931c190 con 0x560c39308790 2024-04-24T02:12:22.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.190+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f95a4075030 con 0x560c39308790 2024-04-24T02:12:22.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.190+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94610499156912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c39318fc0 con 0x560c39308790 2024-04-24T02:12:22.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.190+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94610499156912] v30'62 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f95a4075030 con 0x560c39308790 2024-04-24T02:12:22.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.191+0000 7f94677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:22.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.191+0000 7f95b622f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:22.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.191+0000 7f95b622f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:22.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.191+0000 7f95b622f800 5 note: GC not initialized 2024-04-24T02:12:22.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.191+0000 7f94667e4640 20 reqs_thread_entry: start 2024-04-24T02:12:22.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.191+0000 7f95b622f800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:22.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.191+0000 7f95b622f800 20 Filter name: none 2024-04-24T02:12:22.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.191+0000 7f93d7fff640 20 reqs_thread_entry: start 2024-04-24T02:12:22.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.191+0000 7f95b622f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T02:12:22.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.191+0000 7f95b622f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.191+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c3934f560 con 0x560c39308790 2024-04-24T02:12:22.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.191+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f95a4075030 con 0x560c39308790 2024-04-24T02:12:22.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.192+0000 7f95b622f800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T02:12:22.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.192+0000 7f95b622f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T02:12:22.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.192+0000 7f95b622f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:22.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.192+0000 7f95b622f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:12:22.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.192+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c39351ff0 con 0x7f959c037020 2024-04-24T02:12:22.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.192+0000 7f95b1dc1640 1 -- 172.21.15.134:0/1821960007 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f95ac040040 con 0x7f959c037020 2024-04-24T02:12:22.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.192+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c393557f0 con 0x560c39308790 2024-04-24T02:12:22.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.193+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v30'2 uv2 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f95a4075030 con 0x560c39308790 2024-04-24T02:12:22.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.193+0000 7f95b622f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T02:12:22.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.193+0000 7f95b622f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:22.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.193+0000 7f95b622f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-24T02:12:22.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.193+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94610499392096 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560c39354340 con 0x560c39308790 2024-04-24T02:12:22.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.193+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== watch-notify(notify (1) cookie 94610499126160 notify 128849018881 ret 0) ==== 609+0+0 (crc 0 0 0) 0x560c392d1280 con 0x560c39308790 2024-04-24T02:12:22.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.193+0000 7f9494ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018881 cookie 94610499126160 notifier 4306 bl.length()=567 2024-04-24T02:12:22.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.193+0000 7f9494ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T02:12:22.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.193+0000 7f9494ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:22.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.193+0000 7f9494ff9640 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f9474003ea0 con 0x560c39308790 2024-04-24T02:12:22.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.193+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(65 notify.4 [notify cookie 94610499392096 out=8b] v0'0 uv33 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f95a4075030 con 0x560c39308790 2024-04-24T02:12:22.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.193+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95a4075030 con 0x560c39308790 2024-04-24T02:12:22.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.194+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== watch-notify(notify_complete (2) cookie 94610499392096 notify 128849018881 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560c392ce670 con 0x560c39308790 2024-04-24T02:12:22.209 INFO:teuthology.orchestra.run.smithi134.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T02:12:21.778798Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T02:12:21.778786Z","tags":[],"group_ids":[]} 2024-04-24T02:12:22.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.194+0000 7f94677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:22.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.194+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94610499156912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c39354340 con 0x560c39308790 2024-04-24T02:12:22.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.195+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94610499156912] v30'63 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f95a4075030 con 0x560c39308790 2024-04-24T02:12:22.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.195+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94610499120880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c39354340 con 0x7f959c037020 2024-04-24T02:12:22.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.196+0000 7f95b1dc1640 1 -- 172.21.15.134:0/1821960007 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94610499120880] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95ac040040 con 0x7f959c037020 2024-04-24T02:12:22.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.196+0000 7f95b622f800 20 remove_watcher() i=0 2024-04-24T02:12:22.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.196+0000 7f95b622f800 2 removed watcher, disabling cache 2024-04-24T02:12:22.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.196+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94610499125104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c39354340 con 0x560c39308790 2024-04-24T02:12:22.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.197+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 <== osd.1 v2:172.21.15.134:6804/1487076214 30 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94610499125104] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95a4075030 con 0x560c39308790 2024-04-24T02:12:22.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.197+0000 7f95b622f800 20 remove_watcher() i=1 2024-04-24T02:12:22.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.197+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94610499129008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c39354340 con 0x560c3930e9e0 2024-04-24T02:12:22.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.198+0000 7f95a8dbf640 1 -- 172.21.15.134:0/1821960007 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94610499129008] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f959c05b040 con 0x560c3930e9e0 2024-04-24T02:12:22.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.198+0000 7f95b622f800 20 remove_watcher() i=2 2024-04-24T02:12:22.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.198+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94610499131344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c39313f70 con 0x7f959c037020 2024-04-24T02:12:22.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.199+0000 7f95b1dc1640 1 -- 172.21.15.134:0/1821960007 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94610499131344] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95ac040040 con 0x7f959c037020 2024-04-24T02:12:22.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.199+0000 7f95b622f800 20 remove_watcher() i=3 2024-04-24T02:12:22.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.199+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94610499126160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c393157d0 con 0x560c39308790 2024-04-24T02:12:22.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.200+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 <== osd.1 v2:172.21.15.134:6804/1487076214 31 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94610499126160] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95a4075030 con 0x560c39308790 2024-04-24T02:12:22.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.200+0000 7f95b622f800 20 remove_watcher() i=4 2024-04-24T02:12:22.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.200+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94610499138912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c393157d0 con 0x7f95ac031040 2024-04-24T02:12:22.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.201+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94610499138912] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95a4075030 con 0x7f95ac031040 2024-04-24T02:12:22.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.201+0000 7f95b622f800 20 remove_watcher() i=5 2024-04-24T02:12:22.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.201+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94610499141184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c39317560 con 0x7f95ac031040 2024-04-24T02:12:22.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.202+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94610499141184] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95a4075030 con 0x7f95ac031040 2024-04-24T02:12:22.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.202+0000 7f95b622f800 20 remove_watcher() i=6 2024-04-24T02:12:22.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.202+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94610499136288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560c39317e40 con 0x7f95ac031040 2024-04-24T02:12:22.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.203+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94610499136288] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95a4075030 con 0x7f95ac031040 2024-04-24T02:12:22.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.203+0000 7f95b622f800 20 remove_watcher() i=7 2024-04-24T02:12:22.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.203+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f95ac031040 msgr2=0x7f95ac032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.203+0000 7f95b622f800 1 --2- 172.21.15.134:0/1821960007 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f95ac031040 0x7f95ac032940 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.203+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560c39308790 msgr2=0x560c3930ac50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.203+0000 7f95b622f800 1 --2- 172.21.15.134:0/1821960007 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560c39308790 0x560c3930ac50 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.203+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f959c037020 msgr2=0x7f959c03e0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.203+0000 7f95b622f800 1 --2- 172.21.15.134:0/1821960007 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f959c037020 0x7f959c03e0a0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.203+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x560c3930e9e0 msgr2=0x560c39310dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.203+0000 7f95b622f800 1 --2- 172.21.15.134:0/1821960007 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x560c3930e9e0 0x560c39310dd0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.203+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f947c036950 msgr2=0x7f947c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.203+0000 7f95b622f800 1 --2- 172.21.15.134:0/1821960007 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f947c036950 0x7f947c038e10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x560c392cf020 tx=0x7f95ac01f000 comp rx=0 tx=0).stop 2024-04-24T02:12:22.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.203+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c392f5630 msgr2=0x560c392fcc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.203+0000 7f95b622f800 1 --2- 172.21.15.134:0/1821960007 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c392f5630 0x560c392fcc60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f959c0234c0 tx=0x7f959c04c560 comp rx=0 tx=0).stop 2024-04-24T02:12:22.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.203+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 reap_dead start 2024-04-24T02:12:22.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.203+0000 7f95b15c0640 1 -- 172.21.15.134:0/1821960007 reap_dead start 2024-04-24T02:12:22.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.203+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 shutdown_connections 2024-04-24T02:12:22.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.203+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 >> 172.21.15.134:0/1821960007 conn(0x560c392f1990 msgr2=0x560c392eeff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:22.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.203+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 shutdown_connections 2024-04-24T02:12:22.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.203+0000 7f95b622f800 1 -- 172.21.15.134:0/1821960007 wait complete. 2024-04-24T02:12:22.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.204+0000 7f95b622f800 1 -- 172.21.15.134:0/909468378 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9488036950 msgr2=0x7f9488038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.204+0000 7f95b622f800 1 --2- 172.21.15.134:0/909468378 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9488036950 0x7f9488038e10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x560c392d61e0 tx=0x7f95ac005840 comp rx=0 tx=0).stop 2024-04-24T02:12:22.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.204+0000 7f95b622f800 1 -- 172.21.15.134:0/909468378 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c3914a370 msgr2=0x560c391487e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.204+0000 7f95b622f800 1 --2- 172.21.15.134:0/909468378 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c3914a370 0x560c391487e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f959c00be20 tx=0x7f959c00f790 comp rx=0 tx=0).stop 2024-04-24T02:12:22.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.204+0000 7f95b622f800 1 -- 172.21.15.134:0/909468378 shutdown_connections 2024-04-24T02:12:22.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.204+0000 7f95b622f800 1 --2- 172.21.15.134:0/909468378 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9488036950 0x7f9488038e10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.204+0000 7f95b622f800 1 --2- 172.21.15.134:0/909468378 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c3914a370 0x560c391487e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.204+0000 7f95b622f800 1 -- 172.21.15.134:0/909468378 >> 172.21.15.134:0/909468378 conn(0x560c392da1f0 msgr2=0x560c392da5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:22.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.204+0000 7f95b622f800 1 -- 172.21.15.134:0/909468378 shutdown_connections 2024-04-24T02:12:22.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.204+0000 7f95b622f800 1 -- 172.21.15.134:0/909468378 wait complete. 2024-04-24T02:12:22.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.204+0000 7f95b622f800 1 -- 172.21.15.134:0/231592485 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560c391d6130 msgr2=0x560c392d5040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.204+0000 7f95b622f800 1 --2- 172.21.15.134:0/231592485 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560c391d6130 0x560c392d5040 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.204+0000 7f95b622f800 1 -- 172.21.15.134:0/231592485 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9498036950 msgr2=0x7f9498038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.204+0000 7f95b622f800 1 --2- 172.21.15.134:0/231592485 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9498036950 0x7f9498038e10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f959c001e30 tx=0x7f959c0013b0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.204+0000 7f95b622f800 1 -- 172.21.15.134:0/231592485 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c391d4ed0 msgr2=0x560c392cdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.204+0000 7f95b622f800 1 --2- 172.21.15.134:0/231592485 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c391d4ed0 0x560c392cdea0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f95a4052540 tx=0x7f95a4003020 comp rx=0 tx=0).stop 2024-04-24T02:12:22.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.204+0000 7f95b622f800 1 -- 172.21.15.134:0/231592485 shutdown_connections 2024-04-24T02:12:22.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.204+0000 7f95b622f800 1 --2- 172.21.15.134:0/231592485 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560c391d6130 0x560c392d5040 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.204+0000 7f95b622f800 1 --2- 172.21.15.134:0/231592485 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9498036950 0x7f9498038e10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.204+0000 7f95b622f800 1 --2- 172.21.15.134:0/231592485 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c391d4ed0 0x560c392cdea0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.204+0000 7f95b622f800 1 -- 172.21.15.134:0/231592485 >> 172.21.15.134:0/231592485 conn(0x560c391d04d0 msgr2=0x560c392c0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:22.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.204+0000 7f95b622f800 1 -- 172.21.15.134:0/231592485 shutdown_connections 2024-04-24T02:12:22.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.204+0000 7f95b622f800 1 -- 172.21.15.134:0/231592485 wait complete. 2024-04-24T02:12:22.220 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T02:12:21.778798Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:12:21.778786Z', 'tags': [], 'group_ids': []} 2024-04-24T02:12:22.220 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-24T02:12:22.220 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-24T02:12:22.221 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-24T02:12:22.298 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:22.298 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:22.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.297+0000 7f68efb31800 1 Processor -- start 2024-04-24T02:12:22.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.297+0000 7f68efb31800 1 -- start start 2024-04-24T02:12:22.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.297+0000 7f68efb31800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55e05f76b970 0x55e05f76dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.297+0000 7f68efb31800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e05f629d40 con 0x55e05f76e2a0 2024-04-24T02:12:22.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.297+0000 7f68efb31800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55e05f5fc4d0 con 0x55e05f76b970 2024-04-24T02:12:22.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.297+0000 7f68eb82f640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55e05f76b970 0x55e05f76dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.297+0000 7f68eb82f640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55e05f76b970 0x55e05f76dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45730/0 (socket says 172.21.15.134:45730) 2024-04-24T02:12:22.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.297+0000 7f68eb82f640 1 -- 172.21.15.134:0/3862402457 learned_addr learned my addr 172.21.15.134:0/3862402457 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:22.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.297+0000 7f68eb02e640 1 --1- 172.21.15.134:0/3862402457 >> v1:172.21.15.104:6789/0 conn(0x55e05f76e2a0 0x55e05f770690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:43226/0 (socket says 172.21.15.134:43226) 2024-04-24T02:12:22.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.298+0000 7f68eb82f640 1 -- 172.21.15.134:0/3862402457 >> v1:172.21.15.104:6789/0 conn(0x55e05f76e2a0 legacy=0x55e05f770690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.298+0000 7f68ea82d640 1 -- 172.21.15.134:0/3862402457 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2529360897 0 0) 0x55e05f629d40 con 0x55e05f76e2a0 2024-04-24T02:12:22.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.298+0000 7f68eb82f640 1 -- 172.21.15.134:0/3862402457 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e05f628590 con 0x55e05f76b970 2024-04-24T02:12:22.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.300+0000 7f68eb82f640 1 --2- 172.21.15.134:0/3862402457 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e05f76b970 0x55e05f76dd60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f68dc00a520 tx=0x7f68dc01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56c9ddd862e149b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.300+0000 7f68ea82d640 1 -- 172.21.15.134:0/3862402457 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68dc057070 con 0x55e05f76b970 2024-04-24T02:12:22.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.300+0000 7f68ea82d640 1 -- 172.21.15.134:0/3862402457 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68dc052570 con 0x55e05f76b970 2024-04-24T02:12:22.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.300+0000 7f68ea82d640 1 -- 172.21.15.134:0/3862402457 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68dc04ae60 con 0x55e05f76b970 2024-04-24T02:12:22.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.300+0000 7f68efb31800 1 -- 172.21.15.134:0/3862402457 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e05f76b970 msgr2=0x55e05f76dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.300+0000 7f68efb31800 1 --2- 172.21.15.134:0/3862402457 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e05f76b970 0x55e05f76dd60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f68dc00a520 tx=0x7f68dc01d010 comp rx=0 tx=0).stop 2024-04-24T02:12:22.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.300+0000 7f68efb31800 1 -- 172.21.15.134:0/3862402457 shutdown_connections 2024-04-24T02:12:22.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.300+0000 7f68efb31800 1 --2- 172.21.15.134:0/3862402457 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e05f76b970 0x55e05f76dd60 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.300+0000 7f68efb31800 1 -- 172.21.15.134:0/3862402457 >> 172.21.15.134:0/3862402457 conn(0x55e05f765320 msgr2=0x55e05f767740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:22.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.300+0000 7f68efb31800 1 -- 172.21.15.134:0/3862402457 shutdown_connections 2024-04-24T02:12:22.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.300+0000 7f68efb31800 1 -- 172.21.15.134:0/3862402457 wait complete. 2024-04-24T02:12:22.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.312+0000 7f68efb31800 1 Processor -- start 2024-04-24T02:12:22.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.312+0000 7f68efb31800 1 -- start start 2024-04-24T02:12:22.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.312+0000 7f68efb31800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e05f76b970 0x55e05f76b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.312+0000 7f68efb31800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e05f6b63c0 con 0x55e05f76b970 2024-04-24T02:12:22.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.312+0000 7f68eb82f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e05f76b970 0x55e05f76b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.312+0000 7f68eb82f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e05f76b970 0x55e05f76b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45740/0 (socket says 172.21.15.134:45740) 2024-04-24T02:12:22.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.312+0000 7f68eb82f640 1 -- 172.21.15.134:0/3557767151 learned_addr learned my addr 172.21.15.134:0/3557767151 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:22.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.313+0000 7f68eb82f640 1 -- 172.21.15.134:0/3557767151 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e05f769870 con 0x55e05f76b970 2024-04-24T02:12:22.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.313+0000 7f68eb82f640 1 --2- 172.21.15.134:0/3557767151 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e05f76b970 0x55e05f76b2b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f68dc055040 tx=0x7f68dc04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60c13206d47374de server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.313+0000 7f67d9e0b640 1 -- 172.21.15.134:0/3557767151 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68dc057040 con 0x55e05f76b970 2024-04-24T02:12:22.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.313+0000 7f67d9e0b640 1 -- 172.21.15.134:0/3557767151 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68dc052720 con 0x55e05f76b970 2024-04-24T02:12:22.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.313+0000 7f67d9e0b640 1 -- 172.21.15.134:0/3557767151 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68dc052a40 con 0x55e05f76b970 2024-04-24T02:12:22.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.313+0000 7f68efb31800 1 -- 172.21.15.134:0/3557767151 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e05f76b970 msgr2=0x55e05f76b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.313+0000 7f68efb31800 1 --2- 172.21.15.134:0/3557767151 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e05f76b970 0x55e05f76b2b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f68dc055040 tx=0x7f68dc04c000 comp rx=0 tx=0).stop 2024-04-24T02:12:22.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.314+0000 7f68efb31800 1 -- 172.21.15.134:0/3557767151 shutdown_connections 2024-04-24T02:12:22.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.314+0000 7f68efb31800 1 --2- 172.21.15.134:0/3557767151 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e05f76b970 0x55e05f76b2b0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.314+0000 7f68efb31800 1 -- 172.21.15.134:0/3557767151 >> 172.21.15.134:0/3557767151 conn(0x55e05f765320 msgr2=0x55e05f857840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:22.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.314+0000 7f68efb31800 1 -- 172.21.15.134:0/3557767151 shutdown_connections 2024-04-24T02:12:22.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.314+0000 7f68efb31800 1 -- 172.21.15.134:0/3557767151 wait complete. 2024-04-24T02:12:22.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.314+0000 7f68efb31800 1 Processor -- start 2024-04-24T02:12:22.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.314+0000 7f68efb31800 1 -- start start 2024-04-24T02:12:22.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.314+0000 7f68efb31800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e05f76b970 0x55e05f865b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.314+0000 7f68efb31800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e05f7740c0 con 0x55e05f76b970 2024-04-24T02:12:22.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.314+0000 7f68eb82f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e05f76b970 0x55e05f865b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.314+0000 7f68eb82f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e05f76b970 0x55e05f865b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45752/0 (socket says 172.21.15.134:45752) 2024-04-24T02:12:22.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.314+0000 7f68eb82f640 1 -- 172.21.15.134:0/1820606414 learned_addr learned my addr 172.21.15.134:0/1820606414 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:22.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.314+0000 7f68eb82f640 1 -- 172.21.15.134:0/1820606414 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e05f866040 con 0x55e05f76b970 2024-04-24T02:12:22.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.315+0000 7f68eb82f640 1 --2- 172.21.15.134:0/1820606414 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e05f76b970 0x55e05f865b00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f68dc0524f0 tx=0x7f68dc003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.315+0000 7f67d3fff640 1 -- 172.21.15.134:0/1820606414 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68dc073070 con 0x55e05f76b970 2024-04-24T02:12:22.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.315+0000 7f67d3fff640 1 -- 172.21.15.134:0/1820606414 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68dc05d440 con 0x55e05f76b970 2024-04-24T02:12:22.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.315+0000 7f68efb31800 1 -- 172.21.15.134:0/1820606414 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e05f8662d0 con 0x55e05f76b970 2024-04-24T02:12:22.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.315+0000 7f67d3fff640 1 -- 172.21.15.134:0/1820606414 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68dc057070 con 0x55e05f76b970 2024-04-24T02:12:22.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.315+0000 7f68efb31800 1 -- 172.21.15.134:0/1820606414 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e05f868f80 con 0x55e05f76b970 2024-04-24T02:12:22.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.315+0000 7f67d3fff640 1 -- 172.21.15.134:0/1820606414 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f68dc076070 con 0x55e05f76b970 2024-04-24T02:12:22.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.316+0000 7f67d3fff640 1 --2- 172.21.15.134:0/1820606414 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f67d4036950 0x7f67d4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.316+0000 7f67d3fff640 1 -- 172.21.15.134:0/1820606414 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f68dc08db30 con 0x55e05f76b970 2024-04-24T02:12:22.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.316+0000 7f68eb02e640 1 --2- 172.21.15.134:0/1820606414 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f67d4036950 0x7f67d4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.316+0000 7f68efb31800 1 --2- 172.21.15.134:0/1820606414 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e05f76e2a0 0x55e05f86cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.316+0000 7f68efb31800 1 -- 172.21.15.134:0/1820606414 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e05f86d280 con 0x55e05f76e2a0 2024-04-24T02:12:22.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.316+0000 7f68ec030640 1 --2- 172.21.15.134:0/1820606414 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e05f76e2a0 0x55e05f86cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.316+0000 7f68eb02e640 1 --2- 172.21.15.134:0/1820606414 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f67d4036950 0x7f67d4038e10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f68e0000c00 tx=0x7f68e00013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.316+0000 7f68ec030640 1 --2- 172.21.15.134:0/1820606414 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e05f76e2a0 0x55e05f86cd40 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.317+0000 7f68ec030640 1 -- 172.21.15.134:0/1820606414 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68e400a4a0 con 0x55e05f76e2a0 2024-04-24T02:12:22.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.317+0000 7f68efb31800 1 -- 172.21.15.134:0/1820606414 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e05f86a2d0 con 0x55e05f76e2a0 2024-04-24T02:12:22.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.317+0000 7f68ec030640 1 -- 172.21.15.134:0/1820606414 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f68e400a4a0 con 0x55e05f76e2a0 2024-04-24T02:12:22.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.317+0000 7f68efb31800 1 -- 172.21.15.134:0/1820606414 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e05f86f040 con 0x55e05f76e2a0 2024-04-24T02:12:22.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.317+0000 7f68ec030640 1 -- 172.21.15.134:0/1820606414 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f68e400a4a0 con 0x55e05f76e2a0 2024-04-24T02:12:22.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.317+0000 7f68efb31800 1 -- 172.21.15.134:0/1820606414 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e05f86e380 con 0x55e05f76e2a0 2024-04-24T02:12:22.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.318+0000 7f68ec030640 1 -- 172.21.15.134:0/1820606414 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f68e400a4a0 con 0x55e05f76e2a0 2024-04-24T02:12:22.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.318+0000 7f68efb31800 1 -- 172.21.15.134:0/1820606414 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e05f86e7a0 con 0x55e05f76e2a0 2024-04-24T02:12:22.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.318+0000 7f68ec030640 1 -- 172.21.15.134:0/1820606414 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f68e400a4a0 con 0x55e05f76e2a0 2024-04-24T02:12:22.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.318+0000 7f68efb31800 1 Processor -- start 2024-04-24T02:12:22.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.318+0000 7f68efb31800 1 -- start start 2024-04-24T02:12:22.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.318+0000 7f68efb31800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e05f87de50 0x55e05f87e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.318+0000 7f68efb31800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e05f65c6b0 con 0x55e05f87de50 2024-04-24T02:12:22.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.319+0000 7f68eb02e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e05f87de50 0x55e05f87e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.319+0000 7f68eb02e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e05f87de50 0x55e05f87e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45766/0 (socket says 172.21.15.134:45766) 2024-04-24T02:12:22.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.319+0000 7f68eb02e640 1 -- 172.21.15.134:0/992866606 learned_addr learned my addr 172.21.15.134:0/992866606 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:22.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.319+0000 7f68eb02e640 1 -- 172.21.15.134:0/992866606 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e05f87e7b0 con 0x55e05f87de50 2024-04-24T02:12:22.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.319+0000 7f68eb02e640 1 --2- 172.21.15.134:0/992866606 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e05f87de50 0x55e05f87e270 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f68e000e610 tx=0x7f68e000ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.319+0000 7f67d17fa640 1 -- 172.21.15.134:0/992866606 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68e0022070 con 0x55e05f87de50 2024-04-24T02:12:22.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.319+0000 7f67d17fa640 1 -- 172.21.15.134:0/992866606 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68e0009050 con 0x55e05f87de50 2024-04-24T02:12:22.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.319+0000 7f68efb31800 1 -- 172.21.15.134:0/992866606 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e05f87f220 con 0x55e05f87de50 2024-04-24T02:12:22.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.319+0000 7f67d17fa640 1 -- 172.21.15.134:0/992866606 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68e000d500 con 0x55e05f87de50 2024-04-24T02:12:22.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.319+0000 7f68efb31800 1 -- 172.21.15.134:0/992866606 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e05f87f720 con 0x55e05f87de50 2024-04-24T02:12:22.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.320+0000 7f67d17fa640 1 -- 172.21.15.134:0/992866606 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f68e0025070 con 0x55e05f87de50 2024-04-24T02:12:22.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.320+0000 7f67d17fa640 1 --2- 172.21.15.134:0/992866606 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f67c4036950 0x7f67c4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.320+0000 7f67d17fa640 1 -- 172.21.15.134:0/992866606 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f68e004d9a0 con 0x55e05f87de50 2024-04-24T02:12:22.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.320+0000 7f68ec030640 1 --2- 172.21.15.134:0/992866606 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f67c4036950 0x7f67c4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.321+0000 7f68efb31800 1 Processor -- start 2024-04-24T02:12:22.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.321+0000 7f68efb31800 1 -- start start 2024-04-24T02:12:22.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.321+0000 7f68ec030640 1 --2- 172.21.15.134:0/992866606 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f67c4036950 0x7f67c4038e10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x55e05f86e720 tx=0x7f68e4005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.321+0000 7f68efb31800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e05f88b190 0x55e05f88b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.321+0000 7f68efb31800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e05f769b30 con 0x55e05f88b190 2024-04-24T02:12:22.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.321+0000 7f68eb02e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e05f88b190 0x55e05f88b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.321+0000 7f68eb02e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e05f88b190 0x55e05f88b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45776/0 (socket says 172.21.15.134:45776) 2024-04-24T02:12:22.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.321+0000 7f68eb02e640 1 -- 172.21.15.134:0/4225633193 learned_addr learned my addr 172.21.15.134:0/4225633193 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:22.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.321+0000 7f68eb02e640 1 -- 172.21.15.134:0/4225633193 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e05f88bb80 con 0x55e05f88b190 2024-04-24T02:12:22.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.321+0000 7f68eb02e640 1 --2- 172.21.15.134:0/4225633193 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e05f88b190 0x55e05f88b5b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f68e0026fd0 tx=0x7f68e0024eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b456ecda1c56cb30 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.321+0000 7f67caffd640 1 -- 172.21.15.134:0/4225633193 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68e004a030 con 0x55e05f88b190 2024-04-24T02:12:22.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.321+0000 7f67caffd640 1 -- 172.21.15.134:0/4225633193 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68e0025e30 con 0x55e05f88b190 2024-04-24T02:12:22.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.322+0000 7f67caffd640 1 -- 172.21.15.134:0/4225633193 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68e001ad50 con 0x55e05f88b190 2024-04-24T02:12:22.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.322+0000 7f68efb31800 1 -- 172.21.15.134:0/4225633193 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e05f88b190 msgr2=0x55e05f88b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.322+0000 7f68efb31800 1 --2- 172.21.15.134:0/4225633193 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e05f88b190 0x55e05f88b5b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f68e0026fd0 tx=0x7f68e0024eb0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.322+0000 7f68efb31800 1 -- 172.21.15.134:0/4225633193 shutdown_connections 2024-04-24T02:12:22.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.322+0000 7f68efb31800 1 --2- 172.21.15.134:0/4225633193 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e05f88b190 0x55e05f88b5b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.322+0000 7f68efb31800 1 -- 172.21.15.134:0/4225633193 >> 172.21.15.134:0/4225633193 conn(0x55e05f8874f0 msgr2=0x55e05f885550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:22.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.322+0000 7f68efb31800 1 -- 172.21.15.134:0/4225633193 shutdown_connections 2024-04-24T02:12:22.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.322+0000 7f68efb31800 1 -- 172.21.15.134:0/4225633193 wait complete. 2024-04-24T02:12:22.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.322+0000 7f68efb31800 1 Processor -- start 2024-04-24T02:12:22.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.322+0000 7f68efb31800 1 -- start start 2024-04-24T02:12:22.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.322+0000 7f68efb31800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e05f88b190 0x55e05f892850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.322+0000 7f68efb31800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e05f88c2f0 con 0x55e05f88b190 2024-04-24T02:12:22.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.323+0000 7f68eb02e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e05f88b190 0x55e05f892850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.323+0000 7f68eb02e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e05f88b190 0x55e05f892850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45792/0 (socket says 172.21.15.134:45792) 2024-04-24T02:12:22.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.323+0000 7f68eb02e640 1 -- 172.21.15.134:0/4215797057 learned_addr learned my addr 172.21.15.134:0/4215797057 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:22.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.323+0000 7f68eb02e640 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e05f892d90 con 0x55e05f88b190 2024-04-24T02:12:22.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.323+0000 7f68eb02e640 1 --2- 172.21.15.134:0/4215797057 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e05f88b190 0x55e05f892850 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f68e0026fd0 tx=0x7f68e004be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.323+0000 7f67c97fa640 1 -- 172.21.15.134:0/4215797057 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68e004a050 con 0x55e05f88b190 2024-04-24T02:12:22.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.323+0000 7f67c97fa640 1 -- 172.21.15.134:0/4215797057 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68e0025360 con 0x55e05f88b190 2024-04-24T02:12:22.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.323+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e05f893020 con 0x55e05f88b190 2024-04-24T02:12:22.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.323+0000 7f67c97fa640 1 -- 172.21.15.134:0/4215797057 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68e00256a0 con 0x55e05f88b190 2024-04-24T02:12:22.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.323+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e05f895cd0 con 0x55e05f88b190 2024-04-24T02:12:22.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.324+0000 7f67c97fa640 1 -- 172.21.15.134:0/4215797057 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f68e000d6a0 con 0x55e05f88b190 2024-04-24T02:12:22.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.324+0000 7f67c97fa640 1 --2- 172.21.15.134:0/4215797057 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f67b4036900 0x7f67b4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.324+0000 7f67c97fa640 1 -- 172.21.15.134:0/4215797057 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f68e00456f0 con 0x55e05f88b190 2024-04-24T02:12:22.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.324+0000 7f68ec030640 1 --2- 172.21.15.134:0/4215797057 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f67b4036900 0x7f67b4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.324+0000 7f68efb31800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.324+0000 7f68efb31800 1 --2- 172.21.15.134:0/4215797057 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e05f89e350 0x55e05f8a0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.325+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8a0f60 con 0x55e05f89e350 2024-04-24T02:12:22.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.325+0000 7f68ec030640 1 --2- 172.21.15.134:0/4215797057 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f67b4036900 0x7f67b4038dc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x55e05f86dea0 tx=0x7f68e401f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.325+0000 7f68eb82f640 1 --2- 172.21.15.134:0/4215797057 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e05f89e350 0x55e05f8a0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.325+0000 7f68eb82f640 1 --2- 172.21.15.134:0/4215797057 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e05f89e350 0x55e05f8a0810 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.325+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68dc075030 con 0x55e05f89e350 2024-04-24T02:12:22.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.325+0000 7f68efb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:22.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.325+0000 7f68efb31800 20 realm 2024-04-24T02:12:22.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.325+0000 7f68efb31800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.325+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8a1370 con 0x55e05f89e350 2024-04-24T02:12:22.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.325+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68dc075030 con 0x55e05f89e350 2024-04-24T02:12:22.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.325+0000 7f68efb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:22.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.325+0000 7f68efb31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:22.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.325+0000 7f68efb31800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.325+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8a1c40 con 0x55e05f89e350 2024-04-24T02:12:22.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.325+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68dc075030 con 0x55e05f89e350 2024-04-24T02:12:22.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.325+0000 7f68efb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:22.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.325+0000 7f68efb31800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.325+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8a1fe0 con 0x55e05f89e350 2024-04-24T02:12:22.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.326+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f68dc075030 con 0x55e05f89e350 2024-04-24T02:12:22.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.326+0000 7f68efb31800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:22.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.326+0000 7f68efb31800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.326+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8a2440 con 0x55e05f89e350 2024-04-24T02:12:22.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.326+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f68dc075030 con 0x55e05f89e350 2024-04-24T02:12:22.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.326+0000 7f68efb31800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:22.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.326+0000 7f68efb31800 20 searching for the correct realm 2024-04-24T02:12:22.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.326+0000 7f68efb31800 1 --2- 172.21.15.134:0/4215797057 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55e05f8a4490 0x55e05f8a6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.326+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8a6f30 con 0x55e05f8a4490 2024-04-24T02:12:22.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.326+0000 7f68eb02e640 1 --2- 172.21.15.134:0/4215797057 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55e05f8a4490 0x55e05f8a6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.326+0000 7f68eb02e640 1 --2- 172.21.15.134:0/4215797057 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55e05f8a4490 0x55e05f8a6880 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.327+0000 7f68eb02e640 1 -- 172.21.15.134:0/4215797057 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68e0024030 con 0x55e05f8a4490 2024-04-24T02:12:22.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.327+0000 7f68eb02e640 1 --2- 172.21.15.134:0/4215797057 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f68e0027060 0x7f68e001e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.327+0000 7f68eb02e640 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8a6f30 con 0x7f68e0027060 2024-04-24T02:12:22.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.327+0000 7f68ec030640 1 --2- 172.21.15.134:0/4215797057 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f68e0027060 0x7f68e001e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.327+0000 7f68ec030640 1 --2- 172.21.15.134:0/4215797057 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f68e0027060 0x7f68e001e9c0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.327+0000 7f68ec030640 1 -- 172.21.15.134:0/4215797057 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68e401f070 con 0x7f68e0027060 2024-04-24T02:12:22.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.327+0000 7f68ec030640 1 --2- 172.21.15.134:0/4215797057 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f68e4031040 0x7f68e4032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.327+0000 7f68ec030640 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8a6f30 con 0x7f68e4031040 2024-04-24T02:12:22.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.328+0000 7f68eb82f640 1 --2- 172.21.15.134:0/4215797057 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f68e4031040 0x7f68e4032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.328+0000 7f68eb82f640 1 --2- 172.21.15.134:0/4215797057 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f68e4031040 0x7f68e4032940 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.328+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68dc075030 con 0x7f68e4031040 2024-04-24T02:12:22.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.328+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8a6f30 con 0x55e05f89e350 2024-04-24T02:12:22.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.329+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68dc075030 con 0x55e05f89e350 2024-04-24T02:12:22.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.329+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8a6f30 con 0x55e05f89e350 2024-04-24T02:12:22.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.329+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f68dc075030 con 0x55e05f89e350 2024-04-24T02:12:22.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.329+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8a6f30 con 0x7f68e4031040 2024-04-24T02:12:22.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.329+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68dc075030 con 0x7f68e4031040 2024-04-24T02:12:22.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.329+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8a6f30 con 0x7f68e4031040 2024-04-24T02:12:22.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.329+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68dc075030 con 0x7f68e4031040 2024-04-24T02:12:22.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.329+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8a6f30 con 0x7f68e0027060 2024-04-24T02:12:22.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.329+0000 7f68ec030640 1 -- 172.21.15.134:0/4215797057 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68e401f070 con 0x7f68e0027060 2024-04-24T02:12:22.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.329+0000 7f68ec030640 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8a6f30 con 0x55e05f8a4490 2024-04-24T02:12:22.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.330+0000 7f68eb02e640 1 -- 172.21.15.134:0/4215797057 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68e0024030 con 0x55e05f8a4490 2024-04-24T02:12:22.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.330+0000 7f68eb02e640 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8a6f30 con 0x55e05f89e350 2024-04-24T02:12:22.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.330+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68dc075030 con 0x55e05f89e350 2024-04-24T02:12:22.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.330+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8a6f30 con 0x7f68e4031040 2024-04-24T02:12:22.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.330+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68dc075030 con 0x7f68e4031040 2024-04-24T02:12:22.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.330+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8a6f30 con 0x55e05f89e350 2024-04-24T02:12:22.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.330+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68dc075030 con 0x55e05f89e350 2024-04-24T02:12:22.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.330+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8a6f30 con 0x7f68e0027060 2024-04-24T02:12:22.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.331+0000 7f68ec030640 1 -- 172.21.15.134:0/4215797057 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f68e401f070 con 0x7f68e0027060 2024-04-24T02:12:22.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.331+0000 7f68ec030640 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8a6f30 con 0x55e05f8a4490 2024-04-24T02:12:22.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.331+0000 7f68eb02e640 1 -- 172.21.15.134:0/4215797057 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68e0024030 con 0x55e05f8a4490 2024-04-24T02:12:22.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.331+0000 7f68eb02e640 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8a6f30 con 0x55e05f8a4490 2024-04-24T02:12:22.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.331+0000 7f68eb02e640 1 -- 172.21.15.134:0/4215797057 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68e0024030 con 0x55e05f8a4490 2024-04-24T02:12:22.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.331+0000 7f68eb02e640 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8a6f30 con 0x7f68e4031040 2024-04-24T02:12:22.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.331+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68dc075030 con 0x7f68e4031040 2024-04-24T02:12:22.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.331+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8a6f30 con 0x55e05f8a4490 2024-04-24T02:12:22.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.332+0000 7f68eb02e640 1 -- 172.21.15.134:0/4215797057 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68e0024030 con 0x55e05f8a4490 2024-04-24T02:12:22.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.332+0000 7f68eb02e640 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8a6f30 con 0x55e05f8a4490 2024-04-24T02:12:22.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.332+0000 7f68eb02e640 1 -- 172.21.15.134:0/4215797057 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68e0024030 con 0x55e05f8a4490 2024-04-24T02:12:22.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.332+0000 7f68eb02e640 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8a6f30 con 0x55e05f89e350 2024-04-24T02:12:22.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.332+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68dc075030 con 0x55e05f89e350 2024-04-24T02:12:22.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.332+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8a6f30 con 0x55e05f89e350 2024-04-24T02:12:22.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.332+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f68dc075030 con 0x55e05f89e350 2024-04-24T02:12:22.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.332+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8a6f30 con 0x7f68e4031040 2024-04-24T02:12:22.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.333+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68dc075030 con 0x7f68e4031040 2024-04-24T02:12:22.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.333+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8a6f30 con 0x55e05f8a4490 2024-04-24T02:12:22.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.333+0000 7f68eb02e640 1 -- 172.21.15.134:0/4215797057 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68e0024030 con 0x55e05f8a4490 2024-04-24T02:12:22.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.333+0000 7f68eb02e640 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8a6f30 con 0x7f68e0027060 2024-04-24T02:12:22.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.333+0000 7f68ec030640 1 -- 172.21.15.134:0/4215797057 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68e401f070 con 0x7f68e0027060 2024-04-24T02:12:22.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.333+0000 7f68ec030640 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8a6f30 con 0x55e05f89e350 2024-04-24T02:12:22.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.333+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68dc075030 con 0x55e05f89e350 2024-04-24T02:12:22.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.333+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8a6f30 con 0x7f68e4031040 2024-04-24T02:12:22.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.334+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68dc075030 con 0x7f68e4031040 2024-04-24T02:12:22.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.334+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8a6f30 con 0x55e05f8a4490 2024-04-24T02:12:22.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.334+0000 7f68eb02e640 1 -- 172.21.15.134:0/4215797057 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68e0024030 con 0x55e05f8a4490 2024-04-24T02:12:22.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.334+0000 7f68eb02e640 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8a6f30 con 0x7f68e4031040 2024-04-24T02:12:22.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.334+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68dc075030 con 0x7f68e4031040 2024-04-24T02:12:22.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.334+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8a6f30 con 0x7f68e0027060 2024-04-24T02:12:22.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.334+0000 7f68ec030640 1 -- 172.21.15.134:0/4215797057 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68e401f070 con 0x7f68e0027060 2024-04-24T02:12:22.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.334+0000 7f68ec030640 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8a6f30 con 0x55e05f8a4490 2024-04-24T02:12:22.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.335+0000 7f68eb02e640 1 -- 172.21.15.134:0/4215797057 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68e0024030 con 0x55e05f8a4490 2024-04-24T02:12:22.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.335+0000 7f68eb02e640 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8a6f30 con 0x7f68e4031040 2024-04-24T02:12:22.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.335+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68dc075030 con 0x7f68e4031040 2024-04-24T02:12:22.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.335+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8a6f30 con 0x55e05f89e350 2024-04-24T02:12:22.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.335+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f68dc075030 con 0x55e05f89e350 2024-04-24T02:12:22.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.335+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8a6f30 con 0x7f68e0027060 2024-04-24T02:12:22.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.335+0000 7f68ec030640 1 -- 172.21.15.134:0/4215797057 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68e401f070 con 0x7f68e0027060 2024-04-24T02:12:22.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.335+0000 7f68efb31800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:22.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.335+0000 7f68efb31800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:22.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.335+0000 7f68efb31800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:22.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.335+0000 7f68efb31800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:22.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.335+0000 7f68efb31800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:22.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.335+0000 7f68efb31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:22.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.335+0000 7f68efb31800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.335+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8a2f10 con 0x55e05f89e350 2024-04-24T02:12:22.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.336+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68dc075030 con 0x55e05f89e350 2024-04-24T02:12:22.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.336+0000 7f68efb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:22.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.336+0000 7f68efb31800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.336+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8a37b0 con 0x55e05f89e350 2024-04-24T02:12:22.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.336+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f68dc075030 con 0x55e05f89e350 2024-04-24T02:12:22.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.336+0000 7f68efb31800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:22.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.336+0000 7f68efb31800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.336+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8a2b50 con 0x55e05f89e350 2024-04-24T02:12:22.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.336+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f68dc075030 con 0x55e05f89e350 2024-04-24T02:12:22.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.336+0000 7f68efb31800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:22.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.336+0000 7f68efb31800 20 zone default found 2024-04-24T02:12:22.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.336+0000 7f68efb31800 4 Realm: () 2024-04-24T02:12:22.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.336+0000 7f68efb31800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:22.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.336+0000 7f68efb31800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:22.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.336+0000 7f68efb31800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:22.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.336+0000 7f68efb31800 20 zonegroup default 2024-04-24T02:12:22.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.336+0000 7f68efb31800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.336+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8a7390 con 0x7f68e4031040 2024-04-24T02:12:22.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.337+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f68dc075030 con 0x7f68e4031040 2024-04-24T02:12:22.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.337+0000 7f68efb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:22.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.337+0000 7f68efb31800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.337+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8a9220 con 0x55e05f8a4490 2024-04-24T02:12:22.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.337+0000 7f68eb02e640 1 -- 172.21.15.134:0/4215797057 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f68e0067040 con 0x55e05f8a4490 2024-04-24T02:12:22.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.337+0000 7f68efb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:22.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.337+0000 7f68efb31800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.337+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8a95c0 con 0x55e05f8a4490 2024-04-24T02:12:22.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.337+0000 7f68eb02e640 1 -- 172.21.15.134:0/4215797057 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f68e0067040 con 0x55e05f8a4490 2024-04-24T02:12:22.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.337+0000 7f68efb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:22.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.337+0000 7f68efb31800 20 started sync module instance, tier type = 2024-04-24T02:12:22.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.337+0000 7f68efb31800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:22.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.337+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8a8660 con 0x7f68e0027060 2024-04-24T02:12:22.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.338+0000 7f68ec030640 1 -- 172.21.15.134:0/4215797057 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68e4040040 con 0x7f68e0027060 2024-04-24T02:12:22.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.338+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94422163950208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8a82c0 con 0x7f68e0027060 2024-04-24T02:12:22.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.338+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8aa430 con 0x55e05f89e350 2024-04-24T02:12:22.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.339+0000 7f68ec030640 1 -- 172.21.15.134:0/4215797057 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94422163950208] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68e4040040 con 0x7f68e0027060 2024-04-24T02:12:22.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.340+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68dc075030 con 0x55e05f89e350 2024-04-24T02:12:22.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.340+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94422163954016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8aa430 con 0x55e05f89e350 2024-04-24T02:12:22.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.340+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8aadf0 con 0x55e05f8a4490 2024-04-24T02:12:22.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.340+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94422163954016] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68dc075030 con 0x55e05f89e350 2024-04-24T02:12:22.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.341+0000 7f68eb02e640 1 -- 172.21.15.134:0/4215797057 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68e0067040 con 0x55e05f8a4490 2024-04-24T02:12:22.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.341+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94422163955584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8aa3a0 con 0x55e05f8a4490 2024-04-24T02:12:22.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.341+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8abcb0 con 0x7f68e0027060 2024-04-24T02:12:22.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.342+0000 7f68eb02e640 1 -- 172.21.15.134:0/4215797057 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94422163955584] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68e0067040 con 0x55e05f8a4490 2024-04-24T02:12:22.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.342+0000 7f68ec030640 1 -- 172.21.15.134:0/4215797057 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68e4040040 con 0x7f68e0027060 2024-04-24T02:12:22.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.342+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94422163961856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8abc20 con 0x7f68e0027060 2024-04-24T02:12:22.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.342+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8acb70 con 0x55e05f89e350 2024-04-24T02:12:22.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.343+0000 7f68ec030640 1 -- 172.21.15.134:0/4215797057 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94422163961856] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68e4040040 con 0x7f68e0027060 2024-04-24T02:12:22.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.343+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68dc075030 con 0x55e05f89e350 2024-04-24T02:12:22.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.343+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94422163964064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8acb70 con 0x55e05f89e350 2024-04-24T02:12:22.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.343+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8ad530 con 0x7f68e4031040 2024-04-24T02:12:22.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.344+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68dc075030 con 0x7f68e4031040 2024-04-24T02:12:22.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.344+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94422163968128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8ad4a0 con 0x7f68e4031040 2024-04-24T02:12:22.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.344+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8ae4a0 con 0x7f68e4031040 2024-04-24T02:12:22.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.344+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94422163964064] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68dc075030 con 0x55e05f89e350 2024-04-24T02:12:22.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.345+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94422163968128] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68dc075030 con 0x7f68e4031040 2024-04-24T02:12:22.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.346+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(56 notify.6 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68dc075030 con 0x7f68e4031040 2024-04-24T02:12:22.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.347+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94422163970336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8ac6c0 con 0x7f68e4031040 2024-04-24T02:12:22.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.347+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8ae910 con 0x7f68e4031040 2024-04-24T02:12:22.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.347+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(58 notify.7 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68dc075030 con 0x7f68e4031040 2024-04-24T02:12:22.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.347+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94422163970336] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68dc075030 con 0x7f68e4031040 2024-04-24T02:12:22.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.348+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94422163973216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8aed30 con 0x7f68e4031040 2024-04-24T02:12:22.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.348+0000 7f68efb31800 20 add_watcher() i=0 2024-04-24T02:12:22.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.348+0000 7f68efb31800 20 add_watcher() i=1 2024-04-24T02:12:22.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.348+0000 7f68efb31800 20 add_watcher() i=2 2024-04-24T02:12:22.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.348+0000 7f68efb31800 20 add_watcher() i=3 2024-04-24T02:12:22.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.348+0000 7f68efb31800 20 add_watcher() i=4 2024-04-24T02:12:22.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.348+0000 7f68efb31800 20 add_watcher() i=5 2024-04-24T02:12:22.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.348+0000 7f68efb31800 20 add_watcher() i=6 2024-04-24T02:12:22.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.348+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94422163973216] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68dc075030 con 0x7f68e4031040 2024-04-24T02:12:22.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.348+0000 7f68efb31800 20 add_watcher() i=7 2024-04-24T02:12:22.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.348+0000 7f68efb31800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:22.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.348+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8aed30 con 0x55e05f89e350 2024-04-24T02:12:22.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.349+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f68dc075030 con 0x55e05f89e350 2024-04-24T02:12:22.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.349+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94422163974272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8aed10 con 0x55e05f89e350 2024-04-24T02:12:22.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.350+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94422163974272] v30'64 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f68dc075030 con 0x55e05f89e350 2024-04-24T02:12:22.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.350+0000 7f67a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:22.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.350+0000 7f68efb31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:22.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.350+0000 7f68efb31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:22.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.350+0000 7f68efb31800 5 note: GC not initialized 2024-04-24T02:12:22.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.350+0000 7f67a0fe1640 20 reqs_thread_entry: start 2024-04-24T02:12:22.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.350+0000 7f68efb31800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:22.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.350+0000 7f68efb31800 20 Filter name: none 2024-04-24T02:12:22.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.350+0000 7f671a7fc640 20 reqs_thread_entry: start 2024-04-24T02:12:22.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.350+0000 7f68efb31800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.350+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8e4c10 con 0x55e05f89e350 2024-04-24T02:12:22.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.351+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f68dc075030 con 0x55e05f89e350 2024-04-24T02:12:22.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.351+0000 7f68efb31800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T02:12:22.381 INFO:teuthology.orchestra.run.smithi134.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T02:12:21.778798Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T02:12:21.778786Z","tags":[],"group_ids":[]} 2024-04-24T02:12:22.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.352+0000 7f67a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:22.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.352+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94422163974272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e05f89b710 con 0x55e05f89e350 2024-04-24T02:12:22.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.352+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94422163974272] v30'65 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f68dc075030 con 0x55e05f89e350 2024-04-24T02:12:22.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.353+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94422163950208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8ae880 con 0x7f68e0027060 2024-04-24T02:12:22.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.353+0000 7f68ec030640 1 -- 172.21.15.134:0/4215797057 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94422163950208] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68e4040040 con 0x7f68e0027060 2024-04-24T02:12:22.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.353+0000 7f68efb31800 20 remove_watcher() i=0 2024-04-24T02:12:22.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.353+0000 7f68efb31800 2 removed watcher, disabling cache 2024-04-24T02:12:22.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.353+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94422163954016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8ae880 con 0x55e05f89e350 2024-04-24T02:12:22.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.354+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94422163954016] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68dc075030 con 0x55e05f89e350 2024-04-24T02:12:22.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.354+0000 7f68efb31800 20 remove_watcher() i=1 2024-04-24T02:12:22.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.354+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94422163955584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8ae880 con 0x55e05f8a4490 2024-04-24T02:12:22.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.355+0000 7f68eb02e640 1 -- 172.21.15.134:0/4215797057 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94422163955584] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68e0067040 con 0x55e05f8a4490 2024-04-24T02:12:22.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.355+0000 7f68efb31800 20 remove_watcher() i=2 2024-04-24T02:12:22.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.355+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94422163961856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8a9f80 con 0x7f68e0027060 2024-04-24T02:12:22.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.356+0000 7f68ec030640 1 -- 172.21.15.134:0/4215797057 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94422163961856] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68e4040040 con 0x7f68e0027060 2024-04-24T02:12:22.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.356+0000 7f68efb31800 20 remove_watcher() i=3 2024-04-24T02:12:22.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.356+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94422163964064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8a9f80 con 0x55e05f89e350 2024-04-24T02:12:22.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.357+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94422163964064] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68dc075030 con 0x55e05f89e350 2024-04-24T02:12:22.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.357+0000 7f68efb31800 20 remove_watcher() i=4 2024-04-24T02:12:22.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.357+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94422163968128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8ac0a0 con 0x7f68e4031040 2024-04-24T02:12:22.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.358+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94422163968128] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68dc075030 con 0x7f68e4031040 2024-04-24T02:12:22.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.358+0000 7f68efb31800 20 remove_watcher() i=5 2024-04-24T02:12:22.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.358+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94422163970336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8a9f80 con 0x7f68e4031040 2024-04-24T02:12:22.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.359+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94422163970336] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68dc075030 con 0x7f68e4031040 2024-04-24T02:12:22.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.359+0000 7f68efb31800 20 remove_watcher() i=6 2024-04-24T02:12:22.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.359+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94422163973216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e05f8ad080 con 0x7f68e4031040 2024-04-24T02:12:22.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.360+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94422163973216] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68dc075030 con 0x7f68e4031040 2024-04-24T02:12:22.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.360+0000 7f68efb31800 20 remove_watcher() i=7 2024-04-24T02:12:22.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.360+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f68e4031040 msgr2=0x7f68e4032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.360+0000 7f68efb31800 1 --2- 172.21.15.134:0/4215797057 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f68e4031040 0x7f68e4032940 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.360+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e05f89e350 msgr2=0x55e05f8a0810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.360+0000 7f68efb31800 1 --2- 172.21.15.134:0/4215797057 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e05f89e350 0x55e05f8a0810 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.360+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f68e0027060 msgr2=0x7f68e001e9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.360+0000 7f68efb31800 1 --2- 172.21.15.134:0/4215797057 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f68e0027060 0x7f68e001e9c0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.360+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55e05f8a4490 msgr2=0x55e05f8a6880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.360+0000 7f68efb31800 1 --2- 172.21.15.134:0/4215797057 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55e05f8a4490 0x55e05f8a6880 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.360+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f67b4036900 msgr2=0x7f67b4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.360+0000 7f68efb31800 1 --2- 172.21.15.134:0/4215797057 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f67b4036900 0x7f67b4038dc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x55e05f86dea0 tx=0x7f68e401f000 comp rx=0 tx=0).stop 2024-04-24T02:12:22.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.360+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e05f88b190 msgr2=0x55e05f892850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.360+0000 7f68efb31800 1 --2- 172.21.15.134:0/4215797057 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e05f88b190 0x55e05f892850 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f68e0026fd0 tx=0x7f68e004be50 comp rx=0 tx=0).stop 2024-04-24T02:12:22.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.360+0000 7f68eb82f640 1 -- 172.21.15.134:0/4215797057 reap_dead start 2024-04-24T02:12:22.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.360+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 shutdown_connections 2024-04-24T02:12:22.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.360+0000 7f68efb31800 1 --2- 172.21.15.134:0/4215797057 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e05f88b190 0x55e05f892850 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.360+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 >> 172.21.15.134:0/4215797057 conn(0x55e05f8874f0 msgr2=0x55e05f884b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:22.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.360+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 shutdown_connections 2024-04-24T02:12:22.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.360+0000 7f68efb31800 1 -- 172.21.15.134:0/4215797057 wait complete. 2024-04-24T02:12:22.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.361+0000 7f68efb31800 1 -- 172.21.15.134:0/992866606 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f67c4036950 msgr2=0x7f67c4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.361+0000 7f68efb31800 1 --2- 172.21.15.134:0/992866606 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f67c4036950 0x7f67c4038e10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x55e05f86e720 tx=0x7f68e4005840 comp rx=0 tx=0).stop 2024-04-24T02:12:22.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.361+0000 7f68efb31800 1 -- 172.21.15.134:0/992866606 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e05f87de50 msgr2=0x55e05f87e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.361+0000 7f68efb31800 1 --2- 172.21.15.134:0/992866606 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e05f87de50 0x55e05f87e270 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f68e000e610 tx=0x7f68e000ff90 comp rx=0 tx=0).stop 2024-04-24T02:12:22.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.361+0000 7f68efb31800 1 -- 172.21.15.134:0/992866606 shutdown_connections 2024-04-24T02:12:22.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.361+0000 7f68efb31800 1 --2- 172.21.15.134:0/992866606 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f67c4036950 0x7f67c4038e10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.361+0000 7f68efb31800 1 --2- 172.21.15.134:0/992866606 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e05f87de50 0x55e05f87e270 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.361+0000 7f68efb31800 1 -- 172.21.15.134:0/992866606 >> 172.21.15.134:0/992866606 conn(0x55e05f871ef0 msgr2=0x55e05f8722f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:22.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.361+0000 7f68efb31800 1 -- 172.21.15.134:0/992866606 shutdown_connections 2024-04-24T02:12:22.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.361+0000 7f68efb31800 1 -- 172.21.15.134:0/992866606 wait complete. 2024-04-24T02:12:22.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.361+0000 7f68efb31800 1 -- 172.21.15.134:0/1820606414 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e05f76e2a0 msgr2=0x55e05f86cd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.361+0000 7f68efb31800 1 --2- 172.21.15.134:0/1820606414 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e05f76e2a0 0x55e05f86cd40 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.361+0000 7f68efb31800 1 -- 172.21.15.134:0/1820606414 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f67d4036950 msgr2=0x7f67d4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.361+0000 7f68efb31800 1 --2- 172.21.15.134:0/1820606414 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f67d4036950 0x7f67d4038e10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f68e0000c00 tx=0x7f68e00013b0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.361+0000 7f68efb31800 1 -- 172.21.15.134:0/1820606414 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e05f76b970 msgr2=0x55e05f865b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.361+0000 7f68efb31800 1 --2- 172.21.15.134:0/1820606414 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e05f76b970 0x55e05f865b00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f68dc0524f0 tx=0x7f68dc003020 comp rx=0 tx=0).stop 2024-04-24T02:12:22.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.361+0000 7f68efb31800 1 -- 172.21.15.134:0/1820606414 shutdown_connections 2024-04-24T02:12:22.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.361+0000 7f68efb31800 1 --2- 172.21.15.134:0/1820606414 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e05f76e2a0 0x55e05f86cd40 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.361+0000 7f68efb31800 1 --2- 172.21.15.134:0/1820606414 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f67d4036950 0x7f67d4038e10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.361+0000 7f68efb31800 1 --2- 172.21.15.134:0/1820606414 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e05f76b970 0x55e05f865b00 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.361+0000 7f68efb31800 1 -- 172.21.15.134:0/1820606414 >> 172.21.15.134:0/1820606414 conn(0x55e05f765320 msgr2=0x55e05f76a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:22.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.361+0000 7f68efb31800 1 -- 172.21.15.134:0/1820606414 shutdown_connections 2024-04-24T02:12:22.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.361+0000 7f68efb31800 1 -- 172.21.15.134:0/1820606414 wait complete. 2024-04-24T02:12:22.392 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T02:12:21.778798Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:12:21.778786Z', 'tags': [], 'group_ids': []} 2024-04-24T02:12:22.392 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-04-24T02:12:22.393 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-04-24T02:12:22.393 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-04-24T02:12:22.469 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:22.470 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:22.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.469+0000 7fc87c687800 1 Processor -- start 2024-04-24T02:12:22.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.469+0000 7fc87c687800 1 -- start start 2024-04-24T02:12:22.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.469+0000 7fc87c687800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5568f8d27990 0x5568f8d29d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.469+0000 7fc87c687800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5568f8be5d40 con 0x5568f8d2a2c0 2024-04-24T02:12:22.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.469+0000 7fc87c687800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x5568f8bb84d0 con 0x5568f8d27990 2024-04-24T02:12:22.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.469+0000 7fc87a186640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5568f8d27990 0x5568f8d29d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.469+0000 7fc87a186640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5568f8d27990 0x5568f8d29d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45800/0 (socket says 172.21.15.134:45800) 2024-04-24T02:12:22.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.469+0000 7fc87a186640 1 -- 172.21.15.134:0/3110211011 learned_addr learned my addr 172.21.15.134:0/3110211011 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:22.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.469+0000 7fc873fff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x5568f8d2a2c0 0x5568f8d2c6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:43242/0 (socket says 172.21.15.134:43242) 2024-04-24T02:12:22.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.470+0000 7fc87a186640 1 -- 172.21.15.134:0/3110211011 >> v1:172.21.15.104:6789/0 conn(0x5568f8d2a2c0 legacy=0x5568f8d2c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.470+0000 7fc87a186640 1 -- 172.21.15.134:0/3110211011 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568f8be4590 con 0x5568f8d27990 2024-04-24T02:12:22.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.470+0000 7fc879985640 1 -- 172.21.15.134:0/3110211011 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3614994176 0 0) 0x5568f8be5d40 con 0x5568f8d2a2c0 2024-04-24T02:12:22.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.472+0000 7fc87a186640 1 --2- 172.21.15.134:0/3110211011 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5568f8d27990 0x5568f8d29d80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc86c00a520 tx=0x7fc86c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d80914c918464b30 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.472+0000 7fc879985640 1 -- 172.21.15.134:0/3110211011 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc86c057070 con 0x5568f8d27990 2024-04-24T02:12:22.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.472+0000 7fc879985640 1 -- 172.21.15.134:0/3110211011 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc86c052570 con 0x5568f8d27990 2024-04-24T02:12:22.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.472+0000 7fc879985640 1 -- 172.21.15.134:0/3110211011 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc86c04ae60 con 0x5568f8d27990 2024-04-24T02:12:22.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.472+0000 7fc87c687800 1 -- 172.21.15.134:0/3110211011 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5568f8d27990 msgr2=0x5568f8d29d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.472+0000 7fc87c687800 1 --2- 172.21.15.134:0/3110211011 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5568f8d27990 0x5568f8d29d80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc86c00a520 tx=0x7fc86c01d010 comp rx=0 tx=0).stop 2024-04-24T02:12:22.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.472+0000 7fc87c687800 1 -- 172.21.15.134:0/3110211011 shutdown_connections 2024-04-24T02:12:22.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.472+0000 7fc87c687800 1 --2- 172.21.15.134:0/3110211011 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5568f8d27990 0x5568f8d29d80 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.472+0000 7fc87c687800 1 -- 172.21.15.134:0/3110211011 >> 172.21.15.134:0/3110211011 conn(0x5568f8d21320 msgr2=0x5568f8d23740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:22.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.472+0000 7fc87c687800 1 -- 172.21.15.134:0/3110211011 shutdown_connections 2024-04-24T02:12:22.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.472+0000 7fc87c687800 1 -- 172.21.15.134:0/3110211011 wait complete. 2024-04-24T02:12:22.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.484+0000 7fc87c687800 1 Processor -- start 2024-04-24T02:12:22.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.484+0000 7fc87c687800 1 -- start start 2024-04-24T02:12:22.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.484+0000 7fc87c687800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5568f8d27990 0x5568f8d272d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.484+0000 7fc87c687800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5568f8c723c0 con 0x5568f8d27990 2024-04-24T02:12:22.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.484+0000 7fc87a186640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5568f8d27990 0x5568f8d272d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.484+0000 7fc87a186640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5568f8d27990 0x5568f8d272d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45812/0 (socket says 172.21.15.134:45812) 2024-04-24T02:12:22.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.484+0000 7fc87a186640 1 -- 172.21.15.134:0/2086301577 learned_addr learned my addr 172.21.15.134:0/2086301577 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:22.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.484+0000 7fc87a186640 1 -- 172.21.15.134:0/2086301577 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568f8d25890 con 0x5568f8d27990 2024-04-24T02:12:22.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.485+0000 7fc87a186640 1 --2- 172.21.15.134:0/2086301577 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5568f8d27990 0x5568f8d272d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc86c055040 tx=0x7fc86c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76f13b27d30253d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.485+0000 7fc768608640 1 -- 172.21.15.134:0/2086301577 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc86c062070 con 0x5568f8d27990 2024-04-24T02:12:22.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.485+0000 7fc768608640 1 -- 172.21.15.134:0/2086301577 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc86c052720 con 0x5568f8d27990 2024-04-24T02:12:22.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.485+0000 7fc768608640 1 -- 172.21.15.134:0/2086301577 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc86c057040 con 0x5568f8d27990 2024-04-24T02:12:22.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.485+0000 7fc87c687800 1 -- 172.21.15.134:0/2086301577 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5568f8d27990 msgr2=0x5568f8d272d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.485+0000 7fc87c687800 1 --2- 172.21.15.134:0/2086301577 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5568f8d27990 0x5568f8d272d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc86c055040 tx=0x7fc86c04c000 comp rx=0 tx=0).stop 2024-04-24T02:12:22.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.486+0000 7fc87c687800 1 -- 172.21.15.134:0/2086301577 shutdown_connections 2024-04-24T02:12:22.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.486+0000 7fc87c687800 1 --2- 172.21.15.134:0/2086301577 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5568f8d27990 0x5568f8d272d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.486+0000 7fc87c687800 1 -- 172.21.15.134:0/2086301577 >> 172.21.15.134:0/2086301577 conn(0x5568f8d21320 msgr2=0x5568f8e13780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:22.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.486+0000 7fc87c687800 1 -- 172.21.15.134:0/2086301577 shutdown_connections 2024-04-24T02:12:22.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.486+0000 7fc87c687800 1 -- 172.21.15.134:0/2086301577 wait complete. 2024-04-24T02:12:22.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.486+0000 7fc87c687800 1 Processor -- start 2024-04-24T02:12:22.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.486+0000 7fc87c687800 1 -- start start 2024-04-24T02:12:22.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.486+0000 7fc87c687800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5568f8d27990 0x5568f8e21ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.486+0000 7fc87c687800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5568f8d300e0 con 0x5568f8d27990 2024-04-24T02:12:22.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.486+0000 7fc87a186640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5568f8d27990 0x5568f8e21ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.486+0000 7fc87a186640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5568f8d27990 0x5568f8e21ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45818/0 (socket says 172.21.15.134:45818) 2024-04-24T02:12:22.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.486+0000 7fc87a186640 1 -- 172.21.15.134:0/1661895247 learned_addr learned my addr 172.21.15.134:0/1661895247 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:22.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.487+0000 7fc87a186640 1 -- 172.21.15.134:0/1661895247 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568f8e22000 con 0x5568f8d27990 2024-04-24T02:12:22.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.487+0000 7fc87a186640 1 --2- 172.21.15.134:0/1661895247 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5568f8d27990 0x5568f8e21ac0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc86c0057e0 tx=0x7fc86c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.487+0000 7fc766e05640 1 -- 172.21.15.134:0/1661895247 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc86c057050 con 0x5568f8d27990 2024-04-24T02:12:22.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.487+0000 7fc766e05640 1 -- 172.21.15.134:0/1661895247 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc86c067450 con 0x5568f8d27990 2024-04-24T02:12:22.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.487+0000 7fc87c687800 1 -- 172.21.15.134:0/1661895247 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5568f8e22290 con 0x5568f8d27990 2024-04-24T02:12:22.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.487+0000 7fc766e05640 1 -- 172.21.15.134:0/1661895247 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc86c062040 con 0x5568f8d27990 2024-04-24T02:12:22.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.487+0000 7fc87c687800 1 -- 172.21.15.134:0/1661895247 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568f8e24f40 con 0x5568f8d27990 2024-04-24T02:12:22.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.488+0000 7fc766e05640 1 -- 172.21.15.134:0/1661895247 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc86c067750 con 0x5568f8d27990 2024-04-24T02:12:22.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.488+0000 7fc766e05640 1 --2- 172.21.15.134:0/1661895247 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc760036900 0x7fc760038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.488+0000 7fc766e05640 1 -- 172.21.15.134:0/1661895247 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc86c08dfa0 con 0x5568f8d27990 2024-04-24T02:12:22.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.488+0000 7fc873fff640 1 --2- 172.21.15.134:0/1661895247 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc760036900 0x7fc760038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.488+0000 7fc87c687800 1 --2- 172.21.15.134:0/1661895247 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5568f8d2a2c0 0x5568f8e28d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.488+0000 7fc87c687800 1 -- 172.21.15.134:0/1661895247 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5568f8e29280 con 0x5568f8d2a2c0 2024-04-24T02:12:22.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.488+0000 7fc87a987640 1 --2- 172.21.15.134:0/1661895247 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5568f8d2a2c0 0x5568f8e28d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.488+0000 7fc873fff640 1 --2- 172.21.15.134:0/1661895247 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc760036900 0x7fc760038dc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc864000c00 tx=0x7fc8640013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.488+0000 7fc87a987640 1 --2- 172.21.15.134:0/1661895247 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5568f8d2a2c0 0x5568f8e28d00 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.489+0000 7fc87a987640 1 -- 172.21.15.134:0/1661895247 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc87400a4a0 con 0x5568f8d2a2c0 2024-04-24T02:12:22.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.489+0000 7fc87c687800 1 -- 172.21.15.134:0/1661895247 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5568f8e262b0 con 0x5568f8d2a2c0 2024-04-24T02:12:22.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.489+0000 7fc87a987640 1 -- 172.21.15.134:0/1661895247 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc87400a4a0 con 0x5568f8d2a2c0 2024-04-24T02:12:22.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.489+0000 7fc87c687800 1 -- 172.21.15.134:0/1661895247 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5568f8e2b060 con 0x5568f8d2a2c0 2024-04-24T02:12:22.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.489+0000 7fc87a987640 1 -- 172.21.15.134:0/1661895247 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc87400a4a0 con 0x5568f8d2a2c0 2024-04-24T02:12:22.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.489+0000 7fc87c687800 1 -- 172.21.15.134:0/1661895247 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5568f8e2a3a0 con 0x5568f8d2a2c0 2024-04-24T02:12:22.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.489+0000 7fc87a987640 1 -- 172.21.15.134:0/1661895247 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc87400a4a0 con 0x5568f8d2a2c0 2024-04-24T02:12:22.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.489+0000 7fc87c687800 1 -- 172.21.15.134:0/1661895247 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5568f8e2a7c0 con 0x5568f8d2a2c0 2024-04-24T02:12:22.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.490+0000 7fc87a987640 1 -- 172.21.15.134:0/1661895247 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc87400a4a0 con 0x5568f8d2a2c0 2024-04-24T02:12:22.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.490+0000 7fc87c687800 1 Processor -- start 2024-04-24T02:12:22.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.490+0000 7fc87c687800 1 -- start start 2024-04-24T02:12:22.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.490+0000 7fc87c687800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5568f8e39e70 0x5568f8e3a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.490+0000 7fc87c687800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5568f8c186b0 con 0x5568f8e39e70 2024-04-24T02:12:22.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.490+0000 7fc873fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5568f8e39e70 0x5568f8e3a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.490+0000 7fc873fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5568f8e39e70 0x5568f8e3a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45830/0 (socket says 172.21.15.134:45830) 2024-04-24T02:12:22.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.490+0000 7fc873fff640 1 -- 172.21.15.134:0/2178198895 learned_addr learned my addr 172.21.15.134:0/2178198895 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:22.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.491+0000 7fc873fff640 1 -- 172.21.15.134:0/2178198895 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568f8e3a7d0 con 0x5568f8e39e70 2024-04-24T02:12:22.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.491+0000 7fc873fff640 1 --2- 172.21.15.134:0/2178198895 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5568f8e39e70 0x5568f8e3a290 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc86400e610 tx=0x7fc86400ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.491+0000 7fc75ffff640 1 -- 172.21.15.134:0/2178198895 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc864022070 con 0x5568f8e39e70 2024-04-24T02:12:22.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.491+0000 7fc75ffff640 1 -- 172.21.15.134:0/2178198895 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc864009050 con 0x5568f8e39e70 2024-04-24T02:12:22.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.491+0000 7fc87c687800 1 -- 172.21.15.134:0/2178198895 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5568f8e3b240 con 0x5568f8e39e70 2024-04-24T02:12:22.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.491+0000 7fc75ffff640 1 -- 172.21.15.134:0/2178198895 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc86400d500 con 0x5568f8e39e70 2024-04-24T02:12:22.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.491+0000 7fc87c687800 1 -- 172.21.15.134:0/2178198895 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568f8e3b740 con 0x5568f8e39e70 2024-04-24T02:12:22.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.492+0000 7fc75ffff640 1 -- 172.21.15.134:0/2178198895 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc864025070 con 0x5568f8e39e70 2024-04-24T02:12:22.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.492+0000 7fc75ffff640 1 --2- 172.21.15.134:0/2178198895 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc754036950 0x7fc754038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.492+0000 7fc75ffff640 1 -- 172.21.15.134:0/2178198895 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc86404d920 con 0x5568f8e39e70 2024-04-24T02:12:22.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.492+0000 7fc87a987640 1 --2- 172.21.15.134:0/2178198895 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc754036950 0x7fc754038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.492+0000 7fc87c687800 1 Processor -- start 2024-04-24T02:12:22.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.492+0000 7fc87a987640 1 --2- 172.21.15.134:0/2178198895 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc754036950 0x7fc754038e10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x5568f8e2a740 tx=0x7fc874005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.492+0000 7fc87c687800 1 -- start start 2024-04-24T02:12:22.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.492+0000 7fc87c687800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5568f8e471b0 0x5568f8e475d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.492+0000 7fc87c687800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5568f8d25b50 con 0x5568f8e471b0 2024-04-24T02:12:22.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.493+0000 7fc873fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5568f8e471b0 0x5568f8e475d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.493+0000 7fc873fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5568f8e471b0 0x5568f8e475d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45832/0 (socket says 172.21.15.134:45832) 2024-04-24T02:12:22.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.493+0000 7fc873fff640 1 -- 172.21.15.134:0/607449770 learned_addr learned my addr 172.21.15.134:0/607449770 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:22.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.493+0000 7fc873fff640 1 -- 172.21.15.134:0/607449770 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568f8e47ba0 con 0x5568f8e471b0 2024-04-24T02:12:22.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.493+0000 7fc873fff640 1 --2- 172.21.15.134:0/607449770 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5568f8e471b0 0x5568f8e475d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc864026fd0 tx=0x7fc864026680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d0c278cfdc1eb63 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.493+0000 7fc75dffb640 1 -- 172.21.15.134:0/607449770 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc86401ac20 con 0x5568f8e471b0 2024-04-24T02:12:22.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.493+0000 7fc75dffb640 1 -- 172.21.15.134:0/607449770 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc86401adc0 con 0x5568f8e471b0 2024-04-24T02:12:22.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.493+0000 7fc75dffb640 1 -- 172.21.15.134:0/607449770 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8640254d0 con 0x5568f8e471b0 2024-04-24T02:12:22.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.494+0000 7fc87c687800 1 -- 172.21.15.134:0/607449770 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5568f8e471b0 msgr2=0x5568f8e475d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.494+0000 7fc87c687800 1 --2- 172.21.15.134:0/607449770 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5568f8e471b0 0x5568f8e475d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc864026fd0 tx=0x7fc864026680 comp rx=0 tx=0).stop 2024-04-24T02:12:22.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.494+0000 7fc87c687800 1 -- 172.21.15.134:0/607449770 shutdown_connections 2024-04-24T02:12:22.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.494+0000 7fc87c687800 1 --2- 172.21.15.134:0/607449770 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5568f8e471b0 0x5568f8e475d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.494+0000 7fc87c687800 1 -- 172.21.15.134:0/607449770 >> 172.21.15.134:0/607449770 conn(0x5568f8e43510 msgr2=0x5568f8e41570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:22.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.494+0000 7fc87c687800 1 -- 172.21.15.134:0/607449770 shutdown_connections 2024-04-24T02:12:22.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.494+0000 7fc87c687800 1 -- 172.21.15.134:0/607449770 wait complete. 2024-04-24T02:12:22.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.494+0000 7fc87c687800 1 Processor -- start 2024-04-24T02:12:22.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.494+0000 7fc87c687800 1 -- start start 2024-04-24T02:12:22.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.494+0000 7fc87c687800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5568f8e471b0 0x5568f8e4e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.494+0000 7fc87c687800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5568f8e48310 con 0x5568f8e471b0 2024-04-24T02:12:22.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.495+0000 7fc873fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5568f8e471b0 0x5568f8e4e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.495+0000 7fc873fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5568f8e471b0 0x5568f8e4e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45844/0 (socket says 172.21.15.134:45844) 2024-04-24T02:12:22.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.495+0000 7fc873fff640 1 -- 172.21.15.134:0/3531573152 learned_addr learned my addr 172.21.15.134:0/3531573152 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:22.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.495+0000 7fc873fff640 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568f8e4ed30 con 0x5568f8e471b0 2024-04-24T02:12:22.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.495+0000 7fc873fff640 1 --2- 172.21.15.134:0/3531573152 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5568f8e471b0 0x5568f8e4e7f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc8640266c0 tx=0x7fc86404be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.495+0000 7fc74bfff640 1 -- 172.21.15.134:0/3531573152 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc86400d8b0 con 0x5568f8e471b0 2024-04-24T02:12:22.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.495+0000 7fc74bfff640 1 -- 172.21.15.134:0/3531573152 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc86400da50 con 0x5568f8e471b0 2024-04-24T02:12:22.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.495+0000 7fc74bfff640 1 -- 172.21.15.134:0/3531573152 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc86404d220 con 0x5568f8e471b0 2024-04-24T02:12:22.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.495+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5568f8e4efc0 con 0x5568f8e471b0 2024-04-24T02:12:22.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.495+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568f8e51c70 con 0x5568f8e471b0 2024-04-24T02:12:22.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.496+0000 7fc74bfff640 1 -- 172.21.15.134:0/3531573152 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc86404d3c0 con 0x5568f8e471b0 2024-04-24T02:12:22.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.496+0000 7fc74bfff640 1 --2- 172.21.15.134:0/3531573152 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc744036950 0x7fc744038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.496+0000 7fc74bfff640 1 -- 172.21.15.134:0/3531573152 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc864036af0 con 0x5568f8e471b0 2024-04-24T02:12:22.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.496+0000 7fc87a987640 1 --2- 172.21.15.134:0/3531573152 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc744036950 0x7fc744038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.496+0000 7fc87c687800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.497+0000 7fc87c687800 1 --2- 172.21.15.134:0/3531573152 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5568f8e5a2e0 0x5568f8e5c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.497+0000 7fc87a987640 1 --2- 172.21.15.134:0/3531573152 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc744036950 0x7fc744038e10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x5568f8e29ec0 tx=0x7fc87401f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.497+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5568f8e5cef0 con 0x5568f8e5a2e0 2024-04-24T02:12:22.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.497+0000 7fc87a186640 1 --2- 172.21.15.134:0/3531573152 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5568f8e5a2e0 0x5568f8e5c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.497+0000 7fc87a186640 1 --2- 172.21.15.134:0/3531573152 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5568f8e5a2e0 0x5568f8e5c7a0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.497+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc86c064070 con 0x5568f8e5a2e0 2024-04-24T02:12:22.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.497+0000 7fc87c687800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:22.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.497+0000 7fc87c687800 20 realm 2024-04-24T02:12:22.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.497+0000 7fc87c687800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.497+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5568f8e5d300 con 0x5568f8e5a2e0 2024-04-24T02:12:22.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.497+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc86c064070 con 0x5568f8e5a2e0 2024-04-24T02:12:22.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.497+0000 7fc87c687800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:22.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.497+0000 7fc87c687800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:22.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.497+0000 7fc87c687800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.497+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5568f8e5dbd0 con 0x5568f8e5a2e0 2024-04-24T02:12:22.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.497+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc86c064070 con 0x5568f8e5a2e0 2024-04-24T02:12:22.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.498+0000 7fc87c687800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:22.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.498+0000 7fc87c687800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.498+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5568f8e5df70 con 0x5568f8e5a2e0 2024-04-24T02:12:22.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.498+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc86c064070 con 0x5568f8e5a2e0 2024-04-24T02:12:22.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.498+0000 7fc87c687800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:22.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.498+0000 7fc87c687800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.498+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5568f8e5e7c0 con 0x5568f8e5a2e0 2024-04-24T02:12:22.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.498+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc86c064070 con 0x5568f8e5a2e0 2024-04-24T02:12:22.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.498+0000 7fc87c687800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:22.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.498+0000 7fc87c687800 20 searching for the correct realm 2024-04-24T02:12:22.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.498+0000 7fc87c687800 1 --2- 172.21.15.134:0/3531573152 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5568f8e60530 0x5568f8e62920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.498+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5568f8e62f00 con 0x5568f8e60530 2024-04-24T02:12:22.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.498+0000 7fc873fff640 1 --2- 172.21.15.134:0/3531573152 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5568f8e60530 0x5568f8e62920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.498+0000 7fc873fff640 1 --2- 172.21.15.134:0/3531573152 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5568f8e60530 0x5568f8e62920 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.499+0000 7fc873fff640 1 -- 172.21.15.134:0/3531573152 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc864024030 con 0x5568f8e60530 2024-04-24T02:12:22.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.499+0000 7fc873fff640 1 --2- 172.21.15.134:0/3531573152 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fc864027060 0x7fc864027440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.499+0000 7fc873fff640 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5568f8e62f00 con 0x7fc864027060 2024-04-24T02:12:22.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.499+0000 7fc87a987640 1 --2- 172.21.15.134:0/3531573152 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fc864027060 0x7fc864027440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.499+0000 7fc87a987640 1 --2- 172.21.15.134:0/3531573152 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fc864027060 0x7fc864027440 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.499+0000 7fc87a987640 1 -- 172.21.15.134:0/3531573152 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc87401f070 con 0x7fc864027060 2024-04-24T02:12:22.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.499+0000 7fc87a987640 1 --2- 172.21.15.134:0/3531573152 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fc874031040 0x7fc874032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.500+0000 7fc87a987640 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5568f8e62f00 con 0x7fc874031040 2024-04-24T02:12:22.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.500+0000 7fc87a186640 1 --2- 172.21.15.134:0/3531573152 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fc874031040 0x7fc874032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.500+0000 7fc87a186640 1 --2- 172.21.15.134:0/3531573152 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fc874031040 0x7fc874032940 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.500+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c064070 con 0x7fc874031040 2024-04-24T02:12:22.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.500+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5568f8e62f00 con 0x5568f8e5a2e0 2024-04-24T02:12:22.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.501+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c064070 con 0x5568f8e5a2e0 2024-04-24T02:12:22.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.501+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5568f8e62f00 con 0x5568f8e5a2e0 2024-04-24T02:12:22.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.501+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc86c064070 con 0x5568f8e5a2e0 2024-04-24T02:12:22.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.501+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5568f8e62f00 con 0x7fc874031040 2024-04-24T02:12:22.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.501+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c064070 con 0x7fc874031040 2024-04-24T02:12:22.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.501+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5568f8e62f00 con 0x7fc874031040 2024-04-24T02:12:22.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.501+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c064070 con 0x7fc874031040 2024-04-24T02:12:22.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.501+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc86c091040 con 0x7fc864027060 2024-04-24T02:12:22.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.502+0000 7fc87a987640 1 -- 172.21.15.134:0/3531573152 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc87401f070 con 0x7fc864027060 2024-04-24T02:12:22.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.502+0000 7fc87a987640 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc86c091040 con 0x5568f8e60530 2024-04-24T02:12:22.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.502+0000 7fc873fff640 1 -- 172.21.15.134:0/3531573152 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc864024030 con 0x5568f8e60530 2024-04-24T02:12:22.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.502+0000 7fc873fff640 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc86c091040 con 0x5568f8e5a2e0 2024-04-24T02:12:22.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.502+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c064070 con 0x5568f8e5a2e0 2024-04-24T02:12:22.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.502+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc86c091040 con 0x7fc874031040 2024-04-24T02:12:22.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.502+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c064070 con 0x7fc874031040 2024-04-24T02:12:22.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.502+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc86c091040 con 0x5568f8e5a2e0 2024-04-24T02:12:22.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.502+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c064070 con 0x5568f8e5a2e0 2024-04-24T02:12:22.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.502+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc86c091040 con 0x7fc864027060 2024-04-24T02:12:22.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.503+0000 7fc87a987640 1 -- 172.21.15.134:0/3531573152 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc87401f070 con 0x7fc864027060 2024-04-24T02:12:22.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.503+0000 7fc87a987640 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc86c091040 con 0x5568f8e60530 2024-04-24T02:12:22.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.503+0000 7fc873fff640 1 -- 172.21.15.134:0/3531573152 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc864024030 con 0x5568f8e60530 2024-04-24T02:12:22.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.503+0000 7fc873fff640 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc86c091040 con 0x5568f8e60530 2024-04-24T02:12:22.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.503+0000 7fc873fff640 1 -- 172.21.15.134:0/3531573152 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc864024030 con 0x5568f8e60530 2024-04-24T02:12:22.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.503+0000 7fc873fff640 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc86c091040 con 0x7fc874031040 2024-04-24T02:12:22.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.504+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c064070 con 0x7fc874031040 2024-04-24T02:12:22.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.504+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc86c091040 con 0x5568f8e60530 2024-04-24T02:12:22.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.504+0000 7fc873fff640 1 -- 172.21.15.134:0/3531573152 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc864024030 con 0x5568f8e60530 2024-04-24T02:12:22.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.504+0000 7fc873fff640 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc86c091040 con 0x5568f8e60530 2024-04-24T02:12:22.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.504+0000 7fc873fff640 1 -- 172.21.15.134:0/3531573152 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc864024030 con 0x5568f8e60530 2024-04-24T02:12:22.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.504+0000 7fc873fff640 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc86c091040 con 0x5568f8e5a2e0 2024-04-24T02:12:22.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.504+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c064070 con 0x5568f8e5a2e0 2024-04-24T02:12:22.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.504+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc86c091040 con 0x5568f8e5a2e0 2024-04-24T02:12:22.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.504+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fc86c064070 con 0x5568f8e5a2e0 2024-04-24T02:12:22.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.504+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc86c091040 con 0x7fc874031040 2024-04-24T02:12:22.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.505+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c064070 con 0x7fc874031040 2024-04-24T02:12:22.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.505+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc86c091040 con 0x5568f8e60530 2024-04-24T02:12:22.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.505+0000 7fc873fff640 1 -- 172.21.15.134:0/3531573152 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc864024030 con 0x5568f8e60530 2024-04-24T02:12:22.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.505+0000 7fc873fff640 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc86c091040 con 0x7fc864027060 2024-04-24T02:12:22.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.505+0000 7fc87a987640 1 -- 172.21.15.134:0/3531573152 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc87401f070 con 0x7fc864027060 2024-04-24T02:12:22.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.505+0000 7fc87a987640 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc86c091040 con 0x5568f8e5a2e0 2024-04-24T02:12:22.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.505+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c064070 con 0x5568f8e5a2e0 2024-04-24T02:12:22.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.505+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc86c091040 con 0x7fc874031040 2024-04-24T02:12:22.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.506+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c064070 con 0x7fc874031040 2024-04-24T02:12:22.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.506+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc86c091040 con 0x5568f8e60530 2024-04-24T02:12:22.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.506+0000 7fc873fff640 1 -- 172.21.15.134:0/3531573152 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc864024030 con 0x5568f8e60530 2024-04-24T02:12:22.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.506+0000 7fc873fff640 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc86c091040 con 0x7fc874031040 2024-04-24T02:12:22.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.506+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c064070 con 0x7fc874031040 2024-04-24T02:12:22.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.506+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc86c091040 con 0x7fc864027060 2024-04-24T02:12:22.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.506+0000 7fc87a987640 1 -- 172.21.15.134:0/3531573152 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc87401f070 con 0x7fc864027060 2024-04-24T02:12:22.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.506+0000 7fc87a987640 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc86c091040 con 0x5568f8e60530 2024-04-24T02:12:22.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.507+0000 7fc873fff640 1 -- 172.21.15.134:0/3531573152 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc864024030 con 0x5568f8e60530 2024-04-24T02:12:22.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.507+0000 7fc873fff640 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc86c091040 con 0x7fc874031040 2024-04-24T02:12:22.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.507+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c064070 con 0x7fc874031040 2024-04-24T02:12:22.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.507+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc86c091040 con 0x5568f8e5a2e0 2024-04-24T02:12:22.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.507+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc86c064070 con 0x5568f8e5a2e0 2024-04-24T02:12:22.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.507+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc86c091040 con 0x7fc864027060 2024-04-24T02:12:22.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.508+0000 7fc87a987640 1 -- 172.21.15.134:0/3531573152 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc87401f070 con 0x7fc864027060 2024-04-24T02:12:22.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.508+0000 7fc87c687800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:22.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.508+0000 7fc87c687800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:22.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.508+0000 7fc87c687800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:22.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.508+0000 7fc87c687800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:22.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.508+0000 7fc87c687800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:22.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.508+0000 7fc87c687800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:22.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.508+0000 7fc87c687800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.508+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5568f8e5f010 con 0x5568f8e5a2e0 2024-04-24T02:12:22.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.508+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc86c064070 con 0x5568f8e5a2e0 2024-04-24T02:12:22.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.508+0000 7fc87c687800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:22.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.508+0000 7fc87c687800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.508+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5568f8e5f400 con 0x5568f8e5a2e0 2024-04-24T02:12:22.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.508+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc86c064070 con 0x5568f8e5a2e0 2024-04-24T02:12:22.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.508+0000 7fc87c687800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:22.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.508+0000 7fc87c687800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.508+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5568f8e5f400 con 0x5568f8e5a2e0 2024-04-24T02:12:22.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.509+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc86c064070 con 0x5568f8e5a2e0 2024-04-24T02:12:22.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.509+0000 7fc87c687800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:22.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.509+0000 7fc87c687800 20 zone default found 2024-04-24T02:12:22.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.509+0000 7fc87c687800 4 Realm: () 2024-04-24T02:12:22.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.509+0000 7fc87c687800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:22.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.509+0000 7fc87c687800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:22.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.509+0000 7fc87c687800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:22.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.509+0000 7fc87c687800 20 zonegroup default 2024-04-24T02:12:22.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.509+0000 7fc87c687800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.509+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5568f8e63380 con 0x7fc874031040 2024-04-24T02:12:22.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.509+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc86c064070 con 0x7fc874031040 2024-04-24T02:12:22.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.509+0000 7fc87c687800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:22.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.509+0000 7fc87c687800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.509+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5568f8e64d60 con 0x5568f8e60530 2024-04-24T02:12:22.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.509+0000 7fc873fff640 1 -- 172.21.15.134:0/3531573152 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc864024030 con 0x5568f8e60530 2024-04-24T02:12:22.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.509+0000 7fc87c687800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:22.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.509+0000 7fc87c687800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.510+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5568f8e65100 con 0x5568f8e60530 2024-04-24T02:12:22.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.510+0000 7fc873fff640 1 -- 172.21.15.134:0/3531573152 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc864024030 con 0x5568f8e60530 2024-04-24T02:12:22.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.510+0000 7fc87c687800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:22.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.510+0000 7fc87c687800 20 started sync module instance, tier type = 2024-04-24T02:12:22.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.510+0000 7fc87c687800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:22.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.510+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5568f8e64200 con 0x7fc864027060 2024-04-24T02:12:22.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.511+0000 7fc87a987640 1 -- 172.21.15.134:0/3531573152 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc874040040 con 0x7fc864027060 2024-04-24T02:12:22.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.511+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93909340798288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5568f8e654a0 con 0x7fc864027060 2024-04-24T02:12:22.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.511+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5568f8e65e60 con 0x5568f8e5a2e0 2024-04-24T02:12:22.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.512+0000 7fc87a987640 1 -- 172.21.15.134:0/3531573152 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93909340798288] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc874040040 con 0x7fc864027060 2024-04-24T02:12:22.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.512+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc86c064070 con 0x5568f8e5a2e0 2024-04-24T02:12:22.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.512+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93909340800544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5568f8e65e60 con 0x5568f8e5a2e0 2024-04-24T02:12:22.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.512+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5568f8e668a0 con 0x5568f8e60530 2024-04-24T02:12:22.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.513+0000 7fc873fff640 1 -- 172.21.15.134:0/3531573152 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc864024030 con 0x5568f8e60530 2024-04-24T02:12:22.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.513+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93909340808048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5568f8e67140 con 0x5568f8e60530 2024-04-24T02:12:22.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.513+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5568f8e67c00 con 0x7fc864027060 2024-04-24T02:12:22.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.513+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93909340800544] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc86c064070 con 0x5568f8e5a2e0 2024-04-24T02:12:22.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.514+0000 7fc873fff640 1 -- 172.21.15.134:0/3531573152 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93909340808048] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc864024030 con 0x5568f8e60530 2024-04-24T02:12:22.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.514+0000 7fc87a987640 1 -- 172.21.15.134:0/3531573152 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc874040040 con 0x7fc864027060 2024-04-24T02:12:22.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.514+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93909340810384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5568f8e659b0 con 0x7fc864027060 2024-04-24T02:12:22.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.514+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5568f8e684a0 con 0x5568f8e5a2e0 2024-04-24T02:12:22.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.515+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc86c064070 con 0x5568f8e5a2e0 2024-04-24T02:12:22.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.515+0000 7fc87a987640 1 -- 172.21.15.134:0/3531573152 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93909340810384] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc874040040 con 0x7fc864027060 2024-04-24T02:12:22.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.515+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93909340815344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5568f8e68450 con 0x5568f8e5a2e0 2024-04-24T02:12:22.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.515+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5568f8e676d0 con 0x7fc874031040 2024-04-24T02:12:22.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.516+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc86c064070 con 0x7fc874031040 2024-04-24T02:12:22.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.516+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93909340819216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5568f8e676d0 con 0x7fc874031040 2024-04-24T02:12:22.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.516+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5568f8e69e40 con 0x7fc874031040 2024-04-24T02:12:22.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.516+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93909340815344] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc86c064070 con 0x5568f8e5a2e0 2024-04-24T02:12:22.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.517+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93909340819216] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc86c064070 con 0x7fc874031040 2024-04-24T02:12:22.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.517+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(56 notify.6 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc86c064070 con 0x7fc874031040 2024-04-24T02:12:22.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.517+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93909340820272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5568f8e69950 con 0x7fc874031040 2024-04-24T02:12:22.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.517+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5568f8e6a6e0 con 0x7fc874031040 2024-04-24T02:12:22.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.518+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93909340820272] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc86c064070 con 0x7fc874031040 2024-04-24T02:12:22.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.518+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(58 notify.7 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc86c064070 con 0x7fc874031040 2024-04-24T02:12:22.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.518+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93909340817552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5568f8e69950 con 0x7fc874031040 2024-04-24T02:12:22.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.518+0000 7fc87c687800 20 add_watcher() i=0 2024-04-24T02:12:22.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.518+0000 7fc87c687800 20 add_watcher() i=1 2024-04-24T02:12:22.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.518+0000 7fc87c687800 20 add_watcher() i=2 2024-04-24T02:12:22.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.518+0000 7fc87c687800 20 add_watcher() i=3 2024-04-24T02:12:22.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.518+0000 7fc87c687800 20 add_watcher() i=4 2024-04-24T02:12:22.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.518+0000 7fc87c687800 20 add_watcher() i=5 2024-04-24T02:12:22.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.518+0000 7fc87c687800 20 add_watcher() i=6 2024-04-24T02:12:22.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.519+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93909340817552] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc86c064070 con 0x7fc874031040 2024-04-24T02:12:22.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.519+0000 7fc87c687800 20 add_watcher() i=7 2024-04-24T02:12:22.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.519+0000 7fc87c687800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:22.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.519+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5568f8e6d750 con 0x5568f8e5a2e0 2024-04-24T02:12:22.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.519+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc86c064070 con 0x5568f8e5a2e0 2024-04-24T02:12:22.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.519+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93909340823936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5568f8e6aa50 con 0x5568f8e5a2e0 2024-04-24T02:12:22.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.520+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93909340823936] v30'66 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc86c064070 con 0x5568f8e5a2e0 2024-04-24T02:12:22.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.520+0000 7fc730fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:22.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.521+0000 7fc87c687800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:22.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.521+0000 7fc87c687800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:22.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.521+0000 7fc87c687800 5 note: GC not initialized 2024-04-24T02:12:22.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.521+0000 7fc6ab7fe640 20 reqs_thread_entry: start 2024-04-24T02:12:22.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.521+0000 7fc87c687800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:22.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.521+0000 7fc87c687800 20 Filter name: none 2024-04-24T02:12:22.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.521+0000 7fc6a97fa640 20 reqs_thread_entry: start 2024-04-24T02:12:22.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.521+0000 7fc87c687800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T02:12:22.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.521+0000 7fc87c687800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.521+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5568f8ea09e0 con 0x5568f8e5a2e0 2024-04-24T02:12:22.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.521+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc86c064070 con 0x5568f8e5a2e0 2024-04-24T02:12:22.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.521+0000 7fc87c687800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T02:12:22.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.521+0000 7fc87c687800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T02:12:22.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.521+0000 7fc87c687800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:22.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.521+0000 7fc87c687800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:12:22.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.521+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5568f8ea3470 con 0x7fc864027060 2024-04-24T02:12:22.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.522+0000 7fc87a987640 1 -- 172.21.15.134:0/3531573152 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fc874040040 con 0x7fc864027060 2024-04-24T02:12:22.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.522+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5568f8ea6c40 con 0x5568f8e5a2e0 2024-04-24T02:12:22.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.523+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v30'3 uv3 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fc86c064070 con 0x5568f8e5a2e0 2024-04-24T02:12:22.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.523+0000 7fc87c687800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T02:12:22.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.523+0000 7fc87c687800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:22.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.523+0000 7fc87c687800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-24T02:12:22.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.523+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 93909341070992 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5568f8ea2460 con 0x5568f8e5a2e0 2024-04-24T02:12:22.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.523+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== watch-notify(notify (1) cookie 93909340815344 notify 128849018882 ret 0) ==== 609+0+0 (crc 0 0 0) 0x5568f8e24f40 con 0x5568f8e5a2e0 2024-04-24T02:12:22.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.523+0000 7fc75dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018882 cookie 93909340815344 notifier 4320 bl.length()=567 2024-04-24T02:12:22.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.523+0000 7fc75dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T02:12:22.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.523+0000 7fc75dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:22.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.523+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(65 notify.4 [notify cookie 93909341070992 out=8b] v0'0 uv39 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc86c064070 con 0x5568f8e5a2e0 2024-04-24T02:12:22.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.523+0000 7fc75dffb640 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fc740003ea0 con 0x5568f8e5a2e0 2024-04-24T02:12:22.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.523+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc86c064070 con 0x5568f8e5a2e0 2024-04-24T02:12:22.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.523+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== watch-notify(notify_complete (2) cookie 93909341070992 notify 128849018882 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5568f8e22290 con 0x5568f8e5a2e0 2024-04-24T02:12:22.559 INFO:teuthology.orchestra.run.smithi134.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T02:12:21.778798Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T02:12:21.778786Z","tags":[],"group_ids":[]} 2024-04-24T02:12:22.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.524+0000 7fc730fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:22.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.524+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93909340823936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5568f8e6cce0 con 0x5568f8e5a2e0 2024-04-24T02:12:22.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.525+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 93909340823936] v30'67 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc86c064070 con 0x5568f8e5a2e0 2024-04-24T02:12:22.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.525+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93909340798288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5568f8e6a180 con 0x7fc864027060 2024-04-24T02:12:22.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.526+0000 7fc87a987640 1 -- 172.21.15.134:0/3531573152 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 93909340798288] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc874040040 con 0x7fc864027060 2024-04-24T02:12:22.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.526+0000 7fc87c687800 20 remove_watcher() i=0 2024-04-24T02:12:22.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.526+0000 7fc87c687800 2 removed watcher, disabling cache 2024-04-24T02:12:22.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.526+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93909340800544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5568f8e6a180 con 0x5568f8e5a2e0 2024-04-24T02:12:22.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.527+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 <== osd.1 v2:172.21.15.134:6804/1487076214 30 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 93909340800544] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc86c064070 con 0x5568f8e5a2e0 2024-04-24T02:12:22.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.527+0000 7fc87c687800 20 remove_watcher() i=1 2024-04-24T02:12:22.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.527+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93909340808048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5568f8e6a180 con 0x5568f8e60530 2024-04-24T02:12:22.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.529+0000 7fc873fff640 1 -- 172.21.15.134:0/3531573152 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 93909340808048] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc864024030 con 0x5568f8e60530 2024-04-24T02:12:22.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.529+0000 7fc87c687800 20 remove_watcher() i=2 2024-04-24T02:12:22.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.529+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93909340810384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5568f8e66370 con 0x7fc864027060 2024-04-24T02:12:22.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.530+0000 7fc87a987640 1 -- 172.21.15.134:0/3531573152 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 93909340810384] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc874040040 con 0x7fc864027060 2024-04-24T02:12:22.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.530+0000 7fc87c687800 20 remove_watcher() i=3 2024-04-24T02:12:22.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.530+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93909340815344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5568f8e66c90 con 0x5568f8e5a2e0 2024-04-24T02:12:22.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.531+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 <== osd.1 v2:172.21.15.134:6804/1487076214 31 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 93909340815344] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc86c064070 con 0x5568f8e5a2e0 2024-04-24T02:12:22.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.531+0000 7fc87c687800 20 remove_watcher() i=4 2024-04-24T02:12:22.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.531+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93909340819216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5568f8e66370 con 0x7fc874031040 2024-04-24T02:12:22.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.532+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 93909340819216] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc86c064070 con 0x7fc874031040 2024-04-24T02:12:22.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.532+0000 7fc87c687800 20 remove_watcher() i=5 2024-04-24T02:12:22.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.532+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93909340820272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5568f8e67ff0 con 0x7fc874031040 2024-04-24T02:12:22.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.533+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 93909340820272] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc86c064070 con 0x7fc874031040 2024-04-24T02:12:22.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.533+0000 7fc87c687800 20 remove_watcher() i=6 2024-04-24T02:12:22.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.533+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93909340817552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5568f8e66370 con 0x7fc874031040 2024-04-24T02:12:22.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.533+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 93909340817552] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc86c064070 con 0x7fc874031040 2024-04-24T02:12:22.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.533+0000 7fc87c687800 20 remove_watcher() i=7 2024-04-24T02:12:22.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.534+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fc874031040 msgr2=0x7fc874032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.534+0000 7fc87c687800 1 --2- 172.21.15.134:0/3531573152 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fc874031040 0x7fc874032940 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.534+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5568f8e5a2e0 msgr2=0x5568f8e5c7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.534+0000 7fc87c687800 1 --2- 172.21.15.134:0/3531573152 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5568f8e5a2e0 0x5568f8e5c7a0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.534+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fc864027060 msgr2=0x7fc864027440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.534+0000 7fc87c687800 1 --2- 172.21.15.134:0/3531573152 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fc864027060 0x7fc864027440 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.534+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5568f8e60530 msgr2=0x5568f8e62920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.534+0000 7fc87c687800 1 --2- 172.21.15.134:0/3531573152 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5568f8e60530 0x5568f8e62920 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.534+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc744036950 msgr2=0x7fc744038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.534+0000 7fc87c687800 1 --2- 172.21.15.134:0/3531573152 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc744036950 0x7fc744038e10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x5568f8e29ec0 tx=0x7fc87401f000 comp rx=0 tx=0).stop 2024-04-24T02:12:22.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.534+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5568f8e471b0 msgr2=0x5568f8e4e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.534+0000 7fc87a186640 1 -- 172.21.15.134:0/3531573152 reap_dead start 2024-04-24T02:12:22.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.534+0000 7fc87c687800 1 --2- 172.21.15.134:0/3531573152 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5568f8e471b0 0x5568f8e4e7f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc8640266c0 tx=0x7fc86404be50 comp rx=0 tx=0).stop 2024-04-24T02:12:22.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.534+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 shutdown_connections 2024-04-24T02:12:22.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.534+0000 7fc87c687800 1 --2- 172.21.15.134:0/3531573152 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5568f8e471b0 0x5568f8e4e7f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.534+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 >> 172.21.15.134:0/3531573152 conn(0x5568f8e43510 msgr2=0x5568f8e40b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:22.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.534+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 shutdown_connections 2024-04-24T02:12:22.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.534+0000 7fc87c687800 1 -- 172.21.15.134:0/3531573152 wait complete. 2024-04-24T02:12:22.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.534+0000 7fc87c687800 1 -- 172.21.15.134:0/2178198895 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc754036950 msgr2=0x7fc754038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.534+0000 7fc87c687800 1 --2- 172.21.15.134:0/2178198895 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc754036950 0x7fc754038e10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x5568f8e2a740 tx=0x7fc874005840 comp rx=0 tx=0).stop 2024-04-24T02:12:22.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.534+0000 7fc87c687800 1 -- 172.21.15.134:0/2178198895 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5568f8e39e70 msgr2=0x5568f8e3a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.534+0000 7fc87c687800 1 --2- 172.21.15.134:0/2178198895 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5568f8e39e70 0x5568f8e3a290 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc86400e610 tx=0x7fc86400ff90 comp rx=0 tx=0).stop 2024-04-24T02:12:22.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.534+0000 7fc87c687800 1 -- 172.21.15.134:0/2178198895 shutdown_connections 2024-04-24T02:12:22.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.534+0000 7fc87c687800 1 --2- 172.21.15.134:0/2178198895 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc754036950 0x7fc754038e10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.534+0000 7fc87c687800 1 --2- 172.21.15.134:0/2178198895 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5568f8e39e70 0x5568f8e3a290 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.534+0000 7fc87c687800 1 -- 172.21.15.134:0/2178198895 >> 172.21.15.134:0/2178198895 conn(0x5568f8e2df10 msgr2=0x5568f8e2e310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:22.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.534+0000 7fc87c687800 1 -- 172.21.15.134:0/2178198895 shutdown_connections 2024-04-24T02:12:22.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.534+0000 7fc87c687800 1 -- 172.21.15.134:0/2178198895 wait complete. 2024-04-24T02:12:22.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.535+0000 7fc87c687800 1 -- 172.21.15.134:0/1661895247 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5568f8d2a2c0 msgr2=0x5568f8e28d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.535+0000 7fc87c687800 1 --2- 172.21.15.134:0/1661895247 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5568f8d2a2c0 0x5568f8e28d00 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.535+0000 7fc87c687800 1 -- 172.21.15.134:0/1661895247 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc760036900 msgr2=0x7fc760038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.535+0000 7fc87c687800 1 --2- 172.21.15.134:0/1661895247 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc760036900 0x7fc760038dc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc864000c00 tx=0x7fc8640013b0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.535+0000 7fc87c687800 1 -- 172.21.15.134:0/1661895247 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5568f8d27990 msgr2=0x5568f8e21ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.535+0000 7fc87c687800 1 --2- 172.21.15.134:0/1661895247 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5568f8d27990 0x5568f8e21ac0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc86c0057e0 tx=0x7fc86c002fb0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.535+0000 7fc87c687800 1 -- 172.21.15.134:0/1661895247 shutdown_connections 2024-04-24T02:12:22.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.535+0000 7fc87c687800 1 --2- 172.21.15.134:0/1661895247 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5568f8d2a2c0 0x5568f8e28d00 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.535+0000 7fc87c687800 1 --2- 172.21.15.134:0/1661895247 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc760036900 0x7fc760038dc0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.535+0000 7fc87c687800 1 --2- 172.21.15.134:0/1661895247 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5568f8d27990 0x5568f8e21ac0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.535+0000 7fc87c687800 1 -- 172.21.15.134:0/1661895247 >> 172.21.15.134:0/1661895247 conn(0x5568f8d21320 msgr2=0x5568f8e13350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:22.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.535+0000 7fc87c687800 1 -- 172.21.15.134:0/1661895247 shutdown_connections 2024-04-24T02:12:22.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.535+0000 7fc87c687800 1 -- 172.21.15.134:0/1661895247 wait complete. 2024-04-24T02:12:22.571 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T02:12:21.778798Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:12:21.778786Z', 'tags': [], 'group_ids': []} 2024-04-24T02:12:22.571 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-24T02:12:22.572 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-24T02:12:22.574 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-24T02:12:22.648 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:22.648 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:22.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.647+0000 7f65e6d2f800 1 Processor -- start 2024-04-24T02:12:22.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.647+0000 7f65e6d2f800 1 -- start start 2024-04-24T02:12:22.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.647+0000 7f65e6d2f800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x555802ae2d60 0x555802ae3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.647+0000 7f65e6d2f800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5558029a2d40 con 0x555802ae3fc0 2024-04-24T02:12:22.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.647+0000 7f65e6d2f800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x5558029754d0 con 0x555802ae2d60 2024-04-24T02:12:22.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.648+0000 7f65e2af2640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x555802ae2d60 0x555802ae3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.648+0000 7f65e22f1640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x555802ae3fc0 0x555802ae4440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:43252/0 (socket says 172.21.15.134:43252) 2024-04-24T02:12:22.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.648+0000 7f65e2af2640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x555802ae2d60 0x555802ae3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45854/0 (socket says 172.21.15.134:45854) 2024-04-24T02:12:22.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.648+0000 7f65e22f1640 1 -- 172.21.15.134:0/516991701 learned_addr learned my addr 172.21.15.134:0/516991701 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:12:22.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.648+0000 7f65e2af2640 1 -- 172.21.15.134:0/516991701 >> v1:172.21.15.104:6789/0 conn(0x555802ae3fc0 legacy=0x555802ae4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.648+0000 7f65e2af2640 1 -- 172.21.15.134:0/516991701 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558029a1590 con 0x555802ae2d60 2024-04-24T02:12:22.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.650+0000 7f65e2af2640 1 --2- 172.21.15.134:0/516991701 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555802ae2d60 0x555802ae3180 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f65dc00a470 tx=0x7f65dc01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a74b883402ab86e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.650+0000 7f65e1af0640 1 -- 172.21.15.134:0/516991701 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65dc057070 con 0x555802ae2d60 2024-04-24T02:12:22.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.650+0000 7f65e1af0640 1 -- 172.21.15.134:0/516991701 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65dc052570 con 0x555802ae2d60 2024-04-24T02:12:22.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.650+0000 7f65e1af0640 1 -- 172.21.15.134:0/516991701 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65dc052870 con 0x555802ae2d60 2024-04-24T02:12:22.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.650+0000 7f65e6d2f800 1 -- 172.21.15.134:0/516991701 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555802ae2d60 msgr2=0x555802ae3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.650+0000 7f65e6d2f800 1 --2- 172.21.15.134:0/516991701 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555802ae2d60 0x555802ae3180 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f65dc00a470 tx=0x7f65dc01ce90 comp rx=0 tx=0).stop 2024-04-24T02:12:22.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.650+0000 7f65e6d2f800 1 -- 172.21.15.134:0/516991701 shutdown_connections 2024-04-24T02:12:22.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.650+0000 7f65e6d2f800 1 --2- 172.21.15.134:0/516991701 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555802ae2d60 0x555802ae3180 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.650+0000 7f65e6d2f800 1 -- 172.21.15.134:0/516991701 >> 172.21.15.134:0/516991701 conn(0x555802ade300 msgr2=0x555802ae0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:22.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.650+0000 7f65e6d2f800 1 -- 172.21.15.134:0/516991701 shutdown_connections 2024-04-24T02:12:22.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.650+0000 7f65e6d2f800 1 -- 172.21.15.134:0/516991701 wait complete. 2024-04-24T02:12:22.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.662+0000 7f65e6d2f800 1 Processor -- start 2024-04-24T02:12:22.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.662+0000 7f65e6d2f800 1 -- start start 2024-04-24T02:12:22.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.662+0000 7f65e6d2f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555802ae2d60 0x555802bd5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.662+0000 7f65e6d2f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x555802a2f3c0 con 0x555802ae2d60 2024-04-24T02:12:22.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.662+0000 7f65e2af2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555802ae2d60 0x555802bd5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.662+0000 7f65e2af2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555802ae2d60 0x555802bd5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45868/0 (socket says 172.21.15.134:45868) 2024-04-24T02:12:22.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.662+0000 7f65e2af2640 1 -- 172.21.15.134:0/60637795 learned_addr learned my addr 172.21.15.134:0/60637795 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:22.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.663+0000 7f65e2af2640 1 -- 172.21.15.134:0/60637795 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555802bd5b50 con 0x555802ae2d60 2024-04-24T02:12:22.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.663+0000 7f65e2af2640 1 --2- 172.21.15.134:0/60637795 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555802ae2d60 0x555802bd5580 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f65dc055040 tx=0x7f65dc04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77caa48dd2c9fe2b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.663+0000 7f64d0e09640 1 -- 172.21.15.134:0/60637795 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65dc057070 con 0x555802ae2d60 2024-04-24T02:12:22.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.663+0000 7f64d0e09640 1 -- 172.21.15.134:0/60637795 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65dc063070 con 0x555802ae2d60 2024-04-24T02:12:22.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.663+0000 7f64d0e09640 1 -- 172.21.15.134:0/60637795 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65dc052720 con 0x555802ae2d60 2024-04-24T02:12:22.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.664+0000 7f65e6d2f800 1 -- 172.21.15.134:0/60637795 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555802ae2d60 msgr2=0x555802bd5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.664+0000 7f65e6d2f800 1 --2- 172.21.15.134:0/60637795 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555802ae2d60 0x555802bd5580 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f65dc055040 tx=0x7f65dc04c000 comp rx=0 tx=0).stop 2024-04-24T02:12:22.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.664+0000 7f65e6d2f800 1 -- 172.21.15.134:0/60637795 shutdown_connections 2024-04-24T02:12:22.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.664+0000 7f65e6d2f800 1 --2- 172.21.15.134:0/60637795 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555802ae2d60 0x555802bd5580 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.664+0000 7f65e6d2f800 1 -- 172.21.15.134:0/60637795 >> 172.21.15.134:0/60637795 conn(0x555802ade300 msgr2=0x555802bd3950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:22.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.664+0000 7f65e6d2f800 1 -- 172.21.15.134:0/60637795 shutdown_connections 2024-04-24T02:12:22.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.664+0000 7f65e6d2f800 1 -- 172.21.15.134:0/60637795 wait complete. 2024-04-24T02:12:22.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.664+0000 7f65e6d2f800 1 Processor -- start 2024-04-24T02:12:22.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.664+0000 7f65e6d2f800 1 -- start start 2024-04-24T02:12:22.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.664+0000 7f65e6d2f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555802ae2d60 0x555802bdd040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.664+0000 7f65e6d2f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x555802aec430 con 0x555802ae2d60 2024-04-24T02:12:22.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.664+0000 7f65e2af2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555802ae2d60 0x555802bdd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.664+0000 7f65e2af2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555802ae2d60 0x555802bdd040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45878/0 (socket says 172.21.15.134:45878) 2024-04-24T02:12:22.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.664+0000 7f65e2af2640 1 -- 172.21.15.134:0/2350505555 learned_addr learned my addr 172.21.15.134:0/2350505555 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:22.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.665+0000 7f65e2af2640 1 -- 172.21.15.134:0/2350505555 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555802bdd580 con 0x555802ae2d60 2024-04-24T02:12:22.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.665+0000 7f65e2af2640 1 --2- 172.21.15.134:0/2350505555 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555802ae2d60 0x555802bdd040 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f65dc060040 tx=0x7f65dc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.665+0000 7f64cf606640 1 -- 172.21.15.134:0/2350505555 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65dc052c70 con 0x555802ae2d60 2024-04-24T02:12:22.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.665+0000 7f64cf606640 1 -- 172.21.15.134:0/2350505555 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65dc06c070 con 0x555802ae2d60 2024-04-24T02:12:22.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.665+0000 7f65e6d2f800 1 -- 172.21.15.134:0/2350505555 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555802bdd810 con 0x555802ae2d60 2024-04-24T02:12:22.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.665+0000 7f64cf606640 1 -- 172.21.15.134:0/2350505555 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65dc05e480 con 0x555802ae2d60 2024-04-24T02:12:22.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.665+0000 7f65e6d2f800 1 -- 172.21.15.134:0/2350505555 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555802be04c0 con 0x555802ae2d60 2024-04-24T02:12:22.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.666+0000 7f64cf606640 1 -- 172.21.15.134:0/2350505555 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f65dc05e620 con 0x555802ae2d60 2024-04-24T02:12:22.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.666+0000 7f64cf606640 1 --2- 172.21.15.134:0/2350505555 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f64c8036950 0x7f64c8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.666+0000 7f64cf606640 1 -- 172.21.15.134:0/2350505555 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f65dc08e530 con 0x555802ae2d60 2024-04-24T02:12:22.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.666+0000 7f65e22f1640 1 --2- 172.21.15.134:0/2350505555 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f64c8036950 0x7f64c8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.666+0000 7f65e6d2f800 1 --2- 172.21.15.134:0/2350505555 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x555802ae3fc0 0x555802be4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.666+0000 7f65e6d2f800 1 -- 172.21.15.134:0/2350505555 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555802be47c0 con 0x555802ae3fc0 2024-04-24T02:12:22.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.666+0000 7f65e32f3640 1 --2- 172.21.15.134:0/2350505555 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x555802ae3fc0 0x555802be4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.666+0000 7f65e22f1640 1 --2- 172.21.15.134:0/2350505555 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f64c8036950 0x7f64c8038e10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f65d8000f60 tx=0x7f65d80012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.667+0000 7f65e32f3640 1 --2- 172.21.15.134:0/2350505555 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x555802ae3fc0 0x555802be4280 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.667+0000 7f65e32f3640 1 -- 172.21.15.134:0/2350505555 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65d400a4a0 con 0x555802ae3fc0 2024-04-24T02:12:22.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.667+0000 7f65e6d2f800 1 -- 172.21.15.134:0/2350505555 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555802be1850 con 0x555802ae3fc0 2024-04-24T02:12:22.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.667+0000 7f65e32f3640 1 -- 172.21.15.134:0/2350505555 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f65d400a4a0 con 0x555802ae3fc0 2024-04-24T02:12:22.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.667+0000 7f65e6d2f800 1 -- 172.21.15.134:0/2350505555 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555802be6600 con 0x555802ae3fc0 2024-04-24T02:12:22.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.667+0000 7f65e32f3640 1 -- 172.21.15.134:0/2350505555 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f65d400a4a0 con 0x555802ae3fc0 2024-04-24T02:12:22.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.667+0000 7f65e6d2f800 1 -- 172.21.15.134:0/2350505555 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555802be5940 con 0x555802ae3fc0 2024-04-24T02:12:22.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.668+0000 7f65e32f3640 1 -- 172.21.15.134:0/2350505555 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f65d400a4a0 con 0x555802ae3fc0 2024-04-24T02:12:22.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.668+0000 7f65e6d2f800 1 -- 172.21.15.134:0/2350505555 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555802be5d90 con 0x555802ae3fc0 2024-04-24T02:12:22.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.668+0000 7f65e32f3640 1 -- 172.21.15.134:0/2350505555 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f65d400a4a0 con 0x555802ae3fc0 2024-04-24T02:12:22.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.668+0000 7f65e6d2f800 1 Processor -- start 2024-04-24T02:12:22.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.668+0000 7f65e6d2f800 1 -- start start 2024-04-24T02:12:22.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.668+0000 7f65e6d2f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555802bf53d0 0x555802bf57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.668+0000 7f65e6d2f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5558029d56b0 con 0x555802bf53d0 2024-04-24T02:12:22.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.669+0000 7f65e22f1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555802bf53d0 0x555802bf57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.669+0000 7f65e22f1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555802bf53d0 0x555802bf57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45894/0 (socket says 172.21.15.134:45894) 2024-04-24T02:12:22.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.669+0000 7f65e22f1640 1 -- 172.21.15.134:0/800156971 learned_addr learned my addr 172.21.15.134:0/800156971 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:22.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.669+0000 7f65e22f1640 1 -- 172.21.15.134:0/800156971 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555802bf5d30 con 0x555802bf53d0 2024-04-24T02:12:22.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.669+0000 7f65e22f1640 1 --2- 172.21.15.134:0/800156971 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555802bf53d0 0x555802bf57f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f65d8001ed0 tx=0x7f65d800d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.669+0000 7f64cce01640 1 -- 172.21.15.134:0/800156971 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65d801b550 con 0x555802bf53d0 2024-04-24T02:12:22.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.669+0000 7f64cce01640 1 -- 172.21.15.134:0/800156971 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65d801b6f0 con 0x555802bf53d0 2024-04-24T02:12:22.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.669+0000 7f65e6d2f800 1 -- 172.21.15.134:0/800156971 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555802bf67a0 con 0x555802bf53d0 2024-04-24T02:12:22.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.669+0000 7f64cce01640 1 -- 172.21.15.134:0/800156971 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65d801b9d0 con 0x555802bf53d0 2024-04-24T02:12:22.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.669+0000 7f65e6d2f800 1 -- 172.21.15.134:0/800156971 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555802bf6ca0 con 0x555802bf53d0 2024-04-24T02:12:22.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.670+0000 7f64cce01640 1 -- 172.21.15.134:0/800156971 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f65d8023020 con 0x555802bf53d0 2024-04-24T02:12:22.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.670+0000 7f64cce01640 1 --2- 172.21.15.134:0/800156971 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f64bc0369a0 0x7f64bc038e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.670+0000 7f64cce01640 1 -- 172.21.15.134:0/800156971 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f65d8021020 con 0x555802bf53d0 2024-04-24T02:12:22.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.670+0000 7f65e32f3640 1 --2- 172.21.15.134:0/800156971 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f64bc0369a0 0x7f64bc038e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.671+0000 7f65e6d2f800 1 Processor -- start 2024-04-24T02:12:22.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.671+0000 7f65e6d2f800 1 -- start start 2024-04-24T02:12:22.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.671+0000 7f65e32f3640 1 --2- 172.21.15.134:0/800156971 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f64bc0369a0 0x7f64bc038e60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x555802be5460 tx=0x7f65d4005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.671+0000 7f65e6d2f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555802c02710 0x555802c02b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.671+0000 7f65e6d2f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x555802bd5e10 con 0x555802c02710 2024-04-24T02:12:22.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.671+0000 7f65e22f1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555802c02710 0x555802c02b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.671+0000 7f65e22f1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555802c02710 0x555802c02b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45908/0 (socket says 172.21.15.134:45908) 2024-04-24T02:12:22.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.671+0000 7f65e22f1640 1 -- 172.21.15.134:0/741794380 learned_addr learned my addr 172.21.15.134:0/741794380 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:22.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.671+0000 7f65e22f1640 1 -- 172.21.15.134:0/741794380 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555802c03100 con 0x555802c02710 2024-04-24T02:12:22.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.671+0000 7f65e22f1640 1 --2- 172.21.15.134:0/741794380 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555802c02710 0x555802c02b30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f65d804ce10 tx=0x7f65d8024c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=471dc1d248c9cc3f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.672+0000 7f64c67fc640 1 -- 172.21.15.134:0/741794380 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65d8041110 con 0x555802c02710 2024-04-24T02:12:22.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.672+0000 7f64c67fc640 1 -- 172.21.15.134:0/741794380 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65d80258e0 con 0x555802c02710 2024-04-24T02:12:22.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.672+0000 7f64c67fc640 1 -- 172.21.15.134:0/741794380 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65d8025410 con 0x555802c02710 2024-04-24T02:12:22.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.672+0000 7f65e6d2f800 1 -- 172.21.15.134:0/741794380 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555802c02710 msgr2=0x555802c02b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.672+0000 7f65e6d2f800 1 --2- 172.21.15.134:0/741794380 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555802c02710 0x555802c02b30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f65d804ce10 tx=0x7f65d8024c00 comp rx=0 tx=0).stop 2024-04-24T02:12:22.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.672+0000 7f65e6d2f800 1 -- 172.21.15.134:0/741794380 shutdown_connections 2024-04-24T02:12:22.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.672+0000 7f65e6d2f800 1 --2- 172.21.15.134:0/741794380 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555802c02710 0x555802c02b30 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.672+0000 7f65e6d2f800 1 -- 172.21.15.134:0/741794380 >> 172.21.15.134:0/741794380 conn(0x555802bfea70 msgr2=0x555802bfcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:22.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.672+0000 7f65e6d2f800 1 -- 172.21.15.134:0/741794380 shutdown_connections 2024-04-24T02:12:22.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.672+0000 7f65e6d2f800 1 -- 172.21.15.134:0/741794380 wait complete. 2024-04-24T02:12:22.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.672+0000 7f65e6d2f800 1 Processor -- start 2024-04-24T02:12:22.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.672+0000 7f65e6d2f800 1 -- start start 2024-04-24T02:12:22.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.672+0000 7f65e6d2f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555802c02710 0x555802c09d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.673+0000 7f65e6d2f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x555802c03870 con 0x555802c02710 2024-04-24T02:12:22.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.673+0000 7f65e22f1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555802c02710 0x555802c09d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.673+0000 7f65e22f1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555802c02710 0x555802c09d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45912/0 (socket says 172.21.15.134:45912) 2024-04-24T02:12:22.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.673+0000 7f65e22f1640 1 -- 172.21.15.134:0/4275971240 learned_addr learned my addr 172.21.15.134:0/4275971240 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:22.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.673+0000 7f65e22f1640 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555802c0a2c0 con 0x555802c02710 2024-04-24T02:12:22.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.673+0000 7f65e22f1640 1 --2- 172.21.15.134:0/4275971240 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555802c02710 0x555802c09d80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f65d804bd30 tx=0x7f65d804cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.673+0000 7f64c4ff9640 1 -- 172.21.15.134:0/4275971240 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65d800cc60 con 0x555802c02710 2024-04-24T02:12:22.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.673+0000 7f64c4ff9640 1 -- 172.21.15.134:0/4275971240 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65d800ce00 con 0x555802c02710 2024-04-24T02:12:22.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.673+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555802c0a550 con 0x555802c02710 2024-04-24T02:12:22.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.673+0000 7f64c4ff9640 1 -- 172.21.15.134:0/4275971240 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65d8046070 con 0x555802c02710 2024-04-24T02:12:22.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.673+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555802c0a550 con 0x555802c02710 2024-04-24T02:12:22.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.674+0000 7f64c4ff9640 1 -- 172.21.15.134:0/4275971240 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f65d804ea00 con 0x555802c02710 2024-04-24T02:12:22.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.674+0000 7f64c4ff9640 1 --2- 172.21.15.134:0/4275971240 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f64ac036950 0x7f64ac038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.674+0000 7f64c4ff9640 1 -- 172.21.15.134:0/4275971240 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f65d803f8b0 con 0x555802c02710 2024-04-24T02:12:22.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.674+0000 7f65e32f3640 1 --2- 172.21.15.134:0/4275971240 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f64ac036950 0x7f64ac038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.674+0000 7f65e6d2f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.674+0000 7f65e6d2f800 1 --2- 172.21.15.134:0/4275971240 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x555802c15650 0x555802c17b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.674+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555802c18210 con 0x555802c15650 2024-04-24T02:12:22.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.675+0000 7f65e2af2640 1 --2- 172.21.15.134:0/4275971240 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x555802c15650 0x555802c17b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.675+0000 7f65e32f3640 1 --2- 172.21.15.134:0/4275971240 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f64ac036950 0x7f64ac038e10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x555802be17a0 tx=0x7f65d401f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.675+0000 7f65e2af2640 1 --2- 172.21.15.134:0/4275971240 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x555802c15650 0x555802c17b10 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.675+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65dc009d10 con 0x555802c15650 2024-04-24T02:12:22.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.675+0000 7f65e6d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:22.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.675+0000 7f65e6d2f800 20 realm 2024-04-24T02:12:22.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.675+0000 7f65e6d2f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.675+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555802c18620 con 0x555802c15650 2024-04-24T02:12:22.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.675+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65dc009d10 con 0x555802c15650 2024-04-24T02:12:22.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.675+0000 7f65e6d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:22.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.675+0000 7f65e6d2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:22.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.675+0000 7f65e6d2f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.675+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555802c18ef0 con 0x555802c15650 2024-04-24T02:12:22.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.676+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65dc009d10 con 0x555802c15650 2024-04-24T02:12:22.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.676+0000 7f65e6d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:22.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.676+0000 7f65e6d2f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.676+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555802c19290 con 0x555802c15650 2024-04-24T02:12:22.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.676+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f65dc009d10 con 0x555802c15650 2024-04-24T02:12:22.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.676+0000 7f65e6d2f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:22.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.676+0000 7f65e6d2f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.676+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555802c19730 con 0x555802c15650 2024-04-24T02:12:22.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.676+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f65dc009d10 con 0x555802c15650 2024-04-24T02:12:22.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.676+0000 7f65e6d2f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:22.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.676+0000 7f65e6d2f800 20 searching for the correct realm 2024-04-24T02:12:22.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.676+0000 7f65e6d2f800 1 --2- 172.21.15.134:0/4275971240 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x555802c1b730 0x555802c1db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.676+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555802c1e1f0 con 0x555802c1b730 2024-04-24T02:12:22.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.676+0000 7f65e22f1640 1 --2- 172.21.15.134:0/4275971240 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x555802c1b730 0x555802c1db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.676+0000 7f65e22f1640 1 --2- 172.21.15.134:0/4275971240 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x555802c1b730 0x555802c1db20 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.677+0000 7f65e22f1640 1 -- 172.21.15.134:0/4275971240 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65d8009050 con 0x555802c1b730 2024-04-24T02:12:22.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.677+0000 7f65e22f1640 1 --2- 172.21.15.134:0/4275971240 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f65d803f0d0 0x7f65d800c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.677+0000 7f65e22f1640 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555802c1e1f0 con 0x7f65d803f0d0 2024-04-24T02:12:22.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.677+0000 7f65e32f3640 1 --2- 172.21.15.134:0/4275971240 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f65d803f0d0 0x7f65d800c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.677+0000 7f65e32f3640 1 --2- 172.21.15.134:0/4275971240 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f65d803f0d0 0x7f65d800c6a0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.678+0000 7f65e32f3640 1 -- 172.21.15.134:0/4275971240 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65d401f070 con 0x7f65d803f0d0 2024-04-24T02:12:22.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.678+0000 7f65e32f3640 1 --2- 172.21.15.134:0/4275971240 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f65d4031040 0x7f65d4032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.678+0000 7f65e32f3640 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555802c1e1f0 con 0x7f65d4031040 2024-04-24T02:12:22.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.678+0000 7f65e2af2640 1 --2- 172.21.15.134:0/4275971240 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f65d4031040 0x7f65d4032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.678+0000 7f65e2af2640 1 --2- 172.21.15.134:0/4275971240 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f65d4031040 0x7f65d4032940 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.678+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65dc009d10 con 0x7f65d4031040 2024-04-24T02:12:22.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.678+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555802c1e1f0 con 0x555802c15650 2024-04-24T02:12:22.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.679+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65dc009d10 con 0x555802c15650 2024-04-24T02:12:22.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.679+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555802c1e1f0 con 0x555802c15650 2024-04-24T02:12:22.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.679+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f65dc009d10 con 0x555802c15650 2024-04-24T02:12:22.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.679+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555802c1e1f0 con 0x7f65d4031040 2024-04-24T02:12:22.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.679+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65dc009d10 con 0x7f65d4031040 2024-04-24T02:12:22.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.679+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555802c1e1f0 con 0x7f65d4031040 2024-04-24T02:12:22.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.679+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65dc009d10 con 0x7f65d4031040 2024-04-24T02:12:22.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.679+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555802c1e1f0 con 0x7f65d803f0d0 2024-04-24T02:12:22.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.680+0000 7f65e32f3640 1 -- 172.21.15.134:0/4275971240 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65d401f070 con 0x7f65d803f0d0 2024-04-24T02:12:22.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.680+0000 7f65e32f3640 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555802c1e1f0 con 0x555802c1b730 2024-04-24T02:12:22.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.680+0000 7f65e22f1640 1 -- 172.21.15.134:0/4275971240 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65d8009050 con 0x555802c1b730 2024-04-24T02:12:22.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.680+0000 7f65e22f1640 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555802c1e1f0 con 0x555802c15650 2024-04-24T02:12:22.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.680+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65dc009d10 con 0x555802c15650 2024-04-24T02:12:22.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.680+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555802c1e1f0 con 0x7f65d4031040 2024-04-24T02:12:22.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.680+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65dc009d10 con 0x7f65d4031040 2024-04-24T02:12:22.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.680+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555802c1e1f0 con 0x555802c15650 2024-04-24T02:12:22.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.681+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65dc009d10 con 0x555802c15650 2024-04-24T02:12:22.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.681+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555802c1e1f0 con 0x7f65d803f0d0 2024-04-24T02:12:22.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.681+0000 7f65e32f3640 1 -- 172.21.15.134:0/4275971240 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f65d401f070 con 0x7f65d803f0d0 2024-04-24T02:12:22.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.681+0000 7f65e32f3640 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555802c1e1f0 con 0x555802c1b730 2024-04-24T02:12:22.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.681+0000 7f65e22f1640 1 -- 172.21.15.134:0/4275971240 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65d8009050 con 0x555802c1b730 2024-04-24T02:12:22.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.681+0000 7f65e22f1640 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555802c1e1f0 con 0x555802c1b730 2024-04-24T02:12:22.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.681+0000 7f65e22f1640 1 -- 172.21.15.134:0/4275971240 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65d8009050 con 0x555802c1b730 2024-04-24T02:12:22.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.681+0000 7f65e22f1640 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555802c1e1f0 con 0x7f65d4031040 2024-04-24T02:12:22.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.681+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65dc009d10 con 0x7f65d4031040 2024-04-24T02:12:22.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.681+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555802c1e1f0 con 0x555802c1b730 2024-04-24T02:12:22.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.682+0000 7f65e22f1640 1 -- 172.21.15.134:0/4275971240 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65d8009050 con 0x555802c1b730 2024-04-24T02:12:22.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.682+0000 7f65e22f1640 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555802c1e1f0 con 0x555802c1b730 2024-04-24T02:12:22.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.682+0000 7f65e22f1640 1 -- 172.21.15.134:0/4275971240 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65d8009050 con 0x555802c1b730 2024-04-24T02:12:22.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.682+0000 7f65e22f1640 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555802c1e1f0 con 0x555802c15650 2024-04-24T02:12:22.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.682+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65dc009d10 con 0x555802c15650 2024-04-24T02:12:22.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.682+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555802c1e1f0 con 0x555802c15650 2024-04-24T02:12:22.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.682+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f65dc009d10 con 0x555802c15650 2024-04-24T02:12:22.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.682+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555802c1e1f0 con 0x7f65d4031040 2024-04-24T02:12:22.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.683+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65dc009d10 con 0x7f65d4031040 2024-04-24T02:12:22.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.683+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555802c1e1f0 con 0x555802c1b730 2024-04-24T02:12:22.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.683+0000 7f65e22f1640 1 -- 172.21.15.134:0/4275971240 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65d8009050 con 0x555802c1b730 2024-04-24T02:12:22.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.683+0000 7f65e22f1640 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555802c1e1f0 con 0x7f65d803f0d0 2024-04-24T02:12:22.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.683+0000 7f65e32f3640 1 -- 172.21.15.134:0/4275971240 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65d401f070 con 0x7f65d803f0d0 2024-04-24T02:12:22.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.683+0000 7f65e32f3640 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555802c1e1f0 con 0x555802c15650 2024-04-24T02:12:22.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.683+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65dc009d10 con 0x555802c15650 2024-04-24T02:12:22.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.683+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555802c1e1f0 con 0x7f65d4031040 2024-04-24T02:12:22.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.684+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65dc009d10 con 0x7f65d4031040 2024-04-24T02:12:22.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.684+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555802c1e1f0 con 0x555802c1b730 2024-04-24T02:12:22.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.684+0000 7f65e22f1640 1 -- 172.21.15.134:0/4275971240 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65d8009050 con 0x555802c1b730 2024-04-24T02:12:22.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.684+0000 7f65e22f1640 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555802c1e1f0 con 0x7f65d4031040 2024-04-24T02:12:22.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.684+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65dc009d10 con 0x7f65d4031040 2024-04-24T02:12:22.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.684+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555802c1e1f0 con 0x7f65d803f0d0 2024-04-24T02:12:22.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.684+0000 7f65e32f3640 1 -- 172.21.15.134:0/4275971240 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65d401f070 con 0x7f65d803f0d0 2024-04-24T02:12:22.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.684+0000 7f65e32f3640 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555802c1e1f0 con 0x555802c1b730 2024-04-24T02:12:22.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.685+0000 7f65e22f1640 1 -- 172.21.15.134:0/4275971240 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65d8009050 con 0x555802c1b730 2024-04-24T02:12:22.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.685+0000 7f65e22f1640 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555802c1e1f0 con 0x7f65d4031040 2024-04-24T02:12:22.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.685+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65dc009d10 con 0x7f65d4031040 2024-04-24T02:12:22.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.685+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555802c1e1f0 con 0x555802c15650 2024-04-24T02:12:22.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.685+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f65dc009d10 con 0x555802c15650 2024-04-24T02:12:22.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.685+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555802c1e1f0 con 0x7f65d803f0d0 2024-04-24T02:12:22.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.685+0000 7f65e32f3640 1 -- 172.21.15.134:0/4275971240 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65d401f070 con 0x7f65d803f0d0 2024-04-24T02:12:22.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.685+0000 7f65e6d2f800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:22.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.685+0000 7f65e6d2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:22.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.685+0000 7f65e6d2f800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:22.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.685+0000 7f65e6d2f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:22.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.685+0000 7f65e6d2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:22.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.685+0000 7f65e6d2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:22.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.686+0000 7f65e6d2f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.686+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555802c1a200 con 0x555802c15650 2024-04-24T02:12:22.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.686+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65dc009d10 con 0x555802c15650 2024-04-24T02:12:22.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.686+0000 7f65e6d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:22.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.686+0000 7f65e6d2f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.686+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555802c1aaa0 con 0x555802c15650 2024-04-24T02:12:22.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.686+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f65dc009d10 con 0x555802c15650 2024-04-24T02:12:22.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.686+0000 7f65e6d2f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:22.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.686+0000 7f65e6d2f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.686+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555802c19e40 con 0x555802c15650 2024-04-24T02:12:22.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.686+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f65dc009d10 con 0x555802c15650 2024-04-24T02:12:22.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.686+0000 7f65e6d2f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:22.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.686+0000 7f65e6d2f800 20 zone default found 2024-04-24T02:12:22.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.686+0000 7f65e6d2f800 4 Realm: () 2024-04-24T02:12:22.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.686+0000 7f65e6d2f800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:22.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.686+0000 7f65e6d2f800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:22.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.686+0000 7f65e6d2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:22.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.686+0000 7f65e6d2f800 20 zonegroup default 2024-04-24T02:12:22.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.686+0000 7f65e6d2f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.686+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555802c1aaa0 con 0x7f65d4031040 2024-04-24T02:12:22.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.687+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f65dc009d10 con 0x7f65d4031040 2024-04-24T02:12:22.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.687+0000 7f65e6d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:22.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.687+0000 7f65e6d2f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.687+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555802c20050 con 0x555802c1b730 2024-04-24T02:12:22.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.687+0000 7f65e22f1640 1 -- 172.21.15.134:0/4275971240 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f65d8009050 con 0x555802c1b730 2024-04-24T02:12:22.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.687+0000 7f65e6d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:22.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.687+0000 7f65e6d2f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.687+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555802c203f0 con 0x555802c1b730 2024-04-24T02:12:22.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.687+0000 7f65e22f1640 1 -- 172.21.15.134:0/4275971240 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f65d8009050 con 0x555802c1b730 2024-04-24T02:12:22.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.687+0000 7f65e6d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:22.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.687+0000 7f65e6d2f800 20 started sync module instance, tier type = 2024-04-24T02:12:22.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.687+0000 7f65e6d2f800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:22.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.687+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555802c1f4f0 con 0x7f65d803f0d0 2024-04-24T02:12:22.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.688+0000 7f65e32f3640 1 -- 172.21.15.134:0/4275971240 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65d4040040 con 0x7f65d803f0d0 2024-04-24T02:12:22.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.688+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93836491749648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555802c20c90 con 0x7f65d803f0d0 2024-04-24T02:12:22.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.688+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555802c214e0 con 0x555802c15650 2024-04-24T02:12:22.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.689+0000 7f65e32f3640 1 -- 172.21.15.134:0/4275971240 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93836491749648] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65d4040040 con 0x7f65d803f0d0 2024-04-24T02:12:22.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.690+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65dc009d10 con 0x555802c15650 2024-04-24T02:12:22.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.690+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93836491753440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555802c211d0 con 0x555802c15650 2024-04-24T02:12:22.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.690+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555802c21cd0 con 0x555802c1b730 2024-04-24T02:12:22.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.690+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93836491753440] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65dc009d10 con 0x555802c15650 2024-04-24T02:12:22.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.691+0000 7f65e22f1640 1 -- 172.21.15.134:0/4275971240 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65d8009050 con 0x555802c1b730 2024-04-24T02:12:22.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.691+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93836491757504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555802c22070 con 0x555802c1b730 2024-04-24T02:12:22.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.691+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555802c22ab0 con 0x7f65d803f0d0 2024-04-24T02:12:22.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.692+0000 7f65e22f1640 1 -- 172.21.15.134:0/4275971240 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93836491757504] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65d8009050 con 0x555802c1b730 2024-04-24T02:12:22.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.692+0000 7f65e32f3640 1 -- 172.21.15.134:0/4275971240 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65d4040040 con 0x7f65d803f0d0 2024-04-24T02:12:22.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.692+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93836491761024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555802c22ea0 con 0x7f65d803f0d0 2024-04-24T02:12:22.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.692+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555802c238e0 con 0x555802c15650 2024-04-24T02:12:22.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.693+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65dc009d10 con 0x555802c15650 2024-04-24T02:12:22.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.693+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93836491764656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555802c238a0 con 0x555802c15650 2024-04-24T02:12:22.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.693+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555802c248a0 con 0x7f65d4031040 2024-04-24T02:12:22.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.693+0000 7f65e32f3640 1 -- 172.21.15.134:0/4275971240 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93836491761024] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65d4040040 con 0x7f65d803f0d0 2024-04-24T02:12:22.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.694+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65dc009d10 con 0x7f65d4031040 2024-04-24T02:12:22.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.694+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93836491768784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555802c248a0 con 0x7f65d4031040 2024-04-24T02:12:22.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.694+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555802c252b0 con 0x7f65d4031040 2024-04-24T02:12:22.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.694+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93836491764656] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65dc009d10 con 0x555802c15650 2024-04-24T02:12:22.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.695+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(56 notify.6 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65dc009d10 con 0x7f65d4031040 2024-04-24T02:12:22.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.695+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93836491766880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555802c252b0 con 0x7f65d4031040 2024-04-24T02:12:22.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.695+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555802c25c70 con 0x7f65d4031040 2024-04-24T02:12:22.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.695+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93836491768784] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65dc009d10 con 0x7f65d4031040 2024-04-24T02:12:22.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.695+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(58 notify.7 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65dc009d10 con 0x7f65d4031040 2024-04-24T02:12:22.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.695+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93836491754560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555802c25c70 con 0x7f65d4031040 2024-04-24T02:12:22.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.695+0000 7f65e6d2f800 20 add_watcher() i=0 2024-04-24T02:12:22.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.696+0000 7f65e6d2f800 20 add_watcher() i=1 2024-04-24T02:12:22.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.696+0000 7f65e6d2f800 20 add_watcher() i=2 2024-04-24T02:12:22.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.696+0000 7f65e6d2f800 20 add_watcher() i=3 2024-04-24T02:12:22.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.696+0000 7f65e6d2f800 20 add_watcher() i=4 2024-04-24T02:12:22.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.696+0000 7f65e6d2f800 20 add_watcher() i=5 2024-04-24T02:12:22.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.696+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93836491766880] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65dc009d10 con 0x7f65d4031040 2024-04-24T02:12:22.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.696+0000 7f65e6d2f800 20 add_watcher() i=6 2024-04-24T02:12:22.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.696+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93836491754560] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65dc009d10 con 0x7f65d4031040 2024-04-24T02:12:22.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.696+0000 7f65e6d2f800 20 add_watcher() i=7 2024-04-24T02:12:22.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.696+0000 7f65e6d2f800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:22.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.696+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555802c25c70 con 0x555802c15650 2024-04-24T02:12:22.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.697+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f65dc009d10 con 0x555802c15650 2024-04-24T02:12:22.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.697+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93836491773888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555802c26090 con 0x555802c15650 2024-04-24T02:12:22.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.698+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93836491773888] v30'68 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f65dc009d10 con 0x555802c15650 2024-04-24T02:12:22.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.698+0000 7f64997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:22.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.698+0000 7f65e6d2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:22.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.698+0000 7f65e6d2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:22.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.698+0000 7f65e6d2f800 5 note: GC not initialized 2024-04-24T02:12:22.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.698+0000 7f6413fff640 20 reqs_thread_entry: start 2024-04-24T02:12:22.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.698+0000 7f65e6d2f800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:22.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.698+0000 7f65e6d2f800 20 Filter name: none 2024-04-24T02:12:22.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.698+0000 7f6411ffb640 20 reqs_thread_entry: start 2024-04-24T02:12:22.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.698+0000 7f65e6d2f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.698+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555802c5b990 con 0x555802c15650 2024-04-24T02:12:22.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.699+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f65dc009d10 con 0x555802c15650 2024-04-24T02:12:22.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.699+0000 7f65e6d2f800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T02:12:22.723 INFO:teuthology.orchestra.run.smithi134.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T02:12:21.778798Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T02:12:21.778786Z","tags":[],"group_ids":[]} 2024-04-24T02:12:22.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.700+0000 7f64997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:22.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.700+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93836491773888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555802c5a920 con 0x555802c15650 2024-04-24T02:12:22.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.701+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93836491773888] v30'69 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f65dc009d10 con 0x555802c15650 2024-04-24T02:12:22.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.701+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93836491749648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555802c257c0 con 0x7f65d803f0d0 2024-04-24T02:12:22.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.702+0000 7f65e32f3640 1 -- 172.21.15.134:0/4275971240 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93836491749648] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65d4040040 con 0x7f65d803f0d0 2024-04-24T02:12:22.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.702+0000 7f65e6d2f800 20 remove_watcher() i=0 2024-04-24T02:12:22.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.702+0000 7f65e6d2f800 2 removed watcher, disabling cache 2024-04-24T02:12:22.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.702+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93836491753440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555802c257c0 con 0x555802c15650 2024-04-24T02:12:22.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.703+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93836491753440] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65dc009d10 con 0x555802c15650 2024-04-24T02:12:22.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.703+0000 7f65e6d2f800 20 remove_watcher() i=1 2024-04-24T02:12:22.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.703+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93836491757504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555802c257c0 con 0x555802c1b730 2024-04-24T02:12:22.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.704+0000 7f65e22f1640 1 -- 172.21.15.134:0/4275971240 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93836491757504] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65d8009050 con 0x555802c1b730 2024-04-24T02:12:22.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.704+0000 7f65e6d2f800 20 remove_watcher() i=2 2024-04-24T02:12:22.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.704+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93836491761024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555802c217c0 con 0x7f65d803f0d0 2024-04-24T02:12:22.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.705+0000 7f65e32f3640 1 -- 172.21.15.134:0/4275971240 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93836491761024] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65d4040040 con 0x7f65d803f0d0 2024-04-24T02:12:22.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.705+0000 7f65e6d2f800 20 remove_watcher() i=3 2024-04-24T02:12:22.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.705+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93836491764656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555802c217c0 con 0x555802c15650 2024-04-24T02:12:22.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.706+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93836491764656] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65dc009d10 con 0x555802c15650 2024-04-24T02:12:22.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.706+0000 7f65e6d2f800 20 remove_watcher() i=4 2024-04-24T02:12:22.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.706+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93836491768784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555802c217c0 con 0x7f65d4031040 2024-04-24T02:12:22.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.707+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93836491768784] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65dc009d10 con 0x7f65d4031040 2024-04-24T02:12:22.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.707+0000 7f65e6d2f800 20 remove_watcher() i=5 2024-04-24T02:12:22.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.707+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93836491766880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555802c243d0 con 0x7f65d4031040 2024-04-24T02:12:22.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.708+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93836491766880] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65dc009d10 con 0x7f65d4031040 2024-04-24T02:12:22.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.708+0000 7f65e6d2f800 20 remove_watcher() i=6 2024-04-24T02:12:22.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.708+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93836491754560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555802c243d0 con 0x7f65d4031040 2024-04-24T02:12:22.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.709+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93836491754560] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65dc009d10 con 0x7f65d4031040 2024-04-24T02:12:22.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.709+0000 7f65e6d2f800 20 remove_watcher() i=7 2024-04-24T02:12:22.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.709+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f65d4031040 msgr2=0x7f65d4032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.709+0000 7f65e6d2f800 1 --2- 172.21.15.134:0/4275971240 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f65d4031040 0x7f65d4032940 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.709+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x555802c15650 msgr2=0x555802c17b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.709+0000 7f65e6d2f800 1 --2- 172.21.15.134:0/4275971240 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x555802c15650 0x555802c17b10 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.709+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f65d803f0d0 msgr2=0x7f65d800c6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.709+0000 7f65e6d2f800 1 --2- 172.21.15.134:0/4275971240 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f65d803f0d0 0x7f65d800c6a0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.709+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x555802c1b730 msgr2=0x555802c1db20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.709+0000 7f65e6d2f800 1 --2- 172.21.15.134:0/4275971240 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x555802c1b730 0x555802c1db20 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.709+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f64ac036950 msgr2=0x7f64ac038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.709+0000 7f65e6d2f800 1 --2- 172.21.15.134:0/4275971240 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f64ac036950 0x7f64ac038e10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x555802be17a0 tx=0x7f65d401f000 comp rx=0 tx=0).stop 2024-04-24T02:12:22.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.709+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555802c02710 msgr2=0x555802c09d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.709+0000 7f65e6d2f800 1 --2- 172.21.15.134:0/4275971240 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555802c02710 0x555802c09d80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f65d804bd30 tx=0x7f65d804cda0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.709+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 reap_dead start 2024-04-24T02:12:22.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.709+0000 7f65e2af2640 1 -- 172.21.15.134:0/4275971240 reap_dead start 2024-04-24T02:12:22.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.709+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 shutdown_connections 2024-04-24T02:12:22.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.709+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 >> 172.21.15.134:0/4275971240 conn(0x555802bfea70 msgr2=0x555802bfc0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:22.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.709+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 shutdown_connections 2024-04-24T02:12:22.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.709+0000 7f65e6d2f800 1 -- 172.21.15.134:0/4275971240 wait complete. 2024-04-24T02:12:22.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.709+0000 7f65e6d2f800 1 -- 172.21.15.134:0/800156971 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f64bc0369a0 msgr2=0x7f64bc038e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.709+0000 7f65e6d2f800 1 --2- 172.21.15.134:0/800156971 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f64bc0369a0 0x7f64bc038e60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x555802be5460 tx=0x7f65d4005840 comp rx=0 tx=0).stop 2024-04-24T02:12:22.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.709+0000 7f65e6d2f800 1 -- 172.21.15.134:0/800156971 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555802bf53d0 msgr2=0x555802bf57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.709+0000 7f65e6d2f800 1 --2- 172.21.15.134:0/800156971 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555802bf53d0 0x555802bf57f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f65d8001ed0 tx=0x7f65d800d7a0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.710+0000 7f65e6d2f800 1 -- 172.21.15.134:0/800156971 shutdown_connections 2024-04-24T02:12:22.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.710+0000 7f65e6d2f800 1 --2- 172.21.15.134:0/800156971 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f64bc0369a0 0x7f64bc038e60 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.710+0000 7f65e6d2f800 1 --2- 172.21.15.134:0/800156971 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555802bf53d0 0x555802bf57f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.710+0000 7f65e6d2f800 1 -- 172.21.15.134:0/800156971 >> 172.21.15.134:0/800156971 conn(0x555802be9470 msgr2=0x555802be9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:22.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.710+0000 7f65e6d2f800 1 -- 172.21.15.134:0/800156971 shutdown_connections 2024-04-24T02:12:22.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.710+0000 7f65e6d2f800 1 -- 172.21.15.134:0/800156971 wait complete. 2024-04-24T02:12:22.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.710+0000 7f65e6d2f800 1 -- 172.21.15.134:0/2350505555 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x555802ae3fc0 msgr2=0x555802be4280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.710+0000 7f65e6d2f800 1 --2- 172.21.15.134:0/2350505555 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x555802ae3fc0 0x555802be4280 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.710+0000 7f65e6d2f800 1 -- 172.21.15.134:0/2350505555 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f64c8036950 msgr2=0x7f64c8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.710+0000 7f65e6d2f800 1 --2- 172.21.15.134:0/2350505555 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f64c8036950 0x7f64c8038e10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f65d8000f60 tx=0x7f65d80012b0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.710+0000 7f65e6d2f800 1 -- 172.21.15.134:0/2350505555 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555802ae2d60 msgr2=0x555802bdd040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.710+0000 7f65e6d2f800 1 --2- 172.21.15.134:0/2350505555 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555802ae2d60 0x555802bdd040 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f65dc060040 tx=0x7f65dc002fb0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.710+0000 7f65e6d2f800 1 -- 172.21.15.134:0/2350505555 shutdown_connections 2024-04-24T02:12:22.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.710+0000 7f65e6d2f800 1 --2- 172.21.15.134:0/2350505555 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x555802ae3fc0 0x555802be4280 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.710+0000 7f65e6d2f800 1 --2- 172.21.15.134:0/2350505555 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f64c8036950 0x7f64c8038e10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.710+0000 7f65e6d2f800 1 --2- 172.21.15.134:0/2350505555 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555802ae2d60 0x555802bdd040 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.710+0000 7f65e6d2f800 1 -- 172.21.15.134:0/2350505555 >> 172.21.15.134:0/2350505555 conn(0x555802ade300 msgr2=0x555802bcee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:22.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.710+0000 7f65e6d2f800 1 -- 172.21.15.134:0/2350505555 shutdown_connections 2024-04-24T02:12:22.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.710+0000 7f65e6d2f800 1 -- 172.21.15.134:0/2350505555 wait complete. 2024-04-24T02:12:22.735 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T02:12:21.778798Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:12:21.778786Z', 'tags': [], 'group_ids': []} 2024-04-24T02:12:22.735 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-04-24T02:12:22.735 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-04-24T02:12:22.735 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-04-24T02:12:22.816 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:22.816 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:22.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.815+0000 7f2ee6616800 1 Processor -- start 2024-04-24T02:12:22.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.815+0000 7f2ee6616800 1 -- start start 2024-04-24T02:12:22.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.816+0000 7f2ee6616800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55b777fefd40 0x55b777ff0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.816+0000 7f2ee6616800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b777eafd40 con 0x55b777ff0fa0 2024-04-24T02:12:22.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.816+0000 7f2ee6616800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55b777e824d0 con 0x55b777fefd40 2024-04-24T02:12:22.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.816+0000 7f2ee1d5c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55b777fefd40 0x55b777ff0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.816+0000 7f2edbfff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55b777ff0fa0 0x55b777ff1420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:43262/0 (socket says 172.21.15.134:43262) 2024-04-24T02:12:22.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.816+0000 7f2ee1d5c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55b777fefd40 0x55b777ff0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45914/0 (socket says 172.21.15.134:45914) 2024-04-24T02:12:22.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.816+0000 7f2edbfff640 1 -- 172.21.15.134:0/3061643812 learned_addr learned my addr 172.21.15.134:0/3061643812 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:12:22.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.816+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/3061643812 >> v1:172.21.15.104:6789/0 conn(0x55b777ff0fa0 legacy=0x55b777ff1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.816+0000 7f2ee155b640 1 -- 172.21.15.134:0/3061643812 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2799355433 0 0) 0x55b777eafd40 con 0x55b777ff0fa0 2024-04-24T02:12:22.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.816+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/3061643812 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b777eae590 con 0x55b777fefd40 2024-04-24T02:12:22.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.818+0000 7f2ee1d5c640 1 --2- 172.21.15.134:0/3061643812 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b777fefd40 0x55b777ff0160 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2ed400a470 tx=0x7f2ed401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81f03fec802ad0b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.818+0000 7f2ee155b640 1 -- 172.21.15.134:0/3061643812 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ed4057070 con 0x55b777fefd40 2024-04-24T02:12:22.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.818+0000 7f2ee155b640 1 -- 172.21.15.134:0/3061643812 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ed4052570 con 0x55b777fefd40 2024-04-24T02:12:22.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.818+0000 7f2ee155b640 1 -- 172.21.15.134:0/3061643812 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ed4052870 con 0x55b777fefd40 2024-04-24T02:12:22.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.819+0000 7f2ee6616800 1 -- 172.21.15.134:0/3061643812 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b777fefd40 msgr2=0x55b777ff0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.819+0000 7f2ee6616800 1 --2- 172.21.15.134:0/3061643812 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b777fefd40 0x55b777ff0160 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2ed400a470 tx=0x7f2ed401ce90 comp rx=0 tx=0).stop 2024-04-24T02:12:22.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.819+0000 7f2ee6616800 1 -- 172.21.15.134:0/3061643812 shutdown_connections 2024-04-24T02:12:22.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.819+0000 7f2ee6616800 1 --2- 172.21.15.134:0/3061643812 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b777fefd40 0x55b777ff0160 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.819+0000 7f2ee6616800 1 -- 172.21.15.134:0/3061643812 >> 172.21.15.134:0/3061643812 conn(0x55b777feb3a0 msgr2=0x55b777fed7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:22.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.819+0000 7f2ee6616800 1 -- 172.21.15.134:0/3061643812 shutdown_connections 2024-04-24T02:12:22.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.819+0000 7f2ee6616800 1 -- 172.21.15.134:0/3061643812 wait complete. 2024-04-24T02:12:22.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.830+0000 7f2ee6616800 1 Processor -- start 2024-04-24T02:12:22.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.831+0000 7f2ee6616800 1 -- start start 2024-04-24T02:12:22.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.831+0000 7f2ee6616800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b777fefd40 0x55b777f64010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.831+0000 7f2ee6616800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b777f3c3e0 con 0x55b777fefd40 2024-04-24T02:12:22.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.831+0000 7f2ee1d5c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b777fefd40 0x55b777f64010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.831+0000 7f2ee1d5c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b777fefd40 0x55b777f64010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45926/0 (socket says 172.21.15.134:45926) 2024-04-24T02:12:22.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.831+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/3604787330 learned_addr learned my addr 172.21.15.134:0/3604787330 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:22.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.831+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/3604787330 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7780e50c0 con 0x55b777fefd40 2024-04-24T02:12:22.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.832+0000 7f2ee1d5c640 1 --2- 172.21.15.134:0/3604787330 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b777fefd40 0x55b777f64010 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4055040 tx=0x7f2ed404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=884cd0c6b50f581 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.832+0000 7f2dcfe07640 1 -- 172.21.15.134:0/3604787330 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ed4063070 con 0x55b777fefd40 2024-04-24T02:12:22.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.832+0000 7f2dcfe07640 1 -- 172.21.15.134:0/3604787330 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ed4058040 con 0x55b777fefd40 2024-04-24T02:12:22.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.832+0000 7f2dcfe07640 1 -- 172.21.15.134:0/3604787330 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ed4057070 con 0x55b777fefd40 2024-04-24T02:12:22.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.832+0000 7f2ee6616800 1 -- 172.21.15.134:0/3604787330 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b777fefd40 msgr2=0x55b777f64010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.832+0000 7f2ee6616800 1 --2- 172.21.15.134:0/3604787330 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b777fefd40 0x55b777f64010 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4055040 tx=0x7f2ed404c000 comp rx=0 tx=0).stop 2024-04-24T02:12:22.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.832+0000 7f2ee6616800 1 -- 172.21.15.134:0/3604787330 shutdown_connections 2024-04-24T02:12:22.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.832+0000 7f2ee6616800 1 --2- 172.21.15.134:0/3604787330 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b777fefd40 0x55b777f64010 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.832+0000 7f2ee6616800 1 -- 172.21.15.134:0/3604787330 >> 172.21.15.134:0/3604787330 conn(0x55b777feb3a0 msgr2=0x55b7780dcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:22.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.832+0000 7f2ee6616800 1 -- 172.21.15.134:0/3604787330 shutdown_connections 2024-04-24T02:12:22.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.832+0000 7f2ee6616800 1 -- 172.21.15.134:0/3604787330 wait complete. 2024-04-24T02:12:22.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.833+0000 7f2ee6616800 1 Processor -- start 2024-04-24T02:12:22.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.833+0000 7f2ee6616800 1 -- start start 2024-04-24T02:12:22.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.833+0000 7f2ee6616800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b777fefd40 0x55b7780e2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.833+0000 7f2ee6616800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b777ff9440 con 0x55b777fefd40 2024-04-24T02:12:22.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.833+0000 7f2ee1d5c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b777fefd40 0x55b7780e2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.833+0000 7f2ee1d5c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b777fefd40 0x55b7780e2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45940/0 (socket says 172.21.15.134:45940) 2024-04-24T02:12:22.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.833+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/1326210789 learned_addr learned my addr 172.21.15.134:0/1326210789 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:22.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.833+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/1326210789 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7780e1100 con 0x55b777fefd40 2024-04-24T02:12:22.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.833+0000 7f2ee1d5c640 1 --2- 172.21.15.134:0/1326210789 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b777fefd40 0x55b7780e2a10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4061040 tx=0x7f2ed4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.834+0000 7f2dce604640 1 -- 172.21.15.134:0/1326210789 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ed4063030 con 0x55b777fefd40 2024-04-24T02:12:22.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.834+0000 7f2dce604640 1 -- 172.21.15.134:0/1326210789 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ed4052a60 con 0x55b777fefd40 2024-04-24T02:12:22.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.834+0000 7f2ee6616800 1 -- 172.21.15.134:0/1326210789 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b7780e1390 con 0x55b777fefd40 2024-04-24T02:12:22.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.834+0000 7f2dce604640 1 -- 172.21.15.134:0/1326210789 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ed4052d40 con 0x55b777fefd40 2024-04-24T02:12:22.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.834+0000 7f2ee6616800 1 -- 172.21.15.134:0/1326210789 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7780e18b0 con 0x55b777fefd40 2024-04-24T02:12:22.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.834+0000 7f2dce604640 1 -- 172.21.15.134:0/1326210789 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2ed405e480 con 0x55b777fefd40 2024-04-24T02:12:22.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.835+0000 7f2dce604640 1 --2- 172.21.15.134:0/1326210789 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f2dc8036950 0x7f2dc8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.835+0000 7f2dce604640 1 -- 172.21.15.134:0/1326210789 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f2ed4064070 con 0x55b777fefd40 2024-04-24T02:12:22.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.835+0000 7f2edbfff640 1 --2- 172.21.15.134:0/1326210789 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f2dc8036950 0x7f2dc8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.835+0000 7f2ee6616800 1 --2- 172.21.15.134:0/1326210789 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b777ff0fa0 0x55b7780f33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.835+0000 7f2ee6616800 1 -- 172.21.15.134:0/1326210789 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7780f3900 con 0x55b777ff0fa0 2024-04-24T02:12:22.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.835+0000 7f2ee255d640 1 --2- 172.21.15.134:0/1326210789 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b777ff0fa0 0x55b7780f33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.835+0000 7f2edbfff640 1 --2- 172.21.15.134:0/1326210789 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f2dc8036950 0x7f2dc8038e10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc000c00 tx=0x7f2ecc0013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.835+0000 7f2ee255d640 1 --2- 172.21.15.134:0/1326210789 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b777ff0fa0 0x55b7780f33c0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.835+0000 7f2ee255d640 1 -- 172.21.15.134:0/1326210789 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2edc00a4a0 con 0x55b777ff0fa0 2024-04-24T02:12:22.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.835+0000 7f2ee6616800 1 -- 172.21.15.134:0/1326210789 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7780f3cc0 con 0x55b777ff0fa0 2024-04-24T02:12:22.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.836+0000 7f2ee255d640 1 -- 172.21.15.134:0/1326210789 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2edc00a4a0 con 0x55b777ff0fa0 2024-04-24T02:12:22.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.836+0000 7f2ee6616800 1 -- 172.21.15.134:0/1326210789 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7780f55c0 con 0x55b777ff0fa0 2024-04-24T02:12:22.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.836+0000 7f2ee255d640 1 -- 172.21.15.134:0/1326210789 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2edc00a4a0 con 0x55b777ff0fa0 2024-04-24T02:12:22.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.836+0000 7f2ee6616800 1 -- 172.21.15.134:0/1326210789 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7780f4900 con 0x55b777ff0fa0 2024-04-24T02:12:22.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.836+0000 7f2ee255d640 1 -- 172.21.15.134:0/1326210789 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2edc00a4a0 con 0x55b777ff0fa0 2024-04-24T02:12:22.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.836+0000 7f2ee6616800 1 -- 172.21.15.134:0/1326210789 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7780f4d20 con 0x55b777ff0fa0 2024-04-24T02:12:22.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.837+0000 7f2ee255d640 1 -- 172.21.15.134:0/1326210789 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2edc00a4a0 con 0x55b777ff0fa0 2024-04-24T02:12:22.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.837+0000 7f2ee6616800 1 Processor -- start 2024-04-24T02:12:22.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.837+0000 7f2ee6616800 1 -- start start 2024-04-24T02:12:22.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.837+0000 7f2ee6616800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7781043d0 0x55b7781047f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.837+0000 7f2ee6616800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b777ee26b0 con 0x55b7781043d0 2024-04-24T02:12:22.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.837+0000 7f2edbfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7781043d0 0x55b7781047f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.837+0000 7f2edbfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7781043d0 0x55b7781047f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45952/0 (socket says 172.21.15.134:45952) 2024-04-24T02:12:22.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.837+0000 7f2edbfff640 1 -- 172.21.15.134:0/2693069625 learned_addr learned my addr 172.21.15.134:0/2693069625 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:22.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.838+0000 7f2edbfff640 1 -- 172.21.15.134:0/2693069625 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b778104d30 con 0x55b7781043d0 2024-04-24T02:12:22.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.838+0000 7f2edbfff640 1 --2- 172.21.15.134:0/2693069625 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7781043d0 0x55b7781047f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc00e610 tx=0x7f2ecc00ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.838+0000 7f2dc77fe640 1 -- 172.21.15.134:0/2693069625 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ecc022070 con 0x55b7781043d0 2024-04-24T02:12:22.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.838+0000 7f2dc77fe640 1 -- 172.21.15.134:0/2693069625 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ecc009050 con 0x55b7781043d0 2024-04-24T02:12:22.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.838+0000 7f2ee6616800 1 -- 172.21.15.134:0/2693069625 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b7781057a0 con 0x55b7781043d0 2024-04-24T02:12:22.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.838+0000 7f2dc77fe640 1 -- 172.21.15.134:0/2693069625 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ecc00d500 con 0x55b7781043d0 2024-04-24T02:12:22.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.838+0000 7f2ee6616800 1 -- 172.21.15.134:0/2693069625 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b778105ca0 con 0x55b7781043d0 2024-04-24T02:12:22.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.839+0000 7f2dc77fe640 1 -- 172.21.15.134:0/2693069625 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2ecc025070 con 0x55b7781043d0 2024-04-24T02:12:22.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.839+0000 7f2dc77fe640 1 --2- 172.21.15.134:0/2693069625 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f2dbc036950 0x7f2dbc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.839+0000 7f2dc77fe640 1 -- 172.21.15.134:0/2693069625 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f2ecc04d920 con 0x55b7781043d0 2024-04-24T02:12:22.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.839+0000 7f2ee255d640 1 --2- 172.21.15.134:0/2693069625 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f2dbc036950 0x7f2dbc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.839+0000 7f2ee6616800 1 Processor -- start 2024-04-24T02:12:22.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.839+0000 7f2ee6616800 1 -- start start 2024-04-24T02:12:22.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.839+0000 7f2ee255d640 1 --2- 172.21.15.134:0/2693069625 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f2dbc036950 0x7f2dbc038e10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x55b7780f4ca0 tx=0x7f2edc005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.839+0000 7f2ee6616800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b778111710 0x55b778111b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.839+0000 7f2ee6616800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b7780e5350 con 0x55b778111710 2024-04-24T02:12:22.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.840+0000 7f2edbfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b778111710 0x55b778111b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.840+0000 7f2edbfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b778111710 0x55b778111b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45956/0 (socket says 172.21.15.134:45956) 2024-04-24T02:12:22.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.840+0000 7f2edbfff640 1 -- 172.21.15.134:0/1292993799 learned_addr learned my addr 172.21.15.134:0/1292993799 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:22.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.840+0000 7f2edbfff640 1 -- 172.21.15.134:0/1292993799 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b778112100 con 0x55b778111710 2024-04-24T02:12:22.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.840+0000 7f2edbfff640 1 --2- 172.21.15.134:0/1292993799 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b778111710 0x55b778111b30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc026fd0 tx=0x7f2ecc026680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64e99bad363236c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.840+0000 7f2dc57fa640 1 -- 172.21.15.134:0/1292993799 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ecc01ac20 con 0x55b778111710 2024-04-24T02:12:22.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.840+0000 7f2dc57fa640 1 -- 172.21.15.134:0/1292993799 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ecc01adc0 con 0x55b778111710 2024-04-24T02:12:22.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.840+0000 7f2dc57fa640 1 -- 172.21.15.134:0/1292993799 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ecc0254d0 con 0x55b778111710 2024-04-24T02:12:22.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.841+0000 7f2ee6616800 1 -- 172.21.15.134:0/1292993799 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b778111710 msgr2=0x55b778111b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.841+0000 7f2ee6616800 1 --2- 172.21.15.134:0/1292993799 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b778111710 0x55b778111b30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc026fd0 tx=0x7f2ecc026680 comp rx=0 tx=0).stop 2024-04-24T02:12:22.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.841+0000 7f2ee6616800 1 -- 172.21.15.134:0/1292993799 shutdown_connections 2024-04-24T02:12:22.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.841+0000 7f2ee6616800 1 --2- 172.21.15.134:0/1292993799 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b778111710 0x55b778111b30 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.841+0000 7f2ee6616800 1 -- 172.21.15.134:0/1292993799 >> 172.21.15.134:0/1292993799 conn(0x55b77810da70 msgr2=0x55b77810bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:22.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.841+0000 7f2ee6616800 1 -- 172.21.15.134:0/1292993799 shutdown_connections 2024-04-24T02:12:22.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.841+0000 7f2ee6616800 1 -- 172.21.15.134:0/1292993799 wait complete. 2024-04-24T02:12:22.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.841+0000 7f2ee6616800 1 Processor -- start 2024-04-24T02:12:22.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.841+0000 7f2ee6616800 1 -- start start 2024-04-24T02:12:22.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.841+0000 7f2ee6616800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b778111710 0x55b778118d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.841+0000 7f2ee6616800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b778112870 con 0x55b778111710 2024-04-24T02:12:22.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.841+0000 7f2edbfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b778111710 0x55b778118d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.841+0000 7f2edbfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b778111710 0x55b778118d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45964/0 (socket says 172.21.15.134:45964) 2024-04-24T02:12:22.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.841+0000 7f2edbfff640 1 -- 172.21.15.134:0/669045141 learned_addr learned my addr 172.21.15.134:0/669045141 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:22.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.842+0000 7f2edbfff640 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7781192b0 con 0x55b778111710 2024-04-24T02:12:22.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.842+0000 7f2edbfff640 1 --2- 172.21.15.134:0/669045141 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b778111710 0x55b778118d70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc0266c0 tx=0x7f2ecc04be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.842+0000 7f2db37fe640 1 -- 172.21.15.134:0/669045141 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ecc00d8b0 con 0x55b778111710 2024-04-24T02:12:22.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.842+0000 7f2db37fe640 1 -- 172.21.15.134:0/669045141 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ecc00da50 con 0x55b778111710 2024-04-24T02:12:22.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.842+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b778119540 con 0x55b778111710 2024-04-24T02:12:22.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.842+0000 7f2db37fe640 1 -- 172.21.15.134:0/669045141 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ecc04d220 con 0x55b778111710 2024-04-24T02:12:22.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.842+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b77811c1f0 con 0x55b778111710 2024-04-24T02:12:22.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.843+0000 7f2db37fe640 1 -- 172.21.15.134:0/669045141 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2ecc04d3c0 con 0x55b778111710 2024-04-24T02:12:22.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.843+0000 7f2db37fe640 1 --2- 172.21.15.134:0/669045141 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f2dac036950 0x7f2dac038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.843+0000 7f2db37fe640 1 -- 172.21.15.134:0/669045141 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f2ecc036af0 con 0x55b778111710 2024-04-24T02:12:22.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.843+0000 7f2ee255d640 1 --2- 172.21.15.134:0/669045141 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f2dac036950 0x7f2dac038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.843+0000 7f2ee6616800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.844+0000 7f2ee6616800 1 --2- 172.21.15.134:0/669045141 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b778124860 0x55b778126d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.844+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b778127470 con 0x55b778124860 2024-04-24T02:12:22.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.844+0000 7f2ee255d640 1 --2- 172.21.15.134:0/669045141 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f2dac036950 0x7f2dac038e10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x55b7780f4420 tx=0x7f2edc01f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.844+0000 7f2ee1d5c640 1 --2- 172.21.15.134:0/669045141 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b778124860 0x55b778126d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.844+0000 7f2ee1d5c640 1 --2- 172.21.15.134:0/669045141 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b778124860 0x55b778126d20 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.844+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2ed4070020 con 0x55b778124860 2024-04-24T02:12:22.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.844+0000 7f2ee6616800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:22.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.844+0000 7f2ee6616800 20 realm 2024-04-24T02:12:22.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.844+0000 7f2ee6616800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.844+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b778127880 con 0x55b778124860 2024-04-24T02:12:22.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.844+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2ed4070020 con 0x55b778124860 2024-04-24T02:12:22.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.844+0000 7f2ee6616800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:22.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.844+0000 7f2ee6616800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:22.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.844+0000 7f2ee6616800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.844+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b778128150 con 0x55b778124860 2024-04-24T02:12:22.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.845+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2ed4070020 con 0x55b778124860 2024-04-24T02:12:22.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.845+0000 7f2ee6616800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:22.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.845+0000 7f2ee6616800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.845+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7781284f0 con 0x55b778124860 2024-04-24T02:12:22.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.845+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2ed4070020 con 0x55b778124860 2024-04-24T02:12:22.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.845+0000 7f2ee6616800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:22.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.845+0000 7f2ee6616800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.845+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b778128d40 con 0x55b778124860 2024-04-24T02:12:22.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.845+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2ed4070020 con 0x55b778124860 2024-04-24T02:12:22.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.845+0000 7f2ee6616800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:22.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.845+0000 7f2ee6616800 20 searching for the correct realm 2024-04-24T02:12:22.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.845+0000 7f2ee6616800 1 --2- 172.21.15.134:0/669045141 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55b77812aab0 0x55b77812cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.845+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b77812d480 con 0x55b77812aab0 2024-04-24T02:12:22.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.845+0000 7f2edbfff640 1 --2- 172.21.15.134:0/669045141 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55b77812aab0 0x55b77812cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.846+0000 7f2edbfff640 1 --2- 172.21.15.134:0/669045141 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55b77812aab0 0x55b77812cea0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.846+0000 7f2edbfff640 1 -- 172.21.15.134:0/669045141 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ecc024030 con 0x55b77812aab0 2024-04-24T02:12:22.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.846+0000 7f2edbfff640 1 --2- 172.21.15.134:0/669045141 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f2ecc027060 0x7f2ecc027440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.846+0000 7f2edbfff640 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b77812d480 con 0x7f2ecc027060 2024-04-24T02:12:22.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.846+0000 7f2ee255d640 1 --2- 172.21.15.134:0/669045141 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f2ecc027060 0x7f2ecc027440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.846+0000 7f2ee255d640 1 --2- 172.21.15.134:0/669045141 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f2ecc027060 0x7f2ecc027440 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.847+0000 7f2ee255d640 1 -- 172.21.15.134:0/669045141 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2edc01f070 con 0x7f2ecc027060 2024-04-24T02:12:22.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.847+0000 7f2ee255d640 1 --2- 172.21.15.134:0/669045141 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f2edc031040 0x7f2edc032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.847+0000 7f2ee255d640 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b77812d480 con 0x7f2edc031040 2024-04-24T02:12:22.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.847+0000 7f2ee1d5c640 1 --2- 172.21.15.134:0/669045141 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f2edc031040 0x7f2edc032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.847+0000 7f2ee1d5c640 1 --2- 172.21.15.134:0/669045141 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f2edc031040 0x7f2edc032940 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.847+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ed4070020 con 0x7f2edc031040 2024-04-24T02:12:22.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.847+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b77812d480 con 0x55b778124860 2024-04-24T02:12:22.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.848+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ed4070020 con 0x55b778124860 2024-04-24T02:12:22.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.848+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b77812d480 con 0x55b778124860 2024-04-24T02:12:22.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.848+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2ed4070020 con 0x55b778124860 2024-04-24T02:12:22.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.848+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b77812d480 con 0x7f2edc031040 2024-04-24T02:12:22.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.848+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ed4070020 con 0x7f2edc031040 2024-04-24T02:12:22.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.848+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b77812d480 con 0x7f2edc031040 2024-04-24T02:12:22.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.848+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ed4070020 con 0x7f2edc031040 2024-04-24T02:12:22.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.848+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b77812d480 con 0x7f2ecc027060 2024-04-24T02:12:22.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.849+0000 7f2ee255d640 1 -- 172.21.15.134:0/669045141 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2edc01f070 con 0x7f2ecc027060 2024-04-24T02:12:22.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.849+0000 7f2ee255d640 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b77812d480 con 0x55b77812aab0 2024-04-24T02:12:22.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.849+0000 7f2edbfff640 1 -- 172.21.15.134:0/669045141 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ecc024030 con 0x55b77812aab0 2024-04-24T02:12:22.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.849+0000 7f2edbfff640 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b77812d480 con 0x55b778124860 2024-04-24T02:12:22.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.849+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ed4070020 con 0x55b778124860 2024-04-24T02:12:22.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.849+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b77812d480 con 0x7f2edc031040 2024-04-24T02:12:22.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.849+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ed4070020 con 0x7f2edc031040 2024-04-24T02:12:22.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.849+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b77812d480 con 0x55b778124860 2024-04-24T02:12:22.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.850+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ed4070020 con 0x55b778124860 2024-04-24T02:12:22.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.850+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b77812d480 con 0x7f2ecc027060 2024-04-24T02:12:22.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.850+0000 7f2ee255d640 1 -- 172.21.15.134:0/669045141 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2edc01f070 con 0x7f2ecc027060 2024-04-24T02:12:22.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.850+0000 7f2ee255d640 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b77812d480 con 0x55b77812aab0 2024-04-24T02:12:22.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.850+0000 7f2edbfff640 1 -- 172.21.15.134:0/669045141 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ecc024030 con 0x55b77812aab0 2024-04-24T02:12:22.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.850+0000 7f2edbfff640 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b77812d480 con 0x55b77812aab0 2024-04-24T02:12:22.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.850+0000 7f2edbfff640 1 -- 172.21.15.134:0/669045141 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ecc024030 con 0x55b77812aab0 2024-04-24T02:12:22.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.850+0000 7f2edbfff640 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b77812d480 con 0x7f2edc031040 2024-04-24T02:12:22.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.851+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ed4070020 con 0x7f2edc031040 2024-04-24T02:12:22.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.851+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b77812d480 con 0x55b77812aab0 2024-04-24T02:12:22.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.851+0000 7f2edbfff640 1 -- 172.21.15.134:0/669045141 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ecc024030 con 0x55b77812aab0 2024-04-24T02:12:22.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.851+0000 7f2edbfff640 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b77812d480 con 0x55b77812aab0 2024-04-24T02:12:22.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.851+0000 7f2edbfff640 1 -- 172.21.15.134:0/669045141 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ecc024030 con 0x55b77812aab0 2024-04-24T02:12:22.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.851+0000 7f2edbfff640 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b77812d480 con 0x55b778124860 2024-04-24T02:12:22.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.851+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ed4070020 con 0x55b778124860 2024-04-24T02:12:22.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.851+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b77812d480 con 0x55b778124860 2024-04-24T02:12:22.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.852+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f2ed4070020 con 0x55b778124860 2024-04-24T02:12:22.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.852+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b77812d480 con 0x7f2edc031040 2024-04-24T02:12:22.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.852+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ed4070020 con 0x7f2edc031040 2024-04-24T02:12:22.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.852+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b77812d480 con 0x55b77812aab0 2024-04-24T02:12:22.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.852+0000 7f2edbfff640 1 -- 172.21.15.134:0/669045141 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ecc024030 con 0x55b77812aab0 2024-04-24T02:12:22.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.852+0000 7f2edbfff640 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b77812d480 con 0x7f2ecc027060 2024-04-24T02:12:22.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.853+0000 7f2ee255d640 1 -- 172.21.15.134:0/669045141 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2edc01f070 con 0x7f2ecc027060 2024-04-24T02:12:22.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.853+0000 7f2ee255d640 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b77812d480 con 0x55b778124860 2024-04-24T02:12:22.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.853+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ed4070020 con 0x55b778124860 2024-04-24T02:12:22.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.853+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b77812d480 con 0x7f2edc031040 2024-04-24T02:12:22.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.853+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ed4070020 con 0x7f2edc031040 2024-04-24T02:12:22.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.853+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b77812d480 con 0x55b77812aab0 2024-04-24T02:12:22.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.854+0000 7f2edbfff640 1 -- 172.21.15.134:0/669045141 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ecc024030 con 0x55b77812aab0 2024-04-24T02:12:22.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.854+0000 7f2edbfff640 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b77812d480 con 0x7f2edc031040 2024-04-24T02:12:22.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.854+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ed4070020 con 0x7f2edc031040 2024-04-24T02:12:22.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.854+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b77812d480 con 0x7f2ecc027060 2024-04-24T02:12:22.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.854+0000 7f2ee255d640 1 -- 172.21.15.134:0/669045141 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2edc01f070 con 0x7f2ecc027060 2024-04-24T02:12:22.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.854+0000 7f2ee255d640 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b77812d480 con 0x55b77812aab0 2024-04-24T02:12:22.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.854+0000 7f2edbfff640 1 -- 172.21.15.134:0/669045141 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ecc024030 con 0x55b77812aab0 2024-04-24T02:12:22.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.854+0000 7f2edbfff640 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b77812d480 con 0x7f2edc031040 2024-04-24T02:12:22.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.855+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ed4070020 con 0x7f2edc031040 2024-04-24T02:12:22.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.855+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b77812d480 con 0x55b778124860 2024-04-24T02:12:22.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.855+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2ed4070020 con 0x55b778124860 2024-04-24T02:12:22.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.855+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b77812d480 con 0x7f2ecc027060 2024-04-24T02:12:22.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.856+0000 7f2ee255d640 1 -- 172.21.15.134:0/669045141 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2edc01f070 con 0x7f2ecc027060 2024-04-24T02:12:22.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.856+0000 7f2ee6616800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:22.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.856+0000 7f2ee6616800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:22.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.856+0000 7f2ee6616800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:22.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.856+0000 7f2ee6616800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:22.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.856+0000 7f2ee6616800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:22.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.856+0000 7f2ee6616800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:22.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.856+0000 7f2ee6616800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.856+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7781296c0 con 0x55b778124860 2024-04-24T02:12:22.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.856+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2ed4070020 con 0x55b778124860 2024-04-24T02:12:22.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.856+0000 7f2ee6616800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:22.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.856+0000 7f2ee6616800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.856+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b778129f60 con 0x55b778124860 2024-04-24T02:12:22.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.856+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2ed4070020 con 0x55b778124860 2024-04-24T02:12:22.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.856+0000 7f2ee6616800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:22.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.856+0000 7f2ee6616800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.856+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b77812d900 con 0x55b778124860 2024-04-24T02:12:22.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.856+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2ed4070020 con 0x55b778124860 2024-04-24T02:12:22.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.856+0000 7f2ee6616800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:22.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.856+0000 7f2ee6616800 20 zone default found 2024-04-24T02:12:22.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.856+0000 7f2ee6616800 4 Realm: () 2024-04-24T02:12:22.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.856+0000 7f2ee6616800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:22.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.856+0000 7f2ee6616800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:22.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.856+0000 7f2ee6616800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:22.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.856+0000 7f2ee6616800 20 zonegroup default 2024-04-24T02:12:22.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.856+0000 7f2ee6616800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.856+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b778129bc0 con 0x7f2edc031040 2024-04-24T02:12:22.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.857+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2ed4070020 con 0x7f2edc031040 2024-04-24T02:12:22.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.857+0000 7f2ee6616800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:22.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.857+0000 7f2ee6616800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.857+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b77812f810 con 0x55b77812aab0 2024-04-24T02:12:22.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.857+0000 7f2edbfff640 1 -- 172.21.15.134:0/669045141 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2ecc024030 con 0x55b77812aab0 2024-04-24T02:12:22.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.857+0000 7f2ee6616800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:22.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.857+0000 7f2ee6616800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.857+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b77812fc00 con 0x55b77812aab0 2024-04-24T02:12:22.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.857+0000 7f2edbfff640 1 -- 172.21.15.134:0/669045141 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2ecc024030 con 0x55b77812aab0 2024-04-24T02:12:22.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.857+0000 7f2ee6616800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:22.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.857+0000 7f2ee6616800 20 started sync module instance, tier type = 2024-04-24T02:12:22.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.857+0000 7f2ee6616800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:22.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.857+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b77812ecb0 con 0x7f2ecc027060 2024-04-24T02:12:22.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.858+0000 7f2ee255d640 1 -- 172.21.15.134:0/669045141 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2edc040040 con 0x7f2ecc027060 2024-04-24T02:12:22.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.858+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94246481883296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b778130510 con 0x7f2ecc027060 2024-04-24T02:12:22.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.858+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b778130d60 con 0x55b778124860 2024-04-24T02:12:22.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.859+0000 7f2ee255d640 1 -- 172.21.15.134:0/669045141 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94246481883296] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2edc040040 con 0x7f2ecc027060 2024-04-24T02:12:22.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.860+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ed4070020 con 0x55b778124860 2024-04-24T02:12:22.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.860+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94246481887328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7781309f0 con 0x55b778124860 2024-04-24T02:12:22.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.860+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7781314e0 con 0x55b77812aab0 2024-04-24T02:12:22.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.860+0000 7f2edbfff640 1 -- 172.21.15.134:0/669045141 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ecc024030 con 0x55b77812aab0 2024-04-24T02:12:22.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.860+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94246481891248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b778131d80 con 0x55b77812aab0 2024-04-24T02:12:22.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.861+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b778132820 con 0x7f2ecc027060 2024-04-24T02:12:22.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.861+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94246481887328] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ed4070020 con 0x55b778124860 2024-04-24T02:12:22.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.862+0000 7f2edbfff640 1 -- 172.21.15.134:0/669045141 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94246481891248] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ecc024030 con 0x55b77812aab0 2024-04-24T02:12:22.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.862+0000 7f2ee255d640 1 -- 172.21.15.134:0/669045141 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2edc040040 con 0x7f2ecc027060 2024-04-24T02:12:22.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.862+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94246481893584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b778130480 con 0x7f2ecc027060 2024-04-24T02:12:22.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.862+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7781330c0 con 0x55b778124860 2024-04-24T02:12:22.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.863+0000 7f2ee255d640 1 -- 172.21.15.134:0/669045141 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94246481893584] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2edc040040 con 0x7f2ecc027060 2024-04-24T02:12:22.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.863+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ed4070020 con 0x55b778124860 2024-04-24T02:12:22.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.863+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94246481896176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7781330c0 con 0x55b778124860 2024-04-24T02:12:22.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.863+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b778133b40 con 0x7f2edc031040 2024-04-24T02:12:22.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.864+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ed4070020 con 0x7f2edc031040 2024-04-24T02:12:22.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.864+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94246481901136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b778133a70 con 0x7f2edc031040 2024-04-24T02:12:22.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.864+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b778134a70 con 0x7f2edc031040 2024-04-24T02:12:22.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.864+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94246481896176] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ed4070020 con 0x55b778124860 2024-04-24T02:12:22.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.865+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94246481901136] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ed4070020 con 0x7f2edc031040 2024-04-24T02:12:22.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.865+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(56 notify.6 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ed4070020 con 0x7f2edc031040 2024-04-24T02:12:22.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.865+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94246481903408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b778134580 con 0x7f2edc031040 2024-04-24T02:12:22.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.865+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b778135340 con 0x7f2edc031040 2024-04-24T02:12:22.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.866+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(58 notify.7 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ed4070020 con 0x7f2edc031040 2024-04-24T02:12:22.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.866+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94246481903408] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ed4070020 con 0x7f2edc031040 2024-04-24T02:12:22.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.866+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94246481907344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b778134580 con 0x7f2edc031040 2024-04-24T02:12:22.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.866+0000 7f2ee6616800 20 add_watcher() i=0 2024-04-24T02:12:22.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.866+0000 7f2ee6616800 20 add_watcher() i=1 2024-04-24T02:12:22.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.866+0000 7f2ee6616800 20 add_watcher() i=2 2024-04-24T02:12:22.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.866+0000 7f2ee6616800 20 add_watcher() i=3 2024-04-24T02:12:22.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.866+0000 7f2ee6616800 20 add_watcher() i=4 2024-04-24T02:12:22.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.866+0000 7f2ee6616800 20 add_watcher() i=5 2024-04-24T02:12:22.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.866+0000 7f2ee6616800 20 add_watcher() i=6 2024-04-24T02:12:22.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.867+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94246481907344] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ed4070020 con 0x7f2edc031040 2024-04-24T02:12:22.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.867+0000 7f2ee6616800 20 add_watcher() i=7 2024-04-24T02:12:22.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.867+0000 7f2ee6616800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:22.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.867+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b778138370 con 0x55b778124860 2024-04-24T02:12:22.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.867+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2ed4070020 con 0x55b778124860 2024-04-24T02:12:22.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.867+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94246481898512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b778135860 con 0x55b778124860 2024-04-24T02:12:22.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.868+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94246481898512] v30'70 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2ed4070020 con 0x55b778124860 2024-04-24T02:12:22.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.868+0000 7f2d937fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:22.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.868+0000 7f2ee6616800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:22.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.868+0000 7f2ee6616800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:22.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.869+0000 7f2ee6616800 5 note: GC not initialized 2024-04-24T02:12:22.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.869+0000 7f2d927fc640 20 reqs_thread_entry: start 2024-04-24T02:12:22.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.869+0000 7f2ee6616800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:22.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.869+0000 7f2ee6616800 20 Filter name: none 2024-04-24T02:12:22.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.869+0000 7f2d03fff640 20 reqs_thread_entry: start 2024-04-24T02:12:22.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.869+0000 7f2ee6616800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T02:12:22.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.869+0000 7f2ee6616800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.869+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b77816b6e0 con 0x55b778124860 2024-04-24T02:12:22.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.869+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f2ed4070020 con 0x55b778124860 2024-04-24T02:12:22.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.869+0000 7f2ee6616800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T02:12:22.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.869+0000 7f2ee6616800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T02:12:22.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.869+0000 7f2ee6616800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:22.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.869+0000 7f2ee6616800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:12:22.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.870+0000 7f2ee6616800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-04-24T02:12:22.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.870+0000 7f2ee6616800 20 rados->read ofs=0 len=0 2024-04-24T02:12:22.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.870+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b77816c150 con 0x7f2edc031040 2024-04-24T02:12:22.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.870+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f2ed4070020 con 0x7f2edc031040 2024-04-24T02:12:22.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.870+0000 7f2ee6616800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:22.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.870+0000 7f2ee6616800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-04-24T02:12:22.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.870+0000 7f2ee6616800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-24T02:12:22.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.870+0000 7f2ee6616800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-24T02:12:22.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.870+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~502 in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b778171af0 con 0x55b778124860 2024-04-24T02:12:22.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.871+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~502] v30'4 uv4 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f2ed4070020 con 0x55b778124860 2024-04-24T02:12:22.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.871+0000 7f2ee6616800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T02:12:22.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.871+0000 7f2ee6616800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:22.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.871+0000 7f2ee6616800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-24T02:12:22.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.871+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94246482154848 in=690b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b77816d220 con 0x55b778124860 2024-04-24T02:12:22.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.872+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== watch-notify(notify (1) cookie 94246481896176 notify 128849018883 ret 0) ==== 720+0+0 (crc 0 0 0) 0x55b7780e18b0 con 0x55b778124860 2024-04-24T02:12:22.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.872+0000 7f2dc57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018883 cookie 94246481896176 notifier 4334 bl.length()=678 2024-04-24T02:12:22.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.872+0000 7f2dc57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T02:12:22.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.872+0000 7f2dc57fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:22.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.872+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(65 notify.4 [notify cookie 94246482154848 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2ed4070020 con 0x55b778124860 2024-04-24T02:12:22.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.872+0000 7f2dc57fa640 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f2da4003ea0 con 0x55b778124860 2024-04-24T02:12:22.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.872+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== watch-notify(notify_complete (2) cookie 94246482154848 notify 128849018883 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f2ed4078030 con 0x55b778124860 2024-04-24T02:12:22.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.872+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ed4070020 con 0x55b778124860 2024-04-24T02:12:22.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.872+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b778171560 con 0x7f2edc031040 2024-04-24T02:12:22.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.873+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f2ed4070020 con 0x7f2edc031040 2024-04-24T02:12:22.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.873+0000 7f2ee6616800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-24T02:12:22.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.873+0000 7f2ee6616800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-24T02:12:22.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.873+0000 7f2ee6616800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-24T02:12:22.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.874+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94246482154848 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b77816cd70 con 0x55b77812aab0 2024-04-24T02:12:22.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.874+0000 7f2edbfff640 1 -- 172.21.15.134:0/669045141 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== watch-notify(notify (1) cookie 94246481891248 notify 128849018880 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55b778119540 con 0x55b77812aab0 2024-04-24T02:12:22.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.874+0000 7f2dc4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018880 cookie 94246481891248 notifier 4334 bl.length()=177 2024-04-24T02:12:22.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.874+0000 7f2dc4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-24T02:12:22.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.874+0000 7f2dc4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-24T02:12:22.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.874+0000 7f2edbfff640 1 -- 172.21.15.134:0/669045141 <== osd.3 v2:172.21.15.134:6801/3585115521 15 ==== osd_op_reply(68 notify.2 [notify cookie 94246482154848 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2ecc024030 con 0x55b77812aab0 2024-04-24T02:12:22.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.874+0000 7f2dc4ff9640 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f2d0c003400 con 0x55b77812aab0 2024-04-24T02:12:22.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.874+0000 7f2edbfff640 1 -- 172.21.15.134:0/669045141 <== osd.3 v2:172.21.15.134:6801/3585115521 16 ==== watch-notify(notify_complete (2) cookie 94246482154848 notify 128849018880 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b7781192b0 con 0x55b77812aab0 2024-04-24T02:12:22.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.874+0000 7f2edbfff640 1 -- 172.21.15.134:0/669045141 <== osd.3 v2:172.21.15.134:6801/3585115521 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ecc024030 con 0x55b77812aab0 2024-04-24T02:12:22.888 INFO:teuthology.orchestra.run.smithi134.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T02:12:21.778798Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-04-24T02:12:22.871836Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T02:12:21.778786Z","tags":[],"group_ids":[]} 2024-04-24T02:12:22.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.875+0000 7f2d937fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:22.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.875+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94246481898512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b77816d650 con 0x55b778124860 2024-04-24T02:12:22.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.876+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94246481898512] v30'71 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2ed4070020 con 0x55b778124860 2024-04-24T02:12:22.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.876+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94246481883296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b778132c10 con 0x7f2ecc027060 2024-04-24T02:12:22.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.877+0000 7f2ee255d640 1 -- 172.21.15.134:0/669045141 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94246481883296] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2edc040040 con 0x7f2ecc027060 2024-04-24T02:12:22.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.877+0000 7f2ee6616800 20 remove_watcher() i=0 2024-04-24T02:12:22.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.877+0000 7f2ee6616800 2 removed watcher, disabling cache 2024-04-24T02:12:22.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.877+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94246481887328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b778132c10 con 0x55b778124860 2024-04-24T02:12:22.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.878+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.1 v2:172.21.15.134:6804/1487076214 30 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94246481887328] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ed4070020 con 0x55b778124860 2024-04-24T02:12:22.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.878+0000 7f2ee6616800 20 remove_watcher() i=1 2024-04-24T02:12:22.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.878+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94246481891248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b778132c10 con 0x55b77812aab0 2024-04-24T02:12:22.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.879+0000 7f2edbfff640 1 -- 172.21.15.134:0/669045141 <== osd.3 v2:172.21.15.134:6801/3585115521 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94246481891248] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ecc024030 con 0x55b77812aab0 2024-04-24T02:12:22.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.879+0000 7f2ee6616800 20 remove_watcher() i=2 2024-04-24T02:12:22.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.879+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94246481893584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b778130fb0 con 0x7f2ecc027060 2024-04-24T02:12:22.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.880+0000 7f2ee255d640 1 -- 172.21.15.134:0/669045141 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94246481893584] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2edc040040 con 0x7f2ecc027060 2024-04-24T02:12:22.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.880+0000 7f2ee6616800 20 remove_watcher() i=3 2024-04-24T02:12:22.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.880+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94246481896176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7781318d0 con 0x55b778124860 2024-04-24T02:12:22.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.881+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.1 v2:172.21.15.134:6804/1487076214 31 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94246481896176] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ed4070020 con 0x55b778124860 2024-04-24T02:12:22.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.881+0000 7f2ee6616800 20 remove_watcher() i=4 2024-04-24T02:12:22.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.881+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94246481901136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b778130fb0 con 0x7f2edc031040 2024-04-24T02:12:22.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.882+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94246481901136] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ed4070020 con 0x7f2edc031040 2024-04-24T02:12:22.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.882+0000 7f2ee6616800 20 remove_watcher() i=5 2024-04-24T02:12:22.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.882+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94246481903408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7781318d0 con 0x7f2edc031040 2024-04-24T02:12:22.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.883+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.0 v2:172.21.15.104:6800/2419146313 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94246481903408] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ed4070020 con 0x7f2edc031040 2024-04-24T02:12:22.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.883+0000 7f2ee6616800 20 remove_watcher() i=6 2024-04-24T02:12:22.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.883+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94246481907344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b778133650 con 0x7f2edc031040 2024-04-24T02:12:22.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.884+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 <== osd.0 v2:172.21.15.104:6800/2419146313 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94246481907344] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ed4070020 con 0x7f2edc031040 2024-04-24T02:12:22.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.884+0000 7f2ee6616800 20 remove_watcher() i=7 2024-04-24T02:12:22.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.884+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f2edc031040 msgr2=0x7f2edc032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.884+0000 7f2ee6616800 1 --2- 172.21.15.134:0/669045141 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f2edc031040 0x7f2edc032940 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.884+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b778124860 msgr2=0x55b778126d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.884+0000 7f2ee6616800 1 --2- 172.21.15.134:0/669045141 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b778124860 0x55b778126d20 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.884+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f2ecc027060 msgr2=0x7f2ecc027440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.884+0000 7f2ee6616800 1 --2- 172.21.15.134:0/669045141 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f2ecc027060 0x7f2ecc027440 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.884+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55b77812aab0 msgr2=0x55b77812cea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.884+0000 7f2ee6616800 1 --2- 172.21.15.134:0/669045141 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55b77812aab0 0x55b77812cea0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.884+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f2dac036950 msgr2=0x7f2dac038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.884+0000 7f2ee6616800 1 --2- 172.21.15.134:0/669045141 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f2dac036950 0x7f2dac038e10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x55b7780f4420 tx=0x7f2edc01f000 comp rx=0 tx=0).stop 2024-04-24T02:12:22.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.884+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b778111710 msgr2=0x55b778118d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.884+0000 7f2ee1d5c640 1 -- 172.21.15.134:0/669045141 reap_dead start 2024-04-24T02:12:22.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.884+0000 7f2ee6616800 1 --2- 172.21.15.134:0/669045141 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b778111710 0x55b778118d70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc0266c0 tx=0x7f2ecc04be50 comp rx=0 tx=0).stop 2024-04-24T02:12:22.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.884+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 shutdown_connections 2024-04-24T02:12:22.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.884+0000 7f2ee6616800 1 --2- 172.21.15.134:0/669045141 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b778111710 0x55b778118d70 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.884+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 >> 172.21.15.134:0/669045141 conn(0x55b77810da70 msgr2=0x55b77810b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:22.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.884+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 shutdown_connections 2024-04-24T02:12:22.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.884+0000 7f2ee6616800 1 -- 172.21.15.134:0/669045141 wait complete. 2024-04-24T02:12:22.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.885+0000 7f2ee6616800 1 -- 172.21.15.134:0/2693069625 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f2dbc036950 msgr2=0x7f2dbc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.885+0000 7f2ee6616800 1 --2- 172.21.15.134:0/2693069625 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f2dbc036950 0x7f2dbc038e10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x55b7780f4ca0 tx=0x7f2edc005840 comp rx=0 tx=0).stop 2024-04-24T02:12:22.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.885+0000 7f2ee6616800 1 -- 172.21.15.134:0/2693069625 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7781043d0 msgr2=0x55b7781047f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.885+0000 7f2ee6616800 1 --2- 172.21.15.134:0/2693069625 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7781043d0 0x55b7781047f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc00e610 tx=0x7f2ecc00ff90 comp rx=0 tx=0).stop 2024-04-24T02:12:22.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.885+0000 7f2ee6616800 1 -- 172.21.15.134:0/2693069625 shutdown_connections 2024-04-24T02:12:22.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.885+0000 7f2ee6616800 1 --2- 172.21.15.134:0/2693069625 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f2dbc036950 0x7f2dbc038e10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.885+0000 7f2ee6616800 1 --2- 172.21.15.134:0/2693069625 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7781043d0 0x55b7781047f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.885+0000 7f2ee6616800 1 -- 172.21.15.134:0/2693069625 >> 172.21.15.134:0/2693069625 conn(0x55b7780f8470 msgr2=0x55b7780f8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:22.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.885+0000 7f2ee6616800 1 -- 172.21.15.134:0/2693069625 shutdown_connections 2024-04-24T02:12:22.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.885+0000 7f2ee6616800 1 -- 172.21.15.134:0/2693069625 wait complete. 2024-04-24T02:12:22.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.885+0000 7f2ee6616800 1 -- 172.21.15.134:0/1326210789 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b777ff0fa0 msgr2=0x55b7780f33c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.885+0000 7f2ee6616800 1 --2- 172.21.15.134:0/1326210789 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b777ff0fa0 0x55b7780f33c0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.885+0000 7f2ee6616800 1 -- 172.21.15.134:0/1326210789 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f2dc8036950 msgr2=0x7f2dc8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.885+0000 7f2ee6616800 1 --2- 172.21.15.134:0/1326210789 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f2dc8036950 0x7f2dc8038e10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc000c00 tx=0x7f2ecc0013b0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.885+0000 7f2ee6616800 1 -- 172.21.15.134:0/1326210789 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b777fefd40 msgr2=0x55b7780e2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.885+0000 7f2ee6616800 1 --2- 172.21.15.134:0/1326210789 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b777fefd40 0x55b7780e2a10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4061040 tx=0x7f2ed4002fb0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.885+0000 7f2ee6616800 1 -- 172.21.15.134:0/1326210789 shutdown_connections 2024-04-24T02:12:22.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.885+0000 7f2ee6616800 1 --2- 172.21.15.134:0/1326210789 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b777ff0fa0 0x55b7780f33c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.885+0000 7f2ee6616800 1 --2- 172.21.15.134:0/1326210789 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f2dc8036950 0x7f2dc8038e10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.885+0000 7f2ee6616800 1 --2- 172.21.15.134:0/1326210789 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b777fefd40 0x55b7780e2a10 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.885+0000 7f2ee6616800 1 -- 172.21.15.134:0/1326210789 >> 172.21.15.134:0/1326210789 conn(0x55b777feb3a0 msgr2=0x55b7780db410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:22.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.885+0000 7f2ee6616800 1 -- 172.21.15.134:0/1326210789 shutdown_connections 2024-04-24T02:12:22.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.885+0000 7f2ee6616800 1 -- 172.21.15.134:0/1326210789 wait complete. 2024-04-24T02:12:22.899 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T02:12:21.778798Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-04-24T02:12:22.871836Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:12:21.778786Z', 'tags': [], 'group_ids': []} 2024-04-24T02:12:22.900 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-24T02:12:22.900 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-24T02:12:22.900 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-24T02:12:22.942 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:22.943 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:22.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.942+0000 7fe649211800 1 Processor -- start 2024-04-24T02:12:22.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.942+0000 7fe649211800 1 -- start start 2024-04-24T02:12:22.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.942+0000 7fe649211800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x556597836130 0x5565978385f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.942+0000 7fe649211800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5565976f0d40 con 0x5565977a51c0 2024-04-24T02:12:22.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.942+0000 7fe649211800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x5565976c34d0 con 0x556597836130 2024-04-24T02:12:22.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.942+0000 7fe63ffff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x556597836130 0x5565978385f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.942+0000 7fe644947640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x5565977a51c0 0x5565978349e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:43276/0 (socket says 172.21.15.134:43276) 2024-04-24T02:12:22.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.942+0000 7fe644947640 1 -- 172.21.15.134:0/1616872130 learned_addr learned my addr 172.21.15.134:0/1616872130 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:12:22.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.942+0000 7fe63ffff640 1 --2- 172.21.15.134:0/1616872130 >> v2:172.21.15.104:3300/0 conn(0x556597836130 0x5565978385f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45972/0 (socket says 172.21.15.134:45972) 2024-04-24T02:12:22.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.943+0000 7fe63ffff640 1 -- 172.21.15.134:0/1616872130 >> v1:172.21.15.104:6789/0 conn(0x5565977a51c0 legacy=0x5565978349e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.943+0000 7fe63f7fe640 1 -- 172.21.15.134:0/1616872130 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3108450534 0 0) 0x5565976f0d40 con 0x5565977a51c0 2024-04-24T02:12:22.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.943+0000 7fe63ffff640 1 -- 172.21.15.134:0/1616872130 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565976ef590 con 0x556597836130 2024-04-24T02:12:22.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.944+0000 7fe63ffff640 1 --2- 172.21.15.134:0/1616872130 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556597836130 0x5565978385f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe63000a470 tx=0x7fe63001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d49b372ae2217f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.944+0000 7fe63f7fe640 1 -- 172.21.15.134:0/1616872130 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe630057070 con 0x556597836130 2024-04-24T02:12:22.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.945+0000 7fe63f7fe640 1 -- 172.21.15.134:0/1616872130 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe630052570 con 0x556597836130 2024-04-24T02:12:22.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.945+0000 7fe63f7fe640 1 -- 172.21.15.134:0/1616872130 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe630052870 con 0x556597836130 2024-04-24T02:12:22.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.945+0000 7fe649211800 1 -- 172.21.15.134:0/1616872130 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556597836130 msgr2=0x5565978385f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.945+0000 7fe649211800 1 --2- 172.21.15.134:0/1616872130 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556597836130 0x5565978385f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe63000a470 tx=0x7fe63001ce90 comp rx=0 tx=0).stop 2024-04-24T02:12:22.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.945+0000 7fe649211800 1 -- 172.21.15.134:0/1616872130 shutdown_connections 2024-04-24T02:12:22.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.945+0000 7fe649211800 1 --2- 172.21.15.134:0/1616872130 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556597836130 0x5565978385f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.945+0000 7fe649211800 1 -- 172.21.15.134:0/1616872130 >> 172.21.15.134:0/1616872130 conn(0x55659782c380 msgr2=0x55659782e7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:22.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.945+0000 7fe649211800 1 -- 172.21.15.134:0/1616872130 shutdown_connections 2024-04-24T02:12:22.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.945+0000 7fe649211800 1 -- 172.21.15.134:0/1616872130 wait complete. 2024-04-24T02:12:22.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.957+0000 7fe649211800 1 Processor -- start 2024-04-24T02:12:22.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.957+0000 7fe649211800 1 -- start start 2024-04-24T02:12:22.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.957+0000 7fe649211800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5565977a51c0 0x556597922f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.957+0000 7fe649211800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55659777d3c0 con 0x5565977a51c0 2024-04-24T02:12:22.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.957+0000 7fe644947640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5565977a51c0 0x556597922f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.957+0000 7fe644947640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5565977a51c0 0x556597922f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45974/0 (socket says 172.21.15.134:45974) 2024-04-24T02:12:22.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.957+0000 7fe644947640 1 -- 172.21.15.134:0/484491663 learned_addr learned my addr 172.21.15.134:0/484491663 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:22.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.957+0000 7fe644947640 1 -- 172.21.15.134:0/484491663 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565979234d0 con 0x5565977a51c0 2024-04-24T02:12:22.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.958+0000 7fe644947640 1 --2- 172.21.15.134:0/484491663 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5565977a51c0 0x556597922f00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe63800b210 tx=0x7fe63800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ded07331133715da server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.958+0000 7fe532e05640 1 -- 172.21.15.134:0/484491663 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe638008070 con 0x5565977a51c0 2024-04-24T02:12:22.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.958+0000 7fe532e05640 1 -- 172.21.15.134:0/484491663 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe63800d500 con 0x5565977a51c0 2024-04-24T02:12:22.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.958+0000 7fe532e05640 1 -- 172.21.15.134:0/484491663 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe63800d840 con 0x5565977a51c0 2024-04-24T02:12:22.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.958+0000 7fe649211800 1 -- 172.21.15.134:0/484491663 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5565977a51c0 msgr2=0x556597922f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:22.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.958+0000 7fe649211800 1 --2- 172.21.15.134:0/484491663 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5565977a51c0 0x556597922f00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe63800b210 tx=0x7fe63800b6d0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.959+0000 7fe649211800 1 -- 172.21.15.134:0/484491663 shutdown_connections 2024-04-24T02:12:22.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.959+0000 7fe649211800 1 --2- 172.21.15.134:0/484491663 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5565977a51c0 0x556597922f00 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:22.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.959+0000 7fe649211800 1 -- 172.21.15.134:0/484491663 >> 172.21.15.134:0/484491663 conn(0x55659782c380 msgr2=0x55659791e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:22.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.959+0000 7fe649211800 1 -- 172.21.15.134:0/484491663 shutdown_connections 2024-04-24T02:12:22.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.959+0000 7fe649211800 1 -- 172.21.15.134:0/484491663 wait complete. 2024-04-24T02:12:22.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.959+0000 7fe649211800 1 Processor -- start 2024-04-24T02:12:22.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.959+0000 7fe649211800 1 -- start start 2024-04-24T02:12:22.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.959+0000 7fe649211800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5565977a51c0 0x55659792aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:22.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.959+0000 7fe649211800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556597838fa0 con 0x5565977a51c0 2024-04-24T02:12:22.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.959+0000 7fe644947640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5565977a51c0 0x55659792aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:22.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.959+0000 7fe644947640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5565977a51c0 0x55659792aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45978/0 (socket says 172.21.15.134:45978) 2024-04-24T02:12:22.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.959+0000 7fe644947640 1 -- 172.21.15.134:0/1167045592 learned_addr learned my addr 172.21.15.134:0/1167045592 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:22.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.960+0000 7fe644947640 1 -- 172.21.15.134:0/1167045592 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55659792afc0 con 0x5565977a51c0 2024-04-24T02:12:22.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.960+0000 7fe644947640 1 --2- 172.21.15.134:0/1167045592 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5565977a51c0 0x55659792aa80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe63800b210 tx=0x7fe638000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:22.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.960+0000 7fe531602640 1 -- 172.21.15.134:0/1167045592 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe63800f950 con 0x5565977a51c0 2024-04-24T02:12:22.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.960+0000 7fe531602640 1 -- 172.21.15.134:0/1167045592 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe63800faf0 con 0x5565977a51c0 2024-04-24T02:12:22.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.960+0000 7fe649211800 1 -- 172.21.15.134:0/1167045592 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55659792b250 con 0x5565977a51c0 2024-04-24T02:12:22.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.960+0000 7fe531602640 1 -- 172.21.15.134:0/1167045592 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe63800fdd0 con 0x5565977a51c0 2024-04-24T02:12:22.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.960+0000 7fe649211800 1 -- 172.21.15.134:0/1167045592 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55659792df00 con 0x5565977a51c0 2024-04-24T02:12:22.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.961+0000 7fe531602640 1 -- 172.21.15.134:0/1167045592 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe638017040 con 0x5565977a51c0 2024-04-24T02:12:23.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.961+0000 7fe531602640 1 --2- 172.21.15.134:0/1167045592 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe52c036900 0x7fe52c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.961+0000 7fe531602640 1 -- 172.21.15.134:0/1167045592 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fe638015020 con 0x5565977a51c0 2024-04-24T02:12:23.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.961+0000 7fe63ffff640 1 --2- 172.21.15.134:0/1167045592 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe52c036900 0x7fe52c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.961+0000 7fe649211800 1 --2- 172.21.15.134:0/1167045592 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556597836130 0x556597931cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.961+0000 7fe649211800 1 -- 172.21.15.134:0/1167045592 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556597932200 con 0x556597836130 2024-04-24T02:12:23.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.961+0000 7fe645148640 1 --2- 172.21.15.134:0/1167045592 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556597836130 0x556597931cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.962+0000 7fe63ffff640 1 --2- 172.21.15.134:0/1167045592 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe52c036900 0x7fe52c038dc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe630054000 tx=0x7fe63004e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.962+0000 7fe645148640 1 --2- 172.21.15.134:0/1167045592 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556597836130 0x556597931cc0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.962+0000 7fe645148640 1 -- 172.21.15.134:0/1167045592 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe64000a4a0 con 0x556597836130 2024-04-24T02:12:23.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.962+0000 7fe649211800 1 -- 172.21.15.134:0/1167045592 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55659792f290 con 0x556597836130 2024-04-24T02:12:23.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.962+0000 7fe645148640 1 -- 172.21.15.134:0/1167045592 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe64000a4a0 con 0x556597836130 2024-04-24T02:12:23.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.962+0000 7fe649211800 1 -- 172.21.15.134:0/1167045592 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556597934020 con 0x556597836130 2024-04-24T02:12:23.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.963+0000 7fe645148640 1 -- 172.21.15.134:0/1167045592 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe64000a4a0 con 0x556597836130 2024-04-24T02:12:23.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.963+0000 7fe649211800 1 -- 172.21.15.134:0/1167045592 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556597933360 con 0x556597836130 2024-04-24T02:12:23.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.963+0000 7fe645148640 1 -- 172.21.15.134:0/1167045592 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe64000a4a0 con 0x556597836130 2024-04-24T02:12:23.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.963+0000 7fe649211800 1 -- 172.21.15.134:0/1167045592 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556597933700 con 0x556597836130 2024-04-24T02:12:23.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.963+0000 7fe645148640 1 -- 172.21.15.134:0/1167045592 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe64000a4a0 con 0x556597836130 2024-04-24T02:12:23.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.963+0000 7fe649211800 1 Processor -- start 2024-04-24T02:12:23.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.963+0000 7fe649211800 1 -- start start 2024-04-24T02:12:23.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.964+0000 7fe649211800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556597832590 0x556597830a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.964+0000 7fe649211800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5565977236b0 con 0x556597832590 2024-04-24T02:12:23.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.964+0000 7fe63ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556597832590 0x556597830a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.964+0000 7fe63ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556597832590 0x556597830a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:45994/0 (socket says 172.21.15.134:45994) 2024-04-24T02:12:23.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.964+0000 7fe63ffff640 1 -- 172.21.15.134:0/2679618826 learned_addr learned my addr 172.21.15.134:0/2679618826 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:23.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.964+0000 7fe63ffff640 1 -- 172.21.15.134:0/2679618826 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556597830f40 con 0x556597832590 2024-04-24T02:12:23.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.964+0000 7fe63ffff640 1 --2- 172.21.15.134:0/2679618826 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556597832590 0x556597830a00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe630044840 tx=0x7fe630002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.964+0000 7fe52a7fc640 1 -- 172.21.15.134:0/2679618826 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe63006f070 con 0x556597832590 2024-04-24T02:12:23.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.964+0000 7fe52a7fc640 1 -- 172.21.15.134:0/2679618826 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe630058040 con 0x556597832590 2024-04-24T02:12:23.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.964+0000 7fe649211800 1 -- 172.21.15.134:0/2679618826 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556597831170 con 0x556597832590 2024-04-24T02:12:23.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.964+0000 7fe52a7fc640 1 -- 172.21.15.134:0/2679618826 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe630057050 con 0x556597832590 2024-04-24T02:12:23.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.965+0000 7fe649211800 1 -- 172.21.15.134:0/2679618826 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556597831610 con 0x556597832590 2024-04-24T02:12:23.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.965+0000 7fe52a7fc640 1 -- 172.21.15.134:0/2679618826 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe630072070 con 0x556597832590 2024-04-24T02:12:23.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.965+0000 7fe52a7fc640 1 --2- 172.21.15.134:0/2679618826 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe51c036950 0x7fe51c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.965+0000 7fe52a7fc640 1 -- 172.21.15.134:0/2679618826 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fe63008f830 con 0x556597832590 2024-04-24T02:12:23.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.965+0000 7fe645148640 1 --2- 172.21.15.134:0/2679618826 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe51c036950 0x7fe51c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.966+0000 7fe649211800 1 Processor -- start 2024-04-24T02:12:23.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.966+0000 7fe645148640 1 --2- 172.21.15.134:0/2679618826 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe51c036950 0x7fe51c038e10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x556597932e80 tx=0x7fe640005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.966+0000 7fe649211800 1 -- start start 2024-04-24T02:12:23.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.966+0000 7fe649211800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556597952260 0x556597952680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.966+0000 7fe649211800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556597923850 con 0x556597952260 2024-04-24T02:12:23.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.966+0000 7fe63ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556597952260 0x556597952680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.966+0000 7fe63ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556597952260 0x556597952680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46006/0 (socket says 172.21.15.134:46006) 2024-04-24T02:12:23.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.966+0000 7fe63ffff640 1 -- 172.21.15.134:0/3916051241 learned_addr learned my addr 172.21.15.134:0/3916051241 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:23.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.966+0000 7fe63ffff640 1 -- 172.21.15.134:0/3916051241 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556597952c50 con 0x556597952260 2024-04-24T02:12:23.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.966+0000 7fe63ffff640 1 --2- 172.21.15.134:0/3916051241 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556597952260 0x556597952680 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe63008dd50 tx=0x7fe63008df50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69c3d504489e53e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.966+0000 7fe51bfff640 1 -- 172.21.15.134:0/3916051241 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe63008b030 con 0x556597952260 2024-04-24T02:12:23.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.966+0000 7fe51bfff640 1 -- 172.21.15.134:0/3916051241 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe63005e480 con 0x556597952260 2024-04-24T02:12:23.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.967+0000 7fe51bfff640 1 -- 172.21.15.134:0/3916051241 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe630087b40 con 0x556597952260 2024-04-24T02:12:23.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.967+0000 7fe649211800 1 -- 172.21.15.134:0/3916051241 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556597952260 msgr2=0x556597952680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.967+0000 7fe649211800 1 --2- 172.21.15.134:0/3916051241 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556597952260 0x556597952680 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe63008dd50 tx=0x7fe63008df50 comp rx=0 tx=0).stop 2024-04-24T02:12:23.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.967+0000 7fe649211800 1 -- 172.21.15.134:0/3916051241 shutdown_connections 2024-04-24T02:12:23.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.967+0000 7fe649211800 1 --2- 172.21.15.134:0/3916051241 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556597952260 0x556597952680 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.967+0000 7fe649211800 1 -- 172.21.15.134:0/3916051241 >> 172.21.15.134:0/3916051241 conn(0x55659794e5c0 msgr2=0x55659794c620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:23.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.967+0000 7fe649211800 1 -- 172.21.15.134:0/3916051241 shutdown_connections 2024-04-24T02:12:23.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.967+0000 7fe649211800 1 -- 172.21.15.134:0/3916051241 wait complete. 2024-04-24T02:12:23.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.967+0000 7fe649211800 1 Processor -- start 2024-04-24T02:12:23.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.967+0000 7fe649211800 1 -- start start 2024-04-24T02:12:23.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.967+0000 7fe649211800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556597952260 0x556597959950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.967+0000 7fe649211800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5565979533c0 con 0x556597952260 2024-04-24T02:12:23.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.968+0000 7fe63ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556597952260 0x556597959950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.968+0000 7fe63ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556597952260 0x556597959950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46012/0 (socket says 172.21.15.134:46012) 2024-04-24T02:12:23.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.968+0000 7fe63ffff640 1 -- 172.21.15.134:0/3948921906 learned_addr learned my addr 172.21.15.134:0/3948921906 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:23.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.968+0000 7fe63ffff640 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556597959e90 con 0x556597952260 2024-04-24T02:12:23.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.968+0000 7fe63ffff640 1 --2- 172.21.15.134:0/3948921906 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556597952260 0x556597959950 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe63008dd50 tx=0x7fe63008dce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.968+0000 7fe51a7fc640 1 -- 172.21.15.134:0/3948921906 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe630072660 con 0x556597952260 2024-04-24T02:12:23.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.968+0000 7fe51a7fc640 1 -- 172.21.15.134:0/3948921906 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe63005fe10 con 0x556597952260 2024-04-24T02:12:23.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.968+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55659795a120 con 0x556597952260 2024-04-24T02:12:23.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.968+0000 7fe51a7fc640 1 -- 172.21.15.134:0/3948921906 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe63005de50 con 0x556597952260 2024-04-24T02:12:23.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.968+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55659795a120 con 0x556597952260 2024-04-24T02:12:23.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.969+0000 7fe51a7fc640 1 -- 172.21.15.134:0/3948921906 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe63007b020 con 0x556597952260 2024-04-24T02:12:23.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.969+0000 7fe51a7fc640 1 --2- 172.21.15.134:0/3948921906 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe510036900 0x7fe510038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.969+0000 7fe51a7fc640 1 -- 172.21.15.134:0/3948921906 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fe63008c070 con 0x556597952260 2024-04-24T02:12:23.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.969+0000 7fe649211800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.969+0000 7fe645148640 1 --2- 172.21.15.134:0/3948921906 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe510036900 0x7fe510038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.970+0000 7fe649211800 1 --2- 172.21.15.134:0/3948921906 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556597965240 0x5565979676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.970+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556597967e20 con 0x556597965240 2024-04-24T02:12:23.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.970+0000 7fe644947640 1 --2- 172.21.15.134:0/3948921906 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556597965240 0x5565979676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.970+0000 7fe645148640 1 --2- 172.21.15.134:0/3948921906 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe510036900 0x7fe510038dc0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x55659792b8a0 tx=0x7fe64001f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.970+0000 7fe644947640 1 --2- 172.21.15.134:0/3948921906 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556597965240 0x5565979676d0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.970+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe63802d070 con 0x556597965240 2024-04-24T02:12:23.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.970+0000 7fe649211800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.970+0000 7fe649211800 20 realm 2024-04-24T02:12:23.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.970+0000 7fe649211800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.970+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556597968230 con 0x556597965240 2024-04-24T02:12:23.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.970+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe63802d070 con 0x556597965240 2024-04-24T02:12:23.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.970+0000 7fe649211800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.970+0000 7fe649211800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:23.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.970+0000 7fe649211800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.970+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556597968b00 con 0x556597965240 2024-04-24T02:12:23.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.971+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe63802d070 con 0x556597965240 2024-04-24T02:12:23.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.971+0000 7fe649211800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.971+0000 7fe649211800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.971+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556597968ea0 con 0x556597965240 2024-04-24T02:12:23.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.971+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe63802d070 con 0x556597965240 2024-04-24T02:12:23.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.971+0000 7fe649211800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:23.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.971+0000 7fe649211800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.971+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556597969300 con 0x556597965240 2024-04-24T02:12:23.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.971+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe63802d070 con 0x556597965240 2024-04-24T02:12:23.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.971+0000 7fe649211800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:23.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.971+0000 7fe649211800 20 searching for the correct realm 2024-04-24T02:12:23.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.971+0000 7fe649211800 1 --2- 172.21.15.134:0/3948921906 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55659796b350 0x55659796d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.971+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55659796ddf0 con 0x55659796b350 2024-04-24T02:12:23.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.971+0000 7fe63ffff640 1 --2- 172.21.15.134:0/3948921906 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55659796b350 0x55659796d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.972+0000 7fe63ffff640 1 --2- 172.21.15.134:0/3948921906 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55659796b350 0x55659796d740 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.972+0000 7fe63ffff640 1 -- 172.21.15.134:0/3948921906 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe630071030 con 0x55659796b350 2024-04-24T02:12:23.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.972+0000 7fe63ffff640 1 --2- 172.21.15.134:0/3948921906 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fe630074060 0x7fe63008c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.972+0000 7fe63ffff640 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55659796ddf0 con 0x7fe630074060 2024-04-24T02:12:23.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.972+0000 7fe645148640 1 --2- 172.21.15.134:0/3948921906 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fe630074060 0x7fe63008c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.972+0000 7fe645148640 1 --2- 172.21.15.134:0/3948921906 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fe630074060 0x7fe63008c270 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.973+0000 7fe645148640 1 -- 172.21.15.134:0/3948921906 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe64001f070 con 0x7fe630074060 2024-04-24T02:12:23.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.973+0000 7fe645148640 1 --2- 172.21.15.134:0/3948921906 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fe640031040 0x7fe640032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.973+0000 7fe645148640 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55659796ddf0 con 0x7fe640031040 2024-04-24T02:12:23.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.973+0000 7fe644947640 1 --2- 172.21.15.134:0/3948921906 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fe640031040 0x7fe640032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.973+0000 7fe644947640 1 --2- 172.21.15.134:0/3948921906 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fe640031040 0x7fe640032940 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.974+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe638048040 con 0x7fe640031040 2024-04-24T02:12:23.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.974+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55659796ddf0 con 0x556597965240 2024-04-24T02:12:23.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.974+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe638048040 con 0x556597965240 2024-04-24T02:12:23.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.974+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55659796ddf0 con 0x556597965240 2024-04-24T02:12:23.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.974+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe638048040 con 0x556597965240 2024-04-24T02:12:23.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.974+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55659796ddf0 con 0x7fe640031040 2024-04-24T02:12:23.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.974+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe638048040 con 0x7fe640031040 2024-04-24T02:12:23.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.974+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55659796ddf0 con 0x7fe640031040 2024-04-24T02:12:23.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.975+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe638048040 con 0x7fe640031040 2024-04-24T02:12:23.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.975+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55659796ddf0 con 0x7fe630074060 2024-04-24T02:12:23.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.975+0000 7fe645148640 1 -- 172.21.15.134:0/3948921906 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe64001f070 con 0x7fe630074060 2024-04-24T02:12:23.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.975+0000 7fe645148640 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55659796ddf0 con 0x55659796b350 2024-04-24T02:12:23.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.975+0000 7fe63ffff640 1 -- 172.21.15.134:0/3948921906 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe630071030 con 0x55659796b350 2024-04-24T02:12:23.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.975+0000 7fe63ffff640 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55659796ddf0 con 0x556597965240 2024-04-24T02:12:23.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.975+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe638048040 con 0x556597965240 2024-04-24T02:12:23.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.975+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55659796ddf0 con 0x7fe640031040 2024-04-24T02:12:23.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.976+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe638048040 con 0x7fe640031040 2024-04-24T02:12:23.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.976+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55659796ddf0 con 0x556597965240 2024-04-24T02:12:23.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.976+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe638048040 con 0x556597965240 2024-04-24T02:12:23.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.976+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55659796ddf0 con 0x7fe630074060 2024-04-24T02:12:23.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.976+0000 7fe645148640 1 -- 172.21.15.134:0/3948921906 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe64001f070 con 0x7fe630074060 2024-04-24T02:12:23.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.976+0000 7fe645148640 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55659796ddf0 con 0x55659796b350 2024-04-24T02:12:23.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.976+0000 7fe63ffff640 1 -- 172.21.15.134:0/3948921906 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe630071030 con 0x55659796b350 2024-04-24T02:12:23.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.976+0000 7fe63ffff640 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55659796ddf0 con 0x55659796b350 2024-04-24T02:12:23.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.976+0000 7fe63ffff640 1 -- 172.21.15.134:0/3948921906 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe630071030 con 0x55659796b350 2024-04-24T02:12:23.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.976+0000 7fe63ffff640 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55659796ddf0 con 0x7fe640031040 2024-04-24T02:12:23.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.977+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe638048040 con 0x7fe640031040 2024-04-24T02:12:23.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.977+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55659796ddf0 con 0x55659796b350 2024-04-24T02:12:23.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.977+0000 7fe63ffff640 1 -- 172.21.15.134:0/3948921906 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe630071030 con 0x55659796b350 2024-04-24T02:12:23.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.977+0000 7fe63ffff640 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55659796ddf0 con 0x55659796b350 2024-04-24T02:12:23.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.977+0000 7fe63ffff640 1 -- 172.21.15.134:0/3948921906 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe630071030 con 0x55659796b350 2024-04-24T02:12:23.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.977+0000 7fe63ffff640 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55659796ddf0 con 0x556597965240 2024-04-24T02:12:23.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.978+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe638048040 con 0x556597965240 2024-04-24T02:12:23.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.978+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55659796ddf0 con 0x556597965240 2024-04-24T02:12:23.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.978+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fe638048040 con 0x556597965240 2024-04-24T02:12:23.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.978+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55659796ddf0 con 0x7fe640031040 2024-04-24T02:12:23.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.979+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe638048040 con 0x7fe640031040 2024-04-24T02:12:23.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.979+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55659796ddf0 con 0x55659796b350 2024-04-24T02:12:23.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.979+0000 7fe63ffff640 1 -- 172.21.15.134:0/3948921906 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe630071030 con 0x55659796b350 2024-04-24T02:12:23.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.979+0000 7fe63ffff640 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55659796ddf0 con 0x7fe630074060 2024-04-24T02:12:23.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.979+0000 7fe645148640 1 -- 172.21.15.134:0/3948921906 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe64001f070 con 0x7fe630074060 2024-04-24T02:12:23.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.979+0000 7fe645148640 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55659796ddf0 con 0x556597965240 2024-04-24T02:12:23.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.979+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe638048040 con 0x556597965240 2024-04-24T02:12:23.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.979+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55659796ddf0 con 0x7fe640031040 2024-04-24T02:12:23.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.979+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe638048040 con 0x7fe640031040 2024-04-24T02:12:23.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.979+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55659796ddf0 con 0x55659796b350 2024-04-24T02:12:23.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.980+0000 7fe63ffff640 1 -- 172.21.15.134:0/3948921906 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe630071030 con 0x55659796b350 2024-04-24T02:12:23.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.980+0000 7fe63ffff640 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55659796ddf0 con 0x7fe640031040 2024-04-24T02:12:23.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.980+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe638048040 con 0x7fe640031040 2024-04-24T02:12:23.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.980+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55659796ddf0 con 0x7fe630074060 2024-04-24T02:12:23.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.980+0000 7fe645148640 1 -- 172.21.15.134:0/3948921906 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe64001f070 con 0x7fe630074060 2024-04-24T02:12:23.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.980+0000 7fe645148640 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55659796ddf0 con 0x55659796b350 2024-04-24T02:12:23.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.980+0000 7fe63ffff640 1 -- 172.21.15.134:0/3948921906 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe630071030 con 0x55659796b350 2024-04-24T02:12:23.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.980+0000 7fe63ffff640 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55659796ddf0 con 0x7fe640031040 2024-04-24T02:12:23.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.981+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe638048040 con 0x7fe640031040 2024-04-24T02:12:23.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.981+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55659796ddf0 con 0x556597965240 2024-04-24T02:12:23.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.981+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe638048040 con 0x556597965240 2024-04-24T02:12:23.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.981+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55659796ddf0 con 0x7fe630074060 2024-04-24T02:12:23.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.981+0000 7fe645148640 1 -- 172.21.15.134:0/3948921906 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe64001f070 con 0x7fe630074060 2024-04-24T02:12:23.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.981+0000 7fe649211800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:23.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.981+0000 7fe649211800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:23.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.981+0000 7fe649211800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:23.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.981+0000 7fe649211800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:23.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.981+0000 7fe649211800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:23.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.981+0000 7fe649211800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:23.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.981+0000 7fe649211800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.981+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556597969dd0 con 0x556597965240 2024-04-24T02:12:23.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.981+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe638048040 con 0x556597965240 2024-04-24T02:12:23.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.981+0000 7fe649211800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.981+0000 7fe649211800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.981+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55659796a670 con 0x556597965240 2024-04-24T02:12:23.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.982+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe638048040 con 0x556597965240 2024-04-24T02:12:23.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.982+0000 7fe649211800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:23.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.982+0000 7fe649211800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.982+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556597969a10 con 0x556597965240 2024-04-24T02:12:23.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.982+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe638048040 con 0x556597965240 2024-04-24T02:12:23.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.982+0000 7fe649211800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:23.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.982+0000 7fe649211800 20 zone default found 2024-04-24T02:12:23.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.982+0000 7fe649211800 4 Realm: () 2024-04-24T02:12:23.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.982+0000 7fe649211800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:23.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.982+0000 7fe649211800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:23.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.982+0000 7fe649211800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:23.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.982+0000 7fe649211800 20 zonegroup default 2024-04-24T02:12:23.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.982+0000 7fe649211800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.982+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55659796e270 con 0x7fe640031040 2024-04-24T02:12:23.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.982+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe638048040 con 0x7fe640031040 2024-04-24T02:12:23.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.982+0000 7fe649211800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.982+0000 7fe649211800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.982+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556597970100 con 0x55659796b350 2024-04-24T02:12:23.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.983+0000 7fe63ffff640 1 -- 172.21.15.134:0/3948921906 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe630071030 con 0x55659796b350 2024-04-24T02:12:23.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.983+0000 7fe649211800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.983+0000 7fe649211800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.983+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5565979704a0 con 0x55659796b350 2024-04-24T02:12:23.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.983+0000 7fe63ffff640 1 -- 172.21.15.134:0/3948921906 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe630071030 con 0x55659796b350 2024-04-24T02:12:23.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.983+0000 7fe649211800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.983+0000 7fe649211800 20 started sync module instance, tier type = 2024-04-24T02:12:23.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.983+0000 7fe649211800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:23.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.983+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55659796f540 con 0x7fe630074060 2024-04-24T02:12:23.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.984+0000 7fe645148640 1 -- 172.21.15.134:0/3948921906 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe640040040 con 0x7fe630074060 2024-04-24T02:12:23.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.984+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93894823311664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55659796fd50 con 0x7fe630074060 2024-04-24T02:12:23.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.984+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5565979711e0 con 0x556597965240 2024-04-24T02:12:23.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.985+0000 7fe645148640 1 -- 172.21.15.134:0/3948921906 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93894823311664] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe640040040 con 0x7fe630074060 2024-04-24T02:12:23.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.985+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe638048040 con 0x556597965240 2024-04-24T02:12:23.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.985+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93894823315520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556597971600 con 0x556597965240 2024-04-24T02:12:23.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.985+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556597972000 con 0x55659796b350 2024-04-24T02:12:23.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.986+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93894823315520] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe638048040 con 0x556597965240 2024-04-24T02:12:23.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.986+0000 7fe63ffff640 1 -- 172.21.15.134:0/3948921906 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe630071030 con 0x55659796b350 2024-04-24T02:12:23.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.986+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93894823316576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5565979723a0 con 0x55659796b350 2024-04-24T02:12:23.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.986+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556597972dc0 con 0x7fe630074060 2024-04-24T02:12:23.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.987+0000 7fe645148640 1 -- 172.21.15.134:0/3948921906 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe640040040 con 0x7fe630074060 2024-04-24T02:12:23.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.987+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93894823323824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556597973660 con 0x7fe630074060 2024-04-24T02:12:23.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.987+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556597974140 con 0x556597965240 2024-04-24T02:12:23.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.987+0000 7fe63ffff640 1 -- 172.21.15.134:0/3948921906 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93894823316576] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe630071030 con 0x55659796b350 2024-04-24T02:12:23.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.988+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe638048040 con 0x556597965240 2024-04-24T02:12:23.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.988+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93894823328848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556597974140 con 0x556597965240 2024-04-24T02:12:23.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.988+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556597974b90 con 0x7fe640031040 2024-04-24T02:12:23.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.988+0000 7fe645148640 1 -- 172.21.15.134:0/3948921906 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93894823323824] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe640040040 con 0x7fe630074060 2024-04-24T02:12:23.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.989+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93894823328848] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe638048040 con 0x556597965240 2024-04-24T02:12:23.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.989+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe638048040 con 0x7fe640031040 2024-04-24T02:12:23.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.989+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93894823320336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5565979746a0 con 0x7fe640031040 2024-04-24T02:12:23.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.989+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556597975460 con 0x7fe640031040 2024-04-24T02:12:23.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.990+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93894823320336] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe638048040 con 0x7fe640031040 2024-04-24T02:12:23.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.990+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(56 notify.6 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe638048040 con 0x7fe640031040 2024-04-24T02:12:23.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.990+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93894823326128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5565979750e0 con 0x7fe640031040 2024-04-24T02:12:23.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.990+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556597975990 con 0x7fe640031040 2024-04-24T02:12:23.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.991+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(58 notify.7 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe638048040 con 0x7fe640031040 2024-04-24T02:12:23.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.991+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93894823326128] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe638048040 con 0x7fe640031040 2024-04-24T02:12:23.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.991+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93894823334112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556597976040 con 0x7fe640031040 2024-04-24T02:12:23.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.991+0000 7fe649211800 20 add_watcher() i=0 2024-04-24T02:12:23.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.991+0000 7fe649211800 20 add_watcher() i=1 2024-04-24T02:12:23.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.991+0000 7fe649211800 20 add_watcher() i=2 2024-04-24T02:12:23.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.991+0000 7fe649211800 20 add_watcher() i=3 2024-04-24T02:12:23.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.991+0000 7fe649211800 20 add_watcher() i=4 2024-04-24T02:12:23.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.991+0000 7fe649211800 20 add_watcher() i=5 2024-04-24T02:12:23.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.991+0000 7fe649211800 20 add_watcher() i=6 2024-04-24T02:12:23.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.992+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93894823334112] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe638048040 con 0x7fe640031040 2024-04-24T02:12:23.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.992+0000 7fe649211800 20 add_watcher() i=7 2024-04-24T02:12:23.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.992+0000 7fe649211800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:23.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.992+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556597978f40 con 0x556597965240 2024-04-24T02:12:23.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.993+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe638048040 con 0x556597965240 2024-04-24T02:12:23.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.993+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93894823336544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556597976330 con 0x556597965240 2024-04-24T02:12:23.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.994+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93894823336544] v30'72 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe638048040 con 0x556597965240 2024-04-24T02:12:23.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.994+0000 7fe4fafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:23.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.994+0000 7fe649211800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:23.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.994+0000 7fe649211800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:23.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.994+0000 7fe649211800 5 note: GC not initialized 2024-04-24T02:12:23.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.994+0000 7fe4f9fe3640 20 reqs_thread_entry: start 2024-04-24T02:12:23.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.994+0000 7fe649211800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:23.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.994+0000 7fe649211800 20 Filter name: none 2024-04-24T02:12:23.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.994+0000 7fe46b7fe640 20 reqs_thread_entry: start 2024-04-24T02:12:23.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.994+0000 7fe649211800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.994+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5565979abc70 con 0x556597965240 2024-04-24T02:12:23.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.995+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7fe638048040 con 0x556597965240 2024-04-24T02:12:23.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.995+0000 7fe649211800 20 rados_obj.operate() r=0 bl.length=502 2024-04-24T02:12:23.020 INFO:teuthology.orchestra.run.smithi134.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T02:12:21.778798Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-04-24T02:12:22.871836Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T02:12:21.778786Z","tags":[],"group_ids":[]} 2024-04-24T02:12:23.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.996+0000 7fe4fafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:23.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.996+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93894823336544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5565979aa820 con 0x556597965240 2024-04-24T02:12:23.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.997+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93894823336544] v30'73 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe638048040 con 0x556597965240 2024-04-24T02:12:23.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.997+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93894823311664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556597975a60 con 0x7fe630074060 2024-04-24T02:12:23.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.998+0000 7fe645148640 1 -- 172.21.15.134:0/3948921906 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93894823311664] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe640040040 con 0x7fe630074060 2024-04-24T02:12:23.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.998+0000 7fe649211800 20 remove_watcher() i=0 2024-04-24T02:12:23.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.998+0000 7fe649211800 2 removed watcher, disabling cache 2024-04-24T02:12:23.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.998+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93894823315520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556597975a60 con 0x556597965240 2024-04-24T02:12:23.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.999+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93894823315520] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe638048040 con 0x556597965240 2024-04-24T02:12:23.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.999+0000 7fe649211800 20 remove_watcher() i=1 2024-04-24T02:12:23.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:22.999+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93894823316576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556597970840 con 0x55659796b350 2024-04-24T02:12:23.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.000+0000 7fe63ffff640 1 -- 172.21.15.134:0/3948921906 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93894823316576] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe630071030 con 0x55659796b350 2024-04-24T02:12:23.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.000+0000 7fe649211800 20 remove_watcher() i=2 2024-04-24T02:12:23.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.000+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93894823323824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556597975a60 con 0x7fe630074060 2024-04-24T02:12:23.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.001+0000 7fe645148640 1 -- 172.21.15.134:0/3948921906 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93894823323824] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe640040040 con 0x7fe630074060 2024-04-24T02:12:23.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.001+0000 7fe649211800 20 remove_watcher() i=3 2024-04-24T02:12:23.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.001+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93894823328848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556597975a60 con 0x556597965240 2024-04-24T02:12:23.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.002+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93894823328848] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe638048040 con 0x556597965240 2024-04-24T02:12:23.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.002+0000 7fe649211800 20 remove_watcher() i=4 2024-04-24T02:12:23.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.002+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93894823320336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556597973c50 con 0x7fe640031040 2024-04-24T02:12:23.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.003+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93894823320336] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe638048040 con 0x7fe640031040 2024-04-24T02:12:23.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.003+0000 7fe649211800 20 remove_watcher() i=5 2024-04-24T02:12:23.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.003+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93894823326128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556597975a60 con 0x7fe640031040 2024-04-24T02:12:23.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.004+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93894823326128] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe638048040 con 0x7fe640031040 2024-04-24T02:12:23.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.004+0000 7fe649211800 20 remove_watcher() i=6 2024-04-24T02:12:23.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.004+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93894823334112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556597975a60 con 0x7fe640031040 2024-04-24T02:12:23.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.004+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93894823334112] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe638048040 con 0x7fe640031040 2024-04-24T02:12:23.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.005+0000 7fe649211800 20 remove_watcher() i=7 2024-04-24T02:12:23.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.005+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fe640031040 msgr2=0x7fe640032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.005+0000 7fe649211800 1 --2- 172.21.15.134:0/3948921906 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fe640031040 0x7fe640032940 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.005+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556597965240 msgr2=0x5565979676d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.005+0000 7fe649211800 1 --2- 172.21.15.134:0/3948921906 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556597965240 0x5565979676d0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.005+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fe630074060 msgr2=0x7fe63008c270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.005+0000 7fe649211800 1 --2- 172.21.15.134:0/3948921906 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fe630074060 0x7fe63008c270 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.005+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55659796b350 msgr2=0x55659796d740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.005+0000 7fe649211800 1 --2- 172.21.15.134:0/3948921906 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55659796b350 0x55659796d740 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.005+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe510036900 msgr2=0x7fe510038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.005+0000 7fe649211800 1 --2- 172.21.15.134:0/3948921906 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe510036900 0x7fe510038dc0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x55659792b8a0 tx=0x7fe64001f000 comp rx=0 tx=0).stop 2024-04-24T02:12:23.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.005+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556597952260 msgr2=0x556597959950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.005+0000 7fe644947640 1 -- 172.21.15.134:0/3948921906 reap_dead start 2024-04-24T02:12:23.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.005+0000 7fe649211800 1 --2- 172.21.15.134:0/3948921906 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556597952260 0x556597959950 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe63008dd50 tx=0x7fe63008dce0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.005+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 shutdown_connections 2024-04-24T02:12:23.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.005+0000 7fe649211800 1 --2- 172.21.15.134:0/3948921906 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556597952260 0x556597959950 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.005+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 >> 172.21.15.134:0/3948921906 conn(0x55659794e5c0 msgr2=0x55659794bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:23.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.005+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 shutdown_connections 2024-04-24T02:12:23.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.005+0000 7fe649211800 1 -- 172.21.15.134:0/3948921906 wait complete. 2024-04-24T02:12:23.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.005+0000 7fe649211800 1 -- 172.21.15.134:0/2679618826 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe51c036950 msgr2=0x7fe51c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.005+0000 7fe649211800 1 --2- 172.21.15.134:0/2679618826 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe51c036950 0x7fe51c038e10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x556597932e80 tx=0x7fe640005840 comp rx=0 tx=0).stop 2024-04-24T02:12:23.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.005+0000 7fe649211800 1 -- 172.21.15.134:0/2679618826 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556597832590 msgr2=0x556597830a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.005+0000 7fe649211800 1 --2- 172.21.15.134:0/2679618826 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556597832590 0x556597830a00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe630044840 tx=0x7fe630002fb0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.005+0000 7fe649211800 1 -- 172.21.15.134:0/2679618826 shutdown_connections 2024-04-24T02:12:23.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.005+0000 7fe649211800 1 --2- 172.21.15.134:0/2679618826 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe51c036950 0x7fe51c038e10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.005+0000 7fe649211800 1 --2- 172.21.15.134:0/2679618826 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556597832590 0x556597830a00 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.005+0000 7fe649211800 1 -- 172.21.15.134:0/2679618826 >> 172.21.15.134:0/2679618826 conn(0x556597936ed0 msgr2=0x5565979372d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:23.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.005+0000 7fe649211800 1 -- 172.21.15.134:0/2679618826 shutdown_connections 2024-04-24T02:12:23.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.005+0000 7fe649211800 1 -- 172.21.15.134:0/2679618826 wait complete. 2024-04-24T02:12:23.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.006+0000 7fe649211800 1 -- 172.21.15.134:0/1167045592 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556597836130 msgr2=0x556597931cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.006+0000 7fe649211800 1 --2- 172.21.15.134:0/1167045592 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556597836130 0x556597931cc0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.006+0000 7fe649211800 1 -- 172.21.15.134:0/1167045592 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe52c036900 msgr2=0x7fe52c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.006+0000 7fe649211800 1 --2- 172.21.15.134:0/1167045592 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe52c036900 0x7fe52c038dc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe630054000 tx=0x7fe63004e000 comp rx=0 tx=0).stop 2024-04-24T02:12:23.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.006+0000 7fe649211800 1 -- 172.21.15.134:0/1167045592 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5565977a51c0 msgr2=0x55659792aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.006+0000 7fe649211800 1 --2- 172.21.15.134:0/1167045592 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5565977a51c0 0x55659792aa80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe63800b210 tx=0x7fe638000ed0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.006+0000 7fe649211800 1 -- 172.21.15.134:0/1167045592 shutdown_connections 2024-04-24T02:12:23.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.006+0000 7fe649211800 1 --2- 172.21.15.134:0/1167045592 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556597836130 0x556597931cc0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.006+0000 7fe649211800 1 --2- 172.21.15.134:0/1167045592 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe52c036900 0x7fe52c038dc0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.006+0000 7fe649211800 1 --2- 172.21.15.134:0/1167045592 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5565977a51c0 0x55659792aa80 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.006+0000 7fe649211800 1 -- 172.21.15.134:0/1167045592 >> 172.21.15.134:0/1167045592 conn(0x55659782c380 msgr2=0x55659791d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:23.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.006+0000 7fe649211800 1 -- 172.21.15.134:0/1167045592 shutdown_connections 2024-04-24T02:12:23.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.006+0000 7fe649211800 1 -- 172.21.15.134:0/1167045592 wait complete. 2024-04-24T02:12:23.032 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T02:12:21.778798Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-04-24T02:12:22.871836Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:12:21.778786Z', 'tags': [], 'group_ids': []} 2024-04-24T02:12:23.033 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-04-24T02:12:23.033 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-04-24T02:12:23.033 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-04-24T02:12:23.112 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:23.112 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:23.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.111+0000 7fcaae72f800 1 Processor -- start 2024-04-24T02:12:23.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.112+0000 7fcaae72f800 1 -- start start 2024-04-24T02:12:23.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.112+0000 7fcaae72f800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55fa56f0f3e0 0x55fa56f117d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.112+0000 7fcaae72f800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fa56dc9d40 con 0x55fa56f0b8d0 2024-04-24T02:12:23.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.112+0000 7fcaae72f800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55fa56d9c4d0 con 0x55fa56f0f3e0 2024-04-24T02:12:23.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.112+0000 7fcaa1cc4640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55fa56f0f3e0 0x55fa56f117d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.112+0000 7fcaaa4c5640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55fa56f0b8d0 0x55fa56f0dcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:43288/0 (socket says 172.21.15.134:43288) 2024-04-24T02:12:23.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.112+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/834851483 learned_addr learned my addr 172.21.15.134:0/834851483 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:12:23.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.112+0000 7fcaa1cc4640 1 -- 172.21.15.134:0/834851483 >> v1:172.21.15.104:6789/0 conn(0x55fa56f0b8d0 legacy=0x55fa56f0dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.112+0000 7fcaa9cc4640 1 -- 172.21.15.134:0/834851483 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3942645014 0 0) 0x55fa56dc9d40 con 0x55fa56f0b8d0 2024-04-24T02:12:23.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.112+0000 7fcaa1cc4640 1 -- 172.21.15.134:0/834851483 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa56dc8590 con 0x55fa56f0f3e0 2024-04-24T02:12:23.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.114+0000 7fcaa1cc4640 1 --2- 172.21.15.134:0/834851483 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa56f0f3e0 0x55fa56f117d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fca9400a470 tx=0x7fca9401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59044ad3ed897f30 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.114+0000 7fcaa9cc4640 1 -- 172.21.15.134:0/834851483 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca94057070 con 0x55fa56f0f3e0 2024-04-24T02:12:23.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.114+0000 7fcaa9cc4640 1 -- 172.21.15.134:0/834851483 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca94052570 con 0x55fa56f0f3e0 2024-04-24T02:12:23.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.114+0000 7fcaa9cc4640 1 -- 172.21.15.134:0/834851483 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca94052870 con 0x55fa56f0f3e0 2024-04-24T02:12:23.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.115+0000 7fcaae72f800 1 -- 172.21.15.134:0/834851483 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa56f0f3e0 msgr2=0x55fa56f117d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.115+0000 7fcaae72f800 1 --2- 172.21.15.134:0/834851483 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa56f0f3e0 0x55fa56f117d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fca9400a470 tx=0x7fca9401ce90 comp rx=0 tx=0).stop 2024-04-24T02:12:23.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.115+0000 7fcaae72f800 1 -- 172.21.15.134:0/834851483 shutdown_connections 2024-04-24T02:12:23.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.115+0000 7fcaae72f800 1 --2- 172.21.15.134:0/834851483 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa56f0f3e0 0x55fa56f117d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.115+0000 7fcaae72f800 1 -- 172.21.15.134:0/834851483 >> 172.21.15.134:0/834851483 conn(0x55fa56f053a0 msgr2=0x55fa56f077c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:23.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.115+0000 7fcaae72f800 1 -- 172.21.15.134:0/834851483 shutdown_connections 2024-04-24T02:12:23.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.115+0000 7fcaae72f800 1 -- 172.21.15.134:0/834851483 wait complete. 2024-04-24T02:12:23.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.126+0000 7fcaae72f800 1 Processor -- start 2024-04-24T02:12:23.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.126+0000 7fcaae72f800 1 -- start start 2024-04-24T02:12:23.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.127+0000 7fcaae72f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa56f0b8d0 0x55fa56ffbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.127+0000 7fcaae72f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55fa56e563b0 con 0x55fa56f0b8d0 2024-04-24T02:12:23.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.127+0000 7fcaaa4c5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa56f0b8d0 0x55fa56ffbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.127+0000 7fcaaa4c5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa56f0b8d0 0x55fa56ffbfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46030/0 (socket says 172.21.15.134:46030) 2024-04-24T02:12:23.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.127+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/2140543865 learned_addr learned my addr 172.21.15.134:0/2140543865 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:23.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.127+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/2140543865 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa56ffc570 con 0x55fa56f0b8d0 2024-04-24T02:12:23.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.127+0000 7fcaaa4c5640 1 --2- 172.21.15.134:0/2140543865 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa56f0b8d0 0x55fa56ffbfa0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fca9c00b210 tx=0x7fca9c00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=685186f85fa3e095 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.128+0000 7fc998608640 1 -- 172.21.15.134:0/2140543865 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca9c008070 con 0x55fa56f0b8d0 2024-04-24T02:12:23.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.128+0000 7fc998608640 1 -- 172.21.15.134:0/2140543865 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca9c00d500 con 0x55fa56f0b8d0 2024-04-24T02:12:23.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.128+0000 7fc998608640 1 -- 172.21.15.134:0/2140543865 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca9c00d840 con 0x55fa56f0b8d0 2024-04-24T02:12:23.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.128+0000 7fcaae72f800 1 -- 172.21.15.134:0/2140543865 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa56f0b8d0 msgr2=0x55fa56ffbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.128+0000 7fcaae72f800 1 --2- 172.21.15.134:0/2140543865 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa56f0b8d0 0x55fa56ffbfa0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fca9c00b210 tx=0x7fca9c00b6d0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.128+0000 7fcaae72f800 1 -- 172.21.15.134:0/2140543865 shutdown_connections 2024-04-24T02:12:23.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.128+0000 7fcaae72f800 1 --2- 172.21.15.134:0/2140543865 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa56f0b8d0 0x55fa56ffbfa0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.128+0000 7fcaae72f800 1 -- 172.21.15.134:0/2140543865 >> 172.21.15.134:0/2140543865 conn(0x55fa56f053a0 msgr2=0x55fa56ff78c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:23.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.128+0000 7fcaae72f800 1 -- 172.21.15.134:0/2140543865 shutdown_connections 2024-04-24T02:12:23.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.128+0000 7fcaae72f800 1 -- 172.21.15.134:0/2140543865 wait complete. 2024-04-24T02:12:23.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.129+0000 7fcaae72f800 1 Processor -- start 2024-04-24T02:12:23.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.129+0000 7fcaae72f800 1 -- start start 2024-04-24T02:12:23.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.129+0000 7fcaae72f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa56f0b8d0 0x55fa56f0b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.129+0000 7fcaae72f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55fa56f12010 con 0x55fa56f0b8d0 2024-04-24T02:12:23.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.129+0000 7fcaaa4c5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa56f0b8d0 0x55fa56f0b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.129+0000 7fcaaa4c5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa56f0b8d0 0x55fa56f0b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46032/0 (socket says 172.21.15.134:46032) 2024-04-24T02:12:23.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.129+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/970333785 learned_addr learned my addr 172.21.15.134:0/970333785 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:23.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.129+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/970333785 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa56f09900 con 0x55fa56f0b8d0 2024-04-24T02:12:23.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.129+0000 7fcaaa4c5640 1 --2- 172.21.15.134:0/970333785 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa56f0b8d0 0x55fa56f0b210 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fca9c00b210 tx=0x7fca9c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.130+0000 7fc996e05640 1 -- 172.21.15.134:0/970333785 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca9c00f950 con 0x55fa56f0b8d0 2024-04-24T02:12:23.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.130+0000 7fc996e05640 1 -- 172.21.15.134:0/970333785 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca9c00faf0 con 0x55fa56f0b8d0 2024-04-24T02:12:23.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.130+0000 7fcaae72f800 1 -- 172.21.15.134:0/970333785 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fa56f09b90 con 0x55fa56f0b8d0 2024-04-24T02:12:23.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.130+0000 7fc996e05640 1 -- 172.21.15.134:0/970333785 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca9c00fdd0 con 0x55fa56f0b8d0 2024-04-24T02:12:23.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.130+0000 7fcaae72f800 1 -- 172.21.15.134:0/970333785 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa56f0a0b0 con 0x55fa56f0b8d0 2024-04-24T02:12:23.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.130+0000 7fc996e05640 1 -- 172.21.15.134:0/970333785 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fca9c017040 con 0x55fa56f0b8d0 2024-04-24T02:12:23.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.131+0000 7fc996e05640 1 --2- 172.21.15.134:0/970333785 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc990036900 0x7fc990038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.131+0000 7fc996e05640 1 -- 172.21.15.134:0/970333785 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fca9c015020 con 0x55fa56f0b8d0 2024-04-24T02:12:23.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.131+0000 7fcaa1cc4640 1 --2- 172.21.15.134:0/970333785 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc990036900 0x7fc990038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.131+0000 7fcaae72f800 1 --2- 172.21.15.134:0/970333785 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55fa56f0f3e0 0x55fa5700cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.131+0000 7fcaae72f800 1 -- 172.21.15.134:0/970333785 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fa5700d4a0 con 0x55fa56f0f3e0 2024-04-24T02:12:23.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.131+0000 7fcaaacc6640 1 --2- 172.21.15.134:0/970333785 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55fa56f0f3e0 0x55fa5700cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.131+0000 7fcaa1cc4640 1 --2- 172.21.15.134:0/970333785 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc990036900 0x7fc990038dc0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fca94054000 tx=0x7fca9404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.131+0000 7fcaaacc6640 1 --2- 172.21.15.134:0/970333785 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55fa56f0f3e0 0x55fa5700cf10 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.131+0000 7fcaaacc6640 1 -- 172.21.15.134:0/970333785 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcaa400a4a0 con 0x55fa56f0f3e0 2024-04-24T02:12:23.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.132+0000 7fcaae72f800 1 -- 172.21.15.134:0/970333785 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fa5700ddb0 con 0x55fa56f0f3e0 2024-04-24T02:12:23.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.132+0000 7fcaaacc6640 1 -- 172.21.15.134:0/970333785 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcaa400a4a0 con 0x55fa56f0f3e0 2024-04-24T02:12:23.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.132+0000 7fcaae72f800 1 -- 172.21.15.134:0/970333785 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fa5700f160 con 0x55fa56f0f3e0 2024-04-24T02:12:23.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.132+0000 7fcaaacc6640 1 -- 172.21.15.134:0/970333785 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcaa400a4a0 con 0x55fa56f0f3e0 2024-04-24T02:12:23.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.132+0000 7fcaae72f800 1 -- 172.21.15.134:0/970333785 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fa5700e600 con 0x55fa56f0f3e0 2024-04-24T02:12:23.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.132+0000 7fcaaacc6640 1 -- 172.21.15.134:0/970333785 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcaa400a4a0 con 0x55fa56f0f3e0 2024-04-24T02:12:23.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.132+0000 7fcaae72f800 1 -- 172.21.15.134:0/970333785 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fa5700ea20 con 0x55fa56f0f3e0 2024-04-24T02:12:23.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.133+0000 7fcaaacc6640 1 -- 172.21.15.134:0/970333785 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcaa400a4a0 con 0x55fa56f0f3e0 2024-04-24T02:12:23.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.133+0000 7fcaae72f800 1 Processor -- start 2024-04-24T02:12:23.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.133+0000 7fcaae72f800 1 -- start start 2024-04-24T02:12:23.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.133+0000 7fcaae72f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa5701e260 0x55fa5701e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.133+0000 7fcaae72f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55fa56f0b750 con 0x55fa5701e260 2024-04-24T02:12:23.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.133+0000 7fcaa1cc4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa5701e260 0x55fa5701e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.133+0000 7fcaa1cc4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa5701e260 0x55fa5701e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46040/0 (socket says 172.21.15.134:46040) 2024-04-24T02:12:23.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.133+0000 7fcaa1cc4640 1 -- 172.21.15.134:0/1493785077 learned_addr learned my addr 172.21.15.134:0/1493785077 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:23.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.134+0000 7fcaa1cc4640 1 -- 172.21.15.134:0/1493785077 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa5701ebc0 con 0x55fa5701e260 2024-04-24T02:12:23.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.134+0000 7fcaa1cc4640 1 --2- 172.21.15.134:0/1493785077 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa5701e260 0x55fa5701e680 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fca94044840 tx=0x7fca94002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.134+0000 7fc98ffff640 1 -- 172.21.15.134:0/1493785077 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca9406f070 con 0x55fa5701e260 2024-04-24T02:12:23.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.134+0000 7fc98ffff640 1 -- 172.21.15.134:0/1493785077 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca94058040 con 0x55fa5701e260 2024-04-24T02:12:23.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.134+0000 7fc98ffff640 1 -- 172.21.15.134:0/1493785077 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca94057050 con 0x55fa5701e260 2024-04-24T02:12:23.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.134+0000 7fcaae72f800 1 -- 172.21.15.134:0/1493785077 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fa5701f630 con 0x55fa5701e260 2024-04-24T02:12:23.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.134+0000 7fcaae72f800 1 -- 172.21.15.134:0/1493785077 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa5701fad0 con 0x55fa5701e260 2024-04-24T02:12:23.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.135+0000 7fc98ffff640 1 -- 172.21.15.134:0/1493785077 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fca94072070 con 0x55fa5701e260 2024-04-24T02:12:23.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.135+0000 7fc98ffff640 1 --2- 172.21.15.134:0/1493785077 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc984036950 0x7fc984038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.135+0000 7fc98ffff640 1 -- 172.21.15.134:0/1493785077 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fca9408f830 con 0x55fa5701e260 2024-04-24T02:12:23.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.135+0000 7fcaaacc6640 1 --2- 172.21.15.134:0/1493785077 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc984036950 0x7fc984038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.135+0000 7fcaae72f800 1 Processor -- start 2024-04-24T02:12:23.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.135+0000 7fcaae72f800 1 -- start start 2024-04-24T02:12:23.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.135+0000 7fcaaacc6640 1 --2- 172.21.15.134:0/1493785077 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc984036950 0x7fc984038e10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x55fa5700e9a0 tx=0x7fcaa4005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.135+0000 7fcaae72f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa5702b4a0 0x55fa5702b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.135+0000 7fcaae72f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55fa56dfc6b0 con 0x55fa5702b4a0 2024-04-24T02:12:23.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.136+0000 7fcaa1cc4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa5702b4a0 0x55fa5702b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.136+0000 7fcaa1cc4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa5702b4a0 0x55fa5702b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46056/0 (socket says 172.21.15.134:46056) 2024-04-24T02:12:23.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.136+0000 7fcaa1cc4640 1 -- 172.21.15.134:0/1805312840 learned_addr learned my addr 172.21.15.134:0/1805312840 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:23.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.136+0000 7fcaa1cc4640 1 -- 172.21.15.134:0/1805312840 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa5702be90 con 0x55fa5702b4a0 2024-04-24T02:12:23.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.136+0000 7fcaa1cc4640 1 --2- 172.21.15.134:0/1805312840 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa5702b4a0 0x55fa5702b8c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fca9408dd50 tx=0x7fca9408df50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f76e14cada84ba8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.136+0000 7fc98dffb640 1 -- 172.21.15.134:0/1805312840 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca9408b030 con 0x55fa5702b4a0 2024-04-24T02:12:23.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.136+0000 7fc98dffb640 1 -- 172.21.15.134:0/1805312840 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca9405e480 con 0x55fa5702b4a0 2024-04-24T02:12:23.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.136+0000 7fc98dffb640 1 -- 172.21.15.134:0/1805312840 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca94087b40 con 0x55fa5702b4a0 2024-04-24T02:12:23.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.137+0000 7fcaae72f800 1 -- 172.21.15.134:0/1805312840 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa5702b4a0 msgr2=0x55fa5702b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.137+0000 7fcaae72f800 1 --2- 172.21.15.134:0/1805312840 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa5702b4a0 0x55fa5702b8c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fca9408dd50 tx=0x7fca9408df50 comp rx=0 tx=0).stop 2024-04-24T02:12:23.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.137+0000 7fcaae72f800 1 -- 172.21.15.134:0/1805312840 shutdown_connections 2024-04-24T02:12:23.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.137+0000 7fcaae72f800 1 --2- 172.21.15.134:0/1805312840 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa5702b4a0 0x55fa5702b8c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.137+0000 7fcaae72f800 1 -- 172.21.15.134:0/1805312840 >> 172.21.15.134:0/1805312840 conn(0x55fa57027800 msgr2=0x55fa57025860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:23.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.137+0000 7fcaae72f800 1 -- 172.21.15.134:0/1805312840 shutdown_connections 2024-04-24T02:12:23.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.137+0000 7fcaae72f800 1 -- 172.21.15.134:0/1805312840 wait complete. 2024-04-24T02:12:23.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.137+0000 7fcaae72f800 1 Processor -- start 2024-04-24T02:12:23.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.137+0000 7fcaae72f800 1 -- start start 2024-04-24T02:12:23.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.137+0000 7fcaae72f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa5702b4a0 0x55fa57032a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.137+0000 7fcaae72f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55fa5702c480 con 0x55fa5702b4a0 2024-04-24T02:12:23.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.137+0000 7fcaa1cc4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa5702b4a0 0x55fa57032a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.137+0000 7fcaa1cc4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa5702b4a0 0x55fa57032a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46064/0 (socket says 172.21.15.134:46064) 2024-04-24T02:12:23.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.137+0000 7fcaa1cc4640 1 -- 172.21.15.134:0/1759587816 learned_addr learned my addr 172.21.15.134:0/1759587816 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:23.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.138+0000 7fcaa1cc4640 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa57032f50 con 0x55fa5702b4a0 2024-04-24T02:12:23.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.138+0000 7fcaa1cc4640 1 --2- 172.21.15.134:0/1759587816 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa5702b4a0 0x55fa57032a10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fca9408dd50 tx=0x7fca9408dce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.138+0000 7fc97bfff640 1 -- 172.21.15.134:0/1759587816 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca94072660 con 0x55fa5702b4a0 2024-04-24T02:12:23.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.138+0000 7fc97bfff640 1 -- 172.21.15.134:0/1759587816 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca9405fe10 con 0x55fa5702b4a0 2024-04-24T02:12:23.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.138+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fa570331e0 con 0x55fa5702b4a0 2024-04-24T02:12:23.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.138+0000 7fc97bfff640 1 -- 172.21.15.134:0/1759587816 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca9405de50 con 0x55fa5702b4a0 2024-04-24T02:12:23.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.138+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa570331e0 con 0x55fa5702b4a0 2024-04-24T02:12:23.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.139+0000 7fc97bfff640 1 -- 172.21.15.134:0/1759587816 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fca9407b020 con 0x55fa5702b4a0 2024-04-24T02:12:23.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.139+0000 7fc97bfff640 1 --2- 172.21.15.134:0/1759587816 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc974036900 0x7fc974038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.139+0000 7fc97bfff640 1 -- 172.21.15.134:0/1759587816 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fca9408c070 con 0x55fa5702b4a0 2024-04-24T02:12:23.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.139+0000 7fcaaacc6640 1 --2- 172.21.15.134:0/1759587816 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc974036900 0x7fc974038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.139+0000 7fcaaacc6640 1 --2- 172.21.15.134:0/1759587816 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc974036900 0x7fc974038dc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x55fa56f0a690 tx=0x7fcaa401f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.139+0000 7fcaae72f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.139+0000 7fcaae72f800 1 --2- 172.21.15.134:0/1759587816 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55fa5703e290 0x55fa57040750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.139+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fa57040ea0 con 0x55fa5703e290 2024-04-24T02:12:23.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.140+0000 7fcaaa4c5640 1 --2- 172.21.15.134:0/1759587816 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55fa5703e290 0x55fa57040750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.140+0000 7fcaaa4c5640 1 --2- 172.21.15.134:0/1759587816 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55fa5703e290 0x55fa57040750 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.140+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca9c02d070 con 0x55fa5703e290 2024-04-24T02:12:23.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.140+0000 7fcaae72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.140+0000 7fcaae72f800 20 realm 2024-04-24T02:12:23.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.140+0000 7fcaae72f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.140+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fa570412b0 con 0x55fa5703e290 2024-04-24T02:12:23.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.140+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca9c02d070 con 0x55fa5703e290 2024-04-24T02:12:23.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.140+0000 7fcaae72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.140+0000 7fcaae72f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:23.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.140+0000 7fcaae72f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.140+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fa57041b80 con 0x55fa5703e290 2024-04-24T02:12:23.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.140+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca9c02d070 con 0x55fa5703e290 2024-04-24T02:12:23.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.140+0000 7fcaae72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.140+0000 7fcaae72f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.140+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fa57041f20 con 0x55fa5703e290 2024-04-24T02:12:23.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.141+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fca9c02d070 con 0x55fa5703e290 2024-04-24T02:12:23.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.141+0000 7fcaae72f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:23.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.141+0000 7fcaae72f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.141+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fa57042770 con 0x55fa5703e290 2024-04-24T02:12:23.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.141+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fca9c02d070 con 0x55fa5703e290 2024-04-24T02:12:23.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.141+0000 7fcaae72f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:23.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.141+0000 7fcaae72f800 20 searching for the correct realm 2024-04-24T02:12:23.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.141+0000 7fcaae72f800 1 --2- 172.21.15.134:0/1759587816 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55fa570444e0 0x55fa570468d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.141+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fa57046eb0 con 0x55fa570444e0 2024-04-24T02:12:23.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.141+0000 7fcaa1cc4640 1 --2- 172.21.15.134:0/1759587816 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55fa570444e0 0x55fa570468d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.141+0000 7fcaa1cc4640 1 --2- 172.21.15.134:0/1759587816 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55fa570444e0 0x55fa570468d0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.142+0000 7fcaa1cc4640 1 -- 172.21.15.134:0/1759587816 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca94071030 con 0x55fa570444e0 2024-04-24T02:12:23.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.142+0000 7fcaa1cc4640 1 --2- 172.21.15.134:0/1759587816 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fca94074060 0x7fca9408c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.142+0000 7fcaa1cc4640 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fa57046eb0 con 0x7fca94074060 2024-04-24T02:12:23.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.142+0000 7fcaaacc6640 1 --2- 172.21.15.134:0/1759587816 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fca94074060 0x7fca9408c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.142+0000 7fcaaacc6640 1 --2- 172.21.15.134:0/1759587816 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fca94074060 0x7fca9408c270 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.142+0000 7fcaaacc6640 1 -- 172.21.15.134:0/1759587816 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcaa401f070 con 0x7fca94074060 2024-04-24T02:12:23.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.142+0000 7fcaaacc6640 1 --2- 172.21.15.134:0/1759587816 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fcaa4031040 0x7fcaa4032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.142+0000 7fcaaacc6640 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fa57046eb0 con 0x7fcaa4031040 2024-04-24T02:12:23.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.143+0000 7fcaaa4c5640 1 --2- 172.21.15.134:0/1759587816 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fcaa4031040 0x7fcaa4032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.143+0000 7fcaaa4c5640 1 --2- 172.21.15.134:0/1759587816 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fcaa4031040 0x7fcaa4032430 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.143+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca9c048040 con 0x7fcaa4031040 2024-04-24T02:12:23.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.143+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fa57046eb0 con 0x55fa5703e290 2024-04-24T02:12:23.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.144+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca9c048040 con 0x55fa5703e290 2024-04-24T02:12:23.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.144+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fa57046eb0 con 0x55fa5703e290 2024-04-24T02:12:23.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.144+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fca9c048040 con 0x55fa5703e290 2024-04-24T02:12:23.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.144+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fa57046eb0 con 0x7fcaa4031040 2024-04-24T02:12:23.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.144+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca9c048040 con 0x7fcaa4031040 2024-04-24T02:12:23.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.144+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fa57046eb0 con 0x7fcaa4031040 2024-04-24T02:12:23.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.144+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca9c048040 con 0x7fcaa4031040 2024-04-24T02:12:23.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.144+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fa57046eb0 con 0x7fca94074060 2024-04-24T02:12:23.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.144+0000 7fcaaacc6640 1 -- 172.21.15.134:0/1759587816 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcaa401f070 con 0x7fca94074060 2024-04-24T02:12:23.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.144+0000 7fcaaacc6640 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fa57046eb0 con 0x55fa570444e0 2024-04-24T02:12:23.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.145+0000 7fcaa1cc4640 1 -- 172.21.15.134:0/1759587816 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca94071030 con 0x55fa570444e0 2024-04-24T02:12:23.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.145+0000 7fcaa1cc4640 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fa57046eb0 con 0x55fa5703e290 2024-04-24T02:12:23.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.145+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca9c048040 con 0x55fa5703e290 2024-04-24T02:12:23.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.145+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fa57046eb0 con 0x7fcaa4031040 2024-04-24T02:12:23.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.145+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca9c048040 con 0x7fcaa4031040 2024-04-24T02:12:23.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.145+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fa57046eb0 con 0x55fa5703e290 2024-04-24T02:12:23.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.145+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca9c048040 con 0x55fa5703e290 2024-04-24T02:12:23.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.145+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fa57046eb0 con 0x7fca94074060 2024-04-24T02:12:23.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.146+0000 7fcaaacc6640 1 -- 172.21.15.134:0/1759587816 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcaa401f070 con 0x7fca94074060 2024-04-24T02:12:23.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.146+0000 7fcaaacc6640 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fa57046eb0 con 0x55fa570444e0 2024-04-24T02:12:23.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.146+0000 7fcaa1cc4640 1 -- 172.21.15.134:0/1759587816 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca94071030 con 0x55fa570444e0 2024-04-24T02:12:23.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.146+0000 7fcaa1cc4640 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fa57046eb0 con 0x55fa570444e0 2024-04-24T02:12:23.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.146+0000 7fcaa1cc4640 1 -- 172.21.15.134:0/1759587816 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca94071030 con 0x55fa570444e0 2024-04-24T02:12:23.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.146+0000 7fcaa1cc4640 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fa57046eb0 con 0x7fcaa4031040 2024-04-24T02:12:23.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.146+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca9c048040 con 0x7fcaa4031040 2024-04-24T02:12:23.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.146+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fa57046eb0 con 0x55fa570444e0 2024-04-24T02:12:23.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.147+0000 7fcaa1cc4640 1 -- 172.21.15.134:0/1759587816 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca94071030 con 0x55fa570444e0 2024-04-24T02:12:23.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.147+0000 7fcaa1cc4640 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fa57046eb0 con 0x55fa570444e0 2024-04-24T02:12:23.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.147+0000 7fcaa1cc4640 1 -- 172.21.15.134:0/1759587816 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca94071030 con 0x55fa570444e0 2024-04-24T02:12:23.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.147+0000 7fcaa1cc4640 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fa57046eb0 con 0x55fa5703e290 2024-04-24T02:12:23.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.147+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca9c048040 con 0x55fa5703e290 2024-04-24T02:12:23.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.147+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fa57046eb0 con 0x55fa5703e290 2024-04-24T02:12:23.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.147+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fca9c048040 con 0x55fa5703e290 2024-04-24T02:12:23.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.147+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fa57046eb0 con 0x7fcaa4031040 2024-04-24T02:12:23.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.147+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca9c048040 con 0x7fcaa4031040 2024-04-24T02:12:23.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.147+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fa57046eb0 con 0x55fa570444e0 2024-04-24T02:12:23.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.148+0000 7fcaa1cc4640 1 -- 172.21.15.134:0/1759587816 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca94071030 con 0x55fa570444e0 2024-04-24T02:12:23.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.148+0000 7fcaa1cc4640 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fa57046eb0 con 0x7fca94074060 2024-04-24T02:12:23.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.148+0000 7fcaaacc6640 1 -- 172.21.15.134:0/1759587816 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcaa401f070 con 0x7fca94074060 2024-04-24T02:12:23.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.148+0000 7fcaaacc6640 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fa57046eb0 con 0x55fa5703e290 2024-04-24T02:12:23.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.148+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca9c048040 con 0x55fa5703e290 2024-04-24T02:12:23.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.148+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fa57046eb0 con 0x7fcaa4031040 2024-04-24T02:12:23.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.148+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca9c048040 con 0x7fcaa4031040 2024-04-24T02:12:23.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.148+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fa57046eb0 con 0x55fa570444e0 2024-04-24T02:12:23.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.149+0000 7fcaa1cc4640 1 -- 172.21.15.134:0/1759587816 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca94071030 con 0x55fa570444e0 2024-04-24T02:12:23.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.149+0000 7fcaa1cc4640 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fa57046eb0 con 0x7fcaa4031040 2024-04-24T02:12:23.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.149+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca9c048040 con 0x7fcaa4031040 2024-04-24T02:12:23.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.149+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fa57046eb0 con 0x7fca94074060 2024-04-24T02:12:23.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.149+0000 7fcaaacc6640 1 -- 172.21.15.134:0/1759587816 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcaa401f070 con 0x7fca94074060 2024-04-24T02:12:23.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.149+0000 7fcaaacc6640 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fa57046eb0 con 0x55fa570444e0 2024-04-24T02:12:23.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.149+0000 7fcaa1cc4640 1 -- 172.21.15.134:0/1759587816 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca94071030 con 0x55fa570444e0 2024-04-24T02:12:23.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.149+0000 7fcaa1cc4640 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fa57046eb0 con 0x7fcaa4031040 2024-04-24T02:12:23.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.150+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca9c048040 con 0x7fcaa4031040 2024-04-24T02:12:23.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.150+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fa57046eb0 con 0x55fa5703e290 2024-04-24T02:12:23.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.150+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fca9c048040 con 0x55fa5703e290 2024-04-24T02:12:23.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.150+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fa57046eb0 con 0x7fca94074060 2024-04-24T02:12:23.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.151+0000 7fcaaacc6640 1 -- 172.21.15.134:0/1759587816 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcaa401f070 con 0x7fca94074060 2024-04-24T02:12:23.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.151+0000 7fcaae72f800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:23.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.151+0000 7fcaae72f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:23.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.151+0000 7fcaae72f800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:23.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.151+0000 7fcaae72f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:23.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.151+0000 7fcaae72f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:23.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.151+0000 7fcaae72f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:23.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.151+0000 7fcaae72f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.151+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fa57043120 con 0x55fa5703e290 2024-04-24T02:12:23.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.151+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca9c048040 con 0x55fa5703e290 2024-04-24T02:12:23.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.151+0000 7fcaae72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.151+0000 7fcaae72f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.151+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fa570439c0 con 0x55fa5703e290 2024-04-24T02:12:23.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.151+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fca9c048040 con 0x55fa5703e290 2024-04-24T02:12:23.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.151+0000 7fcaae72f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:23.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.151+0000 7fcaae72f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.151+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fa57047330 con 0x55fa5703e290 2024-04-24T02:12:23.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.151+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fca9c048040 con 0x55fa5703e290 2024-04-24T02:12:23.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.151+0000 7fcaae72f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:23.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.151+0000 7fcaae72f800 20 zone default found 2024-04-24T02:12:23.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.151+0000 7fcaae72f800 4 Realm: () 2024-04-24T02:12:23.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.151+0000 7fcaae72f800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:23.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.151+0000 7fcaae72f800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:23.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.151+0000 7fcaae72f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:23.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.151+0000 7fcaae72f800 20 zonegroup default 2024-04-24T02:12:23.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.151+0000 7fcaae72f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.151+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fa570477e0 con 0x7fcaa4031040 2024-04-24T02:12:23.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.152+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fca9c048040 con 0x7fcaa4031040 2024-04-24T02:12:23.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.152+0000 7fcaae72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.152+0000 7fcaae72f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.152+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fa570491c0 con 0x55fa570444e0 2024-04-24T02:12:23.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.152+0000 7fcaa1cc4640 1 -- 172.21.15.134:0/1759587816 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fca94071030 con 0x55fa570444e0 2024-04-24T02:12:23.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.152+0000 7fcaae72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.152+0000 7fcaae72f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.152+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fa570496b0 con 0x55fa570444e0 2024-04-24T02:12:23.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.152+0000 7fcaa1cc4640 1 -- 172.21.15.134:0/1759587816 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fca94071030 con 0x55fa570444e0 2024-04-24T02:12:23.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.152+0000 7fcaae72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.153+0000 7fcaae72f800 20 started sync module instance, tier type = 2024-04-24T02:12:23.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.153+0000 7fcaae72f800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:23.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.153+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fa57048650 con 0x7fca94074060 2024-04-24T02:12:23.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.154+0000 7fcaaacc6640 1 -- 172.21.15.134:0/1759587816 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcaa4040040 con 0x7fca94074060 2024-04-24T02:12:23.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.154+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94533690100288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fa570482b0 con 0x7fca94074060 2024-04-24T02:12:23.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.154+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fa5704a4b0 con 0x55fa5703e290 2024-04-24T02:12:23.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.155+0000 7fcaaacc6640 1 -- 172.21.15.134:0/1759587816 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94533690100288] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcaa4040040 con 0x7fca94074060 2024-04-24T02:12:23.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.155+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca9c048040 con 0x55fa5703e290 2024-04-24T02:12:23.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.155+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94533690104592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fa5704a3e0 con 0x55fa5703e290 2024-04-24T02:12:23.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.155+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fa5704af00 con 0x55fa570444e0 2024-04-24T02:12:23.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.156+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94533690104592] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca9c048040 con 0x55fa5703e290 2024-04-24T02:12:23.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.156+0000 7fcaa1cc4640 1 -- 172.21.15.134:0/1759587816 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca94071030 con 0x55fa570444e0 2024-04-24T02:12:23.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.156+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94533690105648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fa5704a350 con 0x55fa570444e0 2024-04-24T02:12:23.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.156+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fa5704bdc0 con 0x7fca94074060 2024-04-24T02:12:23.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.157+0000 7fcaa1cc4640 1 -- 172.21.15.134:0/1759587816 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94533690105648] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca94071030 con 0x55fa570444e0 2024-04-24T02:12:23.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.157+0000 7fcaaacc6640 1 -- 172.21.15.134:0/1759587816 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcaa4040040 con 0x7fca94074060 2024-04-24T02:12:23.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.157+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94533690112272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fa5704c1e0 con 0x7fca94074060 2024-04-24T02:12:23.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.157+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fa5704cba0 con 0x55fa5703e290 2024-04-24T02:12:23.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.158+0000 7fcaaacc6640 1 -- 172.21.15.134:0/1759587816 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94533690112272] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcaa4040040 con 0x7fca94074060 2024-04-24T02:12:23.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.158+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca9c048040 con 0x55fa5703e290 2024-04-24T02:12:23.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.158+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94533690113808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fa5704cba0 con 0x55fa5703e290 2024-04-24T02:12:23.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.158+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fa5704d560 con 0x7fcaa4031040 2024-04-24T02:12:23.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.159+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca9c048040 con 0x7fcaa4031040 2024-04-24T02:12:23.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.159+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94533690118320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fa5704d4d0 con 0x7fcaa4031040 2024-04-24T02:12:23.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.159+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fa5704e4e0 con 0x7fcaa4031040 2024-04-24T02:12:23.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.159+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94533690113808] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca9c048040 con 0x55fa5703e290 2024-04-24T02:12:23.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.160+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94533690118320] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca9c048040 con 0x7fcaa4031040 2024-04-24T02:12:23.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.160+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(56 notify.6 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca9c048040 con 0x7fcaa4031040 2024-04-24T02:12:23.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.160+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94533690122192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fa5704d900 con 0x7fcaa4031040 2024-04-24T02:12:23.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.160+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fa5704eac0 con 0x7fcaa4031040 2024-04-24T02:12:23.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.161+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(58 notify.7 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca9c048040 con 0x7fcaa4031040 2024-04-24T02:12:23.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.161+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94533690122192] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca9c048040 con 0x7fcaa4031040 2024-04-24T02:12:23.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.161+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94533690123792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fa5704eee0 con 0x7fcaa4031040 2024-04-24T02:12:23.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.161+0000 7fcaae72f800 20 add_watcher() i=0 2024-04-24T02:12:23.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.161+0000 7fcaae72f800 20 add_watcher() i=1 2024-04-24T02:12:23.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.161+0000 7fcaae72f800 20 add_watcher() i=2 2024-04-24T02:12:23.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.161+0000 7fcaae72f800 20 add_watcher() i=3 2024-04-24T02:12:23.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.161+0000 7fcaae72f800 20 add_watcher() i=4 2024-04-24T02:12:23.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.161+0000 7fcaae72f800 20 add_watcher() i=5 2024-04-24T02:12:23.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.161+0000 7fcaae72f800 20 add_watcher() i=6 2024-04-24T02:12:23.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.162+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94533690123792] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca9c048040 con 0x7fcaa4031040 2024-04-24T02:12:23.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.162+0000 7fcaae72f800 20 add_watcher() i=7 2024-04-24T02:12:23.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.162+0000 7fcaae72f800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:23.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.162+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fa5704eee0 con 0x55fa5703e290 2024-04-24T02:12:23.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.163+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fca9c048040 con 0x55fa5703e290 2024-04-24T02:12:23.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.163+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94533690124848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fa5704ee50 con 0x55fa5703e290 2024-04-24T02:12:23.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.163+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94533690124848] v30'74 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fca9c048040 con 0x55fa5703e290 2024-04-24T02:12:23.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.163+0000 7fc960fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:23.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.164+0000 7fcaae72f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:23.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.164+0000 7fcaae72f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:23.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.164+0000 7fcaae72f800 5 note: GC not initialized 2024-04-24T02:12:23.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.164+0000 7fc8db7fe640 20 reqs_thread_entry: start 2024-04-24T02:12:23.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.164+0000 7fcaae72f800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:23.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.164+0000 7fcaae72f800 20 Filter name: none 2024-04-24T02:12:23.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.164+0000 7fc8d97fa640 20 reqs_thread_entry: start 2024-04-24T02:12:23.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.164+0000 7fcaae72f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T02:12:23.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.164+0000 7fcaae72f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.164+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fa570850d0 con 0x55fa5703e290 2024-04-24T02:12:23.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.164+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7fca9c048040 con 0x55fa5703e290 2024-04-24T02:12:23.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.164+0000 7fcaae72f800 20 rados_obj.operate() r=0 bl.length=502 2024-04-24T02:12:23.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.164+0000 7fcaae72f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T02:12:23.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.164+0000 7fcaae72f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:23.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.164+0000 7fcaae72f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:12:23.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.165+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fa5708b760 con 0x55fa5703e290 2024-04-24T02:12:23.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.166+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v30'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fca9c048040 con 0x55fa5703e290 2024-04-24T02:12:23.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.166+0000 7fcaae72f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T02:12:23.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.166+0000 7fcaae72f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:23.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.166+0000 7fcaae72f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-24T02:12:23.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.166+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94533690372560 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fa57086e70 con 0x55fa5703e290 2024-04-24T02:12:23.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.166+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== watch-notify(notify (1) cookie 94533690113808 notify 128849018884 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7fca9c052040 con 0x55fa5703e290 2024-04-24T02:12:23.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.166+0000 7fc98dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018884 cookie 94533690113808 notifier 4348 bl.length()=567 2024-04-24T02:12:23.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.166+0000 7fc98dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T02:12:23.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.166+0000 7fc98dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:23.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.166+0000 7fc98dffb640 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fc970003ea0 con 0x55fa5703e290 2024-04-24T02:12:23.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.166+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(64 notify.4 [notify cookie 94533690372560 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fca9c048040 con 0x55fa5703e290 2024-04-24T02:12:23.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.166+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca9c048040 con 0x55fa5703e290 2024-04-24T02:12:23.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.166+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== watch-notify(notify_complete (2) cookie 94533690372560 notify 128849018884 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fca9c036040 con 0x55fa5703e290 2024-04-24T02:12:23.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.166+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:66 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fa5708b1d0 con 0x7fcaa4031040 2024-04-24T02:12:23.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.167+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(66 p5YnriCv1nAtykxBrupQ [delete] v30'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fca9c048040 con 0x7fcaa4031040 2024-04-24T02:12:23.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.167+0000 7fcaae72f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-24T02:12:23.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.167+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94533690372560 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fa570869c0 con 0x55fa570444e0 2024-04-24T02:12:23.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.168+0000 7fcaa1cc4640 1 -- 172.21.15.134:0/1759587816 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== watch-notify(notify (1) cookie 94533690105648 notify 128849018881 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55fa57032f50 con 0x55fa570444e0 2024-04-24T02:12:23.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.168+0000 7fc98d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018881 cookie 94533690105648 notifier 4348 bl.length()=170 2024-04-24T02:12:23.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.168+0000 7fc98d7fa640 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fc8e00032c0 con 0x55fa570444e0 2024-04-24T02:12:23.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.168+0000 7fcaa1cc4640 1 -- 172.21.15.134:0/1759587816 <== osd.3 v2:172.21.15.134:6801/3585115521 15 ==== osd_op_reply(67 notify.2 [notify cookie 94533690372560 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fca94071030 con 0x55fa570444e0 2024-04-24T02:12:23.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.168+0000 7fcaa1cc4640 1 -- 172.21.15.134:0/1759587816 <== osd.3 v2:172.21.15.134:6801/3585115521 16 ==== watch-notify(notify_complete (2) cookie 94533690372560 notify 128849018881 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fca94085040 con 0x55fa570444e0 2024-04-24T02:12:23.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.168+0000 7fcaa1cc4640 1 -- 172.21.15.134:0/1759587816 <== osd.3 v2:172.21.15.134:6801/3585115521 17 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca94071030 con 0x55fa570444e0 2024-04-24T02:12:23.199 INFO:teuthology.orchestra.run.smithi134.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T02:12:21.778798Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T02:12:21.778786Z","tags":[],"group_ids":[]} 2024-04-24T02:12:23.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.169+0000 7fc960fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:23.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.169+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94533690124848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fa57085810 con 0x55fa5703e290 2024-04-24T02:12:23.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.170+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94533690124848] v30'75 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fca9c048040 con 0x55fa5703e290 2024-04-24T02:12:23.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.170+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94533690100288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fa5704ea30 con 0x7fca94074060 2024-04-24T02:12:23.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.171+0000 7fcaaacc6640 1 -- 172.21.15.134:0/1759587816 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94533690100288] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcaa4040040 con 0x7fca94074060 2024-04-24T02:12:23.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.171+0000 7fcaae72f800 20 remove_watcher() i=0 2024-04-24T02:12:23.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.171+0000 7fcaae72f800 2 removed watcher, disabling cache 2024-04-24T02:12:23.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.171+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94533690104592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fa5704ea30 con 0x55fa5703e290 2024-04-24T02:12:23.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.172+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.1 v2:172.21.15.134:6804/1487076214 30 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94533690104592] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca9c048040 con 0x55fa5703e290 2024-04-24T02:12:23.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.172+0000 7fcaae72f800 20 remove_watcher() i=1 2024-04-24T02:12:23.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.172+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94533690105648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fa57049b10 con 0x55fa570444e0 2024-04-24T02:12:23.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.173+0000 7fcaa1cc4640 1 -- 172.21.15.134:0/1759587816 <== osd.3 v2:172.21.15.134:6801/3585115521 18 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94533690105648] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca94071030 con 0x55fa570444e0 2024-04-24T02:12:23.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.173+0000 7fcaae72f800 20 remove_watcher() i=2 2024-04-24T02:12:23.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.173+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94533690112272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fa5704ea30 con 0x7fca94074060 2024-04-24T02:12:23.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.174+0000 7fcaaacc6640 1 -- 172.21.15.134:0/1759587816 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94533690112272] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcaa4040040 con 0x7fca94074060 2024-04-24T02:12:23.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.174+0000 7fcaae72f800 20 remove_watcher() i=3 2024-04-24T02:12:23.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.174+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94533690113808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fa5704b910 con 0x55fa5703e290 2024-04-24T02:12:23.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.175+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.1 v2:172.21.15.134:6804/1487076214 31 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94533690113808] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca9c048040 con 0x55fa5703e290 2024-04-24T02:12:23.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.175+0000 7fcaae72f800 20 remove_watcher() i=4 2024-04-24T02:12:23.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.175+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94533690118320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fa5704ea30 con 0x7fcaa4031040 2024-04-24T02:12:23.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.176+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94533690118320] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca9c048040 con 0x7fcaa4031040 2024-04-24T02:12:23.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.176+0000 7fcaae72f800 20 remove_watcher() i=5 2024-04-24T02:12:23.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.176+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94533690122192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fa5704bf10 con 0x7fcaa4031040 2024-04-24T02:12:23.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.177+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94533690122192] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca9c048040 con 0x7fcaa4031040 2024-04-24T02:12:23.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.177+0000 7fcaae72f800 20 remove_watcher() i=6 2024-04-24T02:12:23.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.177+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94533690123792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fa5704b910 con 0x7fcaa4031040 2024-04-24T02:12:23.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.177+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 <== osd.0 v2:172.21.15.104:6800/2419146313 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94533690123792] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca9c048040 con 0x7fcaa4031040 2024-04-24T02:12:23.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.178+0000 7fcaae72f800 20 remove_watcher() i=7 2024-04-24T02:12:23.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.178+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fcaa4031040 msgr2=0x7fcaa4032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.178+0000 7fcaae72f800 1 --2- 172.21.15.134:0/1759587816 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fcaa4031040 0x7fcaa4032430 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.178+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55fa5703e290 msgr2=0x55fa57040750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.178+0000 7fcaae72f800 1 --2- 172.21.15.134:0/1759587816 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55fa5703e290 0x55fa57040750 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.178+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fca94074060 msgr2=0x7fca9408c270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.178+0000 7fcaae72f800 1 --2- 172.21.15.134:0/1759587816 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fca94074060 0x7fca9408c270 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.178+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55fa570444e0 msgr2=0x55fa570468d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.178+0000 7fcaae72f800 1 --2- 172.21.15.134:0/1759587816 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55fa570444e0 0x55fa570468d0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.178+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc974036900 msgr2=0x7fc974038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.178+0000 7fcaae72f800 1 --2- 172.21.15.134:0/1759587816 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc974036900 0x7fc974038dc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x55fa56f0a690 tx=0x7fcaa401f000 comp rx=0 tx=0).stop 2024-04-24T02:12:23.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.178+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa5702b4a0 msgr2=0x55fa57032a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.178+0000 7fcaae72f800 1 --2- 172.21.15.134:0/1759587816 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa5702b4a0 0x55fa57032a10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fca9408dd50 tx=0x7fca9408dce0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.178+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 reap_dead start 2024-04-24T02:12:23.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.178+0000 7fcaaa4c5640 1 -- 172.21.15.134:0/1759587816 reap_dead start 2024-04-24T02:12:23.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.178+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 shutdown_connections 2024-04-24T02:12:23.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.178+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 >> 172.21.15.134:0/1759587816 conn(0x55fa57027800 msgr2=0x55fa57024e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:23.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.178+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 shutdown_connections 2024-04-24T02:12:23.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.178+0000 7fcaae72f800 1 -- 172.21.15.134:0/1759587816 wait complete. 2024-04-24T02:12:23.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.178+0000 7fcaae72f800 1 -- 172.21.15.134:0/1493785077 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc984036950 msgr2=0x7fc984038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.178+0000 7fcaae72f800 1 --2- 172.21.15.134:0/1493785077 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc984036950 0x7fc984038e10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x55fa5700e9a0 tx=0x7fcaa4005840 comp rx=0 tx=0).stop 2024-04-24T02:12:23.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.178+0000 7fcaae72f800 1 -- 172.21.15.134:0/1493785077 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa5701e260 msgr2=0x55fa5701e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.178+0000 7fcaae72f800 1 --2- 172.21.15.134:0/1493785077 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa5701e260 0x55fa5701e680 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fca94044840 tx=0x7fca94002fb0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.178+0000 7fcaae72f800 1 -- 172.21.15.134:0/1493785077 shutdown_connections 2024-04-24T02:12:23.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.178+0000 7fcaae72f800 1 --2- 172.21.15.134:0/1493785077 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc984036950 0x7fc984038e10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.178+0000 7fcaae72f800 1 --2- 172.21.15.134:0/1493785077 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa5701e260 0x55fa5701e680 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.178+0000 7fcaae72f800 1 -- 172.21.15.134:0/1493785077 >> 172.21.15.134:0/1493785077 conn(0x55fa57012300 msgr2=0x55fa57012700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:23.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.178+0000 7fcaae72f800 1 -- 172.21.15.134:0/1493785077 shutdown_connections 2024-04-24T02:12:23.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.178+0000 7fcaae72f800 1 -- 172.21.15.134:0/1493785077 wait complete. 2024-04-24T02:12:23.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.179+0000 7fcaae72f800 1 -- 172.21.15.134:0/970333785 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55fa56f0f3e0 msgr2=0x55fa5700cf10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.179+0000 7fcaae72f800 1 --2- 172.21.15.134:0/970333785 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55fa56f0f3e0 0x55fa5700cf10 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.179+0000 7fcaae72f800 1 -- 172.21.15.134:0/970333785 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc990036900 msgr2=0x7fc990038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.179+0000 7fcaae72f800 1 --2- 172.21.15.134:0/970333785 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc990036900 0x7fc990038dc0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fca94054000 tx=0x7fca9404e000 comp rx=0 tx=0).stop 2024-04-24T02:12:23.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.179+0000 7fcaae72f800 1 -- 172.21.15.134:0/970333785 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa56f0b8d0 msgr2=0x55fa56f0b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.179+0000 7fcaae72f800 1 --2- 172.21.15.134:0/970333785 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa56f0b8d0 0x55fa56f0b210 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fca9c00b210 tx=0x7fca9c000ed0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.179+0000 7fcaae72f800 1 -- 172.21.15.134:0/970333785 shutdown_connections 2024-04-24T02:12:23.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.179+0000 7fcaae72f800 1 --2- 172.21.15.134:0/970333785 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55fa56f0f3e0 0x55fa5700cf10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.179+0000 7fcaae72f800 1 --2- 172.21.15.134:0/970333785 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc990036900 0x7fc990038dc0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.179+0000 7fcaae72f800 1 --2- 172.21.15.134:0/970333785 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fa56f0b8d0 0x55fa56f0b210 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.179+0000 7fcaae72f800 1 -- 172.21.15.134:0/970333785 >> 172.21.15.134:0/970333785 conn(0x55fa56f053a0 msgr2=0x55fa56ff6140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:23.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.179+0000 7fcaae72f800 1 -- 172.21.15.134:0/970333785 shutdown_connections 2024-04-24T02:12:23.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.179+0000 7fcaae72f800 1 -- 172.21.15.134:0/970333785 wait complete. 2024-04-24T02:12:23.211 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T02:12:21.778798Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:12:21.778786Z', 'tags': [], 'group_ids': []} 2024-04-24T02:12:23.211 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-04-24T02:12:23.211 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-04-24T02:12:23.211 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-04-24T02:12:23.256 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:23.256 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:23.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.255+0000 7f79ee519800 1 Processor -- start 2024-04-24T02:12:23.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.255+0000 7f79ee519800 1 -- start start 2024-04-24T02:12:23.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.256+0000 7f79ee519800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55d28845d8d0 0x55d28845fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.256+0000 7f79ee519800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d28831bd40 con 0x55d288460200 2024-04-24T02:12:23.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.256+0000 7f79ee519800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55d2882ee4d0 con 0x55d28845d8d0 2024-04-24T02:12:23.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.256+0000 7f79ec018640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55d28845d8d0 0x55d28845fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.256+0000 7f79ec018640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55d28845d8d0 0x55d28845fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46070/0 (socket says 172.21.15.134:46070) 2024-04-24T02:12:23.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.256+0000 7f79ec018640 1 -- 172.21.15.134:0/3223696372 learned_addr learned my addr 172.21.15.134:0/3223696372 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:23.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.256+0000 7f79ec018640 1 -- 172.21.15.134:0/3223696372 >> v1:172.21.15.104:6789/0 conn(0x55d288460200 legacy=0x55d2884625f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.256+0000 7f79ec018640 1 -- 172.21.15.134:0/3223696372 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d28831a590 con 0x55d28845d8d0 2024-04-24T02:12:23.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.258+0000 7f79ec018640 1 --2- 172.21.15.134:0/3223696372 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d28845d8d0 0x55d28845fcc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f79dc00a520 tx=0x7f79dc01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2879b8077c5bb57c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.258+0000 7f79eb817640 1 -- 172.21.15.134:0/3223696372 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79dc057070 con 0x55d28845d8d0 2024-04-24T02:12:23.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.258+0000 7f79eb817640 1 -- 172.21.15.134:0/3223696372 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79dc052570 con 0x55d28845d8d0 2024-04-24T02:12:23.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.258+0000 7f79eb817640 1 -- 172.21.15.134:0/3223696372 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79dc04ae60 con 0x55d28845d8d0 2024-04-24T02:12:23.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.259+0000 7f79ee519800 1 -- 172.21.15.134:0/3223696372 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d28845d8d0 msgr2=0x55d28845fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.259+0000 7f79ee519800 1 --2- 172.21.15.134:0/3223696372 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d28845d8d0 0x55d28845fcc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f79dc00a520 tx=0x7f79dc01d010 comp rx=0 tx=0).stop 2024-04-24T02:12:23.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.259+0000 7f79ee519800 1 -- 172.21.15.134:0/3223696372 shutdown_connections 2024-04-24T02:12:23.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.259+0000 7f79ee519800 1 --2- 172.21.15.134:0/3223696372 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d28845d8d0 0x55d28845fcc0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.259+0000 7f79ee519800 1 -- 172.21.15.134:0/3223696372 >> 172.21.15.134:0/3223696372 conn(0x55d2884573a0 msgr2=0x55d2884597c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:23.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.259+0000 7f79ee519800 1 -- 172.21.15.134:0/3223696372 shutdown_connections 2024-04-24T02:12:23.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.259+0000 7f79ee519800 1 -- 172.21.15.134:0/3223696372 wait complete. 2024-04-24T02:12:23.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.270+0000 7f79ee519800 1 Processor -- start 2024-04-24T02:12:23.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.271+0000 7f79ee519800 1 -- start start 2024-04-24T02:12:23.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.271+0000 7f79ee519800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d28845d8d0 0x55d28854e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.271+0000 7f79ee519800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d2883a83b0 con 0x55d28845d8d0 2024-04-24T02:12:23.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.271+0000 7f79ec018640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d28845d8d0 0x55d28854e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.271+0000 7f79ec018640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d28845d8d0 0x55d28854e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46082/0 (socket says 172.21.15.134:46082) 2024-04-24T02:12:23.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.271+0000 7f79ec018640 1 -- 172.21.15.134:0/2722937267 learned_addr learned my addr 172.21.15.134:0/2722937267 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:23.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.271+0000 7f79ec018640 1 -- 172.21.15.134:0/2722937267 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d28854e6c0 con 0x55d28845d8d0 2024-04-24T02:12:23.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.272+0000 7f79ec018640 1 --2- 172.21.15.134:0/2722937267 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d28845d8d0 0x55d28854e0f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f79dc055040 tx=0x7f79dc04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cdecec4bc38ae57 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.272+0000 7f78da60c640 1 -- 172.21.15.134:0/2722937267 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79dc057040 con 0x55d28845d8d0 2024-04-24T02:12:23.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.272+0000 7f78da60c640 1 -- 172.21.15.134:0/2722937267 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79dc052720 con 0x55d28845d8d0 2024-04-24T02:12:23.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.272+0000 7f78da60c640 1 -- 172.21.15.134:0/2722937267 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79dc052a40 con 0x55d28845d8d0 2024-04-24T02:12:23.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.273+0000 7f79ee519800 1 -- 172.21.15.134:0/2722937267 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d28845d8d0 msgr2=0x55d28854e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.273+0000 7f79ee519800 1 --2- 172.21.15.134:0/2722937267 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d28845d8d0 0x55d28854e0f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f79dc055040 tx=0x7f79dc04c000 comp rx=0 tx=0).stop 2024-04-24T02:12:23.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.273+0000 7f79ee519800 1 -- 172.21.15.134:0/2722937267 shutdown_connections 2024-04-24T02:12:23.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.273+0000 7f79ee519800 1 --2- 172.21.15.134:0/2722937267 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d28845d8d0 0x55d28854e0f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.273+0000 7f79ee519800 1 -- 172.21.15.134:0/2722937267 >> 172.21.15.134:0/2722937267 conn(0x55d2884573a0 msgr2=0x55d288549a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:23.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.273+0000 7f79ee519800 1 -- 172.21.15.134:0/2722937267 shutdown_connections 2024-04-24T02:12:23.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.273+0000 7f79ee519800 1 -- 172.21.15.134:0/2722937267 wait complete. 2024-04-24T02:12:23.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.273+0000 7f79ee519800 1 Processor -- start 2024-04-24T02:12:23.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.273+0000 7f79ee519800 1 -- start start 2024-04-24T02:12:23.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.273+0000 7f79ee519800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d28845d8d0 0x55d288555b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.273+0000 7f79ee519800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d288463fb0 con 0x55d28845d8d0 2024-04-24T02:12:23.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.273+0000 7f79ec018640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d28845d8d0 0x55d288555b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.273+0000 7f79ec018640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d28845d8d0 0x55d288555b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46086/0 (socket says 172.21.15.134:46086) 2024-04-24T02:12:23.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.273+0000 7f79ec018640 1 -- 172.21.15.134:0/842554461 learned_addr learned my addr 172.21.15.134:0/842554461 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:23.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.274+0000 7f79ec018640 1 -- 172.21.15.134:0/842554461 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2885560a0 con 0x55d28845d8d0 2024-04-24T02:12:23.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.274+0000 7f79ec018640 1 --2- 172.21.15.134:0/842554461 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d28845d8d0 0x55d288555b60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f79dc0524f0 tx=0x7f79dc003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.274+0000 7f78d8e09640 1 -- 172.21.15.134:0/842554461 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79dc073070 con 0x55d28845d8d0 2024-04-24T02:12:23.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.274+0000 7f78d8e09640 1 -- 172.21.15.134:0/842554461 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79dc05d440 con 0x55d28845d8d0 2024-04-24T02:12:23.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.274+0000 7f79ee519800 1 -- 172.21.15.134:0/842554461 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d288556330 con 0x55d28845d8d0 2024-04-24T02:12:23.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.274+0000 7f78d8e09640 1 -- 172.21.15.134:0/842554461 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79dc057070 con 0x55d28845d8d0 2024-04-24T02:12:23.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.274+0000 7f79ee519800 1 -- 172.21.15.134:0/842554461 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d288558fe0 con 0x55d28845d8d0 2024-04-24T02:12:23.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.275+0000 7f78d8e09640 1 -- 172.21.15.134:0/842554461 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f79dc076070 con 0x55d28845d8d0 2024-04-24T02:12:23.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.275+0000 7f78d8e09640 1 --2- 172.21.15.134:0/842554461 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f78d4036950 0x7f78d4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.275+0000 7f78d8e09640 1 -- 172.21.15.134:0/842554461 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f79dc08daf0 con 0x55d28845d8d0 2024-04-24T02:12:23.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.275+0000 7f79e3fff640 1 --2- 172.21.15.134:0/842554461 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f78d4036950 0x7f78d4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.275+0000 7f79ee519800 1 --2- 172.21.15.134:0/842554461 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d288460200 0x55d28855cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.275+0000 7f79ee519800 1 -- 172.21.15.134:0/842554461 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d28855d2e0 con 0x55d288460200 2024-04-24T02:12:23.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.275+0000 7f79ec819640 1 --2- 172.21.15.134:0/842554461 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d288460200 0x55d28855cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.275+0000 7f79e3fff640 1 --2- 172.21.15.134:0/842554461 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f78d4036950 0x7f78d4038e10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f79d4001e10 tx=0x7f79d4001390 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.276+0000 7f79ec819640 1 --2- 172.21.15.134:0/842554461 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d288460200 0x55d28855cda0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.276+0000 7f79ec819640 1 -- 172.21.15.134:0/842554461 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f79e400a4a0 con 0x55d288460200 2024-04-24T02:12:23.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.276+0000 7f79ee519800 1 -- 172.21.15.134:0/842554461 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d28855dbd0 con 0x55d288460200 2024-04-24T02:12:23.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.276+0000 7f79ec819640 1 -- 172.21.15.134:0/842554461 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f79e400a4a0 con 0x55d288460200 2024-04-24T02:12:23.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.276+0000 7f79ee519800 1 -- 172.21.15.134:0/842554461 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d28855ef80 con 0x55d288460200 2024-04-24T02:12:23.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.277+0000 7f79ec819640 1 -- 172.21.15.134:0/842554461 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f79e400a4a0 con 0x55d288460200 2024-04-24T02:12:23.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.277+0000 7f79ee519800 1 -- 172.21.15.134:0/842554461 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d28855e420 con 0x55d288460200 2024-04-24T02:12:23.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.277+0000 7f79ec819640 1 -- 172.21.15.134:0/842554461 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f79e400a4a0 con 0x55d288460200 2024-04-24T02:12:23.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.277+0000 7f79ee519800 1 -- 172.21.15.134:0/842554461 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d28855e870 con 0x55d288460200 2024-04-24T02:12:23.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.277+0000 7f79ec819640 1 -- 172.21.15.134:0/842554461 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f79e400a4a0 con 0x55d288460200 2024-04-24T02:12:23.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.277+0000 7f79ee519800 1 Processor -- start 2024-04-24T02:12:23.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.277+0000 7f79ee519800 1 -- start start 2024-04-24T02:12:23.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.278+0000 7f79ee519800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d28845d470 0x55d28845b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.278+0000 7f79ee519800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d28834e6b0 con 0x55d28845d470 2024-04-24T02:12:23.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.278+0000 7f79e3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d28845d470 0x55d28845b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.278+0000 7f79e3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d28845d470 0x55d28845b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46092/0 (socket says 172.21.15.134:46092) 2024-04-24T02:12:23.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.278+0000 7f79e3fff640 1 -- 172.21.15.134:0/462057388 learned_addr learned my addr 172.21.15.134:0/462057388 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:23.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.278+0000 7f79e3fff640 1 -- 172.21.15.134:0/462057388 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d28845be20 con 0x55d28845d470 2024-04-24T02:12:23.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.279+0000 7f79e3fff640 1 --2- 172.21.15.134:0/462057388 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d28845d470 0x55d28845b8e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f79d4001770 tx=0x7f79d400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.279+0000 7f78d1ffb640 1 -- 172.21.15.134:0/462057388 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79d401c410 con 0x55d28845d470 2024-04-24T02:12:23.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.279+0000 7f78d1ffb640 1 -- 172.21.15.134:0/462057388 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79d4017050 con 0x55d28845d470 2024-04-24T02:12:23.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.279+0000 7f79ee519800 1 -- 172.21.15.134:0/462057388 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d28845c0b0 con 0x55d28845d470 2024-04-24T02:12:23.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.279+0000 7f78d1ffb640 1 -- 172.21.15.134:0/462057388 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79d401c6e0 con 0x55d28845d470 2024-04-24T02:12:23.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.279+0000 7f79ee519800 1 -- 172.21.15.134:0/462057388 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d28845c5b0 con 0x55d28845d470 2024-04-24T02:12:23.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.279+0000 7f78d1ffb640 1 -- 172.21.15.134:0/462057388 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f79d400e070 con 0x55d28845d470 2024-04-24T02:12:23.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.280+0000 7f78d1ffb640 1 --2- 172.21.15.134:0/462057388 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f78c4036900 0x7f78c4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.280+0000 7f78d1ffb640 1 -- 172.21.15.134:0/462057388 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f79d404ddc0 con 0x55d28845d470 2024-04-24T02:12:23.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.280+0000 7f79ec819640 1 --2- 172.21.15.134:0/462057388 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f78c4036900 0x7f78c4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.280+0000 7f79ee519800 1 Processor -- start 2024-04-24T02:12:23.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.280+0000 7f79ee519800 1 -- start start 2024-04-24T02:12:23.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.280+0000 7f79ec819640 1 --2- 172.21.15.134:0/462057388 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f78c4036900 0x7f78c4038dc0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x55d28855a4a0 tx=0x7f79e4005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.280+0000 7f79ee519800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d28857d460 0x55d28857d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.280+0000 7f79ee519800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d28854e980 con 0x55d28857d460 2024-04-24T02:12:23.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.280+0000 7f79e3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d28857d460 0x55d28857d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.280+0000 7f79e3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d28857d460 0x55d28857d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46104/0 (socket says 172.21.15.134:46104) 2024-04-24T02:12:23.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.280+0000 7f79e3fff640 1 -- 172.21.15.134:0/4292183193 learned_addr learned my addr 172.21.15.134:0/4292183193 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:23.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.281+0000 7f79e3fff640 1 -- 172.21.15.134:0/4292183193 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d28857de50 con 0x55d28857d460 2024-04-24T02:12:23.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.281+0000 7f79e3fff640 1 --2- 172.21.15.134:0/4292183193 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d28857d460 0x55d28857d880 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f79d401afd0 tx=0x7f79d401ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec427e8551faa792 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.281+0000 7f78cb7fe640 1 -- 172.21.15.134:0/4292183193 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79d4040070 con 0x55d28857d460 2024-04-24T02:12:23.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.281+0000 7f78cb7fe640 1 -- 172.21.15.134:0/4292183193 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79d4002e50 con 0x55d28857d460 2024-04-24T02:12:23.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.281+0000 7f78cb7fe640 1 -- 172.21.15.134:0/4292183193 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79d4025920 con 0x55d28857d460 2024-04-24T02:12:23.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.281+0000 7f79ee519800 1 -- 172.21.15.134:0/4292183193 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d28857d460 msgr2=0x55d28857d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.281+0000 7f79ee519800 1 --2- 172.21.15.134:0/4292183193 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d28857d460 0x55d28857d880 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f79d401afd0 tx=0x7f79d401ac60 comp rx=0 tx=0).stop 2024-04-24T02:12:23.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.281+0000 7f79ee519800 1 -- 172.21.15.134:0/4292183193 shutdown_connections 2024-04-24T02:12:23.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.281+0000 7f79ee519800 1 --2- 172.21.15.134:0/4292183193 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d28857d460 0x55d28857d880 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.281+0000 7f79ee519800 1 -- 172.21.15.134:0/4292183193 >> 172.21.15.134:0/4292183193 conn(0x55d2885797c0 msgr2=0x55d288577820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:23.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.281+0000 7f79ee519800 1 -- 172.21.15.134:0/4292183193 shutdown_connections 2024-04-24T02:12:23.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.281+0000 7f79ee519800 1 -- 172.21.15.134:0/4292183193 wait complete. 2024-04-24T02:12:23.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.282+0000 7f79ee519800 1 Processor -- start 2024-04-24T02:12:23.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.282+0000 7f79ee519800 1 -- start start 2024-04-24T02:12:23.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.282+0000 7f79ee519800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d28857d460 0x55d288584b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.282+0000 7f79ee519800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d28857e5c0 con 0x55d28857d460 2024-04-24T02:12:23.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.282+0000 7f79e3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d28857d460 0x55d288584b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.282+0000 7f79e3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d28857d460 0x55d288584b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46110/0 (socket says 172.21.15.134:46110) 2024-04-24T02:12:23.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.282+0000 7f79e3fff640 1 -- 172.21.15.134:0/3005634485 learned_addr learned my addr 172.21.15.134:0/3005634485 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:23.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.282+0000 7f79e3fff640 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d288585060 con 0x55d28857d460 2024-04-24T02:12:23.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.283+0000 7f79e3fff640 1 --2- 172.21.15.134:0/3005634485 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d28857d460 0x55d288584b20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f79d404b280 tx=0x7f79d404c2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.283+0000 7f78c9ffb640 1 -- 172.21.15.134:0/3005634485 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79d4046030 con 0x55d28857d460 2024-04-24T02:12:23.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.283+0000 7f78c9ffb640 1 -- 172.21.15.134:0/3005634485 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79d4025920 con 0x55d28857d460 2024-04-24T02:12:23.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.283+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d2885852f0 con 0x55d28857d460 2024-04-24T02:12:23.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.283+0000 7f78c9ffb640 1 -- 172.21.15.134:0/3005634485 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79d400ec60 con 0x55d28857d460 2024-04-24T02:12:23.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.283+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d288587fa0 con 0x55d28857d460 2024-04-24T02:12:23.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.283+0000 7f78c9ffb640 1 -- 172.21.15.134:0/3005634485 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f79d403b0c0 con 0x55d28857d460 2024-04-24T02:12:23.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.284+0000 7f78c9ffb640 1 --2- 172.21.15.134:0/3005634485 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f78bc036950 0x7f78bc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.284+0000 7f78c9ffb640 1 -- 172.21.15.134:0/3005634485 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f79d403aaf0 con 0x55d28857d460 2024-04-24T02:12:23.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.284+0000 7f79ec819640 1 --2- 172.21.15.134:0/3005634485 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f78bc036950 0x7f78bc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.284+0000 7f79ec819640 1 --2- 172.21.15.134:0/3005634485 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f78bc036950 0x7f78bc038e10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x55d28855a2c0 tx=0x7f79e401f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.284+0000 7f79ee519800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.284+0000 7f79ee519800 1 --2- 172.21.15.134:0/3005634485 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d2885905b0 0x55d288592a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.284+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d2885931c0 con 0x55d2885905b0 2024-04-24T02:12:23.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.284+0000 7f79ec018640 1 --2- 172.21.15.134:0/3005634485 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d2885905b0 0x55d288592a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.285+0000 7f79ec018640 1 --2- 172.21.15.134:0/3005634485 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d2885905b0 0x55d288592a70 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.285+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f79dc075030 con 0x55d2885905b0 2024-04-24T02:12:23.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.285+0000 7f79ee519800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.285+0000 7f79ee519800 20 realm 2024-04-24T02:12:23.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.285+0000 7f79ee519800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.285+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d2885935d0 con 0x55d2885905b0 2024-04-24T02:12:23.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.285+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f79dc075030 con 0x55d2885905b0 2024-04-24T02:12:23.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.285+0000 7f79ee519800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.285+0000 7f79ee519800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:23.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.285+0000 7f79ee519800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.285+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d288593ea0 con 0x55d2885905b0 2024-04-24T02:12:23.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.285+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f79dc075030 con 0x55d2885905b0 2024-04-24T02:12:23.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.285+0000 7f79ee519800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.285+0000 7f79ee519800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.285+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d288594240 con 0x55d2885905b0 2024-04-24T02:12:23.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.286+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f79dc075030 con 0x55d2885905b0 2024-04-24T02:12:23.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.286+0000 7f79ee519800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:23.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.286+0000 7f79ee519800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.286+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d288594a90 con 0x55d2885905b0 2024-04-24T02:12:23.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.286+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f79dc075030 con 0x55d2885905b0 2024-04-24T02:12:23.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.286+0000 7f79ee519800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:23.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.286+0000 7f79ee519800 20 searching for the correct realm 2024-04-24T02:12:23.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.286+0000 7f79ee519800 1 --2- 172.21.15.134:0/3005634485 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55d288596800 0x55d288598bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.286+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2885991d0 con 0x55d288596800 2024-04-24T02:12:23.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.286+0000 7f79e3fff640 1 --2- 172.21.15.134:0/3005634485 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55d288596800 0x55d288598bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.286+0000 7f79e3fff640 1 --2- 172.21.15.134:0/3005634485 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55d288596800 0x55d288598bf0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.287+0000 7f79e3fff640 1 -- 172.21.15.134:0/3005634485 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79d4052060 con 0x55d288596800 2024-04-24T02:12:23.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.287+0000 7f79e3fff640 1 --2- 172.21.15.134:0/3005634485 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f79d401c030 0x7f79d404c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.287+0000 7f79e3fff640 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2885991d0 con 0x7f79d401c030 2024-04-24T02:12:23.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.287+0000 7f79ec819640 1 --2- 172.21.15.134:0/3005634485 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f79d401c030 0x7f79d404c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.287+0000 7f79ec819640 1 --2- 172.21.15.134:0/3005634485 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f79d401c030 0x7f79d404c920 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.287+0000 7f79ec819640 1 -- 172.21.15.134:0/3005634485 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79e401f070 con 0x7f79d401c030 2024-04-24T02:12:23.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.287+0000 7f79ec819640 1 --2- 172.21.15.134:0/3005634485 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f79e4031040 0x7f79e4032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.287+0000 7f79ec819640 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2885991d0 con 0x7f79e4031040 2024-04-24T02:12:23.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.288+0000 7f79ec018640 1 --2- 172.21.15.134:0/3005634485 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f79e4031040 0x7f79e4032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.288+0000 7f79ec018640 1 --2- 172.21.15.134:0/3005634485 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f79e4031040 0x7f79e4032430 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.288+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79dc075030 con 0x7f79e4031040 2024-04-24T02:12:23.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.288+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2885991d0 con 0x55d2885905b0 2024-04-24T02:12:23.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.288+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79dc075030 con 0x55d2885905b0 2024-04-24T02:12:23.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.288+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2885991d0 con 0x55d2885905b0 2024-04-24T02:12:23.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.289+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f79dc075030 con 0x55d2885905b0 2024-04-24T02:12:23.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.289+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2885991d0 con 0x7f79e4031040 2024-04-24T02:12:23.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.289+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79dc075030 con 0x7f79e4031040 2024-04-24T02:12:23.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.289+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2885991d0 con 0x7f79e4031040 2024-04-24T02:12:23.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.289+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79dc075030 con 0x7f79e4031040 2024-04-24T02:12:23.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.289+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2885991d0 con 0x7f79d401c030 2024-04-24T02:12:23.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.290+0000 7f79ec819640 1 -- 172.21.15.134:0/3005634485 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79e401f070 con 0x7f79d401c030 2024-04-24T02:12:23.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.290+0000 7f79ec819640 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2885991d0 con 0x55d288596800 2024-04-24T02:12:23.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.290+0000 7f79e3fff640 1 -- 172.21.15.134:0/3005634485 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79d4052060 con 0x55d288596800 2024-04-24T02:12:23.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.290+0000 7f79e3fff640 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2885991d0 con 0x55d2885905b0 2024-04-24T02:12:23.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.290+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79dc075030 con 0x55d2885905b0 2024-04-24T02:12:23.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.290+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2885991d0 con 0x7f79e4031040 2024-04-24T02:12:23.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.290+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79dc075030 con 0x7f79e4031040 2024-04-24T02:12:23.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.290+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2885991d0 con 0x55d2885905b0 2024-04-24T02:12:23.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.291+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79dc075030 con 0x55d2885905b0 2024-04-24T02:12:23.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.291+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2885991d0 con 0x7f79d401c030 2024-04-24T02:12:23.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.291+0000 7f79ec819640 1 -- 172.21.15.134:0/3005634485 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f79e401f070 con 0x7f79d401c030 2024-04-24T02:12:23.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.291+0000 7f79ec819640 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2885991d0 con 0x55d288596800 2024-04-24T02:12:23.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.291+0000 7f79e3fff640 1 -- 172.21.15.134:0/3005634485 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79d4052060 con 0x55d288596800 2024-04-24T02:12:23.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.291+0000 7f79e3fff640 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2885991d0 con 0x55d288596800 2024-04-24T02:12:23.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.291+0000 7f79e3fff640 1 -- 172.21.15.134:0/3005634485 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79d4052060 con 0x55d288596800 2024-04-24T02:12:23.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.291+0000 7f79e3fff640 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2885991d0 con 0x7f79e4031040 2024-04-24T02:12:23.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.292+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79dc075030 con 0x7f79e4031040 2024-04-24T02:12:23.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.292+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2885991d0 con 0x55d288596800 2024-04-24T02:12:23.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.292+0000 7f79e3fff640 1 -- 172.21.15.134:0/3005634485 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79d4052060 con 0x55d288596800 2024-04-24T02:12:23.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.292+0000 7f79e3fff640 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2885991d0 con 0x55d288596800 2024-04-24T02:12:23.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.292+0000 7f79e3fff640 1 -- 172.21.15.134:0/3005634485 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79d4052060 con 0x55d288596800 2024-04-24T02:12:23.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.292+0000 7f79e3fff640 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2885991d0 con 0x55d2885905b0 2024-04-24T02:12:23.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.292+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79dc075030 con 0x55d2885905b0 2024-04-24T02:12:23.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.292+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2885991d0 con 0x55d2885905b0 2024-04-24T02:12:23.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.293+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f79dc075030 con 0x55d2885905b0 2024-04-24T02:12:23.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.293+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2885991d0 con 0x7f79e4031040 2024-04-24T02:12:23.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.293+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79dc075030 con 0x7f79e4031040 2024-04-24T02:12:23.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.293+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2885991d0 con 0x55d288596800 2024-04-24T02:12:23.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.293+0000 7f79e3fff640 1 -- 172.21.15.134:0/3005634485 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79d4052060 con 0x55d288596800 2024-04-24T02:12:23.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.293+0000 7f79e3fff640 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2885991d0 con 0x7f79d401c030 2024-04-24T02:12:23.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.293+0000 7f79ec819640 1 -- 172.21.15.134:0/3005634485 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79e401f070 con 0x7f79d401c030 2024-04-24T02:12:23.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.293+0000 7f79ec819640 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2885991d0 con 0x55d2885905b0 2024-04-24T02:12:23.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.294+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79dc075030 con 0x55d2885905b0 2024-04-24T02:12:23.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.294+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2885991d0 con 0x7f79e4031040 2024-04-24T02:12:23.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.294+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79dc075030 con 0x7f79e4031040 2024-04-24T02:12:23.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.294+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2885991d0 con 0x55d288596800 2024-04-24T02:12:23.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.294+0000 7f79e3fff640 1 -- 172.21.15.134:0/3005634485 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79d4052060 con 0x55d288596800 2024-04-24T02:12:23.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.294+0000 7f79e3fff640 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2885991d0 con 0x7f79e4031040 2024-04-24T02:12:23.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.295+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79dc075030 con 0x7f79e4031040 2024-04-24T02:12:23.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.295+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2885991d0 con 0x7f79d401c030 2024-04-24T02:12:23.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.295+0000 7f79ec819640 1 -- 172.21.15.134:0/3005634485 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79e401f070 con 0x7f79d401c030 2024-04-24T02:12:23.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.295+0000 7f79ec819640 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2885991d0 con 0x55d288596800 2024-04-24T02:12:23.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.295+0000 7f79e3fff640 1 -- 172.21.15.134:0/3005634485 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79d4052060 con 0x55d288596800 2024-04-24T02:12:23.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.295+0000 7f79e3fff640 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2885991d0 con 0x7f79e4031040 2024-04-24T02:12:23.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.296+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79dc075030 con 0x7f79e4031040 2024-04-24T02:12:23.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.296+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2885991d0 con 0x55d2885905b0 2024-04-24T02:12:23.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.296+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f79dc075030 con 0x55d2885905b0 2024-04-24T02:12:23.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.296+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2885991d0 con 0x7f79d401c030 2024-04-24T02:12:23.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.296+0000 7f79ec819640 1 -- 172.21.15.134:0/3005634485 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79e401f070 con 0x7f79d401c030 2024-04-24T02:12:23.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.296+0000 7f79ee519800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:23.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.296+0000 7f79ee519800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:23.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.296+0000 7f79ee519800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:23.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.296+0000 7f79ee519800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:23.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.296+0000 7f79ee519800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:23.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.296+0000 7f79ee519800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:23.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.296+0000 7f79ee519800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.296+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d288595440 con 0x55d2885905b0 2024-04-24T02:12:23.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.296+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f79dc075030 con 0x55d2885905b0 2024-04-24T02:12:23.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.296+0000 7f79ee519800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.296+0000 7f79ee519800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.296+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d288595ce0 con 0x55d2885905b0 2024-04-24T02:12:23.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.297+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f79dc075030 con 0x55d2885905b0 2024-04-24T02:12:23.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.297+0000 7f79ee519800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:23.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.297+0000 7f79ee519800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.297+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d288599650 con 0x55d2885905b0 2024-04-24T02:12:23.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.297+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f79dc075030 con 0x55d2885905b0 2024-04-24T02:12:23.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.297+0000 7f79ee519800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:23.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.297+0000 7f79ee519800 20 zone default found 2024-04-24T02:12:23.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.297+0000 7f79ee519800 4 Realm: () 2024-04-24T02:12:23.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.297+0000 7f79ee519800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:23.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.297+0000 7f79ee519800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:23.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.297+0000 7f79ee519800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:23.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.297+0000 7f79ee519800 20 zonegroup default 2024-04-24T02:12:23.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.297+0000 7f79ee519800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.297+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d288599b00 con 0x7f79e4031040 2024-04-24T02:12:23.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.297+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f79dc075030 con 0x7f79e4031040 2024-04-24T02:12:23.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.297+0000 7f79ee519800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.297+0000 7f79ee519800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.297+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d28859b4e0 con 0x55d288596800 2024-04-24T02:12:23.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.297+0000 7f79e3fff640 1 -- 172.21.15.134:0/3005634485 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f79d4052060 con 0x55d288596800 2024-04-24T02:12:23.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.298+0000 7f79ee519800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.298+0000 7f79ee519800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.298+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d28859b960 con 0x55d288596800 2024-04-24T02:12:23.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.298+0000 7f79e3fff640 1 -- 172.21.15.134:0/3005634485 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f79d4052060 con 0x55d288596800 2024-04-24T02:12:23.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.298+0000 7f79ee519800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.298+0000 7f79ee519800 20 started sync module instance, tier type = 2024-04-24T02:12:23.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.298+0000 7f79ee519800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:23.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.298+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d28859a970 con 0x7f79d401c030 2024-04-24T02:12:23.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.299+0000 7f79ec819640 1 -- 172.21.15.134:0/3005634485 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79e4040040 con 0x7f79d401c030 2024-04-24T02:12:23.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.299+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94362719071632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d28859a5d0 con 0x7f79d401c030 2024-04-24T02:12:23.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.299+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d28859c7a0 con 0x55d2885905b0 2024-04-24T02:12:23.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.300+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79dc075030 con 0x55d2885905b0 2024-04-24T02:12:23.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.300+0000 7f79ec819640 1 -- 172.21.15.134:0/3005634485 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94362719071632] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79e4040040 con 0x7f79d401c030 2024-04-24T02:12:23.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.300+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94362719075776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d28859c760 con 0x55d2885905b0 2024-04-24T02:12:23.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.300+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d28859d280 con 0x55d288596800 2024-04-24T02:12:23.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.301+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94362719075776] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79dc075030 con 0x55d2885905b0 2024-04-24T02:12:23.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.301+0000 7f79e3fff640 1 -- 172.21.15.134:0/3005634485 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79d4052060 con 0x55d288596800 2024-04-24T02:12:23.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.301+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94362719079760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d28859d620 con 0x55d288596800 2024-04-24T02:12:23.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.301+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d28859e040 con 0x7f79d401c030 2024-04-24T02:12:23.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.302+0000 7f79e3fff640 1 -- 172.21.15.134:0/3005634485 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94362719079760] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79d4052060 con 0x55d288596800 2024-04-24T02:12:23.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.302+0000 7f79ec819640 1 -- 172.21.15.134:0/3005634485 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79e4040040 con 0x7f79d401c030 2024-04-24T02:12:23.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.302+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94362719083312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d28859e460 con 0x7f79d401c030 2024-04-24T02:12:23.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.302+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d28859ee60 con 0x55d2885905b0 2024-04-24T02:12:23.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.303+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79dc075030 con 0x55d2885905b0 2024-04-24T02:12:23.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.303+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94362719086960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d28859edf0 con 0x55d2885905b0 2024-04-24T02:12:23.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.303+0000 7f79ec819640 1 -- 172.21.15.134:0/3005634485 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94362719083312] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79e4040040 con 0x7f79d401c030 2024-04-24T02:12:23.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.303+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d28859c200 con 0x7f79e4031040 2024-04-24T02:12:23.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.304+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79dc075030 con 0x7f79e4031040 2024-04-24T02:12:23.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.305+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94362719090944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d28859c200 con 0x7f79e4031040 2024-04-24T02:12:23.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.305+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94362719086960] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79dc075030 con 0x55d2885905b0 2024-04-24T02:12:23.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.305+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d2885a0830 con 0x7f79e4031040 2024-04-24T02:12:23.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.306+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94362719090944] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79dc075030 con 0x7f79e4031040 2024-04-24T02:12:23.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.306+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(56 notify.6 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79dc075030 con 0x7f79e4031040 2024-04-24T02:12:23.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.306+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94362719089360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d2885a0340 con 0x7f79e4031040 2024-04-24T02:12:23.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.306+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d2885a0d00 con 0x7f79e4031040 2024-04-24T02:12:23.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.307+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94362719089360] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79dc075030 con 0x7f79e4031040 2024-04-24T02:12:23.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.307+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(58 notify.7 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79dc075030 con 0x7f79e4031040 2024-04-24T02:12:23.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.307+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94362719092000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d2885a0d00 con 0x7f79e4031040 2024-04-24T02:12:23.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.307+0000 7f79ee519800 20 add_watcher() i=0 2024-04-24T02:12:23.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.307+0000 7f79ee519800 20 add_watcher() i=1 2024-04-24T02:12:23.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.307+0000 7f79ee519800 20 add_watcher() i=2 2024-04-24T02:12:23.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.307+0000 7f79ee519800 20 add_watcher() i=3 2024-04-24T02:12:23.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.307+0000 7f79ee519800 20 add_watcher() i=4 2024-04-24T02:12:23.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.307+0000 7f79ee519800 20 add_watcher() i=5 2024-04-24T02:12:23.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.307+0000 7f79ee519800 20 add_watcher() i=6 2024-04-24T02:12:23.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.308+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94362719092000] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79dc075030 con 0x7f79e4031040 2024-04-24T02:12:23.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.308+0000 7f79ee519800 20 add_watcher() i=7 2024-04-24T02:12:23.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.308+0000 7f79ee519800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:23.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.308+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d2885a4010 con 0x55d2885905b0 2024-04-24T02:12:23.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.308+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f79dc075030 con 0x55d2885905b0 2024-04-24T02:12:23.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.308+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94362719107616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d2885a0e70 con 0x55d2885905b0 2024-04-24T02:12:23.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.309+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94362719107616] v30'76 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f79dc075030 con 0x55d2885905b0 2024-04-24T02:12:23.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.309+0000 7f78a27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:23.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.309+0000 7f79ee519800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:23.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.309+0000 7f79ee519800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:23.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.309+0000 7f79ee519800 5 note: GC not initialized 2024-04-24T02:12:23.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.309+0000 7f78a17e2640 20 reqs_thread_entry: start 2024-04-24T02:12:23.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.310+0000 7f79ee519800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:23.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.310+0000 7f79ee519800 20 Filter name: none 2024-04-24T02:12:23.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.310+0000 7f7812ffd640 20 reqs_thread_entry: start 2024-04-24T02:12:23.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.310+0000 7f79ee519800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T02:12:23.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.310+0000 7f79ee519800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.310+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d2885d73e0 con 0x55d2885905b0 2024-04-24T02:12:23.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.310+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f79dc075030 con 0x55d2885905b0 2024-04-24T02:12:23.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.310+0000 7f79ee519800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T02:12:23.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.310+0000 7f79ee519800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T02:12:23.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.310+0000 7f79ee519800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:23.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.310+0000 7f79ee519800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:12:23.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.310+0000 7f79ee519800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-04-24T02:12:23.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.310+0000 7f79ee519800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.310+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d2885d7e50 con 0x55d2885905b0 2024-04-24T02:12:23.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.311+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f79dc075030 con 0x55d2885905b0 2024-04-24T02:12:23.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.311+0000 7f79ee519800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.311+0000 7f79ee519800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-04-24T02:12:23.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.311+0000 7f79ee519800 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-04-24T02:12:23.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.311+0000 7f79ee519800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-04-24T02:12:23.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.311+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d2885dd840 con 0x55d2885905b0 2024-04-24T02:12:23.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.312+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~556] v30'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f79dc075030 con 0x55d2885905b0 2024-04-24T02:12:23.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.312+0000 7f79ee519800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T02:12:23.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.312+0000 7f79ee519800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:23.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.312+0000 7f79ee519800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-24T02:12:23.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.312+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94362719343280 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d2885d8e90 con 0x55d2885905b0 2024-04-24T02:12:23.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.312+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== watch-notify(notify (1) cookie 94362719086960 notify 128849018885 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7f79dc094040 con 0x55d2885905b0 2024-04-24T02:12:23.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.312+0000 7f78cb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018885 cookie 94362719086960 notifier 4355 bl.length()=732 2024-04-24T02:12:23.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.312+0000 7f78cb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T02:12:23.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.312+0000 7f78cb7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:23.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.312+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(65 notify.4 [notify cookie 94362719343280 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f79dc075030 con 0x55d2885905b0 2024-04-24T02:12:23.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.312+0000 7f78cb7fe640 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f78b0003ea0 con 0x55d2885905b0 2024-04-24T02:12:23.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.313+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== watch-notify(notify_complete (2) cookie 94362719343280 notify 128849018885 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d288558fe0 con 0x55d2885905b0 2024-04-24T02:12:23.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.313+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79dc075030 con 0x55d2885905b0 2024-04-24T02:12:23.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.313+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d2885dd2b0 con 0x55d2885905b0 2024-04-24T02:12:23.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.314+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.1 v2:172.21.15.134:6804/1487076214 30 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f79dc075030 con 0x55d2885905b0 2024-04-24T02:12:23.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.314+0000 7f79ee519800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-04-24T02:12:23.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.314+0000 7f79ee519800 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-04-24T02:12:23.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.314+0000 7f79ee519800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-04-24T02:12:23.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.314+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94362719343280 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d2885d89e0 con 0x7f79d401c030 2024-04-24T02:12:23.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.314+0000 7f79ec819640 1 -- 172.21.15.134:0/3005634485 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== watch-notify(notify (1) cookie 94362719071632 notify 128849018882 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7f79e40247e0 con 0x7f79d401c030 2024-04-24T02:12:23.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.314+0000 7f78caffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018882 cookie 94362719071632 notifier 4355 bl.length()=166 2024-04-24T02:12:23.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.314+0000 7f79ec819640 1 -- 172.21.15.134:0/3005634485 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(68 notify.0 [notify cookie 94362719343280 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f79e4040040 con 0x7f79d401c030 2024-04-24T02:12:23.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.314+0000 7f78caffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-04-24T02:12:23.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.314+0000 7f78caffd640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-04-24T02:12:23.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.314+0000 7f78caffd640 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f7820003400 con 0x7f79d401c030 2024-04-24T02:12:23.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.314+0000 7f79ec819640 1 -- 172.21.15.134:0/3005634485 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== watch-notify(notify_complete (2) cookie 94362719343280 notify 128849018882 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f79e4032970 con 0x7f79d401c030 2024-04-24T02:12:23.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.314+0000 7f79ec819640 1 -- 172.21.15.134:0/3005634485 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79e4040040 con 0x7f79d401c030 2024-04-24T02:12:23.350 INFO:teuthology.orchestra.run.smithi134.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T02:12:21.778798Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"AnY3WiEZ9EGBW9YGSAq60ykxJZJBi4UUA1WceKtn","active":true,"create_date":"2024-04-24T02:12:23.312520Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T02:12:21.778786Z","tags":[],"group_ids":[]} 2024-04-24T02:12:23.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.315+0000 7f78a27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:23.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.315+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94362719107616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d2885a2d90 con 0x55d2885905b0 2024-04-24T02:12:23.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.316+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.1 v2:172.21.15.134:6804/1487076214 31 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94362719107616] v30'77 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f79dc075030 con 0x55d2885905b0 2024-04-24T02:12:23.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.316+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94362719071632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d2885a3a20 con 0x7f79d401c030 2024-04-24T02:12:23.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.317+0000 7f79ec819640 1 -- 172.21.15.134:0/3005634485 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94362719071632] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79e4040040 con 0x7f79d401c030 2024-04-24T02:12:23.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.317+0000 7f79ee519800 20 remove_watcher() i=0 2024-04-24T02:12:23.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.317+0000 7f79ee519800 2 removed watcher, disabling cache 2024-04-24T02:12:23.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.317+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94362719075776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d28859ad90 con 0x55d2885905b0 2024-04-24T02:12:23.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.318+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.1 v2:172.21.15.134:6804/1487076214 32 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94362719075776] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79dc075030 con 0x55d2885905b0 2024-04-24T02:12:23.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.319+0000 7f79ee519800 20 remove_watcher() i=1 2024-04-24T02:12:23.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.319+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94362719079760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d28859bdc0 con 0x55d288596800 2024-04-24T02:12:23.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.320+0000 7f79e3fff640 1 -- 172.21.15.134:0/3005634485 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94362719079760] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79d4052060 con 0x55d288596800 2024-04-24T02:12:23.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.320+0000 7f79ee519800 20 remove_watcher() i=2 2024-04-24T02:12:23.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.320+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94362719083312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d28859cd50 con 0x7f79d401c030 2024-04-24T02:12:23.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.321+0000 7f79ec819640 1 -- 172.21.15.134:0/3005634485 <== osd.2 v2:172.21.15.134:6800/214480313 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94362719083312] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79e4040040 con 0x7f79d401c030 2024-04-24T02:12:23.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.321+0000 7f79ee519800 20 remove_watcher() i=3 2024-04-24T02:12:23.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.321+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94362719086960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d28859cd50 con 0x55d2885905b0 2024-04-24T02:12:23.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.322+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.1 v2:172.21.15.134:6804/1487076214 33 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94362719086960] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79dc075030 con 0x55d2885905b0 2024-04-24T02:12:23.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.322+0000 7f79ee519800 20 remove_watcher() i=4 2024-04-24T02:12:23.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.322+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94362719090944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d28859e970 con 0x7f79e4031040 2024-04-24T02:12:23.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.322+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94362719090944] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79dc075030 con 0x7f79e4031040 2024-04-24T02:12:23.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.322+0000 7f79ee519800 20 remove_watcher() i=5 2024-04-24T02:12:23.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.323+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94362719089360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d28859cd50 con 0x7f79e4031040 2024-04-24T02:12:23.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.324+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94362719089360] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79dc075030 con 0x7f79e4031040 2024-04-24T02:12:23.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.324+0000 7f79ee519800 20 remove_watcher() i=6 2024-04-24T02:12:23.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.324+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94362719092000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d28859f900 con 0x7f79e4031040 2024-04-24T02:12:23.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.325+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94362719092000] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79dc075030 con 0x7f79e4031040 2024-04-24T02:12:23.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.325+0000 7f79ee519800 20 remove_watcher() i=7 2024-04-24T02:12:23.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.325+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f79e4031040 msgr2=0x7f79e4032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.325+0000 7f79ee519800 1 --2- 172.21.15.134:0/3005634485 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f79e4031040 0x7f79e4032430 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.325+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d2885905b0 msgr2=0x55d288592a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.325+0000 7f79ee519800 1 --2- 172.21.15.134:0/3005634485 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d2885905b0 0x55d288592a70 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.325+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f79d401c030 msgr2=0x7f79d404c920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.325+0000 7f79ee519800 1 --2- 172.21.15.134:0/3005634485 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f79d401c030 0x7f79d404c920 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.325+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55d288596800 msgr2=0x55d288598bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.325+0000 7f79ee519800 1 --2- 172.21.15.134:0/3005634485 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55d288596800 0x55d288598bf0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.325+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f78bc036950 msgr2=0x7f78bc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.325+0000 7f79ee519800 1 --2- 172.21.15.134:0/3005634485 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f78bc036950 0x7f78bc038e10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x55d28855a2c0 tx=0x7f79e401f000 comp rx=0 tx=0).stop 2024-04-24T02:12:23.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.325+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d28857d460 msgr2=0x55d288584b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.325+0000 7f79ee519800 1 --2- 172.21.15.134:0/3005634485 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d28857d460 0x55d288584b20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f79d404b280 tx=0x7f79d404c2f0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.325+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 reap_dead start 2024-04-24T02:12:23.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.325+0000 7f79ec018640 1 -- 172.21.15.134:0/3005634485 reap_dead start 2024-04-24T02:12:23.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.325+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 shutdown_connections 2024-04-24T02:12:23.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.325+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 >> 172.21.15.134:0/3005634485 conn(0x55d2885797c0 msgr2=0x55d288576e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:23.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.325+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 shutdown_connections 2024-04-24T02:12:23.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.325+0000 7f79ee519800 1 -- 172.21.15.134:0/3005634485 wait complete. 2024-04-24T02:12:23.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.326+0000 7f79ee519800 1 -- 172.21.15.134:0/462057388 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f78c4036900 msgr2=0x7f78c4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.326+0000 7f79ee519800 1 --2- 172.21.15.134:0/462057388 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f78c4036900 0x7f78c4038dc0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x55d28855a4a0 tx=0x7f79e4005840 comp rx=0 tx=0).stop 2024-04-24T02:12:23.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.326+0000 7f79ee519800 1 -- 172.21.15.134:0/462057388 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d28845d470 msgr2=0x55d28845b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.326+0000 7f79ee519800 1 --2- 172.21.15.134:0/462057388 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d28845d470 0x55d28845b8e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f79d4001770 tx=0x7f79d400f790 comp rx=0 tx=0).stop 2024-04-24T02:12:23.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.326+0000 7f79ee519800 1 -- 172.21.15.134:0/462057388 shutdown_connections 2024-04-24T02:12:23.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.326+0000 7f79ee519800 1 --2- 172.21.15.134:0/462057388 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f78c4036900 0x7f78c4038dc0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.326+0000 7f79ee519800 1 --2- 172.21.15.134:0/462057388 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d28845d470 0x55d28845b8e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.326+0000 7f79ee519800 1 -- 172.21.15.134:0/462057388 >> 172.21.15.134:0/462057388 conn(0x55d288561f50 msgr2=0x55d288562350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:23.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.326+0000 7f79ee519800 1 -- 172.21.15.134:0/462057388 shutdown_connections 2024-04-24T02:12:23.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.326+0000 7f79ee519800 1 -- 172.21.15.134:0/462057388 wait complete. 2024-04-24T02:12:23.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.326+0000 7f79ee519800 1 -- 172.21.15.134:0/842554461 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d288460200 msgr2=0x55d28855cda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.326+0000 7f79ee519800 1 --2- 172.21.15.134:0/842554461 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d288460200 0x55d28855cda0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.326+0000 7f79ee519800 1 -- 172.21.15.134:0/842554461 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f78d4036950 msgr2=0x7f78d4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.326+0000 7f79ee519800 1 --2- 172.21.15.134:0/842554461 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f78d4036950 0x7f78d4038e10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f79d4001e10 tx=0x7f79d4001390 comp rx=0 tx=0).stop 2024-04-24T02:12:23.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.326+0000 7f79ee519800 1 -- 172.21.15.134:0/842554461 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d28845d8d0 msgr2=0x55d288555b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.326+0000 7f79ee519800 1 --2- 172.21.15.134:0/842554461 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d28845d8d0 0x55d288555b60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f79dc0524f0 tx=0x7f79dc003020 comp rx=0 tx=0).stop 2024-04-24T02:12:23.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.326+0000 7f79ee519800 1 -- 172.21.15.134:0/842554461 shutdown_connections 2024-04-24T02:12:23.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.326+0000 7f79ee519800 1 --2- 172.21.15.134:0/842554461 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d288460200 0x55d28855cda0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.326+0000 7f79ee519800 1 --2- 172.21.15.134:0/842554461 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f78d4036950 0x7f78d4038e10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.326+0000 7f79ee519800 1 --2- 172.21.15.134:0/842554461 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d28845d8d0 0x55d288555b60 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.326+0000 7f79ee519800 1 -- 172.21.15.134:0/842554461 >> 172.21.15.134:0/842554461 conn(0x55d2884573a0 msgr2=0x55d288548230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:23.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.326+0000 7f79ee519800 1 -- 172.21.15.134:0/842554461 shutdown_connections 2024-04-24T02:12:23.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.326+0000 7f79ee519800 1 -- 172.21.15.134:0/842554461 wait complete. 2024-04-24T02:12:23.372 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T02:12:21.778798Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'AnY3WiEZ9EGBW9YGSAq60ykxJZJBi4UUA1WceKtn', 'active': True, 'create_date': '2024-04-24T02:12:23.312520Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:12:21.778786Z', 'tags': [], 'group_ids': []} 2024-04-24T02:12:23.372 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-04-24T02:12:23.373 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-04-24T02:12:23.373 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-04-24T02:12:23.423 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:23.424 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:23.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.421+0000 7f3fd7c3f800 1 Processor -- start 2024-04-24T02:12:23.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.421+0000 7f3fd7c3f800 1 -- start start 2024-04-24T02:12:23.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.421+0000 7f3fd7c3f800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55d3c0e697e0 0x55d3c0e69c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.421+0000 7f3fd7c3f800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d3c0d29d40 con 0x55d3c0e6a140 2024-04-24T02:12:23.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.421+0000 7f3fd7c3f800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55d3c0cfc4d0 con 0x55d3c0e697e0 2024-04-24T02:12:23.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.421+0000 7f3fd5745640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55d3c0e697e0 0x55d3c0e69c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.421+0000 7f3fd5745640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55d3c0e697e0 0x55d3c0e69c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46126/0 (socket says 172.21.15.134:46126) 2024-04-24T02:12:23.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.421+0000 7f3fd5745640 1 -- 172.21.15.134:0/310931334 learned_addr learned my addr 172.21.15.134:0/310931334 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:23.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.421+0000 7f3fd5745640 1 -- 172.21.15.134:0/310931334 >> v1:172.21.15.104:6789/0 conn(0x55d3c0e6a140 legacy=0x55d3c0e6a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.421+0000 7f3fd5745640 1 -- 172.21.15.134:0/310931334 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3c0d28590 con 0x55d3c0e697e0 2024-04-24T02:12:23.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.423+0000 7f3fd5745640 1 --2- 172.21.15.134:0/310931334 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3c0e697e0 0x55d3c0e69c00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0005fd0 tx=0x7f3fd001cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b79445a170808eae server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.423+0000 7f3fc7fff640 1 -- 172.21.15.134:0/310931334 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fd0052540 con 0x55d3c0e697e0 2024-04-24T02:12:23.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.423+0000 7f3fc7fff640 1 -- 172.21.15.134:0/310931334 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fd004e070 con 0x55d3c0e697e0 2024-04-24T02:12:23.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.423+0000 7f3fc7fff640 1 -- 172.21.15.134:0/310931334 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fd0052890 con 0x55d3c0e697e0 2024-04-24T02:12:23.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.424+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/310931334 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3c0e697e0 msgr2=0x55d3c0e69c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.424+0000 7f3fd7c3f800 1 --2- 172.21.15.134:0/310931334 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3c0e697e0 0x55d3c0e69c00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0005fd0 tx=0x7f3fd001cd80 comp rx=0 tx=0).stop 2024-04-24T02:12:23.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.424+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/310931334 shutdown_connections 2024-04-24T02:12:23.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.424+0000 7f3fd7c3f800 1 --2- 172.21.15.134:0/310931334 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3c0e697e0 0x55d3c0e69c00 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.424+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/310931334 >> 172.21.15.134:0/310931334 conn(0x55d3c0e65320 msgr2=0x55d3c0e67740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:23.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.424+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/310931334 shutdown_connections 2024-04-24T02:12:23.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.424+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/310931334 wait complete. 2024-04-24T02:12:23.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.436+0000 7f3fd7c3f800 1 Processor -- start 2024-04-24T02:12:23.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.436+0000 7f3fd7c3f800 1 -- start start 2024-04-24T02:12:23.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.436+0000 7f3fd7c3f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3c0e697e0 0x55d3c0f5e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.436+0000 7f3fd7c3f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d3c0db63e0 con 0x55d3c0e697e0 2024-04-24T02:12:23.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.436+0000 7f3fd5745640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3c0e697e0 0x55d3c0f5e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.436+0000 7f3fd5745640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3c0e697e0 0x55d3c0f5e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46134/0 (socket says 172.21.15.134:46134) 2024-04-24T02:12:23.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.436+0000 7f3fd5745640 1 -- 172.21.15.134:0/15362227 learned_addr learned my addr 172.21.15.134:0/15362227 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:23.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.436+0000 7f3fd5745640 1 -- 172.21.15.134:0/15362227 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3c0f5ea00 con 0x55d3c0e697e0 2024-04-24T02:12:23.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.437+0000 7f3fd5745640 1 --2- 172.21.15.134:0/15362227 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3c0e697e0 0x55d3c0f5e430 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0007000 tx=0x7f3fd004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93389c3e8653881f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.437+0000 7f3ec3606640 1 -- 172.21.15.134:0/15362227 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fd0052860 con 0x55d3c0e697e0 2024-04-24T02:12:23.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.437+0000 7f3ec3606640 1 -- 172.21.15.134:0/15362227 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fd0058040 con 0x55d3c0e697e0 2024-04-24T02:12:23.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.437+0000 7f3ec3606640 1 -- 172.21.15.134:0/15362227 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fd0052b50 con 0x55d3c0e697e0 2024-04-24T02:12:23.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.437+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/15362227 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3c0e697e0 msgr2=0x55d3c0f5e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.437+0000 7f3fd7c3f800 1 --2- 172.21.15.134:0/15362227 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3c0e697e0 0x55d3c0f5e430 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0007000 tx=0x7f3fd004c000 comp rx=0 tx=0).stop 2024-04-24T02:12:23.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.437+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/15362227 shutdown_connections 2024-04-24T02:12:23.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.437+0000 7f3fd7c3f800 1 --2- 172.21.15.134:0/15362227 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3c0e697e0 0x55d3c0f5e430 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.437+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/15362227 >> 172.21.15.134:0/15362227 conn(0x55d3c0e65320 msgr2=0x55d3c0f59d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:23.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.437+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/15362227 shutdown_connections 2024-04-24T02:12:23.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.437+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/15362227 wait complete. 2024-04-24T02:12:23.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.438+0000 7f3fd7c3f800 1 Processor -- start 2024-04-24T02:12:23.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.438+0000 7f3fd7c3f800 1 -- start start 2024-04-24T02:12:23.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.438+0000 7f3fd7c3f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3c0e697e0 0x55d3c0f65fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.438+0000 7f3fd7c3f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d3c0e6af40 con 0x55d3c0e697e0 2024-04-24T02:12:23.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.438+0000 7f3fd5745640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3c0e697e0 0x55d3c0f65fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.438+0000 7f3fd5745640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3c0e697e0 0x55d3c0f65fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46150/0 (socket says 172.21.15.134:46150) 2024-04-24T02:12:23.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.438+0000 7f3fd5745640 1 -- 172.21.15.134:0/1294865327 learned_addr learned my addr 172.21.15.134:0/1294865327 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:23.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.438+0000 7f3fd5745640 1 -- 172.21.15.134:0/1294865327 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3c0f664f0 con 0x55d3c0e697e0 2024-04-24T02:12:23.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.438+0000 7f3fd5745640 1 --2- 172.21.15.134:0/1294865327 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3c0e697e0 0x55d3c0f65fb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0007000 tx=0x7f3fd0003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.439+0000 7f3ec1e03640 1 -- 172.21.15.134:0/1294865327 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fd005d630 con 0x55d3c0e697e0 2024-04-24T02:12:23.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.439+0000 7f3ec1e03640 1 -- 172.21.15.134:0/1294865327 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fd005d7d0 con 0x55d3c0e697e0 2024-04-24T02:12:23.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.439+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/1294865327 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d3c0f66780 con 0x55d3c0e697e0 2024-04-24T02:12:23.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.439+0000 7f3ec1e03640 1 -- 172.21.15.134:0/1294865327 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fd005dad0 con 0x55d3c0e697e0 2024-04-24T02:12:23.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.439+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/1294865327 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3c0f69390 con 0x55d3c0e697e0 2024-04-24T02:12:23.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.439+0000 7f3ec1e03640 1 -- 172.21.15.134:0/1294865327 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3fd0050070 con 0x55d3c0e697e0 2024-04-24T02:12:23.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.440+0000 7f3ec1e03640 1 --2- 172.21.15.134:0/1294865327 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3ebc036900 0x7f3ebc038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.440+0000 7f3ec1e03640 1 -- 172.21.15.134:0/1294865327 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f3fd0062070 con 0x55d3c0e697e0 2024-04-24T02:12:23.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.440+0000 7f3fd4f44640 1 --2- 172.21.15.134:0/1294865327 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3ebc036900 0x7f3ebc038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.440+0000 7f3fd7c3f800 1 --2- 172.21.15.134:0/1294865327 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d3c0e6a140 0x55d3c0f6d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.440+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/1294865327 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0f6d690 con 0x55d3c0e6a140 2024-04-24T02:12:23.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.440+0000 7f3fd5f46640 1 --2- 172.21.15.134:0/1294865327 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d3c0e6a140 0x55d3c0f6d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.440+0000 7f3fd4f44640 1 --2- 172.21.15.134:0/1294865327 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3ebc036900 0x7f3ebc038dc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc001e10 tx=0x7f3fcc001390 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.440+0000 7f3fd5f46640 1 --2- 172.21.15.134:0/1294865327 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d3c0e6a140 0x55d3c0f6d150 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.440+0000 7f3fd5f46640 1 -- 172.21.15.134:0/1294865327 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3fc80083e0 con 0x55d3c0e6a140 2024-04-24T02:12:23.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.440+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/1294865327 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0f6a720 con 0x55d3c0e6a140 2024-04-24T02:12:23.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.441+0000 7f3fd5f46640 1 -- 172.21.15.134:0/1294865327 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3fc80083e0 con 0x55d3c0e6a140 2024-04-24T02:12:23.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.441+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/1294865327 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0f6f520 con 0x55d3c0e6a140 2024-04-24T02:12:23.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.441+0000 7f3fd5f46640 1 -- 172.21.15.134:0/1294865327 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3fc80083e0 con 0x55d3c0e6a140 2024-04-24T02:12:23.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.441+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/1294865327 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0f6e860 con 0x55d3c0e6a140 2024-04-24T02:12:23.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.441+0000 7f3fd5f46640 1 -- 172.21.15.134:0/1294865327 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3fc80083e0 con 0x55d3c0e6a140 2024-04-24T02:12:23.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.441+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/1294865327 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0f6ec50 con 0x55d3c0e6a140 2024-04-24T02:12:23.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.442+0000 7f3fd5f46640 1 -- 172.21.15.134:0/1294865327 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3fc80083e0 con 0x55d3c0e6a140 2024-04-24T02:12:23.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.442+0000 7f3fd7c3f800 1 Processor -- start 2024-04-24T02:12:23.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.442+0000 7f3fd7c3f800 1 -- start start 2024-04-24T02:12:23.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.442+0000 7f3fd7c3f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3c0f7e370 0x55d3c0f7e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.442+0000 7f3fd7c3f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d3c0d5c6b0 con 0x55d3c0f7e370 2024-04-24T02:12:23.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.442+0000 7f3fd4f44640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3c0f7e370 0x55d3c0f7e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.442+0000 7f3fd4f44640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3c0f7e370 0x55d3c0f7e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46166/0 (socket says 172.21.15.134:46166) 2024-04-24T02:12:23.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.442+0000 7f3fd4f44640 1 -- 172.21.15.134:0/2192711065 learned_addr learned my addr 172.21.15.134:0/2192711065 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:23.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.443+0000 7f3fd4f44640 1 -- 172.21.15.134:0/2192711065 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3c0f7ecd0 con 0x55d3c0f7e370 2024-04-24T02:12:23.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.443+0000 7f3fd4f44640 1 --2- 172.21.15.134:0/2192711065 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3c0f7e370 0x55d3c0f7e790 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc001770 tx=0x7f3fcc00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.443+0000 7f3ebaffd640 1 -- 172.21.15.134:0/2192711065 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fcc01c410 con 0x55d3c0f7e370 2024-04-24T02:12:23.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.443+0000 7f3ebaffd640 1 -- 172.21.15.134:0/2192711065 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fcc017050 con 0x55d3c0f7e370 2024-04-24T02:12:23.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.443+0000 7f3ebaffd640 1 -- 172.21.15.134:0/2192711065 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fcc01c6e0 con 0x55d3c0f7e370 2024-04-24T02:12:23.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.443+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/2192711065 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d3c0f7f740 con 0x55d3c0f7e370 2024-04-24T02:12:23.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.443+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/2192711065 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3c0f7fc40 con 0x55d3c0f7e370 2024-04-24T02:12:23.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.444+0000 7f3ebaffd640 1 -- 172.21.15.134:0/2192711065 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3fcc00e070 con 0x55d3c0f7e370 2024-04-24T02:12:23.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.444+0000 7f3ebaffd640 1 --2- 172.21.15.134:0/2192711065 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3eb0036900 0x7f3eb0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.444+0000 7f3ebaffd640 1 -- 172.21.15.134:0/2192711065 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f3fcc04de00 con 0x55d3c0f7e370 2024-04-24T02:12:23.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.444+0000 7f3fd5f46640 1 --2- 172.21.15.134:0/2192711065 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3eb0036900 0x7f3eb0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.444+0000 7f3fd7c3f800 1 Processor -- start 2024-04-24T02:12:23.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.444+0000 7f3fd7c3f800 1 -- start start 2024-04-24T02:12:23.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.444+0000 7f3fd5f46640 1 --2- 172.21.15.134:0/2192711065 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3eb0036900 0x7f3eb0038dc0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x55d3c0f6e380 tx=0x7f3fc8000f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.444+0000 7f3fd7c3f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3c0f8b6e0 0x55d3c0f8bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.444+0000 7f3fd7c3f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d3c0f5ecc0 con 0x55d3c0f8b6e0 2024-04-24T02:12:23.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.445+0000 7f3fd4f44640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3c0f8b6e0 0x55d3c0f8bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.445+0000 7f3fd4f44640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3c0f8b6e0 0x55d3c0f8bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46182/0 (socket says 172.21.15.134:46182) 2024-04-24T02:12:23.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.445+0000 7f3fd4f44640 1 -- 172.21.15.134:0/512666205 learned_addr learned my addr 172.21.15.134:0/512666205 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:23.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.445+0000 7f3fd4f44640 1 -- 172.21.15.134:0/512666205 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3c0f8c0d0 con 0x55d3c0f8b6e0 2024-04-24T02:12:23.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.445+0000 7f3fd4f44640 1 --2- 172.21.15.134:0/512666205 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3c0f8b6e0 0x55d3c0f8bb00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc04c3a0 tx=0x7f3fcc01ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ac83edfb60f29e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.445+0000 7f3eb8ff9640 1 -- 172.21.15.134:0/512666205 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fcc040070 con 0x55d3c0f8b6e0 2024-04-24T02:12:23.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.445+0000 7f3eb8ff9640 1 -- 172.21.15.134:0/512666205 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fcc002e50 con 0x55d3c0f8b6e0 2024-04-24T02:12:23.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.445+0000 7f3eb8ff9640 1 -- 172.21.15.134:0/512666205 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fcc025a70 con 0x55d3c0f8b6e0 2024-04-24T02:12:23.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.446+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/512666205 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3c0f8b6e0 msgr2=0x55d3c0f8bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.446+0000 7f3fd7c3f800 1 --2- 172.21.15.134:0/512666205 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3c0f8b6e0 0x55d3c0f8bb00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc04c3a0 tx=0x7f3fcc01ac60 comp rx=0 tx=0).stop 2024-04-24T02:12:23.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.446+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/512666205 shutdown_connections 2024-04-24T02:12:23.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.446+0000 7f3fd7c3f800 1 --2- 172.21.15.134:0/512666205 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3c0f8b6e0 0x55d3c0f8bb00 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.446+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/512666205 >> 172.21.15.134:0/512666205 conn(0x55d3c0f87a40 msgr2=0x55d3c0f85aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:23.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.446+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/512666205 shutdown_connections 2024-04-24T02:12:23.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.446+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/512666205 wait complete. 2024-04-24T02:12:23.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.446+0000 7f3fd7c3f800 1 Processor -- start 2024-04-24T02:12:23.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.446+0000 7f3fd7c3f800 1 -- start start 2024-04-24T02:12:23.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.446+0000 7f3fd7c3f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3c0f8b6e0 0x55d3c0f92d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.446+0000 7f3fd7c3f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d3c0f8c840 con 0x55d3c0f8b6e0 2024-04-24T02:12:23.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.447+0000 7f3fd4f44640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3c0f8b6e0 0x55d3c0f92d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.447+0000 7f3fd4f44640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3c0f8b6e0 0x55d3c0f92d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46194/0 (socket says 172.21.15.134:46194) 2024-04-24T02:12:23.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.447+0000 7f3fd4f44640 1 -- 172.21.15.134:0/444705333 learned_addr learned my addr 172.21.15.134:0/444705333 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:23.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.447+0000 7f3fd4f44640 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3c0f93290 con 0x55d3c0f8b6e0 2024-04-24T02:12:23.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.447+0000 7f3fd4f44640 1 --2- 172.21.15.134:0/444705333 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3c0f8b6e0 0x55d3c0f92d50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc04c3a0 tx=0x7f3fcc04c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.447+0000 7f3ea6ffd640 1 -- 172.21.15.134:0/444705333 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fcc046070 con 0x55d3c0f8b6e0 2024-04-24T02:12:23.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.447+0000 7f3ea6ffd640 1 -- 172.21.15.134:0/444705333 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fcc03b400 con 0x55d3c0f8b6e0 2024-04-24T02:12:23.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.447+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d3c0f93520 con 0x55d3c0f8b6e0 2024-04-24T02:12:23.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.447+0000 7f3ea6ffd640 1 -- 172.21.15.134:0/444705333 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fcc00ec60 con 0x55d3c0f8b6e0 2024-04-24T02:12:23.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.447+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3c0f93520 con 0x55d3c0f8b6e0 2024-04-24T02:12:23.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.448+0000 7f3ea6ffd640 1 -- 172.21.15.134:0/444705333 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3fcc023530 con 0x55d3c0f8b6e0 2024-04-24T02:12:23.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.448+0000 7f3ea6ffd640 1 --2- 172.21.15.134:0/444705333 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3ea0036950 0x7f3ea0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.448+0000 7f3ea6ffd640 1 -- 172.21.15.134:0/444705333 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f3fcc055b60 con 0x55d3c0f8b6e0 2024-04-24T02:12:23.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.448+0000 7f3fd5f46640 1 --2- 172.21.15.134:0/444705333 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3ea0036950 0x7f3ea0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.448+0000 7f3fd5f46640 1 --2- 172.21.15.134:0/444705333 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3ea0036950 0x7f3ea0038e10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3fc800f010 tx=0x7f3fc800c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.449+0000 7f3fd7c3f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.449+0000 7f3fd7c3f800 1 --2- 172.21.15.134:0/444705333 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d3c0f9e650 0x55d3c0fa0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.449+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fa1260 con 0x55d3c0f9e650 2024-04-24T02:12:23.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.449+0000 7f3fd5745640 1 --2- 172.21.15.134:0/444705333 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d3c0f9e650 0x55d3c0fa0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.449+0000 7f3fd5745640 1 --2- 172.21.15.134:0/444705333 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d3c0f9e650 0x55d3c0fa0b10 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.449+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3fd0078070 con 0x55d3c0f9e650 2024-04-24T02:12:23.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.449+0000 7f3fd7c3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.449+0000 7f3fd7c3f800 20 realm 2024-04-24T02:12:23.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.449+0000 7f3fd7c3f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.449+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fa1670 con 0x55d3c0f9e650 2024-04-24T02:12:23.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.449+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3fd0078070 con 0x55d3c0f9e650 2024-04-24T02:12:23.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.449+0000 7f3fd7c3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.449+0000 7f3fd7c3f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:23.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.449+0000 7f3fd7c3f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.449+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fa1f40 con 0x55d3c0f9e650 2024-04-24T02:12:23.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.450+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3fd0078070 con 0x55d3c0f9e650 2024-04-24T02:12:23.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.450+0000 7f3fd7c3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.450+0000 7f3fd7c3f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.450+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fa22e0 con 0x55d3c0f9e650 2024-04-24T02:12:23.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.450+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3fd0078070 con 0x55d3c0f9e650 2024-04-24T02:12:23.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.450+0000 7f3fd7c3f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:23.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.450+0000 7f3fd7c3f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.450+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fa2b30 con 0x55d3c0f9e650 2024-04-24T02:12:23.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.450+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3fd0078070 con 0x55d3c0f9e650 2024-04-24T02:12:23.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.450+0000 7f3fd7c3f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:23.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.450+0000 7f3fd7c3f800 20 searching for the correct realm 2024-04-24T02:12:23.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.450+0000 7f3fd7c3f800 1 --2- 172.21.15.134:0/444705333 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55d3c0fa48a0 0x55d3c0fa6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.450+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fa7270 con 0x55d3c0fa48a0 2024-04-24T02:12:23.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.450+0000 7f3fd4f44640 1 --2- 172.21.15.134:0/444705333 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55d3c0fa48a0 0x55d3c0fa6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.451+0000 7f3fd4f44640 1 --2- 172.21.15.134:0/444705333 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55d3c0fa48a0 0x55d3c0fa6c90 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.451+0000 7f3fd4f44640 1 -- 172.21.15.134:0/444705333 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fcc038020 con 0x55d3c0fa48a0 2024-04-24T02:12:23.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.451+0000 7f3fd4f44640 1 --2- 172.21.15.134:0/444705333 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f3fcc03b020 0x7f3fcc040740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.451+0000 7f3fd4f44640 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fa7270 con 0x7f3fcc03b020 2024-04-24T02:12:23.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.451+0000 7f3fd5f46640 1 --2- 172.21.15.134:0/444705333 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f3fcc03b020 0x7f3fcc040740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.451+0000 7f3fd5f46640 1 --2- 172.21.15.134:0/444705333 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f3fcc03b020 0x7f3fcc040740 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.452+0000 7f3fd5f46640 1 -- 172.21.15.134:0/444705333 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc802f040 con 0x7f3fcc03b020 2024-04-24T02:12:23.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.452+0000 7f3fd5f46640 1 --2- 172.21.15.134:0/444705333 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f3fc8019040 0x7f3fc8019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.452+0000 7f3fd5f46640 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fa7270 con 0x7f3fc8019040 2024-04-24T02:12:23.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.452+0000 7f3fd5745640 1 --2- 172.21.15.134:0/444705333 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f3fc8019040 0x7f3fc8019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.452+0000 7f3fd5745640 1 --2- 172.21.15.134:0/444705333 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f3fc8019040 0x7f3fc8019930 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.452+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fd0078070 con 0x7f3fc8019040 2024-04-24T02:12:23.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.452+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fa7270 con 0x55d3c0f9e650 2024-04-24T02:12:23.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.453+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fd0078070 con 0x55d3c0f9e650 2024-04-24T02:12:23.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.453+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fa7270 con 0x55d3c0f9e650 2024-04-24T02:12:23.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.453+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3fd0078070 con 0x55d3c0f9e650 2024-04-24T02:12:23.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.453+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fa7270 con 0x7f3fc8019040 2024-04-24T02:12:23.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.453+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fd0078070 con 0x7f3fc8019040 2024-04-24T02:12:23.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.453+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fa7270 con 0x7f3fc8019040 2024-04-24T02:12:23.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.453+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fd0078070 con 0x7f3fc8019040 2024-04-24T02:12:23.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.453+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fa7270 con 0x7f3fcc03b020 2024-04-24T02:12:23.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.453+0000 7f3fd5f46640 1 -- 172.21.15.134:0/444705333 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc802f040 con 0x7f3fcc03b020 2024-04-24T02:12:23.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.453+0000 7f3fd5f46640 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fa7270 con 0x55d3c0fa48a0 2024-04-24T02:12:23.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.454+0000 7f3fd4f44640 1 -- 172.21.15.134:0/444705333 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fcc063040 con 0x55d3c0fa48a0 2024-04-24T02:12:23.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.454+0000 7f3fd4f44640 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fa7270 con 0x55d3c0f9e650 2024-04-24T02:12:23.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.454+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fd0078070 con 0x55d3c0f9e650 2024-04-24T02:12:23.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.454+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fa7270 con 0x7f3fc8019040 2024-04-24T02:12:23.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.454+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fd0078070 con 0x7f3fc8019040 2024-04-24T02:12:23.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.454+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fa7270 con 0x55d3c0f9e650 2024-04-24T02:12:23.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.454+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fd0078070 con 0x55d3c0f9e650 2024-04-24T02:12:23.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.454+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fa7270 con 0x7f3fcc03b020 2024-04-24T02:12:23.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.455+0000 7f3fd5f46640 1 -- 172.21.15.134:0/444705333 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3fc802f040 con 0x7f3fcc03b020 2024-04-24T02:12:23.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.455+0000 7f3fd5f46640 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fa7270 con 0x55d3c0fa48a0 2024-04-24T02:12:23.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.455+0000 7f3fd4f44640 1 -- 172.21.15.134:0/444705333 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fcc063040 con 0x55d3c0fa48a0 2024-04-24T02:12:23.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.455+0000 7f3fd4f44640 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fa7270 con 0x55d3c0fa48a0 2024-04-24T02:12:23.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.455+0000 7f3fd4f44640 1 -- 172.21.15.134:0/444705333 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fcc063040 con 0x55d3c0fa48a0 2024-04-24T02:12:23.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.455+0000 7f3fd4f44640 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fa7270 con 0x7f3fc8019040 2024-04-24T02:12:23.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.455+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fd0078070 con 0x7f3fc8019040 2024-04-24T02:12:23.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.455+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fa7270 con 0x55d3c0fa48a0 2024-04-24T02:12:23.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.456+0000 7f3fd4f44640 1 -- 172.21.15.134:0/444705333 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fcc063040 con 0x55d3c0fa48a0 2024-04-24T02:12:23.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.456+0000 7f3fd4f44640 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fa7270 con 0x55d3c0fa48a0 2024-04-24T02:12:23.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.456+0000 7f3fd4f44640 1 -- 172.21.15.134:0/444705333 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fcc063040 con 0x55d3c0fa48a0 2024-04-24T02:12:23.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.456+0000 7f3fd4f44640 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fa7270 con 0x55d3c0f9e650 2024-04-24T02:12:23.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.456+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fd0078070 con 0x55d3c0f9e650 2024-04-24T02:12:23.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.456+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fa7270 con 0x55d3c0f9e650 2024-04-24T02:12:23.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.456+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f3fd0078070 con 0x55d3c0f9e650 2024-04-24T02:12:23.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.456+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fa7270 con 0x7f3fc8019040 2024-04-24T02:12:23.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.456+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fd0078070 con 0x7f3fc8019040 2024-04-24T02:12:23.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.456+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fa7270 con 0x55d3c0fa48a0 2024-04-24T02:12:23.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.457+0000 7f3fd4f44640 1 -- 172.21.15.134:0/444705333 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fcc063040 con 0x55d3c0fa48a0 2024-04-24T02:12:23.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.457+0000 7f3fd4f44640 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fa7270 con 0x7f3fcc03b020 2024-04-24T02:12:23.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.457+0000 7f3fd5f46640 1 -- 172.21.15.134:0/444705333 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc802f040 con 0x7f3fcc03b020 2024-04-24T02:12:23.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.457+0000 7f3fd5f46640 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fa7270 con 0x55d3c0f9e650 2024-04-24T02:12:23.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.457+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fd0078070 con 0x55d3c0f9e650 2024-04-24T02:12:23.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.457+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fa7270 con 0x7f3fc8019040 2024-04-24T02:12:23.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.457+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fd0078070 con 0x7f3fc8019040 2024-04-24T02:12:23.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.457+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fa7270 con 0x55d3c0fa48a0 2024-04-24T02:12:23.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.458+0000 7f3fd4f44640 1 -- 172.21.15.134:0/444705333 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fcc063040 con 0x55d3c0fa48a0 2024-04-24T02:12:23.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.458+0000 7f3fd4f44640 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fa7270 con 0x7f3fc8019040 2024-04-24T02:12:23.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.458+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fd0078070 con 0x7f3fc8019040 2024-04-24T02:12:23.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.458+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fa7270 con 0x7f3fcc03b020 2024-04-24T02:12:23.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.458+0000 7f3fd5f46640 1 -- 172.21.15.134:0/444705333 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc802f040 con 0x7f3fcc03b020 2024-04-24T02:12:23.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.458+0000 7f3fd5f46640 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fa7270 con 0x55d3c0fa48a0 2024-04-24T02:12:23.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.459+0000 7f3fd4f44640 1 -- 172.21.15.134:0/444705333 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fcc063040 con 0x55d3c0fa48a0 2024-04-24T02:12:23.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.459+0000 7f3fd4f44640 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fa7270 con 0x7f3fc8019040 2024-04-24T02:12:23.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.459+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fd0078070 con 0x7f3fc8019040 2024-04-24T02:12:23.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.459+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fa7270 con 0x55d3c0f9e650 2024-04-24T02:12:23.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.459+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3fd0078070 con 0x55d3c0f9e650 2024-04-24T02:12:23.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.459+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fa7270 con 0x7f3fcc03b020 2024-04-24T02:12:23.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.460+0000 7f3fd5f46640 1 -- 172.21.15.134:0/444705333 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc802f040 con 0x7f3fcc03b020 2024-04-24T02:12:23.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.460+0000 7f3fd7c3f800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:23.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.460+0000 7f3fd7c3f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:23.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.460+0000 7f3fd7c3f800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:23.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.460+0000 7f3fd7c3f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:23.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.460+0000 7f3fd7c3f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:23.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.460+0000 7f3fd7c3f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:23.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.460+0000 7f3fd7c3f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.460+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fa34b0 con 0x55d3c0f9e650 2024-04-24T02:12:23.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.460+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3fd0078070 con 0x55d3c0f9e650 2024-04-24T02:12:23.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.460+0000 7f3fd7c3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.460+0000 7f3fd7c3f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.460+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fa3d50 con 0x55d3c0f9e650 2024-04-24T02:12:23.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.460+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3fd0078070 con 0x55d3c0f9e650 2024-04-24T02:12:23.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.460+0000 7f3fd7c3f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:23.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.460+0000 7f3fd7c3f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.460+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fa3d50 con 0x55d3c0f9e650 2024-04-24T02:12:23.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.460+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3fd0078070 con 0x55d3c0f9e650 2024-04-24T02:12:23.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.460+0000 7f3fd7c3f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:23.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.460+0000 7f3fd7c3f800 20 zone default found 2024-04-24T02:12:23.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.460+0000 7f3fd7c3f800 4 Realm: () 2024-04-24T02:12:23.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.460+0000 7f3fd7c3f800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:23.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.460+0000 7f3fd7c3f800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:23.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.460+0000 7f3fd7c3f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:23.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.460+0000 7f3fd7c3f800 20 zonegroup default 2024-04-24T02:12:23.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.460+0000 7f3fd7c3f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.460+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fa76f0 con 0x7f3fc8019040 2024-04-24T02:12:23.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.461+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3fd0078070 con 0x7f3fc8019040 2024-04-24T02:12:23.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.461+0000 7f3fd7c3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.461+0000 7f3fd7c3f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.461+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fa9100 con 0x55d3c0fa48a0 2024-04-24T02:12:23.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.461+0000 7f3fd4f44640 1 -- 172.21.15.134:0/444705333 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3fcc063040 con 0x55d3c0fa48a0 2024-04-24T02:12:23.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.461+0000 7f3fd7c3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.461+0000 7f3fd7c3f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.461+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fa9610 con 0x55d3c0fa48a0 2024-04-24T02:12:23.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.461+0000 7f3fd4f44640 1 -- 172.21.15.134:0/444705333 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3fcc063040 con 0x55d3c0fa48a0 2024-04-24T02:12:23.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.461+0000 7f3fd7c3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.461+0000 7f3fd7c3f800 20 started sync module instance, tier type = 2024-04-24T02:12:23.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.461+0000 7f3fd7c3f800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:23.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.461+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fa8570 con 0x7f3fcc03b020 2024-04-24T02:12:23.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.462+0000 7f3fd5f46640 1 -- 172.21.15.134:0/444705333 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc802f040 con 0x7f3fcc03b020 2024-04-24T02:12:23.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.462+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94367964105360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fa8570 con 0x7f3fcc03b020 2024-04-24T02:12:23.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.462+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0faa090 con 0x55d3c0f9e650 2024-04-24T02:12:23.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.463+0000 7f3fd5f46640 1 -- 172.21.15.134:0/444705333 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94367964105360] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc802f040 con 0x7f3fcc03b020 2024-04-24T02:12:23.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.464+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fd0078070 con 0x55d3c0f9e650 2024-04-24T02:12:23.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.464+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94367964110272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fa8570 con 0x55d3c0f9e650 2024-04-24T02:12:23.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.464+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0faab30 con 0x55d3c0fa48a0 2024-04-24T02:12:23.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.465+0000 7f3fd4f44640 1 -- 172.21.15.134:0/444705333 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fcc063040 con 0x55d3c0fa48a0 2024-04-24T02:12:23.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.465+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94367964112416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fab3d0 con 0x55d3c0fa48a0 2024-04-24T02:12:23.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.465+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fabe90 con 0x7f3fcc03b020 2024-04-24T02:12:23.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.465+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94367964110272] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fd0078070 con 0x55d3c0f9e650 2024-04-24T02:12:23.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.466+0000 7f3fd4f44640 1 -- 172.21.15.134:0/444705333 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94367964112416] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fcc063040 con 0x55d3c0fa48a0 2024-04-24T02:12:23.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.466+0000 7f3fd5f46640 1 -- 172.21.15.134:0/444705333 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc802f040 con 0x7f3fcc03b020 2024-04-24T02:12:23.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.466+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94367964114720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fa80c0 con 0x7f3fcc03b020 2024-04-24T02:12:23.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.466+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fac790 con 0x55d3c0f9e650 2024-04-24T02:12:23.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.467+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fd0078070 con 0x55d3c0f9e650 2024-04-24T02:12:23.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.467+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94367964119680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fac750 con 0x55d3c0f9e650 2024-04-24T02:12:23.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.467+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fad720 con 0x7f3fc8019040 2024-04-24T02:12:23.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.467+0000 7f3fd5f46640 1 -- 172.21.15.134:0/444705333 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94367964114720] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc802f040 con 0x7f3fcc03b020 2024-04-24T02:12:23.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.468+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fd0078070 con 0x7f3fc8019040 2024-04-24T02:12:23.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.468+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94367964123696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fad720 con 0x7f3fc8019040 2024-04-24T02:12:23.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.468+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94367964119680] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fd0078070 con 0x55d3c0f9e650 2024-04-24T02:12:23.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.468+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0facb30 con 0x7f3fc8019040 2024-04-24T02:12:23.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.469+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94367964123696] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fd0078070 con 0x7f3fc8019040 2024-04-24T02:12:23.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.470+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(56 notify.6 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fd0078070 con 0x7f3fc8019040 2024-04-24T02:12:23.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.470+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94367964117344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fadc80 con 0x7f3fc8019040 2024-04-24T02:12:23.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.470+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fae640 con 0x7f3fc8019040 2024-04-24T02:12:23.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.471+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94367964117344] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fd0078070 con 0x7f3fc8019040 2024-04-24T02:12:23.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.471+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(58 notify.7 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fd0078070 con 0x7f3fc8019040 2024-04-24T02:12:23.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.471+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94367964121904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fae640 con 0x7f3fc8019040 2024-04-24T02:12:23.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.471+0000 7f3fd7c3f800 20 add_watcher() i=0 2024-04-24T02:12:23.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.471+0000 7f3fd7c3f800 20 add_watcher() i=1 2024-04-24T02:12:23.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.471+0000 7f3fd7c3f800 20 add_watcher() i=2 2024-04-24T02:12:23.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.471+0000 7f3fd7c3f800 20 add_watcher() i=3 2024-04-24T02:12:23.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.471+0000 7f3fd7c3f800 20 add_watcher() i=4 2024-04-24T02:12:23.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.471+0000 7f3fd7c3f800 20 add_watcher() i=5 2024-04-24T02:12:23.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.471+0000 7f3fd7c3f800 20 add_watcher() i=6 2024-04-24T02:12:23.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.471+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94367964121904] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fd0078070 con 0x7f3fc8019040 2024-04-24T02:12:23.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.472+0000 7f3fd7c3f800 20 add_watcher() i=7 2024-04-24T02:12:23.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.472+0000 7f3fd7c3f800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:23.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.472+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fb1950 con 0x55d3c0f9e650 2024-04-24T02:12:23.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.472+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3fd0078070 con 0x55d3c0f9e650 2024-04-24T02:12:23.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.472+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94367964140384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fae7b0 con 0x55d3c0f9e650 2024-04-24T02:12:23.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.473+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94367964140384] v30'78 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3fd0078070 con 0x55d3c0f9e650 2024-04-24T02:12:23.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.473+0000 7f3e8b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:23.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.473+0000 7f3fd7c3f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:23.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.473+0000 7f3fd7c3f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:23.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.473+0000 7f3fd7c3f800 5 note: GC not initialized 2024-04-24T02:12:23.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.473+0000 7f3e8a7e4640 20 reqs_thread_entry: start 2024-04-24T02:12:23.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.473+0000 7f3fd7c3f800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:23.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.473+0000 7f3fd7c3f800 20 Filter name: none 2024-04-24T02:12:23.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.473+0000 7f3dfbfff640 20 reqs_thread_entry: start 2024-04-24T02:12:23.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.474+0000 7f3fd7c3f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T02:12:23.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.474+0000 7f3fd7c3f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.474+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fe4d20 con 0x55d3c0f9e650 2024-04-24T02:12:23.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.474+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f3fd0078070 con 0x55d3c0f9e650 2024-04-24T02:12:23.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.474+0000 7f3fd7c3f800 20 rados_obj.operate() r=0 bl.length=556 2024-04-24T02:12:23.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.474+0000 7f3fd7c3f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T02:12:23.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.474+0000 7f3fd7c3f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:23.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.474+0000 7f3fd7c3f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:12:23.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.474+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0feb4a0 con 0x55d3c0f9e650 2024-04-24T02:12:23.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.475+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v30'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f3fd0078070 con 0x55d3c0f9e650 2024-04-24T02:12:23.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.475+0000 7f3fd7c3f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T02:12:23.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.475+0000 7f3fd7c3f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:23.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.475+0000 7f3fd7c3f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-24T02:12:23.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.475+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94367964376880 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fe6bf0 con 0x55d3c0f9e650 2024-04-24T02:12:23.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.475+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== watch-notify(notify (1) cookie 94367964119680 notify 128849018886 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7f3fd0085040 con 0x55d3c0f9e650 2024-04-24T02:12:23.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.475+0000 7f3eb8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018886 cookie 94367964119680 notifier 4362 bl.length()=732 2024-04-24T02:12:23.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.475+0000 7f3eb8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T02:12:23.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.475+0000 7f3eb8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:23.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.475+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(64 notify.4 [notify cookie 94367964376880 out=8b] v0'0 uv57 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3fd0078070 con 0x55d3c0f9e650 2024-04-24T02:12:23.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.475+0000 7f3eb8ff9640 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f3e98003ea0 con 0x55d3c0f9e650 2024-04-24T02:12:23.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.476+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fd0078070 con 0x55d3c0f9e650 2024-04-24T02:12:23.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.476+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== watch-notify(notify_complete (2) cookie 94367964376880 notify 128849018886 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d3c0f69390 con 0x55d3c0f9e650 2024-04-24T02:12:23.498 INFO:teuthology.orchestra.run.smithi134.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T02:12:21.778798Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T02:12:21.778786Z","tags":[],"group_ids":[]} 2024-04-24T02:12:23.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.477+0000 7f3e8b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:23.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.477+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94367964140384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fe7020 con 0x55d3c0f9e650 2024-04-24T02:12:23.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.477+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94367964140384] v30'79 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3fd0078070 con 0x55d3c0f9e650 2024-04-24T02:12:23.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.477+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94367964105360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fb1360 con 0x7f3fcc03b020 2024-04-24T02:12:23.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.478+0000 7f3fd5f46640 1 -- 172.21.15.134:0/444705333 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94367964105360] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc802f040 con 0x7f3fcc03b020 2024-04-24T02:12:23.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.478+0000 7f3fd7c3f800 20 remove_watcher() i=0 2024-04-24T02:12:23.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.478+0000 7f3fd7c3f800 2 removed watcher, disabling cache 2024-04-24T02:12:23.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.478+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94367964110272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fa8a70 con 0x55d3c0f9e650 2024-04-24T02:12:23.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.480+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 <== osd.1 v2:172.21.15.134:6804/1487076214 30 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94367964110272] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fd0078070 con 0x55d3c0f9e650 2024-04-24T02:12:23.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.480+0000 7f3fd7c3f800 20 remove_watcher() i=1 2024-04-24T02:12:23.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.480+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94367964112416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fa9dc0 con 0x55d3c0fa48a0 2024-04-24T02:12:23.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.481+0000 7f3fd4f44640 1 -- 172.21.15.134:0/444705333 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94367964112416] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fcc063040 con 0x55d3c0fa48a0 2024-04-24T02:12:23.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.481+0000 7f3fd7c3f800 20 remove_watcher() i=2 2024-04-24T02:12:23.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.481+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94367964114720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0faa620 con 0x7f3fcc03b020 2024-04-24T02:12:23.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.482+0000 7f3fd5f46640 1 -- 172.21.15.134:0/444705333 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94367964114720] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc802f040 con 0x7f3fcc03b020 2024-04-24T02:12:23.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.482+0000 7f3fd7c3f800 20 remove_watcher() i=3 2024-04-24T02:12:23.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.482+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94367964119680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0faa620 con 0x55d3c0f9e650 2024-04-24T02:12:23.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.482+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 <== osd.1 v2:172.21.15.134:6804/1487076214 31 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94367964119680] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fd0078070 con 0x55d3c0f9e650 2024-04-24T02:12:23.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.483+0000 7f3fd7c3f800 20 remove_watcher() i=4 2024-04-24T02:12:23.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.483+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94367964123696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0faa620 con 0x7f3fc8019040 2024-04-24T02:12:23.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.483+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94367964123696] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fd0078070 con 0x7f3fc8019040 2024-04-24T02:12:23.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.483+0000 7f3fd7c3f800 20 remove_watcher() i=5 2024-04-24T02:12:23.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.483+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94367964117344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0fad230 con 0x7f3fc8019040 2024-04-24T02:12:23.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.484+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94367964117344] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fd0078070 con 0x7f3fc8019040 2024-04-24T02:12:23.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.484+0000 7f3fd7c3f800 20 remove_watcher() i=6 2024-04-24T02:12:23.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.484+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94367964121904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d3c0faa620 con 0x7f3fc8019040 2024-04-24T02:12:23.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.485+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94367964121904] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fd0078070 con 0x7f3fc8019040 2024-04-24T02:12:23.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.485+0000 7f3fd7c3f800 20 remove_watcher() i=7 2024-04-24T02:12:23.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.485+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f3fc8019040 msgr2=0x7f3fc8019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.485+0000 7f3fd7c3f800 1 --2- 172.21.15.134:0/444705333 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f3fc8019040 0x7f3fc8019930 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.485+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d3c0f9e650 msgr2=0x55d3c0fa0b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.485+0000 7f3fd7c3f800 1 --2- 172.21.15.134:0/444705333 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d3c0f9e650 0x55d3c0fa0b10 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.485+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f3fcc03b020 msgr2=0x7f3fcc040740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.485+0000 7f3fd7c3f800 1 --2- 172.21.15.134:0/444705333 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f3fcc03b020 0x7f3fcc040740 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.485+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55d3c0fa48a0 msgr2=0x55d3c0fa6c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.485+0000 7f3fd7c3f800 1 --2- 172.21.15.134:0/444705333 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55d3c0fa48a0 0x55d3c0fa6c90 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.485+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3ea0036950 msgr2=0x7f3ea0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.485+0000 7f3fd7c3f800 1 --2- 172.21.15.134:0/444705333 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3ea0036950 0x7f3ea0038e10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3fc800f010 tx=0x7f3fc800c040 comp rx=0 tx=0).stop 2024-04-24T02:12:23.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.485+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3c0f8b6e0 msgr2=0x55d3c0f92d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.485+0000 7f3fd5745640 1 -- 172.21.15.134:0/444705333 reap_dead start 2024-04-24T02:12:23.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.485+0000 7f3fd7c3f800 1 --2- 172.21.15.134:0/444705333 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3c0f8b6e0 0x55d3c0f92d50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc04c3a0 tx=0x7f3fcc04c330 comp rx=0 tx=0).stop 2024-04-24T02:12:23.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.486+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 shutdown_connections 2024-04-24T02:12:23.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.486+0000 7f3fd7c3f800 1 --2- 172.21.15.134:0/444705333 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3c0f8b6e0 0x55d3c0f92d50 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.486+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 >> 172.21.15.134:0/444705333 conn(0x55d3c0f87a40 msgr2=0x55d3c0f850a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:23.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.486+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 shutdown_connections 2024-04-24T02:12:23.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.486+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/444705333 wait complete. 2024-04-24T02:12:23.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.486+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/2192711065 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3eb0036900 msgr2=0x7f3eb0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.486+0000 7f3fd7c3f800 1 --2- 172.21.15.134:0/2192711065 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3eb0036900 0x7f3eb0038dc0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x55d3c0f6e380 tx=0x7f3fc8000f90 comp rx=0 tx=0).stop 2024-04-24T02:12:23.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.486+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/2192711065 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3c0f7e370 msgr2=0x55d3c0f7e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.486+0000 7f3fd7c3f800 1 --2- 172.21.15.134:0/2192711065 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3c0f7e370 0x55d3c0f7e790 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc001770 tx=0x7f3fcc00f790 comp rx=0 tx=0).stop 2024-04-24T02:12:23.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.486+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/2192711065 shutdown_connections 2024-04-24T02:12:23.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.486+0000 7f3fd7c3f800 1 --2- 172.21.15.134:0/2192711065 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3eb0036900 0x7f3eb0038dc0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.486+0000 7f3fd7c3f800 1 --2- 172.21.15.134:0/2192711065 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3c0f7e370 0x55d3c0f7e790 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.486+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/2192711065 >> 172.21.15.134:0/2192711065 conn(0x55d3c0f72410 msgr2=0x55d3c0f72810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:23.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.486+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/2192711065 shutdown_connections 2024-04-24T02:12:23.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.486+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/2192711065 wait complete. 2024-04-24T02:12:23.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.486+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/1294865327 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d3c0e6a140 msgr2=0x55d3c0f6d150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.486+0000 7f3fd7c3f800 1 --2- 172.21.15.134:0/1294865327 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d3c0e6a140 0x55d3c0f6d150 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.486+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/1294865327 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3ebc036900 msgr2=0x7f3ebc038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.486+0000 7f3fd7c3f800 1 --2- 172.21.15.134:0/1294865327 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3ebc036900 0x7f3ebc038dc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc001e10 tx=0x7f3fcc001390 comp rx=0 tx=0).stop 2024-04-24T02:12:23.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.486+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/1294865327 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3c0e697e0 msgr2=0x55d3c0f65fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.486+0000 7f3fd7c3f800 1 --2- 172.21.15.134:0/1294865327 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3c0e697e0 0x55d3c0f65fb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0007000 tx=0x7f3fd0003330 comp rx=0 tx=0).stop 2024-04-24T02:12:23.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.486+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/1294865327 shutdown_connections 2024-04-24T02:12:23.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.486+0000 7f3fd7c3f800 1 --2- 172.21.15.134:0/1294865327 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d3c0e6a140 0x55d3c0f6d150 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.486+0000 7f3fd7c3f800 1 --2- 172.21.15.134:0/1294865327 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3ebc036900 0x7f3ebc038dc0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.486+0000 7f3fd7c3f800 1 --2- 172.21.15.134:0/1294865327 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3c0e697e0 0x55d3c0f65fb0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.486+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/1294865327 >> 172.21.15.134:0/1294865327 conn(0x55d3c0e65320 msgr2=0x55d3c0f58550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:23.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.486+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/1294865327 shutdown_connections 2024-04-24T02:12:23.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.486+0000 7f3fd7c3f800 1 -- 172.21.15.134:0/1294865327 wait complete. 2024-04-24T02:12:23.510 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T02:12:21.778798Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:12:21.778786Z', 'tags': [], 'group_ids': []} 2024-04-24T02:12:23.510 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-24T02:12:23.510 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-24T02:12:23.510 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-24T02:12:23.553 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:23.553 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:23.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.552+0000 7f4100e3e800 1 Processor -- start 2024-04-24T02:12:23.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.552+0000 7f4100e3e800 1 -- start start 2024-04-24T02:12:23.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.553+0000 7f4100e3e800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x559055f292e0 0x559055f31de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.553+0000 7f4100e3e800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559055de7d40 con 0x559055f277a0 2024-04-24T02:12:23.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.553+0000 7f4100e3e800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x559055dba4d0 con 0x559055f292e0 2024-04-24T02:12:23.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.553+0000 7f40f32d4640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x559055f292e0 0x559055f31de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.553+0000 7f40f32d4640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x559055f292e0 0x559055f31de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46198/0 (socket says 172.21.15.134:46198) 2024-04-24T02:12:23.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.553+0000 7f40f32d4640 1 -- 172.21.15.134:0/1592066946 learned_addr learned my addr 172.21.15.134:0/1592066946 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:23.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.553+0000 7f40f32d4640 1 -- 172.21.15.134:0/1592066946 >> v1:172.21.15.104:6789/0 conn(0x559055f277a0 legacy=0x559055f27bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.553+0000 7f40f32d4640 1 -- 172.21.15.134:0/1592066946 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559055de6590 con 0x559055f292e0 2024-04-24T02:12:23.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.555+0000 7f40f32d4640 1 --2- 172.21.15.134:0/1592066946 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559055f292e0 0x559055f31de0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f40e400a520 tx=0x7f40e401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=437827a7fd07ba5e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.555+0000 7f40fb2d4640 1 -- 172.21.15.134:0/1592066946 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40e4057070 con 0x559055f292e0 2024-04-24T02:12:23.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.555+0000 7f40fb2d4640 1 -- 172.21.15.134:0/1592066946 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40e4052440 con 0x559055f292e0 2024-04-24T02:12:23.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.555+0000 7f40fb2d4640 1 -- 172.21.15.134:0/1592066946 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40e404ae60 con 0x559055f292e0 2024-04-24T02:12:23.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.556+0000 7f4100e3e800 1 -- 172.21.15.134:0/1592066946 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559055f292e0 msgr2=0x559055f31de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.556+0000 7f4100e3e800 1 --2- 172.21.15.134:0/1592066946 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559055f292e0 0x559055f31de0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f40e400a520 tx=0x7f40e401d010 comp rx=0 tx=0).stop 2024-04-24T02:12:23.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.556+0000 7f4100e3e800 1 -- 172.21.15.134:0/1592066946 shutdown_connections 2024-04-24T02:12:23.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.556+0000 7f4100e3e800 1 --2- 172.21.15.134:0/1592066946 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559055f292e0 0x559055f31de0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.556+0000 7f4100e3e800 1 -- 172.21.15.134:0/1592066946 >> 172.21.15.134:0/1592066946 conn(0x559055f23320 msgr2=0x559055f25740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:23.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.556+0000 7f4100e3e800 1 -- 172.21.15.134:0/1592066946 shutdown_connections 2024-04-24T02:12:23.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.556+0000 7f4100e3e800 1 -- 172.21.15.134:0/1592066946 wait complete. 2024-04-24T02:12:23.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.567+0000 7f4100e3e800 1 Processor -- start 2024-04-24T02:12:23.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.567+0000 7f4100e3e800 1 -- start start 2024-04-24T02:12:23.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.567+0000 7f4100e3e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559055f277a0 0x55905601c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.567+0000 7f4100e3e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x559055e743c0 con 0x559055f277a0 2024-04-24T02:12:23.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.568+0000 7f40fbad5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559055f277a0 0x55905601c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.568+0000 7f40fbad5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559055f277a0 0x55905601c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46206/0 (socket says 172.21.15.134:46206) 2024-04-24T02:12:23.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.568+0000 7f40fbad5640 1 -- 172.21.15.134:0/2383530888 learned_addr learned my addr 172.21.15.134:0/2383530888 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:23.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.568+0000 7f40fbad5640 1 -- 172.21.15.134:0/2383530888 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55905601cad0 con 0x559055f277a0 2024-04-24T02:12:23.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.568+0000 7f40fbad5640 1 --2- 172.21.15.134:0/2383530888 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559055f277a0 0x55905601c500 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f40ec001d20 tx=0x7f40ec00b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbdc7595dde9315f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.568+0000 7f3fe9e0b640 1 -- 172.21.15.134:0/2383530888 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40ec00f400 con 0x559055f277a0 2024-04-24T02:12:23.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.568+0000 7f3fe9e0b640 1 -- 172.21.15.134:0/2383530888 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40ec00f5a0 con 0x559055f277a0 2024-04-24T02:12:23.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.568+0000 7f3fe9e0b640 1 -- 172.21.15.134:0/2383530888 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40ec00f7d0 con 0x559055f277a0 2024-04-24T02:12:23.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.569+0000 7f4100e3e800 1 -- 172.21.15.134:0/2383530888 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559055f277a0 msgr2=0x55905601c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.569+0000 7f4100e3e800 1 --2- 172.21.15.134:0/2383530888 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559055f277a0 0x55905601c500 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f40ec001d20 tx=0x7f40ec00b5b0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.569+0000 7f4100e3e800 1 -- 172.21.15.134:0/2383530888 shutdown_connections 2024-04-24T02:12:23.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.569+0000 7f4100e3e800 1 --2- 172.21.15.134:0/2383530888 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559055f277a0 0x55905601c500 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.569+0000 7f4100e3e800 1 -- 172.21.15.134:0/2383530888 >> 172.21.15.134:0/2383530888 conn(0x559055f23320 msgr2=0x559056017e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:23.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.569+0000 7f4100e3e800 1 -- 172.21.15.134:0/2383530888 shutdown_connections 2024-04-24T02:12:23.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.569+0000 7f4100e3e800 1 -- 172.21.15.134:0/2383530888 wait complete. 2024-04-24T02:12:23.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.569+0000 7f4100e3e800 1 Processor -- start 2024-04-24T02:12:23.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.569+0000 7f4100e3e800 1 -- start start 2024-04-24T02:12:23.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.570+0000 7f4100e3e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559055f277a0 0x559056024050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.570+0000 7f4100e3e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x559055f34600 con 0x559055f277a0 2024-04-24T02:12:23.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.570+0000 7f40fbad5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559055f277a0 0x559056024050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.570+0000 7f40fbad5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559055f277a0 0x559056024050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46222/0 (socket says 172.21.15.134:46222) 2024-04-24T02:12:23.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.570+0000 7f40fbad5640 1 -- 172.21.15.134:0/22718545 learned_addr learned my addr 172.21.15.134:0/22718545 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:23.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.570+0000 7f40fbad5640 1 -- 172.21.15.134:0/22718545 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559056024590 con 0x559055f277a0 2024-04-24T02:12:23.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.570+0000 7f40fbad5640 1 --2- 172.21.15.134:0/22718545 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559055f277a0 0x559056024050 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x55905601d290 tx=0x7f40ec000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.570+0000 7f3fe3fff640 1 -- 172.21.15.134:0/22718545 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40ec01a690 con 0x559055f277a0 2024-04-24T02:12:23.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.571+0000 7f3fe3fff640 1 -- 172.21.15.134:0/22718545 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40ec01a830 con 0x559055f277a0 2024-04-24T02:12:23.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.571+0000 7f4100e3e800 1 -- 172.21.15.134:0/22718545 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559056024820 con 0x559055f277a0 2024-04-24T02:12:23.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.571+0000 7f3fe3fff640 1 -- 172.21.15.134:0/22718545 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40ec01ab30 con 0x559055f277a0 2024-04-24T02:12:23.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.571+0000 7f4100e3e800 1 -- 172.21.15.134:0/22718545 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590560274d0 con 0x559055f277a0 2024-04-24T02:12:23.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.571+0000 7f3fe3fff640 1 -- 172.21.15.134:0/22718545 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f40ec017070 con 0x559055f277a0 2024-04-24T02:12:23.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.571+0000 7f3fe3fff640 1 --2- 172.21.15.134:0/22718545 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3fe4036950 0x7f3fe4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.571+0000 7f3fe3fff640 1 -- 172.21.15.134:0/22718545 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f40ec015020 con 0x559055f277a0 2024-04-24T02:12:23.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.572+0000 7f40f32d4640 1 --2- 172.21.15.134:0/22718545 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3fe4036950 0x7f3fe4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.572+0000 7f4100e3e800 1 --2- 172.21.15.134:0/22718545 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x559055f292e0 0x55905602b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.572+0000 7f4100e3e800 1 -- 172.21.15.134:0/22718545 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55905602b810 con 0x559055f292e0 2024-04-24T02:12:23.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.572+0000 7f40fc2d6640 1 --2- 172.21.15.134:0/22718545 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x559055f292e0 0x55905602b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.572+0000 7f40f32d4640 1 --2- 172.21.15.134:0/22718545 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3fe4036950 0x7f3fe4038e10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f40e4054000 tx=0x7f40e404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.572+0000 7f40fc2d6640 1 --2- 172.21.15.134:0/22718545 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x559055f292e0 0x55905602b290 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.572+0000 7f40fc2d6640 1 -- 172.21.15.134:0/22718545 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40f400a4a0 con 0x559055f292e0 2024-04-24T02:12:23.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.572+0000 7f4100e3e800 1 -- 172.21.15.134:0/22718545 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559056028840 con 0x559055f292e0 2024-04-24T02:12:23.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.572+0000 7f40fc2d6640 1 -- 172.21.15.134:0/22718545 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f40f400a4a0 con 0x559055f292e0 2024-04-24T02:12:23.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.573+0000 7f4100e3e800 1 -- 172.21.15.134:0/22718545 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55905602d5f0 con 0x559055f292e0 2024-04-24T02:12:23.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.573+0000 7f40fc2d6640 1 -- 172.21.15.134:0/22718545 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f40f400a4a0 con 0x559055f292e0 2024-04-24T02:12:23.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.573+0000 7f4100e3e800 1 -- 172.21.15.134:0/22718545 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55905602c930 con 0x559055f292e0 2024-04-24T02:12:23.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.573+0000 7f40fc2d6640 1 -- 172.21.15.134:0/22718545 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f40f400a4a0 con 0x559055f292e0 2024-04-24T02:12:23.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.573+0000 7f4100e3e800 1 -- 172.21.15.134:0/22718545 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55905602cd80 con 0x559055f292e0 2024-04-24T02:12:23.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.573+0000 7f40fc2d6640 1 -- 172.21.15.134:0/22718545 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f40f400a4a0 con 0x559055f292e0 2024-04-24T02:12:23.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.574+0000 7f4100e3e800 1 Processor -- start 2024-04-24T02:12:23.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.574+0000 7f4100e3e800 1 -- start start 2024-04-24T02:12:23.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.574+0000 7f4100e3e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55905603c3c0 0x55905603c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.574+0000 7f4100e3e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x559055e1a6b0 con 0x55905603c3c0 2024-04-24T02:12:23.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.574+0000 7f40f32d4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55905603c3c0 0x55905603c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.574+0000 7f40f32d4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55905603c3c0 0x55905603c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46236/0 (socket says 172.21.15.134:46236) 2024-04-24T02:12:23.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.574+0000 7f40f32d4640 1 -- 172.21.15.134:0/4133705918 learned_addr learned my addr 172.21.15.134:0/4133705918 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:23.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.574+0000 7f40f32d4640 1 -- 172.21.15.134:0/4133705918 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55905603cd20 con 0x55905603c3c0 2024-04-24T02:12:23.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.574+0000 7f40f32d4640 1 --2- 172.21.15.134:0/4133705918 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55905603c3c0 0x55905603c7e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f40e4000c00 tx=0x7f40e4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.575+0000 7f3fe17fa640 1 -- 172.21.15.134:0/4133705918 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40e4057040 con 0x55905603c3c0 2024-04-24T02:12:23.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.575+0000 7f3fe17fa640 1 -- 172.21.15.134:0/4133705918 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40e4069650 con 0x55905603c3c0 2024-04-24T02:12:23.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.575+0000 7f4100e3e800 1 -- 172.21.15.134:0/4133705918 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55905603d790 con 0x55905603c3c0 2024-04-24T02:12:23.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.575+0000 7f3fe17fa640 1 -- 172.21.15.134:0/4133705918 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40e4069970 con 0x55905603c3c0 2024-04-24T02:12:23.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.575+0000 7f4100e3e800 1 -- 172.21.15.134:0/4133705918 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55905603dc30 con 0x55905603c3c0 2024-04-24T02:12:23.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.575+0000 7f3fe17fa640 1 -- 172.21.15.134:0/4133705918 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f40e4069b10 con 0x55905603c3c0 2024-04-24T02:12:23.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.575+0000 7f3fe17fa640 1 --2- 172.21.15.134:0/4133705918 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3fd4036950 0x7f3fd4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.576+0000 7f3fe17fa640 1 -- 172.21.15.134:0/4133705918 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f40e4090290 con 0x55905603c3c0 2024-04-24T02:12:23.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.576+0000 7f40fc2d6640 1 --2- 172.21.15.134:0/4133705918 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3fd4036950 0x7f3fd4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.576+0000 7f4100e3e800 1 Processor -- start 2024-04-24T02:12:23.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.576+0000 7f40fc2d6640 1 --2- 172.21.15.134:0/4133705918 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3fd4036950 0x7f3fd4038e10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x55905602c450 tx=0x7f40f4005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.576+0000 7f4100e3e800 1 -- start start 2024-04-24T02:12:23.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.576+0000 7f4100e3e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559056049640 0x559056049a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.576+0000 7f4100e3e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55905601ce50 con 0x559056049640 2024-04-24T02:12:23.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.576+0000 7f40f32d4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559056049640 0x559056049a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.576+0000 7f40f32d4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559056049640 0x559056049a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46250/0 (socket says 172.21.15.134:46250) 2024-04-24T02:12:23.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.576+0000 7f40f32d4640 1 -- 172.21.15.134:0/2019108043 learned_addr learned my addr 172.21.15.134:0/2019108043 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:23.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.576+0000 7f40f32d4640 1 -- 172.21.15.134:0/2019108043 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55905604a030 con 0x559056049640 2024-04-24T02:12:23.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.577+0000 7f40f32d4640 1 --2- 172.21.15.134:0/2019108043 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559056049640 0x559056049a60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f40e408e7a0 tx=0x7f40e40901c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7ed812213bf79dd server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.577+0000 7f3fdaffd640 1 -- 172.21.15.134:0/2019108043 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40e407f020 con 0x559056049640 2024-04-24T02:12:23.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.577+0000 7f3fdaffd640 1 -- 172.21.15.134:0/2019108043 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40e408d300 con 0x559056049640 2024-04-24T02:12:23.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.577+0000 7f3fdaffd640 1 -- 172.21.15.134:0/2019108043 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40e405c530 con 0x559056049640 2024-04-24T02:12:23.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.577+0000 7f4100e3e800 1 -- 172.21.15.134:0/2019108043 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559056049640 msgr2=0x559056049a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.577+0000 7f4100e3e800 1 --2- 172.21.15.134:0/2019108043 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559056049640 0x559056049a60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f40e408e7a0 tx=0x7f40e40901c0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.577+0000 7f4100e3e800 1 -- 172.21.15.134:0/2019108043 shutdown_connections 2024-04-24T02:12:23.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.577+0000 7f4100e3e800 1 --2- 172.21.15.134:0/2019108043 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559056049640 0x559056049a60 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.577+0000 7f4100e3e800 1 -- 172.21.15.134:0/2019108043 >> 172.21.15.134:0/2019108043 conn(0x5590560459a0 msgr2=0x559056043a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:23.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.577+0000 7f4100e3e800 1 -- 172.21.15.134:0/2019108043 shutdown_connections 2024-04-24T02:12:23.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.577+0000 7f4100e3e800 1 -- 172.21.15.134:0/2019108043 wait complete. 2024-04-24T02:12:23.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.577+0000 7f4100e3e800 1 Processor -- start 2024-04-24T02:12:23.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.578+0000 7f4100e3e800 1 -- start start 2024-04-24T02:12:23.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.578+0000 7f4100e3e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559056049640 0x559056050ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.578+0000 7f4100e3e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55905604a7a0 con 0x559056049640 2024-04-24T02:12:23.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.578+0000 7f40f32d4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559056049640 0x559056050ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.578+0000 7f40f32d4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559056049640 0x559056050ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46262/0 (socket says 172.21.15.134:46262) 2024-04-24T02:12:23.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.578+0000 7f40f32d4640 1 -- 172.21.15.134:0/1764253987 learned_addr learned my addr 172.21.15.134:0/1764253987 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:23.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.578+0000 7f40f32d4640 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559056051220 con 0x559056049640 2024-04-24T02:12:23.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.578+0000 7f40f32d4640 1 --2- 172.21.15.134:0/1764253987 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559056049640 0x559056050ce0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f40e408d690 tx=0x7f40e408e700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.578+0000 7f3fd97fa640 1 -- 172.21.15.134:0/1764253987 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40e4066df0 con 0x559056049640 2024-04-24T02:12:23.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.578+0000 7f3fd97fa640 1 -- 172.21.15.134:0/1764253987 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40e404bc00 con 0x559056049640 2024-04-24T02:12:23.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.578+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5590560514b0 con 0x559056049640 2024-04-24T02:12:23.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.578+0000 7f3fd97fa640 1 -- 172.21.15.134:0/1764253987 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40e40719b0 con 0x559056049640 2024-04-24T02:12:23.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.578+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590560514b0 con 0x559056049640 2024-04-24T02:12:23.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.579+0000 7f3fd97fa640 1 -- 172.21.15.134:0/1764253987 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f40e4082020 con 0x559056049640 2024-04-24T02:12:23.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.579+0000 7f3fd97fa640 1 --2- 172.21.15.134:0/1764253987 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3fc4036900 0x7f3fc4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.579+0000 7f3fd97fa640 1 -- 172.21.15.134:0/1764253987 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f40e40880b0 con 0x559056049640 2024-04-24T02:12:23.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.579+0000 7f40fc2d6640 1 --2- 172.21.15.134:0/1764253987 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3fc4036900 0x7f3fc4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.580+0000 7f4100e3e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.580+0000 7f4100e3e800 1 --2- 172.21.15.134:0/1764253987 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55905605c550 0x55905605ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.580+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55905605f160 con 0x55905605c550 2024-04-24T02:12:23.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.580+0000 7f40fc2d6640 1 --2- 172.21.15.134:0/1764253987 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3fc4036900 0x7f3fc4038dc0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x5590560287b0 tx=0x7f40f401f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.580+0000 7f40fbad5640 1 --2- 172.21.15.134:0/1764253987 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55905605c550 0x55905605ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.580+0000 7f40fbad5640 1 --2- 172.21.15.134:0/1764253987 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55905605c550 0x55905605ea10 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.580+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40ec02e070 con 0x55905605c550 2024-04-24T02:12:23.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.580+0000 7f4100e3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.580+0000 7f4100e3e800 20 realm 2024-04-24T02:12:23.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.580+0000 7f4100e3e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.580+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55905605f570 con 0x55905605c550 2024-04-24T02:12:23.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.580+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40ec02e070 con 0x55905605c550 2024-04-24T02:12:23.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.580+0000 7f4100e3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.580+0000 7f4100e3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:23.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.580+0000 7f4100e3e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.581+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55905605fe40 con 0x55905605c550 2024-04-24T02:12:23.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.581+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40ec02e070 con 0x55905605c550 2024-04-24T02:12:23.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.581+0000 7f4100e3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.581+0000 7f4100e3e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.581+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5590560601e0 con 0x55905605c550 2024-04-24T02:12:23.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.581+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f40ec02e070 con 0x55905605c550 2024-04-24T02:12:23.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.581+0000 7f4100e3e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:23.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.581+0000 7f4100e3e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.581+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559056060640 con 0x55905605c550 2024-04-24T02:12:23.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.581+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f40ec02e070 con 0x55905605c550 2024-04-24T02:12:23.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.581+0000 7f4100e3e800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:23.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.581+0000 7f4100e3e800 20 searching for the correct realm 2024-04-24T02:12:23.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.581+0000 7f4100e3e800 1 --2- 172.21.15.134:0/1764253987 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x559056062690 0x559056064a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.581+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559056065130 con 0x559056062690 2024-04-24T02:12:23.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.581+0000 7f40f32d4640 1 --2- 172.21.15.134:0/1764253987 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x559056062690 0x559056064a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.582+0000 7f40f32d4640 1 --2- 172.21.15.134:0/1764253987 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x559056062690 0x559056064a80 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.582+0000 7f40f32d4640 1 -- 172.21.15.134:0/1764253987 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40e406f020 con 0x559056062690 2024-04-24T02:12:23.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.582+0000 7f40f32d4640 1 --2- 172.21.15.134:0/1764253987 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f40e4084050 0x7f40e4085640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.582+0000 7f40f32d4640 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559056065130 con 0x7f40e4084050 2024-04-24T02:12:23.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.582+0000 7f40fc2d6640 1 --2- 172.21.15.134:0/1764253987 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f40e4084050 0x7f40e4085640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.582+0000 7f40fc2d6640 1 --2- 172.21.15.134:0/1764253987 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f40e4084050 0x7f40e4085640 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.583+0000 7f40fc2d6640 1 -- 172.21.15.134:0/1764253987 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40f401f070 con 0x7f40e4084050 2024-04-24T02:12:23.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.583+0000 7f40fc2d6640 1 --2- 172.21.15.134:0/1764253987 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f40f4031040 0x7f40f4032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.583+0000 7f40fc2d6640 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559056065130 con 0x7f40f4031040 2024-04-24T02:12:23.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.583+0000 7f40fbad5640 1 --2- 172.21.15.134:0/1764253987 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f40f4031040 0x7f40f4032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.583+0000 7f40fbad5640 1 --2- 172.21.15.134:0/1764253987 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f40f4031040 0x7f40f4032940 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.583+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40ec02e070 con 0x7f40f4031040 2024-04-24T02:12:23.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.583+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559056065130 con 0x55905605c550 2024-04-24T02:12:23.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.584+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40ec02e070 con 0x55905605c550 2024-04-24T02:12:23.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.584+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559056065130 con 0x55905605c550 2024-04-24T02:12:23.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.584+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f40ec02e070 con 0x55905605c550 2024-04-24T02:12:23.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.584+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559056065130 con 0x7f40f4031040 2024-04-24T02:12:23.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.584+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40ec02e070 con 0x7f40f4031040 2024-04-24T02:12:23.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.584+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559056065130 con 0x7f40f4031040 2024-04-24T02:12:23.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.584+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40ec02e070 con 0x7f40f4031040 2024-04-24T02:12:23.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.584+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559056065130 con 0x7f40e4084050 2024-04-24T02:12:23.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.585+0000 7f40fc2d6640 1 -- 172.21.15.134:0/1764253987 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40f401f070 con 0x7f40e4084050 2024-04-24T02:12:23.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.585+0000 7f40fc2d6640 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559056065130 con 0x559056062690 2024-04-24T02:12:23.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.585+0000 7f40f32d4640 1 -- 172.21.15.134:0/1764253987 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40e406f020 con 0x559056062690 2024-04-24T02:12:23.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.585+0000 7f40f32d4640 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559056065130 con 0x55905605c550 2024-04-24T02:12:23.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.585+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40ec02e070 con 0x55905605c550 2024-04-24T02:12:23.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.585+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559056065130 con 0x7f40f4031040 2024-04-24T02:12:23.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.585+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40ec02e070 con 0x7f40f4031040 2024-04-24T02:12:23.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.585+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559056065130 con 0x55905605c550 2024-04-24T02:12:23.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.586+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40ec02e070 con 0x55905605c550 2024-04-24T02:12:23.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.586+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559056065130 con 0x7f40e4084050 2024-04-24T02:12:23.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.586+0000 7f40fc2d6640 1 -- 172.21.15.134:0/1764253987 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f40f401f070 con 0x7f40e4084050 2024-04-24T02:12:23.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.586+0000 7f40fc2d6640 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559056065130 con 0x559056062690 2024-04-24T02:12:23.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.586+0000 7f40f32d4640 1 -- 172.21.15.134:0/1764253987 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40e406f020 con 0x559056062690 2024-04-24T02:12:23.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.586+0000 7f40f32d4640 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559056065130 con 0x559056062690 2024-04-24T02:12:23.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.586+0000 7f40f32d4640 1 -- 172.21.15.134:0/1764253987 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40e406f020 con 0x559056062690 2024-04-24T02:12:23.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.586+0000 7f40f32d4640 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559056065130 con 0x7f40f4031040 2024-04-24T02:12:23.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.587+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40ec02e070 con 0x7f40f4031040 2024-04-24T02:12:23.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.587+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559056065130 con 0x559056062690 2024-04-24T02:12:23.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.587+0000 7f40f32d4640 1 -- 172.21.15.134:0/1764253987 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40e406f020 con 0x559056062690 2024-04-24T02:12:23.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.587+0000 7f40f32d4640 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559056065130 con 0x559056062690 2024-04-24T02:12:23.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.587+0000 7f40f32d4640 1 -- 172.21.15.134:0/1764253987 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40e406f020 con 0x559056062690 2024-04-24T02:12:23.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.587+0000 7f40f32d4640 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559056065130 con 0x55905605c550 2024-04-24T02:12:23.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.588+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40ec02e070 con 0x55905605c550 2024-04-24T02:12:23.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.588+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559056065130 con 0x55905605c550 2024-04-24T02:12:23.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.588+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f40ec02e070 con 0x55905605c550 2024-04-24T02:12:23.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.588+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559056065130 con 0x7f40f4031040 2024-04-24T02:12:23.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.588+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40ec02e070 con 0x7f40f4031040 2024-04-24T02:12:23.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.588+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559056065130 con 0x559056062690 2024-04-24T02:12:23.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.588+0000 7f40f32d4640 1 -- 172.21.15.134:0/1764253987 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40e406f020 con 0x559056062690 2024-04-24T02:12:23.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.588+0000 7f40f32d4640 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559056065130 con 0x7f40e4084050 2024-04-24T02:12:23.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.589+0000 7f40fc2d6640 1 -- 172.21.15.134:0/1764253987 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40f401f070 con 0x7f40e4084050 2024-04-24T02:12:23.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.589+0000 7f40fc2d6640 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559056065130 con 0x55905605c550 2024-04-24T02:12:23.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.589+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40ec02e070 con 0x55905605c550 2024-04-24T02:12:23.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.589+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559056065130 con 0x7f40f4031040 2024-04-24T02:12:23.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.589+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40ec02e070 con 0x7f40f4031040 2024-04-24T02:12:23.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.589+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559056065130 con 0x559056062690 2024-04-24T02:12:23.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.589+0000 7f40f32d4640 1 -- 172.21.15.134:0/1764253987 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40e406f020 con 0x559056062690 2024-04-24T02:12:23.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.589+0000 7f40f32d4640 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559056065130 con 0x7f40f4031040 2024-04-24T02:12:23.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.590+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40ec02e070 con 0x7f40f4031040 2024-04-24T02:12:23.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.590+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559056065130 con 0x7f40e4084050 2024-04-24T02:12:23.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.590+0000 7f40fc2d6640 1 -- 172.21.15.134:0/1764253987 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40f401f070 con 0x7f40e4084050 2024-04-24T02:12:23.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.590+0000 7f40fc2d6640 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559056065130 con 0x559056062690 2024-04-24T02:12:23.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.590+0000 7f40f32d4640 1 -- 172.21.15.134:0/1764253987 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40e406f020 con 0x559056062690 2024-04-24T02:12:23.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.590+0000 7f40f32d4640 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559056065130 con 0x7f40f4031040 2024-04-24T02:12:23.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.590+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40ec02e070 con 0x7f40f4031040 2024-04-24T02:12:23.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.590+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f40ec057040 con 0x55905605c550 2024-04-24T02:12:23.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.591+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f40ec02e070 con 0x55905605c550 2024-04-24T02:12:23.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.591+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f40ec057040 con 0x7f40e4084050 2024-04-24T02:12:23.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.591+0000 7f40fc2d6640 1 -- 172.21.15.134:0/1764253987 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40f401f070 con 0x7f40e4084050 2024-04-24T02:12:23.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.591+0000 7f4100e3e800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:23.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.591+0000 7f4100e3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:23.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.591+0000 7f4100e3e800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:23.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.591+0000 7f4100e3e800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:23.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.591+0000 7f4100e3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:23.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.591+0000 7f4100e3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:23.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.591+0000 7f4100e3e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.591+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559056061110 con 0x55905605c550 2024-04-24T02:12:23.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.591+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40ec02e070 con 0x55905605c550 2024-04-24T02:12:23.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.591+0000 7f4100e3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.591+0000 7f4100e3e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.591+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5590560619b0 con 0x55905605c550 2024-04-24T02:12:23.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.591+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f40ec02e070 con 0x55905605c550 2024-04-24T02:12:23.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.591+0000 7f4100e3e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:23.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.591+0000 7f4100e3e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.591+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559056060d50 con 0x55905605c550 2024-04-24T02:12:23.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.592+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f40ec02e070 con 0x55905605c550 2024-04-24T02:12:23.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.592+0000 7f4100e3e800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:23.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.592+0000 7f4100e3e800 20 zone default found 2024-04-24T02:12:23.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.592+0000 7f4100e3e800 4 Realm: () 2024-04-24T02:12:23.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.592+0000 7f4100e3e800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:23.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.592+0000 7f4100e3e800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:23.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.592+0000 7f4100e3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:23.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.592+0000 7f4100e3e800 20 zonegroup default 2024-04-24T02:12:23.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.592+0000 7f4100e3e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.592+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5590560619b0 con 0x7f40f4031040 2024-04-24T02:12:23.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.592+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f40ec02e070 con 0x7f40f4031040 2024-04-24T02:12:23.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.592+0000 7f4100e3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.592+0000 7f4100e3e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.592+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559056066f70 con 0x559056062690 2024-04-24T02:12:23.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.592+0000 7f40f32d4640 1 -- 172.21.15.134:0/1764253987 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f40e406f020 con 0x559056062690 2024-04-24T02:12:23.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.593+0000 7f4100e3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.593+0000 7f4100e3e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.593+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559056067310 con 0x559056062690 2024-04-24T02:12:23.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.593+0000 7f40f32d4640 1 -- 172.21.15.134:0/1764253987 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f40e406f020 con 0x559056062690 2024-04-24T02:12:23.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.593+0000 7f4100e3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.593+0000 7f4100e3e800 20 started sync module instance, tier type = 2024-04-24T02:12:23.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.593+0000 7f4100e3e800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:23.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.593+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559056066410 con 0x7f40e4084050 2024-04-24T02:12:23.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.594+0000 7f40fc2d6640 1 -- 172.21.15.134:0/1764253987 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40f4040040 con 0x7f40e4084050 2024-04-24T02:12:23.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.594+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94078406912048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559056067bb0 con 0x7f40e4084050 2024-04-24T02:12:23.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.594+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559056068400 con 0x55905605c550 2024-04-24T02:12:23.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.595+0000 7f40fc2d6640 1 -- 172.21.15.134:0/1764253987 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94078406912048] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40f4040040 con 0x7f40e4084050 2024-04-24T02:12:23.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.595+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40ec02e070 con 0x55905605c550 2024-04-24T02:12:23.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.595+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94078406915840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5590560680d0 con 0x55905605c550 2024-04-24T02:12:23.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.595+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559056068bc0 con 0x559056062690 2024-04-24T02:12:23.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.596+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94078406915840] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40ec02e070 con 0x55905605c550 2024-04-24T02:12:23.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.596+0000 7f40f32d4640 1 -- 172.21.15.134:0/1764253987 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40e406f020 con 0x559056062690 2024-04-24T02:12:23.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.596+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94078406919824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559056068f60 con 0x559056062690 2024-04-24T02:12:23.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.596+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5590560699b0 con 0x7f40e4084050 2024-04-24T02:12:23.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.597+0000 7f40f32d4640 1 -- 172.21.15.134:0/1764253987 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94078406919824] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40e406f020 con 0x559056062690 2024-04-24T02:12:23.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.597+0000 7f40fc2d6640 1 -- 172.21.15.134:0/1764253987 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40f4040040 con 0x7f40e4084050 2024-04-24T02:12:23.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.597+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94078406923424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559056069dd0 con 0x7f40e4084050 2024-04-24T02:12:23.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.597+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55905606a7d0 con 0x55905605c550 2024-04-24T02:12:23.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.598+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40ec02e070 con 0x55905605c550 2024-04-24T02:12:23.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.598+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94078406927072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55905606a760 con 0x55905605c550 2024-04-24T02:12:23.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.598+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55905606b780 con 0x7f40f4031040 2024-04-24T02:12:23.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.598+0000 7f40fc2d6640 1 -- 172.21.15.134:0/1764253987 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94078406923424] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40f4040040 con 0x7f40e4084050 2024-04-24T02:12:23.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.599+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40ec02e070 con 0x7f40f4031040 2024-04-24T02:12:23.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.599+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94078406927072] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40ec02e070 con 0x55905605c550 2024-04-24T02:12:23.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.599+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94078406931056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55905606b740 con 0x7f40f4031040 2024-04-24T02:12:23.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.599+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55905606abf0 con 0x7f40f4031040 2024-04-24T02:12:23.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.600+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(56 notify.6 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40ec02e070 con 0x7f40f4031040 2024-04-24T02:12:23.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.600+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94078406929392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55905606c190 con 0x7f40f4031040 2024-04-24T02:12:23.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.600+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55905606cb50 con 0x7f40f4031040 2024-04-24T02:12:23.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.600+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94078406931056] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40ec02e070 con 0x7f40f4031040 2024-04-24T02:12:23.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.601+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(58 notify.7 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40ec02e070 con 0x7f40f4031040 2024-04-24T02:12:23.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.601+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94078406916896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55905606cb50 con 0x7f40f4031040 2024-04-24T02:12:23.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.601+0000 7f4100e3e800 20 add_watcher() i=0 2024-04-24T02:12:23.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.601+0000 7f4100e3e800 20 add_watcher() i=1 2024-04-24T02:12:23.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.601+0000 7f4100e3e800 20 add_watcher() i=2 2024-04-24T02:12:23.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.601+0000 7f4100e3e800 20 add_watcher() i=3 2024-04-24T02:12:23.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.601+0000 7f4100e3e800 20 add_watcher() i=4 2024-04-24T02:12:23.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.601+0000 7f4100e3e800 20 add_watcher() i=5 2024-04-24T02:12:23.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.604+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94078406929392] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40ec02e070 con 0x7f40f4031040 2024-04-24T02:12:23.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.604+0000 7f4100e3e800 20 add_watcher() i=6 2024-04-24T02:12:23.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.604+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94078406916896] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40ec02e070 con 0x7f40f4031040 2024-04-24T02:12:23.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.604+0000 7f4100e3e800 20 add_watcher() i=7 2024-04-24T02:12:23.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.604+0000 7f4100e3e800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:23.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.604+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55905606cb50 con 0x55905605c550 2024-04-24T02:12:23.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.604+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f40ec02e070 con 0x55905605c550 2024-04-24T02:12:23.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.605+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94078406936224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55905606cac0 con 0x55905605c550 2024-04-24T02:12:23.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.605+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94078406936224] v30'80 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f40ec02e070 con 0x55905605c550 2024-04-24T02:12:23.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.605+0000 7f3fb1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:23.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.606+0000 7f4100e3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:23.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.606+0000 7f4100e3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:23.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.606+0000 7f4100e3e800 5 note: GC not initialized 2024-04-24T02:12:23.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.606+0000 7f3fb0fe1640 20 reqs_thread_entry: start 2024-04-24T02:12:23.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.606+0000 7f4100e3e800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:23.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.606+0000 7f4100e3e800 20 Filter name: none 2024-04-24T02:12:23.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.606+0000 7f3f2a7fc640 20 reqs_thread_entry: start 2024-04-24T02:12:23.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.606+0000 7f4100e3e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.606+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5590560a2940 con 0x55905605c550 2024-04-24T02:12:23.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.607+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f40ec02e070 con 0x55905605c550 2024-04-24T02:12:23.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.607+0000 7f4100e3e800 20 rados_obj.operate() r=0 bl.length=556 2024-04-24T02:12:23.620 INFO:teuthology.orchestra.run.smithi134.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T02:12:21.778798Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T02:12:21.778786Z","tags":[],"group_ids":[]} 2024-04-24T02:12:23.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.607+0000 7f3fb1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:23.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.607+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94078406936224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5590560a14f0 con 0x55905605c550 2024-04-24T02:12:23.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.608+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94078406936224] v30'81 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f40ec02e070 con 0x55905605c550 2024-04-24T02:12:23.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.608+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94078406912048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55905606c6a0 con 0x7f40e4084050 2024-04-24T02:12:23.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.609+0000 7f40fc2d6640 1 -- 172.21.15.134:0/1764253987 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94078406912048] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40f4040040 con 0x7f40e4084050 2024-04-24T02:12:23.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.609+0000 7f4100e3e800 20 remove_watcher() i=0 2024-04-24T02:12:23.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.609+0000 7f4100e3e800 2 removed watcher, disabling cache 2024-04-24T02:12:23.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.609+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94078406915840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55905606c6a0 con 0x55905605c550 2024-04-24T02:12:23.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.610+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94078406915840] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40ec02e070 con 0x55905605c550 2024-04-24T02:12:23.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.610+0000 7f4100e3e800 20 remove_watcher() i=1 2024-04-24T02:12:23.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.610+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94078406919824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559056067700 con 0x559056062690 2024-04-24T02:12:23.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.611+0000 7f40f32d4640 1 -- 172.21.15.134:0/1764253987 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94078406919824] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40e406f020 con 0x559056062690 2024-04-24T02:12:23.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.611+0000 7f4100e3e800 20 remove_watcher() i=2 2024-04-24T02:12:23.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.611+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94078406923424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55905606c6a0 con 0x7f40e4084050 2024-04-24T02:12:23.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.612+0000 7f40fc2d6640 1 -- 172.21.15.134:0/1764253987 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94078406923424] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40f4040040 con 0x7f40e4084050 2024-04-24T02:12:23.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.612+0000 7f4100e3e800 20 remove_watcher() i=3 2024-04-24T02:12:23.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.612+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94078406927072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559056068690 con 0x55905605c550 2024-04-24T02:12:23.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.614+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94078406927072] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40ec02e070 con 0x55905605c550 2024-04-24T02:12:23.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.614+0000 7f4100e3e800 20 remove_watcher() i=4 2024-04-24T02:12:23.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.614+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94078406931056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5590560694a0 con 0x7f40f4031040 2024-04-24T02:12:23.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.614+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94078406931056] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40ec02e070 con 0x7f40f4031040 2024-04-24T02:12:23.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.614+0000 7f4100e3e800 20 remove_watcher() i=5 2024-04-24T02:12:23.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.614+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94078406929392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55905606c6a0 con 0x7f40f4031040 2024-04-24T02:12:23.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.615+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94078406929392] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40ec02e070 con 0x7f40f4031040 2024-04-24T02:12:23.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.615+0000 7f4100e3e800 20 remove_watcher() i=6 2024-04-24T02:12:23.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.615+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94078406916896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559056068690 con 0x7f40f4031040 2024-04-24T02:12:23.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.616+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94078406916896] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40ec02e070 con 0x7f40f4031040 2024-04-24T02:12:23.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.616+0000 7f4100e3e800 20 remove_watcher() i=7 2024-04-24T02:12:23.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.616+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f40f4031040 msgr2=0x7f40f4032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.616+0000 7f4100e3e800 1 --2- 172.21.15.134:0/1764253987 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f40f4031040 0x7f40f4032940 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.616+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55905605c550 msgr2=0x55905605ea10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.616+0000 7f4100e3e800 1 --2- 172.21.15.134:0/1764253987 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55905605c550 0x55905605ea10 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.616+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f40e4084050 msgr2=0x7f40e4085640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.616+0000 7f4100e3e800 1 --2- 172.21.15.134:0/1764253987 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f40e4084050 0x7f40e4085640 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.616+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x559056062690 msgr2=0x559056064a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.616+0000 7f4100e3e800 1 --2- 172.21.15.134:0/1764253987 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x559056062690 0x559056064a80 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.616+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3fc4036900 msgr2=0x7f3fc4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.616+0000 7f4100e3e800 1 --2- 172.21.15.134:0/1764253987 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3fc4036900 0x7f3fc4038dc0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x5590560287b0 tx=0x7f40f401f000 comp rx=0 tx=0).stop 2024-04-24T02:12:23.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.616+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559056049640 msgr2=0x559056050ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.616+0000 7f4100e3e800 1 --2- 172.21.15.134:0/1764253987 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559056049640 0x559056050ce0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f40e408d690 tx=0x7f40e408e700 comp rx=0 tx=0).stop 2024-04-24T02:12:23.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.616+0000 7f40fbad5640 1 -- 172.21.15.134:0/1764253987 reap_dead start 2024-04-24T02:12:23.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.616+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 shutdown_connections 2024-04-24T02:12:23.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.616+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 >> 172.21.15.134:0/1764253987 conn(0x5590560459a0 msgr2=0x559056043000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:23.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.617+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 shutdown_connections 2024-04-24T02:12:23.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.617+0000 7f4100e3e800 1 -- 172.21.15.134:0/1764253987 wait complete. 2024-04-24T02:12:23.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.617+0000 7f4100e3e800 1 -- 172.21.15.134:0/4133705918 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3fd4036950 msgr2=0x7f3fd4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.617+0000 7f4100e3e800 1 --2- 172.21.15.134:0/4133705918 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3fd4036950 0x7f3fd4038e10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x55905602c450 tx=0x7f40f4005840 comp rx=0 tx=0).stop 2024-04-24T02:12:23.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.617+0000 7f4100e3e800 1 -- 172.21.15.134:0/4133705918 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55905603c3c0 msgr2=0x55905603c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.617+0000 7f4100e3e800 1 --2- 172.21.15.134:0/4133705918 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55905603c3c0 0x55905603c7e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f40e4000c00 tx=0x7f40e4002fb0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.617+0000 7f4100e3e800 1 -- 172.21.15.134:0/4133705918 shutdown_connections 2024-04-24T02:12:23.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.617+0000 7f4100e3e800 1 --2- 172.21.15.134:0/4133705918 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3fd4036950 0x7f3fd4038e10 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.617+0000 7f4100e3e800 1 --2- 172.21.15.134:0/4133705918 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55905603c3c0 0x55905603c7e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.617+0000 7f4100e3e800 1 -- 172.21.15.134:0/4133705918 >> 172.21.15.134:0/4133705918 conn(0x559056030460 msgr2=0x559056030860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:23.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.617+0000 7f4100e3e800 1 -- 172.21.15.134:0/4133705918 shutdown_connections 2024-04-24T02:12:23.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.617+0000 7f4100e3e800 1 -- 172.21.15.134:0/4133705918 wait complete. 2024-04-24T02:12:23.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.617+0000 7f4100e3e800 1 -- 172.21.15.134:0/22718545 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x559055f292e0 msgr2=0x55905602b290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.617+0000 7f4100e3e800 1 --2- 172.21.15.134:0/22718545 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x559055f292e0 0x55905602b290 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.617+0000 7f4100e3e800 1 -- 172.21.15.134:0/22718545 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3fe4036950 msgr2=0x7f3fe4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.617+0000 7f4100e3e800 1 --2- 172.21.15.134:0/22718545 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3fe4036950 0x7f3fe4038e10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f40e4054000 tx=0x7f40e404e000 comp rx=0 tx=0).stop 2024-04-24T02:12:23.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.617+0000 7f4100e3e800 1 -- 172.21.15.134:0/22718545 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559055f277a0 msgr2=0x559056024050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.617+0000 7f4100e3e800 1 --2- 172.21.15.134:0/22718545 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559055f277a0 0x559056024050 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x55905601d290 tx=0x7f40ec000ed0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.617+0000 7f4100e3e800 1 -- 172.21.15.134:0/22718545 shutdown_connections 2024-04-24T02:12:23.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.617+0000 7f4100e3e800 1 --2- 172.21.15.134:0/22718545 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x559055f292e0 0x55905602b290 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.617+0000 7f4100e3e800 1 --2- 172.21.15.134:0/22718545 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3fe4036950 0x7f3fe4038e10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.617+0000 7f4100e3e800 1 --2- 172.21.15.134:0/22718545 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559055f277a0 0x559056024050 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.617+0000 7f4100e3e800 1 -- 172.21.15.134:0/22718545 >> 172.21.15.134:0/22718545 conn(0x559055f23320 msgr2=0x559056016620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:23.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.617+0000 7f4100e3e800 1 -- 172.21.15.134:0/22718545 shutdown_connections 2024-04-24T02:12:23.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.617+0000 7f4100e3e800 1 -- 172.21.15.134:0/22718545 wait complete. 2024-04-24T02:12:23.631 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T02:12:21.778798Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:12:21.778786Z', 'tags': [], 'group_ids': []} 2024-04-24T02:12:23.631 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-24T02:12:23.631 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-24T02:12:23.631 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-24T02:12:23.713 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:23.714 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:23.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.713+0000 7f14b9333800 1 Processor -- start 2024-04-24T02:12:23.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.713+0000 7f14b9333800 1 -- start start 2024-04-24T02:12:23.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.713+0000 7f14b9333800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x564b7b1797a0 0x564b7b179bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.713+0000 7f14b9333800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564b7b039d40 con 0x564b7b17a100 2024-04-24T02:12:23.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.713+0000 7f14b9333800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x564b7b00c4d0 con 0x564b7b1797a0 2024-04-24T02:12:23.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.713+0000 7f14b4ff5640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x564b7b1797a0 0x564b7b179bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.713+0000 7f14affff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x564b7b17a100 0x564b7b17a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:43322/0 (socket says 172.21.15.134:43322) 2024-04-24T02:12:23.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.713+0000 7f14affff640 1 -- 172.21.15.134:0/4060886802 learned_addr learned my addr 172.21.15.134:0/4060886802 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:12:23.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.713+0000 7f14b4ff5640 1 -- 172.21.15.134:0/4060886802 >> v1:172.21.15.104:6789/0 conn(0x564b7b17a100 legacy=0x564b7b17a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.713+0000 7f14b4ff5640 1 -- 172.21.15.134:0/4060886802 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b7b038590 con 0x564b7b1797a0 2024-04-24T02:12:23.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.713+0000 7f14af7fe640 1 -- 172.21.15.134:0/4060886802 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1460927310 0 0) 0x564b7b039d40 con 0x564b7b17a100 2024-04-24T02:12:23.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.715+0000 7f14b4ff5640 1 --2- 172.21.15.134:0/4060886802 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b7b1797a0 0x564b7b179bc0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f14a000a470 tx=0x7f14a001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4cc687d5c91336c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.715+0000 7f14af7fe640 1 -- 172.21.15.134:0/4060886802 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14a0057070 con 0x564b7b1797a0 2024-04-24T02:12:23.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.715+0000 7f14af7fe640 1 -- 172.21.15.134:0/4060886802 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14a004adc0 con 0x564b7b1797a0 2024-04-24T02:12:23.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.715+0000 7f14af7fe640 1 -- 172.21.15.134:0/4060886802 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14a0052590 con 0x564b7b1797a0 2024-04-24T02:12:23.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.716+0000 7f14b9333800 1 -- 172.21.15.134:0/4060886802 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b7b1797a0 msgr2=0x564b7b179bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.716+0000 7f14b9333800 1 --2- 172.21.15.134:0/4060886802 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b7b1797a0 0x564b7b179bc0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f14a000a470 tx=0x7f14a001ce90 comp rx=0 tx=0).stop 2024-04-24T02:12:23.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.716+0000 7f14b9333800 1 -- 172.21.15.134:0/4060886802 shutdown_connections 2024-04-24T02:12:23.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.716+0000 7f14b9333800 1 --2- 172.21.15.134:0/4060886802 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b7b1797a0 0x564b7b179bc0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.716+0000 7f14b9333800 1 -- 172.21.15.134:0/4060886802 >> 172.21.15.134:0/4060886802 conn(0x564b7b175320 msgr2=0x564b7b177740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:23.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.716+0000 7f14b9333800 1 -- 172.21.15.134:0/4060886802 shutdown_connections 2024-04-24T02:12:23.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.716+0000 7f14b9333800 1 -- 172.21.15.134:0/4060886802 wait complete. 2024-04-24T02:12:23.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.727+0000 7f14b9333800 1 Processor -- start 2024-04-24T02:12:23.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.728+0000 7f14b9333800 1 -- start start 2024-04-24T02:12:23.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.728+0000 7f14b9333800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b7b1797a0 0x564b7b26e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.728+0000 7f14b9333800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x564b7b0c63c0 con 0x564b7b1797a0 2024-04-24T02:12:23.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.728+0000 7f14b4ff5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b7b1797a0 0x564b7b26e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.728+0000 7f14b4ff5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b7b1797a0 0x564b7b26e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46280/0 (socket says 172.21.15.134:46280) 2024-04-24T02:12:23.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.728+0000 7f14b4ff5640 1 -- 172.21.15.134:0/2959072542 learned_addr learned my addr 172.21.15.134:0/2959072542 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:23.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.728+0000 7f14b4ff5640 1 -- 172.21.15.134:0/2959072542 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b7b26e810 con 0x564b7b1797a0 2024-04-24T02:12:23.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.728+0000 7f14b4ff5640 1 --2- 172.21.15.134:0/2959072542 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b7b1797a0 0x564b7b26e240 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f14a0055040 tx=0x7f14a004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a10980466968ac7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.729+0000 7f13a2e05640 1 -- 172.21.15.134:0/2959072542 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14a0057040 con 0x564b7b1797a0 2024-04-24T02:12:23.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.729+0000 7f13a2e05640 1 -- 172.21.15.134:0/2959072542 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14a0062070 con 0x564b7b1797a0 2024-04-24T02:12:23.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.729+0000 7f13a2e05640 1 -- 172.21.15.134:0/2959072542 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14a005d470 con 0x564b7b1797a0 2024-04-24T02:12:23.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.729+0000 7f14b9333800 1 -- 172.21.15.134:0/2959072542 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b7b1797a0 msgr2=0x564b7b26e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.729+0000 7f14b9333800 1 --2- 172.21.15.134:0/2959072542 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b7b1797a0 0x564b7b26e240 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f14a0055040 tx=0x7f14a004c000 comp rx=0 tx=0).stop 2024-04-24T02:12:23.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.729+0000 7f14b9333800 1 -- 172.21.15.134:0/2959072542 shutdown_connections 2024-04-24T02:12:23.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.729+0000 7f14b9333800 1 --2- 172.21.15.134:0/2959072542 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b7b1797a0 0x564b7b26e240 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.729+0000 7f14b9333800 1 -- 172.21.15.134:0/2959072542 >> 172.21.15.134:0/2959072542 conn(0x564b7b175320 msgr2=0x564b7b269b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:23.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.729+0000 7f14b9333800 1 -- 172.21.15.134:0/2959072542 shutdown_connections 2024-04-24T02:12:23.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.729+0000 7f14b9333800 1 -- 172.21.15.134:0/2959072542 wait complete. 2024-04-24T02:12:23.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.730+0000 7f14b9333800 1 Processor -- start 2024-04-24T02:12:23.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.730+0000 7f14b9333800 1 -- start start 2024-04-24T02:12:23.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.730+0000 7f14b9333800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b7b1797a0 0x564b7b275c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.730+0000 7f14b9333800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x564b7b17afc0 con 0x564b7b1797a0 2024-04-24T02:12:23.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.730+0000 7f14b4ff5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b7b1797a0 0x564b7b275c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.730+0000 7f14b4ff5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b7b1797a0 0x564b7b275c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46284/0 (socket says 172.21.15.134:46284) 2024-04-24T02:12:23.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.730+0000 7f14b4ff5640 1 -- 172.21.15.134:0/2544182830 learned_addr learned my addr 172.21.15.134:0/2544182830 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:23.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.730+0000 7f14b4ff5640 1 -- 172.21.15.134:0/2544182830 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b7b2761c0 con 0x564b7b1797a0 2024-04-24T02:12:23.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.730+0000 7f14b4ff5640 1 --2- 172.21.15.134:0/2544182830 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b7b1797a0 0x564b7b275c80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f14a001ce60 tx=0x7f14a0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.731+0000 7f13a1602640 1 -- 172.21.15.134:0/2544182830 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14a006b070 con 0x564b7b1797a0 2024-04-24T02:12:23.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.731+0000 7f13a1602640 1 -- 172.21.15.134:0/2544182830 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14a005d970 con 0x564b7b1797a0 2024-04-24T02:12:23.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.731+0000 7f14b9333800 1 -- 172.21.15.134:0/2544182830 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b7b276450 con 0x564b7b1797a0 2024-04-24T02:12:23.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.731+0000 7f13a1602640 1 -- 172.21.15.134:0/2544182830 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14a0057070 con 0x564b7b1797a0 2024-04-24T02:12:23.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.731+0000 7f14b9333800 1 -- 172.21.15.134:0/2544182830 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b7b279100 con 0x564b7b1797a0 2024-04-24T02:12:23.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.731+0000 7f13a1602640 1 -- 172.21.15.134:0/2544182830 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f14a005dc90 con 0x564b7b1797a0 2024-04-24T02:12:23.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.732+0000 7f13a1602640 1 --2- 172.21.15.134:0/2544182830 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f139c036950 0x7f139c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.732+0000 7f13a1602640 1 -- 172.21.15.134:0/2544182830 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f14a008dfa0 con 0x564b7b1797a0 2024-04-24T02:12:23.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.732+0000 7f14affff640 1 --2- 172.21.15.134:0/2544182830 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f139c036950 0x7f139c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.732+0000 7f14b9333800 1 --2- 172.21.15.134:0/2544182830 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x564b7b17a100 0x564b7b27cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.732+0000 7f14b9333800 1 -- 172.21.15.134:0/2544182830 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b7b27d400 con 0x564b7b17a100 2024-04-24T02:12:23.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.732+0000 7f14b57f6640 1 --2- 172.21.15.134:0/2544182830 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x564b7b17a100 0x564b7b27cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.732+0000 7f14affff640 1 --2- 172.21.15.134:0/2544182830 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f139c036950 0x7f139c038e10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f14a8000c00 tx=0x7f14a80013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.732+0000 7f14b57f6640 1 --2- 172.21.15.134:0/2544182830 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x564b7b17a100 0x564b7b27cec0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.732+0000 7f14b57f6640 1 -- 172.21.15.134:0/2544182830 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f14b000a4a0 con 0x564b7b17a100 2024-04-24T02:12:23.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.732+0000 7f14b9333800 1 -- 172.21.15.134:0/2544182830 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b7b27a470 con 0x564b7b17a100 2024-04-24T02:12:23.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.733+0000 7f14b57f6640 1 -- 172.21.15.134:0/2544182830 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f14b000a4a0 con 0x564b7b17a100 2024-04-24T02:12:23.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.733+0000 7f14b9333800 1 -- 172.21.15.134:0/2544182830 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b7b27f1c0 con 0x564b7b17a100 2024-04-24T02:12:23.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.733+0000 7f14b57f6640 1 -- 172.21.15.134:0/2544182830 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f14b000a4a0 con 0x564b7b17a100 2024-04-24T02:12:23.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.733+0000 7f14b9333800 1 -- 172.21.15.134:0/2544182830 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b7b27e500 con 0x564b7b17a100 2024-04-24T02:12:23.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.733+0000 7f14b57f6640 1 -- 172.21.15.134:0/2544182830 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f14b000a4a0 con 0x564b7b17a100 2024-04-24T02:12:23.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.733+0000 7f14b9333800 1 -- 172.21.15.134:0/2544182830 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b7b27e920 con 0x564b7b17a100 2024-04-24T02:12:23.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.734+0000 7f14b57f6640 1 -- 172.21.15.134:0/2544182830 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f14b000a4a0 con 0x564b7b17a100 2024-04-24T02:12:23.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.734+0000 7f14b9333800 1 Processor -- start 2024-04-24T02:12:23.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.734+0000 7f14b9333800 1 -- start start 2024-04-24T02:12:23.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.734+0000 7f14b9333800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b7b28dfd0 0x564b7b28e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.734+0000 7f14b9333800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x564b7b06c6b0 con 0x564b7b28dfd0 2024-04-24T02:12:23.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.734+0000 7f14affff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b7b28dfd0 0x564b7b28e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.734+0000 7f14affff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b7b28dfd0 0x564b7b28e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46296/0 (socket says 172.21.15.134:46296) 2024-04-24T02:12:23.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.734+0000 7f14affff640 1 -- 172.21.15.134:0/1446465331 learned_addr learned my addr 172.21.15.134:0/1446465331 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:23.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.735+0000 7f14affff640 1 -- 172.21.15.134:0/1446465331 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b7b28e930 con 0x564b7b28dfd0 2024-04-24T02:12:23.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.735+0000 7f14affff640 1 --2- 172.21.15.134:0/1446465331 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b7b28dfd0 0x564b7b28e3f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f14a800e610 tx=0x7f14a800ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.735+0000 7f139a7fc640 1 -- 172.21.15.134:0/1446465331 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14a8022070 con 0x564b7b28dfd0 2024-04-24T02:12:23.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.735+0000 7f139a7fc640 1 -- 172.21.15.134:0/1446465331 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14a8009050 con 0x564b7b28dfd0 2024-04-24T02:12:23.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.735+0000 7f139a7fc640 1 -- 172.21.15.134:0/1446465331 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14a800d500 con 0x564b7b28dfd0 2024-04-24T02:12:23.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.735+0000 7f14b9333800 1 -- 172.21.15.134:0/1446465331 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b7b28f3a0 con 0x564b7b28dfd0 2024-04-24T02:12:23.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.735+0000 7f14b9333800 1 -- 172.21.15.134:0/1446465331 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b7b28f8a0 con 0x564b7b28dfd0 2024-04-24T02:12:23.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.736+0000 7f139a7fc640 1 -- 172.21.15.134:0/1446465331 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f14a8025070 con 0x564b7b28dfd0 2024-04-24T02:12:23.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.736+0000 7f139a7fc640 1 --2- 172.21.15.134:0/1446465331 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f138c036950 0x7f138c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.736+0000 7f139a7fc640 1 -- 172.21.15.134:0/1446465331 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f14a804d9a0 con 0x564b7b28dfd0 2024-04-24T02:12:23.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.736+0000 7f14b57f6640 1 --2- 172.21.15.134:0/1446465331 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f138c036950 0x7f138c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.736+0000 7f14b9333800 1 Processor -- start 2024-04-24T02:12:23.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.736+0000 7f14b57f6640 1 --2- 172.21.15.134:0/1446465331 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f138c036950 0x7f138c038e10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x564b7b27e8a0 tx=0x7f14b0005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.736+0000 7f14b9333800 1 -- start start 2024-04-24T02:12:23.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.736+0000 7f14b9333800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b7b29b310 0x564b7b29b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.736+0000 7f14b9333800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x564b7b26ead0 con 0x564b7b29b310 2024-04-24T02:12:23.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.737+0000 7f14affff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b7b29b310 0x564b7b29b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.737+0000 7f14affff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b7b29b310 0x564b7b29b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46300/0 (socket says 172.21.15.134:46300) 2024-04-24T02:12:23.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.737+0000 7f14affff640 1 -- 172.21.15.134:0/4119189670 learned_addr learned my addr 172.21.15.134:0/4119189670 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:23.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.737+0000 7f14affff640 1 -- 172.21.15.134:0/4119189670 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b7b29bd00 con 0x564b7b29b310 2024-04-24T02:12:23.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.737+0000 7f14affff640 1 --2- 172.21.15.134:0/4119189670 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b7b29b310 0x564b7b29b730 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f14a8026fd0 tx=0x7f14a8024eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb0976266837bb8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.737+0000 7f138bfff640 1 -- 172.21.15.134:0/4119189670 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14a804a030 con 0x564b7b29b310 2024-04-24T02:12:23.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.737+0000 7f138bfff640 1 -- 172.21.15.134:0/4119189670 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14a8025e30 con 0x564b7b29b310 2024-04-24T02:12:23.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.737+0000 7f138bfff640 1 -- 172.21.15.134:0/4119189670 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14a801ad50 con 0x564b7b29b310 2024-04-24T02:12:23.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.737+0000 7f14b9333800 1 -- 172.21.15.134:0/4119189670 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b7b29b310 msgr2=0x564b7b29b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.737+0000 7f14b9333800 1 --2- 172.21.15.134:0/4119189670 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b7b29b310 0x564b7b29b730 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f14a8026fd0 tx=0x7f14a8024eb0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.738+0000 7f14b9333800 1 -- 172.21.15.134:0/4119189670 shutdown_connections 2024-04-24T02:12:23.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.738+0000 7f14b9333800 1 --2- 172.21.15.134:0/4119189670 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b7b29b310 0x564b7b29b730 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.738+0000 7f14b9333800 1 -- 172.21.15.134:0/4119189670 >> 172.21.15.134:0/4119189670 conn(0x564b7b297670 msgr2=0x564b7b2956d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:23.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.738+0000 7f14b9333800 1 -- 172.21.15.134:0/4119189670 shutdown_connections 2024-04-24T02:12:23.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.738+0000 7f14b9333800 1 -- 172.21.15.134:0/4119189670 wait complete. 2024-04-24T02:12:23.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.738+0000 7f14b9333800 1 Processor -- start 2024-04-24T02:12:23.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.738+0000 7f14b9333800 1 -- start start 2024-04-24T02:12:23.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.738+0000 7f14b9333800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b7b29b310 0x564b7b2a29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.738+0000 7f14b9333800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x564b7b29c470 con 0x564b7b29b310 2024-04-24T02:12:23.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.738+0000 7f14affff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b7b29b310 0x564b7b2a29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.738+0000 7f14affff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b7b29b310 0x564b7b2a29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46314/0 (socket says 172.21.15.134:46314) 2024-04-24T02:12:23.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.738+0000 7f14affff640 1 -- 172.21.15.134:0/1584757083 learned_addr learned my addr 172.21.15.134:0/1584757083 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:23.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.738+0000 7f14affff640 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b7b2a2f10 con 0x564b7b29b310 2024-04-24T02:12:23.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.739+0000 7f14affff640 1 --2- 172.21.15.134:0/1584757083 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b7b29b310 0x564b7b2a29d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f14a8026fd0 tx=0x7f14a804be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.739+0000 7f138a7fc640 1 -- 172.21.15.134:0/1584757083 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14a804a050 con 0x564b7b29b310 2024-04-24T02:12:23.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.739+0000 7f138a7fc640 1 -- 172.21.15.134:0/1584757083 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14a8025360 con 0x564b7b29b310 2024-04-24T02:12:23.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.739+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b7b2a31a0 con 0x564b7b29b310 2024-04-24T02:12:23.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.739+0000 7f138a7fc640 1 -- 172.21.15.134:0/1584757083 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14a80256a0 con 0x564b7b29b310 2024-04-24T02:12:23.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.739+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b7b2a5e50 con 0x564b7b29b310 2024-04-24T02:12:23.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.739+0000 7f138a7fc640 1 -- 172.21.15.134:0/1584757083 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f14a800d6a0 con 0x564b7b29b310 2024-04-24T02:12:23.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.740+0000 7f138a7fc640 1 --2- 172.21.15.134:0/1584757083 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1380036900 0x7f1380038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.740+0000 7f138a7fc640 1 -- 172.21.15.134:0/1584757083 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f14a80456f0 con 0x564b7b29b310 2024-04-24T02:12:23.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.740+0000 7f14b9333800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.740+0000 7f14b57f6640 1 --2- 172.21.15.134:0/1584757083 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1380036900 0x7f1380038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.740+0000 7f14b9333800 1 --2- 172.21.15.134:0/1584757083 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x564b7b2ae500 0x564b7b2b09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.740+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2b10f0 con 0x564b7b2ae500 2024-04-24T02:12:23.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.740+0000 7f14b4ff5640 1 --2- 172.21.15.134:0/1584757083 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x564b7b2ae500 0x564b7b2b09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.740+0000 7f14b57f6640 1 --2- 172.21.15.134:0/1584757083 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1380036900 0x7f1380038dc0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x564b7b27e020 tx=0x7f14b001f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.740+0000 7f14b4ff5640 1 --2- 172.21.15.134:0/1584757083 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x564b7b2ae500 0x564b7b2b09a0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.741+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f14a005a040 con 0x564b7b2ae500 2024-04-24T02:12:23.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.741+0000 7f14b9333800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.741+0000 7f14b9333800 20 realm 2024-04-24T02:12:23.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.741+0000 7f14b9333800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.741+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2b1500 con 0x564b7b2ae500 2024-04-24T02:12:23.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.741+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f14a005a040 con 0x564b7b2ae500 2024-04-24T02:12:23.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.741+0000 7f14b9333800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.741+0000 7f14b9333800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:23.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.741+0000 7f14b9333800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.741+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2b1dd0 con 0x564b7b2ae500 2024-04-24T02:12:23.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.741+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f14a005a040 con 0x564b7b2ae500 2024-04-24T02:12:23.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.741+0000 7f14b9333800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.741+0000 7f14b9333800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.741+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2b2170 con 0x564b7b2ae500 2024-04-24T02:12:23.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.741+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f14a005a040 con 0x564b7b2ae500 2024-04-24T02:12:23.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.741+0000 7f14b9333800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:23.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.741+0000 7f14b9333800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.741+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2b25d0 con 0x564b7b2ae500 2024-04-24T02:12:23.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.741+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f14a005a040 con 0x564b7b2ae500 2024-04-24T02:12:23.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.741+0000 7f14b9333800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:23.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.741+0000 7f14b9333800 20 searching for the correct realm 2024-04-24T02:12:23.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.741+0000 7f14b9333800 1 --2- 172.21.15.134:0/1584757083 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x564b7b2b4620 0x564b7b2b6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.742+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2b70c0 con 0x564b7b2b4620 2024-04-24T02:12:23.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.742+0000 7f14affff640 1 --2- 172.21.15.134:0/1584757083 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x564b7b2b4620 0x564b7b2b6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.742+0000 7f14affff640 1 --2- 172.21.15.134:0/1584757083 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x564b7b2b4620 0x564b7b2b6a10 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.742+0000 7f14affff640 1 -- 172.21.15.134:0/1584757083 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14a8024030 con 0x564b7b2b4620 2024-04-24T02:12:23.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.742+0000 7f14affff640 1 --2- 172.21.15.134:0/1584757083 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f14a8027060 0x7f14a801e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.742+0000 7f14affff640 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2b70c0 con 0x7f14a8027060 2024-04-24T02:12:23.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.742+0000 7f14b57f6640 1 --2- 172.21.15.134:0/1584757083 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f14a8027060 0x7f14a801e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.743+0000 7f14b57f6640 1 --2- 172.21.15.134:0/1584757083 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f14a8027060 0x7f14a801e9c0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.743+0000 7f14b57f6640 1 -- 172.21.15.134:0/1584757083 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14b001f070 con 0x7f14a8027060 2024-04-24T02:12:23.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.743+0000 7f14b57f6640 1 --2- 172.21.15.134:0/1584757083 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f14b0031040 0x7f14b0032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.743+0000 7f14b57f6640 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2b70c0 con 0x7f14b0031040 2024-04-24T02:12:23.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.743+0000 7f14b4ff5640 1 --2- 172.21.15.134:0/1584757083 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f14b0031040 0x7f14b0032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.744+0000 7f14b4ff5640 1 --2- 172.21.15.134:0/1584757083 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f14b0031040 0x7f14b0032940 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.744+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14a005a040 con 0x7f14b0031040 2024-04-24T02:12:23.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.744+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2b25d0 con 0x564b7b2ae500 2024-04-24T02:12:23.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.744+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14a005a040 con 0x564b7b2ae500 2024-04-24T02:12:23.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.744+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2b25d0 con 0x564b7b2ae500 2024-04-24T02:12:23.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.744+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f14a005a040 con 0x564b7b2ae500 2024-04-24T02:12:23.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.744+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2b25d0 con 0x7f14b0031040 2024-04-24T02:12:23.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.745+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14a005a040 con 0x7f14b0031040 2024-04-24T02:12:23.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.745+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2b25d0 con 0x7f14b0031040 2024-04-24T02:12:23.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.745+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14a005a040 con 0x7f14b0031040 2024-04-24T02:12:23.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.745+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2b25d0 con 0x7f14a8027060 2024-04-24T02:12:23.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.745+0000 7f14b57f6640 1 -- 172.21.15.134:0/1584757083 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14b001f070 con 0x7f14a8027060 2024-04-24T02:12:23.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.745+0000 7f14b57f6640 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2b25d0 con 0x564b7b2b4620 2024-04-24T02:12:23.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.745+0000 7f14affff640 1 -- 172.21.15.134:0/1584757083 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14a8024030 con 0x564b7b2b4620 2024-04-24T02:12:23.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.745+0000 7f14affff640 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2b25d0 con 0x564b7b2ae500 2024-04-24T02:12:23.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.746+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14a005a040 con 0x564b7b2ae500 2024-04-24T02:12:23.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.746+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2b25d0 con 0x7f14b0031040 2024-04-24T02:12:23.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.746+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14a005a040 con 0x7f14b0031040 2024-04-24T02:12:23.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.746+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2b25d0 con 0x564b7b2ae500 2024-04-24T02:12:23.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.746+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14a005a040 con 0x564b7b2ae500 2024-04-24T02:12:23.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.746+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2b25d0 con 0x7f14a8027060 2024-04-24T02:12:23.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.747+0000 7f14b57f6640 1 -- 172.21.15.134:0/1584757083 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f14b001f070 con 0x7f14a8027060 2024-04-24T02:12:23.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.747+0000 7f14b57f6640 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2b25d0 con 0x564b7b2b4620 2024-04-24T02:12:23.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.747+0000 7f14affff640 1 -- 172.21.15.134:0/1584757083 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14a8024030 con 0x564b7b2b4620 2024-04-24T02:12:23.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.747+0000 7f14affff640 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2b25d0 con 0x564b7b2b4620 2024-04-24T02:12:23.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.747+0000 7f14affff640 1 -- 172.21.15.134:0/1584757083 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14a8024030 con 0x564b7b2b4620 2024-04-24T02:12:23.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.747+0000 7f14affff640 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2b25d0 con 0x7f14b0031040 2024-04-24T02:12:23.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.747+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14a005a040 con 0x7f14b0031040 2024-04-24T02:12:23.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.747+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2b25d0 con 0x564b7b2b4620 2024-04-24T02:12:23.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.748+0000 7f14affff640 1 -- 172.21.15.134:0/1584757083 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14a8024030 con 0x564b7b2b4620 2024-04-24T02:12:23.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.748+0000 7f14affff640 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2b25d0 con 0x564b7b2b4620 2024-04-24T02:12:23.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.748+0000 7f14affff640 1 -- 172.21.15.134:0/1584757083 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14a8024030 con 0x564b7b2b4620 2024-04-24T02:12:23.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.748+0000 7f14affff640 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2b25d0 con 0x564b7b2ae500 2024-04-24T02:12:23.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.748+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14a005a040 con 0x564b7b2ae500 2024-04-24T02:12:23.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.748+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2b25d0 con 0x564b7b2ae500 2024-04-24T02:12:23.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.748+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f14a005a040 con 0x564b7b2ae500 2024-04-24T02:12:23.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.748+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2b25d0 con 0x7f14b0031040 2024-04-24T02:12:23.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.749+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14a005a040 con 0x7f14b0031040 2024-04-24T02:12:23.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.749+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2b25d0 con 0x564b7b2b4620 2024-04-24T02:12:23.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.749+0000 7f14affff640 1 -- 172.21.15.134:0/1584757083 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14a8024030 con 0x564b7b2b4620 2024-04-24T02:12:23.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.749+0000 7f14affff640 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2b25d0 con 0x7f14a8027060 2024-04-24T02:12:23.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.749+0000 7f14b57f6640 1 -- 172.21.15.134:0/1584757083 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14b001f070 con 0x7f14a8027060 2024-04-24T02:12:23.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.749+0000 7f14b57f6640 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2b25d0 con 0x564b7b2ae500 2024-04-24T02:12:23.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.749+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14a005a040 con 0x564b7b2ae500 2024-04-24T02:12:23.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.749+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2b25d0 con 0x7f14b0031040 2024-04-24T02:12:23.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.750+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14a005a040 con 0x7f14b0031040 2024-04-24T02:12:23.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.750+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2b25d0 con 0x564b7b2b4620 2024-04-24T02:12:23.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.750+0000 7f14affff640 1 -- 172.21.15.134:0/1584757083 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14a8024030 con 0x564b7b2b4620 2024-04-24T02:12:23.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.750+0000 7f14affff640 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2b25d0 con 0x7f14b0031040 2024-04-24T02:12:23.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.750+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14a005a040 con 0x7f14b0031040 2024-04-24T02:12:23.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.750+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2b25d0 con 0x7f14a8027060 2024-04-24T02:12:23.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.750+0000 7f14b57f6640 1 -- 172.21.15.134:0/1584757083 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14b001f070 con 0x7f14a8027060 2024-04-24T02:12:23.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.750+0000 7f14b57f6640 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2b25d0 con 0x564b7b2b4620 2024-04-24T02:12:23.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.751+0000 7f14affff640 1 -- 172.21.15.134:0/1584757083 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14a8024030 con 0x564b7b2b4620 2024-04-24T02:12:23.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.751+0000 7f14affff640 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2b25d0 con 0x7f14b0031040 2024-04-24T02:12:23.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.751+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14a005a040 con 0x7f14b0031040 2024-04-24T02:12:23.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.751+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2b25d0 con 0x564b7b2ae500 2024-04-24T02:12:23.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.751+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f14a005a040 con 0x564b7b2ae500 2024-04-24T02:12:23.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.751+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2b25d0 con 0x7f14a8027060 2024-04-24T02:12:23.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.751+0000 7f14b57f6640 1 -- 172.21.15.134:0/1584757083 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14b001f070 con 0x7f14a8027060 2024-04-24T02:12:23.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.751+0000 7f14b9333800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:23.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.751+0000 7f14b9333800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:23.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.751+0000 7f14b9333800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:23.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.751+0000 7f14b9333800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:23.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.751+0000 7f14b9333800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:23.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.751+0000 7f14b9333800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:23.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.752+0000 7f14b9333800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.752+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2b2f40 con 0x564b7b2ae500 2024-04-24T02:12:23.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.752+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f14a005a040 con 0x564b7b2ae500 2024-04-24T02:12:23.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.752+0000 7f14b9333800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.752+0000 7f14b9333800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.752+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2b3330 con 0x564b7b2ae500 2024-04-24T02:12:23.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.752+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f14a005a040 con 0x564b7b2ae500 2024-04-24T02:12:23.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.752+0000 7f14b9333800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:23.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.752+0000 7f14b9333800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.752+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2b3330 con 0x564b7b2ae500 2024-04-24T02:12:23.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.752+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f14a005a040 con 0x564b7b2ae500 2024-04-24T02:12:23.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.752+0000 7f14b9333800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:23.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.752+0000 7f14b9333800 20 zone default found 2024-04-24T02:12:23.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.752+0000 7f14b9333800 4 Realm: () 2024-04-24T02:12:23.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.752+0000 7f14b9333800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:23.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.752+0000 7f14b9333800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:23.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.752+0000 7f14b9333800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:23.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.752+0000 7f14b9333800 20 zonegroup default 2024-04-24T02:12:23.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.752+0000 7f14b9333800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.752+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2b3750 con 0x7f14b0031040 2024-04-24T02:12:23.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.753+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f14a005a040 con 0x7f14b0031040 2024-04-24T02:12:23.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.753+0000 7f14b9333800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.753+0000 7f14b9333800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.753+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2b3750 con 0x564b7b2b4620 2024-04-24T02:12:23.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.753+0000 7f14affff640 1 -- 172.21.15.134:0/1584757083 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f14a8024030 con 0x564b7b2b4620 2024-04-24T02:12:23.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.753+0000 7f14b9333800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.753+0000 7f14b9333800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.753+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2b8f30 con 0x564b7b2b4620 2024-04-24T02:12:23.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.753+0000 7f14affff640 1 -- 172.21.15.134:0/1584757083 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f14a8024030 con 0x564b7b2b4620 2024-04-24T02:12:23.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.753+0000 7f14b9333800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.753+0000 7f14b9333800 20 started sync module instance, tier type = 2024-04-24T02:12:23.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.753+0000 7f14b9333800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:23.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.753+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2b83a0 con 0x7f14a8027060 2024-04-24T02:12:23.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.754+0000 7f14b57f6640 1 -- 172.21.15.134:0/1584757083 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14b0040040 con 0x7f14a8027060 2024-04-24T02:12:23.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.754+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94882188986256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2b8000 con 0x7f14a8027060 2024-04-24T02:12:23.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.754+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2b9d50 con 0x564b7b2ae500 2024-04-24T02:12:23.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.755+0000 7f14b57f6640 1 -- 172.21.15.134:0/1584757083 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94882188986256] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14b0040040 con 0x7f14a8027060 2024-04-24T02:12:23.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.755+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14a005a040 con 0x564b7b2ae500 2024-04-24T02:12:23.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.755+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94882188989328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2b9d10 con 0x564b7b2ae500 2024-04-24T02:12:23.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.755+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2ba800 con 0x564b7b2b4620 2024-04-24T02:12:23.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.756+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94882188989328] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14a005a040 con 0x564b7b2ae500 2024-04-24T02:12:23.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.757+0000 7f14affff640 1 -- 172.21.15.134:0/1584757083 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14a8024030 con 0x564b7b2b4620 2024-04-24T02:12:23.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.757+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94882188993200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2babf0 con 0x564b7b2b4620 2024-04-24T02:12:23.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.757+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2bb5f0 con 0x7f14a8027060 2024-04-24T02:12:23.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.758+0000 7f14affff640 1 -- 172.21.15.134:0/1584757083 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94882188993200] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14a8024030 con 0x564b7b2b4620 2024-04-24T02:12:23.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.758+0000 7f14b57f6640 1 -- 172.21.15.134:0/1584757083 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14b0040040 con 0x7f14a8027060 2024-04-24T02:12:23.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.758+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94882188990384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2bba10 con 0x7f14a8027060 2024-04-24T02:12:23.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.758+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2bc450 con 0x564b7b2ae500 2024-04-24T02:12:23.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.759+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14a005a040 con 0x564b7b2ae500 2024-04-24T02:12:23.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.759+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94882189000480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2bc410 con 0x564b7b2ae500 2024-04-24T02:12:23.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.759+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2bd410 con 0x7f14b0031040 2024-04-24T02:12:23.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.759+0000 7f14b57f6640 1 -- 172.21.15.134:0/1584757083 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94882188990384] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14b0040040 con 0x7f14a8027060 2024-04-24T02:12:23.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.760+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14a005a040 con 0x7f14b0031040 2024-04-24T02:12:23.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.760+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94882189004608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2bd410 con 0x7f14b0031040 2024-04-24T02:12:23.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.760+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2bde20 con 0x7f14b0031040 2024-04-24T02:12:23.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.760+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94882189000480] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14a005a040 con 0x564b7b2ae500 2024-04-24T02:12:23.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.761+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94882189004608] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14a005a040 con 0x7f14b0031040 2024-04-24T02:12:23.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.761+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(56 notify.6 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14a005a040 con 0x7f14b0031040 2024-04-24T02:12:23.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.761+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94882188996864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2bd970 con 0x7f14b0031040 2024-04-24T02:12:23.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.762+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2be330 con 0x7f14b0031040 2024-04-24T02:12:23.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.762+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94882188996864] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14a005a040 con 0x7f14b0031040 2024-04-24T02:12:23.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.763+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(58 notify.7 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14a005a040 con 0x7f14b0031040 2024-04-24T02:12:23.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.763+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94882189002704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2be330 con 0x7f14b0031040 2024-04-24T02:12:23.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.763+0000 7f14b9333800 20 add_watcher() i=0 2024-04-24T02:12:23.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.763+0000 7f14b9333800 20 add_watcher() i=1 2024-04-24T02:12:23.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.763+0000 7f14b9333800 20 add_watcher() i=2 2024-04-24T02:12:23.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.763+0000 7f14b9333800 20 add_watcher() i=3 2024-04-24T02:12:23.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.763+0000 7f14b9333800 20 add_watcher() i=4 2024-04-24T02:12:23.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.763+0000 7f14b9333800 20 add_watcher() i=5 2024-04-24T02:12:23.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.763+0000 7f14b9333800 20 add_watcher() i=6 2024-04-24T02:12:23.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.763+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94882189002704] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14a005a040 con 0x7f14b0031040 2024-04-24T02:12:23.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.763+0000 7f14b9333800 20 add_watcher() i=7 2024-04-24T02:12:23.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.763+0000 7f14b9333800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:23.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.763+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2c1660 con 0x564b7b2ae500 2024-04-24T02:12:23.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.764+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f14a005a040 con 0x564b7b2ae500 2024-04-24T02:12:23.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.764+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94882189021328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2be4a0 con 0x564b7b2ae500 2024-04-24T02:12:23.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.765+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94882189021328] v30'82 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f14a005a040 con 0x564b7b2ae500 2024-04-24T02:12:23.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.765+0000 7f136afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:23.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.765+0000 7f14b9333800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:23.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.765+0000 7f14b9333800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:23.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.765+0000 7f14b9333800 5 note: GC not initialized 2024-04-24T02:12:23.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.765+0000 7f1369fe3640 20 reqs_thread_entry: start 2024-04-24T02:12:23.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.765+0000 7f14b9333800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:23.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.765+0000 7f14b9333800 20 Filter name: none 2024-04-24T02:12:23.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.765+0000 7f12db7fe640 20 reqs_thread_entry: start 2024-04-24T02:12:23.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.765+0000 7f14b9333800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.766+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2f4520 con 0x564b7b2ae500 2024-04-24T02:12:23.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.766+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f14a005a040 con 0x564b7b2ae500 2024-04-24T02:12:23.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.766+0000 7f14b9333800 20 rados_obj.operate() r=0 bl.length=556 2024-04-24T02:12:23.787 INFO:teuthology.orchestra.run.smithi134.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T02:12:21.778798Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T02:12:21.778786Z","tags":[],"group_ids":[]} 2024-04-24T02:12:23.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.767+0000 7f136afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:23.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.767+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94882189021328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2f30f0 con 0x564b7b2ae500 2024-04-24T02:12:23.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.768+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94882189021328] v30'83 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f14a005a040 con 0x564b7b2ae500 2024-04-24T02:12:23.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.768+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94882188986256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2c1090 con 0x7f14a8027060 2024-04-24T02:12:23.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.768+0000 7f14b57f6640 1 -- 172.21.15.134:0/1584757083 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94882188986256] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14b0040040 con 0x7f14a8027060 2024-04-24T02:12:23.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.769+0000 7f14b9333800 20 remove_watcher() i=0 2024-04-24T02:12:23.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.769+0000 7f14b9333800 2 removed watcher, disabling cache 2024-04-24T02:12:23.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.769+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94882188989328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2b8790 con 0x564b7b2ae500 2024-04-24T02:12:23.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.770+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94882188989328] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14a005a040 con 0x564b7b2ae500 2024-04-24T02:12:23.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.770+0000 7f14b9333800 20 remove_watcher() i=1 2024-04-24T02:12:23.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.770+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94882188993200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2b8790 con 0x564b7b2b4620 2024-04-24T02:12:23.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.771+0000 7f14affff640 1 -- 172.21.15.134:0/1584757083 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94882188993200] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14a8024030 con 0x564b7b2b4620 2024-04-24T02:12:23.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.771+0000 7f14b9333800 20 remove_watcher() i=2 2024-04-24T02:12:23.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.771+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94882188990384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2ba2b0 con 0x7f14a8027060 2024-04-24T02:12:23.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.772+0000 7f14b57f6640 1 -- 172.21.15.134:0/1584757083 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94882188990384] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14b0040040 con 0x7f14a8027060 2024-04-24T02:12:23.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.772+0000 7f14b9333800 20 remove_watcher() i=3 2024-04-24T02:12:23.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.772+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94882189000480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2ba2b0 con 0x564b7b2ae500 2024-04-24T02:12:23.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.773+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94882189000480] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14a005a040 con 0x564b7b2ae500 2024-04-24T02:12:23.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.773+0000 7f14b9333800 20 remove_watcher() i=4 2024-04-24T02:12:23.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.773+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94882189004608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2bbf20 con 0x7f14b0031040 2024-04-24T02:12:23.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.774+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94882189004608] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14a005a040 con 0x7f14b0031040 2024-04-24T02:12:23.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.774+0000 7f14b9333800 20 remove_watcher() i=5 2024-04-24T02:12:23.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.774+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94882188996864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2bcf40 con 0x7f14b0031040 2024-04-24T02:12:23.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.774+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94882188996864] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14a005a040 con 0x7f14b0031040 2024-04-24T02:12:23.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.775+0000 7f14b9333800 20 remove_watcher() i=6 2024-04-24T02:12:23.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.775+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94882189002704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b7b2bb100 con 0x7f14b0031040 2024-04-24T02:12:23.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.775+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94882189002704] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14a005a040 con 0x7f14b0031040 2024-04-24T02:12:23.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.775+0000 7f14b9333800 20 remove_watcher() i=7 2024-04-24T02:12:23.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.776+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f14b0031040 msgr2=0x7f14b0032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.776+0000 7f14b9333800 1 --2- 172.21.15.134:0/1584757083 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f14b0031040 0x7f14b0032940 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.776+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x564b7b2ae500 msgr2=0x564b7b2b09a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.776+0000 7f14b9333800 1 --2- 172.21.15.134:0/1584757083 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x564b7b2ae500 0x564b7b2b09a0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.776+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f14a8027060 msgr2=0x7f14a801e9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.776+0000 7f14b9333800 1 --2- 172.21.15.134:0/1584757083 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f14a8027060 0x7f14a801e9c0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.776+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x564b7b2b4620 msgr2=0x564b7b2b6a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.776+0000 7f14b9333800 1 --2- 172.21.15.134:0/1584757083 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x564b7b2b4620 0x564b7b2b6a10 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.776+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1380036900 msgr2=0x7f1380038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.776+0000 7f14b9333800 1 --2- 172.21.15.134:0/1584757083 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1380036900 0x7f1380038dc0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x564b7b27e020 tx=0x7f14b001f000 comp rx=0 tx=0).stop 2024-04-24T02:12:23.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.776+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b7b29b310 msgr2=0x564b7b2a29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.776+0000 7f14b9333800 1 --2- 172.21.15.134:0/1584757083 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b7b29b310 0x564b7b2a29d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f14a8026fd0 tx=0x7f14a804be50 comp rx=0 tx=0).stop 2024-04-24T02:12:23.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.776+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 reap_dead start 2024-04-24T02:12:23.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.776+0000 7f14b4ff5640 1 -- 172.21.15.134:0/1584757083 reap_dead start 2024-04-24T02:12:23.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.776+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 shutdown_connections 2024-04-24T02:12:23.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.776+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 >> 172.21.15.134:0/1584757083 conn(0x564b7b297670 msgr2=0x564b7b294cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:23.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.776+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 shutdown_connections 2024-04-24T02:12:23.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.776+0000 7f14b9333800 1 -- 172.21.15.134:0/1584757083 wait complete. 2024-04-24T02:12:23.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.776+0000 7f14b9333800 1 -- 172.21.15.134:0/1446465331 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f138c036950 msgr2=0x7f138c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.776+0000 7f14b9333800 1 --2- 172.21.15.134:0/1446465331 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f138c036950 0x7f138c038e10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x564b7b27e8a0 tx=0x7f14b0005840 comp rx=0 tx=0).stop 2024-04-24T02:12:23.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.776+0000 7f14b9333800 1 -- 172.21.15.134:0/1446465331 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b7b28dfd0 msgr2=0x564b7b28e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.776+0000 7f14b9333800 1 --2- 172.21.15.134:0/1446465331 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b7b28dfd0 0x564b7b28e3f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f14a800e610 tx=0x7f14a800ff90 comp rx=0 tx=0).stop 2024-04-24T02:12:23.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.776+0000 7f14b9333800 1 -- 172.21.15.134:0/1446465331 shutdown_connections 2024-04-24T02:12:23.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.776+0000 7f14b9333800 1 --2- 172.21.15.134:0/1446465331 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f138c036950 0x7f138c038e10 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.776+0000 7f14b9333800 1 --2- 172.21.15.134:0/1446465331 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b7b28dfd0 0x564b7b28e3f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.776+0000 7f14b9333800 1 -- 172.21.15.134:0/1446465331 >> 172.21.15.134:0/1446465331 conn(0x564b7b282070 msgr2=0x564b7b282470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:23.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.776+0000 7f14b9333800 1 -- 172.21.15.134:0/1446465331 shutdown_connections 2024-04-24T02:12:23.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.776+0000 7f14b9333800 1 -- 172.21.15.134:0/1446465331 wait complete. 2024-04-24T02:12:23.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.776+0000 7f14b9333800 1 -- 172.21.15.134:0/2544182830 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x564b7b17a100 msgr2=0x564b7b27cec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.776+0000 7f14b9333800 1 --2- 172.21.15.134:0/2544182830 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x564b7b17a100 0x564b7b27cec0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.776+0000 7f14b9333800 1 -- 172.21.15.134:0/2544182830 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f139c036950 msgr2=0x7f139c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.776+0000 7f14b9333800 1 --2- 172.21.15.134:0/2544182830 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f139c036950 0x7f139c038e10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f14a8000c00 tx=0x7f14a80013b0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.777+0000 7f14b9333800 1 -- 172.21.15.134:0/2544182830 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b7b1797a0 msgr2=0x564b7b275c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.777+0000 7f14b9333800 1 --2- 172.21.15.134:0/2544182830 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b7b1797a0 0x564b7b275c80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f14a001ce60 tx=0x7f14a0002fb0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.777+0000 7f14b9333800 1 -- 172.21.15.134:0/2544182830 shutdown_connections 2024-04-24T02:12:23.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.777+0000 7f14b9333800 1 --2- 172.21.15.134:0/2544182830 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x564b7b17a100 0x564b7b27cec0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.777+0000 7f14b9333800 1 --2- 172.21.15.134:0/2544182830 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f139c036950 0x7f139c038e10 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.777+0000 7f14b9333800 1 --2- 172.21.15.134:0/2544182830 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b7b1797a0 0x564b7b275c80 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.777+0000 7f14b9333800 1 -- 172.21.15.134:0/2544182830 >> 172.21.15.134:0/2544182830 conn(0x564b7b175320 msgr2=0x564b7b268360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:23.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.777+0000 7f14b9333800 1 -- 172.21.15.134:0/2544182830 shutdown_connections 2024-04-24T02:12:23.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.777+0000 7f14b9333800 1 -- 172.21.15.134:0/2544182830 wait complete. 2024-04-24T02:12:23.799 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T02:12:21.778798Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:12:21.778786Z', 'tags': [], 'group_ids': []} 2024-04-24T02:12:23.799 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-04-24T02:12:23.799 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-04-24T02:12:23.799 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-04-24T02:12:23.881 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:23.882 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:23.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.881+0000 7fe4d1230800 1 Processor -- start 2024-04-24T02:12:23.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.881+0000 7fe4d1230800 1 -- start start 2024-04-24T02:12:23.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.881+0000 7fe4d1230800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x561c6de91fb0 0x561c6de923d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.881+0000 7fe4d1230800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561c6dd50d40 con 0x561c6de93120 2024-04-24T02:12:23.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.881+0000 7fe4d1230800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x561c6dd234d0 con 0x561c6de91fb0 2024-04-24T02:12:23.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.881+0000 7fe4cc455640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x561c6de91fb0 0x561c6de923d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.881+0000 7fe4cbc54640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x561c6de93120 0x561c6de935a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:43336/0 (socket says 172.21.15.134:43336) 2024-04-24T02:12:23.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.881+0000 7fe4cc455640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x561c6de91fb0 0x561c6de923d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46322/0 (socket says 172.21.15.134:46322) 2024-04-24T02:12:23.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.881+0000 7fe4cbc54640 1 -- 172.21.15.134:0/9470904 learned_addr learned my addr 172.21.15.134:0/9470904 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:12:23.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.882+0000 7fe4cc455640 1 -- 172.21.15.134:0/9470904 >> v1:172.21.15.104:6789/0 conn(0x561c6de93120 legacy=0x561c6de935a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.882+0000 7fe4cc455640 1 -- 172.21.15.134:0/9470904 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c6dd4f590 con 0x561c6de91fb0 2024-04-24T02:12:23.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.883+0000 7fe4cc455640 1 --2- 172.21.15.134:0/9470904 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561c6de91fb0 0x561c6de923d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc00a470 tx=0x7fe4bc01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2261b6f7f11c740 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.884+0000 7fe4cb453640 1 -- 172.21.15.134:0/9470904 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4bc057070 con 0x561c6de91fb0 2024-04-24T02:12:23.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.884+0000 7fe4cb453640 1 -- 172.21.15.134:0/9470904 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4bc052570 con 0x561c6de91fb0 2024-04-24T02:12:23.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.884+0000 7fe4cb453640 1 -- 172.21.15.134:0/9470904 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4bc052870 con 0x561c6de91fb0 2024-04-24T02:12:23.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.884+0000 7fe4d1230800 1 -- 172.21.15.134:0/9470904 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561c6de91fb0 msgr2=0x561c6de923d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.884+0000 7fe4d1230800 1 --2- 172.21.15.134:0/9470904 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561c6de91fb0 0x561c6de923d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc00a470 tx=0x7fe4bc01ce90 comp rx=0 tx=0).stop 2024-04-24T02:12:23.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.884+0000 7fe4d1230800 1 -- 172.21.15.134:0/9470904 shutdown_connections 2024-04-24T02:12:23.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.884+0000 7fe4d1230800 1 --2- 172.21.15.134:0/9470904 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561c6de91fb0 0x561c6de923d0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.884+0000 7fe4d1230800 1 -- 172.21.15.134:0/9470904 >> 172.21.15.134:0/9470904 conn(0x561c6de8d550 msgr2=0x561c6de8f970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:23.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.884+0000 7fe4d1230800 1 -- 172.21.15.134:0/9470904 shutdown_connections 2024-04-24T02:12:23.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.884+0000 7fe4d1230800 1 -- 172.21.15.134:0/9470904 wait complete. 2024-04-24T02:12:23.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.896+0000 7fe4d1230800 1 Processor -- start 2024-04-24T02:12:23.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.896+0000 7fe4d1230800 1 -- start start 2024-04-24T02:12:23.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.896+0000 7fe4d1230800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561c6de91fb0 0x561c6df83630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.896+0000 7fe4d1230800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x561c6dddd3e0 con 0x561c6de91fb0 2024-04-24T02:12:23.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.896+0000 7fe4cc455640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561c6de91fb0 0x561c6df83630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.896+0000 7fe4cc455640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561c6de91fb0 0x561c6df83630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46334/0 (socket says 172.21.15.134:46334) 2024-04-24T02:12:23.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.896+0000 7fe4cc455640 1 -- 172.21.15.134:0/2007395341 learned_addr learned my addr 172.21.15.134:0/2007395341 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:23.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.897+0000 7fe4cc455640 1 -- 172.21.15.134:0/2007395341 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c6df83c00 con 0x561c6de91fb0 2024-04-24T02:12:23.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.897+0000 7fe4cc455640 1 --2- 172.21.15.134:0/2007395341 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561c6de91fb0 0x561c6df83630 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc055040 tx=0x7fe4bc04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ad2409d57d7a331 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.897+0000 7fe3ba60c640 1 -- 172.21.15.134:0/2007395341 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4bc057070 con 0x561c6de91fb0 2024-04-24T02:12:23.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.897+0000 7fe3ba60c640 1 -- 172.21.15.134:0/2007395341 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4bc063070 con 0x561c6de91fb0 2024-04-24T02:12:23.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.897+0000 7fe3ba60c640 1 -- 172.21.15.134:0/2007395341 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4bc052720 con 0x561c6de91fb0 2024-04-24T02:12:23.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.897+0000 7fe4d1230800 1 -- 172.21.15.134:0/2007395341 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561c6de91fb0 msgr2=0x561c6df83630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.897+0000 7fe4d1230800 1 --2- 172.21.15.134:0/2007395341 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561c6de91fb0 0x561c6df83630 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc055040 tx=0x7fe4bc04c000 comp rx=0 tx=0).stop 2024-04-24T02:12:23.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.898+0000 7fe4d1230800 1 -- 172.21.15.134:0/2007395341 shutdown_connections 2024-04-24T02:12:23.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.898+0000 7fe4d1230800 1 --2- 172.21.15.134:0/2007395341 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561c6de91fb0 0x561c6df83630 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.898+0000 7fe4d1230800 1 -- 172.21.15.134:0/2007395341 >> 172.21.15.134:0/2007395341 conn(0x561c6de8d550 msgr2=0x561c6df7ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:23.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.898+0000 7fe4d1230800 1 -- 172.21.15.134:0/2007395341 shutdown_connections 2024-04-24T02:12:23.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.898+0000 7fe4d1230800 1 -- 172.21.15.134:0/2007395341 wait complete. 2024-04-24T02:12:23.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.898+0000 7fe4d1230800 1 Processor -- start 2024-04-24T02:12:23.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.898+0000 7fe4d1230800 1 -- start start 2024-04-24T02:12:23.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.898+0000 7fe4d1230800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561c6de91fb0 0x561c6df8b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.898+0000 7fe4d1230800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x561c6de9b590 con 0x561c6de91fb0 2024-04-24T02:12:23.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.898+0000 7fe4cc455640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561c6de91fb0 0x561c6df8b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.898+0000 7fe4cc455640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561c6de91fb0 0x561c6df8b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46340/0 (socket says 172.21.15.134:46340) 2024-04-24T02:12:23.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.898+0000 7fe4cc455640 1 -- 172.21.15.134:0/257432485 learned_addr learned my addr 172.21.15.134:0/257432485 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:23.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.899+0000 7fe4cc455640 1 -- 172.21.15.134:0/257432485 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c6df8b650 con 0x561c6de91fb0 2024-04-24T02:12:23.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.899+0000 7fe4cc455640 1 --2- 172.21.15.134:0/257432485 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561c6de91fb0 0x561c6df8b110 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc060040 tx=0x7fe4bc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.899+0000 7fe3b8e09640 1 -- 172.21.15.134:0/257432485 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4bc052c70 con 0x561c6de91fb0 2024-04-24T02:12:23.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.899+0000 7fe3b8e09640 1 -- 172.21.15.134:0/257432485 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4bc06c070 con 0x561c6de91fb0 2024-04-24T02:12:23.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.899+0000 7fe4d1230800 1 -- 172.21.15.134:0/257432485 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561c6df8b8e0 con 0x561c6de91fb0 2024-04-24T02:12:23.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.899+0000 7fe3b8e09640 1 -- 172.21.15.134:0/257432485 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4bc05e480 con 0x561c6de91fb0 2024-04-24T02:12:23.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.899+0000 7fe4d1230800 1 -- 172.21.15.134:0/257432485 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c6df8e540 con 0x561c6de91fb0 2024-04-24T02:12:23.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.900+0000 7fe3b8e09640 1 -- 172.21.15.134:0/257432485 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe4bc05e620 con 0x561c6de91fb0 2024-04-24T02:12:23.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.900+0000 7fe3b8e09640 1 --2- 172.21.15.134:0/257432485 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe3b4036950 0x7fe3b4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.900+0000 7fe3b8e09640 1 -- 172.21.15.134:0/257432485 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fe4bc08e570 con 0x561c6de91fb0 2024-04-24T02:12:23.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.900+0000 7fe4cbc54640 1 --2- 172.21.15.134:0/257432485 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe3b4036950 0x7fe3b4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.900+0000 7fe4d1230800 1 --2- 172.21.15.134:0/257432485 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x561c6de93120 0x561c6df92300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.900+0000 7fe4d1230800 1 -- 172.21.15.134:0/257432485 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561c6df92840 con 0x561c6de93120 2024-04-24T02:12:23.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.900+0000 7fe4ccc56640 1 --2- 172.21.15.134:0/257432485 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x561c6de93120 0x561c6df92300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.900+0000 7fe4cbc54640 1 --2- 172.21.15.134:0/257432485 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe3b4036950 0x7fe3b4038e10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0000f60 tx=0x7fe4c00012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.901+0000 7fe4ccc56640 1 --2- 172.21.15.134:0/257432485 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x561c6de93120 0x561c6df92300 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.901+0000 7fe4ccc56640 1 -- 172.21.15.134:0/257432485 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4c400a4a0 con 0x561c6de93120 2024-04-24T02:12:23.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.901+0000 7fe4d1230800 1 -- 172.21.15.134:0/257432485 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561c6df8f8d0 con 0x561c6de93120 2024-04-24T02:12:23.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.901+0000 7fe4ccc56640 1 -- 172.21.15.134:0/257432485 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe4c400a4a0 con 0x561c6de93120 2024-04-24T02:12:23.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.901+0000 7fe4d1230800 1 -- 172.21.15.134:0/257432485 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561c6df94680 con 0x561c6de93120 2024-04-24T02:12:23.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.901+0000 7fe4ccc56640 1 -- 172.21.15.134:0/257432485 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe4c400a4a0 con 0x561c6de93120 2024-04-24T02:12:23.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.901+0000 7fe4d1230800 1 -- 172.21.15.134:0/257432485 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561c6df939c0 con 0x561c6de93120 2024-04-24T02:12:23.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.902+0000 7fe4ccc56640 1 -- 172.21.15.134:0/257432485 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe4c400a4a0 con 0x561c6de93120 2024-04-24T02:12:23.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.902+0000 7fe4d1230800 1 -- 172.21.15.134:0/257432485 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561c6df93e10 con 0x561c6de93120 2024-04-24T02:12:23.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.902+0000 7fe4ccc56640 1 -- 172.21.15.134:0/257432485 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe4c400a4a0 con 0x561c6de93120 2024-04-24T02:12:23.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.902+0000 7fe4d1230800 1 Processor -- start 2024-04-24T02:12:23.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.902+0000 7fe4d1230800 1 -- start start 2024-04-24T02:12:23.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.902+0000 7fe4d1230800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561c6dfa3450 0x561c6dfa3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.902+0000 7fe4d1230800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x561c6dd836b0 con 0x561c6dfa3450 2024-04-24T02:12:23.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.903+0000 7fe4cbc54640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561c6dfa3450 0x561c6dfa3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.903+0000 7fe4cbc54640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561c6dfa3450 0x561c6dfa3870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46342/0 (socket says 172.21.15.134:46342) 2024-04-24T02:12:23.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.903+0000 7fe4cbc54640 1 -- 172.21.15.134:0/2086162607 learned_addr learned my addr 172.21.15.134:0/2086162607 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:23.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.903+0000 7fe4cbc54640 1 -- 172.21.15.134:0/2086162607 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c6dfa3db0 con 0x561c6dfa3450 2024-04-24T02:12:23.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.903+0000 7fe4cbc54640 1 --2- 172.21.15.134:0/2086162607 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561c6dfa3450 0x561c6dfa3870 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0001ed0 tx=0x7fe4c000d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.903+0000 7fe3b1ffb640 1 -- 172.21.15.134:0/2086162607 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4c001b550 con 0x561c6dfa3450 2024-04-24T02:12:23.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.903+0000 7fe3b1ffb640 1 -- 172.21.15.134:0/2086162607 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4c001b6f0 con 0x561c6dfa3450 2024-04-24T02:12:23.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.903+0000 7fe4d1230800 1 -- 172.21.15.134:0/2086162607 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561c6dfa4820 con 0x561c6dfa3450 2024-04-24T02:12:23.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.903+0000 7fe3b1ffb640 1 -- 172.21.15.134:0/2086162607 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4c001b9d0 con 0x561c6dfa3450 2024-04-24T02:12:23.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.903+0000 7fe4d1230800 1 -- 172.21.15.134:0/2086162607 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c6dfa4d20 con 0x561c6dfa3450 2024-04-24T02:12:23.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.904+0000 7fe3b1ffb640 1 -- 172.21.15.134:0/2086162607 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe4c0023020 con 0x561c6dfa3450 2024-04-24T02:12:23.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.904+0000 7fe3b1ffb640 1 --2- 172.21.15.134:0/2086162607 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe3a40369a0 0x7fe3a4038e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.904+0000 7fe3b1ffb640 1 -- 172.21.15.134:0/2086162607 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fe4c0021020 con 0x561c6dfa3450 2024-04-24T02:12:23.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.904+0000 7fe4ccc56640 1 --2- 172.21.15.134:0/2086162607 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe3a40369a0 0x7fe3a4038e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.904+0000 7fe4d1230800 1 Processor -- start 2024-04-24T02:12:23.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.905+0000 7fe4d1230800 1 -- start start 2024-04-24T02:12:23.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.905+0000 7fe4ccc56640 1 --2- 172.21.15.134:0/2086162607 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe3a40369a0 0x7fe3a4038e60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x561c6df934e0 tx=0x7fe4c4005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.905+0000 7fe4d1230800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561c6de07670 0x561c6de07a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.905+0000 7fe4d1230800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x561c6df83ec0 con 0x561c6de07670 2024-04-24T02:12:23.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.905+0000 7fe4cbc54640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561c6de07670 0x561c6de07a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.905+0000 7fe4cbc54640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561c6de07670 0x561c6de07a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46358/0 (socket says 172.21.15.134:46358) 2024-04-24T02:12:23.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.905+0000 7fe4cbc54640 1 -- 172.21.15.134:0/3176956487 learned_addr learned my addr 172.21.15.134:0/3176956487 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:23.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.905+0000 7fe4cbc54640 1 -- 172.21.15.134:0/3176956487 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c6de05e70 con 0x561c6de07670 2024-04-24T02:12:23.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.905+0000 7fe4cbc54640 1 --2- 172.21.15.134:0/3176956487 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561c6de07670 0x561c6de07a90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe4c004ce10 tx=0x7fe4c0024c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0a41af0093b5bc1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.906+0000 7fe3ab7fe640 1 -- 172.21.15.134:0/3176956487 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4c0041110 con 0x561c6de07670 2024-04-24T02:12:23.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.906+0000 7fe3ab7fe640 1 -- 172.21.15.134:0/3176956487 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4c00258e0 con 0x561c6de07670 2024-04-24T02:12:23.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.906+0000 7fe3ab7fe640 1 -- 172.21.15.134:0/3176956487 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4c0025410 con 0x561c6de07670 2024-04-24T02:12:23.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.906+0000 7fe4d1230800 1 -- 172.21.15.134:0/3176956487 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561c6de07670 msgr2=0x561c6de07a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.906+0000 7fe4d1230800 1 --2- 172.21.15.134:0/3176956487 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561c6de07670 0x561c6de07a90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe4c004ce10 tx=0x7fe4c0024c00 comp rx=0 tx=0).stop 2024-04-24T02:12:23.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.906+0000 7fe4d1230800 1 -- 172.21.15.134:0/3176956487 shutdown_connections 2024-04-24T02:12:23.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.906+0000 7fe4d1230800 1 --2- 172.21.15.134:0/3176956487 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561c6de07670 0x561c6de07a90 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.906+0000 7fe4d1230800 1 -- 172.21.15.134:0/3176956487 >> 172.21.15.134:0/3176956487 conn(0x561c6dfacaf0 msgr2=0x561c6dfaab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:23.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.906+0000 7fe4d1230800 1 -- 172.21.15.134:0/3176956487 shutdown_connections 2024-04-24T02:12:23.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.906+0000 7fe4d1230800 1 -- 172.21.15.134:0/3176956487 wait complete. 2024-04-24T02:12:23.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.906+0000 7fe4d1230800 1 Processor -- start 2024-04-24T02:12:23.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.906+0000 7fe4d1230800 1 -- start start 2024-04-24T02:12:23.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.906+0000 7fe4d1230800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561c6de07670 0x561c6dfb9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.906+0000 7fe4d1230800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x561c6de06340 con 0x561c6de07670 2024-04-24T02:12:23.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.907+0000 7fe4cbc54640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561c6de07670 0x561c6dfb9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.907+0000 7fe4cbc54640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561c6de07670 0x561c6dfb9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46368/0 (socket says 172.21.15.134:46368) 2024-04-24T02:12:23.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.907+0000 7fe4cbc54640 1 -- 172.21.15.134:0/3634444117 learned_addr learned my addr 172.21.15.134:0/3634444117 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:23.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.907+0000 7fe4cbc54640 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c6dfba4f0 con 0x561c6de07670 2024-04-24T02:12:23.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.907+0000 7fe4cbc54640 1 --2- 172.21.15.134:0/3634444117 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561c6de07670 0x561c6dfb9fb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x561c6dfabfc0 tx=0x7fe4c004cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.907+0000 7fe3a9ffb640 1 -- 172.21.15.134:0/3634444117 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4c000cc60 con 0x561c6de07670 2024-04-24T02:12:23.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.907+0000 7fe3a9ffb640 1 -- 172.21.15.134:0/3634444117 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4c000ce20 con 0x561c6de07670 2024-04-24T02:12:23.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.907+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561c6dfba780 con 0x561c6de07670 2024-04-24T02:12:23.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.907+0000 7fe3a9ffb640 1 -- 172.21.15.134:0/3634444117 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4c0046070 con 0x561c6de07670 2024-04-24T02:12:23.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.907+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c6dfbd430 con 0x561c6de07670 2024-04-24T02:12:23.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.908+0000 7fe3a9ffb640 1 -- 172.21.15.134:0/3634444117 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe4c004ea00 con 0x561c6de07670 2024-04-24T02:12:23.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.908+0000 7fe3a9ffb640 1 --2- 172.21.15.134:0/3634444117 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe39c036950 0x7fe39c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.908+0000 7fe3a9ffb640 1 -- 172.21.15.134:0/3634444117 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fe4c004d050 con 0x561c6de07670 2024-04-24T02:12:23.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.908+0000 7fe4ccc56640 1 --2- 172.21.15.134:0/3634444117 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe39c036950 0x7fe39c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.909+0000 7fe4d1230800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.909+0000 7fe4d1230800 1 --2- 172.21.15.134:0/3634444117 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x561c6dfc58b0 0x561c6dfc7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.909+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfc84c0 con 0x561c6dfc58b0 2024-04-24T02:12:23.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.909+0000 7fe4ccc56640 1 --2- 172.21.15.134:0/3634444117 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe39c036950 0x7fe39c038e10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x561c6df8f820 tx=0x7fe4c401f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.909+0000 7fe4cc455640 1 --2- 172.21.15.134:0/3634444117 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x561c6dfc58b0 0x561c6dfc7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.909+0000 7fe4cc455640 1 --2- 172.21.15.134:0/3634444117 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x561c6dfc58b0 0x561c6dfc7d70 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.909+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4bc009d10 con 0x561c6dfc58b0 2024-04-24T02:12:23.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.909+0000 7fe4d1230800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.909+0000 7fe4d1230800 20 realm 2024-04-24T02:12:23.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.909+0000 7fe4d1230800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.909+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfc88d0 con 0x561c6dfc58b0 2024-04-24T02:12:23.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.909+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4bc009d10 con 0x561c6dfc58b0 2024-04-24T02:12:23.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.909+0000 7fe4d1230800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.909+0000 7fe4d1230800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:23.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.909+0000 7fe4d1230800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.909+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfc91a0 con 0x561c6dfc58b0 2024-04-24T02:12:23.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.910+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4bc009d10 con 0x561c6dfc58b0 2024-04-24T02:12:23.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.910+0000 7fe4d1230800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.910+0000 7fe4d1230800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.910+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfc9540 con 0x561c6dfc58b0 2024-04-24T02:12:23.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.910+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe4bc009d10 con 0x561c6dfc58b0 2024-04-24T02:12:23.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.910+0000 7fe4d1230800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:23.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.910+0000 7fe4d1230800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.910+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfc9d90 con 0x561c6dfc58b0 2024-04-24T02:12:23.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.910+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe4bc009d10 con 0x561c6dfc58b0 2024-04-24T02:12:23.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.910+0000 7fe4d1230800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:23.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.910+0000 7fe4d1230800 20 searching for the correct realm 2024-04-24T02:12:23.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.910+0000 7fe4d1230800 1 --2- 172.21.15.134:0/3634444117 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x561c6dfcbb00 0x561c6dfcdef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.910+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfce520 con 0x561c6dfcbb00 2024-04-24T02:12:23.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.910+0000 7fe4cbc54640 1 --2- 172.21.15.134:0/3634444117 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x561c6dfcbb00 0x561c6dfcdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.911+0000 7fe4cbc54640 1 --2- 172.21.15.134:0/3634444117 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x561c6dfcbb00 0x561c6dfcdef0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.911+0000 7fe4cbc54640 1 -- 172.21.15.134:0/3634444117 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4c0009050 con 0x561c6dfcbb00 2024-04-24T02:12:23.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.911+0000 7fe4cbc54640 1 --2- 172.21.15.134:0/3634444117 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fe4c0036300 0x7fe4c004b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.911+0000 7fe4cbc54640 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfce520 con 0x7fe4c0036300 2024-04-24T02:12:23.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.911+0000 7fe4ccc56640 1 --2- 172.21.15.134:0/3634444117 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fe4c0036300 0x7fe4c004b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.911+0000 7fe4ccc56640 1 --2- 172.21.15.134:0/3634444117 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fe4c0036300 0x7fe4c004b250 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.912+0000 7fe4ccc56640 1 -- 172.21.15.134:0/3634444117 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4c401f070 con 0x7fe4c0036300 2024-04-24T02:12:23.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.912+0000 7fe4ccc56640 1 --2- 172.21.15.134:0/3634444117 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fe4c4031040 0x7fe4c4032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:23.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.912+0000 7fe4ccc56640 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfce520 con 0x7fe4c4031040 2024-04-24T02:12:23.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.912+0000 7fe4cc455640 1 --2- 172.21.15.134:0/3634444117 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fe4c4031040 0x7fe4c4032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:23.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.912+0000 7fe4cc455640 1 --2- 172.21.15.134:0/3634444117 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fe4c4031040 0x7fe4c4032940 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:23.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.913+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4bc009d10 con 0x7fe4c4031040 2024-04-24T02:12:23.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.913+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfce520 con 0x561c6dfc58b0 2024-04-24T02:12:23.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.913+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4bc009d10 con 0x561c6dfc58b0 2024-04-24T02:12:23.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.913+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfce520 con 0x561c6dfc58b0 2024-04-24T02:12:23.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.913+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe4bc009d10 con 0x561c6dfc58b0 2024-04-24T02:12:23.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.913+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfce520 con 0x7fe4c4031040 2024-04-24T02:12:23.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.913+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4bc009d10 con 0x7fe4c4031040 2024-04-24T02:12:23.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.913+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfce520 con 0x7fe4c4031040 2024-04-24T02:12:23.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.914+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4bc009d10 con 0x7fe4c4031040 2024-04-24T02:12:23.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.914+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfce520 con 0x7fe4c0036300 2024-04-24T02:12:23.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.914+0000 7fe4ccc56640 1 -- 172.21.15.134:0/3634444117 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4c401f070 con 0x7fe4c0036300 2024-04-24T02:12:23.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.914+0000 7fe4ccc56640 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfce520 con 0x561c6dfcbb00 2024-04-24T02:12:23.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.914+0000 7fe4cbc54640 1 -- 172.21.15.134:0/3634444117 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4c0009050 con 0x561c6dfcbb00 2024-04-24T02:12:23.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.914+0000 7fe4cbc54640 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfce520 con 0x561c6dfc58b0 2024-04-24T02:12:23.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.914+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4bc009d10 con 0x561c6dfc58b0 2024-04-24T02:12:23.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.914+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfce520 con 0x7fe4c4031040 2024-04-24T02:12:23.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.915+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4bc009d10 con 0x7fe4c4031040 2024-04-24T02:12:23.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.915+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfce520 con 0x561c6dfc58b0 2024-04-24T02:12:23.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.915+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4bc009d10 con 0x561c6dfc58b0 2024-04-24T02:12:23.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.915+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfce520 con 0x7fe4c0036300 2024-04-24T02:12:23.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.915+0000 7fe4ccc56640 1 -- 172.21.15.134:0/3634444117 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe4c401f070 con 0x7fe4c0036300 2024-04-24T02:12:23.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.915+0000 7fe4ccc56640 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfce520 con 0x561c6dfcbb00 2024-04-24T02:12:23.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.915+0000 7fe4cbc54640 1 -- 172.21.15.134:0/3634444117 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4c0009050 con 0x561c6dfcbb00 2024-04-24T02:12:23.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.915+0000 7fe4cbc54640 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfce520 con 0x561c6dfcbb00 2024-04-24T02:12:23.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.916+0000 7fe4cbc54640 1 -- 172.21.15.134:0/3634444117 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4c0009050 con 0x561c6dfcbb00 2024-04-24T02:12:23.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.916+0000 7fe4cbc54640 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfce520 con 0x7fe4c4031040 2024-04-24T02:12:23.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.916+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4bc009d10 con 0x7fe4c4031040 2024-04-24T02:12:23.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.916+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfce520 con 0x561c6dfcbb00 2024-04-24T02:12:23.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.916+0000 7fe4cbc54640 1 -- 172.21.15.134:0/3634444117 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4c0009050 con 0x561c6dfcbb00 2024-04-24T02:12:23.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.916+0000 7fe4cbc54640 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfce520 con 0x561c6dfcbb00 2024-04-24T02:12:23.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.916+0000 7fe4cbc54640 1 -- 172.21.15.134:0/3634444117 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4c0009050 con 0x561c6dfcbb00 2024-04-24T02:12:23.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.916+0000 7fe4cbc54640 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfce520 con 0x561c6dfc58b0 2024-04-24T02:12:23.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.917+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4bc009d10 con 0x561c6dfc58b0 2024-04-24T02:12:23.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.917+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfce520 con 0x561c6dfc58b0 2024-04-24T02:12:23.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.917+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fe4bc009d10 con 0x561c6dfc58b0 2024-04-24T02:12:23.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.917+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfce520 con 0x7fe4c4031040 2024-04-24T02:12:23.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.917+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4bc009d10 con 0x7fe4c4031040 2024-04-24T02:12:23.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.917+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfce520 con 0x561c6dfcbb00 2024-04-24T02:12:23.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.917+0000 7fe4cbc54640 1 -- 172.21.15.134:0/3634444117 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4c0009050 con 0x561c6dfcbb00 2024-04-24T02:12:23.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.917+0000 7fe4cbc54640 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfce520 con 0x7fe4c0036300 2024-04-24T02:12:23.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.918+0000 7fe4ccc56640 1 -- 172.21.15.134:0/3634444117 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4c401f070 con 0x7fe4c0036300 2024-04-24T02:12:23.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.918+0000 7fe4ccc56640 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfce520 con 0x561c6dfc58b0 2024-04-24T02:12:23.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.918+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4bc009d10 con 0x561c6dfc58b0 2024-04-24T02:12:23.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.918+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfce520 con 0x7fe4c4031040 2024-04-24T02:12:23.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.918+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4bc009d10 con 0x7fe4c4031040 2024-04-24T02:12:23.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.918+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfce520 con 0x561c6dfcbb00 2024-04-24T02:12:23.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.919+0000 7fe4cbc54640 1 -- 172.21.15.134:0/3634444117 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4c0009050 con 0x561c6dfcbb00 2024-04-24T02:12:23.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.919+0000 7fe4cbc54640 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfce520 con 0x7fe4c4031040 2024-04-24T02:12:23.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.919+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4bc009d10 con 0x7fe4c4031040 2024-04-24T02:12:23.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.919+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfce520 con 0x7fe4c0036300 2024-04-24T02:12:23.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.919+0000 7fe4ccc56640 1 -- 172.21.15.134:0/3634444117 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4c401f070 con 0x7fe4c0036300 2024-04-24T02:12:23.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.919+0000 7fe4ccc56640 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfce520 con 0x561c6dfcbb00 2024-04-24T02:12:23.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.919+0000 7fe4cbc54640 1 -- 172.21.15.134:0/3634444117 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4c0009050 con 0x561c6dfcbb00 2024-04-24T02:12:23.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.919+0000 7fe4cbc54640 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfce520 con 0x7fe4c4031040 2024-04-24T02:12:23.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.920+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4bc009d10 con 0x7fe4c4031040 2024-04-24T02:12:23.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.920+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfce520 con 0x561c6dfc58b0 2024-04-24T02:12:23.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.920+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe4bc009d10 con 0x561c6dfc58b0 2024-04-24T02:12:23.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.920+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfce520 con 0x7fe4c0036300 2024-04-24T02:12:23.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.920+0000 7fe4ccc56640 1 -- 172.21.15.134:0/3634444117 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4c401f070 con 0x7fe4c0036300 2024-04-24T02:12:23.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.920+0000 7fe4d1230800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:23.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.920+0000 7fe4d1230800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:23.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.920+0000 7fe4d1230800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:23.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.920+0000 7fe4d1230800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:23.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.920+0000 7fe4d1230800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:23.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.920+0000 7fe4d1230800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:23.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.920+0000 7fe4d1230800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.920+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfca740 con 0x561c6dfc58b0 2024-04-24T02:12:23.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.920+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4bc009d10 con 0x561c6dfc58b0 2024-04-24T02:12:23.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.920+0000 7fe4d1230800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.920+0000 7fe4d1230800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.921+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfcafe0 con 0x561c6dfc58b0 2024-04-24T02:12:23.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.921+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe4bc009d10 con 0x561c6dfc58b0 2024-04-24T02:12:23.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.921+0000 7fe4d1230800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:23.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.921+0000 7fe4d1230800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.921+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfcafe0 con 0x561c6dfc58b0 2024-04-24T02:12:23.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.921+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe4bc009d10 con 0x561c6dfc58b0 2024-04-24T02:12:23.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.921+0000 7fe4d1230800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:23.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.921+0000 7fe4d1230800 20 zone default found 2024-04-24T02:12:23.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.921+0000 7fe4d1230800 4 Realm: () 2024-04-24T02:12:23.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.921+0000 7fe4d1230800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:23.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.921+0000 7fe4d1230800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:23.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.921+0000 7fe4d1230800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:23.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.921+0000 7fe4d1230800 20 zonegroup default 2024-04-24T02:12:23.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.921+0000 7fe4d1230800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.921+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfce980 con 0x7fe4c4031040 2024-04-24T02:12:23.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.921+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe4bc009d10 con 0x7fe4c4031040 2024-04-24T02:12:23.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.921+0000 7fe4d1230800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.921+0000 7fe4d1230800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.921+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfd03c0 con 0x561c6dfcbb00 2024-04-24T02:12:23.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.922+0000 7fe4cbc54640 1 -- 172.21.15.134:0/3634444117 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe4c0009050 con 0x561c6dfcbb00 2024-04-24T02:12:23.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.922+0000 7fe4d1230800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.922+0000 7fe4d1230800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.922+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfd08d0 con 0x561c6dfcbb00 2024-04-24T02:12:23.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.922+0000 7fe4cbc54640 1 -- 172.21.15.134:0/3634444117 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe4c0009050 con 0x561c6dfcbb00 2024-04-24T02:12:23.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.922+0000 7fe4d1230800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.922+0000 7fe4d1230800 20 started sync module instance, tier type = 2024-04-24T02:12:23.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.922+0000 7fe4d1230800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:23.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.922+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfcf800 con 0x7fe4c0036300 2024-04-24T02:12:23.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.923+0000 7fe4ccc56640 1 -- 172.21.15.134:0/3634444117 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4c4040040 con 0x7fe4c0036300 2024-04-24T02:12:23.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.923+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94680104369136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfd11e0 con 0x7fe4c0036300 2024-04-24T02:12:23.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.923+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfd1a30 con 0x561c6dfc58b0 2024-04-24T02:12:23.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.924+0000 7fe4ccc56640 1 -- 172.21.15.134:0/3634444117 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94680104369136] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4c4040040 con 0x7fe4c0036300 2024-04-24T02:12:23.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.924+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4bc009d10 con 0x561c6dfc58b0 2024-04-24T02:12:23.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.924+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94680104373552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfd1700 con 0x561c6dfc58b0 2024-04-24T02:12:23.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.924+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfd21f0 con 0x561c6dfcbb00 2024-04-24T02:12:23.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.925+0000 7fe4cbc54640 1 -- 172.21.15.134:0/3634444117 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4c0009050 con 0x561c6dfcbb00 2024-04-24T02:12:23.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.925+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94680104377536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfd2a90 con 0x561c6dfcbb00 2024-04-24T02:12:23.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.925+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfd3530 con 0x7fe4c0036300 2024-04-24T02:12:23.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.925+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94680104373552] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4bc009d10 con 0x561c6dfc58b0 2024-04-24T02:12:23.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.926+0000 7fe4cbc54640 1 -- 172.21.15.134:0/3634444117 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94680104377536] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4c0009050 con 0x561c6dfcbb00 2024-04-24T02:12:23.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.926+0000 7fe4ccc56640 1 -- 172.21.15.134:0/3634444117 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4c4040040 con 0x7fe4c0036300 2024-04-24T02:12:23.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.926+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94680104379872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfd1150 con 0x7fe4c0036300 2024-04-24T02:12:23.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.926+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfd3e00 con 0x561c6dfc58b0 2024-04-24T02:12:23.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.927+0000 7fe4ccc56640 1 -- 172.21.15.134:0/3634444117 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94680104379872] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4c4040040 con 0x7fe4c0036300 2024-04-24T02:12:23.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.927+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4bc009d10 con 0x561c6dfc58b0 2024-04-24T02:12:23.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.927+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94680104382496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfd3e00 con 0x561c6dfc58b0 2024-04-24T02:12:23.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.927+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfd4850 con 0x7fe4c4031040 2024-04-24T02:12:23.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.928+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4bc009d10 con 0x7fe4c4031040 2024-04-24T02:12:23.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.928+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94680104387424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfd4780 con 0x7fe4c4031040 2024-04-24T02:12:23.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.928+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfd57a0 con 0x7fe4c4031040 2024-04-24T02:12:23.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.928+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94680104382496] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4bc009d10 con 0x561c6dfc58b0 2024-04-24T02:12:23.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.929+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94680104387424] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4bc009d10 con 0x7fe4c4031040 2024-04-24T02:12:23.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.930+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(56 notify.6 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4bc009d10 con 0x7fe4c4031040 2024-04-24T02:12:23.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.930+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94680104389696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfd3950 con 0x7fe4c4031040 2024-04-24T02:12:23.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.930+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfd5c10 con 0x7fe4c4031040 2024-04-24T02:12:23.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.930+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(58 notify.7 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4bc009d10 con 0x7fe4c4031040 2024-04-24T02:12:23.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.931+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94680104392544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfd5b80 con 0x7fe4c4031040 2024-04-24T02:12:23.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.931+0000 7fe4d1230800 20 add_watcher() i=0 2024-04-24T02:12:23.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.931+0000 7fe4d1230800 20 add_watcher() i=1 2024-04-24T02:12:23.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.931+0000 7fe4d1230800 20 add_watcher() i=2 2024-04-24T02:12:23.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.931+0000 7fe4d1230800 20 add_watcher() i=3 2024-04-24T02:12:23.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.931+0000 7fe4d1230800 20 add_watcher() i=4 2024-04-24T02:12:23.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.931+0000 7fe4d1230800 20 add_watcher() i=5 2024-04-24T02:12:23.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.931+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94680104389696] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4bc009d10 con 0x7fe4c4031040 2024-04-24T02:12:23.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.931+0000 7fe4d1230800 20 add_watcher() i=6 2024-04-24T02:12:23.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.931+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94680104392544] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4bc009d10 con 0x7fe4c4031040 2024-04-24T02:12:23.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.931+0000 7fe4d1230800 20 add_watcher() i=7 2024-04-24T02:12:23.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.931+0000 7fe4d1230800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:23.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.931+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfd5290 con 0x561c6dfc58b0 2024-04-24T02:12:23.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.932+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe4bc009d10 con 0x561c6dfc58b0 2024-04-24T02:12:23.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.932+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94680104394576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfd5290 con 0x561c6dfc58b0 2024-04-24T02:12:23.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.933+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94680104394576] v30'84 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe4bc009d10 con 0x561c6dfc58b0 2024-04-24T02:12:23.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.933+0000 7fe3827e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:23.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.933+0000 7fe4d1230800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:23.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.933+0000 7fe4d1230800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:23.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.933+0000 7fe4d1230800 5 note: GC not initialized 2024-04-24T02:12:23.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.933+0000 7fe3817e2640 20 reqs_thread_entry: start 2024-04-24T02:12:23.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.933+0000 7fe4d1230800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:23.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.933+0000 7fe4d1230800 20 Filter name: none 2024-04-24T02:12:23.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.934+0000 7fe2f2ffd640 20 reqs_thread_entry: start 2024-04-24T02:12:23.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.934+0000 7fe4d1230800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T02:12:23.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.934+0000 7fe4d1230800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.934+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561c6e00c410 con 0x561c6dfc58b0 2024-04-24T02:12:23.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.934+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fe4bc009d10 con 0x561c6dfc58b0 2024-04-24T02:12:23.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.934+0000 7fe4d1230800 20 rados_obj.operate() r=0 bl.length=556 2024-04-24T02:12:23.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.934+0000 7fe4d1230800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T02:12:23.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.934+0000 7fe4d1230800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:23.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.934+0000 7fe4d1230800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:12:23.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.934+0000 7fe4d1230800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-04-24T02:12:23.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.934+0000 7fe4d1230800 20 rados->read ofs=0 len=0 2024-04-24T02:12:23.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.934+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561c6e00d1a0 con 0x7fe4c0036300 2024-04-24T02:12:23.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.934+0000 7fe4ccc56640 1 -- 172.21.15.134:0/3634444117 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7fe4c4040040 con 0x7fe4c0036300 2024-04-24T02:12:23.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.934+0000 7fe4d1230800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:23.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.934+0000 7fe4d1230800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-04-24T02:12:23.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.934+0000 7fe4d1230800 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-04-24T02:12:23.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.934+0000 7fe4d1230800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-04-24T02:12:23.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.934+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~673 in=673b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c6e012f20 con 0x561c6dfc58b0 2024-04-24T02:12:23.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.935+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~673] v30'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fe4bc009d10 con 0x561c6dfc58b0 2024-04-24T02:12:23.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.935+0000 7fe4d1230800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T02:12:23.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.935+0000 7fe4d1230800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:23.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.935+0000 7fe4d1230800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-24T02:12:23.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.935+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94680104642960 in=861b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561c6e00fa90 con 0x561c6dfc58b0 2024-04-24T02:12:23.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.936+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== watch-notify(notify (1) cookie 94680104382496 notify 128849018887 ret 0) ==== 891+0+0 (crc 0 0 0) 0x561c6df8e540 con 0x561c6dfc58b0 2024-04-24T02:12:23.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.936+0000 7fe3ab7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018887 cookie 94680104382496 notifier 4383 bl.length()=849 2024-04-24T02:12:23.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.936+0000 7fe3ab7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T02:12:23.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.936+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(65 notify.4 [notify cookie 94680104642960 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe4bc009d10 con 0x561c6dfc58b0 2024-04-24T02:12:23.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.936+0000 7fe3ab7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:23.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.936+0000 7fe3ab7fe640 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fe390003ea0 con 0x561c6dfc58b0 2024-04-24T02:12:23.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.936+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4bc009d10 con 0x561c6dfc58b0 2024-04-24T02:12:23.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.936+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== watch-notify(notify_complete (2) cookie 94680104642960 notify 128849018887 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561c6df8b8e0 con 0x561c6dfc58b0 2024-04-24T02:12:23.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.936+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c6e012990 con 0x7fe4c0036300 2024-04-24T02:12:23.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.937+0000 7fe4ccc56640 1 -- 172.21.15.134:0/3634444117 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7fe4c4040040 con 0x7fe4c0036300 2024-04-24T02:12:23.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.937+0000 7fe4d1230800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-04-24T02:12:23.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.937+0000 7fe4d1230800 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-04-24T02:12:23.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.937+0000 7fe4d1230800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-04-24T02:12:23.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.937+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94680104642960 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561c6e00fa90 con 0x7fe4c0036300 2024-04-24T02:12:23.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.938+0000 7fe4ccc56640 1 -- 172.21.15.134:0/3634444117 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== watch-notify(notify (1) cookie 94680104369136 notify 128849018883 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7fe4c4014420 con 0x7fe4c0036300 2024-04-24T02:12:23.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.938+0000 7fe3ab7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018883 cookie 94680104369136 notifier 4383 bl.length()=166 2024-04-24T02:12:23.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.938+0000 7fe3ab7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-04-24T02:12:23.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.938+0000 7fe3ab7fe640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-04-24T02:12:23.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.938+0000 7fe4ccc56640 1 -- 172.21.15.134:0/3634444117 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(68 notify.0 [notify cookie 94680104642960 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe4c4040040 con 0x7fe4c0036300 2024-04-24T02:12:23.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.938+0000 7fe3ab7fe640 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fe390003ea0 con 0x7fe4c0036300 2024-04-24T02:12:23.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.938+0000 7fe4ccc56640 1 -- 172.21.15.134:0/3634444117 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== watch-notify(notify_complete (2) cookie 94680104642960 notify 128849018883 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fe4c4024860 con 0x7fe4c0036300 2024-04-24T02:12:23.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.938+0000 7fe4ccc56640 1 -- 172.21.15.134:0/3634444117 <== osd.2 v2:172.21.15.134:6800/214480313 16 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4c4040040 con 0x7fe4c0036300 2024-04-24T02:12:23.956 INFO:teuthology.orchestra.run.smithi134.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T02:12:21.778798Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-04-24T02:12:23.936085Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T02:12:21.778786Z","tags":[],"group_ids":[]} 2024-04-24T02:12:23.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.939+0000 7fe3827e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:23.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.939+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94680104394576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c6e00fec0 con 0x561c6dfc58b0 2024-04-24T02:12:23.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.940+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94680104394576] v30'85 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe4bc009d10 con 0x561c6dfc58b0 2024-04-24T02:12:23.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.940+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94680104369136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfd5f50 con 0x7fe4c0036300 2024-04-24T02:12:23.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.941+0000 7fe4ccc56640 1 -- 172.21.15.134:0/3634444117 <== osd.2 v2:172.21.15.134:6800/214480313 17 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94680104369136] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4c4040040 con 0x7fe4c0036300 2024-04-24T02:12:23.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.941+0000 7fe4d1230800 20 remove_watcher() i=0 2024-04-24T02:12:23.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.941+0000 7fe4d1230800 2 removed watcher, disabling cache 2024-04-24T02:12:23.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.941+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94680104373552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfd5f50 con 0x561c6dfc58b0 2024-04-24T02:12:23.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.942+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 <== osd.1 v2:172.21.15.134:6804/1487076214 30 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94680104373552] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4bc009d10 con 0x561c6dfc58b0 2024-04-24T02:12:23.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.942+0000 7fe4d1230800 20 remove_watcher() i=1 2024-04-24T02:12:23.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.942+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94680104377536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfd0d30 con 0x561c6dfcbb00 2024-04-24T02:12:23.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.943+0000 7fe4cbc54640 1 -- 172.21.15.134:0/3634444117 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94680104377536] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4c0009050 con 0x561c6dfcbb00 2024-04-24T02:12:23.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.943+0000 7fe4d1230800 20 remove_watcher() i=2 2024-04-24T02:12:23.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.943+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94680104379872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfd1cc0 con 0x7fe4c0036300 2024-04-24T02:12:23.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.944+0000 7fe4ccc56640 1 -- 172.21.15.134:0/3634444117 <== osd.2 v2:172.21.15.134:6800/214480313 18 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94680104379872] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4c4040040 con 0x7fe4c0036300 2024-04-24T02:12:23.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.944+0000 7fe4d1230800 20 remove_watcher() i=3 2024-04-24T02:12:23.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.944+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94680104382496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfd25e0 con 0x561c6dfc58b0 2024-04-24T02:12:23.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.945+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 <== osd.1 v2:172.21.15.134:6804/1487076214 31 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94680104382496] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4bc009d10 con 0x561c6dfc58b0 2024-04-24T02:12:23.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.945+0000 7fe4d1230800 20 remove_watcher() i=4 2024-04-24T02:12:23.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.945+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94680104387424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfd1cc0 con 0x7fe4c4031040 2024-04-24T02:12:23.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.946+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94680104387424] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4bc009d10 con 0x7fe4c4031040 2024-04-24T02:12:23.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.946+0000 7fe4d1230800 20 remove_watcher() i=5 2024-04-24T02:12:23.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.946+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94680104389696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfd25e0 con 0x7fe4c4031040 2024-04-24T02:12:23.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.947+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94680104389696] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4bc009d10 con 0x7fe4c4031040 2024-04-24T02:12:23.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.947+0000 7fe4d1230800 20 remove_watcher() i=6 2024-04-24T02:12:23.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.947+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94680104392544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561c6dfd4360 con 0x7fe4c4031040 2024-04-24T02:12:23.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.948+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94680104392544] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4bc009d10 con 0x7fe4c4031040 2024-04-24T02:12:23.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.948+0000 7fe4d1230800 20 remove_watcher() i=7 2024-04-24T02:12:23.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.948+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fe4c4031040 msgr2=0x7fe4c4032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.948+0000 7fe4d1230800 1 --2- 172.21.15.134:0/3634444117 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fe4c4031040 0x7fe4c4032940 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.948+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x561c6dfc58b0 msgr2=0x561c6dfc7d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.948+0000 7fe4d1230800 1 --2- 172.21.15.134:0/3634444117 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x561c6dfc58b0 0x561c6dfc7d70 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.948+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fe4c0036300 msgr2=0x7fe4c004b250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.948+0000 7fe4d1230800 1 --2- 172.21.15.134:0/3634444117 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fe4c0036300 0x7fe4c004b250 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.948+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x561c6dfcbb00 msgr2=0x561c6dfcdef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.948+0000 7fe4d1230800 1 --2- 172.21.15.134:0/3634444117 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x561c6dfcbb00 0x561c6dfcdef0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.948+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe39c036950 msgr2=0x7fe39c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.948+0000 7fe4d1230800 1 --2- 172.21.15.134:0/3634444117 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe39c036950 0x7fe39c038e10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x561c6df8f820 tx=0x7fe4c401f000 comp rx=0 tx=0).stop 2024-04-24T02:12:23.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.948+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561c6de07670 msgr2=0x561c6dfb9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.948+0000 7fe4cc455640 1 -- 172.21.15.134:0/3634444117 reap_dead start 2024-04-24T02:12:23.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.948+0000 7fe4d1230800 1 --2- 172.21.15.134:0/3634444117 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561c6de07670 0x561c6dfb9fb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x561c6dfabfc0 tx=0x7fe4c004cda0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.948+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 shutdown_connections 2024-04-24T02:12:23.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.948+0000 7fe4d1230800 1 --2- 172.21.15.134:0/3634444117 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561c6de07670 0x561c6dfb9fb0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.948+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 >> 172.21.15.134:0/3634444117 conn(0x561c6dfacaf0 msgr2=0x561c6dfaa150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:23.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.948+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 shutdown_connections 2024-04-24T02:12:23.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.948+0000 7fe4d1230800 1 -- 172.21.15.134:0/3634444117 wait complete. 2024-04-24T02:12:23.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.948+0000 7fe4d1230800 1 -- 172.21.15.134:0/2086162607 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe3a40369a0 msgr2=0x7fe3a4038e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.948+0000 7fe4d1230800 1 --2- 172.21.15.134:0/2086162607 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe3a40369a0 0x7fe3a4038e60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x561c6df934e0 tx=0x7fe4c4005840 comp rx=0 tx=0).stop 2024-04-24T02:12:23.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.948+0000 7fe4d1230800 1 -- 172.21.15.134:0/2086162607 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561c6dfa3450 msgr2=0x561c6dfa3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.948+0000 7fe4d1230800 1 --2- 172.21.15.134:0/2086162607 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561c6dfa3450 0x561c6dfa3870 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0001ed0 tx=0x7fe4c000d7a0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.948+0000 7fe4d1230800 1 -- 172.21.15.134:0/2086162607 shutdown_connections 2024-04-24T02:12:23.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.948+0000 7fe4d1230800 1 --2- 172.21.15.134:0/2086162607 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe3a40369a0 0x7fe3a4038e60 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.949+0000 7fe4d1230800 1 --2- 172.21.15.134:0/2086162607 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561c6dfa3450 0x561c6dfa3870 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.949+0000 7fe4d1230800 1 -- 172.21.15.134:0/2086162607 >> 172.21.15.134:0/2086162607 conn(0x561c6df974f0 msgr2=0x561c6df978f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:23.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.949+0000 7fe4d1230800 1 -- 172.21.15.134:0/2086162607 shutdown_connections 2024-04-24T02:12:23.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.949+0000 7fe4d1230800 1 -- 172.21.15.134:0/2086162607 wait complete. 2024-04-24T02:12:23.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.949+0000 7fe4d1230800 1 -- 172.21.15.134:0/257432485 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x561c6de93120 msgr2=0x561c6df92300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.949+0000 7fe4d1230800 1 --2- 172.21.15.134:0/257432485 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x561c6de93120 0x561c6df92300 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.949+0000 7fe4d1230800 1 -- 172.21.15.134:0/257432485 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe3b4036950 msgr2=0x7fe3b4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.949+0000 7fe4d1230800 1 --2- 172.21.15.134:0/257432485 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe3b4036950 0x7fe3b4038e10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0000f60 tx=0x7fe4c00012b0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.949+0000 7fe4d1230800 1 -- 172.21.15.134:0/257432485 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561c6de91fb0 msgr2=0x561c6df8b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:23.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.949+0000 7fe4d1230800 1 --2- 172.21.15.134:0/257432485 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561c6de91fb0 0x561c6df8b110 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc060040 tx=0x7fe4bc002fb0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.949+0000 7fe4d1230800 1 -- 172.21.15.134:0/257432485 shutdown_connections 2024-04-24T02:12:23.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.949+0000 7fe4d1230800 1 --2- 172.21.15.134:0/257432485 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x561c6de93120 0x561c6df92300 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.949+0000 7fe4d1230800 1 --2- 172.21.15.134:0/257432485 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe3b4036950 0x7fe3b4038e10 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.949+0000 7fe4d1230800 1 --2- 172.21.15.134:0/257432485 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561c6de91fb0 0x561c6df8b110 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:23.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.949+0000 7fe4d1230800 1 -- 172.21.15.134:0/257432485 >> 172.21.15.134:0/257432485 conn(0x561c6de8d550 msgr2=0x561c6df7d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:23.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.949+0000 7fe4d1230800 1 -- 172.21.15.134:0/257432485 shutdown_connections 2024-04-24T02:12:23.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:23.949+0000 7fe4d1230800 1 -- 172.21.15.134:0/257432485 wait complete. 2024-04-24T02:12:23.967 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T02:12:21.778798Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-04-24T02:12:23.936085Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:12:21.778786Z', 'tags': [], 'group_ids': []} 2024-04-24T02:12:23.967 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-24T02:12:23.967 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-24T02:12:23.967 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-24T02:12:24.011 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:24.012 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:24.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.009+0000 7f75f7094800 1 Processor -- start 2024-04-24T02:12:24.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.009+0000 7f75f7094800 1 -- start start 2024-04-24T02:12:24.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.010+0000 7f75f7094800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x557cc003ef90 0x557cc003f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.010+0000 7f75f7094800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557cbfefdd40 con 0x557cc0040100 2024-04-24T02:12:24.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.010+0000 7f75f7094800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x557cbfed04d0 con 0x557cc003ef90 2024-04-24T02:12:24.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.010+0000 7f75f4b93640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x557cc003ef90 0x557cc003f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.010+0000 7f75f4b93640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x557cc003ef90 0x557cc003f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46382/0 (socket says 172.21.15.134:46382) 2024-04-24T02:12:24.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.010+0000 7f75f4b93640 1 -- 172.21.15.134:0/1646980632 learned_addr learned my addr 172.21.15.134:0/1646980632 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:24.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.010+0000 7f75f4392640 1 --1- 172.21.15.134:0/1646980632 >> v1:172.21.15.104:6789/0 conn(0x557cc0040100 0x557cc0040580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:43346/0 (socket says 172.21.15.134:43346) 2024-04-24T02:12:24.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.010+0000 7f75f4b93640 1 -- 172.21.15.134:0/1646980632 >> v1:172.21.15.104:6789/0 conn(0x557cc0040100 legacy=0x557cc0040580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.010+0000 7f75f4b93640 1 -- 172.21.15.134:0/1646980632 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cbfefc590 con 0x557cc003ef90 2024-04-24T02:12:24.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.012+0000 7f75f4b93640 1 --2- 172.21.15.134:0/1646980632 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557cc003ef90 0x557cc003f3b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f75e400a520 tx=0x7f75e401ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e53a4d7d98855c0b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.012+0000 7f75f3b91640 1 -- 172.21.15.134:0/1646980632 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75e4057070 con 0x557cc003ef90 2024-04-24T02:12:24.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.012+0000 7f75f3b91640 1 -- 172.21.15.134:0/1646980632 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75e4052570 con 0x557cc003ef90 2024-04-24T02:12:24.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.012+0000 7f75f3b91640 1 -- 172.21.15.134:0/1646980632 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75e4052870 con 0x557cc003ef90 2024-04-24T02:12:24.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.013+0000 7f75f7094800 1 -- 172.21.15.134:0/1646980632 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557cc003ef90 msgr2=0x557cc003f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.013+0000 7f75f7094800 1 --2- 172.21.15.134:0/1646980632 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557cc003ef90 0x557cc003f3b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f75e400a520 tx=0x7f75e401ce40 comp rx=0 tx=0).stop 2024-04-24T02:12:24.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.013+0000 7f75f7094800 1 -- 172.21.15.134:0/1646980632 shutdown_connections 2024-04-24T02:12:24.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.013+0000 7f75f7094800 1 --2- 172.21.15.134:0/1646980632 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557cc003ef90 0x557cc003f3b0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.013+0000 7f75f7094800 1 -- 172.21.15.134:0/1646980632 >> 172.21.15.134:0/1646980632 conn(0x557cc003a530 msgr2=0x557cc003c950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:24.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.013+0000 7f75f7094800 1 -- 172.21.15.134:0/1646980632 shutdown_connections 2024-04-24T02:12:24.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.013+0000 7f75f7094800 1 -- 172.21.15.134:0/1646980632 wait complete. 2024-04-24T02:12:24.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.025+0000 7f75f7094800 1 Processor -- start 2024-04-24T02:12:24.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.025+0000 7f75f7094800 1 -- start start 2024-04-24T02:12:24.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.025+0000 7f75f7094800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557cc003ef90 0x557cbffb49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.025+0000 7f75f7094800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x557cbff8a3c0 con 0x557cc003ef90 2024-04-24T02:12:24.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.025+0000 7f75f4b93640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557cc003ef90 0x557cbffb49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.025+0000 7f75f4b93640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557cc003ef90 0x557cbffb49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46398/0 (socket says 172.21.15.134:46398) 2024-04-24T02:12:24.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.025+0000 7f75f4b93640 1 -- 172.21.15.134:0/3393300777 learned_addr learned my addr 172.21.15.134:0/3393300777 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:24.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.025+0000 7f75f4b93640 1 -- 172.21.15.134:0/3393300777 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cbffb2f60 con 0x557cc003ef90 2024-04-24T02:12:24.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.026+0000 7f75f4b93640 1 --2- 172.21.15.134:0/3393300777 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557cc003ef90 0x557cbffb49a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f75e4055040 tx=0x7f75e404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2d123cf75caf137 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.026+0000 7f74e2e0d640 1 -- 172.21.15.134:0/3393300777 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75e4057040 con 0x557cc003ef90 2024-04-24T02:12:24.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.026+0000 7f74e2e0d640 1 -- 172.21.15.134:0/3393300777 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75e4052870 con 0x557cc003ef90 2024-04-24T02:12:24.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.026+0000 7f74e2e0d640 1 -- 172.21.15.134:0/3393300777 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75e4052b90 con 0x557cc003ef90 2024-04-24T02:12:24.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.026+0000 7f75f7094800 1 -- 172.21.15.134:0/3393300777 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557cc003ef90 msgr2=0x557cbffb49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.026+0000 7f75f7094800 1 --2- 172.21.15.134:0/3393300777 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557cc003ef90 0x557cbffb49a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f75e4055040 tx=0x7f75e404c000 comp rx=0 tx=0).stop 2024-04-24T02:12:24.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.026+0000 7f75f7094800 1 -- 172.21.15.134:0/3393300777 shutdown_connections 2024-04-24T02:12:24.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.026+0000 7f75f7094800 1 --2- 172.21.15.134:0/3393300777 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557cc003ef90 0x557cbffb49a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.026+0000 7f75f7094800 1 -- 172.21.15.134:0/3393300777 >> 172.21.15.134:0/3393300777 conn(0x557cc003a530 msgr2=0x557cc012bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:24.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.027+0000 7f75f7094800 1 -- 172.21.15.134:0/3393300777 shutdown_connections 2024-04-24T02:12:24.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.027+0000 7f75f7094800 1 -- 172.21.15.134:0/3393300777 wait complete. 2024-04-24T02:12:24.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.027+0000 7f75f7094800 1 Processor -- start 2024-04-24T02:12:24.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.027+0000 7f75f7094800 1 -- start start 2024-04-24T02:12:24.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.027+0000 7f75f7094800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557cc0040100 0x557cc013a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.027+0000 7f75f7094800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x557cc00485a0 con 0x557cc0040100 2024-04-24T02:12:24.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.027+0000 7f75f4b93640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557cc0040100 0x557cc013a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.027+0000 7f75f4b93640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557cc0040100 0x557cc013a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46400/0 (socket says 172.21.15.134:46400) 2024-04-24T02:12:24.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.027+0000 7f75f4b93640 1 -- 172.21.15.134:0/1380672289 learned_addr learned my addr 172.21.15.134:0/1380672289 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:24.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.028+0000 7f75f4b93640 1 -- 172.21.15.134:0/1380672289 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cc013aa60 con 0x557cc0040100 2024-04-24T02:12:24.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.028+0000 7f75f4b93640 1 --2- 172.21.15.134:0/1380672289 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557cc0040100 0x557cc013a520 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f75e4052540 tx=0x7f75e4003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.028+0000 7f74e160a640 1 -- 172.21.15.134:0/1380672289 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75e4073070 con 0x557cc0040100 2024-04-24T02:12:24.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.028+0000 7f74e160a640 1 -- 172.21.15.134:0/1380672289 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75e4052e30 con 0x557cc0040100 2024-04-24T02:12:24.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.028+0000 7f75f7094800 1 -- 172.21.15.134:0/1380672289 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557cc013acf0 con 0x557cc0040100 2024-04-24T02:12:24.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.028+0000 7f74e160a640 1 -- 172.21.15.134:0/1380672289 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75e4057070 con 0x557cc0040100 2024-04-24T02:12:24.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.028+0000 7f75f7094800 1 -- 172.21.15.134:0/1380672289 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557cc013d950 con 0x557cc0040100 2024-04-24T02:12:24.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.029+0000 7f74e160a640 1 -- 172.21.15.134:0/1380672289 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f75e4076070 con 0x557cc0040100 2024-04-24T02:12:24.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.029+0000 7f74e160a640 1 --2- 172.21.15.134:0/1380672289 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f74dc036950 0x7f74dc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.029+0000 7f74e160a640 1 -- 172.21.15.134:0/1380672289 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f75e408d850 con 0x557cc0040100 2024-04-24T02:12:24.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.029+0000 7f75f4392640 1 --2- 172.21.15.134:0/1380672289 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f74dc036950 0x7f74dc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.029+0000 7f75f7094800 1 --2- 172.21.15.134:0/1380672289 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x557cc013f700 0x557cc0141af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.029+0000 7f75f7094800 1 -- 172.21.15.134:0/1380672289 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557cc0142030 con 0x557cc013f700 2024-04-24T02:12:24.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.029+0000 7f75f5394640 1 --2- 172.21.15.134:0/1380672289 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x557cc013f700 0x557cc0141af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.029+0000 7f75f4392640 1 --2- 172.21.15.134:0/1380672289 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f74dc036950 0x7f74dc038e10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f75e800b340 tx=0x7f75e8001520 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.029+0000 7f75f5394640 1 --2- 172.21.15.134:0/1380672289 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x557cc013f700 0x557cc0141af0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.030+0000 7f75f5394640 1 -- 172.21.15.134:0/1380672289 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f75ec00a4a0 con 0x557cc013f700 2024-04-24T02:12:24.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.030+0000 7f75f7094800 1 -- 172.21.15.134:0/1380672289 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557cc013ec90 con 0x557cc013f700 2024-04-24T02:12:24.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.030+0000 7f75f5394640 1 -- 172.21.15.134:0/1380672289 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f75ec00a4a0 con 0x557cc013f700 2024-04-24T02:12:24.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.030+0000 7f75f7094800 1 -- 172.21.15.134:0/1380672289 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557cc0143d90 con 0x557cc013f700 2024-04-24T02:12:24.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.030+0000 7f75f5394640 1 -- 172.21.15.134:0/1380672289 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f75ec00a4a0 con 0x557cc013f700 2024-04-24T02:12:24.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.030+0000 7f75f7094800 1 -- 172.21.15.134:0/1380672289 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557cc0143100 con 0x557cc013f700 2024-04-24T02:12:24.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.030+0000 7f75f5394640 1 -- 172.21.15.134:0/1380672289 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f75ec00a4a0 con 0x557cc013f700 2024-04-24T02:12:24.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.030+0000 7f75f7094800 1 -- 172.21.15.134:0/1380672289 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557cc0143520 con 0x557cc013f700 2024-04-24T02:12:24.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.031+0000 7f75f5394640 1 -- 172.21.15.134:0/1380672289 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f75ec00a4a0 con 0x557cc013f700 2024-04-24T02:12:24.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.031+0000 7f75f7094800 1 Processor -- start 2024-04-24T02:12:24.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.031+0000 7f75f7094800 1 -- start start 2024-04-24T02:12:24.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.031+0000 7f75f7094800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557cc0152b40 0x557cc0152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.031+0000 7f75f7094800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x557cbff306b0 con 0x557cc0152b40 2024-04-24T02:12:24.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.031+0000 7f75f4392640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557cc0152b40 0x557cc0152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.031+0000 7f75f4392640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557cc0152b40 0x557cc0152f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46404/0 (socket says 172.21.15.134:46404) 2024-04-24T02:12:24.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.031+0000 7f75f4392640 1 -- 172.21.15.134:0/948155267 learned_addr learned my addr 172.21.15.134:0/948155267 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:24.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.032+0000 7f75f4392640 1 -- 172.21.15.134:0/948155267 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cc01534a0 con 0x557cc0152b40 2024-04-24T02:12:24.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.032+0000 7f75f4392640 1 --2- 172.21.15.134:0/948155267 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557cc0152b40 0x557cc0152f60 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f75e800e610 tx=0x7f75e800ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.032+0000 7f74da7fc640 1 -- 172.21.15.134:0/948155267 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75e8022070 con 0x557cc0152b40 2024-04-24T02:12:24.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.032+0000 7f74da7fc640 1 -- 172.21.15.134:0/948155267 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75e8009050 con 0x557cc0152b40 2024-04-24T02:12:24.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.032+0000 7f74da7fc640 1 -- 172.21.15.134:0/948155267 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75e800d7b0 con 0x557cc0152b40 2024-04-24T02:12:24.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.032+0000 7f75f7094800 1 -- 172.21.15.134:0/948155267 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557cc0153f10 con 0x557cc0152b40 2024-04-24T02:12:24.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.032+0000 7f75f7094800 1 -- 172.21.15.134:0/948155267 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557cc0154410 con 0x557cc0152b40 2024-04-24T02:12:24.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.033+0000 7f74da7fc640 1 -- 172.21.15.134:0/948155267 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f75e8025070 con 0x557cc0152b40 2024-04-24T02:12:24.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.033+0000 7f74da7fc640 1 --2- 172.21.15.134:0/948155267 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f74cc036900 0x7f74cc038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.033+0000 7f74da7fc640 1 -- 172.21.15.134:0/948155267 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f75e804db60 con 0x557cc0152b40 2024-04-24T02:12:24.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.033+0000 7f75f5394640 1 --2- 172.21.15.134:0/948155267 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f74cc036900 0x7f74cc038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.033+0000 7f75f7094800 1 Processor -- start 2024-04-24T02:12:24.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.033+0000 7f75f5394640 1 --2- 172.21.15.134:0/948155267 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f74cc036900 0x7f74cc038dc0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x557cc01434a0 tx=0x7f75ec005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.033+0000 7f75f7094800 1 -- start start 2024-04-24T02:12:24.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.033+0000 7f75f7094800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557cc015fe40 0x557cc0160260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.033+0000 7f75f7094800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x557cbffb3220 con 0x557cc015fe40 2024-04-24T02:12:24.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.034+0000 7f75f4392640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557cc015fe40 0x557cc0160260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.034+0000 7f75f4392640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557cc015fe40 0x557cc0160260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46412/0 (socket says 172.21.15.134:46412) 2024-04-24T02:12:24.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.034+0000 7f75f4392640 1 -- 172.21.15.134:0/3652427759 learned_addr learned my addr 172.21.15.134:0/3652427759 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:24.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.034+0000 7f75f4392640 1 -- 172.21.15.134:0/3652427759 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cc0160830 con 0x557cc015fe40 2024-04-24T02:12:24.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.034+0000 7f75f4392640 1 --2- 172.21.15.134:0/3652427759 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557cc015fe40 0x557cc0160260 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f75e804c070 tx=0x7f75e8024eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=139b23608df2f128 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.034+0000 7f74cbfff640 1 -- 172.21.15.134:0/3652427759 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75e8026730 con 0x557cc015fe40 2024-04-24T02:12:24.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.034+0000 7f74cbfff640 1 -- 172.21.15.134:0/3652427759 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75e801a320 con 0x557cc015fe40 2024-04-24T02:12:24.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.034+0000 7f74cbfff640 1 -- 172.21.15.134:0/3652427759 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75e80268d0 con 0x557cc015fe40 2024-04-24T02:12:24.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.035+0000 7f75f7094800 1 -- 172.21.15.134:0/3652427759 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557cc015fe40 msgr2=0x557cc0160260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.035+0000 7f75f7094800 1 --2- 172.21.15.134:0/3652427759 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557cc015fe40 0x557cc0160260 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f75e804c070 tx=0x7f75e8024eb0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.035+0000 7f75f7094800 1 -- 172.21.15.134:0/3652427759 shutdown_connections 2024-04-24T02:12:24.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.035+0000 7f75f7094800 1 --2- 172.21.15.134:0/3652427759 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557cc015fe40 0x557cc0160260 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.035+0000 7f75f7094800 1 -- 172.21.15.134:0/3652427759 >> 172.21.15.134:0/3652427759 conn(0x557cc015c1a0 msgr2=0x557cc015a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:24.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.035+0000 7f75f7094800 1 -- 172.21.15.134:0/3652427759 shutdown_connections 2024-04-24T02:12:24.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.035+0000 7f75f7094800 1 -- 172.21.15.134:0/3652427759 wait complete. 2024-04-24T02:12:24.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.035+0000 7f75f7094800 1 Processor -- start 2024-04-24T02:12:24.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.035+0000 7f75f7094800 1 -- start start 2024-04-24T02:12:24.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.035+0000 7f75f7094800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557cc015fe40 0x557cc01674e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.035+0000 7f75f7094800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x557cc0160fa0 con 0x557cc015fe40 2024-04-24T02:12:24.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.035+0000 7f75f4392640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557cc015fe40 0x557cc01674e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.035+0000 7f75f4392640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557cc015fe40 0x557cc01674e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46428/0 (socket says 172.21.15.134:46428) 2024-04-24T02:12:24.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.035+0000 7f75f4392640 1 -- 172.21.15.134:0/786971593 learned_addr learned my addr 172.21.15.134:0/786971593 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:24.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.036+0000 7f75f4392640 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cc0167a20 con 0x557cc015fe40 2024-04-24T02:12:24.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.036+0000 7f75f4392640 1 --2- 172.21.15.134:0/786971593 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557cc015fe40 0x557cc01674e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f75e800eea0 tx=0x7f75e804bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.036+0000 7f74ca7fc640 1 -- 172.21.15.134:0/786971593 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75e80256a0 con 0x557cc015fe40 2024-04-24T02:12:24.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.036+0000 7f74ca7fc640 1 -- 172.21.15.134:0/786971593 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75e800d950 con 0x557cc015fe40 2024-04-24T02:12:24.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.036+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557cc0167a20 con 0x557cc015fe40 2024-04-24T02:12:24.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.036+0000 7f74ca7fc640 1 -- 172.21.15.134:0/786971593 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75e800dcb0 con 0x557cc015fe40 2024-04-24T02:12:24.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.036+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557cc0167a20 con 0x557cc015fe40 2024-04-24T02:12:24.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.037+0000 7f74ca7fc640 1 -- 172.21.15.134:0/786971593 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f75e801a680 con 0x557cc015fe40 2024-04-24T02:12:24.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.037+0000 7f74ca7fc640 1 --2- 172.21.15.134:0/786971593 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f74c0036950 0x7f74c0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.037+0000 7f74ca7fc640 1 -- 172.21.15.134:0/786971593 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f75e8036af0 con 0x557cc015fe40 2024-04-24T02:12:24.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.037+0000 7f75f5394640 1 --2- 172.21.15.134:0/786971593 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f74c0036950 0x7f74c0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.037+0000 7f75f7094800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.037+0000 7f75f7094800 1 --2- 172.21.15.134:0/786971593 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x557cc0172ba0 0x557cc0175060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.037+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557cc01757b0 con 0x557cc0172ba0 2024-04-24T02:12:24.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.037+0000 7f75f4b93640 1 --2- 172.21.15.134:0/786971593 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x557cc0172ba0 0x557cc0175060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.037+0000 7f75f5394640 1 --2- 172.21.15.134:0/786971593 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f74c0036950 0x7f74c0038e10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x557cc0142c20 tx=0x7f75ec01f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.038+0000 7f75f4b93640 1 --2- 172.21.15.134:0/786971593 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x557cc0172ba0 0x557cc0175060 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.038+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f75e4075030 con 0x557cc0172ba0 2024-04-24T02:12:24.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.038+0000 7f75f7094800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:24.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.038+0000 7f75f7094800 20 realm 2024-04-24T02:12:24.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.038+0000 7f75f7094800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.038+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557cc0175bc0 con 0x557cc0172ba0 2024-04-24T02:12:24.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.038+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f75e4075030 con 0x557cc0172ba0 2024-04-24T02:12:24.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.038+0000 7f75f7094800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:24.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.038+0000 7f75f7094800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:24.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.038+0000 7f75f7094800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.038+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557cc0176460 con 0x557cc0172ba0 2024-04-24T02:12:24.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.038+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f75e4075030 con 0x557cc0172ba0 2024-04-24T02:12:24.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.038+0000 7f75f7094800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:24.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.038+0000 7f75f7094800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.038+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557cc0176800 con 0x557cc0172ba0 2024-04-24T02:12:24.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.038+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f75e4075030 con 0x557cc0172ba0 2024-04-24T02:12:24.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.038+0000 7f75f7094800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:24.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.039+0000 7f75f7094800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.039+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557cc0177050 con 0x557cc0172ba0 2024-04-24T02:12:24.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.039+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f75e4075030 con 0x557cc0172ba0 2024-04-24T02:12:24.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.039+0000 7f75f7094800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:24.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.039+0000 7f75f7094800 20 searching for the correct realm 2024-04-24T02:12:24.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.039+0000 7f75f7094800 1 --2- 172.21.15.134:0/786971593 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x557cc0178dc0 0x557cc017b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.039+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557cc017b790 con 0x557cc0178dc0 2024-04-24T02:12:24.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.039+0000 7f75f4392640 1 --2- 172.21.15.134:0/786971593 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x557cc0178dc0 0x557cc017b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.039+0000 7f75f4392640 1 --2- 172.21.15.134:0/786971593 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x557cc0178dc0 0x557cc017b1b0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.040+0000 7f75f4392640 1 -- 172.21.15.134:0/786971593 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75e8024030 con 0x557cc0178dc0 2024-04-24T02:12:24.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.040+0000 7f75f4392640 1 --2- 172.21.15.134:0/786971593 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f75e8058040 0x7f75e80457b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.040+0000 7f75f4392640 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557cc017b790 con 0x7f75e8058040 2024-04-24T02:12:24.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.040+0000 7f75f5394640 1 --2- 172.21.15.134:0/786971593 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f75e8058040 0x7f75e80457b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.040+0000 7f75f5394640 1 --2- 172.21.15.134:0/786971593 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f75e8058040 0x7f75e80457b0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.040+0000 7f75f5394640 1 -- 172.21.15.134:0/786971593 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75ec01f070 con 0x7f75e8058040 2024-04-24T02:12:24.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.040+0000 7f75f5394640 1 --2- 172.21.15.134:0/786971593 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f75ec031040 0x7f75ec032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.040+0000 7f75f5394640 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557cc017b790 con 0x7f75ec031040 2024-04-24T02:12:24.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.040+0000 7f75f4b93640 1 --2- 172.21.15.134:0/786971593 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f75ec031040 0x7f75ec032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.041+0000 7f75f4b93640 1 --2- 172.21.15.134:0/786971593 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f75ec031040 0x7f75ec032940 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.041+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75e4075030 con 0x7f75ec031040 2024-04-24T02:12:24.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.041+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557cc017b790 con 0x557cc0172ba0 2024-04-24T02:12:24.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.041+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75e4075030 con 0x557cc0172ba0 2024-04-24T02:12:24.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.041+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557cc017b790 con 0x557cc0172ba0 2024-04-24T02:12:24.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.042+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f75e4075030 con 0x557cc0172ba0 2024-04-24T02:12:24.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.042+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557cc017b790 con 0x7f75ec031040 2024-04-24T02:12:24.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.042+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75e4075030 con 0x7f75ec031040 2024-04-24T02:12:24.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.042+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557cc017b790 con 0x7f75ec031040 2024-04-24T02:12:24.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.042+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75e4075030 con 0x7f75ec031040 2024-04-24T02:12:24.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.042+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557cc017b790 con 0x7f75e8058040 2024-04-24T02:12:24.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.042+0000 7f75f5394640 1 -- 172.21.15.134:0/786971593 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75ec01f070 con 0x7f75e8058040 2024-04-24T02:12:24.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.042+0000 7f75f5394640 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557cc017b790 con 0x557cc0178dc0 2024-04-24T02:12:24.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.043+0000 7f75f4392640 1 -- 172.21.15.134:0/786971593 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75e8024030 con 0x557cc0178dc0 2024-04-24T02:12:24.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.043+0000 7f75f4392640 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557cc017b790 con 0x557cc0172ba0 2024-04-24T02:12:24.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.043+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75e4075030 con 0x557cc0172ba0 2024-04-24T02:12:24.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.043+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557cc017b790 con 0x7f75ec031040 2024-04-24T02:12:24.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.043+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75e4075030 con 0x7f75ec031040 2024-04-24T02:12:24.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.043+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557cc017b790 con 0x557cc0172ba0 2024-04-24T02:12:24.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.043+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75e4075030 con 0x557cc0172ba0 2024-04-24T02:12:24.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.043+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557cc017b790 con 0x7f75e8058040 2024-04-24T02:12:24.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.044+0000 7f75f5394640 1 -- 172.21.15.134:0/786971593 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f75ec01f070 con 0x7f75e8058040 2024-04-24T02:12:24.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.044+0000 7f75f5394640 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557cc017b790 con 0x557cc0178dc0 2024-04-24T02:12:24.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.044+0000 7f75f4392640 1 -- 172.21.15.134:0/786971593 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75e8024030 con 0x557cc0178dc0 2024-04-24T02:12:24.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.044+0000 7f75f4392640 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557cc017b790 con 0x557cc0178dc0 2024-04-24T02:12:24.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.044+0000 7f75f4392640 1 -- 172.21.15.134:0/786971593 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75e8024030 con 0x557cc0178dc0 2024-04-24T02:12:24.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.044+0000 7f75f4392640 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557cc017b790 con 0x7f75ec031040 2024-04-24T02:12:24.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.044+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75e4075030 con 0x7f75ec031040 2024-04-24T02:12:24.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.044+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557cc017b790 con 0x557cc0178dc0 2024-04-24T02:12:24.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.044+0000 7f75f4392640 1 -- 172.21.15.134:0/786971593 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75e8024030 con 0x557cc0178dc0 2024-04-24T02:12:24.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.044+0000 7f75f4392640 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557cc017b790 con 0x557cc0178dc0 2024-04-24T02:12:24.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.045+0000 7f75f4392640 1 -- 172.21.15.134:0/786971593 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75e8024030 con 0x557cc0178dc0 2024-04-24T02:12:24.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.045+0000 7f75f4392640 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557cc017b790 con 0x557cc0172ba0 2024-04-24T02:12:24.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.045+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75e4075030 con 0x557cc0172ba0 2024-04-24T02:12:24.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.045+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557cc017b790 con 0x557cc0172ba0 2024-04-24T02:12:24.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.045+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f75e4075030 con 0x557cc0172ba0 2024-04-24T02:12:24.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.045+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557cc017b790 con 0x7f75ec031040 2024-04-24T02:12:24.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.045+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75e4075030 con 0x7f75ec031040 2024-04-24T02:12:24.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.045+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557cc017b790 con 0x557cc0178dc0 2024-04-24T02:12:24.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.046+0000 7f75f4392640 1 -- 172.21.15.134:0/786971593 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75e8024030 con 0x557cc0178dc0 2024-04-24T02:12:24.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.046+0000 7f75f4392640 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557cc017b790 con 0x7f75e8058040 2024-04-24T02:12:24.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.046+0000 7f75f5394640 1 -- 172.21.15.134:0/786971593 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75ec01f070 con 0x7f75e8058040 2024-04-24T02:12:24.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.046+0000 7f75f5394640 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557cc017b790 con 0x557cc0172ba0 2024-04-24T02:12:24.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.046+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75e4075030 con 0x557cc0172ba0 2024-04-24T02:12:24.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.046+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557cc017b790 con 0x7f75ec031040 2024-04-24T02:12:24.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.046+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75e4075030 con 0x7f75ec031040 2024-04-24T02:12:24.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.046+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557cc017b790 con 0x557cc0178dc0 2024-04-24T02:12:24.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.047+0000 7f75f4392640 1 -- 172.21.15.134:0/786971593 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75e8024030 con 0x557cc0178dc0 2024-04-24T02:12:24.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.047+0000 7f75f4392640 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557cc017b790 con 0x7f75ec031040 2024-04-24T02:12:24.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.047+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75e4075030 con 0x7f75ec031040 2024-04-24T02:12:24.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.047+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557cc017b790 con 0x7f75e8058040 2024-04-24T02:12:24.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.047+0000 7f75f5394640 1 -- 172.21.15.134:0/786971593 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75ec01f070 con 0x7f75e8058040 2024-04-24T02:12:24.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.047+0000 7f75f5394640 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557cc017b790 con 0x557cc0178dc0 2024-04-24T02:12:24.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.047+0000 7f75f4392640 1 -- 172.21.15.134:0/786971593 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75e8024030 con 0x557cc0178dc0 2024-04-24T02:12:24.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.047+0000 7f75f4392640 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557cc017b790 con 0x7f75ec031040 2024-04-24T02:12:24.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.047+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75e4075030 con 0x7f75ec031040 2024-04-24T02:12:24.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.048+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557cc017b790 con 0x557cc0172ba0 2024-04-24T02:12:24.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.048+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f75e4075030 con 0x557cc0172ba0 2024-04-24T02:12:24.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.048+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557cc017b790 con 0x7f75e8058040 2024-04-24T02:12:24.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.048+0000 7f75f5394640 1 -- 172.21.15.134:0/786971593 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75ec01f070 con 0x7f75e8058040 2024-04-24T02:12:24.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.048+0000 7f75f7094800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:24.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.048+0000 7f75f7094800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:24.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.048+0000 7f75f7094800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:24.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.048+0000 7f75f7094800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:24.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.048+0000 7f75f7094800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:24.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.048+0000 7f75f7094800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:24.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.048+0000 7f75f7094800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.048+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557cc01779d0 con 0x557cc0172ba0 2024-04-24T02:12:24.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.048+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f75e4075030 con 0x557cc0172ba0 2024-04-24T02:12:24.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.048+0000 7f75f7094800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:24.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.048+0000 7f75f7094800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.048+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557cc0178270 con 0x557cc0172ba0 2024-04-24T02:12:24.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.048+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f75e4075030 con 0x557cc0172ba0 2024-04-24T02:12:24.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.049+0000 7f75f7094800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:24.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.049+0000 7f75f7094800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.049+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557cc0177610 con 0x557cc0172ba0 2024-04-24T02:12:24.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.049+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f75e4075030 con 0x557cc0172ba0 2024-04-24T02:12:24.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.049+0000 7f75f7094800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:24.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.049+0000 7f75f7094800 20 zone default found 2024-04-24T02:12:24.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.049+0000 7f75f7094800 4 Realm: () 2024-04-24T02:12:24.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.049+0000 7f75f7094800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:24.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.049+0000 7f75f7094800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:24.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.049+0000 7f75f7094800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:24.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.049+0000 7f75f7094800 20 zonegroup default 2024-04-24T02:12:24.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.049+0000 7f75f7094800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.049+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557cc017bbf0 con 0x7f75ec031040 2024-04-24T02:12:24.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.049+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f75e4075030 con 0x7f75ec031040 2024-04-24T02:12:24.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.049+0000 7f75f7094800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:24.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.049+0000 7f75f7094800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.049+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557cc017da80 con 0x557cc0178dc0 2024-04-24T02:12:24.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.050+0000 7f75f4392640 1 -- 172.21.15.134:0/786971593 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f75e8024030 con 0x557cc0178dc0 2024-04-24T02:12:24.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.050+0000 7f75f7094800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:24.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.050+0000 7f75f7094800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.050+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557cc017de20 con 0x557cc0178dc0 2024-04-24T02:12:24.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.050+0000 7f75f4392640 1 -- 172.21.15.134:0/786971593 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f75e8024030 con 0x557cc0178dc0 2024-04-24T02:12:24.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.050+0000 7f75f7094800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:24.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.050+0000 7f75f7094800 20 started sync module instance, tier type = 2024-04-24T02:12:24.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.050+0000 7f75f7094800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:24.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.050+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557cc017cec0 con 0x7f75e8058040 2024-04-24T02:12:24.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.051+0000 7f75f5394640 1 -- 172.21.15.134:0/786971593 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75ec01f070 con 0x7f75e8058040 2024-04-24T02:12:24.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.051+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93994287092400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557cc017d6d0 con 0x7f75e8058040 2024-04-24T02:12:24.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.051+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557cc017ec90 con 0x557cc0172ba0 2024-04-24T02:12:24.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.052+0000 7f75f5394640 1 -- 172.21.15.134:0/786971593 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93994287092400] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75ec01f070 con 0x7f75e8058040 2024-04-24T02:12:24.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.052+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75e4075030 con 0x557cc0172ba0 2024-04-24T02:12:24.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.052+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93994287097824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557cc017f0b0 con 0x557cc0172ba0 2024-04-24T02:12:24.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.052+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557cc017fa70 con 0x557cc0178dc0 2024-04-24T02:12:24.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.054+0000 7f75f4392640 1 -- 172.21.15.134:0/786971593 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75e8024030 con 0x557cc0178dc0 2024-04-24T02:12:24.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.054+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93994287101376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557cc01802c0 con 0x557cc0178dc0 2024-04-24T02:12:24.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.054+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557cc0180d20 con 0x7f75e8058040 2024-04-24T02:12:24.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.054+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93994287097824] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75e4075030 con 0x557cc0172ba0 2024-04-24T02:12:24.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.055+0000 7f75f4392640 1 -- 172.21.15.134:0/786971593 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93994287101376] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75e8024030 con 0x557cc0178dc0 2024-04-24T02:12:24.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.055+0000 7f75f5394640 1 -- 172.21.15.134:0/786971593 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75ec01f070 con 0x7f75e8058040 2024-04-24T02:12:24.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.055+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93994287103504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557cc0180800 con 0x7f75e8058040 2024-04-24T02:12:24.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.055+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557cc01815c0 con 0x557cc0172ba0 2024-04-24T02:12:24.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.056+0000 7f75f5394640 1 -- 172.21.15.134:0/786971593 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93994287103504] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75ec01f070 con 0x7f75e8058040 2024-04-24T02:12:24.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.056+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75e4075030 con 0x557cc0172ba0 2024-04-24T02:12:24.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.057+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93994287098880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557cc01815c0 con 0x557cc0172ba0 2024-04-24T02:12:24.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.057+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557cc0182040 con 0x7f75ec031040 2024-04-24T02:12:24.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.058+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93994287098880] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75e4075030 con 0x557cc0172ba0 2024-04-24T02:12:24.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.058+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75e4075030 con 0x7f75ec031040 2024-04-24T02:12:24.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.058+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93994287110992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557cc01815c0 con 0x7f75ec031040 2024-04-24T02:12:24.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.058+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557cc0182a50 con 0x7f75ec031040 2024-04-24T02:12:24.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.059+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93994287110992] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75e4075030 con 0x7f75ec031040 2024-04-24T02:12:24.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.059+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(56 notify.6 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75e4075030 con 0x7f75ec031040 2024-04-24T02:12:24.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.059+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93994287108368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557cc0182c30 con 0x7f75ec031040 2024-04-24T02:12:24.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.059+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557cc0183480 con 0x7f75ec031040 2024-04-24T02:12:24.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.060+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93994287108368] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75e4075030 con 0x7f75ec031040 2024-04-24T02:12:24.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.060+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(58 notify.7 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75e4075030 con 0x7f75ec031040 2024-04-24T02:12:24.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.060+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93994287114384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557cc01832a0 con 0x7f75ec031040 2024-04-24T02:12:24.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.060+0000 7f75f7094800 20 add_watcher() i=0 2024-04-24T02:12:24.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.060+0000 7f75f7094800 20 add_watcher() i=1 2024-04-24T02:12:24.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.060+0000 7f75f7094800 20 add_watcher() i=2 2024-04-24T02:12:24.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.060+0000 7f75f7094800 20 add_watcher() i=3 2024-04-24T02:12:24.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.060+0000 7f75f7094800 20 add_watcher() i=4 2024-04-24T02:12:24.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.060+0000 7f75f7094800 20 add_watcher() i=5 2024-04-24T02:12:24.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.060+0000 7f75f7094800 20 add_watcher() i=6 2024-04-24T02:12:24.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.061+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93994287114384] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75e4075030 con 0x7f75ec031040 2024-04-24T02:12:24.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.061+0000 7f75f7094800 20 add_watcher() i=7 2024-04-24T02:12:24.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.061+0000 7f75f7094800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:24.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.061+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557cc0186810 con 0x557cc0172ba0 2024-04-24T02:12:24.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.061+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f75e4075030 con 0x557cc0172ba0 2024-04-24T02:12:24.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.061+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93994287115568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557cc0183cd0 con 0x557cc0172ba0 2024-04-24T02:12:24.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.062+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93994287115568] v30'86 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f75e4075030 con 0x557cc0172ba0 2024-04-24T02:12:24.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.062+0000 7f74aafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:24.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.062+0000 7f75f7094800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:24.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.062+0000 7f75f7094800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:24.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.062+0000 7f75f7094800 5 note: GC not initialized 2024-04-24T02:12:24.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.062+0000 7f74a9fe3640 20 reqs_thread_entry: start 2024-04-24T02:12:24.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.062+0000 7f75f7094800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:24.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.062+0000 7f75f7094800 20 Filter name: none 2024-04-24T02:12:24.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.062+0000 7f741b7fe640 20 reqs_thread_entry: start 2024-04-24T02:12:24.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.062+0000 7f75f7094800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.063+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557cc01b9750 con 0x557cc0172ba0 2024-04-24T02:12:24.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.063+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f75e4075030 con 0x557cc0172ba0 2024-04-24T02:12:24.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.063+0000 7f75f7094800 20 rados_obj.operate() r=0 bl.length=673 2024-04-24T02:12:24.086 INFO:teuthology.orchestra.run.smithi134.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T02:12:21.778798Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-04-24T02:12:23.936085Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T02:12:21.778786Z","tags":[],"group_ids":[]} 2024-04-24T02:12:24.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.064+0000 7f74aafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:24.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.064+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93994287115568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557cc01b9c90 con 0x557cc0172ba0 2024-04-24T02:12:24.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.065+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93994287115568] v30'87 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f75e4075030 con 0x557cc0172ba0 2024-04-24T02:12:24.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.065+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93994287092400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557cc01b9c90 con 0x7f75e8058040 2024-04-24T02:12:24.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.066+0000 7f75f5394640 1 -- 172.21.15.134:0/786971593 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93994287092400] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75ec01f070 con 0x7f75e8058040 2024-04-24T02:12:24.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.066+0000 7f75f7094800 20 remove_watcher() i=0 2024-04-24T02:12:24.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.066+0000 7f75f7094800 2 removed watcher, disabling cache 2024-04-24T02:12:24.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.066+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93994287097824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557cc017d2b0 con 0x557cc0172ba0 2024-04-24T02:12:24.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.067+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93994287097824] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75e4075030 con 0x557cc0172ba0 2024-04-24T02:12:24.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.067+0000 7f75f7094800 20 remove_watcher() i=1 2024-04-24T02:12:24.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.067+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93994287101376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557cc017d2b0 con 0x557cc0178dc0 2024-04-24T02:12:24.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.068+0000 7f75f4392640 1 -- 172.21.15.134:0/786971593 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93994287101376] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75e8024030 con 0x557cc0178dc0 2024-04-24T02:12:24.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.068+0000 7f75f7094800 20 remove_watcher() i=2 2024-04-24T02:12:24.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.068+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93994287103504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557cc017f5c0 con 0x7f75e8058040 2024-04-24T02:12:24.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.069+0000 7f75f5394640 1 -- 172.21.15.134:0/786971593 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93994287103504] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75ec01f070 con 0x7f75e8058040 2024-04-24T02:12:24.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.069+0000 7f75f7094800 20 remove_watcher() i=3 2024-04-24T02:12:24.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.069+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93994287098880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557cc017fe10 con 0x557cc0172ba0 2024-04-24T02:12:24.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.070+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93994287098880] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75e4075030 con 0x557cc0172ba0 2024-04-24T02:12:24.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.070+0000 7f75f7094800 20 remove_watcher() i=4 2024-04-24T02:12:24.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.070+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93994287110992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557cc017fe10 con 0x7f75ec031040 2024-04-24T02:12:24.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.071+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93994287110992] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75e4075030 con 0x7f75ec031040 2024-04-24T02:12:24.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.071+0000 7f75f7094800 20 remove_watcher() i=5 2024-04-24T02:12:24.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.071+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93994287108368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557cc017ec90 con 0x7f75ec031040 2024-04-24T02:12:24.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.072+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93994287108368] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75e4075030 con 0x7f75ec031040 2024-04-24T02:12:24.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.072+0000 7f75f7094800 20 remove_watcher() i=6 2024-04-24T02:12:24.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.072+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93994287114384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557cc017ec90 con 0x7f75ec031040 2024-04-24T02:12:24.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.072+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93994287114384] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75e4075030 con 0x7f75ec031040 2024-04-24T02:12:24.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.072+0000 7f75f7094800 20 remove_watcher() i=7 2024-04-24T02:12:24.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.073+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f75ec031040 msgr2=0x7f75ec032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.073+0000 7f75f7094800 1 --2- 172.21.15.134:0/786971593 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f75ec031040 0x7f75ec032940 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.073+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x557cc0172ba0 msgr2=0x557cc0175060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.073+0000 7f75f7094800 1 --2- 172.21.15.134:0/786971593 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x557cc0172ba0 0x557cc0175060 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.073+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f75e8058040 msgr2=0x7f75e80457b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.073+0000 7f75f7094800 1 --2- 172.21.15.134:0/786971593 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f75e8058040 0x7f75e80457b0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.073+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x557cc0178dc0 msgr2=0x557cc017b1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.073+0000 7f75f7094800 1 --2- 172.21.15.134:0/786971593 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x557cc0178dc0 0x557cc017b1b0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.073+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f74c0036950 msgr2=0x7f74c0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.073+0000 7f75f7094800 1 --2- 172.21.15.134:0/786971593 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f74c0036950 0x7f74c0038e10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x557cc0142c20 tx=0x7f75ec01f000 comp rx=0 tx=0).stop 2024-04-24T02:12:24.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.073+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557cc015fe40 msgr2=0x557cc01674e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.073+0000 7f75f4b93640 1 -- 172.21.15.134:0/786971593 reap_dead start 2024-04-24T02:12:24.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.073+0000 7f75f7094800 1 --2- 172.21.15.134:0/786971593 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557cc015fe40 0x557cc01674e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f75e800eea0 tx=0x7f75e804bfd0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.073+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 shutdown_connections 2024-04-24T02:12:24.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.073+0000 7f75f7094800 1 --2- 172.21.15.134:0/786971593 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557cc015fe40 0x557cc01674e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.073+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 >> 172.21.15.134:0/786971593 conn(0x557cc015c1a0 msgr2=0x557cc0159800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:24.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.073+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 shutdown_connections 2024-04-24T02:12:24.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.073+0000 7f75f7094800 1 -- 172.21.15.134:0/786971593 wait complete. 2024-04-24T02:12:24.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.073+0000 7f75f7094800 1 -- 172.21.15.134:0/948155267 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f74cc036900 msgr2=0x7f74cc038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.073+0000 7f75f7094800 1 --2- 172.21.15.134:0/948155267 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f74cc036900 0x7f74cc038dc0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x557cc01434a0 tx=0x7f75ec005840 comp rx=0 tx=0).stop 2024-04-24T02:12:24.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.073+0000 7f75f7094800 1 -- 172.21.15.134:0/948155267 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557cc0152b40 msgr2=0x557cc0152f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.073+0000 7f75f7094800 1 --2- 172.21.15.134:0/948155267 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557cc0152b40 0x557cc0152f60 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f75e800e610 tx=0x7f75e800ea10 comp rx=0 tx=0).stop 2024-04-24T02:12:24.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.073+0000 7f75f7094800 1 -- 172.21.15.134:0/948155267 shutdown_connections 2024-04-24T02:12:24.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.073+0000 7f75f7094800 1 --2- 172.21.15.134:0/948155267 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f74cc036900 0x7f74cc038dc0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.073+0000 7f75f7094800 1 --2- 172.21.15.134:0/948155267 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557cc0152b40 0x557cc0152f60 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.073+0000 7f75f7094800 1 -- 172.21.15.134:0/948155267 >> 172.21.15.134:0/948155267 conn(0x557cc0146be0 msgr2=0x557cc0146fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:24.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.073+0000 7f75f7094800 1 -- 172.21.15.134:0/948155267 shutdown_connections 2024-04-24T02:12:24.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.073+0000 7f75f7094800 1 -- 172.21.15.134:0/948155267 wait complete. 2024-04-24T02:12:24.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.074+0000 7f75f7094800 1 -- 172.21.15.134:0/1380672289 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x557cc013f700 msgr2=0x557cc0141af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.074+0000 7f75f7094800 1 --2- 172.21.15.134:0/1380672289 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x557cc013f700 0x557cc0141af0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.074+0000 7f75f7094800 1 -- 172.21.15.134:0/1380672289 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f74dc036950 msgr2=0x7f74dc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.074+0000 7f75f7094800 1 --2- 172.21.15.134:0/1380672289 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f74dc036950 0x7f74dc038e10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f75e800b340 tx=0x7f75e8001520 comp rx=0 tx=0).stop 2024-04-24T02:12:24.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.074+0000 7f75f7094800 1 -- 172.21.15.134:0/1380672289 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557cc0040100 msgr2=0x557cc013a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.074+0000 7f75f7094800 1 --2- 172.21.15.134:0/1380672289 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557cc0040100 0x557cc013a520 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f75e4052540 tx=0x7f75e4003020 comp rx=0 tx=0).stop 2024-04-24T02:12:24.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.074+0000 7f75f7094800 1 -- 172.21.15.134:0/1380672289 shutdown_connections 2024-04-24T02:12:24.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.074+0000 7f75f7094800 1 --2- 172.21.15.134:0/1380672289 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x557cc013f700 0x557cc0141af0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.074+0000 7f75f7094800 1 --2- 172.21.15.134:0/1380672289 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f74dc036950 0x7f74dc038e10 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.074+0000 7f75f7094800 1 --2- 172.21.15.134:0/1380672289 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557cc0040100 0x557cc013a520 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.074+0000 7f75f7094800 1 -- 172.21.15.134:0/1380672289 >> 172.21.15.134:0/1380672289 conn(0x557cc003a530 msgr2=0x557cbffb3800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:24.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.074+0000 7f75f7094800 1 -- 172.21.15.134:0/1380672289 shutdown_connections 2024-04-24T02:12:24.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.074+0000 7f75f7094800 1 -- 172.21.15.134:0/1380672289 wait complete. 2024-04-24T02:12:24.098 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T02:12:21.778798Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-04-24T02:12:23.936085Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:12:21.778786Z', 'tags': [], 'group_ids': []} 2024-04-24T02:12:24.099 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-04-24T02:12:24.099 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-04-24T02:12:24.099 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-04-24T02:12:24.178 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:24.178 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:24.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.177+0000 7f4cd280f800 1 Processor -- start 2024-04-24T02:12:24.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.177+0000 7f4cd280f800 1 -- start start 2024-04-24T02:12:24.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.177+0000 7f4cd280f800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55d2a81894c0 0x55d2a818b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.177+0000 7f4cd280f800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d2a8043d40 con 0x55d2a81859b0 2024-04-24T02:12:24.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.177+0000 7f4cd280f800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55d2a80164d0 con 0x55d2a81894c0 2024-04-24T02:12:24.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.178+0000 7f4ccd746640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55d2a81894c0 0x55d2a818b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.178+0000 7f4ccd746640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55d2a81894c0 0x55d2a818b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46432/0 (socket says 172.21.15.134:46432) 2024-04-24T02:12:24.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.178+0000 7f4ccd746640 1 -- 172.21.15.134:0/1675011252 learned_addr learned my addr 172.21.15.134:0/1675011252 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:24.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.178+0000 7f4ccdf47640 1 --1- 172.21.15.134:0/1675011252 >> v1:172.21.15.104:6789/0 conn(0x55d2a81859b0 0x55d2a8187da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:43350/0 (socket says 172.21.15.134:43350) 2024-04-24T02:12:24.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.178+0000 7f4ccd746640 1 -- 172.21.15.134:0/1675011252 >> v1:172.21.15.104:6789/0 conn(0x55d2a81859b0 legacy=0x55d2a8187da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.178+0000 7f4cccf45640 1 -- 172.21.15.134:0/1675011252 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 482523835 0 0) 0x55d2a8043d40 con 0x55d2a81859b0 2024-04-24T02:12:24.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.178+0000 7f4ccd746640 1 -- 172.21.15.134:0/1675011252 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2a8042590 con 0x55d2a81894c0 2024-04-24T02:12:24.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.180+0000 7f4ccd746640 1 --2- 172.21.15.134:0/1675011252 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d2a81894c0 0x55d2a818b8b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4cc400a520 tx=0x7f4cc401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=647c4b53267aee4f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.180+0000 7f4cccf45640 1 -- 172.21.15.134:0/1675011252 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cc4057070 con 0x55d2a81894c0 2024-04-24T02:12:24.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.180+0000 7f4cccf45640 1 -- 172.21.15.134:0/1675011252 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cc4052570 con 0x55d2a81894c0 2024-04-24T02:12:24.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.180+0000 7f4cccf45640 1 -- 172.21.15.134:0/1675011252 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cc404ae60 con 0x55d2a81894c0 2024-04-24T02:12:24.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.181+0000 7f4cd280f800 1 -- 172.21.15.134:0/1675011252 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d2a81894c0 msgr2=0x55d2a818b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.181+0000 7f4cd280f800 1 --2- 172.21.15.134:0/1675011252 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d2a81894c0 0x55d2a818b8b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4cc400a520 tx=0x7f4cc401d010 comp rx=0 tx=0).stop 2024-04-24T02:12:24.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.181+0000 7f4cd280f800 1 -- 172.21.15.134:0/1675011252 shutdown_connections 2024-04-24T02:12:24.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.181+0000 7f4cd280f800 1 --2- 172.21.15.134:0/1675011252 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d2a81894c0 0x55d2a818b8b0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.181+0000 7f4cd280f800 1 -- 172.21.15.134:0/1675011252 >> 172.21.15.134:0/1675011252 conn(0x55d2a817f340 msgr2=0x55d2a8181760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:24.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.181+0000 7f4cd280f800 1 -- 172.21.15.134:0/1675011252 shutdown_connections 2024-04-24T02:12:24.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.181+0000 7f4cd280f800 1 -- 172.21.15.134:0/1675011252 wait complete. 2024-04-24T02:12:24.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.192+0000 7f4cd280f800 1 Processor -- start 2024-04-24T02:12:24.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.192+0000 7f4cd280f800 1 -- start start 2024-04-24T02:12:24.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.192+0000 7f4cd280f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d2a81859b0 0x55d2a8275eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.192+0000 7f4cd280f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d2a80d03b0 con 0x55d2a81859b0 2024-04-24T02:12:24.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.193+0000 7f4ccdf47640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d2a81859b0 0x55d2a8275eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.193+0000 7f4ccdf47640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d2a81859b0 0x55d2a8275eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46434/0 (socket says 172.21.15.134:46434) 2024-04-24T02:12:24.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.193+0000 7f4ccdf47640 1 -- 172.21.15.134:0/411700049 learned_addr learned my addr 172.21.15.134:0/411700049 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:24.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.193+0000 7f4ccdf47640 1 -- 172.21.15.134:0/411700049 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2a8276480 con 0x55d2a81859b0 2024-04-24T02:12:24.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.193+0000 7f4ccdf47640 1 --2- 172.21.15.134:0/411700049 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d2a81859b0 0x55d2a8275eb0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4cc000b210 tx=0x7f4cc000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a7c6800d12ef01c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.193+0000 7f4bbbe07640 1 -- 172.21.15.134:0/411700049 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cc0008070 con 0x55d2a81859b0 2024-04-24T02:12:24.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.193+0000 7f4bbbe07640 1 -- 172.21.15.134:0/411700049 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cc000d500 con 0x55d2a81859b0 2024-04-24T02:12:24.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.193+0000 7f4bbbe07640 1 -- 172.21.15.134:0/411700049 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cc000d840 con 0x55d2a81859b0 2024-04-24T02:12:24.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.194+0000 7f4cd280f800 1 -- 172.21.15.134:0/411700049 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d2a81859b0 msgr2=0x55d2a8275eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.194+0000 7f4cd280f800 1 --2- 172.21.15.134:0/411700049 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d2a81859b0 0x55d2a8275eb0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4cc000b210 tx=0x7f4cc000b6d0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.194+0000 7f4cd280f800 1 -- 172.21.15.134:0/411700049 shutdown_connections 2024-04-24T02:12:24.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.194+0000 7f4cd280f800 1 --2- 172.21.15.134:0/411700049 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d2a81859b0 0x55d2a8275eb0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.194+0000 7f4cd280f800 1 -- 172.21.15.134:0/411700049 >> 172.21.15.134:0/411700049 conn(0x55d2a817f340 msgr2=0x55d2a82717d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:24.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.194+0000 7f4cd280f800 1 -- 172.21.15.134:0/411700049 shutdown_connections 2024-04-24T02:12:24.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.194+0000 7f4cd280f800 1 -- 172.21.15.134:0/411700049 wait complete. 2024-04-24T02:12:24.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.194+0000 7f4cd280f800 1 Processor -- start 2024-04-24T02:12:24.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.194+0000 7f4cd280f800 1 -- start start 2024-04-24T02:12:24.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.194+0000 7f4cd280f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d2a81859b0 0x55d2a81852a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.195+0000 7f4cd280f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d2a818e100 con 0x55d2a81859b0 2024-04-24T02:12:24.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.195+0000 7f4ccdf47640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d2a81859b0 0x55d2a81852a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.195+0000 7f4ccdf47640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d2a81859b0 0x55d2a81852a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46446/0 (socket says 172.21.15.134:46446) 2024-04-24T02:12:24.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.195+0000 7f4ccdf47640 1 -- 172.21.15.134:0/1371649424 learned_addr learned my addr 172.21.15.134:0/1371649424 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:24.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.195+0000 7f4ccdf47640 1 -- 172.21.15.134:0/1371649424 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2a81857e0 con 0x55d2a81859b0 2024-04-24T02:12:24.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.195+0000 7f4ccdf47640 1 --2- 172.21.15.134:0/1371649424 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d2a81859b0 0x55d2a81852a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4cc000b210 tx=0x7f4cc0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.195+0000 7f4bba604640 1 -- 172.21.15.134:0/1371649424 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cc000f950 con 0x55d2a81859b0 2024-04-24T02:12:24.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.195+0000 7f4bba604640 1 -- 172.21.15.134:0/1371649424 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cc000faf0 con 0x55d2a81859b0 2024-04-24T02:12:24.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.195+0000 7f4cd280f800 1 -- 172.21.15.134:0/1371649424 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d2a81839e0 con 0x55d2a81859b0 2024-04-24T02:12:24.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.195+0000 7f4bba604640 1 -- 172.21.15.134:0/1371649424 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cc000fdd0 con 0x55d2a81859b0 2024-04-24T02:12:24.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.195+0000 7f4cd280f800 1 -- 172.21.15.134:0/1371649424 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2a8183f00 con 0x55d2a81859b0 2024-04-24T02:12:24.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.196+0000 7f4bba604640 1 -- 172.21.15.134:0/1371649424 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4cc0017040 con 0x55d2a81859b0 2024-04-24T02:12:24.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.196+0000 7f4bba604640 1 --2- 172.21.15.134:0/1371649424 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4bb40368b0 0x7f4bb4038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.196+0000 7f4bba604640 1 -- 172.21.15.134:0/1371649424 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f4cc0015020 con 0x55d2a81859b0 2024-04-24T02:12:24.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.196+0000 7f4ccd746640 1 --2- 172.21.15.134:0/1371649424 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4bb40368b0 0x7f4bb4038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.196+0000 7f4cd280f800 1 --2- 172.21.15.134:0/1371649424 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d2a81894c0 0x55d2a8286f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.196+0000 7f4cd280f800 1 -- 172.21.15.134:0/1371649424 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82874b0 con 0x55d2a81894c0 2024-04-24T02:12:24.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.196+0000 7f4cce748640 1 --2- 172.21.15.134:0/1371649424 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d2a81894c0 0x55d2a8286f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.197+0000 7f4ccd746640 1 --2- 172.21.15.134:0/1371649424 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4bb40368b0 0x7f4bb4038d70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4054000 tx=0x7f4cc404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.197+0000 7f4cce748640 1 --2- 172.21.15.134:0/1371649424 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d2a81894c0 0x55d2a8286f30 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.197+0000 7f4cce748640 1 -- 172.21.15.134:0/1371649424 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4cc800a4a0 con 0x55d2a81894c0 2024-04-24T02:12:24.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.197+0000 7f4cd280f800 1 -- 172.21.15.134:0/1371649424 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d2a8184400 con 0x55d2a81894c0 2024-04-24T02:12:24.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.197+0000 7f4cce748640 1 -- 172.21.15.134:0/1371649424 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4cc800a4a0 con 0x55d2a81894c0 2024-04-24T02:12:24.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.197+0000 7f4cd280f800 1 -- 172.21.15.134:0/1371649424 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82892d0 con 0x55d2a81894c0 2024-04-24T02:12:24.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.198+0000 7f4cce748640 1 -- 172.21.15.134:0/1371649424 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4cc800a4a0 con 0x55d2a81894c0 2024-04-24T02:12:24.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.198+0000 7f4cd280f800 1 -- 172.21.15.134:0/1371649424 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d2a8288610 con 0x55d2a81894c0 2024-04-24T02:12:24.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.198+0000 7f4cce748640 1 -- 172.21.15.134:0/1371649424 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4cc800a4a0 con 0x55d2a81894c0 2024-04-24T02:12:24.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.198+0000 7f4cd280f800 1 -- 172.21.15.134:0/1371649424 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d2a8288a60 con 0x55d2a81894c0 2024-04-24T02:12:24.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.198+0000 7f4cce748640 1 -- 172.21.15.134:0/1371649424 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4cc800a4a0 con 0x55d2a81894c0 2024-04-24T02:12:24.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.199+0000 7f4cd280f800 1 Processor -- start 2024-04-24T02:12:24.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.199+0000 7f4cd280f800 1 -- start start 2024-04-24T02:12:24.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.199+0000 7f4cd280f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d2a8298040 0x55d2a8298460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.199+0000 7f4cd280f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d2a80766b0 con 0x55d2a8298040 2024-04-24T02:12:24.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.199+0000 7f4ccd746640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d2a8298040 0x55d2a8298460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.199+0000 7f4ccd746640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d2a8298040 0x55d2a8298460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46456/0 (socket says 172.21.15.134:46456) 2024-04-24T02:12:24.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.199+0000 7f4ccd746640 1 -- 172.21.15.134:0/915944319 learned_addr learned my addr 172.21.15.134:0/915944319 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:24.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.199+0000 7f4ccd746640 1 -- 172.21.15.134:0/915944319 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2a82989a0 con 0x55d2a8298040 2024-04-24T02:12:24.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.200+0000 7f4ccd746640 1 --2- 172.21.15.134:0/915944319 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d2a8298040 0x55d2a8298460 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4055040 tx=0x7f4cc4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.200+0000 7f4bb37fe640 1 -- 172.21.15.134:0/915944319 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cc4057040 con 0x55d2a8298040 2024-04-24T02:12:24.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.200+0000 7f4bb37fe640 1 -- 172.21.15.134:0/915944319 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cc406d070 con 0x55d2a8298040 2024-04-24T02:12:24.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.200+0000 7f4bb37fe640 1 -- 172.21.15.134:0/915944319 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cc405d650 con 0x55d2a8298040 2024-04-24T02:12:24.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.200+0000 7f4cd280f800 1 -- 172.21.15.134:0/915944319 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d2a8299410 con 0x55d2a8298040 2024-04-24T02:12:24.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.200+0000 7f4cd280f800 1 -- 172.21.15.134:0/915944319 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2a82998b0 con 0x55d2a8298040 2024-04-24T02:12:24.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.200+0000 7f4bb37fe640 1 -- 172.21.15.134:0/915944319 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4cc4067070 con 0x55d2a8298040 2024-04-24T02:12:24.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.201+0000 7f4bb37fe640 1 --2- 172.21.15.134:0/915944319 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4ba8036950 0x7f4ba8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.201+0000 7f4bb37fe640 1 -- 172.21.15.134:0/915944319 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f4cc408f550 con 0x55d2a8298040 2024-04-24T02:12:24.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.201+0000 7f4cce748640 1 --2- 172.21.15.134:0/915944319 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4ba8036950 0x7f4ba8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.201+0000 7f4cd280f800 1 Processor -- start 2024-04-24T02:12:24.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.201+0000 7f4cce748640 1 --2- 172.21.15.134:0/915944319 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4ba8036950 0x7f4ba8038e10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x55d2a8288130 tx=0x7f4cc8005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.201+0000 7f4cd280f800 1 -- start start 2024-04-24T02:12:24.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.201+0000 7f4cd280f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d2a82a52c0 0x55d2a82a56e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.201+0000 7f4cd280f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d2a8276800 con 0x55d2a82a52c0 2024-04-24T02:12:24.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.201+0000 7f4ccd746640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d2a82a52c0 0x55d2a82a56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.201+0000 7f4ccd746640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d2a82a52c0 0x55d2a82a56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46468/0 (socket says 172.21.15.134:46468) 2024-04-24T02:12:24.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.201+0000 7f4ccd746640 1 -- 172.21.15.134:0/1058019430 learned_addr learned my addr 172.21.15.134:0/1058019430 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:24.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.202+0000 7f4ccd746640 1 -- 172.21.15.134:0/1058019430 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2a82a5cb0 con 0x55d2a82a52c0 2024-04-24T02:12:24.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.202+0000 7f4ccd746640 1 --2- 172.21.15.134:0/1058019430 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d2a82a52c0 0x55d2a82a56e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4cc408da70 tx=0x7f4cc408f420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc793e0a05cee200 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.202+0000 7f4bb17fa640 1 -- 172.21.15.134:0/1058019430 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cc407f030 con 0x55d2a82a52c0 2024-04-24T02:12:24.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.202+0000 7f4bb17fa640 1 -- 172.21.15.134:0/1058019430 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cc405cc70 con 0x55d2a82a52c0 2024-04-24T02:12:24.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.202+0000 7f4bb17fa640 1 -- 172.21.15.134:0/1058019430 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cc4072910 con 0x55d2a82a52c0 2024-04-24T02:12:24.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.202+0000 7f4cd280f800 1 -- 172.21.15.134:0/1058019430 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d2a82a52c0 msgr2=0x55d2a82a56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.202+0000 7f4cd280f800 1 --2- 172.21.15.134:0/1058019430 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d2a82a52c0 0x55d2a82a56e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4cc408da70 tx=0x7f4cc408f420 comp rx=0 tx=0).stop 2024-04-24T02:12:24.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.202+0000 7f4cd280f800 1 -- 172.21.15.134:0/1058019430 shutdown_connections 2024-04-24T02:12:24.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.202+0000 7f4cd280f800 1 --2- 172.21.15.134:0/1058019430 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d2a82a52c0 0x55d2a82a56e0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.202+0000 7f4cd280f800 1 -- 172.21.15.134:0/1058019430 >> 172.21.15.134:0/1058019430 conn(0x55d2a82a1620 msgr2=0x55d2a829f680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:24.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.202+0000 7f4cd280f800 1 -- 172.21.15.134:0/1058019430 shutdown_connections 2024-04-24T02:12:24.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.202+0000 7f4cd280f800 1 -- 172.21.15.134:0/1058019430 wait complete. 2024-04-24T02:12:24.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.203+0000 7f4cd280f800 1 Processor -- start 2024-04-24T02:12:24.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.203+0000 7f4cd280f800 1 -- start start 2024-04-24T02:12:24.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.203+0000 7f4cd280f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d2a82a52c0 0x55d2a82ac960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.203+0000 7f4cd280f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d2a82a6420 con 0x55d2a82a52c0 2024-04-24T02:12:24.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.203+0000 7f4ccd746640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d2a82a52c0 0x55d2a82ac960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.203+0000 7f4ccd746640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d2a82a52c0 0x55d2a82ac960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46476/0 (socket says 172.21.15.134:46476) 2024-04-24T02:12:24.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.203+0000 7f4ccd746640 1 -- 172.21.15.134:0/3683537670 learned_addr learned my addr 172.21.15.134:0/3683537670 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:24.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.203+0000 7f4ccd746640 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2a82acea0 con 0x55d2a82a52c0 2024-04-24T02:12:24.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.204+0000 7f4ccd746640 1 --2- 172.21.15.134:0/3683537670 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d2a82a52c0 0x55d2a82ac960 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4067b80 tx=0x7f4cc408da00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.204+0000 7f4b9f7fe640 1 -- 172.21.15.134:0/3683537670 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cc4093070 con 0x55d2a82a52c0 2024-04-24T02:12:24.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.204+0000 7f4b9f7fe640 1 -- 172.21.15.134:0/3683537670 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cc4069030 con 0x55d2a82a52c0 2024-04-24T02:12:24.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.204+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d2a82ad130 con 0x55d2a82a52c0 2024-04-24T02:12:24.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.204+0000 7f4b9f7fe640 1 -- 172.21.15.134:0/3683537670 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cc407f040 con 0x55d2a82a52c0 2024-04-24T02:12:24.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.204+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2a82afde0 con 0x55d2a82a52c0 2024-04-24T02:12:24.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.204+0000 7f4b9f7fe640 1 -- 172.21.15.134:0/3683537670 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4cc4096070 con 0x55d2a82a52c0 2024-04-24T02:12:24.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.205+0000 7f4b9f7fe640 1 --2- 172.21.15.134:0/3683537670 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4b98036950 0x7f4b98038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.205+0000 7f4b9f7fe640 1 -- 172.21.15.134:0/3683537670 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f4cc4080070 con 0x55d2a82a52c0 2024-04-24T02:12:24.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.205+0000 7f4cce748640 1 --2- 172.21.15.134:0/3683537670 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4b98036950 0x7f4b98038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.205+0000 7f4cce748640 1 --2- 172.21.15.134:0/3683537670 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4b98036950 0x7f4b98038e10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x55d2a8184a50 tx=0x7f4cc801f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.205+0000 7f4cd280f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.205+0000 7f4cd280f800 1 --2- 172.21.15.134:0/3683537670 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d2a82b8440 0x55d2a82ba900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.205+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82bb050 con 0x55d2a82b8440 2024-04-24T02:12:24.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.205+0000 7f4ccdf47640 1 --2- 172.21.15.134:0/3683537670 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d2a82b8440 0x55d2a82ba900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.206+0000 7f4ccdf47640 1 --2- 172.21.15.134:0/3683537670 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d2a82b8440 0x55d2a82ba900 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.206+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4cc002d070 con 0x55d2a82b8440 2024-04-24T02:12:24.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.206+0000 7f4cd280f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:24.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.206+0000 7f4cd280f800 20 realm 2024-04-24T02:12:24.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.206+0000 7f4cd280f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.206+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82bb460 con 0x55d2a82b8440 2024-04-24T02:12:24.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.206+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4cc002d070 con 0x55d2a82b8440 2024-04-24T02:12:24.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.206+0000 7f4cd280f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:24.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.206+0000 7f4cd280f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:24.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.206+0000 7f4cd280f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.206+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82bbd30 con 0x55d2a82b8440 2024-04-24T02:12:24.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.206+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4cc002d070 con 0x55d2a82b8440 2024-04-24T02:12:24.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.206+0000 7f4cd280f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:24.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.206+0000 7f4cd280f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.206+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82bc0d0 con 0x55d2a82b8440 2024-04-24T02:12:24.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.206+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4cc002d070 con 0x55d2a82b8440 2024-04-24T02:12:24.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.206+0000 7f4cd280f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:24.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.207+0000 7f4cd280f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.207+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82bc920 con 0x55d2a82b8440 2024-04-24T02:12:24.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.207+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4cc002d070 con 0x55d2a82b8440 2024-04-24T02:12:24.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.207+0000 7f4cd280f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:24.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.207+0000 7f4cd280f800 20 searching for the correct realm 2024-04-24T02:12:24.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.207+0000 7f4cd280f800 1 --2- 172.21.15.134:0/3683537670 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55d2a82be690 0x55d2a82c0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.207+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c1040 con 0x55d2a82be690 2024-04-24T02:12:24.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.207+0000 7f4ccd746640 1 --2- 172.21.15.134:0/3683537670 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55d2a82be690 0x55d2a82c0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.207+0000 7f4ccd746640 1 --2- 172.21.15.134:0/3683537670 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55d2a82be690 0x55d2a82c0a80 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.208+0000 7f4ccd746640 1 -- 172.21.15.134:0/3683537670 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cc409f070 con 0x55d2a82be690 2024-04-24T02:12:24.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.208+0000 7f4ccd746640 1 --2- 172.21.15.134:0/3683537670 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f4cc4098070 0x7f4cc40065b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.208+0000 7f4ccd746640 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c1040 con 0x7f4cc4098070 2024-04-24T02:12:24.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.208+0000 7f4cce748640 1 --2- 172.21.15.134:0/3683537670 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f4cc4098070 0x7f4cc40065b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.208+0000 7f4cce748640 1 --2- 172.21.15.134:0/3683537670 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f4cc4098070 0x7f4cc40065b0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.208+0000 7f4cce748640 1 -- 172.21.15.134:0/3683537670 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cc801f070 con 0x7f4cc4098070 2024-04-24T02:12:24.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.208+0000 7f4cce748640 1 --2- 172.21.15.134:0/3683537670 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f4cc8031040 0x7f4cc8032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.208+0000 7f4cce748640 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c1040 con 0x7f4cc8031040 2024-04-24T02:12:24.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.208+0000 7f4ccdf47640 1 --2- 172.21.15.134:0/3683537670 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f4cc8031040 0x7f4cc8032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.209+0000 7f4ccdf47640 1 --2- 172.21.15.134:0/3683537670 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f4cc8031040 0x7f4cc8032940 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.209+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cc002d070 con 0x7f4cc8031040 2024-04-24T02:12:24.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.209+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c1040 con 0x55d2a82b8440 2024-04-24T02:12:24.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.209+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cc002d070 con 0x55d2a82b8440 2024-04-24T02:12:24.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.209+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c1040 con 0x55d2a82b8440 2024-04-24T02:12:24.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.210+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4cc002d070 con 0x55d2a82b8440 2024-04-24T02:12:24.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.210+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c1040 con 0x7f4cc8031040 2024-04-24T02:12:24.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.210+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cc002d070 con 0x7f4cc8031040 2024-04-24T02:12:24.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.210+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c1040 con 0x7f4cc8031040 2024-04-24T02:12:24.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.210+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cc002d070 con 0x7f4cc8031040 2024-04-24T02:12:24.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.210+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c1040 con 0x7f4cc4098070 2024-04-24T02:12:24.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.210+0000 7f4cce748640 1 -- 172.21.15.134:0/3683537670 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cc801f070 con 0x7f4cc4098070 2024-04-24T02:12:24.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.210+0000 7f4cce748640 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c1040 con 0x55d2a82be690 2024-04-24T02:12:24.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.211+0000 7f4ccd746640 1 -- 172.21.15.134:0/3683537670 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cc409f070 con 0x55d2a82be690 2024-04-24T02:12:24.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.211+0000 7f4ccd746640 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c1040 con 0x55d2a82b8440 2024-04-24T02:12:24.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.211+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cc002d070 con 0x55d2a82b8440 2024-04-24T02:12:24.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.211+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c1040 con 0x7f4cc8031040 2024-04-24T02:12:24.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.211+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cc002d070 con 0x7f4cc8031040 2024-04-24T02:12:24.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.211+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c1040 con 0x55d2a82b8440 2024-04-24T02:12:24.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.211+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cc002d070 con 0x55d2a82b8440 2024-04-24T02:12:24.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.211+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c1040 con 0x7f4cc4098070 2024-04-24T02:12:24.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.211+0000 7f4cce748640 1 -- 172.21.15.134:0/3683537670 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4cc801f070 con 0x7f4cc4098070 2024-04-24T02:12:24.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.211+0000 7f4cce748640 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c1040 con 0x55d2a82be690 2024-04-24T02:12:24.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.212+0000 7f4ccd746640 1 -- 172.21.15.134:0/3683537670 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cc409f070 con 0x55d2a82be690 2024-04-24T02:12:24.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.212+0000 7f4ccd746640 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c1040 con 0x55d2a82be690 2024-04-24T02:12:24.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.212+0000 7f4ccd746640 1 -- 172.21.15.134:0/3683537670 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cc409f070 con 0x55d2a82be690 2024-04-24T02:12:24.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.212+0000 7f4ccd746640 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c1040 con 0x7f4cc8031040 2024-04-24T02:12:24.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.212+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cc002d070 con 0x7f4cc8031040 2024-04-24T02:12:24.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.212+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c1040 con 0x55d2a82be690 2024-04-24T02:12:24.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.212+0000 7f4ccd746640 1 -- 172.21.15.134:0/3683537670 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cc409f070 con 0x55d2a82be690 2024-04-24T02:12:24.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.212+0000 7f4ccd746640 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c1040 con 0x55d2a82be690 2024-04-24T02:12:24.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.213+0000 7f4ccd746640 1 -- 172.21.15.134:0/3683537670 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cc409f070 con 0x55d2a82be690 2024-04-24T02:12:24.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.213+0000 7f4ccd746640 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c1040 con 0x55d2a82b8440 2024-04-24T02:12:24.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.213+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cc002d070 con 0x55d2a82b8440 2024-04-24T02:12:24.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.213+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c1040 con 0x55d2a82b8440 2024-04-24T02:12:24.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.213+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f4cc002d070 con 0x55d2a82b8440 2024-04-24T02:12:24.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.213+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c1040 con 0x7f4cc8031040 2024-04-24T02:12:24.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.214+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cc002d070 con 0x7f4cc8031040 2024-04-24T02:12:24.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.214+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c1040 con 0x55d2a82be690 2024-04-24T02:12:24.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.214+0000 7f4ccd746640 1 -- 172.21.15.134:0/3683537670 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cc409f070 con 0x55d2a82be690 2024-04-24T02:12:24.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.214+0000 7f4ccd746640 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c1040 con 0x7f4cc4098070 2024-04-24T02:12:24.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.214+0000 7f4cce748640 1 -- 172.21.15.134:0/3683537670 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cc801f070 con 0x7f4cc4098070 2024-04-24T02:12:24.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.214+0000 7f4cce748640 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c1040 con 0x55d2a82b8440 2024-04-24T02:12:24.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.214+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cc002d070 con 0x55d2a82b8440 2024-04-24T02:12:24.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.214+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c1040 con 0x7f4cc8031040 2024-04-24T02:12:24.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.215+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cc002d070 con 0x7f4cc8031040 2024-04-24T02:12:24.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.215+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c1040 con 0x55d2a82be690 2024-04-24T02:12:24.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.215+0000 7f4ccd746640 1 -- 172.21.15.134:0/3683537670 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cc409f070 con 0x55d2a82be690 2024-04-24T02:12:24.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.215+0000 7f4ccd746640 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c1040 con 0x7f4cc8031040 2024-04-24T02:12:24.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.215+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cc002d070 con 0x7f4cc8031040 2024-04-24T02:12:24.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.215+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c1040 con 0x7f4cc4098070 2024-04-24T02:12:24.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.215+0000 7f4cce748640 1 -- 172.21.15.134:0/3683537670 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cc801f070 con 0x7f4cc4098070 2024-04-24T02:12:24.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.215+0000 7f4cce748640 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c1040 con 0x55d2a82be690 2024-04-24T02:12:24.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.215+0000 7f4ccd746640 1 -- 172.21.15.134:0/3683537670 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cc409f070 con 0x55d2a82be690 2024-04-24T02:12:24.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.215+0000 7f4ccd746640 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c1040 con 0x7f4cc8031040 2024-04-24T02:12:24.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.216+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cc002d070 con 0x7f4cc8031040 2024-04-24T02:12:24.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.216+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c1040 con 0x55d2a82b8440 2024-04-24T02:12:24.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.216+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4cc002d070 con 0x55d2a82b8440 2024-04-24T02:12:24.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.216+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c1040 con 0x7f4cc4098070 2024-04-24T02:12:24.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.216+0000 7f4cce748640 1 -- 172.21.15.134:0/3683537670 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cc801f070 con 0x7f4cc4098070 2024-04-24T02:12:24.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.216+0000 7f4cd280f800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:24.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.216+0000 7f4cd280f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:24.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.216+0000 7f4cd280f800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:24.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.216+0000 7f4cd280f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:24.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.216+0000 7f4cd280f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:24.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.216+0000 7f4cd280f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:24.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.216+0000 7f4cd280f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.216+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82bd2d0 con 0x55d2a82b8440 2024-04-24T02:12:24.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.217+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4cc002d070 con 0x55d2a82b8440 2024-04-24T02:12:24.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.217+0000 7f4cd280f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:24.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.217+0000 7f4cd280f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.217+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82bdb70 con 0x55d2a82b8440 2024-04-24T02:12:24.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.217+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4cc002d070 con 0x55d2a82b8440 2024-04-24T02:12:24.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.217+0000 7f4cd280f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:24.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.217+0000 7f4cd280f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.217+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c14c0 con 0x55d2a82b8440 2024-04-24T02:12:24.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.217+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4cc002d070 con 0x55d2a82b8440 2024-04-24T02:12:24.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.217+0000 7f4cd280f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:24.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.217+0000 7f4cd280f800 20 zone default found 2024-04-24T02:12:24.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.217+0000 7f4cd280f800 4 Realm: () 2024-04-24T02:12:24.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.217+0000 7f4cd280f800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:24.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.217+0000 7f4cd280f800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:24.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.217+0000 7f4cd280f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:24.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.217+0000 7f4cd280f800 20 zonegroup default 2024-04-24T02:12:24.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.217+0000 7f4cd280f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.217+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c1970 con 0x7f4cc8031040 2024-04-24T02:12:24.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.218+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4cc002d070 con 0x7f4cc8031040 2024-04-24T02:12:24.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.218+0000 7f4cd280f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:24.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.218+0000 7f4cd280f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.218+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c3350 con 0x55d2a82be690 2024-04-24T02:12:24.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.218+0000 7f4ccd746640 1 -- 172.21.15.134:0/3683537670 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4cc409f070 con 0x55d2a82be690 2024-04-24T02:12:24.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.218+0000 7f4cd280f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:24.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.218+0000 7f4cd280f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.218+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c3790 con 0x55d2a82be690 2024-04-24T02:12:24.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.218+0000 7f4ccd746640 1 -- 172.21.15.134:0/3683537670 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4cc409f070 con 0x55d2a82be690 2024-04-24T02:12:24.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.218+0000 7f4cd280f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:24.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.218+0000 7f4cd280f800 20 started sync module instance, tier type = 2024-04-24T02:12:24.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.218+0000 7f4cd280f800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:24.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.218+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c27e0 con 0x7f4cc4098070 2024-04-24T02:12:24.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.219+0000 7f4cce748640 1 -- 172.21.15.134:0/3683537670 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cc8040040 con 0x7f4cc4098070 2024-04-24T02:12:24.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.219+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94363252960208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c40a0 con 0x7f4cc4098070 2024-04-24T02:12:24.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.219+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c48f0 con 0x55d2a82b8440 2024-04-24T02:12:24.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.220+0000 7f4cce748640 1 -- 172.21.15.134:0/3683537670 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94363252960208] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cc8040040 con 0x7f4cc4098070 2024-04-24T02:12:24.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.220+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cc002d070 con 0x55d2a82b8440 2024-04-24T02:12:24.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.220+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94363252964336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c45a0 con 0x55d2a82b8440 2024-04-24T02:12:24.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.220+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c50c0 con 0x55d2a82be690 2024-04-24T02:12:24.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.221+0000 7f4ccd746640 1 -- 172.21.15.134:0/3683537670 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cc409f070 con 0x55d2a82be690 2024-04-24T02:12:24.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.222+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94363252968336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c5960 con 0x55d2a82be690 2024-04-24T02:12:24.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.222+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c6410 con 0x7f4cc4098070 2024-04-24T02:12:24.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.222+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94363252964336] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cc002d070 con 0x55d2a82b8440 2024-04-24T02:12:24.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.223+0000 7f4ccd746640 1 -- 172.21.15.134:0/3683537670 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94363252968336] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cc409f070 con 0x55d2a82be690 2024-04-24T02:12:24.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.223+0000 7f4cce748640 1 -- 172.21.15.134:0/3683537670 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cc8040040 con 0x7f4cc4098070 2024-04-24T02:12:24.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.223+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94363252970672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c4010 con 0x7f4cc4098070 2024-04-24T02:12:24.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.223+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c6cb0 con 0x55d2a82b8440 2024-04-24T02:12:24.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.224+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cc002d070 con 0x55d2a82b8440 2024-04-24T02:12:24.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.224+0000 7f4cce748640 1 -- 172.21.15.134:0/3683537670 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94363252970672] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cc8040040 con 0x7f4cc4098070 2024-04-24T02:12:24.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.224+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94363252973296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c6cb0 con 0x55d2a82b8440 2024-04-24T02:12:24.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.224+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c7700 con 0x7f4cc8031040 2024-04-24T02:12:24.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.225+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cc002d070 con 0x7f4cc8031040 2024-04-24T02:12:24.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.225+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94363252978192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c7630 con 0x7f4cc8031040 2024-04-24T02:12:24.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.225+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c8630 con 0x7f4cc8031040 2024-04-24T02:12:24.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.225+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94363252973296] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cc002d070 con 0x55d2a82b8440 2024-04-24T02:12:24.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.226+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94363252978192] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cc002d070 con 0x7f4cc8031040 2024-04-24T02:12:24.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.226+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(56 notify.6 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cc002d070 con 0x7f4cc8031040 2024-04-24T02:12:24.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.226+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94363252975616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c8140 con 0x7f4cc8031040 2024-04-24T02:12:24.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.226+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c8b00 con 0x7f4cc8031040 2024-04-24T02:12:24.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.227+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94363252975616] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cc002d070 con 0x7f4cc8031040 2024-04-24T02:12:24.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.227+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(58 notify.7 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cc002d070 con 0x7f4cc8031040 2024-04-24T02:12:24.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.227+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94363252980384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c8b00 con 0x7f4cc8031040 2024-04-24T02:12:24.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.227+0000 7f4cd280f800 20 add_watcher() i=0 2024-04-24T02:12:24.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.227+0000 7f4cd280f800 20 add_watcher() i=1 2024-04-24T02:12:24.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.227+0000 7f4cd280f800 20 add_watcher() i=2 2024-04-24T02:12:24.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.227+0000 7f4cd280f800 20 add_watcher() i=3 2024-04-24T02:12:24.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.227+0000 7f4cd280f800 20 add_watcher() i=4 2024-04-24T02:12:24.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.227+0000 7f4cd280f800 20 add_watcher() i=5 2024-04-24T02:12:24.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.227+0000 7f4cd280f800 20 add_watcher() i=6 2024-04-24T02:12:24.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.228+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94363252980384] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cc002d070 con 0x7f4cc8031040 2024-04-24T02:12:24.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.228+0000 7f4cd280f800 20 add_watcher() i=7 2024-04-24T02:12:24.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.228+0000 7f4cd280f800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:24.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.228+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82cbf30 con 0x55d2a82b8440 2024-04-24T02:12:24.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.228+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4cc002d070 con 0x55d2a82b8440 2024-04-24T02:12:24.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.228+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94363252983840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c9480 con 0x55d2a82b8440 2024-04-24T02:12:24.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.229+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94363252983840] v30'88 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4cc002d070 con 0x55d2a82b8440 2024-04-24T02:12:24.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.230+0000 7f4b7f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:24.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.230+0000 7f4cd280f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:24.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.230+0000 7f4cd280f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:24.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.230+0000 7f4cd280f800 5 note: GC not initialized 2024-04-24T02:12:24.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.230+0000 7f4b7e7fc640 20 reqs_thread_entry: start 2024-04-24T02:12:24.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.230+0000 7f4cd280f800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:24.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.230+0000 7f4cd280f800 20 Filter name: none 2024-04-24T02:12:24.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.230+0000 7f4aeffff640 20 reqs_thread_entry: start 2024-04-24T02:12:24.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.230+0000 7f4cd280f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T02:12:24.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.230+0000 7f4cd280f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.230+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82ff250 con 0x55d2a82b8440 2024-04-24T02:12:24.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.230+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f4cc002d070 con 0x55d2a82b8440 2024-04-24T02:12:24.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.231+0000 7f4cd280f800 20 rados_obj.operate() r=0 bl.length=673 2024-04-24T02:12:24.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.231+0000 7f4cd280f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T02:12:24.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.231+0000 7f4cd280f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:24.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.231+0000 7f4cd280f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:12:24.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.231+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d2a8305e40 con 0x55d2a82b8440 2024-04-24T02:12:24.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.232+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~582] v30'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f4cc002d070 con 0x55d2a82b8440 2024-04-24T02:12:24.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.232+0000 7f4cd280f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T02:12:24.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.232+0000 7f4cd280f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:24.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.232+0000 7f4cd280f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-24T02:12:24.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.232+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94363253233840 in=770b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d2a8301590 con 0x55d2a82b8440 2024-04-24T02:12:24.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.232+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== watch-notify(notify (1) cookie 94363252973296 notify 128849018888 ret 0) ==== 800+0+0 (crc 0 0 0) 0x55d2a8183f00 con 0x55d2a82b8440 2024-04-24T02:12:24.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.232+0000 7f4bb17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018888 cookie 94363252973296 notifier 4397 bl.length()=758 2024-04-24T02:12:24.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.232+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(64 notify.4 [notify cookie 94363253233840 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4cc002d070 con 0x55d2a82b8440 2024-04-24T02:12:24.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.232+0000 7f4bb17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T02:12:24.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.232+0000 7f4bb17fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:24.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.232+0000 7f4bb17fa640 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f4b90003ea0 con 0x55d2a82b8440 2024-04-24T02:12:24.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.232+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== watch-notify(notify_complete (2) cookie 94363253233840 notify 128849018888 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d2a81839e0 con 0x55d2a82b8440 2024-04-24T02:12:24.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.232+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cc002d070 con 0x55d2a82b8440 2024-04-24T02:12:24.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.232+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:66 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d2a83058b0 con 0x55d2a82b8440 2024-04-24T02:12:24.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.233+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(66 foo:foo1 [delete] v30'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cc002d070 con 0x55d2a82b8440 2024-04-24T02:12:24.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.233+0000 7f4cd280f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-04-24T02:12:24.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.233+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94363253233840 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d2a83010e0 con 0x7f4cc4098070 2024-04-24T02:12:24.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.233+0000 7f4cce748640 1 -- 172.21.15.134:0/3683537670 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== watch-notify(notify (1) cookie 94363252960208 notify 128849018884 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7f4cc80247b0 con 0x7f4cc4098070 2024-04-24T02:12:24.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.234+0000 7f4bb17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018884 cookie 94363252960208 notifier 4397 bl.length()=159 2024-04-24T02:12:24.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.234+0000 7f4bb17fa640 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f4b90003ea0 con 0x7f4cc4098070 2024-04-24T02:12:24.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.234+0000 7f4cce748640 1 -- 172.21.15.134:0/3683537670 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(67 notify.0 [notify cookie 94363253233840 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4cc8040040 con 0x7f4cc4098070 2024-04-24T02:12:24.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.234+0000 7f4cce748640 1 -- 172.21.15.134:0/3683537670 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== watch-notify(notify_complete (2) cookie 94363253233840 notify 128849018884 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f4cc8024980 con 0x7f4cc4098070 2024-04-24T02:12:24.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.234+0000 7f4cce748640 1 -- 172.21.15.134:0/3683537670 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cc8040040 con 0x7f4cc4098070 2024-04-24T02:12:24.279 INFO:teuthology.orchestra.run.smithi134.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T02:12:21.778798Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-04-24T02:12:23.936085Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T02:12:21.778786Z","tags":[],"group_ids":[]} 2024-04-24T02:12:24.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.235+0000 7f4b7f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:24.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.235+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94363252983840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82fd930 con 0x55d2a82b8440 2024-04-24T02:12:24.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.236+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.1 v2:172.21.15.134:6804/1487076214 30 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94363252983840] v30'89 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4cc002d070 con 0x55d2a82b8440 2024-04-24T02:12:24.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.236+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94363252960208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c87f0 con 0x7f4cc4098070 2024-04-24T02:12:24.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.237+0000 7f4cce748640 1 -- 172.21.15.134:0/3683537670 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94363252960208] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cc8040040 con 0x7f4cc4098070 2024-04-24T02:12:24.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.237+0000 7f4cd280f800 20 remove_watcher() i=0 2024-04-24T02:12:24.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.237+0000 7f4cd280f800 2 removed watcher, disabling cache 2024-04-24T02:12:24.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.237+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94363252964336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c2bd0 con 0x55d2a82b8440 2024-04-24T02:12:24.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.238+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.1 v2:172.21.15.134:6804/1487076214 31 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94363252964336] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cc002d070 con 0x55d2a82b8440 2024-04-24T02:12:24.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.238+0000 7f4cd280f800 20 remove_watcher() i=1 2024-04-24T02:12:24.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.238+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94363252968336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c2bd0 con 0x55d2a82be690 2024-04-24T02:12:24.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.239+0000 7f4ccd746640 1 -- 172.21.15.134:0/3683537670 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94363252968336] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cc409f070 con 0x55d2a82be690 2024-04-24T02:12:24.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.239+0000 7f4cd280f800 20 remove_watcher() i=2 2024-04-24T02:12:24.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.239+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94363252970672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c3bf0 con 0x7f4cc4098070 2024-04-24T02:12:24.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.240+0000 7f4cce748640 1 -- 172.21.15.134:0/3683537670 <== osd.2 v2:172.21.15.134:6800/214480313 16 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94363252970672] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cc8040040 con 0x7f4cc4098070 2024-04-24T02:12:24.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.240+0000 7f4cd280f800 20 remove_watcher() i=3 2024-04-24T02:12:24.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.240+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94363252973296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c3bf0 con 0x55d2a82b8440 2024-04-24T02:12:24.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.241+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.1 v2:172.21.15.134:6804/1487076214 32 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94363252973296] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cc002d070 con 0x55d2a82b8440 2024-04-24T02:12:24.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.241+0000 7f4cd280f800 20 remove_watcher() i=4 2024-04-24T02:12:24.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.241+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94363252978192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c3bf0 con 0x7f4cc8031040 2024-04-24T02:12:24.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.242+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94363252978192] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cc002d070 con 0x7f4cc8031040 2024-04-24T02:12:24.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.242+0000 7f4cd280f800 20 remove_watcher() i=5 2024-04-24T02:12:24.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.242+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94363252975616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c7210 con 0x7f4cc8031040 2024-04-24T02:12:24.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.242+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94363252975616] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cc002d070 con 0x7f4cc8031040 2024-04-24T02:12:24.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.242+0000 7f4cd280f800 20 remove_watcher() i=6 2024-04-24T02:12:24.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.242+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94363252980384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d2a82c3bf0 con 0x7f4cc8031040 2024-04-24T02:12:24.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.243+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94363252980384] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cc002d070 con 0x7f4cc8031040 2024-04-24T02:12:24.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.243+0000 7f4cd280f800 20 remove_watcher() i=7 2024-04-24T02:12:24.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.243+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f4cc8031040 msgr2=0x7f4cc8032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.243+0000 7f4cd280f800 1 --2- 172.21.15.134:0/3683537670 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f4cc8031040 0x7f4cc8032940 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.243+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d2a82b8440 msgr2=0x55d2a82ba900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.243+0000 7f4cd280f800 1 --2- 172.21.15.134:0/3683537670 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d2a82b8440 0x55d2a82ba900 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.243+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f4cc4098070 msgr2=0x7f4cc40065b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.243+0000 7f4cd280f800 1 --2- 172.21.15.134:0/3683537670 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f4cc4098070 0x7f4cc40065b0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.243+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55d2a82be690 msgr2=0x55d2a82c0a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.243+0000 7f4cd280f800 1 --2- 172.21.15.134:0/3683537670 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55d2a82be690 0x55d2a82c0a80 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.244+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4b98036950 msgr2=0x7f4b98038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.244+0000 7f4cd280f800 1 --2- 172.21.15.134:0/3683537670 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4b98036950 0x7f4b98038e10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x55d2a8184a50 tx=0x7f4cc801f000 comp rx=0 tx=0).stop 2024-04-24T02:12:24.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.244+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d2a82a52c0 msgr2=0x55d2a82ac960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.244+0000 7f4ccdf47640 1 -- 172.21.15.134:0/3683537670 reap_dead start 2024-04-24T02:12:24.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.244+0000 7f4cd280f800 1 --2- 172.21.15.134:0/3683537670 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d2a82a52c0 0x55d2a82ac960 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4067b80 tx=0x7f4cc408da00 comp rx=0 tx=0).stop 2024-04-24T02:12:24.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.244+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 shutdown_connections 2024-04-24T02:12:24.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.244+0000 7f4cd280f800 1 --2- 172.21.15.134:0/3683537670 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d2a82a52c0 0x55d2a82ac960 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.244+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 >> 172.21.15.134:0/3683537670 conn(0x55d2a82a1620 msgr2=0x55d2a829ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:24.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.244+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 shutdown_connections 2024-04-24T02:12:24.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.244+0000 7f4cd280f800 1 -- 172.21.15.134:0/3683537670 wait complete. 2024-04-24T02:12:24.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.244+0000 7f4cd280f800 1 -- 172.21.15.134:0/915944319 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4ba8036950 msgr2=0x7f4ba8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.244+0000 7f4cd280f800 1 --2- 172.21.15.134:0/915944319 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4ba8036950 0x7f4ba8038e10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x55d2a8288130 tx=0x7f4cc8005840 comp rx=0 tx=0).stop 2024-04-24T02:12:24.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.244+0000 7f4cd280f800 1 -- 172.21.15.134:0/915944319 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d2a8298040 msgr2=0x55d2a8298460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.244+0000 7f4cd280f800 1 --2- 172.21.15.134:0/915944319 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d2a8298040 0x55d2a8298460 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4055040 tx=0x7f4cc4002fb0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.244+0000 7f4cd280f800 1 -- 172.21.15.134:0/915944319 shutdown_connections 2024-04-24T02:12:24.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.244+0000 7f4cd280f800 1 --2- 172.21.15.134:0/915944319 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4ba8036950 0x7f4ba8038e10 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.244+0000 7f4cd280f800 1 --2- 172.21.15.134:0/915944319 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d2a8298040 0x55d2a8298460 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.244+0000 7f4cd280f800 1 -- 172.21.15.134:0/915944319 >> 172.21.15.134:0/915944319 conn(0x55d2a828c0e0 msgr2=0x55d2a828c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:24.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.244+0000 7f4cd280f800 1 -- 172.21.15.134:0/915944319 shutdown_connections 2024-04-24T02:12:24.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.244+0000 7f4cd280f800 1 -- 172.21.15.134:0/915944319 wait complete. 2024-04-24T02:12:24.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.244+0000 7f4cd280f800 1 -- 172.21.15.134:0/1371649424 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d2a81894c0 msgr2=0x55d2a8286f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.244+0000 7f4cd280f800 1 --2- 172.21.15.134:0/1371649424 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d2a81894c0 0x55d2a8286f30 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.244+0000 7f4cd280f800 1 -- 172.21.15.134:0/1371649424 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4bb40368b0 msgr2=0x7f4bb4038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.244+0000 7f4cd280f800 1 --2- 172.21.15.134:0/1371649424 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4bb40368b0 0x7f4bb4038d70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4054000 tx=0x7f4cc404e000 comp rx=0 tx=0).stop 2024-04-24T02:12:24.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.244+0000 7f4cd280f800 1 -- 172.21.15.134:0/1371649424 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d2a81859b0 msgr2=0x55d2a81852a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.244+0000 7f4cd280f800 1 --2- 172.21.15.134:0/1371649424 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d2a81859b0 0x55d2a81852a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4cc000b210 tx=0x7f4cc0000ed0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.245+0000 7f4cd280f800 1 -- 172.21.15.134:0/1371649424 shutdown_connections 2024-04-24T02:12:24.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.245+0000 7f4cd280f800 1 --2- 172.21.15.134:0/1371649424 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d2a81894c0 0x55d2a8286f30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.245+0000 7f4cd280f800 1 --2- 172.21.15.134:0/1371649424 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4bb40368b0 0x7f4bb4038d70 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.245+0000 7f4cd280f800 1 --2- 172.21.15.134:0/1371649424 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d2a81859b0 0x55d2a81852a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.245+0000 7f4cd280f800 1 -- 172.21.15.134:0/1371649424 >> 172.21.15.134:0/1371649424 conn(0x55d2a817f340 msgr2=0x55d2a826ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:24.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.245+0000 7f4cd280f800 1 -- 172.21.15.134:0/1371649424 shutdown_connections 2024-04-24T02:12:24.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.245+0000 7f4cd280f800 1 -- 172.21.15.134:0/1371649424 wait complete. 2024-04-24T02:12:24.296 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T02:12:21.778798Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-04-24T02:12:23.936085Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:12:21.778786Z', 'tags': [], 'group_ids': []} 2024-04-24T02:12:24.296 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-04-24T02:12:24.296 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-04-24T02:12:24.296 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-04-24T02:12:24.339 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:24.339 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:24.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.338+0000 7f3a7791f800 1 Processor -- start 2024-04-24T02:12:24.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.338+0000 7f3a7791f800 1 -- start start 2024-04-24T02:12:24.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.338+0000 7f3a7791f800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5555c8d11f90 0x5555c8d123b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.338+0000 7f3a7791f800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5555c8bd0d40 con 0x5555c8d13100 2024-04-24T02:12:24.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.338+0000 7f3a7791f800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x5555c8ba34d0 con 0x5555c8d11f90 2024-04-24T02:12:24.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.339+0000 7f3a735ca640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5555c8d11f90 0x5555c8d123b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.339+0000 7f3a735ca640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5555c8d11f90 0x5555c8d123b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46480/0 (socket says 172.21.15.134:46480) 2024-04-24T02:12:24.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.339+0000 7f3a735ca640 1 -- 172.21.15.134:0/2254481836 learned_addr learned my addr 172.21.15.134:0/2254481836 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:24.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.339+0000 7f3a6adc9640 1 --1- 172.21.15.134:0/2254481836 >> v1:172.21.15.104:6789/0 conn(0x5555c8d13100 0x5555c8d13580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:43364/0 (socket says 172.21.15.134:43364) 2024-04-24T02:12:24.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.339+0000 7f3a735ca640 1 -- 172.21.15.134:0/2254481836 >> v1:172.21.15.104:6789/0 conn(0x5555c8d13100 legacy=0x5555c8d13580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.339+0000 7f3a735ca640 1 -- 172.21.15.134:0/2254481836 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555c8bcf590 con 0x5555c8d11f90 2024-04-24T02:12:24.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.341+0000 7f3a735ca640 1 --2- 172.21.15.134:0/2254481836 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555c8d11f90 0x5555c8d123b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3a6400a520 tx=0x7f3a6401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53e5e625e53b55a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.341+0000 7f3a72dc9640 1 -- 172.21.15.134:0/2254481836 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a64057070 con 0x5555c8d11f90 2024-04-24T02:12:24.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.341+0000 7f3a72dc9640 1 -- 172.21.15.134:0/2254481836 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a64052570 con 0x5555c8d11f90 2024-04-24T02:12:24.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.341+0000 7f3a72dc9640 1 -- 172.21.15.134:0/2254481836 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a6404ae60 con 0x5555c8d11f90 2024-04-24T02:12:24.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.341+0000 7f3a7791f800 1 -- 172.21.15.134:0/2254481836 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555c8d11f90 msgr2=0x5555c8d123b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.341+0000 7f3a7791f800 1 --2- 172.21.15.134:0/2254481836 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555c8d11f90 0x5555c8d123b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3a6400a520 tx=0x7f3a6401d010 comp rx=0 tx=0).stop 2024-04-24T02:12:24.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.342+0000 7f3a7791f800 1 -- 172.21.15.134:0/2254481836 shutdown_connections 2024-04-24T02:12:24.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.342+0000 7f3a7791f800 1 --2- 172.21.15.134:0/2254481836 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555c8d11f90 0x5555c8d123b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.342+0000 7f3a7791f800 1 -- 172.21.15.134:0/2254481836 >> 172.21.15.134:0/2254481836 conn(0x5555c8d0d530 msgr2=0x5555c8d0f950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:24.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.342+0000 7f3a7791f800 1 -- 172.21.15.134:0/2254481836 shutdown_connections 2024-04-24T02:12:24.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.342+0000 7f3a7791f800 1 -- 172.21.15.134:0/2254481836 wait complete. 2024-04-24T02:12:24.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.353+0000 7f3a7791f800 1 Processor -- start 2024-04-24T02:12:24.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.353+0000 7f3a7791f800 1 -- start start 2024-04-24T02:12:24.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.353+0000 7f3a7791f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555c8d11f90 0x5555c8e03580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.353+0000 7f3a7791f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5555c8c5d3c0 con 0x5555c8d11f90 2024-04-24T02:12:24.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.354+0000 7f3a735ca640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555c8d11f90 0x5555c8e03580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.354+0000 7f3a735ca640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555c8d11f90 0x5555c8e03580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46490/0 (socket says 172.21.15.134:46490) 2024-04-24T02:12:24.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.354+0000 7f3a735ca640 1 -- 172.21.15.134:0/4260489252 learned_addr learned my addr 172.21.15.134:0/4260489252 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:24.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.354+0000 7f3a735ca640 1 -- 172.21.15.134:0/4260489252 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555c8e03b50 con 0x5555c8d11f90 2024-04-24T02:12:24.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.354+0000 7f3a735ca640 1 --2- 172.21.15.134:0/4260489252 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555c8d11f90 0x5555c8e03580 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3a64055040 tx=0x7f3a6404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28e8a7c4e11afb35 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.354+0000 7f396160a640 1 -- 172.21.15.134:0/4260489252 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a64057040 con 0x5555c8d11f90 2024-04-24T02:12:24.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.354+0000 7f396160a640 1 -- 172.21.15.134:0/4260489252 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a64052720 con 0x5555c8d11f90 2024-04-24T02:12:24.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.354+0000 7f396160a640 1 -- 172.21.15.134:0/4260489252 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a64052a40 con 0x5555c8d11f90 2024-04-24T02:12:24.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.355+0000 7f3a7791f800 1 -- 172.21.15.134:0/4260489252 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555c8d11f90 msgr2=0x5555c8e03580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.355+0000 7f3a7791f800 1 --2- 172.21.15.134:0/4260489252 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555c8d11f90 0x5555c8e03580 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3a64055040 tx=0x7f3a6404c000 comp rx=0 tx=0).stop 2024-04-24T02:12:24.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.355+0000 7f3a7791f800 1 -- 172.21.15.134:0/4260489252 shutdown_connections 2024-04-24T02:12:24.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.355+0000 7f3a7791f800 1 --2- 172.21.15.134:0/4260489252 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555c8d11f90 0x5555c8e03580 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.355+0000 7f3a7791f800 1 -- 172.21.15.134:0/4260489252 >> 172.21.15.134:0/4260489252 conn(0x5555c8d0d530 msgr2=0x5555c8dfeea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:24.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.355+0000 7f3a7791f800 1 -- 172.21.15.134:0/4260489252 shutdown_connections 2024-04-24T02:12:24.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.355+0000 7f3a7791f800 1 -- 172.21.15.134:0/4260489252 wait complete. 2024-04-24T02:12:24.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.355+0000 7f3a7791f800 1 Processor -- start 2024-04-24T02:12:24.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.355+0000 7f3a7791f800 1 -- start start 2024-04-24T02:12:24.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.356+0000 7f3a7791f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555c8d11f90 0x5555c8e0b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.356+0000 7f3a7791f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5555c8d1b570 con 0x5555c8d11f90 2024-04-24T02:12:24.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.356+0000 7f3a735ca640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555c8d11f90 0x5555c8e0b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.356+0000 7f3a735ca640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555c8d11f90 0x5555c8e0b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46502/0 (socket says 172.21.15.134:46502) 2024-04-24T02:12:24.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.356+0000 7f3a735ca640 1 -- 172.21.15.134:0/390300167 learned_addr learned my addr 172.21.15.134:0/390300167 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:24.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.356+0000 7f3a735ca640 1 -- 172.21.15.134:0/390300167 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555c8e0b590 con 0x5555c8d11f90 2024-04-24T02:12:24.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.356+0000 7f3a735ca640 1 --2- 172.21.15.134:0/390300167 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555c8d11f90 0x5555c8e0b050 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3a64052540 tx=0x7f3a64003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.356+0000 7f395fe07640 1 -- 172.21.15.134:0/390300167 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a64073070 con 0x5555c8d11f90 2024-04-24T02:12:24.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.356+0000 7f395fe07640 1 -- 172.21.15.134:0/390300167 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a64052c90 con 0x5555c8d11f90 2024-04-24T02:12:24.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.356+0000 7f395fe07640 1 -- 172.21.15.134:0/390300167 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a64057070 con 0x5555c8d11f90 2024-04-24T02:12:24.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.356+0000 7f3a7791f800 1 -- 172.21.15.134:0/390300167 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5555c8e0b820 con 0x5555c8d11f90 2024-04-24T02:12:24.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.356+0000 7f3a7791f800 1 -- 172.21.15.134:0/390300167 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555c8e0e430 con 0x5555c8d11f90 2024-04-24T02:12:24.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.357+0000 7f395fe07640 1 -- 172.21.15.134:0/390300167 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3a64076070 con 0x5555c8d11f90 2024-04-24T02:12:24.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.357+0000 7f395fe07640 1 --2- 172.21.15.134:0/390300167 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3958036950 0x7f3958038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.357+0000 7f395fe07640 1 -- 172.21.15.134:0/390300167 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f3a6408d840 con 0x5555c8d11f90 2024-04-24T02:12:24.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.357+0000 7f3a6adc9640 1 --2- 172.21.15.134:0/390300167 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3958036950 0x7f3958038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.357+0000 7f3a7791f800 1 --2- 172.21.15.134:0/390300167 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5555c8d13100 0x5555c8e121f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.357+0000 7f3a7791f800 1 -- 172.21.15.134:0/390300167 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e12730 con 0x5555c8d13100 2024-04-24T02:12:24.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.358+0000 7f3a73dcb640 1 --2- 172.21.15.134:0/390300167 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5555c8d13100 0x5555c8e121f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.358+0000 7f3a6adc9640 1 --2- 172.21.15.134:0/390300167 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3958036950 0x7f3958038e10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c001e40 tx=0x7f3a5c0013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.358+0000 7f3a73dcb640 1 --2- 172.21.15.134:0/390300167 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5555c8d13100 0x5555c8e121f0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.358+0000 7f3a73dcb640 1 -- 172.21.15.134:0/390300167 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3a6c00a4a0 con 0x5555c8d13100 2024-04-24T02:12:24.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.358+0000 7f3a7791f800 1 -- 172.21.15.134:0/390300167 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e0f7c0 con 0x5555c8d13100 2024-04-24T02:12:24.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.358+0000 7f3a73dcb640 1 -- 172.21.15.134:0/390300167 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3a6c00a4a0 con 0x5555c8d13100 2024-04-24T02:12:24.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.358+0000 7f3a7791f800 1 -- 172.21.15.134:0/390300167 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e14510 con 0x5555c8d13100 2024-04-24T02:12:24.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.359+0000 7f3a73dcb640 1 -- 172.21.15.134:0/390300167 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3a6c00a4a0 con 0x5555c8d13100 2024-04-24T02:12:24.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.359+0000 7f3a7791f800 1 -- 172.21.15.134:0/390300167 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e13850 con 0x5555c8d13100 2024-04-24T02:12:24.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.359+0000 7f3a73dcb640 1 -- 172.21.15.134:0/390300167 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3a6c00a4a0 con 0x5555c8d13100 2024-04-24T02:12:24.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.359+0000 7f3a7791f800 1 -- 172.21.15.134:0/390300167 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e13ca0 con 0x5555c8d13100 2024-04-24T02:12:24.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.359+0000 7f3a73dcb640 1 -- 172.21.15.134:0/390300167 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3a6c00a4a0 con 0x5555c8d13100 2024-04-24T02:12:24.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.360+0000 7f3a7791f800 1 Processor -- start 2024-04-24T02:12:24.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.360+0000 7f3a7791f800 1 -- start start 2024-04-24T02:12:24.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.360+0000 7f3a7791f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555c8c87be0 0x5555c8c86050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.360+0000 7f3a7791f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5555c8c036b0 con 0x5555c8c87be0 2024-04-24T02:12:24.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.360+0000 7f3a6adc9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555c8c87be0 0x5555c8c86050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.360+0000 7f3a6adc9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555c8c87be0 0x5555c8c86050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46516/0 (socket says 172.21.15.134:46516) 2024-04-24T02:12:24.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.360+0000 7f3a6adc9640 1 -- 172.21.15.134:0/1847556991 learned_addr learned my addr 172.21.15.134:0/1847556991 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:24.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.360+0000 7f3a6adc9640 1 -- 172.21.15.134:0/1847556991 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555c8c86590 con 0x5555c8c87be0 2024-04-24T02:12:24.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.361+0000 7f3a6adc9640 1 --2- 172.21.15.134:0/1847556991 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555c8c87be0 0x5555c8c86050 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c00e630 tx=0x7f3a5c00ea30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.361+0000 7f395d602640 1 -- 172.21.15.134:0/1847556991 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a5c022070 con 0x5555c8c87be0 2024-04-24T02:12:24.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.361+0000 7f395d602640 1 -- 172.21.15.134:0/1847556991 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a5c00d520 con 0x5555c8c87be0 2024-04-24T02:12:24.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.361+0000 7f395d602640 1 -- 172.21.15.134:0/1847556991 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a5c00d840 con 0x5555c8c87be0 2024-04-24T02:12:24.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.361+0000 7f3a7791f800 1 -- 172.21.15.134:0/1847556991 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5555c8c867c0 con 0x5555c8c87be0 2024-04-24T02:12:24.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.361+0000 7f3a7791f800 1 -- 172.21.15.134:0/1847556991 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555c8c86cc0 con 0x5555c8c87be0 2024-04-24T02:12:24.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.362+0000 7f395d602640 1 -- 172.21.15.134:0/1847556991 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3a5c025070 con 0x5555c8c87be0 2024-04-24T02:12:24.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.362+0000 7f395d602640 1 --2- 172.21.15.134:0/1847556991 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f394c036950 0x7f394c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.362+0000 7f395d602640 1 -- 172.21.15.134:0/1847556991 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f3a5c04dc00 con 0x5555c8c87be0 2024-04-24T02:12:24.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.362+0000 7f3a73dcb640 1 --2- 172.21.15.134:0/1847556991 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f394c036950 0x7f394c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.362+0000 7f3a7791f800 1 Processor -- start 2024-04-24T02:12:24.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.362+0000 7f3a7791f800 1 -- start start 2024-04-24T02:12:24.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.362+0000 7f3a73dcb640 1 --2- 172.21.15.134:0/1847556991 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f394c036950 0x7f394c038e10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x5555c8e13370 tx=0x7f3a6c005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.362+0000 7f3a7791f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555c8e327c0 0x5555c8e32be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.362+0000 7f3a7791f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5555c8e03e10 con 0x5555c8e327c0 2024-04-24T02:12:24.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.362+0000 7f3a6adc9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555c8e327c0 0x5555c8e32be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.362+0000 7f3a6adc9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555c8e327c0 0x5555c8e32be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46532/0 (socket says 172.21.15.134:46532) 2024-04-24T02:12:24.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.362+0000 7f3a6adc9640 1 -- 172.21.15.134:0/1985583090 learned_addr learned my addr 172.21.15.134:0/1985583090 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:24.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.363+0000 7f3a6adc9640 1 -- 172.21.15.134:0/1985583090 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555c8e331b0 con 0x5555c8e327c0 2024-04-24T02:12:24.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.363+0000 7f3a6adc9640 1 --2- 172.21.15.134:0/1985583090 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555c8e327c0 0x5555c8e32be0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c04c1a0 tx=0x7f3a5c025f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32380d2a32f102f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.363+0000 7f3956ffd640 1 -- 172.21.15.134:0/1985583090 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a5c040130 con 0x5555c8e327c0 2024-04-24T02:12:24.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.363+0000 7f3956ffd640 1 -- 172.21.15.134:0/1985583090 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a5c0402d0 con 0x5555c8e327c0 2024-04-24T02:12:24.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.363+0000 7f3956ffd640 1 -- 172.21.15.134:0/1985583090 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a5c0404a0 con 0x5555c8e327c0 2024-04-24T02:12:24.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.363+0000 7f3a7791f800 1 -- 172.21.15.134:0/1985583090 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555c8e327c0 msgr2=0x5555c8e32be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.363+0000 7f3a7791f800 1 --2- 172.21.15.134:0/1985583090 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555c8e327c0 0x5555c8e32be0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c04c1a0 tx=0x7f3a5c025f90 comp rx=0 tx=0).stop 2024-04-24T02:12:24.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.363+0000 7f3a7791f800 1 -- 172.21.15.134:0/1985583090 shutdown_connections 2024-04-24T02:12:24.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.363+0000 7f3a7791f800 1 --2- 172.21.15.134:0/1985583090 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555c8e327c0 0x5555c8e32be0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.363+0000 7f3a7791f800 1 -- 172.21.15.134:0/1985583090 >> 172.21.15.134:0/1985583090 conn(0x5555c8e2eb20 msgr2=0x5555c8e2cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:24.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.363+0000 7f3a7791f800 1 -- 172.21.15.134:0/1985583090 shutdown_connections 2024-04-24T02:12:24.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.363+0000 7f3a7791f800 1 -- 172.21.15.134:0/1985583090 wait complete. 2024-04-24T02:12:24.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.364+0000 7f3a7791f800 1 Processor -- start 2024-04-24T02:12:24.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.364+0000 7f3a7791f800 1 -- start start 2024-04-24T02:12:24.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.364+0000 7f3a7791f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555c8e327c0 0x5555c8e39e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.364+0000 7f3a7791f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5555c8e33920 con 0x5555c8e327c0 2024-04-24T02:12:24.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.364+0000 7f3a6adc9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555c8e327c0 0x5555c8e39e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.364+0000 7f3a6adc9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555c8e327c0 0x5555c8e39e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46536/0 (socket says 172.21.15.134:46536) 2024-04-24T02:12:24.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.364+0000 7f3a6adc9640 1 -- 172.21.15.134:0/2427472203 learned_addr learned my addr 172.21.15.134:0/2427472203 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:24.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.364+0000 7f3a6adc9640 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555c8e3a370 con 0x5555c8e327c0 2024-04-24T02:12:24.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.364+0000 7f3a6adc9640 1 --2- 172.21.15.134:0/2427472203 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555c8e327c0 0x5555c8e39e30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c026fd0 tx=0x7f3a5c04c130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.365+0000 7f39557fa640 1 -- 172.21.15.134:0/2427472203 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a5c036070 con 0x5555c8e327c0 2024-04-24T02:12:24.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.365+0000 7f39557fa640 1 -- 172.21.15.134:0/2427472203 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a5c0244d0 con 0x5555c8e327c0 2024-04-24T02:12:24.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.365+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5555c8e3a370 con 0x5555c8e327c0 2024-04-24T02:12:24.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.365+0000 7f39557fa640 1 -- 172.21.15.134:0/2427472203 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a5c00d9e0 con 0x5555c8e327c0 2024-04-24T02:12:24.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.365+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555c8e3a370 con 0x5555c8e327c0 2024-04-24T02:12:24.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.365+0000 7f39557fa640 1 -- 172.21.15.134:0/2427472203 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3a5c01a320 con 0x5555c8e327c0 2024-04-24T02:12:24.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.365+0000 7f39557fa640 1 --2- 172.21.15.134:0/2427472203 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f393c036950 0x7f393c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.366+0000 7f39557fa640 1 -- 172.21.15.134:0/2427472203 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f3a5c03a3f0 con 0x5555c8e327c0 2024-04-24T02:12:24.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.366+0000 7f3a73dcb640 1 --2- 172.21.15.134:0/2427472203 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f393c036950 0x7f393c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.366+0000 7f3a73dcb640 1 --2- 172.21.15.134:0/2427472203 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f393c036950 0x7f393c038e10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x5555c8e0c1d0 tx=0x7f3a6c01f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.366+0000 7f3a7791f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.366+0000 7f3a7791f800 1 --2- 172.21.15.134:0/2427472203 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5555c8e45590 0x5555c8e47a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.366+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e481a0 con 0x5555c8e45590 2024-04-24T02:12:24.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.366+0000 7f3a735ca640 1 --2- 172.21.15.134:0/2427472203 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5555c8e45590 0x5555c8e47a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.366+0000 7f3a735ca640 1 --2- 172.21.15.134:0/2427472203 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5555c8e45590 0x5555c8e47a50 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.367+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3a64075030 con 0x5555c8e45590 2024-04-24T02:12:24.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.367+0000 7f3a7791f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:24.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.367+0000 7f3a7791f800 20 realm 2024-04-24T02:12:24.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.367+0000 7f3a7791f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.367+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e485b0 con 0x5555c8e45590 2024-04-24T02:12:24.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.367+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3a64075030 con 0x5555c8e45590 2024-04-24T02:12:24.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.367+0000 7f3a7791f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:24.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.367+0000 7f3a7791f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:24.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.367+0000 7f3a7791f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.367+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e48e80 con 0x5555c8e45590 2024-04-24T02:12:24.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.367+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3a64075030 con 0x5555c8e45590 2024-04-24T02:12:24.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.367+0000 7f3a7791f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:24.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.367+0000 7f3a7791f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.367+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e49220 con 0x5555c8e45590 2024-04-24T02:12:24.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.367+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3a64075030 con 0x5555c8e45590 2024-04-24T02:12:24.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.367+0000 7f3a7791f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:24.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.367+0000 7f3a7791f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.367+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e49a70 con 0x5555c8e45590 2024-04-24T02:12:24.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.368+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3a64075030 con 0x5555c8e45590 2024-04-24T02:12:24.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.368+0000 7f3a7791f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:24.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.368+0000 7f3a7791f800 20 searching for the correct realm 2024-04-24T02:12:24.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.368+0000 7f3a7791f800 1 --2- 172.21.15.134:0/2427472203 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5555c8e4b7e0 0x5555c8e4dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.368+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e4e1b0 con 0x5555c8e4b7e0 2024-04-24T02:12:24.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.368+0000 7f3a6adc9640 1 --2- 172.21.15.134:0/2427472203 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5555c8e4b7e0 0x5555c8e4dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.368+0000 7f3a6adc9640 1 --2- 172.21.15.134:0/2427472203 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5555c8e4b7e0 0x5555c8e4dbd0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.368+0000 7f3a6adc9640 1 -- 172.21.15.134:0/2427472203 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a5c024030 con 0x5555c8e4b7e0 2024-04-24T02:12:24.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.368+0000 7f3a6adc9640 1 --2- 172.21.15.134:0/2427472203 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f3a5c027060 0x7f3a5c0407f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.368+0000 7f3a6adc9640 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e4e1b0 con 0x7f3a5c027060 2024-04-24T02:12:24.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.369+0000 7f3a73dcb640 1 --2- 172.21.15.134:0/2427472203 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f3a5c027060 0x7f3a5c0407f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.369+0000 7f3a73dcb640 1 --2- 172.21.15.134:0/2427472203 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f3a5c027060 0x7f3a5c0407f0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.369+0000 7f3a73dcb640 1 -- 172.21.15.134:0/2427472203 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a6c01f070 con 0x7f3a5c027060 2024-04-24T02:12:24.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.369+0000 7f3a73dcb640 1 --2- 172.21.15.134:0/2427472203 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f3a6c031040 0x7f3a6c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.369+0000 7f3a73dcb640 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e4e1b0 con 0x7f3a6c031040 2024-04-24T02:12:24.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.369+0000 7f3a735ca640 1 --2- 172.21.15.134:0/2427472203 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f3a6c031040 0x7f3a6c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.370+0000 7f3a735ca640 1 --2- 172.21.15.134:0/2427472203 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f3a6c031040 0x7f3a6c032940 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.370+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a64075030 con 0x7f3a6c031040 2024-04-24T02:12:24.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.370+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e4e1b0 con 0x5555c8e45590 2024-04-24T02:12:24.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.370+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a64075030 con 0x5555c8e45590 2024-04-24T02:12:24.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.370+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e4e1b0 con 0x5555c8e45590 2024-04-24T02:12:24.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.370+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3a64075030 con 0x5555c8e45590 2024-04-24T02:12:24.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.370+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e4e1b0 con 0x7f3a6c031040 2024-04-24T02:12:24.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.371+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a64075030 con 0x7f3a6c031040 2024-04-24T02:12:24.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.371+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e4e1b0 con 0x7f3a6c031040 2024-04-24T02:12:24.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.371+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a64075030 con 0x7f3a6c031040 2024-04-24T02:12:24.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.371+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e4e1b0 con 0x7f3a5c027060 2024-04-24T02:12:24.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.371+0000 7f3a73dcb640 1 -- 172.21.15.134:0/2427472203 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a6c01f070 con 0x7f3a5c027060 2024-04-24T02:12:24.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.371+0000 7f3a73dcb640 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e4e1b0 con 0x5555c8e4b7e0 2024-04-24T02:12:24.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.371+0000 7f3a6adc9640 1 -- 172.21.15.134:0/2427472203 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a5c024030 con 0x5555c8e4b7e0 2024-04-24T02:12:24.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.371+0000 7f3a6adc9640 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e4e1b0 con 0x5555c8e45590 2024-04-24T02:12:24.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.372+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a64075030 con 0x5555c8e45590 2024-04-24T02:12:24.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.372+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e4e1b0 con 0x7f3a6c031040 2024-04-24T02:12:24.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.372+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a64075030 con 0x7f3a6c031040 2024-04-24T02:12:24.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.372+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e4e1b0 con 0x5555c8e45590 2024-04-24T02:12:24.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.372+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a64075030 con 0x5555c8e45590 2024-04-24T02:12:24.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.372+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e4e1b0 con 0x7f3a5c027060 2024-04-24T02:12:24.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.372+0000 7f3a73dcb640 1 -- 172.21.15.134:0/2427472203 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3a6c01f070 con 0x7f3a5c027060 2024-04-24T02:12:24.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.372+0000 7f3a73dcb640 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e4e1b0 con 0x5555c8e4b7e0 2024-04-24T02:12:24.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.373+0000 7f3a6adc9640 1 -- 172.21.15.134:0/2427472203 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a5c024030 con 0x5555c8e4b7e0 2024-04-24T02:12:24.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.373+0000 7f3a6adc9640 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e4e1b0 con 0x5555c8e4b7e0 2024-04-24T02:12:24.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.373+0000 7f3a6adc9640 1 -- 172.21.15.134:0/2427472203 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a5c024030 con 0x5555c8e4b7e0 2024-04-24T02:12:24.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.373+0000 7f3a6adc9640 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e4e1b0 con 0x7f3a6c031040 2024-04-24T02:12:24.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.374+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a64075030 con 0x7f3a6c031040 2024-04-24T02:12:24.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.374+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e4e1b0 con 0x5555c8e4b7e0 2024-04-24T02:12:24.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.374+0000 7f3a6adc9640 1 -- 172.21.15.134:0/2427472203 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a5c024030 con 0x5555c8e4b7e0 2024-04-24T02:12:24.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.374+0000 7f3a6adc9640 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e4e1b0 con 0x5555c8e4b7e0 2024-04-24T02:12:24.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.374+0000 7f3a6adc9640 1 -- 172.21.15.134:0/2427472203 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a5c024030 con 0x5555c8e4b7e0 2024-04-24T02:12:24.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.374+0000 7f3a6adc9640 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e4e1b0 con 0x5555c8e45590 2024-04-24T02:12:24.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.374+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a64075030 con 0x5555c8e45590 2024-04-24T02:12:24.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.374+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e4e1b0 con 0x5555c8e45590 2024-04-24T02:12:24.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.374+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f3a64075030 con 0x5555c8e45590 2024-04-24T02:12:24.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.374+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e4e1b0 con 0x7f3a6c031040 2024-04-24T02:12:24.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.375+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a64075030 con 0x7f3a6c031040 2024-04-24T02:12:24.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.375+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e4e1b0 con 0x5555c8e4b7e0 2024-04-24T02:12:24.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.375+0000 7f3a6adc9640 1 -- 172.21.15.134:0/2427472203 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a5c024030 con 0x5555c8e4b7e0 2024-04-24T02:12:24.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.375+0000 7f3a6adc9640 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e4e1b0 con 0x7f3a5c027060 2024-04-24T02:12:24.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.375+0000 7f3a73dcb640 1 -- 172.21.15.134:0/2427472203 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a6c01f070 con 0x7f3a5c027060 2024-04-24T02:12:24.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.375+0000 7f3a73dcb640 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e4e1b0 con 0x5555c8e45590 2024-04-24T02:12:24.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.375+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a64075030 con 0x5555c8e45590 2024-04-24T02:12:24.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.376+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e4e1b0 con 0x7f3a6c031040 2024-04-24T02:12:24.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.376+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a64075030 con 0x7f3a6c031040 2024-04-24T02:12:24.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.376+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e4e1b0 con 0x5555c8e4b7e0 2024-04-24T02:12:24.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.376+0000 7f3a6adc9640 1 -- 172.21.15.134:0/2427472203 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a5c024030 con 0x5555c8e4b7e0 2024-04-24T02:12:24.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.376+0000 7f3a6adc9640 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e4e1b0 con 0x7f3a6c031040 2024-04-24T02:12:24.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.376+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a64075030 con 0x7f3a6c031040 2024-04-24T02:12:24.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.376+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e4e1b0 con 0x7f3a5c027060 2024-04-24T02:12:24.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.377+0000 7f3a73dcb640 1 -- 172.21.15.134:0/2427472203 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a6c01f070 con 0x7f3a5c027060 2024-04-24T02:12:24.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.377+0000 7f3a73dcb640 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e4e1b0 con 0x5555c8e4b7e0 2024-04-24T02:12:24.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.377+0000 7f3a6adc9640 1 -- 172.21.15.134:0/2427472203 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a5c024030 con 0x5555c8e4b7e0 2024-04-24T02:12:24.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.377+0000 7f3a6adc9640 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e4e1b0 con 0x7f3a6c031040 2024-04-24T02:12:24.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.377+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a64075030 con 0x7f3a6c031040 2024-04-24T02:12:24.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.377+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e4e1b0 con 0x5555c8e45590 2024-04-24T02:12:24.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.377+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3a64075030 con 0x5555c8e45590 2024-04-24T02:12:24.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.378+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e4e1b0 con 0x7f3a5c027060 2024-04-24T02:12:24.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.378+0000 7f3a73dcb640 1 -- 172.21.15.134:0/2427472203 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a6c01f070 con 0x7f3a5c027060 2024-04-24T02:12:24.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.378+0000 7f3a7791f800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:24.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.378+0000 7f3a7791f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:24.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.378+0000 7f3a7791f800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:24.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.378+0000 7f3a7791f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:24.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.378+0000 7f3a7791f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:24.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.378+0000 7f3a7791f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:24.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.378+0000 7f3a7791f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.378+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e4a420 con 0x5555c8e45590 2024-04-24T02:12:24.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.378+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3a64075030 con 0x5555c8e45590 2024-04-24T02:12:24.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.378+0000 7f3a7791f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:24.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.378+0000 7f3a7791f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.378+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e4acc0 con 0x5555c8e45590 2024-04-24T02:12:24.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.378+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3a64075030 con 0x5555c8e45590 2024-04-24T02:12:24.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.378+0000 7f3a7791f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:24.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.378+0000 7f3a7791f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.378+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e4e630 con 0x5555c8e45590 2024-04-24T02:12:24.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.378+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3a64075030 con 0x5555c8e45590 2024-04-24T02:12:24.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.378+0000 7f3a7791f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:24.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.378+0000 7f3a7791f800 20 zone default found 2024-04-24T02:12:24.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.378+0000 7f3a7791f800 4 Realm: () 2024-04-24T02:12:24.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.378+0000 7f3a7791f800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:24.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.378+0000 7f3a7791f800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:24.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.379+0000 7f3a7791f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:24.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.379+0000 7f3a7791f800 20 zonegroup default 2024-04-24T02:12:24.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.379+0000 7f3a7791f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.379+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e4eae0 con 0x7f3a6c031040 2024-04-24T02:12:24.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.379+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3a64075030 con 0x7f3a6c031040 2024-04-24T02:12:24.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.379+0000 7f3a7791f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:24.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.379+0000 7f3a7791f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.379+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e504c0 con 0x5555c8e4b7e0 2024-04-24T02:12:24.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.379+0000 7f3a6adc9640 1 -- 172.21.15.134:0/2427472203 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3a5c024030 con 0x5555c8e4b7e0 2024-04-24T02:12:24.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.379+0000 7f3a7791f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:24.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.379+0000 7f3a7791f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.379+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e50960 con 0x5555c8e4b7e0 2024-04-24T02:12:24.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.380+0000 7f3a6adc9640 1 -- 172.21.15.134:0/2427472203 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3a5c024030 con 0x5555c8e4b7e0 2024-04-24T02:12:24.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.380+0000 7f3a7791f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:24.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.380+0000 7f3a7791f800 20 started sync module instance, tier type = 2024-04-24T02:12:24.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.380+0000 7f3a7791f800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:24.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.380+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e4f950 con 0x7f3a5c027060 2024-04-24T02:12:24.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.381+0000 7f3a73dcb640 1 -- 172.21.15.134:0/2427472203 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a6c040040 con 0x7f3a5c027060 2024-04-24T02:12:24.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.381+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93826931031360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e51270 con 0x7f3a5c027060 2024-04-24T02:12:24.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.381+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e51ac0 con 0x5555c8e45590 2024-04-24T02:12:24.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.382+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a64075030 con 0x5555c8e45590 2024-04-24T02:12:24.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.382+0000 7f3a73dcb640 1 -- 172.21.15.134:0/2427472203 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93826931031360] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a6c040040 con 0x7f3a5c027060 2024-04-24T02:12:24.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.382+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93826931035584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e51730 con 0x5555c8e45590 2024-04-24T02:12:24.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.382+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e52250 con 0x5555c8e4b7e0 2024-04-24T02:12:24.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.383+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93826931035584] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a64075030 con 0x5555c8e45590 2024-04-24T02:12:24.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.383+0000 7f3a6adc9640 1 -- 172.21.15.134:0/2427472203 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a5c024030 con 0x5555c8e4b7e0 2024-04-24T02:12:24.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.383+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93826931039520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e52640 con 0x5555c8e4b7e0 2024-04-24T02:12:24.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.383+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e53060 con 0x7f3a5c027060 2024-04-24T02:12:24.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.384+0000 7f3a73dcb640 1 -- 172.21.15.134:0/2427472203 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a6c040040 con 0x7f3a5c027060 2024-04-24T02:12:24.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.384+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93826931043152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e53900 con 0x7f3a5c027060 2024-04-24T02:12:24.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.384+0000 7f3a6adc9640 1 -- 172.21.15.134:0/2427472203 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93826931039520] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a5c024030 con 0x5555c8e4b7e0 2024-04-24T02:12:24.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.384+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e543e0 con 0x5555c8e45590 2024-04-24T02:12:24.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.385+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a64075030 con 0x5555c8e45590 2024-04-24T02:12:24.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.385+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93826931036720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e543e0 con 0x5555c8e45590 2024-04-24T02:12:24.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.385+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e54e20 con 0x7f3a6c031040 2024-04-24T02:12:24.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.385+0000 7f3a73dcb640 1 -- 172.21.15.134:0/2427472203 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93826931043152] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a6c040040 con 0x7f3a5c027060 2024-04-24T02:12:24.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.386+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a64075030 con 0x7f3a6c031040 2024-04-24T02:12:24.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.386+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93826931036720] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a64075030 con 0x5555c8e45590 2024-04-24T02:12:24.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.386+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93826931050736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e54de0 con 0x7f3a6c031040 2024-04-24T02:12:24.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.386+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e55380 con 0x7f3a6c031040 2024-04-24T02:12:24.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.387+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93826931050736] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a64075030 con 0x7f3a6c031040 2024-04-24T02:12:24.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.387+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(56 notify.6 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a64075030 con 0x7f3a6c031040 2024-04-24T02:12:24.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.387+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93826931048176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e55380 con 0x7f3a6c031040 2024-04-24T02:12:24.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.387+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e55d40 con 0x7f3a6c031040 2024-04-24T02:12:24.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.389+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(58 notify.7 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a64075030 con 0x7f3a6c031040 2024-04-24T02:12:24.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.389+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93826931054736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e56160 con 0x7f3a6c031040 2024-04-24T02:12:24.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.389+0000 7f3a7791f800 20 add_watcher() i=0 2024-04-24T02:12:24.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.389+0000 7f3a7791f800 20 add_watcher() i=1 2024-04-24T02:12:24.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.389+0000 7f3a7791f800 20 add_watcher() i=2 2024-04-24T02:12:24.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.389+0000 7f3a7791f800 20 add_watcher() i=3 2024-04-24T02:12:24.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.389+0000 7f3a7791f800 20 add_watcher() i=4 2024-04-24T02:12:24.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.389+0000 7f3a7791f800 20 add_watcher() i=5 2024-04-24T02:12:24.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.389+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93826931048176] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a64075030 con 0x7f3a6c031040 2024-04-24T02:12:24.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.389+0000 7f3a7791f800 20 add_watcher() i=6 2024-04-24T02:12:24.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.390+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93826931054736] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a64075030 con 0x7f3a6c031040 2024-04-24T02:12:24.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.390+0000 7f3a7791f800 20 add_watcher() i=7 2024-04-24T02:12:24.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.390+0000 7f3a7791f800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:24.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.390+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e53450 con 0x5555c8e45590 2024-04-24T02:12:24.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.390+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3a64075030 con 0x5555c8e45590 2024-04-24T02:12:24.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.391+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93826931045456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e56630 con 0x5555c8e45590 2024-04-24T02:12:24.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.391+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93826931045456] v30'90 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3a64075030 con 0x5555c8e45590 2024-04-24T02:12:24.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.392+0000 7f3929fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:24.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.392+0000 7f3a7791f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:24.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.392+0000 7f3a7791f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:24.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.392+0000 7f3a7791f800 5 note: GC not initialized 2024-04-24T02:12:24.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.392+0000 7f3928fe1640 20 reqs_thread_entry: start 2024-04-24T02:12:24.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.392+0000 7f3a7791f800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:24.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.392+0000 7f3a7791f800 20 Filter name: none 2024-04-24T02:12:24.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.392+0000 7f38a27fc640 20 reqs_thread_entry: start 2024-04-24T02:12:24.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.392+0000 7f3a7791f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T02:12:24.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.392+0000 7f3a7791f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.392+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e8c460 con 0x5555c8e45590 2024-04-24T02:12:24.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.393+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 foo [call out=48b,read 0~582 out=582b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+705 (crc 0 0 0) 0x7f3a64075030 con 0x5555c8e45590 2024-04-24T02:12:24.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.393+0000 7f3a7791f800 20 rados_obj.operate() r=0 bl.length=582 2024-04-24T02:12:24.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.393+0000 7f3a7791f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T02:12:24.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.393+0000 7f3a7791f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:24.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.393+0000 7f3a7791f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:12:24.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.393+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e92a50 con 0x5555c8e45590 2024-04-24T02:12:24.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.394+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v30'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f3a64075030 con 0x5555c8e45590 2024-04-24T02:12:24.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.394+0000 7f3a7791f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T02:12:24.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.394+0000 7f3a7791f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:24.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.394+0000 7f3a7791f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-24T02:12:24.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.394+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93826931303616 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e8e410 con 0x5555c8e45590 2024-04-24T02:12:24.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.394+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== watch-notify(notify (1) cookie 93826931036720 notify 128849018889 ret 0) ==== 774+0+0 (crc 0 0 0) 0x5555c8e0e430 con 0x5555c8e45590 2024-04-24T02:12:24.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.394+0000 7f3956ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018889 cookie 93826931036720 notifier 4404 bl.length()=732 2024-04-24T02:12:24.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.394+0000 7f3956ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T02:12:24.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.394+0000 7f3956ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:24.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.394+0000 7f3956ffd640 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f3938003ea0 con 0x5555c8e45590 2024-04-24T02:12:24.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.394+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(64 notify.4 [notify cookie 93826931303616 out=8b] v0'0 uv75 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3a64075030 con 0x5555c8e45590 2024-04-24T02:12:24.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.394+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a64075030 con 0x5555c8e45590 2024-04-24T02:12:24.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.395+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== watch-notify(notify_complete (2) cookie 93826931303616 notify 128849018889 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5555c8e0b820 con 0x5555c8e45590 2024-04-24T02:12:24.418 INFO:teuthology.orchestra.run.smithi134.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T02:12:21.778798Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-04-24T02:12:23.936085Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T02:12:21.778786Z","tags":[],"group_ids":[]} 2024-04-24T02:12:24.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.395+0000 7f3929fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:24.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.395+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93826931045456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e8cdb0 con 0x5555c8e45590 2024-04-24T02:12:24.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.396+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93826931045456] v30'91 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3a64075030 con 0x5555c8e45590 2024-04-24T02:12:24.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.396+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93826931031360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e53450 con 0x7f3a5c027060 2024-04-24T02:12:24.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.397+0000 7f3a73dcb640 1 -- 172.21.15.134:0/2427472203 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93826931031360] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a6c040040 con 0x7f3a5c027060 2024-04-24T02:12:24.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.397+0000 7f3a7791f800 20 remove_watcher() i=0 2024-04-24T02:12:24.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.397+0000 7f3a7791f800 2 removed watcher, disabling cache 2024-04-24T02:12:24.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.397+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93826931035584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e4fd40 con 0x5555c8e45590 2024-04-24T02:12:24.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.398+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 <== osd.1 v2:172.21.15.134:6804/1487076214 30 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93826931035584] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a64075030 con 0x5555c8e45590 2024-04-24T02:12:24.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.398+0000 7f3a7791f800 20 remove_watcher() i=1 2024-04-24T02:12:24.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.398+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93826931039520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e4fd40 con 0x5555c8e4b7e0 2024-04-24T02:12:24.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.399+0000 7f3a6adc9640 1 -- 172.21.15.134:0/2427472203 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93826931039520] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a5c024030 con 0x5555c8e4b7e0 2024-04-24T02:12:24.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.399+0000 7f3a7791f800 20 remove_watcher() i=2 2024-04-24T02:12:24.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.399+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93826931043152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e51d20 con 0x7f3a5c027060 2024-04-24T02:12:24.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.400+0000 7f3a73dcb640 1 -- 172.21.15.134:0/2427472203 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93826931043152] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a6c040040 con 0x7f3a5c027060 2024-04-24T02:12:24.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.400+0000 7f3a7791f800 20 remove_watcher() i=3 2024-04-24T02:12:24.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.400+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93826931036720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e51d20 con 0x5555c8e45590 2024-04-24T02:12:24.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.401+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 <== osd.1 v2:172.21.15.134:6804/1487076214 31 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93826931036720] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a64075030 con 0x5555c8e45590 2024-04-24T02:12:24.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.401+0000 7f3a7791f800 20 remove_watcher() i=4 2024-04-24T02:12:24.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.401+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93826931050736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e51d20 con 0x7f3a6c031040 2024-04-24T02:12:24.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.402+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93826931050736] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a64075030 con 0x7f3a6c031040 2024-04-24T02:12:24.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.402+0000 7f3a7791f800 20 remove_watcher() i=5 2024-04-24T02:12:24.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.402+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93826931048176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e548f0 con 0x7f3a6c031040 2024-04-24T02:12:24.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.403+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93826931048176] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a64075030 con 0x7f3a6c031040 2024-04-24T02:12:24.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.403+0000 7f3a7791f800 20 remove_watcher() i=6 2024-04-24T02:12:24.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.403+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93826931054736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555c8e51d20 con 0x7f3a6c031040 2024-04-24T02:12:24.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.404+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93826931054736] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a64075030 con 0x7f3a6c031040 2024-04-24T02:12:24.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.404+0000 7f3a7791f800 20 remove_watcher() i=7 2024-04-24T02:12:24.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.405+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f3a6c031040 msgr2=0x7f3a6c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.405+0000 7f3a7791f800 1 --2- 172.21.15.134:0/2427472203 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f3a6c031040 0x7f3a6c032940 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.405+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5555c8e45590 msgr2=0x5555c8e47a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.405+0000 7f3a7791f800 1 --2- 172.21.15.134:0/2427472203 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5555c8e45590 0x5555c8e47a50 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.405+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f3a5c027060 msgr2=0x7f3a5c0407f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.405+0000 7f3a7791f800 1 --2- 172.21.15.134:0/2427472203 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f3a5c027060 0x7f3a5c0407f0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.405+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5555c8e4b7e0 msgr2=0x5555c8e4dbd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.405+0000 7f3a7791f800 1 --2- 172.21.15.134:0/2427472203 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5555c8e4b7e0 0x5555c8e4dbd0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.405+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f393c036950 msgr2=0x7f393c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.405+0000 7f3a7791f800 1 --2- 172.21.15.134:0/2427472203 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f393c036950 0x7f393c038e10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x5555c8e0c1d0 tx=0x7f3a6c01f000 comp rx=0 tx=0).stop 2024-04-24T02:12:24.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.405+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555c8e327c0 msgr2=0x5555c8e39e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.405+0000 7f3a7791f800 1 --2- 172.21.15.134:0/2427472203 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555c8e327c0 0x5555c8e39e30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c026fd0 tx=0x7f3a5c04c130 comp rx=0 tx=0).stop 2024-04-24T02:12:24.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.405+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 reap_dead start 2024-04-24T02:12:24.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.405+0000 7f3a735ca640 1 -- 172.21.15.134:0/2427472203 reap_dead start 2024-04-24T02:12:24.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.405+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 shutdown_connections 2024-04-24T02:12:24.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.405+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 >> 172.21.15.134:0/2427472203 conn(0x5555c8e2eb20 msgr2=0x5555c8e2c180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:24.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.405+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 shutdown_connections 2024-04-24T02:12:24.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.405+0000 7f3a7791f800 1 -- 172.21.15.134:0/2427472203 wait complete. 2024-04-24T02:12:24.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.405+0000 7f3a7791f800 1 -- 172.21.15.134:0/1847556991 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f394c036950 msgr2=0x7f394c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.405+0000 7f3a7791f800 1 --2- 172.21.15.134:0/1847556991 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f394c036950 0x7f394c038e10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x5555c8e13370 tx=0x7f3a6c005840 comp rx=0 tx=0).stop 2024-04-24T02:12:24.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.405+0000 7f3a7791f800 1 -- 172.21.15.134:0/1847556991 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555c8c87be0 msgr2=0x5555c8c86050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.405+0000 7f3a7791f800 1 --2- 172.21.15.134:0/1847556991 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555c8c87be0 0x5555c8c86050 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c00e630 tx=0x7f3a5c00ea30 comp rx=0 tx=0).stop 2024-04-24T02:12:24.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.405+0000 7f3a7791f800 1 -- 172.21.15.134:0/1847556991 shutdown_connections 2024-04-24T02:12:24.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.405+0000 7f3a7791f800 1 --2- 172.21.15.134:0/1847556991 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f394c036950 0x7f394c038e10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.405+0000 7f3a7791f800 1 --2- 172.21.15.134:0/1847556991 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555c8c87be0 0x5555c8c86050 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.405+0000 7f3a7791f800 1 -- 172.21.15.134:0/1847556991 >> 172.21.15.134:0/1847556991 conn(0x5555c8e17380 msgr2=0x5555c8e17780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:24.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.405+0000 7f3a7791f800 1 -- 172.21.15.134:0/1847556991 shutdown_connections 2024-04-24T02:12:24.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.405+0000 7f3a7791f800 1 -- 172.21.15.134:0/1847556991 wait complete. 2024-04-24T02:12:24.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.406+0000 7f3a7791f800 1 -- 172.21.15.134:0/390300167 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5555c8d13100 msgr2=0x5555c8e121f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.406+0000 7f3a7791f800 1 --2- 172.21.15.134:0/390300167 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5555c8d13100 0x5555c8e121f0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.406+0000 7f3a7791f800 1 -- 172.21.15.134:0/390300167 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3958036950 msgr2=0x7f3958038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.406+0000 7f3a7791f800 1 --2- 172.21.15.134:0/390300167 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3958036950 0x7f3958038e10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c001e40 tx=0x7f3a5c0013a0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.406+0000 7f3a7791f800 1 -- 172.21.15.134:0/390300167 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555c8d11f90 msgr2=0x5555c8e0b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.406+0000 7f3a7791f800 1 --2- 172.21.15.134:0/390300167 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555c8d11f90 0x5555c8e0b050 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3a64052540 tx=0x7f3a64003020 comp rx=0 tx=0).stop 2024-04-24T02:12:24.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.406+0000 7f3a7791f800 1 -- 172.21.15.134:0/390300167 shutdown_connections 2024-04-24T02:12:24.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.406+0000 7f3a7791f800 1 --2- 172.21.15.134:0/390300167 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5555c8d13100 0x5555c8e121f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.406+0000 7f3a7791f800 1 --2- 172.21.15.134:0/390300167 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3958036950 0x7f3958038e10 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.406+0000 7f3a7791f800 1 --2- 172.21.15.134:0/390300167 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555c8d11f90 0x5555c8e0b050 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.406+0000 7f3a7791f800 1 -- 172.21.15.134:0/390300167 >> 172.21.15.134:0/390300167 conn(0x5555c8d0d530 msgr2=0x5555c8dfd6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:24.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.406+0000 7f3a7791f800 1 -- 172.21.15.134:0/390300167 shutdown_connections 2024-04-24T02:12:24.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.406+0000 7f3a7791f800 1 -- 172.21.15.134:0/390300167 wait complete. 2024-04-24T02:12:24.429 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T02:12:21.778798Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-04-24T02:12:23.936085Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:12:21.778786Z', 'tags': [], 'group_ids': []} 2024-04-24T02:12:24.429 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-04-24T02:12:24.429 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-04-24T02:12:24.430 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-04-24T02:12:24.510 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:24.510 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:24.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.509+0000 7f492e211800 1 Processor -- start 2024-04-24T02:12:24.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.509+0000 7f492e211800 1 -- start start 2024-04-24T02:12:24.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.509+0000 7f492e211800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5651d62ad190 0x5651d62af650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.509+0000 7f492e211800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5651d6167d40 con 0x5651d621ca70 2024-04-24T02:12:24.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.509+0000 7f492e211800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x5651d613a4d0 con 0x5651d62ad190 2024-04-24T02:12:24.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.510+0000 7f4929169640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5651d62ad190 0x5651d62af650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.510+0000 7f4929169640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5651d62ad190 0x5651d62af650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46546/0 (socket says 172.21.15.134:46546) 2024-04-24T02:12:24.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.510+0000 7f4929169640 1 -- 172.21.15.134:0/3030399626 learned_addr learned my addr 172.21.15.134:0/3030399626 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:24.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.510+0000 7f492996a640 1 --1- 172.21.15.134:0/3030399626 >> v1:172.21.15.104:6789/0 conn(0x5651d621ca70 0x5651d62aba40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:43374/0 (socket says 172.21.15.134:43374) 2024-04-24T02:12:24.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.510+0000 7f4929169640 1 -- 172.21.15.134:0/3030399626 >> v1:172.21.15.104:6789/0 conn(0x5651d621ca70 legacy=0x5651d62aba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.510+0000 7f4928968640 1 -- 172.21.15.134:0/3030399626 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2325135366 0 0) 0x5651d6167d40 con 0x5651d621ca70 2024-04-24T02:12:24.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.510+0000 7f4929169640 1 -- 172.21.15.134:0/3030399626 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651d6166590 con 0x5651d62ad190 2024-04-24T02:12:24.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.512+0000 7f4929169640 1 --2- 172.21.15.134:0/3030399626 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651d62ad190 0x5651d62af650 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f492000a520 tx=0x7f492001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cb4ff514afc67e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.512+0000 7f4928968640 1 -- 172.21.15.134:0/3030399626 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4920057070 con 0x5651d62ad190 2024-04-24T02:12:24.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.512+0000 7f4928968640 1 -- 172.21.15.134:0/3030399626 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4920052570 con 0x5651d62ad190 2024-04-24T02:12:24.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.512+0000 7f4928968640 1 -- 172.21.15.134:0/3030399626 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f492004ae60 con 0x5651d62ad190 2024-04-24T02:12:24.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.512+0000 7f492e211800 1 -- 172.21.15.134:0/3030399626 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651d62ad190 msgr2=0x5651d62af650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.512+0000 7f492e211800 1 --2- 172.21.15.134:0/3030399626 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651d62ad190 0x5651d62af650 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f492000a520 tx=0x7f492001d010 comp rx=0 tx=0).stop 2024-04-24T02:12:24.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.512+0000 7f492e211800 1 -- 172.21.15.134:0/3030399626 shutdown_connections 2024-04-24T02:12:24.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.512+0000 7f492e211800 1 --2- 172.21.15.134:0/3030399626 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651d62ad190 0x5651d62af650 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.512+0000 7f492e211800 1 -- 172.21.15.134:0/3030399626 >> 172.21.15.134:0/3030399626 conn(0x5651d62a3340 msgr2=0x5651d62a5760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:24.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.512+0000 7f492e211800 1 -- 172.21.15.134:0/3030399626 shutdown_connections 2024-04-24T02:12:24.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.512+0000 7f492e211800 1 -- 172.21.15.134:0/3030399626 wait complete. 2024-04-24T02:12:24.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.524+0000 7f492e211800 1 Processor -- start 2024-04-24T02:12:24.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.524+0000 7f492e211800 1 -- start start 2024-04-24T02:12:24.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.524+0000 7f492e211800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651d621ca70 0x5651d6399ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.524+0000 7f492e211800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5651d61f43e0 con 0x5651d621ca70 2024-04-24T02:12:24.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.524+0000 7f492996a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651d621ca70 0x5651d6399ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.524+0000 7f492996a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651d621ca70 0x5651d6399ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46554/0 (socket says 172.21.15.134:46554) 2024-04-24T02:12:24.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.524+0000 7f492996a640 1 -- 172.21.15.134:0/2163336920 learned_addr learned my addr 172.21.15.134:0/2163336920 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:24.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.525+0000 7f492996a640 1 -- 172.21.15.134:0/2163336920 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651d639a470 con 0x5651d621ca70 2024-04-24T02:12:24.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.525+0000 7f492996a640 1 --2- 172.21.15.134:0/2163336920 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651d621ca70 0x5651d6399ea0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f491c00b210 tx=0x7f491c00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ac7e3c3875644ba server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.525+0000 7f4817e07640 1 -- 172.21.15.134:0/2163336920 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f491c008070 con 0x5651d621ca70 2024-04-24T02:12:24.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.525+0000 7f4817e07640 1 -- 172.21.15.134:0/2163336920 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f491c00d500 con 0x5651d621ca70 2024-04-24T02:12:24.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.525+0000 7f4817e07640 1 -- 172.21.15.134:0/2163336920 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f491c00d840 con 0x5651d621ca70 2024-04-24T02:12:24.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.526+0000 7f492e211800 1 -- 172.21.15.134:0/2163336920 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651d621ca70 msgr2=0x5651d6399ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.526+0000 7f492e211800 1 --2- 172.21.15.134:0/2163336920 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651d621ca70 0x5651d6399ea0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f491c00b210 tx=0x7f491c00b6d0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.526+0000 7f492e211800 1 -- 172.21.15.134:0/2163336920 shutdown_connections 2024-04-24T02:12:24.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.526+0000 7f492e211800 1 --2- 172.21.15.134:0/2163336920 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651d621ca70 0x5651d6399ea0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.526+0000 7f492e211800 1 -- 172.21.15.134:0/2163336920 >> 172.21.15.134:0/2163336920 conn(0x5651d62a3340 msgr2=0x5651d63957c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:24.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.526+0000 7f492e211800 1 -- 172.21.15.134:0/2163336920 shutdown_connections 2024-04-24T02:12:24.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.526+0000 7f492e211800 1 -- 172.21.15.134:0/2163336920 wait complete. 2024-04-24T02:12:24.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.526+0000 7f492e211800 1 Processor -- start 2024-04-24T02:12:24.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.526+0000 7f492e211800 1 -- start start 2024-04-24T02:12:24.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.526+0000 7f492e211800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651d621ca70 0x5651d62a9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.526+0000 7f492e211800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5651d62b0000 con 0x5651d621ca70 2024-04-24T02:12:24.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.526+0000 7f492996a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651d621ca70 0x5651d62a9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.526+0000 7f492996a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651d621ca70 0x5651d62a9340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46570/0 (socket says 172.21.15.134:46570) 2024-04-24T02:12:24.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.526+0000 7f492996a640 1 -- 172.21.15.134:0/4121834781 learned_addr learned my addr 172.21.15.134:0/4121834781 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:24.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.527+0000 7f492996a640 1 -- 172.21.15.134:0/4121834781 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651d62a7a80 con 0x5651d621ca70 2024-04-24T02:12:24.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.527+0000 7f492996a640 1 --2- 172.21.15.134:0/4121834781 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651d621ca70 0x5651d62a9340 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f491c00b210 tx=0x7f491c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.527+0000 7f4816604640 1 -- 172.21.15.134:0/4121834781 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f491c00f950 con 0x5651d621ca70 2024-04-24T02:12:24.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.527+0000 7f4816604640 1 -- 172.21.15.134:0/4121834781 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f491c00faf0 con 0x5651d621ca70 2024-04-24T02:12:24.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.527+0000 7f492e211800 1 -- 172.21.15.134:0/4121834781 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5651d62a7d10 con 0x5651d621ca70 2024-04-24T02:12:24.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.527+0000 7f4816604640 1 -- 172.21.15.134:0/4121834781 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f491c00fdd0 con 0x5651d621ca70 2024-04-24T02:12:24.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.527+0000 7f492e211800 1 -- 172.21.15.134:0/4121834781 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651d62a8230 con 0x5651d621ca70 2024-04-24T02:12:24.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.528+0000 7f4816604640 1 -- 172.21.15.134:0/4121834781 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f491c017040 con 0x5651d621ca70 2024-04-24T02:12:24.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.528+0000 7f4816604640 1 --2- 172.21.15.134:0/4121834781 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4810036900 0x7f4810038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.528+0000 7f4816604640 1 -- 172.21.15.134:0/4121834781 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f491c015020 con 0x5651d621ca70 2024-04-24T02:12:24.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.528+0000 7f4929169640 1 --2- 172.21.15.134:0/4121834781 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4810036900 0x7f4810038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.528+0000 7f492e211800 1 --2- 172.21.15.134:0/4121834781 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5651d62ad190 0x5651d63aaf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.528+0000 7f492e211800 1 -- 172.21.15.134:0/4121834781 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5651d63ab440 con 0x5651d62ad190 2024-04-24T02:12:24.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.528+0000 7f492a16b640 1 --2- 172.21.15.134:0/4121834781 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5651d62ad190 0x5651d63aaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.528+0000 7f4929169640 1 --2- 172.21.15.134:0/4121834781 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4810036900 0x7f4810038dc0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4920054000 tx=0x7f492004e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.529+0000 7f492a16b640 1 --2- 172.21.15.134:0/4121834781 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5651d62ad190 0x5651d63aaf00 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.529+0000 7f492a16b640 1 -- 172.21.15.134:0/4121834781 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f492400a4a0 con 0x5651d62ad190 2024-04-24T02:12:24.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.529+0000 7f492e211800 1 -- 172.21.15.134:0/4121834781 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5651d62a85c0 con 0x5651d62ad190 2024-04-24T02:12:24.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.529+0000 7f492a16b640 1 -- 172.21.15.134:0/4121834781 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f492400a4a0 con 0x5651d62ad190 2024-04-24T02:12:24.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.529+0000 7f492e211800 1 -- 172.21.15.134:0/4121834781 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5651d63ad260 con 0x5651d62ad190 2024-04-24T02:12:24.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.529+0000 7f492a16b640 1 -- 172.21.15.134:0/4121834781 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f492400a4a0 con 0x5651d62ad190 2024-04-24T02:12:24.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.529+0000 7f492e211800 1 -- 172.21.15.134:0/4121834781 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5651d63ac5a0 con 0x5651d62ad190 2024-04-24T02:12:24.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.530+0000 7f492a16b640 1 -- 172.21.15.134:0/4121834781 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f492400a4a0 con 0x5651d62ad190 2024-04-24T02:12:24.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.530+0000 7f492e211800 1 -- 172.21.15.134:0/4121834781 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5651d63ac9f0 con 0x5651d62ad190 2024-04-24T02:12:24.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.530+0000 7f492a16b640 1 -- 172.21.15.134:0/4121834781 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f492400a4a0 con 0x5651d62ad190 2024-04-24T02:12:24.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.530+0000 7f492e211800 1 Processor -- start 2024-04-24T02:12:24.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.530+0000 7f492e211800 1 -- start start 2024-04-24T02:12:24.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.530+0000 7f492e211800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651d63bbfd0 0x5651d63bc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.530+0000 7f492e211800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5651d619a6b0 con 0x5651d63bbfd0 2024-04-24T02:12:24.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.531+0000 7f4929169640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651d63bbfd0 0x5651d63bc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.531+0000 7f4929169640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651d63bbfd0 0x5651d63bc3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46574/0 (socket says 172.21.15.134:46574) 2024-04-24T02:12:24.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.531+0000 7f4929169640 1 -- 172.21.15.134:0/1317251156 learned_addr learned my addr 172.21.15.134:0/1317251156 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:24.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.531+0000 7f4929169640 1 -- 172.21.15.134:0/1317251156 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651d63bc930 con 0x5651d63bbfd0 2024-04-24T02:12:24.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.531+0000 7f4929169640 1 --2- 172.21.15.134:0/1317251156 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651d63bbfd0 0x5651d63bc3f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4920055040 tx=0x7f4920002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.531+0000 7f480f7fe640 1 -- 172.21.15.134:0/1317251156 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4920057040 con 0x5651d63bbfd0 2024-04-24T02:12:24.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.531+0000 7f480f7fe640 1 -- 172.21.15.134:0/1317251156 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f492006d070 con 0x5651d63bbfd0 2024-04-24T02:12:24.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.531+0000 7f480f7fe640 1 -- 172.21.15.134:0/1317251156 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f492005d650 con 0x5651d63bbfd0 2024-04-24T02:12:24.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.531+0000 7f492e211800 1 -- 172.21.15.134:0/1317251156 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5651d63bd3a0 con 0x5651d63bbfd0 2024-04-24T02:12:24.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.532+0000 7f492e211800 1 -- 172.21.15.134:0/1317251156 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651d63bd840 con 0x5651d63bbfd0 2024-04-24T02:12:24.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.532+0000 7f480f7fe640 1 -- 172.21.15.134:0/1317251156 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4920067070 con 0x5651d63bbfd0 2024-04-24T02:12:24.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.532+0000 7f480f7fe640 1 --2- 172.21.15.134:0/1317251156 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4804036900 0x7f4804038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.532+0000 7f480f7fe640 1 -- 172.21.15.134:0/1317251156 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f492008f5d0 con 0x5651d63bbfd0 2024-04-24T02:12:24.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.532+0000 7f492a16b640 1 --2- 172.21.15.134:0/1317251156 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4804036900 0x7f4804038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.533+0000 7f492e211800 1 Processor -- start 2024-04-24T02:12:24.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.533+0000 7f492e211800 1 -- start start 2024-04-24T02:12:24.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.533+0000 7f492a16b640 1 --2- 172.21.15.134:0/1317251156 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4804036900 0x7f4804038dc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x5651d63ac0c0 tx=0x7f4924005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.533+0000 7f492e211800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651d63c9290 0x5651d63c96b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.533+0000 7f492e211800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5651d639a7f0 con 0x5651d63c9290 2024-04-24T02:12:24.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.533+0000 7f4929169640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651d63c9290 0x5651d63c96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.533+0000 7f4929169640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651d63c9290 0x5651d63c96b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46586/0 (socket says 172.21.15.134:46586) 2024-04-24T02:12:24.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.533+0000 7f4929169640 1 -- 172.21.15.134:0/1781340771 learned_addr learned my addr 172.21.15.134:0/1781340771 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:24.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.533+0000 7f4929169640 1 -- 172.21.15.134:0/1781340771 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651d63c9c80 con 0x5651d63c9290 2024-04-24T02:12:24.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.534+0000 7f4929169640 1 --2- 172.21.15.134:0/1781340771 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651d63c9290 0x5651d63c96b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f492008dab0 tx=0x7f4920067ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85e5ceae4d331d2f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.534+0000 7f480d7fa640 1 -- 172.21.15.134:0/1781340771 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4920006e60 con 0x5651d63c9290 2024-04-24T02:12:24.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.534+0000 7f480d7fa640 1 -- 172.21.15.134:0/1781340771 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f492005cc70 con 0x5651d63c9290 2024-04-24T02:12:24.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.534+0000 7f480d7fa640 1 -- 172.21.15.134:0/1781340771 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4920072910 con 0x5651d63c9290 2024-04-24T02:12:24.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.534+0000 7f492e211800 1 -- 172.21.15.134:0/1781340771 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651d63c9290 msgr2=0x5651d63c96b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.534+0000 7f492e211800 1 --2- 172.21.15.134:0/1781340771 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651d63c9290 0x5651d63c96b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f492008dab0 tx=0x7f4920067ab0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.534+0000 7f492e211800 1 -- 172.21.15.134:0/1781340771 shutdown_connections 2024-04-24T02:12:24.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.534+0000 7f492e211800 1 --2- 172.21.15.134:0/1781340771 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651d63c9290 0x5651d63c96b0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.534+0000 7f492e211800 1 -- 172.21.15.134:0/1781340771 >> 172.21.15.134:0/1781340771 conn(0x5651d63c55b0 msgr2=0x5651d63c3610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:24.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.534+0000 7f492e211800 1 -- 172.21.15.134:0/1781340771 shutdown_connections 2024-04-24T02:12:24.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.534+0000 7f492e211800 1 -- 172.21.15.134:0/1781340771 wait complete. 2024-04-24T02:12:24.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.534+0000 7f492e211800 1 Processor -- start 2024-04-24T02:12:24.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.534+0000 7f492e211800 1 -- start start 2024-04-24T02:12:24.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.535+0000 7f492e211800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651d63c9290 0x5651d63d08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.535+0000 7f492e211800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5651d63ca400 con 0x5651d63c9290 2024-04-24T02:12:24.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.535+0000 7f4929169640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651d63c9290 0x5651d63d08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.535+0000 7f4929169640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651d63c9290 0x5651d63d08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46602/0 (socket says 172.21.15.134:46602) 2024-04-24T02:12:24.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.535+0000 7f4929169640 1 -- 172.21.15.134:0/3009528766 learned_addr learned my addr 172.21.15.134:0/3009528766 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:24.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.535+0000 7f4929169640 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651d63d0e10 con 0x5651d63c9290 2024-04-24T02:12:24.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.535+0000 7f4929169640 1 --2- 172.21.15.134:0/3009528766 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651d63c9290 0x5651d63d08d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4920067f90 tx=0x7f492008da40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.535+0000 7f47fb7fe640 1 -- 172.21.15.134:0/3009528766 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4920006e60 con 0x5651d63c9290 2024-04-24T02:12:24.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.535+0000 7f47fb7fe640 1 -- 172.21.15.134:0/3009528766 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4920093070 con 0x5651d63c9290 2024-04-24T02:12:24.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.535+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5651d63d10a0 con 0x5651d63c9290 2024-04-24T02:12:24.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.535+0000 7f47fb7fe640 1 -- 172.21.15.134:0/3009528766 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f492005daa0 con 0x5651d63c9290 2024-04-24T02:12:24.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.535+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651d63d3d50 con 0x5651d63c9290 2024-04-24T02:12:24.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.536+0000 7f47fb7fe640 1 -- 172.21.15.134:0/3009528766 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f492005dc40 con 0x5651d63c9290 2024-04-24T02:12:24.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.536+0000 7f47fb7fe640 1 --2- 172.21.15.134:0/3009528766 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f47f4036950 0x7f47f4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.536+0000 7f47fb7fe640 1 -- 172.21.15.134:0/3009528766 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f4920099b20 con 0x5651d63c9290 2024-04-24T02:12:24.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.536+0000 7f492a16b640 1 --2- 172.21.15.134:0/3009528766 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f47f4036950 0x7f47f4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.537+0000 7f492e211800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.537+0000 7f492a16b640 1 --2- 172.21.15.134:0/3009528766 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f47f4036950 0x7f47f4038e10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x5651d62a8510 tx=0x7f492401f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.537+0000 7f492e211800 1 --2- 172.21.15.134:0/3009528766 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5651d63dc3d0 0x5651d63de890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.537+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5651d63defe0 con 0x5651d63dc3d0 2024-04-24T02:12:24.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.537+0000 7f492996a640 1 --2- 172.21.15.134:0/3009528766 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5651d63dc3d0 0x5651d63de890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.537+0000 7f492996a640 1 --2- 172.21.15.134:0/3009528766 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5651d63dc3d0 0x5651d63de890 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.537+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f491c02d070 con 0x5651d63dc3d0 2024-04-24T02:12:24.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.537+0000 7f492e211800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:24.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.537+0000 7f492e211800 20 realm 2024-04-24T02:12:24.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.537+0000 7f492e211800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.537+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5651d63df3f0 con 0x5651d63dc3d0 2024-04-24T02:12:24.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.537+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f491c02d070 con 0x5651d63dc3d0 2024-04-24T02:12:24.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.537+0000 7f492e211800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:24.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.538+0000 7f492e211800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:24.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.538+0000 7f492e211800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.538+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5651d63dfcc0 con 0x5651d63dc3d0 2024-04-24T02:12:24.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.538+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f491c02d070 con 0x5651d63dc3d0 2024-04-24T02:12:24.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.538+0000 7f492e211800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:24.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.538+0000 7f492e211800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.538+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e0060 con 0x5651d63dc3d0 2024-04-24T02:12:24.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.538+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f491c02d070 con 0x5651d63dc3d0 2024-04-24T02:12:24.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.538+0000 7f492e211800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:24.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.538+0000 7f492e211800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.538+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e08b0 con 0x5651d63dc3d0 2024-04-24T02:12:24.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.538+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f491c02d070 con 0x5651d63dc3d0 2024-04-24T02:12:24.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.538+0000 7f492e211800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:24.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.538+0000 7f492e211800 20 searching for the correct realm 2024-04-24T02:12:24.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.538+0000 7f492e211800 1 --2- 172.21.15.134:0/3009528766 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5651d63e2620 0x5651d63e4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.538+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e4ff0 con 0x5651d63e2620 2024-04-24T02:12:24.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.538+0000 7f4929169640 1 --2- 172.21.15.134:0/3009528766 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5651d63e2620 0x5651d63e4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.539+0000 7f4929169640 1 --2- 172.21.15.134:0/3009528766 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5651d63e2620 0x5651d63e4a10 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.539+0000 7f4929169640 1 -- 172.21.15.134:0/3009528766 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4920066030 con 0x5651d63e2620 2024-04-24T02:12:24.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.539+0000 7f4929169640 1 --2- 172.21.15.134:0/3009528766 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f492005c3e0 0x7f4920006750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.539+0000 7f4929169640 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e4ff0 con 0x7f492005c3e0 2024-04-24T02:12:24.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.539+0000 7f492a16b640 1 --2- 172.21.15.134:0/3009528766 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f492005c3e0 0x7f4920006750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.539+0000 7f492a16b640 1 --2- 172.21.15.134:0/3009528766 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f492005c3e0 0x7f4920006750 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.540+0000 7f492a16b640 1 -- 172.21.15.134:0/3009528766 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f492401f070 con 0x7f492005c3e0 2024-04-24T02:12:24.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.540+0000 7f492a16b640 1 --2- 172.21.15.134:0/3009528766 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f4924031040 0x7f4924032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.540+0000 7f492a16b640 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e4ff0 con 0x7f4924031040 2024-04-24T02:12:24.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.540+0000 7f492996a640 1 --2- 172.21.15.134:0/3009528766 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f4924031040 0x7f4924032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.540+0000 7f492996a640 1 --2- 172.21.15.134:0/3009528766 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f4924031040 0x7f4924032940 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.540+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f491c048040 con 0x7f4924031040 2024-04-24T02:12:24.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.540+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e4ff0 con 0x5651d63dc3d0 2024-04-24T02:12:24.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.541+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f491c048040 con 0x5651d63dc3d0 2024-04-24T02:12:24.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.541+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e4ff0 con 0x5651d63dc3d0 2024-04-24T02:12:24.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.541+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f491c048040 con 0x5651d63dc3d0 2024-04-24T02:12:24.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.541+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e4ff0 con 0x7f4924031040 2024-04-24T02:12:24.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.541+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f491c048040 con 0x7f4924031040 2024-04-24T02:12:24.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.541+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e4ff0 con 0x7f4924031040 2024-04-24T02:12:24.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.541+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f491c048040 con 0x7f4924031040 2024-04-24T02:12:24.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.541+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e4ff0 con 0x7f492005c3e0 2024-04-24T02:12:24.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.541+0000 7f492a16b640 1 -- 172.21.15.134:0/3009528766 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f492401f070 con 0x7f492005c3e0 2024-04-24T02:12:24.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.541+0000 7f492a16b640 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e4ff0 con 0x5651d63e2620 2024-04-24T02:12:24.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.542+0000 7f4929169640 1 -- 172.21.15.134:0/3009528766 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49200ad040 con 0x5651d63e2620 2024-04-24T02:12:24.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.542+0000 7f4929169640 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e4ff0 con 0x5651d63dc3d0 2024-04-24T02:12:24.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.542+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f491c048040 con 0x5651d63dc3d0 2024-04-24T02:12:24.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.542+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e4ff0 con 0x7f4924031040 2024-04-24T02:12:24.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.542+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f491c048040 con 0x7f4924031040 2024-04-24T02:12:24.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.542+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e4ff0 con 0x5651d63dc3d0 2024-04-24T02:12:24.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.542+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f491c048040 con 0x5651d63dc3d0 2024-04-24T02:12:24.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.542+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e4ff0 con 0x7f492005c3e0 2024-04-24T02:12:24.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.543+0000 7f492a16b640 1 -- 172.21.15.134:0/3009528766 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f492401f070 con 0x7f492005c3e0 2024-04-24T02:12:24.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.543+0000 7f492a16b640 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e4ff0 con 0x5651d63e2620 2024-04-24T02:12:24.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.543+0000 7f4929169640 1 -- 172.21.15.134:0/3009528766 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49200ad040 con 0x5651d63e2620 2024-04-24T02:12:24.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.543+0000 7f4929169640 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e4ff0 con 0x5651d63e2620 2024-04-24T02:12:24.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.543+0000 7f4929169640 1 -- 172.21.15.134:0/3009528766 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49200ad040 con 0x5651d63e2620 2024-04-24T02:12:24.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.543+0000 7f4929169640 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e4ff0 con 0x7f4924031040 2024-04-24T02:12:24.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.543+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f491c048040 con 0x7f4924031040 2024-04-24T02:12:24.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.543+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e4ff0 con 0x5651d63e2620 2024-04-24T02:12:24.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.544+0000 7f4929169640 1 -- 172.21.15.134:0/3009528766 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49200ad040 con 0x5651d63e2620 2024-04-24T02:12:24.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.544+0000 7f4929169640 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e4ff0 con 0x5651d63e2620 2024-04-24T02:12:24.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.544+0000 7f4929169640 1 -- 172.21.15.134:0/3009528766 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49200ad040 con 0x5651d63e2620 2024-04-24T02:12:24.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.544+0000 7f4929169640 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e4ff0 con 0x5651d63dc3d0 2024-04-24T02:12:24.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.544+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f491c048040 con 0x5651d63dc3d0 2024-04-24T02:12:24.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.544+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e4ff0 con 0x5651d63dc3d0 2024-04-24T02:12:24.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.544+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f491c048040 con 0x5651d63dc3d0 2024-04-24T02:12:24.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.544+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e4ff0 con 0x7f4924031040 2024-04-24T02:12:24.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.544+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f491c048040 con 0x7f4924031040 2024-04-24T02:12:24.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.544+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e4ff0 con 0x5651d63e2620 2024-04-24T02:12:24.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.545+0000 7f4929169640 1 -- 172.21.15.134:0/3009528766 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49200ad040 con 0x5651d63e2620 2024-04-24T02:12:24.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.545+0000 7f4929169640 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e4ff0 con 0x7f492005c3e0 2024-04-24T02:12:24.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.545+0000 7f492a16b640 1 -- 172.21.15.134:0/3009528766 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f492401f070 con 0x7f492005c3e0 2024-04-24T02:12:24.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.545+0000 7f492a16b640 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e4ff0 con 0x5651d63dc3d0 2024-04-24T02:12:24.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.545+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f491c048040 con 0x5651d63dc3d0 2024-04-24T02:12:24.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.545+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e4ff0 con 0x7f4924031040 2024-04-24T02:12:24.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.545+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f491c048040 con 0x7f4924031040 2024-04-24T02:12:24.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.545+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e4ff0 con 0x5651d63e2620 2024-04-24T02:12:24.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.546+0000 7f4929169640 1 -- 172.21.15.134:0/3009528766 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49200ad040 con 0x5651d63e2620 2024-04-24T02:12:24.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.546+0000 7f4929169640 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e4ff0 con 0x7f4924031040 2024-04-24T02:12:24.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.546+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f491c048040 con 0x7f4924031040 2024-04-24T02:12:24.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.546+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e4ff0 con 0x7f492005c3e0 2024-04-24T02:12:24.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.546+0000 7f492a16b640 1 -- 172.21.15.134:0/3009528766 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f492401f070 con 0x7f492005c3e0 2024-04-24T02:12:24.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.546+0000 7f492a16b640 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e4ff0 con 0x5651d63e2620 2024-04-24T02:12:24.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.546+0000 7f4929169640 1 -- 172.21.15.134:0/3009528766 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49200ad040 con 0x5651d63e2620 2024-04-24T02:12:24.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.546+0000 7f4929169640 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e4ff0 con 0x7f4924031040 2024-04-24T02:12:24.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.547+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f491c048040 con 0x7f4924031040 2024-04-24T02:12:24.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.547+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e4ff0 con 0x5651d63dc3d0 2024-04-24T02:12:24.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.548+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f491c048040 con 0x5651d63dc3d0 2024-04-24T02:12:24.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.548+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e4ff0 con 0x7f492005c3e0 2024-04-24T02:12:24.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.548+0000 7f492a16b640 1 -- 172.21.15.134:0/3009528766 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f492401f070 con 0x7f492005c3e0 2024-04-24T02:12:24.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.548+0000 7f492e211800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:24.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.548+0000 7f492e211800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:24.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.548+0000 7f492e211800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:24.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.548+0000 7f492e211800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:24.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.548+0000 7f492e211800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:24.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.548+0000 7f492e211800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:24.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.548+0000 7f492e211800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.548+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e1260 con 0x5651d63dc3d0 2024-04-24T02:12:24.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.548+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f491c048040 con 0x5651d63dc3d0 2024-04-24T02:12:24.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.548+0000 7f492e211800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:24.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.548+0000 7f492e211800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.548+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e1b00 con 0x5651d63dc3d0 2024-04-24T02:12:24.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.548+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f491c048040 con 0x5651d63dc3d0 2024-04-24T02:12:24.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.548+0000 7f492e211800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:24.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.548+0000 7f492e211800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.548+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e5470 con 0x5651d63dc3d0 2024-04-24T02:12:24.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.549+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f491c048040 con 0x5651d63dc3d0 2024-04-24T02:12:24.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.549+0000 7f492e211800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:24.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.549+0000 7f492e211800 20 zone default found 2024-04-24T02:12:24.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.549+0000 7f492e211800 4 Realm: () 2024-04-24T02:12:24.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.549+0000 7f492e211800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:24.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.549+0000 7f492e211800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:24.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.549+0000 7f492e211800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:24.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.549+0000 7f492e211800 20 zonegroup default 2024-04-24T02:12:24.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.549+0000 7f492e211800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.549+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e5920 con 0x7f4924031040 2024-04-24T02:12:24.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.549+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f491c048040 con 0x7f4924031040 2024-04-24T02:12:24.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.549+0000 7f492e211800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:24.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.549+0000 7f492e211800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.549+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e7300 con 0x5651d63e2620 2024-04-24T02:12:24.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.549+0000 7f4929169640 1 -- 172.21.15.134:0/3009528766 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f49200ad040 con 0x5651d63e2620 2024-04-24T02:12:24.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.549+0000 7f492e211800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:24.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.549+0000 7f492e211800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.549+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e77b0 con 0x5651d63e2620 2024-04-24T02:12:24.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.549+0000 7f4929169640 1 -- 172.21.15.134:0/3009528766 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f49200ad040 con 0x5651d63e2620 2024-04-24T02:12:24.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.549+0000 7f492e211800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:24.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.549+0000 7f492e211800 20 started sync module instance, tier type = 2024-04-24T02:12:24.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.550+0000 7f492e211800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:24.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.550+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e6790 con 0x7f492005c3e0 2024-04-24T02:12:24.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.551+0000 7f492a16b640 1 -- 172.21.15.134:0/3009528766 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4924040040 con 0x7f492005c3e0 2024-04-24T02:12:24.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.551+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94909486754688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e63f0 con 0x7f492005c3e0 2024-04-24T02:12:24.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.551+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e85b0 con 0x5651d63dc3d0 2024-04-24T02:12:24.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.552+0000 7f492a16b640 1 -- 172.21.15.134:0/3009528766 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94909486754688] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4924040040 con 0x7f492005c3e0 2024-04-24T02:12:24.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.552+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f491c048040 con 0x5651d63dc3d0 2024-04-24T02:12:24.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.552+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94909486758928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e84e0 con 0x5651d63dc3d0 2024-04-24T02:12:24.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.552+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e9050 con 0x5651d63e2620 2024-04-24T02:12:24.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.553+0000 7f4929169640 1 -- 172.21.15.134:0/3009528766 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49200ad040 con 0x5651d63e2620 2024-04-24T02:12:24.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.553+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94909486762816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e98a0 con 0x5651d63e2620 2024-04-24T02:12:24.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.553+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651d63ea390 con 0x7f492005c3e0 2024-04-24T02:12:24.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.553+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94909486758928] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f491c048040 con 0x5651d63dc3d0 2024-04-24T02:12:24.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.554+0000 7f4929169640 1 -- 172.21.15.134:0/3009528766 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94909486762816] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49200ad040 con 0x5651d63e2620 2024-04-24T02:12:24.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.554+0000 7f492a16b640 1 -- 172.21.15.134:0/3009528766 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4924040040 con 0x7f492005c3e0 2024-04-24T02:12:24.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.554+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94909486765040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e8030 con 0x7f492005c3e0 2024-04-24T02:12:24.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.554+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651d63eac30 con 0x5651d63dc3d0 2024-04-24T02:12:24.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.555+0000 7f492a16b640 1 -- 172.21.15.134:0/3009528766 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94909486765040] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4924040040 con 0x7f492005c3e0 2024-04-24T02:12:24.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.555+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f491c048040 con 0x5651d63dc3d0 2024-04-24T02:12:24.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.555+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94909486767712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651d63eac30 con 0x5651d63dc3d0 2024-04-24T02:12:24.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.555+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651d63eb6f0 con 0x7f4924031040 2024-04-24T02:12:24.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.556+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94909486767712] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f491c048040 con 0x5651d63dc3d0 2024-04-24T02:12:24.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.556+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f491c048040 con 0x7f4924031040 2024-04-24T02:12:24.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.556+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94909486772672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651d63eac30 con 0x7f4924031040 2024-04-24T02:12:24.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.556+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651d63ec100 con 0x7f4924031040 2024-04-24T02:12:24.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.557+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94909486772672] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f491c048040 con 0x7f4924031040 2024-04-24T02:12:24.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.559+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(56 notify.6 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f491c048040 con 0x7f4924031040 2024-04-24T02:12:24.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.559+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94909486770048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651d63ec2e0 con 0x7f4924031040 2024-04-24T02:12:24.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.559+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651d63ecb30 con 0x7f4924031040 2024-04-24T02:12:24.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.560+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94909486770048] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f491c048040 con 0x7f4924031040 2024-04-24T02:12:24.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.560+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(58 notify.7 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f491c048040 con 0x7f4924031040 2024-04-24T02:12:24.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.560+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94909486776336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651d63ec9a0 con 0x7f4924031040 2024-04-24T02:12:24.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.560+0000 7f492e211800 20 add_watcher() i=0 2024-04-24T02:12:24.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.560+0000 7f492e211800 20 add_watcher() i=1 2024-04-24T02:12:24.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.560+0000 7f492e211800 20 add_watcher() i=2 2024-04-24T02:12:24.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.560+0000 7f492e211800 20 add_watcher() i=3 2024-04-24T02:12:24.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.560+0000 7f492e211800 20 add_watcher() i=4 2024-04-24T02:12:24.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.560+0000 7f492e211800 20 add_watcher() i=5 2024-04-24T02:12:24.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.560+0000 7f492e211800 20 add_watcher() i=6 2024-04-24T02:12:24.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.561+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94909486776336] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f491c048040 con 0x7f4924031040 2024-04-24T02:12:24.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.561+0000 7f492e211800 20 add_watcher() i=7 2024-04-24T02:12:24.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.561+0000 7f492e211800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:24.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.561+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5651d63eff10 con 0x5651d63dc3d0 2024-04-24T02:12:24.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.562+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f491c048040 con 0x5651d63dc3d0 2024-04-24T02:12:24.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.562+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94909486777392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651d63ed430 con 0x5651d63dc3d0 2024-04-24T02:12:24.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.563+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94909486777392] v30'92 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f491c048040 con 0x5651d63dc3d0 2024-04-24T02:12:24.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.563+0000 7f47db7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:24.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.563+0000 7f492e211800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:24.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.563+0000 7f492e211800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:24.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.563+0000 7f492e211800 5 note: GC not initialized 2024-04-24T02:12:24.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.563+0000 7f47da7fc640 20 reqs_thread_entry: start 2024-04-24T02:12:24.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.563+0000 7f492e211800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:24.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.563+0000 7f492e211800 20 Filter name: none 2024-04-24T02:12:24.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.563+0000 7f474bfff640 20 reqs_thread_entry: start 2024-04-24T02:12:24.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.563+0000 7f492e211800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T02:12:24.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.563+0000 7f492e211800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.563+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5651d6423260 con 0x5651d63dc3d0 2024-04-24T02:12:24.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.564+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f491c048040 con 0x5651d63dc3d0 2024-04-24T02:12:24.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.564+0000 7f492e211800 20 rados_obj.operate() r=0 bl.length=556 2024-04-24T02:12:24.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.564+0000 7f492e211800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T02:12:24.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.564+0000 7f492e211800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:24.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.564+0000 7f492e211800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:12:24.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.564+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651d64299a0 con 0x5651d63dc3d0 2024-04-24T02:12:24.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.565+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v30'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f491c048040 con 0x5651d63dc3d0 2024-04-24T02:12:24.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.565+0000 7f492e211800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T02:12:24.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.565+0000 7f492e211800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:24.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.565+0000 7f492e211800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-24T02:12:24.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.565+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94909487027248 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5651d6425130 con 0x5651d63dc3d0 2024-04-24T02:12:24.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.565+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== watch-notify(notify (1) cookie 94909486767712 notify 128849018890 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f491c036040 con 0x5651d63dc3d0 2024-04-24T02:12:24.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.565+0000 7f480d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018890 cookie 94909486767712 notifier 4411 bl.length()=567 2024-04-24T02:12:24.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.565+0000 7f480d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T02:12:24.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.566+0000 7f480d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:24.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.566+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(64 notify.4 [notify cookie 94909487027248 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f491c048040 con 0x5651d63dc3d0 2024-04-24T02:12:24.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.566+0000 7f480d7fa640 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f47ec003ea0 con 0x5651d63dc3d0 2024-04-24T02:12:24.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.566+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== watch-notify(notify_complete (2) cookie 94909487027248 notify 128849018890 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5651d62a8230 con 0x5651d63dc3d0 2024-04-24T02:12:24.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.566+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f491c048040 con 0x5651d63dc3d0 2024-04-24T02:12:24.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.566+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:66 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651d6429430 con 0x7f492005c3e0 2024-04-24T02:12:24.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.567+0000 7f492a16b640 1 -- 172.21.15.134:0/3009528766 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(66 foo:foo2 [delete] v30'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4924040040 con 0x7f492005c3e0 2024-04-24T02:12:24.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.567+0000 7f492e211800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-04-24T02:12:24.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.567+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94909487027248 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5651d6424c80 con 0x7f492005c3e0 2024-04-24T02:12:24.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.567+0000 7f492a16b640 1 -- 172.21.15.134:0/3009528766 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== watch-notify(notify (1) cookie 94909486754688 notify 128849018885 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7f49240247b0 con 0x7f492005c3e0 2024-04-24T02:12:24.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.567+0000 7f480cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018885 cookie 94909486754688 notifier 4411 bl.length()=159 2024-04-24T02:12:24.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.567+0000 7f492a16b640 1 -- 172.21.15.134:0/3009528766 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(67 notify.0 [notify cookie 94909487027248 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4924040040 con 0x7f492005c3e0 2024-04-24T02:12:24.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.567+0000 7f480cff9640 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f47540032c0 con 0x7f492005c3e0 2024-04-24T02:12:24.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.568+0000 7f492a16b640 1 -- 172.21.15.134:0/3009528766 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4924040040 con 0x7f492005c3e0 2024-04-24T02:12:24.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.568+0000 7f492a16b640 1 -- 172.21.15.134:0/3009528766 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== watch-notify(notify_complete (2) cookie 94909487027248 notify 128849018885 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f4924024980 con 0x7f492005c3e0 2024-04-24T02:12:24.580 INFO:teuthology.orchestra.run.smithi134.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T02:12:21.778798Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T02:12:21.778786Z","tags":[],"group_ids":[]} 2024-04-24T02:12:24.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.568+0000 7f47db7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:24.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.568+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94909486777392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651d6421960 con 0x5651d63dc3d0 2024-04-24T02:12:24.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.569+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94909486777392] v30'93 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f491c048040 con 0x5651d63dc3d0 2024-04-24T02:12:24.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.569+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94909486754688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651d63ec430 con 0x7f492005c3e0 2024-04-24T02:12:24.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.570+0000 7f492a16b640 1 -- 172.21.15.134:0/3009528766 <== osd.2 v2:172.21.15.134:6800/214480313 16 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94909486754688] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4924040040 con 0x7f492005c3e0 2024-04-24T02:12:24.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.570+0000 7f492e211800 20 remove_watcher() i=0 2024-04-24T02:12:24.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.570+0000 7f492e211800 2 removed watcher, disabling cache 2024-04-24T02:12:24.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.570+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94909486758928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e6b80 con 0x5651d63dc3d0 2024-04-24T02:12:24.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.571+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 <== osd.1 v2:172.21.15.134:6804/1487076214 30 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94909486758928] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f491c048040 con 0x5651d63dc3d0 2024-04-24T02:12:24.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.571+0000 7f492e211800 20 remove_watcher() i=1 2024-04-24T02:12:24.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.571+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94909486762816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e6b80 con 0x5651d63e2620 2024-04-24T02:12:24.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.572+0000 7f4929169640 1 -- 172.21.15.134:0/3009528766 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94909486762816] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49200ad040 con 0x5651d63e2620 2024-04-24T02:12:24.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.572+0000 7f492e211800 20 remove_watcher() i=2 2024-04-24T02:12:24.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.572+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94909486765040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e8b40 con 0x7f492005c3e0 2024-04-24T02:12:24.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.573+0000 7f492a16b640 1 -- 172.21.15.134:0/3009528766 <== osd.2 v2:172.21.15.134:6800/214480313 17 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94909486765040] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4924040040 con 0x7f492005c3e0 2024-04-24T02:12:24.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.573+0000 7f492e211800 20 remove_watcher() i=3 2024-04-24T02:12:24.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.573+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94909486767712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e8b40 con 0x5651d63dc3d0 2024-04-24T02:12:24.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.574+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 <== osd.1 v2:172.21.15.134:6804/1487076214 31 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94909486767712] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f491c048040 con 0x5651d63dc3d0 2024-04-24T02:12:24.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.574+0000 7f492e211800 20 remove_watcher() i=4 2024-04-24T02:12:24.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.574+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94909486772672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e9e60 con 0x7f4924031040 2024-04-24T02:12:24.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.575+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94909486772672] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f491c048040 con 0x7f4924031040 2024-04-24T02:12:24.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.575+0000 7f492e211800 20 remove_watcher() i=5 2024-04-24T02:12:24.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.575+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94909486770048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651d63e8b40 con 0x7f4924031040 2024-04-24T02:12:24.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.576+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94909486770048] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f491c048040 con 0x7f4924031040 2024-04-24T02:12:24.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.576+0000 7f492e211800 20 remove_watcher() i=6 2024-04-24T02:12:24.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.576+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94909486776336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5651d63eb1c0 con 0x7f4924031040 2024-04-24T02:12:24.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.577+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94909486776336] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f491c048040 con 0x7f4924031040 2024-04-24T02:12:24.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.577+0000 7f492e211800 20 remove_watcher() i=7 2024-04-24T02:12:24.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.577+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f4924031040 msgr2=0x7f4924032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.577+0000 7f492e211800 1 --2- 172.21.15.134:0/3009528766 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f4924031040 0x7f4924032940 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.577+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5651d63dc3d0 msgr2=0x5651d63de890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.577+0000 7f492e211800 1 --2- 172.21.15.134:0/3009528766 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5651d63dc3d0 0x5651d63de890 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.577+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f492005c3e0 msgr2=0x7f4920006750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.577+0000 7f492e211800 1 --2- 172.21.15.134:0/3009528766 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f492005c3e0 0x7f4920006750 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.577+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5651d63e2620 msgr2=0x5651d63e4a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.577+0000 7f492e211800 1 --2- 172.21.15.134:0/3009528766 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5651d63e2620 0x5651d63e4a10 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.577+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f47f4036950 msgr2=0x7f47f4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.577+0000 7f492e211800 1 --2- 172.21.15.134:0/3009528766 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f47f4036950 0x7f47f4038e10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x5651d62a8510 tx=0x7f492401f000 comp rx=0 tx=0).stop 2024-04-24T02:12:24.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.577+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651d63c9290 msgr2=0x5651d63d08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.577+0000 7f492996a640 1 -- 172.21.15.134:0/3009528766 reap_dead start 2024-04-24T02:12:24.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.577+0000 7f492e211800 1 --2- 172.21.15.134:0/3009528766 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651d63c9290 0x5651d63d08d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4920067f90 tx=0x7f492008da40 comp rx=0 tx=0).stop 2024-04-24T02:12:24.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.577+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 shutdown_connections 2024-04-24T02:12:24.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.577+0000 7f492e211800 1 --2- 172.21.15.134:0/3009528766 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651d63c9290 0x5651d63d08d0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.578+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 >> 172.21.15.134:0/3009528766 conn(0x5651d63c55b0 msgr2=0x5651d63c2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:24.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.578+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 shutdown_connections 2024-04-24T02:12:24.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.578+0000 7f492e211800 1 -- 172.21.15.134:0/3009528766 wait complete. 2024-04-24T02:12:24.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.578+0000 7f492e211800 1 -- 172.21.15.134:0/1317251156 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4804036900 msgr2=0x7f4804038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.578+0000 7f492e211800 1 --2- 172.21.15.134:0/1317251156 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4804036900 0x7f4804038dc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x5651d63ac0c0 tx=0x7f4924005840 comp rx=0 tx=0).stop 2024-04-24T02:12:24.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.578+0000 7f492e211800 1 -- 172.21.15.134:0/1317251156 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651d63bbfd0 msgr2=0x5651d63bc3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.578+0000 7f492e211800 1 --2- 172.21.15.134:0/1317251156 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651d63bbfd0 0x5651d63bc3f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4920055040 tx=0x7f4920002fb0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.578+0000 7f492e211800 1 -- 172.21.15.134:0/1317251156 shutdown_connections 2024-04-24T02:12:24.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.578+0000 7f492e211800 1 --2- 172.21.15.134:0/1317251156 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4804036900 0x7f4804038dc0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.578+0000 7f492e211800 1 --2- 172.21.15.134:0/1317251156 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651d63bbfd0 0x5651d63bc3f0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.578+0000 7f492e211800 1 -- 172.21.15.134:0/1317251156 >> 172.21.15.134:0/1317251156 conn(0x5651d63b0070 msgr2=0x5651d63b0470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:24.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.578+0000 7f492e211800 1 -- 172.21.15.134:0/1317251156 shutdown_connections 2024-04-24T02:12:24.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.578+0000 7f492e211800 1 -- 172.21.15.134:0/1317251156 wait complete. 2024-04-24T02:12:24.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.578+0000 7f492e211800 1 -- 172.21.15.134:0/4121834781 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5651d62ad190 msgr2=0x5651d63aaf00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.578+0000 7f492e211800 1 --2- 172.21.15.134:0/4121834781 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5651d62ad190 0x5651d63aaf00 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.578+0000 7f492e211800 1 -- 172.21.15.134:0/4121834781 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4810036900 msgr2=0x7f4810038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.578+0000 7f492e211800 1 --2- 172.21.15.134:0/4121834781 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4810036900 0x7f4810038dc0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4920054000 tx=0x7f492004e000 comp rx=0 tx=0).stop 2024-04-24T02:12:24.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.578+0000 7f492e211800 1 -- 172.21.15.134:0/4121834781 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651d621ca70 msgr2=0x5651d62a9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.578+0000 7f492e211800 1 --2- 172.21.15.134:0/4121834781 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651d621ca70 0x5651d62a9340 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f491c00b210 tx=0x7f491c000ed0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.578+0000 7f492e211800 1 -- 172.21.15.134:0/4121834781 shutdown_connections 2024-04-24T02:12:24.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.578+0000 7f492e211800 1 --2- 172.21.15.134:0/4121834781 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5651d62ad190 0x5651d63aaf00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.578+0000 7f492e211800 1 --2- 172.21.15.134:0/4121834781 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4810036900 0x7f4810038dc0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.578+0000 7f492e211800 1 --2- 172.21.15.134:0/4121834781 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651d621ca70 0x5651d62a9340 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.578+0000 7f492e211800 1 -- 172.21.15.134:0/4121834781 >> 172.21.15.134:0/4121834781 conn(0x5651d62a3340 msgr2=0x5651d6393fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:24.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.578+0000 7f492e211800 1 -- 172.21.15.134:0/4121834781 shutdown_connections 2024-04-24T02:12:24.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.578+0000 7f492e211800 1 -- 172.21.15.134:0/4121834781 wait complete. 2024-04-24T02:12:24.592 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T02:12:21.778798Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:12:21.778786Z', 'tags': [], 'group_ids': []} 2024-04-24T02:12:24.592 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-04-24T02:12:24.592 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-04-24T02:12:24.592 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-04-24T02:12:24.634 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:24.635 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:24.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.634+0000 7f5e83638800 1 Processor -- start 2024-04-24T02:12:24.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.634+0000 7f5e83638800 1 -- start start 2024-04-24T02:12:24.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.634+0000 7f5e83638800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55b50f952300 0x55b50f95ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.634+0000 7f5e83638800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b50f810d40 con 0x55b50f9507c0 2024-04-24T02:12:24.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.634+0000 7f5e83638800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55b50f7e34d0 con 0x55b50f952300 2024-04-24T02:12:24.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.634+0000 7f5e80936640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55b50f952300 0x55b50f95ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.634+0000 7f5e80936640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55b50f952300 0x55b50f95ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46608/0 (socket says 172.21.15.134:46608) 2024-04-24T02:12:24.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.634+0000 7f5e80936640 1 -- 172.21.15.134:0/1102505885 learned_addr learned my addr 172.21.15.134:0/1102505885 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:24.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.634+0000 7f5e81137640 1 --1- 172.21.15.134:0/1102505885 >> v1:172.21.15.104:6789/0 conn(0x55b50f9507c0 0x55b50f950be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:43376/0 (socket says 172.21.15.134:43376) 2024-04-24T02:12:24.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.635+0000 7f5e80936640 1 -- 172.21.15.134:0/1102505885 >> v1:172.21.15.104:6789/0 conn(0x55b50f9507c0 legacy=0x55b50f950be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.635+0000 7f5e73fff640 1 -- 172.21.15.134:0/1102505885 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3886631590 0 0) 0x55b50f810d40 con 0x55b50f9507c0 2024-04-24T02:12:24.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.635+0000 7f5e80936640 1 -- 172.21.15.134:0/1102505885 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b50f80f590 con 0x55b50f952300 2024-04-24T02:12:24.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.636+0000 7f5e80936640 1 --2- 172.21.15.134:0/1102505885 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b50f952300 0x55b50f95ae00 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5e7800a520 tx=0x7f5e7801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7d10affdb119bdd server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.636+0000 7f5e73fff640 1 -- 172.21.15.134:0/1102505885 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e78057070 con 0x55b50f952300 2024-04-24T02:12:24.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.637+0000 7f5e73fff640 1 -- 172.21.15.134:0/1102505885 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e78052570 con 0x55b50f952300 2024-04-24T02:12:24.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.637+0000 7f5e73fff640 1 -- 172.21.15.134:0/1102505885 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e7804ae60 con 0x55b50f952300 2024-04-24T02:12:24.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.637+0000 7f5e83638800 1 -- 172.21.15.134:0/1102505885 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b50f952300 msgr2=0x55b50f95ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.637+0000 7f5e83638800 1 --2- 172.21.15.134:0/1102505885 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b50f952300 0x55b50f95ae00 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5e7800a520 tx=0x7f5e7801d010 comp rx=0 tx=0).stop 2024-04-24T02:12:24.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.637+0000 7f5e83638800 1 -- 172.21.15.134:0/1102505885 shutdown_connections 2024-04-24T02:12:24.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.637+0000 7f5e83638800 1 --2- 172.21.15.134:0/1102505885 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b50f952300 0x55b50f95ae00 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.637+0000 7f5e83638800 1 -- 172.21.15.134:0/1102505885 >> 172.21.15.134:0/1102505885 conn(0x55b50f94c320 msgr2=0x55b50f94e740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:24.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.637+0000 7f5e83638800 1 -- 172.21.15.134:0/1102505885 shutdown_connections 2024-04-24T02:12:24.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.637+0000 7f5e83638800 1 -- 172.21.15.134:0/1102505885 wait complete. 2024-04-24T02:12:24.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.649+0000 7f5e83638800 1 Processor -- start 2024-04-24T02:12:24.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.649+0000 7f5e83638800 1 -- start start 2024-04-24T02:12:24.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.649+0000 7f5e83638800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b50f9507c0 0x55b50fa454a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.649+0000 7f5e83638800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b50f89d3c0 con 0x55b50f9507c0 2024-04-24T02:12:24.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.649+0000 7f5e81137640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b50f9507c0 0x55b50fa454a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.649+0000 7f5e81137640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b50f9507c0 0x55b50fa454a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46618/0 (socket says 172.21.15.134:46618) 2024-04-24T02:12:24.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.649+0000 7f5e81137640 1 -- 172.21.15.134:0/4082993543 learned_addr learned my addr 172.21.15.134:0/4082993543 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:24.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.649+0000 7f5e81137640 1 -- 172.21.15.134:0/4082993543 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b50fa45a70 con 0x55b50f9507c0 2024-04-24T02:12:24.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.649+0000 7f5e81137640 1 --2- 172.21.15.134:0/4082993543 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b50f9507c0 0x55b50fa454a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5e7400b210 tx=0x7f5e7400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b92a29889973a614 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.650+0000 7f5d6f606640 1 -- 172.21.15.134:0/4082993543 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e74008070 con 0x55b50f9507c0 2024-04-24T02:12:24.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.650+0000 7f5d6f606640 1 -- 172.21.15.134:0/4082993543 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e7400d500 con 0x55b50f9507c0 2024-04-24T02:12:24.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.650+0000 7f5d6f606640 1 -- 172.21.15.134:0/4082993543 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e7400d840 con 0x55b50f9507c0 2024-04-24T02:12:24.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.650+0000 7f5e83638800 1 -- 172.21.15.134:0/4082993543 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b50f9507c0 msgr2=0x55b50fa454a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.650+0000 7f5e83638800 1 --2- 172.21.15.134:0/4082993543 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b50f9507c0 0x55b50fa454a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5e7400b210 tx=0x7f5e7400b6d0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.650+0000 7f5e83638800 1 -- 172.21.15.134:0/4082993543 shutdown_connections 2024-04-24T02:12:24.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.650+0000 7f5e83638800 1 --2- 172.21.15.134:0/4082993543 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b50f9507c0 0x55b50fa454a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.650+0000 7f5e83638800 1 -- 172.21.15.134:0/4082993543 >> 172.21.15.134:0/4082993543 conn(0x55b50f94c320 msgr2=0x55b50fa40dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:24.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.650+0000 7f5e83638800 1 -- 172.21.15.134:0/4082993543 shutdown_connections 2024-04-24T02:12:24.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.650+0000 7f5e83638800 1 -- 172.21.15.134:0/4082993543 wait complete. 2024-04-24T02:12:24.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.651+0000 7f5e83638800 1 Processor -- start 2024-04-24T02:12:24.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.651+0000 7f5e83638800 1 -- start start 2024-04-24T02:12:24.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.651+0000 7f5e83638800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b50f9507c0 0x55b50fa4d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.651+0000 7f5e83638800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b50f95d620 con 0x55b50f9507c0 2024-04-24T02:12:24.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.651+0000 7f5e81137640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b50f9507c0 0x55b50fa4d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.651+0000 7f5e81137640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b50f9507c0 0x55b50fa4d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46632/0 (socket says 172.21.15.134:46632) 2024-04-24T02:12:24.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.651+0000 7f5e81137640 1 -- 172.21.15.134:0/2817368167 learned_addr learned my addr 172.21.15.134:0/2817368167 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:24.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.651+0000 7f5e81137640 1 -- 172.21.15.134:0/2817368167 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b50fa4d580 con 0x55b50f9507c0 2024-04-24T02:12:24.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.651+0000 7f5e81137640 1 --2- 172.21.15.134:0/2817368167 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b50f9507c0 0x55b50fa4d040 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5e7400b210 tx=0x7f5e74000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.652+0000 7f5d6de03640 1 -- 172.21.15.134:0/2817368167 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e7400f950 con 0x55b50f9507c0 2024-04-24T02:12:24.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.652+0000 7f5d6de03640 1 -- 172.21.15.134:0/2817368167 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e7400faf0 con 0x55b50f9507c0 2024-04-24T02:12:24.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.652+0000 7f5e83638800 1 -- 172.21.15.134:0/2817368167 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b50fa4d810 con 0x55b50f9507c0 2024-04-24T02:12:24.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.652+0000 7f5d6de03640 1 -- 172.21.15.134:0/2817368167 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e7400fdd0 con 0x55b50f9507c0 2024-04-24T02:12:24.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.652+0000 7f5e83638800 1 -- 172.21.15.134:0/2817368167 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b50fa504c0 con 0x55b50f9507c0 2024-04-24T02:12:24.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.652+0000 7f5d6de03640 1 -- 172.21.15.134:0/2817368167 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5e74017040 con 0x55b50f9507c0 2024-04-24T02:12:24.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.652+0000 7f5d6de03640 1 --2- 172.21.15.134:0/2817368167 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5d68036900 0x7f5d68038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.652+0000 7f5d6de03640 1 -- 172.21.15.134:0/2817368167 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f5e74015020 con 0x55b50f9507c0 2024-04-24T02:12:24.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.653+0000 7f5e80936640 1 --2- 172.21.15.134:0/2817368167 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5d68036900 0x7f5d68038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.653+0000 7f5e83638800 1 --2- 172.21.15.134:0/2817368167 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b50f952300 0x55b50fa54280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.653+0000 7f5e83638800 1 -- 172.21.15.134:0/2817368167 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa547c0 con 0x55b50f952300 2024-04-24T02:12:24.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.653+0000 7f5e81938640 1 --2- 172.21.15.134:0/2817368167 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b50f952300 0x55b50fa54280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.653+0000 7f5e80936640 1 --2- 172.21.15.134:0/2817368167 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5d68036900 0x7f5d68038dc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5e78054000 tx=0x7f5e7804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.653+0000 7f5e81938640 1 --2- 172.21.15.134:0/2817368167 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b50f952300 0x55b50fa54280 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.653+0000 7f5e81938640 1 -- 172.21.15.134:0/2817368167 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e7c00a4a0 con 0x55b50f952300 2024-04-24T02:12:24.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.653+0000 7f5e83638800 1 -- 172.21.15.134:0/2817368167 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa51830 con 0x55b50f952300 2024-04-24T02:12:24.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.654+0000 7f5e81938640 1 -- 172.21.15.134:0/2817368167 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5e7c00a4a0 con 0x55b50f952300 2024-04-24T02:12:24.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.654+0000 7f5e83638800 1 -- 172.21.15.134:0/2817368167 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa565d0 con 0x55b50f952300 2024-04-24T02:12:24.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.654+0000 7f5e81938640 1 -- 172.21.15.134:0/2817368167 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5e7c00a4a0 con 0x55b50f952300 2024-04-24T02:12:24.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.654+0000 7f5e83638800 1 -- 172.21.15.134:0/2817368167 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa55910 con 0x55b50f952300 2024-04-24T02:12:24.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.654+0000 7f5e81938640 1 -- 172.21.15.134:0/2817368167 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5e7c00a4a0 con 0x55b50f952300 2024-04-24T02:12:24.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.654+0000 7f5e83638800 1 -- 172.21.15.134:0/2817368167 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa55d30 con 0x55b50f952300 2024-04-24T02:12:24.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.654+0000 7f5e81938640 1 -- 172.21.15.134:0/2817368167 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5e7c00a4a0 con 0x55b50f952300 2024-04-24T02:12:24.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.655+0000 7f5e83638800 1 Processor -- start 2024-04-24T02:12:24.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.655+0000 7f5e83638800 1 -- start start 2024-04-24T02:12:24.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.655+0000 7f5e83638800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b50fa653c0 0x55b50fa657e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.655+0000 7f5e83638800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b50f8436b0 con 0x55b50fa653c0 2024-04-24T02:12:24.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.655+0000 7f5e80936640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b50fa653c0 0x55b50fa657e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.655+0000 7f5e80936640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b50fa653c0 0x55b50fa657e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46634/0 (socket says 172.21.15.134:46634) 2024-04-24T02:12:24.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.655+0000 7f5e80936640 1 -- 172.21.15.134:0/1089365438 learned_addr learned my addr 172.21.15.134:0/1089365438 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:24.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.655+0000 7f5e80936640 1 -- 172.21.15.134:0/1089365438 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b50fa65d20 con 0x55b50fa653c0 2024-04-24T02:12:24.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.656+0000 7f5e80936640 1 --2- 172.21.15.134:0/1089365438 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b50fa653c0 0x55b50fa657e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5e78005930 tx=0x7f5e78002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.656+0000 7f5d66ffd640 1 -- 172.21.15.134:0/1089365438 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e78057040 con 0x55b50fa653c0 2024-04-24T02:12:24.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.656+0000 7f5d66ffd640 1 -- 172.21.15.134:0/1089365438 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e7805d440 con 0x55b50fa653c0 2024-04-24T02:12:24.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.656+0000 7f5e83638800 1 -- 172.21.15.134:0/1089365438 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b50fa66790 con 0x55b50fa653c0 2024-04-24T02:12:24.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.656+0000 7f5d66ffd640 1 -- 172.21.15.134:0/1089365438 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e7805d740 con 0x55b50fa653c0 2024-04-24T02:12:24.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.656+0000 7f5e83638800 1 -- 172.21.15.134:0/1089365438 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b50fa66c30 con 0x55b50fa653c0 2024-04-24T02:12:24.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.656+0000 7f5d66ffd640 1 -- 172.21.15.134:0/1089365438 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5e78067070 con 0x55b50fa653c0 2024-04-24T02:12:24.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.657+0000 7f5d66ffd640 1 --2- 172.21.15.134:0/1089365438 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5d58036900 0x7f5d58038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.657+0000 7f5d66ffd640 1 -- 172.21.15.134:0/1089365438 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f5e7808f320 con 0x55b50fa653c0 2024-04-24T02:12:24.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.657+0000 7f5e81938640 1 --2- 172.21.15.134:0/1089365438 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5d58036900 0x7f5d58038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.657+0000 7f5e83638800 1 Processor -- start 2024-04-24T02:12:24.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.657+0000 7f5e81938640 1 --2- 172.21.15.134:0/1089365438 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5d58036900 0x7f5d58038dc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x55b50fa55cb0 tx=0x7f5e7c005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.657+0000 7f5e83638800 1 -- start start 2024-04-24T02:12:24.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.657+0000 7f5e83638800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b50fa72640 0x55b50fa72a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.657+0000 7f5e83638800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b50fa45df0 con 0x55b50fa72640 2024-04-24T02:12:24.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.657+0000 7f5e80936640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b50fa72640 0x55b50fa72a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.657+0000 7f5e80936640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b50fa72640 0x55b50fa72a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46638/0 (socket says 172.21.15.134:46638) 2024-04-24T02:12:24.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.657+0000 7f5e80936640 1 -- 172.21.15.134:0/4225551174 learned_addr learned my addr 172.21.15.134:0/4225551174 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:24.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.658+0000 7f5e80936640 1 -- 172.21.15.134:0/4225551174 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b50fa73030 con 0x55b50fa72640 2024-04-24T02:12:24.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.658+0000 7f5e80936640 1 --2- 172.21.15.134:0/4225551174 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b50fa72640 0x55b50fa72a60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5e7808d800 tx=0x7f5e7808d940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5315473f679d72ad server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.658+0000 7f5d64ff9640 1 -- 172.21.15.134:0/4225551174 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e78082070 con 0x55b50fa72640 2024-04-24T02:12:24.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.658+0000 7f5d64ff9640 1 -- 172.21.15.134:0/4225551174 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e780719e0 con 0x55b50fa72640 2024-04-24T02:12:24.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.658+0000 7f5d64ff9640 1 -- 172.21.15.134:0/4225551174 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e7808b070 con 0x55b50fa72640 2024-04-24T02:12:24.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.658+0000 7f5e83638800 1 -- 172.21.15.134:0/4225551174 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b50fa72640 msgr2=0x55b50fa72a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.658+0000 7f5e83638800 1 --2- 172.21.15.134:0/4225551174 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b50fa72640 0x55b50fa72a60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5e7808d800 tx=0x7f5e7808d940 comp rx=0 tx=0).stop 2024-04-24T02:12:24.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.658+0000 7f5e83638800 1 -- 172.21.15.134:0/4225551174 shutdown_connections 2024-04-24T02:12:24.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.658+0000 7f5e83638800 1 --2- 172.21.15.134:0/4225551174 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b50fa72640 0x55b50fa72a60 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.658+0000 7f5e83638800 1 -- 172.21.15.134:0/4225551174 >> 172.21.15.134:0/4225551174 conn(0x55b50fa6e9a0 msgr2=0x55b50fa6ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:24.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.658+0000 7f5e83638800 1 -- 172.21.15.134:0/4225551174 shutdown_connections 2024-04-24T02:12:24.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.658+0000 7f5e83638800 1 -- 172.21.15.134:0/4225551174 wait complete. 2024-04-24T02:12:24.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.659+0000 7f5e83638800 1 Processor -- start 2024-04-24T02:12:24.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.659+0000 7f5e83638800 1 -- start start 2024-04-24T02:12:24.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.659+0000 7f5e83638800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b50fa72640 0x55b50fa79d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.659+0000 7f5e83638800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b50fa737a0 con 0x55b50fa72640 2024-04-24T02:12:24.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.659+0000 7f5e80936640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b50fa72640 0x55b50fa79d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.659+0000 7f5e80936640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b50fa72640 0x55b50fa79d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46650/0 (socket says 172.21.15.134:46650) 2024-04-24T02:12:24.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.659+0000 7f5e80936640 1 -- 172.21.15.134:0/3273237122 learned_addr learned my addr 172.21.15.134:0/3273237122 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:24.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.659+0000 7f5e80936640 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b50fa7a260 con 0x55b50fa72640 2024-04-24T02:12:24.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.659+0000 7f5e80936640 1 --2- 172.21.15.134:0/3273237122 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b50fa72640 0x55b50fa79d20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5e7808c720 tx=0x7f5e7808d790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.659+0000 7f5d56ffd640 1 -- 172.21.15.134:0/3273237122 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e78082040 con 0x55b50fa72640 2024-04-24T02:12:24.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.659+0000 7f5d56ffd640 1 -- 172.21.15.134:0/3273237122 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e7808c400 con 0x55b50fa72640 2024-04-24T02:12:24.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.659+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b50fa7a4f0 con 0x55b50fa72640 2024-04-24T02:12:24.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.660+0000 7f5d56ffd640 1 -- 172.21.15.134:0/3273237122 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e7805eba0 con 0x55b50fa72640 2024-04-24T02:12:24.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.660+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b50fa7d1a0 con 0x55b50fa72640 2024-04-24T02:12:24.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.660+0000 7f5d56ffd640 1 -- 172.21.15.134:0/3273237122 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5e7805d970 con 0x55b50fa72640 2024-04-24T02:12:24.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.661+0000 7f5d56ffd640 1 --2- 172.21.15.134:0/3273237122 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5d4c036950 0x7f5d4c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.661+0000 7f5d56ffd640 1 -- 172.21.15.134:0/3273237122 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f5e7809aae0 con 0x55b50fa72640 2024-04-24T02:12:24.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.661+0000 7f5e83638800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.661+0000 7f5e81938640 1 --2- 172.21.15.134:0/3273237122 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5d4c036950 0x7f5d4c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.661+0000 7f5e83638800 1 --2- 172.21.15.134:0/3273237122 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b50fa857c0 0x55b50fa87c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.661+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa883b0 con 0x55b50fa857c0 2024-04-24T02:12:24.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.661+0000 7f5e81137640 1 --2- 172.21.15.134:0/3273237122 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b50fa857c0 0x55b50fa87c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.661+0000 7f5e81938640 1 --2- 172.21.15.134:0/3273237122 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5d4c036950 0x7f5d4c038e10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x55b50fa55430 tx=0x7f5e7c01f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.661+0000 7f5e81137640 1 --2- 172.21.15.134:0/3273237122 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b50fa857c0 0x55b50fa87c60 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.661+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e7402d070 con 0x55b50fa857c0 2024-04-24T02:12:24.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.661+0000 7f5e83638800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:24.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.661+0000 7f5e83638800 20 realm 2024-04-24T02:12:24.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.661+0000 7f5e83638800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.661+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa887c0 con 0x55b50fa857c0 2024-04-24T02:12:24.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.662+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e7402d070 con 0x55b50fa857c0 2024-04-24T02:12:24.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.662+0000 7f5e83638800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:24.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.662+0000 7f5e83638800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:24.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.662+0000 7f5e83638800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.662+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa89090 con 0x55b50fa857c0 2024-04-24T02:12:24.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.662+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e7402d070 con 0x55b50fa857c0 2024-04-24T02:12:24.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.662+0000 7f5e83638800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:24.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.662+0000 7f5e83638800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.662+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa89430 con 0x55b50fa857c0 2024-04-24T02:12:24.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.662+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5e7402d070 con 0x55b50fa857c0 2024-04-24T02:12:24.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.662+0000 7f5e83638800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:24.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.662+0000 7f5e83638800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.662+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa89890 con 0x55b50fa857c0 2024-04-24T02:12:24.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.662+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5e7402d070 con 0x55b50fa857c0 2024-04-24T02:12:24.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.662+0000 7f5e83638800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:24.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.662+0000 7f5e83638800 20 searching for the correct realm 2024-04-24T02:12:24.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.662+0000 7f5e83638800 1 --2- 172.21.15.134:0/3273237122 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55b50fa8b8e0 0x55b50fa8dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.662+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa8e380 con 0x55b50fa8b8e0 2024-04-24T02:12:24.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.662+0000 7f5e80936640 1 --2- 172.21.15.134:0/3273237122 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55b50fa8b8e0 0x55b50fa8dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.663+0000 7f5e80936640 1 --2- 172.21.15.134:0/3273237122 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55b50fa8b8e0 0x55b50fa8dcd0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.663+0000 7f5e80936640 1 -- 172.21.15.134:0/3273237122 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e780a0070 con 0x55b50fa8b8e0 2024-04-24T02:12:24.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.663+0000 7f5e80936640 1 --2- 172.21.15.134:0/3273237122 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f5e78070360 0x7f5e78094230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.663+0000 7f5e80936640 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa8e380 con 0x7f5e78070360 2024-04-24T02:12:24.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.663+0000 7f5e81938640 1 --2- 172.21.15.134:0/3273237122 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f5e78070360 0x7f5e78094230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.663+0000 7f5e81938640 1 --2- 172.21.15.134:0/3273237122 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f5e78070360 0x7f5e78094230 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.664+0000 7f5e81938640 1 -- 172.21.15.134:0/3273237122 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e7c01f070 con 0x7f5e78070360 2024-04-24T02:12:24.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.664+0000 7f5e81938640 1 --2- 172.21.15.134:0/3273237122 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f5e7c031040 0x7f5e7c032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.664+0000 7f5e81938640 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa8e380 con 0x7f5e7c031040 2024-04-24T02:12:24.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.664+0000 7f5e81137640 1 --2- 172.21.15.134:0/3273237122 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f5e7c031040 0x7f5e7c032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.664+0000 7f5e81137640 1 --2- 172.21.15.134:0/3273237122 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f5e7c031040 0x7f5e7c032430 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.665+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e74048040 con 0x7f5e7c031040 2024-04-24T02:12:24.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.665+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa8e380 con 0x55b50fa857c0 2024-04-24T02:12:24.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.665+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e74048040 con 0x55b50fa857c0 2024-04-24T02:12:24.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.665+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa8e380 con 0x55b50fa857c0 2024-04-24T02:12:24.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.665+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5e74048040 con 0x55b50fa857c0 2024-04-24T02:12:24.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.665+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa8e380 con 0x7f5e7c031040 2024-04-24T02:12:24.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.665+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e74048040 con 0x7f5e7c031040 2024-04-24T02:12:24.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.665+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa8e380 con 0x7f5e7c031040 2024-04-24T02:12:24.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.665+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e74048040 con 0x7f5e7c031040 2024-04-24T02:12:24.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.665+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa8e380 con 0x7f5e78070360 2024-04-24T02:12:24.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.666+0000 7f5e81938640 1 -- 172.21.15.134:0/3273237122 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e7c01f070 con 0x7f5e78070360 2024-04-24T02:12:24.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.666+0000 7f5e81938640 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa8e380 con 0x55b50fa8b8e0 2024-04-24T02:12:24.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.666+0000 7f5e80936640 1 -- 172.21.15.134:0/3273237122 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e780a0070 con 0x55b50fa8b8e0 2024-04-24T02:12:24.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.666+0000 7f5e80936640 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa8e380 con 0x55b50fa857c0 2024-04-24T02:12:24.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.666+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e74048040 con 0x55b50fa857c0 2024-04-24T02:12:24.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.666+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa8e380 con 0x7f5e7c031040 2024-04-24T02:12:24.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.666+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e74048040 con 0x7f5e7c031040 2024-04-24T02:12:24.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.666+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa8e380 con 0x55b50fa857c0 2024-04-24T02:12:24.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.666+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e74048040 con 0x55b50fa857c0 2024-04-24T02:12:24.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.667+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa8e380 con 0x7f5e78070360 2024-04-24T02:12:24.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.667+0000 7f5e81938640 1 -- 172.21.15.134:0/3273237122 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5e7c01f070 con 0x7f5e78070360 2024-04-24T02:12:24.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.667+0000 7f5e81938640 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa8e380 con 0x55b50fa8b8e0 2024-04-24T02:12:24.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.667+0000 7f5e80936640 1 -- 172.21.15.134:0/3273237122 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e780a0070 con 0x55b50fa8b8e0 2024-04-24T02:12:24.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.667+0000 7f5e80936640 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa8e380 con 0x55b50fa8b8e0 2024-04-24T02:12:24.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.667+0000 7f5e80936640 1 -- 172.21.15.134:0/3273237122 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e780a0070 con 0x55b50fa8b8e0 2024-04-24T02:12:24.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.667+0000 7f5e80936640 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa8e380 con 0x7f5e7c031040 2024-04-24T02:12:24.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.667+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e74048040 con 0x7f5e7c031040 2024-04-24T02:12:24.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.668+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa8e380 con 0x55b50fa8b8e0 2024-04-24T02:12:24.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.668+0000 7f5e80936640 1 -- 172.21.15.134:0/3273237122 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e780a0070 con 0x55b50fa8b8e0 2024-04-24T02:12:24.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.668+0000 7f5e80936640 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa8e380 con 0x55b50fa8b8e0 2024-04-24T02:12:24.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.668+0000 7f5e80936640 1 -- 172.21.15.134:0/3273237122 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e780a0070 con 0x55b50fa8b8e0 2024-04-24T02:12:24.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.668+0000 7f5e80936640 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa8e380 con 0x55b50fa857c0 2024-04-24T02:12:24.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.668+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e74048040 con 0x55b50fa857c0 2024-04-24T02:12:24.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.668+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa8e380 con 0x55b50fa857c0 2024-04-24T02:12:24.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.668+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f5e74048040 con 0x55b50fa857c0 2024-04-24T02:12:24.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.668+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa8e380 con 0x7f5e7c031040 2024-04-24T02:12:24.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.669+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e74048040 con 0x7f5e7c031040 2024-04-24T02:12:24.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.669+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa8e380 con 0x55b50fa8b8e0 2024-04-24T02:12:24.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.669+0000 7f5e80936640 1 -- 172.21.15.134:0/3273237122 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e780a0070 con 0x55b50fa8b8e0 2024-04-24T02:12:24.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.669+0000 7f5e80936640 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa8e380 con 0x7f5e78070360 2024-04-24T02:12:24.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.669+0000 7f5e81938640 1 -- 172.21.15.134:0/3273237122 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e7c01f070 con 0x7f5e78070360 2024-04-24T02:12:24.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.669+0000 7f5e81938640 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa8e380 con 0x55b50fa857c0 2024-04-24T02:12:24.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.669+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e74048040 con 0x55b50fa857c0 2024-04-24T02:12:24.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.669+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa8e380 con 0x7f5e7c031040 2024-04-24T02:12:24.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.670+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e74048040 con 0x7f5e7c031040 2024-04-24T02:12:24.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.670+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa8e380 con 0x55b50fa8b8e0 2024-04-24T02:12:24.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.670+0000 7f5e80936640 1 -- 172.21.15.134:0/3273237122 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e780a0070 con 0x55b50fa8b8e0 2024-04-24T02:12:24.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.670+0000 7f5e80936640 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa8e380 con 0x7f5e7c031040 2024-04-24T02:12:24.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.670+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e74048040 con 0x7f5e7c031040 2024-04-24T02:12:24.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.670+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa8e380 con 0x7f5e78070360 2024-04-24T02:12:24.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.671+0000 7f5e81938640 1 -- 172.21.15.134:0/3273237122 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e7c01f070 con 0x7f5e78070360 2024-04-24T02:12:24.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.671+0000 7f5e81938640 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa8e380 con 0x55b50fa8b8e0 2024-04-24T02:12:24.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.671+0000 7f5e80936640 1 -- 172.21.15.134:0/3273237122 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e780a0070 con 0x55b50fa8b8e0 2024-04-24T02:12:24.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.671+0000 7f5e80936640 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa8e380 con 0x7f5e7c031040 2024-04-24T02:12:24.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.672+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e74048040 con 0x7f5e7c031040 2024-04-24T02:12:24.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.672+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa8e380 con 0x55b50fa857c0 2024-04-24T02:12:24.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.672+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5e74048040 con 0x55b50fa857c0 2024-04-24T02:12:24.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.672+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa8e380 con 0x7f5e78070360 2024-04-24T02:12:24.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.672+0000 7f5e81938640 1 -- 172.21.15.134:0/3273237122 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e7c01f070 con 0x7f5e78070360 2024-04-24T02:12:24.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.672+0000 7f5e83638800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:24.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.672+0000 7f5e83638800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:24.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.672+0000 7f5e83638800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:24.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.672+0000 7f5e83638800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:24.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.672+0000 7f5e83638800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:24.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.672+0000 7f5e83638800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:24.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.672+0000 7f5e83638800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.672+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa8a360 con 0x55b50fa857c0 2024-04-24T02:12:24.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.672+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e74048040 con 0x55b50fa857c0 2024-04-24T02:12:24.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.672+0000 7f5e83638800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:24.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.672+0000 7f5e83638800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.672+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa8ac00 con 0x55b50fa857c0 2024-04-24T02:12:24.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.673+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5e74048040 con 0x55b50fa857c0 2024-04-24T02:12:24.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.673+0000 7f5e83638800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:24.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.673+0000 7f5e83638800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.673+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa89fa0 con 0x55b50fa857c0 2024-04-24T02:12:24.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.673+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5e74048040 con 0x55b50fa857c0 2024-04-24T02:12:24.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.673+0000 7f5e83638800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:24.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.673+0000 7f5e83638800 20 zone default found 2024-04-24T02:12:24.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.673+0000 7f5e83638800 4 Realm: () 2024-04-24T02:12:24.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.673+0000 7f5e83638800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:24.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.673+0000 7f5e83638800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:24.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.673+0000 7f5e83638800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:24.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.673+0000 7f5e83638800 20 zonegroup default 2024-04-24T02:12:24.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.673+0000 7f5e83638800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.673+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa8e7e0 con 0x7f5e7c031040 2024-04-24T02:12:24.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.673+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5e74048040 con 0x7f5e7c031040 2024-04-24T02:12:24.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.673+0000 7f5e83638800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:24.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.673+0000 7f5e83638800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.673+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa90670 con 0x55b50fa8b8e0 2024-04-24T02:12:24.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.673+0000 7f5e80936640 1 -- 172.21.15.134:0/3273237122 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5e780a0070 con 0x55b50fa8b8e0 2024-04-24T02:12:24.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.673+0000 7f5e83638800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:24.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.673+0000 7f5e83638800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.673+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa90a10 con 0x55b50fa8b8e0 2024-04-24T02:12:24.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.674+0000 7f5e80936640 1 -- 172.21.15.134:0/3273237122 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5e780a0070 con 0x55b50fa8b8e0 2024-04-24T02:12:24.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.674+0000 7f5e83638800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:24.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.674+0000 7f5e83638800 20 started sync module instance, tier type = 2024-04-24T02:12:24.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.674+0000 7f5e83638800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:24.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.674+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa8fab0 con 0x7f5e78070360 2024-04-24T02:12:24.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.675+0000 7f5e81938640 1 -- 172.21.15.134:0/3273237122 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e7c040040 con 0x7f5e78070360 2024-04-24T02:12:24.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.675+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94236140175008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa902c0 con 0x7f5e78070360 2024-04-24T02:12:24.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.675+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa91880 con 0x55b50fa857c0 2024-04-24T02:12:24.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.676+0000 7f5e81938640 1 -- 172.21.15.134:0/3273237122 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94236140175008] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e7c040040 con 0x7f5e78070360 2024-04-24T02:12:24.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.676+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e74048040 con 0x55b50fa857c0 2024-04-24T02:12:24.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.676+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94236140180432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa91ca0 con 0x55b50fa857c0 2024-04-24T02:12:24.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.676+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa92660 con 0x55b50fa8b8e0 2024-04-24T02:12:24.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.677+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94236140180432] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e74048040 con 0x55b50fa857c0 2024-04-24T02:12:24.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.677+0000 7f5e80936640 1 -- 172.21.15.134:0/3273237122 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e780a0070 con 0x55b50fa8b8e0 2024-04-24T02:12:24.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.677+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94236140181488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa91c10 con 0x55b50fa8b8e0 2024-04-24T02:12:24.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.678+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa93520 con 0x7f5e78070360 2024-04-24T02:12:24.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.678+0000 7f5e80936640 1 -- 172.21.15.134:0/3273237122 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94236140181488] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e780a0070 con 0x55b50fa8b8e0 2024-04-24T02:12:24.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.678+0000 7f5e81938640 1 -- 172.21.15.134:0/3273237122 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e7c040040 con 0x7f5e78070360 2024-04-24T02:12:24.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.678+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94236140187760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa93940 con 0x7f5e78070360 2024-04-24T02:12:24.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.679+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa94300 con 0x55b50fa857c0 2024-04-24T02:12:24.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.680+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e74048040 con 0x55b50fa857c0 2024-04-24T02:12:24.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.680+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94236140191312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa94720 con 0x55b50fa857c0 2024-04-24T02:12:24.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.680+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa951e0 con 0x7f5e7c031040 2024-04-24T02:12:24.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.680+0000 7f5e81938640 1 -- 172.21.15.134:0/3273237122 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94236140187760] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e7c040040 con 0x7f5e78070360 2024-04-24T02:12:24.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.681+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94236140191312] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e74048040 con 0x55b50fa857c0 2024-04-24T02:12:24.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.681+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e74048040 con 0x7f5e7c031040 2024-04-24T02:12:24.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.681+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94236140195088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa94270 con 0x7f5e7c031040 2024-04-24T02:12:24.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.681+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa95ab0 con 0x7f5e7c031040 2024-04-24T02:12:24.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.682+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94236140195088] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e74048040 con 0x7f5e7c031040 2024-04-24T02:12:24.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.682+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(56 notify.6 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e74048040 con 0x7f5e7c031040 2024-04-24T02:12:24.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.682+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94236140188816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa94270 con 0x7f5e7c031040 2024-04-24T02:12:24.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.682+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa960d0 con 0x7f5e7c031040 2024-04-24T02:12:24.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.683+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94236140188816] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e74048040 con 0x7f5e7c031040 2024-04-24T02:12:24.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.683+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(58 notify.7 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e74048040 con 0x7f5e7c031040 2024-04-24T02:12:24.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.683+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94236140197296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa960d0 con 0x7f5e7c031040 2024-04-24T02:12:24.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.683+0000 7f5e83638800 20 add_watcher() i=0 2024-04-24T02:12:24.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.683+0000 7f5e83638800 20 add_watcher() i=1 2024-04-24T02:12:24.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.683+0000 7f5e83638800 20 add_watcher() i=2 2024-04-24T02:12:24.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.683+0000 7f5e83638800 20 add_watcher() i=3 2024-04-24T02:12:24.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.683+0000 7f5e83638800 20 add_watcher() i=4 2024-04-24T02:12:24.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.683+0000 7f5e83638800 20 add_watcher() i=5 2024-04-24T02:12:24.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.683+0000 7f5e83638800 20 add_watcher() i=6 2024-04-24T02:12:24.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.684+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94236140197296] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e74048040 con 0x7f5e7c031040 2024-04-24T02:12:24.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.684+0000 7f5e83638800 20 add_watcher() i=7 2024-04-24T02:12:24.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.684+0000 7f5e83638800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:24.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.684+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa993f0 con 0x55b50fa857c0 2024-04-24T02:12:24.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.685+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5e74048040 con 0x55b50fa857c0 2024-04-24T02:12:24.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.685+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94236140199312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa96660 con 0x55b50fa857c0 2024-04-24T02:12:24.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.686+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94236140199312] v30'94 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5e74048040 con 0x55b50fa857c0 2024-04-24T02:12:24.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.686+0000 7f5d377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:24.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.686+0000 7f5e83638800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:24.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.686+0000 7f5e83638800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:24.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.686+0000 7f5e83638800 5 note: GC not initialized 2024-04-24T02:12:24.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.686+0000 7f5d367e4640 20 reqs_thread_entry: start 2024-04-24T02:12:24.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.686+0000 7f5e83638800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:24.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.686+0000 7f5e83638800 20 Filter name: none 2024-04-24T02:12:24.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.686+0000 7f5ca7fff640 20 reqs_thread_entry: start 2024-04-24T02:12:24.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.686+0000 7f5e83638800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.686+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b50facc2e0 con 0x55b50fa857c0 2024-04-24T02:12:24.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.687+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f5e74048040 con 0x55b50fa857c0 2024-04-24T02:12:24.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.687+0000 7f5e83638800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T02:12:24.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.687+0000 7f5e83638800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.687+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b50facccd0 con 0x55b50fa857c0 2024-04-24T02:12:24.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.687+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f5e74048040 con 0x55b50fa857c0 2024-04-24T02:12:24.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.687+0000 7f5e83638800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T02:12:24.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.687+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b50facdce0 con 0x7f5e78070360 2024-04-24T02:12:24.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.687+0000 7f5e81938640 1 -- 172.21.15.134:0/3273237122 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f5e7c040040 con 0x7f5e78070360 2024-04-24T02:12:24.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.688+0000 7f5d377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:24.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.688+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94236140199312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa98840 con 0x55b50fa857c0 2024-04-24T02:12:24.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.689+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94236140199312] v30'95 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5e74048040 con 0x55b50fa857c0 2024-04-24T02:12:24.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.689+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94236140175008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa95d90 con 0x7f5e78070360 2024-04-24T02:12:24.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.690+0000 7f5e81938640 1 -- 172.21.15.134:0/3273237122 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94236140175008] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e7c040040 con 0x7f5e78070360 2024-04-24T02:12:24.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.690+0000 7f5e83638800 20 remove_watcher() i=0 2024-04-24T02:12:24.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.690+0000 7f5e83638800 2 removed watcher, disabling cache 2024-04-24T02:12:24.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.690+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94236140180432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa95d90 con 0x55b50fa857c0 2024-04-24T02:12:24.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.691+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94236140180432] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e74048040 con 0x55b50fa857c0 2024-04-24T02:12:24.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.691+0000 7f5e83638800 20 remove_watcher() i=1 2024-04-24T02:12:24.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.691+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94236140181488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa913d0 con 0x55b50fa8b8e0 2024-04-24T02:12:24.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.692+0000 7f5e80936640 1 -- 172.21.15.134:0/3273237122 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94236140181488] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e780a0070 con 0x55b50fa8b8e0 2024-04-24T02:12:24.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.692+0000 7f5e83638800 20 remove_watcher() i=2 2024-04-24T02:12:24.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.692+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94236140187760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa95d90 con 0x7f5e78070360 2024-04-24T02:12:24.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.693+0000 7f5e81938640 1 -- 172.21.15.134:0/3273237122 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94236140187760] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e7c040040 con 0x7f5e78070360 2024-04-24T02:12:24.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.693+0000 7f5e83638800 20 remove_watcher() i=3 2024-04-24T02:12:24.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.693+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94236140191312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa93070 con 0x55b50fa857c0 2024-04-24T02:12:24.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.694+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94236140191312] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e74048040 con 0x55b50fa857c0 2024-04-24T02:12:24.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.694+0000 7f5e83638800 20 remove_watcher() i=4 2024-04-24T02:12:24.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.694+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94236140195088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa95d90 con 0x7f5e7c031040 2024-04-24T02:12:24.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.695+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94236140195088] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e74048040 con 0x7f5e7c031040 2024-04-24T02:12:24.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.695+0000 7f5e83638800 20 remove_watcher() i=5 2024-04-24T02:12:24.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.695+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94236140188816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa93e50 con 0x7f5e7c031040 2024-04-24T02:12:24.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.696+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94236140188816] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e74048040 con 0x7f5e7c031040 2024-04-24T02:12:24.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.696+0000 7f5e83638800 20 remove_watcher() i=6 2024-04-24T02:12:24.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.696+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94236140197296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b50fa95d90 con 0x7f5e7c031040 2024-04-24T02:12:24.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.697+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94236140197296] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e74048040 con 0x7f5e7c031040 2024-04-24T02:12:24.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.697+0000 7f5e83638800 20 remove_watcher() i=7 2024-04-24T02:12:24.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.698+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f5e7c031040 msgr2=0x7f5e7c032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.698+0000 7f5e83638800 1 --2- 172.21.15.134:0/3273237122 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f5e7c031040 0x7f5e7c032430 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.698+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b50fa857c0 msgr2=0x55b50fa87c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.698+0000 7f5e83638800 1 --2- 172.21.15.134:0/3273237122 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b50fa857c0 0x55b50fa87c60 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.698+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f5e78070360 msgr2=0x7f5e78094230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.698+0000 7f5e83638800 1 --2- 172.21.15.134:0/3273237122 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f5e78070360 0x7f5e78094230 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.698+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55b50fa8b8e0 msgr2=0x55b50fa8dcd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.698+0000 7f5e83638800 1 --2- 172.21.15.134:0/3273237122 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55b50fa8b8e0 0x55b50fa8dcd0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.698+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5d4c036950 msgr2=0x7f5d4c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.698+0000 7f5e83638800 1 --2- 172.21.15.134:0/3273237122 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5d4c036950 0x7f5d4c038e10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x55b50fa55430 tx=0x7f5e7c01f000 comp rx=0 tx=0).stop 2024-04-24T02:12:24.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.698+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b50fa72640 msgr2=0x55b50fa79d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.698+0000 7f5e83638800 1 --2- 172.21.15.134:0/3273237122 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b50fa72640 0x55b50fa79d20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5e7808c720 tx=0x7f5e7808d790 comp rx=0 tx=0).stop 2024-04-24T02:12:24.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.698+0000 7f5e81137640 1 -- 172.21.15.134:0/3273237122 reap_dead start 2024-04-24T02:12:24.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.698+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 shutdown_connections 2024-04-24T02:12:24.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.698+0000 7f5e83638800 1 --2- 172.21.15.134:0/3273237122 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b50fa72640 0x55b50fa79d20 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.698+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 >> 172.21.15.134:0/3273237122 conn(0x55b50fa6e9a0 msgr2=0x55b50fa6c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:24.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.698+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 shutdown_connections 2024-04-24T02:12:24.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.698+0000 7f5e83638800 1 -- 172.21.15.134:0/3273237122 wait complete. 2024-04-24T02:12:24.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.698+0000 7f5e83638800 1 -- 172.21.15.134:0/1089365438 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5d58036900 msgr2=0x7f5d58038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.698+0000 7f5e83638800 1 --2- 172.21.15.134:0/1089365438 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5d58036900 0x7f5d58038dc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x55b50fa55cb0 tx=0x7f5e7c005840 comp rx=0 tx=0).stop 2024-04-24T02:12:24.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.698+0000 7f5e83638800 1 -- 172.21.15.134:0/1089365438 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b50fa653c0 msgr2=0x55b50fa657e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.698+0000 7f5e83638800 1 --2- 172.21.15.134:0/1089365438 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b50fa653c0 0x55b50fa657e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5e78005930 tx=0x7f5e78002fb0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.698+0000 7f5e83638800 1 -- 172.21.15.134:0/1089365438 shutdown_connections 2024-04-24T02:12:24.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.698+0000 7f5e83638800 1 --2- 172.21.15.134:0/1089365438 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5d58036900 0x7f5d58038dc0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.698+0000 7f5e83638800 1 --2- 172.21.15.134:0/1089365438 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b50fa653c0 0x55b50fa657e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.698+0000 7f5e83638800 1 -- 172.21.15.134:0/1089365438 >> 172.21.15.134:0/1089365438 conn(0x55b50fa59460 msgr2=0x55b50fa59860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:24.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.698+0000 7f5e83638800 1 -- 172.21.15.134:0/1089365438 shutdown_connections 2024-04-24T02:12:24.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.698+0000 7f5e83638800 1 -- 172.21.15.134:0/1089365438 wait complete. 2024-04-24T02:12:24.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.699+0000 7f5e83638800 1 -- 172.21.15.134:0/2817368167 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b50f952300 msgr2=0x55b50fa54280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.699+0000 7f5e83638800 1 --2- 172.21.15.134:0/2817368167 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b50f952300 0x55b50fa54280 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.699+0000 7f5e83638800 1 -- 172.21.15.134:0/2817368167 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5d68036900 msgr2=0x7f5d68038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.699+0000 7f5e83638800 1 --2- 172.21.15.134:0/2817368167 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5d68036900 0x7f5d68038dc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5e78054000 tx=0x7f5e7804e000 comp rx=0 tx=0).stop 2024-04-24T02:12:24.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.699+0000 7f5e83638800 1 -- 172.21.15.134:0/2817368167 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b50f9507c0 msgr2=0x55b50fa4d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.699+0000 7f5e83638800 1 --2- 172.21.15.134:0/2817368167 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b50f9507c0 0x55b50fa4d040 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5e7400b210 tx=0x7f5e74000ed0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.699+0000 7f5e83638800 1 -- 172.21.15.134:0/2817368167 shutdown_connections 2024-04-24T02:12:24.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.699+0000 7f5e83638800 1 --2- 172.21.15.134:0/2817368167 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b50f952300 0x55b50fa54280 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.699+0000 7f5e83638800 1 --2- 172.21.15.134:0/2817368167 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5d68036900 0x7f5d68038dc0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.699+0000 7f5e83638800 1 --2- 172.21.15.134:0/2817368167 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b50f9507c0 0x55b50fa4d040 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.699+0000 7f5e83638800 1 -- 172.21.15.134:0/2817368167 >> 172.21.15.134:0/2817368167 conn(0x55b50f94c320 msgr2=0x55b50fa3f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:24.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.699+0000 7f5e83638800 1 -- 172.21.15.134:0/2817368167 shutdown_connections 2024-04-24T02:12:24.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.699+0000 7f5e83638800 1 -- 172.21.15.134:0/2817368167 wait complete. 2024-04-24T02:12:24.720 INFO:teuthology.orchestra.run.smithi134.stdout:[] 2024-04-24T02:12:24.720 DEBUG:tasks.util.rgw: json result: [] 2024-04-24T02:12:24.721 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-04-24T02:12:24.721 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-04-24T02:12:24.721 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-04-24T02:12:24.805 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:24.805 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:24.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.804+0000 7fe4e2e1f800 1 Processor -- start 2024-04-24T02:12:24.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.804+0000 7fe4e2e1f800 1 -- start start 2024-04-24T02:12:24.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.804+0000 7fe4e2e1f800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x556b965892c0 0x556b96591dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.804+0000 7fe4e2e1f800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556b96447d40 con 0x556b96587780 2024-04-24T02:12:24.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.804+0000 7fe4e2e1f800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x556b9641a4d0 con 0x556b965892c0 2024-04-24T02:12:24.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.805+0000 7fe4e011d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x556b965892c0 0x556b96591dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.805+0000 7fe4e091e640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x556b96587780 0x556b96587ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:43378/0 (socket says 172.21.15.134:43378) 2024-04-24T02:12:24.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.805+0000 7fe4e091e640 1 -- 172.21.15.134:0/607145173 learned_addr learned my addr 172.21.15.134:0/607145173 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:12:24.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.805+0000 7fe4e011d640 1 -- 172.21.15.134:0/607145173 >> v1:172.21.15.104:6789/0 conn(0x556b96587780 legacy=0x556b96587ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.805+0000 7fe4e011d640 1 -- 172.21.15.134:0/607145173 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b96446590 con 0x556b965892c0 2024-04-24T02:12:24.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.807+0000 7fe4e011d640 1 --2- 172.21.15.134:0/607145173 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556b965892c0 0x556b96591dc0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe4d400a470 tx=0x7fe4d401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=765c01a7cb733437 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.807+0000 7fe4df91c640 1 -- 172.21.15.134:0/607145173 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4d4057070 con 0x556b965892c0 2024-04-24T02:12:24.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.807+0000 7fe4df91c640 1 -- 172.21.15.134:0/607145173 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4d4052570 con 0x556b965892c0 2024-04-24T02:12:24.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.807+0000 7fe4df91c640 1 -- 172.21.15.134:0/607145173 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4d4052870 con 0x556b965892c0 2024-04-24T02:12:24.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.807+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/607145173 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556b965892c0 msgr2=0x556b96591dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.807+0000 7fe4e2e1f800 1 --2- 172.21.15.134:0/607145173 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556b965892c0 0x556b96591dc0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe4d400a470 tx=0x7fe4d401ce90 comp rx=0 tx=0).stop 2024-04-24T02:12:24.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.807+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/607145173 shutdown_connections 2024-04-24T02:12:24.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.807+0000 7fe4e2e1f800 1 --2- 172.21.15.134:0/607145173 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556b965892c0 0x556b96591dc0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.807+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/607145173 >> 172.21.15.134:0/607145173 conn(0x556b96583380 msgr2=0x556b965857a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:24.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.807+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/607145173 shutdown_connections 2024-04-24T02:12:24.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.807+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/607145173 wait complete. 2024-04-24T02:12:24.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.819+0000 7fe4e2e1f800 1 Processor -- start 2024-04-24T02:12:24.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.819+0000 7fe4e2e1f800 1 -- start start 2024-04-24T02:12:24.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.819+0000 7fe4e2e1f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556b96587780 0x556b9667c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.819+0000 7fe4e2e1f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556b964d43c0 con 0x556b96587780 2024-04-24T02:12:24.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.820+0000 7fe4e091e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556b96587780 0x556b9667c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.820+0000 7fe4e091e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556b96587780 0x556b9667c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46654/0 (socket says 172.21.15.134:46654) 2024-04-24T02:12:24.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.820+0000 7fe4e091e640 1 -- 172.21.15.134:0/1615263424 learned_addr learned my addr 172.21.15.134:0/1615263424 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:24.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.820+0000 7fe4e091e640 1 -- 172.21.15.134:0/1615263424 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b9667cbf0 con 0x556b96587780 2024-04-24T02:12:24.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.820+0000 7fe4e091e640 1 --2- 172.21.15.134:0/1615263424 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556b96587780 0x556b9667c620 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0001de0 tx=0x7fe4d000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c64533d1b9888aec server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.820+0000 7fe3cee0d640 1 -- 172.21.15.134:0/1615263424 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4d0012020 con 0x556b96587780 2024-04-24T02:12:24.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.820+0000 7fe3cee0d640 1 -- 172.21.15.134:0/1615263424 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4d000e5a0 con 0x556b96587780 2024-04-24T02:12:24.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.820+0000 7fe3cee0d640 1 -- 172.21.15.134:0/1615263424 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4d000e8c0 con 0x556b96587780 2024-04-24T02:12:24.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.821+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/1615263424 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556b96587780 msgr2=0x556b9667c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.821+0000 7fe4e2e1f800 1 --2- 172.21.15.134:0/1615263424 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556b96587780 0x556b9667c620 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0001de0 tx=0x7fe4d000b6c0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.821+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/1615263424 shutdown_connections 2024-04-24T02:12:24.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.821+0000 7fe4e2e1f800 1 --2- 172.21.15.134:0/1615263424 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556b96587780 0x556b9667c620 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.821+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/1615263424 >> 172.21.15.134:0/1615263424 conn(0x556b96583380 msgr2=0x556b96677f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:24.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.821+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/1615263424 shutdown_connections 2024-04-24T02:12:24.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.821+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/1615263424 wait complete. 2024-04-24T02:12:24.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.821+0000 7fe4e2e1f800 1 Processor -- start 2024-04-24T02:12:24.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.821+0000 7fe4e2e1f800 1 -- start start 2024-04-24T02:12:24.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.821+0000 7fe4e2e1f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556b96587780 0x556b96684140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.821+0000 7fe4e2e1f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556b965945e0 con 0x556b96587780 2024-04-24T02:12:24.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.822+0000 7fe4e091e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556b96587780 0x556b96684140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.822+0000 7fe4e091e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556b96587780 0x556b96684140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46668/0 (socket says 172.21.15.134:46668) 2024-04-24T02:12:24.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.822+0000 7fe4e091e640 1 -- 172.21.15.134:0/3553133248 learned_addr learned my addr 172.21.15.134:0/3553133248 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:24.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.822+0000 7fe4e091e640 1 -- 172.21.15.134:0/3553133248 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b96684680 con 0x556b96587780 2024-04-24T02:12:24.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.822+0000 7fe4e091e640 1 --2- 172.21.15.134:0/3553133248 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556b96587780 0x556b96684140 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe4d000c010 tx=0x7fe4d0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.822+0000 7fe3cd60a640 1 -- 172.21.15.134:0/3553133248 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4d0012070 con 0x556b96587780 2024-04-24T02:12:24.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.822+0000 7fe3cd60a640 1 -- 172.21.15.134:0/3553133248 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4d001a7a0 con 0x556b96587780 2024-04-24T02:12:24.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.822+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/3553133248 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b96684910 con 0x556b96587780 2024-04-24T02:12:24.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.822+0000 7fe3cd60a640 1 -- 172.21.15.134:0/3553133248 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4d001aa80 con 0x556b96587780 2024-04-24T02:12:24.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.823+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/3553133248 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b966875c0 con 0x556b96587780 2024-04-24T02:12:24.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.823+0000 7fe3cd60a640 1 -- 172.21.15.134:0/3553133248 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe4d0015020 con 0x556b96587780 2024-04-24T02:12:24.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.823+0000 7fe3cd60a640 1 --2- 172.21.15.134:0/3553133248 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe3c8036950 0x7fe3c8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.823+0000 7fe3cd60a640 1 -- 172.21.15.134:0/3553133248 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fe4d0020070 con 0x556b96587780 2024-04-24T02:12:24.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.824+0000 7fe4e011d640 1 --2- 172.21.15.134:0/3553133248 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe3c8036950 0x7fe3c8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.824+0000 7fe4e2e1f800 1 --2- 172.21.15.134:0/3553133248 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556b965892c0 0x556b9668b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.824+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/3553133248 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b9668b900 con 0x556b965892c0 2024-04-24T02:12:24.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.824+0000 7fe4e111f640 1 --2- 172.21.15.134:0/3553133248 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556b965892c0 0x556b9668b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.824+0000 7fe4e011d640 1 --2- 172.21.15.134:0/3553133248 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe3c8036950 0x7fe3c8038e10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4054000 tx=0x7fe4d404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.824+0000 7fe4e111f640 1 --2- 172.21.15.134:0/3553133248 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556b965892c0 0x556b9668b380 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.824+0000 7fe4e111f640 1 -- 172.21.15.134:0/3553133248 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4d800a4a0 con 0x556b965892c0 2024-04-24T02:12:24.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.824+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/3553133248 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b96688950 con 0x556b965892c0 2024-04-24T02:12:24.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.825+0000 7fe4e111f640 1 -- 172.21.15.134:0/3553133248 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe4d800a4a0 con 0x556b965892c0 2024-04-24T02:12:24.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.825+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/3553133248 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b9668d750 con 0x556b965892c0 2024-04-24T02:12:24.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.825+0000 7fe4e111f640 1 -- 172.21.15.134:0/3553133248 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe4d800a4a0 con 0x556b965892c0 2024-04-24T02:12:24.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.825+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/3553133248 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b9668ca90 con 0x556b965892c0 2024-04-24T02:12:24.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.825+0000 7fe4e111f640 1 -- 172.21.15.134:0/3553133248 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe4d800a4a0 con 0x556b965892c0 2024-04-24T02:12:24.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.825+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/3553133248 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b9668cee0 con 0x556b965892c0 2024-04-24T02:12:24.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.825+0000 7fe4e111f640 1 -- 172.21.15.134:0/3553133248 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe4d800a4a0 con 0x556b965892c0 2024-04-24T02:12:24.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.826+0000 7fe4e2e1f800 1 Processor -- start 2024-04-24T02:12:24.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.826+0000 7fe4e2e1f800 1 -- start start 2024-04-24T02:12:24.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.826+0000 7fe4e2e1f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556b9669c520 0x556b9669c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.826+0000 7fe4e2e1f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556b9647a6b0 con 0x556b9669c520 2024-04-24T02:12:24.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.826+0000 7fe4e011d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556b9669c520 0x556b9669c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.826+0000 7fe4e011d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556b9669c520 0x556b9669c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46684/0 (socket says 172.21.15.134:46684) 2024-04-24T02:12:24.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.826+0000 7fe4e011d640 1 -- 172.21.15.134:0/789603206 learned_addr learned my addr 172.21.15.134:0/789603206 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:24.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.827+0000 7fe4e011d640 1 -- 172.21.15.134:0/789603206 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b9669ce80 con 0x556b9669c520 2024-04-24T02:12:24.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.827+0000 7fe4e011d640 1 --2- 172.21.15.134:0/789603206 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556b9669c520 0x556b9669c940 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4044840 tx=0x7fe4d4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.827+0000 7fe3c67fc640 1 -- 172.21.15.134:0/789603206 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4d406f070 con 0x556b9669c520 2024-04-24T02:12:24.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.827+0000 7fe3c67fc640 1 -- 172.21.15.134:0/789603206 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4d4058040 con 0x556b9669c520 2024-04-24T02:12:24.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.827+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/789603206 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b9669d8f0 con 0x556b9669c520 2024-04-24T02:12:24.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.827+0000 7fe3c67fc640 1 -- 172.21.15.134:0/789603206 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4d4057050 con 0x556b9669c520 2024-04-24T02:12:24.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.827+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/789603206 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b9669dd90 con 0x556b9669c520 2024-04-24T02:12:24.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.828+0000 7fe3c67fc640 1 -- 172.21.15.134:0/789603206 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe4d4072070 con 0x556b9669c520 2024-04-24T02:12:24.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.828+0000 7fe3c67fc640 1 --2- 172.21.15.134:0/789603206 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe3b8036900 0x7fe3b8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.828+0000 7fe3c67fc640 1 -- 172.21.15.134:0/789603206 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fe4d408f670 con 0x556b9669c520 2024-04-24T02:12:24.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.828+0000 7fe4e111f640 1 --2- 172.21.15.134:0/789603206 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe3b8036900 0x7fe3b8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.828+0000 7fe4e2e1f800 1 Processor -- start 2024-04-24T02:12:24.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.828+0000 7fe4e111f640 1 --2- 172.21.15.134:0/789603206 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe3b8036900 0x7fe3b8038dc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x556b9668c5b0 tx=0x7fe4d8005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.828+0000 7fe4e2e1f800 1 -- start start 2024-04-24T02:12:24.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.828+0000 7fe4e2e1f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556b966a97e0 0x556b966a9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.828+0000 7fe4e2e1f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556b9667cf70 con 0x556b966a97e0 2024-04-24T02:12:24.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.829+0000 7fe4e011d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556b966a97e0 0x556b966a9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.829+0000 7fe4e011d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556b966a97e0 0x556b966a9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46686/0 (socket says 172.21.15.134:46686) 2024-04-24T02:12:24.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.829+0000 7fe4e011d640 1 -- 172.21.15.134:0/2930564752 learned_addr learned my addr 172.21.15.134:0/2930564752 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:24.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.829+0000 7fe4e011d640 1 -- 172.21.15.134:0/2930564752 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b966aa1d0 con 0x556b966a97e0 2024-04-24T02:12:24.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.829+0000 7fe4e011d640 1 --2- 172.21.15.134:0/2930564752 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556b966a97e0 0x556b966a9c00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe4d408dbc0 tx=0x7fe4d408dcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88b9a79b06711b98 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.829+0000 7fe3b7fff640 1 -- 172.21.15.134:0/2930564752 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4d4069aa0 con 0x556b966a97e0 2024-04-24T02:12:24.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.829+0000 7fe3b7fff640 1 -- 172.21.15.134:0/2930564752 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4d4069ca0 con 0x556b966a97e0 2024-04-24T02:12:24.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.829+0000 7fe3b7fff640 1 -- 172.21.15.134:0/2930564752 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4d405daf0 con 0x556b966a97e0 2024-04-24T02:12:24.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.830+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2930564752 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556b966a97e0 msgr2=0x556b966a9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.830+0000 7fe4e2e1f800 1 --2- 172.21.15.134:0/2930564752 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556b966a97e0 0x556b966a9c00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe4d408dbc0 tx=0x7fe4d408dcd0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.830+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2930564752 shutdown_connections 2024-04-24T02:12:24.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.830+0000 7fe4e2e1f800 1 --2- 172.21.15.134:0/2930564752 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556b966a97e0 0x556b966a9c00 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.830+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2930564752 >> 172.21.15.134:0/2930564752 conn(0x556b966a5b40 msgr2=0x556b966a3ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:24.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.830+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2930564752 shutdown_connections 2024-04-24T02:12:24.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.830+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2930564752 wait complete. 2024-04-24T02:12:24.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.830+0000 7fe4e2e1f800 1 Processor -- start 2024-04-24T02:12:24.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.830+0000 7fe4e2e1f800 1 -- start start 2024-04-24T02:12:24.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.830+0000 7fe4e2e1f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556b966a97e0 0x556b966b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.830+0000 7fe4e2e1f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556b966aa940 con 0x556b966a97e0 2024-04-24T02:12:24.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.830+0000 7fe4e011d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556b966a97e0 0x556b966b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.830+0000 7fe4e011d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556b966a97e0 0x556b966b0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46692/0 (socket says 172.21.15.134:46692) 2024-04-24T02:12:24.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.830+0000 7fe4e011d640 1 -- 172.21.15.134:0/2297578016 learned_addr learned my addr 172.21.15.134:0/2297578016 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:24.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.831+0000 7fe4e011d640 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b966b1400 con 0x556b966a97e0 2024-04-24T02:12:24.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.831+0000 7fe4e011d640 1 --2- 172.21.15.134:0/2297578016 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556b966a97e0 0x556b966b0ec0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe4d408cab0 tx=0x7fe4d408db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.831+0000 7fe3b67fc640 1 -- 172.21.15.134:0/2297578016 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4d4093070 con 0x556b966a97e0 2024-04-24T02:12:24.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.831+0000 7fe3b67fc640 1 -- 172.21.15.134:0/2297578016 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4d4069aa0 con 0x556b966a97e0 2024-04-24T02:12:24.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.831+0000 7fe3b67fc640 1 -- 172.21.15.134:0/2297578016 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4d4073da0 con 0x556b966a97e0 2024-04-24T02:12:24.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.831+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b966b1690 con 0x556b966a97e0 2024-04-24T02:12:24.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.831+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b966b4340 con 0x556b966a97e0 2024-04-24T02:12:24.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.832+0000 7fe3b67fc640 1 -- 172.21.15.134:0/2297578016 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe4d4096070 con 0x556b966a97e0 2024-04-24T02:12:24.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.832+0000 7fe3b67fc640 1 --2- 172.21.15.134:0/2297578016 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe3ac036950 0x7fe3ac038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.832+0000 7fe3b67fc640 1 -- 172.21.15.134:0/2297578016 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fe4d407f070 con 0x556b966a97e0 2024-04-24T02:12:24.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.832+0000 7fe4e111f640 1 --2- 172.21.15.134:0/2297578016 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe3ac036950 0x7fe3ac038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.832+0000 7fe4e2e1f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.832+0000 7fe4e2e1f800 1 --2- 172.21.15.134:0/2297578016 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556b966bc960 0x556b966bee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.832+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b966bf570 con 0x556b966bc960 2024-04-24T02:12:24.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.832+0000 7fe4e111f640 1 --2- 172.21.15.134:0/2297578016 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe3ac036950 0x7fe3ac038e10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x556b96685360 tx=0x7fe4d801f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.832+0000 7fe4e091e640 1 --2- 172.21.15.134:0/2297578016 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556b966bc960 0x556b966bee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.833+0000 7fe4e091e640 1 --2- 172.21.15.134:0/2297578016 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556b966bc960 0x556b966bee20 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.833+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4d002b070 con 0x556b966bc960 2024-04-24T02:12:24.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.833+0000 7fe4e2e1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:24.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.833+0000 7fe4e2e1f800 20 realm 2024-04-24T02:12:24.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.833+0000 7fe4e2e1f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.833+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b966bf980 con 0x556b966bc960 2024-04-24T02:12:24.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.833+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4d002b070 con 0x556b966bc960 2024-04-24T02:12:24.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.833+0000 7fe4e2e1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:24.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.833+0000 7fe4e2e1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:24.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.833+0000 7fe4e2e1f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.833+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b966c0250 con 0x556b966bc960 2024-04-24T02:12:24.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.833+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4d002b070 con 0x556b966bc960 2024-04-24T02:12:24.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.833+0000 7fe4e2e1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:24.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.833+0000 7fe4e2e1f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.833+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b966c05f0 con 0x556b966bc960 2024-04-24T02:12:24.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.833+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe4d002b070 con 0x556b966bc960 2024-04-24T02:12:24.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.833+0000 7fe4e2e1f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:24.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.833+0000 7fe4e2e1f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.833+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b966c0a50 con 0x556b966bc960 2024-04-24T02:12:24.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.834+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe4d002b070 con 0x556b966bc960 2024-04-24T02:12:24.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.834+0000 7fe4e2e1f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:24.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.834+0000 7fe4e2e1f800 20 searching for the correct realm 2024-04-24T02:12:24.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.834+0000 7fe4e2e1f800 1 --2- 172.21.15.134:0/2297578016 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x556b966c2aa0 0x556b966c4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.834+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b966c5540 con 0x556b966c2aa0 2024-04-24T02:12:24.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.834+0000 7fe4e011d640 1 --2- 172.21.15.134:0/2297578016 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x556b966c2aa0 0x556b966c4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.834+0000 7fe4e011d640 1 --2- 172.21.15.134:0/2297578016 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x556b966c2aa0 0x556b966c4e90 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.835+0000 7fe4e011d640 1 -- 172.21.15.134:0/2297578016 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4d409f070 con 0x556b966c2aa0 2024-04-24T02:12:24.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.835+0000 7fe4e011d640 1 --2- 172.21.15.134:0/2297578016 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fe4d4098070 0x7fe4d408c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.835+0000 7fe4e011d640 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b966c5540 con 0x7fe4d4098070 2024-04-24T02:12:24.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.835+0000 7fe4e111f640 1 --2- 172.21.15.134:0/2297578016 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fe4d4098070 0x7fe4d408c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.835+0000 7fe4e111f640 1 --2- 172.21.15.134:0/2297578016 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fe4d4098070 0x7fe4d408c220 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.835+0000 7fe4e111f640 1 -- 172.21.15.134:0/2297578016 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4d801f070 con 0x7fe4d4098070 2024-04-24T02:12:24.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.835+0000 7fe4e111f640 1 --2- 172.21.15.134:0/2297578016 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fe4d8031040 0x7fe4d8032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.835+0000 7fe4e111f640 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b966c5540 con 0x7fe4d8031040 2024-04-24T02:12:24.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.835+0000 7fe4e091e640 1 --2- 172.21.15.134:0/2297578016 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fe4d8031040 0x7fe4d8032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.836+0000 7fe4e091e640 1 --2- 172.21.15.134:0/2297578016 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fe4d8031040 0x7fe4d8032430 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.836+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4d002b070 con 0x7fe4d8031040 2024-04-24T02:12:24.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.836+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b966c5540 con 0x556b966bc960 2024-04-24T02:12:24.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.836+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4d002b070 con 0x556b966bc960 2024-04-24T02:12:24.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.836+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b966c5540 con 0x556b966bc960 2024-04-24T02:12:24.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.836+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe4d002b070 con 0x556b966bc960 2024-04-24T02:12:24.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.836+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b966c5540 con 0x7fe4d8031040 2024-04-24T02:12:24.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.837+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4d002b070 con 0x7fe4d8031040 2024-04-24T02:12:24.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.837+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b966c5540 con 0x7fe4d8031040 2024-04-24T02:12:24.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.837+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4d002b070 con 0x7fe4d8031040 2024-04-24T02:12:24.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.837+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b966c5540 con 0x7fe4d4098070 2024-04-24T02:12:24.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.837+0000 7fe4e111f640 1 -- 172.21.15.134:0/2297578016 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4d801f070 con 0x7fe4d4098070 2024-04-24T02:12:24.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.837+0000 7fe4e111f640 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b966c5540 con 0x556b966c2aa0 2024-04-24T02:12:24.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.837+0000 7fe4e011d640 1 -- 172.21.15.134:0/2297578016 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4d409f070 con 0x556b966c2aa0 2024-04-24T02:12:24.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.837+0000 7fe4e011d640 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b966c5540 con 0x556b966bc960 2024-04-24T02:12:24.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.838+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4d002b070 con 0x556b966bc960 2024-04-24T02:12:24.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.838+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b966c5540 con 0x7fe4d8031040 2024-04-24T02:12:24.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.838+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4d002b070 con 0x7fe4d8031040 2024-04-24T02:12:24.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.838+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b966c5540 con 0x556b966bc960 2024-04-24T02:12:24.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.838+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4d002b070 con 0x556b966bc960 2024-04-24T02:12:24.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.838+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b966c5540 con 0x7fe4d4098070 2024-04-24T02:12:24.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.838+0000 7fe4e111f640 1 -- 172.21.15.134:0/2297578016 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe4d801f070 con 0x7fe4d4098070 2024-04-24T02:12:24.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.838+0000 7fe4e111f640 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b966c5540 con 0x556b966c2aa0 2024-04-24T02:12:24.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.839+0000 7fe4e011d640 1 -- 172.21.15.134:0/2297578016 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4d409f070 con 0x556b966c2aa0 2024-04-24T02:12:24.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.839+0000 7fe4e011d640 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b966c5540 con 0x556b966c2aa0 2024-04-24T02:12:24.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.839+0000 7fe4e011d640 1 -- 172.21.15.134:0/2297578016 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4d409f070 con 0x556b966c2aa0 2024-04-24T02:12:24.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.839+0000 7fe4e011d640 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b966c5540 con 0x7fe4d8031040 2024-04-24T02:12:24.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.839+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4d002b070 con 0x7fe4d8031040 2024-04-24T02:12:24.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.839+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b966c5540 con 0x556b966c2aa0 2024-04-24T02:12:24.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.840+0000 7fe4e011d640 1 -- 172.21.15.134:0/2297578016 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4d409f070 con 0x556b966c2aa0 2024-04-24T02:12:24.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.840+0000 7fe4e011d640 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b966c5540 con 0x556b966c2aa0 2024-04-24T02:12:24.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.840+0000 7fe4e011d640 1 -- 172.21.15.134:0/2297578016 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4d409f070 con 0x556b966c2aa0 2024-04-24T02:12:24.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.840+0000 7fe4e011d640 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b966c5540 con 0x556b966bc960 2024-04-24T02:12:24.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.840+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4d002b070 con 0x556b966bc960 2024-04-24T02:12:24.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.840+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b966c5540 con 0x556b966bc960 2024-04-24T02:12:24.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.840+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fe4d002b070 con 0x556b966bc960 2024-04-24T02:12:24.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.840+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b966c5540 con 0x7fe4d8031040 2024-04-24T02:12:24.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.840+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4d002b070 con 0x7fe4d8031040 2024-04-24T02:12:24.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.840+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b966c5540 con 0x556b966c2aa0 2024-04-24T02:12:24.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.841+0000 7fe4e011d640 1 -- 172.21.15.134:0/2297578016 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4d409f070 con 0x556b966c2aa0 2024-04-24T02:12:24.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.841+0000 7fe4e011d640 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b966c5540 con 0x7fe4d4098070 2024-04-24T02:12:24.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.841+0000 7fe4e111f640 1 -- 172.21.15.134:0/2297578016 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4d801f070 con 0x7fe4d4098070 2024-04-24T02:12:24.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.841+0000 7fe4e111f640 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b966c5540 con 0x556b966bc960 2024-04-24T02:12:24.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.841+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4d002b070 con 0x556b966bc960 2024-04-24T02:12:24.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.841+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b966c5540 con 0x7fe4d8031040 2024-04-24T02:12:24.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.841+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4d002b070 con 0x7fe4d8031040 2024-04-24T02:12:24.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.841+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b966c5540 con 0x556b966c2aa0 2024-04-24T02:12:24.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.842+0000 7fe4e011d640 1 -- 172.21.15.134:0/2297578016 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4d409f070 con 0x556b966c2aa0 2024-04-24T02:12:24.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.842+0000 7fe4e011d640 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b966c5540 con 0x7fe4d8031040 2024-04-24T02:12:24.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.842+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4d002b070 con 0x7fe4d8031040 2024-04-24T02:12:24.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.842+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b966c5540 con 0x7fe4d4098070 2024-04-24T02:12:24.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.842+0000 7fe4e111f640 1 -- 172.21.15.134:0/2297578016 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4d801f070 con 0x7fe4d4098070 2024-04-24T02:12:24.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.842+0000 7fe4e111f640 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b966c5540 con 0x556b966c2aa0 2024-04-24T02:12:24.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.842+0000 7fe4e011d640 1 -- 172.21.15.134:0/2297578016 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4d409f070 con 0x556b966c2aa0 2024-04-24T02:12:24.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.842+0000 7fe4e011d640 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b966c5540 con 0x7fe4d8031040 2024-04-24T02:12:24.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.843+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4d002b070 con 0x7fe4d8031040 2024-04-24T02:12:24.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.843+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b966c5540 con 0x556b966bc960 2024-04-24T02:12:24.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.843+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe4d002b070 con 0x556b966bc960 2024-04-24T02:12:24.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.843+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b966c5540 con 0x7fe4d4098070 2024-04-24T02:12:24.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.843+0000 7fe4e111f640 1 -- 172.21.15.134:0/2297578016 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4d801f070 con 0x7fe4d4098070 2024-04-24T02:12:24.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.843+0000 7fe4e2e1f800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:24.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.843+0000 7fe4e2e1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:24.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.843+0000 7fe4e2e1f800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:24.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.843+0000 7fe4e2e1f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:24.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.843+0000 7fe4e2e1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:24.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.843+0000 7fe4e2e1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:24.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.843+0000 7fe4e2e1f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.843+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b966c1520 con 0x556b966bc960 2024-04-24T02:12:24.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.843+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4d002b070 con 0x556b966bc960 2024-04-24T02:12:24.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.843+0000 7fe4e2e1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:24.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.843+0000 7fe4e2e1f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.843+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b966c1dc0 con 0x556b966bc960 2024-04-24T02:12:24.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.844+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe4d002b070 con 0x556b966bc960 2024-04-24T02:12:24.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.844+0000 7fe4e2e1f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:24.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.844+0000 7fe4e2e1f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.844+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b966c1160 con 0x556b966bc960 2024-04-24T02:12:24.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.844+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe4d002b070 con 0x556b966bc960 2024-04-24T02:12:24.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.844+0000 7fe4e2e1f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:24.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.844+0000 7fe4e2e1f800 20 zone default found 2024-04-24T02:12:24.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.844+0000 7fe4e2e1f800 4 Realm: () 2024-04-24T02:12:24.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.844+0000 7fe4e2e1f800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:24.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.844+0000 7fe4e2e1f800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:24.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.844+0000 7fe4e2e1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:24.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.844+0000 7fe4e2e1f800 20 zonegroup default 2024-04-24T02:12:24.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.844+0000 7fe4e2e1f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.844+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b966c1dc0 con 0x7fe4d8031040 2024-04-24T02:12:24.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.844+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe4d002b070 con 0x7fe4d8031040 2024-04-24T02:12:24.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.844+0000 7fe4e2e1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:24.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.844+0000 7fe4e2e1f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.844+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b966c7380 con 0x556b966c2aa0 2024-04-24T02:12:24.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.845+0000 7fe4e011d640 1 -- 172.21.15.134:0/2297578016 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe4d409f070 con 0x556b966c2aa0 2024-04-24T02:12:24.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.845+0000 7fe4e2e1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:24.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.845+0000 7fe4e2e1f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.845+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b966c7720 con 0x556b966c2aa0 2024-04-24T02:12:24.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.845+0000 7fe4e011d640 1 -- 172.21.15.134:0/2297578016 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe4d409f070 con 0x556b966c2aa0 2024-04-24T02:12:24.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.845+0000 7fe4e2e1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:24.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.845+0000 7fe4e2e1f800 20 started sync module instance, tier type = 2024-04-24T02:12:24.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.845+0000 7fe4e2e1f800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:24.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.845+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b966c6820 con 0x7fe4d4098070 2024-04-24T02:12:24.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.846+0000 7fe4e111f640 1 -- 172.21.15.134:0/2297578016 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4d8040040 con 0x7fe4d4098070 2024-04-24T02:12:24.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.846+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93920573549632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b966c6480 con 0x7fe4d4098070 2024-04-24T02:12:24.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.846+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b966c85e0 con 0x556b966bc960 2024-04-24T02:12:24.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.847+0000 7fe4e111f640 1 -- 172.21.15.134:0/2297578016 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93920573549632] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4d8040040 con 0x7fe4d4098070 2024-04-24T02:12:24.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.848+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4d002b070 con 0x556b966bc960 2024-04-24T02:12:24.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.848+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93920573553424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b966c85e0 con 0x556b966bc960 2024-04-24T02:12:24.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.848+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b966c8fe0 con 0x556b966c2aa0 2024-04-24T02:12:24.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.849+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93920573553424] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4d002b070 con 0x556b966bc960 2024-04-24T02:12:24.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.849+0000 7fe4e011d640 1 -- 172.21.15.134:0/2297578016 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4d409f070 con 0x556b966c2aa0 2024-04-24T02:12:24.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.849+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93920573554992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b966c9380 con 0x556b966c2aa0 2024-04-24T02:12:24.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.849+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b966c9d80 con 0x7fe4d4098070 2024-04-24T02:12:24.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.850+0000 7fe4e011d640 1 -- 172.21.15.134:0/2297578016 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93920573554992] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4d409f070 con 0x556b966c2aa0 2024-04-24T02:12:24.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.850+0000 7fe4e111f640 1 -- 172.21.15.134:0/2297578016 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4d8040040 con 0x7fe4d4098070 2024-04-24T02:12:24.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.850+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93920573557488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b966ca1a0 con 0x7fe4d4098070 2024-04-24T02:12:24.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.850+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b966caba0 con 0x556b966bc960 2024-04-24T02:12:24.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.851+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4d002b070 con 0x556b966bc960 2024-04-24T02:12:24.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.851+0000 7fe4e111f640 1 -- 172.21.15.134:0/2297578016 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93920573557488] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4d8040040 con 0x7fe4d4098070 2024-04-24T02:12:24.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.851+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93920573560976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b966cab60 con 0x556b966bc960 2024-04-24T02:12:24.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.851+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b966cb5e0 con 0x7fe4d8031040 2024-04-24T02:12:24.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.852+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4d002b070 con 0x7fe4d8031040 2024-04-24T02:12:24.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.852+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93920573567280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b966cba00 con 0x7fe4d8031040 2024-04-24T02:12:24.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.852+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b966cc520 con 0x7fe4d8031040 2024-04-24T02:12:24.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.852+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93920573560976] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4d002b070 con 0x556b966bc960 2024-04-24T02:12:24.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.853+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93920573567280] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4d002b070 con 0x7fe4d8031040 2024-04-24T02:12:24.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.853+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(56 notify.6 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4d002b070 con 0x7fe4d8031040 2024-04-24T02:12:24.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.853+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93920573571056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b966cb550 con 0x7fe4d8031040 2024-04-24T02:12:24.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.853+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b966ccdc0 con 0x7fe4d8031040 2024-04-24T02:12:24.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.854+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(58 notify.7 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4d002b070 con 0x7fe4d8031040 2024-04-24T02:12:24.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.854+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93920573572864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b966ccfd0 con 0x7fe4d8031040 2024-04-24T02:12:24.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.854+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93920573571056] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4d002b070 con 0x7fe4d8031040 2024-04-24T02:12:24.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.854+0000 7fe4e2e1f800 20 add_watcher() i=0 2024-04-24T02:12:24.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.854+0000 7fe4e2e1f800 20 add_watcher() i=1 2024-04-24T02:12:24.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.854+0000 7fe4e2e1f800 20 add_watcher() i=2 2024-04-24T02:12:24.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.854+0000 7fe4e2e1f800 20 add_watcher() i=3 2024-04-24T02:12:24.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.854+0000 7fe4e2e1f800 20 add_watcher() i=4 2024-04-24T02:12:24.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.854+0000 7fe4e2e1f800 20 add_watcher() i=5 2024-04-24T02:12:24.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.854+0000 7fe4e2e1f800 20 add_watcher() i=6 2024-04-24T02:12:24.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.855+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93920573572864] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4d002b070 con 0x7fe4d8031040 2024-04-24T02:12:24.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.855+0000 7fe4e2e1f800 20 add_watcher() i=7 2024-04-24T02:12:24.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.855+0000 7fe4e2e1f800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:24.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.855+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b966d0000 con 0x556b966bc960 2024-04-24T02:12:24.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.856+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe4d002b070 con 0x556b966bc960 2024-04-24T02:12:24.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.856+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93920573573920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b966cd3f0 con 0x556b966bc960 2024-04-24T02:12:24.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.857+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93920573573920] v30'96 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe4d002b070 con 0x556b966bc960 2024-04-24T02:12:24.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.857+0000 7fe396fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:24.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.857+0000 7fe4e2e1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:24.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.857+0000 7fe4e2e1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:24.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.857+0000 7fe4e2e1f800 5 note: GC not initialized 2024-04-24T02:12:24.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.857+0000 7fe395fe3640 20 reqs_thread_entry: start 2024-04-24T02:12:24.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.857+0000 7fe4e2e1f800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:24.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.857+0000 7fe4e2e1f800 20 Filter name: none 2024-04-24T02:12:24.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.857+0000 7fe3077fe640 20 reqs_thread_entry: start 2024-04-24T02:12:24.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.857+0000 7fe4e2e1f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.857+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b96702c80 con 0x556b966bc960 2024-04-24T02:12:24.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.858+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fe4d002b070 con 0x556b966bc960 2024-04-24T02:12:24.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.858+0000 7fe4e2e1f800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T02:12:24.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.858+0000 7fe4e2e1f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:24.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.858+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b96703670 con 0x556b966bc960 2024-04-24T02:12:24.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.858+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fe4d002b070 con 0x556b966bc960 2024-04-24T02:12:24.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.858+0000 7fe4e2e1f800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T02:12:24.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.858+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b96704680 con 0x7fe4d4098070 2024-04-24T02:12:24.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.858+0000 7fe4e111f640 1 -- 172.21.15.134:0/2297578016 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fe4d8040040 con 0x7fe4d4098070 2024-04-24T02:12:24.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.859+0000 7fe396fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:24.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.859+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93920573573920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b966b9800 con 0x556b966bc960 2024-04-24T02:12:24.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.860+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 93920573573920] v30'97 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe4d002b070 con 0x556b966bc960 2024-04-24T02:12:24.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.860+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93920573549632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b966b9800 con 0x7fe4d4098070 2024-04-24T02:12:24.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.861+0000 7fe4e111f640 1 -- 172.21.15.134:0/2297578016 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 93920573549632] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4d8040040 con 0x7fe4d4098070 2024-04-24T02:12:24.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.861+0000 7fe4e2e1f800 20 remove_watcher() i=0 2024-04-24T02:12:24.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.861+0000 7fe4e2e1f800 2 removed watcher, disabling cache 2024-04-24T02:12:24.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.861+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93920573553424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b966c6c40 con 0x556b966bc960 2024-04-24T02:12:24.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.862+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 93920573553424] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4d002b070 con 0x556b966bc960 2024-04-24T02:12:24.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.862+0000 7fe4e2e1f800 20 remove_watcher() i=1 2024-04-24T02:12:24.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.862+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93920573554992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b966c7b10 con 0x556b966c2aa0 2024-04-24T02:12:24.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.863+0000 7fe4e011d640 1 -- 172.21.15.134:0/2297578016 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 93920573554992] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4d409f070 con 0x556b966c2aa0 2024-04-24T02:12:24.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.863+0000 7fe4e2e1f800 20 remove_watcher() i=2 2024-04-24T02:12:24.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.863+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93920573557488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b966c8130 con 0x7fe4d4098070 2024-04-24T02:12:24.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.864+0000 7fe4e111f640 1 -- 172.21.15.134:0/2297578016 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 93920573557488] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4d8040040 con 0x7fe4d4098070 2024-04-24T02:12:24.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.864+0000 7fe4e2e1f800 20 remove_watcher() i=3 2024-04-24T02:12:24.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.864+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93920573560976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b966c8130 con 0x556b966bc960 2024-04-24T02:12:24.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.865+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 93920573560976] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4d002b070 con 0x556b966bc960 2024-04-24T02:12:24.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.865+0000 7fe4e2e1f800 20 remove_watcher() i=4 2024-04-24T02:12:24.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.865+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93920573567280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b966c9890 con 0x7fe4d8031040 2024-04-24T02:12:24.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.866+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 93920573567280] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4d002b070 con 0x7fe4d8031040 2024-04-24T02:12:24.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.866+0000 7fe4e2e1f800 20 remove_watcher() i=5 2024-04-24T02:12:24.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.866+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93920573571056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b966c8130 con 0x7fe4d8031040 2024-04-24T02:12:24.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.867+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 93920573571056] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4d002b070 con 0x7fe4d8031040 2024-04-24T02:12:24.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.867+0000 7fe4e2e1f800 20 remove_watcher() i=6 2024-04-24T02:12:24.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.867+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93920573572864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b966c8130 con 0x7fe4d8031040 2024-04-24T02:12:24.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.868+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 93920573572864] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4d002b070 con 0x7fe4d8031040 2024-04-24T02:12:24.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.868+0000 7fe4e2e1f800 20 remove_watcher() i=7 2024-04-24T02:12:24.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.868+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fe4d8031040 msgr2=0x7fe4d8032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.868+0000 7fe4e2e1f800 1 --2- 172.21.15.134:0/2297578016 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fe4d8031040 0x7fe4d8032430 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.868+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556b966bc960 msgr2=0x556b966bee20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.868+0000 7fe4e2e1f800 1 --2- 172.21.15.134:0/2297578016 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556b966bc960 0x556b966bee20 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.868+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fe4d4098070 msgr2=0x7fe4d408c220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.868+0000 7fe4e2e1f800 1 --2- 172.21.15.134:0/2297578016 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fe4d4098070 0x7fe4d408c220 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.868+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x556b966c2aa0 msgr2=0x556b966c4e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.868+0000 7fe4e2e1f800 1 --2- 172.21.15.134:0/2297578016 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x556b966c2aa0 0x556b966c4e90 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.868+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe3ac036950 msgr2=0x7fe3ac038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.869+0000 7fe4e2e1f800 1 --2- 172.21.15.134:0/2297578016 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe3ac036950 0x7fe3ac038e10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x556b96685360 tx=0x7fe4d801f000 comp rx=0 tx=0).stop 2024-04-24T02:12:24.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.869+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556b966a97e0 msgr2=0x556b966b0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.869+0000 7fe4e2e1f800 1 --2- 172.21.15.134:0/2297578016 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556b966a97e0 0x556b966b0ec0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe4d408cab0 tx=0x7fe4d408db20 comp rx=0 tx=0).stop 2024-04-24T02:12:24.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.869+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 reap_dead start 2024-04-24T02:12:24.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.869+0000 7fe4e091e640 1 -- 172.21.15.134:0/2297578016 reap_dead start 2024-04-24T02:12:24.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.869+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 shutdown_connections 2024-04-24T02:12:24.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.869+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 >> 172.21.15.134:0/2297578016 conn(0x556b966a5b40 msgr2=0x556b966a31a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:24.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.869+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 shutdown_connections 2024-04-24T02:12:24.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.869+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/2297578016 wait complete. 2024-04-24T02:12:24.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.869+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/789603206 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe3b8036900 msgr2=0x7fe3b8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.869+0000 7fe4e2e1f800 1 --2- 172.21.15.134:0/789603206 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe3b8036900 0x7fe3b8038dc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x556b9668c5b0 tx=0x7fe4d8005840 comp rx=0 tx=0).stop 2024-04-24T02:12:24.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.869+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/789603206 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556b9669c520 msgr2=0x556b9669c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.869+0000 7fe4e2e1f800 1 --2- 172.21.15.134:0/789603206 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556b9669c520 0x556b9669c940 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4044840 tx=0x7fe4d4002fb0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.869+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/789603206 shutdown_connections 2024-04-24T02:12:24.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.869+0000 7fe4e2e1f800 1 --2- 172.21.15.134:0/789603206 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe3b8036900 0x7fe3b8038dc0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.869+0000 7fe4e2e1f800 1 --2- 172.21.15.134:0/789603206 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556b9669c520 0x556b9669c940 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.869+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/789603206 >> 172.21.15.134:0/789603206 conn(0x556b966905c0 msgr2=0x556b966909c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:24.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.869+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/789603206 shutdown_connections 2024-04-24T02:12:24.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.869+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/789603206 wait complete. 2024-04-24T02:12:24.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.869+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/3553133248 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556b965892c0 msgr2=0x556b9668b380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.869+0000 7fe4e2e1f800 1 --2- 172.21.15.134:0/3553133248 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556b965892c0 0x556b9668b380 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.869+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/3553133248 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe3c8036950 msgr2=0x7fe3c8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.869+0000 7fe4e2e1f800 1 --2- 172.21.15.134:0/3553133248 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe3c8036950 0x7fe3c8038e10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4054000 tx=0x7fe4d404e000 comp rx=0 tx=0).stop 2024-04-24T02:12:24.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.869+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/3553133248 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556b96587780 msgr2=0x556b96684140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.869+0000 7fe4e2e1f800 1 --2- 172.21.15.134:0/3553133248 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556b96587780 0x556b96684140 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe4d000c010 tx=0x7fe4d0000ed0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.869+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/3553133248 shutdown_connections 2024-04-24T02:12:24.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.869+0000 7fe4e2e1f800 1 --2- 172.21.15.134:0/3553133248 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556b965892c0 0x556b9668b380 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.869+0000 7fe4e2e1f800 1 --2- 172.21.15.134:0/3553133248 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe3c8036950 0x7fe3c8038e10 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.869+0000 7fe4e2e1f800 1 --2- 172.21.15.134:0/3553133248 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556b96587780 0x556b96684140 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.869+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/3553133248 >> 172.21.15.134:0/3553133248 conn(0x556b96583380 msgr2=0x556b96676800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:24.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.870+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/3553133248 shutdown_connections 2024-04-24T02:12:24.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.870+0000 7fe4e2e1f800 1 -- 172.21.15.134:0/3553133248 wait complete. 2024-04-24T02:12:24.894 INFO:teuthology.orchestra.run.smithi134.stdout:[] 2024-04-24T02:12:24.894 DEBUG:tasks.util.rgw: json result: [] 2024-04-24T02:12:24.910 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T02:12:24.911 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-04-24T02:12:24.911 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-04-24T02:12:24.911 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-04-24T02:12:24.978 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:24.978 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:24.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.977+0000 7f064182f800 1 Processor -- start 2024-04-24T02:12:24.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.977+0000 7f064182f800 1 -- start start 2024-04-24T02:12:24.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.977+0000 7f064182f800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x561464e52990 0x561464e54d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.977+0000 7f064182f800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561464d10d40 con 0x561464e552c0 2024-04-24T02:12:24.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.977+0000 7f064182f800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x561464ce34d0 con 0x561464e52990 2024-04-24T02:12:24.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.978+0000 7f063cbc0640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x561464e52990 0x561464e54d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.978+0000 7f063cbc0640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x561464e52990 0x561464e54d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46694/0 (socket says 172.21.15.134:46694) 2024-04-24T02:12:24.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.978+0000 7f063c3bf640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x561464e552c0 0x561464e576b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:43384/0 (socket says 172.21.15.134:43384) 2024-04-24T02:12:24.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.978+0000 7f063cbc0640 1 -- 172.21.15.134:0/1143651669 learned_addr learned my addr 172.21.15.134:0/1143651669 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:24.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.978+0000 7f063cbc0640 1 -- 172.21.15.134:0/1143651669 >> v1:172.21.15.104:6789/0 conn(0x561464e552c0 legacy=0x561464e576b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.978+0000 7f063cbc0640 1 -- 172.21.15.134:0/1143651669 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561464d0f590 con 0x561464e52990 2024-04-24T02:12:24.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.980+0000 7f063cbc0640 1 --2- 172.21.15.134:0/1143651669 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561464e52990 0x561464e54d80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f062c00a520 tx=0x7f062c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2059d7d2d369bed4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.980+0000 7f063bbbe640 1 -- 172.21.15.134:0/1143651669 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f062c057070 con 0x561464e52990 2024-04-24T02:12:24.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.980+0000 7f063bbbe640 1 -- 172.21.15.134:0/1143651669 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f062c052570 con 0x561464e52990 2024-04-24T02:12:24.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.980+0000 7f063bbbe640 1 -- 172.21.15.134:0/1143651669 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f062c04ae60 con 0x561464e52990 2024-04-24T02:12:24.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.980+0000 7f064182f800 1 -- 172.21.15.134:0/1143651669 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561464e52990 msgr2=0x561464e54d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:24.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.980+0000 7f064182f800 1 --2- 172.21.15.134:0/1143651669 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561464e52990 0x561464e54d80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f062c00a520 tx=0x7f062c01d010 comp rx=0 tx=0).stop 2024-04-24T02:12:24.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.980+0000 7f064182f800 1 -- 172.21.15.134:0/1143651669 shutdown_connections 2024-04-24T02:12:24.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.980+0000 7f064182f800 1 --2- 172.21.15.134:0/1143651669 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561464e52990 0x561464e54d80 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:24.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.980+0000 7f064182f800 1 -- 172.21.15.134:0/1143651669 >> 172.21.15.134:0/1143651669 conn(0x561464e4c300 msgr2=0x561464e4e720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:24.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.981+0000 7f064182f800 1 -- 172.21.15.134:0/1143651669 shutdown_connections 2024-04-24T02:12:24.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.981+0000 7f064182f800 1 -- 172.21.15.134:0/1143651669 wait complete. 2024-04-24T02:12:24.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.992+0000 7f064182f800 1 Processor -- start 2024-04-24T02:12:24.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.992+0000 7f064182f800 1 -- start start 2024-04-24T02:12:24.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.992+0000 7f064182f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561464e52990 0x561464f43120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:24.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.992+0000 7f064182f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x561464d9d3c0 con 0x561464e52990 2024-04-24T02:12:24.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.993+0000 7f063cbc0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561464e52990 0x561464f43120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:24.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.993+0000 7f063cbc0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561464e52990 0x561464f43120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46698/0 (socket says 172.21.15.134:46698) 2024-04-24T02:12:24.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.993+0000 7f063cbc0640 1 -- 172.21.15.134:0/1410134100 learned_addr learned my addr 172.21.15.134:0/1410134100 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:24.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.993+0000 7f063cbc0640 1 -- 172.21.15.134:0/1410134100 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561464f436f0 con 0x561464e52990 2024-04-24T02:12:24.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.993+0000 7f063cbc0640 1 --2- 172.21.15.134:0/1410134100 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561464e52990 0x561464f43120 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f062c055040 tx=0x7f062c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74e2539a9a35fa4c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:24.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.993+0000 7f052ae0d640 1 -- 172.21.15.134:0/1410134100 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f062c057040 con 0x561464e52990 2024-04-24T02:12:24.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.993+0000 7f052ae0d640 1 -- 172.21.15.134:0/1410134100 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f062c052720 con 0x561464e52990 2024-04-24T02:12:24.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.993+0000 7f052ae0d640 1 -- 172.21.15.134:0/1410134100 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f062c052a40 con 0x561464e52990 2024-04-24T02:12:25.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.994+0000 7f064182f800 1 -- 172.21.15.134:0/1410134100 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561464e52990 msgr2=0x561464f43120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.994+0000 7f064182f800 1 --2- 172.21.15.134:0/1410134100 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561464e52990 0x561464f43120 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f062c055040 tx=0x7f062c04c000 comp rx=0 tx=0).stop 2024-04-24T02:12:25.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.994+0000 7f064182f800 1 -- 172.21.15.134:0/1410134100 shutdown_connections 2024-04-24T02:12:25.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.994+0000 7f064182f800 1 --2- 172.21.15.134:0/1410134100 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561464e52990 0x561464f43120 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.994+0000 7f064182f800 1 -- 172.21.15.134:0/1410134100 >> 172.21.15.134:0/1410134100 conn(0x561464e4c300 msgr2=0x561464f3ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:25.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.994+0000 7f064182f800 1 -- 172.21.15.134:0/1410134100 shutdown_connections 2024-04-24T02:12:25.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.994+0000 7f064182f800 1 -- 172.21.15.134:0/1410134100 wait complete. 2024-04-24T02:12:25.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.994+0000 7f064182f800 1 Processor -- start 2024-04-24T02:12:25.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.994+0000 7f064182f800 1 -- start start 2024-04-24T02:12:25.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.995+0000 7f064182f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561464e52990 0x561464f4abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.995+0000 7f064182f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x561464e5b0e0 con 0x561464e52990 2024-04-24T02:12:25.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.995+0000 7f063cbc0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561464e52990 0x561464f4abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.995+0000 7f063cbc0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561464e52990 0x561464f4abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46712/0 (socket says 172.21.15.134:46712) 2024-04-24T02:12:25.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.995+0000 7f063cbc0640 1 -- 172.21.15.134:0/934308450 learned_addr learned my addr 172.21.15.134:0/934308450 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:25.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.995+0000 7f063cbc0640 1 -- 172.21.15.134:0/934308450 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561464f4b0f0 con 0x561464e52990 2024-04-24T02:12:25.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.995+0000 7f063cbc0640 1 --2- 172.21.15.134:0/934308450 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561464e52990 0x561464f4abb0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f062c052540 tx=0x7f062c003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.995+0000 7f052960a640 1 -- 172.21.15.134:0/934308450 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f062c073070 con 0x561464e52990 2024-04-24T02:12:25.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.995+0000 7f052960a640 1 -- 172.21.15.134:0/934308450 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f062c05d440 con 0x561464e52990 2024-04-24T02:12:25.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.995+0000 7f064182f800 1 -- 172.21.15.134:0/934308450 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561464f4b380 con 0x561464e52990 2024-04-24T02:12:25.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.995+0000 7f052960a640 1 -- 172.21.15.134:0/934308450 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f062c057070 con 0x561464e52990 2024-04-24T02:12:25.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.995+0000 7f064182f800 1 -- 172.21.15.134:0/934308450 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561464f4e030 con 0x561464e52990 2024-04-24T02:12:25.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.996+0000 7f052960a640 1 -- 172.21.15.134:0/934308450 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f062c076070 con 0x561464e52990 2024-04-24T02:12:25.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.996+0000 7f052960a640 1 --2- 172.21.15.134:0/934308450 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0524036900 0x7f0524038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.996+0000 7f052960a640 1 -- 172.21.15.134:0/934308450 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f062c08da60 con 0x561464e52990 2024-04-24T02:12:25.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.996+0000 7f063c3bf640 1 --2- 172.21.15.134:0/934308450 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0524036900 0x7f0524038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.997+0000 7f064182f800 1 --2- 172.21.15.134:0/934308450 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x561464e552c0 0x561464f51df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.997+0000 7f064182f800 1 -- 172.21.15.134:0/934308450 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561464f52330 con 0x561464e552c0 2024-04-24T02:12:25.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.997+0000 7f063d3c1640 1 --2- 172.21.15.134:0/934308450 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x561464e552c0 0x561464f51df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.997+0000 7f063c3bf640 1 --2- 172.21.15.134:0/934308450 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0524036900 0x7f0524038dc0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0630000f60 tx=0x7f0630001370 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.997+0000 7f063d3c1640 1 --2- 172.21.15.134:0/934308450 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x561464e552c0 0x561464f51df0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.997+0000 7f063d3c1640 1 -- 172.21.15.134:0/934308450 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f063400a4a0 con 0x561464e552c0 2024-04-24T02:12:25.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.997+0000 7f064182f800 1 -- 172.21.15.134:0/934308450 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561464f4f3c0 con 0x561464e552c0 2024-04-24T02:12:25.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.997+0000 7f063d3c1640 1 -- 172.21.15.134:0/934308450 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f063400a4a0 con 0x561464e552c0 2024-04-24T02:12:25.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.997+0000 7f064182f800 1 -- 172.21.15.134:0/934308450 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561464f541a0 con 0x561464e552c0 2024-04-24T02:12:25.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.998+0000 7f063d3c1640 1 -- 172.21.15.134:0/934308450 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f063400a4a0 con 0x561464e552c0 2024-04-24T02:12:25.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.998+0000 7f064182f800 1 -- 172.21.15.134:0/934308450 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561464f534e0 con 0x561464e552c0 2024-04-24T02:12:25.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.998+0000 7f063d3c1640 1 -- 172.21.15.134:0/934308450 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f063400a4a0 con 0x561464e552c0 2024-04-24T02:12:25.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.998+0000 7f064182f800 1 -- 172.21.15.134:0/934308450 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561464f53900 con 0x561464e552c0 2024-04-24T02:12:25.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.998+0000 7f063d3c1640 1 -- 172.21.15.134:0/934308450 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f063400a4a0 con 0x561464e552c0 2024-04-24T02:12:25.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.999+0000 7f064182f800 1 Processor -- start 2024-04-24T02:12:25.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.999+0000 7f064182f800 1 -- start start 2024-04-24T02:12:25.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.999+0000 7f064182f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561464f62fb0 0x561464f633d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.999+0000 7f064182f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x561464d436b0 con 0x561464f62fb0 2024-04-24T02:12:25.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.999+0000 7f063c3bf640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561464f62fb0 0x561464f633d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.999+0000 7f063c3bf640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561464f62fb0 0x561464f633d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46714/0 (socket says 172.21.15.134:46714) 2024-04-24T02:12:25.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.999+0000 7f063c3bf640 1 -- 172.21.15.134:0/3942219220 learned_addr learned my addr 172.21.15.134:0/3942219220 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:25.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:24.999+0000 7f063c3bf640 1 -- 172.21.15.134:0/3942219220 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561464f63910 con 0x561464f62fb0 2024-04-24T02:12:25.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.000+0000 7f063c3bf640 1 --2- 172.21.15.134:0/3942219220 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561464f62fb0 0x561464f633d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0630001ed0 tx=0x7f063000ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.000+0000 7f05227fc640 1 -- 172.21.15.134:0/3942219220 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0630022070 con 0x561464f62fb0 2024-04-24T02:12:25.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.000+0000 7f05227fc640 1 -- 172.21.15.134:0/3942219220 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f063000d520 con 0x561464f62fb0 2024-04-24T02:12:25.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.000+0000 7f05227fc640 1 -- 172.21.15.134:0/3942219220 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f063000d800 con 0x561464f62fb0 2024-04-24T02:12:25.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.000+0000 7f064182f800 1 -- 172.21.15.134:0/3942219220 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561464f64380 con 0x561464f62fb0 2024-04-24T02:12:25.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.000+0000 7f064182f800 1 -- 172.21.15.134:0/3942219220 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561464f64880 con 0x561464f62fb0 2024-04-24T02:12:25.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.000+0000 7f05227fc640 1 -- 172.21.15.134:0/3942219220 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0630025070 con 0x561464f62fb0 2024-04-24T02:12:25.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.001+0000 7f05227fc640 1 --2- 172.21.15.134:0/3942219220 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0514036900 0x7f0514038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.001+0000 7f05227fc640 1 -- 172.21.15.134:0/3942219220 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f063004dbd0 con 0x561464f62fb0 2024-04-24T02:12:25.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.001+0000 7f063d3c1640 1 --2- 172.21.15.134:0/3942219220 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0514036900 0x7f0514038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.001+0000 7f064182f800 1 Processor -- start 2024-04-24T02:12:25.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.001+0000 7f064182f800 1 -- start start 2024-04-24T02:12:25.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.001+0000 7f063d3c1640 1 --2- 172.21.15.134:0/3942219220 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0514036900 0x7f0514038dc0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x561464f53880 tx=0x7f0634005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.001+0000 7f064182f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561464e51f80 0x561464e523a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.001+0000 7f064182f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x561464f439b0 con 0x561464e51f80 2024-04-24T02:12:25.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.001+0000 7f063c3bf640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561464e51f80 0x561464e523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.001+0000 7f063c3bf640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561464e51f80 0x561464e523a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46722/0 (socket says 172.21.15.134:46722) 2024-04-24T02:12:25.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.001+0000 7f063c3bf640 1 -- 172.21.15.134:0/3869480829 learned_addr learned my addr 172.21.15.134:0/3869480829 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:25.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.002+0000 7f063c3bf640 1 -- 172.21.15.134:0/3869480829 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561464e50780 con 0x561464e51f80 2024-04-24T02:12:25.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.002+0000 7f063c3bf640 1 --2- 172.21.15.134:0/3869480829 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561464e51f80 0x561464e523a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f063004c120 tx=0x7f0630024740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=581ed218be6ce737 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.002+0000 7f0513fff640 1 -- 172.21.15.134:0/3869480829 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f063004a030 con 0x561464e51f80 2024-04-24T02:12:25.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.002+0000 7f0513fff640 1 -- 172.21.15.134:0/3869480829 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0630025990 con 0x561464e51f80 2024-04-24T02:12:25.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.002+0000 7f0513fff640 1 -- 172.21.15.134:0/3869480829 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0630026730 con 0x561464e51f80 2024-04-24T02:12:25.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.002+0000 7f064182f800 1 -- 172.21.15.134:0/3869480829 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561464e51f80 msgr2=0x561464e523a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.002+0000 7f064182f800 1 --2- 172.21.15.134:0/3869480829 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561464e51f80 0x561464e523a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f063004c120 tx=0x7f0630024740 comp rx=0 tx=0).stop 2024-04-24T02:12:25.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.002+0000 7f064182f800 1 -- 172.21.15.134:0/3869480829 shutdown_connections 2024-04-24T02:12:25.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.002+0000 7f064182f800 1 --2- 172.21.15.134:0/3869480829 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561464e51f80 0x561464e523a0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.002+0000 7f064182f800 1 -- 172.21.15.134:0/3869480829 >> 172.21.15.134:0/3869480829 conn(0x561464f6c650 msgr2=0x561464f6a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:25.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.002+0000 7f064182f800 1 -- 172.21.15.134:0/3869480829 shutdown_connections 2024-04-24T02:12:25.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.002+0000 7f064182f800 1 -- 172.21.15.134:0/3869480829 wait complete. 2024-04-24T02:12:25.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.003+0000 7f064182f800 1 Processor -- start 2024-04-24T02:12:25.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.003+0000 7f064182f800 1 -- start start 2024-04-24T02:12:25.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.003+0000 7f064182f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561464e51f80 0x561464f79b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.003+0000 7f064182f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x561464e50c50 con 0x561464e51f80 2024-04-24T02:12:25.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.003+0000 7f063c3bf640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561464e51f80 0x561464f79b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.003+0000 7f063c3bf640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561464e51f80 0x561464f79b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46736/0 (socket says 172.21.15.134:46736) 2024-04-24T02:12:25.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.003+0000 7f063c3bf640 1 -- 172.21.15.134:0/2651738623 learned_addr learned my addr 172.21.15.134:0/2651738623 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:25.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.003+0000 7f063c3bf640 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561464f7a070 con 0x561464e51f80 2024-04-24T02:12:25.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.003+0000 7f063c3bf640 1 --2- 172.21.15.134:0/2651738623 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561464e51f80 0x561464f79b30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0630024a50 tx=0x7f063004c080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.003+0000 7f05127fc640 1 -- 172.21.15.134:0/2651738623 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0630025570 con 0x561464e51f80 2024-04-24T02:12:25.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.003+0000 7f05127fc640 1 -- 172.21.15.134:0/2651738623 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f063001be00 con 0x561464e51f80 2024-04-24T02:12:25.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.003+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561464f7a070 con 0x561464e51f80 2024-04-24T02:12:25.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.003+0000 7f05127fc640 1 -- 172.21.15.134:0/2651738623 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f063000daf0 con 0x561464e51f80 2024-04-24T02:12:25.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.003+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561464f7a070 con 0x561464e51f80 2024-04-24T02:12:25.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.004+0000 7f05127fc640 1 -- 172.21.15.134:0/2651738623 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f063000dc90 con 0x561464e51f80 2024-04-24T02:12:25.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.004+0000 7f05127fc640 1 --2- 172.21.15.134:0/2651738623 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0508036950 0x7f0508038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.004+0000 7f05127fc640 1 -- 172.21.15.134:0/2651738623 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f0630045070 con 0x561464e51f80 2024-04-24T02:12:25.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.005+0000 7f063d3c1640 1 --2- 172.21.15.134:0/2651738623 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0508036950 0x7f0508038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.005+0000 7f064182f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.005+0000 7f064182f800 1 --2- 172.21.15.134:0/2651738623 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x561464f85200 0x561464f876c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.005+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561464f87e10 con 0x561464f85200 2024-04-24T02:12:25.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.005+0000 7f063cbc0640 1 --2- 172.21.15.134:0/2651738623 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x561464f85200 0x561464f876c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.005+0000 7f063d3c1640 1 --2- 172.21.15.134:0/2651738623 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0508036950 0x7f0508038e10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x561464f53000 tx=0x7f063401f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.005+0000 7f063cbc0640 1 --2- 172.21.15.134:0/2651738623 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x561464f85200 0x561464f876c0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.005+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f062c075030 con 0x561464f85200 2024-04-24T02:12:25.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.005+0000 7f064182f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:25.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.005+0000 7f064182f800 20 realm 2024-04-24T02:12:25.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.005+0000 7f064182f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.005+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561464f88220 con 0x561464f85200 2024-04-24T02:12:25.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.006+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f062c075030 con 0x561464f85200 2024-04-24T02:12:25.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.006+0000 7f064182f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:25.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.006+0000 7f064182f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:25.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.006+0000 7f064182f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.006+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561464f88ac0 con 0x561464f85200 2024-04-24T02:12:25.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.006+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f062c075030 con 0x561464f85200 2024-04-24T02:12:25.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.006+0000 7f064182f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:25.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.006+0000 7f064182f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.006+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561464f88e60 con 0x561464f85200 2024-04-24T02:12:25.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.006+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f062c075030 con 0x561464f85200 2024-04-24T02:12:25.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.006+0000 7f064182f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:25.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.006+0000 7f064182f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.006+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561464f896b0 con 0x561464f85200 2024-04-24T02:12:25.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.006+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f062c075030 con 0x561464f85200 2024-04-24T02:12:25.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.006+0000 7f064182f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:25.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.006+0000 7f064182f800 20 searching for the correct realm 2024-04-24T02:12:25.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.006+0000 7f064182f800 1 --2- 172.21.15.134:0/2651738623 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x561464f8b420 0x561464f8d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.006+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561464f8ddf0 con 0x561464f8b420 2024-04-24T02:12:25.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.006+0000 7f063c3bf640 1 --2- 172.21.15.134:0/2651738623 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x561464f8b420 0x561464f8d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.007+0000 7f063c3bf640 1 --2- 172.21.15.134:0/2651738623 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x561464f8b420 0x561464f8d810 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.007+0000 7f063c3bf640 1 -- 172.21.15.134:0/2651738623 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0630024030 con 0x561464f8b420 2024-04-24T02:12:25.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.007+0000 7f063c3bf640 1 --2- 172.21.15.134:0/2651738623 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f063001ac20 0x7f06300278a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.007+0000 7f063c3bf640 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561464f8ddf0 con 0x7f063001ac20 2024-04-24T02:12:25.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.007+0000 7f063d3c1640 1 --2- 172.21.15.134:0/2651738623 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f063001ac20 0x7f06300278a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.007+0000 7f063d3c1640 1 --2- 172.21.15.134:0/2651738623 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f063001ac20 0x7f06300278a0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.008+0000 7f063d3c1640 1 -- 172.21.15.134:0/2651738623 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f063401f070 con 0x7f063001ac20 2024-04-24T02:12:25.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.008+0000 7f063d3c1640 1 --2- 172.21.15.134:0/2651738623 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f0634031040 0x7f0634032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.008+0000 7f063d3c1640 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561464f8ddf0 con 0x7f0634031040 2024-04-24T02:12:25.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.008+0000 7f063cbc0640 1 --2- 172.21.15.134:0/2651738623 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f0634031040 0x7f0634032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.008+0000 7f063cbc0640 1 --2- 172.21.15.134:0/2651738623 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f0634031040 0x7f0634032430 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.008+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f062c075030 con 0x7f0634031040 2024-04-24T02:12:25.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.008+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561464f8ddf0 con 0x561464f85200 2024-04-24T02:12:25.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.009+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f062c075030 con 0x561464f85200 2024-04-24T02:12:25.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.009+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561464f8ddf0 con 0x561464f85200 2024-04-24T02:12:25.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.009+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f062c075030 con 0x561464f85200 2024-04-24T02:12:25.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.009+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561464f8ddf0 con 0x7f0634031040 2024-04-24T02:12:25.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.009+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f062c075030 con 0x7f0634031040 2024-04-24T02:12:25.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.009+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561464f8ddf0 con 0x7f0634031040 2024-04-24T02:12:25.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.009+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f062c075030 con 0x7f0634031040 2024-04-24T02:12:25.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.009+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561464f8ddf0 con 0x7f063001ac20 2024-04-24T02:12:25.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.010+0000 7f063d3c1640 1 -- 172.21.15.134:0/2651738623 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f063401f070 con 0x7f063001ac20 2024-04-24T02:12:25.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.010+0000 7f063d3c1640 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561464f8ddf0 con 0x561464f8b420 2024-04-24T02:12:25.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.010+0000 7f063c3bf640 1 -- 172.21.15.134:0/2651738623 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f063005c040 con 0x561464f8b420 2024-04-24T02:12:25.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.010+0000 7f063c3bf640 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561464f8ddf0 con 0x561464f85200 2024-04-24T02:12:25.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.010+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f062c075030 con 0x561464f85200 2024-04-24T02:12:25.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.010+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561464f8ddf0 con 0x7f0634031040 2024-04-24T02:12:25.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.010+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f062c075030 con 0x7f0634031040 2024-04-24T02:12:25.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.010+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561464f8ddf0 con 0x561464f85200 2024-04-24T02:12:25.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.011+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f062c075030 con 0x561464f85200 2024-04-24T02:12:25.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.011+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561464f8ddf0 con 0x7f063001ac20 2024-04-24T02:12:25.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.011+0000 7f063d3c1640 1 -- 172.21.15.134:0/2651738623 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f063401f070 con 0x7f063001ac20 2024-04-24T02:12:25.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.011+0000 7f063d3c1640 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561464f8ddf0 con 0x561464f8b420 2024-04-24T02:12:25.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.011+0000 7f063c3bf640 1 -- 172.21.15.134:0/2651738623 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f063005c040 con 0x561464f8b420 2024-04-24T02:12:25.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.011+0000 7f063c3bf640 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561464f8ddf0 con 0x561464f8b420 2024-04-24T02:12:25.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.011+0000 7f063c3bf640 1 -- 172.21.15.134:0/2651738623 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f063005c040 con 0x561464f8b420 2024-04-24T02:12:25.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.011+0000 7f063c3bf640 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561464f8ddf0 con 0x7f0634031040 2024-04-24T02:12:25.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.012+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f062c075030 con 0x7f0634031040 2024-04-24T02:12:25.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.012+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561464f8ddf0 con 0x561464f8b420 2024-04-24T02:12:25.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.012+0000 7f063c3bf640 1 -- 172.21.15.134:0/2651738623 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f063005c040 con 0x561464f8b420 2024-04-24T02:12:25.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.012+0000 7f063c3bf640 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561464f8ddf0 con 0x561464f8b420 2024-04-24T02:12:25.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.012+0000 7f063c3bf640 1 -- 172.21.15.134:0/2651738623 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f063005c040 con 0x561464f8b420 2024-04-24T02:12:25.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.012+0000 7f063c3bf640 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561464f8ddf0 con 0x561464f85200 2024-04-24T02:12:25.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.012+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f062c075030 con 0x561464f85200 2024-04-24T02:12:25.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.012+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561464f8ddf0 con 0x561464f85200 2024-04-24T02:12:25.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.012+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f062c075030 con 0x561464f85200 2024-04-24T02:12:25.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.012+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561464f8ddf0 con 0x7f0634031040 2024-04-24T02:12:25.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.013+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f062c075030 con 0x7f0634031040 2024-04-24T02:12:25.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.013+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561464f8ddf0 con 0x561464f8b420 2024-04-24T02:12:25.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.013+0000 7f063c3bf640 1 -- 172.21.15.134:0/2651738623 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f063005c040 con 0x561464f8b420 2024-04-24T02:12:25.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.013+0000 7f063c3bf640 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561464f8ddf0 con 0x7f063001ac20 2024-04-24T02:12:25.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.013+0000 7f063d3c1640 1 -- 172.21.15.134:0/2651738623 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f063401f070 con 0x7f063001ac20 2024-04-24T02:12:25.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.013+0000 7f063d3c1640 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561464f8ddf0 con 0x561464f85200 2024-04-24T02:12:25.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.014+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f062c075030 con 0x561464f85200 2024-04-24T02:12:25.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.014+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561464f8ddf0 con 0x7f0634031040 2024-04-24T02:12:25.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.014+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f062c075030 con 0x7f0634031040 2024-04-24T02:12:25.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.014+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561464f8ddf0 con 0x561464f8b420 2024-04-24T02:12:25.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.014+0000 7f063c3bf640 1 -- 172.21.15.134:0/2651738623 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f063005c040 con 0x561464f8b420 2024-04-24T02:12:25.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.014+0000 7f063c3bf640 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561464f8ddf0 con 0x7f0634031040 2024-04-24T02:12:25.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.015+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f062c075030 con 0x7f0634031040 2024-04-24T02:12:25.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.015+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561464f8ddf0 con 0x7f063001ac20 2024-04-24T02:12:25.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.015+0000 7f063d3c1640 1 -- 172.21.15.134:0/2651738623 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f063401f070 con 0x7f063001ac20 2024-04-24T02:12:25.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.015+0000 7f063d3c1640 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561464f8ddf0 con 0x561464f8b420 2024-04-24T02:12:25.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.015+0000 7f063c3bf640 1 -- 172.21.15.134:0/2651738623 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f063005c040 con 0x561464f8b420 2024-04-24T02:12:25.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.015+0000 7f063c3bf640 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561464f8ddf0 con 0x7f0634031040 2024-04-24T02:12:25.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.015+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f062c075030 con 0x7f0634031040 2024-04-24T02:12:25.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.015+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561464f8ddf0 con 0x561464f85200 2024-04-24T02:12:25.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.016+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f062c075030 con 0x561464f85200 2024-04-24T02:12:25.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.016+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561464f8ddf0 con 0x7f063001ac20 2024-04-24T02:12:25.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.016+0000 7f063d3c1640 1 -- 172.21.15.134:0/2651738623 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f063401f070 con 0x7f063001ac20 2024-04-24T02:12:25.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.016+0000 7f064182f800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:25.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.016+0000 7f064182f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:25.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.016+0000 7f064182f800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:25.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.016+0000 7f064182f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:25.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.016+0000 7f064182f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:25.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.016+0000 7f064182f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:25.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.016+0000 7f064182f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.016+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561464f8a030 con 0x561464f85200 2024-04-24T02:12:25.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.016+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f062c075030 con 0x561464f85200 2024-04-24T02:12:25.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.016+0000 7f064182f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:25.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.016+0000 7f064182f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.016+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561464f8a8d0 con 0x561464f85200 2024-04-24T02:12:25.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.016+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f062c075030 con 0x561464f85200 2024-04-24T02:12:25.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.016+0000 7f064182f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:25.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.016+0000 7f064182f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.016+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561464f89c70 con 0x561464f85200 2024-04-24T02:12:25.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.017+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f062c075030 con 0x561464f85200 2024-04-24T02:12:25.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.017+0000 7f064182f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:25.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.017+0000 7f064182f800 20 zone default found 2024-04-24T02:12:25.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.017+0000 7f064182f800 4 Realm: () 2024-04-24T02:12:25.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.017+0000 7f064182f800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:25.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.017+0000 7f064182f800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:25.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.017+0000 7f064182f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:25.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.017+0000 7f064182f800 20 zonegroup default 2024-04-24T02:12:25.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.017+0000 7f064182f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.017+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561464f8e250 con 0x7f0634031040 2024-04-24T02:12:25.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.017+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f062c075030 con 0x7f0634031040 2024-04-24T02:12:25.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.017+0000 7f064182f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:25.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.017+0000 7f064182f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.017+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561464f900e0 con 0x561464f8b420 2024-04-24T02:12:25.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.018+0000 7f063c3bf640 1 -- 172.21.15.134:0/2651738623 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f063005c040 con 0x561464f8b420 2024-04-24T02:12:25.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.018+0000 7f064182f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:25.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.018+0000 7f064182f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.018+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561464f90480 con 0x561464f8b420 2024-04-24T02:12:25.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.018+0000 7f063c3bf640 1 -- 172.21.15.134:0/2651738623 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f063005c040 con 0x561464f8b420 2024-04-24T02:12:25.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.018+0000 7f064182f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:25.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.018+0000 7f064182f800 20 started sync module instance, tier type = 2024-04-24T02:12:25.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.018+0000 7f064182f800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:25.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.018+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561464f8f520 con 0x7f063001ac20 2024-04-24T02:12:25.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.019+0000 7f063d3c1640 1 -- 172.21.15.134:0/2651738623 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0634040040 con 0x7f063001ac20 2024-04-24T02:12:25.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.019+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94645593372992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561464f8f180 con 0x7f063001ac20 2024-04-24T02:12:25.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.019+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561464f911c0 con 0x561464f85200 2024-04-24T02:12:25.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.020+0000 7f063d3c1640 1 -- 172.21.15.134:0/2651738623 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94645593372992] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0634040040 con 0x7f063001ac20 2024-04-24T02:12:25.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.020+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f062c075030 con 0x561464f85200 2024-04-24T02:12:25.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.020+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94645593376800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561464f910f0 con 0x561464f85200 2024-04-24T02:12:25.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.020+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561464f91c40 con 0x561464f8b420 2024-04-24T02:12:25.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.021+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94645593376800] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f062c075030 con 0x561464f85200 2024-04-24T02:12:25.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.021+0000 7f063c3bf640 1 -- 172.21.15.134:0/2651738623 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f063005c040 con 0x561464f8b420 2024-04-24T02:12:25.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.022+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94645593377856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561464f91060 con 0x561464f8b420 2024-04-24T02:12:25.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.022+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561464f92b00 con 0x7f063001ac20 2024-04-24T02:12:25.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.023+0000 7f063c3bf640 1 -- 172.21.15.134:0/2651738623 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94645593377856] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f063005c040 con 0x561464f8b420 2024-04-24T02:12:25.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.023+0000 7f063d3c1640 1 -- 172.21.15.134:0/2651738623 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0634040040 con 0x7f063001ac20 2024-04-24T02:12:25.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.023+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94645593384528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561464f92f20 con 0x7f063001ac20 2024-04-24T02:12:25.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.023+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561464f938e0 con 0x561464f85200 2024-04-24T02:12:25.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.024+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f062c075030 con 0x561464f85200 2024-04-24T02:12:25.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.024+0000 7f063d3c1640 1 -- 172.21.15.134:0/2651738623 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94645593384528] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0634040040 con 0x7f063001ac20 2024-04-24T02:12:25.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.024+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94645593386064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561464f938e0 con 0x561464f85200 2024-04-24T02:12:25.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.024+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561464f942a0 con 0x7f0634031040 2024-04-24T02:12:25.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.025+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f062c075030 con 0x7f0634031040 2024-04-24T02:12:25.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.025+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94645593390576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561464f94210 con 0x7f0634031040 2024-04-24T02:12:25.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.025+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561464f95270 con 0x7f0634031040 2024-04-24T02:12:25.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.025+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94645593386064] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f062c075030 con 0x561464f85200 2024-04-24T02:12:25.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.026+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94645593390576] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f062c075030 con 0x7f0634031040 2024-04-24T02:12:25.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.026+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(56 notify.6 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f062c075030 con 0x7f0634031040 2024-04-24T02:12:25.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.026+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94645593394528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561464f95230 con 0x7f0634031040 2024-04-24T02:12:25.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.026+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561464f95b10 con 0x7f0634031040 2024-04-24T02:12:25.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.027+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94645593394528] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f062c075030 con 0x7f0634031040 2024-04-24T02:12:25.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.027+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(58 notify.7 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f062c075030 con 0x7f0634031040 2024-04-24T02:12:25.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.027+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94645593388080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561464f947b0 con 0x7f0634031040 2024-04-24T02:12:25.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.027+0000 7f064182f800 20 add_watcher() i=0 2024-04-24T02:12:25.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.027+0000 7f064182f800 20 add_watcher() i=1 2024-04-24T02:12:25.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.027+0000 7f064182f800 20 add_watcher() i=2 2024-04-24T02:12:25.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.027+0000 7f064182f800 20 add_watcher() i=3 2024-04-24T02:12:25.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.027+0000 7f064182f800 20 add_watcher() i=4 2024-04-24T02:12:25.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.027+0000 7f064182f800 20 add_watcher() i=5 2024-04-24T02:12:25.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.027+0000 7f064182f800 20 add_watcher() i=6 2024-04-24T02:12:25.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.028+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94645593388080] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f062c075030 con 0x7f0634031040 2024-04-24T02:12:25.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.028+0000 7f064182f800 20 add_watcher() i=7 2024-04-24T02:12:25.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.028+0000 7f064182f800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:25.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.028+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561464f98af0 con 0x561464f85200 2024-04-24T02:12:25.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.028+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f062c075030 con 0x561464f85200 2024-04-24T02:12:25.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.028+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94645593396720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561464f95f90 con 0x561464f85200 2024-04-24T02:12:25.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.029+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94645593396720] v30'98 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f062c075030 con 0x561464f85200 2024-04-24T02:12:25.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.029+0000 7f04f2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:25.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.029+0000 7f064182f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:25.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.029+0000 7f064182f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:25.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.029+0000 7f064182f800 5 note: GC not initialized 2024-04-24T02:12:25.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.030+0000 7f04f1fe3640 20 reqs_thread_entry: start 2024-04-24T02:12:25.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.030+0000 7f064182f800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:25.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.030+0000 7f064182f800 20 Filter name: none 2024-04-24T02:12:25.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.030+0000 7f04637fe640 20 reqs_thread_entry: start 2024-04-24T02:12:25.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.030+0000 7f064182f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.030+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561464fcb920 con 0x561464f85200 2024-04-24T02:12:25.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.030+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f062c075030 con 0x561464f85200 2024-04-24T02:12:25.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.030+0000 7f064182f800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T02:12:25.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.030+0000 7f064182f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.030+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561464fcc310 con 0x561464f85200 2024-04-24T02:12:25.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.031+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f062c075030 con 0x561464f85200 2024-04-24T02:12:25.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.031+0000 7f064182f800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T02:12:25.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.031+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561464fcd320 con 0x7f063001ac20 2024-04-24T02:12:25.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.031+0000 7f063d3c1640 1 -- 172.21.15.134:0/2651738623 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f0634040040 con 0x7f063001ac20 2024-04-24T02:12:25.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.032+0000 7f04f2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:25.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.032+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94645593396720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561464f983d0 con 0x561464f85200 2024-04-24T02:12:25.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.033+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94645593396720] v30'99 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f062c075030 con 0x561464f85200 2024-04-24T02:12:25.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.033+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94645593372992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561464f955f0 con 0x7f063001ac20 2024-04-24T02:12:25.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.034+0000 7f063d3c1640 1 -- 172.21.15.134:0/2651738623 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94645593372992] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0634040040 con 0x7f063001ac20 2024-04-24T02:12:25.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.034+0000 7f064182f800 20 remove_watcher() i=0 2024-04-24T02:12:25.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.034+0000 7f064182f800 2 removed watcher, disabling cache 2024-04-24T02:12:25.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.034+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94645593376800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561464f955f0 con 0x561464f85200 2024-04-24T02:12:25.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.035+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94645593376800] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f062c075030 con 0x561464f85200 2024-04-24T02:12:25.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.035+0000 7f064182f800 20 remove_watcher() i=1 2024-04-24T02:12:25.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.035+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94645593377856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561464f955f0 con 0x561464f8b420 2024-04-24T02:12:25.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.036+0000 7f063c3bf640 1 -- 172.21.15.134:0/2651738623 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94645593377856] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f063005c040 con 0x561464f8b420 2024-04-24T02:12:25.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.036+0000 7f064182f800 20 remove_watcher() i=2 2024-04-24T02:12:25.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.036+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94645593384528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561464f8f940 con 0x7f063001ac20 2024-04-24T02:12:25.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.037+0000 7f063d3c1640 1 -- 172.21.15.134:0/2651738623 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94645593384528] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0634040040 con 0x7f063001ac20 2024-04-24T02:12:25.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.037+0000 7f064182f800 20 remove_watcher() i=3 2024-04-24T02:12:25.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.037+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94645593386064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561464f92650 con 0x561464f85200 2024-04-24T02:12:25.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.038+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94645593386064] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f062c075030 con 0x561464f85200 2024-04-24T02:12:25.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.038+0000 7f064182f800 20 remove_watcher() i=4 2024-04-24T02:12:25.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.038+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94645593390576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561464f92650 con 0x7f0634031040 2024-04-24T02:12:25.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.039+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94645593390576] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f062c075030 con 0x7f0634031040 2024-04-24T02:12:25.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.039+0000 7f064182f800 20 remove_watcher() i=5 2024-04-24T02:12:25.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.039+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94645593394528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561464f93df0 con 0x7f0634031040 2024-04-24T02:12:25.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.040+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94645593394528] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f062c075030 con 0x7f0634031040 2024-04-24T02:12:25.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.040+0000 7f064182f800 20 remove_watcher() i=6 2024-04-24T02:12:25.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.040+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94645593388080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561464f92650 con 0x7f0634031040 2024-04-24T02:12:25.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.041+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94645593388080] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f062c075030 con 0x7f0634031040 2024-04-24T02:12:25.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.041+0000 7f064182f800 20 remove_watcher() i=7 2024-04-24T02:12:25.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.041+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f0634031040 msgr2=0x7f0634032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.041+0000 7f064182f800 1 --2- 172.21.15.134:0/2651738623 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f0634031040 0x7f0634032430 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.041+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x561464f85200 msgr2=0x561464f876c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.041+0000 7f064182f800 1 --2- 172.21.15.134:0/2651738623 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x561464f85200 0x561464f876c0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.041+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f063001ac20 msgr2=0x7f06300278a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.041+0000 7f064182f800 1 --2- 172.21.15.134:0/2651738623 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f063001ac20 0x7f06300278a0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.041+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x561464f8b420 msgr2=0x561464f8d810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.041+0000 7f064182f800 1 --2- 172.21.15.134:0/2651738623 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x561464f8b420 0x561464f8d810 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.041+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0508036950 msgr2=0x7f0508038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.041+0000 7f064182f800 1 --2- 172.21.15.134:0/2651738623 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0508036950 0x7f0508038e10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x561464f53000 tx=0x7f063401f000 comp rx=0 tx=0).stop 2024-04-24T02:12:25.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.041+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561464e51f80 msgr2=0x561464f79b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.041+0000 7f064182f800 1 --2- 172.21.15.134:0/2651738623 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561464e51f80 0x561464f79b30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0630024a50 tx=0x7f063004c080 comp rx=0 tx=0).stop 2024-04-24T02:12:25.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.041+0000 7f063cbc0640 1 -- 172.21.15.134:0/2651738623 reap_dead start 2024-04-24T02:12:25.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.041+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 shutdown_connections 2024-04-24T02:12:25.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.041+0000 7f064182f800 1 --2- 172.21.15.134:0/2651738623 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561464e51f80 0x561464f79b30 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.041+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 >> 172.21.15.134:0/2651738623 conn(0x561464f6c650 msgr2=0x561464f69cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:25.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.041+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 shutdown_connections 2024-04-24T02:12:25.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.041+0000 7f064182f800 1 -- 172.21.15.134:0/2651738623 wait complete. 2024-04-24T02:12:25.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.041+0000 7f064182f800 1 -- 172.21.15.134:0/3942219220 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0514036900 msgr2=0x7f0514038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.041+0000 7f064182f800 1 --2- 172.21.15.134:0/3942219220 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0514036900 0x7f0514038dc0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x561464f53880 tx=0x7f0634005840 comp rx=0 tx=0).stop 2024-04-24T02:12:25.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.041+0000 7f064182f800 1 -- 172.21.15.134:0/3942219220 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561464f62fb0 msgr2=0x561464f633d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.041+0000 7f064182f800 1 --2- 172.21.15.134:0/3942219220 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561464f62fb0 0x561464f633d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0630001ed0 tx=0x7f063000ea00 comp rx=0 tx=0).stop 2024-04-24T02:12:25.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.042+0000 7f064182f800 1 -- 172.21.15.134:0/3942219220 shutdown_connections 2024-04-24T02:12:25.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.042+0000 7f064182f800 1 --2- 172.21.15.134:0/3942219220 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0514036900 0x7f0514038dc0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.042+0000 7f064182f800 1 --2- 172.21.15.134:0/3942219220 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561464f62fb0 0x561464f633d0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.042+0000 7f064182f800 1 -- 172.21.15.134:0/3942219220 >> 172.21.15.134:0/3942219220 conn(0x561464f57050 msgr2=0x561464f57450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:25.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.042+0000 7f064182f800 1 -- 172.21.15.134:0/3942219220 shutdown_connections 2024-04-24T02:12:25.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.042+0000 7f064182f800 1 -- 172.21.15.134:0/3942219220 wait complete. 2024-04-24T02:12:25.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.042+0000 7f064182f800 1 -- 172.21.15.134:0/934308450 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x561464e552c0 msgr2=0x561464f51df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.042+0000 7f064182f800 1 --2- 172.21.15.134:0/934308450 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x561464e552c0 0x561464f51df0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.042+0000 7f064182f800 1 -- 172.21.15.134:0/934308450 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0524036900 msgr2=0x7f0524038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.042+0000 7f064182f800 1 --2- 172.21.15.134:0/934308450 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0524036900 0x7f0524038dc0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0630000f60 tx=0x7f0630001370 comp rx=0 tx=0).stop 2024-04-24T02:12:25.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.042+0000 7f064182f800 1 -- 172.21.15.134:0/934308450 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561464e52990 msgr2=0x561464f4abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.042+0000 7f064182f800 1 --2- 172.21.15.134:0/934308450 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561464e52990 0x561464f4abb0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f062c052540 tx=0x7f062c003020 comp rx=0 tx=0).stop 2024-04-24T02:12:25.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.042+0000 7f064182f800 1 -- 172.21.15.134:0/934308450 shutdown_connections 2024-04-24T02:12:25.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.042+0000 7f064182f800 1 --2- 172.21.15.134:0/934308450 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x561464e552c0 0x561464f51df0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.042+0000 7f064182f800 1 --2- 172.21.15.134:0/934308450 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0524036900 0x7f0524038dc0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.042+0000 7f064182f800 1 --2- 172.21.15.134:0/934308450 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561464e52990 0x561464f4abb0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.042+0000 7f064182f800 1 -- 172.21.15.134:0/934308450 >> 172.21.15.134:0/934308450 conn(0x561464e4c300 msgr2=0x561464f3d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:25.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.042+0000 7f064182f800 1 -- 172.21.15.134:0/934308450 shutdown_connections 2024-04-24T02:12:25.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.042+0000 7f064182f800 1 -- 172.21.15.134:0/934308450 wait complete. 2024-04-24T02:12:25.063 INFO:teuthology.orchestra.run.smithi134.stdout:["myfoo"] 2024-04-24T02:12:25.063 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-04-24T02:12:25.067 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T02:12:25.067 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-04-24T02:12:25.068 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-04-24T02:12:25.068 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-04-24T02:12:25.108 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:25.108 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:25.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.108+0000 7fdc4b239800 1 Processor -- start 2024-04-24T02:12:25.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.108+0000 7fdc4b239800 1 -- start start 2024-04-24T02:12:25.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.108+0000 7fdc4b239800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55f9f0bb7430 0x55f9f0bb9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.108+0000 7fdc4b239800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f9f0a71d40 con 0x55f9f0bb3920 2024-04-24T02:12:25.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.108+0000 7fdc4b239800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55f9f0a444d0 con 0x55f9f0bb7430 2024-04-24T02:12:25.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.108+0000 7fdc4566d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55f9f0bb7430 0x55f9f0bb9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.108+0000 7fdc45e6e640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55f9f0bb3920 0x55f9f0bb5d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:43398/0 (socket says 172.21.15.134:43398) 2024-04-24T02:12:25.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.108+0000 7fdc45e6e640 1 -- 172.21.15.134:0/513425319 learned_addr learned my addr 172.21.15.134:0/513425319 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:12:25.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.108+0000 7fdc4566d640 1 -- 172.21.15.134:0/513425319 >> v1:172.21.15.104:6789/0 conn(0x55f9f0bb3920 legacy=0x55f9f0bb5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.108+0000 7fdc4566d640 1 -- 172.21.15.134:0/513425319 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9f0a70590 con 0x55f9f0bb7430 2024-04-24T02:12:25.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.110+0000 7fdc4566d640 1 --2- 172.21.15.134:0/513425319 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9f0bb7430 0x55f9f0bb9820 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c00a470 tx=0x7fdc3c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fb57fa14ac74dd5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.110+0000 7fdc44e6c640 1 -- 172.21.15.134:0/513425319 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc3c057070 con 0x55f9f0bb7430 2024-04-24T02:12:25.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.110+0000 7fdc44e6c640 1 -- 172.21.15.134:0/513425319 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc3c052570 con 0x55f9f0bb7430 2024-04-24T02:12:25.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.110+0000 7fdc44e6c640 1 -- 172.21.15.134:0/513425319 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc3c052870 con 0x55f9f0bb7430 2024-04-24T02:12:25.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.111+0000 7fdc4b239800 1 -- 172.21.15.134:0/513425319 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9f0bb7430 msgr2=0x55f9f0bb9820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.111+0000 7fdc4b239800 1 --2- 172.21.15.134:0/513425319 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9f0bb7430 0x55f9f0bb9820 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c00a470 tx=0x7fdc3c01ce90 comp rx=0 tx=0).stop 2024-04-24T02:12:25.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.111+0000 7fdc4b239800 1 -- 172.21.15.134:0/513425319 shutdown_connections 2024-04-24T02:12:25.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.111+0000 7fdc4b239800 1 --2- 172.21.15.134:0/513425319 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9f0bb7430 0x55f9f0bb9820 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.111+0000 7fdc4b239800 1 -- 172.21.15.134:0/513425319 >> 172.21.15.134:0/513425319 conn(0x55f9f0bad370 msgr2=0x55f9f0baf790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:25.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.111+0000 7fdc4b239800 1 -- 172.21.15.134:0/513425319 shutdown_connections 2024-04-24T02:12:25.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.111+0000 7fdc4b239800 1 -- 172.21.15.134:0/513425319 wait complete. 2024-04-24T02:12:25.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.123+0000 7fdc4b239800 1 Processor -- start 2024-04-24T02:12:25.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.123+0000 7fdc4b239800 1 -- start start 2024-04-24T02:12:25.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.123+0000 7fdc4b239800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9f0bb3920 0x55f9f0bb3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.123+0000 7fdc4b239800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55f9f0afe3b0 con 0x55f9f0bb3920 2024-04-24T02:12:25.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.123+0000 7fdc45e6e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9f0bb3920 0x55f9f0bb3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.123+0000 7fdc45e6e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9f0bb3920 0x55f9f0bb3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46758/0 (socket says 172.21.15.134:46758) 2024-04-24T02:12:25.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.123+0000 7fdc45e6e640 1 -- 172.21.15.134:0/64487854 learned_addr learned my addr 172.21.15.134:0/64487854 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:25.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.123+0000 7fdc45e6e640 1 -- 172.21.15.134:0/64487854 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9f0bb1820 con 0x55f9f0bb3920 2024-04-24T02:12:25.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.124+0000 7fdc45e6e640 1 --2- 172.21.15.134:0/64487854 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9f0bb3920 0x55f9f0bb3260 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fdc38001de0 tx=0x7fdc3800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60fc158f87e855b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.124+0000 7fdb33e07640 1 -- 172.21.15.134:0/64487854 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc38012020 con 0x55f9f0bb3920 2024-04-24T02:12:25.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.124+0000 7fdb33e07640 1 -- 172.21.15.134:0/64487854 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc3800e5a0 con 0x55f9f0bb3920 2024-04-24T02:12:25.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.124+0000 7fdb33e07640 1 -- 172.21.15.134:0/64487854 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc3800e8c0 con 0x55f9f0bb3920 2024-04-24T02:12:25.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.124+0000 7fdc4b239800 1 -- 172.21.15.134:0/64487854 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9f0bb3920 msgr2=0x55f9f0bb3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.124+0000 7fdc4b239800 1 --2- 172.21.15.134:0/64487854 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9f0bb3920 0x55f9f0bb3260 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fdc38001de0 tx=0x7fdc3800b6c0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.124+0000 7fdc4b239800 1 -- 172.21.15.134:0/64487854 shutdown_connections 2024-04-24T02:12:25.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.124+0000 7fdc4b239800 1 --2- 172.21.15.134:0/64487854 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9f0bb3920 0x55f9f0bb3260 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.124+0000 7fdc4b239800 1 -- 172.21.15.134:0/64487854 >> 172.21.15.134:0/64487854 conn(0x55f9f0bad370 msgr2=0x55f9f0c9f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:25.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.124+0000 7fdc4b239800 1 -- 172.21.15.134:0/64487854 shutdown_connections 2024-04-24T02:12:25.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.124+0000 7fdc4b239800 1 -- 172.21.15.134:0/64487854 wait complete. 2024-04-24T02:12:25.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.125+0000 7fdc4b239800 1 Processor -- start 2024-04-24T02:12:25.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.125+0000 7fdc4b239800 1 -- start start 2024-04-24T02:12:25.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.125+0000 7fdc4b239800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9f0bb3920 0x55f9f0cade10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.125+0000 7fdc4b239800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55f9f0bbc070 con 0x55f9f0bb3920 2024-04-24T02:12:25.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.125+0000 7fdc45e6e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9f0bb3920 0x55f9f0cade10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.125+0000 7fdc45e6e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9f0bb3920 0x55f9f0cade10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46760/0 (socket says 172.21.15.134:46760) 2024-04-24T02:12:25.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.125+0000 7fdc45e6e640 1 -- 172.21.15.134:0/1930348065 learned_addr learned my addr 172.21.15.134:0/1930348065 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:25.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.125+0000 7fdc45e6e640 1 -- 172.21.15.134:0/1930348065 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9f0cae350 con 0x55f9f0bb3920 2024-04-24T02:12:25.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.125+0000 7fdc45e6e640 1 --2- 172.21.15.134:0/1930348065 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9f0bb3920 0x55f9f0cade10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fdc3800c010 tx=0x7fdc38000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.126+0000 7fdb32604640 1 -- 172.21.15.134:0/1930348065 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc38012070 con 0x55f9f0bb3920 2024-04-24T02:12:25.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.126+0000 7fdb32604640 1 -- 172.21.15.134:0/1930348065 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc3801a7a0 con 0x55f9f0bb3920 2024-04-24T02:12:25.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.126+0000 7fdc4b239800 1 -- 172.21.15.134:0/1930348065 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f9f0cae5e0 con 0x55f9f0bb3920 2024-04-24T02:12:25.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.126+0000 7fdb32604640 1 -- 172.21.15.134:0/1930348065 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc3801aa80 con 0x55f9f0bb3920 2024-04-24T02:12:25.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.126+0000 7fdc4b239800 1 -- 172.21.15.134:0/1930348065 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9f0cb1290 con 0x55f9f0bb3920 2024-04-24T02:12:25.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.126+0000 7fdb32604640 1 -- 172.21.15.134:0/1930348065 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdc38015020 con 0x55f9f0bb3920 2024-04-24T02:12:25.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.126+0000 7fdb32604640 1 --2- 172.21.15.134:0/1930348065 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdb2c036900 0x7fdb2c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.127+0000 7fdb32604640 1 -- 172.21.15.134:0/1930348065 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fdc38020070 con 0x55f9f0bb3920 2024-04-24T02:12:25.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.127+0000 7fdc4566d640 1 --2- 172.21.15.134:0/1930348065 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdb2c036900 0x7fdb2c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.127+0000 7fdc4b239800 1 --2- 172.21.15.134:0/1930348065 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f9f0bb7430 0x55f9f0cb5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.127+0000 7fdc4b239800 1 -- 172.21.15.134:0/1930348065 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cb5590 con 0x55f9f0bb7430 2024-04-24T02:12:25.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.127+0000 7fdc4666f640 1 --2- 172.21.15.134:0/1930348065 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f9f0bb7430 0x55f9f0cb5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.127+0000 7fdc4566d640 1 --2- 172.21.15.134:0/1930348065 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdb2c036900 0x7fdb2c038dc0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c054000 tx=0x7fdc3c04e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.127+0000 7fdc4666f640 1 --2- 172.21.15.134:0/1930348065 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f9f0bb7430 0x55f9f0cb5050 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.127+0000 7fdc4666f640 1 -- 172.21.15.134:0/1930348065 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc4000a4a0 con 0x55f9f0bb7430 2024-04-24T02:12:25.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.127+0000 7fdc4b239800 1 -- 172.21.15.134:0/1930348065 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cb2620 con 0x55f9f0bb7430 2024-04-24T02:12:25.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.128+0000 7fdc4666f640 1 -- 172.21.15.134:0/1930348065 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdc4000a4a0 con 0x55f9f0bb7430 2024-04-24T02:12:25.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.128+0000 7fdc4b239800 1 -- 172.21.15.134:0/1930348065 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cb73b0 con 0x55f9f0bb7430 2024-04-24T02:12:25.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.128+0000 7fdc4666f640 1 -- 172.21.15.134:0/1930348065 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdc4000a4a0 con 0x55f9f0bb7430 2024-04-24T02:12:25.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.128+0000 7fdc4b239800 1 -- 172.21.15.134:0/1930348065 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cb66f0 con 0x55f9f0bb7430 2024-04-24T02:12:25.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.128+0000 7fdc4666f640 1 -- 172.21.15.134:0/1930348065 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdc4000a4a0 con 0x55f9f0bb7430 2024-04-24T02:12:25.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.128+0000 7fdc4b239800 1 -- 172.21.15.134:0/1930348065 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cb6b40 con 0x55f9f0bb7430 2024-04-24T02:12:25.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.129+0000 7fdc4666f640 1 -- 172.21.15.134:0/1930348065 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdc4000a4a0 con 0x55f9f0bb7430 2024-04-24T02:12:25.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.129+0000 7fdc4b239800 1 Processor -- start 2024-04-24T02:12:25.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.129+0000 7fdc4b239800 1 -- start start 2024-04-24T02:12:25.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.129+0000 7fdc4b239800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9f0cc61a0 0x55f9f0cc65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.129+0000 7fdc4b239800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55f9f0aa46b0 con 0x55f9f0cc61a0 2024-04-24T02:12:25.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.129+0000 7fdc4566d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9f0cc61a0 0x55f9f0cc65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.129+0000 7fdc4566d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9f0cc61a0 0x55f9f0cc65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46766/0 (socket says 172.21.15.134:46766) 2024-04-24T02:12:25.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.129+0000 7fdc4566d640 1 -- 172.21.15.134:0/2296201215 learned_addr learned my addr 172.21.15.134:0/2296201215 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:25.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.130+0000 7fdc4566d640 1 -- 172.21.15.134:0/2296201215 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9f0cc6b00 con 0x55f9f0cc61a0 2024-04-24T02:12:25.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.130+0000 7fdc4566d640 1 --2- 172.21.15.134:0/2296201215 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9f0cc61a0 0x55f9f0cc65c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c044840 tx=0x7fdc3c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.130+0000 7fdb2b7fe640 1 -- 172.21.15.134:0/2296201215 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc3c06f070 con 0x55f9f0cc61a0 2024-04-24T02:12:25.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.130+0000 7fdb2b7fe640 1 -- 172.21.15.134:0/2296201215 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc3c058040 con 0x55f9f0cc61a0 2024-04-24T02:12:25.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.130+0000 7fdb2b7fe640 1 -- 172.21.15.134:0/2296201215 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc3c057050 con 0x55f9f0cc61a0 2024-04-24T02:12:25.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.130+0000 7fdc4b239800 1 -- 172.21.15.134:0/2296201215 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f9f0cc7570 con 0x55f9f0cc61a0 2024-04-24T02:12:25.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.130+0000 7fdc4b239800 1 -- 172.21.15.134:0/2296201215 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9f0cc7a10 con 0x55f9f0cc61a0 2024-04-24T02:12:25.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.131+0000 7fdb2b7fe640 1 -- 172.21.15.134:0/2296201215 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdc3c072070 con 0x55f9f0cc61a0 2024-04-24T02:12:25.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.131+0000 7fdb2b7fe640 1 --2- 172.21.15.134:0/2296201215 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdb20036900 0x7fdb20038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.131+0000 7fdb2b7fe640 1 -- 172.21.15.134:0/2296201215 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fdc3c08f880 con 0x55f9f0cc61a0 2024-04-24T02:12:25.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.131+0000 7fdc4666f640 1 --2- 172.21.15.134:0/2296201215 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdb20036900 0x7fdb20038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.131+0000 7fdc4b239800 1 Processor -- start 2024-04-24T02:12:25.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.131+0000 7fdc4666f640 1 --2- 172.21.15.134:0/2296201215 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdb20036900 0x7fdb20038dc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x55f9f0cb6210 tx=0x7fdc40005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.131+0000 7fdc4b239800 1 -- start start 2024-04-24T02:12:25.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.131+0000 7fdc4b239800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9f0cd3460 0x55f9f0cd3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.131+0000 7fdc4b239800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55f9f0bb1ba0 con 0x55f9f0cd3460 2024-04-24T02:12:25.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.132+0000 7fdc4566d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9f0cd3460 0x55f9f0cd3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.132+0000 7fdc4566d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9f0cd3460 0x55f9f0cd3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46768/0 (socket says 172.21.15.134:46768) 2024-04-24T02:12:25.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.132+0000 7fdc4566d640 1 -- 172.21.15.134:0/2853251019 learned_addr learned my addr 172.21.15.134:0/2853251019 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:25.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.132+0000 7fdc4566d640 1 -- 172.21.15.134:0/2853251019 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9f0cd3e50 con 0x55f9f0cd3460 2024-04-24T02:12:25.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.132+0000 7fdc4566d640 1 --2- 172.21.15.134:0/2853251019 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9f0cd3460 0x55f9f0cd3880 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c08dda0 tx=0x7fdc3c08e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36345aa97587ac65 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.132+0000 7fdb297fa640 1 -- 172.21.15.134:0/2853251019 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc3c087070 con 0x55f9f0cd3460 2024-04-24T02:12:25.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.132+0000 7fdb297fa640 1 -- 172.21.15.134:0/2853251019 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc3c05e480 con 0x55f9f0cd3460 2024-04-24T02:12:25.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.132+0000 7fdb297fa640 1 -- 172.21.15.134:0/2853251019 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc3c08f040 con 0x55f9f0cd3460 2024-04-24T02:12:25.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.132+0000 7fdc4b239800 1 -- 172.21.15.134:0/2853251019 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9f0cd3460 msgr2=0x55f9f0cd3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.132+0000 7fdc4b239800 1 --2- 172.21.15.134:0/2853251019 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9f0cd3460 0x55f9f0cd3880 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c08dda0 tx=0x7fdc3c08e050 comp rx=0 tx=0).stop 2024-04-24T02:12:25.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.133+0000 7fdc4b239800 1 -- 172.21.15.134:0/2853251019 shutdown_connections 2024-04-24T02:12:25.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.133+0000 7fdc4b239800 1 --2- 172.21.15.134:0/2853251019 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9f0cd3460 0x55f9f0cd3880 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.133+0000 7fdc4b239800 1 -- 172.21.15.134:0/2853251019 >> 172.21.15.134:0/2853251019 conn(0x55f9f0ccf7c0 msgr2=0x55f9f0ccd820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:25.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.133+0000 7fdc4b239800 1 -- 172.21.15.134:0/2853251019 shutdown_connections 2024-04-24T02:12:25.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.133+0000 7fdc4b239800 1 -- 172.21.15.134:0/2853251019 wait complete. 2024-04-24T02:12:25.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.133+0000 7fdc4b239800 1 Processor -- start 2024-04-24T02:12:25.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.133+0000 7fdc4b239800 1 -- start start 2024-04-24T02:12:25.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.133+0000 7fdc4b239800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9f0cd3460 0x55f9f0cdab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.133+0000 7fdc4b239800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55f9f0cd45c0 con 0x55f9f0cd3460 2024-04-24T02:12:25.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.133+0000 7fdc4566d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9f0cd3460 0x55f9f0cdab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.133+0000 7fdc4566d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9f0cd3460 0x55f9f0cdab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46778/0 (socket says 172.21.15.134:46778) 2024-04-24T02:12:25.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.133+0000 7fdc4566d640 1 -- 172.21.15.134:0/3204862902 learned_addr learned my addr 172.21.15.134:0/3204862902 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:25.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.133+0000 7fdc4566d640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9f0cdb040 con 0x55f9f0cd3460 2024-04-24T02:12:25.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.134+0000 7fdc4566d640 1 --2- 172.21.15.134:0/3204862902 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9f0cd3460 0x55f9f0cdab00 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c08ccc0 tx=0x7fdc3c08dd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.134+0000 7fdb177fe640 1 -- 172.21.15.134:0/3204862902 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc3c093070 con 0x55f9f0cd3460 2024-04-24T02:12:25.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.134+0000 7fdb177fe640 1 -- 172.21.15.134:0/3204862902 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc3c088040 con 0x55f9f0cd3460 2024-04-24T02:12:25.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.134+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f9f0cdb2d0 con 0x55f9f0cd3460 2024-04-24T02:12:25.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.134+0000 7fdb177fe640 1 -- 172.21.15.134:0/3204862902 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc3c087070 con 0x55f9f0cd3460 2024-04-24T02:12:25.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.134+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9f0cddf80 con 0x55f9f0cd3460 2024-04-24T02:12:25.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.134+0000 7fdb177fe640 1 -- 172.21.15.134:0/3204862902 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdc3c096070 con 0x55f9f0cd3460 2024-04-24T02:12:25.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.135+0000 7fdb177fe640 1 --2- 172.21.15.134:0/3204862902 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdb10036950 0x7fdb10038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.135+0000 7fdb177fe640 1 -- 172.21.15.134:0/3204862902 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fdc3c07f070 con 0x55f9f0cd3460 2024-04-24T02:12:25.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.135+0000 7fdc4666f640 1 --2- 172.21.15.134:0/3204862902 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdb10036950 0x7fdb10038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.135+0000 7fdc4b239800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.135+0000 7fdc4b239800 1 --2- 172.21.15.134:0/3204862902 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f9f0ce65f0 0x55f9f0ce8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.135+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0ce9200 con 0x55f9f0ce65f0 2024-04-24T02:12:25.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.135+0000 7fdc45e6e640 1 --2- 172.21.15.134:0/3204862902 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f9f0ce65f0 0x55f9f0ce8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.135+0000 7fdc4666f640 1 --2- 172.21.15.134:0/3204862902 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdb10036950 0x7fdb10038e10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x55f9f0cb2570 tx=0x7fdc4001f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.135+0000 7fdc45e6e640 1 --2- 172.21.15.134:0/3204862902 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f9f0ce65f0 0x55f9f0ce8ab0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.136+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc3802b070 con 0x55f9f0ce65f0 2024-04-24T02:12:25.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.136+0000 7fdc4b239800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:25.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.136+0000 7fdc4b239800 20 realm 2024-04-24T02:12:25.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.136+0000 7fdc4b239800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.136+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0ce9610 con 0x55f9f0ce65f0 2024-04-24T02:12:25.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.136+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc3802b070 con 0x55f9f0ce65f0 2024-04-24T02:12:25.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.136+0000 7fdc4b239800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:25.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.136+0000 7fdc4b239800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:25.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.136+0000 7fdc4b239800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.136+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0ce9ee0 con 0x55f9f0ce65f0 2024-04-24T02:12:25.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.136+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc3802b070 con 0x55f9f0ce65f0 2024-04-24T02:12:25.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.136+0000 7fdc4b239800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:25.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.136+0000 7fdc4b239800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.136+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cea280 con 0x55f9f0ce65f0 2024-04-24T02:12:25.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.136+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdc3802b070 con 0x55f9f0ce65f0 2024-04-24T02:12:25.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.136+0000 7fdc4b239800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:25.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.136+0000 7fdc4b239800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.136+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cea6e0 con 0x55f9f0ce65f0 2024-04-24T02:12:25.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.136+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdc3802b070 con 0x55f9f0ce65f0 2024-04-24T02:12:25.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.136+0000 7fdc4b239800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:25.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.136+0000 7fdc4b239800 20 searching for the correct realm 2024-04-24T02:12:25.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.136+0000 7fdc4b239800 1 --2- 172.21.15.134:0/3204862902 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55f9f0cec730 0x55f9f0ceeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.136+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cef1d0 con 0x55f9f0cec730 2024-04-24T02:12:25.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.137+0000 7fdc4566d640 1 --2- 172.21.15.134:0/3204862902 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55f9f0cec730 0x55f9f0ceeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.137+0000 7fdc4566d640 1 --2- 172.21.15.134:0/3204862902 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55f9f0cec730 0x55f9f0ceeb20 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.137+0000 7fdc4566d640 1 -- 172.21.15.134:0/3204862902 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3c09f070 con 0x55f9f0cec730 2024-04-24T02:12:25.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.137+0000 7fdc4566d640 1 --2- 172.21.15.134:0/3204862902 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fdc3c098070 0x7fdc3c082450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.137+0000 7fdc4566d640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cef1d0 con 0x7fdc3c098070 2024-04-24T02:12:25.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.137+0000 7fdc4666f640 1 --2- 172.21.15.134:0/3204862902 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fdc3c098070 0x7fdc3c082450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.138+0000 7fdc4666f640 1 --2- 172.21.15.134:0/3204862902 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fdc3c098070 0x7fdc3c082450 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.138+0000 7fdc4666f640 1 -- 172.21.15.134:0/3204862902 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc4001f070 con 0x7fdc3c098070 2024-04-24T02:12:25.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.138+0000 7fdc4666f640 1 --2- 172.21.15.134:0/3204862902 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fdc40031040 0x7fdc40032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.138+0000 7fdc4666f640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cef1d0 con 0x7fdc40031040 2024-04-24T02:12:25.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.138+0000 7fdc45e6e640 1 --2- 172.21.15.134:0/3204862902 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fdc40031040 0x7fdc40032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.139+0000 7fdc45e6e640 1 --2- 172.21.15.134:0/3204862902 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fdc40031040 0x7fdc40032940 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.139+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3802b070 con 0x7fdc40031040 2024-04-24T02:12:25.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.139+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cef1d0 con 0x55f9f0ce65f0 2024-04-24T02:12:25.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.139+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3802b070 con 0x55f9f0ce65f0 2024-04-24T02:12:25.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.139+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cef1d0 con 0x55f9f0ce65f0 2024-04-24T02:12:25.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.139+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdc3802b070 con 0x55f9f0ce65f0 2024-04-24T02:12:25.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.139+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cef1d0 con 0x7fdc40031040 2024-04-24T02:12:25.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.140+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3802b070 con 0x7fdc40031040 2024-04-24T02:12:25.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.140+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cef1d0 con 0x7fdc40031040 2024-04-24T02:12:25.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.140+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3802b070 con 0x7fdc40031040 2024-04-24T02:12:25.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.140+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cef1d0 con 0x7fdc3c098070 2024-04-24T02:12:25.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.140+0000 7fdc4666f640 1 -- 172.21.15.134:0/3204862902 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc4001f070 con 0x7fdc3c098070 2024-04-24T02:12:25.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.140+0000 7fdc4666f640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cef1d0 con 0x55f9f0cec730 2024-04-24T02:12:25.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.140+0000 7fdc4566d640 1 -- 172.21.15.134:0/3204862902 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3c09f070 con 0x55f9f0cec730 2024-04-24T02:12:25.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.140+0000 7fdc4566d640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cef1d0 con 0x55f9f0ce65f0 2024-04-24T02:12:25.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.140+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3802b070 con 0x55f9f0ce65f0 2024-04-24T02:12:25.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.140+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cef1d0 con 0x7fdc40031040 2024-04-24T02:12:25.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.141+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3802b070 con 0x7fdc40031040 2024-04-24T02:12:25.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.141+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cef1d0 con 0x55f9f0ce65f0 2024-04-24T02:12:25.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.141+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3802b070 con 0x55f9f0ce65f0 2024-04-24T02:12:25.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.141+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cef1d0 con 0x7fdc3c098070 2024-04-24T02:12:25.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.141+0000 7fdc4666f640 1 -- 172.21.15.134:0/3204862902 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdc4001f070 con 0x7fdc3c098070 2024-04-24T02:12:25.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.141+0000 7fdc4666f640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cef1d0 con 0x55f9f0cec730 2024-04-24T02:12:25.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.141+0000 7fdc4566d640 1 -- 172.21.15.134:0/3204862902 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3c09f070 con 0x55f9f0cec730 2024-04-24T02:12:25.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.141+0000 7fdc4566d640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cef1d0 con 0x55f9f0cec730 2024-04-24T02:12:25.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.142+0000 7fdc4566d640 1 -- 172.21.15.134:0/3204862902 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3c09f070 con 0x55f9f0cec730 2024-04-24T02:12:25.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.142+0000 7fdc4566d640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cef1d0 con 0x7fdc40031040 2024-04-24T02:12:25.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.142+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3802b070 con 0x7fdc40031040 2024-04-24T02:12:25.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.142+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cef1d0 con 0x55f9f0cec730 2024-04-24T02:12:25.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.142+0000 7fdc4566d640 1 -- 172.21.15.134:0/3204862902 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3c09f070 con 0x55f9f0cec730 2024-04-24T02:12:25.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.142+0000 7fdc4566d640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cef1d0 con 0x55f9f0cec730 2024-04-24T02:12:25.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.142+0000 7fdc4566d640 1 -- 172.21.15.134:0/3204862902 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3c09f070 con 0x55f9f0cec730 2024-04-24T02:12:25.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.142+0000 7fdc4566d640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cef1d0 con 0x55f9f0ce65f0 2024-04-24T02:12:25.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.142+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3802b070 con 0x55f9f0ce65f0 2024-04-24T02:12:25.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.143+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cef1d0 con 0x55f9f0ce65f0 2024-04-24T02:12:25.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.143+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fdc3802b070 con 0x55f9f0ce65f0 2024-04-24T02:12:25.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.143+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cef1d0 con 0x7fdc40031040 2024-04-24T02:12:25.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.143+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3802b070 con 0x7fdc40031040 2024-04-24T02:12:25.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.143+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cef1d0 con 0x55f9f0cec730 2024-04-24T02:12:25.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.143+0000 7fdc4566d640 1 -- 172.21.15.134:0/3204862902 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3c09f070 con 0x55f9f0cec730 2024-04-24T02:12:25.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.143+0000 7fdc4566d640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cef1d0 con 0x7fdc3c098070 2024-04-24T02:12:25.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.143+0000 7fdc4666f640 1 -- 172.21.15.134:0/3204862902 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc4001f070 con 0x7fdc3c098070 2024-04-24T02:12:25.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.143+0000 7fdc4666f640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cef1d0 con 0x55f9f0ce65f0 2024-04-24T02:12:25.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.144+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3802b070 con 0x55f9f0ce65f0 2024-04-24T02:12:25.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.144+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cef1d0 con 0x7fdc40031040 2024-04-24T02:12:25.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.144+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3802b070 con 0x7fdc40031040 2024-04-24T02:12:25.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.144+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cef1d0 con 0x55f9f0cec730 2024-04-24T02:12:25.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.144+0000 7fdc4566d640 1 -- 172.21.15.134:0/3204862902 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3c09f070 con 0x55f9f0cec730 2024-04-24T02:12:25.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.144+0000 7fdc4566d640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cef1d0 con 0x7fdc40031040 2024-04-24T02:12:25.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.145+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3802b070 con 0x7fdc40031040 2024-04-24T02:12:25.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.145+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cef1d0 con 0x7fdc3c098070 2024-04-24T02:12:25.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.145+0000 7fdc4666f640 1 -- 172.21.15.134:0/3204862902 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc4001f070 con 0x7fdc3c098070 2024-04-24T02:12:25.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.145+0000 7fdc4666f640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cef1d0 con 0x55f9f0cec730 2024-04-24T02:12:25.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.145+0000 7fdc4566d640 1 -- 172.21.15.134:0/3204862902 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3c09f070 con 0x55f9f0cec730 2024-04-24T02:12:25.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.145+0000 7fdc4566d640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cef1d0 con 0x7fdc40031040 2024-04-24T02:12:25.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.145+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3802b070 con 0x7fdc40031040 2024-04-24T02:12:25.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.145+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cef1d0 con 0x55f9f0ce65f0 2024-04-24T02:12:25.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.146+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdc3802b070 con 0x55f9f0ce65f0 2024-04-24T02:12:25.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.146+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cef1d0 con 0x7fdc3c098070 2024-04-24T02:12:25.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.146+0000 7fdc4666f640 1 -- 172.21.15.134:0/3204862902 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc4001f070 con 0x7fdc3c098070 2024-04-24T02:12:25.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.146+0000 7fdc4b239800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:25.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.146+0000 7fdc4b239800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:25.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.146+0000 7fdc4b239800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:25.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.146+0000 7fdc4b239800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:25.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.146+0000 7fdc4b239800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:25.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.146+0000 7fdc4b239800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:25.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.146+0000 7fdc4b239800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.146+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0ceb180 con 0x55f9f0ce65f0 2024-04-24T02:12:25.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.146+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc3802b070 con 0x55f9f0ce65f0 2024-04-24T02:12:25.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.146+0000 7fdc4b239800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:25.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.146+0000 7fdc4b239800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.146+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0ceba20 con 0x55f9f0ce65f0 2024-04-24T02:12:25.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.146+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdc3802b070 con 0x55f9f0ce65f0 2024-04-24T02:12:25.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.146+0000 7fdc4b239800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:25.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.146+0000 7fdc4b239800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.146+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0ceadc0 con 0x55f9f0ce65f0 2024-04-24T02:12:25.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.147+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdc3802b070 con 0x55f9f0ce65f0 2024-04-24T02:12:25.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.147+0000 7fdc4b239800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:25.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.147+0000 7fdc4b239800 20 zone default found 2024-04-24T02:12:25.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.147+0000 7fdc4b239800 4 Realm: () 2024-04-24T02:12:25.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.147+0000 7fdc4b239800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:25.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.147+0000 7fdc4b239800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:25.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.147+0000 7fdc4b239800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:25.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.147+0000 7fdc4b239800 20 zonegroup default 2024-04-24T02:12:25.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.147+0000 7fdc4b239800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.147+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0ceba20 con 0x7fdc40031040 2024-04-24T02:12:25.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.147+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdc3802b070 con 0x7fdc40031040 2024-04-24T02:12:25.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.147+0000 7fdc4b239800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:25.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.147+0000 7fdc4b239800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.147+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf1010 con 0x55f9f0cec730 2024-04-24T02:12:25.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.147+0000 7fdc4566d640 1 -- 172.21.15.134:0/3204862902 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdc3c09f070 con 0x55f9f0cec730 2024-04-24T02:12:25.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.147+0000 7fdc4b239800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:25.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.147+0000 7fdc4b239800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.147+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf13b0 con 0x55f9f0cec730 2024-04-24T02:12:25.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.147+0000 7fdc4566d640 1 -- 172.21.15.134:0/3204862902 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdc3c09f070 con 0x55f9f0cec730 2024-04-24T02:12:25.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.147+0000 7fdc4b239800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:25.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.147+0000 7fdc4b239800 20 started sync module instance, tier type = 2024-04-24T02:12:25.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.147+0000 7fdc4b239800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:25.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.147+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf04b0 con 0x7fdc3c098070 2024-04-24T02:12:25.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.148+0000 7fdc4666f640 1 -- 172.21.15.134:0/3204862902 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc40040040 con 0x7fdc3c098070 2024-04-24T02:12:25.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.148+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94531975317712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf0110 con 0x7fdc3c098070 2024-04-24T02:12:25.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.148+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf2290 con 0x55f9f0ce65f0 2024-04-24T02:12:25.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.150+0000 7fdc4666f640 1 -- 172.21.15.134:0/3204862902 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94531975317712] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc40040040 con 0x7fdc3c098070 2024-04-24T02:12:25.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.150+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc3802b070 con 0x55f9f0ce65f0 2024-04-24T02:12:25.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.150+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94531975321536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf2290 con 0x55f9f0ce65f0 2024-04-24T02:12:25.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.150+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf2d00 con 0x55f9f0cec730 2024-04-24T02:12:25.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.151+0000 7fdc4566d640 1 -- 172.21.15.134:0/3204862902 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc3c09f070 con 0x55f9f0cec730 2024-04-24T02:12:25.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.151+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94531975325680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf35a0 con 0x55f9f0cec730 2024-04-24T02:12:25.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.151+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf4060 con 0x7fdc3c098070 2024-04-24T02:12:25.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.151+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94531975321536] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc3802b070 con 0x55f9f0ce65f0 2024-04-24T02:12:25.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.152+0000 7fdc4566d640 1 -- 172.21.15.134:0/3204862902 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94531975325680] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc3c09f070 con 0x55f9f0cec730 2024-04-24T02:12:25.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.152+0000 7fdc4666f640 1 -- 172.21.15.134:0/3204862902 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc40040040 con 0x7fdc3c098070 2024-04-24T02:12:25.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.152+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94531975327984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf1de0 con 0x7fdc3c098070 2024-04-24T02:12:25.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.152+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf4a70 con 0x55f9f0ce65f0 2024-04-24T02:12:25.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.153+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc3802b070 con 0x55f9f0ce65f0 2024-04-24T02:12:25.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.153+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94531975333312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf4e90 con 0x55f9f0ce65f0 2024-04-24T02:12:25.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.153+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf5900 con 0x7fdc40031040 2024-04-24T02:12:25.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.153+0000 7fdc4666f640 1 -- 172.21.15.134:0/3204862902 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94531975327984] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc40040040 con 0x7fdc3c098070 2024-04-24T02:12:25.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.155+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94531975333312] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc3802b070 con 0x55f9f0ce65f0 2024-04-24T02:12:25.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.156+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc3802b070 con 0x7fdc40031040 2024-04-24T02:12:25.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.156+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94531975336912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf49e0 con 0x7fdc40031040 2024-04-24T02:12:25.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.156+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf61a0 con 0x7fdc40031040 2024-04-24T02:12:25.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.157+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94531975336912] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc3802b070 con 0x7fdc40031040 2024-04-24T02:12:25.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.157+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(56 notify.6 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc3802b070 con 0x7fdc40031040 2024-04-24T02:12:25.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.157+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94531975330608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf49e0 con 0x7fdc40031040 2024-04-24T02:12:25.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.157+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf6720 con 0x7fdc40031040 2024-04-24T02:12:25.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.158+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94531975330608] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc3802b070 con 0x7fdc40031040 2024-04-24T02:12:25.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.160+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(58 notify.7 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc3802b070 con 0x7fdc40031040 2024-04-24T02:12:25.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.160+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94531975340528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf66e0 con 0x7fdc40031040 2024-04-24T02:12:25.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.160+0000 7fdc4b239800 20 add_watcher() i=0 2024-04-24T02:12:25.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.160+0000 7fdc4b239800 20 add_watcher() i=1 2024-04-24T02:12:25.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.160+0000 7fdc4b239800 20 add_watcher() i=2 2024-04-24T02:12:25.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.160+0000 7fdc4b239800 20 add_watcher() i=3 2024-04-24T02:12:25.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.160+0000 7fdc4b239800 20 add_watcher() i=4 2024-04-24T02:12:25.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.160+0000 7fdc4b239800 20 add_watcher() i=5 2024-04-24T02:12:25.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.160+0000 7fdc4b239800 20 add_watcher() i=6 2024-04-24T02:12:25.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.161+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94531975340528] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc3802b070 con 0x7fdc40031040 2024-04-24T02:12:25.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.161+0000 7fdc4b239800 20 add_watcher() i=7 2024-04-24T02:12:25.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.161+0000 7fdc4b239800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:25.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.161+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf9b40 con 0x55f9f0ce65f0 2024-04-24T02:12:25.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.161+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdc3802b070 con 0x55f9f0ce65f0 2024-04-24T02:12:25.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.161+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94531975338960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf7000 con 0x55f9f0ce65f0 2024-04-24T02:12:25.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.162+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94531975338960] v30'100 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdc3802b070 con 0x55f9f0ce65f0 2024-04-24T02:12:25.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.162+0000 7fdaf77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:25.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.162+0000 7fdc4b239800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:25.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.162+0000 7fdc4b239800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:25.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.162+0000 7fdc4b239800 5 note: GC not initialized 2024-04-24T02:12:25.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.162+0000 7fdaf67fc640 20 reqs_thread_entry: start 2024-04-24T02:12:25.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.162+0000 7fdc4b239800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:25.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.162+0000 7fdc4b239800 20 Filter name: none 2024-04-24T02:12:25.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.163+0000 7fda67fff640 20 reqs_thread_entry: start 2024-04-24T02:12:25.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.163+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0d2c670 con 0x55f9f0cec730 2024-04-24T02:12:25.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.163+0000 7fdc4566d640 1 -- 172.21.15.134:0/3204862902 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3c09f070 con 0x55f9f0cec730 2024-04-24T02:12:25.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.163+0000 7fdc4566d640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0d2c670 con 0x55f9f0cec730 2024-04-24T02:12:25.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.163+0000 7fdc4566d640 1 -- 172.21.15.134:0/3204862902 <== osd.3 v2:172.21.15.134:6801/3585115521 15 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3c09f070 con 0x55f9f0cec730 2024-04-24T02:12:25.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.163+0000 7fdc4566d640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0d2c670 con 0x55f9f0ce65f0 2024-04-24T02:12:25.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.164+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v30'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3802b070 con 0x55f9f0ce65f0 2024-04-24T02:12:25.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.164+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0ceb180 con 0x55f9f0ce65f0 2024-04-24T02:12:25.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.164+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v30'11 uv11 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3802b070 con 0x55f9f0ce65f0 2024-04-24T02:12:25.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.164+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0ceb180 con 0x7fdc3c098070 2024-04-24T02:12:25.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.164+0000 7fdc4666f640 1 -- 172.21.15.134:0/3204862902 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc40040040 con 0x7fdc3c098070 2024-04-24T02:12:25.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.164+0000 7fdc4666f640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf04b0 con 0x55f9f0cec730 2024-04-24T02:12:25.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.164+0000 7fdc4566d640 1 -- 172.21.15.134:0/3204862902 <== osd.3 v2:172.21.15.134:6801/3585115521 16 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3c09f070 con 0x55f9f0cec730 2024-04-24T02:12:25.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.164+0000 7fdc4566d640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf04b0 con 0x55f9f0ce65f0 2024-04-24T02:12:25.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.164+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3802b070 con 0x55f9f0ce65f0 2024-04-24T02:12:25.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.164+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf04b0 con 0x55f9f0cec730 2024-04-24T02:12:25.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.165+0000 7fdc4566d640 1 -- 172.21.15.134:0/3204862902 <== osd.3 v2:172.21.15.134:6801/3585115521 17 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3c09f070 con 0x55f9f0cec730 2024-04-24T02:12:25.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.165+0000 7fdc4566d640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf04b0 con 0x7fdc3c098070 2024-04-24T02:12:25.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.165+0000 7fdc4666f640 1 -- 172.21.15.134:0/3204862902 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v30'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc40040040 con 0x7fdc3c098070 2024-04-24T02:12:25.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.165+0000 7fdc4666f640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf04b0 con 0x55f9f0cec730 2024-04-24T02:12:25.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.165+0000 7fdc4566d640 1 -- 172.21.15.134:0/3204862902 <== osd.3 v2:172.21.15.134:6801/3585115521 18 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3c09f070 con 0x55f9f0cec730 2024-04-24T02:12:25.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.165+0000 7fdc4566d640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf04b0 con 0x55f9f0ce65f0 2024-04-24T02:12:25.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.165+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3802b070 con 0x55f9f0ce65f0 2024-04-24T02:12:25.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.165+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf04b0 con 0x7fdc40031040 2024-04-24T02:12:25.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.166+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3802b070 con 0x7fdc40031040 2024-04-24T02:12:25.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.166+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf04b0 con 0x7fdc40031040 2024-04-24T02:12:25.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.166+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(74 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3802b070 con 0x7fdc40031040 2024-04-24T02:12:25.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.166+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf04b0 con 0x55f9f0cec730 2024-04-24T02:12:25.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.166+0000 7fdc4566d640 1 -- 172.21.15.134:0/3204862902 <== osd.3 v2:172.21.15.134:6801/3585115521 19 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3c09f070 con 0x55f9f0cec730 2024-04-24T02:12:25.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.166+0000 7fdc4566d640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf04b0 con 0x7fdc40031040 2024-04-24T02:12:25.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.167+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(76 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3802b070 con 0x7fdc40031040 2024-04-24T02:12:25.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.167+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf04b0 con 0x7fdc40031040 2024-04-24T02:12:25.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.167+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.0 v2:172.21.15.104:6800/2419146313 20 ==== osd_op_reply(77 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3802b070 con 0x7fdc40031040 2024-04-24T02:12:25.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.167+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf04b0 con 0x7fdc40031040 2024-04-24T02:12:25.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.167+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.0 v2:172.21.15.104:6800/2419146313 21 ==== osd_op_reply(78 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3802b070 con 0x7fdc40031040 2024-04-24T02:12:25.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.167+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf04b0 con 0x55f9f0cec730 2024-04-24T02:12:25.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.167+0000 7fdc4566d640 1 -- 172.21.15.134:0/3204862902 <== osd.3 v2:172.21.15.134:6801/3585115521 20 ==== osd_op_reply(79 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3c09f070 con 0x55f9f0cec730 2024-04-24T02:12:25.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.167+0000 7fdc4566d640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf04b0 con 0x7fdc3c098070 2024-04-24T02:12:25.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.168+0000 7fdc4666f640 1 -- 172.21.15.134:0/3204862902 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(80 [pgnls start_epoch 30 out=70b] v30'2 uv2 ondisk = 1) ==== 144+0+70 (crc 0 0 0) 0x7fdc40040040 con 0x7fdc3c098070 2024-04-24T02:12:25.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.168+0000 7fdc4666f640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf04b0 con 0x55f9f0ce65f0 2024-04-24T02:12:25.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.168+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(81 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3802b070 con 0x55f9f0ce65f0 2024-04-24T02:12:25.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.168+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf04b0 con 0x55f9f0ce65f0 2024-04-24T02:12:25.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.168+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(82 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3802b070 con 0x55f9f0ce65f0 2024-04-24T02:12:25.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.168+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf04b0 con 0x55f9f0cec730 2024-04-24T02:12:25.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.168+0000 7fdc4566d640 1 -- 172.21.15.134:0/3204862902 <== osd.3 v2:172.21.15.134:6801/3585115521 21 ==== osd_op_reply(83 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3c09f070 con 0x55f9f0cec730 2024-04-24T02:12:25.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.168+0000 7fdc4566d640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf04b0 con 0x7fdc3c098070 2024-04-24T02:12:25.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.169+0000 7fdc4666f640 1 -- 172.21.15.134:0/3204862902 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(84 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc40040040 con 0x7fdc3c098070 2024-04-24T02:12:25.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.169+0000 7fdc4666f640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf04b0 con 0x7fdc40031040 2024-04-24T02:12:25.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.169+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.0 v2:172.21.15.104:6800/2419146313 22 ==== osd_op_reply(85 [pgnls start_epoch 30 out=127b] v30'1 uv1 ondisk = 1) ==== 144+0+127 (crc 0 0 0) 0x7fdc3802b070 con 0x7fdc40031040 2024-04-24T02:12:25.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.169+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf04b0 con 0x55f9f0ce65f0 2024-04-24T02:12:25.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.169+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(86 [pgnls start_epoch 30 out=49b] v30'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3802b070 con 0x55f9f0ce65f0 2024-04-24T02:12:25.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.169+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf04b0 con 0x7fdc40031040 2024-04-24T02:12:25.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.169+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.0 v2:172.21.15.104:6800/2419146313 23 ==== osd_op_reply(87 [pgnls start_epoch 30 out=49b] v30'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3802b070 con 0x7fdc40031040 2024-04-24T02:12:25.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.169+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf04b0 con 0x55f9f0cec730 2024-04-24T02:12:25.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.170+0000 7fdc4566d640 1 -- 172.21.15.134:0/3204862902 <== osd.3 v2:172.21.15.134:6801/3585115521 22 ==== osd_op_reply(88 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3c09f070 con 0x55f9f0cec730 2024-04-24T02:12:25.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.170+0000 7fdc4566d640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf04b0 con 0x7fdc3c098070 2024-04-24T02:12:25.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.170+0000 7fdc4666f640 1 -- 172.21.15.134:0/3204862902 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(89 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc40040040 con 0x7fdc3c098070 2024-04-24T02:12:25.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.170+0000 7fdc4666f640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf04b0 con 0x7fdc40031040 2024-04-24T02:12:25.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.170+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.0 v2:172.21.15.104:6800/2419146313 24 ==== osd_op_reply(90 [pgnls start_epoch 30 out=49b] v30'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3802b070 con 0x7fdc40031040 2024-04-24T02:12:25.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.170+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf04b0 con 0x55f9f0ce65f0 2024-04-24T02:12:25.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.170+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.1 v2:172.21.15.134:6804/1487076214 30 ==== osd_op_reply(91 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3802b070 con 0x55f9f0ce65f0 2024-04-24T02:12:25.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.170+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf04b0 con 0x55f9f0cec730 2024-04-24T02:12:25.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.171+0000 7fdc4566d640 1 -- 172.21.15.134:0/3204862902 <== osd.3 v2:172.21.15.134:6801/3585115521 23 ==== osd_op_reply(92 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3c09f070 con 0x55f9f0cec730 2024-04-24T02:12:25.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.171+0000 7fdc4566d640 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf04b0 con 0x7fdc3c098070 2024-04-24T02:12:25.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.171+0000 7fdc4666f640 1 -- 172.21.15.134:0/3204862902 <== osd.2 v2:172.21.15.134:6800/214480313 16 ==== osd_op_reply(93 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc40040040 con 0x7fdc3c098070 2024-04-24T02:12:25.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.171+0000 7fdc4b239800 20 RGWRados::pool_iterate: got myfoo 2024-04-24T02:12:25.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.171+0000 7fdc4b239800 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 2024-04-24T02:12:25.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.172+0000 7fdaf77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:25.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.172+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94531975338960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0ceb180 con 0x55f9f0ce65f0 2024-04-24T02:12:25.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.173+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.1 v2:172.21.15.134:6804/1487076214 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94531975338960] v30'101 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdc3802b070 con 0x55f9f0ce65f0 2024-04-24T02:12:25.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.173+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94531975317712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf5bd0 con 0x7fdc3c098070 2024-04-24T02:12:25.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.174+0000 7fdc4666f640 1 -- 172.21.15.134:0/3204862902 <== osd.2 v2:172.21.15.134:6800/214480313 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94531975317712] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc40040040 con 0x7fdc3c098070 2024-04-24T02:12:25.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.174+0000 7fdc4b239800 20 remove_watcher() i=0 2024-04-24T02:12:25.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.174+0000 7fdc4b239800 2 removed watcher, disabling cache 2024-04-24T02:12:25.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.174+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94531975321536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf5bd0 con 0x55f9f0ce65f0 2024-04-24T02:12:25.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.175+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.1 v2:172.21.15.134:6804/1487076214 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94531975321536] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc3802b070 con 0x55f9f0ce65f0 2024-04-24T02:12:25.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.175+0000 7fdc4b239800 20 remove_watcher() i=1 2024-04-24T02:12:25.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.175+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94531975325680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf5bd0 con 0x55f9f0cec730 2024-04-24T02:12:25.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.176+0000 7fdc4566d640 1 -- 172.21.15.134:0/3204862902 <== osd.3 v2:172.21.15.134:6801/3585115521 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94531975325680] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc3c09f070 con 0x55f9f0cec730 2024-04-24T02:12:25.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.176+0000 7fdc4b239800 20 remove_watcher() i=2 2024-04-24T02:12:25.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.176+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94531975327984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf27f0 con 0x7fdc3c098070 2024-04-24T02:12:25.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.177+0000 7fdc4666f640 1 -- 172.21.15.134:0/3204862902 <== osd.2 v2:172.21.15.134:6800/214480313 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94531975327984] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc40040040 con 0x7fdc3c098070 2024-04-24T02:12:25.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.177+0000 7fdc4b239800 20 remove_watcher() i=3 2024-04-24T02:12:25.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.177+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94531975333312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf27f0 con 0x55f9f0ce65f0 2024-04-24T02:12:25.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.178+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.1 v2:172.21.15.134:6804/1487076214 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94531975333312] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc3802b070 con 0x55f9f0ce65f0 2024-04-24T02:12:25.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.178+0000 7fdc4b239800 20 remove_watcher() i=4 2024-04-24T02:12:25.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.178+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94531975336912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf45c0 con 0x7fdc40031040 2024-04-24T02:12:25.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.179+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.0 v2:172.21.15.104:6800/2419146313 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94531975336912] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc3802b070 con 0x7fdc40031040 2024-04-24T02:12:25.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.179+0000 7fdc4b239800 20 remove_watcher() i=5 2024-04-24T02:12:25.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.179+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94531975330608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf27f0 con 0x7fdc40031040 2024-04-24T02:12:25.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.180+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.0 v2:172.21.15.104:6800/2419146313 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94531975330608] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc3802b070 con 0x7fdc40031040 2024-04-24T02:12:25.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.180+0000 7fdc4b239800 20 remove_watcher() i=6 2024-04-24T02:12:25.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.180+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94531975340528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f9f0cf27f0 con 0x7fdc40031040 2024-04-24T02:12:25.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.181+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 <== osd.0 v2:172.21.15.104:6800/2419146313 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94531975340528] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc3802b070 con 0x7fdc40031040 2024-04-24T02:12:25.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.181+0000 7fdc4b239800 20 remove_watcher() i=7 2024-04-24T02:12:25.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.181+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fdc40031040 msgr2=0x7fdc40032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.181+0000 7fdc4b239800 1 --2- 172.21.15.134:0/3204862902 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fdc40031040 0x7fdc40032940 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.181+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f9f0ce65f0 msgr2=0x55f9f0ce8ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.181+0000 7fdc4b239800 1 --2- 172.21.15.134:0/3204862902 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f9f0ce65f0 0x55f9f0ce8ab0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.181+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fdc3c098070 msgr2=0x7fdc3c082450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.181+0000 7fdc4b239800 1 --2- 172.21.15.134:0/3204862902 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fdc3c098070 0x7fdc3c082450 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.181+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55f9f0cec730 msgr2=0x55f9f0ceeb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.181+0000 7fdc4b239800 1 --2- 172.21.15.134:0/3204862902 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55f9f0cec730 0x55f9f0ceeb20 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.181+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdb10036950 msgr2=0x7fdb10038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.181+0000 7fdc4b239800 1 --2- 172.21.15.134:0/3204862902 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdb10036950 0x7fdb10038e10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x55f9f0cb2570 tx=0x7fdc4001f000 comp rx=0 tx=0).stop 2024-04-24T02:12:25.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.181+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9f0cd3460 msgr2=0x55f9f0cdab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.181+0000 7fdc45e6e640 1 -- 172.21.15.134:0/3204862902 reap_dead start 2024-04-24T02:12:25.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.181+0000 7fdc4b239800 1 --2- 172.21.15.134:0/3204862902 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9f0cd3460 0x55f9f0cdab00 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c08ccc0 tx=0x7fdc3c08dd30 comp rx=0 tx=0).stop 2024-04-24T02:12:25.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.181+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 shutdown_connections 2024-04-24T02:12:25.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.181+0000 7fdc4b239800 1 --2- 172.21.15.134:0/3204862902 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9f0cd3460 0x55f9f0cdab00 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.181+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 >> 172.21.15.134:0/3204862902 conn(0x55f9f0ccf7c0 msgr2=0x55f9f0ccce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:25.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.181+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 shutdown_connections 2024-04-24T02:12:25.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.181+0000 7fdc4b239800 1 -- 172.21.15.134:0/3204862902 wait complete. 2024-04-24T02:12:25.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.181+0000 7fdc4b239800 1 -- 172.21.15.134:0/2296201215 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdb20036900 msgr2=0x7fdb20038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.181+0000 7fdc4b239800 1 --2- 172.21.15.134:0/2296201215 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdb20036900 0x7fdb20038dc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x55f9f0cb6210 tx=0x7fdc40005840 comp rx=0 tx=0).stop 2024-04-24T02:12:25.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.181+0000 7fdc4b239800 1 -- 172.21.15.134:0/2296201215 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9f0cc61a0 msgr2=0x55f9f0cc65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.181+0000 7fdc4b239800 1 --2- 172.21.15.134:0/2296201215 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9f0cc61a0 0x55f9f0cc65c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c044840 tx=0x7fdc3c002fb0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.181+0000 7fdc4b239800 1 -- 172.21.15.134:0/2296201215 shutdown_connections 2024-04-24T02:12:25.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.181+0000 7fdc4b239800 1 --2- 172.21.15.134:0/2296201215 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdb20036900 0x7fdb20038dc0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.181+0000 7fdc4b239800 1 --2- 172.21.15.134:0/2296201215 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9f0cc61a0 0x55f9f0cc65c0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.181+0000 7fdc4b239800 1 -- 172.21.15.134:0/2296201215 >> 172.21.15.134:0/2296201215 conn(0x55f9f0cba240 msgr2=0x55f9f0cba640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:25.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.181+0000 7fdc4b239800 1 -- 172.21.15.134:0/2296201215 shutdown_connections 2024-04-24T02:12:25.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.181+0000 7fdc4b239800 1 -- 172.21.15.134:0/2296201215 wait complete. 2024-04-24T02:12:25.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.182+0000 7fdc4b239800 1 -- 172.21.15.134:0/1930348065 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f9f0bb7430 msgr2=0x55f9f0cb5050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.182+0000 7fdc4b239800 1 --2- 172.21.15.134:0/1930348065 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f9f0bb7430 0x55f9f0cb5050 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.182+0000 7fdc4b239800 1 -- 172.21.15.134:0/1930348065 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdb2c036900 msgr2=0x7fdb2c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.182+0000 7fdc4b239800 1 --2- 172.21.15.134:0/1930348065 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdb2c036900 0x7fdb2c038dc0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c054000 tx=0x7fdc3c04e000 comp rx=0 tx=0).stop 2024-04-24T02:12:25.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.182+0000 7fdc4b239800 1 -- 172.21.15.134:0/1930348065 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9f0bb3920 msgr2=0x55f9f0cade10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.182+0000 7fdc4b239800 1 --2- 172.21.15.134:0/1930348065 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9f0bb3920 0x55f9f0cade10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fdc3800c010 tx=0x7fdc38000ed0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.182+0000 7fdc4b239800 1 -- 172.21.15.134:0/1930348065 shutdown_connections 2024-04-24T02:12:25.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.182+0000 7fdc4b239800 1 --2- 172.21.15.134:0/1930348065 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f9f0bb7430 0x55f9f0cb5050 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.182+0000 7fdc4b239800 1 --2- 172.21.15.134:0/1930348065 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdb2c036900 0x7fdb2c038dc0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.182+0000 7fdc4b239800 1 --2- 172.21.15.134:0/1930348065 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f9f0bb3920 0x55f9f0cade10 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.182+0000 7fdc4b239800 1 -- 172.21.15.134:0/1930348065 >> 172.21.15.134:0/1930348065 conn(0x55f9f0bad370 msgr2=0x55f9f0bb2100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:25.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.182+0000 7fdc4b239800 1 -- 172.21.15.134:0/1930348065 shutdown_connections 2024-04-24T02:12:25.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.182+0000 7fdc4b239800 1 -- 172.21.15.134:0/1930348065 wait complete. 2024-04-24T02:12:25.200 INFO:teuthology.orchestra.run.smithi134.stdout:["myfoo"] 2024-04-24T02:12:25.200 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-04-24T02:12:25.214 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T02:12:25.226 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T02:12:25.240 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T02:12:25.283 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-04-24T02:12:25.312 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T02:12:25.339 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T02:12:25.365 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T02:12:25.365 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-04-24T02:12:25.366 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-04-24T02:12:25.366 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-04-24T02:12:25.408 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:25.408 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:25.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.408+0000 7f0b12a13800 1 Processor -- start 2024-04-24T02:12:25.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.408+0000 7f0b12a13800 1 -- start start 2024-04-24T02:12:25.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.408+0000 7f0b12a13800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55b137cbf780 0x55b137cbfba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.408+0000 7f0b12a13800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b137b7fd40 con 0x55b137cc00e0 2024-04-24T02:12:25.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.408+0000 7f0b12a13800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55b137b524d0 con 0x55b137cbf780 2024-04-24T02:12:25.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.408+0000 7f0b0e147640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55b137cbf780 0x55b137cbfba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.408+0000 7f0b07fff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55b137cc00e0 0x55b137cc0590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:43410/0 (socket says 172.21.15.134:43410) 2024-04-24T02:12:25.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.408+0000 7f0b07fff640 1 -- 172.21.15.134:0/2626544614 learned_addr learned my addr 172.21.15.134:0/2626544614 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:12:25.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.409+0000 7f0b0e147640 1 -- 172.21.15.134:0/2626544614 >> v1:172.21.15.104:6789/0 conn(0x55b137cc00e0 legacy=0x55b137cc0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.409+0000 7f0b0e147640 1 -- 172.21.15.134:0/2626544614 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b137b7e590 con 0x55b137cbf780 2024-04-24T02:12:25.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.410+0000 7f0b0e147640 1 --2- 172.21.15.134:0/2626544614 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b137cbf780 0x55b137cbfba0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f0b0000a470 tx=0x7f0b0001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2e877028c1c691c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.411+0000 7f0b0d946640 1 -- 172.21.15.134:0/2626544614 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b00057070 con 0x55b137cbf780 2024-04-24T02:12:25.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.411+0000 7f0b0d946640 1 -- 172.21.15.134:0/2626544614 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b0004adc0 con 0x55b137cbf780 2024-04-24T02:12:25.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.411+0000 7f0b0d946640 1 -- 172.21.15.134:0/2626544614 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b00052590 con 0x55b137cbf780 2024-04-24T02:12:25.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.411+0000 7f0b12a13800 1 -- 172.21.15.134:0/2626544614 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b137cbf780 msgr2=0x55b137cbfba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.411+0000 7f0b12a13800 1 --2- 172.21.15.134:0/2626544614 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b137cbf780 0x55b137cbfba0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f0b0000a470 tx=0x7f0b0001ce90 comp rx=0 tx=0).stop 2024-04-24T02:12:25.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.411+0000 7f0b12a13800 1 -- 172.21.15.134:0/2626544614 shutdown_connections 2024-04-24T02:12:25.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.411+0000 7f0b12a13800 1 --2- 172.21.15.134:0/2626544614 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b137cbf780 0x55b137cbfba0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.411+0000 7f0b12a13800 1 -- 172.21.15.134:0/2626544614 >> 172.21.15.134:0/2626544614 conn(0x55b137cbb320 msgr2=0x55b137cbd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:25.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.411+0000 7f0b12a13800 1 -- 172.21.15.134:0/2626544614 shutdown_connections 2024-04-24T02:12:25.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.411+0000 7f0b12a13800 1 -- 172.21.15.134:0/2626544614 wait complete. 2024-04-24T02:12:25.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.423+0000 7f0b12a13800 1 Processor -- start 2024-04-24T02:12:25.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.423+0000 7f0b12a13800 1 -- start start 2024-04-24T02:12:25.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.423+0000 7f0b12a13800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b137cbf780 0x55b137db4390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.423+0000 7f0b12a13800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b137c0c3c0 con 0x55b137cbf780 2024-04-24T02:12:25.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.423+0000 7f0b0e147640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b137cbf780 0x55b137db4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.423+0000 7f0b0e147640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b137cbf780 0x55b137db4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46790/0 (socket says 172.21.15.134:46790) 2024-04-24T02:12:25.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.423+0000 7f0b0e147640 1 -- 172.21.15.134:0/3790407338 learned_addr learned my addr 172.21.15.134:0/3790407338 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:25.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.424+0000 7f0b0e147640 1 -- 172.21.15.134:0/3790407338 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b137db4960 con 0x55b137cbf780 2024-04-24T02:12:25.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.424+0000 7f0b0e147640 1 --2- 172.21.15.134:0/3790407338 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b137cbf780 0x55b137db4390 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0b00055040 tx=0x7f0b0004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16d8cf058c9c012d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.424+0000 7f09fc608640 1 -- 172.21.15.134:0/3790407338 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b00057040 con 0x55b137cbf780 2024-04-24T02:12:25.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.424+0000 7f09fc608640 1 -- 172.21.15.134:0/3790407338 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b00062070 con 0x55b137cbf780 2024-04-24T02:12:25.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.424+0000 7f09fc608640 1 -- 172.21.15.134:0/3790407338 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b0005d470 con 0x55b137cbf780 2024-04-24T02:12:25.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.425+0000 7f0b12a13800 1 -- 172.21.15.134:0/3790407338 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b137cbf780 msgr2=0x55b137db4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.425+0000 7f0b12a13800 1 --2- 172.21.15.134:0/3790407338 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b137cbf780 0x55b137db4390 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0b00055040 tx=0x7f0b0004c000 comp rx=0 tx=0).stop 2024-04-24T02:12:25.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.425+0000 7f0b12a13800 1 -- 172.21.15.134:0/3790407338 shutdown_connections 2024-04-24T02:12:25.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.425+0000 7f0b12a13800 1 --2- 172.21.15.134:0/3790407338 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b137cbf780 0x55b137db4390 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.425+0000 7f0b12a13800 1 -- 172.21.15.134:0/3790407338 >> 172.21.15.134:0/3790407338 conn(0x55b137cbb320 msgr2=0x55b137dafcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:25.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.425+0000 7f0b12a13800 1 -- 172.21.15.134:0/3790407338 shutdown_connections 2024-04-24T02:12:25.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.425+0000 7f0b12a13800 1 -- 172.21.15.134:0/3790407338 wait complete. 2024-04-24T02:12:25.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.425+0000 7f0b12a13800 1 Processor -- start 2024-04-24T02:12:25.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.425+0000 7f0b12a13800 1 -- start start 2024-04-24T02:12:25.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.425+0000 7f0b12a13800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b137cbf780 0x55b137dbbed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.425+0000 7f0b12a13800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b137cc0f40 con 0x55b137cbf780 2024-04-24T02:12:25.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.425+0000 7f0b0e147640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b137cbf780 0x55b137dbbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.425+0000 7f0b0e147640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b137cbf780 0x55b137dbbed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46800/0 (socket says 172.21.15.134:46800) 2024-04-24T02:12:25.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.425+0000 7f0b0e147640 1 -- 172.21.15.134:0/2011055997 learned_addr learned my addr 172.21.15.134:0/2011055997 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:25.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.426+0000 7f0b0e147640 1 -- 172.21.15.134:0/2011055997 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b137dbc410 con 0x55b137cbf780 2024-04-24T02:12:25.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.426+0000 7f0b0e147640 1 --2- 172.21.15.134:0/2011055997 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b137cbf780 0x55b137dbbed0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0b00005870 tx=0x7f0b00002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.426+0000 7f09fae05640 1 -- 172.21.15.134:0/2011055997 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b0006b070 con 0x55b137cbf780 2024-04-24T02:12:25.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.426+0000 7f09fae05640 1 -- 172.21.15.134:0/2011055997 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b0005d940 con 0x55b137cbf780 2024-04-24T02:12:25.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.426+0000 7f0b12a13800 1 -- 172.21.15.134:0/2011055997 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b137dbc6a0 con 0x55b137cbf780 2024-04-24T02:12:25.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.426+0000 7f09fae05640 1 -- 172.21.15.134:0/2011055997 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b00057070 con 0x55b137cbf780 2024-04-24T02:12:25.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.426+0000 7f0b12a13800 1 -- 172.21.15.134:0/2011055997 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b137dbf2b0 con 0x55b137cbf780 2024-04-24T02:12:25.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.427+0000 7f09fae05640 1 -- 172.21.15.134:0/2011055997 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0b0005dc20 con 0x55b137cbf780 2024-04-24T02:12:25.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.427+0000 7f09fae05640 1 --2- 172.21.15.134:0/2011055997 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f09f4036900 0x7f09f4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.427+0000 7f09fae05640 1 -- 172.21.15.134:0/2011055997 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f0b0008e040 con 0x55b137cbf780 2024-04-24T02:12:25.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.427+0000 7f0b07fff640 1 --2- 172.21.15.134:0/2011055997 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f09f4036900 0x7f09f4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.427+0000 7f0b12a13800 1 --2- 172.21.15.134:0/2011055997 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b137cc00e0 0x55b137dc3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.427+0000 7f0b12a13800 1 -- 172.21.15.134:0/2011055997 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b137dc35b0 con 0x55b137cc00e0 2024-04-24T02:12:25.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.427+0000 7f0b0e948640 1 --2- 172.21.15.134:0/2011055997 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b137cc00e0 0x55b137dc3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.427+0000 7f0b07fff640 1 --2- 172.21.15.134:0/2011055997 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f09f4036900 0x7f09f4038dc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0af8000f60 tx=0x7f0af80012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.428+0000 7f0b0e948640 1 --2- 172.21.15.134:0/2011055997 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b137cc00e0 0x55b137dc3070 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.428+0000 7f0b0e948640 1 -- 172.21.15.134:0/2011055997 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b0800a4a0 con 0x55b137cc00e0 2024-04-24T02:12:25.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.428+0000 7f0b12a13800 1 -- 172.21.15.134:0/2011055997 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b137dc0640 con 0x55b137cc00e0 2024-04-24T02:12:25.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.428+0000 7f0b0e948640 1 -- 172.21.15.134:0/2011055997 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0b0800a4a0 con 0x55b137cc00e0 2024-04-24T02:12:25.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.428+0000 7f0b12a13800 1 -- 172.21.15.134:0/2011055997 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b137dc53f0 con 0x55b137cc00e0 2024-04-24T02:12:25.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.428+0000 7f0b0e948640 1 -- 172.21.15.134:0/2011055997 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0b0800a4a0 con 0x55b137cc00e0 2024-04-24T02:12:25.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.428+0000 7f0b12a13800 1 -- 172.21.15.134:0/2011055997 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b137dc4730 con 0x55b137cc00e0 2024-04-24T02:12:25.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.429+0000 7f0b0e948640 1 -- 172.21.15.134:0/2011055997 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0b0800a4a0 con 0x55b137cc00e0 2024-04-24T02:12:25.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.429+0000 7f0b12a13800 1 -- 172.21.15.134:0/2011055997 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b137dc4ad0 con 0x55b137cc00e0 2024-04-24T02:12:25.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.429+0000 7f0b0e948640 1 -- 172.21.15.134:0/2011055997 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0b0800a4a0 con 0x55b137cc00e0 2024-04-24T02:12:25.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.429+0000 7f0b12a13800 1 Processor -- start 2024-04-24T02:12:25.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.429+0000 7f0b12a13800 1 -- start start 2024-04-24T02:12:25.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.430+0000 7f0b12a13800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b137dd4210 0x55b137dd4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.430+0000 7f0b12a13800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b137bb26b0 con 0x55b137dd4210 2024-04-24T02:12:25.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.430+0000 7f0b07fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b137dd4210 0x55b137dd4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.430+0000 7f0b07fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b137dd4210 0x55b137dd4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46802/0 (socket says 172.21.15.134:46802) 2024-04-24T02:12:25.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.430+0000 7f0b07fff640 1 -- 172.21.15.134:0/544988898 learned_addr learned my addr 172.21.15.134:0/544988898 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:25.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.430+0000 7f0b07fff640 1 -- 172.21.15.134:0/544988898 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b137dd4b70 con 0x55b137dd4210 2024-04-24T02:12:25.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.430+0000 7f0b07fff640 1 --2- 172.21.15.134:0/544988898 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b137dd4210 0x55b137dd4630 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0af8001ed0 tx=0x7f0af800d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.430+0000 7f09f3fff640 1 -- 172.21.15.134:0/544988898 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0af801b550 con 0x55b137dd4210 2024-04-24T02:12:25.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.430+0000 7f09f3fff640 1 -- 172.21.15.134:0/544988898 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0af801b6f0 con 0x55b137dd4210 2024-04-24T02:12:25.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.430+0000 7f0b12a13800 1 -- 172.21.15.134:0/544988898 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b137dd55e0 con 0x55b137dd4210 2024-04-24T02:12:25.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.430+0000 7f09f3fff640 1 -- 172.21.15.134:0/544988898 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0af801b9d0 con 0x55b137dd4210 2024-04-24T02:12:25.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.431+0000 7f0b12a13800 1 -- 172.21.15.134:0/544988898 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b137dd5ae0 con 0x55b137dd4210 2024-04-24T02:12:25.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.431+0000 7f09f3fff640 1 -- 172.21.15.134:0/544988898 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0af8023020 con 0x55b137dd4210 2024-04-24T02:12:25.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.431+0000 7f09f3fff640 1 --2- 172.21.15.134:0/544988898 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f09e8036900 0x7f09e8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.431+0000 7f09f3fff640 1 -- 172.21.15.134:0/544988898 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f0af8021020 con 0x55b137dd4210 2024-04-24T02:12:25.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.431+0000 7f0b0e948640 1 --2- 172.21.15.134:0/544988898 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f09e8036900 0x7f09e8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.432+0000 7f0b12a13800 1 Processor -- start 2024-04-24T02:12:25.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.432+0000 7f0b12a13800 1 -- start start 2024-04-24T02:12:25.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.432+0000 7f0b0e948640 1 --2- 172.21.15.134:0/544988898 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f09e8036900 0x7f09e8038dc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x55b137dc4250 tx=0x7f0b08005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.432+0000 7f0b12a13800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b137de1590 0x55b137de19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.432+0000 7f0b12a13800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b137db4c20 con 0x55b137de1590 2024-04-24T02:12:25.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.432+0000 7f0b07fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b137de1590 0x55b137de19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.432+0000 7f0b07fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b137de1590 0x55b137de19b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46818/0 (socket says 172.21.15.134:46818) 2024-04-24T02:12:25.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.432+0000 7f0b07fff640 1 -- 172.21.15.134:0/761917448 learned_addr learned my addr 172.21.15.134:0/761917448 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:25.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.432+0000 7f0b07fff640 1 -- 172.21.15.134:0/761917448 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b137de1f80 con 0x55b137de1590 2024-04-24T02:12:25.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.432+0000 7f0b07fff640 1 --2- 172.21.15.134:0/761917448 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b137de1590 0x55b137de19b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0af804ce90 tx=0x7f0af804e6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64cb475e28496ace server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.433+0000 7f09f1ffb640 1 -- 172.21.15.134:0/761917448 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0af801be20 con 0x55b137de1590 2024-04-24T02:12:25.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.433+0000 7f09f1ffb640 1 -- 172.21.15.134:0/761917448 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0af803e070 con 0x55b137de1590 2024-04-24T02:12:25.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.433+0000 7f09f1ffb640 1 -- 172.21.15.134:0/761917448 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0af8024e10 con 0x55b137de1590 2024-04-24T02:12:25.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.433+0000 7f0b12a13800 1 -- 172.21.15.134:0/761917448 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b137de1590 msgr2=0x55b137de19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.433+0000 7f0b12a13800 1 --2- 172.21.15.134:0/761917448 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b137de1590 0x55b137de19b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0af804ce90 tx=0x7f0af804e6a0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.433+0000 7f0b12a13800 1 -- 172.21.15.134:0/761917448 shutdown_connections 2024-04-24T02:12:25.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.433+0000 7f0b12a13800 1 --2- 172.21.15.134:0/761917448 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b137de1590 0x55b137de19b0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.433+0000 7f0b12a13800 1 -- 172.21.15.134:0/761917448 >> 172.21.15.134:0/761917448 conn(0x55b137ddd8b0 msgr2=0x55b137ddb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:25.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.433+0000 7f0b12a13800 1 -- 172.21.15.134:0/761917448 shutdown_connections 2024-04-24T02:12:25.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.433+0000 7f0b12a13800 1 -- 172.21.15.134:0/761917448 wait complete. 2024-04-24T02:12:25.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.433+0000 7f0b12a13800 1 Processor -- start 2024-04-24T02:12:25.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.433+0000 7f0b12a13800 1 -- start start 2024-04-24T02:12:25.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.433+0000 7f0b12a13800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b137de1590 0x55b137de8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.433+0000 7f0b12a13800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b137de2700 con 0x55b137de1590 2024-04-24T02:12:25.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.434+0000 7f0b07fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b137de1590 0x55b137de8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.434+0000 7f0b07fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b137de1590 0x55b137de8c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:46830/0 (socket says 172.21.15.134:46830) 2024-04-24T02:12:25.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.434+0000 7f0b07fff640 1 -- 172.21.15.134:0/2896421138 learned_addr learned my addr 172.21.15.134:0/2896421138 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:25.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.434+0000 7f0b07fff640 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b137de9160 con 0x55b137de1590 2024-04-24T02:12:25.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.434+0000 7f0b07fff640 1 --2- 172.21.15.134:0/2896421138 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b137de1590 0x55b137de8c20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f0af800dcc0 tx=0x7f0af804ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.434+0000 7f09dffff640 1 -- 172.21.15.134:0/2896421138 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0af8034020 con 0x55b137de1590 2024-04-24T02:12:25.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.434+0000 7f09dffff640 1 -- 172.21.15.134:0/2896421138 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0af804a070 con 0x55b137de1590 2024-04-24T02:12:25.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.434+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b137de93f0 con 0x55b137de1590 2024-04-24T02:12:25.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.434+0000 7f09dffff640 1 -- 172.21.15.134:0/2896421138 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0af8046920 con 0x55b137de1590 2024-04-24T02:12:25.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.434+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b137de93f0 con 0x55b137de1590 2024-04-24T02:12:25.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.435+0000 7f09dffff640 1 -- 172.21.15.134:0/2896421138 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0af8037020 con 0x55b137de1590 2024-04-24T02:12:25.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.435+0000 7f0b12a13800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.435+0000 7f09dffff640 1 --2- 172.21.15.134:0/2896421138 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f09d8036900 0x7f09d8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.435+0000 7f09dffff640 1 -- 172.21.15.134:0/2896421138 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f0af803aab0 con 0x55b137de1590 2024-04-24T02:12:25.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.435+0000 7f0b0e948640 1 --2- 172.21.15.134:0/2896421138 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f09d8036900 0x7f09d8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.435+0000 7f0b12a13800 1 --2- 172.21.15.134:0/2896421138 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b137df4500 0x55b137df6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.435+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b137df70e0 con 0x55b137df4500 2024-04-24T02:12:25.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.435+0000 7f0b0e147640 1 --2- 172.21.15.134:0/2896421138 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b137df4500 0x55b137df6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.436+0000 7f0b0e948640 1 --2- 172.21.15.134:0/2896421138 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f09d8036900 0x7f09d8038dc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x55b137dc0590 tx=0x7f0b0801f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.436+0000 7f0b0e147640 1 --2- 172.21.15.134:0/2896421138 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b137df4500 0x55b137df6990 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.436+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b0005a040 con 0x55b137df4500 2024-04-24T02:12:25.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.436+0000 7f0b12a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:25.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.436+0000 7f0b12a13800 20 realm 2024-04-24T02:12:25.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.436+0000 7f0b12a13800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.436+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b137df74f0 con 0x55b137df4500 2024-04-24T02:12:25.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.436+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b0005a040 con 0x55b137df4500 2024-04-24T02:12:25.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.436+0000 7f0b12a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:25.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.436+0000 7f0b12a13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:25.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.436+0000 7f0b12a13800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.436+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b137df7dc0 con 0x55b137df4500 2024-04-24T02:12:25.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.436+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b0005a040 con 0x55b137df4500 2024-04-24T02:12:25.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.436+0000 7f0b12a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:25.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.436+0000 7f0b12a13800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.436+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b137df8160 con 0x55b137df4500 2024-04-24T02:12:25.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.436+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0b0005a040 con 0x55b137df4500 2024-04-24T02:12:25.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.436+0000 7f0b12a13800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:25.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.436+0000 7f0b12a13800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.437+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b137df85c0 con 0x55b137df4500 2024-04-24T02:12:25.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.437+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0b0005a040 con 0x55b137df4500 2024-04-24T02:12:25.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.437+0000 7f0b12a13800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:25.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.437+0000 7f0b12a13800 20 searching for the correct realm 2024-04-24T02:12:25.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.437+0000 7f0b12a13800 1 --2- 172.21.15.134:0/2896421138 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55b137dfa610 0x55b137dfca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.437+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b137dfd0d0 con 0x55b137dfa610 2024-04-24T02:12:25.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.437+0000 7f0b07fff640 1 --2- 172.21.15.134:0/2896421138 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55b137dfa610 0x55b137dfca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.437+0000 7f0b07fff640 1 --2- 172.21.15.134:0/2896421138 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55b137dfa610 0x55b137dfca00 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.438+0000 7f0b07fff640 1 -- 172.21.15.134:0/2896421138 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0af804e040 con 0x55b137dfa610 2024-04-24T02:12:25.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.438+0000 7f0b07fff640 1 --2- 172.21.15.134:0/2896421138 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f0af8039020 0x7f0af80512f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.438+0000 7f0b07fff640 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b137dfd0d0 con 0x7f0af8039020 2024-04-24T02:12:25.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.438+0000 7f0b0e948640 1 --2- 172.21.15.134:0/2896421138 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f0af8039020 0x7f0af80512f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.438+0000 7f0b0e948640 1 --2- 172.21.15.134:0/2896421138 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f0af8039020 0x7f0af80512f0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.438+0000 7f0b0e948640 1 -- 172.21.15.134:0/2896421138 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b0801f070 con 0x7f0af8039020 2024-04-24T02:12:25.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.438+0000 7f0b0e948640 1 --2- 172.21.15.134:0/2896421138 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f0b08031040 0x7f0b08032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.438+0000 7f0b0e948640 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b137dfd0d0 con 0x7f0b08031040 2024-04-24T02:12:25.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.438+0000 7f0b0e147640 1 --2- 172.21.15.134:0/2896421138 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f0b08031040 0x7f0b08032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.439+0000 7f0b0e147640 1 --2- 172.21.15.134:0/2896421138 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f0b08031040 0x7f0b08032940 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.439+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b0005a040 con 0x7f0b08031040 2024-04-24T02:12:25.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.439+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b137dfd0d0 con 0x55b137df4500 2024-04-24T02:12:25.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.439+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b0005a040 con 0x55b137df4500 2024-04-24T02:12:25.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.439+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b137dfd0d0 con 0x55b137df4500 2024-04-24T02:12:25.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.439+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0b0005a040 con 0x55b137df4500 2024-04-24T02:12:25.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.439+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b137dfd0d0 con 0x7f0b08031040 2024-04-24T02:12:25.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.440+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b0005a040 con 0x7f0b08031040 2024-04-24T02:12:25.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.440+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b137dfd0d0 con 0x7f0b08031040 2024-04-24T02:12:25.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.440+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b0005a040 con 0x7f0b08031040 2024-04-24T02:12:25.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.440+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b137dfd0d0 con 0x7f0af8039020 2024-04-24T02:12:25.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.440+0000 7f0b0e948640 1 -- 172.21.15.134:0/2896421138 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b0801f070 con 0x7f0af8039020 2024-04-24T02:12:25.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.440+0000 7f0b0e948640 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b137dfd0d0 con 0x55b137dfa610 2024-04-24T02:12:25.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.440+0000 7f0b07fff640 1 -- 172.21.15.134:0/2896421138 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0af804e040 con 0x55b137dfa610 2024-04-24T02:12:25.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.440+0000 7f0b07fff640 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b137dfd0d0 con 0x55b137df4500 2024-04-24T02:12:25.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.440+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b0005a040 con 0x55b137df4500 2024-04-24T02:12:25.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.440+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b137dfd0d0 con 0x7f0b08031040 2024-04-24T02:12:25.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.441+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b0005a040 con 0x7f0b08031040 2024-04-24T02:12:25.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.441+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b137dfd0d0 con 0x55b137df4500 2024-04-24T02:12:25.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.441+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b0005a040 con 0x55b137df4500 2024-04-24T02:12:25.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.441+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b137dfd0d0 con 0x7f0af8039020 2024-04-24T02:12:25.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.441+0000 7f0b0e948640 1 -- 172.21.15.134:0/2896421138 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0b0801f070 con 0x7f0af8039020 2024-04-24T02:12:25.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.441+0000 7f0b0e948640 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b137dfd0d0 con 0x55b137dfa610 2024-04-24T02:12:25.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.441+0000 7f0b07fff640 1 -- 172.21.15.134:0/2896421138 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0af804e040 con 0x55b137dfa610 2024-04-24T02:12:25.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.441+0000 7f0b07fff640 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b137dfd0d0 con 0x55b137dfa610 2024-04-24T02:12:25.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.442+0000 7f0b07fff640 1 -- 172.21.15.134:0/2896421138 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0af804e040 con 0x55b137dfa610 2024-04-24T02:12:25.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.442+0000 7f0b07fff640 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b137dfd0d0 con 0x7f0b08031040 2024-04-24T02:12:25.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.442+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b0005a040 con 0x7f0b08031040 2024-04-24T02:12:25.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.442+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b137dfd0d0 con 0x55b137dfa610 2024-04-24T02:12:25.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.442+0000 7f0b07fff640 1 -- 172.21.15.134:0/2896421138 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0af804e040 con 0x55b137dfa610 2024-04-24T02:12:25.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.442+0000 7f0b07fff640 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b137dfd0d0 con 0x55b137dfa610 2024-04-24T02:12:25.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.442+0000 7f0b07fff640 1 -- 172.21.15.134:0/2896421138 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0af804e040 con 0x55b137dfa610 2024-04-24T02:12:25.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.442+0000 7f0b07fff640 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b137dfd0d0 con 0x55b137df4500 2024-04-24T02:12:25.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.443+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b0005a040 con 0x55b137df4500 2024-04-24T02:12:25.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.443+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b137dfd0d0 con 0x55b137df4500 2024-04-24T02:12:25.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.443+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f0b0005a040 con 0x55b137df4500 2024-04-24T02:12:25.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.443+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b137dfd0d0 con 0x7f0b08031040 2024-04-24T02:12:25.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.443+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b0005a040 con 0x7f0b08031040 2024-04-24T02:12:25.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.443+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b137dfd0d0 con 0x55b137dfa610 2024-04-24T02:12:25.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.443+0000 7f0b07fff640 1 -- 172.21.15.134:0/2896421138 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0af804e040 con 0x55b137dfa610 2024-04-24T02:12:25.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.443+0000 7f0b07fff640 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b137dfd0d0 con 0x7f0af8039020 2024-04-24T02:12:25.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.444+0000 7f0b0e948640 1 -- 172.21.15.134:0/2896421138 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b0801f070 con 0x7f0af8039020 2024-04-24T02:12:25.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.444+0000 7f0b0e948640 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b137dfd0d0 con 0x55b137df4500 2024-04-24T02:12:25.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.444+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b0005a040 con 0x55b137df4500 2024-04-24T02:12:25.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.444+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b137dfd0d0 con 0x7f0b08031040 2024-04-24T02:12:25.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.444+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b0005a040 con 0x7f0b08031040 2024-04-24T02:12:25.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.444+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b137dfd0d0 con 0x55b137dfa610 2024-04-24T02:12:25.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.444+0000 7f0b07fff640 1 -- 172.21.15.134:0/2896421138 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0af804e040 con 0x55b137dfa610 2024-04-24T02:12:25.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.444+0000 7f0b07fff640 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b137dfd0d0 con 0x7f0b08031040 2024-04-24T02:12:25.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.445+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b0005a040 con 0x7f0b08031040 2024-04-24T02:12:25.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.445+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b137dfd0d0 con 0x7f0af8039020 2024-04-24T02:12:25.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.445+0000 7f0b0e948640 1 -- 172.21.15.134:0/2896421138 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b0801f070 con 0x7f0af8039020 2024-04-24T02:12:25.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.445+0000 7f0b0e948640 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b137dfd0d0 con 0x55b137dfa610 2024-04-24T02:12:25.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.445+0000 7f0b07fff640 1 -- 172.21.15.134:0/2896421138 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0af804e040 con 0x55b137dfa610 2024-04-24T02:12:25.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.445+0000 7f0b07fff640 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b137dfd0d0 con 0x7f0b08031040 2024-04-24T02:12:25.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.445+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b0005a040 con 0x7f0b08031040 2024-04-24T02:12:25.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.445+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b137dfd0d0 con 0x55b137df4500 2024-04-24T02:12:25.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.446+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0b0005a040 con 0x55b137df4500 2024-04-24T02:12:25.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.446+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b137dfd0d0 con 0x7f0af8039020 2024-04-24T02:12:25.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.446+0000 7f0b0e948640 1 -- 172.21.15.134:0/2896421138 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b0801f070 con 0x7f0af8039020 2024-04-24T02:12:25.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.446+0000 7f0b12a13800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:25.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.446+0000 7f0b12a13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:25.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.446+0000 7f0b12a13800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:25.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.446+0000 7f0b12a13800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:25.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.446+0000 7f0b12a13800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:25.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.446+0000 7f0b12a13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:25.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.446+0000 7f0b12a13800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.446+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b137df9060 con 0x55b137df4500 2024-04-24T02:12:25.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.446+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b0005a040 con 0x55b137df4500 2024-04-24T02:12:25.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.446+0000 7f0b12a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:25.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.446+0000 7f0b12a13800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.446+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b137df9900 con 0x55b137df4500 2024-04-24T02:12:25.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.446+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0b0005a040 con 0x55b137df4500 2024-04-24T02:12:25.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.446+0000 7f0b12a13800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:25.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.446+0000 7f0b12a13800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.446+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b137df8ca0 con 0x55b137df4500 2024-04-24T02:12:25.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.446+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0b0005a040 con 0x55b137df4500 2024-04-24T02:12:25.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.447+0000 7f0b12a13800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:25.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.447+0000 7f0b12a13800 20 zone default found 2024-04-24T02:12:25.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.447+0000 7f0b12a13800 4 Realm: () 2024-04-24T02:12:25.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.447+0000 7f0b12a13800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:25.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.447+0000 7f0b12a13800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:25.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.447+0000 7f0b12a13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:25.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.447+0000 7f0b12a13800 20 zonegroup default 2024-04-24T02:12:25.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.447+0000 7f0b12a13800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.447+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b137df9900 con 0x7f0b08031040 2024-04-24T02:12:25.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.447+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0b0005a040 con 0x7f0b08031040 2024-04-24T02:12:25.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.447+0000 7f0b12a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:25.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.447+0000 7f0b12a13800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.447+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b137dfef30 con 0x55b137dfa610 2024-04-24T02:12:25.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.447+0000 7f0b07fff640 1 -- 172.21.15.134:0/2896421138 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0af804e040 con 0x55b137dfa610 2024-04-24T02:12:25.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.447+0000 7f0b12a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:25.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.447+0000 7f0b12a13800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.447+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b137dff2d0 con 0x55b137dfa610 2024-04-24T02:12:25.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.448+0000 7f0b07fff640 1 -- 172.21.15.134:0/2896421138 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0af804e040 con 0x55b137dfa610 2024-04-24T02:12:25.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.448+0000 7f0b12a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:25.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.448+0000 7f0b12a13800 20 started sync module instance, tier type = 2024-04-24T02:12:25.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.448+0000 7f0b12a13800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:25.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.448+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b137dfe3d0 con 0x7f0af8039020 2024-04-24T02:12:25.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.449+0000 7f0b0e948640 1 -- 172.21.15.134:0/2896421138 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b08040040 con 0x7f0af8039020 2024-04-24T02:12:25.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.449+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94219634993136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b137dfe030 con 0x7f0af8039020 2024-04-24T02:12:25.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.449+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b137e00140 con 0x55b137df4500 2024-04-24T02:12:25.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.450+0000 7f0b0e948640 1 -- 172.21.15.134:0/2896421138 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94219634993136] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b08040040 con 0x7f0af8039020 2024-04-24T02:12:25.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.450+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b0005a040 con 0x55b137df4500 2024-04-24T02:12:25.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.450+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94219634996848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b137e00140 con 0x55b137df4500 2024-04-24T02:12:25.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.450+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b137e00b80 con 0x55b137dfa610 2024-04-24T02:12:25.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.451+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94219634996848] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b0005a040 con 0x55b137df4500 2024-04-24T02:12:25.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.451+0000 7f0b07fff640 1 -- 172.21.15.134:0/2896421138 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0af804e040 con 0x55b137dfa610 2024-04-24T02:12:25.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.451+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94219634998416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b137e000b0 con 0x55b137dfa610 2024-04-24T02:12:25.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.451+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b137e01a40 con 0x7f0af8039020 2024-04-24T02:12:25.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.452+0000 7f0b0e948640 1 -- 172.21.15.134:0/2896421138 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b08040040 con 0x7f0af8039020 2024-04-24T02:12:25.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.452+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94219635005296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b137e02220 con 0x7f0af8039020 2024-04-24T02:12:25.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.452+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b137e02d40 con 0x55b137df4500 2024-04-24T02:12:25.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.452+0000 7f0b07fff640 1 -- 172.21.15.134:0/2896421138 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94219634998416] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0af804e040 con 0x55b137dfa610 2024-04-24T02:12:25.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.453+0000 7f0b0e948640 1 -- 172.21.15.134:0/2896421138 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94219635005296] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b08040040 con 0x7f0af8039020 2024-04-24T02:12:25.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.453+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b0005a040 con 0x55b137df4500 2024-04-24T02:12:25.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.453+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94219635009552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b137e02d00 con 0x55b137df4500 2024-04-24T02:12:25.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.453+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b137e035e0 con 0x7f0b08031040 2024-04-24T02:12:25.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.454+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94219635009552] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b0005a040 con 0x55b137df4500 2024-04-24T02:12:25.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.454+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b0005a040 con 0x7f0b08031040 2024-04-24T02:12:25.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.454+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94219635003248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b137e02d00 con 0x7f0b08031040 2024-04-24T02:12:25.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.454+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b137e03c10 con 0x7f0b08031040 2024-04-24T02:12:25.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.455+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(56 notify.6 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b0005a040 con 0x7f0b08031040 2024-04-24T02:12:25.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.455+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94219635013376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b137e04080 con 0x7f0b08031040 2024-04-24T02:12:25.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.455+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b137e04b60 con 0x7f0b08031040 2024-04-24T02:12:25.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.456+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94219635003248] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b0005a040 con 0x7f0b08031040 2024-04-24T02:12:25.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.456+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(58 notify.7 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b0005a040 con 0x7f0b08031040 2024-04-24T02:12:25.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.456+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94219635017328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b137e04b60 con 0x7f0b08031040 2024-04-24T02:12:25.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.456+0000 7f0b12a13800 20 add_watcher() i=0 2024-04-24T02:12:25.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.456+0000 7f0b12a13800 20 add_watcher() i=1 2024-04-24T02:12:25.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.456+0000 7f0b12a13800 20 add_watcher() i=2 2024-04-24T02:12:25.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.456+0000 7f0b12a13800 20 add_watcher() i=3 2024-04-24T02:12:25.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.456+0000 7f0b12a13800 20 add_watcher() i=4 2024-04-24T02:12:25.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.456+0000 7f0b12a13800 20 add_watcher() i=5 2024-04-24T02:12:25.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.456+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94219635013376] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b0005a040 con 0x7f0b08031040 2024-04-24T02:12:25.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.456+0000 7f0b12a13800 20 add_watcher() i=6 2024-04-24T02:12:25.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.457+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94219635017328] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b0005a040 con 0x7f0b08031040 2024-04-24T02:12:25.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.457+0000 7f0b12a13800 20 add_watcher() i=7 2024-04-24T02:12:25.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.457+0000 7f0b12a13800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:25.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.457+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b137e03bd0 con 0x55b137df4500 2024-04-24T02:12:25.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.458+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0b0005a040 con 0x55b137df4500 2024-04-24T02:12:25.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.458+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94219635014608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b137e04fa0 con 0x55b137df4500 2024-04-24T02:12:25.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.459+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94219635014608] v30'103 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0b0005a040 con 0x55b137df4500 2024-04-24T02:12:25.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.459+0000 7f09c4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:25.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.459+0000 7f0b12a13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:25.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.459+0000 7f0b12a13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:25.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.459+0000 7f0b12a13800 5 note: GC not initialized 2024-04-24T02:12:25.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.459+0000 7f093f7fe640 20 reqs_thread_entry: start 2024-04-24T02:12:25.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.459+0000 7f0b12a13800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:25.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.459+0000 7f0b12a13800 20 Filter name: none 2024-04-24T02:12:25.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.459+0000 7f093d7fa640 20 reqs_thread_entry: start 2024-04-24T02:12:25.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.459+0000 7f0b12a13800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.459+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b137e3ae10 con 0x7f0af8039020 2024-04-24T02:12:25.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.460+0000 7f0b0e948640 1 -- 172.21.15.134:0/2896421138 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f0b08040040 con 0x7f0af8039020 2024-04-24T02:12:25.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.460+0000 7f0b12a13800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T02:12:25.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.460+0000 7f0b12a13800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.460+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:63 8.1d 8:be2d2b4a:root::.bucket.meta.myfoo%3a582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b137e3b6a0 con 0x7f0b08031040 2024-04-24T02:12:25.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.460+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(63 .bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f0b0005a040 con 0x7f0b08031040 2024-04-24T02:12:25.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.460+0000 7f0b12a13800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T02:12:25.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.460+0000 7f0b12a13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-24T02:12:25.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.460+0000 7f0b12a13800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.460+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b137e3a1b0 con 0x7f0af8039020 2024-04-24T02:12:25.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.461+0000 7f0b0e948640 1 -- 172.21.15.134:0/2896421138 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f0b08040040 con 0x7f0af8039020 2024-04-24T02:12:25.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.461+0000 7f0b12a13800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T02:12:25.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.461+0000 7f0b12a13800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.461+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:65 8.1d 8:be2d2b4a:root::.bucket.meta.myfoo%3a582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b137e3cd00 con 0x7f0b08031040 2024-04-24T02:12:25.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.461+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(65 .bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f0b0005a040 con 0x7f0b08031040 2024-04-24T02:12:25.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.461+0000 7f0b12a13800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T02:12:25.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.461+0000 7f0b12a13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-24T02:12:25.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.461+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:66 4.2f 4:f4626d03:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b137e3e5f0 con 0x55b137df4500 2024-04-24T02:12:25.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.461+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:67 4.2f 4:f41e46b8:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b137e40ee0 con 0x55b137df4500 2024-04-24T02:12:25.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.461+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:68 4.39 4:9e407d1f:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b137e43ae0 con 0x55b137dfa610 2024-04-24T02:12:25.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.461+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:69 4.3 4:c3c22538:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b137e464c0 con 0x55b137df4500 2024-04-24T02:12:25.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.461+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:70 4.b 4:d224abc6:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b137e49230 con 0x7f0af8039020 2024-04-24T02:12:25.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.461+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:71 4.e 4:706a3c35:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b137e464c0 con 0x7f0af8039020 2024-04-24T02:12:25.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.461+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:72 4.0 4:009d6733:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b137e4e550 con 0x55b137dfa610 2024-04-24T02:12:25.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.461+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:73 4.39 4:9c24c7ad:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b137e50f40 con 0x55b137dfa610 2024-04-24T02:12:25.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.461+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:74 4.35 4:aece7739:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b137e53e00 con 0x55b137df4500 2024-04-24T02:12:25.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.462+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:75 4.24 4:2482d015:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b137e56960 con 0x7f0b08031040 2024-04-24T02:12:25.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.462+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:76 4.0 4:03cc5f7d:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b137e595a0 con 0x55b137dfa610 2024-04-24T02:12:25.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.462+0000 7f0b0e948640 1 -- 172.21.15.134:0/2896421138 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(70 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0b08040040 con 0x7f0af8039020 2024-04-24T02:12:25.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.462+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(66 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0b0005a040 con 0x55b137df4500 2024-04-24T02:12:25.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.462+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(69 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0b0005a040 con 0x55b137df4500 2024-04-24T02:12:25.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.462+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(67 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.1 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0b0005a040 con 0x55b137df4500 2024-04-24T02:12:25.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.462+0000 7f0b0e948640 1 -- 172.21.15.134:0/2896421138 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(71 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0b08040040 con 0x7f0af8039020 2024-04-24T02:12:25.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.462+0000 7f0b07fff640 1 -- 172.21.15.134:0/2896421138 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(68 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0af804e040 con 0x55b137dfa610 2024-04-24T02:12:25.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.462+0000 7f0b07fff640 1 -- 172.21.15.134:0/2896421138 <== osd.3 v2:172.21.15.134:6801/3585115521 15 ==== osd_op_reply(72 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0af804e040 con 0x55b137dfa610 2024-04-24T02:12:25.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.462+0000 7f0b07fff640 1 -- 172.21.15.134:0/2896421138 <== osd.3 v2:172.21.15.134:6801/3585115521 16 ==== osd_op_reply(73 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0af804e040 con 0x55b137dfa610 2024-04-24T02:12:25.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.462+0000 7f0b07fff640 1 -- 172.21.15.134:0/2896421138 <== osd.3 v2:172.21.15.134:6801/3585115521 17 ==== osd_op_reply(76 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.10 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f0af804e040 con 0x55b137dfa610 2024-04-24T02:12:25.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.462+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(74 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0b000ac060 con 0x55b137df4500 2024-04-24T02:12:25.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.462+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(75 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0b000ac060 con 0x7f0b08031040 2024-04-24T02:12:25.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.463+0000 7f09c4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:25.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.463+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94219635014608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b137e595a0 con 0x55b137df4500 2024-04-24T02:12:25.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.464+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94219635014608] v30'104 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0b000ac060 con 0x55b137df4500 2024-04-24T02:12:25.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.464+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94219634993136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b137e23550 con 0x7f0af8039020 2024-04-24T02:12:25.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.465+0000 7f0b0e948640 1 -- 172.21.15.134:0/2896421138 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94219634993136] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b08040040 con 0x7f0af8039020 2024-04-24T02:12:25.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.465+0000 7f0b12a13800 20 remove_watcher() i=0 2024-04-24T02:12:25.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.465+0000 7f0b12a13800 2 removed watcher, disabling cache 2024-04-24T02:12:25.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.465+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94219634996848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b137e23550 con 0x55b137df4500 2024-04-24T02:12:25.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.466+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94219634996848] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b000ac060 con 0x55b137df4500 2024-04-24T02:12:25.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.466+0000 7f0b12a13800 20 remove_watcher() i=1 2024-04-24T02:12:25.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.466+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94219634998416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b137e23550 con 0x55b137dfa610 2024-04-24T02:12:25.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.467+0000 7f0b07fff640 1 -- 172.21.15.134:0/2896421138 <== osd.3 v2:172.21.15.134:6801/3585115521 18 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94219634998416] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0af804e040 con 0x55b137dfa610 2024-04-24T02:12:25.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.467+0000 7f0b12a13800 20 remove_watcher() i=2 2024-04-24T02:12:25.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.467+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94219635005296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b137e23550 con 0x7f0af8039020 2024-04-24T02:12:25.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.468+0000 7f0b0e948640 1 -- 172.21.15.134:0/2896421138 <== osd.2 v2:172.21.15.134:6800/214480313 16 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94219635005296] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b08040040 con 0x7f0af8039020 2024-04-24T02:12:25.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.468+0000 7f0b12a13800 20 remove_watcher() i=3 2024-04-24T02:12:25.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.468+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94219635009552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b137e23550 con 0x55b137df4500 2024-04-24T02:12:25.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.469+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94219635009552] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b000ac060 con 0x55b137df4500 2024-04-24T02:12:25.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.469+0000 7f0b12a13800 20 remove_watcher() i=4 2024-04-24T02:12:25.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.469+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94219635003248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b137e23550 con 0x7f0b08031040 2024-04-24T02:12:25.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.470+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.0 v2:172.21.15.104:6800/2419146313 20 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94219635003248] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b000ac060 con 0x7f0b08031040 2024-04-24T02:12:25.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.470+0000 7f0b12a13800 20 remove_watcher() i=5 2024-04-24T02:12:25.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.470+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94219635013376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b137e23550 con 0x7f0b08031040 2024-04-24T02:12:25.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.471+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.0 v2:172.21.15.104:6800/2419146313 21 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94219635013376] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b000ac060 con 0x7f0b08031040 2024-04-24T02:12:25.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.471+0000 7f0b12a13800 20 remove_watcher() i=6 2024-04-24T02:12:25.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.471+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94219635017328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b137e23550 con 0x7f0b08031040 2024-04-24T02:12:25.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.472+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 <== osd.0 v2:172.21.15.104:6800/2419146313 22 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94219635017328] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b000ac060 con 0x7f0b08031040 2024-04-24T02:12:25.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.472+0000 7f0b12a13800 20 remove_watcher() i=7 2024-04-24T02:12:25.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.472+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f0b08031040 msgr2=0x7f0b08032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.472+0000 7f0b12a13800 1 --2- 172.21.15.134:0/2896421138 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f0b08031040 0x7f0b08032940 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.472+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b137df4500 msgr2=0x55b137df6990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.472+0000 7f0b12a13800 1 --2- 172.21.15.134:0/2896421138 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b137df4500 0x55b137df6990 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.472+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f0af8039020 msgr2=0x7f0af80512f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.472+0000 7f0b12a13800 1 --2- 172.21.15.134:0/2896421138 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f0af8039020 0x7f0af80512f0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.472+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55b137dfa610 msgr2=0x55b137dfca00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.472+0000 7f0b12a13800 1 --2- 172.21.15.134:0/2896421138 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55b137dfa610 0x55b137dfca00 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.472+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f09d8036900 msgr2=0x7f09d8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.472+0000 7f0b12a13800 1 --2- 172.21.15.134:0/2896421138 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f09d8036900 0x7f09d8038dc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x55b137dc0590 tx=0x7f0b0801f000 comp rx=0 tx=0).stop 2024-04-24T02:12:25.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.472+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b137de1590 msgr2=0x55b137de8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.472+0000 7f0b12a13800 1 --2- 172.21.15.134:0/2896421138 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b137de1590 0x55b137de8c20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f0af800dcc0 tx=0x7f0af804ce20 comp rx=0 tx=0).stop 2024-04-24T02:12:25.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.472+0000 7f0b0e147640 1 -- 172.21.15.134:0/2896421138 reap_dead start 2024-04-24T02:12:25.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.473+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 shutdown_connections 2024-04-24T02:12:25.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.473+0000 7f0b12a13800 1 --2- 172.21.15.134:0/2896421138 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b137de1590 0x55b137de8c20 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.473+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 >> 172.21.15.134:0/2896421138 conn(0x55b137ddd8b0 msgr2=0x55b137ddaf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:25.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.473+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 shutdown_connections 2024-04-24T02:12:25.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.473+0000 7f0b12a13800 1 -- 172.21.15.134:0/2896421138 wait complete. 2024-04-24T02:12:25.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.473+0000 7f0b12a13800 1 -- 172.21.15.134:0/544988898 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f09e8036900 msgr2=0x7f09e8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.473+0000 7f0b12a13800 1 --2- 172.21.15.134:0/544988898 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f09e8036900 0x7f09e8038dc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x55b137dc4250 tx=0x7f0b08005840 comp rx=0 tx=0).stop 2024-04-24T02:12:25.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.473+0000 7f0b12a13800 1 -- 172.21.15.134:0/544988898 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b137dd4210 msgr2=0x55b137dd4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.473+0000 7f0b12a13800 1 --2- 172.21.15.134:0/544988898 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b137dd4210 0x55b137dd4630 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0af8001ed0 tx=0x7f0af800d7a0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.473+0000 7f0b12a13800 1 -- 172.21.15.134:0/544988898 shutdown_connections 2024-04-24T02:12:25.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.473+0000 7f0b12a13800 1 --2- 172.21.15.134:0/544988898 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f09e8036900 0x7f09e8038dc0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.473+0000 7f0b12a13800 1 --2- 172.21.15.134:0/544988898 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b137dd4210 0x55b137dd4630 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.473+0000 7f0b12a13800 1 -- 172.21.15.134:0/544988898 >> 172.21.15.134:0/544988898 conn(0x55b137dc82b0 msgr2=0x55b137dc86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:25.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.473+0000 7f0b12a13800 1 -- 172.21.15.134:0/544988898 shutdown_connections 2024-04-24T02:12:25.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.473+0000 7f0b12a13800 1 -- 172.21.15.134:0/544988898 wait complete. 2024-04-24T02:12:25.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.473+0000 7f0b12a13800 1 -- 172.21.15.134:0/2011055997 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b137cc00e0 msgr2=0x55b137dc3070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.473+0000 7f0b12a13800 1 --2- 172.21.15.134:0/2011055997 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b137cc00e0 0x55b137dc3070 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.473+0000 7f0b12a13800 1 -- 172.21.15.134:0/2011055997 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f09f4036900 msgr2=0x7f09f4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.473+0000 7f0b12a13800 1 --2- 172.21.15.134:0/2011055997 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f09f4036900 0x7f09f4038dc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0af8000f60 tx=0x7f0af80012b0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.473+0000 7f0b12a13800 1 -- 172.21.15.134:0/2011055997 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b137cbf780 msgr2=0x55b137dbbed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.473+0000 7f0b12a13800 1 --2- 172.21.15.134:0/2011055997 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b137cbf780 0x55b137dbbed0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0b00005870 tx=0x7f0b00002fb0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.473+0000 7f0b12a13800 1 -- 172.21.15.134:0/2011055997 shutdown_connections 2024-04-24T02:12:25.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.473+0000 7f0b12a13800 1 --2- 172.21.15.134:0/2011055997 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b137cc00e0 0x55b137dc3070 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.473+0000 7f0b12a13800 1 --2- 172.21.15.134:0/2011055997 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f09f4036900 0x7f09f4038dc0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.473+0000 7f0b12a13800 1 --2- 172.21.15.134:0/2011055997 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b137cbf780 0x55b137dbbed0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.473+0000 7f0b12a13800 1 -- 172.21.15.134:0/2011055997 >> 172.21.15.134:0/2011055997 conn(0x55b137cbb320 msgr2=0x55b137dae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:25.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.474+0000 7f0b12a13800 1 -- 172.21.15.134:0/2011055997 shutdown_connections 2024-04-24T02:12:25.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.474+0000 7f0b12a13800 1 -- 172.21.15.134:0/2011055997 wait complete. 2024-04-24T02:12:25.497 INFO:teuthology.orchestra.run.smithi134.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"b893fd8a-cafc-4918-98fa-f8aa8e20a508","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1","marker":"582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-04-24T02:12:24.905198Z","creation_time":"2024-04-24T02:12:24.901996Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-04-24T02:12:25.497 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'b893fd8a-cafc-4918-98fa-f8aa8e20a508', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1', 'marker': '582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-24T02:12:24.905198Z', 'creation_time': '2024-04-24T02:12:24.901996Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-04-24T02:12:25.497 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-04-24T02:12:25.498 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-04-24T02:12:25.498 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-04-24T02:12:25.580 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:25.580 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:25.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.579+0000 7f904e087800 1 Processor -- start 2024-04-24T02:12:25.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.579+0000 7f904e087800 1 -- start start 2024-04-24T02:12:25.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.580+0000 7f904e087800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x563485171760 0x563485171b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.580+0000 7f904e087800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563485031d40 con 0x5634851720c0 2024-04-24T02:12:25.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.580+0000 7f904e087800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x5634850044d0 con 0x563485171760 2024-04-24T02:12:25.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.580+0000 7f904bb86640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x563485171760 0x563485171b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.580+0000 7f904bb86640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x563485171760 0x563485171b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55738/0 (socket says 172.21.15.134:55738) 2024-04-24T02:12:25.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.580+0000 7f904bb86640 1 -- 172.21.15.134:0/2627836746 learned_addr learned my addr 172.21.15.134:0/2627836746 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:25.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.580+0000 7f904bb86640 1 -- 172.21.15.134:0/2627836746 >> v1:172.21.15.104:6789/0 conn(0x5634851720c0 legacy=0x563485172570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.580+0000 7f904bb86640 1 -- 172.21.15.134:0/2627836746 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563485030590 con 0x563485171760 2024-04-24T02:12:25.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.582+0000 7f904bb86640 1 --2- 172.21.15.134:0/2627836746 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563485171760 0x563485171b80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f903c00a520 tx=0x7f903c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6847841abd47725e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.582+0000 7f904ab84640 1 -- 172.21.15.134:0/2627836746 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f903c057070 con 0x563485171760 2024-04-24T02:12:25.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.582+0000 7f904ab84640 1 -- 172.21.15.134:0/2627836746 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f903c052570 con 0x563485171760 2024-04-24T02:12:25.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.582+0000 7f904ab84640 1 -- 172.21.15.134:0/2627836746 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f903c052870 con 0x563485171760 2024-04-24T02:12:25.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.583+0000 7f904e087800 1 -- 172.21.15.134:0/2627836746 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563485171760 msgr2=0x563485171b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.583+0000 7f904e087800 1 --2- 172.21.15.134:0/2627836746 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563485171760 0x563485171b80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f903c00a520 tx=0x7f903c01d010 comp rx=0 tx=0).stop 2024-04-24T02:12:25.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.583+0000 7f904e087800 1 -- 172.21.15.134:0/2627836746 shutdown_connections 2024-04-24T02:12:25.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.583+0000 7f904e087800 1 --2- 172.21.15.134:0/2627836746 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563485171760 0x563485171b80 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.583+0000 7f904e087800 1 -- 172.21.15.134:0/2627836746 >> 172.21.15.134:0/2627836746 conn(0x56348516d380 msgr2=0x56348516f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:25.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.583+0000 7f904e087800 1 -- 172.21.15.134:0/2627836746 shutdown_connections 2024-04-24T02:12:25.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.583+0000 7f904e087800 1 -- 172.21.15.134:0/2627836746 wait complete. 2024-04-24T02:12:25.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.594+0000 7f904e087800 1 Processor -- start 2024-04-24T02:12:25.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.594+0000 7f904e087800 1 -- start start 2024-04-24T02:12:25.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.594+0000 7f904e087800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563485171760 0x563485266370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.594+0000 7f904e087800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5634850be3c0 con 0x563485171760 2024-04-24T02:12:25.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.595+0000 7f904bb86640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563485171760 0x563485266370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.595+0000 7f904bb86640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563485171760 0x563485266370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55742/0 (socket says 172.21.15.134:55742) 2024-04-24T02:12:25.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.595+0000 7f904bb86640 1 -- 172.21.15.134:0/1344468760 learned_addr learned my addr 172.21.15.134:0/1344468760 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:25.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.595+0000 7f904bb86640 1 -- 172.21.15.134:0/1344468760 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563485266940 con 0x563485171760 2024-04-24T02:12:25.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.595+0000 7f904bb86640 1 --2- 172.21.15.134:0/1344468760 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563485171760 0x563485266370 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f903c01d050 tx=0x7f903c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39e32323f6a45315 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.595+0000 7f8f39e0b640 1 -- 172.21.15.134:0/1344468760 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f903c057040 con 0x563485171760 2024-04-24T02:12:25.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.595+0000 7f8f39e0b640 1 -- 172.21.15.134:0/1344468760 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f903c052850 con 0x563485171760 2024-04-24T02:12:25.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.595+0000 7f8f39e0b640 1 -- 172.21.15.134:0/1344468760 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f903c052b70 con 0x563485171760 2024-04-24T02:12:25.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.596+0000 7f904e087800 1 -- 172.21.15.134:0/1344468760 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563485171760 msgr2=0x563485266370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.596+0000 7f904e087800 1 --2- 172.21.15.134:0/1344468760 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563485171760 0x563485266370 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f903c01d050 tx=0x7f903c04c000 comp rx=0 tx=0).stop 2024-04-24T02:12:25.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.596+0000 7f904e087800 1 -- 172.21.15.134:0/1344468760 shutdown_connections 2024-04-24T02:12:25.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.596+0000 7f904e087800 1 --2- 172.21.15.134:0/1344468760 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563485171760 0x563485266370 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.596+0000 7f904e087800 1 -- 172.21.15.134:0/1344468760 >> 172.21.15.134:0/1344468760 conn(0x56348516d380 msgr2=0x563485261c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:25.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.596+0000 7f904e087800 1 -- 172.21.15.134:0/1344468760 shutdown_connections 2024-04-24T02:12:25.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.596+0000 7f904e087800 1 -- 172.21.15.134:0/1344468760 wait complete. 2024-04-24T02:12:25.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.596+0000 7f904e087800 1 Processor -- start 2024-04-24T02:12:25.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.596+0000 7f904e087800 1 -- start start 2024-04-24T02:12:25.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.597+0000 7f904e087800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563485171760 0x56348526de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.597+0000 7f904e087800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x563485172f20 con 0x563485171760 2024-04-24T02:12:25.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.597+0000 7f904bb86640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563485171760 0x56348526de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.597+0000 7f904bb86640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563485171760 0x56348526de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55750/0 (socket says 172.21.15.134:55750) 2024-04-24T02:12:25.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.597+0000 7f904bb86640 1 -- 172.21.15.134:0/578313612 learned_addr learned my addr 172.21.15.134:0/578313612 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:25.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.597+0000 7f904bb86640 1 -- 172.21.15.134:0/578313612 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56348526e3a0 con 0x563485171760 2024-04-24T02:12:25.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.597+0000 7f904bb86640 1 --2- 172.21.15.134:0/578313612 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563485171760 0x56348526de60 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f903c01cfe0 tx=0x7f903c003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.597+0000 7f8f33fff640 1 -- 172.21.15.134:0/578313612 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f903c073070 con 0x563485171760 2024-04-24T02:12:25.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.597+0000 7f8f33fff640 1 -- 172.21.15.134:0/578313612 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f903c05d650 con 0x563485171760 2024-04-24T02:12:25.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.597+0000 7f8f33fff640 1 -- 172.21.15.134:0/578313612 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f903c057070 con 0x563485171760 2024-04-24T02:12:25.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.597+0000 7f904e087800 1 -- 172.21.15.134:0/578313612 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56348526e630 con 0x563485171760 2024-04-24T02:12:25.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.597+0000 7f904e087800 1 -- 172.21.15.134:0/578313612 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563485271290 con 0x563485171760 2024-04-24T02:12:25.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.598+0000 7f8f33fff640 1 -- 172.21.15.134:0/578313612 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f903c076070 con 0x563485171760 2024-04-24T02:12:25.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.598+0000 7f8f33fff640 1 --2- 172.21.15.134:0/578313612 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8f34036900 0x7f8f34038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.598+0000 7f8f33fff640 1 -- 172.21.15.134:0/578313612 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f903c08de40 con 0x563485171760 2024-04-24T02:12:25.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.598+0000 7f904b385640 1 --2- 172.21.15.134:0/578313612 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8f34036900 0x7f8f34038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.598+0000 7f904e087800 1 --2- 172.21.15.134:0/578313612 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5634851720c0 0x563485275050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.598+0000 7f904e087800 1 -- 172.21.15.134:0/578313612 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563485275590 con 0x5634851720c0 2024-04-24T02:12:25.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.599+0000 7f904c387640 1 --2- 172.21.15.134:0/578313612 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5634851720c0 0x563485275050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.599+0000 7f904b385640 1 --2- 172.21.15.134:0/578313612 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8f34036900 0x7f8f34038dc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9040001e10 tx=0x7f9040001390 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.599+0000 7f904c387640 1 --2- 172.21.15.134:0/578313612 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5634851720c0 0x563485275050 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.599+0000 7f904c387640 1 -- 172.21.15.134:0/578313612 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f904400a4a0 con 0x5634851720c0 2024-04-24T02:12:25.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.599+0000 7f904e087800 1 -- 172.21.15.134:0/578313612 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563485275e50 con 0x5634851720c0 2024-04-24T02:12:25.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.599+0000 7f904c387640 1 -- 172.21.15.134:0/578313612 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f904400a4a0 con 0x5634851720c0 2024-04-24T02:12:25.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.599+0000 7f904e087800 1 -- 172.21.15.134:0/578313612 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563485277200 con 0x5634851720c0 2024-04-24T02:12:25.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.600+0000 7f904c387640 1 -- 172.21.15.134:0/578313612 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f904400a4a0 con 0x5634851720c0 2024-04-24T02:12:25.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.600+0000 7f904e087800 1 -- 172.21.15.134:0/578313612 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634852766a0 con 0x5634851720c0 2024-04-24T02:12:25.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.600+0000 7f904c387640 1 -- 172.21.15.134:0/578313612 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f904400a4a0 con 0x5634851720c0 2024-04-24T02:12:25.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.600+0000 7f904e087800 1 -- 172.21.15.134:0/578313612 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563485276ac0 con 0x5634851720c0 2024-04-24T02:12:25.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.600+0000 7f904c387640 1 -- 172.21.15.134:0/578313612 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f904400a4a0 con 0x5634851720c0 2024-04-24T02:12:25.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.601+0000 7f904e087800 1 Processor -- start 2024-04-24T02:12:25.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.601+0000 7f904e087800 1 -- start start 2024-04-24T02:12:25.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.601+0000 7f904e087800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5634852861e0 0x563485286600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.601+0000 7f904e087800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5634850646b0 con 0x5634852861e0 2024-04-24T02:12:25.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.601+0000 7f904b385640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5634852861e0 0x563485286600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.601+0000 7f904b385640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5634852861e0 0x563485286600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55766/0 (socket says 172.21.15.134:55766) 2024-04-24T02:12:25.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.601+0000 7f904b385640 1 -- 172.21.15.134:0/1349023412 learned_addr learned my addr 172.21.15.134:0/1349023412 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:25.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.601+0000 7f904b385640 1 -- 172.21.15.134:0/1349023412 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563485286b40 con 0x5634852861e0 2024-04-24T02:12:25.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.601+0000 7f904b385640 1 --2- 172.21.15.134:0/1349023412 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5634852861e0 0x563485286600 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9040001770 tx=0x7f904000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.602+0000 7f8f317fa640 1 -- 172.21.15.134:0/1349023412 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f904001c410 con 0x5634852861e0 2024-04-24T02:12:25.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.602+0000 7f8f317fa640 1 -- 172.21.15.134:0/1349023412 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9040017050 con 0x5634852861e0 2024-04-24T02:12:25.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.602+0000 7f904e087800 1 -- 172.21.15.134:0/1349023412 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5634852875b0 con 0x5634852861e0 2024-04-24T02:12:25.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.602+0000 7f8f317fa640 1 -- 172.21.15.134:0/1349023412 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f904001c6e0 con 0x5634852861e0 2024-04-24T02:12:25.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.602+0000 7f904e087800 1 -- 172.21.15.134:0/1349023412 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563485287ab0 con 0x5634852861e0 2024-04-24T02:12:25.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.602+0000 7f8f317fa640 1 -- 172.21.15.134:0/1349023412 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f904000e070 con 0x5634852861e0 2024-04-24T02:12:25.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.603+0000 7f8f317fa640 1 --2- 172.21.15.134:0/1349023412 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8f24036900 0x7f8f24038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.603+0000 7f8f317fa640 1 -- 172.21.15.134:0/1349023412 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f904004de80 con 0x5634852861e0 2024-04-24T02:12:25.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.603+0000 7f904c387640 1 --2- 172.21.15.134:0/1349023412 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8f24036900 0x7f8f24038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.603+0000 7f904e087800 1 Processor -- start 2024-04-24T02:12:25.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.603+0000 7f904c387640 1 --2- 172.21.15.134:0/1349023412 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8f24036900 0x7f8f24038dc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x563485276a40 tx=0x7f9044005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.603+0000 7f904e087800 1 -- start start 2024-04-24T02:12:25.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.603+0000 7f904e087800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563485293580 0x5634852939a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.603+0000 7f904e087800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x563485266c00 con 0x563485293580 2024-04-24T02:12:25.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.603+0000 7f904b385640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563485293580 0x5634852939a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.603+0000 7f904b385640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563485293580 0x5634852939a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55772/0 (socket says 172.21.15.134:55772) 2024-04-24T02:12:25.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.603+0000 7f904b385640 1 -- 172.21.15.134:0/776728544 learned_addr learned my addr 172.21.15.134:0/776728544 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:25.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.604+0000 7f904b385640 1 -- 172.21.15.134:0/776728544 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563485293f70 con 0x563485293580 2024-04-24T02:12:25.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.604+0000 7f904b385640 1 --2- 172.21.15.134:0/776728544 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563485293580 0x5634852939a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f904001afd0 tx=0x7f904001ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b62b3ce548abd2e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.604+0000 7f8f2affd640 1 -- 172.21.15.134:0/776728544 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9040040070 con 0x563485293580 2024-04-24T02:12:25.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.604+0000 7f8f2affd640 1 -- 172.21.15.134:0/776728544 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9040002e50 con 0x563485293580 2024-04-24T02:12:25.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.604+0000 7f8f2affd640 1 -- 172.21.15.134:0/776728544 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9040024c10 con 0x563485293580 2024-04-24T02:12:25.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.604+0000 7f904e087800 1 -- 172.21.15.134:0/776728544 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563485293580 msgr2=0x5634852939a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.604+0000 7f904e087800 1 --2- 172.21.15.134:0/776728544 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563485293580 0x5634852939a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f904001afd0 tx=0x7f904001ac60 comp rx=0 tx=0).stop 2024-04-24T02:12:25.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.604+0000 7f904e087800 1 -- 172.21.15.134:0/776728544 shutdown_connections 2024-04-24T02:12:25.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.604+0000 7f904e087800 1 --2- 172.21.15.134:0/776728544 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563485293580 0x5634852939a0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.604+0000 7f904e087800 1 -- 172.21.15.134:0/776728544 >> 172.21.15.134:0/776728544 conn(0x56348528f8e0 msgr2=0x56348528d940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:25.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.604+0000 7f904e087800 1 -- 172.21.15.134:0/776728544 shutdown_connections 2024-04-24T02:12:25.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.604+0000 7f904e087800 1 -- 172.21.15.134:0/776728544 wait complete. 2024-04-24T02:12:25.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.605+0000 7f904e087800 1 Processor -- start 2024-04-24T02:12:25.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.605+0000 7f904e087800 1 -- start start 2024-04-24T02:12:25.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.605+0000 7f904e087800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563485293580 0x56348529abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.605+0000 7f904e087800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5634852946e0 con 0x563485293580 2024-04-24T02:12:25.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.605+0000 7f904b385640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563485293580 0x56348529abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.605+0000 7f904b385640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563485293580 0x56348529abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55780/0 (socket says 172.21.15.134:55780) 2024-04-24T02:12:25.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.605+0000 7f904b385640 1 -- 172.21.15.134:0/2557966177 learned_addr learned my addr 172.21.15.134:0/2557966177 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:25.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.605+0000 7f904b385640 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56348529b120 con 0x563485293580 2024-04-24T02:12:25.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.605+0000 7f904b385640 1 --2- 172.21.15.134:0/2557966177 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563485293580 0x56348529abe0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9040044040 tx=0x7f904004c2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.605+0000 7f8f297fa640 1 -- 172.21.15.134:0/2557966177 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9040046030 con 0x563485293580 2024-04-24T02:12:25.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.605+0000 7f8f297fa640 1 -- 172.21.15.134:0/2557966177 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f904001a310 con 0x563485293580 2024-04-24T02:12:25.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.605+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56348529b3b0 con 0x563485293580 2024-04-24T02:12:25.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.605+0000 7f8f297fa640 1 -- 172.21.15.134:0/2557966177 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f904000ec60 con 0x563485293580 2024-04-24T02:12:25.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.606+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56348529e060 con 0x563485293580 2024-04-24T02:12:25.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.606+0000 7f8f297fa640 1 -- 172.21.15.134:0/2557966177 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f904003b0c0 con 0x563485293580 2024-04-24T02:12:25.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.606+0000 7f8f297fa640 1 --2- 172.21.15.134:0/2557966177 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8f14036900 0x7f8f14038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.606+0000 7f8f297fa640 1 -- 172.21.15.134:0/2557966177 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f9040055ad0 con 0x563485293580 2024-04-24T02:12:25.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.606+0000 7f904c387640 1 --2- 172.21.15.134:0/2557966177 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8f14036900 0x7f8f14038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.607+0000 7f904e087800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.607+0000 7f904e087800 1 --2- 172.21.15.134:0/2557966177 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5634852a6690 0x5634852a8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.607+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634852a92a0 con 0x5634852a6690 2024-04-24T02:12:25.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.607+0000 7f904c387640 1 --2- 172.21.15.134:0/2557966177 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8f14036900 0x7f8f14038dc0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x563485275db0 tx=0x7f904401f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.607+0000 7f904bb86640 1 --2- 172.21.15.134:0/2557966177 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5634852a6690 0x5634852a8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.607+0000 7f904bb86640 1 --2- 172.21.15.134:0/2557966177 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5634852a6690 0x5634852a8b50 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.607+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f903c075030 con 0x5634852a6690 2024-04-24T02:12:25.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.607+0000 7f904e087800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:25.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.607+0000 7f904e087800 20 realm 2024-04-24T02:12:25.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.607+0000 7f904e087800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.607+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634852a96b0 con 0x5634852a6690 2024-04-24T02:12:25.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.608+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f903c075030 con 0x5634852a6690 2024-04-24T02:12:25.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.608+0000 7f904e087800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:25.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.608+0000 7f904e087800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:25.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.608+0000 7f904e087800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.608+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634852a9f80 con 0x5634852a6690 2024-04-24T02:12:25.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.608+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f903c075030 con 0x5634852a6690 2024-04-24T02:12:25.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.608+0000 7f904e087800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:25.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.608+0000 7f904e087800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.608+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634852aa320 con 0x5634852a6690 2024-04-24T02:12:25.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.608+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f903c075030 con 0x5634852a6690 2024-04-24T02:12:25.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.608+0000 7f904e087800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:25.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.608+0000 7f904e087800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.608+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634852aa780 con 0x5634852a6690 2024-04-24T02:12:25.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.608+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f903c075030 con 0x5634852a6690 2024-04-24T02:12:25.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.608+0000 7f904e087800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:25.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.608+0000 7f904e087800 20 searching for the correct realm 2024-04-24T02:12:25.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.608+0000 7f904e087800 1 --2- 172.21.15.134:0/2557966177 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5634852ac770 0x5634852aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.608+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634852af250 con 0x5634852ac770 2024-04-24T02:12:25.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.609+0000 7f904b385640 1 --2- 172.21.15.134:0/2557966177 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5634852ac770 0x5634852aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.609+0000 7f904b385640 1 --2- 172.21.15.134:0/2557966177 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5634852ac770 0x5634852aeb80 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.609+0000 7f904b385640 1 -- 172.21.15.134:0/2557966177 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f904005d040 con 0x5634852ac770 2024-04-24T02:12:25.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.609+0000 7f904b385640 1 --2- 172.21.15.134:0/2557966177 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f904001c030 0x7f904004c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.609+0000 7f904b385640 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634852af250 con 0x7f904001c030 2024-04-24T02:12:25.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.609+0000 7f904c387640 1 --2- 172.21.15.134:0/2557966177 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f904001c030 0x7f904004c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.610+0000 7f904c387640 1 --2- 172.21.15.134:0/2557966177 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f904001c030 0x7f904004c700 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.610+0000 7f904c387640 1 -- 172.21.15.134:0/2557966177 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f904401f070 con 0x7f904001c030 2024-04-24T02:12:25.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.610+0000 7f904c387640 1 --2- 172.21.15.134:0/2557966177 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f9044031040 0x7f9044032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.610+0000 7f904c387640 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634852af250 con 0x7f9044031040 2024-04-24T02:12:25.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.610+0000 7f904bb86640 1 --2- 172.21.15.134:0/2557966177 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f9044031040 0x7f9044032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.611+0000 7f904bb86640 1 --2- 172.21.15.134:0/2557966177 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f9044031040 0x7f9044032940 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.611+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f903c075030 con 0x7f9044031040 2024-04-24T02:12:25.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.611+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634852af250 con 0x5634852a6690 2024-04-24T02:12:25.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.611+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f903c075030 con 0x5634852a6690 2024-04-24T02:12:25.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.611+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634852af250 con 0x5634852a6690 2024-04-24T02:12:25.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.611+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f903c075030 con 0x5634852a6690 2024-04-24T02:12:25.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.611+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634852af250 con 0x7f9044031040 2024-04-24T02:12:25.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.612+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f903c075030 con 0x7f9044031040 2024-04-24T02:12:25.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.612+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634852af250 con 0x7f9044031040 2024-04-24T02:12:25.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.612+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f903c075030 con 0x7f9044031040 2024-04-24T02:12:25.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.612+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634852af250 con 0x7f904001c030 2024-04-24T02:12:25.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.612+0000 7f904c387640 1 -- 172.21.15.134:0/2557966177 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f904401f070 con 0x7f904001c030 2024-04-24T02:12:25.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.612+0000 7f904c387640 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634852af250 con 0x5634852ac770 2024-04-24T02:12:25.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.612+0000 7f904b385640 1 -- 172.21.15.134:0/2557966177 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f904005d040 con 0x5634852ac770 2024-04-24T02:12:25.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.612+0000 7f904b385640 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634852af250 con 0x5634852a6690 2024-04-24T02:12:25.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.612+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f903c075030 con 0x5634852a6690 2024-04-24T02:12:25.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.613+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634852af250 con 0x7f9044031040 2024-04-24T02:12:25.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.613+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f903c075030 con 0x7f9044031040 2024-04-24T02:12:25.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.613+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634852af250 con 0x5634852a6690 2024-04-24T02:12:25.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.613+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f903c075030 con 0x5634852a6690 2024-04-24T02:12:25.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.613+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634852af250 con 0x7f904001c030 2024-04-24T02:12:25.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.613+0000 7f904c387640 1 -- 172.21.15.134:0/2557966177 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f904401f070 con 0x7f904001c030 2024-04-24T02:12:25.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.613+0000 7f904c387640 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634852af250 con 0x5634852ac770 2024-04-24T02:12:25.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.614+0000 7f904b385640 1 -- 172.21.15.134:0/2557966177 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f904005d040 con 0x5634852ac770 2024-04-24T02:12:25.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.614+0000 7f904b385640 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634852af250 con 0x5634852ac770 2024-04-24T02:12:25.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.614+0000 7f904b385640 1 -- 172.21.15.134:0/2557966177 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f904005d040 con 0x5634852ac770 2024-04-24T02:12:25.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.614+0000 7f904b385640 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634852af250 con 0x7f9044031040 2024-04-24T02:12:25.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.614+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f903c075030 con 0x7f9044031040 2024-04-24T02:12:25.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.614+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634852af250 con 0x5634852ac770 2024-04-24T02:12:25.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.614+0000 7f904b385640 1 -- 172.21.15.134:0/2557966177 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f904005d040 con 0x5634852ac770 2024-04-24T02:12:25.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.614+0000 7f904b385640 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634852af250 con 0x5634852ac770 2024-04-24T02:12:25.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.614+0000 7f904b385640 1 -- 172.21.15.134:0/2557966177 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f904005d040 con 0x5634852ac770 2024-04-24T02:12:25.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.615+0000 7f904b385640 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634852af250 con 0x5634852a6690 2024-04-24T02:12:25.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.615+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f903c075030 con 0x5634852a6690 2024-04-24T02:12:25.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.615+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634852af250 con 0x5634852a6690 2024-04-24T02:12:25.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.615+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f903c075030 con 0x5634852a6690 2024-04-24T02:12:25.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.615+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634852af250 con 0x7f9044031040 2024-04-24T02:12:25.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.616+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f903c075030 con 0x7f9044031040 2024-04-24T02:12:25.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.616+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634852af250 con 0x5634852ac770 2024-04-24T02:12:25.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.616+0000 7f904b385640 1 -- 172.21.15.134:0/2557966177 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f904005d040 con 0x5634852ac770 2024-04-24T02:12:25.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.616+0000 7f904b385640 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634852af250 con 0x7f904001c030 2024-04-24T02:12:25.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.616+0000 7f904c387640 1 -- 172.21.15.134:0/2557966177 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f904401f070 con 0x7f904001c030 2024-04-24T02:12:25.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.616+0000 7f904c387640 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634852af250 con 0x5634852a6690 2024-04-24T02:12:25.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.616+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f903c075030 con 0x5634852a6690 2024-04-24T02:12:25.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.616+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634852af250 con 0x7f9044031040 2024-04-24T02:12:25.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.617+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f903c075030 con 0x7f9044031040 2024-04-24T02:12:25.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.617+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634852af250 con 0x5634852ac770 2024-04-24T02:12:25.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.617+0000 7f904b385640 1 -- 172.21.15.134:0/2557966177 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f904005d040 con 0x5634852ac770 2024-04-24T02:12:25.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.617+0000 7f904b385640 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634852af250 con 0x7f9044031040 2024-04-24T02:12:25.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.617+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f903c075030 con 0x7f9044031040 2024-04-24T02:12:25.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.617+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634852af250 con 0x7f904001c030 2024-04-24T02:12:25.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.617+0000 7f904c387640 1 -- 172.21.15.134:0/2557966177 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f904401f070 con 0x7f904001c030 2024-04-24T02:12:25.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.617+0000 7f904c387640 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634852af250 con 0x5634852ac770 2024-04-24T02:12:25.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.617+0000 7f904b385640 1 -- 172.21.15.134:0/2557966177 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f904005d040 con 0x5634852ac770 2024-04-24T02:12:25.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.618+0000 7f904b385640 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634852af250 con 0x7f9044031040 2024-04-24T02:12:25.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.618+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f903c075030 con 0x7f9044031040 2024-04-24T02:12:25.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.618+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634852af250 con 0x5634852a6690 2024-04-24T02:12:25.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.618+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f903c075030 con 0x5634852a6690 2024-04-24T02:12:25.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.618+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634852af250 con 0x7f904001c030 2024-04-24T02:12:25.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.618+0000 7f904c387640 1 -- 172.21.15.134:0/2557966177 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f904401f070 con 0x7f904001c030 2024-04-24T02:12:25.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.618+0000 7f904e087800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:25.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.618+0000 7f904e087800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:25.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.618+0000 7f904e087800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:25.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.618+0000 7f904e087800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:25.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.618+0000 7f904e087800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:25.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.618+0000 7f904e087800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:25.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.618+0000 7f904e087800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.618+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634852ab1f0 con 0x5634852a6690 2024-04-24T02:12:25.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.619+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f903c075030 con 0x5634852a6690 2024-04-24T02:12:25.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.619+0000 7f904e087800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:25.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.619+0000 7f904e087800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.619+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634852aae30 con 0x5634852a6690 2024-04-24T02:12:25.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.619+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f903c075030 con 0x5634852a6690 2024-04-24T02:12:25.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.619+0000 7f904e087800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:25.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.619+0000 7f904e087800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.619+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634852abb50 con 0x5634852a6690 2024-04-24T02:12:25.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.619+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f903c075030 con 0x5634852a6690 2024-04-24T02:12:25.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.619+0000 7f904e087800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:25.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.619+0000 7f904e087800 20 zone default found 2024-04-24T02:12:25.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.619+0000 7f904e087800 4 Realm: () 2024-04-24T02:12:25.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.619+0000 7f904e087800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:25.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.619+0000 7f904e087800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:25.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.619+0000 7f904e087800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:25.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.619+0000 7f904e087800 20 zonegroup default 2024-04-24T02:12:25.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.619+0000 7f904e087800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.619+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634852af6d0 con 0x7f9044031040 2024-04-24T02:12:25.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.620+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f903c075030 con 0x7f9044031040 2024-04-24T02:12:25.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.620+0000 7f904e087800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:25.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.620+0000 7f904e087800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.620+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634852b1560 con 0x5634852ac770 2024-04-24T02:12:25.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.620+0000 7f904b385640 1 -- 172.21.15.134:0/2557966177 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f904005d040 con 0x5634852ac770 2024-04-24T02:12:25.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.620+0000 7f904e087800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:25.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.620+0000 7f904e087800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.620+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634852b1900 con 0x5634852ac770 2024-04-24T02:12:25.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.620+0000 7f904b385640 1 -- 172.21.15.134:0/2557966177 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f904005d040 con 0x5634852ac770 2024-04-24T02:12:25.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.620+0000 7f904e087800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:25.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.620+0000 7f904e087800 20 started sync module instance, tier type = 2024-04-24T02:12:25.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.620+0000 7f904e087800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:25.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.620+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634852b09a0 con 0x7f904001c030 2024-04-24T02:12:25.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.621+0000 7f904c387640 1 -- 172.21.15.134:0/2557966177 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f904401f070 con 0x7f904001c030 2024-04-24T02:12:25.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.621+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94783572477168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634852b1ca0 con 0x7f904001c030 2024-04-24T02:12:25.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.621+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634852b2660 con 0x5634852a6690 2024-04-24T02:12:25.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.622+0000 7f904c387640 1 -- 172.21.15.134:0/2557966177 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94783572477168] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f904401f070 con 0x7f904001c030 2024-04-24T02:12:25.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.622+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f903c075030 con 0x5634852a6690 2024-04-24T02:12:25.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.622+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94783572479488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634852b2660 con 0x5634852a6690 2024-04-24T02:12:25.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.622+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634852b30c0 con 0x5634852ac770 2024-04-24T02:12:25.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.623+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94783572479488] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f903c075030 con 0x5634852a6690 2024-04-24T02:12:25.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.624+0000 7f904b385640 1 -- 172.21.15.134:0/2557966177 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f904005d040 con 0x5634852ac770 2024-04-24T02:12:25.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.624+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94783572484528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634852b25d0 con 0x5634852ac770 2024-04-24T02:12:25.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.624+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634852b3f80 con 0x7f904001c030 2024-04-24T02:12:25.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.625+0000 7f904c387640 1 -- 172.21.15.134:0/2557966177 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f904401f070 con 0x7f904001c030 2024-04-24T02:12:25.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.625+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94783572491440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634852b4820 con 0x7f904001c030 2024-04-24T02:12:25.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.625+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634852b52d0 con 0x5634852a6690 2024-04-24T02:12:25.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.625+0000 7f904b385640 1 -- 172.21.15.134:0/2557966177 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94783572484528] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f904005d040 con 0x5634852ac770 2024-04-24T02:12:25.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.626+0000 7f904c387640 1 -- 172.21.15.134:0/2557966177 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94783572491440] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f904401f070 con 0x7f904001c030 2024-04-24T02:12:25.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.626+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f903c075030 con 0x5634852a6690 2024-04-24T02:12:25.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.626+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94783572489392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634852b4370 con 0x5634852a6690 2024-04-24T02:12:25.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.626+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634852b5ba0 con 0x7f9044031040 2024-04-24T02:12:25.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.627+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f903c075030 con 0x7f9044031040 2024-04-24T02:12:25.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.627+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94783572489392] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f903c075030 con 0x5634852a6690 2024-04-24T02:12:25.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.627+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94783572497888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634852b5eb0 con 0x7f9044031040 2024-04-24T02:12:25.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.627+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634852b4e00 con 0x7f9044031040 2024-04-24T02:12:25.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.628+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94783572497888] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f903c075030 con 0x7f9044031040 2024-04-24T02:12:25.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.628+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(56 notify.6 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f903c075030 con 0x7f9044031040 2024-04-24T02:12:25.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.628+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94783572498944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634852b62d0 con 0x7f9044031040 2024-04-24T02:12:25.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.628+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634852b6c90 con 0x7f9044031040 2024-04-24T02:12:25.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.629+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(58 notify.7 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f903c075030 con 0x7f9044031040 2024-04-24T02:12:25.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.629+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94783572498944] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f903c075030 con 0x7f9044031040 2024-04-24T02:12:25.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.629+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94783572502496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634852b70b0 con 0x7f9044031040 2024-04-24T02:12:25.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.629+0000 7f904e087800 20 add_watcher() i=0 2024-04-24T02:12:25.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.629+0000 7f904e087800 20 add_watcher() i=1 2024-04-24T02:12:25.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.629+0000 7f904e087800 20 add_watcher() i=2 2024-04-24T02:12:25.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.629+0000 7f904e087800 20 add_watcher() i=3 2024-04-24T02:12:25.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.629+0000 7f904e087800 20 add_watcher() i=4 2024-04-24T02:12:25.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.629+0000 7f904e087800 20 add_watcher() i=5 2024-04-24T02:12:25.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.629+0000 7f904e087800 20 add_watcher() i=6 2024-04-24T02:12:25.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.630+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94783572502496] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f903c075030 con 0x7f9044031040 2024-04-24T02:12:25.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.630+0000 7f904e087800 20 add_watcher() i=7 2024-04-24T02:12:25.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.630+0000 7f904e087800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:25.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.630+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634852b70b0 con 0x5634852a6690 2024-04-24T02:12:25.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.630+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f903c075030 con 0x5634852a6690 2024-04-24T02:12:25.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.630+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94783572503552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634852b7020 con 0x5634852a6690 2024-04-24T02:12:25.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.631+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94783572503552] v30'105 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f903c075030 con 0x5634852a6690 2024-04-24T02:12:25.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.631+0000 7f8f01fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:25.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.631+0000 7f904e087800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:25.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.631+0000 7f904e087800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:25.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.631+0000 7f904e087800 5 note: GC not initialized 2024-04-24T02:12:25.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.631+0000 7f8f00fe1640 20 reqs_thread_entry: start 2024-04-24T02:12:25.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.631+0000 7f904e087800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:25.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.632+0000 7f904e087800 20 Filter name: none 2024-04-24T02:12:25.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.632+0000 7f8e7a7fc640 20 reqs_thread_entry: start 2024-04-24T02:12:25.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.632+0000 7f904e087800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.632+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634852ece70 con 0x5634852a6690 2024-04-24T02:12:25.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.632+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f903c075030 con 0x5634852a6690 2024-04-24T02:12:25.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.632+0000 7f904e087800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T02:12:25.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.632+0000 7f904e087800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.632+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634852ed860 con 0x5634852a6690 2024-04-24T02:12:25.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.632+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f903c075030 con 0x5634852a6690 2024-04-24T02:12:25.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.632+0000 7f904e087800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T02:12:25.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.632+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634852ee870 con 0x7f904001c030 2024-04-24T02:12:25.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.633+0000 7f904c387640 1 -- 172.21.15.134:0/2557966177 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f904401f070 con 0x7f904001c030 2024-04-24T02:12:25.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.633+0000 7f904e087800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.633+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:65 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634852ec120 con 0x7f904001c030 2024-04-24T02:12:25.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.633+0000 7f904c387640 1 -- 172.21.15.134:0/2557966177 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(65 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f904401f070 con 0x7f904001c030 2024-04-24T02:12:25.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.633+0000 7f904e087800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T02:12:25.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.633+0000 7f904e087800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.633+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:66 8.1d 8:be2d2b4a:root::.bucket.meta.myfoo%3a582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634852ee870 con 0x7f9044031040 2024-04-24T02:12:25.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.634+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(66 .bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f903c075030 con 0x7f9044031040 2024-04-24T02:12:25.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.634+0000 7f904e087800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T02:12:25.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.634+0000 7f904e087800 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-24T02:12:25.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.634+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:67 4.2f 4:f4626d03:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634852ee2f0 con 0x5634852a6690 2024-04-24T02:12:25.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.634+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 4.2f 4:f41e46b8:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634852f32d0 con 0x5634852a6690 2024-04-24T02:12:25.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.634+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:69 4.39 4:9e407d1f:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634852f5b80 con 0x5634852ac770 2024-04-24T02:12:25.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.634+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:70 4.3 4:c3c22538:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634852f32d0 con 0x5634852a6690 2024-04-24T02:12:25.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.634+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:71 4.b 4:d224abc6:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634852fae20 con 0x7f904001c030 2024-04-24T02:12:25.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.634+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:72 4.e 4:706a3c35:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634852fae20 con 0x7f904001c030 2024-04-24T02:12:25.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.634+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:73 4.0 4:009d6733:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634852ffdb0 con 0x5634852ac770 2024-04-24T02:12:25.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.634+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:74 4.39 4:9c24c7ad:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563485302c30 con 0x5634852ac770 2024-04-24T02:12:25.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.634+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:75 4.35 4:aece7739:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563485305af0 con 0x5634852a6690 2024-04-24T02:12:25.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.634+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:76 4.24 4:2482d015:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563485308960 con 0x7f9044031040 2024-04-24T02:12:25.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.634+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:77 4.0 4:03cc5f7d:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56348530b7e0 con 0x5634852ac770 2024-04-24T02:12:25.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.634+0000 7f904b385640 1 -- 172.21.15.134:0/2557966177 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(69 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f904005d040 con 0x5634852ac770 2024-04-24T02:12:25.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.634+0000 7f904c387640 1 -- 172.21.15.134:0/2557966177 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(71 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f904401f070 con 0x7f904001c030 2024-04-24T02:12:25.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.634+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(67 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f903c075030 con 0x5634852a6690 2024-04-24T02:12:25.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.634+0000 7f904c387640 1 -- 172.21.15.134:0/2557966177 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(72 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f904401f070 con 0x7f904001c030 2024-04-24T02:12:25.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.634+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(70 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f903c075030 con 0x5634852a6690 2024-04-24T02:12:25.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.634+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(68 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.1 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f903c075030 con 0x5634852a6690 2024-04-24T02:12:25.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.634+0000 7f904b385640 1 -- 172.21.15.134:0/2557966177 <== osd.3 v2:172.21.15.134:6801/3585115521 15 ==== osd_op_reply(73 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f904005d040 con 0x5634852ac770 2024-04-24T02:12:25.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.634+0000 7f904b385640 1 -- 172.21.15.134:0/2557966177 <== osd.3 v2:172.21.15.134:6801/3585115521 16 ==== osd_op_reply(74 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f904005d040 con 0x5634852ac770 2024-04-24T02:12:25.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.635+0000 7f904b385640 1 -- 172.21.15.134:0/2557966177 <== osd.3 v2:172.21.15.134:6801/3585115521 17 ==== osd_op_reply(77 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.10 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f904005d040 con 0x5634852ac770 2024-04-24T02:12:25.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.635+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(75 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f903c0af060 con 0x5634852a6690 2024-04-24T02:12:25.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.635+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(76 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f903c0af060 con 0x7f9044031040 2024-04-24T02:12:25.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.635+0000 7f8f01fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:25.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.635+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94783572503552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56348530b7e0 con 0x5634852a6690 2024-04-24T02:12:25.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.637+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94783572503552] v30'106 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f903c0af060 con 0x5634852a6690 2024-04-24T02:12:25.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.637+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94783572477168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634852d5a30 con 0x7f904001c030 2024-04-24T02:12:25.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.637+0000 7f904c387640 1 -- 172.21.15.134:0/2557966177 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94783572477168] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f904401f070 con 0x7f904001c030 2024-04-24T02:12:25.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.637+0000 7f904e087800 20 remove_watcher() i=0 2024-04-24T02:12:25.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.637+0000 7f904e087800 2 removed watcher, disabling cache 2024-04-24T02:12:25.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.638+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94783572479488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634852d5a30 con 0x5634852a6690 2024-04-24T02:12:25.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.639+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.1 v2:172.21.15.134:6804/1487076214 30 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94783572479488] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f903c0af060 con 0x5634852a6690 2024-04-24T02:12:25.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.639+0000 7f904e087800 20 remove_watcher() i=1 2024-04-24T02:12:25.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.639+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94783572484528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634852d5a30 con 0x5634852ac770 2024-04-24T02:12:25.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.640+0000 7f904b385640 1 -- 172.21.15.134:0/2557966177 <== osd.3 v2:172.21.15.134:6801/3585115521 18 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94783572484528] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f904005d040 con 0x5634852ac770 2024-04-24T02:12:25.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.640+0000 7f904e087800 20 remove_watcher() i=2 2024-04-24T02:12:25.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.640+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94783572491440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634852d5a30 con 0x7f904001c030 2024-04-24T02:12:25.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.641+0000 7f904c387640 1 -- 172.21.15.134:0/2557966177 <== osd.2 v2:172.21.15.134:6800/214480313 16 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94783572491440] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f904401f070 con 0x7f904001c030 2024-04-24T02:12:25.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.641+0000 7f904e087800 20 remove_watcher() i=3 2024-04-24T02:12:25.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.641+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94783572489392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634852d5a30 con 0x5634852a6690 2024-04-24T02:12:25.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.642+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.1 v2:172.21.15.134:6804/1487076214 31 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94783572489392] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f903c0af060 con 0x5634852a6690 2024-04-24T02:12:25.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.642+0000 7f904e087800 20 remove_watcher() i=4 2024-04-24T02:12:25.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.642+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94783572497888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634852d5a30 con 0x7f9044031040 2024-04-24T02:12:25.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.643+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94783572497888] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f903c0af060 con 0x7f9044031040 2024-04-24T02:12:25.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.643+0000 7f904e087800 20 remove_watcher() i=5 2024-04-24T02:12:25.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.643+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94783572498944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634852d5a30 con 0x7f9044031040 2024-04-24T02:12:25.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.644+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.0 v2:172.21.15.104:6800/2419146313 20 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94783572498944] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f903c0af060 con 0x7f9044031040 2024-04-24T02:12:25.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.644+0000 7f904e087800 20 remove_watcher() i=6 2024-04-24T02:12:25.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.644+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94783572502496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634852d5a30 con 0x7f9044031040 2024-04-24T02:12:25.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.645+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 <== osd.0 v2:172.21.15.104:6800/2419146313 21 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94783572502496] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f903c0af060 con 0x7f9044031040 2024-04-24T02:12:25.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.645+0000 7f904e087800 20 remove_watcher() i=7 2024-04-24T02:12:25.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.645+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f9044031040 msgr2=0x7f9044032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.645+0000 7f904e087800 1 --2- 172.21.15.134:0/2557966177 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f9044031040 0x7f9044032940 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.645+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5634852a6690 msgr2=0x5634852a8b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.645+0000 7f904e087800 1 --2- 172.21.15.134:0/2557966177 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5634852a6690 0x5634852a8b50 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.645+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f904001c030 msgr2=0x7f904004c700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.645+0000 7f904e087800 1 --2- 172.21.15.134:0/2557966177 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f904001c030 0x7f904004c700 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.645+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5634852ac770 msgr2=0x5634852aeb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.645+0000 7f904e087800 1 --2- 172.21.15.134:0/2557966177 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5634852ac770 0x5634852aeb80 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.646+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8f14036900 msgr2=0x7f8f14038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.646+0000 7f904e087800 1 --2- 172.21.15.134:0/2557966177 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8f14036900 0x7f8f14038dc0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x563485275db0 tx=0x7f904401f000 comp rx=0 tx=0).stop 2024-04-24T02:12:25.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.646+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563485293580 msgr2=0x56348529abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.646+0000 7f904e087800 1 --2- 172.21.15.134:0/2557966177 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563485293580 0x56348529abe0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9040044040 tx=0x7f904004c2f0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.646+0000 7f904bb86640 1 -- 172.21.15.134:0/2557966177 reap_dead start 2024-04-24T02:12:25.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.646+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 shutdown_connections 2024-04-24T02:12:25.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.646+0000 7f904e087800 1 --2- 172.21.15.134:0/2557966177 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563485293580 0x56348529abe0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.646+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 >> 172.21.15.134:0/2557966177 conn(0x56348528f8e0 msgr2=0x56348528cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:25.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.646+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 shutdown_connections 2024-04-24T02:12:25.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.646+0000 7f904e087800 1 -- 172.21.15.134:0/2557966177 wait complete. 2024-04-24T02:12:25.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.646+0000 7f904e087800 1 -- 172.21.15.134:0/1349023412 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8f24036900 msgr2=0x7f8f24038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.646+0000 7f904e087800 1 --2- 172.21.15.134:0/1349023412 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8f24036900 0x7f8f24038dc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x563485276a40 tx=0x7f9044005840 comp rx=0 tx=0).stop 2024-04-24T02:12:25.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.646+0000 7f904e087800 1 -- 172.21.15.134:0/1349023412 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5634852861e0 msgr2=0x563485286600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.646+0000 7f904e087800 1 --2- 172.21.15.134:0/1349023412 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5634852861e0 0x563485286600 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9040001770 tx=0x7f904000f790 comp rx=0 tx=0).stop 2024-04-24T02:12:25.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.646+0000 7f904e087800 1 -- 172.21.15.134:0/1349023412 shutdown_connections 2024-04-24T02:12:25.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.646+0000 7f904e087800 1 --2- 172.21.15.134:0/1349023412 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8f24036900 0x7f8f24038dc0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.646+0000 7f904e087800 1 --2- 172.21.15.134:0/1349023412 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5634852861e0 0x563485286600 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.646+0000 7f904e087800 1 -- 172.21.15.134:0/1349023412 >> 172.21.15.134:0/1349023412 conn(0x56348527a280 msgr2=0x56348527a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:25.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.646+0000 7f904e087800 1 -- 172.21.15.134:0/1349023412 shutdown_connections 2024-04-24T02:12:25.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.646+0000 7f904e087800 1 -- 172.21.15.134:0/1349023412 wait complete. 2024-04-24T02:12:25.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.646+0000 7f904e087800 1 -- 172.21.15.134:0/578313612 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5634851720c0 msgr2=0x563485275050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.646+0000 7f904e087800 1 --2- 172.21.15.134:0/578313612 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5634851720c0 0x563485275050 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.646+0000 7f904e087800 1 -- 172.21.15.134:0/578313612 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8f34036900 msgr2=0x7f8f34038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.646+0000 7f904e087800 1 --2- 172.21.15.134:0/578313612 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8f34036900 0x7f8f34038dc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9040001e10 tx=0x7f9040001390 comp rx=0 tx=0).stop 2024-04-24T02:12:25.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.646+0000 7f904e087800 1 -- 172.21.15.134:0/578313612 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563485171760 msgr2=0x56348526de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.646+0000 7f904e087800 1 --2- 172.21.15.134:0/578313612 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563485171760 0x56348526de60 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f903c01cfe0 tx=0x7f903c003020 comp rx=0 tx=0).stop 2024-04-24T02:12:25.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.646+0000 7f904e087800 1 -- 172.21.15.134:0/578313612 shutdown_connections 2024-04-24T02:12:25.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.646+0000 7f904e087800 1 --2- 172.21.15.134:0/578313612 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5634851720c0 0x563485275050 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.646+0000 7f904e087800 1 --2- 172.21.15.134:0/578313612 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8f34036900 0x7f8f34038dc0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.646+0000 7f904e087800 1 --2- 172.21.15.134:0/578313612 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563485171760 0x56348526de60 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.647+0000 7f904e087800 1 -- 172.21.15.134:0/578313612 >> 172.21.15.134:0/578313612 conn(0x56348516d380 msgr2=0x5634852604f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:25.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.647+0000 7f904e087800 1 -- 172.21.15.134:0/578313612 shutdown_connections 2024-04-24T02:12:25.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.647+0000 7f904e087800 1 -- 172.21.15.134:0/578313612 wait complete. 2024-04-24T02:12:25.667 INFO:teuthology.orchestra.run.smithi134.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"b893fd8a-cafc-4918-98fa-f8aa8e20a508","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1","marker":"582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-04-24T02:12:24.905198Z","creation_time":"2024-04-24T02:12:24.901996Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}}] 2024-04-24T02:12:25.667 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'b893fd8a-cafc-4918-98fa-f8aa8e20a508', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1', 'marker': '582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-24T02:12:24.905198Z', 'creation_time': '2024-04-24T02:12:24.901996Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-04-24T02:12:25.673 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-04-24T02:12:25.673 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-04-24T02:12:25.673 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-04-24T02:12:25.673 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-04-24T02:12:25.750 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:25.750 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:25.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.749+0000 7f5e47e3e800 1 Processor -- start 2024-04-24T02:12:25.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.749+0000 7f5e47e3e800 1 -- start start 2024-04-24T02:12:25.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.749+0000 7f5e47e3e800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55b7b0bbff90 0x55b7b0bc03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.749+0000 7f5e47e3e800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b7b0a7ed40 con 0x55b7b0bc1100 2024-04-24T02:12:25.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.749+0000 7f5e47e3e800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55b7b0a514d0 con 0x55b7b0bbff90 2024-04-24T02:12:25.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.750+0000 7f5e42ad5640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55b7b0bbff90 0x55b7b0bc03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.750+0000 7f5e422d4640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55b7b0bc1100 0x55b7b0bc1580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:55244/0 (socket says 172.21.15.134:55244) 2024-04-24T02:12:25.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.750+0000 7f5e422d4640 1 -- 172.21.15.134:0/337207465 learned_addr learned my addr 172.21.15.134:0/337207465 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:12:25.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.750+0000 7f5e42ad5640 1 -- 172.21.15.134:0/337207465 >> v1:172.21.15.104:6789/0 conn(0x55b7b0bc1100 legacy=0x55b7b0bc1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.750+0000 7f5e42ad5640 1 -- 172.21.15.134:0/337207465 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7b0a7d590 con 0x55b7b0bbff90 2024-04-24T02:12:25.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.752+0000 7f5e42ad5640 1 --2- 172.21.15.134:0/337207465 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7b0bbff90 0x55b7b0bc03b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c005fd0 tx=0x7f5e3c01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d053c4f296026bc7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.752+0000 7f5e41ad3640 1 -- 172.21.15.134:0/337207465 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e3c052560 con 0x55b7b0bbff90 2024-04-24T02:12:25.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.752+0000 7f5e41ad3640 1 -- 172.21.15.134:0/337207465 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e3c052700 con 0x55b7b0bbff90 2024-04-24T02:12:25.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.752+0000 7f5e41ad3640 1 -- 172.21.15.134:0/337207465 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e3c052a60 con 0x55b7b0bbff90 2024-04-24T02:12:25.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.752+0000 7f5e47e3e800 1 -- 172.21.15.134:0/337207465 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7b0bbff90 msgr2=0x55b7b0bc03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.752+0000 7f5e47e3e800 1 --2- 172.21.15.134:0/337207465 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7b0bbff90 0x55b7b0bc03b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c005fd0 tx=0x7f5e3c01ccc0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.752+0000 7f5e47e3e800 1 -- 172.21.15.134:0/337207465 shutdown_connections 2024-04-24T02:12:25.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.752+0000 7f5e47e3e800 1 --2- 172.21.15.134:0/337207465 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7b0bbff90 0x55b7b0bc03b0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.752+0000 7f5e47e3e800 1 -- 172.21.15.134:0/337207465 >> 172.21.15.134:0/337207465 conn(0x55b7b0bbb530 msgr2=0x55b7b0bbd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:25.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.752+0000 7f5e47e3e800 1 -- 172.21.15.134:0/337207465 shutdown_connections 2024-04-24T02:12:25.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.752+0000 7f5e47e3e800 1 -- 172.21.15.134:0/337207465 wait complete. 2024-04-24T02:12:25.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.764+0000 7f5e47e3e800 1 Processor -- start 2024-04-24T02:12:25.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.764+0000 7f5e47e3e800 1 -- start start 2024-04-24T02:12:25.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.764+0000 7f5e47e3e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7b0bbff90 0x55b7b0b359a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.764+0000 7f5e47e3e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b7b0b0b3c0 con 0x55b7b0bbff90 2024-04-24T02:12:25.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.764+0000 7f5e42ad5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7b0bbff90 0x55b7b0b359a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.764+0000 7f5e42ad5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7b0bbff90 0x55b7b0b359a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55786/0 (socket says 172.21.15.134:55786) 2024-04-24T02:12:25.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.764+0000 7f5e42ad5640 1 -- 172.21.15.134:0/2933907878 learned_addr learned my addr 172.21.15.134:0/2933907878 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:25.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.765+0000 7f5e42ad5640 1 -- 172.21.15.134:0/2933907878 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7b0b33f60 con 0x55b7b0bbff90 2024-04-24T02:12:25.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.765+0000 7f5e42ad5640 1 --2- 172.21.15.134:0/2933907878 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7b0bbff90 0x55b7b0b359a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c054040 tx=0x7f5e3c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34971f7288c767d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.765+0000 7f5d30e09640 1 -- 172.21.15.134:0/2933907878 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e3c0529e0 con 0x55b7b0bbff90 2024-04-24T02:12:25.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.765+0000 7f5d30e09640 1 -- 172.21.15.134:0/2933907878 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e3c052b80 con 0x55b7b0bbff90 2024-04-24T02:12:25.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.765+0000 7f5d30e09640 1 -- 172.21.15.134:0/2933907878 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e3c05c430 con 0x55b7b0bbff90 2024-04-24T02:12:25.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.766+0000 7f5e47e3e800 1 -- 172.21.15.134:0/2933907878 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7b0bbff90 msgr2=0x55b7b0b359a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.766+0000 7f5e47e3e800 1 --2- 172.21.15.134:0/2933907878 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7b0bbff90 0x55b7b0b359a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c054040 tx=0x7f5e3c04c000 comp rx=0 tx=0).stop 2024-04-24T02:12:25.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.766+0000 7f5e47e3e800 1 -- 172.21.15.134:0/2933907878 shutdown_connections 2024-04-24T02:12:25.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.766+0000 7f5e47e3e800 1 --2- 172.21.15.134:0/2933907878 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7b0bbff90 0x55b7b0b359a0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.766+0000 7f5e47e3e800 1 -- 172.21.15.134:0/2933907878 >> 172.21.15.134:0/2933907878 conn(0x55b7b0bbb530 msgr2=0x55b7b0cace20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:25.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.766+0000 7f5e47e3e800 1 -- 172.21.15.134:0/2933907878 shutdown_connections 2024-04-24T02:12:25.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.766+0000 7f5e47e3e800 1 -- 172.21.15.134:0/2933907878 wait complete. 2024-04-24T02:12:25.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.766+0000 7f5e47e3e800 1 Processor -- start 2024-04-24T02:12:25.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.766+0000 7f5e47e3e800 1 -- start start 2024-04-24T02:12:25.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.766+0000 7f5e47e3e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7b0bbff90 0x55b7b0cbb130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.766+0000 7f5e47e3e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b7b0bc9570 con 0x55b7b0bbff90 2024-04-24T02:12:25.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.766+0000 7f5e42ad5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7b0bbff90 0x55b7b0cbb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.766+0000 7f5e42ad5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7b0bbff90 0x55b7b0cbb130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55790/0 (socket says 172.21.15.134:55790) 2024-04-24T02:12:25.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.766+0000 7f5e42ad5640 1 -- 172.21.15.134:0/2533859493 learned_addr learned my addr 172.21.15.134:0/2533859493 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:25.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.767+0000 7f5e42ad5640 1 -- 172.21.15.134:0/2533859493 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7b0cbb670 con 0x55b7b0bbff90 2024-04-24T02:12:25.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.767+0000 7f5e42ad5640 1 --2- 172.21.15.134:0/2533859493 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7b0bbff90 0x55b7b0cbb130 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c044920 tx=0x7f5e3c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.767+0000 7f5d2f606640 1 -- 172.21.15.134:0/2533859493 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e3c066410 con 0x55b7b0bbff90 2024-04-24T02:12:25.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.767+0000 7f5d2f606640 1 -- 172.21.15.134:0/2533859493 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e3c0665b0 con 0x55b7b0bbff90 2024-04-24T02:12:25.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.767+0000 7f5e47e3e800 1 -- 172.21.15.134:0/2533859493 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b7b0cbb900 con 0x55b7b0bbff90 2024-04-24T02:12:25.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.767+0000 7f5d2f606640 1 -- 172.21.15.134:0/2533859493 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e3c0668d0 con 0x55b7b0bbff90 2024-04-24T02:12:25.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.767+0000 7f5e47e3e800 1 -- 172.21.15.134:0/2533859493 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7b0cbe5b0 con 0x55b7b0bbff90 2024-04-24T02:12:25.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.768+0000 7f5d2f606640 1 -- 172.21.15.134:0/2533859493 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5e3c078020 con 0x55b7b0bbff90 2024-04-24T02:12:25.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.768+0000 7f5d2f606640 1 --2- 172.21.15.134:0/2533859493 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5d28036900 0x7f5d28038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.768+0000 7f5d2f606640 1 -- 172.21.15.134:0/2533859493 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f5e3c08e790 con 0x55b7b0bbff90 2024-04-24T02:12:25.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.768+0000 7f5e422d4640 1 --2- 172.21.15.134:0/2533859493 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5d28036900 0x7f5d28038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.768+0000 7f5e47e3e800 1 --2- 172.21.15.134:0/2533859493 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b7b0bc1100 0x55b7b0cc2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.768+0000 7f5e47e3e800 1 -- 172.21.15.134:0/2533859493 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cc2950 con 0x55b7b0bc1100 2024-04-24T02:12:25.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.769+0000 7f5e432d6640 1 --2- 172.21.15.134:0/2533859493 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b7b0bc1100 0x55b7b0cc2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.769+0000 7f5e422d4640 1 --2- 172.21.15.134:0/2533859493 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5d28036900 0x7f5d28038dc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c000f60 tx=0x7f5e2c0012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.769+0000 7f5e432d6640 1 --2- 172.21.15.134:0/2533859493 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b7b0bc1100 0x55b7b0cc2370 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.769+0000 7f5e432d6640 1 -- 172.21.15.134:0/2533859493 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e340083e0 con 0x55b7b0bc1100 2024-04-24T02:12:25.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.769+0000 7f5e47e3e800 1 -- 172.21.15.134:0/2533859493 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cbf920 con 0x55b7b0bc1100 2024-04-24T02:12:25.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.769+0000 7f5e432d6640 1 -- 172.21.15.134:0/2533859493 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5e340083e0 con 0x55b7b0bc1100 2024-04-24T02:12:25.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.769+0000 7f5e47e3e800 1 -- 172.21.15.134:0/2533859493 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cc4770 con 0x55b7b0bc1100 2024-04-24T02:12:25.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.770+0000 7f5e432d6640 1 -- 172.21.15.134:0/2533859493 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5e340083e0 con 0x55b7b0bc1100 2024-04-24T02:12:25.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.770+0000 7f5e47e3e800 1 -- 172.21.15.134:0/2533859493 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cc3ab0 con 0x55b7b0bc1100 2024-04-24T02:12:25.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.770+0000 7f5e432d6640 1 -- 172.21.15.134:0/2533859493 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5e340083e0 con 0x55b7b0bc1100 2024-04-24T02:12:25.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.770+0000 7f5e47e3e800 1 -- 172.21.15.134:0/2533859493 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cc3ea0 con 0x55b7b0bc1100 2024-04-24T02:12:25.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.770+0000 7f5e432d6640 1 -- 172.21.15.134:0/2533859493 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5e340083e0 con 0x55b7b0bc1100 2024-04-24T02:12:25.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.770+0000 7f5e47e3e800 1 Processor -- start 2024-04-24T02:12:25.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.771+0000 7f5e47e3e800 1 -- start start 2024-04-24T02:12:25.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.771+0000 7f5e47e3e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7b0cd3580 0x55b7b0cd39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.771+0000 7f5e47e3e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b7b0ab16b0 con 0x55b7b0cd3580 2024-04-24T02:12:25.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.771+0000 7f5e422d4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7b0cd3580 0x55b7b0cd39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.771+0000 7f5e422d4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7b0cd3580 0x55b7b0cd39a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55800/0 (socket says 172.21.15.134:55800) 2024-04-24T02:12:25.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.771+0000 7f5e422d4640 1 -- 172.21.15.134:0/2301193247 learned_addr learned my addr 172.21.15.134:0/2301193247 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:25.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.771+0000 7f5e422d4640 1 -- 172.21.15.134:0/2301193247 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7b0cd3ee0 con 0x55b7b0cd3580 2024-04-24T02:12:25.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.771+0000 7f5e422d4640 1 --2- 172.21.15.134:0/2301193247 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7b0cd3580 0x55b7b0cd39a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c001ed0 tx=0x7f5e2c00d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.772+0000 7f5d2ce01640 1 -- 172.21.15.134:0/2301193247 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e2c01b550 con 0x55b7b0cd3580 2024-04-24T02:12:25.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.772+0000 7f5d2ce01640 1 -- 172.21.15.134:0/2301193247 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e2c01b6f0 con 0x55b7b0cd3580 2024-04-24T02:12:25.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.772+0000 7f5e47e3e800 1 -- 172.21.15.134:0/2301193247 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b7b0cd4950 con 0x55b7b0cd3580 2024-04-24T02:12:25.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.772+0000 7f5d2ce01640 1 -- 172.21.15.134:0/2301193247 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e2c01b9d0 con 0x55b7b0cd3580 2024-04-24T02:12:25.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.772+0000 7f5e47e3e800 1 -- 172.21.15.134:0/2301193247 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7b0cd4e50 con 0x55b7b0cd3580 2024-04-24T02:12:25.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.772+0000 7f5d2ce01640 1 -- 172.21.15.134:0/2301193247 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5e2c023020 con 0x55b7b0cd3580 2024-04-24T02:12:25.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.773+0000 7f5d2ce01640 1 --2- 172.21.15.134:0/2301193247 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5d1c036950 0x7f5d1c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.773+0000 7f5d2ce01640 1 -- 172.21.15.134:0/2301193247 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f5e2c021020 con 0x55b7b0cd3580 2024-04-24T02:12:25.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.773+0000 7f5e432d6640 1 --2- 172.21.15.134:0/2301193247 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5d1c036950 0x7f5d1c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.773+0000 7f5e47e3e800 1 Processor -- start 2024-04-24T02:12:25.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.773+0000 7f5e432d6640 1 --2- 172.21.15.134:0/2301193247 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5d1c036950 0x7f5d1c038e10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x55b7b0cc35d0 tx=0x7f5e34000f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.773+0000 7f5e47e3e800 1 -- start start 2024-04-24T02:12:25.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.773+0000 7f5e47e3e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7b0ce08c0 0x55b7b0ce0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.773+0000 7f5e47e3e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b7b0b34220 con 0x55b7b0ce08c0 2024-04-24T02:12:25.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.773+0000 7f5e422d4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7b0ce08c0 0x55b7b0ce0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.773+0000 7f5e422d4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7b0ce08c0 0x55b7b0ce0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55810/0 (socket says 172.21.15.134:55810) 2024-04-24T02:12:25.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.773+0000 7f5e422d4640 1 -- 172.21.15.134:0/1741974023 learned_addr learned my addr 172.21.15.134:0/1741974023 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:25.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.773+0000 7f5e422d4640 1 -- 172.21.15.134:0/1741974023 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7b0ce12b0 con 0x55b7b0ce08c0 2024-04-24T02:12:25.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.774+0000 7f5e422d4640 1 --2- 172.21.15.134:0/1741974023 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7b0ce08c0 0x55b7b0ce0ce0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c04ce10 tx=0x7f5e2c019ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86e6df0da2e2b852 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.774+0000 7f5d267fc640 1 -- 172.21.15.134:0/1741974023 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e2c041070 con 0x55b7b0ce08c0 2024-04-24T02:12:25.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.774+0000 7f5d267fc640 1 -- 172.21.15.134:0/1741974023 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e2c01bd50 con 0x55b7b0ce08c0 2024-04-24T02:12:25.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.774+0000 7f5d267fc640 1 -- 172.21.15.134:0/1741974023 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e2c025a30 con 0x55b7b0ce08c0 2024-04-24T02:12:25.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.774+0000 7f5e47e3e800 1 -- 172.21.15.134:0/1741974023 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7b0ce08c0 msgr2=0x55b7b0ce0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.774+0000 7f5e47e3e800 1 --2- 172.21.15.134:0/1741974023 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7b0ce08c0 0x55b7b0ce0ce0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c04ce10 tx=0x7f5e2c019ce0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.774+0000 7f5e47e3e800 1 -- 172.21.15.134:0/1741974023 shutdown_connections 2024-04-24T02:12:25.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.774+0000 7f5e47e3e800 1 --2- 172.21.15.134:0/1741974023 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7b0ce08c0 0x55b7b0ce0ce0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.774+0000 7f5e47e3e800 1 -- 172.21.15.134:0/1741974023 >> 172.21.15.134:0/1741974023 conn(0x55b7b0cdcc20 msgr2=0x55b7b0cdac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:25.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.774+0000 7f5e47e3e800 1 -- 172.21.15.134:0/1741974023 shutdown_connections 2024-04-24T02:12:25.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.774+0000 7f5e47e3e800 1 -- 172.21.15.134:0/1741974023 wait complete. 2024-04-24T02:12:25.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.775+0000 7f5e47e3e800 1 Processor -- start 2024-04-24T02:12:25.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.775+0000 7f5e47e3e800 1 -- start start 2024-04-24T02:12:25.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.775+0000 7f5e47e3e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7b0ce08c0 0x55b7b0ce7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.775+0000 7f5e47e3e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b7b0ce1a20 con 0x55b7b0ce08c0 2024-04-24T02:12:25.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.775+0000 7f5e422d4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7b0ce08c0 0x55b7b0ce7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.775+0000 7f5e422d4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7b0ce08c0 0x55b7b0ce7f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55816/0 (socket says 172.21.15.134:55816) 2024-04-24T02:12:25.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.775+0000 7f5e422d4640 1 -- 172.21.15.134:0/3468306283 learned_addr learned my addr 172.21.15.134:0/3468306283 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:25.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.775+0000 7f5e422d4640 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7b0ce8460 con 0x55b7b0ce08c0 2024-04-24T02:12:25.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.775+0000 7f5e422d4640 1 --2- 172.21.15.134:0/3468306283 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7b0ce08c0 0x55b7b0ce7f20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c048010 tx=0x7f5e2c04cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.775+0000 7f5d24ff9640 1 -- 172.21.15.134:0/3468306283 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e2c034070 con 0x55b7b0ce08c0 2024-04-24T02:12:25.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.775+0000 7f5d24ff9640 1 -- 172.21.15.134:0/3468306283 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e2c00cc60 con 0x55b7b0ce08c0 2024-04-24T02:12:25.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.775+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b7b0ce86f0 con 0x55b7b0ce08c0 2024-04-24T02:12:25.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.775+0000 7f5d24ff9640 1 -- 172.21.15.134:0/3468306283 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e2c041040 con 0x55b7b0ce08c0 2024-04-24T02:12:25.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.775+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7b0ce86f0 con 0x55b7b0ce08c0 2024-04-24T02:12:25.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.776+0000 7f5d24ff9640 1 -- 172.21.15.134:0/3468306283 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5e2c04e940 con 0x55b7b0ce08c0 2024-04-24T02:12:25.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.776+0000 7f5e47e3e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.776+0000 7f5d24ff9640 1 --2- 172.21.15.134:0/3468306283 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5d0c036900 0x7f5d0c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.776+0000 7f5d24ff9640 1 -- 172.21.15.134:0/3468306283 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f5e2c039ac0 con 0x55b7b0ce08c0 2024-04-24T02:12:25.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.776+0000 7f5e432d6640 1 --2- 172.21.15.134:0/3468306283 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5d0c036900 0x7f5d0c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.777+0000 7f5e47e3e800 1 --2- 172.21.15.134:0/3468306283 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b7b0cf3800 0x55b7b0cf5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.777+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cf63f0 con 0x55b7b0cf3800 2024-04-24T02:12:25.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.777+0000 7f5e42ad5640 1 --2- 172.21.15.134:0/3468306283 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b7b0cf3800 0x55b7b0cf5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.777+0000 7f5e432d6640 1 --2- 172.21.15.134:0/3468306283 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5d0c036900 0x7f5d0c038dc0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5e3400f010 tx=0x7f5e3400c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.777+0000 7f5e42ad5640 1 --2- 172.21.15.134:0/3468306283 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b7b0cf3800 0x55b7b0cf5ca0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.777+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e3c071910 con 0x55b7b0cf3800 2024-04-24T02:12:25.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.777+0000 7f5e47e3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:25.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.777+0000 7f5e47e3e800 20 realm 2024-04-24T02:12:25.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.777+0000 7f5e47e3e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.777+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cf6800 con 0x55b7b0cf3800 2024-04-24T02:12:25.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.777+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e3c071910 con 0x55b7b0cf3800 2024-04-24T02:12:25.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.777+0000 7f5e47e3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:25.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.777+0000 7f5e47e3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:25.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.777+0000 7f5e47e3e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.777+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cf70a0 con 0x55b7b0cf3800 2024-04-24T02:12:25.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.778+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e3c071910 con 0x55b7b0cf3800 2024-04-24T02:12:25.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.778+0000 7f5e47e3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:25.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.778+0000 7f5e47e3e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.778+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cf7440 con 0x55b7b0cf3800 2024-04-24T02:12:25.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.778+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5e3c071910 con 0x55b7b0cf3800 2024-04-24T02:12:25.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.778+0000 7f5e47e3e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:25.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.778+0000 7f5e47e3e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.778+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cf7c90 con 0x55b7b0cf3800 2024-04-24T02:12:25.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.778+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5e3c071910 con 0x55b7b0cf3800 2024-04-24T02:12:25.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.778+0000 7f5e47e3e800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:25.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.778+0000 7f5e47e3e800 20 searching for the correct realm 2024-04-24T02:12:25.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.778+0000 7f5e47e3e800 1 --2- 172.21.15.134:0/3468306283 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55b7b0cf9a00 0x55b7b0cfbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.778+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cfc3d0 con 0x55b7b0cf9a00 2024-04-24T02:12:25.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.778+0000 7f5e422d4640 1 --2- 172.21.15.134:0/3468306283 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55b7b0cf9a00 0x55b7b0cfbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.778+0000 7f5e422d4640 1 --2- 172.21.15.134:0/3468306283 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55b7b0cf9a00 0x55b7b0cfbdf0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.779+0000 7f5e422d4640 1 -- 172.21.15.134:0/3468306283 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e2c009050 con 0x55b7b0cf9a00 2024-04-24T02:12:25.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.779+0000 7f5e422d4640 1 --2- 172.21.15.134:0/3468306283 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f5e2c0467d0 0x7f5e2c0152e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.779+0000 7f5e422d4640 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cfc3d0 con 0x7f5e2c0467d0 2024-04-24T02:12:25.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.779+0000 7f5e432d6640 1 --2- 172.21.15.134:0/3468306283 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f5e2c0467d0 0x7f5e2c0152e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.779+0000 7f5e432d6640 1 --2- 172.21.15.134:0/3468306283 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f5e2c0467d0 0x7f5e2c0152e0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.780+0000 7f5e432d6640 1 -- 172.21.15.134:0/3468306283 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3402f040 con 0x7f5e2c0467d0 2024-04-24T02:12:25.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.780+0000 7f5e432d6640 1 --2- 172.21.15.134:0/3468306283 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f5e34019040 0x7f5e34019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.780+0000 7f5e432d6640 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cfc3d0 con 0x7f5e34019040 2024-04-24T02:12:25.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.780+0000 7f5e42ad5640 1 --2- 172.21.15.134:0/3468306283 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f5e34019040 0x7f5e34019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.780+0000 7f5e42ad5640 1 --2- 172.21.15.134:0/3468306283 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f5e34019040 0x7f5e34019930 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.780+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3c071910 con 0x7f5e34019040 2024-04-24T02:12:25.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.780+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cfc3d0 con 0x55b7b0cf3800 2024-04-24T02:12:25.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.781+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3c071910 con 0x55b7b0cf3800 2024-04-24T02:12:25.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.781+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cfc3d0 con 0x55b7b0cf3800 2024-04-24T02:12:25.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.781+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5e3c071910 con 0x55b7b0cf3800 2024-04-24T02:12:25.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.781+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cfc3d0 con 0x7f5e34019040 2024-04-24T02:12:25.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.781+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3c071910 con 0x7f5e34019040 2024-04-24T02:12:25.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.781+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cfc3d0 con 0x7f5e34019040 2024-04-24T02:12:25.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.781+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3c071910 con 0x7f5e34019040 2024-04-24T02:12:25.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.781+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cfc3d0 con 0x7f5e2c0467d0 2024-04-24T02:12:25.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.782+0000 7f5e432d6640 1 -- 172.21.15.134:0/3468306283 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3402f040 con 0x7f5e2c0467d0 2024-04-24T02:12:25.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.782+0000 7f5e432d6640 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cfc3d0 con 0x55b7b0cf9a00 2024-04-24T02:12:25.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.782+0000 7f5e422d4640 1 -- 172.21.15.134:0/3468306283 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e2c009050 con 0x55b7b0cf9a00 2024-04-24T02:12:25.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.782+0000 7f5e422d4640 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cfc3d0 con 0x55b7b0cf3800 2024-04-24T02:12:25.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.782+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3c071910 con 0x55b7b0cf3800 2024-04-24T02:12:25.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.782+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cfc3d0 con 0x7f5e34019040 2024-04-24T02:12:25.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.782+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3c071910 con 0x7f5e34019040 2024-04-24T02:12:25.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.782+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cfc3d0 con 0x55b7b0cf3800 2024-04-24T02:12:25.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.782+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3c071910 con 0x55b7b0cf3800 2024-04-24T02:12:25.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.782+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cfc3d0 con 0x7f5e2c0467d0 2024-04-24T02:12:25.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.783+0000 7f5e432d6640 1 -- 172.21.15.134:0/3468306283 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5e3402f040 con 0x7f5e2c0467d0 2024-04-24T02:12:25.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.783+0000 7f5e432d6640 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cfc3d0 con 0x55b7b0cf9a00 2024-04-24T02:12:25.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.783+0000 7f5e422d4640 1 -- 172.21.15.134:0/3468306283 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e2c009050 con 0x55b7b0cf9a00 2024-04-24T02:12:25.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.783+0000 7f5e422d4640 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cfc3d0 con 0x55b7b0cf9a00 2024-04-24T02:12:25.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.783+0000 7f5e422d4640 1 -- 172.21.15.134:0/3468306283 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e2c009050 con 0x55b7b0cf9a00 2024-04-24T02:12:25.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.783+0000 7f5e422d4640 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cfc3d0 con 0x7f5e34019040 2024-04-24T02:12:25.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.783+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3c071910 con 0x7f5e34019040 2024-04-24T02:12:25.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.783+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cfc3d0 con 0x55b7b0cf9a00 2024-04-24T02:12:25.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.784+0000 7f5e422d4640 1 -- 172.21.15.134:0/3468306283 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e2c009050 con 0x55b7b0cf9a00 2024-04-24T02:12:25.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.784+0000 7f5e422d4640 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cfc3d0 con 0x55b7b0cf9a00 2024-04-24T02:12:25.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.784+0000 7f5e422d4640 1 -- 172.21.15.134:0/3468306283 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e2c009050 con 0x55b7b0cf9a00 2024-04-24T02:12:25.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.784+0000 7f5e422d4640 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cfc3d0 con 0x55b7b0cf3800 2024-04-24T02:12:25.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.784+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3c071910 con 0x55b7b0cf3800 2024-04-24T02:12:25.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.784+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cfc3d0 con 0x55b7b0cf3800 2024-04-24T02:12:25.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.784+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f5e3c071910 con 0x55b7b0cf3800 2024-04-24T02:12:25.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.784+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cfc3d0 con 0x7f5e34019040 2024-04-24T02:12:25.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.784+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3c071910 con 0x7f5e34019040 2024-04-24T02:12:25.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.784+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cfc3d0 con 0x55b7b0cf9a00 2024-04-24T02:12:25.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.785+0000 7f5e422d4640 1 -- 172.21.15.134:0/3468306283 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e2c009050 con 0x55b7b0cf9a00 2024-04-24T02:12:25.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.785+0000 7f5e422d4640 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cfc3d0 con 0x7f5e2c0467d0 2024-04-24T02:12:25.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.785+0000 7f5e432d6640 1 -- 172.21.15.134:0/3468306283 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3402f040 con 0x7f5e2c0467d0 2024-04-24T02:12:25.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.785+0000 7f5e432d6640 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cfc3d0 con 0x55b7b0cf3800 2024-04-24T02:12:25.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.785+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3c071910 con 0x55b7b0cf3800 2024-04-24T02:12:25.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.785+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cfc3d0 con 0x7f5e34019040 2024-04-24T02:12:25.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.785+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3c071910 con 0x7f5e34019040 2024-04-24T02:12:25.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.785+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cfc3d0 con 0x55b7b0cf9a00 2024-04-24T02:12:25.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.786+0000 7f5e422d4640 1 -- 172.21.15.134:0/3468306283 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e2c009050 con 0x55b7b0cf9a00 2024-04-24T02:12:25.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.786+0000 7f5e422d4640 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cfc3d0 con 0x7f5e34019040 2024-04-24T02:12:25.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.786+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3c071910 con 0x7f5e34019040 2024-04-24T02:12:25.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.786+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cfc3d0 con 0x7f5e2c0467d0 2024-04-24T02:12:25.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.786+0000 7f5e432d6640 1 -- 172.21.15.134:0/3468306283 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3402f040 con 0x7f5e2c0467d0 2024-04-24T02:12:25.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.786+0000 7f5e432d6640 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cfc3d0 con 0x55b7b0cf9a00 2024-04-24T02:12:25.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.786+0000 7f5e422d4640 1 -- 172.21.15.134:0/3468306283 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e2c009050 con 0x55b7b0cf9a00 2024-04-24T02:12:25.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.786+0000 7f5e422d4640 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cfc3d0 con 0x7f5e34019040 2024-04-24T02:12:25.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.787+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3c071910 con 0x7f5e34019040 2024-04-24T02:12:25.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.787+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cfc3d0 con 0x55b7b0cf3800 2024-04-24T02:12:25.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.787+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5e3c071910 con 0x55b7b0cf3800 2024-04-24T02:12:25.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.787+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cfc3d0 con 0x7f5e2c0467d0 2024-04-24T02:12:25.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.787+0000 7f5e432d6640 1 -- 172.21.15.134:0/3468306283 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3402f040 con 0x7f5e2c0467d0 2024-04-24T02:12:25.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.787+0000 7f5e47e3e800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:25.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.787+0000 7f5e47e3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:25.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.787+0000 7f5e47e3e800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:25.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.787+0000 7f5e47e3e800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:25.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.787+0000 7f5e47e3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:25.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.787+0000 7f5e47e3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:25.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.787+0000 7f5e47e3e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.787+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cf8610 con 0x55b7b0cf3800 2024-04-24T02:12:25.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.787+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e3c071910 con 0x55b7b0cf3800 2024-04-24T02:12:25.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.787+0000 7f5e47e3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:25.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.787+0000 7f5e47e3e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.787+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cf8eb0 con 0x55b7b0cf3800 2024-04-24T02:12:25.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.788+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5e3c071910 con 0x55b7b0cf3800 2024-04-24T02:12:25.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.788+0000 7f5e47e3e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:25.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.788+0000 7f5e47e3e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.788+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cf8250 con 0x55b7b0cf3800 2024-04-24T02:12:25.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.788+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5e3c071910 con 0x55b7b0cf3800 2024-04-24T02:12:25.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.788+0000 7f5e47e3e800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:25.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.788+0000 7f5e47e3e800 20 zone default found 2024-04-24T02:12:25.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.788+0000 7f5e47e3e800 4 Realm: () 2024-04-24T02:12:25.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.788+0000 7f5e47e3e800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:25.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.788+0000 7f5e47e3e800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:25.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.788+0000 7f5e47e3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:25.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.788+0000 7f5e47e3e800 20 zonegroup default 2024-04-24T02:12:25.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.788+0000 7f5e47e3e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.788+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cfc830 con 0x7f5e34019040 2024-04-24T02:12:25.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.788+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5e3c071910 con 0x7f5e34019040 2024-04-24T02:12:25.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.788+0000 7f5e47e3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:25.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.788+0000 7f5e47e3e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.788+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cfe6c0 con 0x55b7b0cf9a00 2024-04-24T02:12:25.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.788+0000 7f5e422d4640 1 -- 172.21.15.134:0/3468306283 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5e2c009050 con 0x55b7b0cf9a00 2024-04-24T02:12:25.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.788+0000 7f5e47e3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:25.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.788+0000 7f5e47e3e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.788+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cfea60 con 0x55b7b0cf9a00 2024-04-24T02:12:25.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.789+0000 7f5e422d4640 1 -- 172.21.15.134:0/3468306283 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5e2c009050 con 0x55b7b0cf9a00 2024-04-24T02:12:25.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.789+0000 7f5e47e3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:25.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.789+0000 7f5e47e3e800 20 started sync module instance, tier type = 2024-04-24T02:12:25.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.789+0000 7f5e47e3e800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:25.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.789+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cfdb00 con 0x7f5e2c0467d0 2024-04-24T02:12:25.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.790+0000 7f5e432d6640 1 -- 172.21.15.134:0/3468306283 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3402f040 con 0x7f5e2c0467d0 2024-04-24T02:12:25.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.790+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94247433789472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cfdb00 con 0x7f5e2c0467d0 2024-04-24T02:12:25.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.790+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cff460 con 0x55b7b0cf3800 2024-04-24T02:12:25.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.791+0000 7f5e432d6640 1 -- 172.21.15.134:0/3468306283 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94247433789472] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3402f040 con 0x7f5e2c0467d0 2024-04-24T02:12:25.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.791+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3c071910 con 0x55b7b0cf3800 2024-04-24T02:12:25.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.791+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94247433793392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cfdb00 con 0x55b7b0cf3800 2024-04-24T02:12:25.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.791+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cffef0 con 0x55b7b0cf9a00 2024-04-24T02:12:25.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.792+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94247433793392] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3c071910 con 0x55b7b0cf3800 2024-04-24T02:12:25.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.792+0000 7f5e422d4640 1 -- 172.21.15.134:0/3468306283 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e2c009050 con 0x55b7b0cf9a00 2024-04-24T02:12:25.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.792+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94247433786960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0cfda70 con 0x55b7b0cf9a00 2024-04-24T02:12:25.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.792+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0d00c90 con 0x7f5e2c0467d0 2024-04-24T02:12:25.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.793+0000 7f5e422d4640 1 -- 172.21.15.134:0/3468306283 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94247433786960] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e2c009050 con 0x55b7b0cf9a00 2024-04-24T02:12:25.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.793+0000 7f5e432d6640 1 -- 172.21.15.134:0/3468306283 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3402f040 con 0x7f5e2c0467d0 2024-04-24T02:12:25.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.793+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94247433798368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0d010b0 con 0x7f5e2c0467d0 2024-04-24T02:12:25.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.793+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0d01ab0 con 0x55b7b0cf3800 2024-04-24T02:12:25.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.794+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3c071910 con 0x55b7b0cf3800 2024-04-24T02:12:25.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.794+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94247433803200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0d01a20 con 0x55b7b0cf3800 2024-04-24T02:12:25.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.794+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0d02aa0 con 0x7f5e34019040 2024-04-24T02:12:25.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.794+0000 7f5e432d6640 1 -- 172.21.15.134:0/3468306283 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94247433798368] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3402f040 con 0x7f5e2c0467d0 2024-04-24T02:12:25.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.795+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3c071910 con 0x7f5e34019040 2024-04-24T02:12:25.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.795+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94247433807216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0d02a60 con 0x7f5e34019040 2024-04-24T02:12:25.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.795+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0d034b0 con 0x7f5e34019040 2024-04-24T02:12:25.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.795+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94247433803200] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3c071910 con 0x55b7b0cf3800 2024-04-24T02:12:25.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.796+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94247433807216] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3c071910 con 0x7f5e34019040 2024-04-24T02:12:25.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.796+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(56 notify.6 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3c071910 con 0x7f5e34019040 2024-04-24T02:12:25.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.796+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94247433799424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0d03000 con 0x7f5e34019040 2024-04-24T02:12:25.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.796+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0d039c0 con 0x7f5e34019040 2024-04-24T02:12:25.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.797+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(58 notify.7 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3c071910 con 0x7f5e34019040 2024-04-24T02:12:25.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.797+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94247433799424] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3c071910 con 0x7f5e34019040 2024-04-24T02:12:25.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.797+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94247433811216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0d03de0 con 0x7f5e34019040 2024-04-24T02:12:25.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.797+0000 7f5e47e3e800 20 add_watcher() i=0 2024-04-24T02:12:25.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.797+0000 7f5e47e3e800 20 add_watcher() i=1 2024-04-24T02:12:25.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.797+0000 7f5e47e3e800 20 add_watcher() i=2 2024-04-24T02:12:25.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.797+0000 7f5e47e3e800 20 add_watcher() i=3 2024-04-24T02:12:25.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.797+0000 7f5e47e3e800 20 add_watcher() i=4 2024-04-24T02:12:25.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.797+0000 7f5e47e3e800 20 add_watcher() i=5 2024-04-24T02:12:25.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.797+0000 7f5e47e3e800 20 add_watcher() i=6 2024-04-24T02:12:25.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.798+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94247433811216] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3c071910 con 0x7f5e34019040 2024-04-24T02:12:25.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.798+0000 7f5e47e3e800 20 add_watcher() i=7 2024-04-24T02:12:25.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.798+0000 7f5e47e3e800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:25.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.798+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0d03de0 con 0x55b7b0cf3800 2024-04-24T02:12:25.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.798+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5e3c071910 con 0x55b7b0cf3800 2024-04-24T02:12:25.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.799+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94247433812272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0d03d80 con 0x55b7b0cf3800 2024-04-24T02:12:25.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.799+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94247433812272] v30'107 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5e3c071910 con 0x55b7b0cf3800 2024-04-24T02:12:25.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.800+0000 7f5cf97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:25.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.800+0000 7f5e47e3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:25.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.800+0000 7f5e47e3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:25.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.800+0000 7f5e47e3e800 5 note: GC not initialized 2024-04-24T02:12:25.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.800+0000 7f5c73fff640 20 reqs_thread_entry: start 2024-04-24T02:12:25.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.800+0000 7f5e47e3e800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:25.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.800+0000 7f5e47e3e800 20 Filter name: none 2024-04-24T02:12:25.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.800+0000 7f5c71ffb640 20 reqs_thread_entry: start 2024-04-24T02:12:25.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.800+0000 7f5e47e3e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.800+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0d3a170 con 0x7f5e2c0467d0 2024-04-24T02:12:25.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.801+0000 7f5e432d6640 1 -- 172.21.15.134:0/3468306283 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f5e3402f040 con 0x7f5e2c0467d0 2024-04-24T02:12:25.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.801+0000 7f5e47e3e800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T02:12:25.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.801+0000 7f5e47e3e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.801+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:63 8.1d 8:be2d2b4a:root::.bucket.meta.myfoo%3a582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0d3aa00 con 0x7f5e34019040 2024-04-24T02:12:25.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.801+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(63 .bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f5e3c071910 con 0x7f5e34019040 2024-04-24T02:12:25.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.801+0000 7f5e47e3e800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T02:12:25.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.801+0000 7f5e47e3e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-24T02:12:25.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.801+0000 7f5e47e3e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.801+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0d39510 con 0x7f5e2c0467d0 2024-04-24T02:12:25.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.801+0000 7f5e432d6640 1 -- 172.21.15.134:0/3468306283 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f5e3402f040 con 0x7f5e2c0467d0 2024-04-24T02:12:25.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.801+0000 7f5e47e3e800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T02:12:25.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.802+0000 7f5e47e3e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.802+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:65 8.1d 8:be2d2b4a:root::.bucket.meta.myfoo%3a582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0d3c060 con 0x7f5e34019040 2024-04-24T02:12:25.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.802+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(65 .bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f5e3c071910 con 0x7f5e34019040 2024-04-24T02:12:25.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.802+0000 7f5e47e3e800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T02:12:25.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.802+0000 7f5e47e3e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-24T02:12:25.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.802+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:66 4.2f 4:f4626d03:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0d3d8f0 con 0x55b7b0cf3800 2024-04-24T02:12:25.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.802+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:67 4.2f 4:f41e46b8:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0d402a0 con 0x55b7b0cf3800 2024-04-24T02:12:25.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.802+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:68 4.39 4:9e407d1f:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0d42ec0 con 0x55b7b0cf9a00 2024-04-24T02:12:25.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.802+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:69 4.3 4:c3c22538:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0d402a0 con 0x55b7b0cf3800 2024-04-24T02:12:25.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.802+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:70 4.b 4:d224abc6:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0d48030 con 0x7f5e2c0467d0 2024-04-24T02:12:25.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.802+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:71 4.e 4:706a3c35:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0d4a500 con 0x7f5e2c0467d0 2024-04-24T02:12:25.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.802+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:72 4.0 4:009d6733:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0d4d150 con 0x55b7b0cf9a00 2024-04-24T02:12:25.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.802+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:73 4.39 4:9c24c7ad:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0d4ffd0 con 0x55b7b0cf9a00 2024-04-24T02:12:25.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.802+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:74 4.35 4:aece7739:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0d52e60 con 0x55b7b0cf3800 2024-04-24T02:12:25.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.802+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:75 4.24 4:2482d015:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0d55840 con 0x7f5e34019040 2024-04-24T02:12:25.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.802+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(66 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5e3c071910 con 0x55b7b0cf3800 2024-04-24T02:12:25.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.802+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:76 4.0 4:03cc5f7d:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0d3b160 con 0x55b7b0cf9a00 2024-04-24T02:12:25.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.802+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(69 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5e3c071910 con 0x55b7b0cf3800 2024-04-24T02:12:25.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.803+0000 7f5e432d6640 1 -- 172.21.15.134:0/3468306283 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(70 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5e3402f040 con 0x7f5e2c0467d0 2024-04-24T02:12:25.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.803+0000 7f5e422d4640 1 -- 172.21.15.134:0/3468306283 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(68 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5e2c009050 con 0x55b7b0cf9a00 2024-04-24T02:12:25.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.803+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(67 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.1 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5e3c071910 con 0x55b7b0cf3800 2024-04-24T02:12:25.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.803+0000 7f5e432d6640 1 -- 172.21.15.134:0/3468306283 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(71 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.5 [call out=124b] v0'0 uv3 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f5e3402f040 con 0x7f5e2c0467d0 2024-04-24T02:12:25.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.803+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(74 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5e3c071910 con 0x55b7b0cf3800 2024-04-24T02:12:25.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.803+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(75 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5e3c071910 con 0x7f5e34019040 2024-04-24T02:12:25.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.803+0000 7f5e422d4640 1 -- 172.21.15.134:0/3468306283 <== osd.3 v2:172.21.15.134:6801/3585115521 15 ==== osd_op_reply(72 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5e2c009050 con 0x55b7b0cf9a00 2024-04-24T02:12:25.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.803+0000 7f5e422d4640 1 -- 172.21.15.134:0/3468306283 <== osd.3 v2:172.21.15.134:6801/3585115521 16 ==== osd_op_reply(73 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5e2c009050 con 0x55b7b0cf9a00 2024-04-24T02:12:25.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.803+0000 7f5e422d4640 1 -- 172.21.15.134:0/3468306283 <== osd.3 v2:172.21.15.134:6801/3585115521 17 ==== osd_op_reply(76 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.10 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5e2c009050 con 0x55b7b0cf9a00 2024-04-24T02:12:25.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.804+0000 7f5cf97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:25.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.804+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94247433812272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0d55840 con 0x55b7b0cf3800 2024-04-24T02:12:25.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.805+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94247433812272] v30'108 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5e3c071910 con 0x55b7b0cf3800 2024-04-24T02:12:25.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.805+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94247433789472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0d22890 con 0x7f5e2c0467d0 2024-04-24T02:12:25.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.806+0000 7f5e432d6640 1 -- 172.21.15.134:0/3468306283 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94247433789472] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3402f040 con 0x7f5e2c0467d0 2024-04-24T02:12:25.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.806+0000 7f5e47e3e800 20 remove_watcher() i=0 2024-04-24T02:12:25.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.806+0000 7f5e47e3e800 2 removed watcher, disabling cache 2024-04-24T02:12:25.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.806+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94247433793392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0d22890 con 0x55b7b0cf3800 2024-04-24T02:12:25.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.807+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94247433793392] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3c071910 con 0x55b7b0cf3800 2024-04-24T02:12:25.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.807+0000 7f5e47e3e800 20 remove_watcher() i=1 2024-04-24T02:12:25.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.807+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94247433786960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0d22890 con 0x55b7b0cf9a00 2024-04-24T02:12:25.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.808+0000 7f5e422d4640 1 -- 172.21.15.134:0/3468306283 <== osd.3 v2:172.21.15.134:6801/3585115521 18 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94247433786960] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e2c009050 con 0x55b7b0cf9a00 2024-04-24T02:12:25.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.808+0000 7f5e47e3e800 20 remove_watcher() i=2 2024-04-24T02:12:25.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.808+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94247433798368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0d22890 con 0x7f5e2c0467d0 2024-04-24T02:12:25.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.809+0000 7f5e432d6640 1 -- 172.21.15.134:0/3468306283 <== osd.2 v2:172.21.15.134:6800/214480313 16 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94247433798368] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3402f040 con 0x7f5e2c0467d0 2024-04-24T02:12:25.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.809+0000 7f5e47e3e800 20 remove_watcher() i=3 2024-04-24T02:12:25.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.809+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94247433803200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0d22890 con 0x55b7b0cf3800 2024-04-24T02:12:25.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.810+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94247433803200] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3c071910 con 0x55b7b0cf3800 2024-04-24T02:12:25.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.810+0000 7f5e47e3e800 20 remove_watcher() i=4 2024-04-24T02:12:25.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.810+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94247433807216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0d22890 con 0x7f5e34019040 2024-04-24T02:12:25.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.812+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.0 v2:172.21.15.104:6800/2419146313 20 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94247433807216] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3c071910 con 0x7f5e34019040 2024-04-24T02:12:25.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.812+0000 7f5e47e3e800 20 remove_watcher() i=5 2024-04-24T02:12:25.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.812+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94247433799424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0d22890 con 0x7f5e34019040 2024-04-24T02:12:25.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.812+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.0 v2:172.21.15.104:6800/2419146313 21 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94247433799424] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3c071910 con 0x7f5e34019040 2024-04-24T02:12:25.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.813+0000 7f5e47e3e800 20 remove_watcher() i=6 2024-04-24T02:12:25.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.813+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94247433811216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7b0d22890 con 0x7f5e34019040 2024-04-24T02:12:25.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.813+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 <== osd.0 v2:172.21.15.104:6800/2419146313 22 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94247433811216] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3c071910 con 0x7f5e34019040 2024-04-24T02:12:25.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.813+0000 7f5e47e3e800 20 remove_watcher() i=7 2024-04-24T02:12:25.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.814+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f5e34019040 msgr2=0x7f5e34019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.814+0000 7f5e47e3e800 1 --2- 172.21.15.134:0/3468306283 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f5e34019040 0x7f5e34019930 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.814+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b7b0cf3800 msgr2=0x55b7b0cf5ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.814+0000 7f5e47e3e800 1 --2- 172.21.15.134:0/3468306283 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b7b0cf3800 0x55b7b0cf5ca0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.814+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f5e2c0467d0 msgr2=0x7f5e2c0152e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.814+0000 7f5e47e3e800 1 --2- 172.21.15.134:0/3468306283 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f5e2c0467d0 0x7f5e2c0152e0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.814+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55b7b0cf9a00 msgr2=0x55b7b0cfbdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.814+0000 7f5e47e3e800 1 --2- 172.21.15.134:0/3468306283 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55b7b0cf9a00 0x55b7b0cfbdf0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.814+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5d0c036900 msgr2=0x7f5d0c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.814+0000 7f5e47e3e800 1 --2- 172.21.15.134:0/3468306283 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5d0c036900 0x7f5d0c038dc0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5e3400f010 tx=0x7f5e3400c040 comp rx=0 tx=0).stop 2024-04-24T02:12:25.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.814+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7b0ce08c0 msgr2=0x55b7b0ce7f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.814+0000 7f5e47e3e800 1 --2- 172.21.15.134:0/3468306283 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7b0ce08c0 0x55b7b0ce7f20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c048010 tx=0x7f5e2c04cda0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.814+0000 7f5e42ad5640 1 -- 172.21.15.134:0/3468306283 reap_dead start 2024-04-24T02:12:25.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.814+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 shutdown_connections 2024-04-24T02:12:25.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.814+0000 7f5e47e3e800 1 --2- 172.21.15.134:0/3468306283 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7b0ce08c0 0x55b7b0ce7f20 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.814+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 >> 172.21.15.134:0/3468306283 conn(0x55b7b0cdcc20 msgr2=0x55b7b0cda280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:25.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.814+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 shutdown_connections 2024-04-24T02:12:25.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.814+0000 7f5e47e3e800 1 -- 172.21.15.134:0/3468306283 wait complete. 2024-04-24T02:12:25.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.814+0000 7f5e47e3e800 1 -- 172.21.15.134:0/2301193247 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5d1c036950 msgr2=0x7f5d1c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.814+0000 7f5e47e3e800 1 --2- 172.21.15.134:0/2301193247 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5d1c036950 0x7f5d1c038e10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x55b7b0cc35d0 tx=0x7f5e34000f90 comp rx=0 tx=0).stop 2024-04-24T02:12:25.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.814+0000 7f5e47e3e800 1 -- 172.21.15.134:0/2301193247 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7b0cd3580 msgr2=0x55b7b0cd39a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.814+0000 7f5e47e3e800 1 --2- 172.21.15.134:0/2301193247 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7b0cd3580 0x55b7b0cd39a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c001ed0 tx=0x7f5e2c00d7a0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.814+0000 7f5e47e3e800 1 -- 172.21.15.134:0/2301193247 shutdown_connections 2024-04-24T02:12:25.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.814+0000 7f5e47e3e800 1 --2- 172.21.15.134:0/2301193247 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5d1c036950 0x7f5d1c038e10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.814+0000 7f5e47e3e800 1 --2- 172.21.15.134:0/2301193247 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7b0cd3580 0x55b7b0cd39a0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.814+0000 7f5e47e3e800 1 -- 172.21.15.134:0/2301193247 >> 172.21.15.134:0/2301193247 conn(0x55b7b0cc7620 msgr2=0x55b7b0cc7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:25.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.814+0000 7f5e47e3e800 1 -- 172.21.15.134:0/2301193247 shutdown_connections 2024-04-24T02:12:25.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.814+0000 7f5e47e3e800 1 -- 172.21.15.134:0/2301193247 wait complete. 2024-04-24T02:12:25.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.815+0000 7f5e47e3e800 1 -- 172.21.15.134:0/2533859493 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b7b0bc1100 msgr2=0x55b7b0cc2370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.815+0000 7f5e47e3e800 1 --2- 172.21.15.134:0/2533859493 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b7b0bc1100 0x55b7b0cc2370 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.815+0000 7f5e47e3e800 1 -- 172.21.15.134:0/2533859493 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5d28036900 msgr2=0x7f5d28038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.815+0000 7f5e47e3e800 1 --2- 172.21.15.134:0/2533859493 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5d28036900 0x7f5d28038dc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c000f60 tx=0x7f5e2c0012b0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.815+0000 7f5e47e3e800 1 -- 172.21.15.134:0/2533859493 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7b0bbff90 msgr2=0x55b7b0cbb130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.815+0000 7f5e47e3e800 1 --2- 172.21.15.134:0/2533859493 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7b0bbff90 0x55b7b0cbb130 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c044920 tx=0x7f5e3c003330 comp rx=0 tx=0).stop 2024-04-24T02:12:25.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.815+0000 7f5e47e3e800 1 -- 172.21.15.134:0/2533859493 shutdown_connections 2024-04-24T02:12:25.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.815+0000 7f5e47e3e800 1 --2- 172.21.15.134:0/2533859493 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b7b0bc1100 0x55b7b0cc2370 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.815+0000 7f5e47e3e800 1 --2- 172.21.15.134:0/2533859493 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5d28036900 0x7f5d28038dc0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.815+0000 7f5e47e3e800 1 --2- 172.21.15.134:0/2533859493 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7b0bbff90 0x55b7b0cbb130 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.815+0000 7f5e47e3e800 1 -- 172.21.15.134:0/2533859493 >> 172.21.15.134:0/2533859493 conn(0x55b7b0bbb530 msgr2=0x55b7b0b34780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:25.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.815+0000 7f5e47e3e800 1 -- 172.21.15.134:0/2533859493 shutdown_connections 2024-04-24T02:12:25.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.815+0000 7f5e47e3e800 1 -- 172.21.15.134:0/2533859493 wait complete. 2024-04-24T02:12:25.832 INFO:teuthology.orchestra.run.smithi134.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"b893fd8a-cafc-4918-98fa-f8aa8e20a508","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1","marker":"582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-04-24T02:12:24.905198Z","creation_time":"2024-04-24T02:12:24.901996Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-04-24T02:12:25.832 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'b893fd8a-cafc-4918-98fa-f8aa8e20a508', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1', 'marker': '582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-24T02:12:24.905198Z', 'creation_time': '2024-04-24T02:12:24.901996Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-04-24T02:12:25.833 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-04-24T02:12:25.833 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-04-24T02:12:25.833 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-04-24T02:12:25.918 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:25.918 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:25.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.918+0000 7f654b92e800 1 Processor -- start 2024-04-24T02:12:25.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.918+0000 7f654b92e800 1 -- start start 2024-04-24T02:12:25.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.918+0000 7f654b92e800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x559e83894990 0x559e83896d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.918+0000 7f654b92e800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559e83752d40 con 0x559e838972c0 2024-04-24T02:12:25.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.918+0000 7f654b92e800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x559e837254d0 con 0x559e83894990 2024-04-24T02:12:25.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.918+0000 7f6547667640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x559e83894990 0x559e83896d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.918+0000 7f6547667640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x559e83894990 0x559e83896d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55828/0 (socket says 172.21.15.134:55828) 2024-04-24T02:12:25.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.918+0000 7f6547667640 1 -- 172.21.15.134:0/2306238441 learned_addr learned my addr 172.21.15.134:0/2306238441 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:25.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.918+0000 7f653ee66640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x559e838972c0 0x559e838996b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:55246/0 (socket says 172.21.15.134:55246) 2024-04-24T02:12:25.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.918+0000 7f6547667640 1 -- 172.21.15.134:0/2306238441 >> v1:172.21.15.104:6789/0 conn(0x559e838972c0 legacy=0x559e838996b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.918+0000 7f6547667640 1 -- 172.21.15.134:0/2306238441 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e83751590 con 0x559e83894990 2024-04-24T02:12:25.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.920+0000 7f6547667640 1 --2- 172.21.15.134:0/2306238441 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e83894990 0x559e83896d80 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f653800a520 tx=0x7f653801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbbf13d84c66f7fa server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.921+0000 7f6546e66640 1 -- 172.21.15.134:0/2306238441 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6538057070 con 0x559e83894990 2024-04-24T02:12:25.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.921+0000 7f6546e66640 1 -- 172.21.15.134:0/2306238441 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6538052570 con 0x559e83894990 2024-04-24T02:12:25.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.921+0000 7f6546e66640 1 -- 172.21.15.134:0/2306238441 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f653804ae60 con 0x559e83894990 2024-04-24T02:12:25.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.921+0000 7f654b92e800 1 -- 172.21.15.134:0/2306238441 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e83894990 msgr2=0x559e83896d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.921+0000 7f654b92e800 1 --2- 172.21.15.134:0/2306238441 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e83894990 0x559e83896d80 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f653800a520 tx=0x7f653801d010 comp rx=0 tx=0).stop 2024-04-24T02:12:25.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.921+0000 7f654b92e800 1 -- 172.21.15.134:0/2306238441 shutdown_connections 2024-04-24T02:12:25.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.921+0000 7f654b92e800 1 --2- 172.21.15.134:0/2306238441 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e83894990 0x559e83896d80 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.921+0000 7f654b92e800 1 -- 172.21.15.134:0/2306238441 >> 172.21.15.134:0/2306238441 conn(0x559e8388e340 msgr2=0x559e83890760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:25.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.921+0000 7f654b92e800 1 -- 172.21.15.134:0/2306238441 shutdown_connections 2024-04-24T02:12:25.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.921+0000 7f654b92e800 1 -- 172.21.15.134:0/2306238441 wait complete. 2024-04-24T02:12:25.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.933+0000 7f654b92e800 1 Processor -- start 2024-04-24T02:12:25.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.933+0000 7f654b92e800 1 -- start start 2024-04-24T02:12:25.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.933+0000 7f654b92e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e83894990 0x559e83985130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.933+0000 7f654b92e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x559e837df3b0 con 0x559e83894990 2024-04-24T02:12:25.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.933+0000 7f6547667640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e83894990 0x559e83985130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.933+0000 7f6547667640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e83894990 0x559e83985130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55842/0 (socket says 172.21.15.134:55842) 2024-04-24T02:12:25.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.933+0000 7f6547667640 1 -- 172.21.15.134:0/2058830339 learned_addr learned my addr 172.21.15.134:0/2058830339 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:25.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.934+0000 7f6547667640 1 -- 172.21.15.134:0/2058830339 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e83985700 con 0x559e83894990 2024-04-24T02:12:25.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.934+0000 7f6547667640 1 --2- 172.21.15.134:0/2058830339 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e83894990 0x559e83985130 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6538055040 tx=0x7f653804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=299959fd7f622ec server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.934+0000 7f643560a640 1 -- 172.21.15.134:0/2058830339 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6538057040 con 0x559e83894990 2024-04-24T02:12:25.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.934+0000 7f643560a640 1 -- 172.21.15.134:0/2058830339 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6538052720 con 0x559e83894990 2024-04-24T02:12:25.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.934+0000 7f643560a640 1 -- 172.21.15.134:0/2058830339 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6538052a40 con 0x559e83894990 2024-04-24T02:12:25.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.934+0000 7f654b92e800 1 -- 172.21.15.134:0/2058830339 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e83894990 msgr2=0x559e83985130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.935+0000 7f654b92e800 1 --2- 172.21.15.134:0/2058830339 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e83894990 0x559e83985130 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6538055040 tx=0x7f653804c000 comp rx=0 tx=0).stop 2024-04-24T02:12:25.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.935+0000 7f654b92e800 1 -- 172.21.15.134:0/2058830339 shutdown_connections 2024-04-24T02:12:25.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.935+0000 7f654b92e800 1 --2- 172.21.15.134:0/2058830339 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e83894990 0x559e83985130 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.935+0000 7f654b92e800 1 -- 172.21.15.134:0/2058830339 >> 172.21.15.134:0/2058830339 conn(0x559e8388e340 msgr2=0x559e83980a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:25.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.935+0000 7f654b92e800 1 -- 172.21.15.134:0/2058830339 shutdown_connections 2024-04-24T02:12:25.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.935+0000 7f654b92e800 1 -- 172.21.15.134:0/2058830339 wait complete. 2024-04-24T02:12:25.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.935+0000 7f654b92e800 1 Processor -- start 2024-04-24T02:12:25.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.935+0000 7f654b92e800 1 -- start start 2024-04-24T02:12:25.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.935+0000 7f654b92e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e83894990 0x559e8398cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.935+0000 7f654b92e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x559e8389d0e0 con 0x559e83894990 2024-04-24T02:12:25.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.935+0000 7f6547667640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e83894990 0x559e8398cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.935+0000 7f6547667640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e83894990 0x559e8398cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55858/0 (socket says 172.21.15.134:55858) 2024-04-24T02:12:25.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.935+0000 7f6547667640 1 -- 172.21.15.134:0/1745445540 learned_addr learned my addr 172.21.15.134:0/1745445540 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:25.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.936+0000 7f6547667640 1 -- 172.21.15.134:0/1745445540 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e8398d080 con 0x559e83894990 2024-04-24T02:12:25.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.936+0000 7f6547667640 1 --2- 172.21.15.134:0/1745445540 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e83894990 0x559e8398cb40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f65380524f0 tx=0x7f6538003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.936+0000 7f6433e07640 1 -- 172.21.15.134:0/1745445540 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6538073070 con 0x559e83894990 2024-04-24T02:12:25.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.936+0000 7f6433e07640 1 -- 172.21.15.134:0/1745445540 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f653805d440 con 0x559e83894990 2024-04-24T02:12:25.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.936+0000 7f654b92e800 1 -- 172.21.15.134:0/1745445540 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559e8398d310 con 0x559e83894990 2024-04-24T02:12:25.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.936+0000 7f6433e07640 1 -- 172.21.15.134:0/1745445540 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6538057070 con 0x559e83894990 2024-04-24T02:12:25.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.936+0000 7f654b92e800 1 -- 172.21.15.134:0/1745445540 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e8398ffc0 con 0x559e83894990 2024-04-24T02:12:25.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.937+0000 7f6433e07640 1 -- 172.21.15.134:0/1745445540 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6538076070 con 0x559e83894990 2024-04-24T02:12:25.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.937+0000 7f6433e07640 1 --2- 172.21.15.134:0/1745445540 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f642c036900 0x7f642c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.937+0000 7f6433e07640 1 -- 172.21.15.134:0/1745445540 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f653808db50 con 0x559e83894990 2024-04-24T02:12:25.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.937+0000 7f653ee66640 1 --2- 172.21.15.134:0/1745445540 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f642c036900 0x7f642c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.937+0000 7f654b92e800 1 --2- 172.21.15.134:0/1745445540 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x559e838972c0 0x559e83993d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.937+0000 7f654b92e800 1 -- 172.21.15.134:0/1745445540 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e839942c0 con 0x559e838972c0 2024-04-24T02:12:25.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.937+0000 7f6547e68640 1 --2- 172.21.15.134:0/1745445540 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x559e838972c0 0x559e83993d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.937+0000 7f653ee66640 1 --2- 172.21.15.134:0/1745445540 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f642c036900 0x7f642c038dc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6530000f60 tx=0x7f6530001370 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.937+0000 7f6547e68640 1 --2- 172.21.15.134:0/1745445540 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x559e838972c0 0x559e83993d80 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.938+0000 7f6547e68640 1 -- 172.21.15.134:0/1745445540 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f654000a4a0 con 0x559e838972c0 2024-04-24T02:12:25.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.938+0000 7f654b92e800 1 -- 172.21.15.134:0/1745445540 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e83991350 con 0x559e838972c0 2024-04-24T02:12:25.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.938+0000 7f6547e68640 1 -- 172.21.15.134:0/1745445540 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f654000a4a0 con 0x559e838972c0 2024-04-24T02:12:25.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.938+0000 7f654b92e800 1 -- 172.21.15.134:0/1745445540 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e83996100 con 0x559e838972c0 2024-04-24T02:12:25.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.938+0000 7f6547e68640 1 -- 172.21.15.134:0/1745445540 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f654000a4a0 con 0x559e838972c0 2024-04-24T02:12:25.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.938+0000 7f654b92e800 1 -- 172.21.15.134:0/1745445540 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e83995440 con 0x559e838972c0 2024-04-24T02:12:25.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.939+0000 7f6547e68640 1 -- 172.21.15.134:0/1745445540 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f654000a4a0 con 0x559e838972c0 2024-04-24T02:12:25.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.939+0000 7f654b92e800 1 -- 172.21.15.134:0/1745445540 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e839957e0 con 0x559e838972c0 2024-04-24T02:12:25.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.939+0000 7f6547e68640 1 -- 172.21.15.134:0/1745445540 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f654000a4a0 con 0x559e838972c0 2024-04-24T02:12:25.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.939+0000 7f654b92e800 1 Processor -- start 2024-04-24T02:12:25.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.939+0000 7f654b92e800 1 -- start start 2024-04-24T02:12:25.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.939+0000 7f654b92e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e839a4f20 0x559e839a5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.939+0000 7f654b92e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x559e837856b0 con 0x559e839a4f20 2024-04-24T02:12:25.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.940+0000 7f653ee66640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e839a4f20 0x559e839a5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.940+0000 7f653ee66640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e839a4f20 0x559e839a5340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55866/0 (socket says 172.21.15.134:55866) 2024-04-24T02:12:25.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.940+0000 7f653ee66640 1 -- 172.21.15.134:0/2582539117 learned_addr learned my addr 172.21.15.134:0/2582539117 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:25.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.940+0000 7f653ee66640 1 -- 172.21.15.134:0/2582539117 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e839a5880 con 0x559e839a4f20 2024-04-24T02:12:25.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.940+0000 7f653ee66640 1 --2- 172.21.15.134:0/2582539117 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e839a4f20 0x559e839a5340 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6530001ed0 tx=0x7f653000ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.940+0000 7f6431602640 1 -- 172.21.15.134:0/2582539117 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6530022070 con 0x559e839a4f20 2024-04-24T02:12:25.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.940+0000 7f6431602640 1 -- 172.21.15.134:0/2582539117 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f653000d520 con 0x559e839a4f20 2024-04-24T02:12:25.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.940+0000 7f654b92e800 1 -- 172.21.15.134:0/2582539117 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559e839a62f0 con 0x559e839a4f20 2024-04-24T02:12:25.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.940+0000 7f6431602640 1 -- 172.21.15.134:0/2582539117 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f653000d800 con 0x559e839a4f20 2024-04-24T02:12:25.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.940+0000 7f654b92e800 1 -- 172.21.15.134:0/2582539117 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e839a67f0 con 0x559e839a4f20 2024-04-24T02:12:25.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.941+0000 7f6431602640 1 -- 172.21.15.134:0/2582539117 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6530025070 con 0x559e839a4f20 2024-04-24T02:12:25.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.941+0000 7f6431602640 1 --2- 172.21.15.134:0/2582539117 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6420036900 0x7f6420038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.941+0000 7f6431602640 1 -- 172.21.15.134:0/2582539117 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f653004dc10 con 0x559e839a4f20 2024-04-24T02:12:25.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.941+0000 7f6547e68640 1 --2- 172.21.15.134:0/2582539117 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6420036900 0x7f6420038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.941+0000 7f654b92e800 1 Processor -- start 2024-04-24T02:12:25.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.942+0000 7f654b92e800 1 -- start start 2024-04-24T02:12:25.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.942+0000 7f6547e68640 1 --2- 172.21.15.134:0/2582539117 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6420036900 0x7f6420038dc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x559e83994f60 tx=0x7f6540005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.942+0000 7f654b92e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e839b2260 0x559e839b2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.942+0000 7f654b92e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x559e839859c0 con 0x559e839b2260 2024-04-24T02:12:25.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.942+0000 7f653ee66640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e839b2260 0x559e839b2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.942+0000 7f653ee66640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e839b2260 0x559e839b2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55874/0 (socket says 172.21.15.134:55874) 2024-04-24T02:12:25.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.942+0000 7f653ee66640 1 -- 172.21.15.134:0/2680020470 learned_addr learned my addr 172.21.15.134:0/2680020470 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:25.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.942+0000 7f653ee66640 1 -- 172.21.15.134:0/2680020470 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e839b2c50 con 0x559e839b2260 2024-04-24T02:12:25.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.942+0000 7f653ee66640 1 --2- 172.21.15.134:0/2680020470 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e839b2260 0x559e839b2680 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f653004c120 tx=0x7f6530024740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35a486c632874334 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.942+0000 7f642affd640 1 -- 172.21.15.134:0/2680020470 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f653004a030 con 0x559e839b2260 2024-04-24T02:12:25.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.942+0000 7f642affd640 1 -- 172.21.15.134:0/2680020470 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6530025990 con 0x559e839b2260 2024-04-24T02:12:25.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.942+0000 7f642affd640 1 -- 172.21.15.134:0/2680020470 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6530026730 con 0x559e839b2260 2024-04-24T02:12:25.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.943+0000 7f654b92e800 1 -- 172.21.15.134:0/2680020470 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e839b2260 msgr2=0x559e839b2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.943+0000 7f654b92e800 1 --2- 172.21.15.134:0/2680020470 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e839b2260 0x559e839b2680 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f653004c120 tx=0x7f6530024740 comp rx=0 tx=0).stop 2024-04-24T02:12:25.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.943+0000 7f654b92e800 1 -- 172.21.15.134:0/2680020470 shutdown_connections 2024-04-24T02:12:25.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.943+0000 7f654b92e800 1 --2- 172.21.15.134:0/2680020470 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e839b2260 0x559e839b2680 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.943+0000 7f654b92e800 1 -- 172.21.15.134:0/2680020470 >> 172.21.15.134:0/2680020470 conn(0x559e839ae5c0 msgr2=0x559e839ac620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:25.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.943+0000 7f654b92e800 1 -- 172.21.15.134:0/2680020470 shutdown_connections 2024-04-24T02:12:25.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.943+0000 7f654b92e800 1 -- 172.21.15.134:0/2680020470 wait complete. 2024-04-24T02:12:25.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.943+0000 7f654b92e800 1 Processor -- start 2024-04-24T02:12:25.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.943+0000 7f654b92e800 1 -- start start 2024-04-24T02:12:25.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.943+0000 7f654b92e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e839b2260 0x559e839b98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.943+0000 7f654b92e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x559e839b33c0 con 0x559e839b2260 2024-04-24T02:12:25.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.943+0000 7f653ee66640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e839b2260 0x559e839b98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.943+0000 7f653ee66640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e839b2260 0x559e839b98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55880/0 (socket says 172.21.15.134:55880) 2024-04-24T02:12:25.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.943+0000 7f653ee66640 1 -- 172.21.15.134:0/3080344381 learned_addr learned my addr 172.21.15.134:0/3080344381 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:25.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.944+0000 7f653ee66640 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e839b9e00 con 0x559e839b2260 2024-04-24T02:12:25.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.944+0000 7f653ee66640 1 --2- 172.21.15.134:0/3080344381 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e839b2260 0x559e839b98c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6530024a50 tx=0x7f653004c080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.944+0000 7f64297fa640 1 -- 172.21.15.134:0/3080344381 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6530025570 con 0x559e839b2260 2024-04-24T02:12:25.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.944+0000 7f64297fa640 1 -- 172.21.15.134:0/3080344381 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f653004c2f0 con 0x559e839b2260 2024-04-24T02:12:25.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.944+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559e839b9e00 con 0x559e839b2260 2024-04-24T02:12:25.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.944+0000 7f64297fa640 1 -- 172.21.15.134:0/3080344381 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f653000d9a0 con 0x559e839b2260 2024-04-24T02:12:25.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.944+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e839b9e00 con 0x559e839b2260 2024-04-24T02:12:25.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.945+0000 7f64297fa640 1 -- 172.21.15.134:0/3080344381 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f653000dbe0 con 0x559e839b2260 2024-04-24T02:12:25.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.945+0000 7f64297fa640 1 --2- 172.21.15.134:0/3080344381 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6410036840 0x7f6410038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.945+0000 7f64297fa640 1 -- 172.21.15.134:0/3080344381 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f6530045070 con 0x559e839b2260 2024-04-24T02:12:25.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.945+0000 7f6547e68640 1 --2- 172.21.15.134:0/3080344381 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6410036840 0x7f6410038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.945+0000 7f6547e68640 1 --2- 172.21.15.134:0/3080344381 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6410036840 0x7f6410038d00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x559e839912a0 tx=0x7f654001f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.945+0000 7f654b92e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.945+0000 7f654b92e800 1 --2- 172.21.15.134:0/3080344381 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x559e839c50e0 0x559e839c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.945+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e839c7cf0 con 0x559e839c50e0 2024-04-24T02:12:25.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.946+0000 7f6547667640 1 --2- 172.21.15.134:0/3080344381 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x559e839c50e0 0x559e839c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.946+0000 7f6547667640 1 --2- 172.21.15.134:0/3080344381 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x559e839c50e0 0x559e839c75a0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.946+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6538075030 con 0x559e839c50e0 2024-04-24T02:12:25.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.946+0000 7f654b92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:25.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.946+0000 7f654b92e800 20 realm 2024-04-24T02:12:25.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.946+0000 7f654b92e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.946+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e839c8100 con 0x559e839c50e0 2024-04-24T02:12:25.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.946+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6538075030 con 0x559e839c50e0 2024-04-24T02:12:25.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.946+0000 7f654b92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:25.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.946+0000 7f654b92e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:25.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.946+0000 7f654b92e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.946+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e839c89d0 con 0x559e839c50e0 2024-04-24T02:12:25.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.946+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6538075030 con 0x559e839c50e0 2024-04-24T02:12:25.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.946+0000 7f654b92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:25.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.946+0000 7f654b92e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.946+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e839c8d70 con 0x559e839c50e0 2024-04-24T02:12:25.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.947+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6538075030 con 0x559e839c50e0 2024-04-24T02:12:25.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.947+0000 7f654b92e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:25.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.947+0000 7f654b92e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.947+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e839c91d0 con 0x559e839c50e0 2024-04-24T02:12:25.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.947+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6538075030 con 0x559e839c50e0 2024-04-24T02:12:25.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.947+0000 7f654b92e800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:25.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.947+0000 7f654b92e800 20 searching for the correct realm 2024-04-24T02:12:25.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.947+0000 7f654b92e800 1 --2- 172.21.15.134:0/3080344381 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x559e839cb1c0 0x559e839cd610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.947+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e839cdce0 con 0x559e839cb1c0 2024-04-24T02:12:25.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.947+0000 7f653ee66640 1 --2- 172.21.15.134:0/3080344381 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x559e839cb1c0 0x559e839cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.947+0000 7f653ee66640 1 --2- 172.21.15.134:0/3080344381 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x559e839cb1c0 0x559e839cd610 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.948+0000 7f653ee66640 1 -- 172.21.15.134:0/3080344381 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6530024030 con 0x559e839cb1c0 2024-04-24T02:12:25.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.948+0000 7f653ee66640 1 --2- 172.21.15.134:0/3080344381 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f653001ac20 0x7f6530035440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.948+0000 7f653ee66640 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e839cdce0 con 0x7f653001ac20 2024-04-24T02:12:25.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.948+0000 7f6547e68640 1 --2- 172.21.15.134:0/3080344381 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f653001ac20 0x7f6530035440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.948+0000 7f6547e68640 1 --2- 172.21.15.134:0/3080344381 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f653001ac20 0x7f6530035440 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.948+0000 7f6547e68640 1 -- 172.21.15.134:0/3080344381 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f654001f070 con 0x7f653001ac20 2024-04-24T02:12:25.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.948+0000 7f6547e68640 1 --2- 172.21.15.134:0/3080344381 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f6540031040 0x7f6540032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:25.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.948+0000 7f6547e68640 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e839cdce0 con 0x7f6540031040 2024-04-24T02:12:25.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.949+0000 7f6547667640 1 --2- 172.21.15.134:0/3080344381 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f6540031040 0x7f6540032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:25.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.949+0000 7f6547667640 1 --2- 172.21.15.134:0/3080344381 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f6540031040 0x7f6540032940 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:25.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.949+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6538075030 con 0x7f6540031040 2024-04-24T02:12:25.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.949+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e839cdce0 con 0x559e839c50e0 2024-04-24T02:12:25.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.950+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6538075030 con 0x559e839c50e0 2024-04-24T02:12:25.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.950+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e839cdce0 con 0x559e839c50e0 2024-04-24T02:12:25.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.950+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6538075030 con 0x559e839c50e0 2024-04-24T02:12:25.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.950+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e839cdce0 con 0x7f6540031040 2024-04-24T02:12:25.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.950+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6538075030 con 0x7f6540031040 2024-04-24T02:12:25.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.950+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e839cdce0 con 0x7f6540031040 2024-04-24T02:12:25.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.950+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6538075030 con 0x7f6540031040 2024-04-24T02:12:25.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.950+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e839cdce0 con 0x7f653001ac20 2024-04-24T02:12:25.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.950+0000 7f6547e68640 1 -- 172.21.15.134:0/3080344381 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f654001f070 con 0x7f653001ac20 2024-04-24T02:12:25.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.951+0000 7f6547e68640 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e839cdce0 con 0x559e839cb1c0 2024-04-24T02:12:25.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.951+0000 7f653ee66640 1 -- 172.21.15.134:0/3080344381 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6530024030 con 0x559e839cb1c0 2024-04-24T02:12:25.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.951+0000 7f653ee66640 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e839cdce0 con 0x559e839c50e0 2024-04-24T02:12:25.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.951+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6538075030 con 0x559e839c50e0 2024-04-24T02:12:25.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.951+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e839cdce0 con 0x7f6540031040 2024-04-24T02:12:25.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.951+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6538075030 con 0x7f6540031040 2024-04-24T02:12:25.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.951+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e839cdce0 con 0x559e839c50e0 2024-04-24T02:12:25.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.951+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6538075030 con 0x559e839c50e0 2024-04-24T02:12:25.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.951+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e839cdce0 con 0x7f653001ac20 2024-04-24T02:12:25.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.952+0000 7f6547e68640 1 -- 172.21.15.134:0/3080344381 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f654001f070 con 0x7f653001ac20 2024-04-24T02:12:25.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.952+0000 7f6547e68640 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e839cdce0 con 0x559e839cb1c0 2024-04-24T02:12:25.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.952+0000 7f653ee66640 1 -- 172.21.15.134:0/3080344381 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6530024030 con 0x559e839cb1c0 2024-04-24T02:12:25.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.952+0000 7f653ee66640 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e839cdce0 con 0x559e839cb1c0 2024-04-24T02:12:25.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.952+0000 7f653ee66640 1 -- 172.21.15.134:0/3080344381 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6530024030 con 0x559e839cb1c0 2024-04-24T02:12:25.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.952+0000 7f653ee66640 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e839cdce0 con 0x7f6540031040 2024-04-24T02:12:25.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.952+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6538075030 con 0x7f6540031040 2024-04-24T02:12:25.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.952+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e839cdce0 con 0x559e839cb1c0 2024-04-24T02:12:25.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.953+0000 7f653ee66640 1 -- 172.21.15.134:0/3080344381 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6530024030 con 0x559e839cb1c0 2024-04-24T02:12:25.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.953+0000 7f653ee66640 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e839cdce0 con 0x559e839cb1c0 2024-04-24T02:12:25.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.953+0000 7f653ee66640 1 -- 172.21.15.134:0/3080344381 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6530024030 con 0x559e839cb1c0 2024-04-24T02:12:25.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.953+0000 7f653ee66640 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e839cdce0 con 0x559e839c50e0 2024-04-24T02:12:25.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.953+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6538075030 con 0x559e839c50e0 2024-04-24T02:12:25.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.953+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e839cdce0 con 0x559e839c50e0 2024-04-24T02:12:25.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.953+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f6538075030 con 0x559e839c50e0 2024-04-24T02:12:25.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.953+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e839cdce0 con 0x7f6540031040 2024-04-24T02:12:25.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.954+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6538075030 con 0x7f6540031040 2024-04-24T02:12:25.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.954+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e839cdce0 con 0x559e839cb1c0 2024-04-24T02:12:25.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.954+0000 7f653ee66640 1 -- 172.21.15.134:0/3080344381 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6530024030 con 0x559e839cb1c0 2024-04-24T02:12:25.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.954+0000 7f653ee66640 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e839cdce0 con 0x7f653001ac20 2024-04-24T02:12:25.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.954+0000 7f6547e68640 1 -- 172.21.15.134:0/3080344381 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f654001f070 con 0x7f653001ac20 2024-04-24T02:12:25.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.954+0000 7f6547e68640 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e839cdce0 con 0x559e839c50e0 2024-04-24T02:12:25.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.954+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6538075030 con 0x559e839c50e0 2024-04-24T02:12:25.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.954+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e839cdce0 con 0x7f6540031040 2024-04-24T02:12:25.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.954+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6538075030 con 0x7f6540031040 2024-04-24T02:12:25.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.955+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e839cdce0 con 0x559e839cb1c0 2024-04-24T02:12:25.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.955+0000 7f653ee66640 1 -- 172.21.15.134:0/3080344381 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6530024030 con 0x559e839cb1c0 2024-04-24T02:12:25.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.955+0000 7f653ee66640 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e839cdce0 con 0x7f6540031040 2024-04-24T02:12:25.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.955+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6538075030 con 0x7f6540031040 2024-04-24T02:12:25.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.955+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e839cdce0 con 0x7f653001ac20 2024-04-24T02:12:25.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.955+0000 7f6547e68640 1 -- 172.21.15.134:0/3080344381 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f654001f070 con 0x7f653001ac20 2024-04-24T02:12:25.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.955+0000 7f6547e68640 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e839cdce0 con 0x559e839cb1c0 2024-04-24T02:12:25.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.955+0000 7f653ee66640 1 -- 172.21.15.134:0/3080344381 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6530024030 con 0x559e839cb1c0 2024-04-24T02:12:25.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.955+0000 7f653ee66640 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e839cdce0 con 0x7f6540031040 2024-04-24T02:12:25.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.956+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6538075030 con 0x7f6540031040 2024-04-24T02:12:25.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.956+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e839cdce0 con 0x559e839c50e0 2024-04-24T02:12:25.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.956+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6538075030 con 0x559e839c50e0 2024-04-24T02:12:25.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.956+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559e839cdce0 con 0x7f653001ac20 2024-04-24T02:12:25.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.956+0000 7f6547e68640 1 -- 172.21.15.134:0/3080344381 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f654001f070 con 0x7f653001ac20 2024-04-24T02:12:25.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.956+0000 7f654b92e800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:25.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.956+0000 7f654b92e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:25.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.956+0000 7f654b92e800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:25.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.956+0000 7f654b92e800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:25.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.956+0000 7f654b92e800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:25.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.956+0000 7f654b92e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:25.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.956+0000 7f654b92e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.956+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e839c9c10 con 0x559e839c50e0 2024-04-24T02:12:25.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.956+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6538075030 con 0x559e839c50e0 2024-04-24T02:12:25.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.956+0000 7f654b92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:25.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.956+0000 7f654b92e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.956+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e839ca4b0 con 0x559e839c50e0 2024-04-24T02:12:25.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.957+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6538075030 con 0x559e839c50e0 2024-04-24T02:12:25.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.957+0000 7f654b92e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:25.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.957+0000 7f654b92e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.957+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e839c9850 con 0x559e839c50e0 2024-04-24T02:12:25.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.957+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6538075030 con 0x559e839c50e0 2024-04-24T02:12:25.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.957+0000 7f654b92e800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:25.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.957+0000 7f654b92e800 20 zone default found 2024-04-24T02:12:25.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.957+0000 7f654b92e800 4 Realm: () 2024-04-24T02:12:25.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.957+0000 7f654b92e800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:25.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.957+0000 7f654b92e800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:25.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.957+0000 7f654b92e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:25.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.957+0000 7f654b92e800 20 zonegroup default 2024-04-24T02:12:25.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.957+0000 7f654b92e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.957+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e839ce160 con 0x7f6540031040 2024-04-24T02:12:25.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.957+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6538075030 con 0x7f6540031040 2024-04-24T02:12:25.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.958+0000 7f654b92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:25.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.958+0000 7f654b92e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.958+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e839cfff0 con 0x559e839cb1c0 2024-04-24T02:12:25.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.958+0000 7f653ee66640 1 -- 172.21.15.134:0/3080344381 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6530024030 con 0x559e839cb1c0 2024-04-24T02:12:25.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.958+0000 7f654b92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:25.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.958+0000 7f654b92e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.958+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e839d0390 con 0x559e839cb1c0 2024-04-24T02:12:25.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.958+0000 7f653ee66640 1 -- 172.21.15.134:0/3080344381 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6530024030 con 0x559e839cb1c0 2024-04-24T02:12:25.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.958+0000 7f654b92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:25.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.958+0000 7f654b92e800 20 started sync module instance, tier type = 2024-04-24T02:12:25.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.958+0000 7f654b92e800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:25.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.958+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e839cf430 con 0x7f653001ac20 2024-04-24T02:12:25.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.959+0000 7f6547e68640 1 -- 172.21.15.134:0/3080344381 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6540040040 con 0x7f653001ac20 2024-04-24T02:12:25.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.959+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94139301296160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e839cfc40 con 0x7f653001ac20 2024-04-24T02:12:25.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.959+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e839d1200 con 0x559e839c50e0 2024-04-24T02:12:25.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.960+0000 7f6547e68640 1 -- 172.21.15.134:0/3080344381 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94139301296160] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6540040040 con 0x7f653001ac20 2024-04-24T02:12:25.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.960+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6538075030 con 0x559e839c50e0 2024-04-24T02:12:25.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.960+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94139301301584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e839d1620 con 0x559e839c50e0 2024-04-24T02:12:25.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.960+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e839d1fe0 con 0x559e839cb1c0 2024-04-24T02:12:25.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.961+0000 7f653ee66640 1 -- 172.21.15.134:0/3080344381 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6530024030 con 0x559e839cb1c0 2024-04-24T02:12:25.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.961+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94139301301584] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6538075030 con 0x559e839c50e0 2024-04-24T02:12:25.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.961+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94139301302640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e839d1590 con 0x559e839cb1c0 2024-04-24T02:12:25.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.961+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e839d2e50 con 0x7f653001ac20 2024-04-24T02:12:25.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.963+0000 7f653ee66640 1 -- 172.21.15.134:0/3080344381 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94139301302640] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6530024030 con 0x559e839cb1c0 2024-04-24T02:12:25.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.963+0000 7f6547e68640 1 -- 172.21.15.134:0/3080344381 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6540040040 con 0x7f653001ac20 2024-04-24T02:12:25.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.963+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94139301308832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e839d2dc0 con 0x7f653001ac20 2024-04-24T02:12:25.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.963+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e839d3d10 con 0x559e839c50e0 2024-04-24T02:12:25.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.964+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6538075030 con 0x559e839c50e0 2024-04-24T02:12:25.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.964+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94139301312608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e839d4130 con 0x559e839c50e0 2024-04-24T02:12:25.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.964+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e839d4ba0 con 0x7f6540031040 2024-04-24T02:12:25.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.964+0000 7f6547e68640 1 -- 172.21.15.134:0/3080344381 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94139301308832] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6540040040 con 0x7f653001ac20 2024-04-24T02:12:25.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.965+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94139301312608] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6538075030 con 0x559e839c50e0 2024-04-24T02:12:25.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.965+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6538075030 con 0x7f6540031040 2024-04-24T02:12:25.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.965+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94139301316208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e839d3c80 con 0x7f6540031040 2024-04-24T02:12:25.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.965+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e839d5440 con 0x7f6540031040 2024-04-24T02:12:25.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.966+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(56 notify.6 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6538075030 con 0x7f6540031040 2024-04-24T02:12:25.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.966+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94139301318256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e839d5740 con 0x7f6540031040 2024-04-24T02:12:25.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.966+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e839d5f90 con 0x7f6540031040 2024-04-24T02:12:25.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.966+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94139301316208] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6538075030 con 0x7f6540031040 2024-04-24T02:12:25.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.967+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94139301318256] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6538075030 con 0x7f6540031040 2024-04-24T02:12:25.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.967+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(58 notify.7 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6538075030 con 0x7f6540031040 2024-04-24T02:12:25.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.967+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94139301311040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e839d5c40 con 0x7f6540031040 2024-04-24T02:12:25.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.967+0000 7f654b92e800 20 add_watcher() i=0 2024-04-24T02:12:25.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.967+0000 7f654b92e800 20 add_watcher() i=1 2024-04-24T02:12:25.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.967+0000 7f654b92e800 20 add_watcher() i=2 2024-04-24T02:12:25.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.967+0000 7f654b92e800 20 add_watcher() i=3 2024-04-24T02:12:25.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.967+0000 7f654b92e800 20 add_watcher() i=4 2024-04-24T02:12:25.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.967+0000 7f654b92e800 20 add_watcher() i=5 2024-04-24T02:12:25.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.967+0000 7f654b92e800 20 add_watcher() i=6 2024-04-24T02:12:25.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.967+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94139301311040] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6538075030 con 0x7f6540031040 2024-04-24T02:12:25.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.967+0000 7f654b92e800 20 add_watcher() i=7 2024-04-24T02:12:25.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.967+0000 7f654b92e800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:25.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.967+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e839d8dd0 con 0x559e839c50e0 2024-04-24T02:12:25.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.968+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6538075030 con 0x559e839c50e0 2024-04-24T02:12:25.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.968+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94139301320448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e839d5fd0 con 0x559e839c50e0 2024-04-24T02:12:25.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.969+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94139301320448] v30'109 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6538075030 con 0x559e839c50e0 2024-04-24T02:12:25.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.969+0000 7f63fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:25.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.969+0000 7f654b92e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:25.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.969+0000 7f654b92e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:25.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.969+0000 7f654b92e800 5 note: GC not initialized 2024-04-24T02:12:25.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.969+0000 7f63fcfe1640 20 reqs_thread_entry: start 2024-04-24T02:12:25.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.969+0000 7f654b92e800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:25.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.969+0000 7f654b92e800 20 Filter name: none 2024-04-24T02:12:25.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.969+0000 7f63767fc640 20 reqs_thread_entry: start 2024-04-24T02:12:25.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.970+0000 7f654b92e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.970+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e83a0bc80 con 0x559e839c50e0 2024-04-24T02:12:25.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.970+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f6538075030 con 0x559e839c50e0 2024-04-24T02:12:25.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.970+0000 7f654b92e800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T02:12:25.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.970+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e83a0d1d0 con 0x7f653001ac20 2024-04-24T02:12:25.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.970+0000 7f6547e68640 1 -- 172.21.15.134:0/3080344381 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f6540040040 con 0x7f653001ac20 2024-04-24T02:12:25.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.970+0000 7f654b92e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.970+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:64 8.1d 8:be2d2b4a:root::.bucket.meta.myfoo%3a582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e83a0d1d0 con 0x7f6540031040 2024-04-24T02:12:25.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.971+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(64 .bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f6538075030 con 0x7f6540031040 2024-04-24T02:12:25.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.971+0000 7f654b92e800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T02:12:25.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.971+0000 7f654b92e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-24T02:12:25.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.971+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 4.2f 4:f4626d03:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e83a0ec90 con 0x559e839c50e0 2024-04-24T02:12:25.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.971+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:66 4.2f 4:f41e46b8:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e83a11900 con 0x559e839c50e0 2024-04-24T02:12:25.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.971+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:67 4.39 4:9e407d1f:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e83a14320 con 0x559e839cb1c0 2024-04-24T02:12:25.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.971+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 4.3 4:c3c22538:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e83a16b90 con 0x559e839c50e0 2024-04-24T02:12:25.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.971+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:69 4.b 4:d224abc6:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e83a197b0 con 0x7f653001ac20 2024-04-24T02:12:25.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.971+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:70 4.e 4:706a3c35:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e83a1c0f0 con 0x7f653001ac20 2024-04-24T02:12:25.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.971+0000 7f653ee66640 1 -- 172.21.15.134:0/3080344381 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(67 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6530024030 con 0x559e839cb1c0 2024-04-24T02:12:25.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.971+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:71 4.0 4:009d6733:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e83a1ed20 con 0x559e839cb1c0 2024-04-24T02:12:25.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.971+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:72 4.39 4:9c24c7ad:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e83a13e70 con 0x559e839cb1c0 2024-04-24T02:12:25.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.972+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:73 4.35 4:aece7739:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e83a197b0 con 0x559e839c50e0 2024-04-24T02:12:25.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.972+0000 7f6547e68640 1 -- 172.21.15.134:0/3080344381 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(69 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6540040040 con 0x7f653001ac20 2024-04-24T02:12:25.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.972+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:74 4.24 4:2482d015:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e83a13e70 con 0x7f6540031040 2024-04-24T02:12:25.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.972+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:75 4.0 4:03cc5f7d:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e83a24560 con 0x559e839cb1c0 2024-04-24T02:12:25.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.972+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(65 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6538075030 con 0x559e839c50e0 2024-04-24T02:12:25.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.972+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(68 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6538075030 con 0x559e839c50e0 2024-04-24T02:12:25.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.972+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(66 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.1 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6538075030 con 0x559e839c50e0 2024-04-24T02:12:25.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.972+0000 7f653ee66640 1 -- 172.21.15.134:0/3080344381 <== osd.3 v2:172.21.15.134:6801/3585115521 15 ==== osd_op_reply(71 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6530024030 con 0x559e839cb1c0 2024-04-24T02:12:25.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.972+0000 7f6547e68640 1 -- 172.21.15.134:0/3080344381 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(70 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.5 [call out=124b] v0'0 uv3 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f6540040040 con 0x7f653001ac20 2024-04-24T02:12:25.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.972+0000 7f653ee66640 1 -- 172.21.15.134:0/3080344381 <== osd.3 v2:172.21.15.134:6801/3585115521 16 ==== osd_op_reply(72 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6530024030 con 0x559e839cb1c0 2024-04-24T02:12:25.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.972+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(73 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6538075030 con 0x559e839c50e0 2024-04-24T02:12:25.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.972+0000 7f653ee66640 1 -- 172.21.15.134:0/3080344381 <== osd.3 v2:172.21.15.134:6801/3585115521 17 ==== osd_op_reply(75 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.10 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f6530024030 con 0x559e839cb1c0 2024-04-24T02:12:25.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.972+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(74 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6538075030 con 0x7f6540031040 2024-04-24T02:12:25.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.972+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e83a197b0 con 0x7f653001ac20 2024-04-24T02:12:25.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.973+0000 7f6547e68640 1 -- 172.21.15.134:0/3080344381 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(76 foo.buckets [call] v30'15 uv15 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f6540040040 con 0x7f653001ac20 2024-04-24T02:12:25.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.973+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e83a197b0 con 0x7f653001ac20 2024-04-24T02:12:25.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.974+0000 7f6547e68640 1 -- 172.21.15.134:0/3080344381 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(77 foo.buckets [call] v30'16 uv16 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f6540040040 con 0x7f653001ac20 2024-04-24T02:12:25.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.974+0000 7f654b92e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:25.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.974+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e83a197b0 con 0x559e839c50e0 2024-04-24T02:12:25.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.974+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(78 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f6538075030 con 0x559e839c50e0 2024-04-24T02:12:25.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.974+0000 7f654b92e800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T02:12:25.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.974+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559e83a197b0 con 0x7f653001ac20 2024-04-24T02:12:25.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.975+0000 7f6547e68640 1 -- 172.21.15.134:0/3080344381 <== osd.2 v2:172.21.15.134:6800/214480313 16 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv16 ondisk = 0) ==== 155+0+58 (crc 0 0 0) 0x7f6540040040 con 0x7f653001ac20 2024-04-24T02:12:25.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.975+0000 7f63fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:25.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.975+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94139301320448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e83a197b0 con 0x559e839c50e0 2024-04-24T02:12:25.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.976+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 94139301320448] v30'110 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6538075030 con 0x559e839c50e0 2024-04-24T02:12:25.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.976+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94139301296160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e83a197b0 con 0x7f653001ac20 2024-04-24T02:12:25.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.977+0000 7f6547e68640 1 -- 172.21.15.134:0/3080344381 <== osd.2 v2:172.21.15.134:6800/214480313 17 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 94139301296160] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6540040040 con 0x7f653001ac20 2024-04-24T02:12:25.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.977+0000 7f654b92e800 20 remove_watcher() i=0 2024-04-24T02:12:25.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.977+0000 7f654b92e800 2 removed watcher, disabling cache 2024-04-24T02:12:25.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.977+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94139301301584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e83a197b0 con 0x559e839c50e0 2024-04-24T02:12:25.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.978+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.1 v2:172.21.15.134:6804/1487076214 30 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 94139301301584] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6538075030 con 0x559e839c50e0 2024-04-24T02:12:25.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.978+0000 7f654b92e800 20 remove_watcher() i=1 2024-04-24T02:12:25.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.978+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94139301302640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e83a197b0 con 0x559e839cb1c0 2024-04-24T02:12:25.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.980+0000 7f653ee66640 1 -- 172.21.15.134:0/3080344381 <== osd.3 v2:172.21.15.134:6801/3585115521 18 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 94139301302640] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6530024030 con 0x559e839cb1c0 2024-04-24T02:12:25.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.980+0000 7f654b92e800 20 remove_watcher() i=2 2024-04-24T02:12:25.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.980+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94139301308832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e83a197b0 con 0x7f653001ac20 2024-04-24T02:12:25.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.980+0000 7f6547e68640 1 -- 172.21.15.134:0/3080344381 <== osd.2 v2:172.21.15.134:6800/214480313 18 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 94139301308832] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6540040040 con 0x7f653001ac20 2024-04-24T02:12:25.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.980+0000 7f654b92e800 20 remove_watcher() i=3 2024-04-24T02:12:25.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.981+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94139301312608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e83a197b0 con 0x559e839c50e0 2024-04-24T02:12:25.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.982+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.1 v2:172.21.15.134:6804/1487076214 31 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 94139301312608] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6538075030 con 0x559e839c50e0 2024-04-24T02:12:25.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.982+0000 7f654b92e800 20 remove_watcher() i=4 2024-04-24T02:12:25.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.982+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94139301316208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e83a197b0 con 0x7f6540031040 2024-04-24T02:12:25.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.983+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 94139301316208] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6538075030 con 0x7f6540031040 2024-04-24T02:12:25.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.983+0000 7f654b92e800 20 remove_watcher() i=5 2024-04-24T02:12:25.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.983+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94139301318256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e83a197b0 con 0x7f6540031040 2024-04-24T02:12:25.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.984+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.0 v2:172.21.15.104:6800/2419146313 20 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 94139301318256] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6538075030 con 0x7f6540031040 2024-04-24T02:12:25.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.984+0000 7f654b92e800 20 remove_watcher() i=6 2024-04-24T02:12:25.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.984+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94139301311040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559e83a197b0 con 0x7f6540031040 2024-04-24T02:12:25.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.985+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 <== osd.0 v2:172.21.15.104:6800/2419146313 21 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 94139301311040] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6538075030 con 0x7f6540031040 2024-04-24T02:12:25.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.985+0000 7f654b92e800 20 remove_watcher() i=7 2024-04-24T02:12:25.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.985+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f6540031040 msgr2=0x7f6540032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.985+0000 7f654b92e800 1 --2- 172.21.15.134:0/3080344381 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f6540031040 0x7f6540032940 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.985+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x559e839c50e0 msgr2=0x559e839c75a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.985+0000 7f654b92e800 1 --2- 172.21.15.134:0/3080344381 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x559e839c50e0 0x559e839c75a0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.985+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f653001ac20 msgr2=0x7f6530035440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:25.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.985+0000 7f654b92e800 1 --2- 172.21.15.134:0/3080344381 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f653001ac20 0x7f6530035440 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:25.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.985+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x559e839cb1c0 msgr2=0x559e839cd610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.985+0000 7f654b92e800 1 --2- 172.21.15.134:0/3080344381 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x559e839cb1c0 0x559e839cd610 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.986+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6410036840 msgr2=0x7f6410038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.986+0000 7f654b92e800 1 --2- 172.21.15.134:0/3080344381 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6410036840 0x7f6410038d00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x559e839912a0 tx=0x7f654001f000 comp rx=0 tx=0).stop 2024-04-24T02:12:26.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.986+0000 7f6547667640 1 -- 172.21.15.134:0/3080344381 reap_dead start 2024-04-24T02:12:26.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.986+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e839b2260 msgr2=0x559e839b98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.986+0000 7f654b92e800 1 --2- 172.21.15.134:0/3080344381 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e839b2260 0x559e839b98c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6530024a50 tx=0x7f653004c080 comp rx=0 tx=0).stop 2024-04-24T02:12:26.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.986+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 shutdown_connections 2024-04-24T02:12:26.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.986+0000 7f654b92e800 1 --2- 172.21.15.134:0/3080344381 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e839b2260 0x559e839b98c0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.986+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 >> 172.21.15.134:0/3080344381 conn(0x559e839ae5c0 msgr2=0x559e839abc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:26.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.986+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 shutdown_connections 2024-04-24T02:12:26.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.986+0000 7f654b92e800 1 -- 172.21.15.134:0/3080344381 wait complete. 2024-04-24T02:12:26.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.986+0000 7f654b92e800 1 -- 172.21.15.134:0/2582539117 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6420036900 msgr2=0x7f6420038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.986+0000 7f654b92e800 1 --2- 172.21.15.134:0/2582539117 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6420036900 0x7f6420038dc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x559e83994f60 tx=0x7f6540005840 comp rx=0 tx=0).stop 2024-04-24T02:12:26.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.986+0000 7f654b92e800 1 -- 172.21.15.134:0/2582539117 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e839a4f20 msgr2=0x559e839a5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.986+0000 7f654b92e800 1 --2- 172.21.15.134:0/2582539117 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e839a4f20 0x559e839a5340 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6530001ed0 tx=0x7f653000ea00 comp rx=0 tx=0).stop 2024-04-24T02:12:26.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.986+0000 7f654b92e800 1 -- 172.21.15.134:0/2582539117 shutdown_connections 2024-04-24T02:12:26.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.986+0000 7f654b92e800 1 --2- 172.21.15.134:0/2582539117 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6420036900 0x7f6420038dc0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.986+0000 7f654b92e800 1 --2- 172.21.15.134:0/2582539117 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e839a4f20 0x559e839a5340 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.986+0000 7f654b92e800 1 -- 172.21.15.134:0/2582539117 >> 172.21.15.134:0/2582539117 conn(0x559e83998fc0 msgr2=0x559e839993c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:26.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.986+0000 7f654b92e800 1 -- 172.21.15.134:0/2582539117 shutdown_connections 2024-04-24T02:12:26.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.986+0000 7f654b92e800 1 -- 172.21.15.134:0/2582539117 wait complete. 2024-04-24T02:12:26.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.986+0000 7f654b92e800 1 -- 172.21.15.134:0/1745445540 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x559e838972c0 msgr2=0x559e83993d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.986+0000 7f654b92e800 1 --2- 172.21.15.134:0/1745445540 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x559e838972c0 0x559e83993d80 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.986+0000 7f654b92e800 1 -- 172.21.15.134:0/1745445540 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f642c036900 msgr2=0x7f642c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.986+0000 7f654b92e800 1 --2- 172.21.15.134:0/1745445540 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f642c036900 0x7f642c038dc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6530000f60 tx=0x7f6530001370 comp rx=0 tx=0).stop 2024-04-24T02:12:26.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.986+0000 7f654b92e800 1 -- 172.21.15.134:0/1745445540 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e83894990 msgr2=0x559e8398cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.987+0000 7f654b92e800 1 --2- 172.21.15.134:0/1745445540 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e83894990 0x559e8398cb40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f65380524f0 tx=0x7f6538003020 comp rx=0 tx=0).stop 2024-04-24T02:12:26.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.987+0000 7f654b92e800 1 -- 172.21.15.134:0/1745445540 shutdown_connections 2024-04-24T02:12:26.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.987+0000 7f654b92e800 1 --2- 172.21.15.134:0/1745445540 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x559e838972c0 0x559e83993d80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.987+0000 7f654b92e800 1 --2- 172.21.15.134:0/1745445540 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f642c036900 0x7f642c038dc0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.987+0000 7f654b92e800 1 --2- 172.21.15.134:0/1745445540 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e83894990 0x559e8398cb40 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.987+0000 7f654b92e800 1 -- 172.21.15.134:0/1745445540 >> 172.21.15.134:0/1745445540 conn(0x559e8388e340 msgr2=0x559e8397f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:26.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.987+0000 7f654b92e800 1 -- 172.21.15.134:0/1745445540 shutdown_connections 2024-04-24T02:12:26.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:25.987+0000 7f654b92e800 1 -- 172.21.15.134:0/1745445540 wait complete. 2024-04-24T02:12:26.003 INFO:teuthology.orchestra.run.smithi134.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2024-04-24T02:12:25.974924Z","last_stats_update":"2024-04-24T02:12:25.973898Z"} 2024-04-24T02:12:26.003 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-04-24T02:12:25.974924Z', 'last_stats_update': '2024-04-24T02:12:25.973898Z'} 2024-04-24T02:12:26.008 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T02:12:26.008 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-04-24T02:12:26.008 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-04-24T02:12:26.008 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-04-24T02:12:26.056 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:26.057 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:26.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.054+0000 7f579103e800 1 Processor -- start 2024-04-24T02:12:26.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.054+0000 7f579103e800 1 -- start start 2024-04-24T02:12:26.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.054+0000 7f579103e800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55d8df4512e0 0x55d8df459de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.054+0000 7f579103e800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d8df30fd40 con 0x55d8df44f7a0 2024-04-24T02:12:26.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.054+0000 7f579103e800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55d8df2e24d0 con 0x55d8df4512e0 2024-04-24T02:12:26.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.055+0000 7f57834d4640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55d8df4512e0 0x55d8df459de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.055+0000 7f57834d4640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55d8df4512e0 0x55d8df459de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55890/0 (socket says 172.21.15.134:55890) 2024-04-24T02:12:26.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.055+0000 7f578bcd5640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55d8df44f7a0 0x55d8df44fbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:55248/0 (socket says 172.21.15.134:55248) 2024-04-24T02:12:26.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.055+0000 7f57834d4640 1 -- 172.21.15.134:0/2707320368 learned_addr learned my addr 172.21.15.134:0/2707320368 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:26.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.055+0000 7f57834d4640 1 -- 172.21.15.134:0/2707320368 >> v1:172.21.15.104:6789/0 conn(0x55d8df44f7a0 legacy=0x55d8df44fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.055+0000 7f578b4d4640 1 -- 172.21.15.134:0/2707320368 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2259731430 0 0) 0x55d8df30fd40 con 0x55d8df44f7a0 2024-04-24T02:12:26.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.055+0000 7f57834d4640 1 -- 172.21.15.134:0/2707320368 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8df30e590 con 0x55d8df4512e0 2024-04-24T02:12:26.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.057+0000 7f57834d4640 1 --2- 172.21.15.134:0/2707320368 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8df4512e0 0x55d8df459de0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f577400a520 tx=0x7f577401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e3a867c2fbcf626 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.057+0000 7f578b4d4640 1 -- 172.21.15.134:0/2707320368 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5774057070 con 0x55d8df4512e0 2024-04-24T02:12:26.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.057+0000 7f578b4d4640 1 -- 172.21.15.134:0/2707320368 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5774052570 con 0x55d8df4512e0 2024-04-24T02:12:26.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.057+0000 7f578b4d4640 1 -- 172.21.15.134:0/2707320368 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5774052870 con 0x55d8df4512e0 2024-04-24T02:12:26.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.057+0000 7f579103e800 1 -- 172.21.15.134:0/2707320368 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8df4512e0 msgr2=0x55d8df459de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.057+0000 7f579103e800 1 --2- 172.21.15.134:0/2707320368 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8df4512e0 0x55d8df459de0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f577400a520 tx=0x7f577401d010 comp rx=0 tx=0).stop 2024-04-24T02:12:26.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.057+0000 7f579103e800 1 -- 172.21.15.134:0/2707320368 shutdown_connections 2024-04-24T02:12:26.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.057+0000 7f579103e800 1 --2- 172.21.15.134:0/2707320368 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8df4512e0 0x55d8df459de0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.057+0000 7f579103e800 1 -- 172.21.15.134:0/2707320368 >> 172.21.15.134:0/2707320368 conn(0x55d8df44b340 msgr2=0x55d8df44d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:26.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.057+0000 7f579103e800 1 -- 172.21.15.134:0/2707320368 shutdown_connections 2024-04-24T02:12:26.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.057+0000 7f579103e800 1 -- 172.21.15.134:0/2707320368 wait complete. 2024-04-24T02:12:26.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.069+0000 7f579103e800 1 Processor -- start 2024-04-24T02:12:26.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.069+0000 7f579103e800 1 -- start start 2024-04-24T02:12:26.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.069+0000 7f579103e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8df44f7a0 0x55d8df544480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.069+0000 7f579103e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d8df39c3b0 con 0x55d8df44f7a0 2024-04-24T02:12:26.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.069+0000 7f578bcd5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8df44f7a0 0x55d8df544480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.069+0000 7f578bcd5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8df44f7a0 0x55d8df544480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55896/0 (socket says 172.21.15.134:55896) 2024-04-24T02:12:26.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.069+0000 7f578bcd5640 1 -- 172.21.15.134:0/3561770572 learned_addr learned my addr 172.21.15.134:0/3561770572 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:26.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.070+0000 7f578bcd5640 1 -- 172.21.15.134:0/3561770572 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8df544a50 con 0x55d8df44f7a0 2024-04-24T02:12:26.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.070+0000 7f578bcd5640 1 --2- 172.21.15.134:0/3561770572 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8df44f7a0 0x55d8df544480 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f577c00b210 tx=0x7f577c00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d0638d892e5e657 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.070+0000 7f5679e0b640 1 -- 172.21.15.134:0/3561770572 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f577c008070 con 0x55d8df44f7a0 2024-04-24T02:12:26.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.070+0000 7f5679e0b640 1 -- 172.21.15.134:0/3561770572 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f577c00d500 con 0x55d8df44f7a0 2024-04-24T02:12:26.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.070+0000 7f5679e0b640 1 -- 172.21.15.134:0/3561770572 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f577c00d840 con 0x55d8df44f7a0 2024-04-24T02:12:26.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.071+0000 7f579103e800 1 -- 172.21.15.134:0/3561770572 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8df44f7a0 msgr2=0x55d8df544480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.071+0000 7f579103e800 1 --2- 172.21.15.134:0/3561770572 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8df44f7a0 0x55d8df544480 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f577c00b210 tx=0x7f577c00b6d0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.071+0000 7f579103e800 1 -- 172.21.15.134:0/3561770572 shutdown_connections 2024-04-24T02:12:26.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.071+0000 7f579103e800 1 --2- 172.21.15.134:0/3561770572 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8df44f7a0 0x55d8df544480 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.071+0000 7f579103e800 1 -- 172.21.15.134:0/3561770572 >> 172.21.15.134:0/3561770572 conn(0x55d8df44b340 msgr2=0x55d8df53fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:26.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.071+0000 7f579103e800 1 -- 172.21.15.134:0/3561770572 shutdown_connections 2024-04-24T02:12:26.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.071+0000 7f579103e800 1 -- 172.21.15.134:0/3561770572 wait complete. 2024-04-24T02:12:26.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.071+0000 7f579103e800 1 Processor -- start 2024-04-24T02:12:26.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.071+0000 7f579103e800 1 -- start start 2024-04-24T02:12:26.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.071+0000 7f579103e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8df44f7a0 0x55d8df54c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.071+0000 7f579103e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d8df45c600 con 0x55d8df44f7a0 2024-04-24T02:12:26.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.071+0000 7f578bcd5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8df44f7a0 0x55d8df54c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.071+0000 7f578bcd5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8df44f7a0 0x55d8df54c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55900/0 (socket says 172.21.15.134:55900) 2024-04-24T02:12:26.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.071+0000 7f578bcd5640 1 -- 172.21.15.134:0/734654275 learned_addr learned my addr 172.21.15.134:0/734654275 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:26.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.072+0000 7f578bcd5640 1 -- 172.21.15.134:0/734654275 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8df54c560 con 0x55d8df44f7a0 2024-04-24T02:12:26.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.072+0000 7f578bcd5640 1 --2- 172.21.15.134:0/734654275 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8df44f7a0 0x55d8df54c020 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f577c00b210 tx=0x7f577c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.072+0000 7f5673fff640 1 -- 172.21.15.134:0/734654275 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f577c00f950 con 0x55d8df44f7a0 2024-04-24T02:12:26.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.072+0000 7f5673fff640 1 -- 172.21.15.134:0/734654275 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f577c00faf0 con 0x55d8df44f7a0 2024-04-24T02:12:26.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.072+0000 7f579103e800 1 -- 172.21.15.134:0/734654275 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d8df54c7f0 con 0x55d8df44f7a0 2024-04-24T02:12:26.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.072+0000 7f5673fff640 1 -- 172.21.15.134:0/734654275 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f577c00fdd0 con 0x55d8df44f7a0 2024-04-24T02:12:26.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.072+0000 7f579103e800 1 -- 172.21.15.134:0/734654275 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8df54f4a0 con 0x55d8df44f7a0 2024-04-24T02:12:26.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.073+0000 7f5673fff640 1 -- 172.21.15.134:0/734654275 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f577c017040 con 0x55d8df44f7a0 2024-04-24T02:12:26.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.073+0000 7f5673fff640 1 --2- 172.21.15.134:0/734654275 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5674036900 0x7f5674038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.073+0000 7f5673fff640 1 -- 172.21.15.134:0/734654275 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f577c015020 con 0x55d8df44f7a0 2024-04-24T02:12:26.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.073+0000 7f57834d4640 1 --2- 172.21.15.134:0/734654275 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5674036900 0x7f5674038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.073+0000 7f579103e800 1 --2- 172.21.15.134:0/734654275 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d8df4512e0 0x55d8df553260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.073+0000 7f579103e800 1 -- 172.21.15.134:0/734654275 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d8df5537a0 con 0x55d8df4512e0 2024-04-24T02:12:26.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.073+0000 7f578c4d6640 1 --2- 172.21.15.134:0/734654275 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d8df4512e0 0x55d8df553260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.073+0000 7f57834d4640 1 --2- 172.21.15.134:0/734654275 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5674036900 0x7f5674038dc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5774054000 tx=0x7f577404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.073+0000 7f578c4d6640 1 --2- 172.21.15.134:0/734654275 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d8df4512e0 0x55d8df553260 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.074+0000 7f578c4d6640 1 -- 172.21.15.134:0/734654275 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f578400a4a0 con 0x55d8df4512e0 2024-04-24T02:12:26.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.074+0000 7f579103e800 1 -- 172.21.15.134:0/734654275 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d8df550810 con 0x55d8df4512e0 2024-04-24T02:12:26.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.074+0000 7f578c4d6640 1 -- 172.21.15.134:0/734654275 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f578400a4a0 con 0x55d8df4512e0 2024-04-24T02:12:26.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.074+0000 7f579103e800 1 -- 172.21.15.134:0/734654275 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d8df5555a0 con 0x55d8df4512e0 2024-04-24T02:12:26.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.074+0000 7f578c4d6640 1 -- 172.21.15.134:0/734654275 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f578400a4a0 con 0x55d8df4512e0 2024-04-24T02:12:26.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.074+0000 7f579103e800 1 -- 172.21.15.134:0/734654275 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d8df5548e0 con 0x55d8df4512e0 2024-04-24T02:12:26.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.075+0000 7f578c4d6640 1 -- 172.21.15.134:0/734654275 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f578400a4a0 con 0x55d8df4512e0 2024-04-24T02:12:26.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.075+0000 7f579103e800 1 -- 172.21.15.134:0/734654275 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d8df554d00 con 0x55d8df4512e0 2024-04-24T02:12:26.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.075+0000 7f578c4d6640 1 -- 172.21.15.134:0/734654275 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f578400a4a0 con 0x55d8df4512e0 2024-04-24T02:12:26.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.075+0000 7f579103e800 1 Processor -- start 2024-04-24T02:12:26.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.075+0000 7f579103e800 1 -- start start 2024-04-24T02:12:26.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.075+0000 7f579103e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8df564390 0x55d8df5647b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.075+0000 7f579103e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d8df3426b0 con 0x55d8df564390 2024-04-24T02:12:26.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.075+0000 7f57834d4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8df564390 0x55d8df5647b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.075+0000 7f57834d4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8df564390 0x55d8df5647b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55914/0 (socket says 172.21.15.134:55914) 2024-04-24T02:12:26.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.075+0000 7f57834d4640 1 -- 172.21.15.134:0/4024591136 learned_addr learned my addr 172.21.15.134:0/4024591136 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:26.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.076+0000 7f57834d4640 1 -- 172.21.15.134:0/4024591136 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8df564cf0 con 0x55d8df564390 2024-04-24T02:12:26.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.076+0000 7f57834d4640 1 --2- 172.21.15.134:0/4024591136 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8df564390 0x55d8df5647b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5774005930 tx=0x7f5774002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.076+0000 7f56717fa640 1 -- 172.21.15.134:0/4024591136 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5774057040 con 0x55d8df564390 2024-04-24T02:12:26.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.076+0000 7f56717fa640 1 -- 172.21.15.134:0/4024591136 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f577406d070 con 0x55d8df564390 2024-04-24T02:12:26.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.076+0000 7f579103e800 1 -- 172.21.15.134:0/4024591136 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d8df565760 con 0x55d8df564390 2024-04-24T02:12:26.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.076+0000 7f56717fa640 1 -- 172.21.15.134:0/4024591136 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f577405d6f0 con 0x55d8df564390 2024-04-24T02:12:26.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.076+0000 7f579103e800 1 -- 172.21.15.134:0/4024591136 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8df565c00 con 0x55d8df564390 2024-04-24T02:12:26.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.077+0000 7f56717fa640 1 -- 172.21.15.134:0/4024591136 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5774067070 con 0x55d8df564390 2024-04-24T02:12:26.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.077+0000 7f56717fa640 1 --2- 172.21.15.134:0/4024591136 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5664036950 0x7f5664038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.077+0000 7f56717fa640 1 -- 172.21.15.134:0/4024591136 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f577408f500 con 0x55d8df564390 2024-04-24T02:12:26.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.077+0000 7f578c4d6640 1 --2- 172.21.15.134:0/4024591136 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5664036950 0x7f5664038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.077+0000 7f579103e800 1 Processor -- start 2024-04-24T02:12:26.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.077+0000 7f579103e800 1 -- start start 2024-04-24T02:12:26.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.077+0000 7f578c4d6640 1 --2- 172.21.15.134:0/4024591136 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5664036950 0x7f5664038e10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x55d8df554c80 tx=0x7f5784005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.077+0000 7f579103e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8df571650 0x55d8df571a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.077+0000 7f579103e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d8df544dd0 con 0x55d8df571650 2024-04-24T02:12:26.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.078+0000 7f57834d4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8df571650 0x55d8df571a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.078+0000 7f57834d4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8df571650 0x55d8df571a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55922/0 (socket says 172.21.15.134:55922) 2024-04-24T02:12:26.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.078+0000 7f57834d4640 1 -- 172.21.15.134:0/2732047787 learned_addr learned my addr 172.21.15.134:0/2732047787 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:26.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.078+0000 7f57834d4640 1 -- 172.21.15.134:0/2732047787 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8df572040 con 0x55d8df571650 2024-04-24T02:12:26.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.078+0000 7f57834d4640 1 --2- 172.21.15.134:0/2732047787 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8df571650 0x55d8df571a70 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f577408daa0 tx=0x7f5774067ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9efcfc6f6a7b070 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.078+0000 7f566affd640 1 -- 172.21.15.134:0/2732047787 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5774080070 con 0x55d8df571650 2024-04-24T02:12:26.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.078+0000 7f566affd640 1 -- 172.21.15.134:0/2732047787 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f577405cd50 con 0x55d8df571650 2024-04-24T02:12:26.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.078+0000 7f566affd640 1 -- 172.21.15.134:0/2732047787 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f577408b030 con 0x55d8df571650 2024-04-24T02:12:26.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.079+0000 7f579103e800 1 -- 172.21.15.134:0/2732047787 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8df571650 msgr2=0x55d8df571a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.079+0000 7f579103e800 1 --2- 172.21.15.134:0/2732047787 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8df571650 0x55d8df571a70 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f577408daa0 tx=0x7f5774067ab0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.079+0000 7f579103e800 1 -- 172.21.15.134:0/2732047787 shutdown_connections 2024-04-24T02:12:26.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.079+0000 7f579103e800 1 --2- 172.21.15.134:0/2732047787 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8df571650 0x55d8df571a70 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.079+0000 7f579103e800 1 -- 172.21.15.134:0/2732047787 >> 172.21.15.134:0/2732047787 conn(0x55d8df56d970 msgr2=0x55d8df56b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:26.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.079+0000 7f579103e800 1 -- 172.21.15.134:0/2732047787 shutdown_connections 2024-04-24T02:12:26.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.079+0000 7f579103e800 1 -- 172.21.15.134:0/2732047787 wait complete. 2024-04-24T02:12:26.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.079+0000 7f579103e800 1 Processor -- start 2024-04-24T02:12:26.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.079+0000 7f579103e800 1 -- start start 2024-04-24T02:12:26.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.079+0000 7f579103e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8df571650 0x55d8df578ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.079+0000 7f579103e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d8df5727c0 con 0x55d8df571650 2024-04-24T02:12:26.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.079+0000 7f57834d4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8df571650 0x55d8df578ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.079+0000 7f57834d4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8df571650 0x55d8df578ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55932/0 (socket says 172.21.15.134:55932) 2024-04-24T02:12:26.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.079+0000 7f57834d4640 1 -- 172.21.15.134:0/2919973921 learned_addr learned my addr 172.21.15.134:0/2919973921 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:26.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.080+0000 7f57834d4640 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8df579220 con 0x55d8df571650 2024-04-24T02:12:26.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.080+0000 7f57834d4640 1 --2- 172.21.15.134:0/2919973921 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8df571650 0x55d8df578ce0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5774006540 tx=0x7f577408da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.080+0000 7f56697fa640 1 -- 172.21.15.134:0/2919973921 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5774093020 con 0x55d8df571650 2024-04-24T02:12:26.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.080+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d8df5794b0 con 0x55d8df571650 2024-04-24T02:12:26.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.080+0000 7f56697fa640 1 -- 172.21.15.134:0/2919973921 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5774071cc0 con 0x55d8df571650 2024-04-24T02:12:26.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.080+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8df57c160 con 0x55d8df571650 2024-04-24T02:12:26.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.080+0000 7f56697fa640 1 -- 172.21.15.134:0/2919973921 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5774080040 con 0x55d8df571650 2024-04-24T02:12:26.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.081+0000 7f56697fa640 1 -- 172.21.15.134:0/2919973921 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5774096020 con 0x55d8df571650 2024-04-24T02:12:26.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.081+0000 7f56697fa640 1 --2- 172.21.15.134:0/2919973921 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5654036900 0x7f5654038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.081+0000 7f56697fa640 1 -- 172.21.15.134:0/2919973921 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f5774099ab0 con 0x55d8df571650 2024-04-24T02:12:26.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.081+0000 7f578c4d6640 1 --2- 172.21.15.134:0/2919973921 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5654036900 0x7f5654038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.081+0000 7f578c4d6640 1 --2- 172.21.15.134:0/2919973921 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5654036900 0x7f5654038dc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x55d8df554400 tx=0x7f578401f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.081+0000 7f579103e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.081+0000 7f579103e800 1 --2- 172.21.15.134:0/2919973921 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d8df584830 0x55d8df586cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.081+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d8df587440 con 0x55d8df584830 2024-04-24T02:12:26.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.082+0000 7f578bcd5640 1 --2- 172.21.15.134:0/2919973921 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d8df584830 0x55d8df586cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.082+0000 7f578bcd5640 1 --2- 172.21.15.134:0/2919973921 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d8df584830 0x55d8df586cf0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.082+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f577c02d070 con 0x55d8df584830 2024-04-24T02:12:26.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.082+0000 7f579103e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:26.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.082+0000 7f579103e800 20 realm 2024-04-24T02:12:26.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.082+0000 7f579103e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.082+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d8df587850 con 0x55d8df584830 2024-04-24T02:12:26.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.082+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f577c02d070 con 0x55d8df584830 2024-04-24T02:12:26.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.082+0000 7f579103e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:26.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.082+0000 7f579103e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:26.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.082+0000 7f579103e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.082+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d8df588120 con 0x55d8df584830 2024-04-24T02:12:26.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.083+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f577c02d070 con 0x55d8df584830 2024-04-24T02:12:26.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.083+0000 7f579103e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:26.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.083+0000 7f579103e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.083+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d8df5884c0 con 0x55d8df584830 2024-04-24T02:12:26.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.083+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f577c02d070 con 0x55d8df584830 2024-04-24T02:12:26.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.083+0000 7f579103e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:26.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.083+0000 7f579103e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.083+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d8df588d10 con 0x55d8df584830 2024-04-24T02:12:26.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.083+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f577c02d070 con 0x55d8df584830 2024-04-24T02:12:26.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.083+0000 7f579103e800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:26.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.083+0000 7f579103e800 20 searching for the correct realm 2024-04-24T02:12:26.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.083+0000 7f579103e800 1 --2- 172.21.15.134:0/2919973921 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55d8df58aa80 0x55d8df58ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.083+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8df58d4a0 con 0x55d8df58aa80 2024-04-24T02:12:26.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.083+0000 7f57834d4640 1 --2- 172.21.15.134:0/2919973921 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55d8df58aa80 0x55d8df58ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.084+0000 7f57834d4640 1 --2- 172.21.15.134:0/2919973921 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55d8df58aa80 0x55d8df58ce70 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.084+0000 7f57834d4640 1 -- 172.21.15.134:0/2919973921 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5774083040 con 0x55d8df58aa80 2024-04-24T02:12:26.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.084+0000 7f57834d4640 1 --2- 172.21.15.134:0/2919973921 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f5774098020 0x7f57740764f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.084+0000 7f57834d4640 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8df58d4a0 con 0x7f5774098020 2024-04-24T02:12:26.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.084+0000 7f578c4d6640 1 --2- 172.21.15.134:0/2919973921 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f5774098020 0x7f57740764f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.084+0000 7f578c4d6640 1 --2- 172.21.15.134:0/2919973921 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f5774098020 0x7f57740764f0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.085+0000 7f578c4d6640 1 -- 172.21.15.134:0/2919973921 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f578401f070 con 0x7f5774098020 2024-04-24T02:12:26.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.085+0000 7f578c4d6640 1 --2- 172.21.15.134:0/2919973921 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f5784031040 0x7f5784032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.085+0000 7f578c4d6640 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8df58d4a0 con 0x7f5784031040 2024-04-24T02:12:26.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.085+0000 7f578bcd5640 1 --2- 172.21.15.134:0/2919973921 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f5784031040 0x7f5784032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.085+0000 7f578bcd5640 1 --2- 172.21.15.134:0/2919973921 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f5784031040 0x7f5784032940 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.085+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f577c02d070 con 0x7f5784031040 2024-04-24T02:12:26.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.085+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8df58d4a0 con 0x55d8df584830 2024-04-24T02:12:26.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.086+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f577c02d070 con 0x55d8df584830 2024-04-24T02:12:26.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.086+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8df58d4a0 con 0x55d8df584830 2024-04-24T02:12:26.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.086+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f577c02d070 con 0x55d8df584830 2024-04-24T02:12:26.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.086+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8df58d4a0 con 0x7f5784031040 2024-04-24T02:12:26.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.086+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f577c02d070 con 0x7f5784031040 2024-04-24T02:12:26.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.086+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8df58d4a0 con 0x7f5784031040 2024-04-24T02:12:26.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.086+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f577c02d070 con 0x7f5784031040 2024-04-24T02:12:26.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.086+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8df58d4a0 con 0x7f5774098020 2024-04-24T02:12:26.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.086+0000 7f578c4d6640 1 -- 172.21.15.134:0/2919973921 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f578401f070 con 0x7f5774098020 2024-04-24T02:12:26.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.086+0000 7f578c4d6640 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8df58d4a0 con 0x55d8df58aa80 2024-04-24T02:12:26.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.087+0000 7f57834d4640 1 -- 172.21.15.134:0/2919973921 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5774083040 con 0x55d8df58aa80 2024-04-24T02:12:26.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.087+0000 7f57834d4640 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8df58d4a0 con 0x55d8df584830 2024-04-24T02:12:26.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.087+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f577c02d070 con 0x55d8df584830 2024-04-24T02:12:26.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.087+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8df58d4a0 con 0x7f5784031040 2024-04-24T02:12:26.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.087+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f577c02d070 con 0x7f5784031040 2024-04-24T02:12:26.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.087+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8df58d4a0 con 0x55d8df584830 2024-04-24T02:12:26.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.087+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f577c02d070 con 0x55d8df584830 2024-04-24T02:12:26.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.087+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8df58d4a0 con 0x7f5774098020 2024-04-24T02:12:26.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.088+0000 7f578c4d6640 1 -- 172.21.15.134:0/2919973921 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f578401f070 con 0x7f5774098020 2024-04-24T02:12:26.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.088+0000 7f578c4d6640 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8df58d4a0 con 0x55d8df58aa80 2024-04-24T02:12:26.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.088+0000 7f57834d4640 1 -- 172.21.15.134:0/2919973921 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5774083040 con 0x55d8df58aa80 2024-04-24T02:12:26.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.088+0000 7f57834d4640 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8df58d4a0 con 0x55d8df58aa80 2024-04-24T02:12:26.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.088+0000 7f57834d4640 1 -- 172.21.15.134:0/2919973921 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5774083040 con 0x55d8df58aa80 2024-04-24T02:12:26.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.088+0000 7f57834d4640 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8df58d4a0 con 0x7f5784031040 2024-04-24T02:12:26.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.088+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f577c02d070 con 0x7f5784031040 2024-04-24T02:12:26.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.088+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8df58d4a0 con 0x55d8df58aa80 2024-04-24T02:12:26.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.089+0000 7f57834d4640 1 -- 172.21.15.134:0/2919973921 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5774083040 con 0x55d8df58aa80 2024-04-24T02:12:26.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.089+0000 7f57834d4640 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8df58d4a0 con 0x55d8df58aa80 2024-04-24T02:12:26.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.089+0000 7f57834d4640 1 -- 172.21.15.134:0/2919973921 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5774083040 con 0x55d8df58aa80 2024-04-24T02:12:26.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.089+0000 7f57834d4640 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8df58d4a0 con 0x55d8df584830 2024-04-24T02:12:26.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.089+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f577c02d070 con 0x55d8df584830 2024-04-24T02:12:26.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.089+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8df58d4a0 con 0x55d8df584830 2024-04-24T02:12:26.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.089+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f577c02d070 con 0x55d8df584830 2024-04-24T02:12:26.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.089+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8df58d4a0 con 0x7f5784031040 2024-04-24T02:12:26.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.089+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f577c02d070 con 0x7f5784031040 2024-04-24T02:12:26.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.089+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8df58d4a0 con 0x55d8df58aa80 2024-04-24T02:12:26.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.090+0000 7f57834d4640 1 -- 172.21.15.134:0/2919973921 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5774083040 con 0x55d8df58aa80 2024-04-24T02:12:26.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.090+0000 7f57834d4640 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8df58d4a0 con 0x7f5774098020 2024-04-24T02:12:26.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.090+0000 7f578c4d6640 1 -- 172.21.15.134:0/2919973921 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f578401f070 con 0x7f5774098020 2024-04-24T02:12:26.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.090+0000 7f578c4d6640 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8df58d4a0 con 0x55d8df584830 2024-04-24T02:12:26.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.090+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f577c02d070 con 0x55d8df584830 2024-04-24T02:12:26.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.090+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8df58d4a0 con 0x7f5784031040 2024-04-24T02:12:26.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.090+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f577c02d070 con 0x7f5784031040 2024-04-24T02:12:26.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.090+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8df58d4a0 con 0x55d8df58aa80 2024-04-24T02:12:26.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.091+0000 7f57834d4640 1 -- 172.21.15.134:0/2919973921 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5774083040 con 0x55d8df58aa80 2024-04-24T02:12:26.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.091+0000 7f57834d4640 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8df58d4a0 con 0x7f5784031040 2024-04-24T02:12:26.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.091+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f577c02d070 con 0x7f5784031040 2024-04-24T02:12:26.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.091+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8df58d4a0 con 0x7f5774098020 2024-04-24T02:12:26.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.091+0000 7f578c4d6640 1 -- 172.21.15.134:0/2919973921 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f578401f070 con 0x7f5774098020 2024-04-24T02:12:26.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.091+0000 7f578c4d6640 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8df58d4a0 con 0x55d8df58aa80 2024-04-24T02:12:26.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.091+0000 7f57834d4640 1 -- 172.21.15.134:0/2919973921 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5774083040 con 0x55d8df58aa80 2024-04-24T02:12:26.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.091+0000 7f57834d4640 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8df58d4a0 con 0x7f5784031040 2024-04-24T02:12:26.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.092+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f577c02d070 con 0x7f5784031040 2024-04-24T02:12:26.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.092+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8df58d4a0 con 0x55d8df584830 2024-04-24T02:12:26.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.092+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f577c02d070 con 0x55d8df584830 2024-04-24T02:12:26.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.092+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d8df58d4a0 con 0x7f5774098020 2024-04-24T02:12:26.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.092+0000 7f578c4d6640 1 -- 172.21.15.134:0/2919973921 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f578401f070 con 0x7f5774098020 2024-04-24T02:12:26.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.092+0000 7f579103e800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:26.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.092+0000 7f579103e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:26.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.092+0000 7f579103e800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:26.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.092+0000 7f579103e800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:26.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.092+0000 7f579103e800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:26.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.092+0000 7f579103e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:26.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.092+0000 7f579103e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.092+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d8df589690 con 0x55d8df584830 2024-04-24T02:12:26.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.093+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f577c02d070 con 0x55d8df584830 2024-04-24T02:12:26.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.093+0000 7f579103e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:26.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.093+0000 7f579103e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.093+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d8df589f30 con 0x55d8df584830 2024-04-24T02:12:26.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.093+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f577c02d070 con 0x55d8df584830 2024-04-24T02:12:26.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.093+0000 7f579103e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:26.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.093+0000 7f579103e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.093+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d8df58d920 con 0x55d8df584830 2024-04-24T02:12:26.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.093+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f577c02d070 con 0x55d8df584830 2024-04-24T02:12:26.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.093+0000 7f579103e800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:26.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.093+0000 7f579103e800 20 zone default found 2024-04-24T02:12:26.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.093+0000 7f579103e800 4 Realm: () 2024-04-24T02:12:26.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.093+0000 7f579103e800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:26.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.093+0000 7f579103e800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:26.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.093+0000 7f579103e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:26.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.093+0000 7f579103e800 20 zonegroup default 2024-04-24T02:12:26.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.093+0000 7f579103e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.093+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d8df589b90 con 0x7f5784031040 2024-04-24T02:12:26.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.094+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f577c02d070 con 0x7f5784031040 2024-04-24T02:12:26.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.094+0000 7f579103e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:26.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.094+0000 7f579103e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.094+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d8df58f800 con 0x55d8df58aa80 2024-04-24T02:12:26.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.094+0000 7f57834d4640 1 -- 172.21.15.134:0/2919973921 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5774083040 con 0x55d8df58aa80 2024-04-24T02:12:26.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.094+0000 7f579103e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:26.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.094+0000 7f579103e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.094+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d8df58fba0 con 0x55d8df58aa80 2024-04-24T02:12:26.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.094+0000 7f57834d4640 1 -- 172.21.15.134:0/2919973921 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5774083040 con 0x55d8df58aa80 2024-04-24T02:12:26.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.094+0000 7f579103e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:26.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.094+0000 7f579103e800 20 started sync module instance, tier type = 2024-04-24T02:12:26.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.094+0000 7f579103e800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:26.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.094+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8df58eca0 con 0x7f5774098020 2024-04-24T02:12:26.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.095+0000 7f578c4d6640 1 -- 172.21.15.134:0/2919973921 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5784040040 con 0x7f5774098020 2024-04-24T02:12:26.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.095+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94389948444816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8df58e900 con 0x7f5774098020 2024-04-24T02:12:26.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.095+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8df590990 con 0x55d8df584830 2024-04-24T02:12:26.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.096+0000 7f578c4d6640 1 -- 172.21.15.134:0/2919973921 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94389948444816] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5784040040 con 0x7f5774098020 2024-04-24T02:12:26.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.096+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f577c02d070 con 0x55d8df584830 2024-04-24T02:12:26.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.096+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94389948448816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8df590900 con 0x55d8df584830 2024-04-24T02:12:26.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.096+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8df591490 con 0x55d8df58aa80 2024-04-24T02:12:26.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.097+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94389948448816] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f577c02d070 con 0x55d8df584830 2024-04-24T02:12:26.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.098+0000 7f57834d4640 1 -- 172.21.15.134:0/2919973921 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5774083040 con 0x55d8df58aa80 2024-04-24T02:12:26.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.098+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94389948449872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8df590870 con 0x55d8df58aa80 2024-04-24T02:12:26.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.098+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8df592350 con 0x7f5774098020 2024-04-24T02:12:26.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.098+0000 7f57834d4640 1 -- 172.21.15.134:0/2919973921 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94389948449872] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5774083040 con 0x55d8df58aa80 2024-04-24T02:12:26.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.099+0000 7f578c4d6640 1 -- 172.21.15.134:0/2919973921 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5784040040 con 0x7f5774098020 2024-04-24T02:12:26.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.099+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94389948456608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8df592770 con 0x7f5774098020 2024-04-24T02:12:26.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.099+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8df593130 con 0x55d8df584830 2024-04-24T02:12:26.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.100+0000 7f578c4d6640 1 -- 172.21.15.134:0/2919973921 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94389948456608] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5784040040 con 0x7f5774098020 2024-04-24T02:12:26.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.100+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f577c02d070 con 0x55d8df584830 2024-04-24T02:12:26.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.100+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94389948458144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8df593130 con 0x55d8df584830 2024-04-24T02:12:26.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.100+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8df593b30 con 0x7f5784031040 2024-04-24T02:12:26.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.101+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94389948458144] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f577c02d070 con 0x55d8df584830 2024-04-24T02:12:26.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.101+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f577c02d070 con 0x7f5784031040 2024-04-24T02:12:26.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.101+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94389948462656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8df593130 con 0x7f5784031040 2024-04-24T02:12:26.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.101+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8df594540 con 0x7f5784031040 2024-04-24T02:12:26.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.102+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94389948462656] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f577c02d070 con 0x7f5784031040 2024-04-24T02:12:26.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.102+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(56 notify.6 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f577c02d070 con 0x7f5784031040 2024-04-24T02:12:26.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.102+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94389948465776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8df593130 con 0x7f5784031040 2024-04-24T02:12:26.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.102+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8df594f50 con 0x7f5784031040 2024-04-24T02:12:26.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.103+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94389948465776] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f577c02d070 con 0x7f5784031040 2024-04-24T02:12:26.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.103+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(58 notify.7 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f577c02d070 con 0x7f5784031040 2024-04-24T02:12:26.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.103+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94389948460432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8df594f50 con 0x7f5784031040 2024-04-24T02:12:26.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.103+0000 7f579103e800 20 add_watcher() i=0 2024-04-24T02:12:26.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.103+0000 7f579103e800 20 add_watcher() i=1 2024-04-24T02:12:26.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.103+0000 7f579103e800 20 add_watcher() i=2 2024-04-24T02:12:26.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.103+0000 7f579103e800 20 add_watcher() i=3 2024-04-24T02:12:26.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.103+0000 7f579103e800 20 add_watcher() i=4 2024-04-24T02:12:26.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.103+0000 7f579103e800 20 add_watcher() i=5 2024-04-24T02:12:26.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.103+0000 7f579103e800 20 add_watcher() i=6 2024-04-24T02:12:26.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.104+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94389948460432] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f577c02d070 con 0x7f5784031040 2024-04-24T02:12:26.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.104+0000 7f579103e800 20 add_watcher() i=7 2024-04-24T02:12:26.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.104+0000 7f579103e800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:26.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.104+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d8df598270 con 0x55d8df584830 2024-04-24T02:12:26.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.104+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f577c02d070 con 0x55d8df584830 2024-04-24T02:12:26.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.104+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94389948480688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8df5950c0 con 0x55d8df584830 2024-04-24T02:12:26.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.105+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94389948480688] v30'111 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f577c02d070 con 0x55d8df584830 2024-04-24T02:12:26.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.105+0000 7f5641fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:26.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.106+0000 7f579103e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:26.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.106+0000 7f579103e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:26.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.106+0000 7f579103e800 5 note: GC not initialized 2024-04-24T02:12:26.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.106+0000 7f5640fe1640 20 reqs_thread_entry: start 2024-04-24T02:12:26.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.106+0000 7f579103e800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:26.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.106+0000 7f579103e800 20 Filter name: none 2024-04-24T02:12:26.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.106+0000 7f55ba7fc640 20 reqs_thread_entry: start 2024-04-24T02:12:26.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.106+0000 7f579103e800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T02:12:26.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.106+0000 7f579103e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.106+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d8df5cb620 con 0x55d8df584830 2024-04-24T02:12:26.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.106+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f577c02d070 con 0x55d8df584830 2024-04-24T02:12:26.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.106+0000 7f579103e800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T02:12:26.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.106+0000 7f579103e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T02:12:26.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.106+0000 7f579103e800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:26.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.106+0000 7f579103e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:12:26.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.106+0000 7f579103e800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-24T02:12:26.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.106+0000 7f579103e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.106+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d8df5cd700 con 0x7f5774098020 2024-04-24T02:12:26.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.107+0000 7f578c4d6640 1 -- 172.21.15.134:0/2919973921 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f5784040040 con 0x7f5774098020 2024-04-24T02:12:26.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.107+0000 7f579103e800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T02:12:26.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.107+0000 7f579103e800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-24T02:12:26.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.107+0000 7f579103e800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T02:12:26.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.107+0000 7f579103e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 : miss 2024-04-24T02:12:26.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.107+0000 7f579103e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.107+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:64 8.1d 8:be2d2b4a:root::.bucket.meta.myfoo%3a582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d8df5cef80 con 0x7f5784031040 2024-04-24T02:12:26.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.107+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(64 .bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f577c02d070 con 0x7f5784031040 2024-04-24T02:12:26.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.107+0000 7f579103e800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T02:12:26.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.107+0000 7f579103e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 info.flags=0x17 2024-04-24T02:12:26.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.107+0000 7f579103e800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 to cache LRU end 2024-04-24T02:12:26.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.107+0000 7f579103e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:12:26.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.107+0000 7f579103e800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T02:12:26.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.107+0000 7f579103e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 2024-04-24T02:12:26.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.107+0000 7f579103e800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-04-24T02:12:26.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.107+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8df5d26a0 con 0x7f5774098020 2024-04-24T02:12:26.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.109+0000 7f578c4d6640 1 -- 172.21.15.134:0/2919973921 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(65 foo.buckets [call] v30'17 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f5784040040 con 0x7f5774098020 2024-04-24T02:12:26.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.109+0000 7f579103e800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-04-24T02:12:26.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.109+0000 7f579103e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.109+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d8df5d1810 con 0x7f5774098020 2024-04-24T02:12:26.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.109+0000 7f578c4d6640 1 -- 172.21.15.134:0/2919973921 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f5784040040 con 0x7f5774098020 2024-04-24T02:12:26.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.109+0000 7f579103e800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T02:12:26.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.109+0000 7f579103e800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-04-24T02:12:26.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.109+0000 7f579103e800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T02:12:26.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.109+0000 7f579103e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:12:26.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.109+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8df5d2390 con 0x7f5774098020 2024-04-24T02:12:26.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.110+0000 7f578c4d6640 1 -- 172.21.15.134:0/2919973921 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v30'18 uv18 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f5784040040 con 0x7f5774098020 2024-04-24T02:12:26.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.110+0000 7f579103e800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-04-24T02:12:26.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.110+0000 7f579103e800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T02:12:26.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.110+0000 7f579103e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-24T02:12:26.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.110+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94389948718624 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d8df5d3f20 con 0x7f5784031040 2024-04-24T02:12:26.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.110+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== watch-notify(notify (1) cookie 94389948465776 notify 128849018882 ret 0) ==== 380+0+0 (crc 0 0 0) 0x55d8df5cf370 con 0x7f5784031040 2024-04-24T02:12:26.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.110+0000 7f566affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018882 cookie 94389948465776 notifier 4474 bl.length()=338 2024-04-24T02:12:26.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.110+0000 7f566affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-04-24T02:12:26.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.110+0000 7f566affd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T02:12:26.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.110+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(68 notify.6 [notify cookie 94389948718624 out=8b] v0'0 uv105 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f577c02d070 con 0x7f5784031040 2024-04-24T02:12:26.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.110+0000 7f566affd640 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f5650003ea0 con 0x7f5784031040 2024-04-24T02:12:26.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.111+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 <== osd.0 v2:172.21.15.104:6800/2419146313 20 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f577c02d070 con 0x7f5784031040 2024-04-24T02:12:26.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.111+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 <== osd.0 v2:172.21.15.104:6800/2419146313 21 ==== watch-notify(notify_complete (2) cookie 94389948718624 notify 128849018882 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d8df5ce4a0 con 0x7f5784031040 2024-04-24T02:12:26.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.111+0000 7f5641fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:26.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.111+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94389948480688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8df5d1e20 con 0x55d8df584830 2024-04-24T02:12:26.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.112+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94389948480688] v30'112 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f577c02d070 con 0x55d8df584830 2024-04-24T02:12:26.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.112+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94389948444816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8df5d1e20 con 0x7f5774098020 2024-04-24T02:12:26.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.113+0000 7f578c4d6640 1 -- 172.21.15.134:0/2919973921 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94389948444816] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5784040040 con 0x7f5774098020 2024-04-24T02:12:26.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.113+0000 7f579103e800 20 remove_watcher() i=0 2024-04-24T02:12:26.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.113+0000 7f579103e800 2 removed watcher, disabling cache 2024-04-24T02:12:26.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.113+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94389948448816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8df58f090 con 0x55d8df584830 2024-04-24T02:12:26.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.114+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94389948448816] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f577c02d070 con 0x55d8df584830 2024-04-24T02:12:26.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.114+0000 7f579103e800 20 remove_watcher() i=1 2024-04-24T02:12:26.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.115+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94389948449872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8df58f090 con 0x55d8df58aa80 2024-04-24T02:12:26.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.116+0000 7f57834d4640 1 -- 172.21.15.134:0/2919973921 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94389948449872] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5774083040 con 0x55d8df58aa80 2024-04-24T02:12:26.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.116+0000 7f579103e800 20 remove_watcher() i=2 2024-04-24T02:12:26.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.116+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94389948456608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8df5d1e20 con 0x7f5774098020 2024-04-24T02:12:26.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.117+0000 7f578c4d6640 1 -- 172.21.15.134:0/2919973921 <== osd.2 v2:172.21.15.134:6800/214480313 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94389948456608] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5784040040 con 0x7f5774098020 2024-04-24T02:12:26.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.117+0000 7f579103e800 20 remove_watcher() i=3 2024-04-24T02:12:26.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.117+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94389948458144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8df591ea0 con 0x55d8df584830 2024-04-24T02:12:26.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.118+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94389948458144] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f577c02d070 con 0x55d8df584830 2024-04-24T02:12:26.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.118+0000 7f579103e800 20 remove_watcher() i=4 2024-04-24T02:12:26.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.118+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94389948462656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8df591ea0 con 0x7f5784031040 2024-04-24T02:12:26.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.119+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 <== osd.0 v2:172.21.15.104:6800/2419146313 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94389948462656] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f577c02d070 con 0x7f5784031040 2024-04-24T02:12:26.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.119+0000 7f579103e800 20 remove_watcher() i=5 2024-04-24T02:12:26.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.119+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94389948465776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8df591ea0 con 0x7f5784031040 2024-04-24T02:12:26.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.120+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 <== osd.0 v2:172.21.15.104:6800/2419146313 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94389948465776] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f577c02d070 con 0x7f5784031040 2024-04-24T02:12:26.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.120+0000 7f579103e800 20 remove_watcher() i=6 2024-04-24T02:12:26.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.120+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94389948460432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8df591ea0 con 0x7f5784031040 2024-04-24T02:12:26.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.121+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 <== osd.0 v2:172.21.15.104:6800/2419146313 24 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94389948460432] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f577c02d070 con 0x7f5784031040 2024-04-24T02:12:26.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.121+0000 7f579103e800 20 remove_watcher() i=7 2024-04-24T02:12:26.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.121+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f5784031040 msgr2=0x7f5784032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.121+0000 7f579103e800 1 --2- 172.21.15.134:0/2919973921 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f5784031040 0x7f5784032940 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.121+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d8df584830 msgr2=0x55d8df586cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.121+0000 7f579103e800 1 --2- 172.21.15.134:0/2919973921 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d8df584830 0x55d8df586cf0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.121+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f5774098020 msgr2=0x7f57740764f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.121+0000 7f579103e800 1 --2- 172.21.15.134:0/2919973921 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f5774098020 0x7f57740764f0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.121+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55d8df58aa80 msgr2=0x55d8df58ce70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.121+0000 7f579103e800 1 --2- 172.21.15.134:0/2919973921 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55d8df58aa80 0x55d8df58ce70 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.121+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5654036900 msgr2=0x7f5654038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.121+0000 7f579103e800 1 --2- 172.21.15.134:0/2919973921 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5654036900 0x7f5654038dc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x55d8df554400 tx=0x7f578401f000 comp rx=0 tx=0).stop 2024-04-24T02:12:26.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.121+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8df571650 msgr2=0x55d8df578ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.121+0000 7f578bcd5640 1 -- 172.21.15.134:0/2919973921 reap_dead start 2024-04-24T02:12:26.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.121+0000 7f579103e800 1 --2- 172.21.15.134:0/2919973921 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8df571650 0x55d8df578ce0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5774006540 tx=0x7f577408da30 comp rx=0 tx=0).stop 2024-04-24T02:12:26.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.121+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 shutdown_connections 2024-04-24T02:12:26.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.121+0000 7f579103e800 1 --2- 172.21.15.134:0/2919973921 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8df571650 0x55d8df578ce0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.121+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 >> 172.21.15.134:0/2919973921 conn(0x55d8df56d970 msgr2=0x55d8df56afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:26.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.121+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 shutdown_connections 2024-04-24T02:12:26.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.121+0000 7f579103e800 1 -- 172.21.15.134:0/2919973921 wait complete. 2024-04-24T02:12:26.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.121+0000 7f579103e800 1 -- 172.21.15.134:0/4024591136 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5664036950 msgr2=0x7f5664038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.121+0000 7f579103e800 1 --2- 172.21.15.134:0/4024591136 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5664036950 0x7f5664038e10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x55d8df554c80 tx=0x7f5784005840 comp rx=0 tx=0).stop 2024-04-24T02:12:26.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.121+0000 7f579103e800 1 -- 172.21.15.134:0/4024591136 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8df564390 msgr2=0x55d8df5647b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.121+0000 7f579103e800 1 --2- 172.21.15.134:0/4024591136 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8df564390 0x55d8df5647b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5774005930 tx=0x7f5774002fb0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.121+0000 7f579103e800 1 -- 172.21.15.134:0/4024591136 shutdown_connections 2024-04-24T02:12:26.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.121+0000 7f579103e800 1 --2- 172.21.15.134:0/4024591136 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5664036950 0x7f5664038e10 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.121+0000 7f579103e800 1 --2- 172.21.15.134:0/4024591136 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8df564390 0x55d8df5647b0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.121+0000 7f579103e800 1 -- 172.21.15.134:0/4024591136 >> 172.21.15.134:0/4024591136 conn(0x55d8df558430 msgr2=0x55d8df558830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:26.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.122+0000 7f579103e800 1 -- 172.21.15.134:0/4024591136 shutdown_connections 2024-04-24T02:12:26.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.122+0000 7f579103e800 1 -- 172.21.15.134:0/4024591136 wait complete. 2024-04-24T02:12:26.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.122+0000 7f579103e800 1 -- 172.21.15.134:0/734654275 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d8df4512e0 msgr2=0x55d8df553260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.122+0000 7f579103e800 1 --2- 172.21.15.134:0/734654275 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d8df4512e0 0x55d8df553260 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.122+0000 7f579103e800 1 -- 172.21.15.134:0/734654275 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5674036900 msgr2=0x7f5674038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.122+0000 7f579103e800 1 --2- 172.21.15.134:0/734654275 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5674036900 0x7f5674038dc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5774054000 tx=0x7f577404e000 comp rx=0 tx=0).stop 2024-04-24T02:12:26.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.122+0000 7f579103e800 1 -- 172.21.15.134:0/734654275 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8df44f7a0 msgr2=0x55d8df54c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.122+0000 7f579103e800 1 --2- 172.21.15.134:0/734654275 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8df44f7a0 0x55d8df54c020 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f577c00b210 tx=0x7f577c000ed0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.122+0000 7f579103e800 1 -- 172.21.15.134:0/734654275 shutdown_connections 2024-04-24T02:12:26.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.122+0000 7f579103e800 1 --2- 172.21.15.134:0/734654275 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d8df4512e0 0x55d8df553260 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.122+0000 7f579103e800 1 --2- 172.21.15.134:0/734654275 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5674036900 0x7f5674038dc0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.122+0000 7f579103e800 1 --2- 172.21.15.134:0/734654275 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8df44f7a0 0x55d8df54c020 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.122+0000 7f579103e800 1 -- 172.21.15.134:0/734654275 >> 172.21.15.134:0/734654275 conn(0x55d8df44b340 msgr2=0x55d8df53e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:26.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.122+0000 7f579103e800 1 -- 172.21.15.134:0/734654275 shutdown_connections 2024-04-24T02:12:26.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.122+0000 7f579103e800 1 -- 172.21.15.134:0/734654275 wait complete. 2024-04-24T02:12:26.146 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-04-24T02:12:26.146 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-04-24T02:12:26.146 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-04-24T02:12:26.197 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:26.197 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:26.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.197+0000 7fe18341f800 1 Processor -- start 2024-04-24T02:12:26.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.197+0000 7fe18341f800 1 -- start start 2024-04-24T02:12:26.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.197+0000 7fe18341f800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5596a8a73900 0x5596a8a75cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.197+0000 7fe18341f800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5596a8931d40 con 0x5596a8a76230 2024-04-24T02:12:26.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.197+0000 7fe18341f800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x5596a89044d0 con 0x5596a8a73900 2024-04-24T02:12:26.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.197+0000 7fe180f1e640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5596a8a73900 0x5596a8a75cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.197+0000 7fe17bfff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x5596a8a76230 0x5596a8a78620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:55254/0 (socket says 172.21.15.134:55254) 2024-04-24T02:12:26.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.197+0000 7fe180f1e640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5596a8a73900 0x5596a8a75cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55946/0 (socket says 172.21.15.134:55946) 2024-04-24T02:12:26.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.197+0000 7fe17bfff640 1 -- 172.21.15.134:0/397611865 learned_addr learned my addr 172.21.15.134:0/397611865 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:12:26.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.197+0000 7fe180f1e640 1 -- 172.21.15.134:0/397611865 >> v1:172.21.15.104:6789/0 conn(0x5596a8a76230 legacy=0x5596a8a78620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.197+0000 7fe17b7fe640 1 -- 172.21.15.134:0/397611865 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2300252126 0 0) 0x5596a8931d40 con 0x5596a8a76230 2024-04-24T02:12:26.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.197+0000 7fe180f1e640 1 -- 172.21.15.134:0/397611865 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596a8930590 con 0x5596a8a73900 2024-04-24T02:12:26.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.199+0000 7fe180f1e640 1 --2- 172.21.15.134:0/397611865 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5596a8a73900 0x5596a8a75cf0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe17400a470 tx=0x7fe17401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dcb56d12a35b3de server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.199+0000 7fe17b7fe640 1 -- 172.21.15.134:0/397611865 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe174057070 con 0x5596a8a73900 2024-04-24T02:12:26.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.199+0000 7fe17b7fe640 1 -- 172.21.15.134:0/397611865 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe174052570 con 0x5596a8a73900 2024-04-24T02:12:26.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.199+0000 7fe17b7fe640 1 -- 172.21.15.134:0/397611865 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe174052870 con 0x5596a8a73900 2024-04-24T02:12:26.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.200+0000 7fe18341f800 1 -- 172.21.15.134:0/397611865 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5596a8a73900 msgr2=0x5596a8a75cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.200+0000 7fe18341f800 1 --2- 172.21.15.134:0/397611865 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5596a8a73900 0x5596a8a75cf0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe17400a470 tx=0x7fe17401ce90 comp rx=0 tx=0).stop 2024-04-24T02:12:26.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.200+0000 7fe18341f800 1 -- 172.21.15.134:0/397611865 shutdown_connections 2024-04-24T02:12:26.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.200+0000 7fe18341f800 1 --2- 172.21.15.134:0/397611865 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5596a8a73900 0x5596a8a75cf0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.200+0000 7fe18341f800 1 -- 172.21.15.134:0/397611865 >> 172.21.15.134:0/397611865 conn(0x5596a8a6d3d0 msgr2=0x5596a8a6f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:26.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.200+0000 7fe18341f800 1 -- 172.21.15.134:0/397611865 shutdown_connections 2024-04-24T02:12:26.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.200+0000 7fe18341f800 1 -- 172.21.15.134:0/397611865 wait complete. 2024-04-24T02:12:26.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.212+0000 7fe18341f800 1 Processor -- start 2024-04-24T02:12:26.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.212+0000 7fe18341f800 1 -- start start 2024-04-24T02:12:26.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.212+0000 7fe18341f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5596a8a73900 0x5596a8a73240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.212+0000 7fe18341f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5596a89be3e0 con 0x5596a8a73900 2024-04-24T02:12:26.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.212+0000 7fe180f1e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5596a8a73900 0x5596a8a73240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.212+0000 7fe180f1e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5596a8a73900 0x5596a8a73240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55958/0 (socket says 172.21.15.134:55958) 2024-04-24T02:12:26.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.212+0000 7fe180f1e640 1 -- 172.21.15.134:0/3449476642 learned_addr learned my addr 172.21.15.134:0/3449476642 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:26.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.212+0000 7fe180f1e640 1 -- 172.21.15.134:0/3449476642 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596a8a71800 con 0x5596a8a73900 2024-04-24T02:12:26.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.213+0000 7fe180f1e640 1 --2- 172.21.15.134:0/3449476642 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5596a8a73900 0x5596a8a73240 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe174055040 tx=0x7fe17404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dab88c7fa959a8d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.213+0000 7fe06ee05640 1 -- 172.21.15.134:0/3449476642 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe174057070 con 0x5596a8a73900 2024-04-24T02:12:26.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.213+0000 7fe06ee05640 1 -- 172.21.15.134:0/3449476642 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe174063070 con 0x5596a8a73900 2024-04-24T02:12:26.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.213+0000 7fe06ee05640 1 -- 172.21.15.134:0/3449476642 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe174052720 con 0x5596a8a73900 2024-04-24T02:12:26.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.213+0000 7fe18341f800 1 -- 172.21.15.134:0/3449476642 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5596a8a73900 msgr2=0x5596a8a73240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.213+0000 7fe18341f800 1 --2- 172.21.15.134:0/3449476642 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5596a8a73900 0x5596a8a73240 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe174055040 tx=0x7fe17404c000 comp rx=0 tx=0).stop 2024-04-24T02:12:26.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.213+0000 7fe18341f800 1 -- 172.21.15.134:0/3449476642 shutdown_connections 2024-04-24T02:12:26.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.213+0000 7fe18341f800 1 --2- 172.21.15.134:0/3449476642 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5596a8a73900 0x5596a8a73240 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.213+0000 7fe18341f800 1 -- 172.21.15.134:0/3449476642 >> 172.21.15.134:0/3449476642 conn(0x5596a8a6d3d0 msgr2=0x5596a8b5f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:26.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.213+0000 7fe18341f800 1 -- 172.21.15.134:0/3449476642 shutdown_connections 2024-04-24T02:12:26.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.213+0000 7fe18341f800 1 -- 172.21.15.134:0/3449476642 wait complete. 2024-04-24T02:12:26.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.214+0000 7fe18341f800 1 Processor -- start 2024-04-24T02:12:26.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.214+0000 7fe18341f800 1 -- start start 2024-04-24T02:12:26.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.214+0000 7fe18341f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5596a8a73900 0x5596a8b6dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.214+0000 7fe18341f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5596a8a7a040 con 0x5596a8a73900 2024-04-24T02:12:26.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.214+0000 7fe180f1e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5596a8a73900 0x5596a8b6dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.214+0000 7fe180f1e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5596a8a73900 0x5596a8b6dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55964/0 (socket says 172.21.15.134:55964) 2024-04-24T02:12:26.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.214+0000 7fe180f1e640 1 -- 172.21.15.134:0/3173647000 learned_addr learned my addr 172.21.15.134:0/3173647000 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:26.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.215+0000 7fe180f1e640 1 -- 172.21.15.134:0/3173647000 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596a8b6e160 con 0x5596a8a73900 2024-04-24T02:12:26.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.215+0000 7fe180f1e640 1 --2- 172.21.15.134:0/3173647000 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5596a8a73900 0x5596a8b6dc20 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe174060040 tx=0x7fe174002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.215+0000 7fe06d602640 1 -- 172.21.15.134:0/3173647000 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe174052e30 con 0x5596a8a73900 2024-04-24T02:12:26.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.215+0000 7fe06d602640 1 -- 172.21.15.134:0/3173647000 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe17406c070 con 0x5596a8a73900 2024-04-24T02:12:26.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.215+0000 7fe06d602640 1 -- 172.21.15.134:0/3173647000 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe17405e5f0 con 0x5596a8a73900 2024-04-24T02:12:26.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.215+0000 7fe18341f800 1 -- 172.21.15.134:0/3173647000 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5596a8b6e3f0 con 0x5596a8a73900 2024-04-24T02:12:26.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.215+0000 7fe18341f800 1 -- 172.21.15.134:0/3173647000 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596a8b710a0 con 0x5596a8a73900 2024-04-24T02:12:26.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.216+0000 7fe06d602640 1 -- 172.21.15.134:0/3173647000 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe17405e790 con 0x5596a8a73900 2024-04-24T02:12:26.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.216+0000 7fe06d602640 1 --2- 172.21.15.134:0/3173647000 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe068036950 0x7fe068038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.216+0000 7fe06d602640 1 -- 172.21.15.134:0/3173647000 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fe17408e6f0 con 0x5596a8a73900 2024-04-24T02:12:26.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.216+0000 7fe17bfff640 1 --2- 172.21.15.134:0/3173647000 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe068036950 0x7fe068038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.216+0000 7fe18341f800 1 --2- 172.21.15.134:0/3173647000 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5596a8a76230 0x5596a8b74e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.216+0000 7fe18341f800 1 -- 172.21.15.134:0/3173647000 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5596a8b753a0 con 0x5596a8a76230 2024-04-24T02:12:26.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.216+0000 7fe18171f640 1 --2- 172.21.15.134:0/3173647000 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5596a8a76230 0x5596a8b74e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.216+0000 7fe17bfff640 1 --2- 172.21.15.134:0/3173647000 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe068036950 0x7fe068038e10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe16c000c00 tx=0x7fe16c0013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.216+0000 7fe18171f640 1 --2- 172.21.15.134:0/3173647000 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5596a8a76230 0x5596a8b74e60 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.217+0000 7fe18171f640 1 -- 172.21.15.134:0/3173647000 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe17c00a4a0 con 0x5596a8a76230 2024-04-24T02:12:26.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.217+0000 7fe18341f800 1 -- 172.21.15.134:0/3173647000 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5596a8b72410 con 0x5596a8a76230 2024-04-24T02:12:26.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.217+0000 7fe18171f640 1 -- 172.21.15.134:0/3173647000 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe17c00a4a0 con 0x5596a8a76230 2024-04-24T02:12:26.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.217+0000 7fe18341f800 1 -- 172.21.15.134:0/3173647000 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5596a8b77180 con 0x5596a8a76230 2024-04-24T02:12:26.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.217+0000 7fe18171f640 1 -- 172.21.15.134:0/3173647000 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe17c00a4a0 con 0x5596a8a76230 2024-04-24T02:12:26.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.217+0000 7fe18341f800 1 -- 172.21.15.134:0/3173647000 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5596a8b764c0 con 0x5596a8a76230 2024-04-24T02:12:26.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.218+0000 7fe18171f640 1 -- 172.21.15.134:0/3173647000 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe17c00a4a0 con 0x5596a8a76230 2024-04-24T02:12:26.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.218+0000 7fe18341f800 1 -- 172.21.15.134:0/3173647000 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5596a8b768e0 con 0x5596a8a76230 2024-04-24T02:12:26.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.218+0000 7fe18171f640 1 -- 172.21.15.134:0/3173647000 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe17c00a4a0 con 0x5596a8a76230 2024-04-24T02:12:26.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.218+0000 7fe18341f800 1 Processor -- start 2024-04-24T02:12:26.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.218+0000 7fe18341f800 1 -- start start 2024-04-24T02:12:26.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.218+0000 7fe18341f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5596a8b85f90 0x5596a8b863b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.218+0000 7fe18341f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5596a89646b0 con 0x5596a8b85f90 2024-04-24T02:12:26.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.219+0000 7fe17bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5596a8b85f90 0x5596a8b863b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.219+0000 7fe17bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5596a8b85f90 0x5596a8b863b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55968/0 (socket says 172.21.15.134:55968) 2024-04-24T02:12:26.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.219+0000 7fe17bfff640 1 -- 172.21.15.134:0/2549369790 learned_addr learned my addr 172.21.15.134:0/2549369790 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:26.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.219+0000 7fe17bfff640 1 -- 172.21.15.134:0/2549369790 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596a8b868f0 con 0x5596a8b85f90 2024-04-24T02:12:26.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.220+0000 7fe17bfff640 1 --2- 172.21.15.134:0/2549369790 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5596a8b85f90 0x5596a8b863b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe16c00e610 tx=0x7fe16c00ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.220+0000 7fe0667fc640 1 -- 172.21.15.134:0/2549369790 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe16c022070 con 0x5596a8b85f90 2024-04-24T02:12:26.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.220+0000 7fe0667fc640 1 -- 172.21.15.134:0/2549369790 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe16c009050 con 0x5596a8b85f90 2024-04-24T02:12:26.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.220+0000 7fe18341f800 1 -- 172.21.15.134:0/2549369790 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5596a8b87360 con 0x5596a8b85f90 2024-04-24T02:12:26.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.220+0000 7fe0667fc640 1 -- 172.21.15.134:0/2549369790 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe16c00d500 con 0x5596a8b85f90 2024-04-24T02:12:26.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.220+0000 7fe18341f800 1 -- 172.21.15.134:0/2549369790 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596a8b87860 con 0x5596a8b85f90 2024-04-24T02:12:26.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.221+0000 7fe0667fc640 1 -- 172.21.15.134:0/2549369790 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe16c025070 con 0x5596a8b85f90 2024-04-24T02:12:26.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.221+0000 7fe0667fc640 1 --2- 172.21.15.134:0/2549369790 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe058036950 0x7fe058038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.221+0000 7fe0667fc640 1 -- 172.21.15.134:0/2549369790 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fe16c04d9e0 con 0x5596a8b85f90 2024-04-24T02:12:26.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.221+0000 7fe18171f640 1 --2- 172.21.15.134:0/2549369790 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe058036950 0x7fe058038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.221+0000 7fe18341f800 1 Processor -- start 2024-04-24T02:12:26.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.221+0000 7fe18171f640 1 --2- 172.21.15.134:0/2549369790 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe058036950 0x7fe058038e10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x5596a8b76860 tx=0x7fe17c005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.221+0000 7fe18341f800 1 -- start start 2024-04-24T02:12:26.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.222+0000 7fe18341f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5596a8b932d0 0x5596a8b936f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.222+0000 7fe18341f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5596a8a71ac0 con 0x5596a8b932d0 2024-04-24T02:12:26.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.222+0000 7fe17bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5596a8b932d0 0x5596a8b936f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.222+0000 7fe17bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5596a8b932d0 0x5596a8b936f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55980/0 (socket says 172.21.15.134:55980) 2024-04-24T02:12:26.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.222+0000 7fe17bfff640 1 -- 172.21.15.134:0/500695190 learned_addr learned my addr 172.21.15.134:0/500695190 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:26.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.222+0000 7fe17bfff640 1 -- 172.21.15.134:0/500695190 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596a8b93cc0 con 0x5596a8b932d0 2024-04-24T02:12:26.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.222+0000 7fe17bfff640 1 --2- 172.21.15.134:0/500695190 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5596a8b932d0 0x5596a8b936f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe16c026fd0 tx=0x7fe16c024eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec560acb586905e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.222+0000 7fe057fff640 1 -- 172.21.15.134:0/500695190 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe16c04a030 con 0x5596a8b932d0 2024-04-24T02:12:26.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.222+0000 7fe057fff640 1 -- 172.21.15.134:0/500695190 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe16c025e30 con 0x5596a8b932d0 2024-04-24T02:12:26.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.222+0000 7fe057fff640 1 -- 172.21.15.134:0/500695190 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe16c01ad70 con 0x5596a8b932d0 2024-04-24T02:12:26.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.223+0000 7fe18341f800 1 -- 172.21.15.134:0/500695190 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5596a8b932d0 msgr2=0x5596a8b936f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.223+0000 7fe18341f800 1 --2- 172.21.15.134:0/500695190 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5596a8b932d0 0x5596a8b936f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe16c026fd0 tx=0x7fe16c024eb0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.223+0000 7fe18341f800 1 -- 172.21.15.134:0/500695190 shutdown_connections 2024-04-24T02:12:26.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.223+0000 7fe18341f800 1 --2- 172.21.15.134:0/500695190 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5596a8b932d0 0x5596a8b936f0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.223+0000 7fe18341f800 1 -- 172.21.15.134:0/500695190 >> 172.21.15.134:0/500695190 conn(0x5596a8b8f630 msgr2=0x5596a8b8d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:26.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.223+0000 7fe18341f800 1 -- 172.21.15.134:0/500695190 shutdown_connections 2024-04-24T02:12:26.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.223+0000 7fe18341f800 1 -- 172.21.15.134:0/500695190 wait complete. 2024-04-24T02:12:26.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.223+0000 7fe18341f800 1 Processor -- start 2024-04-24T02:12:26.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.223+0000 7fe18341f800 1 -- start start 2024-04-24T02:12:26.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.223+0000 7fe18341f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5596a8b932d0 0x5596a8b9a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.223+0000 7fe18341f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5596a8b94430 con 0x5596a8b932d0 2024-04-24T02:12:26.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.223+0000 7fe17bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5596a8b932d0 0x5596a8b9a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.223+0000 7fe17bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5596a8b932d0 0x5596a8b9a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55986/0 (socket says 172.21.15.134:55986) 2024-04-24T02:12:26.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.223+0000 7fe17bfff640 1 -- 172.21.15.134:0/3400383105 learned_addr learned my addr 172.21.15.134:0/3400383105 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:26.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.224+0000 7fe17bfff640 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596a8b9ae80 con 0x5596a8b932d0 2024-04-24T02:12:26.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.224+0000 7fe17bfff640 1 --2- 172.21.15.134:0/3400383105 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5596a8b932d0 0x5596a8b9a940 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe16c0266c0 tx=0x7fe16c04be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.224+0000 7fe0567fc640 1 -- 172.21.15.134:0/3400383105 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe16c02f030 con 0x5596a8b932d0 2024-04-24T02:12:26.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.224+0000 7fe0567fc640 1 -- 172.21.15.134:0/3400383105 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe16c025360 con 0x5596a8b932d0 2024-04-24T02:12:26.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.224+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5596a8b9b110 con 0x5596a8b932d0 2024-04-24T02:12:26.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.224+0000 7fe0567fc640 1 -- 172.21.15.134:0/3400383105 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe16c04a050 con 0x5596a8b932d0 2024-04-24T02:12:26.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.224+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596a8b9ddc0 con 0x5596a8b932d0 2024-04-24T02:12:26.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.224+0000 7fe0567fc640 1 -- 172.21.15.134:0/3400383105 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe16c025660 con 0x5596a8b932d0 2024-04-24T02:12:26.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.225+0000 7fe0567fc640 1 --2- 172.21.15.134:0/3400383105 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe04c036950 0x7fe04c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.225+0000 7fe0567fc640 1 -- 172.21.15.134:0/3400383105 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fe16c030070 con 0x5596a8b932d0 2024-04-24T02:12:26.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.225+0000 7fe18171f640 1 --2- 172.21.15.134:0/3400383105 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe04c036950 0x7fe04c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.225+0000 7fe18171f640 1 --2- 172.21.15.134:0/3400383105 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe04c036950 0x7fe04c038e10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x5596a8b75fe0 tx=0x7fe17c01f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.225+0000 7fe18341f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.225+0000 7fe18341f800 1 --2- 172.21.15.134:0/3400383105 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5596a8ba64e0 0x5596a8ba89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.225+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5596a8ba90f0 con 0x5596a8ba64e0 2024-04-24T02:12:26.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.225+0000 7fe180f1e640 1 --2- 172.21.15.134:0/3400383105 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5596a8ba64e0 0x5596a8ba89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.226+0000 7fe180f1e640 1 --2- 172.21.15.134:0/3400383105 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5596a8ba64e0 0x5596a8ba89a0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.226+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe174071990 con 0x5596a8ba64e0 2024-04-24T02:12:26.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.226+0000 7fe18341f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:26.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.226+0000 7fe18341f800 20 realm 2024-04-24T02:12:26.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.226+0000 7fe18341f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.226+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5596a8ba9500 con 0x5596a8ba64e0 2024-04-24T02:12:26.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.226+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe174071990 con 0x5596a8ba64e0 2024-04-24T02:12:26.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.226+0000 7fe18341f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:26.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.226+0000 7fe18341f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:26.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.226+0000 7fe18341f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.226+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5596a8ba9dd0 con 0x5596a8ba64e0 2024-04-24T02:12:26.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.226+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe174071990 con 0x5596a8ba64e0 2024-04-24T02:12:26.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.226+0000 7fe18341f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:26.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.226+0000 7fe18341f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.226+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5596a8baa170 con 0x5596a8ba64e0 2024-04-24T02:12:26.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.227+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe174071990 con 0x5596a8ba64e0 2024-04-24T02:12:26.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.227+0000 7fe18341f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:26.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.227+0000 7fe18341f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.227+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5596a8baa9c0 con 0x5596a8ba64e0 2024-04-24T02:12:26.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.227+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe174071990 con 0x5596a8ba64e0 2024-04-24T02:12:26.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.227+0000 7fe18341f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:26.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.227+0000 7fe18341f800 20 searching for the correct realm 2024-04-24T02:12:26.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.227+0000 7fe18341f800 1 --2- 172.21.15.134:0/3400383105 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5596a8bac730 0x5596a8baeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.227+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596a8baf100 con 0x5596a8bac730 2024-04-24T02:12:26.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.227+0000 7fe17bfff640 1 --2- 172.21.15.134:0/3400383105 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5596a8bac730 0x5596a8baeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.227+0000 7fe17bfff640 1 --2- 172.21.15.134:0/3400383105 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5596a8bac730 0x5596a8baeb20 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.228+0000 7fe17bfff640 1 -- 172.21.15.134:0/3400383105 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe16c024030 con 0x5596a8bac730 2024-04-24T02:12:26.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.228+0000 7fe17bfff640 1 --2- 172.21.15.134:0/3400383105 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fe16c027060 0x7fe16c046070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.228+0000 7fe17bfff640 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596a8baf100 con 0x7fe16c027060 2024-04-24T02:12:26.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.228+0000 7fe18171f640 1 --2- 172.21.15.134:0/3400383105 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fe16c027060 0x7fe16c046070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.228+0000 7fe18171f640 1 --2- 172.21.15.134:0/3400383105 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fe16c027060 0x7fe16c046070 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.228+0000 7fe18171f640 1 -- 172.21.15.134:0/3400383105 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe17c01f070 con 0x7fe16c027060 2024-04-24T02:12:26.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.228+0000 7fe18171f640 1 --2- 172.21.15.134:0/3400383105 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fe17c031040 0x7fe17c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.228+0000 7fe18171f640 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596a8baf100 con 0x7fe17c031040 2024-04-24T02:12:26.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.229+0000 7fe180f1e640 1 --2- 172.21.15.134:0/3400383105 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fe17c031040 0x7fe17c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.229+0000 7fe180f1e640 1 --2- 172.21.15.134:0/3400383105 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fe17c031040 0x7fe17c032940 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.229+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe174071990 con 0x7fe17c031040 2024-04-24T02:12:26.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.229+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596a8baa9c0 con 0x5596a8ba64e0 2024-04-24T02:12:26.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.229+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe174071990 con 0x5596a8ba64e0 2024-04-24T02:12:26.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.229+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596a8baa9c0 con 0x5596a8ba64e0 2024-04-24T02:12:26.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.230+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe174071990 con 0x5596a8ba64e0 2024-04-24T02:12:26.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.230+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596a8baa9c0 con 0x7fe17c031040 2024-04-24T02:12:26.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.230+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe174071990 con 0x7fe17c031040 2024-04-24T02:12:26.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.230+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596a8baa9c0 con 0x7fe17c031040 2024-04-24T02:12:26.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.230+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe174071990 con 0x7fe17c031040 2024-04-24T02:12:26.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.230+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596a8baa9c0 con 0x7fe16c027060 2024-04-24T02:12:26.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.230+0000 7fe18171f640 1 -- 172.21.15.134:0/3400383105 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe17c01f070 con 0x7fe16c027060 2024-04-24T02:12:26.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.230+0000 7fe18171f640 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596a8baa9c0 con 0x5596a8bac730 2024-04-24T02:12:26.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.231+0000 7fe17bfff640 1 -- 172.21.15.134:0/3400383105 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe16c024030 con 0x5596a8bac730 2024-04-24T02:12:26.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.231+0000 7fe17bfff640 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596a8baa9c0 con 0x5596a8ba64e0 2024-04-24T02:12:26.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.231+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe174071990 con 0x5596a8ba64e0 2024-04-24T02:12:26.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.231+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596a8baa9c0 con 0x7fe17c031040 2024-04-24T02:12:26.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.231+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe174071990 con 0x7fe17c031040 2024-04-24T02:12:26.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.231+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596a8baa9c0 con 0x5596a8ba64e0 2024-04-24T02:12:26.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.231+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe174071990 con 0x5596a8ba64e0 2024-04-24T02:12:26.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.231+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596a8baa9c0 con 0x7fe16c027060 2024-04-24T02:12:26.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.232+0000 7fe18171f640 1 -- 172.21.15.134:0/3400383105 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe17c01f070 con 0x7fe16c027060 2024-04-24T02:12:26.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.232+0000 7fe18171f640 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596a8baa9c0 con 0x5596a8bac730 2024-04-24T02:12:26.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.232+0000 7fe17bfff640 1 -- 172.21.15.134:0/3400383105 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe16c024030 con 0x5596a8bac730 2024-04-24T02:12:26.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.232+0000 7fe17bfff640 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596a8baa9c0 con 0x5596a8bac730 2024-04-24T02:12:26.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.232+0000 7fe17bfff640 1 -- 172.21.15.134:0/3400383105 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe16c024030 con 0x5596a8bac730 2024-04-24T02:12:26.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.232+0000 7fe17bfff640 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596a8baa9c0 con 0x7fe17c031040 2024-04-24T02:12:26.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.232+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe174071990 con 0x7fe17c031040 2024-04-24T02:12:26.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.232+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596a8baa9c0 con 0x5596a8bac730 2024-04-24T02:12:26.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.233+0000 7fe17bfff640 1 -- 172.21.15.134:0/3400383105 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe16c024030 con 0x5596a8bac730 2024-04-24T02:12:26.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.233+0000 7fe17bfff640 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596a8baa9c0 con 0x5596a8bac730 2024-04-24T02:12:26.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.233+0000 7fe17bfff640 1 -- 172.21.15.134:0/3400383105 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe16c024030 con 0x5596a8bac730 2024-04-24T02:12:26.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.233+0000 7fe17bfff640 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596a8baa9c0 con 0x5596a8ba64e0 2024-04-24T02:12:26.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.233+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe174071990 con 0x5596a8ba64e0 2024-04-24T02:12:26.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.233+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596a8baa9c0 con 0x5596a8ba64e0 2024-04-24T02:12:26.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.233+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fe174071990 con 0x5596a8ba64e0 2024-04-24T02:12:26.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.233+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596a8baa9c0 con 0x7fe17c031040 2024-04-24T02:12:26.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.234+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe174071990 con 0x7fe17c031040 2024-04-24T02:12:26.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.234+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596a8baa9c0 con 0x5596a8bac730 2024-04-24T02:12:26.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.234+0000 7fe17bfff640 1 -- 172.21.15.134:0/3400383105 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe16c024030 con 0x5596a8bac730 2024-04-24T02:12:26.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.234+0000 7fe17bfff640 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596a8baa9c0 con 0x7fe16c027060 2024-04-24T02:12:26.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.234+0000 7fe18171f640 1 -- 172.21.15.134:0/3400383105 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe17c01f070 con 0x7fe16c027060 2024-04-24T02:12:26.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.234+0000 7fe18171f640 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596a8baa9c0 con 0x5596a8ba64e0 2024-04-24T02:12:26.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.234+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe174071990 con 0x5596a8ba64e0 2024-04-24T02:12:26.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.234+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596a8baa9c0 con 0x7fe17c031040 2024-04-24T02:12:26.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.235+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe174071990 con 0x7fe17c031040 2024-04-24T02:12:26.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.235+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596a8baa9c0 con 0x5596a8bac730 2024-04-24T02:12:26.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.235+0000 7fe17bfff640 1 -- 172.21.15.134:0/3400383105 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe16c024030 con 0x5596a8bac730 2024-04-24T02:12:26.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.235+0000 7fe17bfff640 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596a8baa9c0 con 0x7fe17c031040 2024-04-24T02:12:26.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.235+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe174071990 con 0x7fe17c031040 2024-04-24T02:12:26.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.235+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596a8baa9c0 con 0x7fe16c027060 2024-04-24T02:12:26.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.235+0000 7fe18171f640 1 -- 172.21.15.134:0/3400383105 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe17c01f070 con 0x7fe16c027060 2024-04-24T02:12:26.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.235+0000 7fe18171f640 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596a8baa9c0 con 0x5596a8bac730 2024-04-24T02:12:26.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.235+0000 7fe17bfff640 1 -- 172.21.15.134:0/3400383105 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe16c024030 con 0x5596a8bac730 2024-04-24T02:12:26.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.235+0000 7fe17bfff640 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596a8baa9c0 con 0x7fe17c031040 2024-04-24T02:12:26.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.236+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe174071990 con 0x7fe17c031040 2024-04-24T02:12:26.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.236+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596a8baa9c0 con 0x5596a8ba64e0 2024-04-24T02:12:26.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.236+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe174071990 con 0x5596a8ba64e0 2024-04-24T02:12:26.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.236+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5596a8baa9c0 con 0x7fe16c027060 2024-04-24T02:12:26.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.237+0000 7fe18171f640 1 -- 172.21.15.134:0/3400383105 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe17c01f070 con 0x7fe16c027060 2024-04-24T02:12:26.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.237+0000 7fe18341f800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:26.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.237+0000 7fe18341f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:26.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.237+0000 7fe18341f800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:26.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.237+0000 7fe18341f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:26.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.237+0000 7fe18341f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:26.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.237+0000 7fe18341f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:26.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.237+0000 7fe18341f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.237+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5596a8bab210 con 0x5596a8ba64e0 2024-04-24T02:12:26.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.237+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe174071990 con 0x5596a8ba64e0 2024-04-24T02:12:26.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.237+0000 7fe18341f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:26.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.237+0000 7fe18341f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.237+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5596a8bab600 con 0x5596a8ba64e0 2024-04-24T02:12:26.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.237+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe174071990 con 0x5596a8ba64e0 2024-04-24T02:12:26.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.237+0000 7fe18341f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:26.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.237+0000 7fe18341f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.237+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5596a8bab600 con 0x5596a8ba64e0 2024-04-24T02:12:26.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.237+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe174071990 con 0x5596a8ba64e0 2024-04-24T02:12:26.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.237+0000 7fe18341f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:26.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.237+0000 7fe18341f800 20 zone default found 2024-04-24T02:12:26.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.237+0000 7fe18341f800 4 Realm: () 2024-04-24T02:12:26.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.237+0000 7fe18341f800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:26.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.237+0000 7fe18341f800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:26.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.237+0000 7fe18341f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:26.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.237+0000 7fe18341f800 20 zonegroup default 2024-04-24T02:12:26.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.237+0000 7fe18341f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.237+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5596a8baf580 con 0x7fe17c031040 2024-04-24T02:12:26.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.238+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe174071990 con 0x7fe17c031040 2024-04-24T02:12:26.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.238+0000 7fe18341f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:26.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.238+0000 7fe18341f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.238+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5596a8bb0f60 con 0x5596a8bac730 2024-04-24T02:12:26.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.238+0000 7fe17bfff640 1 -- 172.21.15.134:0/3400383105 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe16c024030 con 0x5596a8bac730 2024-04-24T02:12:26.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.238+0000 7fe18341f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:26.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.238+0000 7fe18341f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.238+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5596a8bb1300 con 0x5596a8bac730 2024-04-24T02:12:26.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.238+0000 7fe17bfff640 1 -- 172.21.15.134:0/3400383105 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe16c024030 con 0x5596a8bac730 2024-04-24T02:12:26.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.238+0000 7fe18341f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:26.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.238+0000 7fe18341f800 20 started sync module instance, tier type = 2024-04-24T02:12:26.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.238+0000 7fe18341f800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:26.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.238+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596a8bb0400 con 0x7fe16c027060 2024-04-24T02:12:26.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.240+0000 7fe18171f640 1 -- 172.21.15.134:0/3400383105 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe17c040040 con 0x7fe16c027060 2024-04-24T02:12:26.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.240+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94105564284960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596a8bb0060 con 0x7fe16c027060 2024-04-24T02:12:26.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.240+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596a8bb2000 con 0x5596a8ba64e0 2024-04-24T02:12:26.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.240+0000 7fe18171f640 1 -- 172.21.15.134:0/3400383105 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94105564284960] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe17c040040 con 0x7fe16c027060 2024-04-24T02:12:26.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.241+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe174071990 con 0x5596a8ba64e0 2024-04-24T02:12:26.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.241+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94105564288672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596a8bb1f70 con 0x5596a8ba64e0 2024-04-24T02:12:26.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.241+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596a8bb2b00 con 0x5596a8bac730 2024-04-24T02:12:26.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.242+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94105564288672] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe174071990 con 0x5596a8ba64e0 2024-04-24T02:12:26.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.242+0000 7fe17bfff640 1 -- 172.21.15.134:0/3400383105 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe16c024030 con 0x5596a8bac730 2024-04-24T02:12:26.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.242+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94105564289728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596a8bb1ee0 con 0x5596a8bac730 2024-04-24T02:12:26.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.242+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596a8bb39c0 con 0x7fe16c027060 2024-04-24T02:12:26.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.243+0000 7fe18171f640 1 -- 172.21.15.134:0/3400383105 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe17c040040 con 0x7fe16c027060 2024-04-24T02:12:26.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.243+0000 7fe17bfff640 1 -- 172.21.15.134:0/3400383105 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94105564289728] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe16c024030 con 0x5596a8bac730 2024-04-24T02:12:26.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.243+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94105564296464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596a8bb3de0 con 0x7fe16c027060 2024-04-24T02:12:26.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.243+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596a8bb47a0 con 0x5596a8ba64e0 2024-04-24T02:12:26.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.244+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe174071990 con 0x5596a8ba64e0 2024-04-24T02:12:26.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.244+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94105564300016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596a8bb4bc0 con 0x5596a8ba64e0 2024-04-24T02:12:26.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.244+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596a8bb5690 con 0x7fe17c031040 2024-04-24T02:12:26.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.244+0000 7fe18171f640 1 -- 172.21.15.134:0/3400383105 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94105564296464] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe17c040040 con 0x7fe16c027060 2024-04-24T02:12:26.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.245+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe174071990 con 0x7fe17c031040 2024-04-24T02:12:26.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.245+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94105564303744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596a8bb5650 con 0x7fe17c031040 2024-04-24T02:12:26.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.245+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596a8bb5650 con 0x7fe17c031040 2024-04-24T02:12:26.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.245+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94105564300016] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe174071990 con 0x5596a8ba64e0 2024-04-24T02:12:26.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.246+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94105564303744] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe174071990 con 0x7fe17c031040 2024-04-24T02:12:26.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.246+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(56 notify.6 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe174071990 con 0x7fe17c031040 2024-04-24T02:12:26.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.246+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94105564297520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596a8bb5c20 con 0x7fe17c031040 2024-04-24T02:12:26.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.246+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596a8bb65e0 con 0x7fe17c031040 2024-04-24T02:12:26.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.247+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94105564297520] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe174071990 con 0x7fe17c031040 2024-04-24T02:12:26.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.247+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(58 notify.7 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe174071990 con 0x7fe17c031040 2024-04-24T02:12:26.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.247+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94105564301072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596a8bb65e0 con 0x7fe17c031040 2024-04-24T02:12:26.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.247+0000 7fe18341f800 20 add_watcher() i=0 2024-04-24T02:12:26.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.247+0000 7fe18341f800 20 add_watcher() i=1 2024-04-24T02:12:26.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.247+0000 7fe18341f800 20 add_watcher() i=2 2024-04-24T02:12:26.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.247+0000 7fe18341f800 20 add_watcher() i=3 2024-04-24T02:12:26.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.247+0000 7fe18341f800 20 add_watcher() i=4 2024-04-24T02:12:26.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.247+0000 7fe18341f800 20 add_watcher() i=5 2024-04-24T02:12:26.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.247+0000 7fe18341f800 20 add_watcher() i=6 2024-04-24T02:12:26.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.248+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94105564301072] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe174071990 con 0x7fe17c031040 2024-04-24T02:12:26.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.248+0000 7fe18341f800 20 add_watcher() i=7 2024-04-24T02:12:26.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.248+0000 7fe18341f800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:26.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.248+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5596a8bb98d0 con 0x5596a8ba64e0 2024-04-24T02:12:26.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.248+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe174071990 con 0x5596a8ba64e0 2024-04-24T02:12:26.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.248+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94105564308128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596a8bb6b70 con 0x5596a8ba64e0 2024-04-24T02:12:26.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.249+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94105564308128] v30'113 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe174071990 con 0x5596a8ba64e0 2024-04-24T02:12:26.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.249+0000 7fe036fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:26.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.249+0000 7fe18341f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:26.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.249+0000 7fe18341f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:26.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.249+0000 7fe18341f800 5 note: GC not initialized 2024-04-24T02:12:26.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.249+0000 7fe035fe3640 20 reqs_thread_entry: start 2024-04-24T02:12:26.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.250+0000 7fe18341f800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:26.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.250+0000 7fe18341f800 20 Filter name: none 2024-04-24T02:12:26.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.250+0000 7fdfa77fe640 20 reqs_thread_entry: start 2024-04-24T02:12:26.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.250+0000 7fe18341f800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-24T02:12:26.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.250+0000 7fe18341f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.250+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5596a8becce0 con 0x7fe17c031040 2024-04-24T02:12:26.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.250+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fe174071990 con 0x7fe17c031040 2024-04-24T02:12:26.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.250+0000 7fe18341f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:26.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.250+0000 7fe18341f800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-04-24T02:12:26.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.250+0000 7fe18341f800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-24T02:12:26.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.250+0000 7fe18341f800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-04-24T02:12:26.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.250+0000 7fe18341f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.250+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5596a8beb480 con 0x7fe17c031040 2024-04-24T02:12:26.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.250+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fe174071990 con 0x7fe17c031040 2024-04-24T02:12:26.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.250+0000 7fe18341f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:26.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.250+0000 7fe18341f800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-04-24T02:12:26.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.250+0000 7fe18341f800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-24T02:12:26.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.250+0000 7fe18341f800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-24T02:12:26.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.250+0000 7fe18341f800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-24T02:12:26.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.250+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596a8bebd20 con 0x7fe17c031040 2024-04-24T02:12:26.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.252+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v30'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fe174071990 con 0x7fe17c031040 2024-04-24T02:12:26.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.252+0000 7fe18341f800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-04-24T02:12:26.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.252+0000 7fe18341f800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-04-24T02:12:26.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.252+0000 7fe18341f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-04-24T02:12:26.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.252+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94105564526704 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5596a8bf0370 con 0x7fe17c031040 2024-04-24T02:12:26.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.252+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.0 v2:172.21.15.104:6800/2419146313 20 ==== watch-notify(notify (1) cookie 94105564303744 notify 128849018883 ret 0) ==== 598+0+0 (crc 0 0 0) 0x5596a8bec730 con 0x7fe17c031040 2024-04-24T02:12:26.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.252+0000 7fe057fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018883 cookie 94105564303744 notifier 4481 bl.length()=556 2024-04-24T02:12:26.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.252+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.0 v2:172.21.15.104:6800/2419146313 21 ==== osd_op_reply(65 notify.5 [notify cookie 94105564526704 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe174071990 con 0x7fe17c031040 2024-04-24T02:12:26.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.252+0000 7fe057fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-04-24T02:12:26.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.252+0000 7fe057fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-04-24T02:12:26.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.252+0000 7fe057fff640 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fe044003ea0 con 0x7fe17c031040 2024-04-24T02:12:26.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.252+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.0 v2:172.21.15.104:6800/2419146313 22 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe174071990 con 0x7fe17c031040 2024-04-24T02:12:26.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.252+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.0 v2:172.21.15.104:6800/2419146313 23 ==== watch-notify(notify_complete (2) cookie 94105564526704 notify 128849018883 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fe17408ce30 con 0x7fe17c031040 2024-04-24T02:12:26.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.252+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596a8bebd70 con 0x7fe17c031040 2024-04-24T02:12:26.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.253+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.0 v2:172.21.15.104:6800/2419146313 24 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v30'3 uv3 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fe174071990 con 0x7fe17c031040 2024-04-24T02:12:26.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.253+0000 7fe18341f800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-24T02:12:26.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.253+0000 7fe18341f800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-24T02:12:26.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.253+0000 7fe18341f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-24T02:12:26.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.253+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94105564527856 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5596a8bf07a0 con 0x5596a8bac730 2024-04-24T02:12:26.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.254+0000 7fe17bfff640 1 -- 172.21.15.134:0/3400383105 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== watch-notify(notify (1) cookie 94105564289728 notify 128849018888 ret 0) ==== 219+0+0 (crc 0 0 0) 0x5596a8b9b110 con 0x5596a8bac730 2024-04-24T02:12:26.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.254+0000 7fe057fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018888 cookie 94105564289728 notifier 4481 bl.length()=177 2024-04-24T02:12:26.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.254+0000 7fe057fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-24T02:12:26.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.254+0000 7fe057fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-24T02:12:26.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.254+0000 7fe17bfff640 1 -- 172.21.15.134:0/3400383105 <== osd.3 v2:172.21.15.134:6801/3585115521 15 ==== osd_op_reply(68 notify.2 [notify cookie 94105564527856 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe16c024030 con 0x5596a8bac730 2024-04-24T02:12:26.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.254+0000 7fe057fff640 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fe044003ea0 con 0x5596a8bac730 2024-04-24T02:12:26.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.254+0000 7fe17bfff640 1 -- 172.21.15.134:0/3400383105 <== osd.3 v2:172.21.15.134:6801/3585115521 16 ==== watch-notify(notify_complete (2) cookie 94105564527856 notify 128849018888 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fe16c060020 con 0x5596a8bac730 2024-04-24T02:12:26.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.254+0000 7fe17bfff640 1 -- 172.21.15.134:0/3400383105 <== osd.3 v2:172.21.15.134:6801/3585115521 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe16c062040 con 0x5596a8bac730 2024-04-24T02:12:26.279 INFO:teuthology.orchestra.run.smithi134.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-04-24T02:12:26.252190Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T02:12:26.252178Z","tags":[],"group_ids":[]} 2024-04-24T02:12:26.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.255+0000 7fe036fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:26.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.255+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94105564308128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596a8bb8f60 con 0x5596a8ba64e0 2024-04-24T02:12:26.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.256+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94105564308128] v30'114 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe174071990 con 0x5596a8ba64e0 2024-04-24T02:12:26.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.256+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94105564284960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596a8bb62a0 con 0x7fe16c027060 2024-04-24T02:12:26.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.257+0000 7fe18171f640 1 -- 172.21.15.134:0/3400383105 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94105564284960] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe17c040040 con 0x7fe16c027060 2024-04-24T02:12:26.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.257+0000 7fe18341f800 20 remove_watcher() i=0 2024-04-24T02:12:26.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.257+0000 7fe18341f800 2 removed watcher, disabling cache 2024-04-24T02:12:26.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.257+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94105564288672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596a8bb62a0 con 0x5596a8ba64e0 2024-04-24T02:12:26.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.258+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94105564288672] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe174071990 con 0x5596a8ba64e0 2024-04-24T02:12:26.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.258+0000 7fe18341f800 20 remove_watcher() i=1 2024-04-24T02:12:26.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.258+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94105564289728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596a8bb16a0 con 0x5596a8bac730 2024-04-24T02:12:26.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.259+0000 7fe17bfff640 1 -- 172.21.15.134:0/3400383105 <== osd.3 v2:172.21.15.134:6801/3585115521 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94105564289728] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe16c062040 con 0x5596a8bac730 2024-04-24T02:12:26.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.259+0000 7fe18341f800 20 remove_watcher() i=2 2024-04-24T02:12:26.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.259+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94105564296464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596a8bb62a0 con 0x7fe16c027060 2024-04-24T02:12:26.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.260+0000 7fe18171f640 1 -- 172.21.15.134:0/3400383105 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94105564296464] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe17c040040 con 0x7fe16c027060 2024-04-24T02:12:26.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.260+0000 7fe18341f800 20 remove_watcher() i=3 2024-04-24T02:12:26.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.260+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94105564300016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596a8bb3510 con 0x5596a8ba64e0 2024-04-24T02:12:26.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.261+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94105564300016] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe174071990 con 0x5596a8ba64e0 2024-04-24T02:12:26.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.261+0000 7fe18341f800 20 remove_watcher() i=4 2024-04-24T02:12:26.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.261+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94105564303744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596a8bb62a0 con 0x7fe17c031040 2024-04-24T02:12:26.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.262+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.0 v2:172.21.15.104:6800/2419146313 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94105564303744] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe174071990 con 0x7fe17c031040 2024-04-24T02:12:26.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.262+0000 7fe18341f800 20 remove_watcher() i=5 2024-04-24T02:12:26.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.262+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94105564297520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596a8bb42f0 con 0x7fe17c031040 2024-04-24T02:12:26.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.263+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.0 v2:172.21.15.104:6800/2419146313 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94105564297520] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe174071990 con 0x7fe17c031040 2024-04-24T02:12:26.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.263+0000 7fe18341f800 20 remove_watcher() i=6 2024-04-24T02:12:26.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.263+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94105564301072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5596a8bb5180 con 0x7fe17c031040 2024-04-24T02:12:26.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.263+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 <== osd.0 v2:172.21.15.104:6800/2419146313 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94105564301072] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe174071990 con 0x7fe17c031040 2024-04-24T02:12:26.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.264+0000 7fe18341f800 20 remove_watcher() i=7 2024-04-24T02:12:26.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.264+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fe17c031040 msgr2=0x7fe17c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.264+0000 7fe18341f800 1 --2- 172.21.15.134:0/3400383105 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fe17c031040 0x7fe17c032940 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.264+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5596a8ba64e0 msgr2=0x5596a8ba89a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.264+0000 7fe18341f800 1 --2- 172.21.15.134:0/3400383105 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5596a8ba64e0 0x5596a8ba89a0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.264+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fe16c027060 msgr2=0x7fe16c046070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.264+0000 7fe18341f800 1 --2- 172.21.15.134:0/3400383105 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fe16c027060 0x7fe16c046070 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.264+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5596a8bac730 msgr2=0x5596a8baeb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.264+0000 7fe18341f800 1 --2- 172.21.15.134:0/3400383105 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5596a8bac730 0x5596a8baeb20 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.264+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe04c036950 msgr2=0x7fe04c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.264+0000 7fe18341f800 1 --2- 172.21.15.134:0/3400383105 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe04c036950 0x7fe04c038e10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x5596a8b75fe0 tx=0x7fe17c01f000 comp rx=0 tx=0).stop 2024-04-24T02:12:26.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.264+0000 7fe180f1e640 1 -- 172.21.15.134:0/3400383105 reap_dead start 2024-04-24T02:12:26.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.264+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5596a8b932d0 msgr2=0x5596a8b9a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.264+0000 7fe18341f800 1 --2- 172.21.15.134:0/3400383105 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5596a8b932d0 0x5596a8b9a940 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe16c0266c0 tx=0x7fe16c04be50 comp rx=0 tx=0).stop 2024-04-24T02:12:26.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.264+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 shutdown_connections 2024-04-24T02:12:26.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.264+0000 7fe18341f800 1 --2- 172.21.15.134:0/3400383105 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5596a8b932d0 0x5596a8b9a940 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.264+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 >> 172.21.15.134:0/3400383105 conn(0x5596a8b8f630 msgr2=0x5596a8b8cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:26.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.264+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 shutdown_connections 2024-04-24T02:12:26.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.264+0000 7fe18341f800 1 -- 172.21.15.134:0/3400383105 wait complete. 2024-04-24T02:12:26.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.264+0000 7fe18341f800 1 -- 172.21.15.134:0/2549369790 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe058036950 msgr2=0x7fe058038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.264+0000 7fe18341f800 1 --2- 172.21.15.134:0/2549369790 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe058036950 0x7fe058038e10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x5596a8b76860 tx=0x7fe17c005840 comp rx=0 tx=0).stop 2024-04-24T02:12:26.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.264+0000 7fe18341f800 1 -- 172.21.15.134:0/2549369790 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5596a8b85f90 msgr2=0x5596a8b863b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.264+0000 7fe18341f800 1 --2- 172.21.15.134:0/2549369790 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5596a8b85f90 0x5596a8b863b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe16c00e610 tx=0x7fe16c00ff90 comp rx=0 tx=0).stop 2024-04-24T02:12:26.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.264+0000 7fe18341f800 1 -- 172.21.15.134:0/2549369790 shutdown_connections 2024-04-24T02:12:26.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.264+0000 7fe18341f800 1 --2- 172.21.15.134:0/2549369790 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe058036950 0x7fe058038e10 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.264+0000 7fe18341f800 1 --2- 172.21.15.134:0/2549369790 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5596a8b85f90 0x5596a8b863b0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.264+0000 7fe18341f800 1 -- 172.21.15.134:0/2549369790 >> 172.21.15.134:0/2549369790 conn(0x5596a8b7a030 msgr2=0x5596a8b7a430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:26.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.264+0000 7fe18341f800 1 -- 172.21.15.134:0/2549369790 shutdown_connections 2024-04-24T02:12:26.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.264+0000 7fe18341f800 1 -- 172.21.15.134:0/2549369790 wait complete. 2024-04-24T02:12:26.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.265+0000 7fe18341f800 1 -- 172.21.15.134:0/3173647000 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5596a8a76230 msgr2=0x5596a8b74e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.265+0000 7fe18341f800 1 --2- 172.21.15.134:0/3173647000 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5596a8a76230 0x5596a8b74e60 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.265+0000 7fe18341f800 1 -- 172.21.15.134:0/3173647000 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe068036950 msgr2=0x7fe068038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.265+0000 7fe18341f800 1 --2- 172.21.15.134:0/3173647000 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe068036950 0x7fe068038e10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe16c000c00 tx=0x7fe16c0013b0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.265+0000 7fe18341f800 1 -- 172.21.15.134:0/3173647000 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5596a8a73900 msgr2=0x5596a8b6dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.265+0000 7fe18341f800 1 --2- 172.21.15.134:0/3173647000 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5596a8a73900 0x5596a8b6dc20 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe174060040 tx=0x7fe174002fb0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.265+0000 7fe18341f800 1 -- 172.21.15.134:0/3173647000 shutdown_connections 2024-04-24T02:12:26.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.265+0000 7fe18341f800 1 --2- 172.21.15.134:0/3173647000 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5596a8a76230 0x5596a8b74e60 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.265+0000 7fe18341f800 1 --2- 172.21.15.134:0/3173647000 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe068036950 0x7fe068038e10 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.265+0000 7fe18341f800 1 --2- 172.21.15.134:0/3173647000 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5596a8a73900 0x5596a8b6dc20 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.265+0000 7fe18341f800 1 -- 172.21.15.134:0/3173647000 >> 172.21.15.134:0/3173647000 conn(0x5596a8a6d3d0 msgr2=0x5596a8b5f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:26.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.265+0000 7fe18341f800 1 -- 172.21.15.134:0/3173647000 shutdown_connections 2024-04-24T02:12:26.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.265+0000 7fe18341f800 1 -- 172.21.15.134:0/3173647000 wait complete. 2024-04-24T02:12:26.291 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-04-24T02:12:26.252190Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:12:26.252178Z', 'tags': [], 'group_ids': []} 2024-04-24T02:12:26.297 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-04-24T02:12:26.301 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T02:12:26.301 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-04-24T02:12:26.301 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-04-24T02:12:26.301 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-04-24T02:12:26.342 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:26.343 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:26.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.342+0000 7f0e93e16800 1 Processor -- start 2024-04-24T02:12:26.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.342+0000 7f0e93e16800 1 -- start start 2024-04-24T02:12:26.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.342+0000 7f0e93e16800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x56379352d970 0x56379352fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.342+0000 7f0e93e16800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5637933ebd40 con 0x5637935302a0 2024-04-24T02:12:26.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.342+0000 7f0e93e16800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x5637933be4d0 con 0x56379352d970 2024-04-24T02:12:26.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.342+0000 7f0e8f484640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x56379352d970 0x56379352fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.342+0000 7f0e8ec83640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x5637935302a0 0x563793532690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:55264/0 (socket says 172.21.15.134:55264) 2024-04-24T02:12:26.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.342+0000 7f0e8f484640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x56379352d970 0x56379352fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56000/0 (socket says 172.21.15.134:56000) 2024-04-24T02:12:26.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.342+0000 7f0e8ec83640 1 -- 172.21.15.134:0/3881611972 learned_addr learned my addr 172.21.15.134:0/3881611972 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:12:26.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.343+0000 7f0e8f484640 1 -- 172.21.15.134:0/3881611972 >> v1:172.21.15.104:6789/0 conn(0x5637935302a0 legacy=0x563793532690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.343+0000 7f0e8f484640 1 -- 172.21.15.134:0/3881611972 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637933ea590 con 0x56379352d970 2024-04-24T02:12:26.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.343+0000 7f0e8e482640 1 -- 172.21.15.134:0/3881611972 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3442830888 0 0) 0x5637933ebd40 con 0x5637935302a0 2024-04-24T02:12:26.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.344+0000 7f0e8f484640 1 --2- 172.21.15.134:0/3881611972 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56379352d970 0x56379352fd60 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f0e8400a470 tx=0x7f0e8401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e27925a2f54ac2e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.345+0000 7f0e8e482640 1 -- 172.21.15.134:0/3881611972 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e84057070 con 0x56379352d970 2024-04-24T02:12:26.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.345+0000 7f0e8e482640 1 -- 172.21.15.134:0/3881611972 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e84052570 con 0x56379352d970 2024-04-24T02:12:26.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.345+0000 7f0e8e482640 1 -- 172.21.15.134:0/3881611972 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e84052870 con 0x56379352d970 2024-04-24T02:12:26.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.345+0000 7f0e93e16800 1 -- 172.21.15.134:0/3881611972 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56379352d970 msgr2=0x56379352fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.345+0000 7f0e93e16800 1 --2- 172.21.15.134:0/3881611972 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56379352d970 0x56379352fd60 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f0e8400a470 tx=0x7f0e8401ce90 comp rx=0 tx=0).stop 2024-04-24T02:12:26.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.345+0000 7f0e93e16800 1 -- 172.21.15.134:0/3881611972 shutdown_connections 2024-04-24T02:12:26.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.345+0000 7f0e93e16800 1 --2- 172.21.15.134:0/3881611972 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56379352d970 0x56379352fd60 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.345+0000 7f0e93e16800 1 -- 172.21.15.134:0/3881611972 >> 172.21.15.134:0/3881611972 conn(0x563793527300 msgr2=0x563793529720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:26.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.345+0000 7f0e93e16800 1 -- 172.21.15.134:0/3881611972 shutdown_connections 2024-04-24T02:12:26.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.345+0000 7f0e93e16800 1 -- 172.21.15.134:0/3881611972 wait complete. 2024-04-24T02:12:26.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.357+0000 7f0e93e16800 1 Processor -- start 2024-04-24T02:12:26.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.357+0000 7f0e93e16800 1 -- start start 2024-04-24T02:12:26.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.357+0000 7f0e93e16800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637935302a0 0x56379361e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.357+0000 7f0e93e16800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5637934783c0 con 0x5637935302a0 2024-04-24T02:12:26.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.357+0000 7f0e8f484640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637935302a0 0x56379361e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.357+0000 7f0e8f484640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637935302a0 0x56379361e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56012/0 (socket says 172.21.15.134:56012) 2024-04-24T02:12:26.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.357+0000 7f0e8f484640 1 -- 172.21.15.134:0/393215160 learned_addr learned my addr 172.21.15.134:0/393215160 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:26.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.358+0000 7f0e8f484640 1 -- 172.21.15.134:0/393215160 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56379361e680 con 0x5637935302a0 2024-04-24T02:12:26.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.358+0000 7f0e8f484640 1 --2- 172.21.15.134:0/393215160 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637935302a0 0x56379361e0b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f0e840447c0 tx=0x7f0e8404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f8ce867d9a91a23 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.358+0000 7f0d7d60a640 1 -- 172.21.15.134:0/393215160 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e84057070 con 0x5637935302a0 2024-04-24T02:12:26.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.358+0000 7f0d7d60a640 1 -- 172.21.15.134:0/393215160 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e84058040 con 0x5637935302a0 2024-04-24T02:12:26.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.358+0000 7f0d7d60a640 1 -- 172.21.15.134:0/393215160 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e84052720 con 0x5637935302a0 2024-04-24T02:12:26.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.359+0000 7f0e93e16800 1 -- 172.21.15.134:0/393215160 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637935302a0 msgr2=0x56379361e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.359+0000 7f0e93e16800 1 --2- 172.21.15.134:0/393215160 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637935302a0 0x56379361e0b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f0e840447c0 tx=0x7f0e8404c000 comp rx=0 tx=0).stop 2024-04-24T02:12:26.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.359+0000 7f0e93e16800 1 -- 172.21.15.134:0/393215160 shutdown_connections 2024-04-24T02:12:26.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.359+0000 7f0e93e16800 1 --2- 172.21.15.134:0/393215160 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637935302a0 0x56379361e0b0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.359+0000 7f0e93e16800 1 -- 172.21.15.134:0/393215160 >> 172.21.15.134:0/393215160 conn(0x563793527300 msgr2=0x563793619930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:26.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.359+0000 7f0e93e16800 1 -- 172.21.15.134:0/393215160 shutdown_connections 2024-04-24T02:12:26.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.359+0000 7f0e93e16800 1 -- 172.21.15.134:0/393215160 wait complete. 2024-04-24T02:12:26.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.359+0000 7f0e93e16800 1 Processor -- start 2024-04-24T02:12:26.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.359+0000 7f0e93e16800 1 -- start start 2024-04-24T02:12:26.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.359+0000 7f0e93e16800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637935302a0 0x563793625bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.359+0000 7f0e93e16800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5637935360c0 con 0x5637935302a0 2024-04-24T02:12:26.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.359+0000 7f0e8f484640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637935302a0 0x563793625bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.360+0000 7f0e8f484640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637935302a0 0x563793625bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56018/0 (socket says 172.21.15.134:56018) 2024-04-24T02:12:26.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.360+0000 7f0e8f484640 1 -- 172.21.15.134:0/3384026258 learned_addr learned my addr 172.21.15.134:0/3384026258 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:26.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.360+0000 7f0e8f484640 1 -- 172.21.15.134:0/3384026258 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563793626100 con 0x5637935302a0 2024-04-24T02:12:26.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.360+0000 7f0e8f484640 1 --2- 172.21.15.134:0/3384026258 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637935302a0 0x563793625bc0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0e84060040 tx=0x7f0e84002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.360+0000 7f0d7be07640 1 -- 172.21.15.134:0/3384026258 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e8406d030 con 0x5637935302a0 2024-04-24T02:12:26.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.360+0000 7f0d7be07640 1 -- 172.21.15.134:0/3384026258 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e84052d90 con 0x5637935302a0 2024-04-24T02:12:26.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.360+0000 7f0e93e16800 1 -- 172.21.15.134:0/3384026258 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563793626390 con 0x5637935302a0 2024-04-24T02:12:26.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.360+0000 7f0d7be07640 1 -- 172.21.15.134:0/3384026258 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e8405e5b0 con 0x5637935302a0 2024-04-24T02:12:26.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.360+0000 7f0e93e16800 1 -- 172.21.15.134:0/3384026258 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563793629040 con 0x5637935302a0 2024-04-24T02:12:26.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.361+0000 7f0d7be07640 1 -- 172.21.15.134:0/3384026258 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0e84070070 con 0x5637935302a0 2024-04-24T02:12:26.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.361+0000 7f0d7be07640 1 --2- 172.21.15.134:0/3384026258 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0d74036950 0x7f0d74038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.361+0000 7f0d7be07640 1 -- 172.21.15.134:0/3384026258 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f0e8406e070 con 0x5637935302a0 2024-04-24T02:12:26.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.361+0000 7f0e8ec83640 1 --2- 172.21.15.134:0/3384026258 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0d74036950 0x7f0d74038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.361+0000 7f0e93e16800 1 --2- 172.21.15.134:0/3384026258 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x56379362adf0 0x56379362d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.361+0000 7f0e93e16800 1 -- 172.21.15.134:0/3384026258 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56379362d760 con 0x56379362adf0 2024-04-24T02:12:26.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.361+0000 7f0e8fc85640 1 --2- 172.21.15.134:0/3384026258 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x56379362adf0 0x56379362d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.362+0000 7f0e8ec83640 1 --2- 172.21.15.134:0/3384026258 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0d74036950 0x7f0d74038e10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0e80000c00 tx=0x7f0e800013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.362+0000 7f0e8fc85640 1 --2- 172.21.15.134:0/3384026258 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x56379362adf0 0x56379362d1e0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.362+0000 7f0e8fc85640 1 -- 172.21.15.134:0/3384026258 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0e8800a4a0 con 0x56379362adf0 2024-04-24T02:12:26.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.362+0000 7f0e93e16800 1 -- 172.21.15.134:0/3384026258 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56379362a390 con 0x56379362adf0 2024-04-24T02:12:26.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.362+0000 7f0e8fc85640 1 -- 172.21.15.134:0/3384026258 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0e8800a4a0 con 0x56379362adf0 2024-04-24T02:12:26.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.362+0000 7f0e93e16800 1 -- 172.21.15.134:0/3384026258 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56379362f5b0 con 0x56379362adf0 2024-04-24T02:12:26.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.362+0000 7f0e8fc85640 1 -- 172.21.15.134:0/3384026258 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0e8800a4a0 con 0x56379362adf0 2024-04-24T02:12:26.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.363+0000 7f0e93e16800 1 -- 172.21.15.134:0/3384026258 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56379362e7e0 con 0x56379362adf0 2024-04-24T02:12:26.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.363+0000 7f0e8fc85640 1 -- 172.21.15.134:0/3384026258 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0e8800a4a0 con 0x56379362adf0 2024-04-24T02:12:26.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.363+0000 7f0e93e16800 1 -- 172.21.15.134:0/3384026258 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56379362ec00 con 0x56379362adf0 2024-04-24T02:12:26.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.363+0000 7f0e8fc85640 1 -- 172.21.15.134:0/3384026258 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0e8800a4a0 con 0x56379362adf0 2024-04-24T02:12:26.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.363+0000 7f0e93e16800 1 Processor -- start 2024-04-24T02:12:26.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.363+0000 7f0e93e16800 1 -- start start 2024-04-24T02:12:26.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.364+0000 7f0e93e16800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56379352d510 0x56379352b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.364+0000 7f0e93e16800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56379341e6b0 con 0x56379352d510 2024-04-24T02:12:26.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.364+0000 7f0e8ec83640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56379352d510 0x56379352b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.364+0000 7f0e8ec83640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56379352d510 0x56379352b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56032/0 (socket says 172.21.15.134:56032) 2024-04-24T02:12:26.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.364+0000 7f0e8ec83640 1 -- 172.21.15.134:0/937353893 learned_addr learned my addr 172.21.15.134:0/937353893 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:26.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.364+0000 7f0e8ec83640 1 -- 172.21.15.134:0/937353893 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56379352bec0 con 0x56379352d510 2024-04-24T02:12:26.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.364+0000 7f0e8ec83640 1 --2- 172.21.15.134:0/937353893 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56379352d510 0x56379352b980 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0e8000e610 tx=0x7f0e8000ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.365+0000 7f0d79602640 1 -- 172.21.15.134:0/937353893 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e80022070 con 0x56379352d510 2024-04-24T02:12:26.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.365+0000 7f0d79602640 1 -- 172.21.15.134:0/937353893 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e80009050 con 0x56379352d510 2024-04-24T02:12:26.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.365+0000 7f0e93e16800 1 -- 172.21.15.134:0/937353893 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56379352c150 con 0x56379352d510 2024-04-24T02:12:26.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.365+0000 7f0d79602640 1 -- 172.21.15.134:0/937353893 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e8000d500 con 0x56379352d510 2024-04-24T02:12:26.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.365+0000 7f0e93e16800 1 -- 172.21.15.134:0/937353893 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56379352c650 con 0x56379352d510 2024-04-24T02:12:26.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.365+0000 7f0d79602640 1 -- 172.21.15.134:0/937353893 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0e80025070 con 0x56379352d510 2024-04-24T02:12:26.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.365+0000 7f0d79602640 1 --2- 172.21.15.134:0/937353893 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0d68036950 0x7f0d68038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.366+0000 7f0d79602640 1 -- 172.21.15.134:0/937353893 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f0e8004d9e0 con 0x56379352d510 2024-04-24T02:12:26.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.366+0000 7f0e8fc85640 1 --2- 172.21.15.134:0/937353893 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0d68036950 0x7f0d68038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.366+0000 7f0e93e16800 1 Processor -- start 2024-04-24T02:12:26.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.366+0000 7f0e8fc85640 1 --2- 172.21.15.134:0/937353893 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0d68036950 0x7f0d68038e10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x56379362eb80 tx=0x7f0e88005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.366+0000 7f0e93e16800 1 -- start start 2024-04-24T02:12:26.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.366+0000 7f0e93e16800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56379363e100 0x56379363e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.366+0000 7f0e93e16800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56379361e940 con 0x56379363e100 2024-04-24T02:12:26.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.366+0000 7f0e8ec83640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56379363e100 0x56379363e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.366+0000 7f0e8ec83640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56379363e100 0x56379363e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56042/0 (socket says 172.21.15.134:56042) 2024-04-24T02:12:26.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.366+0000 7f0e8ec83640 1 -- 172.21.15.134:0/3701144466 learned_addr learned my addr 172.21.15.134:0/3701144466 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:26.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.366+0000 7f0e8ec83640 1 -- 172.21.15.134:0/3701144466 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56379363eaf0 con 0x56379363e100 2024-04-24T02:12:26.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.367+0000 7f0e8ec83640 1 --2- 172.21.15.134:0/3701144466 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56379363e100 0x56379363e520 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f0e80026fd0 tx=0x7f0e80024eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b9090ce51e4db4d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.367+0000 7f0d72ffd640 1 -- 172.21.15.134:0/3701144466 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e8004a030 con 0x56379363e100 2024-04-24T02:12:26.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.367+0000 7f0d72ffd640 1 -- 172.21.15.134:0/3701144466 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e80025e30 con 0x56379363e100 2024-04-24T02:12:26.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.367+0000 7f0d72ffd640 1 -- 172.21.15.134:0/3701144466 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e8001ad50 con 0x56379363e100 2024-04-24T02:12:26.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.367+0000 7f0e93e16800 1 -- 172.21.15.134:0/3701144466 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56379363e100 msgr2=0x56379363e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.367+0000 7f0e93e16800 1 --2- 172.21.15.134:0/3701144466 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56379363e100 0x56379363e520 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f0e80026fd0 tx=0x7f0e80024eb0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.367+0000 7f0e93e16800 1 -- 172.21.15.134:0/3701144466 shutdown_connections 2024-04-24T02:12:26.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.367+0000 7f0e93e16800 1 --2- 172.21.15.134:0/3701144466 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56379363e100 0x56379363e520 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.367+0000 7f0e93e16800 1 -- 172.21.15.134:0/3701144466 >> 172.21.15.134:0/3701144466 conn(0x563793649c30 msgr2=0x563793647c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:26.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.367+0000 7f0e93e16800 1 -- 172.21.15.134:0/3701144466 shutdown_connections 2024-04-24T02:12:26.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.367+0000 7f0e93e16800 1 -- 172.21.15.134:0/3701144466 wait complete. 2024-04-24T02:12:26.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.367+0000 7f0e93e16800 1 Processor -- start 2024-04-24T02:12:26.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.367+0000 7f0e93e16800 1 -- start start 2024-04-24T02:12:26.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.368+0000 7f0e93e16800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56379363e100 0x5637936592f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.368+0000 7f0e93e16800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56379363f240 con 0x56379363e100 2024-04-24T02:12:26.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.368+0000 7f0e8ec83640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56379363e100 0x5637936592f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.368+0000 7f0e8ec83640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56379363e100 0x5637936592f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56054/0 (socket says 172.21.15.134:56054) 2024-04-24T02:12:26.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.368+0000 7f0e8ec83640 1 -- 172.21.15.134:0/2981167667 learned_addr learned my addr 172.21.15.134:0/2981167667 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:26.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.368+0000 7f0e8ec83640 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563793659830 con 0x56379363e100 2024-04-24T02:12:26.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.368+0000 7f0e8ec83640 1 --2- 172.21.15.134:0/2981167667 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56379363e100 0x5637936592f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0e80026fd0 tx=0x7f0e8004be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.368+0000 7f0d717fa640 1 -- 172.21.15.134:0/2981167667 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e8004a050 con 0x56379363e100 2024-04-24T02:12:26.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.368+0000 7f0d717fa640 1 -- 172.21.15.134:0/2981167667 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e8004d7b0 con 0x56379363e100 2024-04-24T02:12:26.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.368+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563793659ac0 con 0x56379363e100 2024-04-24T02:12:26.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.368+0000 7f0d717fa640 1 -- 172.21.15.134:0/2981167667 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e800256a0 con 0x56379363e100 2024-04-24T02:12:26.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.368+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56379365c770 con 0x56379363e100 2024-04-24T02:12:26.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.369+0000 7f0d717fa640 1 -- 172.21.15.134:0/2981167667 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0e8000d6a0 con 0x56379363e100 2024-04-24T02:12:26.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.369+0000 7f0d717fa640 1 --2- 172.21.15.134:0/2981167667 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0d58036950 0x7f0d58038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.369+0000 7f0d717fa640 1 -- 172.21.15.134:0/2981167667 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f0e80036ae0 con 0x56379363e100 2024-04-24T02:12:26.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.369+0000 7f0e93e16800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.369+0000 7f0e8fc85640 1 --2- 172.21.15.134:0/2981167667 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0d58036950 0x7f0d58038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.369+0000 7f0e93e16800 1 --2- 172.21.15.134:0/2981167667 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x563793664e10 0x5637936672b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.369+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563793667a00 con 0x563793664e10 2024-04-24T02:12:26.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.369+0000 7f0e8f484640 1 --2- 172.21.15.134:0/2981167667 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x563793664e10 0x5637936672b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.370+0000 7f0e8fc85640 1 --2- 172.21.15.134:0/2981167667 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0d58036950 0x7f0d58038e10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x56379362e300 tx=0x7f0e8801f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.370+0000 7f0e8f484640 1 --2- 172.21.15.134:0/2981167667 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x563793664e10 0x5637936672b0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.370+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0e84072410 con 0x563793664e10 2024-04-24T02:12:26.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.370+0000 7f0e93e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:26.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.370+0000 7f0e93e16800 20 realm 2024-04-24T02:12:26.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.370+0000 7f0e93e16800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.370+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563793667e10 con 0x563793664e10 2024-04-24T02:12:26.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.370+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0e84072410 con 0x563793664e10 2024-04-24T02:12:26.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.370+0000 7f0e93e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:26.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.370+0000 7f0e93e16800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:26.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.370+0000 7f0e93e16800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.370+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5637936686e0 con 0x563793664e10 2024-04-24T02:12:26.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.370+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0e84072410 con 0x563793664e10 2024-04-24T02:12:26.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.370+0000 7f0e93e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:26.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.370+0000 7f0e93e16800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.370+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563793668a80 con 0x563793664e10 2024-04-24T02:12:26.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.371+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0e84072410 con 0x563793664e10 2024-04-24T02:12:26.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.371+0000 7f0e93e16800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:26.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.371+0000 7f0e93e16800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.371+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563793668ee0 con 0x563793664e10 2024-04-24T02:12:26.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.371+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0e84072410 con 0x563793664e10 2024-04-24T02:12:26.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.371+0000 7f0e93e16800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:26.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.371+0000 7f0e93e16800 20 searching for the correct realm 2024-04-24T02:12:26.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.371+0000 7f0e93e16800 1 --2- 172.21.15.134:0/2981167667 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x56379366af30 0x56379366d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.371+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379366d9d0 con 0x56379366af30 2024-04-24T02:12:26.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.371+0000 7f0e8ec83640 1 --2- 172.21.15.134:0/2981167667 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x56379366af30 0x56379366d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.371+0000 7f0e8ec83640 1 --2- 172.21.15.134:0/2981167667 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x56379366af30 0x56379366d320 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.372+0000 7f0e8ec83640 1 -- 172.21.15.134:0/2981167667 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e80024030 con 0x56379366af30 2024-04-24T02:12:26.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.372+0000 7f0e8ec83640 1 --2- 172.21.15.134:0/2981167667 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f0e80027060 0x7f0e80041460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.372+0000 7f0e8ec83640 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379366d9d0 con 0x7f0e80027060 2024-04-24T02:12:26.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.372+0000 7f0e8fc85640 1 --2- 172.21.15.134:0/2981167667 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f0e80027060 0x7f0e80041460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.372+0000 7f0e8fc85640 1 --2- 172.21.15.134:0/2981167667 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f0e80027060 0x7f0e80041460 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.372+0000 7f0e8fc85640 1 -- 172.21.15.134:0/2981167667 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e8801f070 con 0x7f0e80027060 2024-04-24T02:12:26.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.372+0000 7f0e8fc85640 1 --2- 172.21.15.134:0/2981167667 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f0e88031040 0x7f0e88032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.372+0000 7f0e8fc85640 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379366d9d0 con 0x7f0e88031040 2024-04-24T02:12:26.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.372+0000 7f0e8f484640 1 --2- 172.21.15.134:0/2981167667 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f0e88031040 0x7f0e88032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.373+0000 7f0e8f484640 1 --2- 172.21.15.134:0/2981167667 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f0e88031040 0x7f0e88032430 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.373+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e84072410 con 0x7f0e88031040 2024-04-24T02:12:26.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.373+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379366d9d0 con 0x563793664e10 2024-04-24T02:12:26.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.373+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e84072410 con 0x563793664e10 2024-04-24T02:12:26.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.373+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379366d9d0 con 0x563793664e10 2024-04-24T02:12:26.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.374+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0e84072410 con 0x563793664e10 2024-04-24T02:12:26.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.374+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379366d9d0 con 0x7f0e88031040 2024-04-24T02:12:26.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.374+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e84072410 con 0x7f0e88031040 2024-04-24T02:12:26.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.374+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379366d9d0 con 0x7f0e88031040 2024-04-24T02:12:26.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.374+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e84072410 con 0x7f0e88031040 2024-04-24T02:12:26.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.374+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379366d9d0 con 0x7f0e80027060 2024-04-24T02:12:26.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.374+0000 7f0e8fc85640 1 -- 172.21.15.134:0/2981167667 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e8801f070 con 0x7f0e80027060 2024-04-24T02:12:26.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.374+0000 7f0e8fc85640 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379366d9d0 con 0x56379366af30 2024-04-24T02:12:26.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.374+0000 7f0e8ec83640 1 -- 172.21.15.134:0/2981167667 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e80024030 con 0x56379366af30 2024-04-24T02:12:26.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.374+0000 7f0e8ec83640 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379366d9d0 con 0x563793664e10 2024-04-24T02:12:26.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.375+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e84072410 con 0x563793664e10 2024-04-24T02:12:26.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.375+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379366d9d0 con 0x7f0e88031040 2024-04-24T02:12:26.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.375+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e84072410 con 0x7f0e88031040 2024-04-24T02:12:26.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.375+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379366d9d0 con 0x563793664e10 2024-04-24T02:12:26.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.375+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e84072410 con 0x563793664e10 2024-04-24T02:12:26.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.375+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379366d9d0 con 0x7f0e80027060 2024-04-24T02:12:26.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.375+0000 7f0e8fc85640 1 -- 172.21.15.134:0/2981167667 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0e8801f070 con 0x7f0e80027060 2024-04-24T02:12:26.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.375+0000 7f0e8fc85640 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379366d9d0 con 0x56379366af30 2024-04-24T02:12:26.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.376+0000 7f0e8ec83640 1 -- 172.21.15.134:0/2981167667 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e80024030 con 0x56379366af30 2024-04-24T02:12:26.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.376+0000 7f0e8ec83640 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379366d9d0 con 0x56379366af30 2024-04-24T02:12:26.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.376+0000 7f0e8ec83640 1 -- 172.21.15.134:0/2981167667 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e80024030 con 0x56379366af30 2024-04-24T02:12:26.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.376+0000 7f0e8ec83640 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379366d9d0 con 0x7f0e88031040 2024-04-24T02:12:26.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.376+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e84072410 con 0x7f0e88031040 2024-04-24T02:12:26.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.376+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379366d9d0 con 0x56379366af30 2024-04-24T02:12:26.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.376+0000 7f0e8ec83640 1 -- 172.21.15.134:0/2981167667 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e80024030 con 0x56379366af30 2024-04-24T02:12:26.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.376+0000 7f0e8ec83640 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379366d9d0 con 0x56379366af30 2024-04-24T02:12:26.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.376+0000 7f0e8ec83640 1 -- 172.21.15.134:0/2981167667 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e80024030 con 0x56379366af30 2024-04-24T02:12:26.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.376+0000 7f0e8ec83640 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379366d9d0 con 0x563793664e10 2024-04-24T02:12:26.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.377+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e84072410 con 0x563793664e10 2024-04-24T02:12:26.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.377+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379366d9d0 con 0x563793664e10 2024-04-24T02:12:26.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.377+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f0e84072410 con 0x563793664e10 2024-04-24T02:12:26.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.377+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379366d9d0 con 0x7f0e88031040 2024-04-24T02:12:26.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.377+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e84072410 con 0x7f0e88031040 2024-04-24T02:12:26.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.377+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379366d9d0 con 0x56379366af30 2024-04-24T02:12:26.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.377+0000 7f0e8ec83640 1 -- 172.21.15.134:0/2981167667 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e80024030 con 0x56379366af30 2024-04-24T02:12:26.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.377+0000 7f0e8ec83640 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379366d9d0 con 0x7f0e80027060 2024-04-24T02:12:26.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.378+0000 7f0e8fc85640 1 -- 172.21.15.134:0/2981167667 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e8801f070 con 0x7f0e80027060 2024-04-24T02:12:26.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.378+0000 7f0e8fc85640 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379366d9d0 con 0x563793664e10 2024-04-24T02:12:26.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.378+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e84072410 con 0x563793664e10 2024-04-24T02:12:26.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.378+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379366d9d0 con 0x7f0e88031040 2024-04-24T02:12:26.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.378+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e84072410 con 0x7f0e88031040 2024-04-24T02:12:26.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.378+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379366d9d0 con 0x56379366af30 2024-04-24T02:12:26.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.378+0000 7f0e8ec83640 1 -- 172.21.15.134:0/2981167667 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e80024030 con 0x56379366af30 2024-04-24T02:12:26.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.378+0000 7f0e8ec83640 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379366d9d0 con 0x7f0e88031040 2024-04-24T02:12:26.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.379+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e84072410 con 0x7f0e88031040 2024-04-24T02:12:26.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.379+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379366d9d0 con 0x7f0e80027060 2024-04-24T02:12:26.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.379+0000 7f0e8fc85640 1 -- 172.21.15.134:0/2981167667 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e8801f070 con 0x7f0e80027060 2024-04-24T02:12:26.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.379+0000 7f0e8fc85640 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379366d9d0 con 0x56379366af30 2024-04-24T02:12:26.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.379+0000 7f0e8ec83640 1 -- 172.21.15.134:0/2981167667 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e80024030 con 0x56379366af30 2024-04-24T02:12:26.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.379+0000 7f0e8ec83640 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379366d9d0 con 0x7f0e88031040 2024-04-24T02:12:26.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.379+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e84072410 con 0x7f0e88031040 2024-04-24T02:12:26.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.379+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379366d9d0 con 0x563793664e10 2024-04-24T02:12:26.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.380+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0e84072410 con 0x563793664e10 2024-04-24T02:12:26.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.380+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56379366d9d0 con 0x7f0e80027060 2024-04-24T02:12:26.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.380+0000 7f0e8fc85640 1 -- 172.21.15.134:0/2981167667 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e8801f070 con 0x7f0e80027060 2024-04-24T02:12:26.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.380+0000 7f0e93e16800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:26.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.380+0000 7f0e93e16800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:26.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.380+0000 7f0e93e16800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:26.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.380+0000 7f0e93e16800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:26.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.380+0000 7f0e93e16800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:26.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.380+0000 7f0e93e16800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:26.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.380+0000 7f0e93e16800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.380+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563793669980 con 0x563793664e10 2024-04-24T02:12:26.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.380+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0e84072410 con 0x563793664e10 2024-04-24T02:12:26.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.380+0000 7f0e93e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:26.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.380+0000 7f0e93e16800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.380+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56379366a220 con 0x563793664e10 2024-04-24T02:12:26.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.380+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0e84072410 con 0x563793664e10 2024-04-24T02:12:26.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.380+0000 7f0e93e16800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:26.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.380+0000 7f0e93e16800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.380+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5637936695c0 con 0x563793664e10 2024-04-24T02:12:26.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.381+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0e84072410 con 0x563793664e10 2024-04-24T02:12:26.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.381+0000 7f0e93e16800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:26.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.381+0000 7f0e93e16800 20 zone default found 2024-04-24T02:12:26.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.381+0000 7f0e93e16800 4 Realm: () 2024-04-24T02:12:26.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.381+0000 7f0e93e16800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:26.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.381+0000 7f0e93e16800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:26.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.381+0000 7f0e93e16800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:26.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.381+0000 7f0e93e16800 20 zonegroup default 2024-04-24T02:12:26.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.381+0000 7f0e93e16800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.381+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56379366de30 con 0x7f0e88031040 2024-04-24T02:12:26.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.381+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0e84072410 con 0x7f0e88031040 2024-04-24T02:12:26.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.381+0000 7f0e93e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:26.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.381+0000 7f0e93e16800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.381+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56379366fcc0 con 0x56379366af30 2024-04-24T02:12:26.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.381+0000 7f0e8ec83640 1 -- 172.21.15.134:0/2981167667 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0e80024030 con 0x56379366af30 2024-04-24T02:12:26.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.381+0000 7f0e93e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:26.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.381+0000 7f0e93e16800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.381+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563793670060 con 0x56379366af30 2024-04-24T02:12:26.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.382+0000 7f0e8ec83640 1 -- 172.21.15.134:0/2981167667 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0e80024030 con 0x56379366af30 2024-04-24T02:12:26.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.382+0000 7f0e93e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:26.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.382+0000 7f0e93e16800 20 started sync module instance, tier type = 2024-04-24T02:12:26.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.382+0000 7f0e93e16800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:26.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.382+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56379366f100 con 0x7f0e80027060 2024-04-24T02:12:26.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.383+0000 7f0e8fc85640 1 -- 172.21.15.134:0/2981167667 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e88040040 con 0x7f0e80027060 2024-04-24T02:12:26.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.383+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94796696188192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5637936708b0 con 0x7f0e80027060 2024-04-24T02:12:26.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.383+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563793671100 con 0x563793664e10 2024-04-24T02:12:26.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.384+0000 7f0e8fc85640 1 -- 172.21.15.134:0/2981167667 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94796696188192] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e88040040 con 0x7f0e80027060 2024-04-24T02:12:26.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.384+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e84072410 con 0x563793664e10 2024-04-24T02:12:26.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.384+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94796696192000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563793670d10 con 0x563793664e10 2024-04-24T02:12:26.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.384+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563793671800 con 0x56379366af30 2024-04-24T02:12:26.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.385+0000 7f0e8ec83640 1 -- 172.21.15.134:0/2981167667 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e80024030 con 0x56379366af30 2024-04-24T02:12:26.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.385+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94796696195792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5637936720a0 con 0x56379366af30 2024-04-24T02:12:26.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.385+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563793672b60 con 0x7f0e80027060 2024-04-24T02:12:26.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.385+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94796696192000] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e84072410 con 0x563793664e10 2024-04-24T02:12:26.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.386+0000 7f0e8ec83640 1 -- 172.21.15.134:0/2981167667 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94796696195792] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e80024030 con 0x56379366af30 2024-04-24T02:12:26.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.386+0000 7f0e8fc85640 1 -- 172.21.15.134:0/2981167667 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e88040040 con 0x7f0e80027060 2024-04-24T02:12:26.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.386+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94796696198128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563793670820 con 0x7f0e80027060 2024-04-24T02:12:26.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.386+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563793673570 con 0x563793664e10 2024-04-24T02:12:26.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.387+0000 7f0e8fc85640 1 -- 172.21.15.134:0/2981167667 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94796696198128] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e88040040 con 0x7f0e80027060 2024-04-24T02:12:26.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.388+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e84072410 con 0x563793664e10 2024-04-24T02:12:26.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.388+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94796696200752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563793673570 con 0x563793664e10 2024-04-24T02:12:26.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.388+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563793673f30 con 0x7f0e88031040 2024-04-24T02:12:26.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.389+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e84072410 con 0x7f0e88031040 2024-04-24T02:12:26.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.389+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94796696205952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563793674350 con 0x7f0e88031040 2024-04-24T02:12:26.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.389+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563793674e10 con 0x7f0e88031040 2024-04-24T02:12:26.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.389+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94796696200752] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e84072410 con 0x563793664e10 2024-04-24T02:12:26.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.390+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(56 notify.6 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e84072410 con 0x7f0e88031040 2024-04-24T02:12:26.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.390+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94796696209632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563793674dd0 con 0x7f0e88031040 2024-04-24T02:12:26.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.390+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563793675820 con 0x7f0e88031040 2024-04-24T02:12:26.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.390+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94796696205952] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e84072410 con 0x7f0e88031040 2024-04-24T02:12:26.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.390+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94796696209632] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e84072410 con 0x7f0e88031040 2024-04-24T02:12:26.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.391+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(58 notify.7 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e84072410 con 0x7f0e88031040 2024-04-24T02:12:26.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.391+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94796696203456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563793675370 con 0x7f0e88031040 2024-04-24T02:12:26.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.391+0000 7f0e93e16800 20 add_watcher() i=0 2024-04-24T02:12:26.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.391+0000 7f0e93e16800 20 add_watcher() i=1 2024-04-24T02:12:26.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.391+0000 7f0e93e16800 20 add_watcher() i=2 2024-04-24T02:12:26.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.391+0000 7f0e93e16800 20 add_watcher() i=3 2024-04-24T02:12:26.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.391+0000 7f0e93e16800 20 add_watcher() i=4 2024-04-24T02:12:26.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.391+0000 7f0e93e16800 20 add_watcher() i=5 2024-04-24T02:12:26.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.391+0000 7f0e93e16800 20 add_watcher() i=6 2024-04-24T02:12:26.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.391+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94796696203456] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e84072410 con 0x7f0e88031040 2024-04-24T02:12:26.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.391+0000 7f0e93e16800 20 add_watcher() i=7 2024-04-24T02:12:26.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.391+0000 7f0e93e16800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:26.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.391+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563793678850 con 0x563793664e10 2024-04-24T02:12:26.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.392+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0e84072410 con 0x563793664e10 2024-04-24T02:12:26.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.392+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94796696212336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563793675c40 con 0x563793664e10 2024-04-24T02:12:26.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.393+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94796696212336] v30'115 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0e84072410 con 0x563793664e10 2024-04-24T02:12:26.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.393+0000 7f0d45fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:26.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.393+0000 7f0e93e16800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:26.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.393+0000 7f0e93e16800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:26.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.393+0000 7f0e93e16800 5 note: GC not initialized 2024-04-24T02:12:26.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.393+0000 7f0d44fe1640 20 reqs_thread_entry: start 2024-04-24T02:12:26.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.393+0000 7f0e93e16800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:26.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.393+0000 7f0e93e16800 20 Filter name: none 2024-04-24T02:12:26.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.393+0000 7f0cbe7fc640 20 reqs_thread_entry: start 2024-04-24T02:12:26.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.393+0000 7f0e93e16800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.393+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5637936ab500 con 0x7f0e80027060 2024-04-24T02:12:26.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.394+0000 7f0e8fc85640 1 -- 172.21.15.134:0/2981167667 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv18 ondisk = 0) ==== 275+0+304 (crc 0 0 0) 0x7f0e88040040 con 0x7f0e80027060 2024-04-24T02:12:26.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.394+0000 7f0e93e16800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T02:12:26.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.395+0000 7f0d45fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:26.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.395+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94796696212336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5637936a9440 con 0x563793664e10 2024-04-24T02:12:26.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.396+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94796696212336] v30'116 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0e84072410 con 0x563793664e10 2024-04-24T02:12:26.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.396+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94796696188192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5637936a9440 con 0x7f0e80027060 2024-04-24T02:12:26.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.397+0000 7f0e8fc85640 1 -- 172.21.15.134:0/2981167667 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94796696188192] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e88040040 con 0x7f0e80027060 2024-04-24T02:12:26.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.397+0000 7f0e93e16800 20 remove_watcher() i=0 2024-04-24T02:12:26.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.397+0000 7f0e93e16800 2 removed watcher, disabling cache 2024-04-24T02:12:26.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.397+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94796696192000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56379366f520 con 0x563793664e10 2024-04-24T02:12:26.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.398+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94796696192000] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e84072410 con 0x563793664e10 2024-04-24T02:12:26.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.398+0000 7f0e93e16800 20 remove_watcher() i=1 2024-04-24T02:12:26.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.398+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94796696195792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5637936a9440 con 0x56379366af30 2024-04-24T02:12:26.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.399+0000 7f0e8ec83640 1 -- 172.21.15.134:0/2981167667 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94796696195792] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e80024030 con 0x56379366af30 2024-04-24T02:12:26.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.399+0000 7f0e93e16800 20 remove_watcher() i=2 2024-04-24T02:12:26.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.399+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94796696198128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563793670400 con 0x7f0e80027060 2024-04-24T02:12:26.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.400+0000 7f0e8fc85640 1 -- 172.21.15.134:0/2981167667 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94796696198128] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e88040040 con 0x7f0e80027060 2024-04-24T02:12:26.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.400+0000 7f0e93e16800 20 remove_watcher() i=3 2024-04-24T02:12:26.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.400+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94796696200752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56379366f520 con 0x563793664e10 2024-04-24T02:12:26.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.401+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94796696200752] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e84072410 con 0x563793664e10 2024-04-24T02:12:26.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.401+0000 7f0e93e16800 20 remove_watcher() i=4 2024-04-24T02:12:26.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.401+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94796696205952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5637936712d0 con 0x7f0e88031040 2024-04-24T02:12:26.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.402+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94796696205952] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e84072410 con 0x7f0e88031040 2024-04-24T02:12:26.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.402+0000 7f0e93e16800 20 remove_watcher() i=5 2024-04-24T02:12:26.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.402+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94796696209632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563793671bf0 con 0x7f0e88031040 2024-04-24T02:12:26.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.403+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94796696209632] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e84072410 con 0x7f0e88031040 2024-04-24T02:12:26.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.403+0000 7f0e93e16800 20 remove_watcher() i=6 2024-04-24T02:12:26.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.403+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94796696203456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563793670400 con 0x7f0e88031040 2024-04-24T02:12:26.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.403+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94796696203456] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e84072410 con 0x7f0e88031040 2024-04-24T02:12:26.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.403+0000 7f0e93e16800 20 remove_watcher() i=7 2024-04-24T02:12:26.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.403+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f0e88031040 msgr2=0x7f0e88032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.403+0000 7f0e93e16800 1 --2- 172.21.15.134:0/2981167667 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f0e88031040 0x7f0e88032430 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.404+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x563793664e10 msgr2=0x5637936672b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.404+0000 7f0e93e16800 1 --2- 172.21.15.134:0/2981167667 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x563793664e10 0x5637936672b0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.404+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f0e80027060 msgr2=0x7f0e80041460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.404+0000 7f0e93e16800 1 --2- 172.21.15.134:0/2981167667 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f0e80027060 0x7f0e80041460 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.404+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x56379366af30 msgr2=0x56379366d320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.404+0000 7f0e93e16800 1 --2- 172.21.15.134:0/2981167667 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x56379366af30 0x56379366d320 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.404+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0d58036950 msgr2=0x7f0d58038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.404+0000 7f0e93e16800 1 --2- 172.21.15.134:0/2981167667 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0d58036950 0x7f0d58038e10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x56379362e300 tx=0x7f0e8801f000 comp rx=0 tx=0).stop 2024-04-24T02:12:26.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.404+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56379363e100 msgr2=0x5637936592f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.404+0000 7f0e93e16800 1 --2- 172.21.15.134:0/2981167667 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56379363e100 0x5637936592f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0e80026fd0 tx=0x7f0e8004be50 comp rx=0 tx=0).stop 2024-04-24T02:12:26.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.404+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 reap_dead start 2024-04-24T02:12:26.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.404+0000 7f0e8f484640 1 -- 172.21.15.134:0/2981167667 reap_dead start 2024-04-24T02:12:26.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.404+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 shutdown_connections 2024-04-24T02:12:26.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.404+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 >> 172.21.15.134:0/2981167667 conn(0x563793649c30 msgr2=0x563793647290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:26.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.404+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 shutdown_connections 2024-04-24T02:12:26.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.404+0000 7f0e93e16800 1 -- 172.21.15.134:0/2981167667 wait complete. 2024-04-24T02:12:26.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.404+0000 7f0e93e16800 1 -- 172.21.15.134:0/937353893 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0d68036950 msgr2=0x7f0d68038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.404+0000 7f0e93e16800 1 --2- 172.21.15.134:0/937353893 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0d68036950 0x7f0d68038e10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x56379362eb80 tx=0x7f0e88005840 comp rx=0 tx=0).stop 2024-04-24T02:12:26.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.404+0000 7f0e93e16800 1 -- 172.21.15.134:0/937353893 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56379352d510 msgr2=0x56379352b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.404+0000 7f0e93e16800 1 --2- 172.21.15.134:0/937353893 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56379352d510 0x56379352b980 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0e8000e610 tx=0x7f0e8000ff90 comp rx=0 tx=0).stop 2024-04-24T02:12:26.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.404+0000 7f0e93e16800 1 -- 172.21.15.134:0/937353893 shutdown_connections 2024-04-24T02:12:26.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.404+0000 7f0e93e16800 1 --2- 172.21.15.134:0/937353893 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0d68036950 0x7f0d68038e10 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.404+0000 7f0e93e16800 1 --2- 172.21.15.134:0/937353893 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56379352d510 0x56379352b980 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.404+0000 7f0e93e16800 1 -- 172.21.15.134:0/937353893 >> 172.21.15.134:0/937353893 conn(0x563793632410 msgr2=0x563793632810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:26.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.404+0000 7f0e93e16800 1 -- 172.21.15.134:0/937353893 shutdown_connections 2024-04-24T02:12:26.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.404+0000 7f0e93e16800 1 -- 172.21.15.134:0/937353893 wait complete. 2024-04-24T02:12:26.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.404+0000 7f0e93e16800 1 -- 172.21.15.134:0/3384026258 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x56379362adf0 msgr2=0x56379362d1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.404+0000 7f0e93e16800 1 --2- 172.21.15.134:0/3384026258 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x56379362adf0 0x56379362d1e0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.405+0000 7f0e93e16800 1 -- 172.21.15.134:0/3384026258 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0d74036950 msgr2=0x7f0d74038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.405+0000 7f0e93e16800 1 --2- 172.21.15.134:0/3384026258 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0d74036950 0x7f0d74038e10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0e80000c00 tx=0x7f0e800013b0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.405+0000 7f0e93e16800 1 -- 172.21.15.134:0/3384026258 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637935302a0 msgr2=0x563793625bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.405+0000 7f0e93e16800 1 --2- 172.21.15.134:0/3384026258 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637935302a0 0x563793625bc0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0e84060040 tx=0x7f0e84002fb0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.405+0000 7f0e93e16800 1 -- 172.21.15.134:0/3384026258 shutdown_connections 2024-04-24T02:12:26.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.405+0000 7f0e93e16800 1 --2- 172.21.15.134:0/3384026258 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x56379362adf0 0x56379362d1e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.405+0000 7f0e93e16800 1 --2- 172.21.15.134:0/3384026258 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0d74036950 0x7f0d74038e10 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.405+0000 7f0e93e16800 1 --2- 172.21.15.134:0/3384026258 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637935302a0 0x563793625bc0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.405+0000 7f0e93e16800 1 -- 172.21.15.134:0/3384026258 >> 172.21.15.134:0/3384026258 conn(0x563793527300 msgr2=0x563793618130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:26.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.405+0000 7f0e93e16800 1 -- 172.21.15.134:0/3384026258 shutdown_connections 2024-04-24T02:12:26.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.405+0000 7f0e93e16800 1 -- 172.21.15.134:0/3384026258 wait complete. 2024-04-24T02:12:26.428 INFO:teuthology.orchestra.run.smithi134.stdout:{"key":"bucket:myfoo","ver":{"tag":"_jb4cFQJF3KEw4mxZudsP9Bl","ver":2},"mtime":"2024-04-24T02:12:26.110689Z","data":{"bucket":{"name":"myfoo","marker":"582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1","bucket_id":"582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2024-04-24T02:12:24.901996Z","linked":false,"has_bucket_info":false}} 2024-04-24T02:12:26.428 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_jb4cFQJF3KEw4mxZudsP9Bl', 'ver': 2}, 'mtime': '2024-04-24T02:12:26.110689Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1', 'bucket_id': '582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-04-24T02:12:24.901996Z', 'linked': False, 'has_bucket_info': False}} 2024-04-24T02:12:26.429 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1'] 2024-04-24T02:12:26.429 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1'] 2024-04-24T02:12:26.429 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id 582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 2024-04-24T02:12:26.514 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:26.514 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:26.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.514+0000 7f4f61e0f800 1 Processor -- start 2024-04-24T02:12:26.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.514+0000 7f4f61e0f800 1 -- start start 2024-04-24T02:12:26.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.514+0000 7f4f61e0f800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x555a638d1d40 0x555a638d2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.514+0000 7f4f61e0f800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555a63791d40 con 0x555a638d2fa0 2024-04-24T02:12:26.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.514+0000 7f4f61e0f800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x555a637644d0 con 0x555a638d1d40 2024-04-24T02:12:26.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.514+0000 7f4f5d547640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x555a638d1d40 0x555a638d2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.514+0000 7f4f5cd46640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x555a638d2fa0 0x555a638d3420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:55266/0 (socket says 172.21.15.134:55266) 2024-04-24T02:12:26.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.514+0000 7f4f5cd46640 1 -- 172.21.15.134:0/3178020941 learned_addr learned my addr 172.21.15.134:0/3178020941 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:12:26.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.515+0000 7f4f5d547640 1 -- 172.21.15.134:0/3178020941 >> v1:172.21.15.104:6789/0 conn(0x555a638d2fa0 legacy=0x555a638d3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.515+0000 7f4f4ffff640 1 -- 172.21.15.134:0/3178020941 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1364148440 0 0) 0x555a63791d40 con 0x555a638d2fa0 2024-04-24T02:12:26.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.515+0000 7f4f5d547640 1 -- 172.21.15.134:0/3178020941 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a63790590 con 0x555a638d1d40 2024-04-24T02:12:26.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.516+0000 7f4f5d547640 1 --2- 172.21.15.134:0/3178020941 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555a638d1d40 0x555a638d2160 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f4f5000a470 tx=0x7f4f5001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7416e907c7e033a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.517+0000 7f4f4ffff640 1 -- 172.21.15.134:0/3178020941 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f50057070 con 0x555a638d1d40 2024-04-24T02:12:26.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.517+0000 7f4f4ffff640 1 -- 172.21.15.134:0/3178020941 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f50052570 con 0x555a638d1d40 2024-04-24T02:12:26.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.517+0000 7f4f4ffff640 1 -- 172.21.15.134:0/3178020941 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f50052870 con 0x555a638d1d40 2024-04-24T02:12:26.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.517+0000 7f4f61e0f800 1 -- 172.21.15.134:0/3178020941 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555a638d1d40 msgr2=0x555a638d2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.517+0000 7f4f61e0f800 1 --2- 172.21.15.134:0/3178020941 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555a638d1d40 0x555a638d2160 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f4f5000a470 tx=0x7f4f5001ce90 comp rx=0 tx=0).stop 2024-04-24T02:12:26.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.517+0000 7f4f61e0f800 1 -- 172.21.15.134:0/3178020941 shutdown_connections 2024-04-24T02:12:26.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.517+0000 7f4f61e0f800 1 --2- 172.21.15.134:0/3178020941 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555a638d1d40 0x555a638d2160 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.517+0000 7f4f61e0f800 1 -- 172.21.15.134:0/3178020941 >> 172.21.15.134:0/3178020941 conn(0x555a638cd3a0 msgr2=0x555a638cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:26.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.517+0000 7f4f61e0f800 1 -- 172.21.15.134:0/3178020941 shutdown_connections 2024-04-24T02:12:26.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.517+0000 7f4f61e0f800 1 -- 172.21.15.134:0/3178020941 wait complete. 2024-04-24T02:12:26.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.529+0000 7f4f61e0f800 1 Processor -- start 2024-04-24T02:12:26.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.529+0000 7f4f61e0f800 1 -- start start 2024-04-24T02:12:26.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.529+0000 7f4f61e0f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555a638d1d40 0x555a63846010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.529+0000 7f4f61e0f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x555a6381e3e0 con 0x555a638d1d40 2024-04-24T02:12:26.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.529+0000 7f4f5d547640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555a638d1d40 0x555a63846010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.529+0000 7f4f5d547640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555a638d1d40 0x555a63846010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56076/0 (socket says 172.21.15.134:56076) 2024-04-24T02:12:26.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.529+0000 7f4f5d547640 1 -- 172.21.15.134:0/3865581627 learned_addr learned my addr 172.21.15.134:0/3865581627 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:26.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.530+0000 7f4f5d547640 1 -- 172.21.15.134:0/3865581627 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a639c4e80 con 0x555a638d1d40 2024-04-24T02:12:26.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.530+0000 7f4f5d547640 1 --2- 172.21.15.134:0/3865581627 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555a638d1d40 0x555a63846010 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f4f50055040 tx=0x7f4f5004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f44500d7eb87b50 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.530+0000 7f4e4b606640 1 -- 172.21.15.134:0/3865581627 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f50063070 con 0x555a638d1d40 2024-04-24T02:12:26.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.530+0000 7f4e4b606640 1 -- 172.21.15.134:0/3865581627 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f50058040 con 0x555a638d1d40 2024-04-24T02:12:26.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.530+0000 7f4e4b606640 1 -- 172.21.15.134:0/3865581627 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f50057070 con 0x555a638d1d40 2024-04-24T02:12:26.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.531+0000 7f4f61e0f800 1 -- 172.21.15.134:0/3865581627 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555a638d1d40 msgr2=0x555a63846010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.531+0000 7f4f61e0f800 1 --2- 172.21.15.134:0/3865581627 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555a638d1d40 0x555a63846010 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f4f50055040 tx=0x7f4f5004c000 comp rx=0 tx=0).stop 2024-04-24T02:12:26.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.531+0000 7f4f61e0f800 1 -- 172.21.15.134:0/3865581627 shutdown_connections 2024-04-24T02:12:26.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.531+0000 7f4f61e0f800 1 --2- 172.21.15.134:0/3865581627 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555a638d1d40 0x555a63846010 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.531+0000 7f4f61e0f800 1 -- 172.21.15.134:0/3865581627 >> 172.21.15.134:0/3865581627 conn(0x555a638cd3a0 msgr2=0x555a639beb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:26.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.531+0000 7f4f61e0f800 1 -- 172.21.15.134:0/3865581627 shutdown_connections 2024-04-24T02:12:26.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.531+0000 7f4f61e0f800 1 -- 172.21.15.134:0/3865581627 wait complete. 2024-04-24T02:12:26.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.531+0000 7f4f61e0f800 1 Processor -- start 2024-04-24T02:12:26.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.531+0000 7f4f61e0f800 1 -- start start 2024-04-24T02:12:26.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.531+0000 7f4f61e0f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555a638d1d40 0x555a639ce050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.531+0000 7f4f61e0f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x555a638db440 con 0x555a638d1d40 2024-04-24T02:12:26.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.531+0000 7f4f5d547640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555a638d1d40 0x555a639ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.531+0000 7f4f5d547640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555a638d1d40 0x555a639ce050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56080/0 (socket says 172.21.15.134:56080) 2024-04-24T02:12:26.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.531+0000 7f4f5d547640 1 -- 172.21.15.134:0/594765826 learned_addr learned my addr 172.21.15.134:0/594765826 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:26.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.532+0000 7f4f5d547640 1 -- 172.21.15.134:0/594765826 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a639ce590 con 0x555a638d1d40 2024-04-24T02:12:26.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.532+0000 7f4f5d547640 1 --2- 172.21.15.134:0/594765826 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555a638d1d40 0x555a639ce050 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4f50061040 tx=0x7f4f50002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.532+0000 7f4e49e03640 1 -- 172.21.15.134:0/594765826 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f50063030 con 0x555a638d1d40 2024-04-24T02:12:26.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.532+0000 7f4e49e03640 1 -- 172.21.15.134:0/594765826 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f50052a60 con 0x555a638d1d40 2024-04-24T02:12:26.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.532+0000 7f4f61e0f800 1 -- 172.21.15.134:0/594765826 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555a639ce820 con 0x555a638d1d40 2024-04-24T02:12:26.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.532+0000 7f4e49e03640 1 -- 172.21.15.134:0/594765826 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f50052d40 con 0x555a638d1d40 2024-04-24T02:12:26.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.532+0000 7f4f61e0f800 1 -- 172.21.15.134:0/594765826 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a639d14d0 con 0x555a638d1d40 2024-04-24T02:12:26.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.533+0000 7f4e49e03640 1 -- 172.21.15.134:0/594765826 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4f5005e480 con 0x555a638d1d40 2024-04-24T02:12:26.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.533+0000 7f4e49e03640 1 --2- 172.21.15.134:0/594765826 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4e44036950 0x7f4e44038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.533+0000 7f4e49e03640 1 -- 172.21.15.134:0/594765826 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f4f50064070 con 0x555a638d1d40 2024-04-24T02:12:26.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.533+0000 7f4f5cd46640 1 --2- 172.21.15.134:0/594765826 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4e44036950 0x7f4e44038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.533+0000 7f4f61e0f800 1 --2- 172.21.15.134:0/594765826 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x555a638d2fa0 0x555a639d5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.533+0000 7f4f61e0f800 1 -- 172.21.15.134:0/594765826 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555a639d57d0 con 0x555a638d2fa0 2024-04-24T02:12:26.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.533+0000 7f4f5dd48640 1 --2- 172.21.15.134:0/594765826 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x555a638d2fa0 0x555a639d5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.534+0000 7f4f5cd46640 1 --2- 172.21.15.134:0/594765826 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4e44036950 0x7f4e44038e10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4f54000c00 tx=0x7f4f540013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.534+0000 7f4f5dd48640 1 --2- 172.21.15.134:0/594765826 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x555a638d2fa0 0x555a639d5290 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.534+0000 7f4f5dd48640 1 -- 172.21.15.134:0/594765826 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f5800a4a0 con 0x555a638d2fa0 2024-04-24T02:12:26.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.534+0000 7f4f61e0f800 1 -- 172.21.15.134:0/594765826 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555a639d2820 con 0x555a638d2fa0 2024-04-24T02:12:26.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.534+0000 7f4f5dd48640 1 -- 172.21.15.134:0/594765826 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4f5800a4a0 con 0x555a638d2fa0 2024-04-24T02:12:26.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.534+0000 7f4f61e0f800 1 -- 172.21.15.134:0/594765826 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555a639d75f0 con 0x555a638d2fa0 2024-04-24T02:12:26.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.534+0000 7f4f5dd48640 1 -- 172.21.15.134:0/594765826 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4f5800a4a0 con 0x555a638d2fa0 2024-04-24T02:12:26.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.534+0000 7f4f61e0f800 1 -- 172.21.15.134:0/594765826 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555a639d6930 con 0x555a638d2fa0 2024-04-24T02:12:26.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.535+0000 7f4f5dd48640 1 -- 172.21.15.134:0/594765826 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4f5800a4a0 con 0x555a638d2fa0 2024-04-24T02:12:26.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.535+0000 7f4f61e0f800 1 -- 172.21.15.134:0/594765826 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555a639d6d80 con 0x555a638d2fa0 2024-04-24T02:12:26.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.535+0000 7f4f5dd48640 1 -- 172.21.15.134:0/594765826 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4f5800a4a0 con 0x555a638d2fa0 2024-04-24T02:12:26.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.535+0000 7f4f61e0f800 1 Processor -- start 2024-04-24T02:12:26.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.535+0000 7f4f61e0f800 1 -- start start 2024-04-24T02:12:26.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.535+0000 7f4f61e0f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555a639e63a0 0x555a639e67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.535+0000 7f4f61e0f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x555a637c46b0 con 0x555a639e63a0 2024-04-24T02:12:26.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.536+0000 7f4f5cd46640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555a639e63a0 0x555a639e67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.536+0000 7f4f5cd46640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555a639e63a0 0x555a639e67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56086/0 (socket says 172.21.15.134:56086) 2024-04-24T02:12:26.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.536+0000 7f4f5cd46640 1 -- 172.21.15.134:0/62860826 learned_addr learned my addr 172.21.15.134:0/62860826 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:26.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.536+0000 7f4f5cd46640 1 -- 172.21.15.134:0/62860826 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a639e6d00 con 0x555a639e63a0 2024-04-24T02:12:26.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.536+0000 7f4f5cd46640 1 --2- 172.21.15.134:0/62860826 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555a639e63a0 0x555a639e67c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4f5400e610 tx=0x7f4f5400ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.536+0000 7f4e42ffd640 1 -- 172.21.15.134:0/62860826 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f54022070 con 0x555a639e63a0 2024-04-24T02:12:26.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.536+0000 7f4e42ffd640 1 -- 172.21.15.134:0/62860826 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f54009050 con 0x555a639e63a0 2024-04-24T02:12:26.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.536+0000 7f4f61e0f800 1 -- 172.21.15.134:0/62860826 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555a639e7770 con 0x555a639e63a0 2024-04-24T02:12:26.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.536+0000 7f4e42ffd640 1 -- 172.21.15.134:0/62860826 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f5400d500 con 0x555a639e63a0 2024-04-24T02:12:26.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.536+0000 7f4f61e0f800 1 -- 172.21.15.134:0/62860826 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a639e7c70 con 0x555a639e63a0 2024-04-24T02:12:26.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.537+0000 7f4e42ffd640 1 -- 172.21.15.134:0/62860826 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4f54025070 con 0x555a639e63a0 2024-04-24T02:12:26.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.537+0000 7f4e42ffd640 1 --2- 172.21.15.134:0/62860826 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4e34036950 0x7f4e34038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.537+0000 7f4e42ffd640 1 -- 172.21.15.134:0/62860826 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f4f5404d9e0 con 0x555a639e63a0 2024-04-24T02:12:26.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.537+0000 7f4f5dd48640 1 --2- 172.21.15.134:0/62860826 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4e34036950 0x7f4e34038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.537+0000 7f4f61e0f800 1 Processor -- start 2024-04-24T02:12:26.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.538+0000 7f4f61e0f800 1 -- start start 2024-04-24T02:12:26.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.538+0000 7f4f5dd48640 1 --2- 172.21.15.134:0/62860826 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4e34036950 0x7f4e34038e10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x555a639d6450 tx=0x7f4f58005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.538+0000 7f4f61e0f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555a639f36e0 0x555a639f3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.538+0000 7f4f61e0f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x555a639c9550 con 0x555a639f36e0 2024-04-24T02:12:26.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.538+0000 7f4f5cd46640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555a639f36e0 0x555a639f3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.538+0000 7f4f5cd46640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555a639f36e0 0x555a639f3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56096/0 (socket says 172.21.15.134:56096) 2024-04-24T02:12:26.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.538+0000 7f4f5cd46640 1 -- 172.21.15.134:0/2752633129 learned_addr learned my addr 172.21.15.134:0/2752633129 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:26.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.538+0000 7f4f5cd46640 1 -- 172.21.15.134:0/2752633129 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a639f40d0 con 0x555a639f36e0 2024-04-24T02:12:26.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.538+0000 7f4f5cd46640 1 --2- 172.21.15.134:0/2752633129 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555a639f36e0 0x555a639f3b00 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4f54026fd0 tx=0x7f4f54024eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dce0456a9c636c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.538+0000 7f4e40ff9640 1 -- 172.21.15.134:0/2752633129 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f5404a030 con 0x555a639f36e0 2024-04-24T02:12:26.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.538+0000 7f4e40ff9640 1 -- 172.21.15.134:0/2752633129 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f54025e30 con 0x555a639f36e0 2024-04-24T02:12:26.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.538+0000 7f4e40ff9640 1 -- 172.21.15.134:0/2752633129 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f5401ad50 con 0x555a639f36e0 2024-04-24T02:12:26.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.539+0000 7f4f61e0f800 1 -- 172.21.15.134:0/2752633129 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555a639f36e0 msgr2=0x555a639f3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.539+0000 7f4f61e0f800 1 --2- 172.21.15.134:0/2752633129 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555a639f36e0 0x555a639f3b00 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4f54026fd0 tx=0x7f4f54024eb0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.539+0000 7f4f61e0f800 1 -- 172.21.15.134:0/2752633129 shutdown_connections 2024-04-24T02:12:26.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.539+0000 7f4f61e0f800 1 --2- 172.21.15.134:0/2752633129 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555a639f36e0 0x555a639f3b00 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.539+0000 7f4f61e0f800 1 -- 172.21.15.134:0/2752633129 >> 172.21.15.134:0/2752633129 conn(0x555a639efa40 msgr2=0x555a639edaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:26.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.539+0000 7f4f61e0f800 1 -- 172.21.15.134:0/2752633129 shutdown_connections 2024-04-24T02:12:26.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.539+0000 7f4f61e0f800 1 -- 172.21.15.134:0/2752633129 wait complete. 2024-04-24T02:12:26.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.539+0000 7f4f61e0f800 1 Processor -- start 2024-04-24T02:12:26.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.539+0000 7f4f61e0f800 1 -- start start 2024-04-24T02:12:26.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.539+0000 7f4f61e0f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555a639f36e0 0x555a639fada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.539+0000 7f4f61e0f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x555a639f4840 con 0x555a639f36e0 2024-04-24T02:12:26.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.540+0000 7f4f5cd46640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555a639f36e0 0x555a639fada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.540+0000 7f4f5cd46640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555a639f36e0 0x555a639fada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56112/0 (socket says 172.21.15.134:56112) 2024-04-24T02:12:26.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.540+0000 7f4f5cd46640 1 -- 172.21.15.134:0/120154919 learned_addr learned my addr 172.21.15.134:0/120154919 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:26.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.540+0000 7f4f5cd46640 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a639fb2e0 con 0x555a639f36e0 2024-04-24T02:12:26.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.540+0000 7f4f5cd46640 1 --2- 172.21.15.134:0/120154919 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555a639f36e0 0x555a639fada0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4f54026fd0 tx=0x7f4f5404be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.540+0000 7f4e32ffd640 1 -- 172.21.15.134:0/120154919 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f5404a050 con 0x555a639f36e0 2024-04-24T02:12:26.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.540+0000 7f4e32ffd640 1 -- 172.21.15.134:0/120154919 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f5404d7b0 con 0x555a639f36e0 2024-04-24T02:12:26.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.540+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555a639fb570 con 0x555a639f36e0 2024-04-24T02:12:26.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.540+0000 7f4e32ffd640 1 -- 172.21.15.134:0/120154919 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f540256a0 con 0x555a639f36e0 2024-04-24T02:12:26.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.540+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a639fe220 con 0x555a639f36e0 2024-04-24T02:12:26.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.541+0000 7f4e32ffd640 1 -- 172.21.15.134:0/120154919 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4f5400d6a0 con 0x555a639f36e0 2024-04-24T02:12:26.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.541+0000 7f4e32ffd640 1 --2- 172.21.15.134:0/120154919 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4e28036950 0x7f4e28038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.541+0000 7f4e32ffd640 1 -- 172.21.15.134:0/120154919 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f4f540456f0 con 0x555a639f36e0 2024-04-24T02:12:26.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.541+0000 7f4f5dd48640 1 --2- 172.21.15.134:0/120154919 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4e28036950 0x7f4e28038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.541+0000 7f4f5dd48640 1 --2- 172.21.15.134:0/120154919 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4e28036950 0x7f4e28038e10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x555a639d27b0 tx=0x7f4f5801f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.542+0000 7f4f61e0f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.542+0000 7f4f61e0f800 1 --2- 172.21.15.134:0/120154919 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x555a63a068f0 0x555a63a08db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.542+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555a63a09500 con 0x555a63a068f0 2024-04-24T02:12:26.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.542+0000 7f4f5d547640 1 --2- 172.21.15.134:0/120154919 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x555a63a068f0 0x555a63a08db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.542+0000 7f4f5d547640 1 --2- 172.21.15.134:0/120154919 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x555a63a068f0 0x555a63a08db0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.542+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f50070020 con 0x555a63a068f0 2024-04-24T02:12:26.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.542+0000 7f4f61e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:26.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.542+0000 7f4f61e0f800 20 realm 2024-04-24T02:12:26.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.542+0000 7f4f61e0f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.542+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555a63a09910 con 0x555a63a068f0 2024-04-24T02:12:26.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.542+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f50070020 con 0x555a63a068f0 2024-04-24T02:12:26.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.542+0000 7f4f61e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:26.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.542+0000 7f4f61e0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:26.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.542+0000 7f4f61e0f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.542+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555a63a0a1e0 con 0x555a63a068f0 2024-04-24T02:12:26.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.543+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f50070020 con 0x555a63a068f0 2024-04-24T02:12:26.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.543+0000 7f4f61e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:26.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.543+0000 7f4f61e0f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.543+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555a63a0a580 con 0x555a63a068f0 2024-04-24T02:12:26.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.543+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4f50070020 con 0x555a63a068f0 2024-04-24T02:12:26.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.543+0000 7f4f61e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:26.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.543+0000 7f4f61e0f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.543+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555a63a0add0 con 0x555a63a068f0 2024-04-24T02:12:26.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.543+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4f50070020 con 0x555a63a068f0 2024-04-24T02:12:26.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.543+0000 7f4f61e0f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:26.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.543+0000 7f4f61e0f800 20 searching for the correct realm 2024-04-24T02:12:26.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.543+0000 7f4f61e0f800 1 --2- 172.21.15.134:0/120154919 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x555a63a0cb40 0x555a63a0ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.543+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555a63a0f510 con 0x555a63a0cb40 2024-04-24T02:12:26.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.543+0000 7f4f5cd46640 1 --2- 172.21.15.134:0/120154919 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x555a63a0cb40 0x555a63a0ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.544+0000 7f4f5cd46640 1 --2- 172.21.15.134:0/120154919 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x555a63a0cb40 0x555a63a0ef30 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.544+0000 7f4f5cd46640 1 -- 172.21.15.134:0/120154919 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f54024030 con 0x555a63a0cb40 2024-04-24T02:12:26.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.544+0000 7f4f5cd46640 1 --2- 172.21.15.134:0/120154919 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f4f54027060 0x7f4f5404a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.544+0000 7f4f5cd46640 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555a63a0f510 con 0x7f4f54027060 2024-04-24T02:12:26.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.544+0000 7f4f5dd48640 1 --2- 172.21.15.134:0/120154919 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f4f54027060 0x7f4f5404a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.544+0000 7f4f5dd48640 1 --2- 172.21.15.134:0/120154919 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f4f54027060 0x7f4f5404a530 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.545+0000 7f4f5dd48640 1 -- 172.21.15.134:0/120154919 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f5801f070 con 0x7f4f54027060 2024-04-24T02:12:26.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.545+0000 7f4f5dd48640 1 --2- 172.21.15.134:0/120154919 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f4f58031040 0x7f4f58032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.545+0000 7f4f5dd48640 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555a63a0f510 con 0x7f4f58031040 2024-04-24T02:12:26.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.545+0000 7f4f5d547640 1 --2- 172.21.15.134:0/120154919 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f4f58031040 0x7f4f58032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.545+0000 7f4f5d547640 1 --2- 172.21.15.134:0/120154919 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f4f58031040 0x7f4f58032940 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.546+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f50070020 con 0x7f4f58031040 2024-04-24T02:12:26.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.546+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555a63a0f510 con 0x555a63a068f0 2024-04-24T02:12:26.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.546+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f50070020 con 0x555a63a068f0 2024-04-24T02:12:26.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.546+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555a63a0f510 con 0x555a63a068f0 2024-04-24T02:12:26.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.546+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4f50070020 con 0x555a63a068f0 2024-04-24T02:12:26.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.546+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555a63a0f510 con 0x7f4f58031040 2024-04-24T02:12:26.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.546+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f50070020 con 0x7f4f58031040 2024-04-24T02:12:26.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.546+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555a63a0f510 con 0x7f4f58031040 2024-04-24T02:12:26.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.547+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f50070020 con 0x7f4f58031040 2024-04-24T02:12:26.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.547+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555a63a0f510 con 0x7f4f54027060 2024-04-24T02:12:26.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.547+0000 7f4f5dd48640 1 -- 172.21.15.134:0/120154919 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f5801f070 con 0x7f4f54027060 2024-04-24T02:12:26.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.547+0000 7f4f5dd48640 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555a63a0f510 con 0x555a63a0cb40 2024-04-24T02:12:26.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.547+0000 7f4f5cd46640 1 -- 172.21.15.134:0/120154919 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f54024030 con 0x555a63a0cb40 2024-04-24T02:12:26.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.547+0000 7f4f5cd46640 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555a63a0f510 con 0x555a63a068f0 2024-04-24T02:12:26.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.547+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f50070020 con 0x555a63a068f0 2024-04-24T02:12:26.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.547+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555a63a0f510 con 0x7f4f58031040 2024-04-24T02:12:26.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.547+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f50070020 con 0x7f4f58031040 2024-04-24T02:12:26.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.547+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555a63a0f510 con 0x555a63a068f0 2024-04-24T02:12:26.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.548+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f50070020 con 0x555a63a068f0 2024-04-24T02:12:26.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.548+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555a63a0f510 con 0x7f4f54027060 2024-04-24T02:12:26.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.548+0000 7f4f5dd48640 1 -- 172.21.15.134:0/120154919 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4f5801f070 con 0x7f4f54027060 2024-04-24T02:12:26.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.548+0000 7f4f5dd48640 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555a63a0f510 con 0x555a63a0cb40 2024-04-24T02:12:26.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.548+0000 7f4f5cd46640 1 -- 172.21.15.134:0/120154919 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f54024030 con 0x555a63a0cb40 2024-04-24T02:12:26.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.548+0000 7f4f5cd46640 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555a63a0f510 con 0x555a63a0cb40 2024-04-24T02:12:26.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.548+0000 7f4f5cd46640 1 -- 172.21.15.134:0/120154919 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f54024030 con 0x555a63a0cb40 2024-04-24T02:12:26.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.548+0000 7f4f5cd46640 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555a63a0f510 con 0x7f4f58031040 2024-04-24T02:12:26.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.549+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f50070020 con 0x7f4f58031040 2024-04-24T02:12:26.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.549+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555a63a0f510 con 0x555a63a0cb40 2024-04-24T02:12:26.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.549+0000 7f4f5cd46640 1 -- 172.21.15.134:0/120154919 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f54024030 con 0x555a63a0cb40 2024-04-24T02:12:26.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.549+0000 7f4f5cd46640 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555a63a0f510 con 0x555a63a0cb40 2024-04-24T02:12:26.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.549+0000 7f4f5cd46640 1 -- 172.21.15.134:0/120154919 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f54024030 con 0x555a63a0cb40 2024-04-24T02:12:26.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.549+0000 7f4f5cd46640 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555a63a0f510 con 0x555a63a068f0 2024-04-24T02:12:26.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.549+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f50070020 con 0x555a63a068f0 2024-04-24T02:12:26.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.549+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555a63a0f510 con 0x555a63a068f0 2024-04-24T02:12:26.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.550+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f4f50070020 con 0x555a63a068f0 2024-04-24T02:12:26.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.550+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555a63a0f510 con 0x7f4f58031040 2024-04-24T02:12:26.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.550+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f50070020 con 0x7f4f58031040 2024-04-24T02:12:26.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.550+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555a63a0f510 con 0x555a63a0cb40 2024-04-24T02:12:26.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.550+0000 7f4f5cd46640 1 -- 172.21.15.134:0/120154919 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f54024030 con 0x555a63a0cb40 2024-04-24T02:12:26.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.550+0000 7f4f5cd46640 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555a63a0f510 con 0x7f4f54027060 2024-04-24T02:12:26.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.550+0000 7f4f5dd48640 1 -- 172.21.15.134:0/120154919 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f5801f070 con 0x7f4f54027060 2024-04-24T02:12:26.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.550+0000 7f4f5dd48640 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555a63a0f510 con 0x555a63a068f0 2024-04-24T02:12:26.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.551+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f50070020 con 0x555a63a068f0 2024-04-24T02:12:26.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.551+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555a63a0f510 con 0x7f4f58031040 2024-04-24T02:12:26.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.551+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f50070020 con 0x7f4f58031040 2024-04-24T02:12:26.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.551+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555a63a0f510 con 0x555a63a0cb40 2024-04-24T02:12:26.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.551+0000 7f4f5cd46640 1 -- 172.21.15.134:0/120154919 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f54024030 con 0x555a63a0cb40 2024-04-24T02:12:26.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.551+0000 7f4f5cd46640 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555a63a0f510 con 0x7f4f58031040 2024-04-24T02:12:26.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.552+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f50070020 con 0x7f4f58031040 2024-04-24T02:12:26.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.552+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555a63a0f510 con 0x7f4f54027060 2024-04-24T02:12:26.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.552+0000 7f4f5dd48640 1 -- 172.21.15.134:0/120154919 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f5801f070 con 0x7f4f54027060 2024-04-24T02:12:26.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.552+0000 7f4f5dd48640 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555a63a0f510 con 0x555a63a0cb40 2024-04-24T02:12:26.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.552+0000 7f4f5cd46640 1 -- 172.21.15.134:0/120154919 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f54024030 con 0x555a63a0cb40 2024-04-24T02:12:26.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.552+0000 7f4f5cd46640 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555a63a0f510 con 0x7f4f58031040 2024-04-24T02:12:26.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.552+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f50070020 con 0x7f4f58031040 2024-04-24T02:12:26.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.552+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555a63a0f510 con 0x555a63a068f0 2024-04-24T02:12:26.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.553+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4f50070020 con 0x555a63a068f0 2024-04-24T02:12:26.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.553+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555a63a0f510 con 0x7f4f54027060 2024-04-24T02:12:26.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.553+0000 7f4f5dd48640 1 -- 172.21.15.134:0/120154919 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f5801f070 con 0x7f4f54027060 2024-04-24T02:12:26.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.553+0000 7f4f61e0f800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:26.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.553+0000 7f4f61e0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:26.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.553+0000 7f4f61e0f800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:26.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.553+0000 7f4f61e0f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:26.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.553+0000 7f4f61e0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:26.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.553+0000 7f4f61e0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:26.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.553+0000 7f4f61e0f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.553+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555a63a0b780 con 0x555a63a068f0 2024-04-24T02:12:26.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.553+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f50070020 con 0x555a63a068f0 2024-04-24T02:12:26.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.553+0000 7f4f61e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:26.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.553+0000 7f4f61e0f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.553+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555a63a0c020 con 0x555a63a068f0 2024-04-24T02:12:26.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.553+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4f50070020 con 0x555a63a068f0 2024-04-24T02:12:26.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.553+0000 7f4f61e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:26.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.553+0000 7f4f61e0f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.553+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555a63a0f990 con 0x555a63a068f0 2024-04-24T02:12:26.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.553+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4f50070020 con 0x555a63a068f0 2024-04-24T02:12:26.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.554+0000 7f4f61e0f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:26.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.554+0000 7f4f61e0f800 20 zone default found 2024-04-24T02:12:26.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.554+0000 7f4f61e0f800 4 Realm: () 2024-04-24T02:12:26.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.554+0000 7f4f61e0f800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:26.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.554+0000 7f4f61e0f800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:26.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.554+0000 7f4f61e0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:26.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.554+0000 7f4f61e0f800 20 zonegroup default 2024-04-24T02:12:26.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.554+0000 7f4f61e0f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.554+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555a63a0fe40 con 0x7f4f58031040 2024-04-24T02:12:26.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.554+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4f50070020 con 0x7f4f58031040 2024-04-24T02:12:26.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.554+0000 7f4f61e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:26.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.554+0000 7f4f61e0f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.554+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555a63a11820 con 0x555a63a0cb40 2024-04-24T02:12:26.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.554+0000 7f4f5cd46640 1 -- 172.21.15.134:0/120154919 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4f54024030 con 0x555a63a0cb40 2024-04-24T02:12:26.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.554+0000 7f4f61e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:26.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.554+0000 7f4f61e0f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.554+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555a63a11cc0 con 0x555a63a0cb40 2024-04-24T02:12:26.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.554+0000 7f4f5cd46640 1 -- 172.21.15.134:0/120154919 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4f54024030 con 0x555a63a0cb40 2024-04-24T02:12:26.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.554+0000 7f4f61e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:26.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.554+0000 7f4f61e0f800 20 started sync module instance, tier type = 2024-04-24T02:12:26.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.554+0000 7f4f61e0f800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:26.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.554+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555a63a10cb0 con 0x7f4f54027060 2024-04-24T02:12:26.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.555+0000 7f4f5dd48640 1 -- 172.21.15.134:0/120154919 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f58040040 con 0x7f4f54027060 2024-04-24T02:12:26.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.555+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93846706917536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555a63a125d0 con 0x7f4f54027060 2024-04-24T02:12:26.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.555+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555a63a12e20 con 0x555a63a068f0 2024-04-24T02:12:26.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.556+0000 7f4f5dd48640 1 -- 172.21.15.134:0/120154919 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93846706917536] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f58040040 con 0x7f4f54027060 2024-04-24T02:12:26.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.557+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f50070020 con 0x555a63a068f0 2024-04-24T02:12:26.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.557+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93846706921760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555a63a12a70 con 0x555a63a068f0 2024-04-24T02:12:26.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.557+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555a63a13560 con 0x555a63a0cb40 2024-04-24T02:12:26.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.557+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93846706921760] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f50070020 con 0x555a63a068f0 2024-04-24T02:12:26.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.558+0000 7f4f5cd46640 1 -- 172.21.15.134:0/120154919 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f54024030 con 0x555a63a0cb40 2024-04-24T02:12:26.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.558+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93846706925616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555a63a13950 con 0x555a63a0cb40 2024-04-24T02:12:26.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.558+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555a63a14310 con 0x7f4f54027060 2024-04-24T02:12:26.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.559+0000 7f4f5dd48640 1 -- 172.21.15.134:0/120154919 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f58040040 con 0x7f4f54027060 2024-04-24T02:12:26.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.559+0000 7f4f5cd46640 1 -- 172.21.15.134:0/120154919 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93846706925616] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f54024030 con 0x555a63a0cb40 2024-04-24T02:12:26.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.559+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93846706929728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555a63a14bb0 con 0x7f4f54027060 2024-04-24T02:12:26.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.559+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555a63a12540 con 0x555a63a068f0 2024-04-24T02:12:26.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.560+0000 7f4f5dd48640 1 -- 172.21.15.134:0/120154919 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93846706929728] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f58040040 con 0x7f4f54027060 2024-04-24T02:12:26.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.560+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f50070020 con 0x555a63a068f0 2024-04-24T02:12:26.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.560+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93846706931456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555a63a14b20 con 0x555a63a068f0 2024-04-24T02:12:26.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.560+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555a63a15c40 con 0x7f4f58031040 2024-04-24T02:12:26.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.561+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f50070020 con 0x7f4f58031040 2024-04-24T02:12:26.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.561+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93846706935696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555a63a16060 con 0x7f4f58031040 2024-04-24T02:12:26.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.561+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93846706931456] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f50070020 con 0x555a63a068f0 2024-04-24T02:12:26.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.561+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555a63a15170 con 0x7f4f58031040 2024-04-24T02:12:26.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.562+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93846706935696] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f50070020 con 0x7f4f58031040 2024-04-24T02:12:26.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.562+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(56 notify.6 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f50070020 con 0x7f4f58031040 2024-04-24T02:12:26.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.562+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93846706936752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555a63a15fd0 con 0x7f4f58031040 2024-04-24T02:12:26.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.562+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555a63a170c0 con 0x7f4f58031040 2024-04-24T02:12:26.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.563+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93846706936752] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f50070020 con 0x7f4f58031040 2024-04-24T02:12:26.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.563+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(58 notify.7 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f50070020 con 0x7f4f58031040 2024-04-24T02:12:26.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.563+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93846706939376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555a63a170c0 con 0x7f4f58031040 2024-04-24T02:12:26.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.563+0000 7f4f61e0f800 20 add_watcher() i=0 2024-04-24T02:12:26.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.563+0000 7f4f61e0f800 20 add_watcher() i=1 2024-04-24T02:12:26.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.563+0000 7f4f61e0f800 20 add_watcher() i=2 2024-04-24T02:12:26.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.563+0000 7f4f61e0f800 20 add_watcher() i=3 2024-04-24T02:12:26.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.563+0000 7f4f61e0f800 20 add_watcher() i=4 2024-04-24T02:12:26.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.563+0000 7f4f61e0f800 20 add_watcher() i=5 2024-04-24T02:12:26.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.563+0000 7f4f61e0f800 20 add_watcher() i=6 2024-04-24T02:12:26.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.564+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93846706939376] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f50070020 con 0x7f4f58031040 2024-04-24T02:12:26.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.564+0000 7f4f61e0f800 20 add_watcher() i=7 2024-04-24T02:12:26.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.564+0000 7f4f61e0f800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:26.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.564+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555a63a1a3b0 con 0x555a63a068f0 2024-04-24T02:12:26.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.564+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4f50070020 con 0x555a63a068f0 2024-04-24T02:12:26.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.564+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93846706941312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555a63a17650 con 0x555a63a068f0 2024-04-24T02:12:26.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.565+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93846706941312] v30'117 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4f50070020 con 0x555a63a068f0 2024-04-24T02:12:26.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.565+0000 7f4e137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:26.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.565+0000 7f4f61e0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:26.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.565+0000 7f4f61e0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:26.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.565+0000 7f4f61e0f800 5 note: GC not initialized 2024-04-24T02:12:26.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.565+0000 7f4e127e4640 20 reqs_thread_entry: start 2024-04-24T02:12:26.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.565+0000 7f4f61e0f800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:26.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.565+0000 7f4f61e0f800 20 Filter name: none 2024-04-24T02:12:26.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.566+0000 7f4d83fff640 20 reqs_thread_entry: start 2024-04-24T02:12:26.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.566+0000 7f4f61e0f800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-24T02:12:26.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.566+0000 7f4f61e0f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.566+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555a63a4d780 con 0x7f4f58031040 2024-04-24T02:12:26.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.567+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f4f50070020 con 0x7f4f58031040 2024-04-24T02:12:26.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.567+0000 7f4f61e0f800 20 rados_obj.operate() r=0 bl.length=380 2024-04-24T02:12:26.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.567+0000 7f4f61e0f800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-04-24T02:12:26.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.567+0000 7f4f61e0f800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-24T02:12:26.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.567+0000 7f4f61e0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:12:26.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.567+0000 7f4f61e0f800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-24T02:12:26.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.567+0000 7f4f61e0f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.567+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555a63a4f860 con 0x7f4f54027060 2024-04-24T02:12:26.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.567+0000 7f4f5dd48640 1 -- 172.21.15.134:0/120154919 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv18 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f4f58040040 con 0x7f4f54027060 2024-04-24T02:12:26.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.567+0000 7f4f61e0f800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T02:12:26.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.567+0000 7f4f61e0f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-24T02:12:26.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.567+0000 7f4f61e0f800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T02:12:26.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.567+0000 7f4f61e0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 : miss 2024-04-24T02:12:26.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.567+0000 7f4f61e0f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.567+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:64 8.1d 8:be2d2b4a:root::.bucket.meta.myfoo%3a582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555a63a51320 con 0x7f4f58031040 2024-04-24T02:12:26.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.567+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(64 .bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f4f50070020 con 0x7f4f58031040 2024-04-24T02:12:26.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.567+0000 7f4f61e0f800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T02:12:26.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.567+0000 7f4f61e0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 info.flags=0x17 2024-04-24T02:12:26.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.567+0000 7f4f61e0f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 to cache LRU end 2024-04-24T02:12:26.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.567+0000 7f4f61e0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:12:26.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.567+0000 7f4f61e0f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T02:12:26.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.567+0000 7f4f61e0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 2024-04-24T02:12:26.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.567+0000 7f4f61e0f800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-04-24T02:12:26.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.567+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555a63a55780 con 0x7f4f54027060 2024-04-24T02:12:26.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.568+0000 7f4f5dd48640 1 -- 172.21.15.134:0/120154919 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(65 foo.buckets [call] v30'19 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f4f58040040 con 0x7f4f54027060 2024-04-24T02:12:26.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.569+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:66 8.1d 8:be2d2b4a:root::.bucket.meta.myfoo%3a582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555a63a5b6c0 con 0x7f4f58031040 2024-04-24T02:12:26.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.570+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(66 .bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v30'2 uv2 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f4f50070020 con 0x7f4f58031040 2024-04-24T02:12:26.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.570+0000 7f4f61e0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 info.flags=0x17 2024-04-24T02:12:26.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.570+0000 7f4f61e0f800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 to cache LRU end 2024-04-24T02:12:26.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.570+0000 7f4f61e0f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T02:12:26.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.570+0000 7f4f61e0f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1, ofs0, ns] 2024-04-24T02:12:26.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.570+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:67 7.9 7:93e5b521:::notify.7:head [notify cookie 93846707180176 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555a63a55bb0 con 0x7f4f58031040 2024-04-24T02:12:26.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.570+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.0 v2:172.21.15.104:6800/2419146313 20 ==== watch-notify(notify (1) cookie 93846706939376 notify 128849018884 ret 0) ==== 794+0+0 (crc 0 0 0) 0x555a63a50840 con 0x7f4f58031040 2024-04-24T02:12:26.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.570+0000 7f4e40ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018884 cookie 93846706939376 notifier 4495 bl.length()=752 2024-04-24T02:12:26.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.570+0000 7f4e40ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 info.flags=0x17 2024-04-24T02:12:26.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.570+0000 7f4e40ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 to cache LRU end 2024-04-24T02:12:26.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.570+0000 7f4e40ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T02:12:26.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.570+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.0 v2:172.21.15.104:6800/2419146313 21 ==== osd_op_reply(67 notify.7 [notify cookie 93846707180176 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4f50070020 con 0x7f4f58031040 2024-04-24T02:12:26.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.570+0000 7f4e40ff9640 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:68 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f4e20003ea0 con 0x7f4f58031040 2024-04-24T02:12:26.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.570+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.0 v2:172.21.15.104:6800/2419146313 22 ==== osd_op_reply(68 notify.7 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f50070020 con 0x7f4f58031040 2024-04-24T02:12:26.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.570+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.0 v2:172.21.15.104:6800/2419146313 23 ==== watch-notify(notify_complete (2) cookie 93846707180176 notify 128849018884 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555a639d14d0 con 0x7f4f58031040 2024-04-24T02:12:26.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.570+0000 7f4f61e0f800 20 handle_bi_update(): bucket=:myfoo[582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1]): orig_sources= new_sources= 2024-04-24T02:12:26.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.570+0000 7f4f61e0f800 20 handle_bi_update(): bucket=:myfoo[582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1]): potential sources added=[] removed=[] 2024-04-24T02:12:26.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.570+0000 7f4f61e0f800 20 handle_bi_update(): bucket=:myfoo[582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1]): orig_dests= new_dests= 2024-04-24T02:12:26.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.570+0000 7f4f61e0f800 20 handle_bi_update(): bucket=:myfoo[582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1]): potential dests added=[] removed=[] 2024-04-24T02:12:26.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.571+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555a63a51290 con 0x7f4f58031040 2024-04-24T02:12:26.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.571+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.0 v2:172.21.15.104:6800/2419146313 24 ==== osd_op_reply(69 fud.buckets [call] v30'1 uv1 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f4f50070020 con 0x7f4f58031040 2024-04-24T02:12:26.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.571+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555a63a51290 con 0x7f4f54027060 2024-04-24T02:12:26.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.572+0000 7f4f5dd48640 1 -- 172.21.15.134:0/120154919 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v30'20 uv20 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f4f58040040 con 0x7f4f54027060 2024-04-24T02:12:26.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.572+0000 7f4f61e0f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-04-24T02:12:26.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.572+0000 7f4f61e0f800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T02:12:26.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.573+0000 7f4f61e0f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-24T02:12:26.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.573+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93846707180176 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555a63a5a350 con 0x7f4f58031040 2024-04-24T02:12:26.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.573+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.0 v2:172.21.15.104:6800/2419146313 25 ==== watch-notify(notify (1) cookie 93846706936752 notify 128849018885 ret 0) ==== 356+0+0 (crc 0 0 0) 0x7f4f50078030 con 0x7f4f58031040 2024-04-24T02:12:26.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.573+0000 7f4e40ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018885 cookie 93846706936752 notifier 4495 bl.length()=314 2024-04-24T02:12:26.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.573+0000 7f4e40ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-04-24T02:12:26.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.573+0000 7f4e40ff9640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T02:12:26.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.573+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.0 v2:172.21.15.104:6800/2419146313 26 ==== osd_op_reply(71 notify.6 [notify cookie 93846707180176 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4f50070020 con 0x7f4f58031040 2024-04-24T02:12:26.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.573+0000 7f4e40ff9640 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f4e20003ea0 con 0x7f4f58031040 2024-04-24T02:12:26.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.573+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.0 v2:172.21.15.104:6800/2419146313 27 ==== watch-notify(notify_complete (2) cookie 93846707180176 notify 128849018885 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555a639ce820 con 0x7f4f58031040 2024-04-24T02:12:26.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.573+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.0 v2:172.21.15.104:6800/2419146313 28 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f50070020 con 0x7f4f58031040 2024-04-24T02:12:26.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.574+0000 7f4e137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:26.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.574+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93846706941312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555a63a51290 con 0x555a63a068f0 2024-04-24T02:12:26.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.575+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 93846706941312] v30'118 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4f50070020 con 0x555a63a068f0 2024-04-24T02:12:26.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.575+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93846706917536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555a63a16d80 con 0x7f4f54027060 2024-04-24T02:12:26.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.576+0000 7f4f5dd48640 1 -- 172.21.15.134:0/120154919 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 93846706917536] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f58040040 con 0x7f4f54027060 2024-04-24T02:12:26.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.576+0000 7f4f61e0f800 20 remove_watcher() i=0 2024-04-24T02:12:26.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.576+0000 7f4f61e0f800 2 removed watcher, disabling cache 2024-04-24T02:12:26.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.576+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93846706921760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555a63a16d80 con 0x555a63a068f0 2024-04-24T02:12:26.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.578+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 93846706921760] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f50070020 con 0x555a63a068f0 2024-04-24T02:12:26.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.578+0000 7f4f61e0f800 20 remove_watcher() i=1 2024-04-24T02:12:26.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.578+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93846706925616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555a63a12120 con 0x555a63a0cb40 2024-04-24T02:12:26.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.578+0000 7f4f5cd46640 1 -- 172.21.15.134:0/120154919 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 93846706925616] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f54024030 con 0x555a63a0cb40 2024-04-24T02:12:26.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.579+0000 7f4f61e0f800 20 remove_watcher() i=2 2024-04-24T02:12:26.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.579+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93846706929728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555a63a16d80 con 0x7f4f54027060 2024-04-24T02:12:26.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.580+0000 7f4f5dd48640 1 -- 172.21.15.134:0/120154919 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 93846706929728] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f58040040 con 0x7f4f54027060 2024-04-24T02:12:26.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.580+0000 7f4f61e0f800 20 remove_watcher() i=3 2024-04-24T02:12:26.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.580+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93846706931456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555a63a16d80 con 0x555a63a068f0 2024-04-24T02:12:26.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.581+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 93846706931456] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f50070020 con 0x555a63a068f0 2024-04-24T02:12:26.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.581+0000 7f4f61e0f800 20 remove_watcher() i=4 2024-04-24T02:12:26.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.581+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93846706935696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555a63a14700 con 0x7f4f58031040 2024-04-24T02:12:26.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.582+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.0 v2:172.21.15.104:6800/2419146313 29 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 93846706935696] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f50070020 con 0x7f4f58031040 2024-04-24T02:12:26.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.582+0000 7f4f61e0f800 20 remove_watcher() i=5 2024-04-24T02:12:26.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.582+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93846706936752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555a63a16d80 con 0x7f4f58031040 2024-04-24T02:12:26.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.583+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.0 v2:172.21.15.104:6800/2419146313 30 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 93846706936752] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f50070020 con 0x7f4f58031040 2024-04-24T02:12:26.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.583+0000 7f4f61e0f800 20 remove_watcher() i=6 2024-04-24T02:12:26.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.583+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93846706939376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555a63a14700 con 0x7f4f58031040 2024-04-24T02:12:26.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.583+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 <== osd.0 v2:172.21.15.104:6800/2419146313 31 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 93846706939376] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f50070020 con 0x7f4f58031040 2024-04-24T02:12:26.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.583+0000 7f4f61e0f800 20 remove_watcher() i=7 2024-04-24T02:12:26.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.584+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f4f58031040 msgr2=0x7f4f58032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.584+0000 7f4f61e0f800 1 --2- 172.21.15.134:0/120154919 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f4f58031040 0x7f4f58032940 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.584+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x555a63a068f0 msgr2=0x555a63a08db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.584+0000 7f4f61e0f800 1 --2- 172.21.15.134:0/120154919 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x555a63a068f0 0x555a63a08db0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.584+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f4f54027060 msgr2=0x7f4f5404a530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.584+0000 7f4f61e0f800 1 --2- 172.21.15.134:0/120154919 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f4f54027060 0x7f4f5404a530 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.584+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x555a63a0cb40 msgr2=0x555a63a0ef30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.584+0000 7f4f61e0f800 1 --2- 172.21.15.134:0/120154919 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x555a63a0cb40 0x555a63a0ef30 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.584+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4e28036950 msgr2=0x7f4e28038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.584+0000 7f4f61e0f800 1 --2- 172.21.15.134:0/120154919 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4e28036950 0x7f4e28038e10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x555a639d27b0 tx=0x7f4f5801f000 comp rx=0 tx=0).stop 2024-04-24T02:12:26.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.584+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555a639f36e0 msgr2=0x555a639fada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.584+0000 7f4f5d547640 1 -- 172.21.15.134:0/120154919 reap_dead start 2024-04-24T02:12:26.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.584+0000 7f4f61e0f800 1 --2- 172.21.15.134:0/120154919 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555a639f36e0 0x555a639fada0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4f54026fd0 tx=0x7f4f5404be50 comp rx=0 tx=0).stop 2024-04-24T02:12:26.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.584+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 shutdown_connections 2024-04-24T02:12:26.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.584+0000 7f4f61e0f800 1 --2- 172.21.15.134:0/120154919 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555a639f36e0 0x555a639fada0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.584+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 >> 172.21.15.134:0/120154919 conn(0x555a639efa40 msgr2=0x555a639ed0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:26.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.584+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 shutdown_connections 2024-04-24T02:12:26.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.584+0000 7f4f61e0f800 1 -- 172.21.15.134:0/120154919 wait complete. 2024-04-24T02:12:26.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.584+0000 7f4f61e0f800 1 -- 172.21.15.134:0/62860826 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4e34036950 msgr2=0x7f4e34038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.584+0000 7f4f61e0f800 1 --2- 172.21.15.134:0/62860826 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4e34036950 0x7f4e34038e10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x555a639d6450 tx=0x7f4f58005840 comp rx=0 tx=0).stop 2024-04-24T02:12:26.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.584+0000 7f4f61e0f800 1 -- 172.21.15.134:0/62860826 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555a639e63a0 msgr2=0x555a639e67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.584+0000 7f4f61e0f800 1 --2- 172.21.15.134:0/62860826 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555a639e63a0 0x555a639e67c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4f5400e610 tx=0x7f4f5400ff90 comp rx=0 tx=0).stop 2024-04-24T02:12:26.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.584+0000 7f4f61e0f800 1 -- 172.21.15.134:0/62860826 shutdown_connections 2024-04-24T02:12:26.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.584+0000 7f4f61e0f800 1 --2- 172.21.15.134:0/62860826 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4e34036950 0x7f4e34038e10 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.584+0000 7f4f61e0f800 1 --2- 172.21.15.134:0/62860826 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555a639e63a0 0x555a639e67c0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.584+0000 7f4f61e0f800 1 -- 172.21.15.134:0/62860826 >> 172.21.15.134:0/62860826 conn(0x555a639da440 msgr2=0x555a639da840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:26.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.584+0000 7f4f61e0f800 1 -- 172.21.15.134:0/62860826 shutdown_connections 2024-04-24T02:12:26.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.584+0000 7f4f61e0f800 1 -- 172.21.15.134:0/62860826 wait complete. 2024-04-24T02:12:26.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.585+0000 7f4f61e0f800 1 -- 172.21.15.134:0/594765826 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x555a638d2fa0 msgr2=0x555a639d5290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.585+0000 7f4f61e0f800 1 --2- 172.21.15.134:0/594765826 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x555a638d2fa0 0x555a639d5290 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.585+0000 7f4f61e0f800 1 -- 172.21.15.134:0/594765826 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4e44036950 msgr2=0x7f4e44038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.585+0000 7f4f61e0f800 1 --2- 172.21.15.134:0/594765826 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4e44036950 0x7f4e44038e10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4f54000c00 tx=0x7f4f540013b0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.585+0000 7f4f61e0f800 1 -- 172.21.15.134:0/594765826 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555a638d1d40 msgr2=0x555a639ce050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.585+0000 7f4f61e0f800 1 --2- 172.21.15.134:0/594765826 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555a638d1d40 0x555a639ce050 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4f50061040 tx=0x7f4f50002fb0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.585+0000 7f4f61e0f800 1 -- 172.21.15.134:0/594765826 shutdown_connections 2024-04-24T02:12:26.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.585+0000 7f4f61e0f800 1 --2- 172.21.15.134:0/594765826 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x555a638d2fa0 0x555a639d5290 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.585+0000 7f4f61e0f800 1 --2- 172.21.15.134:0/594765826 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4e44036950 0x7f4e44038e10 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.585+0000 7f4f61e0f800 1 --2- 172.21.15.134:0/594765826 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555a638d1d40 0x555a639ce050 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.585+0000 7f4f61e0f800 1 -- 172.21.15.134:0/594765826 >> 172.21.15.134:0/594765826 conn(0x555a638cd3a0 msgr2=0x555a639bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:26.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.585+0000 7f4f61e0f800 1 -- 172.21.15.134:0/594765826 shutdown_connections 2024-04-24T02:12:26.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.585+0000 7f4f61e0f800 1 -- 172.21.15.134:0/594765826 wait complete. 2024-04-24T02:12:26.610 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-04-24T02:12:26.610 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-04-24T02:12:26.611 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-04-24T02:12:26.653 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:26.653 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:26.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.652+0000 7fa70a810800 1 Processor -- start 2024-04-24T02:12:26.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.652+0000 7fa70a810800 1 -- start start 2024-04-24T02:12:26.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.652+0000 7fa70a810800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x563d88330f90 0x563d883313b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.652+0000 7fa70a810800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563d881efd40 con 0x563d88332100 2024-04-24T02:12:26.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.652+0000 7fa70a810800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x563d881c24d0 con 0x563d88330f90 2024-04-24T02:12:26.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.653+0000 7fa705dee640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x563d88330f90 0x563d883313b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.653+0000 7fa7055ed640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x563d88332100 0x563d88332580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:55272/0 (socket says 172.21.15.134:55272) 2024-04-24T02:12:26.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.653+0000 7fa705dee640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x563d88330f90 0x563d883313b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56118/0 (socket says 172.21.15.134:56118) 2024-04-24T02:12:26.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.653+0000 7fa7055ed640 1 -- 172.21.15.134:0/901613332 learned_addr learned my addr 172.21.15.134:0/901613332 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:12:26.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.653+0000 7fa705dee640 1 -- 172.21.15.134:0/901613332 >> v1:172.21.15.104:6789/0 conn(0x563d88332100 legacy=0x563d88332580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.653+0000 7fa705dee640 1 -- 172.21.15.134:0/901613332 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d881ee590 con 0x563d88330f90 2024-04-24T02:12:26.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.655+0000 7fa705dee640 1 --2- 172.21.15.134:0/901613332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563d88330f90 0x563d883313b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa700005fd0 tx=0x7fa70001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25f98e592dfb5afa server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.655+0000 7fa704dec640 1 -- 172.21.15.134:0/901613332 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa700052560 con 0x563d88330f90 2024-04-24T02:12:26.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.655+0000 7fa704dec640 1 -- 172.21.15.134:0/901613332 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa700052700 con 0x563d88330f90 2024-04-24T02:12:26.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.655+0000 7fa704dec640 1 -- 172.21.15.134:0/901613332 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa700052a60 con 0x563d88330f90 2024-04-24T02:12:26.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.656+0000 7fa70a810800 1 -- 172.21.15.134:0/901613332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563d88330f90 msgr2=0x563d883313b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.656+0000 7fa70a810800 1 --2- 172.21.15.134:0/901613332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563d88330f90 0x563d883313b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa700005fd0 tx=0x7fa70001ccc0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.656+0000 7fa70a810800 1 -- 172.21.15.134:0/901613332 shutdown_connections 2024-04-24T02:12:26.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.656+0000 7fa70a810800 1 --2- 172.21.15.134:0/901613332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563d88330f90 0x563d883313b0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.656+0000 7fa70a810800 1 -- 172.21.15.134:0/901613332 >> 172.21.15.134:0/901613332 conn(0x563d8832c530 msgr2=0x563d8832e950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:26.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.656+0000 7fa70a810800 1 -- 172.21.15.134:0/901613332 shutdown_connections 2024-04-24T02:12:26.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.656+0000 7fa70a810800 1 -- 172.21.15.134:0/901613332 wait complete. 2024-04-24T02:12:26.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.667+0000 7fa70a810800 1 Processor -- start 2024-04-24T02:12:26.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.667+0000 7fa70a810800 1 -- start start 2024-04-24T02:12:26.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.667+0000 7fa70a810800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563d88330f90 0x563d88422500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.667+0000 7fa70a810800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x563d8827c3c0 con 0x563d88330f90 2024-04-24T02:12:26.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.668+0000 7fa705dee640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563d88330f90 0x563d88422500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.668+0000 7fa705dee640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563d88330f90 0x563d88422500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56134/0 (socket says 172.21.15.134:56134) 2024-04-24T02:12:26.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.668+0000 7fa705dee640 1 -- 172.21.15.134:0/3624019380 learned_addr learned my addr 172.21.15.134:0/3624019380 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:26.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.668+0000 7fa705dee640 1 -- 172.21.15.134:0/3624019380 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d88422ad0 con 0x563d88330f90 2024-04-24T02:12:26.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.668+0000 7fa705dee640 1 --2- 172.21.15.134:0/3624019380 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563d88330f90 0x563d88422500 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa700054040 tx=0x7fa70004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e49c7a07a7b0d94d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.668+0000 7fa5f3e07640 1 -- 172.21.15.134:0/3624019380 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7000529e0 con 0x563d88330f90 2024-04-24T02:12:26.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.668+0000 7fa5f3e07640 1 -- 172.21.15.134:0/3624019380 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa700052b80 con 0x563d88330f90 2024-04-24T02:12:26.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.668+0000 7fa5f3e07640 1 -- 172.21.15.134:0/3624019380 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa70005c430 con 0x563d88330f90 2024-04-24T02:12:26.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.669+0000 7fa70a810800 1 -- 172.21.15.134:0/3624019380 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563d88330f90 msgr2=0x563d88422500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.669+0000 7fa70a810800 1 --2- 172.21.15.134:0/3624019380 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563d88330f90 0x563d88422500 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa700054040 tx=0x7fa70004c000 comp rx=0 tx=0).stop 2024-04-24T02:12:26.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.669+0000 7fa70a810800 1 -- 172.21.15.134:0/3624019380 shutdown_connections 2024-04-24T02:12:26.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.669+0000 7fa70a810800 1 --2- 172.21.15.134:0/3624019380 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563d88330f90 0x563d88422500 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.669+0000 7fa70a810800 1 -- 172.21.15.134:0/3624019380 >> 172.21.15.134:0/3624019380 conn(0x563d8832c530 msgr2=0x563d8841de20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:26.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.669+0000 7fa70a810800 1 -- 172.21.15.134:0/3624019380 shutdown_connections 2024-04-24T02:12:26.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.669+0000 7fa70a810800 1 -- 172.21.15.134:0/3624019380 wait complete. 2024-04-24T02:12:26.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.670+0000 7fa70a810800 1 Processor -- start 2024-04-24T02:12:26.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.670+0000 7fa70a810800 1 -- start start 2024-04-24T02:12:26.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.670+0000 7fa70a810800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563d88330f90 0x563d882a69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.670+0000 7fa70a810800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x563d8833a570 con 0x563d88330f90 2024-04-24T02:12:26.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.670+0000 7fa705dee640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563d88330f90 0x563d882a69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.670+0000 7fa705dee640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563d88330f90 0x563d882a69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56142/0 (socket says 172.21.15.134:56142) 2024-04-24T02:12:26.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.670+0000 7fa705dee640 1 -- 172.21.15.134:0/2748120554 learned_addr learned my addr 172.21.15.134:0/2748120554 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:26.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.670+0000 7fa705dee640 1 -- 172.21.15.134:0/2748120554 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d882a5090 con 0x563d88330f90 2024-04-24T02:12:26.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.670+0000 7fa705dee640 1 --2- 172.21.15.134:0/2748120554 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563d88330f90 0x563d882a69a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa700044920 tx=0x7fa700003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.670+0000 7fa5f2604640 1 -- 172.21.15.134:0/2748120554 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa70005cce0 con 0x563d88330f90 2024-04-24T02:12:26.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.670+0000 7fa5f2604640 1 -- 172.21.15.134:0/2748120554 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa700066410 con 0x563d88330f90 2024-04-24T02:12:26.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.671+0000 7fa5f2604640 1 -- 172.21.15.134:0/2748120554 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa700066730 con 0x563d88330f90 2024-04-24T02:12:26.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.671+0000 7fa70a810800 1 -- 172.21.15.134:0/2748120554 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563d882a5320 con 0x563d88330f90 2024-04-24T02:12:26.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.671+0000 7fa70a810800 1 -- 172.21.15.134:0/2748120554 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d882a5840 con 0x563d88330f90 2024-04-24T02:12:26.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.671+0000 7fa5f2604640 1 -- 172.21.15.134:0/2748120554 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa700078020 con 0x563d88330f90 2024-04-24T02:12:26.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.671+0000 7fa5f2604640 1 --2- 172.21.15.134:0/2748120554 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa5ec036900 0x7fa5ec038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.671+0000 7fa5f2604640 1 -- 172.21.15.134:0/2748120554 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fa70008e680 con 0x563d88330f90 2024-04-24T02:12:26.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.672+0000 7fa7055ed640 1 --2- 172.21.15.134:0/2748120554 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa5ec036900 0x7fa5ec038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.672+0000 7fa70a810800 1 --2- 172.21.15.134:0/2748120554 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x563d88332100 0x563d88433500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.672+0000 7fa70a810800 1 -- 172.21.15.134:0/2748120554 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d88433a40 con 0x563d88332100 2024-04-24T02:12:26.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.672+0000 7fa7065ef640 1 --2- 172.21.15.134:0/2748120554 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x563d88332100 0x563d88433500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.672+0000 7fa7055ed640 1 --2- 172.21.15.134:0/2748120554 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa5ec036900 0x7fa5ec038dc0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0000f60 tx=0x7fa6f00012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.672+0000 7fa7065ef640 1 --2- 172.21.15.134:0/2748120554 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x563d88332100 0x563d88433500 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.672+0000 7fa7065ef640 1 -- 172.21.15.134:0/2748120554 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa6f80083e0 con 0x563d88332100 2024-04-24T02:12:26.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.672+0000 7fa70a810800 1 -- 172.21.15.134:0/2748120554 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d884342c0 con 0x563d88332100 2024-04-24T02:12:26.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.673+0000 7fa7065ef640 1 -- 172.21.15.134:0/2748120554 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa6f80083e0 con 0x563d88332100 2024-04-24T02:12:26.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.673+0000 7fa70a810800 1 -- 172.21.15.134:0/2748120554 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d884356b0 con 0x563d88332100 2024-04-24T02:12:26.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.673+0000 7fa7065ef640 1 -- 172.21.15.134:0/2748120554 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa6f80083e0 con 0x563d88332100 2024-04-24T02:12:26.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.673+0000 7fa70a810800 1 -- 172.21.15.134:0/2748120554 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d88434b10 con 0x563d88332100 2024-04-24T02:12:26.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.673+0000 7fa7065ef640 1 -- 172.21.15.134:0/2748120554 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa6f80083e0 con 0x563d88332100 2024-04-24T02:12:26.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.673+0000 7fa70a810800 1 -- 172.21.15.134:0/2748120554 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d88434f60 con 0x563d88332100 2024-04-24T02:12:26.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.673+0000 7fa7065ef640 1 -- 172.21.15.134:0/2748120554 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa6f80083e0 con 0x563d88332100 2024-04-24T02:12:26.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.674+0000 7fa70a810800 1 Processor -- start 2024-04-24T02:12:26.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.674+0000 7fa70a810800 1 -- start start 2024-04-24T02:12:26.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.674+0000 7fa70a810800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563d88444780 0x563d88444ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.674+0000 7fa70a810800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x563d882a6ee0 con 0x563d88444780 2024-04-24T02:12:26.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.674+0000 7fa7055ed640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563d88444780 0x563d88444ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.674+0000 7fa7055ed640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563d88444780 0x563d88444ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56150/0 (socket says 172.21.15.134:56150) 2024-04-24T02:12:26.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.674+0000 7fa7055ed640 1 -- 172.21.15.134:0/3465054890 learned_addr learned my addr 172.21.15.134:0/3465054890 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:26.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.674+0000 7fa7055ed640 1 -- 172.21.15.134:0/3465054890 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d884450e0 con 0x563d88444780 2024-04-24T02:12:26.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.675+0000 7fa7055ed640 1 --2- 172.21.15.134:0/3465054890 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563d88444780 0x563d88444ba0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0001ed0 tx=0x7fa6f000d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.675+0000 7fa5eb7fe640 1 -- 172.21.15.134:0/3465054890 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6f001b550 con 0x563d88444780 2024-04-24T02:12:26.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.675+0000 7fa5eb7fe640 1 -- 172.21.15.134:0/3465054890 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6f001b6f0 con 0x563d88444780 2024-04-24T02:12:26.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.675+0000 7fa70a810800 1 -- 172.21.15.134:0/3465054890 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563d88445b50 con 0x563d88444780 2024-04-24T02:12:26.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.675+0000 7fa5eb7fe640 1 -- 172.21.15.134:0/3465054890 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6f001b9d0 con 0x563d88444780 2024-04-24T02:12:26.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.675+0000 7fa70a810800 1 -- 172.21.15.134:0/3465054890 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d88446050 con 0x563d88444780 2024-04-24T02:12:26.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.675+0000 7fa5eb7fe640 1 -- 172.21.15.134:0/3465054890 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa6f0023020 con 0x563d88444780 2024-04-24T02:12:26.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.676+0000 7fa5eb7fe640 1 --2- 172.21.15.134:0/3465054890 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa5e0036950 0x7fa5e0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.676+0000 7fa5eb7fe640 1 -- 172.21.15.134:0/3465054890 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fa6f0021020 con 0x563d88444780 2024-04-24T02:12:26.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.676+0000 7fa7065ef640 1 --2- 172.21.15.134:0/3465054890 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa5e0036950 0x7fa5e0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.676+0000 7fa70a810800 1 Processor -- start 2024-04-24T02:12:26.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.676+0000 7fa70a810800 1 -- start start 2024-04-24T02:12:26.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.676+0000 7fa7065ef640 1 --2- 172.21.15.134:0/3465054890 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa5e0036950 0x7fa5e0038e10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x563d882a5e90 tx=0x7fa6f8000f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.676+0000 7fa70a810800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563d88451b00 0x563d88451f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.676+0000 7fa70a810800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x563d882226b0 con 0x563d88451b00 2024-04-24T02:12:26.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.676+0000 7fa7055ed640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563d88451b00 0x563d88451f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.676+0000 7fa7055ed640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563d88451b00 0x563d88451f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56164/0 (socket says 172.21.15.134:56164) 2024-04-24T02:12:26.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.676+0000 7fa7055ed640 1 -- 172.21.15.134:0/2735894123 learned_addr learned my addr 172.21.15.134:0/2735894123 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:26.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.677+0000 7fa7055ed640 1 -- 172.21.15.134:0/2735894123 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d884524f0 con 0x563d88451b00 2024-04-24T02:12:26.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.677+0000 7fa7055ed640 1 --2- 172.21.15.134:0/2735894123 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563d88451b00 0x563d88451f20 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa6f004ce10 tx=0x7fa6f0019ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f91bdc4943dc084 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.677+0000 7fa5e97fa640 1 -- 172.21.15.134:0/2735894123 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6f0041070 con 0x563d88451b00 2024-04-24T02:12:26.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.677+0000 7fa5e97fa640 1 -- 172.21.15.134:0/2735894123 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6f00258e0 con 0x563d88451b00 2024-04-24T02:12:26.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.677+0000 7fa5e97fa640 1 -- 172.21.15.134:0/2735894123 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6f0025410 con 0x563d88451b00 2024-04-24T02:12:26.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.677+0000 7fa70a810800 1 -- 172.21.15.134:0/2735894123 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563d88451b00 msgr2=0x563d88451f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.677+0000 7fa70a810800 1 --2- 172.21.15.134:0/2735894123 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563d88451b00 0x563d88451f20 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa6f004ce10 tx=0x7fa6f0019ce0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.677+0000 7fa70a810800 1 -- 172.21.15.134:0/2735894123 shutdown_connections 2024-04-24T02:12:26.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.677+0000 7fa70a810800 1 --2- 172.21.15.134:0/2735894123 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563d88451b00 0x563d88451f20 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.677+0000 7fa70a810800 1 -- 172.21.15.134:0/2735894123 >> 172.21.15.134:0/2735894123 conn(0x563d8844de20 msgr2=0x563d8844be80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:26.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.677+0000 7fa70a810800 1 -- 172.21.15.134:0/2735894123 shutdown_connections 2024-04-24T02:12:26.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.677+0000 7fa70a810800 1 -- 172.21.15.134:0/2735894123 wait complete. 2024-04-24T02:12:26.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.678+0000 7fa70a810800 1 Processor -- start 2024-04-24T02:12:26.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.678+0000 7fa70a810800 1 -- start start 2024-04-24T02:12:26.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.678+0000 7fa70a810800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563d88451b00 0x563d88459000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.678+0000 7fa70a810800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x563d88452af0 con 0x563d88451b00 2024-04-24T02:12:26.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.678+0000 7fa7055ed640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563d88451b00 0x563d88459000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.678+0000 7fa7055ed640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563d88451b00 0x563d88459000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56166/0 (socket says 172.21.15.134:56166) 2024-04-24T02:12:26.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.678+0000 7fa7055ed640 1 -- 172.21.15.134:0/4271891134 learned_addr learned my addr 172.21.15.134:0/4271891134 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:26.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.678+0000 7fa7055ed640 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d88459540 con 0x563d88451b00 2024-04-24T02:12:26.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.678+0000 7fa7055ed640 1 --2- 172.21.15.134:0/4271891134 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563d88451b00 0x563d88459000 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0019d20 tx=0x7fa6f004cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.678+0000 7fa5d77fe640 1 -- 172.21.15.134:0/4271891134 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6f0041070 con 0x563d88451b00 2024-04-24T02:12:26.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.678+0000 7fa5d77fe640 1 -- 172.21.15.134:0/4271891134 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6f0024370 con 0x563d88451b00 2024-04-24T02:12:26.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.678+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563d884597d0 con 0x563d88451b00 2024-04-24T02:12:26.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.678+0000 7fa5d77fe640 1 -- 172.21.15.134:0/4271891134 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6f0024650 con 0x563d88451b00 2024-04-24T02:12:26.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.679+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d884597d0 con 0x563d88451b00 2024-04-24T02:12:26.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.679+0000 7fa5d77fe640 1 -- 172.21.15.134:0/4271891134 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa6f00247f0 con 0x563d88451b00 2024-04-24T02:12:26.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.679+0000 7fa5d77fe640 1 --2- 172.21.15.134:0/4271891134 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa5d0036950 0x7fa5d0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.679+0000 7fa5d77fe640 1 -- 172.21.15.134:0/4271891134 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fa6f000f070 con 0x563d88451b00 2024-04-24T02:12:26.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.679+0000 7fa7065ef640 1 --2- 172.21.15.134:0/4271891134 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa5d0036950 0x7fa5d0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.680+0000 7fa7065ef640 1 --2- 172.21.15.134:0/4271891134 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa5d0036950 0x7fa5d0038e10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa6f800f010 tx=0x7fa6f800c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.680+0000 7fa70a810800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.680+0000 7fa70a810800 1 --2- 172.21.15.134:0/4271891134 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x563d88464910 0x563d88466dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.680+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d88467520 con 0x563d88464910 2024-04-24T02:12:26.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.680+0000 7fa705dee640 1 --2- 172.21.15.134:0/4271891134 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x563d88464910 0x563d88466dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.680+0000 7fa705dee640 1 --2- 172.21.15.134:0/4271891134 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x563d88464910 0x563d88466dd0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.681+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa70007bb70 con 0x563d88464910 2024-04-24T02:12:26.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.681+0000 7fa70a810800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:26.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.681+0000 7fa70a810800 20 realm 2024-04-24T02:12:26.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.681+0000 7fa70a810800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.681+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d88467930 con 0x563d88464910 2024-04-24T02:12:26.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.681+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa70007bb70 con 0x563d88464910 2024-04-24T02:12:26.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.681+0000 7fa70a810800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:26.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.681+0000 7fa70a810800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:26.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.681+0000 7fa70a810800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.681+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d88468200 con 0x563d88464910 2024-04-24T02:12:26.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.681+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa70007bb70 con 0x563d88464910 2024-04-24T02:12:26.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.681+0000 7fa70a810800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:26.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.681+0000 7fa70a810800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.681+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d884685a0 con 0x563d88464910 2024-04-24T02:12:26.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.681+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa70007bb70 con 0x563d88464910 2024-04-24T02:12:26.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.681+0000 7fa70a810800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:26.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.681+0000 7fa70a810800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.681+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d88468df0 con 0x563d88464910 2024-04-24T02:12:26.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.681+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa70007bb70 con 0x563d88464910 2024-04-24T02:12:26.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.681+0000 7fa70a810800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:26.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.682+0000 7fa70a810800 20 searching for the correct realm 2024-04-24T02:12:26.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.682+0000 7fa70a810800 1 --2- 172.21.15.134:0/4271891134 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x563d8846ab60 0x563d8846cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.682+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d8846d530 con 0x563d8846ab60 2024-04-24T02:12:26.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.682+0000 7fa7055ed640 1 --2- 172.21.15.134:0/4271891134 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x563d8846ab60 0x563d8846cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.682+0000 7fa7055ed640 1 --2- 172.21.15.134:0/4271891134 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x563d8846ab60 0x563d8846cf50 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.682+0000 7fa7055ed640 1 -- 172.21.15.134:0/4271891134 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6f0009050 con 0x563d8846ab60 2024-04-24T02:12:26.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.682+0000 7fa7055ed640 1 --2- 172.21.15.134:0/4271891134 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fa6f0030bd0 0x7fa6f0015760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.682+0000 7fa7055ed640 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d8846d530 con 0x7fa6f0030bd0 2024-04-24T02:12:26.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.683+0000 7fa7065ef640 1 --2- 172.21.15.134:0/4271891134 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fa6f0030bd0 0x7fa6f0015760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.683+0000 7fa7065ef640 1 --2- 172.21.15.134:0/4271891134 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fa6f0030bd0 0x7fa6f0015760 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.683+0000 7fa7065ef640 1 -- 172.21.15.134:0/4271891134 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6f802f040 con 0x7fa6f0030bd0 2024-04-24T02:12:26.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.683+0000 7fa7065ef640 1 --2- 172.21.15.134:0/4271891134 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fa6f8019040 0x7fa6f8019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.683+0000 7fa7065ef640 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d8846d530 con 0x7fa6f8019040 2024-04-24T02:12:26.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.683+0000 7fa705dee640 1 --2- 172.21.15.134:0/4271891134 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fa6f8019040 0x7fa6f8019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.683+0000 7fa705dee640 1 --2- 172.21.15.134:0/4271891134 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fa6f8019040 0x7fa6f8019930 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.684+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa70007bb70 con 0x7fa6f8019040 2024-04-24T02:12:26.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.684+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d8846d530 con 0x563d88464910 2024-04-24T02:12:26.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.684+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa70007bb70 con 0x563d88464910 2024-04-24T02:12:26.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.684+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d8846d530 con 0x563d88464910 2024-04-24T02:12:26.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.684+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa70007bb70 con 0x563d88464910 2024-04-24T02:12:26.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.684+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d8846d530 con 0x7fa6f8019040 2024-04-24T02:12:26.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.684+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa70007bb70 con 0x7fa6f8019040 2024-04-24T02:12:26.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.684+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d8846d530 con 0x7fa6f8019040 2024-04-24T02:12:26.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.685+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa70007bb70 con 0x7fa6f8019040 2024-04-24T02:12:26.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.685+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d8846d530 con 0x7fa6f0030bd0 2024-04-24T02:12:26.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.685+0000 7fa7065ef640 1 -- 172.21.15.134:0/4271891134 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6f802f040 con 0x7fa6f0030bd0 2024-04-24T02:12:26.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.685+0000 7fa7065ef640 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d8846d530 con 0x563d8846ab60 2024-04-24T02:12:26.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.685+0000 7fa7055ed640 1 -- 172.21.15.134:0/4271891134 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6f0009050 con 0x563d8846ab60 2024-04-24T02:12:26.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.685+0000 7fa7055ed640 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d8846d530 con 0x563d88464910 2024-04-24T02:12:26.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.685+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa70007bb70 con 0x563d88464910 2024-04-24T02:12:26.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.685+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d8846d530 con 0x7fa6f8019040 2024-04-24T02:12:26.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.686+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa70007bb70 con 0x7fa6f8019040 2024-04-24T02:12:26.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.686+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d8846d530 con 0x563d88464910 2024-04-24T02:12:26.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.686+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa70007bb70 con 0x563d88464910 2024-04-24T02:12:26.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.686+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d8846d530 con 0x7fa6f0030bd0 2024-04-24T02:12:26.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.686+0000 7fa7065ef640 1 -- 172.21.15.134:0/4271891134 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa6f802f040 con 0x7fa6f0030bd0 2024-04-24T02:12:26.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.686+0000 7fa7065ef640 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d8846d530 con 0x563d8846ab60 2024-04-24T02:12:26.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.686+0000 7fa7055ed640 1 -- 172.21.15.134:0/4271891134 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6f0009050 con 0x563d8846ab60 2024-04-24T02:12:26.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.686+0000 7fa7055ed640 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d8846d530 con 0x563d8846ab60 2024-04-24T02:12:26.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.687+0000 7fa7055ed640 1 -- 172.21.15.134:0/4271891134 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6f0009050 con 0x563d8846ab60 2024-04-24T02:12:26.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.687+0000 7fa7055ed640 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d8846d530 con 0x7fa6f8019040 2024-04-24T02:12:26.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.687+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa70007bb70 con 0x7fa6f8019040 2024-04-24T02:12:26.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.687+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d8846d530 con 0x563d8846ab60 2024-04-24T02:12:26.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.687+0000 7fa7055ed640 1 -- 172.21.15.134:0/4271891134 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6f0009050 con 0x563d8846ab60 2024-04-24T02:12:26.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.687+0000 7fa7055ed640 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d8846d530 con 0x563d8846ab60 2024-04-24T02:12:26.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.688+0000 7fa7055ed640 1 -- 172.21.15.134:0/4271891134 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6f0009050 con 0x563d8846ab60 2024-04-24T02:12:26.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.688+0000 7fa7055ed640 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d8846d530 con 0x563d88464910 2024-04-24T02:12:26.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.688+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa70007bb70 con 0x563d88464910 2024-04-24T02:12:26.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.688+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d8846d530 con 0x563d88464910 2024-04-24T02:12:26.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.688+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fa70007bb70 con 0x563d88464910 2024-04-24T02:12:26.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.688+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d8846d530 con 0x7fa6f8019040 2024-04-24T02:12:26.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.688+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa70007bb70 con 0x7fa6f8019040 2024-04-24T02:12:26.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.688+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d8846d530 con 0x563d8846ab60 2024-04-24T02:12:26.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.689+0000 7fa7055ed640 1 -- 172.21.15.134:0/4271891134 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6f0009050 con 0x563d8846ab60 2024-04-24T02:12:26.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.689+0000 7fa7055ed640 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d8846d530 con 0x7fa6f0030bd0 2024-04-24T02:12:26.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.689+0000 7fa7065ef640 1 -- 172.21.15.134:0/4271891134 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6f802f040 con 0x7fa6f0030bd0 2024-04-24T02:12:26.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.689+0000 7fa7065ef640 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d8846d530 con 0x563d88464910 2024-04-24T02:12:26.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.689+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa70007bb70 con 0x563d88464910 2024-04-24T02:12:26.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.689+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d8846d530 con 0x7fa6f8019040 2024-04-24T02:12:26.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.689+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa70007bb70 con 0x7fa6f8019040 2024-04-24T02:12:26.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.689+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d8846d530 con 0x563d8846ab60 2024-04-24T02:12:26.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.690+0000 7fa7055ed640 1 -- 172.21.15.134:0/4271891134 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6f0009050 con 0x563d8846ab60 2024-04-24T02:12:26.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.690+0000 7fa7055ed640 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d8846d530 con 0x7fa6f8019040 2024-04-24T02:12:26.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.690+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa70007bb70 con 0x7fa6f8019040 2024-04-24T02:12:26.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.690+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d8846d530 con 0x7fa6f0030bd0 2024-04-24T02:12:26.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.690+0000 7fa7065ef640 1 -- 172.21.15.134:0/4271891134 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6f802f040 con 0x7fa6f0030bd0 2024-04-24T02:12:26.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.690+0000 7fa7065ef640 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d8846d530 con 0x563d8846ab60 2024-04-24T02:12:26.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.690+0000 7fa7055ed640 1 -- 172.21.15.134:0/4271891134 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6f0009050 con 0x563d8846ab60 2024-04-24T02:12:26.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.690+0000 7fa7055ed640 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d8846d530 con 0x7fa6f8019040 2024-04-24T02:12:26.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.691+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa70007bb70 con 0x7fa6f8019040 2024-04-24T02:12:26.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.691+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d8846d530 con 0x563d88464910 2024-04-24T02:12:26.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.691+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa70007bb70 con 0x563d88464910 2024-04-24T02:12:26.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.691+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d8846d530 con 0x7fa6f0030bd0 2024-04-24T02:12:26.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.691+0000 7fa7065ef640 1 -- 172.21.15.134:0/4271891134 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6f802f040 con 0x7fa6f0030bd0 2024-04-24T02:12:26.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.691+0000 7fa70a810800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:26.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.691+0000 7fa70a810800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:26.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.691+0000 7fa70a810800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:26.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.691+0000 7fa70a810800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:26.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.691+0000 7fa70a810800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:26.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.691+0000 7fa70a810800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:26.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.691+0000 7fa70a810800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.692+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d88469740 con 0x563d88464910 2024-04-24T02:12:26.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.692+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa70007bb70 con 0x563d88464910 2024-04-24T02:12:26.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.692+0000 7fa70a810800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:26.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.692+0000 7fa70a810800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.692+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d88469fe0 con 0x563d88464910 2024-04-24T02:12:26.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.692+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa70007bb70 con 0x563d88464910 2024-04-24T02:12:26.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.692+0000 7fa70a810800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:26.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.692+0000 7fa70a810800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.692+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d8846d9b0 con 0x563d88464910 2024-04-24T02:12:26.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.692+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa70007bb70 con 0x563d88464910 2024-04-24T02:12:26.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.692+0000 7fa70a810800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:26.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.692+0000 7fa70a810800 20 zone default found 2024-04-24T02:12:26.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.692+0000 7fa70a810800 4 Realm: () 2024-04-24T02:12:26.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.692+0000 7fa70a810800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:26.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.692+0000 7fa70a810800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:26.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.692+0000 7fa70a810800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:26.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.692+0000 7fa70a810800 20 zonegroup default 2024-04-24T02:12:26.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.692+0000 7fa70a810800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.692+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d88469c20 con 0x7fa6f8019040 2024-04-24T02:12:26.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.693+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa70007bb70 con 0x7fa6f8019040 2024-04-24T02:12:26.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.693+0000 7fa70a810800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:26.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.693+0000 7fa70a810800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.693+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d8846f8c0 con 0x563d8846ab60 2024-04-24T02:12:26.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.693+0000 7fa7055ed640 1 -- 172.21.15.134:0/4271891134 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa6f0009050 con 0x563d8846ab60 2024-04-24T02:12:26.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.693+0000 7fa70a810800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:26.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.693+0000 7fa70a810800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.693+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d8846fc60 con 0x563d8846ab60 2024-04-24T02:12:26.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.693+0000 7fa7055ed640 1 -- 172.21.15.134:0/4271891134 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa6f0009050 con 0x563d8846ab60 2024-04-24T02:12:26.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.693+0000 7fa70a810800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:26.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.693+0000 7fa70a810800 20 started sync module instance, tier type = 2024-04-24T02:12:26.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.693+0000 7fa70a810800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:26.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.693+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d8846ed60 con 0x7fa6f0030bd0 2024-04-24T02:12:26.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.694+0000 7fa7065ef640 1 -- 172.21.15.134:0/4271891134 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6f802f040 con 0x7fa6f0030bd0 2024-04-24T02:12:26.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.694+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94822279344736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d8846ed60 con 0x7fa6f0030bd0 2024-04-24T02:12:26.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.694+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d88470750 con 0x563d88464910 2024-04-24T02:12:26.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.695+0000 7fa7065ef640 1 -- 172.21.15.134:0/4271891134 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94822279344736] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6f802f040 con 0x7fa6f0030bd0 2024-04-24T02:12:26.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.696+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa70007bb70 con 0x563d88464910 2024-04-24T02:12:26.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.696+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94822279348800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d8846ed60 con 0x563d88464910 2024-04-24T02:12:26.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.696+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d88471200 con 0x563d8846ab60 2024-04-24T02:12:26.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.697+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94822279348800] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa70007bb70 con 0x563d88464910 2024-04-24T02:12:26.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.697+0000 7fa7055ed640 1 -- 172.21.15.134:0/4271891134 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6f0009050 con 0x563d8846ab60 2024-04-24T02:12:26.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.697+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94822279342256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d8846ecd0 con 0x563d8846ab60 2024-04-24T02:12:26.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.697+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d884720c0 con 0x7fa6f0030bd0 2024-04-24T02:12:26.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.698+0000 7fa7055ed640 1 -- 172.21.15.134:0/4271891134 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94822279342256] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6f0009050 con 0x563d8846ab60 2024-04-24T02:12:26.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.698+0000 7fa7065ef640 1 -- 172.21.15.134:0/4271891134 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6f802f040 con 0x7fa6f0030bd0 2024-04-24T02:12:26.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.698+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94822279355408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d884724e0 con 0x7fa6f0030bd0 2024-04-24T02:12:26.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.698+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d88472ea0 con 0x563d88464910 2024-04-24T02:12:26.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.699+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa70007bb70 con 0x563d88464910 2024-04-24T02:12:26.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.699+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94822279358960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d88472e10 con 0x563d88464910 2024-04-24T02:12:26.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.699+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d88473e50 con 0x7fa6f8019040 2024-04-24T02:12:26.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.699+0000 7fa7065ef640 1 -- 172.21.15.134:0/4271891134 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94822279355408] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6f802f040 con 0x7fa6f0030bd0 2024-04-24T02:12:26.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.700+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94822279358960] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa70007bb70 con 0x563d88464910 2024-04-24T02:12:26.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.700+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa70007bb70 con 0x7fa6f8019040 2024-04-24T02:12:26.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.700+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94822279356464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d88473e50 con 0x7fa6f8019040 2024-04-24T02:12:26.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.700+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d884746f0 con 0x7fa6f8019040 2024-04-24T02:12:26.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.701+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94822279356464] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa70007bb70 con 0x7fa6f8019040 2024-04-24T02:12:26.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.701+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(56 notify.6 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa70007bb70 con 0x7fa6f8019040 2024-04-24T02:12:26.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.701+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94822279362864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d884733b0 con 0x7fa6f8019040 2024-04-24T02:12:26.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.701+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d88474d10 con 0x7fa6f8019040 2024-04-24T02:12:26.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.702+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(58 notify.7 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa70007bb70 con 0x7fa6f8019040 2024-04-24T02:12:26.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.702+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94822279366752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d88475130 con 0x7fa6f8019040 2024-04-24T02:12:26.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.702+0000 7fa70a810800 20 add_watcher() i=0 2024-04-24T02:12:26.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.702+0000 7fa70a810800 20 add_watcher() i=1 2024-04-24T02:12:26.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.702+0000 7fa70a810800 20 add_watcher() i=2 2024-04-24T02:12:26.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.702+0000 7fa70a810800 20 add_watcher() i=3 2024-04-24T02:12:26.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.702+0000 7fa70a810800 20 add_watcher() i=4 2024-04-24T02:12:26.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.702+0000 7fa70a810800 20 add_watcher() i=5 2024-04-24T02:12:26.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.702+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94822279362864] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa70007bb70 con 0x7fa6f8019040 2024-04-24T02:12:26.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.702+0000 7fa70a810800 20 add_watcher() i=6 2024-04-24T02:12:26.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.703+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94822279366752] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa70007bb70 con 0x7fa6f8019040 2024-04-24T02:12:26.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.703+0000 7fa70a810800 20 add_watcher() i=7 2024-04-24T02:12:26.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.703+0000 7fa70a810800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:26.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.703+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d88474240 con 0x563d88464910 2024-04-24T02:12:26.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.703+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa70007bb70 con 0x563d88464910 2024-04-24T02:12:26.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.703+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94822279367808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d88474240 con 0x563d88464910 2024-04-24T02:12:26.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.704+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94822279367808] v30'119 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa70007bb70 con 0x563d88464910 2024-04-24T02:12:26.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.704+0000 7fa5b77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:26.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.705+0000 7fa70a810800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:26.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.705+0000 7fa70a810800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:26.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.705+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d88480a80 con 0x563d88464910 2024-04-24T02:12:26.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.706+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'44 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa70007bb70 con 0x563d88464910 2024-04-24T02:12:26.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.706+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d884810d0 con 0x7fa6f8019040 2024-04-24T02:12:26.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.707+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa70007bb70 con 0x7fa6f8019040 2024-04-24T02:12:26.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.707+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d884810d0 con 0x563d8846ab60 2024-04-24T02:12:26.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.708+0000 7fa7055ed640 1 -- 172.21.15.134:0/4271891134 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa6f0009050 con 0x563d8846ab60 2024-04-24T02:12:26.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.708+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d88481510 con 0x563d88464910 2024-04-24T02:12:26.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.709+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'120 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa70007bb70 con 0x563d88464910 2024-04-24T02:12:26.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.709+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d884814b0 con 0x7fa6f0030bd0 2024-04-24T02:12:26.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.710+0000 7fa7065ef640 1 -- 172.21.15.134:0/4271891134 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'38 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa6f802f040 con 0x7fa6f0030bd0 2024-04-24T02:12:26.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.710+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d88481aa0 con 0x563d8846ab60 2024-04-24T02:12:26.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.711+0000 7fa7055ed640 1 -- 172.21.15.134:0/4271891134 <== osd.3 v2:172.21.15.134:6801/3585115521 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'35 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa6f0009050 con 0x563d8846ab60 2024-04-24T02:12:26.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.711+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d884822f0 con 0x563d88464910 2024-04-24T02:12:26.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.712+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa70007bb70 con 0x563d88464910 2024-04-24T02:12:26.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.712+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d884822f0 con 0x7fa6f8019040 2024-04-24T02:12:26.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.713+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'28 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa70007bb70 con 0x7fa6f8019040 2024-04-24T02:12:26.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.713+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d884822f0 con 0x7fa6f0030bd0 2024-04-24T02:12:26.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.714+0000 7fa7065ef640 1 -- 172.21.15.134:0/4271891134 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa6f802f040 con 0x7fa6f0030bd0 2024-04-24T02:12:26.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.714+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d8847e880 con 0x563d8846ab60 2024-04-24T02:12:26.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.715+0000 7fa7055ed640 1 -- 172.21.15.134:0/4271891134 <== osd.3 v2:172.21.15.134:6801/3585115521 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa6f0009050 con 0x563d8846ab60 2024-04-24T02:12:26.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.715+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d8847e880 con 0x7fa6f0030bd0 2024-04-24T02:12:26.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.716+0000 7fa7065ef640 1 -- 172.21.15.134:0/4271891134 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'39 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa6f802f040 con 0x7fa6f0030bd0 2024-04-24T02:12:26.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.716+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d8847e880 con 0x7fa6f8019040 2024-04-24T02:12:26.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.718+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa70007bb70 con 0x7fa6f8019040 2024-04-24T02:12:26.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.718+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d8847e880 con 0x7fa6f0030bd0 2024-04-24T02:12:26.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.719+0000 7fa7065ef640 1 -- 172.21.15.134:0/4271891134 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'20 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa6f802f040 con 0x7fa6f0030bd0 2024-04-24T02:12:26.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.719+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d88482e50 con 0x7fa6f8019040 2024-04-24T02:12:26.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.720+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.0 v2:172.21.15.104:6800/2419146313 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'39 uv16 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa70007bb70 con 0x7fa6f8019040 2024-04-24T02:12:26.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.720+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d88482e50 con 0x563d88464910 2024-04-24T02:12:26.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.721+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'121 uv16 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa70007bb70 con 0x563d88464910 2024-04-24T02:12:26.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.721+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d88482e50 con 0x563d8846ab60 2024-04-24T02:12:26.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.722+0000 7fa7055ed640 1 -- 172.21.15.134:0/4271891134 <== osd.3 v2:172.21.15.134:6801/3585115521 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'32 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa6f0009050 con 0x563d8846ab60 2024-04-24T02:12:26.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.722+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d88482e50 con 0x7fa6f0030bd0 2024-04-24T02:12:26.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.723+0000 7fa7065ef640 1 -- 172.21.15.134:0/4271891134 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'40 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa6f802f040 con 0x7fa6f0030bd0 2024-04-24T02:12:26.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.723+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d88482e50 con 0x563d8846ab60 2024-04-24T02:12:26.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.724+0000 7fa7055ed640 1 -- 172.21.15.134:0/4271891134 <== osd.3 v2:172.21.15.134:6801/3585115521 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'26 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa6f0009050 con 0x563d8846ab60 2024-04-24T02:12:26.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.724+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d88482e50 con 0x563d88464910 2024-04-24T02:12:26.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.725+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa70007bb70 con 0x563d88464910 2024-04-24T02:12:26.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.725+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d88482e50 con 0x563d88464910 2024-04-24T02:12:26.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.726+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'122 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa70007bb70 con 0x563d88464910 2024-04-24T02:12:26.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.726+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d88482e50 con 0x563d8846ab60 2024-04-24T02:12:26.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.727+0000 7fa7055ed640 1 -- 172.21.15.134:0/4271891134 <== osd.3 v2:172.21.15.134:6801/3585115521 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'33 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa6f0009050 con 0x563d8846ab60 2024-04-24T02:12:26.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.727+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d88482e50 con 0x7fa6f0030bd0 2024-04-24T02:12:26.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.728+0000 7fa7065ef640 1 -- 172.21.15.134:0/4271891134 <== osd.2 v2:172.21.15.134:6800/214480313 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'30 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa6f802f040 con 0x7fa6f0030bd0 2024-04-24T02:12:26.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.728+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d88482e50 con 0x563d8846ab60 2024-04-24T02:12:26.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.729+0000 7fa7055ed640 1 -- 172.21.15.134:0/4271891134 <== osd.3 v2:172.21.15.134:6801/3585115521 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa6f0009050 con 0x563d8846ab60 2024-04-24T02:12:26.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.729+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d88482e50 con 0x563d8846ab60 2024-04-24T02:12:26.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.730+0000 7fa7055ed640 1 -- 172.21.15.134:0/4271891134 <== osd.3 v2:172.21.15.134:6801/3585115521 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'32 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa6f0009050 con 0x563d8846ab60 2024-04-24T02:12:26.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.730+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d88482e50 con 0x563d8846ab60 2024-04-24T02:12:26.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.731+0000 7fa7055ed640 1 -- 172.21.15.134:0/4271891134 <== osd.3 v2:172.21.15.134:6801/3585115521 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa6f0009050 con 0x563d8846ab60 2024-04-24T02:12:26.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.731+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d88482e50 con 0x563d8846ab60 2024-04-24T02:12:26.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.732+0000 7fa7055ed640 1 -- 172.21.15.134:0/4271891134 <== osd.3 v2:172.21.15.134:6801/3585115521 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'36 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa6f0009050 con 0x563d8846ab60 2024-04-24T02:12:26.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.732+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d88482e50 con 0x7fa6f8019040 2024-04-24T02:12:26.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.733+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.0 v2:172.21.15.104:6800/2419146313 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'22 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa70007bb70 con 0x7fa6f8019040 2024-04-24T02:12:26.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.733+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d88482e50 con 0x563d8846ab60 2024-04-24T02:12:26.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.734+0000 7fa7055ed640 1 -- 172.21.15.134:0/4271891134 <== osd.3 v2:172.21.15.134:6801/3585115521 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'26 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa6f0009050 con 0x563d8846ab60 2024-04-24T02:12:26.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.734+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d88482e50 con 0x7fa6f8019040 2024-04-24T02:12:26.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.735+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.0 v2:172.21.15.104:6800/2419146313 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'29 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa70007bb70 con 0x7fa6f8019040 2024-04-24T02:12:26.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.735+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d88482e50 con 0x563d8846ab60 2024-04-24T02:12:26.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.736+0000 7fa7055ed640 1 -- 172.21.15.134:0/4271891134 <== osd.3 v2:172.21.15.134:6801/3585115521 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'34 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa6f0009050 con 0x563d8846ab60 2024-04-24T02:12:26.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.736+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d88482e50 con 0x7fa6f8019040 2024-04-24T02:12:26.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.737+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.0 v2:172.21.15.104:6800/2419146313 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'40 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa70007bb70 con 0x7fa6f8019040 2024-04-24T02:12:26.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.737+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d88482e50 con 0x7fa6f0030bd0 2024-04-24T02:12:26.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.738+0000 7fa7065ef640 1 -- 172.21.15.134:0/4271891134 <== osd.2 v2:172.21.15.134:6800/214480313 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa6f802f040 con 0x7fa6f0030bd0 2024-04-24T02:12:26.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.738+0000 7fa5b67fc640 20 reqs_thread_entry: start 2024-04-24T02:12:26.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.738+0000 7fa70a810800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:26.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.738+0000 7fa70a810800 20 Filter name: none 2024-04-24T02:12:26.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.739+0000 7fa527fff640 20 reqs_thread_entry: start 2024-04-24T02:12:26.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.739+0000 7fa70a810800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-24T02:12:26.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.739+0000 7fa70a810800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.739+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d884adb80 con 0x7fa6f8019040 2024-04-24T02:12:26.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.739+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.0 v2:172.21.15.104:6800/2419146313 24 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fa70007bb70 con 0x7fa6f8019040 2024-04-24T02:12:26.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.739+0000 7fa70a810800 20 rados_obj.operate() r=0 bl.length=380 2024-04-24T02:12:26.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.739+0000 7fa70a810800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-04-24T02:12:26.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.739+0000 7fa70a810800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-24T02:12:26.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.739+0000 7fa70a810800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:12:26.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.739+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d884b0610 con 0x7fa6f8019040 2024-04-24T02:12:26.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.739+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.0 v2:172.21.15.104:6800/2419146313 25 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv1 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fa70007bb70 con 0x7fa6f8019040 2024-04-24T02:12:26.743 INFO:teuthology.orchestra.run.smithi134.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-04-24T02:12:26.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.740+0000 7fa5b77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:26.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.740+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94822279367808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d8847ffd0 con 0x563d88464910 2024-04-24T02:12:26.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.741+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94822279367808] v30'123 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa70007bb70 con 0x563d88464910 2024-04-24T02:12:26.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.741+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94822279344736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d8847ffd0 con 0x7fa6f0030bd0 2024-04-24T02:12:26.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.742+0000 7fa7065ef640 1 -- 172.21.15.134:0/4271891134 <== osd.2 v2:172.21.15.134:6800/214480313 18 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94822279344736] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6f802f040 con 0x7fa6f0030bd0 2024-04-24T02:12:26.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.742+0000 7fa70a810800 20 remove_watcher() i=0 2024-04-24T02:12:26.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.742+0000 7fa70a810800 2 removed watcher, disabling cache 2024-04-24T02:12:26.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.742+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94822279348800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d8846f260 con 0x563d88464910 2024-04-24T02:12:26.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.744+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.1 v2:172.21.15.134:6804/1487076214 30 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94822279348800] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa70007bb70 con 0x563d88464910 2024-04-24T02:12:26.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.744+0000 7fa70a810800 20 remove_watcher() i=1 2024-04-24T02:12:26.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.744+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94822279342256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d8847ffd0 con 0x563d8846ab60 2024-04-24T02:12:26.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.745+0000 7fa7055ed640 1 -- 172.21.15.134:0/4271891134 <== osd.3 v2:172.21.15.134:6801/3585115521 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94822279342256] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6f0009050 con 0x563d8846ab60 2024-04-24T02:12:26.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.745+0000 7fa70a810800 20 remove_watcher() i=2 2024-04-24T02:12:26.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.745+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94822279355408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d88470240 con 0x7fa6f0030bd0 2024-04-24T02:12:26.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.745+0000 7fa7065ef640 1 -- 172.21.15.134:0/4271891134 <== osd.2 v2:172.21.15.134:6800/214480313 19 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94822279355408] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6f802f040 con 0x7fa6f0030bd0 2024-04-24T02:12:26.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.745+0000 7fa70a810800 20 remove_watcher() i=3 2024-04-24T02:12:26.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.746+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94822279358960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d8846f260 con 0x563d88464910 2024-04-24T02:12:26.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.746+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.1 v2:172.21.15.134:6804/1487076214 31 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94822279358960] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa70007bb70 con 0x563d88464910 2024-04-24T02:12:26.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.746+0000 7fa70a810800 20 remove_watcher() i=4 2024-04-24T02:12:26.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.746+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94822279356464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d8846e8b0 con 0x7fa6f8019040 2024-04-24T02:12:26.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.747+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.0 v2:172.21.15.104:6800/2419146313 26 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94822279356464] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa70007bb70 con 0x7fa6f8019040 2024-04-24T02:12:26.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.747+0000 7fa70a810800 20 remove_watcher() i=5 2024-04-24T02:12:26.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.747+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94822279362864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d8847ffd0 con 0x7fa6f8019040 2024-04-24T02:12:26.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.748+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.0 v2:172.21.15.104:6800/2419146313 27 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94822279362864] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa70007bb70 con 0x7fa6f8019040 2024-04-24T02:12:26.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.748+0000 7fa70a810800 20 remove_watcher() i=6 2024-04-24T02:12:26.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.748+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94822279366752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d88470240 con 0x7fa6f8019040 2024-04-24T02:12:26.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.749+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 <== osd.0 v2:172.21.15.104:6800/2419146313 28 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94822279366752] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa70007bb70 con 0x7fa6f8019040 2024-04-24T02:12:26.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.749+0000 7fa70a810800 20 remove_watcher() i=7 2024-04-24T02:12:26.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.749+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fa6f8019040 msgr2=0x7fa6f8019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.749+0000 7fa70a810800 1 --2- 172.21.15.134:0/4271891134 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fa6f8019040 0x7fa6f8019930 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.749+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x563d88464910 msgr2=0x563d88466dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.749+0000 7fa70a810800 1 --2- 172.21.15.134:0/4271891134 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x563d88464910 0x563d88466dd0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.749+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fa6f0030bd0 msgr2=0x7fa6f0015760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.749+0000 7fa70a810800 1 --2- 172.21.15.134:0/4271891134 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fa6f0030bd0 0x7fa6f0015760 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.749+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x563d8846ab60 msgr2=0x563d8846cf50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.749+0000 7fa70a810800 1 --2- 172.21.15.134:0/4271891134 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x563d8846ab60 0x563d8846cf50 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.750+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa5d0036950 msgr2=0x7fa5d0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.750+0000 7fa70a810800 1 --2- 172.21.15.134:0/4271891134 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa5d0036950 0x7fa5d0038e10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa6f800f010 tx=0x7fa6f800c040 comp rx=0 tx=0).stop 2024-04-24T02:12:26.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.750+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563d88451b00 msgr2=0x563d88459000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.750+0000 7fa705dee640 1 -- 172.21.15.134:0/4271891134 reap_dead start 2024-04-24T02:12:26.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.750+0000 7fa70a810800 1 --2- 172.21.15.134:0/4271891134 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563d88451b00 0x563d88459000 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0019d20 tx=0x7fa6f004cda0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.750+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 shutdown_connections 2024-04-24T02:12:26.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.750+0000 7fa70a810800 1 --2- 172.21.15.134:0/4271891134 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563d88451b00 0x563d88459000 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.750+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 >> 172.21.15.134:0/4271891134 conn(0x563d8844de20 msgr2=0x563d8844b480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:26.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.750+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 shutdown_connections 2024-04-24T02:12:26.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.750+0000 7fa70a810800 1 -- 172.21.15.134:0/4271891134 wait complete. 2024-04-24T02:12:26.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.750+0000 7fa70a810800 1 -- 172.21.15.134:0/3465054890 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa5e0036950 msgr2=0x7fa5e0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.750+0000 7fa70a810800 1 --2- 172.21.15.134:0/3465054890 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa5e0036950 0x7fa5e0038e10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x563d882a5e90 tx=0x7fa6f8000f90 comp rx=0 tx=0).stop 2024-04-24T02:12:26.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.750+0000 7fa70a810800 1 -- 172.21.15.134:0/3465054890 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563d88444780 msgr2=0x563d88444ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.750+0000 7fa70a810800 1 --2- 172.21.15.134:0/3465054890 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563d88444780 0x563d88444ba0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0001ed0 tx=0x7fa6f000d7a0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.750+0000 7fa70a810800 1 -- 172.21.15.134:0/3465054890 shutdown_connections 2024-04-24T02:12:26.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.750+0000 7fa70a810800 1 --2- 172.21.15.134:0/3465054890 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa5e0036950 0x7fa5e0038e10 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.750+0000 7fa70a810800 1 --2- 172.21.15.134:0/3465054890 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563d88444780 0x563d88444ba0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.750+0000 7fa70a810800 1 -- 172.21.15.134:0/3465054890 >> 172.21.15.134:0/3465054890 conn(0x563d88438820 msgr2=0x563d88438c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:26.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.750+0000 7fa70a810800 1 -- 172.21.15.134:0/3465054890 shutdown_connections 2024-04-24T02:12:26.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.750+0000 7fa70a810800 1 -- 172.21.15.134:0/3465054890 wait complete. 2024-04-24T02:12:26.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.750+0000 7fa70a810800 1 -- 172.21.15.134:0/2748120554 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x563d88332100 msgr2=0x563d88433500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.751+0000 7fa70a810800 1 --2- 172.21.15.134:0/2748120554 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x563d88332100 0x563d88433500 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.751+0000 7fa70a810800 1 -- 172.21.15.134:0/2748120554 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa5ec036900 msgr2=0x7fa5ec038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.751+0000 7fa70a810800 1 --2- 172.21.15.134:0/2748120554 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa5ec036900 0x7fa5ec038dc0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0000f60 tx=0x7fa6f00012b0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.751+0000 7fa70a810800 1 -- 172.21.15.134:0/2748120554 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563d88330f90 msgr2=0x563d882a69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.751+0000 7fa70a810800 1 --2- 172.21.15.134:0/2748120554 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563d88330f90 0x563d882a69a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa700044920 tx=0x7fa700003330 comp rx=0 tx=0).stop 2024-04-24T02:12:26.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.751+0000 7fa70a810800 1 -- 172.21.15.134:0/2748120554 shutdown_connections 2024-04-24T02:12:26.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.751+0000 7fa70a810800 1 --2- 172.21.15.134:0/2748120554 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x563d88332100 0x563d88433500 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.751+0000 7fa70a810800 1 --2- 172.21.15.134:0/2748120554 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa5ec036900 0x7fa5ec038dc0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.751+0000 7fa70a810800 1 --2- 172.21.15.134:0/2748120554 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563d88330f90 0x563d882a69a0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.751+0000 7fa70a810800 1 -- 172.21.15.134:0/2748120554 >> 172.21.15.134:0/2748120554 conn(0x563d8832c530 msgr2=0x563d8841c620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:26.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.751+0000 7fa70a810800 1 -- 172.21.15.134:0/2748120554 shutdown_connections 2024-04-24T02:12:26.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.751+0000 7fa70a810800 1 -- 172.21.15.134:0/2748120554 wait complete. 2024-04-24T02:12:26.762 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-04-24T02:12:26.762 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-04-24T02:12:26.763 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-04-24T02:12:26.763 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-04-24T02:12:26.848 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:26.848 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:26.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.847+0000 7f1e1c438800 1 Processor -- start 2024-04-24T02:12:26.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.847+0000 7f1e1c438800 1 -- start start 2024-04-24T02:12:26.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.848+0000 7f1e1c438800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x56474305a320 0x564743062e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.848+0000 7f1e1c438800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564742f18d40 con 0x5647430587e0 2024-04-24T02:12:26.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.848+0000 7f1e1c438800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x564742eeb4d0 con 0x56474305a320 2024-04-24T02:12:26.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.848+0000 7f1e13fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x56474305a320 0x564743062e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.848+0000 7f1e13fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x56474305a320 0x564743062e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56174/0 (socket says 172.21.15.134:56174) 2024-04-24T02:12:26.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.848+0000 7f1e13fff640 1 -- 172.21.15.134:0/217979697 learned_addr learned my addr 172.21.15.134:0/217979697 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:26.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.848+0000 7f1e19f37640 1 --1- 172.21.15.134:0/217979697 >> v1:172.21.15.104:6789/0 conn(0x5647430587e0 0x564743058c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:55282/0 (socket says 172.21.15.134:55282) 2024-04-24T02:12:26.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.848+0000 7f1e13fff640 1 -- 172.21.15.134:0/217979697 >> v1:172.21.15.104:6789/0 conn(0x5647430587e0 legacy=0x564743058c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.848+0000 7f1e13fff640 1 -- 172.21.15.134:0/217979697 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564742f17590 con 0x56474305a320 2024-04-24T02:12:26.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.848+0000 7f1e19736640 1 -- 172.21.15.134:0/217979697 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2862947177 0 0) 0x564742f18d40 con 0x5647430587e0 2024-04-24T02:12:26.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.850+0000 7f1e13fff640 1 --2- 172.21.15.134:0/217979697 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56474305a320 0x564743062e20 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f1e0400a520 tx=0x7f1e0401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9b24c7beab05b83 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.850+0000 7f1e19736640 1 -- 172.21.15.134:0/217979697 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e04057070 con 0x56474305a320 2024-04-24T02:12:26.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.850+0000 7f1e19736640 1 -- 172.21.15.134:0/217979697 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e04052570 con 0x56474305a320 2024-04-24T02:12:26.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.850+0000 7f1e19736640 1 -- 172.21.15.134:0/217979697 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e0404ae60 con 0x56474305a320 2024-04-24T02:12:26.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.850+0000 7f1e1c438800 1 -- 172.21.15.134:0/217979697 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56474305a320 msgr2=0x564743062e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.850+0000 7f1e1c438800 1 --2- 172.21.15.134:0/217979697 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56474305a320 0x564743062e20 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f1e0400a520 tx=0x7f1e0401d010 comp rx=0 tx=0).stop 2024-04-24T02:12:26.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.851+0000 7f1e1c438800 1 -- 172.21.15.134:0/217979697 shutdown_connections 2024-04-24T02:12:26.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.851+0000 7f1e1c438800 1 --2- 172.21.15.134:0/217979697 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56474305a320 0x564743062e20 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.851+0000 7f1e1c438800 1 -- 172.21.15.134:0/217979697 >> 172.21.15.134:0/217979697 conn(0x564743054340 msgr2=0x564743056760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:26.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.851+0000 7f1e1c438800 1 -- 172.21.15.134:0/217979697 shutdown_connections 2024-04-24T02:12:26.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.851+0000 7f1e1c438800 1 -- 172.21.15.134:0/217979697 wait complete. 2024-04-24T02:12:26.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.862+0000 7f1e1c438800 1 Processor -- start 2024-04-24T02:12:26.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.862+0000 7f1e1c438800 1 -- start start 2024-04-24T02:12:26.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.862+0000 7f1e1c438800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5647430587e0 0x56474314d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.862+0000 7f1e1c438800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x564742fa53b0 con 0x5647430587e0 2024-04-24T02:12:26.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.863+0000 7f1e19f37640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5647430587e0 0x56474314d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.863+0000 7f1e19f37640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5647430587e0 0x56474314d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56176/0 (socket says 172.21.15.134:56176) 2024-04-24T02:12:26.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.863+0000 7f1e19f37640 1 -- 172.21.15.134:0/1347776848 learned_addr learned my addr 172.21.15.134:0/1347776848 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:26.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.863+0000 7f1e19f37640 1 -- 172.21.15.134:0/1347776848 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56474314da90 con 0x5647430587e0 2024-04-24T02:12:26.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.863+0000 7f1e19f37640 1 --2- 172.21.15.134:0/1347776848 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5647430587e0 0x56474314d4c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c00b210 tx=0x7f1e0c00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c77885aa554bca1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.863+0000 7f1d07e07640 1 -- 172.21.15.134:0/1347776848 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e0c008070 con 0x5647430587e0 2024-04-24T02:12:26.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.863+0000 7f1d07e07640 1 -- 172.21.15.134:0/1347776848 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e0c00d500 con 0x5647430587e0 2024-04-24T02:12:26.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.863+0000 7f1d07e07640 1 -- 172.21.15.134:0/1347776848 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e0c00d840 con 0x5647430587e0 2024-04-24T02:12:26.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.864+0000 7f1e1c438800 1 -- 172.21.15.134:0/1347776848 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5647430587e0 msgr2=0x56474314d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.864+0000 7f1e1c438800 1 --2- 172.21.15.134:0/1347776848 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5647430587e0 0x56474314d4c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c00b210 tx=0x7f1e0c00b6d0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.864+0000 7f1e1c438800 1 -- 172.21.15.134:0/1347776848 shutdown_connections 2024-04-24T02:12:26.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.864+0000 7f1e1c438800 1 --2- 172.21.15.134:0/1347776848 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5647430587e0 0x56474314d4c0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.864+0000 7f1e1c438800 1 -- 172.21.15.134:0/1347776848 >> 172.21.15.134:0/1347776848 conn(0x564743054340 msgr2=0x564743148de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:26.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.864+0000 7f1e1c438800 1 -- 172.21.15.134:0/1347776848 shutdown_connections 2024-04-24T02:12:26.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.864+0000 7f1e1c438800 1 -- 172.21.15.134:0/1347776848 wait complete. 2024-04-24T02:12:26.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.864+0000 7f1e1c438800 1 Processor -- start 2024-04-24T02:12:26.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.864+0000 7f1e1c438800 1 -- start start 2024-04-24T02:12:26.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.864+0000 7f1e1c438800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5647430587e0 0x564743155060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.864+0000 7f1e1c438800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x564743065640 con 0x5647430587e0 2024-04-24T02:12:26.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.865+0000 7f1e19f37640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5647430587e0 0x564743155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.865+0000 7f1e19f37640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5647430587e0 0x564743155060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56184/0 (socket says 172.21.15.134:56184) 2024-04-24T02:12:26.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.865+0000 7f1e19f37640 1 -- 172.21.15.134:0/4083594389 learned_addr learned my addr 172.21.15.134:0/4083594389 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:26.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.865+0000 7f1e19f37640 1 -- 172.21.15.134:0/4083594389 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647431555a0 con 0x5647430587e0 2024-04-24T02:12:26.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.865+0000 7f1e19f37640 1 --2- 172.21.15.134:0/4083594389 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5647430587e0 0x564743155060 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c00b210 tx=0x7f1e0c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.865+0000 7f1d06604640 1 -- 172.21.15.134:0/4083594389 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e0c00f950 con 0x5647430587e0 2024-04-24T02:12:26.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.865+0000 7f1d06604640 1 -- 172.21.15.134:0/4083594389 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e0c00faf0 con 0x5647430587e0 2024-04-24T02:12:26.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.865+0000 7f1e1c438800 1 -- 172.21.15.134:0/4083594389 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564743155830 con 0x5647430587e0 2024-04-24T02:12:26.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.865+0000 7f1d06604640 1 -- 172.21.15.134:0/4083594389 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e0c00fdd0 con 0x5647430587e0 2024-04-24T02:12:26.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.865+0000 7f1e1c438800 1 -- 172.21.15.134:0/4083594389 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647431584e0 con 0x5647430587e0 2024-04-24T02:12:26.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.866+0000 7f1d06604640 1 -- 172.21.15.134:0/4083594389 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1e0c017040 con 0x5647430587e0 2024-04-24T02:12:26.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.866+0000 7f1d06604640 1 --2- 172.21.15.134:0/4083594389 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1d00036900 0x7f1d00038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.866+0000 7f1d06604640 1 -- 172.21.15.134:0/4083594389 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f1e0c015020 con 0x5647430587e0 2024-04-24T02:12:26.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.866+0000 7f1e13fff640 1 --2- 172.21.15.134:0/4083594389 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1d00036900 0x7f1d00038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.866+0000 7f1e1c438800 1 --2- 172.21.15.134:0/4083594389 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x56474305a320 0x56474315c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.866+0000 7f1e1c438800 1 -- 172.21.15.134:0/4083594389 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56474315c7e0 con 0x56474305a320 2024-04-24T02:12:26.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.866+0000 7f1e1a738640 1 --2- 172.21.15.134:0/4083594389 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x56474305a320 0x56474315c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.867+0000 7f1e13fff640 1 --2- 172.21.15.134:0/4083594389 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1d00036900 0x7f1d00038dc0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1e04054000 tx=0x7f1e0404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.867+0000 7f1e1a738640 1 --2- 172.21.15.134:0/4083594389 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x56474305a320 0x56474315c2a0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.867+0000 7f1e1a738640 1 -- 172.21.15.134:0/4083594389 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e1400a4a0 con 0x56474305a320 2024-04-24T02:12:26.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.867+0000 7f1e1c438800 1 -- 172.21.15.134:0/4083594389 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564743159850 con 0x56474305a320 2024-04-24T02:12:26.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.867+0000 7f1e1a738640 1 -- 172.21.15.134:0/4083594389 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1e1400a4a0 con 0x56474305a320 2024-04-24T02:12:26.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.867+0000 7f1e1c438800 1 -- 172.21.15.134:0/4083594389 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56474315e5f0 con 0x56474305a320 2024-04-24T02:12:26.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.867+0000 7f1e1a738640 1 -- 172.21.15.134:0/4083594389 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1e1400a4a0 con 0x56474305a320 2024-04-24T02:12:26.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.868+0000 7f1e1c438800 1 -- 172.21.15.134:0/4083594389 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56474315d930 con 0x56474305a320 2024-04-24T02:12:26.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.868+0000 7f1e1a738640 1 -- 172.21.15.134:0/4083594389 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1e1400a4a0 con 0x56474305a320 2024-04-24T02:12:26.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.868+0000 7f1e1c438800 1 -- 172.21.15.134:0/4083594389 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56474315dd50 con 0x56474305a320 2024-04-24T02:12:26.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.868+0000 7f1e1a738640 1 -- 172.21.15.134:0/4083594389 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1e1400a4a0 con 0x56474305a320 2024-04-24T02:12:26.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.868+0000 7f1e1c438800 1 Processor -- start 2024-04-24T02:12:26.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.868+0000 7f1e1c438800 1 -- start start 2024-04-24T02:12:26.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.869+0000 7f1e1c438800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56474316d3e0 0x56474316d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.869+0000 7f1e1c438800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x564742f4b6b0 con 0x56474316d3e0 2024-04-24T02:12:26.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.869+0000 7f1e13fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56474316d3e0 0x56474316d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.869+0000 7f1e13fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56474316d3e0 0x56474316d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56192/0 (socket says 172.21.15.134:56192) 2024-04-24T02:12:26.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.869+0000 7f1e13fff640 1 -- 172.21.15.134:0/4132810160 learned_addr learned my addr 172.21.15.134:0/4132810160 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:26.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.869+0000 7f1e13fff640 1 -- 172.21.15.134:0/4132810160 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56474316dd40 con 0x56474316d3e0 2024-04-24T02:12:26.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.869+0000 7f1e13fff640 1 --2- 172.21.15.134:0/4132810160 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56474316d3e0 0x56474316d800 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1e04005930 tx=0x7f1e04002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.869+0000 7f1cff7fe640 1 -- 172.21.15.134:0/4132810160 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e04057040 con 0x56474316d3e0 2024-04-24T02:12:26.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.870+0000 7f1cff7fe640 1 -- 172.21.15.134:0/4132810160 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e0405d440 con 0x56474316d3e0 2024-04-24T02:12:26.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.870+0000 7f1e1c438800 1 -- 172.21.15.134:0/4132810160 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56474316e7b0 con 0x56474316d3e0 2024-04-24T02:12:26.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.870+0000 7f1cff7fe640 1 -- 172.21.15.134:0/4132810160 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e0405d740 con 0x56474316d3e0 2024-04-24T02:12:26.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.870+0000 7f1e1c438800 1 -- 172.21.15.134:0/4132810160 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56474316ec50 con 0x56474316d3e0 2024-04-24T02:12:26.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.870+0000 7f1cff7fe640 1 -- 172.21.15.134:0/4132810160 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1e04067070 con 0x56474316d3e0 2024-04-24T02:12:26.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.870+0000 7f1cff7fe640 1 --2- 172.21.15.134:0/4132810160 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1cf4036950 0x7f1cf4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.870+0000 7f1cff7fe640 1 -- 172.21.15.134:0/4132810160 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f1e0408f2f0 con 0x56474316d3e0 2024-04-24T02:12:26.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.870+0000 7f1e1a738640 1 --2- 172.21.15.134:0/4132810160 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1cf4036950 0x7f1cf4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.871+0000 7f1e1c438800 1 Processor -- start 2024-04-24T02:12:26.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.871+0000 7f1e1a738640 1 --2- 172.21.15.134:0/4132810160 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1cf4036950 0x7f1cf4038e10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x56474315dcd0 tx=0x7f1e14005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.871+0000 7f1e1c438800 1 -- start start 2024-04-24T02:12:26.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.871+0000 7f1e1c438800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56474317a660 0x56474317aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.871+0000 7f1e1c438800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56474314de10 con 0x56474317a660 2024-04-24T02:12:26.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.871+0000 7f1e13fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56474317a660 0x56474317aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.871+0000 7f1e13fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56474317a660 0x56474317aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56196/0 (socket says 172.21.15.134:56196) 2024-04-24T02:12:26.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.871+0000 7f1e13fff640 1 -- 172.21.15.134:0/2589968970 learned_addr learned my addr 172.21.15.134:0/2589968970 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:26.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.871+0000 7f1e13fff640 1 -- 172.21.15.134:0/2589968970 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56474317b050 con 0x56474317a660 2024-04-24T02:12:26.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.871+0000 7f1e13fff640 1 --2- 172.21.15.134:0/2589968970 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56474317a660 0x56474317aa80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f1e0408d7d0 tx=0x7f1e04067cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f15a1ded6160f8db server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.872+0000 7f1cfd7fa640 1 -- 172.21.15.134:0/2589968970 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e04080070 con 0x56474317a660 2024-04-24T02:12:26.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.872+0000 7f1cfd7fa640 1 -- 172.21.15.134:0/2589968970 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e0408f070 con 0x56474317a660 2024-04-24T02:12:26.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.872+0000 7f1cfd7fa640 1 -- 172.21.15.134:0/2589968970 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e040718b0 con 0x56474317a660 2024-04-24T02:12:26.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.872+0000 7f1e1c438800 1 -- 172.21.15.134:0/2589968970 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56474317a660 msgr2=0x56474317aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.872+0000 7f1e1c438800 1 --2- 172.21.15.134:0/2589968970 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56474317a660 0x56474317aa80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f1e0408d7d0 tx=0x7f1e04067cb0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.872+0000 7f1e1c438800 1 -- 172.21.15.134:0/2589968970 shutdown_connections 2024-04-24T02:12:26.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.872+0000 7f1e1c438800 1 --2- 172.21.15.134:0/2589968970 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56474317a660 0x56474317aa80 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.872+0000 7f1e1c438800 1 -- 172.21.15.134:0/2589968970 >> 172.21.15.134:0/2589968970 conn(0x5647431769c0 msgr2=0x564743174a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:26.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.872+0000 7f1e1c438800 1 -- 172.21.15.134:0/2589968970 shutdown_connections 2024-04-24T02:12:26.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.872+0000 7f1e1c438800 1 -- 172.21.15.134:0/2589968970 wait complete. 2024-04-24T02:12:26.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.872+0000 7f1e1c438800 1 Processor -- start 2024-04-24T02:12:26.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.872+0000 7f1e1c438800 1 -- start start 2024-04-24T02:12:26.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.873+0000 7f1e1c438800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56474317a660 0x564743181d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.873+0000 7f1e1c438800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56474317b7c0 con 0x56474317a660 2024-04-24T02:12:26.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.873+0000 7f1e13fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56474317a660 0x564743181d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.873+0000 7f1e13fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56474317a660 0x564743181d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56204/0 (socket says 172.21.15.134:56204) 2024-04-24T02:12:26.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.873+0000 7f1e13fff640 1 -- 172.21.15.134:0/1441820659 learned_addr learned my addr 172.21.15.134:0/1441820659 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:26.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.873+0000 7f1e13fff640 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564743182280 con 0x56474317a660 2024-04-24T02:12:26.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.873+0000 7f1e13fff640 1 --2- 172.21.15.134:0/1441820659 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56474317a660 0x564743181d40 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f1e0408d7d0 tx=0x7f1e0408d760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.873+0000 7f1ceb7fe640 1 -- 172.21.15.134:0/1441820659 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e04080040 con 0x56474317a660 2024-04-24T02:12:26.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.873+0000 7f1ceb7fe640 1 -- 172.21.15.134:0/1441820659 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e040718c0 con 0x56474317a660 2024-04-24T02:12:26.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.873+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564743182510 con 0x56474317a660 2024-04-24T02:12:26.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.873+0000 7f1ceb7fe640 1 -- 172.21.15.134:0/1441820659 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e0408b040 con 0x56474317a660 2024-04-24T02:12:26.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.873+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647431851c0 con 0x56474317a660 2024-04-24T02:12:26.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.874+0000 7f1ceb7fe640 1 -- 172.21.15.134:0/1441820659 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1e04083070 con 0x56474317a660 2024-04-24T02:12:26.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.874+0000 7f1ceb7fe640 1 --2- 172.21.15.134:0/1441820659 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1ce4036900 0x7f1ce4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.874+0000 7f1ceb7fe640 1 -- 172.21.15.134:0/1441820659 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f1e040910c0 con 0x56474317a660 2024-04-24T02:12:26.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.874+0000 7f1e1a738640 1 --2- 172.21.15.134:0/1441820659 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1ce4036900 0x7f1ce4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.875+0000 7f1e1c438800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.875+0000 7f1e1c438800 1 --2- 172.21.15.134:0/1441820659 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x56474318d820 0x56474318fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.875+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564743190430 con 0x56474318d820 2024-04-24T02:12:26.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.875+0000 7f1e1a738640 1 --2- 172.21.15.134:0/1441820659 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1ce4036900 0x7f1ce4038dc0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x56474315d450 tx=0x7f1e1401f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.875+0000 7f1e19f37640 1 --2- 172.21.15.134:0/1441820659 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x56474318d820 0x56474318fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.875+0000 7f1e19f37640 1 --2- 172.21.15.134:0/1441820659 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x56474318d820 0x56474318fce0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.875+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e0c02d070 con 0x56474318d820 2024-04-24T02:12:26.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.875+0000 7f1e1c438800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:26.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.875+0000 7f1e1c438800 20 realm 2024-04-24T02:12:26.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.875+0000 7f1e1c438800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.875+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564743190840 con 0x56474318d820 2024-04-24T02:12:26.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.876+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e0c02d070 con 0x56474318d820 2024-04-24T02:12:26.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.876+0000 7f1e1c438800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:26.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.876+0000 7f1e1c438800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:26.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.876+0000 7f1e1c438800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.876+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564743191110 con 0x56474318d820 2024-04-24T02:12:26.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.876+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e0c02d070 con 0x56474318d820 2024-04-24T02:12:26.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.876+0000 7f1e1c438800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:26.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.876+0000 7f1e1c438800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.876+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5647431914b0 con 0x56474318d820 2024-04-24T02:12:26.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.876+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1e0c02d070 con 0x56474318d820 2024-04-24T02:12:26.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.876+0000 7f1e1c438800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:26.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.876+0000 7f1e1c438800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.876+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564743191d00 con 0x56474318d820 2024-04-24T02:12:26.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.876+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1e0c02d070 con 0x56474318d820 2024-04-24T02:12:26.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.876+0000 7f1e1c438800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:26.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.876+0000 7f1e1c438800 20 searching for the correct realm 2024-04-24T02:12:26.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.877+0000 7f1e1c438800 1 --2- 172.21.15.134:0/1441820659 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x564743193a70 0x564743195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.877+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564743196440 con 0x564743193a70 2024-04-24T02:12:26.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.877+0000 7f1e13fff640 1 --2- 172.21.15.134:0/1441820659 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x564743193a70 0x564743195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.877+0000 7f1e13fff640 1 --2- 172.21.15.134:0/1441820659 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x564743193a70 0x564743195e60 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.877+0000 7f1e13fff640 1 -- 172.21.15.134:0/1441820659 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e04066030 con 0x564743193a70 2024-04-24T02:12:26.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.877+0000 7f1e13fff640 1 --2- 172.21.15.134:0/1441820659 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f1e0405c3e0 0x7f1e04098630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.877+0000 7f1e13fff640 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564743196440 con 0x7f1e0405c3e0 2024-04-24T02:12:26.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.877+0000 7f1e1a738640 1 --2- 172.21.15.134:0/1441820659 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f1e0405c3e0 0x7f1e04098630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.878+0000 7f1e1a738640 1 --2- 172.21.15.134:0/1441820659 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f1e0405c3e0 0x7f1e04098630 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.878+0000 7f1e1a738640 1 -- 172.21.15.134:0/1441820659 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e1401f070 con 0x7f1e0405c3e0 2024-04-24T02:12:26.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.878+0000 7f1e1a738640 1 --2- 172.21.15.134:0/1441820659 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f1e14031040 0x7f1e14032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.878+0000 7f1e1a738640 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564743196440 con 0x7f1e14031040 2024-04-24T02:12:26.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.878+0000 7f1e19f37640 1 --2- 172.21.15.134:0/1441820659 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f1e14031040 0x7f1e14032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.878+0000 7f1e19f37640 1 --2- 172.21.15.134:0/1441820659 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f1e14031040 0x7f1e14032430 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.879+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e0c048040 con 0x7f1e14031040 2024-04-24T02:12:26.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.879+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564743196440 con 0x56474318d820 2024-04-24T02:12:26.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.879+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e0c048040 con 0x56474318d820 2024-04-24T02:12:26.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.879+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564743196440 con 0x56474318d820 2024-04-24T02:12:26.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.879+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1e0c048040 con 0x56474318d820 2024-04-24T02:12:26.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.879+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564743196440 con 0x7f1e14031040 2024-04-24T02:12:26.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.879+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e0c048040 con 0x7f1e14031040 2024-04-24T02:12:26.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.879+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564743196440 con 0x7f1e14031040 2024-04-24T02:12:26.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.880+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e0c048040 con 0x7f1e14031040 2024-04-24T02:12:26.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.880+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564743196440 con 0x7f1e0405c3e0 2024-04-24T02:12:26.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.880+0000 7f1e1a738640 1 -- 172.21.15.134:0/1441820659 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e1401f070 con 0x7f1e0405c3e0 2024-04-24T02:12:26.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.880+0000 7f1e1a738640 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564743196440 con 0x564743193a70 2024-04-24T02:12:26.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.880+0000 7f1e13fff640 1 -- 172.21.15.134:0/1441820659 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e04066030 con 0x564743193a70 2024-04-24T02:12:26.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.880+0000 7f1e13fff640 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564743196440 con 0x56474318d820 2024-04-24T02:12:26.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.880+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e0c048040 con 0x56474318d820 2024-04-24T02:12:26.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.880+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564743196440 con 0x7f1e14031040 2024-04-24T02:12:26.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.881+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e0c048040 con 0x7f1e14031040 2024-04-24T02:12:26.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.881+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564743196440 con 0x56474318d820 2024-04-24T02:12:26.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.881+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e0c048040 con 0x56474318d820 2024-04-24T02:12:26.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.881+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564743196440 con 0x7f1e0405c3e0 2024-04-24T02:12:26.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.881+0000 7f1e1a738640 1 -- 172.21.15.134:0/1441820659 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1e1401f070 con 0x7f1e0405c3e0 2024-04-24T02:12:26.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.881+0000 7f1e1a738640 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564743196440 con 0x564743193a70 2024-04-24T02:12:26.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.881+0000 7f1e13fff640 1 -- 172.21.15.134:0/1441820659 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e04066030 con 0x564743193a70 2024-04-24T02:12:26.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.881+0000 7f1e13fff640 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564743196440 con 0x564743193a70 2024-04-24T02:12:26.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.881+0000 7f1e13fff640 1 -- 172.21.15.134:0/1441820659 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e04066030 con 0x564743193a70 2024-04-24T02:12:26.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.881+0000 7f1e13fff640 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564743196440 con 0x7f1e14031040 2024-04-24T02:12:26.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.882+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e0c048040 con 0x7f1e14031040 2024-04-24T02:12:26.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.882+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564743196440 con 0x564743193a70 2024-04-24T02:12:26.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.882+0000 7f1e13fff640 1 -- 172.21.15.134:0/1441820659 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e04066030 con 0x564743193a70 2024-04-24T02:12:26.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.882+0000 7f1e13fff640 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564743196440 con 0x564743193a70 2024-04-24T02:12:26.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.882+0000 7f1e13fff640 1 -- 172.21.15.134:0/1441820659 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e04066030 con 0x564743193a70 2024-04-24T02:12:26.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.882+0000 7f1e13fff640 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564743196440 con 0x56474318d820 2024-04-24T02:12:26.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.883+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e0c048040 con 0x56474318d820 2024-04-24T02:12:26.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.883+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564743196440 con 0x56474318d820 2024-04-24T02:12:26.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.883+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f1e0c048040 con 0x56474318d820 2024-04-24T02:12:26.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.883+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564743196440 con 0x7f1e14031040 2024-04-24T02:12:26.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.883+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e0c048040 con 0x7f1e14031040 2024-04-24T02:12:26.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.883+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564743196440 con 0x564743193a70 2024-04-24T02:12:26.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.883+0000 7f1e13fff640 1 -- 172.21.15.134:0/1441820659 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e04066030 con 0x564743193a70 2024-04-24T02:12:26.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.883+0000 7f1e13fff640 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564743196440 con 0x7f1e0405c3e0 2024-04-24T02:12:26.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.884+0000 7f1e1a738640 1 -- 172.21.15.134:0/1441820659 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e1401f070 con 0x7f1e0405c3e0 2024-04-24T02:12:26.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.884+0000 7f1e1a738640 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564743196440 con 0x56474318d820 2024-04-24T02:12:26.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.884+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e0c048040 con 0x56474318d820 2024-04-24T02:12:26.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.884+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564743196440 con 0x7f1e14031040 2024-04-24T02:12:26.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.884+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e0c048040 con 0x7f1e14031040 2024-04-24T02:12:26.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.884+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564743196440 con 0x564743193a70 2024-04-24T02:12:26.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.884+0000 7f1e13fff640 1 -- 172.21.15.134:0/1441820659 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e04066030 con 0x564743193a70 2024-04-24T02:12:26.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.884+0000 7f1e13fff640 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564743196440 con 0x7f1e14031040 2024-04-24T02:12:26.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.885+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e0c048040 con 0x7f1e14031040 2024-04-24T02:12:26.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.885+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564743196440 con 0x7f1e0405c3e0 2024-04-24T02:12:26.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.885+0000 7f1e1a738640 1 -- 172.21.15.134:0/1441820659 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e1401f070 con 0x7f1e0405c3e0 2024-04-24T02:12:26.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.885+0000 7f1e1a738640 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564743196440 con 0x564743193a70 2024-04-24T02:12:26.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.885+0000 7f1e13fff640 1 -- 172.21.15.134:0/1441820659 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e04066030 con 0x564743193a70 2024-04-24T02:12:26.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.885+0000 7f1e13fff640 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564743196440 con 0x7f1e14031040 2024-04-24T02:12:26.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.886+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e0c048040 con 0x7f1e14031040 2024-04-24T02:12:26.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.886+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564743196440 con 0x56474318d820 2024-04-24T02:12:26.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.886+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1e0c048040 con 0x56474318d820 2024-04-24T02:12:26.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.886+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564743196440 con 0x7f1e0405c3e0 2024-04-24T02:12:26.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.886+0000 7f1e1a738640 1 -- 172.21.15.134:0/1441820659 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e1401f070 con 0x7f1e0405c3e0 2024-04-24T02:12:26.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.886+0000 7f1e1c438800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:26.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.886+0000 7f1e1c438800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:26.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.886+0000 7f1e1c438800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:26.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.886+0000 7f1e1c438800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:26.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.886+0000 7f1e1c438800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:26.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.886+0000 7f1e1c438800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:26.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.886+0000 7f1e1c438800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.886+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564743192650 con 0x56474318d820 2024-04-24T02:12:26.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.886+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e0c048040 con 0x56474318d820 2024-04-24T02:12:26.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.886+0000 7f1e1c438800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:26.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.886+0000 7f1e1c438800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.886+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564743192ef0 con 0x56474318d820 2024-04-24T02:12:26.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.887+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1e0c048040 con 0x56474318d820 2024-04-24T02:12:26.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.887+0000 7f1e1c438800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:26.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.887+0000 7f1e1c438800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.887+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5647431968c0 con 0x56474318d820 2024-04-24T02:12:26.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.887+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1e0c048040 con 0x56474318d820 2024-04-24T02:12:26.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.887+0000 7f1e1c438800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:26.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.887+0000 7f1e1c438800 20 zone default found 2024-04-24T02:12:26.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.887+0000 7f1e1c438800 4 Realm: () 2024-04-24T02:12:26.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.887+0000 7f1e1c438800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:26.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.887+0000 7f1e1c438800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:26.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.887+0000 7f1e1c438800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:26.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.887+0000 7f1e1c438800 20 zonegroup default 2024-04-24T02:12:26.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.887+0000 7f1e1c438800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.887+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564743192b30 con 0x7f1e14031040 2024-04-24T02:12:26.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.887+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1e0c048040 con 0x7f1e14031040 2024-04-24T02:12:26.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.887+0000 7f1e1c438800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:26.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.887+0000 7f1e1c438800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.887+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5647431987d0 con 0x564743193a70 2024-04-24T02:12:26.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.888+0000 7f1e13fff640 1 -- 172.21.15.134:0/1441820659 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1e04066030 con 0x564743193a70 2024-04-24T02:12:26.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.888+0000 7f1e1c438800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:26.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.888+0000 7f1e1c438800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.888+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564743198b70 con 0x564743193a70 2024-04-24T02:12:26.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.888+0000 7f1e13fff640 1 -- 172.21.15.134:0/1441820659 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1e04066030 con 0x564743193a70 2024-04-24T02:12:26.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.888+0000 7f1e1c438800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:26.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.888+0000 7f1e1c438800 20 started sync module instance, tier type = 2024-04-24T02:12:26.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.888+0000 7f1e1c438800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:26.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.888+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564743197c70 con 0x7f1e0405c3e0 2024-04-24T02:12:26.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.889+0000 7f1e1a738640 1 -- 172.21.15.134:0/1441820659 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e14040040 con 0x7f1e0405c3e0 2024-04-24T02:12:26.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.889+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94864068411488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564743199460 con 0x7f1e0405c3e0 2024-04-24T02:12:26.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.889+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564743199cb0 con 0x56474318d820 2024-04-24T02:12:26.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.890+0000 7f1e1a738640 1 -- 172.21.15.134:0/1441820659 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94864068411488] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e14040040 con 0x7f1e0405c3e0 2024-04-24T02:12:26.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.890+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e0c048040 con 0x56474318d820 2024-04-24T02:12:26.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.890+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94864068415408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564743199980 con 0x56474318d820 2024-04-24T02:12:26.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.890+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56474319a4a0 con 0x564743193a70 2024-04-24T02:12:26.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.892+0000 7f1e13fff640 1 -- 172.21.15.134:0/1441820659 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e04066030 con 0x564743193a70 2024-04-24T02:12:26.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.892+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94864068415408] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e0c048040 con 0x56474318d820 2024-04-24T02:12:26.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.892+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94864068419440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56474319a890 con 0x564743193a70 2024-04-24T02:12:26.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.892+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56474319b290 con 0x7f1e0405c3e0 2024-04-24T02:12:26.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.893+0000 7f1e1a738640 1 -- 172.21.15.134:0/1441820659 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e14040040 con 0x7f1e0405c3e0 2024-04-24T02:12:26.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.893+0000 7f1e13fff640 1 -- 172.21.15.134:0/1441820659 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94864068419440] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e04066030 con 0x564743193a70 2024-04-24T02:12:26.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.893+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94864068423072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56474319b680 con 0x7f1e0405c3e0 2024-04-24T02:12:26.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.893+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56474319c080 con 0x56474318d820 2024-04-24T02:12:26.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.894+0000 7f1e1a738640 1 -- 172.21.15.134:0/1441820659 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94864068423072] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e14040040 con 0x7f1e0405c3e0 2024-04-24T02:12:26.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.894+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e0c048040 con 0x56474318d820 2024-04-24T02:12:26.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.894+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94864068416464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56474319c040 con 0x56474318d820 2024-04-24T02:12:26.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.894+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56474319cab0 con 0x7f1e14031040 2024-04-24T02:12:26.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.895+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94864068416464] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e0c048040 con 0x56474318d820 2024-04-24T02:12:26.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.895+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e0c048040 con 0x7f1e14031040 2024-04-24T02:12:26.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.895+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94864068429280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56474319c040 con 0x7f1e14031040 2024-04-24T02:12:26.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.895+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56474319d500 con 0x7f1e14031040 2024-04-24T02:12:26.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.896+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94864068429280] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e0c048040 con 0x7f1e14031040 2024-04-24T02:12:26.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.896+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(56 notify.6 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e0c048040 con 0x7f1e14031040 2024-04-24T02:12:26.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.896+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94864068431888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56474319c040 con 0x7f1e14031040 2024-04-24T02:12:26.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.896+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56474319df10 con 0x7f1e14031040 2024-04-24T02:12:26.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.897+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94864068431888] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e0c048040 con 0x7f1e14031040 2024-04-24T02:12:26.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.897+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(58 notify.7 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e0c048040 con 0x7f1e14031040 2024-04-24T02:12:26.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.897+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94864068435008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56474319c040 con 0x7f1e14031040 2024-04-24T02:12:26.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.897+0000 7f1e1c438800 20 add_watcher() i=0 2024-04-24T02:12:26.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.897+0000 7f1e1c438800 20 add_watcher() i=1 2024-04-24T02:12:26.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.897+0000 7f1e1c438800 20 add_watcher() i=2 2024-04-24T02:12:26.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.897+0000 7f1e1c438800 20 add_watcher() i=3 2024-04-24T02:12:26.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.897+0000 7f1e1c438800 20 add_watcher() i=4 2024-04-24T02:12:26.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.897+0000 7f1e1c438800 20 add_watcher() i=5 2024-04-24T02:12:26.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.897+0000 7f1e1c438800 20 add_watcher() i=6 2024-04-24T02:12:26.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.898+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94864068435008] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e0c048040 con 0x7f1e14031040 2024-04-24T02:12:26.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.898+0000 7f1e1c438800 20 add_watcher() i=7 2024-04-24T02:12:26.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.898+0000 7f1e1c438800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:26.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.898+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5647431a1330 con 0x56474318d820 2024-04-24T02:12:26.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.898+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1e0c048040 con 0x56474318d820 2024-04-24T02:12:26.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.898+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94864068427152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56474319e7f0 con 0x56474318d820 2024-04-24T02:12:26.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.899+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94864068427152] v30'124 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1e0c048040 con 0x56474318d820 2024-04-24T02:12:26.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.899+0000 7f1ccb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:26.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.899+0000 7f1e1c438800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:26.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.899+0000 7f1e1c438800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:26.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.899+0000 7f1e1c438800 5 note: GC not initialized 2024-04-24T02:12:26.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.900+0000 7f1cca7fc640 20 reqs_thread_entry: start 2024-04-24T02:12:26.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.900+0000 7f1e1c438800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:26.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.900+0000 7f1e1c438800 20 Filter name: none 2024-04-24T02:12:26.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.900+0000 7f1c3bfff640 20 reqs_thread_entry: start 2024-04-24T02:12:26.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.900+0000 7f1e1c438800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-24T02:12:26.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.900+0000 7f1e1c438800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.900+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5647431d4620 con 0x7f1e14031040 2024-04-24T02:12:26.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.900+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f1e0c048040 con 0x7f1e14031040 2024-04-24T02:12:26.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.900+0000 7f1e1c438800 20 rados_obj.operate() r=0 bl.length=380 2024-04-24T02:12:26.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.900+0000 7f1e1c438800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-04-24T02:12:26.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.900+0000 7f1e1c438800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-24T02:12:26.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.900+0000 7f1e1c438800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:12:26.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.900+0000 7f1e1c438800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-24T02:12:26.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.900+0000 7f1e1c438800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.900+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5647431d6700 con 0x7f1e0405c3e0 2024-04-24T02:12:26.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.901+0000 7f1e1a738640 1 -- 172.21.15.134:0/1441820659 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f1e14040040 con 0x7f1e0405c3e0 2024-04-24T02:12:26.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.901+0000 7f1e1c438800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T02:12:26.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.901+0000 7f1e1c438800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-24T02:12:26.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.901+0000 7f1e1c438800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T02:12:26.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.901+0000 7f1e1c438800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 : miss 2024-04-24T02:12:26.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.901+0000 7f1e1c438800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.901+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:64 8.1d 8:be2d2b4a:root::.bucket.meta.myfoo%3a582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5647431d8180 con 0x7f1e14031040 2024-04-24T02:12:26.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.901+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(64 .bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f1e0c048040 con 0x7f1e14031040 2024-04-24T02:12:26.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.901+0000 7f1e1c438800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T02:12:26.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.901+0000 7f1e1c438800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 info.flags=0x17 2024-04-24T02:12:26.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.901+0000 7f1e1c438800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 to cache LRU end 2024-04-24T02:12:26.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.901+0000 7f1e1c438800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:12:26.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.901+0000 7f1e1c438800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T02:12:26.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.901+0000 7f1e1c438800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 2024-04-24T02:12:26.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.901+0000 7f1e1c438800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-04-24T02:12:26.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.901+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5647431d96f0 con 0x7f1e14031040 2024-04-24T02:12:26.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.903+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(65 fud.buckets [call] v30'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f1e0c048040 con 0x7f1e14031040 2024-04-24T02:12:26.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.903+0000 7f1e1c438800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-04-24T02:12:26.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.903+0000 7f1e1c438800 20 rados->read ofs=0 len=0 2024-04-24T02:12:26.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.903+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5647431d9af0 con 0x7f1e0405c3e0 2024-04-24T02:12:26.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.903+0000 7f1e1a738640 1 -- 172.21.15.134:0/1441820659 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv20 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f1e14040040 con 0x7f1e0405c3e0 2024-04-24T02:12:26.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.903+0000 7f1e1c438800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T02:12:26.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.903+0000 7f1e1c438800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-04-24T02:12:26.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.903+0000 7f1e1c438800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T02:12:26.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.903+0000 7f1e1c438800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:12:26.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.903+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5647431df6a0 con 0x7f1e0405c3e0 2024-04-24T02:12:26.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.904+0000 7f1e1a738640 1 -- 172.21.15.134:0/1441820659 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v30'21 uv21 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f1e14040040 con 0x7f1e0405c3e0 2024-04-24T02:12:26.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.904+0000 7f1e1c438800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-04-24T02:12:26.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.904+0000 7f1e1c438800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T02:12:26.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.904+0000 7f1e1c438800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-24T02:12:26.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.904+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94864068686256 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5647431dcc10 con 0x7f1e14031040 2024-04-24T02:12:26.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.904+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.0 v2:172.21.15.104:6800/2419146313 20 ==== watch-notify(notify (1) cookie 94864068431888 notify 128849018886 ret 0) ==== 380+0+0 (crc 0 0 0) 0x5647431d8570 con 0x7f1e14031040 2024-04-24T02:12:26.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.904+0000 7f1cfd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018886 cookie 94864068431888 notifier 4509 bl.length()=338 2024-04-24T02:12:26.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.904+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.0 v2:172.21.15.104:6800/2419146313 21 ==== osd_op_reply(68 notify.6 [notify cookie 94864068686256 out=8b] v0'0 uv120 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1e0c048040 con 0x7f1e14031040 2024-04-24T02:12:26.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.904+0000 7f1cfd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-04-24T02:12:26.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.904+0000 7f1cfd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T02:12:26.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.904+0000 7f1cfd7fa640 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f1cdc003ea0 con 0x7f1e14031040 2024-04-24T02:12:26.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.905+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.0 v2:172.21.15.104:6800/2419146313 22 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e0c048040 con 0x7f1e14031040 2024-04-24T02:12:26.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.905+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.0 v2:172.21.15.104:6800/2419146313 23 ==== watch-notify(notify_complete (2) cookie 94864068686256 notify 128849018886 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5647431d76c0 con 0x7f1e14031040 2024-04-24T02:12:26.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.905+0000 7f1ccb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:26.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.905+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94864068427152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5647431a0ec0 con 0x56474318d820 2024-04-24T02:12:26.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.906+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94864068427152] v30'125 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1e0c048040 con 0x56474318d820 2024-04-24T02:12:26.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.906+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94864068411488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56474319bd60 con 0x7f1e0405c3e0 2024-04-24T02:12:26.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.907+0000 7f1e1a738640 1 -- 172.21.15.134:0/1441820659 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94864068411488] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e14040040 con 0x7f1e0405c3e0 2024-04-24T02:12:26.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.907+0000 7f1e1c438800 20 remove_watcher() i=0 2024-04-24T02:12:26.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.907+0000 7f1e1c438800 2 removed watcher, disabling cache 2024-04-24T02:12:26.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.907+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94864068415408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564743198060 con 0x56474318d820 2024-04-24T02:12:26.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.909+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94864068415408] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e0c048040 con 0x56474318d820 2024-04-24T02:12:26.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.909+0000 7f1e1c438800 20 remove_watcher() i=1 2024-04-24T02:12:26.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.909+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94864068419440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564743198060 con 0x564743193a70 2024-04-24T02:12:26.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.910+0000 7f1e13fff640 1 -- 172.21.15.134:0/1441820659 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94864068419440] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e04066030 con 0x564743193a70 2024-04-24T02:12:26.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.910+0000 7f1e1c438800 20 remove_watcher() i=2 2024-04-24T02:12:26.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.910+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94864068423072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564743199f70 con 0x7f1e0405c3e0 2024-04-24T02:12:26.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.910+0000 7f1e1a738640 1 -- 172.21.15.134:0/1441820659 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94864068423072] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e14040040 con 0x7f1e0405c3e0 2024-04-24T02:12:26.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.911+0000 7f1e1c438800 20 remove_watcher() i=3 2024-04-24T02:12:26.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.911+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94864068416464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564743199f70 con 0x56474318d820 2024-04-24T02:12:26.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.911+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94864068416464] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e0c048040 con 0x56474318d820 2024-04-24T02:12:26.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.911+0000 7f1e1c438800 20 remove_watcher() i=4 2024-04-24T02:12:26.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.911+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94864068429280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564743199f70 con 0x7f1e14031040 2024-04-24T02:12:26.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.912+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.0 v2:172.21.15.104:6800/2419146313 24 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94864068429280] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e0c048040 con 0x7f1e14031040 2024-04-24T02:12:26.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.912+0000 7f1e1c438800 20 remove_watcher() i=5 2024-04-24T02:12:26.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.912+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94864068431888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564743199f70 con 0x7f1e14031040 2024-04-24T02:12:26.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.913+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.0 v2:172.21.15.104:6800/2419146313 25 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94864068431888] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e0c048040 con 0x7f1e14031040 2024-04-24T02:12:26.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.913+0000 7f1e1c438800 20 remove_watcher() i=6 2024-04-24T02:12:26.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.913+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94864068435008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564743199f70 con 0x7f1e14031040 2024-04-24T02:12:26.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.914+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 <== osd.0 v2:172.21.15.104:6800/2419146313 26 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94864068435008] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e0c048040 con 0x7f1e14031040 2024-04-24T02:12:26.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.914+0000 7f1e1c438800 20 remove_watcher() i=7 2024-04-24T02:12:26.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.914+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f1e14031040 msgr2=0x7f1e14032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.914+0000 7f1e1c438800 1 --2- 172.21.15.134:0/1441820659 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f1e14031040 0x7f1e14032430 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.914+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x56474318d820 msgr2=0x56474318fce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.914+0000 7f1e1c438800 1 --2- 172.21.15.134:0/1441820659 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x56474318d820 0x56474318fce0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.914+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f1e0405c3e0 msgr2=0x7f1e04098630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.914+0000 7f1e1c438800 1 --2- 172.21.15.134:0/1441820659 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f1e0405c3e0 0x7f1e04098630 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.914+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x564743193a70 msgr2=0x564743195e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.914+0000 7f1e1c438800 1 --2- 172.21.15.134:0/1441820659 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x564743193a70 0x564743195e60 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.915+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1ce4036900 msgr2=0x7f1ce4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.915+0000 7f1e1c438800 1 --2- 172.21.15.134:0/1441820659 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1ce4036900 0x7f1ce4038dc0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x56474315d450 tx=0x7f1e1401f000 comp rx=0 tx=0).stop 2024-04-24T02:12:26.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.915+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56474317a660 msgr2=0x564743181d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.915+0000 7f1e19f37640 1 -- 172.21.15.134:0/1441820659 reap_dead start 2024-04-24T02:12:26.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.915+0000 7f1e1c438800 1 --2- 172.21.15.134:0/1441820659 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56474317a660 0x564743181d40 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f1e0408d7d0 tx=0x7f1e0408d760 comp rx=0 tx=0).stop 2024-04-24T02:12:26.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.915+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 shutdown_connections 2024-04-24T02:12:26.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.915+0000 7f1e1c438800 1 --2- 172.21.15.134:0/1441820659 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56474317a660 0x564743181d40 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.915+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 >> 172.21.15.134:0/1441820659 conn(0x5647431769c0 msgr2=0x564743174020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:26.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.915+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 shutdown_connections 2024-04-24T02:12:26.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.915+0000 7f1e1c438800 1 -- 172.21.15.134:0/1441820659 wait complete. 2024-04-24T02:12:26.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.915+0000 7f1e1c438800 1 -- 172.21.15.134:0/4132810160 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1cf4036950 msgr2=0x7f1cf4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.915+0000 7f1e1c438800 1 --2- 172.21.15.134:0/4132810160 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1cf4036950 0x7f1cf4038e10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x56474315dcd0 tx=0x7f1e14005840 comp rx=0 tx=0).stop 2024-04-24T02:12:26.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.915+0000 7f1e1c438800 1 -- 172.21.15.134:0/4132810160 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56474316d3e0 msgr2=0x56474316d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.915+0000 7f1e1c438800 1 --2- 172.21.15.134:0/4132810160 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56474316d3e0 0x56474316d800 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1e04005930 tx=0x7f1e04002fb0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.915+0000 7f1e1c438800 1 -- 172.21.15.134:0/4132810160 shutdown_connections 2024-04-24T02:12:26.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.915+0000 7f1e1c438800 1 --2- 172.21.15.134:0/4132810160 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1cf4036950 0x7f1cf4038e10 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.915+0000 7f1e1c438800 1 --2- 172.21.15.134:0/4132810160 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56474316d3e0 0x56474316d800 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.915+0000 7f1e1c438800 1 -- 172.21.15.134:0/4132810160 >> 172.21.15.134:0/4132810160 conn(0x564743161480 msgr2=0x564743161880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:26.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.915+0000 7f1e1c438800 1 -- 172.21.15.134:0/4132810160 shutdown_connections 2024-04-24T02:12:26.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.915+0000 7f1e1c438800 1 -- 172.21.15.134:0/4132810160 wait complete. 2024-04-24T02:12:26.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.915+0000 7f1e1c438800 1 -- 172.21.15.134:0/4083594389 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x56474305a320 msgr2=0x56474315c2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.915+0000 7f1e1c438800 1 --2- 172.21.15.134:0/4083594389 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x56474305a320 0x56474315c2a0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.915+0000 7f1e1c438800 1 -- 172.21.15.134:0/4083594389 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1d00036900 msgr2=0x7f1d00038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.915+0000 7f1e1c438800 1 --2- 172.21.15.134:0/4083594389 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1d00036900 0x7f1d00038dc0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1e04054000 tx=0x7f1e0404e000 comp rx=0 tx=0).stop 2024-04-24T02:12:26.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.915+0000 7f1e1c438800 1 -- 172.21.15.134:0/4083594389 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5647430587e0 msgr2=0x564743155060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.915+0000 7f1e1c438800 1 --2- 172.21.15.134:0/4083594389 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5647430587e0 0x564743155060 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c00b210 tx=0x7f1e0c000ed0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.915+0000 7f1e1c438800 1 -- 172.21.15.134:0/4083594389 shutdown_connections 2024-04-24T02:12:26.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.915+0000 7f1e1c438800 1 --2- 172.21.15.134:0/4083594389 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x56474305a320 0x56474315c2a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.915+0000 7f1e1c438800 1 --2- 172.21.15.134:0/4083594389 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1d00036900 0x7f1d00038dc0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.915+0000 7f1e1c438800 1 --2- 172.21.15.134:0/4083594389 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5647430587e0 0x564743155060 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.916+0000 7f1e1c438800 1 -- 172.21.15.134:0/4083594389 >> 172.21.15.134:0/4083594389 conn(0x564743054340 msgr2=0x564743147600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:26.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.916+0000 7f1e1c438800 1 -- 172.21.15.134:0/4083594389 shutdown_connections 2024-04-24T02:12:26.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.916+0000 7f1e1c438800 1 -- 172.21.15.134:0/4083594389 wait complete. 2024-04-24T02:12:26.934 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1'] 2024-04-24T02:12:26.934 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1'] 2024-04-24T02:12:26.934 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id 582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 2024-04-24T02:12:26.983 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:26.983 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:26.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.982+0000 7fdbbd72f800 1 Processor -- start 2024-04-24T02:12:26.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.982+0000 7fdbbd72f800 1 -- start start 2024-04-24T02:12:26.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.982+0000 7fdbbd72f800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x562e6373c4a0 0x562e6373e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:26.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.983+0000 7fdbbd72f800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562e635f6d40 con 0x562e63738990 2024-04-24T02:12:26.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.983+0000 7fdbbd72f800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x562e635c94d0 con 0x562e6373c4a0 2024-04-24T02:12:26.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.983+0000 7fdbb3fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x562e6373c4a0 0x562e6373e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:26.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.983+0000 7fdbb93b5640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x562e63738990 0x562e6373ad80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:55296/0 (socket says 172.21.15.134:55296) 2024-04-24T02:12:26.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.983+0000 7fdbb93b5640 1 -- 172.21.15.134:0/383549285 learned_addr learned my addr 172.21.15.134:0/383549285 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:12:26.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.983+0000 7fdbb3fff640 1 -- 172.21.15.134:0/383549285 >> v1:172.21.15.104:6789/0 conn(0x562e63738990 legacy=0x562e6373ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.983+0000 7fdbb3fff640 1 -- 172.21.15.134:0/383549285 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e635f5590 con 0x562e6373c4a0 2024-04-24T02:12:26.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.983+0000 7fdbb8bb4640 1 -- 172.21.15.134:0/383549285 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 909609535 0 0) 0x562e635f6d40 con 0x562e63738990 2024-04-24T02:12:26.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.985+0000 7fdbb3fff640 1 --2- 172.21.15.134:0/383549285 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e6373c4a0 0x562e6373e890 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fdba400a470 tx=0x7fdba401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7269b3a5297d5c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:26.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.985+0000 7fdbb8bb4640 1 -- 172.21.15.134:0/383549285 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdba4057070 con 0x562e6373c4a0 2024-04-24T02:12:26.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.985+0000 7fdbb8bb4640 1 -- 172.21.15.134:0/383549285 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdba4052570 con 0x562e6373c4a0 2024-04-24T02:12:26.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.985+0000 7fdbb8bb4640 1 -- 172.21.15.134:0/383549285 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdba4052870 con 0x562e6373c4a0 2024-04-24T02:12:26.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.986+0000 7fdbbd72f800 1 -- 172.21.15.134:0/383549285 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e6373c4a0 msgr2=0x562e6373e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:26.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.986+0000 7fdbbd72f800 1 --2- 172.21.15.134:0/383549285 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e6373c4a0 0x562e6373e890 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fdba400a470 tx=0x7fdba401ce90 comp rx=0 tx=0).stop 2024-04-24T02:12:26.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.986+0000 7fdbbd72f800 1 -- 172.21.15.134:0/383549285 shutdown_connections 2024-04-24T02:12:26.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.986+0000 7fdbbd72f800 1 --2- 172.21.15.134:0/383549285 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e6373c4a0 0x562e6373e890 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:26.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.986+0000 7fdbbd72f800 1 -- 172.21.15.134:0/383549285 >> 172.21.15.134:0/383549285 conn(0x562e63732340 msgr2=0x562e63734760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:26.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.986+0000 7fdbbd72f800 1 -- 172.21.15.134:0/383549285 shutdown_connections 2024-04-24T02:12:26.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.986+0000 7fdbbd72f800 1 -- 172.21.15.134:0/383549285 wait complete. 2024-04-24T02:12:27.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.997+0000 7fdbbd72f800 1 Processor -- start 2024-04-24T02:12:27.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.997+0000 7fdbbd72f800 1 -- start start 2024-04-24T02:12:27.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.997+0000 7fdbbd72f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e63738990 0x562e637382d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.997+0000 7fdbbd72f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x562e636833e0 con 0x562e63738990 2024-04-24T02:12:27.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.998+0000 7fdbb93b5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e63738990 0x562e637382d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.998+0000 7fdbb93b5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e63738990 0x562e637382d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56220/0 (socket says 172.21.15.134:56220) 2024-04-24T02:12:27.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.998+0000 7fdbb93b5640 1 -- 172.21.15.134:0/1055756899 learned_addr learned my addr 172.21.15.134:0/1055756899 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:27.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.998+0000 7fdbb93b5640 1 -- 172.21.15.134:0/1055756899 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e63736890 con 0x562e63738990 2024-04-24T02:12:27.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.998+0000 7fdbb93b5640 1 --2- 172.21.15.134:0/1055756899 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e63738990 0x562e637382d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fdbac00b210 tx=0x7fdbac00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26f567bed70723d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.998+0000 7fdaa7606640 1 -- 172.21.15.134:0/1055756899 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbac008070 con 0x562e63738990 2024-04-24T02:12:27.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.998+0000 7fdaa7606640 1 -- 172.21.15.134:0/1055756899 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbac00d500 con 0x562e63738990 2024-04-24T02:12:27.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.998+0000 7fdaa7606640 1 -- 172.21.15.134:0/1055756899 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbac00d840 con 0x562e63738990 2024-04-24T02:12:27.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.999+0000 7fdbbd72f800 1 -- 172.21.15.134:0/1055756899 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e63738990 msgr2=0x562e637382d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.999+0000 7fdbbd72f800 1 --2- 172.21.15.134:0/1055756899 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e63738990 0x562e637382d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fdbac00b210 tx=0x7fdbac00b6d0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.999+0000 7fdbbd72f800 1 -- 172.21.15.134:0/1055756899 shutdown_connections 2024-04-24T02:12:27.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.999+0000 7fdbbd72f800 1 --2- 172.21.15.134:0/1055756899 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e63738990 0x562e637382d0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.999+0000 7fdbbd72f800 1 -- 172.21.15.134:0/1055756899 >> 172.21.15.134:0/1055756899 conn(0x562e63732340 msgr2=0x562e63824940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:27.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.999+0000 7fdbbd72f800 1 -- 172.21.15.134:0/1055756899 shutdown_connections 2024-04-24T02:12:27.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.999+0000 7fdbbd72f800 1 -- 172.21.15.134:0/1055756899 wait complete. 2024-04-24T02:12:27.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.999+0000 7fdbbd72f800 1 Processor -- start 2024-04-24T02:12:27.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:26.999+0000 7fdbbd72f800 1 -- start start 2024-04-24T02:12:27.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.000+0000 7fdbbd72f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e63738990 0x562e63832d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.000+0000 7fdbbd72f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x562e637410e0 con 0x562e63738990 2024-04-24T02:12:27.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.000+0000 7fdbb93b5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e63738990 0x562e63832d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.000+0000 7fdbb93b5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e63738990 0x562e63832d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56230/0 (socket says 172.21.15.134:56230) 2024-04-24T02:12:27.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.000+0000 7fdbb93b5640 1 -- 172.21.15.134:0/633276234 learned_addr learned my addr 172.21.15.134:0/633276234 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:27.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.000+0000 7fdbb93b5640 1 -- 172.21.15.134:0/633276234 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e638332c0 con 0x562e63738990 2024-04-24T02:12:27.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.000+0000 7fdbb93b5640 1 --2- 172.21.15.134:0/633276234 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e63738990 0x562e63832d80 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fdbac00b210 tx=0x7fdbac000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.000+0000 7fdaa5e03640 1 -- 172.21.15.134:0/633276234 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbac00f950 con 0x562e63738990 2024-04-24T02:12:27.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.000+0000 7fdaa5e03640 1 -- 172.21.15.134:0/633276234 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbac00faf0 con 0x562e63738990 2024-04-24T02:12:27.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.000+0000 7fdaa5e03640 1 -- 172.21.15.134:0/633276234 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbac00fdd0 con 0x562e63738990 2024-04-24T02:12:27.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.000+0000 7fdbbd72f800 1 -- 172.21.15.134:0/633276234 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e63833550 con 0x562e63738990 2024-04-24T02:12:27.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.000+0000 7fdbbd72f800 1 -- 172.21.15.134:0/633276234 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e63836200 con 0x562e63738990 2024-04-24T02:12:27.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.001+0000 7fdaa5e03640 1 -- 172.21.15.134:0/633276234 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdbac017040 con 0x562e63738990 2024-04-24T02:12:27.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.001+0000 7fdaa5e03640 1 --2- 172.21.15.134:0/633276234 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdaa0036900 0x7fdaa0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.001+0000 7fdaa5e03640 1 -- 172.21.15.134:0/633276234 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fdbac015020 con 0x562e63738990 2024-04-24T02:12:27.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.001+0000 7fdbb3fff640 1 --2- 172.21.15.134:0/633276234 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdaa0036900 0x7fdaa0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.002+0000 7fdbbd72f800 1 --2- 172.21.15.134:0/633276234 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x562e6373c4a0 0x562e63839fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.002+0000 7fdbbd72f800 1 -- 172.21.15.134:0/633276234 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e6383a500 con 0x562e6373c4a0 2024-04-24T02:12:27.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.002+0000 7fdbb9bb6640 1 --2- 172.21.15.134:0/633276234 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x562e6373c4a0 0x562e63839fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.002+0000 7fdbb3fff640 1 --2- 172.21.15.134:0/633276234 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdaa0036900 0x7fdaa0038dc0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdba4054000 tx=0x7fdba404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.002+0000 7fdbb9bb6640 1 --2- 172.21.15.134:0/633276234 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x562e6373c4a0 0x562e63839fc0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.002+0000 7fdbb9bb6640 1 -- 172.21.15.134:0/633276234 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdbb400a4a0 con 0x562e6373c4a0 2024-04-24T02:12:27.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.002+0000 7fdbbd72f800 1 -- 172.21.15.134:0/633276234 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e63837570 con 0x562e6373c4a0 2024-04-24T02:12:27.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.002+0000 7fdbb9bb6640 1 -- 172.21.15.134:0/633276234 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdbb400a4a0 con 0x562e6373c4a0 2024-04-24T02:12:27.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.002+0000 7fdbbd72f800 1 -- 172.21.15.134:0/633276234 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e6383c290 con 0x562e6373c4a0 2024-04-24T02:12:27.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.003+0000 7fdbb9bb6640 1 -- 172.21.15.134:0/633276234 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdbb400a4a0 con 0x562e6373c4a0 2024-04-24T02:12:27.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.003+0000 7fdbbd72f800 1 -- 172.21.15.134:0/633276234 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e6383b5d0 con 0x562e6373c4a0 2024-04-24T02:12:27.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.003+0000 7fdbb9bb6640 1 -- 172.21.15.134:0/633276234 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdbb400a4a0 con 0x562e6373c4a0 2024-04-24T02:12:27.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.003+0000 7fdbbd72f800 1 -- 172.21.15.134:0/633276234 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e6383ba20 con 0x562e6373c4a0 2024-04-24T02:12:27.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.003+0000 7fdbb9bb6640 1 -- 172.21.15.134:0/633276234 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdbb400a4a0 con 0x562e6373c4a0 2024-04-24T02:12:27.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.004+0000 7fdbbd72f800 1 Processor -- start 2024-04-24T02:12:27.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.004+0000 7fdbbd72f800 1 -- start start 2024-04-24T02:12:27.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.004+0000 7fdbbd72f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e6384b080 0x562e6384b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.004+0000 7fdbbd72f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x562e636296b0 con 0x562e6384b080 2024-04-24T02:12:27.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.004+0000 7fdbb3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e6384b080 0x562e6384b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.004+0000 7fdbb3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e6384b080 0x562e6384b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56240/0 (socket says 172.21.15.134:56240) 2024-04-24T02:12:27.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.004+0000 7fdbb3fff640 1 -- 172.21.15.134:0/540205420 learned_addr learned my addr 172.21.15.134:0/540205420 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:27.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.004+0000 7fdbb3fff640 1 -- 172.21.15.134:0/540205420 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e6384b9e0 con 0x562e6384b080 2024-04-24T02:12:27.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.005+0000 7fdbb3fff640 1 --2- 172.21.15.134:0/540205420 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e6384b080 0x562e6384b4a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fdba4044840 tx=0x7fdba4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.005+0000 7fda9effd640 1 -- 172.21.15.134:0/540205420 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdba406f070 con 0x562e6384b080 2024-04-24T02:12:27.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.005+0000 7fda9effd640 1 -- 172.21.15.134:0/540205420 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdba4058040 con 0x562e6384b080 2024-04-24T02:12:27.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.005+0000 7fdbbd72f800 1 -- 172.21.15.134:0/540205420 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e6384c450 con 0x562e6384b080 2024-04-24T02:12:27.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.005+0000 7fda9effd640 1 -- 172.21.15.134:0/540205420 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdba4057050 con 0x562e6384b080 2024-04-24T02:12:27.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.005+0000 7fdbbd72f800 1 -- 172.21.15.134:0/540205420 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e6384c8f0 con 0x562e6384b080 2024-04-24T02:12:27.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.005+0000 7fda9effd640 1 -- 172.21.15.134:0/540205420 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdba4072070 con 0x562e6384b080 2024-04-24T02:12:27.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.006+0000 7fda9effd640 1 --2- 172.21.15.134:0/540205420 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fda94036900 0x7fda94038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.006+0000 7fda9effd640 1 -- 172.21.15.134:0/540205420 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fdba408f8b0 con 0x562e6384b080 2024-04-24T02:12:27.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.006+0000 7fdbb9bb6640 1 --2- 172.21.15.134:0/540205420 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fda94036900 0x7fda94038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.006+0000 7fdbbd72f800 1 Processor -- start 2024-04-24T02:12:27.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.006+0000 7fdbbd72f800 1 -- start start 2024-04-24T02:12:27.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.006+0000 7fdbb9bb6640 1 --2- 172.21.15.134:0/540205420 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fda94036900 0x7fda94038dc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x562e6383b0f0 tx=0x7fdbb4005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.006+0000 7fdbbd72f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e63858300 0x562e63858720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.006+0000 7fdbbd72f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x562e63736c10 con 0x562e63858300 2024-04-24T02:12:27.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.006+0000 7fdbb3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e63858300 0x562e63858720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.006+0000 7fdbb3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e63858300 0x562e63858720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56248/0 (socket says 172.21.15.134:56248) 2024-04-24T02:12:27.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.006+0000 7fdbb3fff640 1 -- 172.21.15.134:0/3977416180 learned_addr learned my addr 172.21.15.134:0/3977416180 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:27.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.007+0000 7fdbb3fff640 1 -- 172.21.15.134:0/3977416180 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e63858cf0 con 0x562e63858300 2024-04-24T02:12:27.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.007+0000 7fdbb3fff640 1 --2- 172.21.15.134:0/3977416180 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e63858300 0x562e63858720 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fdba408ddd0 tx=0x7fdba408df10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f75bf14a0d106d41 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.007+0000 7fda9cff9640 1 -- 172.21.15.134:0/3977416180 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdba405e480 con 0x562e63858300 2024-04-24T02:12:27.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.007+0000 7fda9cff9640 1 -- 172.21.15.134:0/3977416180 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdba4073c00 con 0x562e63858300 2024-04-24T02:12:27.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.007+0000 7fda9cff9640 1 -- 172.21.15.134:0/3977416180 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdba405e620 con 0x562e63858300 2024-04-24T02:12:27.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.007+0000 7fdbbd72f800 1 -- 172.21.15.134:0/3977416180 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e63858300 msgr2=0x562e63858720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.007+0000 7fdbbd72f800 1 --2- 172.21.15.134:0/3977416180 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e63858300 0x562e63858720 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fdba408ddd0 tx=0x7fdba408df10 comp rx=0 tx=0).stop 2024-04-24T02:12:27.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.007+0000 7fdbbd72f800 1 -- 172.21.15.134:0/3977416180 shutdown_connections 2024-04-24T02:12:27.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.007+0000 7fdbbd72f800 1 --2- 172.21.15.134:0/3977416180 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e63858300 0x562e63858720 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.007+0000 7fdbbd72f800 1 -- 172.21.15.134:0/3977416180 >> 172.21.15.134:0/3977416180 conn(0x562e63854660 msgr2=0x562e638526c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:27.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.007+0000 7fdbbd72f800 1 -- 172.21.15.134:0/3977416180 shutdown_connections 2024-04-24T02:12:27.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.007+0000 7fdbbd72f800 1 -- 172.21.15.134:0/3977416180 wait complete. 2024-04-24T02:12:27.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.008+0000 7fdbbd72f800 1 Processor -- start 2024-04-24T02:12:27.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.008+0000 7fdbbd72f800 1 -- start start 2024-04-24T02:12:27.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.008+0000 7fdbbd72f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e63858300 0x562e6385f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.008+0000 7fdbbd72f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x562e63859460 con 0x562e63858300 2024-04-24T02:12:27.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.008+0000 7fdbb3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e63858300 0x562e6385f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.008+0000 7fdbb3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e63858300 0x562e6385f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56262/0 (socket says 172.21.15.134:56262) 2024-04-24T02:12:27.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.008+0000 7fdbb3fff640 1 -- 172.21.15.134:0/317388850 learned_addr learned my addr 172.21.15.134:0/317388850 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:27.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.008+0000 7fdbb3fff640 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e6385fee0 con 0x562e63858300 2024-04-24T02:12:27.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.008+0000 7fdbb3fff640 1 --2- 172.21.15.134:0/317388850 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e63858300 0x562e6385f9a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fdba408cd40 tx=0x7fdba408dd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.008+0000 7fda8affd640 1 -- 172.21.15.134:0/317388850 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdba4072490 con 0x562e63858300 2024-04-24T02:12:27.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.008+0000 7fda8affd640 1 -- 172.21.15.134:0/317388850 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdba4093030 con 0x562e63858300 2024-04-24T02:12:27.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.008+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e63860170 con 0x562e63858300 2024-04-24T02:12:27.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.009+0000 7fda8affd640 1 -- 172.21.15.134:0/317388850 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdba405fae0 con 0x562e63858300 2024-04-24T02:12:27.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.009+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e63862e20 con 0x562e63858300 2024-04-24T02:12:27.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.009+0000 7fda8affd640 1 -- 172.21.15.134:0/317388850 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdba4086070 con 0x562e63858300 2024-04-24T02:12:27.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.009+0000 7fda8affd640 1 --2- 172.21.15.134:0/317388850 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fda84036950 0x7fda84038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.009+0000 7fda8affd640 1 -- 172.21.15.134:0/317388850 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fdba40910e0 con 0x562e63858300 2024-04-24T02:12:27.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.009+0000 7fdbb9bb6640 1 --2- 172.21.15.134:0/317388850 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fda84036950 0x7fda84038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.010+0000 7fdbbd72f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.010+0000 7fdbb9bb6640 1 --2- 172.21.15.134:0/317388850 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fda84036950 0x7fda84038e10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x562e638374e0 tx=0x7fdbb401f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.010+0000 7fdbbd72f800 1 --2- 172.21.15.134:0/317388850 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x562e6386b310 0x562e6386d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.010+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e6386df20 con 0x562e6386b310 2024-04-24T02:12:27.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.010+0000 7fdbb93b5640 1 --2- 172.21.15.134:0/317388850 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x562e6386b310 0x562e6386d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.010+0000 7fdbb93b5640 1 --2- 172.21.15.134:0/317388850 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x562e6386b310 0x562e6386d7d0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.010+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdbac02d070 con 0x562e6386b310 2024-04-24T02:12:27.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.010+0000 7fdbbd72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.010+0000 7fdbbd72f800 20 realm 2024-04-24T02:12:27.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.010+0000 7fdbbd72f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.010+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e6386e330 con 0x562e6386b310 2024-04-24T02:12:27.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.011+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdbac02d070 con 0x562e6386b310 2024-04-24T02:12:27.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.011+0000 7fdbbd72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.011+0000 7fdbbd72f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:27.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.011+0000 7fdbbd72f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.011+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e6386ec00 con 0x562e6386b310 2024-04-24T02:12:27.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.011+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdbac02d070 con 0x562e6386b310 2024-04-24T02:12:27.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.011+0000 7fdbbd72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.011+0000 7fdbbd72f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.011+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e6386efa0 con 0x562e6386b310 2024-04-24T02:12:27.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.011+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdbac02d070 con 0x562e6386b310 2024-04-24T02:12:27.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.011+0000 7fdbbd72f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:27.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.011+0000 7fdbbd72f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.011+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e6386f7f0 con 0x562e6386b310 2024-04-24T02:12:27.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.011+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdbac02d070 con 0x562e6386b310 2024-04-24T02:12:27.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.011+0000 7fdbbd72f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:27.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.011+0000 7fdbbd72f800 20 searching for the correct realm 2024-04-24T02:12:27.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.011+0000 7fdbbd72f800 1 --2- 172.21.15.134:0/317388850 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x562e63871560 0x562e63873950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.011+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e63873f30 con 0x562e63871560 2024-04-24T02:12:27.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.012+0000 7fdbb3fff640 1 --2- 172.21.15.134:0/317388850 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x562e63871560 0x562e63873950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.012+0000 7fdbb3fff640 1 --2- 172.21.15.134:0/317388850 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x562e63871560 0x562e63873950 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.012+0000 7fdbb3fff640 1 -- 172.21.15.134:0/317388850 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdba4071030 con 0x562e63871560 2024-04-24T02:12:27.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.012+0000 7fdbb3fff640 1 --2- 172.21.15.134:0/317388850 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fdba4074060 0x7fdba409b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.012+0000 7fdbb3fff640 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e63873f30 con 0x7fdba4074060 2024-04-24T02:12:27.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.012+0000 7fdbb9bb6640 1 --2- 172.21.15.134:0/317388850 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fdba4074060 0x7fdba409b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.013+0000 7fdbb9bb6640 1 --2- 172.21.15.134:0/317388850 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fdba4074060 0x7fdba409b4a0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.013+0000 7fdbb9bb6640 1 -- 172.21.15.134:0/317388850 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbb401f070 con 0x7fdba4074060 2024-04-24T02:12:27.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.013+0000 7fdbb9bb6640 1 --2- 172.21.15.134:0/317388850 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fdbb4031040 0x7fdbb4032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.013+0000 7fdbb9bb6640 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e63873f30 con 0x7fdbb4031040 2024-04-24T02:12:27.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.013+0000 7fdbb93b5640 1 --2- 172.21.15.134:0/317388850 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fdbb4031040 0x7fdbb4032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.013+0000 7fdbb93b5640 1 --2- 172.21.15.134:0/317388850 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fdbb4031040 0x7fdbb4032940 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.014+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbac048040 con 0x7fdbb4031040 2024-04-24T02:12:27.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.014+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e63873f30 con 0x562e6386b310 2024-04-24T02:12:27.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.014+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbac048040 con 0x562e6386b310 2024-04-24T02:12:27.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.014+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e63873f30 con 0x562e6386b310 2024-04-24T02:12:27.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.014+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdbac048040 con 0x562e6386b310 2024-04-24T02:12:27.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.014+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e63873f30 con 0x7fdbb4031040 2024-04-24T02:12:27.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.014+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbac048040 con 0x7fdbb4031040 2024-04-24T02:12:27.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.014+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e63873f30 con 0x7fdbb4031040 2024-04-24T02:12:27.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.015+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbac048040 con 0x7fdbb4031040 2024-04-24T02:12:27.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.015+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e63873f30 con 0x7fdba4074060 2024-04-24T02:12:27.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.015+0000 7fdbb9bb6640 1 -- 172.21.15.134:0/317388850 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbb401f070 con 0x7fdba4074060 2024-04-24T02:12:27.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.015+0000 7fdbb9bb6640 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e63873f30 con 0x562e63871560 2024-04-24T02:12:27.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.015+0000 7fdbb3fff640 1 -- 172.21.15.134:0/317388850 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdba4071030 con 0x562e63871560 2024-04-24T02:12:27.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.015+0000 7fdbb3fff640 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e63873f30 con 0x562e6386b310 2024-04-24T02:12:27.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.015+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbac048040 con 0x562e6386b310 2024-04-24T02:12:27.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.015+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e63873f30 con 0x7fdbb4031040 2024-04-24T02:12:27.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.016+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbac048040 con 0x7fdbb4031040 2024-04-24T02:12:27.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.016+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e63873f30 con 0x562e6386b310 2024-04-24T02:12:27.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.016+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbac048040 con 0x562e6386b310 2024-04-24T02:12:27.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.016+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e63873f30 con 0x7fdba4074060 2024-04-24T02:12:27.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.016+0000 7fdbb9bb6640 1 -- 172.21.15.134:0/317388850 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdbb401f070 con 0x7fdba4074060 2024-04-24T02:12:27.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.016+0000 7fdbb9bb6640 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e63873f30 con 0x562e63871560 2024-04-24T02:12:27.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.016+0000 7fdbb3fff640 1 -- 172.21.15.134:0/317388850 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdba4071030 con 0x562e63871560 2024-04-24T02:12:27.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.016+0000 7fdbb3fff640 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e63873f30 con 0x562e63871560 2024-04-24T02:12:27.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.017+0000 7fdbb3fff640 1 -- 172.21.15.134:0/317388850 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdba4071030 con 0x562e63871560 2024-04-24T02:12:27.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.017+0000 7fdbb3fff640 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e63873f30 con 0x7fdbb4031040 2024-04-24T02:12:27.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.017+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbac048040 con 0x7fdbb4031040 2024-04-24T02:12:27.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.017+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e63873f30 con 0x562e63871560 2024-04-24T02:12:27.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.017+0000 7fdbb3fff640 1 -- 172.21.15.134:0/317388850 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdba4071030 con 0x562e63871560 2024-04-24T02:12:27.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.017+0000 7fdbb3fff640 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e63873f30 con 0x562e63871560 2024-04-24T02:12:27.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.017+0000 7fdbb3fff640 1 -- 172.21.15.134:0/317388850 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdba4071030 con 0x562e63871560 2024-04-24T02:12:27.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.017+0000 7fdbb3fff640 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e63873f30 con 0x562e6386b310 2024-04-24T02:12:27.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.018+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbac048040 con 0x562e6386b310 2024-04-24T02:12:27.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.018+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e63873f30 con 0x562e6386b310 2024-04-24T02:12:27.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.018+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fdbac048040 con 0x562e6386b310 2024-04-24T02:12:27.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.018+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e63873f30 con 0x7fdbb4031040 2024-04-24T02:12:27.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.018+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbac048040 con 0x7fdbb4031040 2024-04-24T02:12:27.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.018+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e63873f30 con 0x562e63871560 2024-04-24T02:12:27.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.018+0000 7fdbb3fff640 1 -- 172.21.15.134:0/317388850 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdba4071030 con 0x562e63871560 2024-04-24T02:12:27.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.018+0000 7fdbb3fff640 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e63873f30 con 0x7fdba4074060 2024-04-24T02:12:27.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.019+0000 7fdbb9bb6640 1 -- 172.21.15.134:0/317388850 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbb401f070 con 0x7fdba4074060 2024-04-24T02:12:27.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.019+0000 7fdbb9bb6640 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e63873f30 con 0x562e6386b310 2024-04-24T02:12:27.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.019+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbac048040 con 0x562e6386b310 2024-04-24T02:12:27.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.019+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e63873f30 con 0x7fdbb4031040 2024-04-24T02:12:27.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.019+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbac048040 con 0x7fdbb4031040 2024-04-24T02:12:27.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.019+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e63873f30 con 0x562e63871560 2024-04-24T02:12:27.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.019+0000 7fdbb3fff640 1 -- 172.21.15.134:0/317388850 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdba4071030 con 0x562e63871560 2024-04-24T02:12:27.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.019+0000 7fdbb3fff640 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e63873f30 con 0x7fdbb4031040 2024-04-24T02:12:27.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.020+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbac048040 con 0x7fdbb4031040 2024-04-24T02:12:27.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.020+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e63873f30 con 0x7fdba4074060 2024-04-24T02:12:27.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.020+0000 7fdbb9bb6640 1 -- 172.21.15.134:0/317388850 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbb401f070 con 0x7fdba4074060 2024-04-24T02:12:27.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.020+0000 7fdbb9bb6640 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e63873f30 con 0x562e63871560 2024-04-24T02:12:27.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.021+0000 7fdbb3fff640 1 -- 172.21.15.134:0/317388850 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdba4071030 con 0x562e63871560 2024-04-24T02:12:27.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.021+0000 7fdbb3fff640 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e63873f30 con 0x7fdbb4031040 2024-04-24T02:12:27.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.021+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbac048040 con 0x7fdbb4031040 2024-04-24T02:12:27.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.021+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e63873f30 con 0x562e6386b310 2024-04-24T02:12:27.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.021+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdbac048040 con 0x562e6386b310 2024-04-24T02:12:27.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.021+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e63873f30 con 0x7fdba4074060 2024-04-24T02:12:27.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.022+0000 7fdbb9bb6640 1 -- 172.21.15.134:0/317388850 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbb401f070 con 0x7fdba4074060 2024-04-24T02:12:27.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.022+0000 7fdbbd72f800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:27.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.022+0000 7fdbbd72f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:27.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.022+0000 7fdbbd72f800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:27.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.022+0000 7fdbbd72f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:27.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.022+0000 7fdbbd72f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:27.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.022+0000 7fdbbd72f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:27.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.022+0000 7fdbbd72f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.022+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e638701a0 con 0x562e6386b310 2024-04-24T02:12:27.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.022+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdbac048040 con 0x562e6386b310 2024-04-24T02:12:27.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.022+0000 7fdbbd72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.022+0000 7fdbbd72f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.022+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e63870a40 con 0x562e6386b310 2024-04-24T02:12:27.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.022+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdbac048040 con 0x562e6386b310 2024-04-24T02:12:27.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.022+0000 7fdbbd72f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:27.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.022+0000 7fdbbd72f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.022+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e638743b0 con 0x562e6386b310 2024-04-24T02:12:27.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.023+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdbac048040 con 0x562e6386b310 2024-04-24T02:12:27.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.023+0000 7fdbbd72f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:27.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.023+0000 7fdbbd72f800 20 zone default found 2024-04-24T02:12:27.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.023+0000 7fdbbd72f800 4 Realm: () 2024-04-24T02:12:27.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.023+0000 7fdbbd72f800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:27.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.023+0000 7fdbbd72f800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:27.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.023+0000 7fdbbd72f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:27.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.023+0000 7fdbbd72f800 20 zonegroup default 2024-04-24T02:12:27.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.023+0000 7fdbbd72f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.023+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e63874860 con 0x7fdbb4031040 2024-04-24T02:12:27.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.023+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdbac048040 con 0x7fdbb4031040 2024-04-24T02:12:27.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.023+0000 7fdbbd72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.023+0000 7fdbbd72f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.023+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e63876240 con 0x562e63871560 2024-04-24T02:12:27.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.023+0000 7fdbb3fff640 1 -- 172.21.15.134:0/317388850 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdba4071030 con 0x562e63871560 2024-04-24T02:12:27.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.023+0000 7fdbbd72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.023+0000 7fdbbd72f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.023+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e63876710 con 0x562e63871560 2024-04-24T02:12:27.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.023+0000 7fdbb3fff640 1 -- 172.21.15.134:0/317388850 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdba4071030 con 0x562e63871560 2024-04-24T02:12:27.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.023+0000 7fdbbd72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.023+0000 7fdbbd72f800 20 started sync module instance, tier type = 2024-04-24T02:12:27.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.023+0000 7fdbbd72f800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:27.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.023+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e638756d0 con 0x7fdba4074060 2024-04-24T02:12:27.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.024+0000 7fdbb9bb6640 1 -- 172.21.15.134:0/317388850 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbb4040040 con 0x7fdba4074060 2024-04-24T02:12:27.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.024+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94757238299328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e63875330 con 0x7fdba4074060 2024-04-24T02:12:27.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.024+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e63877530 con 0x562e6386b310 2024-04-24T02:12:27.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.025+0000 7fdbb9bb6640 1 -- 172.21.15.134:0/317388850 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94757238299328] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbb4040040 con 0x7fdba4074060 2024-04-24T02:12:27.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.026+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbac048040 con 0x562e6386b310 2024-04-24T02:12:27.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.026+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94757238303600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e638774f0 con 0x562e6386b310 2024-04-24T02:12:27.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.026+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e63877f80 con 0x562e63871560 2024-04-24T02:12:27.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.027+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94757238303600] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbac048040 con 0x562e6386b310 2024-04-24T02:12:27.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.027+0000 7fdbb3fff640 1 -- 172.21.15.134:0/317388850 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdba4071030 con 0x562e63871560 2024-04-24T02:12:27.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.027+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94757238304656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e63878370 con 0x562e63871560 2024-04-24T02:12:27.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.027+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e63878d70 con 0x7fdba4074060 2024-04-24T02:12:27.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.028+0000 7fdbb3fff640 1 -- 172.21.15.134:0/317388850 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94757238304656] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdba4071030 con 0x562e63871560 2024-04-24T02:12:27.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.028+0000 7fdbb9bb6640 1 -- 172.21.15.134:0/317388850 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbb4040040 con 0x7fdba4074060 2024-04-24T02:12:27.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.028+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94757238307472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e63879160 con 0x7fdba4074060 2024-04-24T02:12:27.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.028+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e63879bc0 con 0x562e6386b310 2024-04-24T02:12:27.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.029+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbac048040 con 0x562e6386b310 2024-04-24T02:12:27.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.029+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94757238314656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e63879bc0 con 0x562e6386b310 2024-04-24T02:12:27.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.029+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e6387ab60 con 0x7fdbb4031040 2024-04-24T02:12:27.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.029+0000 7fdbb9bb6640 1 -- 172.21.15.134:0/317388850 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94757238307472] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbb4040040 con 0x7fdba4074060 2024-04-24T02:12:27.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.030+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbac048040 con 0x7fdbb4031040 2024-04-24T02:12:27.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.030+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94757238318640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e6387ab20 con 0x7fdbb4031040 2024-04-24T02:12:27.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.030+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94757238314656] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbac048040 con 0x562e6386b310 2024-04-24T02:12:27.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.030+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e6387b570 con 0x7fdbb4031040 2024-04-24T02:12:27.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.031+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94757238318640] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbac048040 con 0x7fdbb4031040 2024-04-24T02:12:27.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.031+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(56 notify.6 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbac048040 con 0x7fdbb4031040 2024-04-24T02:12:27.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.031+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94757238311040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e6387b0c0 con 0x7fdbb4031040 2024-04-24T02:12:27.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.031+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e6387be40 con 0x7fdbb4031040 2024-04-24T02:12:27.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.032+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(58 notify.7 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbac048040 con 0x7fdbb4031040 2024-04-24T02:12:27.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.032+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94757238311040] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbac048040 con 0x7fdbb4031040 2024-04-24T02:12:27.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.032+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94757238323600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e6387b0c0 con 0x7fdbb4031040 2024-04-24T02:12:27.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.032+0000 7fdbbd72f800 20 add_watcher() i=0 2024-04-24T02:12:27.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.032+0000 7fdbbd72f800 20 add_watcher() i=1 2024-04-24T02:12:27.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.032+0000 7fdbbd72f800 20 add_watcher() i=2 2024-04-24T02:12:27.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.032+0000 7fdbbd72f800 20 add_watcher() i=3 2024-04-24T02:12:27.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.032+0000 7fdbbd72f800 20 add_watcher() i=4 2024-04-24T02:12:27.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.032+0000 7fdbbd72f800 20 add_watcher() i=5 2024-04-24T02:12:27.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.032+0000 7fdbbd72f800 20 add_watcher() i=6 2024-04-24T02:12:27.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.033+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94757238323600] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbac048040 con 0x7fdbb4031040 2024-04-24T02:12:27.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.033+0000 7fdbbd72f800 20 add_watcher() i=7 2024-04-24T02:12:27.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.033+0000 7fdbbd72f800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:27.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.033+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e6387a040 con 0x562e6386b310 2024-04-24T02:12:27.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.033+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdbac048040 con 0x562e6386b310 2024-04-24T02:12:27.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.033+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94757238317120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e6387c330 con 0x562e6386b310 2024-04-24T02:12:27.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.034+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94757238317120] v30'126 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdbac048040 con 0x562e6386b310 2024-04-24T02:12:27.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.034+0000 7fda6f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:27.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.034+0000 7fdbbd72f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:27.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.034+0000 7fdbbd72f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:27.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.034+0000 7fdbbd72f800 5 note: GC not initialized 2024-04-24T02:12:27.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.035+0000 7fda6e7e4640 20 reqs_thread_entry: start 2024-04-24T02:12:27.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.035+0000 7fdbbd72f800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:27.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.035+0000 7fdbbd72f800 20 Filter name: none 2024-04-24T02:12:27.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.035+0000 7fd9dffff640 20 reqs_thread_entry: start 2024-04-24T02:12:27.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.035+0000 7fdbbd72f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T02:12:27.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.035+0000 7fdbbd72f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.035+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e638b21c0 con 0x562e6386b310 2024-04-24T02:12:27.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.035+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fdbac048040 con 0x562e6386b310 2024-04-24T02:12:27.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.035+0000 7fdbbd72f800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T02:12:27.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.035+0000 7fdbbd72f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T02:12:27.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.035+0000 7fdbbd72f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:27.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.035+0000 7fdbbd72f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:12:27.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.035+0000 7fdbbd72f800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-24T02:12:27.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.035+0000 7fdbbd72f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.035+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e638b1d10 con 0x7fdba4074060 2024-04-24T02:12:27.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.036+0000 7fdbb9bb6640 1 -- 172.21.15.134:0/317388850 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv21 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fdbb4040040 con 0x7fdba4074060 2024-04-24T02:12:27.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.036+0000 7fdbbd72f800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T02:12:27.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.036+0000 7fdbbd72f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-24T02:12:27.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.036+0000 7fdbbd72f800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T02:12:27.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.036+0000 7fdbbd72f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 : miss 2024-04-24T02:12:27.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.036+0000 7fdbbd72f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.036+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:64 8.1d 8:be2d2b4a:root::.bucket.meta.myfoo%3a582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e638b5e90 con 0x7fdbb4031040 2024-04-24T02:12:27.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.036+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(64 .bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fdbac048040 con 0x7fdbb4031040 2024-04-24T02:12:27.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.036+0000 7fdbbd72f800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T02:12:27.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.036+0000 7fdbbd72f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 info.flags=0x17 2024-04-24T02:12:27.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.036+0000 7fdbbd72f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 to cache LRU end 2024-04-24T02:12:27.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.036+0000 7fdbbd72f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:12:27.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.036+0000 7fdbbd72f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T02:12:27.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.036+0000 7fdbbd72f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 2024-04-24T02:12:27.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.036+0000 7fdbbd72f800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-04-24T02:12:27.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.036+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e638ba480 con 0x7fdbb4031040 2024-04-24T02:12:27.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.037+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(65 fud.buckets [call] v30'3 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fdbac048040 con 0x7fdbb4031040 2024-04-24T02:12:27.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.037+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:66 8.1d 8:be2d2b4a:root::.bucket.meta.myfoo%3a582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e638c03c0 con 0x7fdbb4031040 2024-04-24T02:12:27.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.038+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(66 .bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v30'3 uv3 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7fdbac048040 con 0x7fdbb4031040 2024-04-24T02:12:27.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.038+0000 7fdbbd72f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 info.flags=0x17 2024-04-24T02:12:27.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.038+0000 7fdbbd72f800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 to cache LRU end 2024-04-24T02:12:27.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.038+0000 7fdbbd72f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T02:12:27.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.038+0000 7fdbbd72f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1, ofs0, ns] 2024-04-24T02:12:27.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.038+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:67 7.9 7:93e5b521:::notify.7:head [notify cookie 94757238560608 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e638ba8b0 con 0x7fdbb4031040 2024-04-24T02:12:27.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.039+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.0 v2:172.21.15.104:6800/2419146313 20 ==== watch-notify(notify (1) cookie 94757238323600 notify 128849018887 ret 0) ==== 794+0+0 (crc 0 0 0) 0x562e638b5490 con 0x7fdbb4031040 2024-04-24T02:12:27.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.039+0000 7fda9cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018887 cookie 94757238323600 notifier 4516 bl.length()=752 2024-04-24T02:12:27.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.039+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.0 v2:172.21.15.104:6800/2419146313 21 ==== osd_op_reply(67 notify.7 [notify cookie 94757238560608 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdbac048040 con 0x7fdbb4031040 2024-04-24T02:12:27.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.039+0000 7fda9cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 info.flags=0x17 2024-04-24T02:12:27.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.039+0000 7fda9cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 to cache LRU end 2024-04-24T02:12:27.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.039+0000 7fda9cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T02:12:27.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.039+0000 7fda9cff9640 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:68 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fda7c003ea0 con 0x7fdbb4031040 2024-04-24T02:12:27.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.039+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.0 v2:172.21.15.104:6800/2419146313 22 ==== osd_op_reply(68 notify.7 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbac048040 con 0x7fdbb4031040 2024-04-24T02:12:27.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.039+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.0 v2:172.21.15.104:6800/2419146313 23 ==== watch-notify(notify_complete (2) cookie 94757238560608 notify 128849018887 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fdbac052040 con 0x7fdbb4031040 2024-04-24T02:12:27.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.039+0000 7fdbbd72f800 20 handle_bi_update(): bucket=:myfoo[582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1]): orig_sources= new_sources= 2024-04-24T02:12:27.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.039+0000 7fdbbd72f800 20 handle_bi_update(): bucket=:myfoo[582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1]): potential sources added=[] removed=[] 2024-04-24T02:12:27.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.039+0000 7fdbbd72f800 20 handle_bi_update(): bucket=:myfoo[582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1]): orig_dests= new_dests= 2024-04-24T02:12:27.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.039+0000 7fdbbd72f800 20 handle_bi_update(): bucket=:myfoo[582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1]): potential dests added=[] removed=[] 2024-04-24T02:12:27.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.039+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e638b5760 con 0x7fdba4074060 2024-04-24T02:12:27.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.040+0000 7fdbb9bb6640 1 -- 172.21.15.134:0/317388850 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(69 foo.buckets [call] v30'22 uv22 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fdbb4040040 con 0x7fdba4074060 2024-04-24T02:12:27.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.040+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e638b5760 con 0x7fdba4074060 2024-04-24T02:12:27.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.041+0000 7fdbb9bb6640 1 -- 172.21.15.134:0/317388850 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v30'23 uv23 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7fdbb4040040 con 0x7fdba4074060 2024-04-24T02:12:27.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.041+0000 7fdbbd72f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-04-24T02:12:27.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.041+0000 7fdbbd72f800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T02:12:27.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.041+0000 7fdbbd72f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-24T02:12:27.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.041+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94757238560608 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e638bf050 con 0x7fdbb4031040 2024-04-24T02:12:27.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.041+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.0 v2:172.21.15.104:6800/2419146313 24 ==== watch-notify(notify (1) cookie 94757238311040 notify 128849018888 ret 0) ==== 356+0+0 (crc 0 0 0) 0x7fdbac036040 con 0x7fdbb4031040 2024-04-24T02:12:27.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.041+0000 7fda9cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018888 cookie 94757238311040 notifier 4516 bl.length()=314 2024-04-24T02:12:27.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.041+0000 7fda9cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-04-24T02:12:27.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.041+0000 7fda9cff9640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T02:12:27.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.041+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.0 v2:172.21.15.104:6800/2419146313 25 ==== osd_op_reply(71 notify.6 [notify cookie 94757238560608 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdbac048040 con 0x7fdbb4031040 2024-04-24T02:12:27.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.041+0000 7fda9cff9640 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fda7c003ea0 con 0x7fdbb4031040 2024-04-24T02:12:27.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.042+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.0 v2:172.21.15.104:6800/2419146313 26 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbac048040 con 0x7fdbb4031040 2024-04-24T02:12:27.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.042+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.0 v2:172.21.15.104:6800/2419146313 27 ==== watch-notify(notify_complete (2) cookie 94757238560608 notify 128849018888 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562e63836200 con 0x7fdbb4031040 2024-04-24T02:12:27.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.043+0000 7fda6f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:27.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.043+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94757238317120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e638b5760 con 0x562e6386b310 2024-04-24T02:12:27.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.044+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94757238317120] v30'127 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdbac048040 con 0x562e6386b310 2024-04-24T02:12:27.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.044+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94757238299328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e6387a040 con 0x7fdba4074060 2024-04-24T02:12:27.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.045+0000 7fdbb9bb6640 1 -- 172.21.15.134:0/317388850 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94757238299328] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbb4040040 con 0x7fdba4074060 2024-04-24T02:12:27.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.045+0000 7fdbbd72f800 20 remove_watcher() i=0 2024-04-24T02:12:27.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.045+0000 7fdbbd72f800 2 removed watcher, disabling cache 2024-04-24T02:12:27.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.045+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94757238303600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e63875ac0 con 0x562e6386b310 2024-04-24T02:12:27.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.046+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94757238303600] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbac048040 con 0x562e6386b310 2024-04-24T02:12:27.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.046+0000 7fdbbd72f800 20 remove_watcher() i=1 2024-04-24T02:12:27.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.046+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94757238304656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e63875ac0 con 0x562e63871560 2024-04-24T02:12:27.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.047+0000 7fdbb3fff640 1 -- 172.21.15.134:0/317388850 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94757238304656] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdba4071030 con 0x562e63871560 2024-04-24T02:12:27.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.047+0000 7fdbbd72f800 20 remove_watcher() i=2 2024-04-24T02:12:27.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.047+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94757238307472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e6387a040 con 0x7fdba4074060 2024-04-24T02:12:27.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.048+0000 7fdbb9bb6640 1 -- 172.21.15.134:0/317388850 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94757238307472] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbb4040040 con 0x7fdba4074060 2024-04-24T02:12:27.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.048+0000 7fdbbd72f800 20 remove_watcher() i=3 2024-04-24T02:12:27.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.048+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94757238314656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e6387a040 con 0x562e6386b310 2024-04-24T02:12:27.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.049+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94757238314656] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbac048040 con 0x562e6386b310 2024-04-24T02:12:27.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.049+0000 7fdbbd72f800 20 remove_watcher() i=4 2024-04-24T02:12:27.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.049+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94757238318640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e6387a040 con 0x7fdbb4031040 2024-04-24T02:12:27.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.049+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.0 v2:172.21.15.104:6800/2419146313 28 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94757238318640] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbac048040 con 0x7fdbb4031040 2024-04-24T02:12:27.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.050+0000 7fdbbd72f800 20 remove_watcher() i=5 2024-04-24T02:12:27.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.050+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94757238311040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e6387a630 con 0x7fdbb4031040 2024-04-24T02:12:27.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.050+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.0 v2:172.21.15.104:6800/2419146313 29 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94757238311040] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbac048040 con 0x7fdbb4031040 2024-04-24T02:12:27.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.050+0000 7fdbbd72f800 20 remove_watcher() i=6 2024-04-24T02:12:27.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.050+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94757238323600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e6387a630 con 0x7fdbb4031040 2024-04-24T02:12:27.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.051+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 <== osd.0 v2:172.21.15.104:6800/2419146313 30 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94757238323600] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbac048040 con 0x7fdbb4031040 2024-04-24T02:12:27.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.051+0000 7fdbbd72f800 20 remove_watcher() i=7 2024-04-24T02:12:27.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.052+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fdbb4031040 msgr2=0x7fdbb4032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.052+0000 7fdbbd72f800 1 --2- 172.21.15.134:0/317388850 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fdbb4031040 0x7fdbb4032940 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.052+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x562e6386b310 msgr2=0x562e6386d7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.052+0000 7fdbbd72f800 1 --2- 172.21.15.134:0/317388850 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x562e6386b310 0x562e6386d7d0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.052+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fdba4074060 msgr2=0x7fdba409b4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.052+0000 7fdbbd72f800 1 --2- 172.21.15.134:0/317388850 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fdba4074060 0x7fdba409b4a0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.052+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x562e63871560 msgr2=0x562e63873950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.052+0000 7fdbbd72f800 1 --2- 172.21.15.134:0/317388850 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x562e63871560 0x562e63873950 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.052+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fda84036950 msgr2=0x7fda84038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.052+0000 7fdbbd72f800 1 --2- 172.21.15.134:0/317388850 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fda84036950 0x7fda84038e10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x562e638374e0 tx=0x7fdbb401f000 comp rx=0 tx=0).stop 2024-04-24T02:12:27.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.052+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e63858300 msgr2=0x562e6385f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.052+0000 7fdbbd72f800 1 --2- 172.21.15.134:0/317388850 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e63858300 0x562e6385f9a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fdba408cd40 tx=0x7fdba408dd60 comp rx=0 tx=0).stop 2024-04-24T02:12:27.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.052+0000 7fdbb93b5640 1 -- 172.21.15.134:0/317388850 reap_dead start 2024-04-24T02:12:27.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.052+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 shutdown_connections 2024-04-24T02:12:27.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.052+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 >> 172.21.15.134:0/317388850 conn(0x562e63854660 msgr2=0x562e63851cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:27.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.052+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 shutdown_connections 2024-04-24T02:12:27.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.052+0000 7fdbbd72f800 1 -- 172.21.15.134:0/317388850 wait complete. 2024-04-24T02:12:27.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.052+0000 7fdbbd72f800 1 -- 172.21.15.134:0/540205420 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fda94036900 msgr2=0x7fda94038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.052+0000 7fdbbd72f800 1 --2- 172.21.15.134:0/540205420 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fda94036900 0x7fda94038dc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x562e6383b0f0 tx=0x7fdbb4005840 comp rx=0 tx=0).stop 2024-04-24T02:12:27.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.052+0000 7fdbbd72f800 1 -- 172.21.15.134:0/540205420 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e6384b080 msgr2=0x562e6384b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.052+0000 7fdbbd72f800 1 --2- 172.21.15.134:0/540205420 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e6384b080 0x562e6384b4a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fdba4044840 tx=0x7fdba4002fb0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.052+0000 7fdbbd72f800 1 -- 172.21.15.134:0/540205420 shutdown_connections 2024-04-24T02:12:27.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.052+0000 7fdbbd72f800 1 --2- 172.21.15.134:0/540205420 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fda94036900 0x7fda94038dc0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.052+0000 7fdbbd72f800 1 --2- 172.21.15.134:0/540205420 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e6384b080 0x562e6384b4a0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.052+0000 7fdbbd72f800 1 -- 172.21.15.134:0/540205420 >> 172.21.15.134:0/540205420 conn(0x562e6383f120 msgr2=0x562e6383f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:27.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.052+0000 7fdbbd72f800 1 -- 172.21.15.134:0/540205420 shutdown_connections 2024-04-24T02:12:27.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.052+0000 7fdbbd72f800 1 -- 172.21.15.134:0/540205420 wait complete. 2024-04-24T02:12:27.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.053+0000 7fdbbd72f800 1 -- 172.21.15.134:0/633276234 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x562e6373c4a0 msgr2=0x562e63839fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.053+0000 7fdbbd72f800 1 --2- 172.21.15.134:0/633276234 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x562e6373c4a0 0x562e63839fc0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.053+0000 7fdbbd72f800 1 -- 172.21.15.134:0/633276234 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdaa0036900 msgr2=0x7fdaa0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.053+0000 7fdbbd72f800 1 --2- 172.21.15.134:0/633276234 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdaa0036900 0x7fdaa0038dc0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdba4054000 tx=0x7fdba404e000 comp rx=0 tx=0).stop 2024-04-24T02:12:27.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.053+0000 7fdbbd72f800 1 -- 172.21.15.134:0/633276234 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e63738990 msgr2=0x562e63832d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.053+0000 7fdbbd72f800 1 --2- 172.21.15.134:0/633276234 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e63738990 0x562e63832d80 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fdbac00b210 tx=0x7fdbac000ed0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.053+0000 7fdbbd72f800 1 -- 172.21.15.134:0/633276234 shutdown_connections 2024-04-24T02:12:27.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.053+0000 7fdbbd72f800 1 --2- 172.21.15.134:0/633276234 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x562e6373c4a0 0x562e63839fc0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.053+0000 7fdbbd72f800 1 --2- 172.21.15.134:0/633276234 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdaa0036900 0x7fdaa0038dc0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.053+0000 7fdbbd72f800 1 --2- 172.21.15.134:0/633276234 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e63738990 0x562e63832d80 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.053+0000 7fdbbd72f800 1 -- 172.21.15.134:0/633276234 >> 172.21.15.134:0/633276234 conn(0x562e63732340 msgr2=0x562e63737170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:27.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.053+0000 7fdbbd72f800 1 -- 172.21.15.134:0/633276234 shutdown_connections 2024-04-24T02:12:27.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.053+0000 7fdbbd72f800 1 -- 172.21.15.134:0/633276234 wait complete. 2024-04-24T02:12:27.070 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-04-24T02:12:27.070 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-04-24T02:12:27.070 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-04-24T02:12:27.113 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:27.113 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:27.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.112+0000 7f43df531800 1 Processor -- start 2024-04-24T02:12:27.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.112+0000 7f43df531800 1 -- start start 2024-04-24T02:12:27.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.112+0000 7f43df531800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55c973bf81f0 0x55c973bfa5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.112+0000 7f43df531800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c973ab3d40 con 0x55c973bf3d60 2024-04-24T02:12:27.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.112+0000 7f43df531800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55c973a864d0 con 0x55c973bf81f0 2024-04-24T02:12:27.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.113+0000 7f43d3fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55c973bf81f0 0x55c973bfa5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.113+0000 7f43db22f640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55c973bf3d60 0x55c973bf4180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:55310/0 (socket says 172.21.15.134:55310) 2024-04-24T02:12:27.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.113+0000 7f43db22f640 1 -- 172.21.15.134:0/1716601881 learned_addr learned my addr 172.21.15.134:0/1716601881 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:12:27.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.113+0000 7f43d3fff640 1 -- 172.21.15.134:0/1716601881 >> v1:172.21.15.104:6789/0 conn(0x55c973bf3d60 legacy=0x55c973bf4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.113+0000 7f43daa2e640 1 -- 172.21.15.134:0/1716601881 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2157981124 0 0) 0x55c973ab3d40 con 0x55c973bf3d60 2024-04-24T02:12:27.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.113+0000 7f43d3fff640 1 -- 172.21.15.134:0/1716601881 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c973ab2590 con 0x55c973bf81f0 2024-04-24T02:12:27.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.115+0000 7f43d3fff640 1 --2- 172.21.15.134:0/1716601881 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c973bf81f0 0x55c973bfa5e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f43c400a470 tx=0x7f43c401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=491a17f67bcf6256 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.115+0000 7f43daa2e640 1 -- 172.21.15.134:0/1716601881 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43c4057070 con 0x55c973bf81f0 2024-04-24T02:12:27.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.115+0000 7f43daa2e640 1 -- 172.21.15.134:0/1716601881 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43c4052570 con 0x55c973bf81f0 2024-04-24T02:12:27.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.115+0000 7f43daa2e640 1 -- 172.21.15.134:0/1716601881 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43c4052870 con 0x55c973bf81f0 2024-04-24T02:12:27.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.116+0000 7f43df531800 1 -- 172.21.15.134:0/1716601881 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c973bf81f0 msgr2=0x55c973bfa5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.116+0000 7f43df531800 1 --2- 172.21.15.134:0/1716601881 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c973bf81f0 0x55c973bfa5e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f43c400a470 tx=0x7f43c401ce90 comp rx=0 tx=0).stop 2024-04-24T02:12:27.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.116+0000 7f43df531800 1 -- 172.21.15.134:0/1716601881 shutdown_connections 2024-04-24T02:12:27.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.116+0000 7f43df531800 1 --2- 172.21.15.134:0/1716601881 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c973bf81f0 0x55c973bfa5e0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.116+0000 7f43df531800 1 -- 172.21.15.134:0/1716601881 >> 172.21.15.134:0/1716601881 conn(0x55c973bef320 msgr2=0x55c973bf1740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:27.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.116+0000 7f43df531800 1 -- 172.21.15.134:0/1716601881 shutdown_connections 2024-04-24T02:12:27.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.116+0000 7f43df531800 1 -- 172.21.15.134:0/1716601881 wait complete. 2024-04-24T02:12:27.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.127+0000 7f43df531800 1 Processor -- start 2024-04-24T02:12:27.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.127+0000 7f43df531800 1 -- start start 2024-04-24T02:12:27.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.128+0000 7f43df531800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c973bf3d60 0x55c973b68880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.128+0000 7f43df531800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c973b403c0 con 0x55c973bf3d60 2024-04-24T02:12:27.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.128+0000 7f43db22f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c973bf3d60 0x55c973b68880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.128+0000 7f43db22f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c973bf3d60 0x55c973b68880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56274/0 (socket says 172.21.15.134:56274) 2024-04-24T02:12:27.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.128+0000 7f43db22f640 1 -- 172.21.15.134:0/1742401199 learned_addr learned my addr 172.21.15.134:0/1742401199 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:27.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.128+0000 7f43db22f640 1 -- 172.21.15.134:0/1742401199 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c973ce6980 con 0x55c973bf3d60 2024-04-24T02:12:27.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.128+0000 7f43db22f640 1 --2- 172.21.15.134:0/1742401199 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c973bf3d60 0x55c973b68880 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f43cc00b240 tx=0x7f43cc00b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cbca0abd4c0e209 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.128+0000 7f42c960a640 1 -- 172.21.15.134:0/1742401199 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43cc008070 con 0x55c973bf3d60 2024-04-24T02:12:27.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.128+0000 7f42c960a640 1 -- 172.21.15.134:0/1742401199 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43cc00d500 con 0x55c973bf3d60 2024-04-24T02:12:27.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.128+0000 7f42c960a640 1 -- 172.21.15.134:0/1742401199 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43cc00d860 con 0x55c973bf3d60 2024-04-24T02:12:27.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.129+0000 7f43df531800 1 -- 172.21.15.134:0/1742401199 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c973bf3d60 msgr2=0x55c973b68880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.129+0000 7f43df531800 1 --2- 172.21.15.134:0/1742401199 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c973bf3d60 0x55c973b68880 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f43cc00b240 tx=0x7f43cc00b700 comp rx=0 tx=0).stop 2024-04-24T02:12:27.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.129+0000 7f43df531800 1 -- 172.21.15.134:0/1742401199 shutdown_connections 2024-04-24T02:12:27.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.129+0000 7f43df531800 1 --2- 172.21.15.134:0/1742401199 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c973bf3d60 0x55c973b68880 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.129+0000 7f43df531800 1 -- 172.21.15.134:0/1742401199 >> 172.21.15.134:0/1742401199 conn(0x55c973bef320 msgr2=0x55c973ce0680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:27.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.129+0000 7f43df531800 1 -- 172.21.15.134:0/1742401199 shutdown_connections 2024-04-24T02:12:27.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.129+0000 7f43df531800 1 -- 172.21.15.134:0/1742401199 wait complete. 2024-04-24T02:12:27.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.129+0000 7f43df531800 1 Processor -- start 2024-04-24T02:12:27.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.130+0000 7f43df531800 1 -- start start 2024-04-24T02:12:27.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.130+0000 7f43df531800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c973bf3d60 0x55c973cefc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.130+0000 7f43df531800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c973bfaeb0 con 0x55c973bf3d60 2024-04-24T02:12:27.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.130+0000 7f43db22f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c973bf3d60 0x55c973cefc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.130+0000 7f43db22f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c973bf3d60 0x55c973cefc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56286/0 (socket says 172.21.15.134:56286) 2024-04-24T02:12:27.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.130+0000 7f43db22f640 1 -- 172.21.15.134:0/1208945917 learned_addr learned my addr 172.21.15.134:0/1208945917 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:27.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.130+0000 7f43db22f640 1 -- 172.21.15.134:0/1208945917 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c973cf01b0 con 0x55c973bf3d60 2024-04-24T02:12:27.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.130+0000 7f43db22f640 1 --2- 172.21.15.134:0/1208945917 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c973bf3d60 0x55c973cefc70 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x55c973b67eb0 tx=0x7f43cc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.130+0000 7f42c7e07640 1 -- 172.21.15.134:0/1208945917 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43cc019870 con 0x55c973bf3d60 2024-04-24T02:12:27.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.130+0000 7f42c7e07640 1 -- 172.21.15.134:0/1208945917 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43cc019a10 con 0x55c973bf3d60 2024-04-24T02:12:27.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.130+0000 7f43df531800 1 -- 172.21.15.134:0/1208945917 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c973cf0440 con 0x55c973bf3d60 2024-04-24T02:12:27.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.130+0000 7f42c7e07640 1 -- 172.21.15.134:0/1208945917 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43cc019d30 con 0x55c973bf3d60 2024-04-24T02:12:27.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.130+0000 7f43df531800 1 -- 172.21.15.134:0/1208945917 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c973cf30f0 con 0x55c973bf3d60 2024-04-24T02:12:27.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.131+0000 7f42c7e07640 1 -- 172.21.15.134:0/1208945917 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f43cc017040 con 0x55c973bf3d60 2024-04-24T02:12:27.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.131+0000 7f42c7e07640 1 --2- 172.21.15.134:0/1208945917 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f42c00369a0 0x7f42c0038e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.131+0000 7f42c7e07640 1 -- 172.21.15.134:0/1208945917 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f43cc015020 con 0x55c973bf3d60 2024-04-24T02:12:27.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.131+0000 7f43d3fff640 1 --2- 172.21.15.134:0/1208945917 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f42c00369a0 0x7f42c0038e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.132+0000 7f43df531800 1 --2- 172.21.15.134:0/1208945917 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c973bf81f0 0x55c973cf6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.132+0000 7f43df531800 1 -- 172.21.15.134:0/1208945917 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c973cf7430 con 0x55c973bf81f0 2024-04-24T02:12:27.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.132+0000 7f43dba30640 1 --2- 172.21.15.134:0/1208945917 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c973bf81f0 0x55c973cf6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.132+0000 7f43d3fff640 1 --2- 172.21.15.134:0/1208945917 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f42c00369a0 0x7f42c0038e60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f43c4054000 tx=0x7f43c404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.132+0000 7f43dba30640 1 --2- 172.21.15.134:0/1208945917 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c973bf81f0 0x55c973cf6eb0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.132+0000 7f43dba30640 1 -- 172.21.15.134:0/1208945917 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f43d400a4a0 con 0x55c973bf81f0 2024-04-24T02:12:27.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.132+0000 7f43df531800 1 -- 172.21.15.134:0/1208945917 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c973cf4480 con 0x55c973bf81f0 2024-04-24T02:12:27.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.132+0000 7f43dba30640 1 -- 172.21.15.134:0/1208945917 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f43d400a4a0 con 0x55c973bf81f0 2024-04-24T02:12:27.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.132+0000 7f43df531800 1 -- 172.21.15.134:0/1208945917 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c973cf9250 con 0x55c973bf81f0 2024-04-24T02:12:27.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.133+0000 7f43dba30640 1 -- 172.21.15.134:0/1208945917 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f43d400a4a0 con 0x55c973bf81f0 2024-04-24T02:12:27.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.133+0000 7f43df531800 1 -- 172.21.15.134:0/1208945917 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c973cf8590 con 0x55c973bf81f0 2024-04-24T02:12:27.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.133+0000 7f43dba30640 1 -- 172.21.15.134:0/1208945917 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f43d400a4a0 con 0x55c973bf81f0 2024-04-24T02:12:27.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.133+0000 7f43df531800 1 -- 172.21.15.134:0/1208945917 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c973cf89e0 con 0x55c973bf81f0 2024-04-24T02:12:27.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.133+0000 7f43dba30640 1 -- 172.21.15.134:0/1208945917 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f43d400a4a0 con 0x55c973bf81f0 2024-04-24T02:12:27.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.134+0000 7f43df531800 1 Processor -- start 2024-04-24T02:12:27.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.134+0000 7f43df531800 1 -- start start 2024-04-24T02:12:27.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.134+0000 7f43df531800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c973d08020 0x55c973d08440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.134+0000 7f43df531800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c973ae66b0 con 0x55c973d08020 2024-04-24T02:12:27.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.134+0000 7f43d3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c973d08020 0x55c973d08440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.134+0000 7f43d3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c973d08020 0x55c973d08440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56294/0 (socket says 172.21.15.134:56294) 2024-04-24T02:12:27.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.134+0000 7f43d3fff640 1 -- 172.21.15.134:0/1117490397 learned_addr learned my addr 172.21.15.134:0/1117490397 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:27.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.134+0000 7f43d3fff640 1 -- 172.21.15.134:0/1117490397 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c973d08980 con 0x55c973d08020 2024-04-24T02:12:27.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.135+0000 7f43d3fff640 1 --2- 172.21.15.134:0/1117490397 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c973d08020 0x55c973d08440 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f43c4044840 tx=0x7f43c4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.135+0000 7f42c5602640 1 -- 172.21.15.134:0/1117490397 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43c406f070 con 0x55c973d08020 2024-04-24T02:12:27.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.135+0000 7f42c5602640 1 -- 172.21.15.134:0/1117490397 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43c4058040 con 0x55c973d08020 2024-04-24T02:12:27.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.135+0000 7f42c5602640 1 -- 172.21.15.134:0/1117490397 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43c4057050 con 0x55c973d08020 2024-04-24T02:12:27.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.135+0000 7f43df531800 1 -- 172.21.15.134:0/1117490397 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c973d093f0 con 0x55c973d08020 2024-04-24T02:12:27.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.135+0000 7f43df531800 1 -- 172.21.15.134:0/1117490397 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c973d09890 con 0x55c973d08020 2024-04-24T02:12:27.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.135+0000 7f42c5602640 1 -- 172.21.15.134:0/1117490397 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f43c4072070 con 0x55c973d08020 2024-04-24T02:12:27.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.136+0000 7f42c5602640 1 --2- 172.21.15.134:0/1117490397 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f42b4036900 0x7f42b4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.136+0000 7f42c5602640 1 -- 172.21.15.134:0/1117490397 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f43c408f960 con 0x55c973d08020 2024-04-24T02:12:27.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.136+0000 7f43dba30640 1 --2- 172.21.15.134:0/1117490397 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f42b4036900 0x7f42b4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.136+0000 7f43df531800 1 Processor -- start 2024-04-24T02:12:27.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.136+0000 7f43df531800 1 -- start start 2024-04-24T02:12:27.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.136+0000 7f43dba30640 1 --2- 172.21.15.134:0/1117490397 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f42b4036900 0x7f42b4038dc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x55c973cf80b0 tx=0x7f43d4005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.136+0000 7f43df531800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c973d152a0 0x55c973d156c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.136+0000 7f43df531800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c973ceb110 con 0x55c973d152a0 2024-04-24T02:12:27.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.136+0000 7f43d3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c973d152a0 0x55c973d156c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.136+0000 7f43d3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c973d152a0 0x55c973d156c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56298/0 (socket says 172.21.15.134:56298) 2024-04-24T02:12:27.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.136+0000 7f43d3fff640 1 -- 172.21.15.134:0/399009630 learned_addr learned my addr 172.21.15.134:0/399009630 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:27.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.137+0000 7f43d3fff640 1 -- 172.21.15.134:0/399009630 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c973d15c90 con 0x55c973d152a0 2024-04-24T02:12:27.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.137+0000 7f43d3fff640 1 --2- 172.21.15.134:0/399009630 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c973d152a0 0x55c973d156c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f43c408df30 tx=0x7f43c405db30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59c4d029296acb2d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.137+0000 7f42beffd640 1 -- 172.21.15.134:0/399009630 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43c405d510 con 0x55c973d152a0 2024-04-24T02:12:27.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.137+0000 7f42beffd640 1 -- 172.21.15.134:0/399009630 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43c405cc80 con 0x55c973d152a0 2024-04-24T02:12:27.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.137+0000 7f42beffd640 1 -- 172.21.15.134:0/399009630 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43c405f870 con 0x55c973d152a0 2024-04-24T02:12:27.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.137+0000 7f43df531800 1 -- 172.21.15.134:0/399009630 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c973d152a0 msgr2=0x55c973d156c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.137+0000 7f43df531800 1 --2- 172.21.15.134:0/399009630 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c973d152a0 0x55c973d156c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f43c408df30 tx=0x7f43c405db30 comp rx=0 tx=0).stop 2024-04-24T02:12:27.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.137+0000 7f43df531800 1 -- 172.21.15.134:0/399009630 shutdown_connections 2024-04-24T02:12:27.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.137+0000 7f43df531800 1 --2- 172.21.15.134:0/399009630 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c973d152a0 0x55c973d156c0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.137+0000 7f43df531800 1 -- 172.21.15.134:0/399009630 >> 172.21.15.134:0/399009630 conn(0x55c973d11600 msgr2=0x55c973d0f660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:27.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.137+0000 7f43df531800 1 -- 172.21.15.134:0/399009630 shutdown_connections 2024-04-24T02:12:27.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.137+0000 7f43df531800 1 -- 172.21.15.134:0/399009630 wait complete. 2024-04-24T02:12:27.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.138+0000 7f43df531800 1 Processor -- start 2024-04-24T02:12:27.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.138+0000 7f43df531800 1 -- start start 2024-04-24T02:12:27.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.138+0000 7f43df531800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c973d152a0 0x55c973d1c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.138+0000 7f43df531800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c973d16400 con 0x55c973d152a0 2024-04-24T02:12:27.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.138+0000 7f43d3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c973d152a0 0x55c973d1c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.138+0000 7f43d3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c973d152a0 0x55c973d1c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56312/0 (socket says 172.21.15.134:56312) 2024-04-24T02:12:27.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.138+0000 7f43d3fff640 1 -- 172.21.15.134:0/3272465187 learned_addr learned my addr 172.21.15.134:0/3272465187 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:27.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.138+0000 7f43d3fff640 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c973d1cec0 con 0x55c973d152a0 2024-04-24T02:12:27.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.138+0000 7f43d3fff640 1 --2- 172.21.15.134:0/3272465187 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c973d152a0 0x55c973d1c980 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f43c4052e00 tx=0x7f43c408de90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.139+0000 7f42bd7fa640 1 -- 172.21.15.134:0/3272465187 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43c40733b0 con 0x55c973d152a0 2024-04-24T02:12:27.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.139+0000 7f42bd7fa640 1 -- 172.21.15.134:0/3272465187 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43c4094070 con 0x55c973d152a0 2024-04-24T02:12:27.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.139+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c973d1d150 con 0x55c973d152a0 2024-04-24T02:12:27.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.139+0000 7f42bd7fa640 1 -- 172.21.15.134:0/3272465187 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43c40736e0 con 0x55c973d152a0 2024-04-24T02:12:27.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.139+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c973d1d150 con 0x55c973d152a0 2024-04-24T02:12:27.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.139+0000 7f42bd7fa640 1 -- 172.21.15.134:0/3272465187 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f43c4073880 con 0x55c973d152a0 2024-04-24T02:12:27.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.139+0000 7f42bd7fa640 1 --2- 172.21.15.134:0/3272465187 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f42a4036950 0x7f42a4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.139+0000 7f42bd7fa640 1 -- 172.21.15.134:0/3272465187 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f43c409c100 con 0x55c973d152a0 2024-04-24T02:12:27.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.140+0000 7f43dba30640 1 --2- 172.21.15.134:0/3272465187 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f42a4036950 0x7f42a4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.140+0000 7f43dba30640 1 --2- 172.21.15.134:0/3272465187 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f42a4036950 0x7f42a4038e10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x55c973cf43d0 tx=0x7f43d401f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.140+0000 7f43df531800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.140+0000 7f43df531800 1 --2- 172.21.15.134:0/3272465187 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c973d28270 0x55c973d2a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.140+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c973d2ae80 con 0x55c973d28270 2024-04-24T02:12:27.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.140+0000 7f43db22f640 1 --2- 172.21.15.134:0/3272465187 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c973d28270 0x55c973d2a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.141+0000 7f43db22f640 1 --2- 172.21.15.134:0/3272465187 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c973d28270 0x55c973d2a730 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.141+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f43cc02d070 con 0x55c973d28270 2024-04-24T02:12:27.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.141+0000 7f43df531800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.141+0000 7f43df531800 20 realm 2024-04-24T02:12:27.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.141+0000 7f43df531800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.141+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c973d2b290 con 0x55c973d28270 2024-04-24T02:12:27.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.141+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f43cc02d070 con 0x55c973d28270 2024-04-24T02:12:27.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.141+0000 7f43df531800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.141+0000 7f43df531800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:27.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.141+0000 7f43df531800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.141+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c973d2bb60 con 0x55c973d28270 2024-04-24T02:12:27.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.141+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f43cc02d070 con 0x55c973d28270 2024-04-24T02:12:27.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.141+0000 7f43df531800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.141+0000 7f43df531800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.141+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c973d2bf00 con 0x55c973d28270 2024-04-24T02:12:27.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.141+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f43cc02d070 con 0x55c973d28270 2024-04-24T02:12:27.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.141+0000 7f43df531800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:27.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.141+0000 7f43df531800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.141+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c973d2c750 con 0x55c973d28270 2024-04-24T02:12:27.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.142+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f43cc02d070 con 0x55c973d28270 2024-04-24T02:12:27.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.142+0000 7f43df531800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:27.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.142+0000 7f43df531800 20 searching for the correct realm 2024-04-24T02:12:27.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.142+0000 7f43df531800 1 --2- 172.21.15.134:0/3272465187 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55c973d2e4c0 0x55c973d308b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.142+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c973d30ec0 con 0x55c973d2e4c0 2024-04-24T02:12:27.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.142+0000 7f43d3fff640 1 --2- 172.21.15.134:0/3272465187 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55c973d2e4c0 0x55c973d308b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.142+0000 7f43d3fff640 1 --2- 172.21.15.134:0/3272465187 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55c973d2e4c0 0x55c973d308b0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.143+0000 7f43d3fff640 1 -- 172.21.15.134:0/3272465187 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43c4071030 con 0x55c973d2e4c0 2024-04-24T02:12:27.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.143+0000 7f43d3fff640 1 --2- 172.21.15.134:0/3272465187 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f43c4074060 0x7f43c407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.143+0000 7f43d3fff640 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c973d30ec0 con 0x7f43c4074060 2024-04-24T02:12:27.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.143+0000 7f43dba30640 1 --2- 172.21.15.134:0/3272465187 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f43c4074060 0x7f43c407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.143+0000 7f43dba30640 1 --2- 172.21.15.134:0/3272465187 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f43c4074060 0x7f43c407d440 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.143+0000 7f43dba30640 1 -- 172.21.15.134:0/3272465187 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43d401f070 con 0x7f43c4074060 2024-04-24T02:12:27.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.143+0000 7f43dba30640 1 --2- 172.21.15.134:0/3272465187 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f43d4031040 0x7f43d4032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.143+0000 7f43dba30640 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c973d30ec0 con 0x7f43d4031040 2024-04-24T02:12:27.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.143+0000 7f43db22f640 1 --2- 172.21.15.134:0/3272465187 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f43d4031040 0x7f43d4032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.144+0000 7f43db22f640 1 --2- 172.21.15.134:0/3272465187 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f43d4031040 0x7f43d4032940 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.144+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43cc02d070 con 0x7f43d4031040 2024-04-24T02:12:27.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.144+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c973d30ec0 con 0x55c973d28270 2024-04-24T02:12:27.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.144+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43cc02d070 con 0x55c973d28270 2024-04-24T02:12:27.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.144+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c973d30ec0 con 0x55c973d28270 2024-04-24T02:12:27.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.144+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f43cc02d070 con 0x55c973d28270 2024-04-24T02:12:27.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.144+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c973d30ec0 con 0x7f43d4031040 2024-04-24T02:12:27.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.145+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43cc02d070 con 0x7f43d4031040 2024-04-24T02:12:27.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.145+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c973d30ec0 con 0x7f43d4031040 2024-04-24T02:12:27.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.145+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43cc02d070 con 0x7f43d4031040 2024-04-24T02:12:27.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.145+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c973d30ec0 con 0x7f43c4074060 2024-04-24T02:12:27.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.145+0000 7f43dba30640 1 -- 172.21.15.134:0/3272465187 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43d401f070 con 0x7f43c4074060 2024-04-24T02:12:27.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.145+0000 7f43dba30640 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c973d30ec0 con 0x55c973d2e4c0 2024-04-24T02:12:27.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.145+0000 7f43d3fff640 1 -- 172.21.15.134:0/3272465187 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43c4071030 con 0x55c973d2e4c0 2024-04-24T02:12:27.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.145+0000 7f43d3fff640 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c973d30ec0 con 0x55c973d28270 2024-04-24T02:12:27.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.145+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43cc02d070 con 0x55c973d28270 2024-04-24T02:12:27.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.145+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c973d30ec0 con 0x7f43d4031040 2024-04-24T02:12:27.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.146+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43cc02d070 con 0x7f43d4031040 2024-04-24T02:12:27.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.146+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c973d30ec0 con 0x55c973d28270 2024-04-24T02:12:27.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.146+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43cc02d070 con 0x55c973d28270 2024-04-24T02:12:27.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.146+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c973d30ec0 con 0x7f43c4074060 2024-04-24T02:12:27.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.146+0000 7f43dba30640 1 -- 172.21.15.134:0/3272465187 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f43d401f070 con 0x7f43c4074060 2024-04-24T02:12:27.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.146+0000 7f43dba30640 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c973d30ec0 con 0x55c973d2e4c0 2024-04-24T02:12:27.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.146+0000 7f43d3fff640 1 -- 172.21.15.134:0/3272465187 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43c4071030 con 0x55c973d2e4c0 2024-04-24T02:12:27.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.146+0000 7f43d3fff640 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c973d30ec0 con 0x55c973d2e4c0 2024-04-24T02:12:27.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.147+0000 7f43d3fff640 1 -- 172.21.15.134:0/3272465187 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43c4071030 con 0x55c973d2e4c0 2024-04-24T02:12:27.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.147+0000 7f43d3fff640 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c973d30ec0 con 0x7f43d4031040 2024-04-24T02:12:27.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.147+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43cc02d070 con 0x7f43d4031040 2024-04-24T02:12:27.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.147+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c973d30ec0 con 0x55c973d2e4c0 2024-04-24T02:12:27.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.147+0000 7f43d3fff640 1 -- 172.21.15.134:0/3272465187 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43c4071030 con 0x55c973d2e4c0 2024-04-24T02:12:27.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.147+0000 7f43d3fff640 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c973d30ec0 con 0x55c973d2e4c0 2024-04-24T02:12:27.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.147+0000 7f43d3fff640 1 -- 172.21.15.134:0/3272465187 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43c4071030 con 0x55c973d2e4c0 2024-04-24T02:12:27.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.147+0000 7f43d3fff640 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c973d30ec0 con 0x55c973d28270 2024-04-24T02:12:27.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.148+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43cc02d070 con 0x55c973d28270 2024-04-24T02:12:27.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.148+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c973d30ec0 con 0x55c973d28270 2024-04-24T02:12:27.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.148+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f43cc02d070 con 0x55c973d28270 2024-04-24T02:12:27.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.148+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c973d30ec0 con 0x7f43d4031040 2024-04-24T02:12:27.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.148+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43cc02d070 con 0x7f43d4031040 2024-04-24T02:12:27.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.148+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c973d30ec0 con 0x55c973d2e4c0 2024-04-24T02:12:27.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.149+0000 7f43d3fff640 1 -- 172.21.15.134:0/3272465187 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43c4071030 con 0x55c973d2e4c0 2024-04-24T02:12:27.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.149+0000 7f43d3fff640 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c973d30ec0 con 0x7f43c4074060 2024-04-24T02:12:27.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.149+0000 7f43dba30640 1 -- 172.21.15.134:0/3272465187 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43d401f070 con 0x7f43c4074060 2024-04-24T02:12:27.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.149+0000 7f43dba30640 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c973d30ec0 con 0x55c973d28270 2024-04-24T02:12:27.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.149+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43cc02d070 con 0x55c973d28270 2024-04-24T02:12:27.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.149+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c973d30ec0 con 0x7f43d4031040 2024-04-24T02:12:27.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.149+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43cc02d070 con 0x7f43d4031040 2024-04-24T02:12:27.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.149+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c973d30ec0 con 0x55c973d2e4c0 2024-04-24T02:12:27.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.150+0000 7f43d3fff640 1 -- 172.21.15.134:0/3272465187 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43c4071030 con 0x55c973d2e4c0 2024-04-24T02:12:27.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.150+0000 7f43d3fff640 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c973d30ec0 con 0x7f43d4031040 2024-04-24T02:12:27.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.150+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43cc02d070 con 0x7f43d4031040 2024-04-24T02:12:27.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.150+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c973d30ec0 con 0x7f43c4074060 2024-04-24T02:12:27.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.150+0000 7f43dba30640 1 -- 172.21.15.134:0/3272465187 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43d401f070 con 0x7f43c4074060 2024-04-24T02:12:27.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.150+0000 7f43dba30640 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c973d30ec0 con 0x55c973d2e4c0 2024-04-24T02:12:27.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.150+0000 7f43d3fff640 1 -- 172.21.15.134:0/3272465187 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43c4071030 con 0x55c973d2e4c0 2024-04-24T02:12:27.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.150+0000 7f43d3fff640 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c973d30ec0 con 0x7f43d4031040 2024-04-24T02:12:27.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.151+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43cc02d070 con 0x7f43d4031040 2024-04-24T02:12:27.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.151+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c973d30ec0 con 0x55c973d28270 2024-04-24T02:12:27.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.151+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f43cc02d070 con 0x55c973d28270 2024-04-24T02:12:27.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.151+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c973d30ec0 con 0x7f43c4074060 2024-04-24T02:12:27.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.151+0000 7f43dba30640 1 -- 172.21.15.134:0/3272465187 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43d401f070 con 0x7f43c4074060 2024-04-24T02:12:27.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.151+0000 7f43df531800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:27.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.151+0000 7f43df531800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:27.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.151+0000 7f43df531800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:27.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.151+0000 7f43df531800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:27.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.151+0000 7f43df531800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:27.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.151+0000 7f43df531800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:27.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.151+0000 7f43df531800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.151+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c973d2d100 con 0x55c973d28270 2024-04-24T02:12:27.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.151+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f43cc02d070 con 0x55c973d28270 2024-04-24T02:12:27.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.151+0000 7f43df531800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.151+0000 7f43df531800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.151+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c973d2d9a0 con 0x55c973d28270 2024-04-24T02:12:27.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.152+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f43cc02d070 con 0x55c973d28270 2024-04-24T02:12:27.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.152+0000 7f43df531800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:27.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.152+0000 7f43df531800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.152+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c973d31340 con 0x55c973d28270 2024-04-24T02:12:27.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.152+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f43cc02d070 con 0x55c973d28270 2024-04-24T02:12:27.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.152+0000 7f43df531800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:27.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.152+0000 7f43df531800 20 zone default found 2024-04-24T02:12:27.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.152+0000 7f43df531800 4 Realm: () 2024-04-24T02:12:27.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.152+0000 7f43df531800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:27.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.152+0000 7f43df531800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:27.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.152+0000 7f43df531800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:27.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.152+0000 7f43df531800 20 zonegroup default 2024-04-24T02:12:27.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.152+0000 7f43df531800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.152+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c973d317f0 con 0x7f43d4031040 2024-04-24T02:12:27.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.152+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f43cc02d070 con 0x7f43d4031040 2024-04-24T02:12:27.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.152+0000 7f43df531800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.152+0000 7f43df531800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.152+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c973d331d0 con 0x55c973d2e4c0 2024-04-24T02:12:27.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.153+0000 7f43d3fff640 1 -- 172.21.15.134:0/3272465187 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f43c4071030 con 0x55c973d2e4c0 2024-04-24T02:12:27.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.153+0000 7f43df531800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.153+0000 7f43df531800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.153+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c973d33610 con 0x55c973d2e4c0 2024-04-24T02:12:27.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.153+0000 7f43d3fff640 1 -- 172.21.15.134:0/3272465187 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f43c4071030 con 0x55c973d2e4c0 2024-04-24T02:12:27.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.153+0000 7f43df531800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.153+0000 7f43df531800 20 started sync module instance, tier type = 2024-04-24T02:12:27.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.153+0000 7f43df531800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:27.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.153+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d32660 con 0x7f43c4074060 2024-04-24T02:12:27.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.154+0000 7f43dba30640 1 -- 172.21.15.134:0/3272465187 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43d4040040 con 0x7f43c4074060 2024-04-24T02:12:27.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.154+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94323720006224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d322c0 con 0x7f43c4074060 2024-04-24T02:12:27.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.154+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d34540 con 0x55c973d28270 2024-04-24T02:12:27.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.155+0000 7f43dba30640 1 -- 172.21.15.134:0/3272465187 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94323720006224] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43d4040040 con 0x7f43c4074060 2024-04-24T02:12:27.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.155+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43cc02d070 con 0x55c973d28270 2024-04-24T02:12:27.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.155+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94323720010352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d34540 con 0x55c973d28270 2024-04-24T02:12:27.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.155+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d34f40 con 0x55c973d2e4c0 2024-04-24T02:12:27.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.156+0000 7f43d3fff640 1 -- 172.21.15.134:0/3272465187 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43c4071030 con 0x55c973d2e4c0 2024-04-24T02:12:27.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.156+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94323720010352] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43cc02d070 con 0x55c973d28270 2024-04-24T02:12:27.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.156+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94323720011920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d344b0 con 0x55c973d2e4c0 2024-04-24T02:12:27.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.156+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d35e00 con 0x7f43c4074060 2024-04-24T02:12:27.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.157+0000 7f43d3fff640 1 -- 172.21.15.134:0/3272465187 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94323720011920] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43c4071030 con 0x55c973d2e4c0 2024-04-24T02:12:27.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.157+0000 7f43dba30640 1 -- 172.21.15.134:0/3272465187 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43d4040040 con 0x7f43c4074060 2024-04-24T02:12:27.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.157+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94323720018256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d36220 con 0x7f43c4074060 2024-04-24T02:12:27.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.157+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d36be0 con 0x55c973d28270 2024-04-24T02:12:27.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.158+0000 7f43dba30640 1 -- 172.21.15.134:0/3272465187 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94323720018256] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43d4040040 con 0x7f43c4074060 2024-04-24T02:12:27.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.158+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43cc02d070 con 0x55c973d28270 2024-04-24T02:12:27.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.158+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94323720019792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d36be0 con 0x55c973d28270 2024-04-24T02:12:27.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.158+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d375a0 con 0x7f43d4031040 2024-04-24T02:12:27.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.159+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43cc02d070 con 0x7f43d4031040 2024-04-24T02:12:27.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.159+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94323720019792] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43cc02d070 con 0x55c973d28270 2024-04-24T02:12:27.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.159+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94323720024304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d37510 con 0x7f43d4031040 2024-04-24T02:12:27.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.159+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d36760 con 0x7f43d4031040 2024-04-24T02:12:27.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.160+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94323720024304] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43cc02d070 con 0x7f43d4031040 2024-04-24T02:12:27.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.160+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(56 notify.6 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43cc02d070 con 0x7f43d4031040 2024-04-24T02:12:27.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.160+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94323720021808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d38010 con 0x7f43d4031040 2024-04-24T02:12:27.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.161+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d389d0 con 0x7f43d4031040 2024-04-24T02:12:27.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.161+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94323720021808] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43cc02d070 con 0x7f43d4031040 2024-04-24T02:12:27.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.161+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(58 notify.7 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43cc02d070 con 0x7f43d4031040 2024-04-24T02:12:27.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.161+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94323720026480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d389d0 con 0x7f43d4031040 2024-04-24T02:12:27.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.162+0000 7f43df531800 20 add_watcher() i=0 2024-04-24T02:12:27.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.162+0000 7f43df531800 20 add_watcher() i=1 2024-04-24T02:12:27.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.162+0000 7f43df531800 20 add_watcher() i=2 2024-04-24T02:12:27.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.162+0000 7f43df531800 20 add_watcher() i=3 2024-04-24T02:12:27.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.162+0000 7f43df531800 20 add_watcher() i=4 2024-04-24T02:12:27.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.162+0000 7f43df531800 20 add_watcher() i=5 2024-04-24T02:12:27.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.162+0000 7f43df531800 20 add_watcher() i=6 2024-04-24T02:12:27.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.162+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94323720026480] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43cc02d070 con 0x7f43d4031040 2024-04-24T02:12:27.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.162+0000 7f43df531800 20 add_watcher() i=7 2024-04-24T02:12:27.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.162+0000 7f43df531800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:27.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.162+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c973d3bd30 con 0x55c973d28270 2024-04-24T02:12:27.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.163+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f43cc02d070 con 0x55c973d28270 2024-04-24T02:12:27.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.163+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94323720042288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d38b40 con 0x55c973d28270 2024-04-24T02:12:27.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.164+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94323720042288] v30'128 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f43cc02d070 con 0x55c973d28270 2024-04-24T02:12:27.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.164+0000 7f4291fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:27.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.164+0000 7f43df531800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:27.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.164+0000 7f43df531800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:27.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.164+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d3b0b0 con 0x55c973d28270 2024-04-24T02:12:27.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.165+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'45 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f43cc02d070 con 0x55c973d28270 2024-04-24T02:12:27.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.165+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d44df0 con 0x7f43d4031040 2024-04-24T02:12:27.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.166+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f43cc02d070 con 0x7f43d4031040 2024-04-24T02:12:27.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.166+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d44df0 con 0x55c973d2e4c0 2024-04-24T02:12:27.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.167+0000 7f43d3fff640 1 -- 172.21.15.134:0/3272465187 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f43c4071030 con 0x55c973d2e4c0 2024-04-24T02:12:27.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.167+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d45190 con 0x55c973d28270 2024-04-24T02:12:27.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.169+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'129 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f43cc02d070 con 0x55c973d28270 2024-04-24T02:12:27.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.169+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d452c0 con 0x7f43c4074060 2024-04-24T02:12:27.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.170+0000 7f43dba30640 1 -- 172.21.15.134:0/3272465187 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'41 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f43d4040040 con 0x7f43c4074060 2024-04-24T02:12:27.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.170+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d459b0 con 0x55c973d2e4c0 2024-04-24T02:12:27.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.172+0000 7f43d3fff640 1 -- 172.21.15.134:0/3272465187 <== osd.3 v2:172.21.15.134:6801/3585115521 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'37 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f43c4071030 con 0x55c973d2e4c0 2024-04-24T02:12:27.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.172+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d45d50 con 0x55c973d28270 2024-04-24T02:12:27.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.173+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f43cc02d070 con 0x55c973d28270 2024-04-24T02:12:27.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.173+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d45d50 con 0x7f43d4031040 2024-04-24T02:12:27.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.174+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'30 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f43cc02d070 con 0x7f43d4031040 2024-04-24T02:12:27.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.174+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d45d50 con 0x7f43c4074060 2024-04-24T02:12:27.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.174+0000 7f43dba30640 1 -- 172.21.15.134:0/3272465187 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f43d4040040 con 0x7f43c4074060 2024-04-24T02:12:27.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.175+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d46320 con 0x55c973d2e4c0 2024-04-24T02:12:27.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.175+0000 7f43d3fff640 1 -- 172.21.15.134:0/3272465187 <== osd.3 v2:172.21.15.134:6801/3585115521 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f43c4071030 con 0x55c973d2e4c0 2024-04-24T02:12:27.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.176+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d46320 con 0x7f43c4074060 2024-04-24T02:12:27.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.178+0000 7f43dba30640 1 -- 172.21.15.134:0/3272465187 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'42 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43d4040040 con 0x7f43c4074060 2024-04-24T02:12:27.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.178+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d46890 con 0x7f43d4031040 2024-04-24T02:12:27.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.179+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43cc02d070 con 0x7f43d4031040 2024-04-24T02:12:27.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.179+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d46890 con 0x7f43c4074060 2024-04-24T02:12:27.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.180+0000 7f43dba30640 1 -- 172.21.15.134:0/3272465187 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'21 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43d4040040 con 0x7f43c4074060 2024-04-24T02:12:27.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.180+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d46d40 con 0x7f43d4031040 2024-04-24T02:12:27.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.182+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.0 v2:172.21.15.104:6800/2419146313 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'41 uv16 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43cc02d070 con 0x7f43d4031040 2024-04-24T02:12:27.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.182+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d46d40 con 0x55c973d28270 2024-04-24T02:12:27.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.183+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'130 uv16 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43cc02d070 con 0x55c973d28270 2024-04-24T02:12:27.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.183+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d46d40 con 0x55c973d2e4c0 2024-04-24T02:12:27.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.184+0000 7f43d3fff640 1 -- 172.21.15.134:0/3272465187 <== osd.3 v2:172.21.15.134:6801/3585115521 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'35 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43c4071030 con 0x55c973d2e4c0 2024-04-24T02:12:27.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.184+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d46d40 con 0x7f43c4074060 2024-04-24T02:12:27.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.185+0000 7f43dba30640 1 -- 172.21.15.134:0/3272465187 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'43 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43d4040040 con 0x7f43c4074060 2024-04-24T02:12:27.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.185+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d46d40 con 0x55c973d2e4c0 2024-04-24T02:12:27.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.186+0000 7f43d3fff640 1 -- 172.21.15.134:0/3272465187 <== osd.3 v2:172.21.15.134:6801/3585115521 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'27 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43c4071030 con 0x55c973d2e4c0 2024-04-24T02:12:27.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.186+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d46d40 con 0x55c973d28270 2024-04-24T02:12:27.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.187+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43cc02d070 con 0x55c973d28270 2024-04-24T02:12:27.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.187+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d46d40 con 0x55c973d28270 2024-04-24T02:12:27.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.188+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'131 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43cc02d070 con 0x55c973d28270 2024-04-24T02:12:27.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.188+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d46d40 con 0x55c973d2e4c0 2024-04-24T02:12:27.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.189+0000 7f43d3fff640 1 -- 172.21.15.134:0/3272465187 <== osd.3 v2:172.21.15.134:6801/3585115521 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'36 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43c4071030 con 0x55c973d2e4c0 2024-04-24T02:12:27.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.189+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d46d40 con 0x7f43c4074060 2024-04-24T02:12:27.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.189+0000 7f43dba30640 1 -- 172.21.15.134:0/3272465187 <== osd.2 v2:172.21.15.134:6800/214480313 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'31 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43d4040040 con 0x7f43c4074060 2024-04-24T02:12:27.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.190+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d46d40 con 0x55c973d2e4c0 2024-04-24T02:12:27.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.190+0000 7f43d3fff640 1 -- 172.21.15.134:0/3272465187 <== osd.3 v2:172.21.15.134:6801/3585115521 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43c4071030 con 0x55c973d2e4c0 2024-04-24T02:12:27.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.190+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d46d40 con 0x55c973d2e4c0 2024-04-24T02:12:27.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.191+0000 7f43d3fff640 1 -- 172.21.15.134:0/3272465187 <== osd.3 v2:172.21.15.134:6801/3585115521 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'33 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43c4071030 con 0x55c973d2e4c0 2024-04-24T02:12:27.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.191+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d46d40 con 0x55c973d2e4c0 2024-04-24T02:12:27.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.192+0000 7f43d3fff640 1 -- 172.21.15.134:0/3272465187 <== osd.3 v2:172.21.15.134:6801/3585115521 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43c4071030 con 0x55c973d2e4c0 2024-04-24T02:12:27.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.192+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d46d40 con 0x55c973d2e4c0 2024-04-24T02:12:27.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.193+0000 7f43d3fff640 1 -- 172.21.15.134:0/3272465187 <== osd.3 v2:172.21.15.134:6801/3585115521 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'38 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43c4071030 con 0x55c973d2e4c0 2024-04-24T02:12:27.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.193+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d46d40 con 0x7f43d4031040 2024-04-24T02:12:27.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.195+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.0 v2:172.21.15.104:6800/2419146313 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'23 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43cc02d070 con 0x7f43d4031040 2024-04-24T02:12:27.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.195+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d46d40 con 0x55c973d2e4c0 2024-04-24T02:12:27.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.195+0000 7f43d3fff640 1 -- 172.21.15.134:0/3272465187 <== osd.3 v2:172.21.15.134:6801/3585115521 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'27 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43c4071030 con 0x55c973d2e4c0 2024-04-24T02:12:27.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.195+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d46d40 con 0x7f43d4031040 2024-04-24T02:12:27.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.197+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.0 v2:172.21.15.104:6800/2419146313 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'31 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43cc02d070 con 0x7f43d4031040 2024-04-24T02:12:27.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.197+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d46d40 con 0x55c973d2e4c0 2024-04-24T02:12:27.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.198+0000 7f43d3fff640 1 -- 172.21.15.134:0/3272465187 <== osd.3 v2:172.21.15.134:6801/3585115521 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'37 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43c4071030 con 0x55c973d2e4c0 2024-04-24T02:12:27.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.198+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d46d40 con 0x7f43d4031040 2024-04-24T02:12:27.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.199+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.0 v2:172.21.15.104:6800/2419146313 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'42 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43cc02d070 con 0x7f43d4031040 2024-04-24T02:12:27.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.199+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d46d40 con 0x7f43c4074060 2024-04-24T02:12:27.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.200+0000 7f43dba30640 1 -- 172.21.15.134:0/3272465187 <== osd.2 v2:172.21.15.134:6800/214480313 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43d4040040 con 0x7f43c4074060 2024-04-24T02:12:27.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.200+0000 7f4290fe1640 20 reqs_thread_entry: start 2024-04-24T02:12:27.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.201+0000 7f43df531800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:27.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.201+0000 7f43df531800 20 Filter name: none 2024-04-24T02:12:27.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.201+0000 7f420a7fc640 20 reqs_thread_entry: start 2024-04-24T02:12:27.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.201+0000 7f43df531800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-24T02:12:27.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.201+0000 7f43df531800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.201+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c973d71ab0 con 0x7f43d4031040 2024-04-24T02:12:27.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.201+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.0 v2:172.21.15.104:6800/2419146313 24 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f43cc02d070 con 0x7f43d4031040 2024-04-24T02:12:27.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.201+0000 7f43df531800 20 rados_obj.operate() r=0 bl.length=380 2024-04-24T02:12:27.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.201+0000 7f43df531800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-04-24T02:12:27.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.201+0000 7f43df531800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-24T02:12:27.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.201+0000 7f43df531800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:12:27.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.201+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c973d744f0 con 0x7f43d4031040 2024-04-24T02:12:27.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.202+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.0 v2:172.21.15.104:6800/2419146313 25 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 155+0+15 (crc 0 0 0) 0x7f43cc02d070 con 0x7f43d4031040 2024-04-24T02:12:27.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.202+0000 7f43df531800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-04-24T02:12:27.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.202+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d724d0 con 0x7f43d4031040 2024-04-24T02:12:27.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.203+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.0 v2:172.21.15.104:6800/2419146313 26 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v30'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f43cc02d070 con 0x7f43d4031040 2024-04-24T02:12:27.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.203+0000 7f43df531800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-24T02:12:27.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.203+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94323720269792 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c973d74a80 con 0x55c973d2e4c0 2024-04-24T02:12:27.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.203+0000 7f43d3fff640 1 -- 172.21.15.134:0/3272465187 <== osd.3 v2:172.21.15.134:6801/3585115521 26 ==== watch-notify(notify (1) cookie 94323720011920 notify 128849018889 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55c973d45da0 con 0x55c973d2e4c0 2024-04-24T02:12:27.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.203+0000 7f42beffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018889 cookie 94323720011920 notifier 4523 bl.length()=170 2024-04-24T02:12:27.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.203+0000 7f43d3fff640 1 -- 172.21.15.134:0/3272465187 <== osd.3 v2:172.21.15.134:6801/3585115521 27 ==== osd_op_reply(97 notify.2 [notify cookie 94323720269792 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f43c4071030 con 0x55c973d2e4c0 2024-04-24T02:12:27.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.203+0000 7f42beffd640 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f42a0003d60 con 0x55c973d2e4c0 2024-04-24T02:12:27.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.203+0000 7f43d3fff640 1 -- 172.21.15.134:0/3272465187 <== osd.3 v2:172.21.15.134:6801/3585115521 28 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43c4071030 con 0x55c973d2e4c0 2024-04-24T02:12:27.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.204+0000 7f43d3fff640 1 -- 172.21.15.134:0/3272465187 <== osd.3 v2:172.21.15.134:6801/3585115521 29 ==== watch-notify(notify_complete (2) cookie 94323720269792 notify 128849018889 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f43c4085040 con 0x55c973d2e4c0 2024-04-24T02:12:27.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.204+0000 7f43df531800 10 removing email index: 2024-04-24T02:12:27.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.204+0000 7f43df531800 10 removing user buckets index 2024-04-24T02:12:27.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.204+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:99 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d74a00 con 0x7f43d4031040 2024-04-24T02:12:27.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.205+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.0 v2:172.21.15.104:6800/2419146313 27 ==== osd_op_reply(99 fud.buckets [delete] v30'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f43cc02d070 con 0x7f43d4031040 2024-04-24T02:12:27.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.205+0000 7f43df531800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-04-24T02:12:27.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.205+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94323720276480 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c973d73ff0 con 0x7f43d4031040 2024-04-24T02:12:27.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.205+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.0 v2:172.21.15.104:6800/2419146313 28 ==== watch-notify(notify (1) cookie 94323720021808 notify 128849018889 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55c973d46320 con 0x7f43d4031040 2024-04-24T02:12:27.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.205+0000 7f42beffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018889 cookie 94323720021808 notifier 4523 bl.length()=160 2024-04-24T02:12:27.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.205+0000 7f42beffd640 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f42a0003d60 con 0x7f43d4031040 2024-04-24T02:12:27.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.205+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.0 v2:172.21.15.104:6800/2419146313 29 ==== osd_op_reply(100 notify.6 [notify cookie 94323720276480 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f43cc02d070 con 0x7f43d4031040 2024-04-24T02:12:27.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.205+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.0 v2:172.21.15.104:6800/2419146313 30 ==== watch-notify(notify_complete (2) cookie 94323720276480 notify 128849018889 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c973d3a940 con 0x7f43d4031040 2024-04-24T02:12:27.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.205+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.0 v2:172.21.15.104:6800/2419146313 31 ==== osd_op_reply(101 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43cc02d070 con 0x7f43d4031040 2024-04-24T02:12:27.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.205+0000 7f43df531800 10 removing user index: fud 2024-04-24T02:12:27.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.205+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d73ff0 con 0x7f43d4031040 2024-04-24T02:12:27.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.206+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.0 v2:172.21.15.104:6800/2419146313 32 ==== osd_op_reply(102 fud [call,call,delete] v30'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f43cc02d070 con 0x7f43d4031040 2024-04-24T02:12:27.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.206+0000 7f43df531800 10 removing default.rgw.meta+users.uid+fud from cache 2024-04-24T02:12:27.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.206+0000 7f43df531800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-04-24T02:12:27.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.206+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify cookie 94323720275120 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c973d73490 con 0x7f43d4031040 2024-04-24T02:12:27.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.207+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.0 v2:172.21.15.104:6800/2419146313 33 ==== watch-notify(notify (1) cookie 94323720024304 notify 128849018890 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55c973d3a940 con 0x7f43d4031040 2024-04-24T02:12:27.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.207+0000 7f42be7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018890 cookie 94323720024304 notifier 4523 bl.length()=152 2024-04-24T02:12:27.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.207+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.0 v2:172.21.15.104:6800/2419146313 34 ==== osd_op_reply(103 notify.5 [notify cookie 94323720275120 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f43cc02d070 con 0x7f43d4031040 2024-04-24T02:12:27.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.207+0000 7f42be7fc640 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f42100032c0 con 0x7f43d4031040 2024-04-24T02:12:27.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.207+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.0 v2:172.21.15.104:6800/2419146313 35 ==== osd_op_reply(104 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43cc02d070 con 0x7f43d4031040 2024-04-24T02:12:27.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.207+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.0 v2:172.21.15.104:6800/2419146313 36 ==== watch-notify(notify_complete (2) cookie 94323720275120 notify 128849018890 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f43cc036040 con 0x7f43d4031040 2024-04-24T02:12:27.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.208+0000 7f4291fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:27.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.208+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94323720042288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d744b0 con 0x55c973d28270 2024-04-24T02:12:27.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.209+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94323720042288] v30'132 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f43cc02d070 con 0x55c973d28270 2024-04-24T02:12:27.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.209+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94323720006224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d744b0 con 0x7f43c4074060 2024-04-24T02:12:27.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.210+0000 7f43dba30640 1 -- 172.21.15.134:0/3272465187 <== osd.2 v2:172.21.15.134:6800/214480313 18 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94323720006224] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43d4040040 con 0x7f43c4074060 2024-04-24T02:12:27.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.210+0000 7f43df531800 20 remove_watcher() i=0 2024-04-24T02:12:27.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.210+0000 7f43df531800 2 removed watcher, disabling cache 2024-04-24T02:12:27.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.210+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94323720010352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d744b0 con 0x55c973d28270 2024-04-24T02:12:27.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.211+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.1 v2:172.21.15.134:6804/1487076214 30 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94323720010352] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43cc02d070 con 0x55c973d28270 2024-04-24T02:12:27.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.211+0000 7f43df531800 20 remove_watcher() i=1 2024-04-24T02:12:27.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.211+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94323720011920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d33a70 con 0x55c973d2e4c0 2024-04-24T02:12:27.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.212+0000 7f43d3fff640 1 -- 172.21.15.134:0/3272465187 <== osd.3 v2:172.21.15.134:6801/3585115521 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94323720011920] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43c4071030 con 0x55c973d2e4c0 2024-04-24T02:12:27.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.212+0000 7f43df531800 20 remove_watcher() i=2 2024-04-24T02:12:27.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.212+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94323720018256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d34090 con 0x7f43c4074060 2024-04-24T02:12:27.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.213+0000 7f43dba30640 1 -- 172.21.15.134:0/3272465187 <== osd.2 v2:172.21.15.134:6800/214480313 19 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94323720018256] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43d4040040 con 0x7f43c4074060 2024-04-24T02:12:27.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.213+0000 7f43df531800 20 remove_watcher() i=3 2024-04-24T02:12:27.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.213+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94323720019792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d35950 con 0x55c973d28270 2024-04-24T02:12:27.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.214+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.1 v2:172.21.15.134:6804/1487076214 31 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94323720019792] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43cc02d070 con 0x55c973d28270 2024-04-24T02:12:27.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.214+0000 7f43df531800 20 remove_watcher() i=4 2024-04-24T02:12:27.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.214+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94323720024304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d34090 con 0x7f43d4031040 2024-04-24T02:12:27.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.215+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.0 v2:172.21.15.104:6800/2419146313 37 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94323720024304] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43cc02d070 con 0x7f43d4031040 2024-04-24T02:12:27.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.215+0000 7f43df531800 20 remove_watcher() i=5 2024-04-24T02:12:27.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.215+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94323720021808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d35f50 con 0x7f43d4031040 2024-04-24T02:12:27.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.216+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.0 v2:172.21.15.104:6800/2419146313 38 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94323720021808] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43cc02d070 con 0x7f43d4031040 2024-04-24T02:12:27.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.216+0000 7f43df531800 20 remove_watcher() i=6 2024-04-24T02:12:27.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.216+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94323720026480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c973d35950 con 0x7f43d4031040 2024-04-24T02:12:27.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.217+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 <== osd.0 v2:172.21.15.104:6800/2419146313 39 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94323720026480] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43cc02d070 con 0x7f43d4031040 2024-04-24T02:12:27.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.217+0000 7f43df531800 20 remove_watcher() i=7 2024-04-24T02:12:27.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.217+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f43d4031040 msgr2=0x7f43d4032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.217+0000 7f43df531800 1 --2- 172.21.15.134:0/3272465187 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f43d4031040 0x7f43d4032940 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.217+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c973d28270 msgr2=0x55c973d2a730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.217+0000 7f43df531800 1 --2- 172.21.15.134:0/3272465187 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c973d28270 0x55c973d2a730 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.217+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f43c4074060 msgr2=0x7f43c407d440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.217+0000 7f43df531800 1 --2- 172.21.15.134:0/3272465187 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f43c4074060 0x7f43c407d440 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.217+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55c973d2e4c0 msgr2=0x55c973d308b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.217+0000 7f43df531800 1 --2- 172.21.15.134:0/3272465187 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55c973d2e4c0 0x55c973d308b0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.217+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f42a4036950 msgr2=0x7f42a4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.217+0000 7f43df531800 1 --2- 172.21.15.134:0/3272465187 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f42a4036950 0x7f42a4038e10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x55c973cf43d0 tx=0x7f43d401f000 comp rx=0 tx=0).stop 2024-04-24T02:12:27.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.217+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c973d152a0 msgr2=0x55c973d1c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.217+0000 7f43df531800 1 --2- 172.21.15.134:0/3272465187 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c973d152a0 0x55c973d1c980 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f43c4052e00 tx=0x7f43c408de90 comp rx=0 tx=0).stop 2024-04-24T02:12:27.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.217+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 reap_dead start 2024-04-24T02:12:27.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.217+0000 7f43db22f640 1 -- 172.21.15.134:0/3272465187 reap_dead start 2024-04-24T02:12:27.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.217+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 shutdown_connections 2024-04-24T02:12:27.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.217+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 >> 172.21.15.134:0/3272465187 conn(0x55c973d11600 msgr2=0x55c973d0ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:27.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.217+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 shutdown_connections 2024-04-24T02:12:27.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.217+0000 7f43df531800 1 -- 172.21.15.134:0/3272465187 wait complete. 2024-04-24T02:12:27.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.218+0000 7f43df531800 1 -- 172.21.15.134:0/1117490397 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f42b4036900 msgr2=0x7f42b4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.218+0000 7f43df531800 1 --2- 172.21.15.134:0/1117490397 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f42b4036900 0x7f42b4038dc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x55c973cf80b0 tx=0x7f43d4005840 comp rx=0 tx=0).stop 2024-04-24T02:12:27.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.218+0000 7f43df531800 1 -- 172.21.15.134:0/1117490397 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c973d08020 msgr2=0x55c973d08440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.218+0000 7f43df531800 1 --2- 172.21.15.134:0/1117490397 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c973d08020 0x55c973d08440 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f43c4044840 tx=0x7f43c4002fb0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.218+0000 7f43df531800 1 -- 172.21.15.134:0/1117490397 shutdown_connections 2024-04-24T02:12:27.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.218+0000 7f43df531800 1 --2- 172.21.15.134:0/1117490397 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f42b4036900 0x7f42b4038dc0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.218+0000 7f43df531800 1 --2- 172.21.15.134:0/1117490397 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c973d08020 0x55c973d08440 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.218+0000 7f43df531800 1 -- 172.21.15.134:0/1117490397 >> 172.21.15.134:0/1117490397 conn(0x55c973cfc0c0 msgr2=0x55c973cfc4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:27.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.218+0000 7f43df531800 1 -- 172.21.15.134:0/1117490397 shutdown_connections 2024-04-24T02:12:27.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.218+0000 7f43df531800 1 -- 172.21.15.134:0/1117490397 wait complete. 2024-04-24T02:12:27.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.218+0000 7f43df531800 1 -- 172.21.15.134:0/1208945917 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c973bf81f0 msgr2=0x55c973cf6eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.218+0000 7f43df531800 1 --2- 172.21.15.134:0/1208945917 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c973bf81f0 0x55c973cf6eb0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.218+0000 7f43df531800 1 -- 172.21.15.134:0/1208945917 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f42c00369a0 msgr2=0x7f42c0038e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.218+0000 7f43df531800 1 --2- 172.21.15.134:0/1208945917 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f42c00369a0 0x7f42c0038e60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f43c4054000 tx=0x7f43c404e000 comp rx=0 tx=0).stop 2024-04-24T02:12:27.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.218+0000 7f43df531800 1 -- 172.21.15.134:0/1208945917 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c973bf3d60 msgr2=0x55c973cefc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.218+0000 7f43df531800 1 --2- 172.21.15.134:0/1208945917 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c973bf3d60 0x55c973cefc70 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x55c973b67eb0 tx=0x7f43cc000ed0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.218+0000 7f43df531800 1 -- 172.21.15.134:0/1208945917 shutdown_connections 2024-04-24T02:12:27.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.218+0000 7f43df531800 1 --2- 172.21.15.134:0/1208945917 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c973bf81f0 0x55c973cf6eb0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.218+0000 7f43df531800 1 --2- 172.21.15.134:0/1208945917 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f42c00369a0 0x7f42c0038e60 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.218+0000 7f43df531800 1 --2- 172.21.15.134:0/1208945917 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c973bf3d60 0x55c973cefc70 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.218+0000 7f43df531800 1 -- 172.21.15.134:0/1208945917 >> 172.21.15.134:0/1208945917 conn(0x55c973bef320 msgr2=0x55c973cdee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:27.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.218+0000 7f43df531800 1 -- 172.21.15.134:0/1208945917 shutdown_connections 2024-04-24T02:12:27.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.218+0000 7f43df531800 1 -- 172.21.15.134:0/1208945917 wait complete. 2024-04-24T02:12:27.227 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-04-24T02:12:27.228 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-04-24T02:12:27.228 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-04-24T02:12:27.321 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:27.321 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:27.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.320+0000 7f8fa9638800 1 Processor -- start 2024-04-24T02:12:27.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.320+0000 7f8fa9638800 1 -- start start 2024-04-24T02:12:27.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.320+0000 7f8fa9638800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55e51d486930 0x55e51d488d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.320+0000 7f8fa9638800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e51d344d40 con 0x55e51d489260 2024-04-24T02:12:27.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.320+0000 7f8fa9638800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55e51d3174d0 con 0x55e51d486930 2024-04-24T02:12:27.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.320+0000 7f8fa7137640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55e51d486930 0x55e51d488d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.320+0000 7f8fa7137640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55e51d486930 0x55e51d488d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56326/0 (socket says 172.21.15.134:56326) 2024-04-24T02:12:27.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.320+0000 7f8fa7137640 1 -- 172.21.15.134:0/1732538447 learned_addr learned my addr 172.21.15.134:0/1732538447 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:27.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.320+0000 7f8fa6936640 1 --1- 172.21.15.134:0/1732538447 >> v1:172.21.15.104:6789/0 conn(0x55e51d489260 0x55e51d48b650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:55316/0 (socket says 172.21.15.134:55316) 2024-04-24T02:12:27.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.321+0000 7f8fa7137640 1 -- 172.21.15.134:0/1732538447 >> v1:172.21.15.104:6789/0 conn(0x55e51d489260 legacy=0x55e51d48b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.321+0000 7f8fa7137640 1 -- 172.21.15.134:0/1732538447 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e51d343590 con 0x55e51d486930 2024-04-24T02:12:27.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.321+0000 7f8fa6135640 1 -- 172.21.15.134:0/1732538447 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2604226651 0 0) 0x55e51d344d40 con 0x55e51d489260 2024-04-24T02:12:27.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.322+0000 7f8fa7137640 1 --2- 172.21.15.134:0/1732538447 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d486930 0x55e51d488d20 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8f9800a520 tx=0x7f8f9801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eacda7131c1558e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.323+0000 7f8fa6135640 1 -- 172.21.15.134:0/1732538447 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f98057070 con 0x55e51d486930 2024-04-24T02:12:27.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.323+0000 7f8fa6135640 1 -- 172.21.15.134:0/1732538447 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f98052570 con 0x55e51d486930 2024-04-24T02:12:27.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.323+0000 7f8fa6135640 1 -- 172.21.15.134:0/1732538447 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f9804ae60 con 0x55e51d486930 2024-04-24T02:12:27.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.323+0000 7f8fa9638800 1 -- 172.21.15.134:0/1732538447 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d486930 msgr2=0x55e51d488d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.323+0000 7f8fa9638800 1 --2- 172.21.15.134:0/1732538447 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d486930 0x55e51d488d20 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8f9800a520 tx=0x7f8f9801d010 comp rx=0 tx=0).stop 2024-04-24T02:12:27.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.323+0000 7f8fa9638800 1 -- 172.21.15.134:0/1732538447 shutdown_connections 2024-04-24T02:12:27.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.323+0000 7f8fa9638800 1 --2- 172.21.15.134:0/1732538447 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d486930 0x55e51d488d20 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.323+0000 7f8fa9638800 1 -- 172.21.15.134:0/1732538447 >> 172.21.15.134:0/1732538447 conn(0x55e51d4802c0 msgr2=0x55e51d4826e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:27.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.323+0000 7f8fa9638800 1 -- 172.21.15.134:0/1732538447 shutdown_connections 2024-04-24T02:12:27.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.323+0000 7f8fa9638800 1 -- 172.21.15.134:0/1732538447 wait complete. 2024-04-24T02:12:27.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.335+0000 7f8fa9638800 1 Processor -- start 2024-04-24T02:12:27.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.335+0000 7f8fa9638800 1 -- start start 2024-04-24T02:12:27.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.335+0000 7f8fa9638800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d486930 0x55e51d576f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.335+0000 7f8fa9638800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e51d3d1360 con 0x55e51d486930 2024-04-24T02:12:27.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.335+0000 7f8fa7137640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d486930 0x55e51d576f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.335+0000 7f8fa7137640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d486930 0x55e51d576f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56330/0 (socket says 172.21.15.134:56330) 2024-04-24T02:12:27.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.335+0000 7f8fa7137640 1 -- 172.21.15.134:0/113871368 learned_addr learned my addr 172.21.15.134:0/113871368 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:27.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.336+0000 7f8fa7137640 1 -- 172.21.15.134:0/113871368 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e51d577550 con 0x55e51d486930 2024-04-24T02:12:27.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.336+0000 7f8fa7137640 1 --2- 172.21.15.134:0/113871368 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d486930 0x55e51d576f80 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8f98055040 tx=0x7f8f9804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=650a53c1fdda2bf7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.336+0000 7f8e9560a640 1 -- 172.21.15.134:0/113871368 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f98057040 con 0x55e51d486930 2024-04-24T02:12:27.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.336+0000 7f8e9560a640 1 -- 172.21.15.134:0/113871368 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f98052720 con 0x55e51d486930 2024-04-24T02:12:27.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.336+0000 7f8e9560a640 1 -- 172.21.15.134:0/113871368 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f98052a40 con 0x55e51d486930 2024-04-24T02:12:27.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.337+0000 7f8fa9638800 1 -- 172.21.15.134:0/113871368 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d486930 msgr2=0x55e51d576f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.337+0000 7f8fa9638800 1 --2- 172.21.15.134:0/113871368 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d486930 0x55e51d576f80 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8f98055040 tx=0x7f8f9804c000 comp rx=0 tx=0).stop 2024-04-24T02:12:27.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.337+0000 7f8fa9638800 1 -- 172.21.15.134:0/113871368 shutdown_connections 2024-04-24T02:12:27.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.337+0000 7f8fa9638800 1 --2- 172.21.15.134:0/113871368 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d486930 0x55e51d576f80 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.337+0000 7f8fa9638800 1 -- 172.21.15.134:0/113871368 >> 172.21.15.134:0/113871368 conn(0x55e51d4802c0 msgr2=0x55e51d5728a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:27.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.337+0000 7f8fa9638800 1 -- 172.21.15.134:0/113871368 shutdown_connections 2024-04-24T02:12:27.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.337+0000 7f8fa9638800 1 -- 172.21.15.134:0/113871368 wait complete. 2024-04-24T02:12:27.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.337+0000 7f8fa9638800 1 Processor -- start 2024-04-24T02:12:27.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.337+0000 7f8fa9638800 1 -- start start 2024-04-24T02:12:27.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.337+0000 7f8fa9638800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d486930 0x55e51d57e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.337+0000 7f8fa9638800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e51d48f080 con 0x55e51d486930 2024-04-24T02:12:27.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.338+0000 7f8fa7137640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d486930 0x55e51d57e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.338+0000 7f8fa7137640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d486930 0x55e51d57e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56342/0 (socket says 172.21.15.134:56342) 2024-04-24T02:12:27.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.338+0000 7f8fa7137640 1 -- 172.21.15.134:0/1224399475 learned_addr learned my addr 172.21.15.134:0/1224399475 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:27.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.338+0000 7f8fa7137640 1 -- 172.21.15.134:0/1224399475 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e51d57eec0 con 0x55e51d486930 2024-04-24T02:12:27.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.338+0000 7f8fa7137640 1 --2- 172.21.15.134:0/1224399475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d486930 0x55e51d57e980 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f8f980524f0 tx=0x7f8f98003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.338+0000 7f8e93e07640 1 -- 172.21.15.134:0/1224399475 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f98073070 con 0x55e51d486930 2024-04-24T02:12:27.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.338+0000 7f8e93e07640 1 -- 172.21.15.134:0/1224399475 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f9805d440 con 0x55e51d486930 2024-04-24T02:12:27.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.338+0000 7f8e93e07640 1 -- 172.21.15.134:0/1224399475 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f98057070 con 0x55e51d486930 2024-04-24T02:12:27.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.338+0000 7f8fa9638800 1 -- 172.21.15.134:0/1224399475 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e51d57f150 con 0x55e51d486930 2024-04-24T02:12:27.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.338+0000 7f8fa9638800 1 -- 172.21.15.134:0/1224399475 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e51d581db0 con 0x55e51d486930 2024-04-24T02:12:27.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.339+0000 7f8e93e07640 1 -- 172.21.15.134:0/1224399475 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8f98076070 con 0x55e51d486930 2024-04-24T02:12:27.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.339+0000 7f8e93e07640 1 --2- 172.21.15.134:0/1224399475 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8e8c036950 0x7f8e8c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.339+0000 7f8e93e07640 1 -- 172.21.15.134:0/1224399475 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f8f9808daf0 con 0x55e51d486930 2024-04-24T02:12:27.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.339+0000 7f8fa6936640 1 --2- 172.21.15.134:0/1224399475 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8e8c036950 0x7f8e8c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.339+0000 7f8fa9638800 1 --2- 172.21.15.134:0/1224399475 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e51d489260 0x55e51d585b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.339+0000 7f8fa9638800 1 -- 172.21.15.134:0/1224399475 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5860b0 con 0x55e51d489260 2024-04-24T02:12:27.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.339+0000 7f8fa7938640 1 --2- 172.21.15.134:0/1224399475 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e51d489260 0x55e51d585b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.340+0000 7f8fa6936640 1 --2- 172.21.15.134:0/1224399475 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8e8c036950 0x7f8e8c038e10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c000c00 tx=0x7f8f9c0013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.340+0000 7f8fa7938640 1 --2- 172.21.15.134:0/1224399475 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e51d489260 0x55e51d585b70 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.340+0000 7f8fa7938640 1 -- 172.21.15.134:0/1224399475 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fa000a4a0 con 0x55e51d489260 2024-04-24T02:12:27.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.340+0000 7f8fa9638800 1 -- 172.21.15.134:0/1224399475 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5830e0 con 0x55e51d489260 2024-04-24T02:12:27.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.340+0000 7f8fa7938640 1 -- 172.21.15.134:0/1224399475 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8fa000a4a0 con 0x55e51d489260 2024-04-24T02:12:27.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.340+0000 7f8fa9638800 1 -- 172.21.15.134:0/1224399475 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e51d587e70 con 0x55e51d489260 2024-04-24T02:12:27.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.341+0000 7f8fa7938640 1 -- 172.21.15.134:0/1224399475 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8fa000a4a0 con 0x55e51d489260 2024-04-24T02:12:27.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.341+0000 7f8fa9638800 1 -- 172.21.15.134:0/1224399475 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5871b0 con 0x55e51d489260 2024-04-24T02:12:27.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.341+0000 7f8fa7938640 1 -- 172.21.15.134:0/1224399475 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8fa000a4a0 con 0x55e51d489260 2024-04-24T02:12:27.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.341+0000 7f8fa9638800 1 -- 172.21.15.134:0/1224399475 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5875d0 con 0x55e51d489260 2024-04-24T02:12:27.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.341+0000 7f8fa7938640 1 -- 172.21.15.134:0/1224399475 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8fa000a4a0 con 0x55e51d489260 2024-04-24T02:12:27.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.341+0000 7f8fa9638800 1 Processor -- start 2024-04-24T02:12:27.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.341+0000 7f8fa9638800 1 -- start start 2024-04-24T02:12:27.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.342+0000 7f8fa9638800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d4864b0 0x55e51d484920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.342+0000 7f8fa9638800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e51d3776b0 con 0x55e51d4864b0 2024-04-24T02:12:27.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.342+0000 7f8fa6936640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d4864b0 0x55e51d484920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.342+0000 7f8fa6936640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d4864b0 0x55e51d484920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56354/0 (socket says 172.21.15.134:56354) 2024-04-24T02:12:27.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.342+0000 7f8fa6936640 1 -- 172.21.15.134:0/101359531 learned_addr learned my addr 172.21.15.134:0/101359531 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:27.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.342+0000 7f8fa6936640 1 -- 172.21.15.134:0/101359531 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e51d484e60 con 0x55e51d4864b0 2024-04-24T02:12:27.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.342+0000 7f8fa6936640 1 --2- 172.21.15.134:0/101359531 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d4864b0 0x55e51d484920 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c00e610 tx=0x7f8f9c00ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.342+0000 7f8e91602640 1 -- 172.21.15.134:0/101359531 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f9c022070 con 0x55e51d4864b0 2024-04-24T02:12:27.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.342+0000 7f8e91602640 1 -- 172.21.15.134:0/101359531 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f9c009050 con 0x55e51d4864b0 2024-04-24T02:12:27.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.342+0000 7f8fa9638800 1 -- 172.21.15.134:0/101359531 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e51d485090 con 0x55e51d4864b0 2024-04-24T02:12:27.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.342+0000 7f8e91602640 1 -- 172.21.15.134:0/101359531 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f9c00d500 con 0x55e51d4864b0 2024-04-24T02:12:27.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.343+0000 7f8fa9638800 1 -- 172.21.15.134:0/101359531 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e51d485590 con 0x55e51d4864b0 2024-04-24T02:12:27.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.343+0000 7f8e91602640 1 -- 172.21.15.134:0/101359531 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8f9c025070 con 0x55e51d4864b0 2024-04-24T02:12:27.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.343+0000 7f8e91602640 1 --2- 172.21.15.134:0/101359531 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8e80036900 0x7f8e80038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.343+0000 7f8e91602640 1 -- 172.21.15.134:0/101359531 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f8f9c04d970 con 0x55e51d4864b0 2024-04-24T02:12:27.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.343+0000 7f8fa7938640 1 --2- 172.21.15.134:0/101359531 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8e80036900 0x7f8e80038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.344+0000 7f8fa9638800 1 Processor -- start 2024-04-24T02:12:27.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.344+0000 7f8fa9638800 1 -- start start 2024-04-24T02:12:27.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.344+0000 7f8fa7938640 1 --2- 172.21.15.134:0/101359531 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8e80036900 0x7f8e80038dc0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x55e51d587550 tx=0x7f8fa0005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.344+0000 7f8fa9638800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d5a61d0 0x55e51d5a65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.344+0000 7f8fa9638800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e51d577810 con 0x55e51d5a61d0 2024-04-24T02:12:27.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.344+0000 7f8fa6936640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d5a61d0 0x55e51d5a65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.344+0000 7f8fa6936640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d5a61d0 0x55e51d5a65f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56366/0 (socket says 172.21.15.134:56366) 2024-04-24T02:12:27.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.344+0000 7f8fa6936640 1 -- 172.21.15.134:0/3366356314 learned_addr learned my addr 172.21.15.134:0/3366356314 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:27.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.344+0000 7f8fa6936640 1 -- 172.21.15.134:0/3366356314 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e51d5a6bc0 con 0x55e51d5a61d0 2024-04-24T02:12:27.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.344+0000 7f8fa6936640 1 --2- 172.21.15.134:0/3366356314 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d5a61d0 0x55e51d5a65f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c04bf40 tx=0x7f8f9c026680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b50de780f37eb532 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.344+0000 7f8e8affd640 1 -- 172.21.15.134:0/3366356314 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f9c04a030 con 0x55e51d5a61d0 2024-04-24T02:12:27.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.345+0000 7f8e8affd640 1 -- 172.21.15.134:0/3366356314 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f9c0401f0 con 0x55e51d5a61d0 2024-04-24T02:12:27.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.345+0000 7f8e8affd640 1 -- 172.21.15.134:0/3366356314 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f9c01ad70 con 0x55e51d5a61d0 2024-04-24T02:12:27.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.345+0000 7f8fa9638800 1 -- 172.21.15.134:0/3366356314 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d5a61d0 msgr2=0x55e51d5a65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.345+0000 7f8fa9638800 1 --2- 172.21.15.134:0/3366356314 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d5a61d0 0x55e51d5a65f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c04bf40 tx=0x7f8f9c026680 comp rx=0 tx=0).stop 2024-04-24T02:12:27.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.345+0000 7f8fa9638800 1 -- 172.21.15.134:0/3366356314 shutdown_connections 2024-04-24T02:12:27.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.345+0000 7f8fa9638800 1 --2- 172.21.15.134:0/3366356314 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d5a61d0 0x55e51d5a65f0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.345+0000 7f8fa9638800 1 -- 172.21.15.134:0/3366356314 >> 172.21.15.134:0/3366356314 conn(0x55e51d5a2530 msgr2=0x55e51d5a0590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:27.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.345+0000 7f8fa9638800 1 -- 172.21.15.134:0/3366356314 shutdown_connections 2024-04-24T02:12:27.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.345+0000 7f8fa9638800 1 -- 172.21.15.134:0/3366356314 wait complete. 2024-04-24T02:12:27.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.345+0000 7f8fa9638800 1 Processor -- start 2024-04-24T02:12:27.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.345+0000 7f8fa9638800 1 -- start start 2024-04-24T02:12:27.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.345+0000 7f8fa9638800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d5a61d0 0x55e51d5ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.346+0000 7f8fa9638800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e51d5a7330 con 0x55e51d5a61d0 2024-04-24T02:12:27.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.346+0000 7f8fa6936640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d5a61d0 0x55e51d5ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.346+0000 7f8fa6936640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d5a61d0 0x55e51d5ad840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56382/0 (socket says 172.21.15.134:56382) 2024-04-24T02:12:27.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.346+0000 7f8fa6936640 1 -- 172.21.15.134:0/2139835337 learned_addr learned my addr 172.21.15.134:0/2139835337 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:27.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.346+0000 7f8fa6936640 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e51d5add80 con 0x55e51d5a61d0 2024-04-24T02:12:27.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.346+0000 7f8fa6936640 1 --2- 172.21.15.134:0/2139835337 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d5a61d0 0x55e51d5ad840 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c024840 tx=0x7f8f9c04bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.346+0000 7f8e897fa640 1 -- 172.21.15.134:0/2139835337 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f9c045040 con 0x55e51d5a61d0 2024-04-24T02:12:27.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.346+0000 7f8e897fa640 1 -- 172.21.15.134:0/2139835337 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f9c00d6a0 con 0x55e51d5a61d0 2024-04-24T02:12:27.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.346+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e51d5ae010 con 0x55e51d5a61d0 2024-04-24T02:12:27.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.346+0000 7f8e897fa640 1 -- 172.21.15.134:0/2139835337 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f9c00d980 con 0x55e51d5a61d0 2024-04-24T02:12:27.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.346+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e51d5b0cc0 con 0x55e51d5a61d0 2024-04-24T02:12:27.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.347+0000 7f8e897fa640 1 -- 172.21.15.134:0/2139835337 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8f9c04dd10 con 0x55e51d5a61d0 2024-04-24T02:12:27.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.347+0000 7f8e897fa640 1 --2- 172.21.15.134:0/2139835337 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8e70036900 0x7f8e70038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.347+0000 7f8e897fa640 1 -- 172.21.15.134:0/2139835337 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f8f9c02c9b0 con 0x55e51d5a61d0 2024-04-24T02:12:27.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.347+0000 7f8fa7938640 1 --2- 172.21.15.134:0/2139835337 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8e70036900 0x7f8e70038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.347+0000 7f8fa9638800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.347+0000 7f8fa7938640 1 --2- 172.21.15.134:0/2139835337 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8e70036900 0x7f8e70038dc0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x55e51d586cd0 tx=0x7f8fa001f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.347+0000 7f8fa9638800 1 --2- 172.21.15.134:0/2139835337 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e51d5b92f0 0x55e51d5bb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.348+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5bbf00 con 0x55e51d5b92f0 2024-04-24T02:12:27.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.348+0000 7f8fa7137640 1 --2- 172.21.15.134:0/2139835337 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e51d5b92f0 0x55e51d5bb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.348+0000 7f8fa7137640 1 --2- 172.21.15.134:0/2139835337 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e51d5b92f0 0x55e51d5bb7b0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.348+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f98075030 con 0x55e51d5b92f0 2024-04-24T02:12:27.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.348+0000 7f8fa9638800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.348+0000 7f8fa9638800 20 realm 2024-04-24T02:12:27.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.348+0000 7f8fa9638800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.348+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5bc310 con 0x55e51d5b92f0 2024-04-24T02:12:27.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.348+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f98075030 con 0x55e51d5b92f0 2024-04-24T02:12:27.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.348+0000 7f8fa9638800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.348+0000 7f8fa9638800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:27.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.348+0000 7f8fa9638800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.348+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5bcbe0 con 0x55e51d5b92f0 2024-04-24T02:12:27.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.349+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f98075030 con 0x55e51d5b92f0 2024-04-24T02:12:27.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.349+0000 7f8fa9638800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.349+0000 7f8fa9638800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.349+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5bcf80 con 0x55e51d5b92f0 2024-04-24T02:12:27.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.349+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8f98075030 con 0x55e51d5b92f0 2024-04-24T02:12:27.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.349+0000 7f8fa9638800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:27.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.349+0000 7f8fa9638800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.349+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5bd7d0 con 0x55e51d5b92f0 2024-04-24T02:12:27.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.349+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8f98075030 con 0x55e51d5b92f0 2024-04-24T02:12:27.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.349+0000 7f8fa9638800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:27.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.349+0000 7f8fa9638800 20 searching for the correct realm 2024-04-24T02:12:27.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.349+0000 7f8fa9638800 1 --2- 172.21.15.134:0/2139835337 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55e51d5bf540 0x55e51d5c1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.349+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c1f40 con 0x55e51d5bf540 2024-04-24T02:12:27.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.349+0000 7f8fa6936640 1 --2- 172.21.15.134:0/2139835337 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55e51d5bf540 0x55e51d5c1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.350+0000 7f8fa6936640 1 --2- 172.21.15.134:0/2139835337 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55e51d5bf540 0x55e51d5c1930 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.350+0000 7f8fa6936640 1 -- 172.21.15.134:0/2139835337 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9c024030 con 0x55e51d5bf540 2024-04-24T02:12:27.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.350+0000 7f8fa6936640 1 --2- 172.21.15.134:0/2139835337 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f8f9c036070 0x7f8f9c03a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.350+0000 7f8fa6936640 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c1f40 con 0x7f8f9c036070 2024-04-24T02:12:27.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.350+0000 7f8fa7938640 1 --2- 172.21.15.134:0/2139835337 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f8f9c036070 0x7f8f9c03a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.350+0000 7f8fa7938640 1 --2- 172.21.15.134:0/2139835337 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f8f9c036070 0x7f8f9c03a1c0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.351+0000 7f8fa7938640 1 -- 172.21.15.134:0/2139835337 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa001f070 con 0x7f8f9c036070 2024-04-24T02:12:27.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.351+0000 7f8fa7938640 1 --2- 172.21.15.134:0/2139835337 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f8fa0031040 0x7f8fa0032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.351+0000 7f8fa7938640 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c1f40 con 0x7f8fa0031040 2024-04-24T02:12:27.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.351+0000 7f8fa7137640 1 --2- 172.21.15.134:0/2139835337 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f8fa0031040 0x7f8fa0032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.351+0000 7f8fa7137640 1 --2- 172.21.15.134:0/2139835337 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f8fa0031040 0x7f8fa0032940 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.351+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f98075030 con 0x7f8fa0031040 2024-04-24T02:12:27.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.351+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c1f40 con 0x55e51d5b92f0 2024-04-24T02:12:27.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.352+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f98075030 con 0x55e51d5b92f0 2024-04-24T02:12:27.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.352+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c1f40 con 0x55e51d5b92f0 2024-04-24T02:12:27.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.352+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8f98075030 con 0x55e51d5b92f0 2024-04-24T02:12:27.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.352+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c1f40 con 0x7f8fa0031040 2024-04-24T02:12:27.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.352+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f98075030 con 0x7f8fa0031040 2024-04-24T02:12:27.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.352+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c1f40 con 0x7f8fa0031040 2024-04-24T02:12:27.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.352+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f98075030 con 0x7f8fa0031040 2024-04-24T02:12:27.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.352+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c1f40 con 0x7f8f9c036070 2024-04-24T02:12:27.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.353+0000 7f8fa7938640 1 -- 172.21.15.134:0/2139835337 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa001f070 con 0x7f8f9c036070 2024-04-24T02:12:27.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.353+0000 7f8fa7938640 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c1f40 con 0x55e51d5bf540 2024-04-24T02:12:27.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.353+0000 7f8fa6936640 1 -- 172.21.15.134:0/2139835337 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9c024030 con 0x55e51d5bf540 2024-04-24T02:12:27.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.353+0000 7f8fa6936640 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c1f40 con 0x55e51d5b92f0 2024-04-24T02:12:27.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.353+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f98075030 con 0x55e51d5b92f0 2024-04-24T02:12:27.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.353+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c1f40 con 0x7f8fa0031040 2024-04-24T02:12:27.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.353+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f98075030 con 0x7f8fa0031040 2024-04-24T02:12:27.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.353+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c1f40 con 0x55e51d5b92f0 2024-04-24T02:12:27.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.353+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f98075030 con 0x55e51d5b92f0 2024-04-24T02:12:27.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.353+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c1f40 con 0x7f8f9c036070 2024-04-24T02:12:27.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.354+0000 7f8fa7938640 1 -- 172.21.15.134:0/2139835337 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8fa001f070 con 0x7f8f9c036070 2024-04-24T02:12:27.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.354+0000 7f8fa7938640 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c1f40 con 0x55e51d5bf540 2024-04-24T02:12:27.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.354+0000 7f8fa6936640 1 -- 172.21.15.134:0/2139835337 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9c024030 con 0x55e51d5bf540 2024-04-24T02:12:27.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.354+0000 7f8fa6936640 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c1f40 con 0x55e51d5bf540 2024-04-24T02:12:27.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.354+0000 7f8fa6936640 1 -- 172.21.15.134:0/2139835337 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9c024030 con 0x55e51d5bf540 2024-04-24T02:12:27.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.354+0000 7f8fa6936640 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c1f40 con 0x7f8fa0031040 2024-04-24T02:12:27.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.354+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f98075030 con 0x7f8fa0031040 2024-04-24T02:12:27.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.354+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c1f40 con 0x55e51d5bf540 2024-04-24T02:12:27.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.355+0000 7f8fa6936640 1 -- 172.21.15.134:0/2139835337 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9c024030 con 0x55e51d5bf540 2024-04-24T02:12:27.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.355+0000 7f8fa6936640 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c1f40 con 0x55e51d5bf540 2024-04-24T02:12:27.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.355+0000 7f8fa6936640 1 -- 172.21.15.134:0/2139835337 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9c024030 con 0x55e51d5bf540 2024-04-24T02:12:27.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.355+0000 7f8fa6936640 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c1f40 con 0x55e51d5b92f0 2024-04-24T02:12:27.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.355+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f98075030 con 0x55e51d5b92f0 2024-04-24T02:12:27.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.355+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c1f40 con 0x55e51d5b92f0 2024-04-24T02:12:27.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.355+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f8f98075030 con 0x55e51d5b92f0 2024-04-24T02:12:27.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.355+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c1f40 con 0x7f8fa0031040 2024-04-24T02:12:27.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.356+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f98075030 con 0x7f8fa0031040 2024-04-24T02:12:27.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.356+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c1f40 con 0x55e51d5bf540 2024-04-24T02:12:27.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.356+0000 7f8fa6936640 1 -- 172.21.15.134:0/2139835337 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9c024030 con 0x55e51d5bf540 2024-04-24T02:12:27.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.356+0000 7f8fa6936640 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c1f40 con 0x7f8f9c036070 2024-04-24T02:12:27.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.356+0000 7f8fa7938640 1 -- 172.21.15.134:0/2139835337 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa001f070 con 0x7f8f9c036070 2024-04-24T02:12:27.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.356+0000 7f8fa7938640 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c1f40 con 0x55e51d5b92f0 2024-04-24T02:12:27.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.356+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f98075030 con 0x55e51d5b92f0 2024-04-24T02:12:27.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.356+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c1f40 con 0x7f8fa0031040 2024-04-24T02:12:27.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.356+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f98075030 con 0x7f8fa0031040 2024-04-24T02:12:27.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.356+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c1f40 con 0x55e51d5bf540 2024-04-24T02:12:27.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.357+0000 7f8fa6936640 1 -- 172.21.15.134:0/2139835337 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9c024030 con 0x55e51d5bf540 2024-04-24T02:12:27.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.357+0000 7f8fa6936640 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c1f40 con 0x7f8fa0031040 2024-04-24T02:12:27.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.357+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f98075030 con 0x7f8fa0031040 2024-04-24T02:12:27.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.357+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c1f40 con 0x7f8f9c036070 2024-04-24T02:12:27.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.357+0000 7f8fa7938640 1 -- 172.21.15.134:0/2139835337 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa001f070 con 0x7f8f9c036070 2024-04-24T02:12:27.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.357+0000 7f8fa7938640 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c1f40 con 0x55e51d5bf540 2024-04-24T02:12:27.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.357+0000 7f8fa6936640 1 -- 172.21.15.134:0/2139835337 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9c024030 con 0x55e51d5bf540 2024-04-24T02:12:27.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.357+0000 7f8fa6936640 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c1f40 con 0x7f8fa0031040 2024-04-24T02:12:27.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.358+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f98075030 con 0x7f8fa0031040 2024-04-24T02:12:27.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.358+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c1f40 con 0x55e51d5b92f0 2024-04-24T02:12:27.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.358+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8f98075030 con 0x55e51d5b92f0 2024-04-24T02:12:27.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.358+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c1f40 con 0x7f8f9c036070 2024-04-24T02:12:27.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.359+0000 7f8fa7938640 1 -- 172.21.15.134:0/2139835337 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa001f070 con 0x7f8f9c036070 2024-04-24T02:12:27.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.359+0000 7f8fa9638800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:27.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.359+0000 7f8fa9638800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:27.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.359+0000 7f8fa9638800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:27.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.359+0000 7f8fa9638800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:27.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.359+0000 7f8fa9638800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:27.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.359+0000 7f8fa9638800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:27.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.359+0000 7f8fa9638800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.359+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5be180 con 0x55e51d5b92f0 2024-04-24T02:12:27.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.359+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f98075030 con 0x55e51d5b92f0 2024-04-24T02:12:27.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.359+0000 7f8fa9638800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.359+0000 7f8fa9638800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.359+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5bea20 con 0x55e51d5b92f0 2024-04-24T02:12:27.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.359+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8f98075030 con 0x55e51d5b92f0 2024-04-24T02:12:27.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.359+0000 7f8fa9638800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:27.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.359+0000 7f8fa9638800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.359+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c23a0 con 0x55e51d5b92f0 2024-04-24T02:12:27.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.359+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8f98075030 con 0x55e51d5b92f0 2024-04-24T02:12:27.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.359+0000 7f8fa9638800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:27.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.359+0000 7f8fa9638800 20 zone default found 2024-04-24T02:12:27.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.359+0000 7f8fa9638800 4 Realm: () 2024-04-24T02:12:27.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.359+0000 7f8fa9638800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:27.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.359+0000 7f8fa9638800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:27.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.359+0000 7f8fa9638800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:27.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.359+0000 7f8fa9638800 20 zonegroup default 2024-04-24T02:12:27.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.359+0000 7f8fa9638800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.359+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c2850 con 0x7f8fa0031040 2024-04-24T02:12:27.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.360+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8f98075030 con 0x7f8fa0031040 2024-04-24T02:12:27.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.360+0000 7f8fa9638800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.360+0000 7f8fa9638800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.360+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c4230 con 0x55e51d5bf540 2024-04-24T02:12:27.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.360+0000 7f8fa6936640 1 -- 172.21.15.134:0/2139835337 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8f9c024030 con 0x55e51d5bf540 2024-04-24T02:12:27.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.360+0000 7f8fa9638800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.360+0000 7f8fa9638800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.360+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c46a0 con 0x55e51d5bf540 2024-04-24T02:12:27.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.360+0000 7f8fa6936640 1 -- 172.21.15.134:0/2139835337 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8f9c024030 con 0x55e51d5bf540 2024-04-24T02:12:27.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.360+0000 7f8fa9638800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.360+0000 7f8fa9638800 20 started sync module instance, tier type = 2024-04-24T02:12:27.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.360+0000 7f8fa9638800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:27.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.360+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c36c0 con 0x7f8f9c036070 2024-04-24T02:12:27.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.361+0000 7f8fa7938640 1 -- 172.21.15.134:0/2139835337 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fa0040040 con 0x7f8f9c036070 2024-04-24T02:12:27.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.361+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94442528455344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c4fb0 con 0x7f8f9c036070 2024-04-24T02:12:27.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.361+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c5800 con 0x55e51d5b92f0 2024-04-24T02:12:27.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.362+0000 7f8fa7938640 1 -- 172.21.15.134:0/2139835337 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94442528455344] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fa0040040 con 0x7f8f9c036070 2024-04-24T02:12:27.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.362+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f98075030 con 0x55e51d5b92f0 2024-04-24T02:12:27.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.362+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94442528459520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c5450 con 0x55e51d5b92f0 2024-04-24T02:12:27.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.363+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c5f70 con 0x55e51d5bf540 2024-04-24T02:12:27.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.364+0000 7f8fa6936640 1 -- 172.21.15.134:0/2139835337 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c024030 con 0x55e51d5bf540 2024-04-24T02:12:27.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.364+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94442528463424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c6810 con 0x55e51d5bf540 2024-04-24T02:12:27.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.364+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c72c0 con 0x7f8f9c036070 2024-04-24T02:12:27.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.364+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94442528459520] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f98075030 con 0x55e51d5b92f0 2024-04-24T02:12:27.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.365+0000 7f8fa6936640 1 -- 172.21.15.134:0/2139835337 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94442528463424] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c024030 con 0x55e51d5bf540 2024-04-24T02:12:27.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.365+0000 7f8fa7938640 1 -- 172.21.15.134:0/2139835337 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fa0040040 con 0x7f8f9c036070 2024-04-24T02:12:27.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.365+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94442528465760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c6da0 con 0x7f8f9c036070 2024-04-24T02:12:27.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.365+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c7ba0 con 0x55e51d5b92f0 2024-04-24T02:12:27.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.366+0000 7f8fa7938640 1 -- 172.21.15.134:0/2139835337 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94442528465760] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fa0040040 con 0x7f8f9c036070 2024-04-24T02:12:27.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.366+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f98075030 con 0x55e51d5b92f0 2024-04-24T02:12:27.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.366+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94442528460576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c7b60 con 0x55e51d5b92f0 2024-04-24T02:12:27.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.366+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c85d0 con 0x7f8fa0031040 2024-04-24T02:12:27.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.367+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94442528460576] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f98075030 con 0x55e51d5b92f0 2024-04-24T02:12:27.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.367+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f98075030 con 0x7f8fa0031040 2024-04-24T02:12:27.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.367+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94442528473344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c7b60 con 0x7f8fa0031040 2024-04-24T02:12:27.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.367+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c9010 con 0x7f8fa0031040 2024-04-24T02:12:27.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.368+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(56 notify.6 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f98075030 con 0x7f8fa0031040 2024-04-24T02:12:27.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.368+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94442528473344] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f98075030 con 0x7f8fa0031040 2024-04-24T02:12:27.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.368+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94442528476000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c9430 con 0x7f8fa0031040 2024-04-24T02:12:27.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.368+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c76d0 con 0x7f8fa0031040 2024-04-24T02:12:27.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.369+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(58 notify.7 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f98075030 con 0x7f8fa0031040 2024-04-24T02:12:27.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.369+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94442528476000] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f98075030 con 0x7f8fa0031040 2024-04-24T02:12:27.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.369+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94442528470736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c9ed0 con 0x7f8fa0031040 2024-04-24T02:12:27.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.369+0000 7f8fa9638800 20 add_watcher() i=0 2024-04-24T02:12:27.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.369+0000 7f8fa9638800 20 add_watcher() i=1 2024-04-24T02:12:27.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.369+0000 7f8fa9638800 20 add_watcher() i=2 2024-04-24T02:12:27.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.369+0000 7f8fa9638800 20 add_watcher() i=3 2024-04-24T02:12:27.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.369+0000 7f8fa9638800 20 add_watcher() i=4 2024-04-24T02:12:27.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.369+0000 7f8fa9638800 20 add_watcher() i=5 2024-04-24T02:12:27.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.369+0000 7f8fa9638800 20 add_watcher() i=6 2024-04-24T02:12:27.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.370+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94442528470736] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f98075030 con 0x7f8fa0031040 2024-04-24T02:12:27.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.370+0000 7f8fa9638800 20 add_watcher() i=7 2024-04-24T02:12:27.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.370+0000 7f8fa9638800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:27.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.370+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c9ed0 con 0x55e51d5b92f0 2024-04-24T02:12:27.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.370+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8f98075030 con 0x55e51d5b92f0 2024-04-24T02:12:27.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.370+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94442528479776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5ca770 con 0x55e51d5b92f0 2024-04-24T02:12:27.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.371+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94442528479776] v30'133 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8f98075030 con 0x55e51d5b92f0 2024-04-24T02:12:27.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.371+0000 7f8e5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:27.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.371+0000 7f8fa9638800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:27.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.371+0000 7f8fa9638800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:27.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.371+0000 7f8fa9638800 5 note: GC not initialized 2024-04-24T02:12:27.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.371+0000 7f8e5cfe1640 20 reqs_thread_entry: start 2024-04-24T02:12:27.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.371+0000 7f8fa9638800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:27.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.371+0000 7f8fa9638800 20 Filter name: none 2024-04-24T02:12:27.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.372+0000 7f8dd67fc640 20 reqs_thread_entry: start 2024-04-24T02:12:27.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.372+0000 7f8fa9638800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-04-24T02:12:27.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.372+0000 7f8fa9638800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.372+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e51d6003d0 con 0x7f8fa0031040 2024-04-24T02:12:27.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.372+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 246+0+0 (crc 0 0 0) 0x7f8f98075030 con 0x7f8fa0031040 2024-04-24T02:12:27.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.372+0000 7f8fa9638800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.372+0000 7f8fa9638800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-04-24T02:12:27.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.372+0000 7f8fa9638800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-04-24T02:12:27.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.372+0000 7f8fa9638800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-04-24T02:12:27.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.372+0000 7f8fa9638800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.372+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5feac0 con 0x7f8fa0031040 2024-04-24T02:12:27.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.372+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f8f98075030 con 0x7f8fa0031040 2024-04-24T02:12:27.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.372+0000 7f8fa9638800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.372+0000 7f8fa9638800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-04-24T02:12:27.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.372+0000 7f8fa9638800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-24T02:12:27.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.372+0000 7f8fa9638800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-24T02:12:27.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.372+0000 7f8fa9638800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-24T02:12:27.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.372+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~419 in=419b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d6030e0 con 0x7f8fa0031040 2024-04-24T02:12:27.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.373+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~419] v30'5 uv5 ondisk = 0) ==== 288+0+0 (crc 0 0 0) 0x7f8f98075030 con 0x7f8fa0031040 2024-04-24T02:12:27.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.373+0000 7f8fa9638800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-04-24T02:12:27.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.373+0000 7f8fa9638800 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-04-24T02:12:27.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.373+0000 7f8fa9638800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-04-24T02:12:27.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.373+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 94442528714976 in=622b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e51d603b90 con 0x7f8f9c036070 2024-04-24T02:12:27.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.374+0000 7f8fa7938640 1 -- 172.21.15.134:0/2139835337 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== watch-notify(notify (1) cookie 94442528465760 notify 128849018892 ret 0) ==== 652+0+0 (crc 0 0 0) 0x7f8fa0024680 con 0x7f8f9c036070 2024-04-24T02:12:27.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.374+0000 7f8e8affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018892 cookie 94442528465760 notifier 4530 bl.length()=610 2024-04-24T02:12:27.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.374+0000 7f8fa7938640 1 -- 172.21.15.134:0/2139835337 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(65 notify.3 [notify cookie 94442528714976 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8fa0040040 con 0x7f8f9c036070 2024-04-24T02:12:27.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.374+0000 7f8e8affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-04-24T02:12:27.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.374+0000 7f8e8affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-04-24T02:12:27.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.374+0000 7f8e8affd640 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f8e6c003ea0 con 0x7f8f9c036070 2024-04-24T02:12:27.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.374+0000 7f8fa7938640 1 -- 172.21.15.134:0/2139835337 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fa0040040 con 0x7f8f9c036070 2024-04-24T02:12:27.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.374+0000 7f8fa7938640 1 -- 172.21.15.134:0/2139835337 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== watch-notify(notify_complete (2) cookie 94442528714976 notify 128849018892 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f8fa0024850 con 0x7f8f9c036070 2024-04-24T02:12:27.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.374+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d6030e0 con 0x7f8fa0031040 2024-04-24T02:12:27.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.375+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 <== osd.0 v2:172.21.15.104:6800/2419146313 20 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v30'6 uv6 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f8f98075030 con 0x7f8fa0031040 2024-04-24T02:12:27.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.375+0000 7f8fa9638800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-24T02:12:27.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.375+0000 7f8fa9638800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-24T02:12:27.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.375+0000 7f8fa9638800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-24T02:12:27.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.375+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94442528714976 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e51d603b90 con 0x55e51d5bf540 2024-04-24T02:12:27.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.375+0000 7f8fa6936640 1 -- 172.21.15.134:0/2139835337 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== watch-notify(notify (1) cookie 94442528463424 notify 128849018890 ret 0) ==== 234+0+0 (crc 0 0 0) 0x55e51d5ae010 con 0x55e51d5bf540 2024-04-24T02:12:27.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.375+0000 7f8e8affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018890 cookie 94442528463424 notifier 4530 bl.length()=192 2024-04-24T02:12:27.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.375+0000 7f8e8affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-24T02:12:27.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.375+0000 7f8e8affd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-24T02:12:27.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.375+0000 7f8fa6936640 1 -- 172.21.15.134:0/2139835337 <== osd.3 v2:172.21.15.134:6801/3585115521 15 ==== osd_op_reply(68 notify.2 [notify cookie 94442528714976 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8f9c024030 con 0x55e51d5bf540 2024-04-24T02:12:27.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.375+0000 7f8e8affd640 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f8e6c003ea0 con 0x55e51d5bf540 2024-04-24T02:12:27.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.376+0000 7f8fa6936640 1 -- 172.21.15.134:0/2139835337 <== osd.3 v2:172.21.15.134:6801/3585115521 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c024030 con 0x55e51d5bf540 2024-04-24T02:12:27.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.376+0000 7f8fa6936640 1 -- 172.21.15.134:0/2139835337 <== osd.3 v2:172.21.15.134:6801/3585115521 17 ==== watch-notify(notify_complete (2) cookie 94442528714976 notify 128849018890 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f8f9c071040 con 0x55e51d5bf540 2024-04-24T02:12:27.395 INFO:teuthology.orchestra.run.smithi134.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-04-24T02:12:27.374069Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T02:12:27.374054Z","tags":[],"group_ids":[]} 2024-04-24T02:12:27.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.377+0000 7f8e5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:27.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.377+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94442528479776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5ff230 con 0x55e51d5b92f0 2024-04-24T02:12:27.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.378+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94442528479776] v30'134 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8f98075030 con 0x55e51d5b92f0 2024-04-24T02:12:27.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.378+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94442528455344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c9a20 con 0x7f8f9c036070 2024-04-24T02:12:27.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.379+0000 7f8fa7938640 1 -- 172.21.15.134:0/2139835337 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94442528455344] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fa0040040 con 0x7f8f9c036070 2024-04-24T02:12:27.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.379+0000 7f8fa9638800 20 remove_watcher() i=0 2024-04-24T02:12:27.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.379+0000 7f8fa9638800 2 removed watcher, disabling cache 2024-04-24T02:12:27.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.379+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94442528459520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c9a20 con 0x55e51d5b92f0 2024-04-24T02:12:27.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.380+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94442528459520] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f98075030 con 0x55e51d5b92f0 2024-04-24T02:12:27.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.380+0000 7f8fa9638800 20 remove_watcher() i=1 2024-04-24T02:12:27.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.380+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94442528463424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c4b00 con 0x55e51d5bf540 2024-04-24T02:12:27.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.381+0000 7f8fa6936640 1 -- 172.21.15.134:0/2139835337 <== osd.3 v2:172.21.15.134:6801/3585115521 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94442528463424] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c024030 con 0x55e51d5bf540 2024-04-24T02:12:27.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.381+0000 7f8fa9638800 20 remove_watcher() i=2 2024-04-24T02:12:27.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.381+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94442528465760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c9a20 con 0x7f8f9c036070 2024-04-24T02:12:27.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.382+0000 7f8fa7938640 1 -- 172.21.15.134:0/2139835337 <== osd.2 v2:172.21.15.134:6800/214480313 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94442528465760] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fa0040040 con 0x7f8f9c036070 2024-04-24T02:12:27.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.382+0000 7f8fa9638800 20 remove_watcher() i=3 2024-04-24T02:12:27.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.382+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94442528460576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c4b00 con 0x55e51d5b92f0 2024-04-24T02:12:27.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.383+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94442528460576] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f98075030 con 0x55e51d5b92f0 2024-04-24T02:12:27.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.383+0000 7f8fa9638800 20 remove_watcher() i=4 2024-04-24T02:12:27.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.383+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94442528473344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c6360 con 0x7f8fa0031040 2024-04-24T02:12:27.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.384+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 <== osd.0 v2:172.21.15.104:6800/2419146313 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94442528473344] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f98075030 con 0x7f8fa0031040 2024-04-24T02:12:27.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.384+0000 7f8fa9638800 20 remove_watcher() i=5 2024-04-24T02:12:27.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.384+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94442528476000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c9a20 con 0x7f8fa0031040 2024-04-24T02:12:27.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.385+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 <== osd.0 v2:172.21.15.104:6800/2419146313 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94442528476000] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f98075030 con 0x7f8fa0031040 2024-04-24T02:12:27.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.385+0000 7f8fa9638800 20 remove_watcher() i=6 2024-04-24T02:12:27.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.385+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94442528470736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e51d5c6360 con 0x7f8fa0031040 2024-04-24T02:12:27.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.386+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 <== osd.0 v2:172.21.15.104:6800/2419146313 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94442528470736] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f98075030 con 0x7f8fa0031040 2024-04-24T02:12:27.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.386+0000 7f8fa9638800 20 remove_watcher() i=7 2024-04-24T02:12:27.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.386+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f8fa0031040 msgr2=0x7f8fa0032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.386+0000 7f8fa9638800 1 --2- 172.21.15.134:0/2139835337 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f8fa0031040 0x7f8fa0032940 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.386+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e51d5b92f0 msgr2=0x55e51d5bb7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.386+0000 7f8fa9638800 1 --2- 172.21.15.134:0/2139835337 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e51d5b92f0 0x55e51d5bb7b0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.386+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f8f9c036070 msgr2=0x7f8f9c03a1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.386+0000 7f8fa9638800 1 --2- 172.21.15.134:0/2139835337 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f8f9c036070 0x7f8f9c03a1c0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.386+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55e51d5bf540 msgr2=0x55e51d5c1930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.386+0000 7f8fa9638800 1 --2- 172.21.15.134:0/2139835337 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55e51d5bf540 0x55e51d5c1930 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.386+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8e70036900 msgr2=0x7f8e70038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.386+0000 7f8fa9638800 1 --2- 172.21.15.134:0/2139835337 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8e70036900 0x7f8e70038dc0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x55e51d586cd0 tx=0x7f8fa001f000 comp rx=0 tx=0).stop 2024-04-24T02:12:27.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.386+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d5a61d0 msgr2=0x55e51d5ad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.386+0000 7f8fa9638800 1 --2- 172.21.15.134:0/2139835337 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d5a61d0 0x55e51d5ad840 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c024840 tx=0x7f8f9c04bea0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.386+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 reap_dead start 2024-04-24T02:12:27.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.386+0000 7f8fa7137640 1 -- 172.21.15.134:0/2139835337 reap_dead start 2024-04-24T02:12:27.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.386+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 shutdown_connections 2024-04-24T02:12:27.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.386+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 >> 172.21.15.134:0/2139835337 conn(0x55e51d5a2530 msgr2=0x55e51d59fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:27.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.386+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 shutdown_connections 2024-04-24T02:12:27.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.386+0000 7f8fa9638800 1 -- 172.21.15.134:0/2139835337 wait complete. 2024-04-24T02:12:27.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.386+0000 7f8fa9638800 1 -- 172.21.15.134:0/101359531 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8e80036900 msgr2=0x7f8e80038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.386+0000 7f8fa9638800 1 --2- 172.21.15.134:0/101359531 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8e80036900 0x7f8e80038dc0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x55e51d587550 tx=0x7f8fa0005840 comp rx=0 tx=0).stop 2024-04-24T02:12:27.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.386+0000 7f8fa9638800 1 -- 172.21.15.134:0/101359531 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d4864b0 msgr2=0x55e51d484920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.386+0000 7f8fa9638800 1 --2- 172.21.15.134:0/101359531 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d4864b0 0x55e51d484920 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c00e610 tx=0x7f8f9c00ff90 comp rx=0 tx=0).stop 2024-04-24T02:12:27.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.386+0000 7f8fa9638800 1 -- 172.21.15.134:0/101359531 shutdown_connections 2024-04-24T02:12:27.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.386+0000 7f8fa9638800 1 --2- 172.21.15.134:0/101359531 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8e80036900 0x7f8e80038dc0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.386+0000 7f8fa9638800 1 --2- 172.21.15.134:0/101359531 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d4864b0 0x55e51d484920 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.386+0000 7f8fa9638800 1 -- 172.21.15.134:0/101359531 >> 172.21.15.134:0/101359531 conn(0x55e51d58ace0 msgr2=0x55e51d58b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:27.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.386+0000 7f8fa9638800 1 -- 172.21.15.134:0/101359531 shutdown_connections 2024-04-24T02:12:27.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.386+0000 7f8fa9638800 1 -- 172.21.15.134:0/101359531 wait complete. 2024-04-24T02:12:27.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.387+0000 7f8fa9638800 1 -- 172.21.15.134:0/1224399475 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e51d489260 msgr2=0x55e51d585b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.387+0000 7f8fa9638800 1 --2- 172.21.15.134:0/1224399475 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e51d489260 0x55e51d585b70 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.387+0000 7f8fa9638800 1 -- 172.21.15.134:0/1224399475 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8e8c036950 msgr2=0x7f8e8c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.387+0000 7f8fa9638800 1 --2- 172.21.15.134:0/1224399475 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8e8c036950 0x7f8e8c038e10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c000c00 tx=0x7f8f9c0013b0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.387+0000 7f8fa9638800 1 -- 172.21.15.134:0/1224399475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d486930 msgr2=0x55e51d57e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.387+0000 7f8fa9638800 1 --2- 172.21.15.134:0/1224399475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d486930 0x55e51d57e980 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f8f980524f0 tx=0x7f8f98003020 comp rx=0 tx=0).stop 2024-04-24T02:12:27.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.387+0000 7f8fa9638800 1 -- 172.21.15.134:0/1224399475 shutdown_connections 2024-04-24T02:12:27.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.387+0000 7f8fa9638800 1 --2- 172.21.15.134:0/1224399475 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e51d489260 0x55e51d585b70 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.387+0000 7f8fa9638800 1 --2- 172.21.15.134:0/1224399475 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8e8c036950 0x7f8e8c038e10 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.387+0000 7f8fa9638800 1 --2- 172.21.15.134:0/1224399475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e51d486930 0x55e51d57e980 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.387+0000 7f8fa9638800 1 -- 172.21.15.134:0/1224399475 >> 172.21.15.134:0/1224399475 conn(0x55e51d4802c0 msgr2=0x55e51d5710a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:27.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.387+0000 7f8fa9638800 1 -- 172.21.15.134:0/1224399475 shutdown_connections 2024-04-24T02:12:27.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.387+0000 7f8fa9638800 1 -- 172.21.15.134:0/1224399475 wait complete. 2024-04-24T02:12:27.406 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-04-24T02:12:27.374069Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:12:27.374054Z', 'tags': [], 'group_ids': []} 2024-04-24T02:12:27.406 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-04-24T02:12:27.406 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-04-24T02:12:27.406 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-04-24T02:12:27.453 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:27.453 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:27.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.453+0000 7f4c2893f800 1 Processor -- start 2024-04-24T02:12:27.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.453+0000 7f4c2893f800 1 -- start start 2024-04-24T02:12:27.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.453+0000 7f4c2893f800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55d126952460 0x55d126954850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.453+0000 7f4c2893f800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d12680cd40 con 0x55d12694e950 2024-04-24T02:12:27.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.453+0000 7f4c2893f800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55d1267df4d0 con 0x55d126952460 2024-04-24T02:12:27.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.453+0000 7f4c23e9a640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55d126952460 0x55d126954850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.453+0000 7f4c2469b640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55d12694e950 0x55d126950d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:55322/0 (socket says 172.21.15.134:55322) 2024-04-24T02:12:27.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.453+0000 7f4c2469b640 1 -- 172.21.15.134:0/1836853927 learned_addr learned my addr 172.21.15.134:0/1836853927 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:12:27.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.453+0000 7f4c23e9a640 1 -- 172.21.15.134:0/1836853927 >> v1:172.21.15.104:6789/0 conn(0x55d12694e950 legacy=0x55d126950d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.453+0000 7f4c23699640 1 -- 172.21.15.134:0/1836853927 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3638900992 0 0) 0x55d12680cd40 con 0x55d12694e950 2024-04-24T02:12:27.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.453+0000 7f4c23e9a640 1 -- 172.21.15.134:0/1836853927 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d12680b590 con 0x55d126952460 2024-04-24T02:12:27.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.455+0000 7f4c23e9a640 1 --2- 172.21.15.134:0/1836853927 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d126952460 0x55d126954850 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c00a470 tx=0x7f4c0c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dffd5f9167288ace server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.455+0000 7f4c23699640 1 -- 172.21.15.134:0/1836853927 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c0c057070 con 0x55d126952460 2024-04-24T02:12:27.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.455+0000 7f4c23699640 1 -- 172.21.15.134:0/1836853927 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c0c052570 con 0x55d126952460 2024-04-24T02:12:27.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.455+0000 7f4c23699640 1 -- 172.21.15.134:0/1836853927 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c0c052870 con 0x55d126952460 2024-04-24T02:12:27.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.456+0000 7f4c2893f800 1 -- 172.21.15.134:0/1836853927 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d126952460 msgr2=0x55d126954850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.456+0000 7f4c2893f800 1 --2- 172.21.15.134:0/1836853927 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d126952460 0x55d126954850 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c00a470 tx=0x7f4c0c01ce90 comp rx=0 tx=0).stop 2024-04-24T02:12:27.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.456+0000 7f4c2893f800 1 -- 172.21.15.134:0/1836853927 shutdown_connections 2024-04-24T02:12:27.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.456+0000 7f4c2893f800 1 --2- 172.21.15.134:0/1836853927 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d126952460 0x55d126954850 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.456+0000 7f4c2893f800 1 -- 172.21.15.134:0/1836853927 >> 172.21.15.134:0/1836853927 conn(0x55d1269483a0 msgr2=0x55d12694a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:27.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.456+0000 7f4c2893f800 1 -- 172.21.15.134:0/1836853927 shutdown_connections 2024-04-24T02:12:27.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.456+0000 7f4c2893f800 1 -- 172.21.15.134:0/1836853927 wait complete. 2024-04-24T02:12:27.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.468+0000 7f4c2893f800 1 Processor -- start 2024-04-24T02:12:27.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.468+0000 7f4c2893f800 1 -- start start 2024-04-24T02:12:27.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.468+0000 7f4c2893f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d12694e950 0x55d12694e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.468+0000 7f4c2893f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d1268993e0 con 0x55d12694e950 2024-04-24T02:12:27.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.468+0000 7f4c2469b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d12694e950 0x55d12694e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.468+0000 7f4c2469b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d12694e950 0x55d12694e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56408/0 (socket says 172.21.15.134:56408) 2024-04-24T02:12:27.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.468+0000 7f4c2469b640 1 -- 172.21.15.134:0/1675023991 learned_addr learned my addr 172.21.15.134:0/1675023991 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:27.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.468+0000 7f4c2469b640 1 -- 172.21.15.134:0/1675023991 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d12694c850 con 0x55d12694e950 2024-04-24T02:12:27.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.469+0000 7f4c2469b640 1 --2- 172.21.15.134:0/1675023991 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d12694e950 0x55d12694e290 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f4c1400b210 tx=0x7f4c1400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4c9b5aada477901 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.469+0000 7f4b1260c640 1 -- 172.21.15.134:0/1675023991 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c14008070 con 0x55d12694e950 2024-04-24T02:12:27.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.469+0000 7f4b1260c640 1 -- 172.21.15.134:0/1675023991 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c1400d500 con 0x55d12694e950 2024-04-24T02:12:27.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.469+0000 7f4b1260c640 1 -- 172.21.15.134:0/1675023991 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c1400d840 con 0x55d12694e950 2024-04-24T02:12:27.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.469+0000 7f4c2893f800 1 -- 172.21.15.134:0/1675023991 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d12694e950 msgr2=0x55d12694e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.469+0000 7f4c2893f800 1 --2- 172.21.15.134:0/1675023991 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d12694e950 0x55d12694e290 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f4c1400b210 tx=0x7f4c1400b6d0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.469+0000 7f4c2893f800 1 -- 172.21.15.134:0/1675023991 shutdown_connections 2024-04-24T02:12:27.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.469+0000 7f4c2893f800 1 --2- 172.21.15.134:0/1675023991 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d12694e950 0x55d12694e290 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.469+0000 7f4c2893f800 1 -- 172.21.15.134:0/1675023991 >> 172.21.15.134:0/1675023991 conn(0x55d1269483a0 msgr2=0x55d126a3a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:27.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.469+0000 7f4c2893f800 1 -- 172.21.15.134:0/1675023991 shutdown_connections 2024-04-24T02:12:27.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.469+0000 7f4c2893f800 1 -- 172.21.15.134:0/1675023991 wait complete. 2024-04-24T02:12:27.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.470+0000 7f4c2893f800 1 Processor -- start 2024-04-24T02:12:27.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.470+0000 7f4c2893f800 1 -- start start 2024-04-24T02:12:27.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.470+0000 7f4c2893f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d12694e950 0x55d126a48cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.470+0000 7f4c2893f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d1269570a0 con 0x55d12694e950 2024-04-24T02:12:27.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.470+0000 7f4c2469b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d12694e950 0x55d126a48cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.470+0000 7f4c2469b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d12694e950 0x55d126a48cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56416/0 (socket says 172.21.15.134:56416) 2024-04-24T02:12:27.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.470+0000 7f4c2469b640 1 -- 172.21.15.134:0/2297561852 learned_addr learned my addr 172.21.15.134:0/2297561852 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:27.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.470+0000 7f4c2469b640 1 -- 172.21.15.134:0/2297561852 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d126a491f0 con 0x55d12694e950 2024-04-24T02:12:27.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.471+0000 7f4c2469b640 1 --2- 172.21.15.134:0/2297561852 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d12694e950 0x55d126a48cb0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4c1400b210 tx=0x7f4c14000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.471+0000 7f4b10e09640 1 -- 172.21.15.134:0/2297561852 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c1400f950 con 0x55d12694e950 2024-04-24T02:12:27.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.471+0000 7f4b10e09640 1 -- 172.21.15.134:0/2297561852 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c1400faf0 con 0x55d12694e950 2024-04-24T02:12:27.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.471+0000 7f4c2893f800 1 -- 172.21.15.134:0/2297561852 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d126a49480 con 0x55d12694e950 2024-04-24T02:12:27.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.471+0000 7f4b10e09640 1 -- 172.21.15.134:0/2297561852 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c1400fdd0 con 0x55d12694e950 2024-04-24T02:12:27.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.471+0000 7f4c2893f800 1 -- 172.21.15.134:0/2297561852 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d126a4c130 con 0x55d12694e950 2024-04-24T02:12:27.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.472+0000 7f4b10e09640 1 -- 172.21.15.134:0/2297561852 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4c14017040 con 0x55d12694e950 2024-04-24T02:12:27.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.472+0000 7f4b10e09640 1 --2- 172.21.15.134:0/2297561852 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4b0c0368b0 0x7f4b0c038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.472+0000 7f4b10e09640 1 -- 172.21.15.134:0/2297561852 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f4c14015020 con 0x55d12694e950 2024-04-24T02:12:27.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.472+0000 7f4c23e9a640 1 --2- 172.21.15.134:0/2297561852 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4b0c0368b0 0x7f4b0c038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.472+0000 7f4c2893f800 1 --2- 172.21.15.134:0/2297561852 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d126952460 0x55d126a4fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.472+0000 7f4c2893f800 1 -- 172.21.15.134:0/2297561852 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d126a50470 con 0x55d126952460 2024-04-24T02:12:27.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.472+0000 7f4c24e9c640 1 --2- 172.21.15.134:0/2297561852 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d126952460 0x55d126a4fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.472+0000 7f4c23e9a640 1 --2- 172.21.15.134:0/2297561852 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4b0c0368b0 0x7f4b0c038d70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c054000 tx=0x7f4c0c04e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.472+0000 7f4c24e9c640 1 --2- 172.21.15.134:0/2297561852 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d126952460 0x55d126a4fef0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.473+0000 7f4c24e9c640 1 -- 172.21.15.134:0/2297561852 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c1c00a4a0 con 0x55d126952460 2024-04-24T02:12:27.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.473+0000 7f4c2893f800 1 -- 172.21.15.134:0/2297561852 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d126a4d4c0 con 0x55d126952460 2024-04-24T02:12:27.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.473+0000 7f4c24e9c640 1 -- 172.21.15.134:0/2297561852 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4c1c00a4a0 con 0x55d126952460 2024-04-24T02:12:27.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.473+0000 7f4c2893f800 1 -- 172.21.15.134:0/2297561852 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d126a52290 con 0x55d126952460 2024-04-24T02:12:27.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.473+0000 7f4c24e9c640 1 -- 172.21.15.134:0/2297561852 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4c1c00a4a0 con 0x55d126952460 2024-04-24T02:12:27.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.473+0000 7f4c2893f800 1 -- 172.21.15.134:0/2297561852 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d126a515d0 con 0x55d126952460 2024-04-24T02:12:27.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.473+0000 7f4c24e9c640 1 -- 172.21.15.134:0/2297561852 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4c1c00a4a0 con 0x55d126952460 2024-04-24T02:12:27.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.474+0000 7f4c2893f800 1 -- 172.21.15.134:0/2297561852 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d126a51a20 con 0x55d126952460 2024-04-24T02:12:27.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.474+0000 7f4c24e9c640 1 -- 172.21.15.134:0/2297561852 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4c1c00a4a0 con 0x55d126952460 2024-04-24T02:12:27.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.474+0000 7f4c2893f800 1 Processor -- start 2024-04-24T02:12:27.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.474+0000 7f4c2893f800 1 -- start start 2024-04-24T02:12:27.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.474+0000 7f4c2893f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d126a61000 0x55d126a61420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.474+0000 7f4c2893f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d12683f6b0 con 0x55d126a61000 2024-04-24T02:12:27.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.474+0000 7f4c23e9a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d126a61000 0x55d126a61420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.475+0000 7f4c23e9a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d126a61000 0x55d126a61420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56424/0 (socket says 172.21.15.134:56424) 2024-04-24T02:12:27.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.475+0000 7f4c23e9a640 1 -- 172.21.15.134:0/4005062885 learned_addr learned my addr 172.21.15.134:0/4005062885 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:27.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.475+0000 7f4c23e9a640 1 -- 172.21.15.134:0/4005062885 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d126a61960 con 0x55d126a61000 2024-04-24T02:12:27.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.475+0000 7f4c23e9a640 1 --2- 172.21.15.134:0/4005062885 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d126a61000 0x55d126a61420 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c044840 tx=0x7f4c0c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.475+0000 7f4b09ffb640 1 -- 172.21.15.134:0/4005062885 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c0c06f070 con 0x55d126a61000 2024-04-24T02:12:27.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.475+0000 7f4b09ffb640 1 -- 172.21.15.134:0/4005062885 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c0c058040 con 0x55d126a61000 2024-04-24T02:12:27.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.475+0000 7f4c2893f800 1 -- 172.21.15.134:0/4005062885 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d126a623d0 con 0x55d126a61000 2024-04-24T02:12:27.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.475+0000 7f4b09ffb640 1 -- 172.21.15.134:0/4005062885 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c0c057050 con 0x55d126a61000 2024-04-24T02:12:27.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.475+0000 7f4c2893f800 1 -- 172.21.15.134:0/4005062885 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d126a62870 con 0x55d126a61000 2024-04-24T02:12:27.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.476+0000 7f4b09ffb640 1 -- 172.21.15.134:0/4005062885 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4c0c072070 con 0x55d126a61000 2024-04-24T02:12:27.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.476+0000 7f4b09ffb640 1 --2- 172.21.15.134:0/4005062885 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4afc036950 0x7f4afc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.476+0000 7f4b09ffb640 1 -- 172.21.15.134:0/4005062885 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f4c0c08f9a0 con 0x55d126a61000 2024-04-24T02:12:27.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.476+0000 7f4c24e9c640 1 --2- 172.21.15.134:0/4005062885 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4afc036950 0x7f4afc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.476+0000 7f4c2893f800 1 Processor -- start 2024-04-24T02:12:27.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.476+0000 7f4c24e9c640 1 --2- 172.21.15.134:0/4005062885 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4afc036950 0x7f4afc038e10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x55d126a510f0 tx=0x7f4c1c005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.476+0000 7f4c2893f800 1 -- start start 2024-04-24T02:12:27.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.477+0000 7f4c2893f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d126a6e240 0x55d126a6e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.477+0000 7f4c2893f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d12694cbd0 con 0x55d126a6e240 2024-04-24T02:12:27.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.477+0000 7f4c23e9a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d126a6e240 0x55d126a6e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.477+0000 7f4c23e9a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d126a6e240 0x55d126a6e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56428/0 (socket says 172.21.15.134:56428) 2024-04-24T02:12:27.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.477+0000 7f4c23e9a640 1 -- 172.21.15.134:0/1260469260 learned_addr learned my addr 172.21.15.134:0/1260469260 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:27.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.477+0000 7f4c23e9a640 1 -- 172.21.15.134:0/1260469260 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d126a6ec30 con 0x55d126a6e240 2024-04-24T02:12:27.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.477+0000 7f4c23e9a640 1 --2- 172.21.15.134:0/1260469260 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d126a6e240 0x55d126a6e660 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c08deb0 tx=0x7f4c0c05db30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46dfefd314759b4a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.477+0000 7f4b037fe640 1 -- 172.21.15.134:0/1260469260 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c0c05d510 con 0x55d126a6e240 2024-04-24T02:12:27.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.477+0000 7f4b037fe640 1 -- 172.21.15.134:0/1260469260 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c0c05cc80 con 0x55d126a6e240 2024-04-24T02:12:27.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.477+0000 7f4b037fe640 1 -- 172.21.15.134:0/1260469260 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c0c0018f0 con 0x55d126a6e240 2024-04-24T02:12:27.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.478+0000 7f4c2893f800 1 -- 172.21.15.134:0/1260469260 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d126a6e240 msgr2=0x55d126a6e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.478+0000 7f4c2893f800 1 --2- 172.21.15.134:0/1260469260 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d126a6e240 0x55d126a6e660 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c08deb0 tx=0x7f4c0c05db30 comp rx=0 tx=0).stop 2024-04-24T02:12:27.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.478+0000 7f4c2893f800 1 -- 172.21.15.134:0/1260469260 shutdown_connections 2024-04-24T02:12:27.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.478+0000 7f4c2893f800 1 --2- 172.21.15.134:0/1260469260 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d126a6e240 0x55d126a6e660 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.478+0000 7f4c2893f800 1 -- 172.21.15.134:0/1260469260 >> 172.21.15.134:0/1260469260 conn(0x55d126a6a5a0 msgr2=0x55d126a68600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:27.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.478+0000 7f4c2893f800 1 -- 172.21.15.134:0/1260469260 shutdown_connections 2024-04-24T02:12:27.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.478+0000 7f4c2893f800 1 -- 172.21.15.134:0/1260469260 wait complete. 2024-04-24T02:12:27.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.478+0000 7f4c2893f800 1 Processor -- start 2024-04-24T02:12:27.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.478+0000 7f4c2893f800 1 -- start start 2024-04-24T02:12:27.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.478+0000 7f4c2893f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d126a6e240 0x55d126a758a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.478+0000 7f4c2893f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d126a6f3a0 con 0x55d126a6e240 2024-04-24T02:12:27.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.478+0000 7f4c23e9a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d126a6e240 0x55d126a758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.478+0000 7f4c23e9a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d126a6e240 0x55d126a758a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56432/0 (socket says 172.21.15.134:56432) 2024-04-24T02:12:27.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.478+0000 7f4c23e9a640 1 -- 172.21.15.134:0/1590771279 learned_addr learned my addr 172.21.15.134:0/1590771279 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:27.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.479+0000 7f4c23e9a640 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d126a75de0 con 0x55d126a6e240 2024-04-24T02:12:27.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.479+0000 7f4c23e9a640 1 --2- 172.21.15.134:0/1590771279 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d126a6e240 0x55d126a758a0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c08e220 tx=0x7f4c0c08de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.479+0000 7f4b01ffb640 1 -- 172.21.15.134:0/1590771279 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c0c08f440 con 0x55d126a6e240 2024-04-24T02:12:27.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.479+0000 7f4b01ffb640 1 -- 172.21.15.134:0/1590771279 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c0c094070 con 0x55d126a6e240 2024-04-24T02:12:27.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.479+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d126a76070 con 0x55d126a6e240 2024-04-24T02:12:27.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.479+0000 7f4b01ffb640 1 -- 172.21.15.134:0/1590771279 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c0c08f710 con 0x55d126a6e240 2024-04-24T02:12:27.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.479+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d126a78d20 con 0x55d126a6e240 2024-04-24T02:12:27.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.480+0000 7f4b01ffb640 1 -- 172.21.15.134:0/1590771279 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4c0c05fa80 con 0x55d126a6e240 2024-04-24T02:12:27.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.480+0000 7f4b01ffb640 1 --2- 172.21.15.134:0/1590771279 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4af4036900 0x7f4af4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.480+0000 7f4b01ffb640 1 -- 172.21.15.134:0/1590771279 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f4c0c09c100 con 0x55d126a6e240 2024-04-24T02:12:27.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.480+0000 7f4c24e9c640 1 --2- 172.21.15.134:0/1590771279 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4af4036900 0x7f4af4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.480+0000 7f4c24e9c640 1 --2- 172.21.15.134:0/1590771279 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4af4036900 0x7f4af4038dc0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x55d126a4d410 tx=0x7f4c1c01f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.480+0000 7f4c2893f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.480+0000 7f4c2893f800 1 --2- 172.21.15.134:0/1590771279 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d126a813f0 0x55d126a838b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.480+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d126a84000 con 0x55d126a813f0 2024-04-24T02:12:27.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.480+0000 7f4c2469b640 1 --2- 172.21.15.134:0/1590771279 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d126a813f0 0x55d126a838b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.481+0000 7f4c2469b640 1 --2- 172.21.15.134:0/1590771279 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d126a813f0 0x55d126a838b0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.481+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c1402d070 con 0x55d126a813f0 2024-04-24T02:12:27.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.481+0000 7f4c2893f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.481+0000 7f4c2893f800 20 realm 2024-04-24T02:12:27.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.481+0000 7f4c2893f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.481+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d126a84410 con 0x55d126a813f0 2024-04-24T02:12:27.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.481+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c1402d070 con 0x55d126a813f0 2024-04-24T02:12:27.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.481+0000 7f4c2893f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.481+0000 7f4c2893f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:27.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.481+0000 7f4c2893f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.481+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d126a84ce0 con 0x55d126a813f0 2024-04-24T02:12:27.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.481+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c1402d070 con 0x55d126a813f0 2024-04-24T02:12:27.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.481+0000 7f4c2893f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.481+0000 7f4c2893f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.481+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d126a85080 con 0x55d126a813f0 2024-04-24T02:12:27.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.482+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4c1402d070 con 0x55d126a813f0 2024-04-24T02:12:27.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.482+0000 7f4c2893f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:27.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.482+0000 7f4c2893f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.482+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d126a858d0 con 0x55d126a813f0 2024-04-24T02:12:27.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.482+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4c1402d070 con 0x55d126a813f0 2024-04-24T02:12:27.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.482+0000 7f4c2893f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:27.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.482+0000 7f4c2893f800 20 searching for the correct realm 2024-04-24T02:12:27.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.482+0000 7f4c2893f800 1 --2- 172.21.15.134:0/1590771279 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55d126a87640 0x55d126a89a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.482+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d126a89ff0 con 0x55d126a87640 2024-04-24T02:12:27.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.482+0000 7f4c23e9a640 1 --2- 172.21.15.134:0/1590771279 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55d126a87640 0x55d126a89a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.482+0000 7f4c23e9a640 1 --2- 172.21.15.134:0/1590771279 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55d126a87640 0x55d126a89a30 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.483+0000 7f4c23e9a640 1 -- 172.21.15.134:0/1590771279 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c0c071030 con 0x55d126a87640 2024-04-24T02:12:27.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.483+0000 7f4c23e9a640 1 --2- 172.21.15.134:0/1590771279 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f4c0c074060 0x7f4c0c0733b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.483+0000 7f4c23e9a640 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d126a89ff0 con 0x7f4c0c074060 2024-04-24T02:12:27.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.483+0000 7f4c24e9c640 1 --2- 172.21.15.134:0/1590771279 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f4c0c074060 0x7f4c0c0733b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.483+0000 7f4c24e9c640 1 --2- 172.21.15.134:0/1590771279 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f4c0c074060 0x7f4c0c0733b0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.483+0000 7f4c24e9c640 1 -- 172.21.15.134:0/1590771279 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c1c01f070 con 0x7f4c0c074060 2024-04-24T02:12:27.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.483+0000 7f4c24e9c640 1 --2- 172.21.15.134:0/1590771279 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f4c1c031040 0x7f4c1c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.483+0000 7f4c24e9c640 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d126a89ff0 con 0x7f4c1c031040 2024-04-24T02:12:27.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.484+0000 7f4c2469b640 1 --2- 172.21.15.134:0/1590771279 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f4c1c031040 0x7f4c1c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.484+0000 7f4c2469b640 1 --2- 172.21.15.134:0/1590771279 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f4c1c031040 0x7f4c1c032940 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.484+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c1402d070 con 0x7f4c1c031040 2024-04-24T02:12:27.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.484+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d126a89ff0 con 0x55d126a813f0 2024-04-24T02:12:27.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.485+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c1402d070 con 0x55d126a813f0 2024-04-24T02:12:27.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.485+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d126a89ff0 con 0x55d126a813f0 2024-04-24T02:12:27.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.485+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4c1402d070 con 0x55d126a813f0 2024-04-24T02:12:27.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.485+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d126a89ff0 con 0x7f4c1c031040 2024-04-24T02:12:27.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.485+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c1402d070 con 0x7f4c1c031040 2024-04-24T02:12:27.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.485+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d126a89ff0 con 0x7f4c1c031040 2024-04-24T02:12:27.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.485+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c1402d070 con 0x7f4c1c031040 2024-04-24T02:12:27.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.485+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d126a89ff0 con 0x7f4c0c074060 2024-04-24T02:12:27.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.485+0000 7f4c24e9c640 1 -- 172.21.15.134:0/1590771279 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c1c01f070 con 0x7f4c0c074060 2024-04-24T02:12:27.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.485+0000 7f4c24e9c640 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d126a89ff0 con 0x55d126a87640 2024-04-24T02:12:27.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.486+0000 7f4c23e9a640 1 -- 172.21.15.134:0/1590771279 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c0c071030 con 0x55d126a87640 2024-04-24T02:12:27.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.486+0000 7f4c23e9a640 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d126a89ff0 con 0x55d126a813f0 2024-04-24T02:12:27.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.486+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c1402d070 con 0x55d126a813f0 2024-04-24T02:12:27.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.486+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d126a89ff0 con 0x7f4c1c031040 2024-04-24T02:12:27.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.486+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c1402d070 con 0x7f4c1c031040 2024-04-24T02:12:27.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.486+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d126a89ff0 con 0x55d126a813f0 2024-04-24T02:12:27.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.486+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c1402d070 con 0x55d126a813f0 2024-04-24T02:12:27.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.486+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d126a89ff0 con 0x7f4c0c074060 2024-04-24T02:12:27.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.487+0000 7f4c24e9c640 1 -- 172.21.15.134:0/1590771279 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4c1c01f070 con 0x7f4c0c074060 2024-04-24T02:12:27.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.487+0000 7f4c24e9c640 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d126a89ff0 con 0x55d126a87640 2024-04-24T02:12:27.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.487+0000 7f4c23e9a640 1 -- 172.21.15.134:0/1590771279 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c0c071030 con 0x55d126a87640 2024-04-24T02:12:27.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.487+0000 7f4c23e9a640 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d126a89ff0 con 0x55d126a87640 2024-04-24T02:12:27.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.487+0000 7f4c23e9a640 1 -- 172.21.15.134:0/1590771279 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c0c071030 con 0x55d126a87640 2024-04-24T02:12:27.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.487+0000 7f4c23e9a640 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d126a89ff0 con 0x7f4c1c031040 2024-04-24T02:12:27.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.487+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c1402d070 con 0x7f4c1c031040 2024-04-24T02:12:27.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.487+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d126a89ff0 con 0x55d126a87640 2024-04-24T02:12:27.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.488+0000 7f4c23e9a640 1 -- 172.21.15.134:0/1590771279 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c0c071030 con 0x55d126a87640 2024-04-24T02:12:27.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.488+0000 7f4c23e9a640 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d126a89ff0 con 0x55d126a87640 2024-04-24T02:12:27.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.488+0000 7f4c23e9a640 1 -- 172.21.15.134:0/1590771279 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c0c071030 con 0x55d126a87640 2024-04-24T02:12:27.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.488+0000 7f4c23e9a640 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d126a89ff0 con 0x55d126a813f0 2024-04-24T02:12:27.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.488+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c1402d070 con 0x55d126a813f0 2024-04-24T02:12:27.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.488+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d126a89ff0 con 0x55d126a813f0 2024-04-24T02:12:27.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.488+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f4c1402d070 con 0x55d126a813f0 2024-04-24T02:12:27.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.488+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d126a89ff0 con 0x7f4c1c031040 2024-04-24T02:12:27.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.488+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c1402d070 con 0x7f4c1c031040 2024-04-24T02:12:27.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.488+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d126a89ff0 con 0x55d126a87640 2024-04-24T02:12:27.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.489+0000 7f4c23e9a640 1 -- 172.21.15.134:0/1590771279 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c0c071030 con 0x55d126a87640 2024-04-24T02:12:27.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.489+0000 7f4c23e9a640 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d126a89ff0 con 0x7f4c0c074060 2024-04-24T02:12:27.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.489+0000 7f4c24e9c640 1 -- 172.21.15.134:0/1590771279 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c1c01f070 con 0x7f4c0c074060 2024-04-24T02:12:27.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.489+0000 7f4c24e9c640 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d126a89ff0 con 0x55d126a813f0 2024-04-24T02:12:27.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.489+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c1402d070 con 0x55d126a813f0 2024-04-24T02:12:27.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.489+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d126a89ff0 con 0x7f4c1c031040 2024-04-24T02:12:27.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.489+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c1402d070 con 0x7f4c1c031040 2024-04-24T02:12:27.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.489+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d126a89ff0 con 0x55d126a87640 2024-04-24T02:12:27.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.490+0000 7f4c23e9a640 1 -- 172.21.15.134:0/1590771279 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c0c071030 con 0x55d126a87640 2024-04-24T02:12:27.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.490+0000 7f4c23e9a640 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d126a89ff0 con 0x7f4c1c031040 2024-04-24T02:12:27.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.490+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c1402d070 con 0x7f4c1c031040 2024-04-24T02:12:27.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.490+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d126a89ff0 con 0x7f4c0c074060 2024-04-24T02:12:27.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.490+0000 7f4c24e9c640 1 -- 172.21.15.134:0/1590771279 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c1c01f070 con 0x7f4c0c074060 2024-04-24T02:12:27.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.490+0000 7f4c24e9c640 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d126a89ff0 con 0x55d126a87640 2024-04-24T02:12:27.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.490+0000 7f4c23e9a640 1 -- 172.21.15.134:0/1590771279 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c0c071030 con 0x55d126a87640 2024-04-24T02:12:27.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.490+0000 7f4c23e9a640 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d126a89ff0 con 0x7f4c1c031040 2024-04-24T02:12:27.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.491+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c1402d070 con 0x7f4c1c031040 2024-04-24T02:12:27.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.491+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d126a89ff0 con 0x55d126a813f0 2024-04-24T02:12:27.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.491+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4c1402d070 con 0x55d126a813f0 2024-04-24T02:12:27.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.491+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d126a89ff0 con 0x7f4c0c074060 2024-04-24T02:12:27.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.491+0000 7f4c24e9c640 1 -- 172.21.15.134:0/1590771279 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c1c01f070 con 0x7f4c0c074060 2024-04-24T02:12:27.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.491+0000 7f4c2893f800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:27.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.491+0000 7f4c2893f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:27.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.491+0000 7f4c2893f800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:27.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.491+0000 7f4c2893f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:27.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.491+0000 7f4c2893f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:27.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.491+0000 7f4c2893f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:27.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.491+0000 7f4c2893f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.491+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d126a86280 con 0x55d126a813f0 2024-04-24T02:12:27.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.492+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c1402d070 con 0x55d126a813f0 2024-04-24T02:12:27.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.492+0000 7f4c2893f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.492+0000 7f4c2893f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.492+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d126a86b20 con 0x55d126a813f0 2024-04-24T02:12:27.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.492+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4c1402d070 con 0x55d126a813f0 2024-04-24T02:12:27.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.492+0000 7f4c2893f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:27.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.492+0000 7f4c2893f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.492+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d126a8a470 con 0x55d126a813f0 2024-04-24T02:12:27.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.492+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4c1402d070 con 0x55d126a813f0 2024-04-24T02:12:27.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.492+0000 7f4c2893f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:27.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.492+0000 7f4c2893f800 20 zone default found 2024-04-24T02:12:27.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.492+0000 7f4c2893f800 4 Realm: () 2024-04-24T02:12:27.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.492+0000 7f4c2893f800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:27.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.492+0000 7f4c2893f800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:27.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.492+0000 7f4c2893f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:27.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.492+0000 7f4c2893f800 20 zonegroup default 2024-04-24T02:12:27.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.492+0000 7f4c2893f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.492+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d126a8a920 con 0x7f4c1c031040 2024-04-24T02:12:27.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.492+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4c1402d070 con 0x7f4c1c031040 2024-04-24T02:12:27.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.493+0000 7f4c2893f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.493+0000 7f4c2893f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.493+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d126a8c300 con 0x55d126a87640 2024-04-24T02:12:27.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.493+0000 7f4c23e9a640 1 -- 172.21.15.134:0/1590771279 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4c0c071030 con 0x55d126a87640 2024-04-24T02:12:27.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.493+0000 7f4c2893f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.493+0000 7f4c2893f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.493+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d126a8c740 con 0x55d126a87640 2024-04-24T02:12:27.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.493+0000 7f4c23e9a640 1 -- 172.21.15.134:0/1590771279 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4c0c071030 con 0x55d126a87640 2024-04-24T02:12:27.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.493+0000 7f4c2893f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.493+0000 7f4c2893f800 20 started sync module instance, tier type = 2024-04-24T02:12:27.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.493+0000 7f4c2893f800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:27.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.493+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d126a8b790 con 0x7f4c0c074060 2024-04-24T02:12:27.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.494+0000 7f4c24e9c640 1 -- 172.21.15.134:0/1590771279 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c1c040040 con 0x7f4c0c074060 2024-04-24T02:12:27.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.494+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94356785118080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d126a8d050 con 0x7f4c0c074060 2024-04-24T02:12:27.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.494+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d126a8d8a0 con 0x55d126a813f0 2024-04-24T02:12:27.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.495+0000 7f4c24e9c640 1 -- 172.21.15.134:0/1590771279 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94356785118080] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c1c040040 con 0x7f4c0c074060 2024-04-24T02:12:27.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.495+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c1402d070 con 0x55d126a813f0 2024-04-24T02:12:27.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.495+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94356785122208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d126a8d530 con 0x55d126a813f0 2024-04-24T02:12:27.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.495+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d126a8e050 con 0x55d126a87640 2024-04-24T02:12:27.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.497+0000 7f4c23e9a640 1 -- 172.21.15.134:0/1590771279 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c0c071030 con 0x55d126a87640 2024-04-24T02:12:27.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.497+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94356785126176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d126a8e8f0 con 0x55d126a87640 2024-04-24T02:12:27.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.497+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d126a8f3a0 con 0x7f4c0c074060 2024-04-24T02:12:27.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.497+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94356785122208] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c1402d070 con 0x55d126a813f0 2024-04-24T02:12:27.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.498+0000 7f4c23e9a640 1 -- 172.21.15.134:0/1590771279 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94356785126176] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c0c071030 con 0x55d126a87640 2024-04-24T02:12:27.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.498+0000 7f4c24e9c640 1 -- 172.21.15.134:0/1590771279 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c1c040040 con 0x7f4c0c074060 2024-04-24T02:12:27.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.498+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94356785128512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d126a8ee80 con 0x7f4c0c074060 2024-04-24T02:12:27.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.498+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d126a8fc80 con 0x55d126a813f0 2024-04-24T02:12:27.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.499+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c1402d070 con 0x55d126a813f0 2024-04-24T02:12:27.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.499+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94356785133456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d126a8fbf0 con 0x55d126a813f0 2024-04-24T02:12:27.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.499+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d126a90c70 con 0x7f4c1c031040 2024-04-24T02:12:27.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.499+0000 7f4c24e9c640 1 -- 172.21.15.134:0/1590771279 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94356785128512] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c1c040040 con 0x7f4c0c074060 2024-04-24T02:12:27.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.500+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94356785133456] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c1402d070 con 0x55d126a813f0 2024-04-24T02:12:27.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.500+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c1402d070 con 0x7f4c1c031040 2024-04-24T02:12:27.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.500+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94356785137472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d126a90c30 con 0x7f4c1c031040 2024-04-24T02:12:27.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.500+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d126a91510 con 0x7f4c1c031040 2024-04-24T02:12:27.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.501+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94356785137472] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c1402d070 con 0x7f4c1c031040 2024-04-24T02:12:27.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.501+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(56 notify.6 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c1402d070 con 0x7f4c1c031040 2024-04-24T02:12:27.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.501+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94356785123264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d126a90c30 con 0x7f4c1c031040 2024-04-24T02:12:27.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.501+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d126a91ae0 con 0x7f4c1c031040 2024-04-24T02:12:27.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.502+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94356785123264] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c1402d070 con 0x7f4c1c031040 2024-04-24T02:12:27.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.502+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(58 notify.7 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c1402d070 con 0x7f4c1c031040 2024-04-24T02:12:27.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.502+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94356785139728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d126a91ae0 con 0x7f4c1c031040 2024-04-24T02:12:27.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.502+0000 7f4c2893f800 20 add_watcher() i=0 2024-04-24T02:12:27.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.502+0000 7f4c2893f800 20 add_watcher() i=1 2024-04-24T02:12:27.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.502+0000 7f4c2893f800 20 add_watcher() i=2 2024-04-24T02:12:27.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.502+0000 7f4c2893f800 20 add_watcher() i=3 2024-04-24T02:12:27.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.502+0000 7f4c2893f800 20 add_watcher() i=4 2024-04-24T02:12:27.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.502+0000 7f4c2893f800 20 add_watcher() i=5 2024-04-24T02:12:27.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.502+0000 7f4c2893f800 20 add_watcher() i=6 2024-04-24T02:12:27.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.503+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94356785139728] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c1402d070 con 0x7f4c1c031040 2024-04-24T02:12:27.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.503+0000 7f4c2893f800 20 add_watcher() i=7 2024-04-24T02:12:27.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.503+0000 7f4c2893f800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:27.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.503+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d126a94e40 con 0x55d126a813f0 2024-04-24T02:12:27.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.503+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4c1402d070 con 0x55d126a813f0 2024-04-24T02:12:27.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.503+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94356785154112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d126a91c50 con 0x55d126a813f0 2024-04-24T02:12:27.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.504+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94356785154112] v30'135 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4c1402d070 con 0x55d126a813f0 2024-04-24T02:12:27.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.504+0000 7f4ada7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:27.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.504+0000 7f4c2893f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:27.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.504+0000 7f4c2893f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:27.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.504+0000 7f4c2893f800 5 note: GC not initialized 2024-04-24T02:12:27.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.504+0000 7f4ad97e2640 20 reqs_thread_entry: start 2024-04-24T02:12:27.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.504+0000 7f4c2893f800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:27.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.504+0000 7f4c2893f800 20 Filter name: none 2024-04-24T02:12:27.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.505+0000 7f4a4affd640 20 reqs_thread_entry: start 2024-04-24T02:12:27.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.505+0000 7f4c2893f800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-04-24T02:12:27.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.505+0000 7f4c2893f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.505+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d126ac8390 con 0x7f4c1c031040 2024-04-24T02:12:27.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.505+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f4c1402d070 con 0x7f4c1c031040 2024-04-24T02:12:27.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.505+0000 7f4c2893f800 20 rados_obj.operate() r=0 bl.length=419 2024-04-24T02:12:27.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.505+0000 7f4c2893f800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-04-24T02:12:27.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.505+0000 7f4c2893f800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-04-24T02:12:27.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.505+0000 7f4c2893f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:12:27.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.505+0000 7f4c2893f800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-24T02:12:27.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.505+0000 7f4c2893f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.505+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d126ac7de0 con 0x7f4c0c074060 2024-04-24T02:12:27.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.506+0000 7f4c24e9c640 1 -- 172.21.15.134:0/1590771279 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f4c1c040040 con 0x7f4c0c074060 2024-04-24T02:12:27.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.506+0000 7f4c2893f800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T02:12:27.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.506+0000 7f4c2893f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-24T02:12:27.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.506+0000 7f4c2893f800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T02:12:27.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.506+0000 7f4c2893f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 : miss 2024-04-24T02:12:27.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.506+0000 7f4c2893f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.506+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:64 8.1d 8:be2d2b4a:root::.bucket.meta.myfoo%3a582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d126acbbc0 con 0x7f4c1c031040 2024-04-24T02:12:27.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.506+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(64 .bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f4c1402d070 con 0x7f4c1c031040 2024-04-24T02:12:27.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.506+0000 7f4c2893f800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T02:12:27.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.507+0000 7f4c2893f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 info.flags=0x17 2024-04-24T02:12:27.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.507+0000 7f4c2893f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 to cache LRU end 2024-04-24T02:12:27.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.507+0000 7f4c2893f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:12:27.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.507+0000 7f4c2893f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T02:12:27.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.507+0000 7f4c2893f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 2024-04-24T02:12:27.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.507+0000 7f4c2893f800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-04-24T02:12:27.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.507+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d126ad0290 con 0x7f4c0c074060 2024-04-24T02:12:27.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.508+0000 7f4c24e9c640 1 -- 172.21.15.134:0/1590771279 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(65 foo.buckets [call] v30'24 uv24 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f4c1c040040 con 0x7f4c0c074060 2024-04-24T02:12:27.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.508+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:66 8.d 8:b4f1ae40:root::.bucket.meta.testx%3amyfoo%3a582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1:head [create,call version.inc in=38b,writefull 0~412 in=412b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d126ad3ba0 con 0x7f4c0c074060 2024-04-24T02:12:27.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.509+0000 7f4c24e9c640 1 -- 172.21.15.134:0/1590771279 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 [create,call,writefull 0~412,setxattr (203)] v30'1 uv1 ondisk = 0) ==== 338+0+0 (crc 0 0 0) 0x7f4c1c040040 con 0x7f4c0c074060 2024-04-24T02:12:27.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.509+0000 7f4c2893f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 info.flags=0x7 2024-04-24T02:12:27.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.509+0000 7f4c2893f800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 to cache LRU end 2024-04-24T02:12:27.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.509+0000 7f4c2893f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-04-24T02:12:27.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.509+0000 7f4c2893f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1, ofs0, ns] 2024-04-24T02:12:27.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.509+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:67 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94356785404368 in=859b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d126ad3670 con 0x7f4c1c031040 2024-04-24T02:12:27.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.509+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== watch-notify(notify (1) cookie 94356785123264 notify 128849018891 ret 0) ==== 889+0+0 (crc 0 0 0) 0x55d126acbfb0 con 0x7f4c1c031040 2024-04-24T02:12:27.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.509+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.0 v2:172.21.15.104:6800/2419146313 20 ==== osd_op_reply(67 notify.6 [notify cookie 94356785404368 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4c1402d070 con 0x7f4c1c031040 2024-04-24T02:12:27.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.509+0000 7f4b037fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018891 cookie 94356785123264 notifier 4537 bl.length()=847 2024-04-24T02:12:27.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.509+0000 7f4b037fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 info.flags=0x7 2024-04-24T02:12:27.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.509+0000 7f4b037fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 to cache LRU end 2024-04-24T02:12:27.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.509+0000 7f4b037fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-04-24T02:12:27.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.509+0000 7f4b037fe640 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f4ae8003ea0 con 0x7f4c1c031040 2024-04-24T02:12:27.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.509+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.0 v2:172.21.15.104:6800/2419146313 21 ==== osd_op_reply(68 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c1402d070 con 0x7f4c1c031040 2024-04-24T02:12:27.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.510+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.0 v2:172.21.15.104:6800/2419146313 22 ==== watch-notify(notify_complete (2) cookie 94356785404368 notify 128849018891 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d126acb130 con 0x7f4c1c031040 2024-04-24T02:12:27.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.510+0000 7f4c2893f800 20 handle_bi_update(): bucket=testx:myfoo[582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1]): orig_sources= new_sources= 2024-04-24T02:12:27.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.510+0000 7f4c2893f800 20 handle_bi_update(): bucket=testx:myfoo[582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1]): potential sources added=[] removed=[] 2024-04-24T02:12:27.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.510+0000 7f4c2893f800 20 handle_bi_update(): bucket=testx:myfoo[582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1]): orig_dests= new_dests= 2024-04-24T02:12:27.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.510+0000 7f4c2893f800 20 handle_bi_update(): bucket=testx:myfoo[582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1]): potential dests added=[] removed=[] 2024-04-24T02:12:27.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.510+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d126ad3770 con 0x55d126a813f0 2024-04-24T02:12:27.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.511+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v30'1 uv1 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f4c1402d070 con 0x55d126a813f0 2024-04-24T02:12:27.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.511+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d126ad2c40 con 0x55d126a813f0 2024-04-24T02:12:27.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.512+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v30'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f4c1402d070 con 0x55d126a813f0 2024-04-24T02:12:27.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.512+0000 7f4c2893f800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-04-24T02:12:27.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.512+0000 7f4c2893f800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-04-24T02:12:27.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.512+0000 7f4c2893f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-04-24T02:12:27.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.512+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 94356785410752 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d126ad4280 con 0x55d126a813f0 2024-04-24T02:12:27.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.512+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== watch-notify(notify (1) cookie 94356785133456 notify 128849018891 ret 0) ==== 390+0+0 (crc 0 0 0) 0x55d126ad3770 con 0x55d126a813f0 2024-04-24T02:12:27.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.512+0000 7f4b037fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018891 cookie 94356785133456 notifier 4537 bl.length()=348 2024-04-24T02:12:27.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.512+0000 7f4b037fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-04-24T02:12:27.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.512+0000 7f4b037fe640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-04-24T02:12:27.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.512+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(71 notify.4 [notify cookie 94356785410752 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4c1402d070 con 0x55d126a813f0 2024-04-24T02:12:27.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.512+0000 7f4b037fe640 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f4ae8003ea0 con 0x55d126a813f0 2024-04-24T02:12:27.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.512+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== watch-notify(notify_complete (2) cookie 94356785410752 notify 128849018891 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d126ad29e0 con 0x55d126a813f0 2024-04-24T02:12:27.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.512+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c1402d070 con 0x55d126a813f0 2024-04-24T02:12:27.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.513+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:73 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d126ad32c0 con 0x7f4c0c074060 2024-04-24T02:12:27.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.514+0000 7f4c24e9c640 1 -- 172.21.15.134:0/1590771279 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(73 myfoo [call,delete] v30'25 uv25 ondisk = 0) ==== 191+0+0 (crc 0 0 0) 0x7f4c1c040040 con 0x7f4c0c074060 2024-04-24T02:12:27.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.514+0000 7f4c2893f800 10 removing default.rgw.meta+root+myfoo from cache 2024-04-24T02:12:27.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.514+0000 7f4c2893f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-24T02:12:27.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.514+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94356785410752 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d126ad09c0 con 0x7f4c1c031040 2024-04-24T02:12:27.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.514+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.0 v2:172.21.15.104:6800/2419146313 23 ==== watch-notify(notify (1) cookie 94356785123264 notify 128849018892 ret 0) ==== 191+0+0 (crc 0 0 0) 0x55d126ad29e0 con 0x7f4c1c031040 2024-04-24T02:12:27.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.514+0000 7f4b02ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018892 cookie 94356785123264 notifier 4537 bl.length()=149 2024-04-24T02:12:27.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.514+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.0 v2:172.21.15.104:6800/2419146313 24 ==== osd_op_reply(74 notify.6 [notify cookie 94356785410752 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4c1402d070 con 0x7f4c1c031040 2024-04-24T02:12:27.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.514+0000 7f4b02ffd640 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:75 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f4a580032c0 con 0x7f4c1c031040 2024-04-24T02:12:27.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.514+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.0 v2:172.21.15.104:6800/2419146313 25 ==== watch-notify(notify_complete (2) cookie 94356785410752 notify 128849018892 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d126acb130 con 0x7f4c1c031040 2024-04-24T02:12:27.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.514+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.0 v2:172.21.15.104:6800/2419146313 26 ==== osd_op_reply(75 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c1402d070 con 0x7f4c1c031040 2024-04-24T02:12:27.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.515+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:76 8.1d 8:be2d2b4a:root::.bucket.meta.myfoo%3a582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d126ad32c0 con 0x7f4c1c031040 2024-04-24T02:12:27.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.515+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.0 v2:172.21.15.104:6800/2419146313 27 ==== osd_op_reply(76 .bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 [call,delete] v30'4 uv4 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f4c1402d070 con 0x7f4c1c031040 2024-04-24T02:12:27.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.515+0000 7f4c2893f800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 from cache 2024-04-24T02:12:27.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.515+0000 7f4c2893f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1, ofs0, ns] 2024-04-24T02:12:27.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.515+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [notify cookie 94356785410752 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d126ad39b0 con 0x7f4c1c031040 2024-04-24T02:12:27.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.516+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.0 v2:172.21.15.104:6800/2419146313 28 ==== watch-notify(notify (1) cookie 94356785139728 notify 128849018893 ret 0) ==== 248+0+0 (crc 0 0 0) 0x55d126acb130 con 0x7f4c1c031040 2024-04-24T02:12:27.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.516+0000 7f4b02ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018893 cookie 94356785139728 notifier 4537 bl.length()=206 2024-04-24T02:12:27.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.516+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.0 v2:172.21.15.104:6800/2419146313 29 ==== osd_op_reply(77 notify.7 [notify cookie 94356785410752 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4c1402d070 con 0x7f4c1c031040 2024-04-24T02:12:27.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.516+0000 7f4b02ffd640 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f4a580032c0 con 0x7f4c1c031040 2024-04-24T02:12:27.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.516+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.0 v2:172.21.15.104:6800/2419146313 30 ==== watch-notify(notify_complete (2) cookie 94356785410752 notify 128849018893 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d126a4c130 con 0x7f4c1c031040 2024-04-24T02:12:27.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.516+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.0 v2:172.21.15.104:6800/2419146313 31 ==== osd_op_reply(78 notify.7 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c1402d070 con 0x7f4c1c031040 2024-04-24T02:12:27.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.517+0000 7f4ada7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:27.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.517+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94356785154112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d126ad32c0 con 0x55d126a813f0 2024-04-24T02:12:27.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.518+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94356785154112] v30'136 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4c1402d070 con 0x55d126a813f0 2024-04-24T02:12:27.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.518+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94356785118080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d126ad32c0 con 0x7f4c0c074060 2024-04-24T02:12:27.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.519+0000 7f4c24e9c640 1 -- 172.21.15.134:0/1590771279 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94356785118080] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c1c040040 con 0x7f4c0c074060 2024-04-24T02:12:27.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.519+0000 7f4c2893f800 20 remove_watcher() i=0 2024-04-24T02:12:27.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.519+0000 7f4c2893f800 2 removed watcher, disabling cache 2024-04-24T02:12:27.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.519+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94356785122208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d126a8bb80 con 0x55d126a813f0 2024-04-24T02:12:27.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.520+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.1 v2:172.21.15.134:6804/1487076214 30 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94356785122208] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c1402d070 con 0x55d126a813f0 2024-04-24T02:12:27.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.520+0000 7f4c2893f800 20 remove_watcher() i=1 2024-04-24T02:12:27.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.520+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94356785126176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d126a8bb80 con 0x55d126a87640 2024-04-24T02:12:27.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.521+0000 7f4c23e9a640 1 -- 172.21.15.134:0/1590771279 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94356785126176] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c0c071030 con 0x55d126a87640 2024-04-24T02:12:27.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.521+0000 7f4c2893f800 20 remove_watcher() i=2 2024-04-24T02:12:27.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.521+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94356785128512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d126a8cba0 con 0x7f4c0c074060 2024-04-24T02:12:27.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.522+0000 7f4c24e9c640 1 -- 172.21.15.134:0/1590771279 <== osd.2 v2:172.21.15.134:6800/214480313 16 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94356785128512] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c1c040040 con 0x7f4c0c074060 2024-04-24T02:12:27.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.522+0000 7f4c2893f800 20 remove_watcher() i=3 2024-04-24T02:12:27.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.522+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94356785133456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d126a8cba0 con 0x55d126a813f0 2024-04-24T02:12:27.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.523+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.1 v2:172.21.15.134:6804/1487076214 31 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94356785133456] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c1402d070 con 0x55d126a813f0 2024-04-24T02:12:27.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.523+0000 7f4c2893f800 20 remove_watcher() i=4 2024-04-24T02:12:27.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.523+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94356785137472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d126a8cba0 con 0x7f4c1c031040 2024-04-24T02:12:27.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.524+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.0 v2:172.21.15.104:6800/2419146313 32 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94356785137472] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c1402d070 con 0x7f4c1c031040 2024-04-24T02:12:27.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.524+0000 7f4c2893f800 20 remove_watcher() i=5 2024-04-24T02:12:27.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.524+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94356785123264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d126a90740 con 0x7f4c1c031040 2024-04-24T02:12:27.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.525+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.0 v2:172.21.15.104:6800/2419146313 33 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94356785123264] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c1402d070 con 0x7f4c1c031040 2024-04-24T02:12:27.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.525+0000 7f4c2893f800 20 remove_watcher() i=6 2024-04-24T02:12:27.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.525+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94356785139728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d126a90740 con 0x7f4c1c031040 2024-04-24T02:12:27.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.526+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 <== osd.0 v2:172.21.15.104:6800/2419146313 34 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94356785139728] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c1402d070 con 0x7f4c1c031040 2024-04-24T02:12:27.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.526+0000 7f4c2893f800 20 remove_watcher() i=7 2024-04-24T02:12:27.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.526+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f4c1c031040 msgr2=0x7f4c1c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.526+0000 7f4c2893f800 1 --2- 172.21.15.134:0/1590771279 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f4c1c031040 0x7f4c1c032940 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.526+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d126a813f0 msgr2=0x55d126a838b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.526+0000 7f4c2893f800 1 --2- 172.21.15.134:0/1590771279 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d126a813f0 0x55d126a838b0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.526+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f4c0c074060 msgr2=0x7f4c0c0733b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.526+0000 7f4c2893f800 1 --2- 172.21.15.134:0/1590771279 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f4c0c074060 0x7f4c0c0733b0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.526+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55d126a87640 msgr2=0x55d126a89a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.526+0000 7f4c2893f800 1 --2- 172.21.15.134:0/1590771279 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55d126a87640 0x55d126a89a30 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.526+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4af4036900 msgr2=0x7f4af4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.526+0000 7f4c2893f800 1 --2- 172.21.15.134:0/1590771279 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4af4036900 0x7f4af4038dc0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x55d126a4d410 tx=0x7f4c1c01f000 comp rx=0 tx=0).stop 2024-04-24T02:12:27.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.526+0000 7f4c2469b640 1 -- 172.21.15.134:0/1590771279 reap_dead start 2024-04-24T02:12:27.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.526+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d126a6e240 msgr2=0x55d126a758a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.526+0000 7f4c2893f800 1 --2- 172.21.15.134:0/1590771279 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d126a6e240 0x55d126a758a0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c08e220 tx=0x7f4c0c08de10 comp rx=0 tx=0).stop 2024-04-24T02:12:27.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.526+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 shutdown_connections 2024-04-24T02:12:27.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.526+0000 7f4c2893f800 1 --2- 172.21.15.134:0/1590771279 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d126a6e240 0x55d126a758a0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.526+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 >> 172.21.15.134:0/1590771279 conn(0x55d126a6a5a0 msgr2=0x55d126a67c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:27.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.526+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 shutdown_connections 2024-04-24T02:12:27.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.526+0000 7f4c2893f800 1 -- 172.21.15.134:0/1590771279 wait complete. 2024-04-24T02:12:27.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.527+0000 7f4c2893f800 1 -- 172.21.15.134:0/4005062885 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4afc036950 msgr2=0x7f4afc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.527+0000 7f4c2893f800 1 --2- 172.21.15.134:0/4005062885 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4afc036950 0x7f4afc038e10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x55d126a510f0 tx=0x7f4c1c005840 comp rx=0 tx=0).stop 2024-04-24T02:12:27.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.527+0000 7f4c2893f800 1 -- 172.21.15.134:0/4005062885 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d126a61000 msgr2=0x55d126a61420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.527+0000 7f4c2893f800 1 --2- 172.21.15.134:0/4005062885 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d126a61000 0x55d126a61420 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c044840 tx=0x7f4c0c002fb0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.527+0000 7f4c2893f800 1 -- 172.21.15.134:0/4005062885 shutdown_connections 2024-04-24T02:12:27.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.527+0000 7f4c2893f800 1 --2- 172.21.15.134:0/4005062885 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4afc036950 0x7f4afc038e10 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.527+0000 7f4c2893f800 1 --2- 172.21.15.134:0/4005062885 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d126a61000 0x55d126a61420 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.527+0000 7f4c2893f800 1 -- 172.21.15.134:0/4005062885 >> 172.21.15.134:0/4005062885 conn(0x55d126a550a0 msgr2=0x55d126a554a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:27.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.527+0000 7f4c2893f800 1 -- 172.21.15.134:0/4005062885 shutdown_connections 2024-04-24T02:12:27.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.527+0000 7f4c2893f800 1 -- 172.21.15.134:0/4005062885 wait complete. 2024-04-24T02:12:27.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.527+0000 7f4c2893f800 1 -- 172.21.15.134:0/2297561852 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d126952460 msgr2=0x55d126a4fef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.527+0000 7f4c2893f800 1 --2- 172.21.15.134:0/2297561852 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d126952460 0x55d126a4fef0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.527+0000 7f4c2893f800 1 -- 172.21.15.134:0/2297561852 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4b0c0368b0 msgr2=0x7f4b0c038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.527+0000 7f4c2893f800 1 --2- 172.21.15.134:0/2297561852 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4b0c0368b0 0x7f4b0c038d70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c054000 tx=0x7f4c0c04e000 comp rx=0 tx=0).stop 2024-04-24T02:12:27.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.527+0000 7f4c2893f800 1 -- 172.21.15.134:0/2297561852 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d12694e950 msgr2=0x55d126a48cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.527+0000 7f4c2893f800 1 --2- 172.21.15.134:0/2297561852 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d12694e950 0x55d126a48cb0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4c1400b210 tx=0x7f4c14000ed0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.527+0000 7f4c2893f800 1 -- 172.21.15.134:0/2297561852 shutdown_connections 2024-04-24T02:12:27.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.527+0000 7f4c2893f800 1 --2- 172.21.15.134:0/2297561852 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d126952460 0x55d126a4fef0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.527+0000 7f4c2893f800 1 --2- 172.21.15.134:0/2297561852 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4b0c0368b0 0x7f4b0c038d70 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.527+0000 7f4c2893f800 1 --2- 172.21.15.134:0/2297561852 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d12694e950 0x55d126a48cb0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.527+0000 7f4c2893f800 1 -- 172.21.15.134:0/2297561852 >> 172.21.15.134:0/2297561852 conn(0x55d1269483a0 msgr2=0x55d12694d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:27.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.527+0000 7f4c2893f800 1 -- 172.21.15.134:0/2297561852 shutdown_connections 2024-04-24T02:12:27.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.527+0000 7f4c2893f800 1 -- 172.21.15.134:0/2297561852 wait complete. 2024-04-24T02:12:27.565 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-04-24T02:12:27.565 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-04-24T02:12:27.565 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-04-24T02:12:27.606 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:27.606 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:27.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.607+0000 7fbf00d1f800 1 Processor -- start 2024-04-24T02:12:27.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.607+0000 7fbf00d1f800 1 -- start start 2024-04-24T02:12:27.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.607+0000 7fbf00d1f800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55f5636864a0 0x55f563688890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.607+0000 7fbf00d1f800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f563540d40 con 0x55f563682990 2024-04-24T02:12:27.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.607+0000 7fbf00d1f800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55f5635134d0 con 0x55f5636864a0 2024-04-24T02:12:27.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.607+0000 7fbef7fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55f5636864a0 0x55f563688890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.607+0000 7fbefc9ca640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55f563682990 0x55f563684d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:55326/0 (socket says 172.21.15.134:55326) 2024-04-24T02:12:27.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.607+0000 7fbefc9ca640 1 -- 172.21.15.134:0/4036937790 learned_addr learned my addr 172.21.15.134:0/4036937790 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:12:27.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.607+0000 7fbef7fff640 1 -- 172.21.15.134:0/4036937790 >> v1:172.21.15.104:6789/0 conn(0x55f563682990 legacy=0x55f563684d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.607+0000 7fbef77fe640 1 -- 172.21.15.134:0/4036937790 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2718661990 0 0) 0x55f563540d40 con 0x55f563682990 2024-04-24T02:12:27.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.607+0000 7fbef7fff640 1 -- 172.21.15.134:0/4036937790 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f56353f590 con 0x55f5636864a0 2024-04-24T02:12:27.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.608+0000 7fbef7fff640 1 --2- 172.21.15.134:0/4036937790 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f5636864a0 0x55f563688890 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fbee800a470 tx=0x7fbee801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da9b90bacc0af7c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.609+0000 7fbef77fe640 1 -- 172.21.15.134:0/4036937790 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbee8057070 con 0x55f5636864a0 2024-04-24T02:12:27.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.609+0000 7fbef77fe640 1 -- 172.21.15.134:0/4036937790 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbee8052570 con 0x55f5636864a0 2024-04-24T02:12:27.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.609+0000 7fbef77fe640 1 -- 172.21.15.134:0/4036937790 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbee8052870 con 0x55f5636864a0 2024-04-24T02:12:27.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.609+0000 7fbf00d1f800 1 -- 172.21.15.134:0/4036937790 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f5636864a0 msgr2=0x55f563688890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.609+0000 7fbf00d1f800 1 --2- 172.21.15.134:0/4036937790 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f5636864a0 0x55f563688890 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fbee800a470 tx=0x7fbee801ce90 comp rx=0 tx=0).stop 2024-04-24T02:12:27.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.609+0000 7fbf00d1f800 1 -- 172.21.15.134:0/4036937790 shutdown_connections 2024-04-24T02:12:27.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.609+0000 7fbf00d1f800 1 --2- 172.21.15.134:0/4036937790 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f5636864a0 0x55f563688890 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.609+0000 7fbf00d1f800 1 -- 172.21.15.134:0/4036937790 >> 172.21.15.134:0/4036937790 conn(0x55f56367c320 msgr2=0x55f56367e740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:27.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.609+0000 7fbf00d1f800 1 -- 172.21.15.134:0/4036937790 shutdown_connections 2024-04-24T02:12:27.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.609+0000 7fbf00d1f800 1 -- 172.21.15.134:0/4036937790 wait complete. 2024-04-24T02:12:27.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.621+0000 7fbf00d1f800 1 Processor -- start 2024-04-24T02:12:27.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.621+0000 7fbf00d1f800 1 -- start start 2024-04-24T02:12:27.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.621+0000 7fbf00d1f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f563682990 0x55f5636822d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.621+0000 7fbf00d1f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55f5635cd3c0 con 0x55f563682990 2024-04-24T02:12:27.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.621+0000 7fbefc9ca640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f563682990 0x55f5636822d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.621+0000 7fbefc9ca640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f563682990 0x55f5636822d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56444/0 (socket says 172.21.15.134:56444) 2024-04-24T02:12:27.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.621+0000 7fbefc9ca640 1 -- 172.21.15.134:0/2539607380 learned_addr learned my addr 172.21.15.134:0/2539607380 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:27.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.622+0000 7fbefc9ca640 1 -- 172.21.15.134:0/2539607380 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f563680890 con 0x55f563682990 2024-04-24T02:12:27.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.622+0000 7fbefc9ca640 1 --2- 172.21.15.134:0/2539607380 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f563682990 0x55f5636822d0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fbef000b210 tx=0x7fbef000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50426b5bb02433df server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.622+0000 7fbdeae05640 1 -- 172.21.15.134:0/2539607380 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbef0008070 con 0x55f563682990 2024-04-24T02:12:27.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.622+0000 7fbdeae05640 1 -- 172.21.15.134:0/2539607380 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbef000d500 con 0x55f563682990 2024-04-24T02:12:27.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.622+0000 7fbdeae05640 1 -- 172.21.15.134:0/2539607380 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbef000d840 con 0x55f563682990 2024-04-24T02:12:27.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.623+0000 7fbf00d1f800 1 -- 172.21.15.134:0/2539607380 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f563682990 msgr2=0x55f5636822d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.623+0000 7fbf00d1f800 1 --2- 172.21.15.134:0/2539607380 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f563682990 0x55f5636822d0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fbef000b210 tx=0x7fbef000b6d0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.623+0000 7fbf00d1f800 1 -- 172.21.15.134:0/2539607380 shutdown_connections 2024-04-24T02:12:27.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.623+0000 7fbf00d1f800 1 --2- 172.21.15.134:0/2539607380 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f563682990 0x55f5636822d0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.623+0000 7fbf00d1f800 1 -- 172.21.15.134:0/2539607380 >> 172.21.15.134:0/2539607380 conn(0x55f56367c320 msgr2=0x55f56376e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:27.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.623+0000 7fbf00d1f800 1 -- 172.21.15.134:0/2539607380 shutdown_connections 2024-04-24T02:12:27.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.623+0000 7fbf00d1f800 1 -- 172.21.15.134:0/2539607380 wait complete. 2024-04-24T02:12:27.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.623+0000 7fbf00d1f800 1 Processor -- start 2024-04-24T02:12:27.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.623+0000 7fbf00d1f800 1 -- start start 2024-04-24T02:12:27.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.623+0000 7fbf00d1f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f563682990 0x55f56377ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.623+0000 7fbf00d1f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55f56368b0e0 con 0x55f563682990 2024-04-24T02:12:27.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.623+0000 7fbefc9ca640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f563682990 0x55f56377ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.624+0000 7fbefc9ca640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f563682990 0x55f56377ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56456/0 (socket says 172.21.15.134:56456) 2024-04-24T02:12:27.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.624+0000 7fbefc9ca640 1 -- 172.21.15.134:0/2892592233 learned_addr learned my addr 172.21.15.134:0/2892592233 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:27.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.624+0000 7fbefc9ca640 1 -- 172.21.15.134:0/2892592233 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f56377d230 con 0x55f563682990 2024-04-24T02:12:27.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.624+0000 7fbefc9ca640 1 --2- 172.21.15.134:0/2892592233 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f563682990 0x55f56377ccf0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fbef000b210 tx=0x7fbef0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.624+0000 7fbde9602640 1 -- 172.21.15.134:0/2892592233 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbef000f950 con 0x55f563682990 2024-04-24T02:12:27.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.624+0000 7fbde9602640 1 -- 172.21.15.134:0/2892592233 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbef000faf0 con 0x55f563682990 2024-04-24T02:12:27.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.624+0000 7fbf00d1f800 1 -- 172.21.15.134:0/2892592233 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f56377d4c0 con 0x55f563682990 2024-04-24T02:12:27.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.624+0000 7fbde9602640 1 -- 172.21.15.134:0/2892592233 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbef000fdd0 con 0x55f563682990 2024-04-24T02:12:27.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.624+0000 7fbf00d1f800 1 -- 172.21.15.134:0/2892592233 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f563780170 con 0x55f563682990 2024-04-24T02:12:27.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.625+0000 7fbde9602640 1 -- 172.21.15.134:0/2892592233 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbef0017040 con 0x55f563682990 2024-04-24T02:12:27.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.625+0000 7fbde9602640 1 --2- 172.21.15.134:0/2892592233 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fbde40368b0 0x7fbde4038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.625+0000 7fbde9602640 1 -- 172.21.15.134:0/2892592233 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fbef0015020 con 0x55f563682990 2024-04-24T02:12:27.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.625+0000 7fbef7fff640 1 --2- 172.21.15.134:0/2892592233 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fbde40368b0 0x7fbde4038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.625+0000 7fbf00d1f800 1 --2- 172.21.15.134:0/2892592233 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f5636864a0 0x55f563783f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.625+0000 7fbf00d1f800 1 -- 172.21.15.134:0/2892592233 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f5637844b0 con 0x55f5636864a0 2024-04-24T02:12:27.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.625+0000 7fbefd1cb640 1 --2- 172.21.15.134:0/2892592233 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f5636864a0 0x55f563783f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.626+0000 7fbef7fff640 1 --2- 172.21.15.134:0/2892592233 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fbde40368b0 0x7fbde4038d70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbee8054000 tx=0x7fbee804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.626+0000 7fbefd1cb640 1 --2- 172.21.15.134:0/2892592233 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f5636864a0 0x55f563783f30 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.626+0000 7fbefd1cb640 1 -- 172.21.15.134:0/2892592233 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbef800a4a0 con 0x55f5636864a0 2024-04-24T02:12:27.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.626+0000 7fbf00d1f800 1 -- 172.21.15.134:0/2892592233 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f563781500 con 0x55f5636864a0 2024-04-24T02:12:27.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.626+0000 7fbefd1cb640 1 -- 172.21.15.134:0/2892592233 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbef800a4a0 con 0x55f5636864a0 2024-04-24T02:12:27.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.626+0000 7fbf00d1f800 1 -- 172.21.15.134:0/2892592233 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f5637862d0 con 0x55f5636864a0 2024-04-24T02:12:27.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.627+0000 7fbefd1cb640 1 -- 172.21.15.134:0/2892592233 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbef800a4a0 con 0x55f5636864a0 2024-04-24T02:12:27.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.627+0000 7fbf00d1f800 1 -- 172.21.15.134:0/2892592233 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f563785610 con 0x55f5636864a0 2024-04-24T02:12:27.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.627+0000 7fbefd1cb640 1 -- 172.21.15.134:0/2892592233 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbef800a4a0 con 0x55f5636864a0 2024-04-24T02:12:27.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.627+0000 7fbf00d1f800 1 -- 172.21.15.134:0/2892592233 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f563785a60 con 0x55f5636864a0 2024-04-24T02:12:27.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.627+0000 7fbefd1cb640 1 -- 172.21.15.134:0/2892592233 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbef800a4a0 con 0x55f5636864a0 2024-04-24T02:12:27.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.627+0000 7fbf00d1f800 1 Processor -- start 2024-04-24T02:12:27.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.627+0000 7fbf00d1f800 1 -- start start 2024-04-24T02:12:27.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.628+0000 7fbf00d1f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f5637950c0 0x55f5637954e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.628+0000 7fbf00d1f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55f5635736b0 con 0x55f5637950c0 2024-04-24T02:12:27.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.628+0000 7fbef7fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f5637950c0 0x55f5637954e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.628+0000 7fbef7fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f5637950c0 0x55f5637954e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56472/0 (socket says 172.21.15.134:56472) 2024-04-24T02:12:27.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.628+0000 7fbef7fff640 1 -- 172.21.15.134:0/1848416041 learned_addr learned my addr 172.21.15.134:0/1848416041 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:27.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.628+0000 7fbef7fff640 1 -- 172.21.15.134:0/1848416041 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f563795a20 con 0x55f5637950c0 2024-04-24T02:12:27.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.628+0000 7fbef7fff640 1 --2- 172.21.15.134:0/1848416041 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f5637950c0 0x55f5637954e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fbee8044840 tx=0x7fbee8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.628+0000 7fbde27fc640 1 -- 172.21.15.134:0/1848416041 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbee806f070 con 0x55f5637950c0 2024-04-24T02:12:27.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.629+0000 7fbde27fc640 1 -- 172.21.15.134:0/1848416041 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbee8058040 con 0x55f5637950c0 2024-04-24T02:12:27.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.629+0000 7fbf00d1f800 1 -- 172.21.15.134:0/1848416041 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f563796490 con 0x55f5637950c0 2024-04-24T02:12:27.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.629+0000 7fbde27fc640 1 -- 172.21.15.134:0/1848416041 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbee8057050 con 0x55f5637950c0 2024-04-24T02:12:27.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.629+0000 7fbf00d1f800 1 -- 172.21.15.134:0/1848416041 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f563796930 con 0x55f5637950c0 2024-04-24T02:12:27.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.629+0000 7fbde27fc640 1 -- 172.21.15.134:0/1848416041 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbee8072070 con 0x55f5637950c0 2024-04-24T02:12:27.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.629+0000 7fbde27fc640 1 --2- 172.21.15.134:0/1848416041 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fbdd4036950 0x7fbdd4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.629+0000 7fbde27fc640 1 -- 172.21.15.134:0/1848416041 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fbee808f9c0 con 0x55f5637950c0 2024-04-24T02:12:27.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.629+0000 7fbefd1cb640 1 --2- 172.21.15.134:0/1848416041 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fbdd4036950 0x7fbdd4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.630+0000 7fbf00d1f800 1 Processor -- start 2024-04-24T02:12:27.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.630+0000 7fbefd1cb640 1 --2- 172.21.15.134:0/1848416041 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fbdd4036950 0x7fbdd4038e10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x55f563785130 tx=0x7fbef8005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.630+0000 7fbf00d1f800 1 -- start start 2024-04-24T02:12:27.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.630+0000 7fbf00d1f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f5637a2300 0x55f5637a2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.630+0000 7fbf00d1f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55f563680c10 con 0x55f5637a2300 2024-04-24T02:12:27.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.630+0000 7fbef7fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f5637a2300 0x55f5637a2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.630+0000 7fbef7fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f5637a2300 0x55f5637a2720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56476/0 (socket says 172.21.15.134:56476) 2024-04-24T02:12:27.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.630+0000 7fbef7fff640 1 -- 172.21.15.134:0/3075725160 learned_addr learned my addr 172.21.15.134:0/3075725160 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:27.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.630+0000 7fbef7fff640 1 -- 172.21.15.134:0/3075725160 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5637a2cf0 con 0x55f5637a2300 2024-04-24T02:12:27.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.630+0000 7fbef7fff640 1 --2- 172.21.15.134:0/3075725160 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f5637a2300 0x55f5637a2720 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fbee808ded0 tx=0x7fbee805db30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c109fb88689ca3cf server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.631+0000 7fbdd3fff640 1 -- 172.21.15.134:0/3075725160 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbee805d3e0 con 0x55f5637a2300 2024-04-24T02:12:27.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.631+0000 7fbdd3fff640 1 -- 172.21.15.134:0/3075725160 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbee805cc80 con 0x55f5637a2300 2024-04-24T02:12:27.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.631+0000 7fbdd3fff640 1 -- 172.21.15.134:0/3075725160 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbee805d580 con 0x55f5637a2300 2024-04-24T02:12:27.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.631+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3075725160 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f5637a2300 msgr2=0x55f5637a2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.631+0000 7fbf00d1f800 1 --2- 172.21.15.134:0/3075725160 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f5637a2300 0x55f5637a2720 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fbee808ded0 tx=0x7fbee805db30 comp rx=0 tx=0).stop 2024-04-24T02:12:27.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.631+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3075725160 shutdown_connections 2024-04-24T02:12:27.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.631+0000 7fbf00d1f800 1 --2- 172.21.15.134:0/3075725160 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f5637a2300 0x55f5637a2720 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.631+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3075725160 >> 172.21.15.134:0/3075725160 conn(0x55f56379e660 msgr2=0x55f56379c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:27.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.631+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3075725160 shutdown_connections 2024-04-24T02:12:27.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.631+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3075725160 wait complete. 2024-04-24T02:12:27.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.631+0000 7fbf00d1f800 1 Processor -- start 2024-04-24T02:12:27.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.631+0000 7fbf00d1f800 1 -- start start 2024-04-24T02:12:27.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.631+0000 7fbf00d1f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f5637a2300 0x55f5637a99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.631+0000 7fbf00d1f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55f5637a3460 con 0x55f5637a2300 2024-04-24T02:12:27.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.632+0000 7fbef7fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f5637a2300 0x55f5637a99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.632+0000 7fbef7fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f5637a2300 0x55f5637a99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56480/0 (socket says 172.21.15.134:56480) 2024-04-24T02:12:27.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.632+0000 7fbef7fff640 1 -- 172.21.15.134:0/3419449144 learned_addr learned my addr 172.21.15.134:0/3419449144 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:27.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.632+0000 7fbef7fff640 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5637a9ef0 con 0x55f5637a2300 2024-04-24T02:12:27.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.632+0000 7fbef7fff640 1 --2- 172.21.15.134:0/3419449144 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f5637a2300 0x55f5637a99b0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fbee805dc00 tx=0x7fbee808de30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.632+0000 7fbdd27fc640 1 -- 172.21.15.134:0/3419449144 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbee808f330 con 0x55f5637a2300 2024-04-24T02:12:27.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.632+0000 7fbdd27fc640 1 -- 172.21.15.134:0/3419449144 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbee808f4d0 con 0x55f5637a2300 2024-04-24T02:12:27.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.632+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f5637aa180 con 0x55f5637a2300 2024-04-24T02:12:27.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.632+0000 7fbdd27fc640 1 -- 172.21.15.134:0/3419449144 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbee805f870 con 0x55f5637a2300 2024-04-24T02:12:27.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.632+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5637ace30 con 0x55f5637a2300 2024-04-24T02:12:27.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.633+0000 7fbdd27fc640 1 -- 172.21.15.134:0/3419449144 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbee8088050 con 0x55f5637a2300 2024-04-24T02:12:27.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.633+0000 7fbdd27fc640 1 --2- 172.21.15.134:0/3419449144 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fbdc8036950 0x7fbdc8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.633+0000 7fbf00d1f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.633+0000 7fbdd27fc640 1 -- 172.21.15.134:0/3419449144 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fbee8077120 con 0x55f5637a2300 2024-04-24T02:12:27.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.633+0000 7fbefd1cb640 1 --2- 172.21.15.134:0/3419449144 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fbdc8036950 0x7fbdc8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.633+0000 7fbf00d1f800 1 --2- 172.21.15.134:0/3419449144 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f5637b5440 0x55f5637b78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.633+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f5637b8030 con 0x55f5637b5440 2024-04-24T02:12:27.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.633+0000 7fbefc9ca640 1 --2- 172.21.15.134:0/3419449144 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f5637b5440 0x55f5637b78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.634+0000 7fbefd1cb640 1 --2- 172.21.15.134:0/3419449144 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fbdc8036950 0x7fbdc8038e10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x55f563781450 tx=0x7fbef801f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.634+0000 7fbefc9ca640 1 --2- 172.21.15.134:0/3419449144 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f5637b5440 0x55f5637b78e0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.634+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbef002d070 con 0x55f5637b5440 2024-04-24T02:12:27.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.634+0000 7fbf00d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.634+0000 7fbf00d1f800 20 realm 2024-04-24T02:12:27.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.634+0000 7fbf00d1f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.634+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f5637b8440 con 0x55f5637b5440 2024-04-24T02:12:27.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.634+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbef002d070 con 0x55f5637b5440 2024-04-24T02:12:27.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.634+0000 7fbf00d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.634+0000 7fbf00d1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:27.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.634+0000 7fbf00d1f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.634+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f5637b8d10 con 0x55f5637b5440 2024-04-24T02:12:27.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.634+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbef002d070 con 0x55f5637b5440 2024-04-24T02:12:27.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.634+0000 7fbf00d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.634+0000 7fbf00d1f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.634+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f5637b90b0 con 0x55f5637b5440 2024-04-24T02:12:27.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.635+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbef002d070 con 0x55f5637b5440 2024-04-24T02:12:27.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.635+0000 7fbf00d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:27.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.635+0000 7fbf00d1f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.635+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f5637b9510 con 0x55f5637b5440 2024-04-24T02:12:27.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.635+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbef002d070 con 0x55f5637b5440 2024-04-24T02:12:27.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.635+0000 7fbf00d1f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:27.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.635+0000 7fbf00d1f800 20 searching for the correct realm 2024-04-24T02:12:27.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.635+0000 7fbf00d1f800 1 --2- 172.21.15.134:0/3419449144 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55f5637bb500 0x55f5637bd910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.635+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f5637bdfe0 con 0x55f5637bb500 2024-04-24T02:12:27.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.635+0000 7fbef7fff640 1 --2- 172.21.15.134:0/3419449144 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55f5637bb500 0x55f5637bd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.635+0000 7fbef7fff640 1 --2- 172.21.15.134:0/3419449144 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55f5637bb500 0x55f5637bd910 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.636+0000 7fbef7fff640 1 -- 172.21.15.134:0/3419449144 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbee8071030 con 0x55f5637bb500 2024-04-24T02:12:27.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.636+0000 7fbef7fff640 1 --2- 172.21.15.134:0/3419449144 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fbee8074060 0x7fbee8088340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.636+0000 7fbef7fff640 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f5637bdfe0 con 0x7fbee8074060 2024-04-24T02:12:27.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.636+0000 7fbefd1cb640 1 --2- 172.21.15.134:0/3419449144 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fbee8074060 0x7fbee8088340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.636+0000 7fbefd1cb640 1 --2- 172.21.15.134:0/3419449144 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fbee8074060 0x7fbee8088340 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.636+0000 7fbefd1cb640 1 -- 172.21.15.134:0/3419449144 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbef801f070 con 0x7fbee8074060 2024-04-24T02:12:27.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.636+0000 7fbefd1cb640 1 --2- 172.21.15.134:0/3419449144 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fbef8031040 0x7fbef8032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.636+0000 7fbefd1cb640 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f5637bdfe0 con 0x7fbef8031040 2024-04-24T02:12:27.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.637+0000 7fbefc9ca640 1 --2- 172.21.15.134:0/3419449144 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fbef8031040 0x7fbef8032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.637+0000 7fbefc9ca640 1 --2- 172.21.15.134:0/3419449144 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fbef8031040 0x7fbef8032940 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.637+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbef002d070 con 0x7fbef8031040 2024-04-24T02:12:27.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.637+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f5637bdfe0 con 0x55f5637b5440 2024-04-24T02:12:27.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.637+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbef002d070 con 0x55f5637b5440 2024-04-24T02:12:27.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.637+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f5637bdfe0 con 0x55f5637b5440 2024-04-24T02:12:27.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.638+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbef002d070 con 0x55f5637b5440 2024-04-24T02:12:27.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.638+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f5637bdfe0 con 0x7fbef8031040 2024-04-24T02:12:27.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.638+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbef002d070 con 0x7fbef8031040 2024-04-24T02:12:27.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.638+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f5637bdfe0 con 0x7fbef8031040 2024-04-24T02:12:27.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.638+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbef002d070 con 0x7fbef8031040 2024-04-24T02:12:27.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.638+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f5637bdfe0 con 0x7fbee8074060 2024-04-24T02:12:27.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.638+0000 7fbefd1cb640 1 -- 172.21.15.134:0/3419449144 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbef801f070 con 0x7fbee8074060 2024-04-24T02:12:27.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.638+0000 7fbefd1cb640 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f5637bdfe0 con 0x55f5637bb500 2024-04-24T02:12:27.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.639+0000 7fbef7fff640 1 -- 172.21.15.134:0/3419449144 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbee8071030 con 0x55f5637bb500 2024-04-24T02:12:27.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.639+0000 7fbef7fff640 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f5637bdfe0 con 0x55f5637b5440 2024-04-24T02:12:27.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.639+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbef002d070 con 0x55f5637b5440 2024-04-24T02:12:27.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.639+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f5637bdfe0 con 0x7fbef8031040 2024-04-24T02:12:27.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.639+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbef002d070 con 0x7fbef8031040 2024-04-24T02:12:27.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.639+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f5637bdfe0 con 0x55f5637b5440 2024-04-24T02:12:27.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.639+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbef002d070 con 0x55f5637b5440 2024-04-24T02:12:27.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.639+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f5637bdfe0 con 0x7fbee8074060 2024-04-24T02:12:27.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.640+0000 7fbefd1cb640 1 -- 172.21.15.134:0/3419449144 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbef801f070 con 0x7fbee8074060 2024-04-24T02:12:27.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.640+0000 7fbefd1cb640 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f5637bdfe0 con 0x55f5637bb500 2024-04-24T02:12:27.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.640+0000 7fbef7fff640 1 -- 172.21.15.134:0/3419449144 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbee8071030 con 0x55f5637bb500 2024-04-24T02:12:27.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.640+0000 7fbef7fff640 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f5637bdfe0 con 0x55f5637bb500 2024-04-24T02:12:27.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.640+0000 7fbef7fff640 1 -- 172.21.15.134:0/3419449144 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbee8071030 con 0x55f5637bb500 2024-04-24T02:12:27.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.640+0000 7fbef7fff640 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f5637bdfe0 con 0x7fbef8031040 2024-04-24T02:12:27.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.640+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbef002d070 con 0x7fbef8031040 2024-04-24T02:12:27.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.640+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f5637bdfe0 con 0x55f5637bb500 2024-04-24T02:12:27.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.641+0000 7fbef7fff640 1 -- 172.21.15.134:0/3419449144 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbee8071030 con 0x55f5637bb500 2024-04-24T02:12:27.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.641+0000 7fbef7fff640 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f5637bdfe0 con 0x55f5637bb500 2024-04-24T02:12:27.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.641+0000 7fbef7fff640 1 -- 172.21.15.134:0/3419449144 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbee8071030 con 0x55f5637bb500 2024-04-24T02:12:27.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.641+0000 7fbef7fff640 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f5637bdfe0 con 0x55f5637b5440 2024-04-24T02:12:27.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.641+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbef002d070 con 0x55f5637b5440 2024-04-24T02:12:27.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.641+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f5637bdfe0 con 0x55f5637b5440 2024-04-24T02:12:27.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.641+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fbef002d070 con 0x55f5637b5440 2024-04-24T02:12:27.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.641+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f5637bdfe0 con 0x7fbef8031040 2024-04-24T02:12:27.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.641+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbef002d070 con 0x7fbef8031040 2024-04-24T02:12:27.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.641+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f5637bdfe0 con 0x55f5637bb500 2024-04-24T02:12:27.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.642+0000 7fbef7fff640 1 -- 172.21.15.134:0/3419449144 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbee8071030 con 0x55f5637bb500 2024-04-24T02:12:27.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.642+0000 7fbef7fff640 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f5637bdfe0 con 0x7fbee8074060 2024-04-24T02:12:27.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.642+0000 7fbefd1cb640 1 -- 172.21.15.134:0/3419449144 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbef801f070 con 0x7fbee8074060 2024-04-24T02:12:27.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.642+0000 7fbefd1cb640 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f5637bdfe0 con 0x55f5637b5440 2024-04-24T02:12:27.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.642+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbef002d070 con 0x55f5637b5440 2024-04-24T02:12:27.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.642+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f5637bdfe0 con 0x7fbef8031040 2024-04-24T02:12:27.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.642+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbef002d070 con 0x7fbef8031040 2024-04-24T02:12:27.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.642+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f5637bdfe0 con 0x55f5637bb500 2024-04-24T02:12:27.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.643+0000 7fbef7fff640 1 -- 172.21.15.134:0/3419449144 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbee8071030 con 0x55f5637bb500 2024-04-24T02:12:27.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.643+0000 7fbef7fff640 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f5637bdfe0 con 0x7fbef8031040 2024-04-24T02:12:27.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.643+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbef002d070 con 0x7fbef8031040 2024-04-24T02:12:27.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.643+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f5637bdfe0 con 0x7fbee8074060 2024-04-24T02:12:27.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.643+0000 7fbefd1cb640 1 -- 172.21.15.134:0/3419449144 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbef801f070 con 0x7fbee8074060 2024-04-24T02:12:27.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.643+0000 7fbefd1cb640 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f5637bdfe0 con 0x55f5637bb500 2024-04-24T02:12:27.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.643+0000 7fbef7fff640 1 -- 172.21.15.134:0/3419449144 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbee8071030 con 0x55f5637bb500 2024-04-24T02:12:27.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.643+0000 7fbef7fff640 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f5637bdfe0 con 0x7fbef8031040 2024-04-24T02:12:27.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.644+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbef002d070 con 0x7fbef8031040 2024-04-24T02:12:27.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.644+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f5637bdfe0 con 0x55f5637b5440 2024-04-24T02:12:27.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.644+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbef002d070 con 0x55f5637b5440 2024-04-24T02:12:27.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.644+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f5637bdfe0 con 0x7fbee8074060 2024-04-24T02:12:27.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.644+0000 7fbefd1cb640 1 -- 172.21.15.134:0/3419449144 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbef801f070 con 0x7fbee8074060 2024-04-24T02:12:27.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.644+0000 7fbf00d1f800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:27.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.644+0000 7fbf00d1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:27.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.644+0000 7fbf00d1f800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:27.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.644+0000 7fbf00d1f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:27.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.644+0000 7fbf00d1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:27.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.644+0000 7fbf00d1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:27.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.644+0000 7fbf00d1f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.644+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f5637b9f80 con 0x55f5637b5440 2024-04-24T02:12:27.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.644+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbef002d070 con 0x55f5637b5440 2024-04-24T02:12:27.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.644+0000 7fbf00d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.644+0000 7fbf00d1f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.644+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f5637ba820 con 0x55f5637b5440 2024-04-24T02:12:27.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.645+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbef002d070 con 0x55f5637b5440 2024-04-24T02:12:27.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.645+0000 7fbf00d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:27.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.645+0000 7fbf00d1f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.645+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f5637b9bc0 con 0x55f5637b5440 2024-04-24T02:12:27.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.645+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbef002d070 con 0x55f5637b5440 2024-04-24T02:12:27.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.645+0000 7fbf00d1f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:27.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.645+0000 7fbf00d1f800 20 zone default found 2024-04-24T02:12:27.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.645+0000 7fbf00d1f800 4 Realm: () 2024-04-24T02:12:27.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.645+0000 7fbf00d1f800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:27.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.645+0000 7fbf00d1f800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:27.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.645+0000 7fbf00d1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:27.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.645+0000 7fbf00d1f800 20 zonegroup default 2024-04-24T02:12:27.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.645+0000 7fbf00d1f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.645+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f5637be460 con 0x7fbef8031040 2024-04-24T02:12:27.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.645+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbef002d070 con 0x7fbef8031040 2024-04-24T02:12:27.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.645+0000 7fbf00d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.645+0000 7fbf00d1f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.645+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f5637c02f0 con 0x55f5637bb500 2024-04-24T02:12:27.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.645+0000 7fbef7fff640 1 -- 172.21.15.134:0/3419449144 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbee8071030 con 0x55f5637bb500 2024-04-24T02:12:27.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.646+0000 7fbf00d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.646+0000 7fbf00d1f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.646+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f5637c0690 con 0x55f5637bb500 2024-04-24T02:12:27.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.646+0000 7fbef7fff640 1 -- 172.21.15.134:0/3419449144 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbee8071030 con 0x55f5637bb500 2024-04-24T02:12:27.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.646+0000 7fbf00d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.646+0000 7fbf00d1f800 20 started sync module instance, tier type = 2024-04-24T02:12:27.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.646+0000 7fbf00d1f800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:27.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.646+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f5637bf730 con 0x7fbee8074060 2024-04-24T02:12:27.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.647+0000 7fbefd1cb640 1 -- 172.21.15.134:0/3419449144 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbef8040040 con 0x7fbee8074060 2024-04-24T02:12:27.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.647+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94512424418080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f5637bff40 con 0x7fbee8074060 2024-04-24T02:12:27.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.647+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f5637c1500 con 0x55f5637b5440 2024-04-24T02:12:27.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.648+0000 7fbefd1cb640 1 -- 172.21.15.134:0/3419449144 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94512424418080] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbef8040040 con 0x7fbee8074060 2024-04-24T02:12:27.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.648+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbef002d070 con 0x55f5637b5440 2024-04-24T02:12:27.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.648+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94512424423504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f5637c1920 con 0x55f5637b5440 2024-04-24T02:12:27.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.648+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f5637c22e0 con 0x55f5637bb500 2024-04-24T02:12:27.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.649+0000 7fbef7fff640 1 -- 172.21.15.134:0/3419449144 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbee8071030 con 0x55f5637bb500 2024-04-24T02:12:27.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.649+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94512424427056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f5637c2b30 con 0x55f5637bb500 2024-04-24T02:12:27.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.649+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f5637c35b0 con 0x7fbee8074060 2024-04-24T02:12:27.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.649+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94512424423504] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbef002d070 con 0x55f5637b5440 2024-04-24T02:12:27.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.650+0000 7fbef7fff640 1 -- 172.21.15.134:0/3419449144 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94512424427056] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbee8071030 con 0x55f5637bb500 2024-04-24T02:12:27.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.650+0000 7fbefd1cb640 1 -- 172.21.15.134:0/3419449144 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbef8040040 con 0x7fbee8074060 2024-04-24T02:12:27.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.650+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94512424429184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f5637c1470 con 0x7fbee8074060 2024-04-24T02:12:27.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.650+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f5637c3e80 con 0x55f5637b5440 2024-04-24T02:12:27.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.651+0000 7fbefd1cb640 1 -- 172.21.15.134:0/3419449144 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94512424429184] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbef8040040 con 0x7fbee8074060 2024-04-24T02:12:27.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.651+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbef002d070 con 0x55f5637b5440 2024-04-24T02:12:27.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.651+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94512424431776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f5637c3e80 con 0x55f5637b5440 2024-04-24T02:12:27.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.651+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f5637c4890 con 0x7fbef8031040 2024-04-24T02:12:27.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.652+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94512424431776] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbef002d070 con 0x55f5637b5440 2024-04-24T02:12:27.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.652+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbef002d070 con 0x7fbef8031040 2024-04-24T02:12:27.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.652+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94512424437184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f5637c3e80 con 0x7fbef8031040 2024-04-24T02:12:27.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.652+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f5637c3e80 con 0x7fbef8031040 2024-04-24T02:12:27.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.653+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94512424437184] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbef002d070 con 0x7fbef8031040 2024-04-24T02:12:27.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.653+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(56 notify.6 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbef002d070 con 0x7fbef8031040 2024-04-24T02:12:27.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.653+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94512424434640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f5637c52d0 con 0x7fbef8031040 2024-04-24T02:12:27.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.653+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f5637c5c90 con 0x7fbef8031040 2024-04-24T02:12:27.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.654+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(58 notify.7 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbef002d070 con 0x7fbef8031040 2024-04-24T02:12:27.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.654+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94512424441824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f5637c60b0 con 0x7fbef8031040 2024-04-24T02:12:27.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.654+0000 7fbf00d1f800 20 add_watcher() i=0 2024-04-24T02:12:27.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.654+0000 7fbf00d1f800 20 add_watcher() i=1 2024-04-24T02:12:27.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.654+0000 7fbf00d1f800 20 add_watcher() i=2 2024-04-24T02:12:27.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.654+0000 7fbf00d1f800 20 add_watcher() i=3 2024-04-24T02:12:27.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.654+0000 7fbf00d1f800 20 add_watcher() i=4 2024-04-24T02:12:27.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.654+0000 7fbf00d1f800 20 add_watcher() i=5 2024-04-24T02:12:27.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.654+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94512424434640] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbef002d070 con 0x7fbef8031040 2024-04-24T02:12:27.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.654+0000 7fbf00d1f800 20 add_watcher() i=6 2024-04-24T02:12:27.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.656+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94512424441824] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbef002d070 con 0x7fbef8031040 2024-04-24T02:12:27.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.656+0000 7fbf00d1f800 20 add_watcher() i=7 2024-04-24T02:12:27.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.656+0000 7fbf00d1f800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:27.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.656+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f5637c60b0 con 0x55f5637b5440 2024-04-24T02:12:27.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.656+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbef002d070 con 0x55f5637b5440 2024-04-24T02:12:27.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.656+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94512424442880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f5637c6020 con 0x55f5637b5440 2024-04-24T02:12:27.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.657+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94512424442880] v30'137 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbef002d070 con 0x55f5637b5440 2024-04-24T02:12:27.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.657+0000 7fbdb2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:27.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.658+0000 7fbf00d1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:27.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.658+0000 7fbf00d1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:27.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.658+0000 7fbf00d1f800 5 note: GC not initialized 2024-04-24T02:12:27.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.658+0000 7fbdb1fe3640 20 reqs_thread_entry: start 2024-04-24T02:12:27.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.658+0000 7fbf00d1f800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:27.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.658+0000 7fbf00d1f800 20 Filter name: none 2024-04-24T02:12:27.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.658+0000 7fbd237fe640 20 reqs_thread_entry: start 2024-04-24T02:12:27.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.658+0000 7fbf00d1f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.658+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f5637fbf50 con 0x55f5637b5440 2024-04-24T02:12:27.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.660+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 281+0+332 (crc 0 0 0) 0x7fbef002d070 con 0x55f5637b5440 2024-04-24T02:12:27.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.660+0000 7fbf00d1f800 20 rados_obj.operate() r=0 bl.length=193 2024-04-24T02:12:27.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.661+0000 7fbdb2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:27.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.661+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94512424442880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f5637d27d0 con 0x55f5637b5440 2024-04-24T02:12:27.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.662+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94512424442880] v30'138 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbef002d070 con 0x55f5637b5440 2024-04-24T02:12:27.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.662+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94512424418080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f5637c5c00 con 0x7fbee8074060 2024-04-24T02:12:27.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.663+0000 7fbefd1cb640 1 -- 172.21.15.134:0/3419449144 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94512424418080] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbef8040040 con 0x7fbee8074060 2024-04-24T02:12:27.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.663+0000 7fbf00d1f800 20 remove_watcher() i=0 2024-04-24T02:12:27.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.663+0000 7fbf00d1f800 2 removed watcher, disabling cache 2024-04-24T02:12:27.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.663+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94512424423504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f5637c5c00 con 0x55f5637b5440 2024-04-24T02:12:27.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.664+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94512424423504] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbef002d070 con 0x55f5637b5440 2024-04-24T02:12:27.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.664+0000 7fbf00d1f800 20 remove_watcher() i=1 2024-04-24T02:12:27.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.664+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94512424427056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f5637c1050 con 0x55f5637bb500 2024-04-24T02:12:27.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.665+0000 7fbef7fff640 1 -- 172.21.15.134:0/3419449144 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94512424427056] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbee8071030 con 0x55f5637bb500 2024-04-24T02:12:27.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.665+0000 7fbf00d1f800 20 remove_watcher() i=2 2024-04-24T02:12:27.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.665+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94512424429184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f5637c5c00 con 0x7fbee8074060 2024-04-24T02:12:27.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.666+0000 7fbefd1cb640 1 -- 172.21.15.134:0/3419449144 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94512424429184] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbef8040040 con 0x7fbee8074060 2024-04-24T02:12:27.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.666+0000 7fbf00d1f800 20 remove_watcher() i=3 2024-04-24T02:12:27.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.666+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94512424431776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f5637c1e30 con 0x55f5637b5440 2024-04-24T02:12:27.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.667+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94512424431776] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbef002d070 con 0x55f5637b5440 2024-04-24T02:12:27.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.667+0000 7fbf00d1f800 20 remove_watcher() i=4 2024-04-24T02:12:27.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.667+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94512424437184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f5637c1050 con 0x7fbef8031040 2024-04-24T02:12:27.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.668+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94512424437184] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbef002d070 con 0x7fbef8031040 2024-04-24T02:12:27.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.668+0000 7fbf00d1f800 20 remove_watcher() i=5 2024-04-24T02:12:27.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.668+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94512424434640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f5637c5c00 con 0x7fbef8031040 2024-04-24T02:12:27.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.669+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94512424434640] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbef002d070 con 0x7fbef8031040 2024-04-24T02:12:27.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.669+0000 7fbf00d1f800 20 remove_watcher() i=6 2024-04-24T02:12:27.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.669+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94512424441824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f5637c1e30 con 0x7fbef8031040 2024-04-24T02:12:27.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.670+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94512424441824] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbef002d070 con 0x7fbef8031040 2024-04-24T02:12:27.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.670+0000 7fbf00d1f800 20 remove_watcher() i=7 2024-04-24T02:12:27.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.670+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fbef8031040 msgr2=0x7fbef8032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.670+0000 7fbf00d1f800 1 --2- 172.21.15.134:0/3419449144 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fbef8031040 0x7fbef8032940 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.670+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f5637b5440 msgr2=0x55f5637b78e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.670+0000 7fbf00d1f800 1 --2- 172.21.15.134:0/3419449144 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f5637b5440 0x55f5637b78e0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.670+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fbee8074060 msgr2=0x7fbee8088340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.670+0000 7fbf00d1f800 1 --2- 172.21.15.134:0/3419449144 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fbee8074060 0x7fbee8088340 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.670+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55f5637bb500 msgr2=0x55f5637bd910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.670+0000 7fbf00d1f800 1 --2- 172.21.15.134:0/3419449144 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55f5637bb500 0x55f5637bd910 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.670+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fbdc8036950 msgr2=0x7fbdc8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.670+0000 7fbf00d1f800 1 --2- 172.21.15.134:0/3419449144 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fbdc8036950 0x7fbdc8038e10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x55f563781450 tx=0x7fbef801f000 comp rx=0 tx=0).stop 2024-04-24T02:12:27.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.670+0000 7fbefc9ca640 1 -- 172.21.15.134:0/3419449144 reap_dead start 2024-04-24T02:12:27.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.670+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f5637a2300 msgr2=0x55f5637a99b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.670+0000 7fbf00d1f800 1 --2- 172.21.15.134:0/3419449144 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f5637a2300 0x55f5637a99b0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fbee805dc00 tx=0x7fbee808de30 comp rx=0 tx=0).stop 2024-04-24T02:12:27.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.670+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 shutdown_connections 2024-04-24T02:12:27.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.670+0000 7fbf00d1f800 1 --2- 172.21.15.134:0/3419449144 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f5637a2300 0x55f5637a99b0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.670+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 >> 172.21.15.134:0/3419449144 conn(0x55f56379e660 msgr2=0x55f56379bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:27.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.670+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 shutdown_connections 2024-04-24T02:12:27.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.670+0000 7fbf00d1f800 1 -- 172.21.15.134:0/3419449144 wait complete. 2024-04-24T02:12:27.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.670+0000 7fbf00d1f800 1 -- 172.21.15.134:0/1848416041 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fbdd4036950 msgr2=0x7fbdd4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.670+0000 7fbf00d1f800 1 --2- 172.21.15.134:0/1848416041 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fbdd4036950 0x7fbdd4038e10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x55f563785130 tx=0x7fbef8005840 comp rx=0 tx=0).stop 2024-04-24T02:12:27.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.670+0000 7fbf00d1f800 1 -- 172.21.15.134:0/1848416041 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f5637950c0 msgr2=0x55f5637954e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.670+0000 7fbf00d1f800 1 --2- 172.21.15.134:0/1848416041 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f5637950c0 0x55f5637954e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fbee8044840 tx=0x7fbee8002fb0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.671+0000 7fbf00d1f800 1 -- 172.21.15.134:0/1848416041 shutdown_connections 2024-04-24T02:12:27.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.671+0000 7fbf00d1f800 1 --2- 172.21.15.134:0/1848416041 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fbdd4036950 0x7fbdd4038e10 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.671+0000 7fbf00d1f800 1 --2- 172.21.15.134:0/1848416041 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f5637950c0 0x55f5637954e0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.671+0000 7fbf00d1f800 1 -- 172.21.15.134:0/1848416041 >> 172.21.15.134:0/1848416041 conn(0x55f563789160 msgr2=0x55f563789560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:27.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.671+0000 7fbf00d1f800 1 -- 172.21.15.134:0/1848416041 shutdown_connections 2024-04-24T02:12:27.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.671+0000 7fbf00d1f800 1 -- 172.21.15.134:0/1848416041 wait complete. 2024-04-24T02:12:27.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.671+0000 7fbf00d1f800 1 -- 172.21.15.134:0/2892592233 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f5636864a0 msgr2=0x55f563783f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.671+0000 7fbf00d1f800 1 --2- 172.21.15.134:0/2892592233 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f5636864a0 0x55f563783f30 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.671+0000 7fbf00d1f800 1 -- 172.21.15.134:0/2892592233 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fbde40368b0 msgr2=0x7fbde4038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.671+0000 7fbf00d1f800 1 --2- 172.21.15.134:0/2892592233 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fbde40368b0 0x7fbde4038d70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbee8054000 tx=0x7fbee804e000 comp rx=0 tx=0).stop 2024-04-24T02:12:27.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.671+0000 7fbf00d1f800 1 -- 172.21.15.134:0/2892592233 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f563682990 msgr2=0x55f56377ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.671+0000 7fbf00d1f800 1 --2- 172.21.15.134:0/2892592233 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f563682990 0x55f56377ccf0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fbef000b210 tx=0x7fbef0000ed0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.671+0000 7fbf00d1f800 1 -- 172.21.15.134:0/2892592233 shutdown_connections 2024-04-24T02:12:27.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.671+0000 7fbf00d1f800 1 --2- 172.21.15.134:0/2892592233 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f5636864a0 0x55f563783f30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.671+0000 7fbf00d1f800 1 --2- 172.21.15.134:0/2892592233 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fbde40368b0 0x7fbde4038d70 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.671+0000 7fbf00d1f800 1 --2- 172.21.15.134:0/2892592233 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f563682990 0x55f56377ccf0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.671+0000 7fbf00d1f800 1 -- 172.21.15.134:0/2892592233 >> 172.21.15.134:0/2892592233 conn(0x55f56367c320 msgr2=0x55f563681170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:27.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.671+0000 7fbf00d1f800 1 -- 172.21.15.134:0/2892592233 shutdown_connections 2024-04-24T02:12:27.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.671+0000 7fbf00d1f800 1 -- 172.21.15.134:0/2892592233 wait complete. 2024-04-24T02:12:27.683 INFO:teuthology.orchestra.run.smithi134.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"ymA8f4W/9w+vNZhrlz6KMecI","ver":2},"mtime":"2024-04-24T02:12:27.512522Z","data":{"bucket":{"name":"myfoo","marker":"582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1","bucket_id":"582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2024-04-24T02:12:24.901996Z","linked":true,"has_bucket_info":false}} 2024-04-24T02:12:27.683 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': 'ymA8f4W/9w+vNZhrlz6KMecI', 'ver': 2}, 'mtime': '2024-04-24T02:12:27.512522Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1', 'bucket_id': '582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-04-24T02:12:24.901996Z', 'linked': True, 'has_bucket_info': False}} 2024-04-24T02:12:27.683 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-04-24T02:12:27.683 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-04-24T02:12:27.683 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-04-24T02:12:27.770 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:27.770 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:27.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.769+0000 7fdb8b631800 1 Processor -- start 2024-04-24T02:12:27.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.769+0000 7fdb8b631800 1 -- start start 2024-04-24T02:12:27.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.769+0000 7fdb8b631800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x56404cecd4a0 0x56404cecf890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.769+0000 7fdb8b631800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56404cd87d40 con 0x56404cec9990 2024-04-24T02:12:27.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.769+0000 7fdb8b631800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x56404cd5a4d0 con 0x56404cecd4a0 2024-04-24T02:12:27.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.769+0000 7fdb85fc9640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x56404cecd4a0 0x56404cecf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.769+0000 7fdb85fc9640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x56404cecd4a0 0x56404cecf890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56494/0 (socket says 172.21.15.134:56494) 2024-04-24T02:12:27.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.769+0000 7fdb85fc9640 1 -- 172.21.15.134:0/2928935670 learned_addr learned my addr 172.21.15.134:0/2928935670 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:27.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.769+0000 7fdb867ca640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x56404cec9990 0x56404cecbd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:55330/0 (socket says 172.21.15.134:55330) 2024-04-24T02:12:27.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.770+0000 7fdb85fc9640 1 -- 172.21.15.134:0/2928935670 >> v1:172.21.15.104:6789/0 conn(0x56404cec9990 legacy=0x56404cecbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.770+0000 7fdb85fc9640 1 -- 172.21.15.134:0/2928935670 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56404cd86590 con 0x56404cecd4a0 2024-04-24T02:12:27.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.772+0000 7fdb85fc9640 1 --2- 172.21.15.134:0/2928935670 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56404cecd4a0 0x56404cecf890 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c00a520 tx=0x7fdb7c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cdbd92d77b0c78f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.772+0000 7fdb857c8640 1 -- 172.21.15.134:0/2928935670 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb7c057070 con 0x56404cecd4a0 2024-04-24T02:12:27.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.772+0000 7fdb857c8640 1 -- 172.21.15.134:0/2928935670 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb7c052570 con 0x56404cecd4a0 2024-04-24T02:12:27.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.772+0000 7fdb857c8640 1 -- 172.21.15.134:0/2928935670 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb7c04ae60 con 0x56404cecd4a0 2024-04-24T02:12:27.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.772+0000 7fdb8b631800 1 -- 172.21.15.134:0/2928935670 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56404cecd4a0 msgr2=0x56404cecf890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.772+0000 7fdb8b631800 1 --2- 172.21.15.134:0/2928935670 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56404cecd4a0 0x56404cecf890 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c00a520 tx=0x7fdb7c01d010 comp rx=0 tx=0).stop 2024-04-24T02:12:27.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.772+0000 7fdb8b631800 1 -- 172.21.15.134:0/2928935670 shutdown_connections 2024-04-24T02:12:27.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.772+0000 7fdb8b631800 1 --2- 172.21.15.134:0/2928935670 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56404cecd4a0 0x56404cecf890 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.772+0000 7fdb8b631800 1 -- 172.21.15.134:0/2928935670 >> 172.21.15.134:0/2928935670 conn(0x56404cec3320 msgr2=0x56404cec5740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:27.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.772+0000 7fdb8b631800 1 -- 172.21.15.134:0/2928935670 shutdown_connections 2024-04-24T02:12:27.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.772+0000 7fdb8b631800 1 -- 172.21.15.134:0/2928935670 wait complete. 2024-04-24T02:12:27.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.784+0000 7fdb8b631800 1 Processor -- start 2024-04-24T02:12:27.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.784+0000 7fdb8b631800 1 -- start start 2024-04-24T02:12:27.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.784+0000 7fdb8b631800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56404cec9990 0x56404cec92d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.784+0000 7fdb8b631800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56404ce143b0 con 0x56404cec9990 2024-04-24T02:12:27.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.784+0000 7fdb867ca640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56404cec9990 0x56404cec92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.784+0000 7fdb867ca640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56404cec9990 0x56404cec92d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56510/0 (socket says 172.21.15.134:56510) 2024-04-24T02:12:27.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.784+0000 7fdb867ca640 1 -- 172.21.15.134:0/1184577006 learned_addr learned my addr 172.21.15.134:0/1184577006 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:27.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.784+0000 7fdb867ca640 1 -- 172.21.15.134:0/1184577006 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56404cec7890 con 0x56404cec9990 2024-04-24T02:12:27.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.785+0000 7fdb867ca640 1 --2- 172.21.15.134:0/1184577006 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56404cec9990 0x56404cec92d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fdb80001e90 tx=0x7fdb8000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f580fffffa5f7fc server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.785+0000 7fda74608640 1 -- 172.21.15.134:0/1184577006 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb8000e5c0 con 0x56404cec9990 2024-04-24T02:12:27.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.785+0000 7fda74608640 1 -- 172.21.15.134:0/1184577006 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb80006070 con 0x56404cec9990 2024-04-24T02:12:27.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.785+0000 7fda74608640 1 -- 172.21.15.134:0/1184577006 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb8000e890 con 0x56404cec9990 2024-04-24T02:12:27.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.786+0000 7fdb8b631800 1 -- 172.21.15.134:0/1184577006 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56404cec9990 msgr2=0x56404cec92d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.786+0000 7fdb8b631800 1 --2- 172.21.15.134:0/1184577006 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56404cec9990 0x56404cec92d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fdb80001e90 tx=0x7fdb8000b6c0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.786+0000 7fdb8b631800 1 -- 172.21.15.134:0/1184577006 shutdown_connections 2024-04-24T02:12:27.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.786+0000 7fdb8b631800 1 --2- 172.21.15.134:0/1184577006 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56404cec9990 0x56404cec92d0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.786+0000 7fdb8b631800 1 -- 172.21.15.134:0/1184577006 >> 172.21.15.134:0/1184577006 conn(0x56404cec3320 msgr2=0x56404cfb5a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:27.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.786+0000 7fdb8b631800 1 -- 172.21.15.134:0/1184577006 shutdown_connections 2024-04-24T02:12:27.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.786+0000 7fdb8b631800 1 -- 172.21.15.134:0/1184577006 wait complete. 2024-04-24T02:12:27.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.786+0000 7fdb8b631800 1 Processor -- start 2024-04-24T02:12:27.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.786+0000 7fdb8b631800 1 -- start start 2024-04-24T02:12:27.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.786+0000 7fdb8b631800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56404cec9990 0x56404cfc3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.786+0000 7fdb8b631800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56404ced20e0 con 0x56404cec9990 2024-04-24T02:12:27.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.787+0000 7fdb867ca640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56404cec9990 0x56404cfc3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.787+0000 7fdb867ca640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56404cec9990 0x56404cfc3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56518/0 (socket says 172.21.15.134:56518) 2024-04-24T02:12:27.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.787+0000 7fdb867ca640 1 -- 172.21.15.134:0/3184739537 learned_addr learned my addr 172.21.15.134:0/3184739537 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:27.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.787+0000 7fdb867ca640 1 -- 172.21.15.134:0/3184739537 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56404cfc4400 con 0x56404cec9990 2024-04-24T02:12:27.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.787+0000 7fdb867ca640 1 --2- 172.21.15.134:0/3184739537 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56404cec9990 0x56404cfc3ec0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fdb80001ed0 tx=0x7fdb80000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.788+0000 7fda72e05640 1 -- 172.21.15.134:0/3184739537 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb8001a880 con 0x56404cec9990 2024-04-24T02:12:27.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.788+0000 7fda72e05640 1 -- 172.21.15.134:0/3184739537 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb8001aa20 con 0x56404cec9990 2024-04-24T02:12:27.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.788+0000 7fdb8b631800 1 -- 172.21.15.134:0/3184739537 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56404cfc4690 con 0x56404cec9990 2024-04-24T02:12:27.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.788+0000 7fda72e05640 1 -- 172.21.15.134:0/3184739537 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb8001ad40 con 0x56404cec9990 2024-04-24T02:12:27.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.788+0000 7fdb8b631800 1 -- 172.21.15.134:0/3184739537 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56404cfc7340 con 0x56404cec9990 2024-04-24T02:12:27.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.789+0000 7fda72e05640 1 -- 172.21.15.134:0/3184739537 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdb80017070 con 0x56404cec9990 2024-04-24T02:12:27.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.789+0000 7fda72e05640 1 --2- 172.21.15.134:0/3184739537 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fda6c036950 0x7fda6c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.789+0000 7fda72e05640 1 -- 172.21.15.134:0/3184739537 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fdb80015020 con 0x56404cec9990 2024-04-24T02:12:27.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.789+0000 7fdb85fc9640 1 --2- 172.21.15.134:0/3184739537 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fda6c036950 0x7fda6c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.789+0000 7fdb8b631800 1 --2- 172.21.15.134:0/3184739537 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x56404cecd4a0 0x56404cfcb100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.789+0000 7fdb8b631800 1 -- 172.21.15.134:0/3184739537 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56404cfcb690 con 0x56404cecd4a0 2024-04-24T02:12:27.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.790+0000 7fdb86fcb640 1 --2- 172.21.15.134:0/3184739537 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x56404cecd4a0 0x56404cfcb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.790+0000 7fdb85fc9640 1 --2- 172.21.15.134:0/3184739537 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fda6c036950 0x7fda6c038e10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c054000 tx=0x7fdb7c04e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.790+0000 7fdb86fcb640 1 --2- 172.21.15.134:0/3184739537 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x56404cecd4a0 0x56404cfcb100 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.790+0000 7fdb86fcb640 1 -- 172.21.15.134:0/3184739537 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb7800a4a0 con 0x56404cecd4a0 2024-04-24T02:12:27.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.790+0000 7fdb8b631800 1 -- 172.21.15.134:0/3184739537 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56404cfc86d0 con 0x56404cecd4a0 2024-04-24T02:12:27.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.790+0000 7fdb86fcb640 1 -- 172.21.15.134:0/3184739537 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdb7800a4a0 con 0x56404cecd4a0 2024-04-24T02:12:27.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.790+0000 7fdb8b631800 1 -- 172.21.15.134:0/3184739537 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56404cfcd4d0 con 0x56404cecd4a0 2024-04-24T02:12:27.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.791+0000 7fdb86fcb640 1 -- 172.21.15.134:0/3184739537 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdb7800a4a0 con 0x56404cecd4a0 2024-04-24T02:12:27.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.791+0000 7fdb8b631800 1 -- 172.21.15.134:0/3184739537 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56404cfcc810 con 0x56404cecd4a0 2024-04-24T02:12:27.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.791+0000 7fdb86fcb640 1 -- 172.21.15.134:0/3184739537 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdb7800a4a0 con 0x56404cecd4a0 2024-04-24T02:12:27.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.791+0000 7fdb8b631800 1 -- 172.21.15.134:0/3184739537 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56404cfccc60 con 0x56404cecd4a0 2024-04-24T02:12:27.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.791+0000 7fdb86fcb640 1 -- 172.21.15.134:0/3184739537 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdb7800a4a0 con 0x56404cecd4a0 2024-04-24T02:12:27.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.792+0000 7fdb8b631800 1 Processor -- start 2024-04-24T02:12:27.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.792+0000 7fdb8b631800 1 -- start start 2024-04-24T02:12:27.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.792+0000 7fdb8b631800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56404cfdc2c0 0x56404cfdc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.792+0000 7fdb8b631800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56404cdba6b0 con 0x56404cfdc2c0 2024-04-24T02:12:27.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.792+0000 7fdb85fc9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56404cfdc2c0 0x56404cfdc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.792+0000 7fdb85fc9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56404cfdc2c0 0x56404cfdc6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56532/0 (socket says 172.21.15.134:56532) 2024-04-24T02:12:27.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.792+0000 7fdb85fc9640 1 -- 172.21.15.134:0/1454122399 learned_addr learned my addr 172.21.15.134:0/1454122399 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:27.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.792+0000 7fdb85fc9640 1 -- 172.21.15.134:0/1454122399 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56404cfdcc20 con 0x56404cfdc2c0 2024-04-24T02:12:27.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.793+0000 7fdb85fc9640 1 --2- 172.21.15.134:0/1454122399 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56404cfdc2c0 0x56404cfdc6e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c000c00 tx=0x7fdb7c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.793+0000 7fda6bfff640 1 -- 172.21.15.134:0/1454122399 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb7c057040 con 0x56404cfdc2c0 2024-04-24T02:12:27.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.793+0000 7fda6bfff640 1 -- 172.21.15.134:0/1454122399 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb7c05d650 con 0x56404cfdc2c0 2024-04-24T02:12:27.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.793+0000 7fdb8b631800 1 -- 172.21.15.134:0/1454122399 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56404cfdd690 con 0x56404cfdc2c0 2024-04-24T02:12:27.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.793+0000 7fda6bfff640 1 -- 172.21.15.134:0/1454122399 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb7c05d930 con 0x56404cfdc2c0 2024-04-24T02:12:27.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.793+0000 7fdb8b631800 1 -- 172.21.15.134:0/1454122399 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56404cfddb30 con 0x56404cfdc2c0 2024-04-24T02:12:27.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.793+0000 7fda6bfff640 1 -- 172.21.15.134:0/1454122399 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdb7c067070 con 0x56404cfdc2c0 2024-04-24T02:12:27.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.794+0000 7fda6bfff640 1 --2- 172.21.15.134:0/1454122399 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fda60036900 0x7fda60038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.794+0000 7fda6bfff640 1 -- 172.21.15.134:0/1454122399 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fdb7c08f5a0 con 0x56404cfdc2c0 2024-04-24T02:12:27.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.794+0000 7fdb86fcb640 1 --2- 172.21.15.134:0/1454122399 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fda60036900 0x7fda60038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.794+0000 7fdb8b631800 1 Processor -- start 2024-04-24T02:12:27.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.794+0000 7fdb8b631800 1 -- start start 2024-04-24T02:12:27.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.794+0000 7fdb86fcb640 1 --2- 172.21.15.134:0/1454122399 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fda60036900 0x7fda60038dc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x56404cfcc330 tx=0x7fdb78005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.794+0000 7fdb8b631800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56404cfe9500 0x56404cfe9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.794+0000 7fdb8b631800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56404cec7c10 con 0x56404cfe9500 2024-04-24T02:12:27.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.794+0000 7fdb85fc9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56404cfe9500 0x56404cfe9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.794+0000 7fdb85fc9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56404cfe9500 0x56404cfe9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56542/0 (socket says 172.21.15.134:56542) 2024-04-24T02:12:27.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.794+0000 7fdb85fc9640 1 -- 172.21.15.134:0/636082548 learned_addr learned my addr 172.21.15.134:0/636082548 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:27.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.795+0000 7fdb85fc9640 1 -- 172.21.15.134:0/636082548 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56404cfe9ef0 con 0x56404cfe9500 2024-04-24T02:12:27.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.795+0000 7fdb85fc9640 1 --2- 172.21.15.134:0/636082548 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56404cfe9500 0x56404cfe9920 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c08db70 tx=0x7fdb7c071a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f5cd53331ef6d9f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.795+0000 7fda69ffb640 1 -- 172.21.15.134:0/636082548 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb7c000ed0 con 0x56404cfe9500 2024-04-24T02:12:27.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.795+0000 7fda69ffb640 1 -- 172.21.15.134:0/636082548 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb7c068c50 con 0x56404cfe9500 2024-04-24T02:12:27.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.795+0000 7fda69ffb640 1 -- 172.21.15.134:0/636082548 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb7c001070 con 0x56404cfe9500 2024-04-24T02:12:27.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.795+0000 7fdb8b631800 1 -- 172.21.15.134:0/636082548 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56404cfe9500 msgr2=0x56404cfe9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.795+0000 7fdb8b631800 1 --2- 172.21.15.134:0/636082548 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56404cfe9500 0x56404cfe9920 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c08db70 tx=0x7fdb7c071a90 comp rx=0 tx=0).stop 2024-04-24T02:12:27.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.795+0000 7fdb8b631800 1 -- 172.21.15.134:0/636082548 shutdown_connections 2024-04-24T02:12:27.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.795+0000 7fdb8b631800 1 --2- 172.21.15.134:0/636082548 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56404cfe9500 0x56404cfe9920 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.795+0000 7fdb8b631800 1 -- 172.21.15.134:0/636082548 >> 172.21.15.134:0/636082548 conn(0x56404cfe5860 msgr2=0x56404cfe38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:27.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.795+0000 7fdb8b631800 1 -- 172.21.15.134:0/636082548 shutdown_connections 2024-04-24T02:12:27.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.795+0000 7fdb8b631800 1 -- 172.21.15.134:0/636082548 wait complete. 2024-04-24T02:12:27.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.796+0000 7fdb8b631800 1 Processor -- start 2024-04-24T02:12:27.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.796+0000 7fdb8b631800 1 -- start start 2024-04-24T02:12:27.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.796+0000 7fdb8b631800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56404cfe9500 0x56404cff0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.796+0000 7fdb8b631800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56404cfea660 con 0x56404cfe9500 2024-04-24T02:12:27.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.796+0000 7fdb85fc9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56404cfe9500 0x56404cff0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.796+0000 7fdb85fc9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56404cfe9500 0x56404cff0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56552/0 (socket says 172.21.15.134:56552) 2024-04-24T02:12:27.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.796+0000 7fdb85fc9640 1 -- 172.21.15.134:0/1865244957 learned_addr learned my addr 172.21.15.134:0/1865244957 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:27.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.796+0000 7fdb85fc9640 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56404cff10f0 con 0x56404cfe9500 2024-04-24T02:12:27.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.796+0000 7fdb85fc9640 1 --2- 172.21.15.134:0/1865244957 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56404cfe9500 0x56404cff0bb0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c052e80 tx=0x7fdb7c08dad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.797+0000 7fda57fff640 1 -- 172.21.15.134:0/1865244957 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb7c068e00 con 0x56404cfe9500 2024-04-24T02:12:27.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.797+0000 7fda57fff640 1 -- 172.21.15.134:0/1865244957 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb7c093030 con 0x56404cfe9500 2024-04-24T02:12:27.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.797+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56404cff1380 con 0x56404cfe9500 2024-04-24T02:12:27.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.797+0000 7fda57fff640 1 -- 172.21.15.134:0/1865244957 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb7c08c6e0 con 0x56404cfe9500 2024-04-24T02:12:27.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.797+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56404cff4030 con 0x56404cfe9500 2024-04-24T02:12:27.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.797+0000 7fda57fff640 1 -- 172.21.15.134:0/1865244957 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdb7c08f8f0 con 0x56404cfe9500 2024-04-24T02:12:27.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.798+0000 7fda57fff640 1 --2- 172.21.15.134:0/1865244957 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fda50036900 0x7fda50038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.798+0000 7fda57fff640 1 -- 172.21.15.134:0/1865244957 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fdb7c099ad0 con 0x56404cfe9500 2024-04-24T02:12:27.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.798+0000 7fdb86fcb640 1 --2- 172.21.15.134:0/1865244957 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fda50036900 0x7fda50038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.798+0000 7fdb8b631800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.798+0000 7fdb8b631800 1 --2- 172.21.15.134:0/1865244957 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x56404cffc6a0 0x56404cffeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.798+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56404cfff2b0 con 0x56404cffc6a0 2024-04-24T02:12:27.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.798+0000 7fdb86fcb640 1 --2- 172.21.15.134:0/1865244957 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fda50036900 0x7fda50038dc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x56404cfc8620 tx=0x7fdb7801f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.798+0000 7fdb867ca640 1 --2- 172.21.15.134:0/1865244957 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x56404cffc6a0 0x56404cffeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.798+0000 7fdb867ca640 1 --2- 172.21.15.134:0/1865244957 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x56404cffc6a0 0x56404cffeb60 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.799+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb8002e070 con 0x56404cffc6a0 2024-04-24T02:12:27.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.799+0000 7fdb8b631800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.799+0000 7fdb8b631800 20 realm 2024-04-24T02:12:27.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.799+0000 7fdb8b631800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.799+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56404cfff6c0 con 0x56404cffc6a0 2024-04-24T02:12:27.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.799+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb8002e070 con 0x56404cffc6a0 2024-04-24T02:12:27.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.799+0000 7fdb8b631800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.799+0000 7fdb8b631800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:27.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.799+0000 7fdb8b631800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.799+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56404cffff90 con 0x56404cffc6a0 2024-04-24T02:12:27.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.799+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb8002e070 con 0x56404cffc6a0 2024-04-24T02:12:27.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.799+0000 7fdb8b631800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.799+0000 7fdb8b631800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.799+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56404d000330 con 0x56404cffc6a0 2024-04-24T02:12:27.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.799+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdb8002e070 con 0x56404cffc6a0 2024-04-24T02:12:27.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.799+0000 7fdb8b631800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:27.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.799+0000 7fdb8b631800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.799+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56404d000b80 con 0x56404cffc6a0 2024-04-24T02:12:27.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.800+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdb8002e070 con 0x56404cffc6a0 2024-04-24T02:12:27.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.800+0000 7fdb8b631800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:27.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.800+0000 7fdb8b631800 20 searching for the correct realm 2024-04-24T02:12:27.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.800+0000 7fdb8b631800 1 --2- 172.21.15.134:0/1865244957 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x56404d0028f0 0x56404d004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.800+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56404d0052c0 con 0x56404d0028f0 2024-04-24T02:12:27.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.800+0000 7fdb85fc9640 1 --2- 172.21.15.134:0/1865244957 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x56404d0028f0 0x56404d004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.800+0000 7fdb85fc9640 1 --2- 172.21.15.134:0/1865244957 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x56404d0028f0 0x56404d004ce0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.801+0000 7fdb85fc9640 1 -- 172.21.15.134:0/1865244957 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb7c066030 con 0x56404d0028f0 2024-04-24T02:12:27.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.801+0000 7fdb85fc9640 1 --2- 172.21.15.134:0/1865244957 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fdb7c086050 0x7fdb7c0706a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.801+0000 7fdb85fc9640 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56404d0052c0 con 0x7fdb7c086050 2024-04-24T02:12:27.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.801+0000 7fdb86fcb640 1 --2- 172.21.15.134:0/1865244957 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fdb7c086050 0x7fdb7c0706a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.801+0000 7fdb86fcb640 1 --2- 172.21.15.134:0/1865244957 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fdb7c086050 0x7fdb7c0706a0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.801+0000 7fdb86fcb640 1 -- 172.21.15.134:0/1865244957 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb7801f070 con 0x7fdb7c086050 2024-04-24T02:12:27.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.801+0000 7fdb86fcb640 1 --2- 172.21.15.134:0/1865244957 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fdb78031040 0x7fdb78032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.801+0000 7fdb86fcb640 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56404d0052c0 con 0x7fdb78031040 2024-04-24T02:12:27.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.802+0000 7fdb867ca640 1 --2- 172.21.15.134:0/1865244957 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fdb78031040 0x7fdb78032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.802+0000 7fdb867ca640 1 --2- 172.21.15.134:0/1865244957 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fdb78031040 0x7fdb78032940 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.802+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb8002e070 con 0x7fdb78031040 2024-04-24T02:12:27.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.802+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56404d0052c0 con 0x56404cffc6a0 2024-04-24T02:12:27.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.802+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb8002e070 con 0x56404cffc6a0 2024-04-24T02:12:27.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.802+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56404d0052c0 con 0x56404cffc6a0 2024-04-24T02:12:27.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.803+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdb8002e070 con 0x56404cffc6a0 2024-04-24T02:12:27.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.803+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56404d0052c0 con 0x7fdb78031040 2024-04-24T02:12:27.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.803+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb8002e070 con 0x7fdb78031040 2024-04-24T02:12:27.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.803+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56404d0052c0 con 0x7fdb78031040 2024-04-24T02:12:27.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.803+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb8002e070 con 0x7fdb78031040 2024-04-24T02:12:27.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.803+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56404d0052c0 con 0x7fdb7c086050 2024-04-24T02:12:27.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.803+0000 7fdb86fcb640 1 -- 172.21.15.134:0/1865244957 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb7801f070 con 0x7fdb7c086050 2024-04-24T02:12:27.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.803+0000 7fdb86fcb640 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56404d0052c0 con 0x56404d0028f0 2024-04-24T02:12:27.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.804+0000 7fdb85fc9640 1 -- 172.21.15.134:0/1865244957 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb7c066030 con 0x56404d0028f0 2024-04-24T02:12:27.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.804+0000 7fdb85fc9640 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56404d0052c0 con 0x56404cffc6a0 2024-04-24T02:12:27.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.804+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb8002e070 con 0x56404cffc6a0 2024-04-24T02:12:27.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.804+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56404d0052c0 con 0x7fdb78031040 2024-04-24T02:12:27.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.804+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb8002e070 con 0x7fdb78031040 2024-04-24T02:12:27.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.804+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56404d0052c0 con 0x56404cffc6a0 2024-04-24T02:12:27.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.804+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb8002e070 con 0x56404cffc6a0 2024-04-24T02:12:27.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.805+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56404d0052c0 con 0x7fdb7c086050 2024-04-24T02:12:27.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.805+0000 7fdb86fcb640 1 -- 172.21.15.134:0/1865244957 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdb7801f070 con 0x7fdb7c086050 2024-04-24T02:12:27.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.805+0000 7fdb86fcb640 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56404d0052c0 con 0x56404d0028f0 2024-04-24T02:12:27.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.805+0000 7fdb85fc9640 1 -- 172.21.15.134:0/1865244957 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb7c066030 con 0x56404d0028f0 2024-04-24T02:12:27.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.805+0000 7fdb85fc9640 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56404d0052c0 con 0x56404d0028f0 2024-04-24T02:12:27.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.805+0000 7fdb85fc9640 1 -- 172.21.15.134:0/1865244957 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb7c066030 con 0x56404d0028f0 2024-04-24T02:12:27.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.805+0000 7fdb85fc9640 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56404d0052c0 con 0x7fdb78031040 2024-04-24T02:12:27.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.806+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb8002e070 con 0x7fdb78031040 2024-04-24T02:12:27.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.806+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56404d0052c0 con 0x56404d0028f0 2024-04-24T02:12:27.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.806+0000 7fdb85fc9640 1 -- 172.21.15.134:0/1865244957 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb7c066030 con 0x56404d0028f0 2024-04-24T02:12:27.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.806+0000 7fdb85fc9640 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56404d0052c0 con 0x56404d0028f0 2024-04-24T02:12:27.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.806+0000 7fdb85fc9640 1 -- 172.21.15.134:0/1865244957 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb7c066030 con 0x56404d0028f0 2024-04-24T02:12:27.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.806+0000 7fdb85fc9640 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56404d0052c0 con 0x56404cffc6a0 2024-04-24T02:12:27.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.806+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb8002e070 con 0x56404cffc6a0 2024-04-24T02:12:27.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.806+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56404d0052c0 con 0x56404cffc6a0 2024-04-24T02:12:27.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.806+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fdb8002e070 con 0x56404cffc6a0 2024-04-24T02:12:27.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.806+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdb80057090 con 0x7fdb78031040 2024-04-24T02:12:27.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.807+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb8002e070 con 0x7fdb78031040 2024-04-24T02:12:27.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.807+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdb80057090 con 0x56404d0028f0 2024-04-24T02:12:27.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.807+0000 7fdb85fc9640 1 -- 172.21.15.134:0/1865244957 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb7c066030 con 0x56404d0028f0 2024-04-24T02:12:27.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.807+0000 7fdb85fc9640 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdb80057090 con 0x7fdb7c086050 2024-04-24T02:12:27.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.807+0000 7fdb86fcb640 1 -- 172.21.15.134:0/1865244957 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb7801f070 con 0x7fdb7c086050 2024-04-24T02:12:27.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.807+0000 7fdb86fcb640 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdb80057090 con 0x56404cffc6a0 2024-04-24T02:12:27.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.808+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb8002e070 con 0x56404cffc6a0 2024-04-24T02:12:27.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.808+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdb80057090 con 0x7fdb78031040 2024-04-24T02:12:27.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.808+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb8002e070 con 0x7fdb78031040 2024-04-24T02:12:27.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.808+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdb80057090 con 0x56404d0028f0 2024-04-24T02:12:27.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.808+0000 7fdb85fc9640 1 -- 172.21.15.134:0/1865244957 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb7c066030 con 0x56404d0028f0 2024-04-24T02:12:27.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.808+0000 7fdb85fc9640 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdb80057090 con 0x7fdb78031040 2024-04-24T02:12:27.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.809+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb8002e070 con 0x7fdb78031040 2024-04-24T02:12:27.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.809+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdb80057090 con 0x7fdb7c086050 2024-04-24T02:12:27.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.809+0000 7fdb86fcb640 1 -- 172.21.15.134:0/1865244957 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb7801f070 con 0x7fdb7c086050 2024-04-24T02:12:27.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.809+0000 7fdb86fcb640 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdb80057090 con 0x56404d0028f0 2024-04-24T02:12:27.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.809+0000 7fdb85fc9640 1 -- 172.21.15.134:0/1865244957 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb7c066030 con 0x56404d0028f0 2024-04-24T02:12:27.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.809+0000 7fdb85fc9640 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdb80057090 con 0x7fdb78031040 2024-04-24T02:12:27.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.810+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb8002e070 con 0x7fdb78031040 2024-04-24T02:12:27.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.810+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdb80057090 con 0x56404cffc6a0 2024-04-24T02:12:27.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.810+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdb8002e070 con 0x56404cffc6a0 2024-04-24T02:12:27.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.810+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdb80057090 con 0x7fdb7c086050 2024-04-24T02:12:27.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.810+0000 7fdb86fcb640 1 -- 172.21.15.134:0/1865244957 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb7801f070 con 0x7fdb7c086050 2024-04-24T02:12:27.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.811+0000 7fdb8b631800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:27.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.811+0000 7fdb8b631800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:27.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.811+0000 7fdb8b631800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:27.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.811+0000 7fdb8b631800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:27.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.811+0000 7fdb8b631800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:27.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.811+0000 7fdb8b631800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:27.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.811+0000 7fdb8b631800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.811+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56404d001530 con 0x56404cffc6a0 2024-04-24T02:12:27.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.811+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb8002e070 con 0x56404cffc6a0 2024-04-24T02:12:27.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.811+0000 7fdb8b631800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.811+0000 7fdb8b631800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.811+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56404d001dd0 con 0x56404cffc6a0 2024-04-24T02:12:27.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.811+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdb8002e070 con 0x56404cffc6a0 2024-04-24T02:12:27.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.811+0000 7fdb8b631800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:27.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.811+0000 7fdb8b631800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.811+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56404d001dd0 con 0x56404cffc6a0 2024-04-24T02:12:27.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.811+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdb8002e070 con 0x56404cffc6a0 2024-04-24T02:12:27.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.811+0000 7fdb8b631800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:27.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.811+0000 7fdb8b631800 20 zone default found 2024-04-24T02:12:27.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.811+0000 7fdb8b631800 4 Realm: () 2024-04-24T02:12:27.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.811+0000 7fdb8b631800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:27.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.811+0000 7fdb8b631800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:27.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.811+0000 7fdb8b631800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:27.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.811+0000 7fdb8b631800 20 zonegroup default 2024-04-24T02:12:27.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.811+0000 7fdb8b631800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.811+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56404d005720 con 0x7fdb78031040 2024-04-24T02:12:27.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.812+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdb8002e070 con 0x7fdb78031040 2024-04-24T02:12:27.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.812+0000 7fdb8b631800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.812+0000 7fdb8b631800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.812+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56404d007190 con 0x56404d0028f0 2024-04-24T02:12:27.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.812+0000 7fdb85fc9640 1 -- 172.21.15.134:0/1865244957 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdb7c066030 con 0x56404d0028f0 2024-04-24T02:12:27.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.812+0000 7fdb8b631800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.812+0000 7fdb8b631800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.812+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56404d007660 con 0x56404d0028f0 2024-04-24T02:12:27.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.812+0000 7fdb85fc9640 1 -- 172.21.15.134:0/1865244957 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdb7c066030 con 0x56404d0028f0 2024-04-24T02:12:27.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.812+0000 7fdb8b631800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.812+0000 7fdb8b631800 20 started sync module instance, tier type = 2024-04-24T02:12:27.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.812+0000 7fdb8b631800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:27.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.812+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56404d0065a0 con 0x7fdb7c086050 2024-04-24T02:12:27.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.813+0000 7fdb86fcb640 1 -- 172.21.15.134:0/1865244957 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb78040040 con 0x7fdb7c086050 2024-04-24T02:12:27.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.813+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94834169768336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56404d006db0 con 0x7fdb7c086050 2024-04-24T02:12:27.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.813+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56404d008590 con 0x56404cffc6a0 2024-04-24T02:12:27.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.814+0000 7fdb86fcb640 1 -- 172.21.15.134:0/1865244957 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94834169768336] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb78040040 con 0x7fdb7c086050 2024-04-24T02:12:27.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.815+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb8002e070 con 0x56404cffc6a0 2024-04-24T02:12:27.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.815+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94834169774304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56404d0089b0 con 0x56404cffc6a0 2024-04-24T02:12:27.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.815+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56404d009370 con 0x56404d0028f0 2024-04-24T02:12:27.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.816+0000 7fdb85fc9640 1 -- 172.21.15.134:0/1865244957 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb7c066030 con 0x56404d0028f0 2024-04-24T02:12:27.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.816+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94834169777856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56404d009c10 con 0x56404d0028f0 2024-04-24T02:12:27.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.816+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94834169774304] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb8002e070 con 0x56404cffc6a0 2024-04-24T02:12:27.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.816+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56404d00a4c0 con 0x7fdb7c086050 2024-04-24T02:12:27.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.817+0000 7fdb85fc9640 1 -- 172.21.15.134:0/1865244957 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94834169777856] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb7c066030 con 0x56404d0028f0 2024-04-24T02:12:27.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.817+0000 7fdb86fcb640 1 -- 172.21.15.134:0/1865244957 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb78040040 con 0x7fdb7c086050 2024-04-24T02:12:27.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.817+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94834169780064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56404d00a4c0 con 0x7fdb7c086050 2024-04-24T02:12:27.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.817+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56404d00af60 con 0x56404cffc6a0 2024-04-24T02:12:27.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.818+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb8002e070 con 0x56404cffc6a0 2024-04-24T02:12:27.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.818+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94834169784880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56404d00af20 con 0x56404cffc6a0 2024-04-24T02:12:27.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.818+0000 7fdb86fcb640 1 -- 172.21.15.134:0/1865244957 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94834169780064] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb78040040 con 0x7fdb7c086050 2024-04-24T02:12:27.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.818+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56404d00a050 con 0x7fdb78031040 2024-04-24T02:12:27.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.819+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94834169784880] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb8002e070 con 0x56404cffc6a0 2024-04-24T02:12:27.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.819+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb8002e070 con 0x7fdb78031040 2024-04-24T02:12:27.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.819+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94834169786144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56404d00b9f0 con 0x7fdb78031040 2024-04-24T02:12:27.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.819+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56404d00c3f0 con 0x7fdb78031040 2024-04-24T02:12:27.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.821+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(56 notify.6 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb8002e070 con 0x7fdb78031040 2024-04-24T02:12:27.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.821+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94834169786144] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb8002e070 con 0x7fdb78031040 2024-04-24T02:12:27.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.821+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94834169790208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56404d00c830 con 0x7fdb78031040 2024-04-24T02:12:27.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.821+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56404d00b380 con 0x7fdb78031040 2024-04-24T02:12:27.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.822+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(58 notify.7 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb8002e070 con 0x7fdb78031040 2024-04-24T02:12:27.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.822+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94834169790208] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb8002e070 con 0x7fdb78031040 2024-04-24T02:12:27.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.822+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94834169787264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56404d00ce20 con 0x7fdb78031040 2024-04-24T02:12:27.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.822+0000 7fdb8b631800 20 add_watcher() i=0 2024-04-24T02:12:27.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.822+0000 7fdb8b631800 20 add_watcher() i=1 2024-04-24T02:12:27.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.822+0000 7fdb8b631800 20 add_watcher() i=2 2024-04-24T02:12:27.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.822+0000 7fdb8b631800 20 add_watcher() i=3 2024-04-24T02:12:27.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.822+0000 7fdb8b631800 20 add_watcher() i=4 2024-04-24T02:12:27.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.822+0000 7fdb8b631800 20 add_watcher() i=5 2024-04-24T02:12:27.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.822+0000 7fdb8b631800 20 add_watcher() i=6 2024-04-24T02:12:27.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.823+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94834169787264] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb8002e070 con 0x7fdb78031040 2024-04-24T02:12:27.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.823+0000 7fdb8b631800 20 add_watcher() i=7 2024-04-24T02:12:27.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.823+0000 7fdb8b631800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:27.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.823+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56404d010300 con 0x56404cffc6a0 2024-04-24T02:12:27.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.823+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdb8002e070 con 0x56404cffc6a0 2024-04-24T02:12:27.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.823+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94834169794080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56404d00d720 con 0x56404cffc6a0 2024-04-24T02:12:27.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.824+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94834169794080] v30'139 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdb8002e070 con 0x56404cffc6a0 2024-04-24T02:12:27.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.824+0000 7fda3cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:27.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.824+0000 7fdb8b631800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:27.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.824+0000 7fdb8b631800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:27.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.824+0000 7fdb8b631800 5 note: GC not initialized 2024-04-24T02:12:27.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.824+0000 7fd9b77fe640 20 reqs_thread_entry: start 2024-04-24T02:12:27.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.824+0000 7fdb8b631800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:27.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.825+0000 7fdb8b631800 20 Filter name: none 2024-04-24T02:12:27.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.825+0000 7fd9b57fa640 20 reqs_thread_entry: start 2024-04-24T02:12:27.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.825+0000 7fdb8b631800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T02:12:27.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.825+0000 7fdb8b631800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.825+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56404d0435b0 con 0x56404cffc6a0 2024-04-24T02:12:27.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.825+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fdb8002e070 con 0x56404cffc6a0 2024-04-24T02:12:27.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.825+0000 7fdb8b631800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T02:12:27.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.825+0000 7fdb8b631800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T02:12:27.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.825+0000 7fdb8b631800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:27.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.825+0000 7fdb8b631800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:12:27.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.825+0000 7fdb8b631800 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-04-24T02:12:27.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.825+0000 7fdb8b631800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.825+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56404d0430d0 con 0x56404cffc6a0 2024-04-24T02:12:27.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.825+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv1 ondisk = 0) ==== 197+0+241 (crc 0 0 0) 0x7fdb8002e070 con 0x56404cffc6a0 2024-04-24T02:12:27.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.825+0000 7fdb8b631800 20 rados_obj.operate() r=0 bl.length=193 2024-04-24T02:12:27.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.825+0000 7fdb8b631800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-04-24T02:12:27.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.825+0000 7fdb8b631800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-04-24T02:12:27.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.825+0000 7fdb8b631800 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 : miss 2024-04-24T02:12:27.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.825+0000 7fdb8b631800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.825+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:64 8.d 8:b4f1ae40:root::.bucket.meta.testx%3amyfoo%3a582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56404d046e90 con 0x7fdb7c086050 2024-04-24T02:12:27.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.826+0000 7fdb86fcb640 1 -- 172.21.15.134:0/1865244957 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 [call out=48b,stat out=16b,read 0~412 out=412b,getxattrs out=298b] v0'0 uv1 ondisk = 0) ==== 338+0+774 (crc 0 0 0) 0x7fdb78040040 con 0x7fdb7c086050 2024-04-24T02:12:27.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.826+0000 7fdb8b631800 20 rados_obj.operate() r=0 bl.length=412 2024-04-24T02:12:27.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.826+0000 7fdb8b631800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 info.flags=0x17 2024-04-24T02:12:27.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.826+0000 7fdb8b631800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 to cache LRU end 2024-04-24T02:12:27.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.826+0000 7fdb8b631800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:12:27.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.826+0000 7fdb8b631800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-04-24T02:12:27.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.826+0000 7fdb8b631800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 2024-04-24T02:12:27.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.826+0000 7fdb8b631800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-04-24T02:12:27.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.826+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56404d04b510 con 0x56404cffc6a0 2024-04-24T02:12:27.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.827+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v30'2 uv2 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7fdb8002e070 con 0x56404cffc6a0 2024-04-24T02:12:27.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.827+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:66 8.1d 8:be2d2b4a:root::.bucket.meta.myfoo%3a582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1:head [create,call version.inc in=38b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56404d04ee20 con 0x7fdb78031040 2024-04-24T02:12:27.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.828+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(66 .bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 [create,call,writefull 0~379,setxattr (123)] v30'5 uv5 ondisk = 0) ==== 332+0+0 (crc 0 0 0) 0x7fdb8002e070 con 0x7fdb78031040 2024-04-24T02:12:27.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.828+0000 7fdb8b631800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 info.flags=0x7 2024-04-24T02:12:27.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.828+0000 7fdb8b631800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 to cache LRU end 2024-04-24T02:12:27.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.828+0000 7fdb8b631800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T02:12:27.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.828+0000 7fdb8b631800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1, ofs0, ns] 2024-04-24T02:12:27.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.828+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:67 7.9 7:93e5b521:::notify.7:head [notify cookie 94834170055616 in=740b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56404d04e860 con 0x7fdb78031040 2024-04-24T02:12:27.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.829+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== watch-notify(notify (1) cookie 94834169787264 notify 128849018894 ret 0) ==== 770+0+0 (crc 0 0 0) 0x56404d04af40 con 0x7fdb78031040 2024-04-24T02:12:27.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.829+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(67 notify.7 [notify cookie 94834170055616 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdb8002e070 con 0x7fdb78031040 2024-04-24T02:12:27.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.829+0000 7fda69ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018894 cookie 94834169787264 notifier 4551 bl.length()=728 2024-04-24T02:12:27.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.829+0000 7fda69ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 info.flags=0x7 2024-04-24T02:12:27.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.829+0000 7fda69ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 to cache LRU end 2024-04-24T02:12:27.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.829+0000 7fda69ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T02:12:27.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.829+0000 7fda69ffb640 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:68 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fda4c003ea0 con 0x7fdb78031040 2024-04-24T02:12:27.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.829+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.0 v2:172.21.15.104:6800/2419146313 20 ==== osd_op_reply(68 notify.7 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb8002e070 con 0x7fdb78031040 2024-04-24T02:12:27.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.829+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.0 v2:172.21.15.104:6800/2419146313 21 ==== watch-notify(notify_complete (2) cookie 94834170055616 notify 128849018894 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fdb80037040 con 0x7fdb78031040 2024-04-24T02:12:27.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.829+0000 7fdb8b631800 20 handle_bi_update(): bucket=:myfoo[582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1]): orig_sources= new_sources= 2024-04-24T02:12:27.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.829+0000 7fdb8b631800 20 handle_bi_update(): bucket=:myfoo[582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1]): potential sources added=[] removed=[] 2024-04-24T02:12:27.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.829+0000 7fdb8b631800 20 handle_bi_update(): bucket=:myfoo[582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1]): orig_dests= new_dests= 2024-04-24T02:12:27.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.829+0000 7fdb8b631800 20 handle_bi_update(): bucket=:myfoo[582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1]): potential dests added=[] removed=[] 2024-04-24T02:12:27.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.829+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56404d04a5b0 con 0x7fdb7c086050 2024-04-24T02:12:27.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.830+0000 7fdb86fcb640 1 -- 172.21.15.134:0/1865244957 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(69 foo.buckets [call] v30'26 uv26 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fdb78040040 con 0x7fdb7c086050 2024-04-24T02:12:27.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.830+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56404d04a5b0 con 0x7fdb7c086050 2024-04-24T02:12:27.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.831+0000 7fdb86fcb640 1 -- 172.21.15.134:0/1865244957 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v30'27 uv27 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7fdb78040040 con 0x7fdb7c086050 2024-04-24T02:12:27.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.831+0000 7fdb8b631800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-04-24T02:12:27.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.831+0000 7fdb8b631800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T02:12:27.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.831+0000 7fdb8b631800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-24T02:12:27.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.831+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94834170044672 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56404d04ab50 con 0x7fdb78031040 2024-04-24T02:12:27.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.831+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.0 v2:172.21.15.104:6800/2419146313 22 ==== watch-notify(notify (1) cookie 94834169790208 notify 128849018895 ret 0) ==== 356+0+0 (crc 0 0 0) 0x56404cfc7340 con 0x7fdb78031040 2024-04-24T02:12:27.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.831+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.0 v2:172.21.15.104:6800/2419146313 23 ==== osd_op_reply(71 notify.6 [notify cookie 94834170044672 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdb8002e070 con 0x7fdb78031040 2024-04-24T02:12:27.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.831+0000 7fda69ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018895 cookie 94834169790208 notifier 4551 bl.length()=314 2024-04-24T02:12:27.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.831+0000 7fda69ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-04-24T02:12:27.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.831+0000 7fda69ffb640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T02:12:27.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.831+0000 7fda69ffb640 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fda4c003ea0 con 0x7fdb78031040 2024-04-24T02:12:27.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.832+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.0 v2:172.21.15.104:6800/2419146313 24 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb8002e070 con 0x7fdb78031040 2024-04-24T02:12:27.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.832+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.0 v2:172.21.15.104:6800/2419146313 25 ==== watch-notify(notify_complete (2) cookie 94834170044672 notify 128849018895 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56404cfc4690 con 0x7fdb78031040 2024-04-24T02:12:27.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.832+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:73 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56404d04a5b0 con 0x56404cffc6a0 2024-04-24T02:12:27.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.833+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(73 testx/myfoo [call,delete] v30'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7fdb8002e070 con 0x56404cffc6a0 2024-04-24T02:12:27.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.833+0000 7fdb8b631800 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-04-24T02:12:27.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.833+0000 7fdb8b631800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-04-24T02:12:27.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.833+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify cookie 94834170047264 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56404d04a5b0 con 0x56404cffc6a0 2024-04-24T02:12:27.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.833+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== watch-notify(notify (1) cookie 94834169784880 notify 128849018892 ret 0) ==== 197+0+0 (crc 0 0 0) 0x56404cfc4690 con 0x56404cffc6a0 2024-04-24T02:12:27.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.833+0000 7fda69ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018892 cookie 94834169784880 notifier 4551 bl.length()=155 2024-04-24T02:12:27.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.833+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(74 notify.4 [notify cookie 94834170047264 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdb8002e070 con 0x56404cffc6a0 2024-04-24T02:12:27.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.833+0000 7fda69ffb640 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fda4c003ea0 con 0x56404cffc6a0 2024-04-24T02:12:27.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.833+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(75 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb8002e070 con 0x56404cffc6a0 2024-04-24T02:12:27.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.833+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.1 v2:172.21.15.134:6804/1487076214 30 ==== watch-notify(notify_complete (2) cookie 94834170047264 notify 128849018892 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56404cfc4400 con 0x56404cffc6a0 2024-04-24T02:12:27.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.833+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:76 8.d 8:b4f1ae40:root::.bucket.meta.testx%3amyfoo%3a582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56404d04a5b0 con 0x7fdb7c086050 2024-04-24T02:12:27.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.835+0000 7fdb86fcb640 1 -- 172.21.15.134:0/1865244957 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(76 .bucket.meta.testx:myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 [call,delete] v30'2 uv2 ondisk = 0) ==== 254+0+0 (crc 0 0 0) 0x7fdb78040040 con 0x7fdb7c086050 2024-04-24T02:12:27.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.835+0000 7fdb8b631800 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 from cache 2024-04-24T02:12:27.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.835+0000 7fdb8b631800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1, ofs0, ns] 2024-04-24T02:12:27.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.835+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94834170047264 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56404d04a100 con 0x7fdb78031040 2024-04-24T02:12:27.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.835+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.0 v2:172.21.15.104:6800/2419146313 26 ==== watch-notify(notify (1) cookie 94834169790208 notify 128849018896 ret 0) ==== 254+0+0 (crc 0 0 0) 0x56404cfc4400 con 0x7fdb78031040 2024-04-24T02:12:27.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.835+0000 7fda69ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018896 cookie 94834169790208 notifier 4551 bl.length()=212 2024-04-24T02:12:27.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.835+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.0 v2:172.21.15.104:6800/2419146313 27 ==== osd_op_reply(77 notify.6 [notify cookie 94834170047264 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdb8002e070 con 0x7fdb78031040 2024-04-24T02:12:27.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.835+0000 7fda69ffb640 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:78 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fda4c003ea0 con 0x7fdb78031040 2024-04-24T02:12:27.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.835+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.0 v2:172.21.15.104:6800/2419146313 28 ==== osd_op_reply(78 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb8002e070 con 0x7fdb78031040 2024-04-24T02:12:27.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.835+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.0 v2:172.21.15.104:6800/2419146313 29 ==== watch-notify(notify_complete (2) cookie 94834170047264 notify 128849018896 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56404cec7890 con 0x7fdb78031040 2024-04-24T02:12:27.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.836+0000 7fda3cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:27.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.836+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94834169794080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56404d0467e0 con 0x56404cffc6a0 2024-04-24T02:12:27.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.837+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.1 v2:172.21.15.134:6804/1487076214 31 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94834169794080] v30'140 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdb8002e070 con 0x56404cffc6a0 2024-04-24T02:12:27.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.837+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94834169768336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56404d00ce20 con 0x7fdb7c086050 2024-04-24T02:12:27.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.838+0000 7fdb86fcb640 1 -- 172.21.15.134:0/1865244957 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94834169768336] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb78040040 con 0x7fdb7c086050 2024-04-24T02:12:27.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.838+0000 7fdb8b631800 20 remove_watcher() i=0 2024-04-24T02:12:27.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.838+0000 7fdb8b631800 2 removed watcher, disabling cache 2024-04-24T02:12:27.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.838+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94834169774304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56404d006990 con 0x56404cffc6a0 2024-04-24T02:12:27.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.839+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.1 v2:172.21.15.134:6804/1487076214 32 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94834169774304] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb8002e070 con 0x56404cffc6a0 2024-04-24T02:12:27.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.839+0000 7fdb8b631800 20 remove_watcher() i=1 2024-04-24T02:12:27.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.839+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94834169777856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56404d00ce20 con 0x56404d0028f0 2024-04-24T02:12:27.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.840+0000 7fdb85fc9640 1 -- 172.21.15.134:0/1865244957 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94834169777856] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb7c066030 con 0x56404d0028f0 2024-04-24T02:12:27.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.840+0000 7fdb8b631800 20 remove_watcher() i=2 2024-04-24T02:12:27.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.840+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94834169780064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56404d0080e0 con 0x7fdb7c086050 2024-04-24T02:12:27.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.841+0000 7fdb86fcb640 1 -- 172.21.15.134:0/1865244957 <== osd.2 v2:172.21.15.134:6800/214480313 16 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94834169780064] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb78040040 con 0x7fdb7c086050 2024-04-24T02:12:27.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.841+0000 7fdb8b631800 20 remove_watcher() i=3 2024-04-24T02:12:27.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.841+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94834169784880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56404d006990 con 0x56404cffc6a0 2024-04-24T02:12:27.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.842+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.1 v2:172.21.15.134:6804/1487076214 33 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94834169784880] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb8002e070 con 0x56404cffc6a0 2024-04-24T02:12:27.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.842+0000 7fdb8b631800 20 remove_watcher() i=4 2024-04-24T02:12:27.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.842+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94834169786144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56404d008ec0 con 0x7fdb78031040 2024-04-24T02:12:27.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.843+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.0 v2:172.21.15.104:6800/2419146313 30 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94834169786144] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb8002e070 con 0x7fdb78031040 2024-04-24T02:12:27.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.843+0000 7fdb8b631800 20 remove_watcher() i=5 2024-04-24T02:12:27.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.843+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94834169790208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56404d0080e0 con 0x7fdb78031040 2024-04-24T02:12:27.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.844+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.0 v2:172.21.15.104:6800/2419146313 31 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94834169790208] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb8002e070 con 0x7fdb78031040 2024-04-24T02:12:27.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.844+0000 7fdb8b631800 20 remove_watcher() i=6 2024-04-24T02:12:27.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.844+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94834169787264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56404d00aa30 con 0x7fdb78031040 2024-04-24T02:12:27.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.845+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 <== osd.0 v2:172.21.15.104:6800/2419146313 32 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94834169787264] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb8002e070 con 0x7fdb78031040 2024-04-24T02:12:27.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.845+0000 7fdb8b631800 20 remove_watcher() i=7 2024-04-24T02:12:27.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.845+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fdb78031040 msgr2=0x7fdb78032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.845+0000 7fdb8b631800 1 --2- 172.21.15.134:0/1865244957 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fdb78031040 0x7fdb78032940 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.845+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x56404cffc6a0 msgr2=0x56404cffeb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.845+0000 7fdb8b631800 1 --2- 172.21.15.134:0/1865244957 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x56404cffc6a0 0x56404cffeb60 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.845+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fdb7c086050 msgr2=0x7fdb7c0706a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.845+0000 7fdb8b631800 1 --2- 172.21.15.134:0/1865244957 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fdb7c086050 0x7fdb7c0706a0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.845+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x56404d0028f0 msgr2=0x56404d004ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.845+0000 7fdb8b631800 1 --2- 172.21.15.134:0/1865244957 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x56404d0028f0 0x56404d004ce0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.845+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fda50036900 msgr2=0x7fda50038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.845+0000 7fdb8b631800 1 --2- 172.21.15.134:0/1865244957 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fda50036900 0x7fda50038dc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x56404cfc8620 tx=0x7fdb7801f000 comp rx=0 tx=0).stop 2024-04-24T02:12:27.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.845+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56404cfe9500 msgr2=0x56404cff0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.845+0000 7fdb867ca640 1 -- 172.21.15.134:0/1865244957 reap_dead start 2024-04-24T02:12:27.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.845+0000 7fdb8b631800 1 --2- 172.21.15.134:0/1865244957 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56404cfe9500 0x56404cff0bb0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c052e80 tx=0x7fdb7c08dad0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.845+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 shutdown_connections 2024-04-24T02:12:27.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.846+0000 7fdb8b631800 1 --2- 172.21.15.134:0/1865244957 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56404cfe9500 0x56404cff0bb0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.846+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 >> 172.21.15.134:0/1865244957 conn(0x56404cfe5860 msgr2=0x56404cfe2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:27.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.846+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 shutdown_connections 2024-04-24T02:12:27.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.846+0000 7fdb8b631800 1 -- 172.21.15.134:0/1865244957 wait complete. 2024-04-24T02:12:27.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.846+0000 7fdb8b631800 1 -- 172.21.15.134:0/1454122399 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fda60036900 msgr2=0x7fda60038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.846+0000 7fdb8b631800 1 --2- 172.21.15.134:0/1454122399 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fda60036900 0x7fda60038dc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x56404cfcc330 tx=0x7fdb78005840 comp rx=0 tx=0).stop 2024-04-24T02:12:27.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.846+0000 7fdb8b631800 1 -- 172.21.15.134:0/1454122399 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56404cfdc2c0 msgr2=0x56404cfdc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.846+0000 7fdb8b631800 1 --2- 172.21.15.134:0/1454122399 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56404cfdc2c0 0x56404cfdc6e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c000c00 tx=0x7fdb7c002fb0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.846+0000 7fdb8b631800 1 -- 172.21.15.134:0/1454122399 shutdown_connections 2024-04-24T02:12:27.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.846+0000 7fdb8b631800 1 --2- 172.21.15.134:0/1454122399 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fda60036900 0x7fda60038dc0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.846+0000 7fdb8b631800 1 --2- 172.21.15.134:0/1454122399 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56404cfdc2c0 0x56404cfdc6e0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.846+0000 7fdb8b631800 1 -- 172.21.15.134:0/1454122399 >> 172.21.15.134:0/1454122399 conn(0x56404cfd0360 msgr2=0x56404cfd0760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:27.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.846+0000 7fdb8b631800 1 -- 172.21.15.134:0/1454122399 shutdown_connections 2024-04-24T02:12:27.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.846+0000 7fdb8b631800 1 -- 172.21.15.134:0/1454122399 wait complete. 2024-04-24T02:12:27.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.846+0000 7fdb8b631800 1 -- 172.21.15.134:0/3184739537 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x56404cecd4a0 msgr2=0x56404cfcb100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.846+0000 7fdb8b631800 1 --2- 172.21.15.134:0/3184739537 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x56404cecd4a0 0x56404cfcb100 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.846+0000 7fdb8b631800 1 -- 172.21.15.134:0/3184739537 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fda6c036950 msgr2=0x7fda6c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.846+0000 7fdb8b631800 1 --2- 172.21.15.134:0/3184739537 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fda6c036950 0x7fda6c038e10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c054000 tx=0x7fdb7c04e000 comp rx=0 tx=0).stop 2024-04-24T02:12:27.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.846+0000 7fdb8b631800 1 -- 172.21.15.134:0/3184739537 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56404cec9990 msgr2=0x56404cfc3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.846+0000 7fdb8b631800 1 --2- 172.21.15.134:0/3184739537 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56404cec9990 0x56404cfc3ec0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fdb80001ed0 tx=0x7fdb80000ed0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.846+0000 7fdb8b631800 1 -- 172.21.15.134:0/3184739537 shutdown_connections 2024-04-24T02:12:27.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.846+0000 7fdb8b631800 1 --2- 172.21.15.134:0/3184739537 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x56404cecd4a0 0x56404cfcb100 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.846+0000 7fdb8b631800 1 --2- 172.21.15.134:0/3184739537 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fda6c036950 0x7fda6c038e10 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.846+0000 7fdb8b631800 1 --2- 172.21.15.134:0/3184739537 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56404cec9990 0x56404cfc3ec0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.846+0000 7fdb8b631800 1 -- 172.21.15.134:0/3184739537 >> 172.21.15.134:0/3184739537 conn(0x56404cec3320 msgr2=0x56404cec8170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:27.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.846+0000 7fdb8b631800 1 -- 172.21.15.134:0/3184739537 shutdown_connections 2024-04-24T02:12:27.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.846+0000 7fdb8b631800 1 -- 172.21.15.134:0/3184739537 wait complete. 2024-04-24T02:12:27.859 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-04-24T02:12:27.859 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-04-24T02:12:27.859 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-04-24T02:12:27.905 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:27.905 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:27.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.903+0000 7fdd50812800 1 Processor -- start 2024-04-24T02:12:27.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.904+0000 7fdd50812800 1 -- start start 2024-04-24T02:12:27.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.904+0000 7fdd50812800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5570cfa721d0 0x5570cfa745c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.904+0000 7fdd50812800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5570cf92dd40 con 0x5570cfa6dd40 2024-04-24T02:12:27.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.904+0000 7fdd50812800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x5570cf9004d0 con 0x5570cfa721d0 2024-04-24T02:12:27.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.904+0000 7fdd43fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5570cfa721d0 0x5570cfa745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.904+0000 7fdd43fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5570cfa721d0 0x5570cfa745c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56554/0 (socket says 172.21.15.134:56554) 2024-04-24T02:12:27.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.904+0000 7fdd43fff640 1 -- 172.21.15.134:0/418775228 learned_addr learned my addr 172.21.15.134:0/418775228 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:27.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.904+0000 7fdd43fff640 1 -- 172.21.15.134:0/418775228 >> v1:172.21.15.104:6789/0 conn(0x5570cfa6dd40 legacy=0x5570cfa6e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.904+0000 7fdd43fff640 1 -- 172.21.15.134:0/418775228 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570cf92c590 con 0x5570cfa721d0 2024-04-24T02:12:27.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.906+0000 7fdd43fff640 1 --2- 172.21.15.134:0/418775228 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5570cfa721d0 0x5570cfa745c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fdd3400a520 tx=0x7fdd3401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1c23b1e26692a61 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.906+0000 7fdd4b5ed640 1 -- 172.21.15.134:0/418775228 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd34057070 con 0x5570cfa721d0 2024-04-24T02:12:27.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.906+0000 7fdd4b5ed640 1 -- 172.21.15.134:0/418775228 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd34052570 con 0x5570cfa721d0 2024-04-24T02:12:27.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.906+0000 7fdd4b5ed640 1 -- 172.21.15.134:0/418775228 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd3404ae60 con 0x5570cfa721d0 2024-04-24T02:12:27.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.907+0000 7fdd50812800 1 -- 172.21.15.134:0/418775228 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5570cfa721d0 msgr2=0x5570cfa745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.907+0000 7fdd50812800 1 --2- 172.21.15.134:0/418775228 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5570cfa721d0 0x5570cfa745c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fdd3400a520 tx=0x7fdd3401d010 comp rx=0 tx=0).stop 2024-04-24T02:12:27.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.907+0000 7fdd50812800 1 -- 172.21.15.134:0/418775228 shutdown_connections 2024-04-24T02:12:27.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.907+0000 7fdd50812800 1 --2- 172.21.15.134:0/418775228 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5570cfa721d0 0x5570cfa745c0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.907+0000 7fdd50812800 1 -- 172.21.15.134:0/418775228 >> 172.21.15.134:0/418775228 conn(0x5570cfa693a0 msgr2=0x5570cfa6b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:27.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.907+0000 7fdd50812800 1 -- 172.21.15.134:0/418775228 shutdown_connections 2024-04-24T02:12:27.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.907+0000 7fdd50812800 1 -- 172.21.15.134:0/418775228 wait complete. 2024-04-24T02:12:27.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.919+0000 7fdd50812800 1 Processor -- start 2024-04-24T02:12:27.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.919+0000 7fdd50812800 1 -- start start 2024-04-24T02:12:27.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.919+0000 7fdd50812800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5570cfa6dd40 0x5570cfb5eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.919+0000 7fdd50812800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5570cf9ba3b0 con 0x5570cfa6dd40 2024-04-24T02:12:27.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.919+0000 7fdd4bdee640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5570cfa6dd40 0x5570cfb5eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.919+0000 7fdd4bdee640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5570cfa6dd40 0x5570cfb5eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56568/0 (socket says 172.21.15.134:56568) 2024-04-24T02:12:27.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.919+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1077529972 learned_addr learned my addr 172.21.15.134:0/1077529972 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:27.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.919+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1077529972 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570cfb5f5c0 con 0x5570cfa6dd40 2024-04-24T02:12:27.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.920+0000 7fdd4bdee640 1 --2- 172.21.15.134:0/1077529972 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5570cfa6dd40 0x5570cfb5eff0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c001d50 tx=0x7fdd3c00b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47b9cc6d4f522ead server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.920+0000 7fdc39e0b640 1 -- 172.21.15.134:0/1077529972 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd3c00f400 con 0x5570cfa6dd40 2024-04-24T02:12:27.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.920+0000 7fdc39e0b640 1 -- 172.21.15.134:0/1077529972 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd3c00f5a0 con 0x5570cfa6dd40 2024-04-24T02:12:27.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.920+0000 7fdc39e0b640 1 -- 172.21.15.134:0/1077529972 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd3c00f7d0 con 0x5570cfa6dd40 2024-04-24T02:12:27.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.920+0000 7fdd50812800 1 -- 172.21.15.134:0/1077529972 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5570cfa6dd40 msgr2=0x5570cfb5eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.920+0000 7fdd50812800 1 --2- 172.21.15.134:0/1077529972 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5570cfa6dd40 0x5570cfb5eff0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c001d50 tx=0x7fdd3c00b5b0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.920+0000 7fdd50812800 1 -- 172.21.15.134:0/1077529972 shutdown_connections 2024-04-24T02:12:27.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.920+0000 7fdd50812800 1 --2- 172.21.15.134:0/1077529972 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5570cfa6dd40 0x5570cfb5eff0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.920+0000 7fdd50812800 1 -- 172.21.15.134:0/1077529972 >> 172.21.15.134:0/1077529972 conn(0x5570cfa693a0 msgr2=0x5570cfb5a910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:27.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.920+0000 7fdd50812800 1 -- 172.21.15.134:0/1077529972 shutdown_connections 2024-04-24T02:12:27.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.920+0000 7fdd50812800 1 -- 172.21.15.134:0/1077529972 wait complete. 2024-04-24T02:12:27.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.921+0000 7fdd50812800 1 Processor -- start 2024-04-24T02:12:27.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.921+0000 7fdd50812800 1 -- start start 2024-04-24T02:12:27.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.921+0000 7fdd50812800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5570cfa6dd40 0x5570cf9e2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.921+0000 7fdd50812800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5570cfa74e90 con 0x5570cfa6dd40 2024-04-24T02:12:27.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.921+0000 7fdd4bdee640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5570cfa6dd40 0x5570cf9e2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.921+0000 7fdd4bdee640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5570cfa6dd40 0x5570cf9e2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56570/0 (socket says 172.21.15.134:56570) 2024-04-24T02:12:27.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.921+0000 7fdd4bdee640 1 -- 172.21.15.134:0/240114258 learned_addr learned my addr 172.21.15.134:0/240114258 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:27.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.922+0000 7fdd4bdee640 1 -- 172.21.15.134:0/240114258 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570cfb6a940 con 0x5570cfa6dd40 2024-04-24T02:12:27.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.922+0000 7fdd4bdee640 1 --2- 172.21.15.134:0/240114258 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5570cfa6dd40 0x5570cf9e2050 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x5570cfb5fd80 tx=0x7fdd3c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.922+0000 7fdc33fff640 1 -- 172.21.15.134:0/240114258 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd3c01a7c0 con 0x5570cfa6dd40 2024-04-24T02:12:27.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.922+0000 7fdc33fff640 1 -- 172.21.15.134:0/240114258 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd3c01a960 con 0x5570cfa6dd40 2024-04-24T02:12:27.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.922+0000 7fdd50812800 1 -- 172.21.15.134:0/240114258 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5570cfb6ab10 con 0x5570cfa6dd40 2024-04-24T02:12:27.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.922+0000 7fdc33fff640 1 -- 172.21.15.134:0/240114258 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd3c01ac60 con 0x5570cfa6dd40 2024-04-24T02:12:27.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.922+0000 7fdd50812800 1 -- 172.21.15.134:0/240114258 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570cfb6b030 con 0x5570cfa6dd40 2024-04-24T02:12:27.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.923+0000 7fdc33fff640 1 -- 172.21.15.134:0/240114258 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdd3c017070 con 0x5570cfa6dd40 2024-04-24T02:12:27.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.923+0000 7fdc33fff640 1 --2- 172.21.15.134:0/240114258 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdc34036900 0x7fdc34038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.923+0000 7fdc33fff640 1 -- 172.21.15.134:0/240114258 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fdd3c015020 con 0x5570cfa6dd40 2024-04-24T02:12:27.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.923+0000 7fdd43fff640 1 --2- 172.21.15.134:0/240114258 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdc34036900 0x7fdc34038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.923+0000 7fdd50812800 1 --2- 172.21.15.134:0/240114258 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5570cfa721d0 0x5570cfb6ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.923+0000 7fdd50812800 1 -- 172.21.15.134:0/240114258 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5570cfb6f450 con 0x5570cfa721d0 2024-04-24T02:12:27.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.923+0000 7fdd4c5ef640 1 --2- 172.21.15.134:0/240114258 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5570cfa721d0 0x5570cfb6ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.923+0000 7fdd43fff640 1 --2- 172.21.15.134:0/240114258 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdc34036900 0x7fdc34038dc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdd34054000 tx=0x7fdd3404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.923+0000 7fdd4c5ef640 1 --2- 172.21.15.134:0/240114258 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5570cfa721d0 0x5570cfb6ee50 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.924+0000 7fdd4c5ef640 1 -- 172.21.15.134:0/240114258 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd4400a4a0 con 0x5570cfa721d0 2024-04-24T02:12:27.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.924+0000 7fdd50812800 1 -- 172.21.15.134:0/240114258 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5570cfb6c420 con 0x5570cfa721d0 2024-04-24T02:12:27.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.924+0000 7fdd4c5ef640 1 -- 172.21.15.134:0/240114258 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdd4400a4a0 con 0x5570cfa721d0 2024-04-24T02:12:27.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.924+0000 7fdd50812800 1 -- 172.21.15.134:0/240114258 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5570cfb71290 con 0x5570cfa721d0 2024-04-24T02:12:27.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.924+0000 7fdd4c5ef640 1 -- 172.21.15.134:0/240114258 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdd4400a4a0 con 0x5570cfa721d0 2024-04-24T02:12:27.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.924+0000 7fdd50812800 1 -- 172.21.15.134:0/240114258 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5570cfb705d0 con 0x5570cfa721d0 2024-04-24T02:12:27.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.925+0000 7fdd4c5ef640 1 -- 172.21.15.134:0/240114258 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdd4400a4a0 con 0x5570cfa721d0 2024-04-24T02:12:27.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.925+0000 7fdd50812800 1 -- 172.21.15.134:0/240114258 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5570cfb70a20 con 0x5570cfa721d0 2024-04-24T02:12:27.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.925+0000 7fdd4c5ef640 1 -- 172.21.15.134:0/240114258 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdd4400a4a0 con 0x5570cfa721d0 2024-04-24T02:12:27.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.925+0000 7fdd50812800 1 Processor -- start 2024-04-24T02:12:27.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.925+0000 7fdd50812800 1 -- start start 2024-04-24T02:12:27.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.925+0000 7fdd50812800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5570cfb684d0 0x5570cfb66940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.925+0000 7fdd50812800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5570cf9606b0 con 0x5570cfb684d0 2024-04-24T02:12:27.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.926+0000 7fdd43fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5570cfb684d0 0x5570cfb66940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.926+0000 7fdd43fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5570cfb684d0 0x5570cfb66940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56582/0 (socket says 172.21.15.134:56582) 2024-04-24T02:12:27.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.926+0000 7fdd43fff640 1 -- 172.21.15.134:0/1554043970 learned_addr learned my addr 172.21.15.134:0/1554043970 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:27.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.926+0000 7fdd43fff640 1 -- 172.21.15.134:0/1554043970 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570cfb66e80 con 0x5570cfb684d0 2024-04-24T02:12:27.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.926+0000 7fdd43fff640 1 --2- 172.21.15.134:0/1554043970 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5570cfb684d0 0x5570cfb66940 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fdd34000c00 tx=0x7fdd34002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.926+0000 7fdc317fa640 1 -- 172.21.15.134:0/1554043970 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd34057040 con 0x5570cfb684d0 2024-04-24T02:12:27.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.926+0000 7fdc317fa640 1 -- 172.21.15.134:0/1554043970 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd3405d650 con 0x5570cfb684d0 2024-04-24T02:12:27.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.926+0000 7fdc317fa640 1 -- 172.21.15.134:0/1554043970 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd3405d930 con 0x5570cfb684d0 2024-04-24T02:12:27.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.926+0000 7fdd50812800 1 -- 172.21.15.134:0/1554043970 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5570cfb670b0 con 0x5570cfb684d0 2024-04-24T02:12:27.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.926+0000 7fdd50812800 1 -- 172.21.15.134:0/1554043970 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570cfb67550 con 0x5570cfb684d0 2024-04-24T02:12:27.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.927+0000 7fdc317fa640 1 -- 172.21.15.134:0/1554043970 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdd34067070 con 0x5570cfb684d0 2024-04-24T02:12:27.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.927+0000 7fdc317fa640 1 --2- 172.21.15.134:0/1554043970 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdc24036900 0x7fdc24038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.927+0000 7fdc317fa640 1 -- 172.21.15.134:0/1554043970 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fdd3408f660 con 0x5570cfb684d0 2024-04-24T02:12:27.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.927+0000 7fdd4c5ef640 1 --2- 172.21.15.134:0/1554043970 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdc24036900 0x7fdc24038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.927+0000 7fdd50812800 1 Processor -- start 2024-04-24T02:12:27.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.927+0000 7fdd50812800 1 -- start start 2024-04-24T02:12:27.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.927+0000 7fdd4c5ef640 1 --2- 172.21.15.134:0/1554043970 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdc24036900 0x7fdc24038dc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x5570cfb700f0 tx=0x7fdd44005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.928+0000 7fdd50812800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5570cfb8f420 0x5570cfb8f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.928+0000 7fdd50812800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5570cfb5f940 con 0x5570cfb8f420 2024-04-24T02:12:27.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.928+0000 7fdd43fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5570cfb8f420 0x5570cfb8f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.928+0000 7fdd43fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5570cfb8f420 0x5570cfb8f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56586/0 (socket says 172.21.15.134:56586) 2024-04-24T02:12:27.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.928+0000 7fdd43fff640 1 -- 172.21.15.134:0/2937459771 learned_addr learned my addr 172.21.15.134:0/2937459771 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:27.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.928+0000 7fdd43fff640 1 -- 172.21.15.134:0/2937459771 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570cfb8fe10 con 0x5570cfb8f420 2024-04-24T02:12:27.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.928+0000 7fdd43fff640 1 --2- 172.21.15.134:0/2937459771 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5570cfb8f420 0x5570cfb8f840 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fdd3408db70 tx=0x7fdd3408ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=410de06ce7dc733 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.928+0000 7fdc2affd640 1 -- 172.21.15.134:0/2937459771 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd34000ed0 con 0x5570cfb8f420 2024-04-24T02:12:27.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.928+0000 7fdc2affd640 1 -- 172.21.15.134:0/2937459771 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd34068c50 con 0x5570cfb8f420 2024-04-24T02:12:27.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.928+0000 7fdc2affd640 1 -- 172.21.15.134:0/2937459771 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd34001070 con 0x5570cfb8f420 2024-04-24T02:12:27.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.929+0000 7fdd50812800 1 -- 172.21.15.134:0/2937459771 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5570cfb8f420 msgr2=0x5570cfb8f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:27.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.929+0000 7fdd50812800 1 --2- 172.21.15.134:0/2937459771 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5570cfb8f420 0x5570cfb8f840 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fdd3408db70 tx=0x7fdd3408ddf0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.929+0000 7fdd50812800 1 -- 172.21.15.134:0/2937459771 shutdown_connections 2024-04-24T02:12:27.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.929+0000 7fdd50812800 1 --2- 172.21.15.134:0/2937459771 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5570cfb8f420 0x5570cfb8f840 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:27.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.929+0000 7fdd50812800 1 -- 172.21.15.134:0/2937459771 >> 172.21.15.134:0/2937459771 conn(0x5570cfb8b780 msgr2=0x5570cfb897e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:27.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.929+0000 7fdd50812800 1 -- 172.21.15.134:0/2937459771 shutdown_connections 2024-04-24T02:12:27.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.929+0000 7fdd50812800 1 -- 172.21.15.134:0/2937459771 wait complete. 2024-04-24T02:12:27.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.929+0000 7fdd50812800 1 Processor -- start 2024-04-24T02:12:27.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.929+0000 7fdd50812800 1 -- start start 2024-04-24T02:12:27.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.929+0000 7fdd50812800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5570cfb8f420 0x5570cfb96a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.929+0000 7fdd50812800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5570cfb90580 con 0x5570cfb8f420 2024-04-24T02:12:27.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.929+0000 7fdd43fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5570cfb8f420 0x5570cfb96a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.929+0000 7fdd43fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5570cfb8f420 0x5570cfb96a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56590/0 (socket says 172.21.15.134:56590) 2024-04-24T02:12:27.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.929+0000 7fdd43fff640 1 -- 172.21.15.134:0/1409953896 learned_addr learned my addr 172.21.15.134:0/1409953896 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:27.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.930+0000 7fdd43fff640 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570cfb96f80 con 0x5570cfb8f420 2024-04-24T02:12:27.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.930+0000 7fdd43fff640 1 --2- 172.21.15.134:0/1409953896 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5570cfb8f420 0x5570cfb96a40 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fdd34052e80 tx=0x7fdd3408dad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.930+0000 7fdc297fa640 1 -- 172.21.15.134:0/1409953896 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd34068e00 con 0x5570cfb8f420 2024-04-24T02:12:27.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.930+0000 7fdc297fa640 1 -- 172.21.15.134:0/1409953896 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd34093030 con 0x5570cfb8f420 2024-04-24T02:12:27.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.930+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5570cfb97210 con 0x5570cfb8f420 2024-04-24T02:12:27.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.930+0000 7fdc297fa640 1 -- 172.21.15.134:0/1409953896 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd3408f980 con 0x5570cfb8f420 2024-04-24T02:12:27.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.930+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570cfb99ec0 con 0x5570cfb8f420 2024-04-24T02:12:27.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.931+0000 7fdc297fa640 1 -- 172.21.15.134:0/1409953896 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdd3408fb20 con 0x5570cfb8f420 2024-04-24T02:12:27.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.931+0000 7fdc297fa640 1 --2- 172.21.15.134:0/1409953896 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdc14036950 0x7fdc14038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.931+0000 7fdc297fa640 1 -- 172.21.15.134:0/1409953896 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fdd34099ad0 con 0x5570cfb8f420 2024-04-24T02:12:27.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.931+0000 7fdd4c5ef640 1 --2- 172.21.15.134:0/1409953896 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdc14036950 0x7fdc14038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.931+0000 7fdd4c5ef640 1 --2- 172.21.15.134:0/1409953896 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdc14036950 0x7fdc14038e10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x5570cfb6c370 tx=0x7fdd4401f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.932+0000 7fdd50812800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.932+0000 7fdd50812800 1 --2- 172.21.15.134:0/1409953896 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5570cfba25a0 0x5570cfba4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.932+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5570cfba51b0 con 0x5570cfba25a0 2024-04-24T02:12:27.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.932+0000 7fdd4bdee640 1 --2- 172.21.15.134:0/1409953896 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5570cfba25a0 0x5570cfba4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.932+0000 7fdd4bdee640 1 --2- 172.21.15.134:0/1409953896 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5570cfba25a0 0x5570cfba4a60 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.932+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd3c02e070 con 0x5570cfba25a0 2024-04-24T02:12:27.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.932+0000 7fdd50812800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.932+0000 7fdd50812800 20 realm 2024-04-24T02:12:27.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.932+0000 7fdd50812800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.932+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5570cfba55c0 con 0x5570cfba25a0 2024-04-24T02:12:27.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.932+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd3c02e070 con 0x5570cfba25a0 2024-04-24T02:12:27.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.932+0000 7fdd50812800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.932+0000 7fdd50812800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:27.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.932+0000 7fdd50812800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.932+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5570cfba5e90 con 0x5570cfba25a0 2024-04-24T02:12:27.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.933+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd3c02e070 con 0x5570cfba25a0 2024-04-24T02:12:27.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.933+0000 7fdd50812800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.933+0000 7fdd50812800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.933+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5570cfba6230 con 0x5570cfba25a0 2024-04-24T02:12:27.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.933+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdd3c02e070 con 0x5570cfba25a0 2024-04-24T02:12:27.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.933+0000 7fdd50812800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:27.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.933+0000 7fdd50812800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.933+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5570cfba6a80 con 0x5570cfba25a0 2024-04-24T02:12:27.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.933+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdd3c02e070 con 0x5570cfba25a0 2024-04-24T02:12:27.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.933+0000 7fdd50812800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:27.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.933+0000 7fdd50812800 20 searching for the correct realm 2024-04-24T02:12:27.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.933+0000 7fdd50812800 1 --2- 172.21.15.134:0/1409953896 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5570cfba87f0 0x5570cfbaabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.933+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbab1f0 con 0x5570cfba87f0 2024-04-24T02:12:27.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.933+0000 7fdd43fff640 1 --2- 172.21.15.134:0/1409953896 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5570cfba87f0 0x5570cfbaabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.933+0000 7fdd43fff640 1 --2- 172.21.15.134:0/1409953896 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5570cfba87f0 0x5570cfbaabe0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.934+0000 7fdd43fff640 1 -- 172.21.15.134:0/1409953896 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd3409f070 con 0x5570cfba87f0 2024-04-24T02:12:27.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.934+0000 7fdd43fff640 1 --2- 172.21.15.134:0/1409953896 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fdd34086050 0x7fdd3405c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.934+0000 7fdd43fff640 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbab1f0 con 0x7fdd34086050 2024-04-24T02:12:27.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.934+0000 7fdd4c5ef640 1 --2- 172.21.15.134:0/1409953896 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fdd34086050 0x7fdd3405c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.934+0000 7fdd4c5ef640 1 --2- 172.21.15.134:0/1409953896 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fdd34086050 0x7fdd3405c720 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.935+0000 7fdd4c5ef640 1 -- 172.21.15.134:0/1409953896 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd4401f070 con 0x7fdd34086050 2024-04-24T02:12:27.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.935+0000 7fdd4c5ef640 1 --2- 172.21.15.134:0/1409953896 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fdd44031040 0x7fdd44032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:27.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.935+0000 7fdd4c5ef640 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbab1f0 con 0x7fdd44031040 2024-04-24T02:12:27.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.935+0000 7fdd4bdee640 1 --2- 172.21.15.134:0/1409953896 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fdd44031040 0x7fdd44032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:27.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.935+0000 7fdd4bdee640 1 --2- 172.21.15.134:0/1409953896 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fdd44031040 0x7fdd44032940 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:27.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.935+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd3c02e070 con 0x7fdd44031040 2024-04-24T02:12:27.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.935+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbab1f0 con 0x5570cfba25a0 2024-04-24T02:12:27.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.935+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd3c02e070 con 0x5570cfba25a0 2024-04-24T02:12:27.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.936+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbab1f0 con 0x5570cfba25a0 2024-04-24T02:12:27.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.936+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdd3c02e070 con 0x5570cfba25a0 2024-04-24T02:12:27.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.936+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbab1f0 con 0x7fdd44031040 2024-04-24T02:12:27.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.936+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd3c02e070 con 0x7fdd44031040 2024-04-24T02:12:27.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.936+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbab1f0 con 0x7fdd44031040 2024-04-24T02:12:27.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.936+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd3c02e070 con 0x7fdd44031040 2024-04-24T02:12:27.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.936+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbab1f0 con 0x7fdd34086050 2024-04-24T02:12:27.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.936+0000 7fdd4c5ef640 1 -- 172.21.15.134:0/1409953896 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd4401f070 con 0x7fdd34086050 2024-04-24T02:12:27.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.936+0000 7fdd4c5ef640 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbab1f0 con 0x5570cfba87f0 2024-04-24T02:12:27.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.937+0000 7fdd43fff640 1 -- 172.21.15.134:0/1409953896 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd3409f070 con 0x5570cfba87f0 2024-04-24T02:12:27.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.937+0000 7fdd43fff640 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbab1f0 con 0x5570cfba25a0 2024-04-24T02:12:27.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.937+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd3c02e070 con 0x5570cfba25a0 2024-04-24T02:12:27.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.937+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbab1f0 con 0x7fdd44031040 2024-04-24T02:12:27.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.937+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd3c02e070 con 0x7fdd44031040 2024-04-24T02:12:27.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.937+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbab1f0 con 0x5570cfba25a0 2024-04-24T02:12:27.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.937+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd3c02e070 con 0x5570cfba25a0 2024-04-24T02:12:27.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.937+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbab1f0 con 0x7fdd34086050 2024-04-24T02:12:27.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.938+0000 7fdd4c5ef640 1 -- 172.21.15.134:0/1409953896 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdd4401f070 con 0x7fdd34086050 2024-04-24T02:12:27.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.938+0000 7fdd4c5ef640 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbab1f0 con 0x5570cfba87f0 2024-04-24T02:12:27.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.938+0000 7fdd43fff640 1 -- 172.21.15.134:0/1409953896 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd3409f070 con 0x5570cfba87f0 2024-04-24T02:12:27.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.938+0000 7fdd43fff640 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbab1f0 con 0x5570cfba87f0 2024-04-24T02:12:27.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.938+0000 7fdd43fff640 1 -- 172.21.15.134:0/1409953896 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd3409f070 con 0x5570cfba87f0 2024-04-24T02:12:27.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.938+0000 7fdd43fff640 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbab1f0 con 0x7fdd44031040 2024-04-24T02:12:27.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.938+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd3c02e070 con 0x7fdd44031040 2024-04-24T02:12:27.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.938+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbab1f0 con 0x5570cfba87f0 2024-04-24T02:12:27.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.939+0000 7fdd43fff640 1 -- 172.21.15.134:0/1409953896 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd3409f070 con 0x5570cfba87f0 2024-04-24T02:12:27.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.939+0000 7fdd43fff640 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbab1f0 con 0x5570cfba87f0 2024-04-24T02:12:27.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.939+0000 7fdd43fff640 1 -- 172.21.15.134:0/1409953896 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd3409f070 con 0x5570cfba87f0 2024-04-24T02:12:27.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.939+0000 7fdd43fff640 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbab1f0 con 0x5570cfba25a0 2024-04-24T02:12:27.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.939+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd3c02e070 con 0x5570cfba25a0 2024-04-24T02:12:27.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.939+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbab1f0 con 0x5570cfba25a0 2024-04-24T02:12:27.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.939+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fdd3c02e070 con 0x5570cfba25a0 2024-04-24T02:12:27.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.939+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbab1f0 con 0x7fdd44031040 2024-04-24T02:12:27.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.939+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd3c02e070 con 0x7fdd44031040 2024-04-24T02:12:27.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.939+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbab1f0 con 0x5570cfba87f0 2024-04-24T02:12:27.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.940+0000 7fdd43fff640 1 -- 172.21.15.134:0/1409953896 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd3409f070 con 0x5570cfba87f0 2024-04-24T02:12:27.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.940+0000 7fdd43fff640 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbab1f0 con 0x7fdd34086050 2024-04-24T02:12:27.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.940+0000 7fdd4c5ef640 1 -- 172.21.15.134:0/1409953896 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd4401f070 con 0x7fdd34086050 2024-04-24T02:12:27.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.940+0000 7fdd4c5ef640 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbab1f0 con 0x5570cfba25a0 2024-04-24T02:12:27.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.940+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd3c02e070 con 0x5570cfba25a0 2024-04-24T02:12:27.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.940+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbab1f0 con 0x7fdd44031040 2024-04-24T02:12:27.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.940+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd3c02e070 con 0x7fdd44031040 2024-04-24T02:12:27.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.940+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbab1f0 con 0x5570cfba87f0 2024-04-24T02:12:27.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.941+0000 7fdd43fff640 1 -- 172.21.15.134:0/1409953896 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd3409f070 con 0x5570cfba87f0 2024-04-24T02:12:27.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.941+0000 7fdd43fff640 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbab1f0 con 0x7fdd44031040 2024-04-24T02:12:27.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.941+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd3c02e070 con 0x7fdd44031040 2024-04-24T02:12:27.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.941+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbab1f0 con 0x7fdd34086050 2024-04-24T02:12:27.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.941+0000 7fdd4c5ef640 1 -- 172.21.15.134:0/1409953896 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd4401f070 con 0x7fdd34086050 2024-04-24T02:12:27.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.941+0000 7fdd4c5ef640 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbab1f0 con 0x5570cfba87f0 2024-04-24T02:12:27.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.941+0000 7fdd43fff640 1 -- 172.21.15.134:0/1409953896 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd3409f070 con 0x5570cfba87f0 2024-04-24T02:12:27.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.941+0000 7fdd43fff640 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbab1f0 con 0x7fdd44031040 2024-04-24T02:12:27.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.942+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd3c02e070 con 0x7fdd44031040 2024-04-24T02:12:27.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.942+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbab1f0 con 0x5570cfba25a0 2024-04-24T02:12:27.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.942+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdd3c02e070 con 0x5570cfba25a0 2024-04-24T02:12:27.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.942+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbab1f0 con 0x7fdd34086050 2024-04-24T02:12:27.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.942+0000 7fdd4c5ef640 1 -- 172.21.15.134:0/1409953896 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd4401f070 con 0x7fdd34086050 2024-04-24T02:12:27.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.942+0000 7fdd50812800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:27.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.942+0000 7fdd50812800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:27.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.942+0000 7fdd50812800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:27.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.942+0000 7fdd50812800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:27.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.942+0000 7fdd50812800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:27.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.942+0000 7fdd50812800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:27.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.942+0000 7fdd50812800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.942+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5570cfba7400 con 0x5570cfba25a0 2024-04-24T02:12:27.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.942+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd3c02e070 con 0x5570cfba25a0 2024-04-24T02:12:27.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.942+0000 7fdd50812800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.942+0000 7fdd50812800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.942+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5570cfba7ca0 con 0x5570cfba25a0 2024-04-24T02:12:27.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.943+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdd3c02e070 con 0x5570cfba25a0 2024-04-24T02:12:27.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.943+0000 7fdd50812800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:27.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.943+0000 7fdd50812800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.943+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbab650 con 0x5570cfba25a0 2024-04-24T02:12:27.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.943+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdd3c02e070 con 0x5570cfba25a0 2024-04-24T02:12:27.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.943+0000 7fdd50812800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:27.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.943+0000 7fdd50812800 20 zone default found 2024-04-24T02:12:27.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.943+0000 7fdd50812800 4 Realm: () 2024-04-24T02:12:27.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.943+0000 7fdd50812800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:27.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.943+0000 7fdd50812800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:27.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.943+0000 7fdd50812800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:27.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.943+0000 7fdd50812800 20 zonegroup default 2024-04-24T02:12:27.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.943+0000 7fdd50812800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.943+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5570cfba7900 con 0x7fdd44031040 2024-04-24T02:12:27.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.943+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdd3c02e070 con 0x7fdd44031040 2024-04-24T02:12:27.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.943+0000 7fdd50812800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.943+0000 7fdd50812800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.943+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbad560 con 0x5570cfba87f0 2024-04-24T02:12:27.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.943+0000 7fdd43fff640 1 -- 172.21.15.134:0/1409953896 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdd3409f070 con 0x5570cfba87f0 2024-04-24T02:12:27.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.943+0000 7fdd50812800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.943+0000 7fdd50812800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.943+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbad930 con 0x5570cfba87f0 2024-04-24T02:12:27.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.944+0000 7fdd43fff640 1 -- 172.21.15.134:0/1409953896 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdd3409f070 con 0x5570cfba87f0 2024-04-24T02:12:27.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.944+0000 7fdd50812800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:27.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.944+0000 7fdd50812800 20 started sync module instance, tier type = 2024-04-24T02:12:27.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.944+0000 7fdd50812800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:27.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.944+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbaca00 con 0x7fdd34086050 2024-04-24T02:12:27.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.945+0000 7fdd4c5ef640 1 -- 172.21.15.134:0/1409953896 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd44040040 con 0x7fdd34086050 2024-04-24T02:12:27.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.945+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93943009824240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbac660 con 0x7fdd34086050 2024-04-24T02:12:27.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.945+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbae730 con 0x5570cfba25a0 2024-04-24T02:12:27.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.946+0000 7fdd4c5ef640 1 -- 172.21.15.134:0/1409953896 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93943009824240] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd44040040 con 0x7fdd34086050 2024-04-24T02:12:27.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.946+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd3c02e070 con 0x5570cfba25a0 2024-04-24T02:12:27.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.946+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93943009828240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbae660 con 0x5570cfba25a0 2024-04-24T02:12:27.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.946+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbaf180 con 0x5570cfba87f0 2024-04-24T02:12:27.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.947+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93943009828240] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd3c02e070 con 0x5570cfba25a0 2024-04-24T02:12:27.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.947+0000 7fdd43fff640 1 -- 172.21.15.134:0/1409953896 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd3409f070 con 0x5570cfba87f0 2024-04-24T02:12:27.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.947+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93943009829296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbae5d0 con 0x5570cfba87f0 2024-04-24T02:12:27.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.947+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbb0070 con 0x7fdd34086050 2024-04-24T02:12:27.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.948+0000 7fdd43fff640 1 -- 172.21.15.134:0/1409953896 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93943009829296] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd3409f070 con 0x5570cfba87f0 2024-04-24T02:12:27.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.948+0000 7fdd4c5ef640 1 -- 172.21.15.134:0/1409953896 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd44040040 con 0x7fdd34086050 2024-04-24T02:12:27.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.948+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93943009835968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbaffe0 con 0x7fdd34086050 2024-04-24T02:12:27.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.948+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbb0f30 con 0x5570cfba25a0 2024-04-24T02:12:27.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.949+0000 7fdd4c5ef640 1 -- 172.21.15.134:0/1409953896 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93943009835968] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd44040040 con 0x7fdd34086050 2024-04-24T02:12:27.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.949+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd3c02e070 con 0x5570cfba25a0 2024-04-24T02:12:27.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.949+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93943009838176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbb0f30 con 0x5570cfba25a0 2024-04-24T02:12:27.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.949+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbb18f0 con 0x7fdd44031040 2024-04-24T02:12:27.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.950+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd3c02e070 con 0x7fdd44031040 2024-04-24T02:12:27.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.950+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93943009842240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbb1860 con 0x7fdd44031040 2024-04-24T02:12:27.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.950+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93943009838176] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd3c02e070 con 0x5570cfba25a0 2024-04-24T02:12:27.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.950+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbb0ab0 con 0x7fdd44031040 2024-04-24T02:12:27.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.951+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93943009842240] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd3c02e070 con 0x7fdd44031040 2024-04-24T02:12:27.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.951+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(56 notify.6 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd3c02e070 con 0x7fdd44031040 2024-04-24T02:12:27.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.951+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93943009839744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbb2380 con 0x7fdd44031040 2024-04-24T02:12:27.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.951+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbb2d40 con 0x7fdd44031040 2024-04-24T02:12:27.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.952+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93943009839744] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd3c02e070 con 0x7fdd44031040 2024-04-24T02:12:27.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.954+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(58 notify.7 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd3c02e070 con 0x7fdd44031040 2024-04-24T02:12:27.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.954+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93943009847440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbb2380 con 0x7fdd44031040 2024-04-24T02:12:27.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.954+0000 7fdd50812800 20 add_watcher() i=0 2024-04-24T02:12:27.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.954+0000 7fdd50812800 20 add_watcher() i=1 2024-04-24T02:12:27.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.954+0000 7fdd50812800 20 add_watcher() i=2 2024-04-24T02:12:27.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.954+0000 7fdd50812800 20 add_watcher() i=3 2024-04-24T02:12:27.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.954+0000 7fdd50812800 20 add_watcher() i=4 2024-04-24T02:12:27.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.954+0000 7fdd50812800 20 add_watcher() i=5 2024-04-24T02:12:27.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.954+0000 7fdd50812800 20 add_watcher() i=6 2024-04-24T02:12:27.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.955+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93943009847440] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd3c02e070 con 0x7fdd44031040 2024-04-24T02:12:27.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.955+0000 7fdd50812800 20 add_watcher() i=7 2024-04-24T02:12:27.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.955+0000 7fdd50812800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:27.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.955+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbb6190 con 0x5570cfba25a0 2024-04-24T02:12:27.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.955+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdd3c02e070 con 0x5570cfba25a0 2024-04-24T02:12:27.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.955+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93943009848496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbb3620 con 0x5570cfba25a0 2024-04-24T02:12:27.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.956+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93943009848496] v30'141 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdd3c02e070 con 0x5570cfba25a0 2024-04-24T02:12:27.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.957+0000 7fdc01fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:27.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.957+0000 7fdd50812800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:27.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.957+0000 7fdd50812800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:27.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.957+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbbea40 con 0x5570cfba25a0 2024-04-24T02:12:27.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.958+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'46 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdd3c02e070 con 0x5570cfba25a0 2024-04-24T02:12:27.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.958+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbbf110 con 0x7fdd44031040 2024-04-24T02:12:27.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.959+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdd3c02e070 con 0x7fdd44031040 2024-04-24T02:12:27.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.959+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbbf110 con 0x5570cfba87f0 2024-04-24T02:12:27.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.960+0000 7fdd43fff640 1 -- 172.21.15.134:0/1409953896 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdd3409f070 con 0x5570cfba87f0 2024-04-24T02:12:27.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.960+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbbf4b0 con 0x5570cfba25a0 2024-04-24T02:12:27.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.961+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'142 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdd3c02e070 con 0x5570cfba25a0 2024-04-24T02:12:27.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.961+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbbe1d0 con 0x7fdd34086050 2024-04-24T02:12:27.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.962+0000 7fdd4c5ef640 1 -- 172.21.15.134:0/1409953896 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'44 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdd44040040 con 0x7fdd34086050 2024-04-24T02:12:27.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.962+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbbe1d0 con 0x5570cfba87f0 2024-04-24T02:12:27.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.963+0000 7fdd43fff640 1 -- 172.21.15.134:0/1409953896 <== osd.3 v2:172.21.15.134:6801/3585115521 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'39 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdd3409f070 con 0x5570cfba87f0 2024-04-24T02:12:27.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.963+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbbfe00 con 0x5570cfba25a0 2024-04-24T02:12:27.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.964+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdd3c02e070 con 0x5570cfba25a0 2024-04-24T02:12:27.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.964+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbbfe00 con 0x7fdd44031040 2024-04-24T02:12:27.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.965+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'32 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdd3c02e070 con 0x7fdd44031040 2024-04-24T02:12:27.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.965+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbbfe00 con 0x7fdd34086050 2024-04-24T02:12:27.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.966+0000 7fdd4c5ef640 1 -- 172.21.15.134:0/1409953896 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdd44040040 con 0x7fdd34086050 2024-04-24T02:12:27.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.966+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbc0370 con 0x5570cfba87f0 2024-04-24T02:12:27.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.967+0000 7fdd43fff640 1 -- 172.21.15.134:0/1409953896 <== osd.3 v2:172.21.15.134:6801/3585115521 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdd3409f070 con 0x5570cfba87f0 2024-04-24T02:12:27.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.967+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbc0900 con 0x7fdd34086050 2024-04-24T02:12:27.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.968+0000 7fdd4c5ef640 1 -- 172.21.15.134:0/1409953896 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'45 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd44040040 con 0x7fdd34086050 2024-04-24T02:12:27.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.968+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbc0ce0 con 0x7fdd44031040 2024-04-24T02:12:27.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.969+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd3c02e070 con 0x7fdd44031040 2024-04-24T02:12:27.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.969+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbc0ce0 con 0x7fdd34086050 2024-04-24T02:12:27.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.970+0000 7fdd4c5ef640 1 -- 172.21.15.134:0/1409953896 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'22 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd44040040 con 0x7fdd34086050 2024-04-24T02:12:27.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.970+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbc1190 con 0x7fdd44031040 2024-04-24T02:12:27.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.971+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.0 v2:172.21.15.104:6800/2419146313 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'43 uv16 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd3c02e070 con 0x7fdd44031040 2024-04-24T02:12:27.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.971+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbc1190 con 0x5570cfba25a0 2024-04-24T02:12:27.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.972+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'143 uv16 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd3c02e070 con 0x5570cfba25a0 2024-04-24T02:12:27.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.972+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbc1190 con 0x5570cfba87f0 2024-04-24T02:12:27.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.973+0000 7fdd43fff640 1 -- 172.21.15.134:0/1409953896 <== osd.3 v2:172.21.15.134:6801/3585115521 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'38 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd3409f070 con 0x5570cfba87f0 2024-04-24T02:12:27.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.973+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbc1190 con 0x7fdd34086050 2024-04-24T02:12:27.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.974+0000 7fdd4c5ef640 1 -- 172.21.15.134:0/1409953896 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'46 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd44040040 con 0x7fdd34086050 2024-04-24T02:12:27.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.974+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbc1190 con 0x5570cfba87f0 2024-04-24T02:12:27.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.975+0000 7fdd43fff640 1 -- 172.21.15.134:0/1409953896 <== osd.3 v2:172.21.15.134:6801/3585115521 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'28 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd3409f070 con 0x5570cfba87f0 2024-04-24T02:12:27.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.975+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbc1190 con 0x5570cfba25a0 2024-04-24T02:12:27.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.977+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd3c02e070 con 0x5570cfba25a0 2024-04-24T02:12:27.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.977+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbc1190 con 0x5570cfba25a0 2024-04-24T02:12:27.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.977+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'144 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd3c02e070 con 0x5570cfba25a0 2024-04-24T02:12:27.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.978+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbc1190 con 0x5570cfba87f0 2024-04-24T02:12:27.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.979+0000 7fdd43fff640 1 -- 172.21.15.134:0/1409953896 <== osd.3 v2:172.21.15.134:6801/3585115521 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'39 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd3409f070 con 0x5570cfba87f0 2024-04-24T02:12:27.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.979+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbc1190 con 0x7fdd34086050 2024-04-24T02:12:27.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.979+0000 7fdd4c5ef640 1 -- 172.21.15.134:0/1409953896 <== osd.2 v2:172.21.15.134:6800/214480313 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'32 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd44040040 con 0x7fdd34086050 2024-04-24T02:12:27.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.980+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbc1190 con 0x5570cfba87f0 2024-04-24T02:12:27.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.980+0000 7fdd43fff640 1 -- 172.21.15.134:0/1409953896 <== osd.3 v2:172.21.15.134:6801/3585115521 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd3409f070 con 0x5570cfba87f0 2024-04-24T02:12:27.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.980+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbc1190 con 0x5570cfba87f0 2024-04-24T02:12:27.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.981+0000 7fdd43fff640 1 -- 172.21.15.134:0/1409953896 <== osd.3 v2:172.21.15.134:6801/3585115521 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'34 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd3409f070 con 0x5570cfba87f0 2024-04-24T02:12:27.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.981+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbc1190 con 0x5570cfba87f0 2024-04-24T02:12:27.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.982+0000 7fdd43fff640 1 -- 172.21.15.134:0/1409953896 <== osd.3 v2:172.21.15.134:6801/3585115521 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd3409f070 con 0x5570cfba87f0 2024-04-24T02:12:27.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.982+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbc1190 con 0x5570cfba87f0 2024-04-24T02:12:27.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.983+0000 7fdd43fff640 1 -- 172.21.15.134:0/1409953896 <== osd.3 v2:172.21.15.134:6801/3585115521 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'40 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd3409f070 con 0x5570cfba87f0 2024-04-24T02:12:27.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.983+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbc1190 con 0x7fdd44031040 2024-04-24T02:12:27.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.985+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.0 v2:172.21.15.104:6800/2419146313 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'24 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd3c02e070 con 0x7fdd44031040 2024-04-24T02:12:27.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.985+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbc1190 con 0x5570cfba87f0 2024-04-24T02:12:27.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.986+0000 7fdd43fff640 1 -- 172.21.15.134:0/1409953896 <== osd.3 v2:172.21.15.134:6801/3585115521 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'28 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd3409f070 con 0x5570cfba87f0 2024-04-24T02:12:27.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.986+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbc1190 con 0x7fdd44031040 2024-04-24T02:12:27.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.987+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.0 v2:172.21.15.104:6800/2419146313 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'33 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd3c02e070 con 0x7fdd44031040 2024-04-24T02:12:27.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.987+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbc1190 con 0x5570cfba87f0 2024-04-24T02:12:27.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.988+0000 7fdd43fff640 1 -- 172.21.15.134:0/1409953896 <== osd.3 v2:172.21.15.134:6801/3585115521 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'40 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd3409f070 con 0x5570cfba87f0 2024-04-24T02:12:27.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.988+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbc1190 con 0x7fdd44031040 2024-04-24T02:12:27.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.989+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.0 v2:172.21.15.104:6800/2419146313 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'44 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd3c02e070 con 0x7fdd44031040 2024-04-24T02:12:27.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.989+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbc1190 con 0x7fdd34086050 2024-04-24T02:12:27.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.990+0000 7fdd4c5ef640 1 -- 172.21.15.134:0/1409953896 <== osd.2 v2:172.21.15.134:6800/214480313 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd44040040 con 0x7fdd34086050 2024-04-24T02:12:27.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.990+0000 7fdc00fe1640 20 reqs_thread_entry: start 2024-04-24T02:12:27.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.990+0000 7fdd50812800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:27.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.990+0000 7fdd50812800 20 Filter name: none 2024-04-24T02:12:27.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.990+0000 7fdb7a7fc640 20 reqs_thread_entry: start 2024-04-24T02:12:27.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.990+0000 7fdd50812800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-04-24T02:12:27.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.990+0000 7fdd50812800 20 rados->read ofs=0 len=0 2024-04-24T02:12:27.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.990+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbebf60 con 0x7fdd44031040 2024-04-24T02:12:27.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.991+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.0 v2:172.21.15.104:6800/2419146313 24 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7fdd3c02e070 con 0x7fdd44031040 2024-04-24T02:12:27.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.991+0000 7fdd50812800 20 rados_obj.operate() r=0 bl.length=419 2024-04-24T02:12:27.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.991+0000 7fdd50812800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-04-24T02:12:27.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.991+0000 7fdd50812800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-04-24T02:12:27.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.991+0000 7fdd50812800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:12:27.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.991+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbebf20 con 0x5570cfba25a0 2024-04-24T02:12:27.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.991+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 170+0+15 (crc 0 0 0) 0x7fdd3c02e070 con 0x5570cfba25a0 2024-04-24T02:12:27.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.991+0000 7fdd50812800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-04-24T02:12:27.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.991+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbebf20 con 0x7fdd44031040 2024-04-24T02:12:27.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.992+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.0 v2:172.21.15.104:6800/2419146313 25 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v30'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fdd3c02e070 con 0x7fdd44031040 2024-04-24T02:12:27.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.992+0000 7fdd50812800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-24T02:12:27.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.992+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 93943010088144 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbeeee0 con 0x5570cfba87f0 2024-04-24T02:12:27.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.992+0000 7fdd43fff640 1 -- 172.21.15.134:0/1409953896 <== osd.3 v2:172.21.15.134:6801/3585115521 26 ==== watch-notify(notify (1) cookie 93943009829296 notify 128849018891 ret 0) ==== 212+0+0 (crc 0 0 0) 0x5570cfbbf9a0 con 0x5570cfba87f0 2024-04-24T02:12:27.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.992+0000 7fdc2affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018891 cookie 93943009829296 notifier 4558 bl.length()=170 2024-04-24T02:12:27.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.992+0000 7fdd43fff640 1 -- 172.21.15.134:0/1409953896 <== osd.3 v2:172.21.15.134:6801/3585115521 27 ==== osd_op_reply(97 notify.2 [notify cookie 93943010088144 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdd3409f070 con 0x5570cfba87f0 2024-04-24T02:12:27.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.993+0000 7fdc2affd640 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fdc10003d60 con 0x5570cfba87f0 2024-04-24T02:12:27.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.993+0000 7fdd43fff640 1 -- 172.21.15.134:0/1409953896 <== osd.3 v2:172.21.15.134:6801/3585115521 28 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd3409f070 con 0x5570cfba87f0 2024-04-24T02:12:27.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.993+0000 7fdd43fff640 1 -- 172.21.15.134:0/1409953896 <== osd.3 v2:172.21.15.134:6801/3585115521 29 ==== watch-notify(notify_complete (2) cookie 93943010088144 notify 128849018891 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5570cfb96f80 con 0x5570cfba87f0 2024-04-24T02:12:27.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.993+0000 7fdd50812800 10 removing email index: 2024-04-24T02:12:27.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.993+0000 7fdd50812800 10 removing user buckets index 2024-04-24T02:12:27.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.993+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:99 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbec970 con 0x5570cfba25a0 2024-04-24T02:12:27.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.994+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.1 v2:172.21.15.134:6804/1487076214 30 ==== osd_op_reply(99 testx$tenanteduser.buckets [delete] v30'3 uv3 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7fdd3c02e070 con 0x5570cfba25a0 2024-04-24T02:12:27.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.994+0000 7fdd50812800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-04-24T02:12:27.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.994+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify cookie 93943010084032 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbec8e0 con 0x5570cfba25a0 2024-04-24T02:12:27.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.994+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.1 v2:172.21.15.134:6804/1487076214 31 ==== watch-notify(notify (1) cookie 93943009838176 notify 128849018893 ret 0) ==== 217+0+0 (crc 0 0 0) 0x5570cfbc08e0 con 0x5570cfba25a0 2024-04-24T02:12:27.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.994+0000 7fdc2affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018893 cookie 93943009838176 notifier 4558 bl.length()=175 2024-04-24T02:12:27.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.994+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.1 v2:172.21.15.134:6804/1487076214 32 ==== osd_op_reply(100 notify.4 [notify cookie 93943010084032 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdd3c02e070 con 0x5570cfba25a0 2024-04-24T02:12:27.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.994+0000 7fdc2affd640 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fdc10003d60 con 0x5570cfba25a0 2024-04-24T02:12:27.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.994+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.1 v2:172.21.15.134:6804/1487076214 33 ==== watch-notify(notify_complete (2) cookie 93943010084032 notify 128849018893 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5570cfb6b030 con 0x5570cfba25a0 2024-04-24T02:12:27.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.994+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.1 v2:172.21.15.134:6804/1487076214 34 ==== osd_op_reply(101 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd3c02e070 con 0x5570cfba25a0 2024-04-24T02:12:27.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.994+0000 7fdd50812800 10 removing user index: testx$tenanteduser 2024-04-24T02:12:27.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.994+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:102 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbedd10 con 0x7fdd44031040 2024-04-24T02:12:27.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.997+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.0 v2:172.21.15.104:6800/2419146313 26 ==== osd_op_reply(102 testx$tenanteduser [call,call,delete] v30'8 uv8 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7fdd3c02e070 con 0x7fdd44031040 2024-04-24T02:12:27.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.997+0000 7fdd50812800 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-04-24T02:12:27.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.997+0000 7fdd50812800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-04-24T02:12:27.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.997+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify cookie 93943010083616 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbedd10 con 0x7fdd34086050 2024-04-24T02:12:27.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.997+0000 7fdd4c5ef640 1 -- 172.21.15.134:0/1409953896 <== osd.2 v2:172.21.15.134:6800/214480313 18 ==== watch-notify(notify (1) cookie 93943009835968 notify 128849018893 ret 0) ==== 209+0+0 (crc 0 0 0) 0x5570cfbbfb70 con 0x7fdd34086050 2024-04-24T02:12:27.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.997+0000 7fdc2a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018893 cookie 93943009835968 notifier 4558 bl.length()=167 2024-04-24T02:12:27.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.997+0000 7fdd4c5ef640 1 -- 172.21.15.134:0/1409953896 <== osd.2 v2:172.21.15.134:6800/214480313 19 ==== osd_op_reply(103 notify.3 [notify cookie 93943010083616 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdd44040040 con 0x7fdd34086050 2024-04-24T02:12:28.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.997+0000 7fdc2a7fc640 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fdb800032c0 con 0x7fdd34086050 2024-04-24T02:12:28.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.997+0000 7fdd4c5ef640 1 -- 172.21.15.134:0/1409953896 <== osd.2 v2:172.21.15.134:6800/214480313 20 ==== watch-notify(notify_complete (2) cookie 93943010083616 notify 128849018893 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5570cfbbe9f0 con 0x7fdd34086050 2024-04-24T02:12:28.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.997+0000 7fdd4c5ef640 1 -- 172.21.15.134:0/1409953896 <== osd.2 v2:172.21.15.134:6800/214480313 21 ==== osd_op_reply(104 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd44040040 con 0x7fdd34086050 2024-04-24T02:12:28.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.997+0000 7fdc01fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:28.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.997+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93943009848496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbee100 con 0x5570cfba25a0 2024-04-24T02:12:28.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.998+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.1 v2:172.21.15.134:6804/1487076214 35 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 93943009848496] v30'145 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdd3c02e070 con 0x5570cfba25a0 2024-04-24T02:12:28.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.998+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93943009824240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbb2cb0 con 0x7fdd34086050 2024-04-24T02:12:28.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.999+0000 7fdd4c5ef640 1 -- 172.21.15.134:0/1409953896 <== osd.2 v2:172.21.15.134:6800/214480313 22 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 93943009824240] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd44040040 con 0x7fdd34086050 2024-04-24T02:12:28.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.999+0000 7fdd50812800 20 remove_watcher() i=0 2024-04-24T02:12:28.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.999+0000 7fdd50812800 2 removed watcher, disabling cache 2024-04-24T02:12:28.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:27.999+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93943009828240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbb2cb0 con 0x5570cfba25a0 2024-04-24T02:12:28.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.000+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.1 v2:172.21.15.134:6804/1487076214 36 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 93943009828240] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd3c02e070 con 0x5570cfba25a0 2024-04-24T02:12:28.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.000+0000 7fdd50812800 20 remove_watcher() i=1 2024-04-24T02:12:28.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.000+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93943009829296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbb2cb0 con 0x5570cfba87f0 2024-04-24T02:12:28.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.001+0000 7fdd43fff640 1 -- 172.21.15.134:0/1409953896 <== osd.3 v2:172.21.15.134:6801/3585115521 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 93943009829296] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd3409f070 con 0x5570cfba87f0 2024-04-24T02:12:28.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.001+0000 7fdd50812800 20 remove_watcher() i=2 2024-04-24T02:12:28.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.001+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93943009835968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbb2cb0 con 0x7fdd34086050 2024-04-24T02:12:28.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.002+0000 7fdd4c5ef640 1 -- 172.21.15.134:0/1409953896 <== osd.2 v2:172.21.15.134:6800/214480313 23 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 93943009835968] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd44040040 con 0x7fdd34086050 2024-04-24T02:12:28.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.002+0000 7fdd50812800 20 remove_watcher() i=3 2024-04-24T02:12:28.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.002+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93943009838176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbb2cb0 con 0x5570cfba25a0 2024-04-24T02:12:28.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.004+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.1 v2:172.21.15.134:6804/1487076214 37 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 93943009838176] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd3c02e070 con 0x5570cfba25a0 2024-04-24T02:12:28.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.004+0000 7fdd50812800 20 remove_watcher() i=4 2024-04-24T02:12:28.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.004+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93943009842240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbb0460 con 0x7fdd44031040 2024-04-24T02:12:28.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.004+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.0 v2:172.21.15.104:6800/2419146313 27 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 93943009842240] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd3c02e070 con 0x7fdd44031040 2024-04-24T02:12:28.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.004+0000 7fdd50812800 20 remove_watcher() i=5 2024-04-24T02:12:28.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.004+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93943009839744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbb2cb0 con 0x7fdd44031040 2024-04-24T02:12:28.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.006+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.0 v2:172.21.15.104:6800/2419146313 28 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 93943009839744] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd3c02e070 con 0x7fdd44031040 2024-04-24T02:12:28.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.006+0000 7fdd50812800 20 remove_watcher() i=6 2024-04-24T02:12:28.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.006+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93943009847440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5570cfbb1440 con 0x7fdd44031040 2024-04-24T02:12:28.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.007+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 <== osd.0 v2:172.21.15.104:6800/2419146313 29 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 93943009847440] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd3c02e070 con 0x7fdd44031040 2024-04-24T02:12:28.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.007+0000 7fdd50812800 20 remove_watcher() i=7 2024-04-24T02:12:28.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.007+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fdd44031040 msgr2=0x7fdd44032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.007+0000 7fdd50812800 1 --2- 172.21.15.134:0/1409953896 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fdd44031040 0x7fdd44032940 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.007+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5570cfba25a0 msgr2=0x5570cfba4a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.007+0000 7fdd50812800 1 --2- 172.21.15.134:0/1409953896 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5570cfba25a0 0x5570cfba4a60 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.007+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fdd34086050 msgr2=0x7fdd3405c720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.007+0000 7fdd50812800 1 --2- 172.21.15.134:0/1409953896 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fdd34086050 0x7fdd3405c720 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.007+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5570cfba87f0 msgr2=0x5570cfbaabe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.007+0000 7fdd50812800 1 --2- 172.21.15.134:0/1409953896 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5570cfba87f0 0x5570cfbaabe0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.007+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdc14036950 msgr2=0x7fdc14038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.007+0000 7fdd50812800 1 --2- 172.21.15.134:0/1409953896 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdc14036950 0x7fdc14038e10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x5570cfb6c370 tx=0x7fdd4401f000 comp rx=0 tx=0).stop 2024-04-24T02:12:28.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.007+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5570cfb8f420 msgr2=0x5570cfb96a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.007+0000 7fdd4bdee640 1 -- 172.21.15.134:0/1409953896 reap_dead start 2024-04-24T02:12:28.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.007+0000 7fdd50812800 1 --2- 172.21.15.134:0/1409953896 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5570cfb8f420 0x5570cfb96a40 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fdd34052e80 tx=0x7fdd3408dad0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.007+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 shutdown_connections 2024-04-24T02:12:28.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.007+0000 7fdd50812800 1 --2- 172.21.15.134:0/1409953896 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5570cfb8f420 0x5570cfb96a40 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.007+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 >> 172.21.15.134:0/1409953896 conn(0x5570cfb8b780 msgr2=0x5570cfb88de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:28.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.007+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 shutdown_connections 2024-04-24T02:12:28.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.007+0000 7fdd50812800 1 -- 172.21.15.134:0/1409953896 wait complete. 2024-04-24T02:12:28.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.007+0000 7fdd50812800 1 -- 172.21.15.134:0/1554043970 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdc24036900 msgr2=0x7fdc24038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.007+0000 7fdd50812800 1 --2- 172.21.15.134:0/1554043970 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdc24036900 0x7fdc24038dc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x5570cfb700f0 tx=0x7fdd44005840 comp rx=0 tx=0).stop 2024-04-24T02:12:28.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.007+0000 7fdd50812800 1 -- 172.21.15.134:0/1554043970 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5570cfb684d0 msgr2=0x5570cfb66940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.007+0000 7fdd50812800 1 --2- 172.21.15.134:0/1554043970 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5570cfb684d0 0x5570cfb66940 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fdd34000c00 tx=0x7fdd34002fb0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.008+0000 7fdd50812800 1 -- 172.21.15.134:0/1554043970 shutdown_connections 2024-04-24T02:12:28.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.008+0000 7fdd50812800 1 --2- 172.21.15.134:0/1554043970 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdc24036900 0x7fdc24038dc0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.008+0000 7fdd50812800 1 --2- 172.21.15.134:0/1554043970 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5570cfb684d0 0x5570cfb66940 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.008+0000 7fdd50812800 1 -- 172.21.15.134:0/1554043970 >> 172.21.15.134:0/1554043970 conn(0x5570cfb740a0 msgr2=0x5570cfb744a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:28.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.008+0000 7fdd50812800 1 -- 172.21.15.134:0/1554043970 shutdown_connections 2024-04-24T02:12:28.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.008+0000 7fdd50812800 1 -- 172.21.15.134:0/1554043970 wait complete. 2024-04-24T02:12:28.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.008+0000 7fdd50812800 1 -- 172.21.15.134:0/240114258 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5570cfa721d0 msgr2=0x5570cfb6ee50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.008+0000 7fdd50812800 1 --2- 172.21.15.134:0/240114258 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5570cfa721d0 0x5570cfb6ee50 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.008+0000 7fdd50812800 1 -- 172.21.15.134:0/240114258 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdc34036900 msgr2=0x7fdc34038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.008+0000 7fdd50812800 1 --2- 172.21.15.134:0/240114258 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdc34036900 0x7fdc34038dc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdd34054000 tx=0x7fdd3404e000 comp rx=0 tx=0).stop 2024-04-24T02:12:28.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.008+0000 7fdd50812800 1 -- 172.21.15.134:0/240114258 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5570cfa6dd40 msgr2=0x5570cf9e2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.008+0000 7fdd50812800 1 --2- 172.21.15.134:0/240114258 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5570cfa6dd40 0x5570cf9e2050 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x5570cfb5fd80 tx=0x7fdd3c000ed0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.008+0000 7fdd50812800 1 -- 172.21.15.134:0/240114258 shutdown_connections 2024-04-24T02:12:28.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.008+0000 7fdd50812800 1 --2- 172.21.15.134:0/240114258 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5570cfa721d0 0x5570cfb6ee50 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.008+0000 7fdd50812800 1 --2- 172.21.15.134:0/240114258 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdc34036900 0x7fdc34038dc0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.008+0000 7fdd50812800 1 --2- 172.21.15.134:0/240114258 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5570cfa6dd40 0x5570cf9e2050 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.008+0000 7fdd50812800 1 -- 172.21.15.134:0/240114258 >> 172.21.15.134:0/240114258 conn(0x5570cfa693a0 msgr2=0x5570cfb591d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:28.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.008+0000 7fdd50812800 1 -- 172.21.15.134:0/240114258 shutdown_connections 2024-04-24T02:12:28.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.008+0000 7fdd50812800 1 -- 172.21.15.134:0/240114258 wait complete. 2024-04-24T02:12:28.022 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-04-24T02:12:28.024 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-04-24T02:12:28.027 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T02:12:28.027 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-04-24T02:12:28.027 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-04-24T02:12:28.028 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-04-24T02:12:28.072 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:28.072 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:28.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.073+0000 7f4e81946800 1 Processor -- start 2024-04-24T02:12:28.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.073+0000 7f4e81946800 1 -- start start 2024-04-24T02:12:28.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.073+0000 7f4e81946800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55f967b4aef0 0x55f967b4b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.073+0000 7f4e81946800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f967a09d40 con 0x55f967b4c150 2024-04-24T02:12:28.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.073+0000 7f4e81946800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55f9679dc4d0 con 0x55f967b4aef0 2024-04-24T02:12:28.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.073+0000 7f4e7f44c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55f967b4aef0 0x55f967b4b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.073+0000 7f4e7f44c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55f967b4aef0 0x55f967b4b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56592/0 (socket says 172.21.15.134:56592) 2024-04-24T02:12:28.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.073+0000 7f4e7ec4b640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55f967b4c150 0x55f967b4c5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:55338/0 (socket says 172.21.15.134:55338) 2024-04-24T02:12:28.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.073+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1431823439 learned_addr learned my addr 172.21.15.134:0/1431823439 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:28.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.074+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1431823439 >> v1:172.21.15.104:6789/0 conn(0x55f967b4c150 legacy=0x55f967b4c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.074+0000 7f4e7e44a640 1 -- 172.21.15.134:0/1431823439 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2276142837 0 0) 0x55f967a09d40 con 0x55f967b4c150 2024-04-24T02:12:28.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.074+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1431823439 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f967a08590 con 0x55f967b4aef0 2024-04-24T02:12:28.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.075+0000 7f4e7f44c640 1 --2- 172.21.15.134:0/1431823439 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f967b4aef0 0x55f967b4b310 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f4e7800a520 tx=0x7f4e7801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5989f83f7c265cd server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.076+0000 7f4e7e44a640 1 -- 172.21.15.134:0/1431823439 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e78057070 con 0x55f967b4aef0 2024-04-24T02:12:28.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.076+0000 7f4e7e44a640 1 -- 172.21.15.134:0/1431823439 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e78052570 con 0x55f967b4aef0 2024-04-24T02:12:28.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.076+0000 7f4e7e44a640 1 -- 172.21.15.134:0/1431823439 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e7804ae60 con 0x55f967b4aef0 2024-04-24T02:12:28.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.076+0000 7f4e81946800 1 -- 172.21.15.134:0/1431823439 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f967b4aef0 msgr2=0x55f967b4b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.076+0000 7f4e81946800 1 --2- 172.21.15.134:0/1431823439 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f967b4aef0 0x55f967b4b310 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f4e7800a520 tx=0x7f4e7801d010 comp rx=0 tx=0).stop 2024-04-24T02:12:28.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.076+0000 7f4e81946800 1 -- 172.21.15.134:0/1431823439 shutdown_connections 2024-04-24T02:12:28.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.076+0000 7f4e81946800 1 --2- 172.21.15.134:0/1431823439 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f967b4aef0 0x55f967b4b310 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.076+0000 7f4e81946800 1 -- 172.21.15.134:0/1431823439 >> 172.21.15.134:0/1431823439 conn(0x55f967b464f0 msgr2=0x55f967b48910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:28.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.076+0000 7f4e81946800 1 -- 172.21.15.134:0/1431823439 shutdown_connections 2024-04-24T02:12:28.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.076+0000 7f4e81946800 1 -- 172.21.15.134:0/1431823439 wait complete. 2024-04-24T02:12:28.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.088+0000 7f4e81946800 1 Processor -- start 2024-04-24T02:12:28.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.088+0000 7f4e81946800 1 -- start start 2024-04-24T02:12:28.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.088+0000 7f4e81946800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f967b4aef0 0x55f967c3c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.088+0000 7f4e81946800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55f967a963b0 con 0x55f967b4aef0 2024-04-24T02:12:28.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.088+0000 7f4e7f44c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f967b4aef0 0x55f967c3c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.088+0000 7f4e7f44c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f967b4aef0 0x55f967c3c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56608/0 (socket says 172.21.15.134:56608) 2024-04-24T02:12:28.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.088+0000 7f4e7f44c640 1 -- 172.21.15.134:0/3522596804 learned_addr learned my addr 172.21.15.134:0/3522596804 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:28.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.088+0000 7f4e7f44c640 1 -- 172.21.15.134:0/3522596804 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f967c3c8e0 con 0x55f967b4aef0 2024-04-24T02:12:28.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.089+0000 7f4e7f44c640 1 --2- 172.21.15.134:0/3522596804 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f967b4aef0 0x55f967c3c310 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f4e78055040 tx=0x7f4e7804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2de70016f9d27e08 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.089+0000 7f4d6d60a640 1 -- 172.21.15.134:0/3522596804 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e78062070 con 0x55f967b4aef0 2024-04-24T02:12:28.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.089+0000 7f4d6d60a640 1 -- 172.21.15.134:0/3522596804 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e78052720 con 0x55f967b4aef0 2024-04-24T02:12:28.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.089+0000 7f4d6d60a640 1 -- 172.21.15.134:0/3522596804 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e78057040 con 0x55f967b4aef0 2024-04-24T02:12:28.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.090+0000 7f4e81946800 1 -- 172.21.15.134:0/3522596804 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f967b4aef0 msgr2=0x55f967c3c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.090+0000 7f4e81946800 1 --2- 172.21.15.134:0/3522596804 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f967b4aef0 0x55f967c3c310 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f4e78055040 tx=0x7f4e7804c000 comp rx=0 tx=0).stop 2024-04-24T02:12:28.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.090+0000 7f4e81946800 1 -- 172.21.15.134:0/3522596804 shutdown_connections 2024-04-24T02:12:28.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.090+0000 7f4e81946800 1 --2- 172.21.15.134:0/3522596804 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f967b4aef0 0x55f967c3c310 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.090+0000 7f4e81946800 1 -- 172.21.15.134:0/3522596804 >> 172.21.15.134:0/3522596804 conn(0x55f967b464f0 msgr2=0x55f967c37c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:28.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.090+0000 7f4e81946800 1 -- 172.21.15.134:0/3522596804 shutdown_connections 2024-04-24T02:12:28.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.090+0000 7f4e81946800 1 -- 172.21.15.134:0/3522596804 wait complete. 2024-04-24T02:12:28.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.090+0000 7f4e81946800 1 Processor -- start 2024-04-24T02:12:28.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.090+0000 7f4e81946800 1 -- start start 2024-04-24T02:12:28.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.090+0000 7f4e81946800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f967b4aef0 0x55f967c43d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.090+0000 7f4e81946800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55f967b545f0 con 0x55f967b4aef0 2024-04-24T02:12:28.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.090+0000 7f4e7f44c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f967b4aef0 0x55f967c43d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.090+0000 7f4e7f44c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f967b4aef0 0x55f967c43d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56622/0 (socket says 172.21.15.134:56622) 2024-04-24T02:12:28.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.090+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1632897294 learned_addr learned my addr 172.21.15.134:0/1632897294 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:28.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.091+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1632897294 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f967c442a0 con 0x55f967b4aef0 2024-04-24T02:12:28.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.091+0000 7f4e7f44c640 1 --2- 172.21.15.134:0/1632897294 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f967b4aef0 0x55f967c43d60 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f4e78005400 tx=0x7f4e78002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.091+0000 7f4d6be07640 1 -- 172.21.15.134:0/1632897294 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e78057050 con 0x55f967b4aef0 2024-04-24T02:12:28.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.091+0000 7f4d6be07640 1 -- 172.21.15.134:0/1632897294 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e78052e40 con 0x55f967b4aef0 2024-04-24T02:12:28.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.091+0000 7f4e81946800 1 -- 172.21.15.134:0/1632897294 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f967c44530 con 0x55f967b4aef0 2024-04-24T02:12:28.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.091+0000 7f4d6be07640 1 -- 172.21.15.134:0/1632897294 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e78062040 con 0x55f967b4aef0 2024-04-24T02:12:28.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.091+0000 7f4e81946800 1 -- 172.21.15.134:0/1632897294 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f967c47140 con 0x55f967b4aef0 2024-04-24T02:12:28.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.092+0000 7f4d6be07640 1 -- 172.21.15.134:0/1632897294 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4e78067580 con 0x55f967b4aef0 2024-04-24T02:12:28.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.092+0000 7f4d6be07640 1 --2- 172.21.15.134:0/1632897294 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4d64036950 0x7f4d64038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.092+0000 7f4d6be07640 1 -- 172.21.15.134:0/1632897294 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f4e7808dbb0 con 0x55f967b4aef0 2024-04-24T02:12:28.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.092+0000 7f4e7ec4b640 1 --2- 172.21.15.134:0/1632897294 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4d64036950 0x7f4d64038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.092+0000 7f4e81946800 1 --2- 172.21.15.134:0/1632897294 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f967b4c150 0x55f967c4af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.092+0000 7f4e81946800 1 -- 172.21.15.134:0/1632897294 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f967c4b480 con 0x55f967b4c150 2024-04-24T02:12:28.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.092+0000 7f4e7fc4d640 1 --2- 172.21.15.134:0/1632897294 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f967b4c150 0x55f967c4af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.092+0000 7f4e7ec4b640 1 --2- 172.21.15.134:0/1632897294 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4d64036950 0x7f4d64038e10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4e68000c00 tx=0x7f4e680013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.092+0000 7f4e7fc4d640 1 --2- 172.21.15.134:0/1632897294 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f967b4c150 0x55f967c4af00 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.093+0000 7f4e7fc4d640 1 -- 172.21.15.134:0/1632897294 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4e7000a4a0 con 0x55f967b4c150 2024-04-24T02:12:28.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.093+0000 7f4e81946800 1 -- 172.21.15.134:0/1632897294 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f967c484b0 con 0x55f967b4c150 2024-04-24T02:12:28.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.093+0000 7f4e7fc4d640 1 -- 172.21.15.134:0/1632897294 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4e7000a4a0 con 0x55f967b4c150 2024-04-24T02:12:28.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.093+0000 7f4e81946800 1 -- 172.21.15.134:0/1632897294 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f967c4d280 con 0x55f967b4c150 2024-04-24T02:12:28.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.093+0000 7f4e7fc4d640 1 -- 172.21.15.134:0/1632897294 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4e7000a4a0 con 0x55f967b4c150 2024-04-24T02:12:28.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.093+0000 7f4e81946800 1 -- 172.21.15.134:0/1632897294 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f967c4c5c0 con 0x55f967b4c150 2024-04-24T02:12:28.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.094+0000 7f4e7fc4d640 1 -- 172.21.15.134:0/1632897294 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4e7000a4a0 con 0x55f967b4c150 2024-04-24T02:12:28.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.094+0000 7f4e81946800 1 -- 172.21.15.134:0/1632897294 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f967c4c9e0 con 0x55f967b4c150 2024-04-24T02:12:28.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.094+0000 7f4e7fc4d640 1 -- 172.21.15.134:0/1632897294 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4e7000a4a0 con 0x55f967b4c150 2024-04-24T02:12:28.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.094+0000 7f4e81946800 1 Processor -- start 2024-04-24T02:12:28.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.094+0000 7f4e81946800 1 -- start start 2024-04-24T02:12:28.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.094+0000 7f4e81946800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f967ac03b0 0x55f967abe820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.094+0000 7f4e81946800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55f967a3c6b0 con 0x55f967ac03b0 2024-04-24T02:12:28.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.095+0000 7f4e7ec4b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f967ac03b0 0x55f967abe820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.095+0000 7f4e7ec4b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f967ac03b0 0x55f967abe820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56638/0 (socket says 172.21.15.134:56638) 2024-04-24T02:12:28.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.095+0000 7f4e7ec4b640 1 -- 172.21.15.134:0/3077467027 learned_addr learned my addr 172.21.15.134:0/3077467027 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:28.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.095+0000 7f4e7ec4b640 1 -- 172.21.15.134:0/3077467027 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f967abed60 con 0x55f967ac03b0 2024-04-24T02:12:28.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.095+0000 7f4e7ec4b640 1 --2- 172.21.15.134:0/3077467027 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f967ac03b0 0x55f967abe820 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f4e6800e610 tx=0x7f4e6800ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.095+0000 7f4d69602640 1 -- 172.21.15.134:0/3077467027 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e68022070 con 0x55f967ac03b0 2024-04-24T02:12:28.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.095+0000 7f4d69602640 1 -- 172.21.15.134:0/3077467027 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e68009050 con 0x55f967ac03b0 2024-04-24T02:12:28.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.095+0000 7f4d69602640 1 -- 172.21.15.134:0/3077467027 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e6800d500 con 0x55f967ac03b0 2024-04-24T02:12:28.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.095+0000 7f4e81946800 1 -- 172.21.15.134:0/3077467027 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f967abeff0 con 0x55f967ac03b0 2024-04-24T02:12:28.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.095+0000 7f4e81946800 1 -- 172.21.15.134:0/3077467027 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f967abf4f0 con 0x55f967ac03b0 2024-04-24T02:12:28.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.096+0000 7f4d69602640 1 -- 172.21.15.134:0/3077467027 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4e68025070 con 0x55f967ac03b0 2024-04-24T02:12:28.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.096+0000 7f4d69602640 1 --2- 172.21.15.134:0/3077467027 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4d58036950 0x7f4d58038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.096+0000 7f4d69602640 1 -- 172.21.15.134:0/3077467027 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f4e6804d920 con 0x55f967ac03b0 2024-04-24T02:12:28.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.096+0000 7f4e7fc4d640 1 --2- 172.21.15.134:0/3077467027 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4d58036950 0x7f4d58038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.096+0000 7f4e81946800 1 Processor -- start 2024-04-24T02:12:28.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.096+0000 7f4e81946800 1 -- start start 2024-04-24T02:12:28.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.096+0000 7f4e7fc4d640 1 --2- 172.21.15.134:0/3077467027 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4d58036950 0x7f4d58038e10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x55f967c4c960 tx=0x7f4e70005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.097+0000 7f4e81946800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f967c6b5f0 0x55f967c6ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.097+0000 7f4e81946800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55f967c3cba0 con 0x55f967c6b5f0 2024-04-24T02:12:28.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.097+0000 7f4e7ec4b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f967c6b5f0 0x55f967c6ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.097+0000 7f4e7ec4b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f967c6b5f0 0x55f967c6ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56642/0 (socket says 172.21.15.134:56642) 2024-04-24T02:12:28.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.097+0000 7f4e7ec4b640 1 -- 172.21.15.134:0/888332711 learned_addr learned my addr 172.21.15.134:0/888332711 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:28.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.097+0000 7f4e7ec4b640 1 -- 172.21.15.134:0/888332711 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f967c6bfe0 con 0x55f967c6b5f0 2024-04-24T02:12:28.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.097+0000 7f4e7ec4b640 1 --2- 172.21.15.134:0/888332711 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f967c6b5f0 0x55f967c6ba10 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f4e68026fd0 tx=0x7f4e68026680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d87ea04c60a4ea2c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.097+0000 7f4d62ffd640 1 -- 172.21.15.134:0/888332711 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e6801ac20 con 0x55f967c6b5f0 2024-04-24T02:12:28.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.097+0000 7f4d62ffd640 1 -- 172.21.15.134:0/888332711 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e6801adc0 con 0x55f967c6b5f0 2024-04-24T02:12:28.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.097+0000 7f4d62ffd640 1 -- 172.21.15.134:0/888332711 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e680254d0 con 0x55f967c6b5f0 2024-04-24T02:12:28.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.098+0000 7f4e81946800 1 -- 172.21.15.134:0/888332711 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f967c6b5f0 msgr2=0x55f967c6ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.098+0000 7f4e81946800 1 --2- 172.21.15.134:0/888332711 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f967c6b5f0 0x55f967c6ba10 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f4e68026fd0 tx=0x7f4e68026680 comp rx=0 tx=0).stop 2024-04-24T02:12:28.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.098+0000 7f4e81946800 1 -- 172.21.15.134:0/888332711 shutdown_connections 2024-04-24T02:12:28.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.098+0000 7f4e81946800 1 --2- 172.21.15.134:0/888332711 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f967c6b5f0 0x55f967c6ba10 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.098+0000 7f4e81946800 1 -- 172.21.15.134:0/888332711 >> 172.21.15.134:0/888332711 conn(0x55f967c67950 msgr2=0x55f967c659b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:28.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.098+0000 7f4e81946800 1 -- 172.21.15.134:0/888332711 shutdown_connections 2024-04-24T02:12:28.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.098+0000 7f4e81946800 1 -- 172.21.15.134:0/888332711 wait complete. 2024-04-24T02:12:28.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.098+0000 7f4e81946800 1 Processor -- start 2024-04-24T02:12:28.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.098+0000 7f4e81946800 1 -- start start 2024-04-24T02:12:28.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.098+0000 7f4e81946800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f967c6b5f0 0x55f967c72c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.098+0000 7f4e81946800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55f967c6c750 con 0x55f967c6b5f0 2024-04-24T02:12:28.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.098+0000 7f4e7ec4b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f967c6b5f0 0x55f967c72c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.098+0000 7f4e7ec4b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f967c6b5f0 0x55f967c72c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56644/0 (socket says 172.21.15.134:56644) 2024-04-24T02:12:28.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.098+0000 7f4e7ec4b640 1 -- 172.21.15.134:0/1193865655 learned_addr learned my addr 172.21.15.134:0/1193865655 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:28.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.099+0000 7f4e7ec4b640 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f967c731a0 con 0x55f967c6b5f0 2024-04-24T02:12:28.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.099+0000 7f4e7ec4b640 1 --2- 172.21.15.134:0/1193865655 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f967c6b5f0 0x55f967c72c60 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f4e680266c0 tx=0x7f4e6804be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.099+0000 7f4d617fa640 1 -- 172.21.15.134:0/1193865655 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e6800d8b0 con 0x55f967c6b5f0 2024-04-24T02:12:28.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.099+0000 7f4d617fa640 1 -- 172.21.15.134:0/1193865655 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e6800da50 con 0x55f967c6b5f0 2024-04-24T02:12:28.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.099+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f967c73430 con 0x55f967c6b5f0 2024-04-24T02:12:28.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.099+0000 7f4d617fa640 1 -- 172.21.15.134:0/1193865655 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e6804d220 con 0x55f967c6b5f0 2024-04-24T02:12:28.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.099+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f967c760e0 con 0x55f967c6b5f0 2024-04-24T02:12:28.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.100+0000 7f4d617fa640 1 -- 172.21.15.134:0/1193865655 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4e6804d3c0 con 0x55f967c6b5f0 2024-04-24T02:12:28.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.100+0000 7f4d617fa640 1 --2- 172.21.15.134:0/1193865655 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4d48036950 0x7f4d48038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.100+0000 7f4d617fa640 1 -- 172.21.15.134:0/1193865655 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f4e68036af0 con 0x55f967c6b5f0 2024-04-24T02:12:28.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.100+0000 7f4e7fc4d640 1 --2- 172.21.15.134:0/1193865655 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4d48036950 0x7f4d48038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.100+0000 7f4e7fc4d640 1 --2- 172.21.15.134:0/1193865655 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4d48036950 0x7f4d48038e10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x55f967c4c0e0 tx=0x7f4e7001f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.100+0000 7f4e81946800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.100+0000 7f4e81946800 1 --2- 172.21.15.134:0/1193865655 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f967c7e760 0x55f967c80c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.100+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f967c81370 con 0x55f967c7e760 2024-04-24T02:12:28.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.100+0000 7f4e7f44c640 1 --2- 172.21.15.134:0/1193865655 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f967c7e760 0x55f967c80c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.101+0000 7f4e7f44c640 1 --2- 172.21.15.134:0/1193865655 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f967c7e760 0x55f967c80c20 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.101+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4e78076070 con 0x55f967c7e760 2024-04-24T02:12:28.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.101+0000 7f4e81946800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:28.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.101+0000 7f4e81946800 20 realm 2024-04-24T02:12:28.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.101+0000 7f4e81946800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.101+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f967c81780 con 0x55f967c7e760 2024-04-24T02:12:28.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.101+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4e78076070 con 0x55f967c7e760 2024-04-24T02:12:28.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.101+0000 7f4e81946800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:28.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.101+0000 7f4e81946800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:28.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.101+0000 7f4e81946800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.101+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f967c82050 con 0x55f967c7e760 2024-04-24T02:12:28.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.101+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4e78076070 con 0x55f967c7e760 2024-04-24T02:12:28.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.101+0000 7f4e81946800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:28.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.101+0000 7f4e81946800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.101+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f967c823f0 con 0x55f967c7e760 2024-04-24T02:12:28.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.102+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4e78076070 con 0x55f967c7e760 2024-04-24T02:12:28.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.102+0000 7f4e81946800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:28.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.102+0000 7f4e81946800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.102+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f967c82c40 con 0x55f967c7e760 2024-04-24T02:12:28.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.102+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4e78076070 con 0x55f967c7e760 2024-04-24T02:12:28.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.102+0000 7f4e81946800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:28.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.102+0000 7f4e81946800 20 searching for the correct realm 2024-04-24T02:12:28.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.102+0000 7f4e81946800 1 --2- 172.21.15.134:0/1193865655 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55f967c849b0 0x55f967c86da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.102+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f967c873b0 con 0x55f967c849b0 2024-04-24T02:12:28.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.102+0000 7f4e7ec4b640 1 --2- 172.21.15.134:0/1193865655 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55f967c849b0 0x55f967c86da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.102+0000 7f4e7ec4b640 1 --2- 172.21.15.134:0/1193865655 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55f967c849b0 0x55f967c86da0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.103+0000 7f4e7ec4b640 1 -- 172.21.15.134:0/1193865655 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e68024030 con 0x55f967c849b0 2024-04-24T02:12:28.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.103+0000 7f4e7ec4b640 1 --2- 172.21.15.134:0/1193865655 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f4e68027060 0x7f4e68027440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.103+0000 7f4e7ec4b640 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f967c873b0 con 0x7f4e68027060 2024-04-24T02:12:28.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.103+0000 7f4e7fc4d640 1 --2- 172.21.15.134:0/1193865655 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f4e68027060 0x7f4e68027440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.103+0000 7f4e7fc4d640 1 --2- 172.21.15.134:0/1193865655 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f4e68027060 0x7f4e68027440 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.103+0000 7f4e7fc4d640 1 -- 172.21.15.134:0/1193865655 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e7001f070 con 0x7f4e68027060 2024-04-24T02:12:28.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.103+0000 7f4e7fc4d640 1 --2- 172.21.15.134:0/1193865655 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f4e70031040 0x7f4e70032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.103+0000 7f4e7fc4d640 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f967c873b0 con 0x7f4e70031040 2024-04-24T02:12:28.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.104+0000 7f4e7f44c640 1 --2- 172.21.15.134:0/1193865655 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f4e70031040 0x7f4e70032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.104+0000 7f4e7f44c640 1 --2- 172.21.15.134:0/1193865655 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f4e70031040 0x7f4e70032940 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.104+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e78076070 con 0x7f4e70031040 2024-04-24T02:12:28.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.104+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f967c873b0 con 0x55f967c7e760 2024-04-24T02:12:28.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.104+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e78076070 con 0x55f967c7e760 2024-04-24T02:12:28.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.104+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f967c873b0 con 0x55f967c7e760 2024-04-24T02:12:28.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.105+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4e78076070 con 0x55f967c7e760 2024-04-24T02:12:28.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.105+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f967c873b0 con 0x7f4e70031040 2024-04-24T02:12:28.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.105+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e78076070 con 0x7f4e70031040 2024-04-24T02:12:28.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.105+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f967c873b0 con 0x7f4e70031040 2024-04-24T02:12:28.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.105+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e78076070 con 0x7f4e70031040 2024-04-24T02:12:28.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.105+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f967c873b0 con 0x7f4e68027060 2024-04-24T02:12:28.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.105+0000 7f4e7fc4d640 1 -- 172.21.15.134:0/1193865655 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e7001f070 con 0x7f4e68027060 2024-04-24T02:12:28.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.105+0000 7f4e7fc4d640 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f967c873b0 con 0x55f967c849b0 2024-04-24T02:12:28.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.105+0000 7f4e7ec4b640 1 -- 172.21.15.134:0/1193865655 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e68024030 con 0x55f967c849b0 2024-04-24T02:12:28.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.105+0000 7f4e7ec4b640 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f967c873b0 con 0x55f967c7e760 2024-04-24T02:12:28.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.106+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e78076070 con 0x55f967c7e760 2024-04-24T02:12:28.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.106+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f967c873b0 con 0x7f4e70031040 2024-04-24T02:12:28.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.106+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e78076070 con 0x7f4e70031040 2024-04-24T02:12:28.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.106+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f967c873b0 con 0x55f967c7e760 2024-04-24T02:12:28.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.106+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e78076070 con 0x55f967c7e760 2024-04-24T02:12:28.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.106+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f967c873b0 con 0x7f4e68027060 2024-04-24T02:12:28.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.107+0000 7f4e7fc4d640 1 -- 172.21.15.134:0/1193865655 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4e7001f070 con 0x7f4e68027060 2024-04-24T02:12:28.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.107+0000 7f4e7fc4d640 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f967c873b0 con 0x55f967c849b0 2024-04-24T02:12:28.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.107+0000 7f4e7ec4b640 1 -- 172.21.15.134:0/1193865655 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e68024030 con 0x55f967c849b0 2024-04-24T02:12:28.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.107+0000 7f4e7ec4b640 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f967c873b0 con 0x55f967c849b0 2024-04-24T02:12:28.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.107+0000 7f4e7ec4b640 1 -- 172.21.15.134:0/1193865655 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e68024030 con 0x55f967c849b0 2024-04-24T02:12:28.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.107+0000 7f4e7ec4b640 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f967c873b0 con 0x7f4e70031040 2024-04-24T02:12:28.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.108+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e78076070 con 0x7f4e70031040 2024-04-24T02:12:28.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.108+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f967c873b0 con 0x55f967c849b0 2024-04-24T02:12:28.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.108+0000 7f4e7ec4b640 1 -- 172.21.15.134:0/1193865655 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e68024030 con 0x55f967c849b0 2024-04-24T02:12:28.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.108+0000 7f4e7ec4b640 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f967c873b0 con 0x55f967c849b0 2024-04-24T02:12:28.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.108+0000 7f4e7ec4b640 1 -- 172.21.15.134:0/1193865655 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e68024030 con 0x55f967c849b0 2024-04-24T02:12:28.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.108+0000 7f4e7ec4b640 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f967c873b0 con 0x55f967c7e760 2024-04-24T02:12:28.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.108+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e78076070 con 0x55f967c7e760 2024-04-24T02:12:28.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.108+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f967c873b0 con 0x55f967c7e760 2024-04-24T02:12:28.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.108+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f4e78076070 con 0x55f967c7e760 2024-04-24T02:12:28.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.108+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f967c873b0 con 0x7f4e70031040 2024-04-24T02:12:28.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.109+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e78076070 con 0x7f4e70031040 2024-04-24T02:12:28.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.109+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f967c873b0 con 0x55f967c849b0 2024-04-24T02:12:28.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.109+0000 7f4e7ec4b640 1 -- 172.21.15.134:0/1193865655 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e68024030 con 0x55f967c849b0 2024-04-24T02:12:28.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.109+0000 7f4e7ec4b640 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f967c873b0 con 0x7f4e68027060 2024-04-24T02:12:28.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.109+0000 7f4e7fc4d640 1 -- 172.21.15.134:0/1193865655 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e7001f070 con 0x7f4e68027060 2024-04-24T02:12:28.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.109+0000 7f4e7fc4d640 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f967c873b0 con 0x55f967c7e760 2024-04-24T02:12:28.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.109+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e78076070 con 0x55f967c7e760 2024-04-24T02:12:28.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.109+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f967c873b0 con 0x7f4e70031040 2024-04-24T02:12:28.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.110+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e78076070 con 0x7f4e70031040 2024-04-24T02:12:28.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.110+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f967c873b0 con 0x55f967c849b0 2024-04-24T02:12:28.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.110+0000 7f4e7ec4b640 1 -- 172.21.15.134:0/1193865655 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e68024030 con 0x55f967c849b0 2024-04-24T02:12:28.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.110+0000 7f4e7ec4b640 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f967c873b0 con 0x7f4e70031040 2024-04-24T02:12:28.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.110+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e78076070 con 0x7f4e70031040 2024-04-24T02:12:28.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.110+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f967c873b0 con 0x7f4e68027060 2024-04-24T02:12:28.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.111+0000 7f4e7fc4d640 1 -- 172.21.15.134:0/1193865655 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e7001f070 con 0x7f4e68027060 2024-04-24T02:12:28.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.111+0000 7f4e7fc4d640 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f967c873b0 con 0x55f967c849b0 2024-04-24T02:12:28.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.111+0000 7f4e7ec4b640 1 -- 172.21.15.134:0/1193865655 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e68024030 con 0x55f967c849b0 2024-04-24T02:12:28.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.111+0000 7f4e7ec4b640 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f967c873b0 con 0x7f4e70031040 2024-04-24T02:12:28.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.111+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e78076070 con 0x7f4e70031040 2024-04-24T02:12:28.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.111+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f967c873b0 con 0x55f967c7e760 2024-04-24T02:12:28.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.111+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4e78076070 con 0x55f967c7e760 2024-04-24T02:12:28.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.111+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f967c873b0 con 0x7f4e68027060 2024-04-24T02:12:28.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.112+0000 7f4e7fc4d640 1 -- 172.21.15.134:0/1193865655 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e7001f070 con 0x7f4e68027060 2024-04-24T02:12:28.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.112+0000 7f4e81946800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:28.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.112+0000 7f4e81946800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:28.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.112+0000 7f4e81946800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:28.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.112+0000 7f4e81946800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:28.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.112+0000 7f4e81946800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:28.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.112+0000 7f4e81946800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:28.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.112+0000 7f4e81946800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.112+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f967c83590 con 0x55f967c7e760 2024-04-24T02:12:28.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.112+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4e78076070 con 0x55f967c7e760 2024-04-24T02:12:28.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.112+0000 7f4e81946800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:28.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.112+0000 7f4e81946800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.112+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f967c83e30 con 0x55f967c7e760 2024-04-24T02:12:28.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.112+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4e78076070 con 0x55f967c7e760 2024-04-24T02:12:28.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.112+0000 7f4e81946800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:28.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.112+0000 7f4e81946800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.112+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f967c83e30 con 0x55f967c7e760 2024-04-24T02:12:28.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.112+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4e78076070 con 0x55f967c7e760 2024-04-24T02:12:28.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.112+0000 7f4e81946800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:28.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.112+0000 7f4e81946800 20 zone default found 2024-04-24T02:12:28.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.112+0000 7f4e81946800 4 Realm: () 2024-04-24T02:12:28.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.112+0000 7f4e81946800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:28.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.112+0000 7f4e81946800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:28.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.112+0000 7f4e81946800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:28.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.112+0000 7f4e81946800 20 zonegroup default 2024-04-24T02:12:28.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.112+0000 7f4e81946800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.112+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f967c87810 con 0x7f4e70031040 2024-04-24T02:12:28.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.113+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4e78076070 con 0x7f4e70031040 2024-04-24T02:12:28.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.113+0000 7f4e81946800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:28.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.113+0000 7f4e81946800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.113+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f967c891f0 con 0x55f967c849b0 2024-04-24T02:12:28.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.113+0000 7f4e7ec4b640 1 -- 172.21.15.134:0/1193865655 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4e68024030 con 0x55f967c849b0 2024-04-24T02:12:28.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.113+0000 7f4e81946800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:28.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.113+0000 7f4e81946800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.113+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f967c89730 con 0x55f967c849b0 2024-04-24T02:12:28.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.113+0000 7f4e7ec4b640 1 -- 172.21.15.134:0/1193865655 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4e68024030 con 0x55f967c849b0 2024-04-24T02:12:28.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.113+0000 7f4e81946800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:28.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.113+0000 7f4e81946800 20 started sync module instance, tier type = 2024-04-24T02:12:28.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.113+0000 7f4e81946800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:28.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.113+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967c88690 con 0x7f4e68027060 2024-04-24T02:12:28.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.114+0000 7f4e7fc4d640 1 -- 172.21.15.134:0/1193865655 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e70040040 con 0x7f4e68027060 2024-04-24T02:12:28.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.114+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94529676413568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967c8a040 con 0x7f4e68027060 2024-04-24T02:12:28.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.114+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967c8a890 con 0x55f967c7e760 2024-04-24T02:12:28.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.115+0000 7f4e7fc4d640 1 -- 172.21.15.134:0/1193865655 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94529676413568] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e70040040 con 0x7f4e68027060 2024-04-24T02:12:28.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.116+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e78076070 con 0x55f967c7e760 2024-04-24T02:12:28.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.116+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94529676417936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967c8a4e0 con 0x55f967c7e760 2024-04-24T02:12:28.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.116+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967c8afd0 con 0x55f967c849b0 2024-04-24T02:12:28.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.117+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94529676417936] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e78076070 con 0x55f967c7e760 2024-04-24T02:12:28.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.117+0000 7f4e7ec4b640 1 -- 172.21.15.134:0/1193865655 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e68024030 con 0x55f967c849b0 2024-04-24T02:12:28.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.117+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94529676421792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967c8b3c0 con 0x55f967c849b0 2024-04-24T02:12:28.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.117+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967c8bdc0 con 0x7f4e68027060 2024-04-24T02:12:28.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.118+0000 7f4e7fc4d640 1 -- 172.21.15.134:0/1193865655 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e70040040 con 0x7f4e68027060 2024-04-24T02:12:28.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.118+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94529676425424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967c8c660 con 0x7f4e68027060 2024-04-24T02:12:28.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.118+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967c8d140 con 0x55f967c7e760 2024-04-24T02:12:28.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.118+0000 7f4e7ec4b640 1 -- 172.21.15.134:0/1193865655 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94529676421792] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e68024030 con 0x55f967c849b0 2024-04-24T02:12:28.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.119+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e78076070 con 0x55f967c7e760 2024-04-24T02:12:28.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.119+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94529676430416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967c8d140 con 0x55f967c7e760 2024-04-24T02:12:28.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.119+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967c8db90 con 0x7f4e70031040 2024-04-24T02:12:28.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.119+0000 7f4e7fc4d640 1 -- 172.21.15.134:0/1193865655 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94529676425424] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e70040040 con 0x7f4e68027060 2024-04-24T02:12:28.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.120+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e78076070 con 0x7f4e70031040 2024-04-24T02:12:28.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.120+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94529676427696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967c8db50 con 0x7f4e70031040 2024-04-24T02:12:28.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.120+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94529676430416] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e78076070 con 0x55f967c7e760 2024-04-24T02:12:28.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.120+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967c8e430 con 0x7f4e70031040 2024-04-24T02:12:28.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.121+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94529676427696] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e78076070 con 0x7f4e70031040 2024-04-24T02:12:28.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.121+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(56 notify.6 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e78076070 con 0x7f4e70031040 2024-04-24T02:12:28.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.121+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94529676433056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967c8df70 con 0x7f4e70031040 2024-04-24T02:12:28.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.121+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967c8e990 con 0x7f4e70031040 2024-04-24T02:12:28.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.122+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94529676433056] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e78076070 con 0x7f4e70031040 2024-04-24T02:12:28.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.122+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(58 notify.7 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e78076070 con 0x7f4e70031040 2024-04-24T02:12:28.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.122+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94529676436608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967c8eb70 con 0x7f4e70031040 2024-04-24T02:12:28.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.122+0000 7f4e81946800 20 add_watcher() i=0 2024-04-24T02:12:28.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.122+0000 7f4e81946800 20 add_watcher() i=1 2024-04-24T02:12:28.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.122+0000 7f4e81946800 20 add_watcher() i=2 2024-04-24T02:12:28.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.122+0000 7f4e81946800 20 add_watcher() i=3 2024-04-24T02:12:28.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.122+0000 7f4e81946800 20 add_watcher() i=4 2024-04-24T02:12:28.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.122+0000 7f4e81946800 20 add_watcher() i=5 2024-04-24T02:12:28.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.122+0000 7f4e81946800 20 add_watcher() i=6 2024-04-24T02:12:28.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.123+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94529676436608] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e78076070 con 0x7f4e70031040 2024-04-24T02:12:28.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.123+0000 7f4e81946800 20 add_watcher() i=7 2024-04-24T02:12:28.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.123+0000 7f4e81946800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:28.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.123+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f967c91f40 con 0x55f967c7e760 2024-04-24T02:12:28.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.124+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4e78076070 con 0x55f967c7e760 2024-04-24T02:12:28.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.124+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94529676438112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967c8f330 con 0x55f967c7e760 2024-04-24T02:12:28.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.125+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94529676438112] v30'146 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4e78076070 con 0x55f967c7e760 2024-04-24T02:12:28.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.125+0000 7f4d35fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:28.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.125+0000 7f4e81946800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:28.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.125+0000 7f4e81946800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:28.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.125+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967c9a730 con 0x55f967c7e760 2024-04-24T02:12:28.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.126+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'47 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4e78076070 con 0x55f967c7e760 2024-04-24T02:12:28.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.126+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967c9ad60 con 0x7f4e70031040 2024-04-24T02:12:28.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.127+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4e78076070 con 0x7f4e70031040 2024-04-24T02:12:28.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.127+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967c9ad60 con 0x55f967c849b0 2024-04-24T02:12:28.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.128+0000 7f4e7ec4b640 1 -- 172.21.15.134:0/1193865655 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4e68024030 con 0x55f967c849b0 2024-04-24T02:12:28.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.128+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967c9b1a0 con 0x55f967c7e760 2024-04-24T02:12:28.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.129+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'147 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4e78076070 con 0x55f967c7e760 2024-04-24T02:12:28.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.129+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967c9b1c0 con 0x7f4e68027060 2024-04-24T02:12:28.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.130+0000 7f4e7fc4d640 1 -- 172.21.15.134:0/1193865655 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'47 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4e70040040 con 0x7f4e68027060 2024-04-24T02:12:28.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.130+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967c9b830 con 0x55f967c849b0 2024-04-24T02:12:28.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.131+0000 7f4e7ec4b640 1 -- 172.21.15.134:0/1193865655 <== osd.3 v2:172.21.15.134:6801/3585115521 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'41 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4e68024030 con 0x55f967c849b0 2024-04-24T02:12:28.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.131+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967c9bbd0 con 0x55f967c7e760 2024-04-24T02:12:28.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.132+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4e78076070 con 0x55f967c7e760 2024-04-24T02:12:28.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.132+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967c9bbd0 con 0x7f4e70031040 2024-04-24T02:12:28.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.133+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'34 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4e78076070 con 0x7f4e70031040 2024-04-24T02:12:28.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.133+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967c9bbd0 con 0x7f4e68027060 2024-04-24T02:12:28.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.134+0000 7f4e7fc4d640 1 -- 172.21.15.134:0/1193865655 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4e70040040 con 0x7f4e68027060 2024-04-24T02:12:28.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.134+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967c9c160 con 0x55f967c849b0 2024-04-24T02:12:28.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.135+0000 7f4e7ec4b640 1 -- 172.21.15.134:0/1193865655 <== osd.3 v2:172.21.15.134:6801/3585115521 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4e68024030 con 0x55f967c849b0 2024-04-24T02:12:28.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.135+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967c9c500 con 0x7f4e68027060 2024-04-24T02:12:28.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.136+0000 7f4e7fc4d640 1 -- 172.21.15.134:0/1193865655 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'48 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e70040040 con 0x7f4e68027060 2024-04-24T02:12:28.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.136+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967c9ca70 con 0x7f4e70031040 2024-04-24T02:12:28.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.137+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e78076070 con 0x7f4e70031040 2024-04-24T02:12:28.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.137+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967c9ca70 con 0x7f4e68027060 2024-04-24T02:12:28.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.138+0000 7f4e7fc4d640 1 -- 172.21.15.134:0/1193865655 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'23 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e70040040 con 0x7f4e68027060 2024-04-24T02:12:28.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.138+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967c9ceb0 con 0x7f4e70031040 2024-04-24T02:12:28.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.140+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.0 v2:172.21.15.104:6800/2419146313 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'45 uv16 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e78076070 con 0x7f4e70031040 2024-04-24T02:12:28.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.140+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967c9ceb0 con 0x55f967c7e760 2024-04-24T02:12:28.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.141+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'148 uv16 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e78076070 con 0x55f967c7e760 2024-04-24T02:12:28.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.141+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967c9ceb0 con 0x55f967c849b0 2024-04-24T02:12:28.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.142+0000 7f4e7ec4b640 1 -- 172.21.15.134:0/1193865655 <== osd.3 v2:172.21.15.134:6801/3585115521 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'41 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e68024030 con 0x55f967c849b0 2024-04-24T02:12:28.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.142+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967c9ceb0 con 0x7f4e68027060 2024-04-24T02:12:28.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.143+0000 7f4e7fc4d640 1 -- 172.21.15.134:0/1193865655 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'49 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e70040040 con 0x7f4e68027060 2024-04-24T02:12:28.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.143+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967c9ceb0 con 0x55f967c849b0 2024-04-24T02:12:28.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.144+0000 7f4e7ec4b640 1 -- 172.21.15.134:0/1193865655 <== osd.3 v2:172.21.15.134:6801/3585115521 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'29 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e68024030 con 0x55f967c849b0 2024-04-24T02:12:28.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.144+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967c9ceb0 con 0x55f967c7e760 2024-04-24T02:12:28.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.145+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e78076070 con 0x55f967c7e760 2024-04-24T02:12:28.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.145+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967c9ceb0 con 0x55f967c7e760 2024-04-24T02:12:28.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.146+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'149 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e78076070 con 0x55f967c7e760 2024-04-24T02:12:28.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.146+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967c9ceb0 con 0x55f967c849b0 2024-04-24T02:12:28.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.147+0000 7f4e7ec4b640 1 -- 172.21.15.134:0/1193865655 <== osd.3 v2:172.21.15.134:6801/3585115521 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'42 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e68024030 con 0x55f967c849b0 2024-04-24T02:12:28.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.147+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967c9ceb0 con 0x7f4e68027060 2024-04-24T02:12:28.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.148+0000 7f4e7fc4d640 1 -- 172.21.15.134:0/1193865655 <== osd.2 v2:172.21.15.134:6800/214480313 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'33 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e70040040 con 0x7f4e68027060 2024-04-24T02:12:28.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.148+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967c9ceb0 con 0x55f967c849b0 2024-04-24T02:12:28.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.149+0000 7f4e7ec4b640 1 -- 172.21.15.134:0/1193865655 <== osd.3 v2:172.21.15.134:6801/3585115521 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e68024030 con 0x55f967c849b0 2024-04-24T02:12:28.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.149+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967c9ceb0 con 0x55f967c849b0 2024-04-24T02:12:28.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.150+0000 7f4e7ec4b640 1 -- 172.21.15.134:0/1193865655 <== osd.3 v2:172.21.15.134:6801/3585115521 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'35 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e68024030 con 0x55f967c849b0 2024-04-24T02:12:28.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.150+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967c9ceb0 con 0x55f967c849b0 2024-04-24T02:12:28.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.150+0000 7f4e7ec4b640 1 -- 172.21.15.134:0/1193865655 <== osd.3 v2:172.21.15.134:6801/3585115521 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e68024030 con 0x55f967c849b0 2024-04-24T02:12:28.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.150+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967c9ceb0 con 0x55f967c849b0 2024-04-24T02:12:28.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.152+0000 7f4e7ec4b640 1 -- 172.21.15.134:0/1193865655 <== osd.3 v2:172.21.15.134:6801/3585115521 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'42 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e68024030 con 0x55f967c849b0 2024-04-24T02:12:28.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.152+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967c9ceb0 con 0x7f4e70031040 2024-04-24T02:12:28.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.154+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.0 v2:172.21.15.104:6800/2419146313 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'25 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e78076070 con 0x7f4e70031040 2024-04-24T02:12:28.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.154+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967c9ceb0 con 0x55f967c849b0 2024-04-24T02:12:28.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.154+0000 7f4e7ec4b640 1 -- 172.21.15.134:0/1193865655 <== osd.3 v2:172.21.15.134:6801/3585115521 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'29 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e68024030 con 0x55f967c849b0 2024-04-24T02:12:28.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.155+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967c9ceb0 con 0x7f4e70031040 2024-04-24T02:12:28.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.156+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.0 v2:172.21.15.104:6800/2419146313 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'35 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e78076070 con 0x7f4e70031040 2024-04-24T02:12:28.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.156+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967c9ceb0 con 0x55f967c849b0 2024-04-24T02:12:28.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.157+0000 7f4e7ec4b640 1 -- 172.21.15.134:0/1193865655 <== osd.3 v2:172.21.15.134:6801/3585115521 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'43 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e68024030 con 0x55f967c849b0 2024-04-24T02:12:28.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.157+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967c9ceb0 con 0x7f4e70031040 2024-04-24T02:12:28.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.158+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.0 v2:172.21.15.104:6800/2419146313 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'46 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e78076070 con 0x7f4e70031040 2024-04-24T02:12:28.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.158+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967c9ceb0 con 0x7f4e68027060 2024-04-24T02:12:28.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.159+0000 7f4e7fc4d640 1 -- 172.21.15.134:0/1193865655 <== osd.2 v2:172.21.15.134:6800/214480313 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e70040040 con 0x7f4e68027060 2024-04-24T02:12:28.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.159+0000 7f4d34fe1640 20 reqs_thread_entry: start 2024-04-24T02:12:28.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.159+0000 7f4e81946800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:28.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.159+0000 7f4e81946800 20 Filter name: none 2024-04-24T02:12:28.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.159+0000 7f4cae7fc640 20 reqs_thread_entry: start 2024-04-24T02:12:28.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.159+0000 7f4e81946800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-24T02:12:28.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.159+0000 7f4e81946800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.159+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f967cc7d20 con 0x7f4e68027060 2024-04-24T02:12:28.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.160+0000 7f4e7fc4d640 1 -- 172.21.15.134:0/1193865655 <== osd.2 v2:172.21.15.134:6800/214480313 18 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f4e70040040 con 0x7f4e68027060 2024-04-24T02:12:28.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.160+0000 7f4e81946800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T02:12:28.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.160+0000 7f4e81946800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-24T02:12:28.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.160+0000 7f4e81946800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T02:12:28.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.160+0000 7f4e81946800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 : miss 2024-04-24T02:12:28.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.160+0000 7f4e81946800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.160+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:95 8.1d 8:be2d2b4a:root::.bucket.meta.myfoo%3a582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f967cc97e0 con 0x7f4e70031040 2024-04-24T02:12:28.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.160+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.0 v2:172.21.15.104:6800/2419146313 24 ==== osd_op_reply(95 .bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f4e78076070 con 0x7f4e70031040 2024-04-24T02:12:28.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.160+0000 7f4e81946800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T02:12:28.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.160+0000 7f4e81946800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 info.flags=0x17 2024-04-24T02:12:28.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.160+0000 7f4e81946800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 to cache LRU end 2024-04-24T02:12:28.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.160+0000 7f4e81946800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:12:28.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.160+0000 7f4e81946800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T02:12:28.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.160+0000 7f4e81946800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 2024-04-24T02:12:28.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.160+0000 7f4e81946800 20 get_obj_state: octx=0x7f4e7807d040 obj=myfoo:four state=0x55f967ccaac8 s->prefetch_data=0 2024-04-24T02:12:28.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.160+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:96 3.38 3:1f6e8477:::582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1_four:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f967ccb8f0 con 0x7f4e70031040 2024-04-24T02:12:28.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.161+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.0 v2:172.21.15.104:6800/2419146313 25 ==== osd_op_reply(96 582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1_four [getxattrs out=851b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 234+0+867 (crc 0 0 0) 0x7f4e78076070 con 0x7f4e70031040 2024-04-24T02:12:28.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.161+0000 7f4e81946800 10 manifest: total_size = 4 2024-04-24T02:12:28.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.161+0000 7f4e81946800 20 get_obj_state: setting s->obj_tag to 582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.12540219880348622140 2024-04-24T02:12:28.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.161+0000 7f4e81946800 20 get_obj_state: octx=0x7f4e7807d040 obj=myfoo:four state=0x55f967ccaac8 s->prefetch_data=0 2024-04-24T02:12:28.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.161+0000 7f4e81946800 20 prepare_atomic_modification: state is not atomic. state=0x55f967ccaac8 2024-04-24T02:12:28.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.161+0000 7f4e81946800 20 bucket index object: :.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.6 2024-04-24T02:12:28.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.161+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:97 4.0 4:009d6733:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967cd01f0 con 0x55f967c849b0 2024-04-24T02:12:28.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.162+0000 7f4e7ec4b640 1 -- 172.21.15.134:0/1193865655 <== osd.3 v2:172.21.15.134:6801/3585115521 26 ==== osd_op_reply(97 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.6 [stat,call,call] v30'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f4e68024030 con 0x55f967c849b0 2024-04-24T02:12:28.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.162+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:98 3.38 3:1f6e8477:::582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967cd01f0 con 0x7f4e70031040 2024-04-24T02:12:28.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.163+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.0 v2:172.21.15.104:6800/2419146313 26 ==== osd_op_reply(98 582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1_four [call] v30'2 uv2 ondisk = 0) ==== 192+0+0 (crc 0 0 0) 0x7f4e78076070 con 0x7f4e70031040 2024-04-24T02:12:28.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.163+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:99 4.0 4:009d6733:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967cd0c80 con 0x55f967c849b0 2024-04-24T02:12:28.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.164+0000 7f4d35fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:28.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.164+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94529676438112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967cd0c80 con 0x55f967c7e760 2024-04-24T02:12:28.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.164+0000 7f4e7ec4b640 1 -- 172.21.15.134:0/1193865655 <== osd.3 v2:172.21.15.134:6801/3585115521 27 ==== osd_op_reply(99 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.6 [stat,call,call] v30'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f4e68024030 con 0x55f967c849b0 2024-04-24T02:12:28.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.164+0000 7f4d62ffd640 20 handle_completion(): completion ok for obj=four 2024-04-24T02:12:28.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.165+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 94529676438112] v30'150 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4e78076070 con 0x55f967c7e760 2024-04-24T02:12:28.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.165+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94529676413568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967cd0c80 con 0x7f4e68027060 2024-04-24T02:12:28.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.166+0000 7f4e7fc4d640 1 -- 172.21.15.134:0/1193865655 <== osd.2 v2:172.21.15.134:6800/214480313 19 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 94529676413568] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e70040040 con 0x7f4e68027060 2024-04-24T02:12:28.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.166+0000 7f4e81946800 20 remove_watcher() i=0 2024-04-24T02:12:28.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.166+0000 7f4e81946800 2 removed watcher, disabling cache 2024-04-24T02:12:28.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.166+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94529676417936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967cd0c80 con 0x55f967c7e760 2024-04-24T02:12:28.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.167+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.1 v2:172.21.15.134:6804/1487076214 30 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 94529676417936] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e78076070 con 0x55f967c7e760 2024-04-24T02:12:28.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.167+0000 7f4e81946800 20 remove_watcher() i=1 2024-04-24T02:12:28.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.167+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94529676421792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967cd0c80 con 0x55f967c849b0 2024-04-24T02:12:28.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.168+0000 7f4e7ec4b640 1 -- 172.21.15.134:0/1193865655 <== osd.3 v2:172.21.15.134:6801/3585115521 28 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 94529676421792] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e68024030 con 0x55f967c849b0 2024-04-24T02:12:28.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.168+0000 7f4e81946800 20 remove_watcher() i=2 2024-04-24T02:12:28.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.168+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94529676425424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967cd0c80 con 0x7f4e68027060 2024-04-24T02:12:28.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.169+0000 7f4e7fc4d640 1 -- 172.21.15.134:0/1193865655 <== osd.2 v2:172.21.15.134:6800/214480313 20 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 94529676425424] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e70040040 con 0x7f4e68027060 2024-04-24T02:12:28.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.169+0000 7f4e81946800 20 remove_watcher() i=3 2024-04-24T02:12:28.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.169+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94529676430416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967cd0c80 con 0x55f967c7e760 2024-04-24T02:12:28.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.170+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.1 v2:172.21.15.134:6804/1487076214 31 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 94529676430416] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e78076070 con 0x55f967c7e760 2024-04-24T02:12:28.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.170+0000 7f4e81946800 20 remove_watcher() i=4 2024-04-24T02:12:28.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.170+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94529676427696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967cd0c80 con 0x7f4e70031040 2024-04-24T02:12:28.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.171+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.0 v2:172.21.15.104:6800/2419146313 27 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 94529676427696] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e78076070 con 0x7f4e70031040 2024-04-24T02:12:28.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.171+0000 7f4e81946800 20 remove_watcher() i=5 2024-04-24T02:12:28.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.171+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94529676433056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967cd0c80 con 0x7f4e70031040 2024-04-24T02:12:28.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.172+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.0 v2:172.21.15.104:6800/2419146313 28 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 94529676433056] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e78076070 con 0x7f4e70031040 2024-04-24T02:12:28.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.172+0000 7f4e81946800 20 remove_watcher() i=6 2024-04-24T02:12:28.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.172+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94529676436608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f967c88a80 con 0x7f4e70031040 2024-04-24T02:12:28.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.173+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 <== osd.0 v2:172.21.15.104:6800/2419146313 29 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 94529676436608] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e78076070 con 0x7f4e70031040 2024-04-24T02:12:28.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.173+0000 7f4e81946800 20 remove_watcher() i=7 2024-04-24T02:12:28.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.173+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f4e70031040 msgr2=0x7f4e70032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.173+0000 7f4e81946800 1 --2- 172.21.15.134:0/1193865655 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f4e70031040 0x7f4e70032940 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.173+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f967c7e760 msgr2=0x55f967c80c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.173+0000 7f4e81946800 1 --2- 172.21.15.134:0/1193865655 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f967c7e760 0x55f967c80c20 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.173+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f4e68027060 msgr2=0x7f4e68027440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.173+0000 7f4e81946800 1 --2- 172.21.15.134:0/1193865655 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f4e68027060 0x7f4e68027440 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.173+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55f967c849b0 msgr2=0x55f967c86da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.173+0000 7f4e81946800 1 --2- 172.21.15.134:0/1193865655 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55f967c849b0 0x55f967c86da0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.173+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4d48036950 msgr2=0x7f4d48038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.173+0000 7f4e81946800 1 --2- 172.21.15.134:0/1193865655 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4d48036950 0x7f4d48038e10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x55f967c4c0e0 tx=0x7f4e7001f000 comp rx=0 tx=0).stop 2024-04-24T02:12:28.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.173+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f967c6b5f0 msgr2=0x55f967c72c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.173+0000 7f4e7f44c640 1 -- 172.21.15.134:0/1193865655 reap_dead start 2024-04-24T02:12:28.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.173+0000 7f4e81946800 1 --2- 172.21.15.134:0/1193865655 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f967c6b5f0 0x55f967c72c60 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f4e680266c0 tx=0x7f4e6804be50 comp rx=0 tx=0).stop 2024-04-24T02:12:28.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.173+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 shutdown_connections 2024-04-24T02:12:28.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.173+0000 7f4e81946800 1 --2- 172.21.15.134:0/1193865655 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f967c6b5f0 0x55f967c72c60 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.173+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 >> 172.21.15.134:0/1193865655 conn(0x55f967c67950 msgr2=0x55f967c64fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:28.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.173+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 shutdown_connections 2024-04-24T02:12:28.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.173+0000 7f4e81946800 1 -- 172.21.15.134:0/1193865655 wait complete. 2024-04-24T02:12:28.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.173+0000 7f4e81946800 1 -- 172.21.15.134:0/3077467027 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4d58036950 msgr2=0x7f4d58038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.173+0000 7f4e81946800 1 --2- 172.21.15.134:0/3077467027 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4d58036950 0x7f4d58038e10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x55f967c4c960 tx=0x7f4e70005840 comp rx=0 tx=0).stop 2024-04-24T02:12:28.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.173+0000 7f4e81946800 1 -- 172.21.15.134:0/3077467027 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f967ac03b0 msgr2=0x55f967abe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.173+0000 7f4e81946800 1 --2- 172.21.15.134:0/3077467027 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f967ac03b0 0x55f967abe820 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f4e6800e610 tx=0x7f4e6800ff90 comp rx=0 tx=0).stop 2024-04-24T02:12:28.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.173+0000 7f4e81946800 1 -- 172.21.15.134:0/3077467027 shutdown_connections 2024-04-24T02:12:28.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.173+0000 7f4e81946800 1 --2- 172.21.15.134:0/3077467027 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4d58036950 0x7f4d58038e10 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.173+0000 7f4e81946800 1 --2- 172.21.15.134:0/3077467027 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f967ac03b0 0x55f967abe820 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.173+0000 7f4e81946800 1 -- 172.21.15.134:0/3077467027 >> 172.21.15.134:0/3077467027 conn(0x55f967c50130 msgr2=0x55f967c50530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:28.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.173+0000 7f4e81946800 1 -- 172.21.15.134:0/3077467027 shutdown_connections 2024-04-24T02:12:28.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.173+0000 7f4e81946800 1 -- 172.21.15.134:0/3077467027 wait complete. 2024-04-24T02:12:28.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.174+0000 7f4e81946800 1 -- 172.21.15.134:0/1632897294 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f967b4c150 msgr2=0x55f967c4af00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.174+0000 7f4e81946800 1 --2- 172.21.15.134:0/1632897294 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f967b4c150 0x55f967c4af00 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.174+0000 7f4e81946800 1 -- 172.21.15.134:0/1632897294 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4d64036950 msgr2=0x7f4d64038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.174+0000 7f4e81946800 1 --2- 172.21.15.134:0/1632897294 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4d64036950 0x7f4d64038e10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4e68000c00 tx=0x7f4e680013b0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.174+0000 7f4e81946800 1 -- 172.21.15.134:0/1632897294 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f967b4aef0 msgr2=0x55f967c43d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.174+0000 7f4e81946800 1 --2- 172.21.15.134:0/1632897294 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f967b4aef0 0x55f967c43d60 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f4e78005400 tx=0x7f4e78002fb0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.174+0000 7f4e81946800 1 -- 172.21.15.134:0/1632897294 shutdown_connections 2024-04-24T02:12:28.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.174+0000 7f4e81946800 1 --2- 172.21.15.134:0/1632897294 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f967b4c150 0x55f967c4af00 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.174+0000 7f4e81946800 1 --2- 172.21.15.134:0/1632897294 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4d64036950 0x7f4d64038e10 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.174+0000 7f4e81946800 1 --2- 172.21.15.134:0/1632897294 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f967b4aef0 0x55f967c43d60 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.174+0000 7f4e81946800 1 -- 172.21.15.134:0/1632897294 >> 172.21.15.134:0/1632897294 conn(0x55f967b464f0 msgr2=0x55f967c36430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:28.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.174+0000 7f4e81946800 1 -- 172.21.15.134:0/1632897294 shutdown_connections 2024-04-24T02:12:28.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.174+0000 7f4e81946800 1 -- 172.21.15.134:0/1632897294 wait complete. 2024-04-24T02:12:28.182 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-04-24T02:12:28.182 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-04-24T02:12:28.183 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-04-24T02:12:28.225 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:28.225 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:28.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.225+0000 7f6fea146800 1 Processor -- start 2024-04-24T02:12:28.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.226+0000 7f6fea146800 1 -- start start 2024-04-24T02:12:28.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.226+0000 7f6fea146800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x560b80401f90 0x560b804023b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.226+0000 7f6fea146800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560b802c0d40 con 0x560b80403100 2024-04-24T02:12:28.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.226+0000 7f6fea146800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x560b802934d0 con 0x560b80401f90 2024-04-24T02:12:28.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.226+0000 7f6fe7c4c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x560b80401f90 0x560b804023b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.226+0000 7f6fdf44b640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x560b80403100 0x560b80403580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:55344/0 (socket says 172.21.15.134:55344) 2024-04-24T02:12:28.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.226+0000 7f6fe7c4c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x560b80401f90 0x560b804023b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56656/0 (socket says 172.21.15.134:56656) 2024-04-24T02:12:28.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.226+0000 7f6fdf44b640 1 -- 172.21.15.134:0/274402341 learned_addr learned my addr 172.21.15.134:0/274402341 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:12:28.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.226+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/274402341 >> v1:172.21.15.104:6789/0 conn(0x560b80403100 legacy=0x560b80403580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.226+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/274402341 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b802bf590 con 0x560b80401f90 2024-04-24T02:12:28.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.228+0000 7f6fe7c4c640 1 --2- 172.21.15.134:0/274402341 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b80401f90 0x560b804023b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f6fd800a470 tx=0x7f6fd801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a566a85957dda3a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.228+0000 7f6fe744b640 1 -- 172.21.15.134:0/274402341 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fd8057070 con 0x560b80401f90 2024-04-24T02:12:28.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.228+0000 7f6fe744b640 1 -- 172.21.15.134:0/274402341 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fd8052570 con 0x560b80401f90 2024-04-24T02:12:28.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.228+0000 7f6fe744b640 1 -- 172.21.15.134:0/274402341 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fd8052870 con 0x560b80401f90 2024-04-24T02:12:28.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.229+0000 7f6fea146800 1 -- 172.21.15.134:0/274402341 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b80401f90 msgr2=0x560b804023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.229+0000 7f6fea146800 1 --2- 172.21.15.134:0/274402341 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b80401f90 0x560b804023b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f6fd800a470 tx=0x7f6fd801ce90 comp rx=0 tx=0).stop 2024-04-24T02:12:28.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.229+0000 7f6fea146800 1 -- 172.21.15.134:0/274402341 shutdown_connections 2024-04-24T02:12:28.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.229+0000 7f6fea146800 1 --2- 172.21.15.134:0/274402341 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b80401f90 0x560b804023b0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.229+0000 7f6fea146800 1 -- 172.21.15.134:0/274402341 >> 172.21.15.134:0/274402341 conn(0x560b803fd530 msgr2=0x560b803ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:28.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.229+0000 7f6fea146800 1 -- 172.21.15.134:0/274402341 shutdown_connections 2024-04-24T02:12:28.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.229+0000 7f6fea146800 1 -- 172.21.15.134:0/274402341 wait complete. 2024-04-24T02:12:28.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.240+0000 7f6fea146800 1 Processor -- start 2024-04-24T02:12:28.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.241+0000 7f6fea146800 1 -- start start 2024-04-24T02:12:28.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.241+0000 7f6fea146800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b80401f90 0x560b804f3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.241+0000 7f6fea146800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560b8034d3c0 con 0x560b80401f90 2024-04-24T02:12:28.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.241+0000 7f6fe7c4c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b80401f90 0x560b804f3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.241+0000 7f6fe7c4c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b80401f90 0x560b804f3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56672/0 (socket says 172.21.15.134:56672) 2024-04-24T02:12:28.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.241+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/3707250750 learned_addr learned my addr 172.21.15.134:0/3707250750 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:28.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.241+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/3707250750 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b804f3ad0 con 0x560b80401f90 2024-04-24T02:12:28.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.241+0000 7f6fe7c4c640 1 --2- 172.21.15.134:0/3707250750 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b80401f90 0x560b804f3500 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8055040 tx=0x7f6fd804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c675ea97b54750f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.242+0000 7f6ed5e0b640 1 -- 172.21.15.134:0/3707250750 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fd8057070 con 0x560b80401f90 2024-04-24T02:12:28.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.242+0000 7f6ed5e0b640 1 -- 172.21.15.134:0/3707250750 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fd8063070 con 0x560b80401f90 2024-04-24T02:12:28.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.242+0000 7f6ed5e0b640 1 -- 172.21.15.134:0/3707250750 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fd8052720 con 0x560b80401f90 2024-04-24T02:12:28.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.242+0000 7f6fea146800 1 -- 172.21.15.134:0/3707250750 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b80401f90 msgr2=0x560b804f3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.242+0000 7f6fea146800 1 --2- 172.21.15.134:0/3707250750 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b80401f90 0x560b804f3500 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8055040 tx=0x7f6fd804c000 comp rx=0 tx=0).stop 2024-04-24T02:12:28.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.242+0000 7f6fea146800 1 -- 172.21.15.134:0/3707250750 shutdown_connections 2024-04-24T02:12:28.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.242+0000 7f6fea146800 1 --2- 172.21.15.134:0/3707250750 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b80401f90 0x560b804f3500 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.242+0000 7f6fea146800 1 -- 172.21.15.134:0/3707250750 >> 172.21.15.134:0/3707250750 conn(0x560b803fd530 msgr2=0x560b804eee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:28.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.242+0000 7f6fea146800 1 -- 172.21.15.134:0/3707250750 shutdown_connections 2024-04-24T02:12:28.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.242+0000 7f6fea146800 1 -- 172.21.15.134:0/3707250750 wait complete. 2024-04-24T02:12:28.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.243+0000 7f6fea146800 1 Processor -- start 2024-04-24T02:12:28.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.243+0000 7f6fea146800 1 -- start start 2024-04-24T02:12:28.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.243+0000 7f6fea146800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b80401f90 0x560b80377950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.243+0000 7f6fea146800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560b8040b570 con 0x560b80401f90 2024-04-24T02:12:28.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.243+0000 7f6fe7c4c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b80401f90 0x560b80377950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.243+0000 7f6fe7c4c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b80401f90 0x560b80377950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56684/0 (socket says 172.21.15.134:56684) 2024-04-24T02:12:28.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.243+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/2410102268 learned_addr learned my addr 172.21.15.134:0/2410102268 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:28.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.243+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/2410102268 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b80377e90 con 0x560b80401f90 2024-04-24T02:12:28.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.244+0000 7f6fe7c4c640 1 --2- 172.21.15.134:0/2410102268 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b80401f90 0x560b80377950 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8000c00 tx=0x7f6fd8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.244+0000 7f6ecffff640 1 -- 172.21.15.134:0/2410102268 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fd8052bb0 con 0x560b80401f90 2024-04-24T02:12:28.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.244+0000 7f6ecffff640 1 -- 172.21.15.134:0/2410102268 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fd806c070 con 0x560b80401f90 2024-04-24T02:12:28.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.244+0000 7f6fea146800 1 -- 172.21.15.134:0/2410102268 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560b80376090 con 0x560b80401f90 2024-04-24T02:12:28.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.244+0000 7f6ecffff640 1 -- 172.21.15.134:0/2410102268 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fd805e480 con 0x560b80401f90 2024-04-24T02:12:28.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.244+0000 7f6fea146800 1 -- 172.21.15.134:0/2410102268 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b803765b0 con 0x560b80401f90 2024-04-24T02:12:28.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.245+0000 7f6ecffff640 1 -- 172.21.15.134:0/2410102268 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6fd8077060 con 0x560b80401f90 2024-04-24T02:12:28.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.245+0000 7f6ecffff640 1 --2- 172.21.15.134:0/2410102268 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6ed0036950 0x7f6ed0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.245+0000 7f6ecffff640 1 -- 172.21.15.134:0/2410102268 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f6fd808dff0 con 0x560b80401f90 2024-04-24T02:12:28.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.245+0000 7f6fdf44b640 1 --2- 172.21.15.134:0/2410102268 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6ed0036950 0x7f6ed0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.245+0000 7f6fea146800 1 --2- 172.21.15.134:0/2410102268 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560b80403100 0x560b805043d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.245+0000 7f6fea146800 1 -- 172.21.15.134:0/2410102268 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560b80504950 con 0x560b80403100 2024-04-24T02:12:28.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.245+0000 7f6fe844d640 1 --2- 172.21.15.134:0/2410102268 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560b80403100 0x560b805043d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.245+0000 7f6fdf44b640 1 --2- 172.21.15.134:0/2410102268 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6ed0036950 0x7f6ed0038e10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6fd0000f60 tx=0x7f6fd00012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.245+0000 7f6fe844d640 1 --2- 172.21.15.134:0/2410102268 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560b80403100 0x560b805043d0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.246+0000 7f6fe844d640 1 -- 172.21.15.134:0/2410102268 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6fe000a4a0 con 0x560b80403100 2024-04-24T02:12:28.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.246+0000 7f6fea146800 1 -- 172.21.15.134:0/2410102268 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560b80376b10 con 0x560b80403100 2024-04-24T02:12:28.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.246+0000 7f6fe844d640 1 -- 172.21.15.134:0/2410102268 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6fe000a4a0 con 0x560b80403100 2024-04-24T02:12:28.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.246+0000 7f6fea146800 1 -- 172.21.15.134:0/2410102268 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560b80506770 con 0x560b80403100 2024-04-24T02:12:28.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.246+0000 7f6fe844d640 1 -- 172.21.15.134:0/2410102268 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6fe000a4a0 con 0x560b80403100 2024-04-24T02:12:28.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.246+0000 7f6fea146800 1 -- 172.21.15.134:0/2410102268 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560b80505ab0 con 0x560b80403100 2024-04-24T02:12:28.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.246+0000 7f6fe844d640 1 -- 172.21.15.134:0/2410102268 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6fe000a4a0 con 0x560b80403100 2024-04-24T02:12:28.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.247+0000 7f6fea146800 1 -- 172.21.15.134:0/2410102268 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560b80505f00 con 0x560b80403100 2024-04-24T02:12:28.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.247+0000 7f6fe844d640 1 -- 172.21.15.134:0/2410102268 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6fe000a4a0 con 0x560b80403100 2024-04-24T02:12:28.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.247+0000 7f6fea146800 1 Processor -- start 2024-04-24T02:12:28.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.247+0000 7f6fea146800 1 -- start start 2024-04-24T02:12:28.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.247+0000 7f6fea146800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b80515540 0x560b80515960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.247+0000 7f6fea146800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560b802f36b0 con 0x560b80515540 2024-04-24T02:12:28.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.248+0000 7f6fdf44b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b80515540 0x560b80515960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.248+0000 7f6fdf44b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b80515540 0x560b80515960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56688/0 (socket says 172.21.15.134:56688) 2024-04-24T02:12:28.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.248+0000 7f6fdf44b640 1 -- 172.21.15.134:0/432693019 learned_addr learned my addr 172.21.15.134:0/432693019 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:28.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.248+0000 7f6fdf44b640 1 -- 172.21.15.134:0/432693019 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b80515ea0 con 0x560b80515540 2024-04-24T02:12:28.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.248+0000 7f6fdf44b640 1 --2- 172.21.15.134:0/432693019 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b80515540 0x560b80515960 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f6fd0001ed0 tx=0x7f6fd000d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.248+0000 7f6ecd7fa640 1 -- 172.21.15.134:0/432693019 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fd001b550 con 0x560b80515540 2024-04-24T02:12:28.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.248+0000 7f6ecd7fa640 1 -- 172.21.15.134:0/432693019 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fd001b6f0 con 0x560b80515540 2024-04-24T02:12:28.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.248+0000 7f6fea146800 1 -- 172.21.15.134:0/432693019 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560b80516910 con 0x560b80515540 2024-04-24T02:12:28.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.248+0000 7f6ecd7fa640 1 -- 172.21.15.134:0/432693019 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fd001b9d0 con 0x560b80515540 2024-04-24T02:12:28.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.248+0000 7f6fea146800 1 -- 172.21.15.134:0/432693019 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b80516e10 con 0x560b80515540 2024-04-24T02:12:28.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.249+0000 7f6ecd7fa640 1 -- 172.21.15.134:0/432693019 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6fd0023020 con 0x560b80515540 2024-04-24T02:12:28.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.249+0000 7f6ecd7fa640 1 --2- 172.21.15.134:0/432693019 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6ec0036950 0x7f6ec0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.249+0000 7f6ecd7fa640 1 -- 172.21.15.134:0/432693019 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f6fd0021020 con 0x560b80515540 2024-04-24T02:12:28.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.249+0000 7f6fe844d640 1 --2- 172.21.15.134:0/432693019 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6ec0036950 0x7f6ec0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.250+0000 7f6fea146800 1 Processor -- start 2024-04-24T02:12:28.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.250+0000 7f6fea146800 1 -- start start 2024-04-24T02:12:28.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.250+0000 7f6fe844d640 1 --2- 172.21.15.134:0/432693019 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6ec0036950 0x7f6ec0038e10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x560b805055d0 tx=0x7f6fe0005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.250+0000 7f6fea146800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b80522880 0x560b80522ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.250+0000 7f6fea146800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560b804f3d90 con 0x560b80522880 2024-04-24T02:12:28.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.250+0000 7f6fdf44b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b80522880 0x560b80522ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.250+0000 7f6fdf44b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b80522880 0x560b80522ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56696/0 (socket says 172.21.15.134:56696) 2024-04-24T02:12:28.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.250+0000 7f6fdf44b640 1 -- 172.21.15.134:0/547629860 learned_addr learned my addr 172.21.15.134:0/547629860 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:28.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.250+0000 7f6fdf44b640 1 -- 172.21.15.134:0/547629860 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b80523270 con 0x560b80522880 2024-04-24T02:12:28.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.250+0000 7f6fdf44b640 1 --2- 172.21.15.134:0/547629860 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b80522880 0x560b80522ca0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f6fd004ce10 tx=0x7f6fd0019ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f09c08bbe5968349 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.250+0000 7f6ec6ffd640 1 -- 172.21.15.134:0/547629860 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fd0041070 con 0x560b80522880 2024-04-24T02:12:28.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.250+0000 7f6ec6ffd640 1 -- 172.21.15.134:0/547629860 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fd00258e0 con 0x560b80522880 2024-04-24T02:12:28.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.250+0000 7f6ec6ffd640 1 -- 172.21.15.134:0/547629860 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fd0025410 con 0x560b80522880 2024-04-24T02:12:28.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.251+0000 7f6fea146800 1 -- 172.21.15.134:0/547629860 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b80522880 msgr2=0x560b80522ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.251+0000 7f6fea146800 1 --2- 172.21.15.134:0/547629860 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b80522880 0x560b80522ca0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f6fd004ce10 tx=0x7f6fd0019ce0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.251+0000 7f6fea146800 1 -- 172.21.15.134:0/547629860 shutdown_connections 2024-04-24T02:12:28.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.251+0000 7f6fea146800 1 --2- 172.21.15.134:0/547629860 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b80522880 0x560b80522ca0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.251+0000 7f6fea146800 1 -- 172.21.15.134:0/547629860 >> 172.21.15.134:0/547629860 conn(0x560b8051ebe0 msgr2=0x560b8051cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:28.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.251+0000 7f6fea146800 1 -- 172.21.15.134:0/547629860 shutdown_connections 2024-04-24T02:12:28.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.251+0000 7f6fea146800 1 -- 172.21.15.134:0/547629860 wait complete. 2024-04-24T02:12:28.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.251+0000 7f6fea146800 1 Processor -- start 2024-04-24T02:12:28.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.251+0000 7f6fea146800 1 -- start start 2024-04-24T02:12:28.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.251+0000 7f6fea146800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b80522880 0x560b80529ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.251+0000 7f6fea146800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560b805239e0 con 0x560b80522880 2024-04-24T02:12:28.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.252+0000 7f6fdf44b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b80522880 0x560b80529ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.252+0000 7f6fdf44b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b80522880 0x560b80529ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56710/0 (socket says 172.21.15.134:56710) 2024-04-24T02:12:28.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.252+0000 7f6fdf44b640 1 -- 172.21.15.134:0/591178648 learned_addr learned my addr 172.21.15.134:0/591178648 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:28.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.252+0000 7f6fdf44b640 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b8052a430 con 0x560b80522880 2024-04-24T02:12:28.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.252+0000 7f6fdf44b640 1 --2- 172.21.15.134:0/591178648 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b80522880 0x560b80529ef0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f6fd0019d20 tx=0x7f6fd004cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.252+0000 7f6ec57fa640 1 -- 172.21.15.134:0/591178648 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fd0041070 con 0x560b80522880 2024-04-24T02:12:28.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.252+0000 7f6ec57fa640 1 -- 172.21.15.134:0/591178648 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fd0024370 con 0x560b80522880 2024-04-24T02:12:28.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.252+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560b8052a6c0 con 0x560b80522880 2024-04-24T02:12:28.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.252+0000 7f6ec57fa640 1 -- 172.21.15.134:0/591178648 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fd0024650 con 0x560b80522880 2024-04-24T02:12:28.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.252+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b8052a6c0 con 0x560b80522880 2024-04-24T02:12:28.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.253+0000 7f6ec57fa640 1 -- 172.21.15.134:0/591178648 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6fd00247f0 con 0x560b80522880 2024-04-24T02:12:28.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.253+0000 7f6ec57fa640 1 --2- 172.21.15.134:0/591178648 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6eb0036950 0x7f6eb0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.253+0000 7f6ec57fa640 1 -- 172.21.15.134:0/591178648 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f6fd004f060 con 0x560b80522880 2024-04-24T02:12:28.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.253+0000 7f6fea146800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.253+0000 7f6fe844d640 1 --2- 172.21.15.134:0/591178648 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6eb0036950 0x7f6eb0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.253+0000 7f6fea146800 1 --2- 172.21.15.134:0/591178648 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560b805357e0 0x560b80537c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.253+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560b805383d0 con 0x560b805357e0 2024-04-24T02:12:28.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.253+0000 7f6fe7c4c640 1 --2- 172.21.15.134:0/591178648 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560b805357e0 0x560b80537c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.254+0000 7f6fe844d640 1 --2- 172.21.15.134:0/591178648 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6eb0036950 0x7f6eb0038e10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x560b80377100 tx=0x7f6fe001f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.254+0000 7f6fe7c4c640 1 --2- 172.21.15.134:0/591178648 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560b805357e0 0x560b80537c80 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.254+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6fd8009d30 con 0x560b805357e0 2024-04-24T02:12:28.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.254+0000 7f6fea146800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:28.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.254+0000 7f6fea146800 20 realm 2024-04-24T02:12:28.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.254+0000 7f6fea146800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.254+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560b805387e0 con 0x560b805357e0 2024-04-24T02:12:28.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.254+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6fd8009d30 con 0x560b805357e0 2024-04-24T02:12:28.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.254+0000 7f6fea146800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:28.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.254+0000 7f6fea146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:28.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.254+0000 7f6fea146800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.254+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560b805390b0 con 0x560b805357e0 2024-04-24T02:12:28.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.254+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6fd8009d30 con 0x560b805357e0 2024-04-24T02:12:28.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.254+0000 7f6fea146800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:28.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.254+0000 7f6fea146800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.254+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560b80539450 con 0x560b805357e0 2024-04-24T02:12:28.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.255+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6fd8009d30 con 0x560b805357e0 2024-04-24T02:12:28.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.255+0000 7f6fea146800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:28.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.255+0000 7f6fea146800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.255+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560b805398b0 con 0x560b805357e0 2024-04-24T02:12:28.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.255+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6fd8009d30 con 0x560b805357e0 2024-04-24T02:12:28.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.255+0000 7f6fea146800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:28.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.255+0000 7f6fea146800 20 searching for the correct realm 2024-04-24T02:12:28.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.255+0000 7f6fea146800 1 --2- 172.21.15.134:0/591178648 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x560b8053b900 0x560b8053dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.255+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560b8053e3a0 con 0x560b8053b900 2024-04-24T02:12:28.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.255+0000 7f6fdf44b640 1 --2- 172.21.15.134:0/591178648 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x560b8053b900 0x560b8053dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.255+0000 7f6fdf44b640 1 --2- 172.21.15.134:0/591178648 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x560b8053b900 0x560b8053dcf0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.256+0000 7f6fdf44b640 1 -- 172.21.15.134:0/591178648 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd0009050 con 0x560b8053b900 2024-04-24T02:12:28.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.256+0000 7f6fdf44b640 1 --2- 172.21.15.134:0/591178648 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f6fd0044b60 0x7f6fd0015720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.256+0000 7f6fdf44b640 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560b8053e3a0 con 0x7f6fd0044b60 2024-04-24T02:12:28.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.256+0000 7f6fe844d640 1 --2- 172.21.15.134:0/591178648 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f6fd0044b60 0x7f6fd0015720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.256+0000 7f6fe844d640 1 --2- 172.21.15.134:0/591178648 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f6fd0044b60 0x7f6fd0015720 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.256+0000 7f6fe844d640 1 -- 172.21.15.134:0/591178648 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fe001f070 con 0x7f6fd0044b60 2024-04-24T02:12:28.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.256+0000 7f6fe844d640 1 --2- 172.21.15.134:0/591178648 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f6fe0031040 0x7f6fe0032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.256+0000 7f6fe844d640 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560b8053e3a0 con 0x7f6fe0031040 2024-04-24T02:12:28.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.257+0000 7f6fe7c4c640 1 --2- 172.21.15.134:0/591178648 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f6fe0031040 0x7f6fe0032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.257+0000 7f6fe7c4c640 1 --2- 172.21.15.134:0/591178648 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f6fe0031040 0x7f6fe0032940 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.257+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd8009d30 con 0x7f6fe0031040 2024-04-24T02:12:28.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.257+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560b8053e3a0 con 0x560b805357e0 2024-04-24T02:12:28.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.257+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd8009d30 con 0x560b805357e0 2024-04-24T02:12:28.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.257+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560b8053e3a0 con 0x560b805357e0 2024-04-24T02:12:28.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.258+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6fd8009d30 con 0x560b805357e0 2024-04-24T02:12:28.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.258+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560b8053e3a0 con 0x7f6fe0031040 2024-04-24T02:12:28.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.258+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd8009d30 con 0x7f6fe0031040 2024-04-24T02:12:28.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.258+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560b8053e3a0 con 0x7f6fe0031040 2024-04-24T02:12:28.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.258+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd8009d30 con 0x7f6fe0031040 2024-04-24T02:12:28.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.258+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560b8053e3a0 con 0x7f6fd0044b60 2024-04-24T02:12:28.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.258+0000 7f6fe844d640 1 -- 172.21.15.134:0/591178648 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fe001f070 con 0x7f6fd0044b60 2024-04-24T02:12:28.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.258+0000 7f6fe844d640 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560b8053e3a0 con 0x560b8053b900 2024-04-24T02:12:28.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.258+0000 7f6fdf44b640 1 -- 172.21.15.134:0/591178648 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd0009050 con 0x560b8053b900 2024-04-24T02:12:28.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.258+0000 7f6fdf44b640 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560b8053e3a0 con 0x560b805357e0 2024-04-24T02:12:28.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.259+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd8009d30 con 0x560b805357e0 2024-04-24T02:12:28.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.259+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560b8053e3a0 con 0x7f6fe0031040 2024-04-24T02:12:28.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.259+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd8009d30 con 0x7f6fe0031040 2024-04-24T02:12:28.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.259+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560b8053e3a0 con 0x560b805357e0 2024-04-24T02:12:28.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.259+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd8009d30 con 0x560b805357e0 2024-04-24T02:12:28.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.259+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560b8053e3a0 con 0x7f6fd0044b60 2024-04-24T02:12:28.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.259+0000 7f6fe844d640 1 -- 172.21.15.134:0/591178648 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6fe001f070 con 0x7f6fd0044b60 2024-04-24T02:12:28.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.259+0000 7f6fe844d640 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560b8053e3a0 con 0x560b8053b900 2024-04-24T02:12:28.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.260+0000 7f6fdf44b640 1 -- 172.21.15.134:0/591178648 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd0009050 con 0x560b8053b900 2024-04-24T02:12:28.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.260+0000 7f6fdf44b640 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560b8053e3a0 con 0x560b8053b900 2024-04-24T02:12:28.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.260+0000 7f6fdf44b640 1 -- 172.21.15.134:0/591178648 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd0009050 con 0x560b8053b900 2024-04-24T02:12:28.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.260+0000 7f6fdf44b640 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560b8053e3a0 con 0x7f6fe0031040 2024-04-24T02:12:28.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.260+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd8009d30 con 0x7f6fe0031040 2024-04-24T02:12:28.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.260+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560b8053e3a0 con 0x560b8053b900 2024-04-24T02:12:28.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.260+0000 7f6fdf44b640 1 -- 172.21.15.134:0/591178648 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd0009050 con 0x560b8053b900 2024-04-24T02:12:28.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.260+0000 7f6fdf44b640 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560b8053e3a0 con 0x560b8053b900 2024-04-24T02:12:28.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.261+0000 7f6fdf44b640 1 -- 172.21.15.134:0/591178648 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd0009050 con 0x560b8053b900 2024-04-24T02:12:28.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.261+0000 7f6fdf44b640 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560b8053e3a0 con 0x560b805357e0 2024-04-24T02:12:28.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.261+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd8009d30 con 0x560b805357e0 2024-04-24T02:12:28.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.261+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560b8053e3a0 con 0x560b805357e0 2024-04-24T02:12:28.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.261+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f6fd8009d30 con 0x560b805357e0 2024-04-24T02:12:28.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.261+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560b8053e3a0 con 0x7f6fe0031040 2024-04-24T02:12:28.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.261+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd8009d30 con 0x7f6fe0031040 2024-04-24T02:12:28.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.261+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560b8053e3a0 con 0x560b8053b900 2024-04-24T02:12:28.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.262+0000 7f6fdf44b640 1 -- 172.21.15.134:0/591178648 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd0009050 con 0x560b8053b900 2024-04-24T02:12:28.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.262+0000 7f6fdf44b640 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560b8053e3a0 con 0x7f6fd0044b60 2024-04-24T02:12:28.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.262+0000 7f6fe844d640 1 -- 172.21.15.134:0/591178648 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fe001f070 con 0x7f6fd0044b60 2024-04-24T02:12:28.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.262+0000 7f6fe844d640 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560b8053e3a0 con 0x560b805357e0 2024-04-24T02:12:28.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.262+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd8009d30 con 0x560b805357e0 2024-04-24T02:12:28.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.262+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560b8053e3a0 con 0x7f6fe0031040 2024-04-24T02:12:28.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.262+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd8009d30 con 0x7f6fe0031040 2024-04-24T02:12:28.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.262+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560b8053e3a0 con 0x560b8053b900 2024-04-24T02:12:28.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.262+0000 7f6fdf44b640 1 -- 172.21.15.134:0/591178648 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd0009050 con 0x560b8053b900 2024-04-24T02:12:28.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.263+0000 7f6fdf44b640 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560b8053e3a0 con 0x7f6fe0031040 2024-04-24T02:12:28.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.263+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd8009d30 con 0x7f6fe0031040 2024-04-24T02:12:28.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.263+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560b8053e3a0 con 0x7f6fd0044b60 2024-04-24T02:12:28.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.263+0000 7f6fe844d640 1 -- 172.21.15.134:0/591178648 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fe001f070 con 0x7f6fd0044b60 2024-04-24T02:12:28.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.263+0000 7f6fe844d640 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560b8053e3a0 con 0x560b8053b900 2024-04-24T02:12:28.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.263+0000 7f6fdf44b640 1 -- 172.21.15.134:0/591178648 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd0009050 con 0x560b8053b900 2024-04-24T02:12:28.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.263+0000 7f6fdf44b640 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560b8053e3a0 con 0x7f6fe0031040 2024-04-24T02:12:28.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.264+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd8009d30 con 0x7f6fe0031040 2024-04-24T02:12:28.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.264+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560b8053e3a0 con 0x560b805357e0 2024-04-24T02:12:28.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.264+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6fd8009d30 con 0x560b805357e0 2024-04-24T02:12:28.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.264+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560b8053e3a0 con 0x7f6fd0044b60 2024-04-24T02:12:28.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.264+0000 7f6fe844d640 1 -- 172.21.15.134:0/591178648 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fe001f070 con 0x7f6fd0044b60 2024-04-24T02:12:28.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.264+0000 7f6fea146800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:28.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.264+0000 7f6fea146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:28.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.264+0000 7f6fea146800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:28.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.264+0000 7f6fea146800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:28.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.264+0000 7f6fea146800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:28.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.264+0000 7f6fea146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:28.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.264+0000 7f6fea146800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.264+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560b8053a380 con 0x560b805357e0 2024-04-24T02:12:28.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.264+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6fd8009d30 con 0x560b805357e0 2024-04-24T02:12:28.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.264+0000 7f6fea146800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:28.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.264+0000 7f6fea146800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.264+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560b8053ac20 con 0x560b805357e0 2024-04-24T02:12:28.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.264+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6fd8009d30 con 0x560b805357e0 2024-04-24T02:12:28.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.264+0000 7f6fea146800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:28.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.264+0000 7f6fea146800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.264+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560b80539fc0 con 0x560b805357e0 2024-04-24T02:12:28.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.265+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6fd8009d30 con 0x560b805357e0 2024-04-24T02:12:28.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.265+0000 7f6fea146800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:28.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.265+0000 7f6fea146800 20 zone default found 2024-04-24T02:12:28.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.265+0000 7f6fea146800 4 Realm: () 2024-04-24T02:12:28.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.265+0000 7f6fea146800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:28.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.265+0000 7f6fea146800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:28.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.265+0000 7f6fea146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:28.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.265+0000 7f6fea146800 20 zonegroup default 2024-04-24T02:12:28.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.265+0000 7f6fea146800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.265+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560b8053e800 con 0x7f6fe0031040 2024-04-24T02:12:28.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.265+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6fd8009d30 con 0x7f6fe0031040 2024-04-24T02:12:28.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.265+0000 7f6fea146800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:28.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.265+0000 7f6fea146800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.265+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560b80540690 con 0x560b8053b900 2024-04-24T02:12:28.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.265+0000 7f6fdf44b640 1 -- 172.21.15.134:0/591178648 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6fd0009050 con 0x560b8053b900 2024-04-24T02:12:28.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.265+0000 7f6fea146800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:28.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.265+0000 7f6fea146800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.265+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560b80540a30 con 0x560b8053b900 2024-04-24T02:12:28.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.266+0000 7f6fdf44b640 1 -- 172.21.15.134:0/591178648 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6fd0009050 con 0x560b8053b900 2024-04-24T02:12:28.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.266+0000 7f6fea146800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:28.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.266+0000 7f6fea146800 20 started sync module instance, tier type = 2024-04-24T02:12:28.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.266+0000 7f6fea146800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:28.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.266+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560b8053fad0 con 0x7f6fd0044b60 2024-04-24T02:12:28.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.267+0000 7f6fe844d640 1 -- 172.21.15.134:0/591178648 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fe0040040 con 0x7f6fd0044b60 2024-04-24T02:12:28.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.267+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94607397617312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560b805402c0 con 0x7f6fd0044b60 2024-04-24T02:12:28.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.267+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560b805418a0 con 0x560b805357e0 2024-04-24T02:12:28.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.268+0000 7f6fe844d640 1 -- 172.21.15.134:0/591178648 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94607397617312] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fe0040040 con 0x7f6fd0044b60 2024-04-24T02:12:28.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.268+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fd8009d30 con 0x560b805357e0 2024-04-24T02:12:28.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.268+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94607397621200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560b805418a0 con 0x560b805357e0 2024-04-24T02:12:28.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.268+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560b805422a0 con 0x560b8053b900 2024-04-24T02:12:28.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.269+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94607397621200] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fd8009d30 con 0x560b805357e0 2024-04-24T02:12:28.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.269+0000 7f6fdf44b640 1 -- 172.21.15.134:0/591178648 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fd0009050 con 0x560b8053b900 2024-04-24T02:12:28.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.270+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94607397622768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560b80541810 con 0x560b8053b900 2024-04-24T02:12:28.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.270+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560b80543160 con 0x7f6fd0044b60 2024-04-24T02:12:28.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.270+0000 7f6fdf44b640 1 -- 172.21.15.134:0/591178648 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94607397622768] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fd0009050 con 0x560b8053b900 2024-04-24T02:12:28.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.271+0000 7f6fe844d640 1 -- 172.21.15.134:0/591178648 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fe0040040 con 0x7f6fd0044b60 2024-04-24T02:12:28.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.271+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94607397629104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560b80543580 con 0x7f6fd0044b60 2024-04-24T02:12:28.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.271+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560b80543f40 con 0x560b805357e0 2024-04-24T02:12:28.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.272+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fd8009d30 con 0x560b805357e0 2024-04-24T02:12:28.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.272+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94607397632656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560b80543ef0 con 0x560b805357e0 2024-04-24T02:12:28.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.272+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560b80544ef0 con 0x7f6fe0031040 2024-04-24T02:12:28.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.273+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fd8009d30 con 0x7f6fe0031040 2024-04-24T02:12:28.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.273+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94607397636608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560b80544e60 con 0x7f6fe0031040 2024-04-24T02:12:28.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.273+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560b80545e50 con 0x7f6fe0031040 2024-04-24T02:12:28.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.273+0000 7f6fe844d640 1 -- 172.21.15.134:0/591178648 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94607397629104] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fe0040040 con 0x7f6fd0044b60 2024-04-24T02:12:28.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.273+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94607397632656] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fd8009d30 con 0x560b805357e0 2024-04-24T02:12:28.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.274+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(56 notify.6 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fd8009d30 con 0x7f6fe0031040 2024-04-24T02:12:28.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.274+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94607397630160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560b80544330 con 0x7f6fe0031040 2024-04-24T02:12:28.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.274+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560b80546300 con 0x7f6fe0031040 2024-04-24T02:12:28.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.274+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94607397636608] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fd8009d30 con 0x7f6fe0031040 2024-04-24T02:12:28.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.274+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(58 notify.7 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fd8009d30 con 0x7f6fe0031040 2024-04-24T02:12:28.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.274+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94607397638800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560b80546300 con 0x7f6fe0031040 2024-04-24T02:12:28.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.275+0000 7f6fea146800 20 add_watcher() i=0 2024-04-24T02:12:28.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.275+0000 7f6fea146800 20 add_watcher() i=1 2024-04-24T02:12:28.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.275+0000 7f6fea146800 20 add_watcher() i=2 2024-04-24T02:12:28.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.275+0000 7f6fea146800 20 add_watcher() i=3 2024-04-24T02:12:28.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.275+0000 7f6fea146800 20 add_watcher() i=4 2024-04-24T02:12:28.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.275+0000 7f6fea146800 20 add_watcher() i=5 2024-04-24T02:12:28.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.275+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94607397630160] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fd8009d30 con 0x7f6fe0031040 2024-04-24T02:12:28.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.275+0000 7f6fea146800 20 add_watcher() i=6 2024-04-24T02:12:28.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.275+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94607397638800] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fd8009d30 con 0x7f6fe0031040 2024-04-24T02:12:28.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.275+0000 7f6fea146800 20 add_watcher() i=7 2024-04-24T02:12:28.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.275+0000 7f6fea146800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:28.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.275+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560b80549330 con 0x560b805357e0 2024-04-24T02:12:28.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.276+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6fd8009d30 con 0x560b805357e0 2024-04-24T02:12:28.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.276+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94607397641808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560b80546720 con 0x560b805357e0 2024-04-24T02:12:28.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.277+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94607397641808] v30'151 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6fd8009d30 con 0x560b805357e0 2024-04-24T02:12:28.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.277+0000 7f6e9dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:28.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.277+0000 7f6fea146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:28.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.277+0000 7f6fea146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:28.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.277+0000 7f6fea146800 5 note: GC not initialized 2024-04-24T02:12:28.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.277+0000 7f6e9cfe1640 20 reqs_thread_entry: start 2024-04-24T02:12:28.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.278+0000 7f6fea146800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:28.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.278+0000 7f6fea146800 20 Filter name: none 2024-04-24T02:12:28.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.278+0000 7f6e167fc640 20 reqs_thread_entry: start 2024-04-24T02:12:28.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.278+0000 7f6fea146800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.278+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560b8057c530 con 0x7f6fd0044b60 2024-04-24T02:12:28.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.278+0000 7f6fe844d640 1 -- 172.21.15.134:0/591178648 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f6fe0040040 con 0x7f6fd0044b60 2024-04-24T02:12:28.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.278+0000 7f6fea146800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T02:12:28.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.278+0000 7f6fea146800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.278+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:63 8.1d 8:be2d2b4a:root::.bucket.meta.myfoo%3a582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560b8057cdc0 con 0x7f6fe0031040 2024-04-24T02:12:28.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.278+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(63 .bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f6fd8009d30 con 0x7f6fe0031040 2024-04-24T02:12:28.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.279+0000 7f6fea146800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T02:12:28.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.279+0000 7f6fea146800 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-24T02:12:28.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.279+0000 7f6fea146800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.279+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560b8057b910 con 0x7f6fd0044b60 2024-04-24T02:12:28.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.279+0000 7f6fe844d640 1 -- 172.21.15.134:0/591178648 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f6fe0040040 con 0x7f6fd0044b60 2024-04-24T02:12:28.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.279+0000 7f6fea146800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T02:12:28.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.279+0000 7f6fea146800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.279+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:65 8.1d 8:be2d2b4a:root::.bucket.meta.myfoo%3a582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560b8057b960 con 0x7f6fe0031040 2024-04-24T02:12:28.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.279+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(65 .bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f6fd8009d30 con 0x7f6fe0031040 2024-04-24T02:12:28.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.279+0000 7f6fea146800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T02:12:28.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.279+0000 7f6fea146800 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-24T02:12:28.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.279+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:66 4.2f 4:f4626d03:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560b8057f920 con 0x560b805357e0 2024-04-24T02:12:28.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.279+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:67 4.2f 4:f41e46b8:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560b80582480 con 0x560b805357e0 2024-04-24T02:12:28.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.279+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:68 4.39 4:9e407d1f:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560b80584fc0 con 0x560b8053b900 2024-04-24T02:12:28.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.279+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:69 4.3 4:c3c22538:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560b80587830 con 0x560b805357e0 2024-04-24T02:12:28.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.279+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:70 4.b 4:d224abc6:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560b80589e00 con 0x7f6fd0044b60 2024-04-24T02:12:28.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.279+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:71 4.e 4:706a3c35:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560b8058c830 con 0x7f6fd0044b60 2024-04-24T02:12:28.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.280+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:72 4.0 4:009d6733:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560b8058f660 con 0x560b8053b900 2024-04-24T02:12:28.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.280+0000 7f6fdf44b640 1 -- 172.21.15.134:0/591178648 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(68 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6fd0009050 con 0x560b8053b900 2024-04-24T02:12:28.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.280+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:73 4.39 4:9c24c7ad:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560b8058ffd0 con 0x560b8053b900 2024-04-24T02:12:28.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.280+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(66 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6fd8009d30 con 0x560b805357e0 2024-04-24T02:12:28.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.280+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:74 4.35 4:aece7739:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560b8057d410 con 0x560b805357e0 2024-04-24T02:12:28.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.280+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(69 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6fd8009d30 con 0x560b805357e0 2024-04-24T02:12:28.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.280+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:75 4.24 4:2482d015:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560b8057f260 con 0x7f6fe0031040 2024-04-24T02:12:28.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.280+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:76 4.0 4:03cc5f7d:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560b805853e0 con 0x560b8053b900 2024-04-24T02:12:28.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.280+0000 7f6fe844d640 1 -- 172.21.15.134:0/591178648 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(70 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6fe0040040 con 0x7f6fd0044b60 2024-04-24T02:12:28.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.280+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(67 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.1 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6fd8009d30 con 0x560b805357e0 2024-04-24T02:12:28.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.280+0000 7f6fdf44b640 1 -- 172.21.15.134:0/591178648 <== osd.3 v2:172.21.15.134:6801/3585115521 15 ==== osd_op_reply(72 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.6 [call out=124b] v0'0 uv8 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f6fd0009050 con 0x560b8053b900 2024-04-24T02:12:28.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.280+0000 7f6fdf44b640 1 -- 172.21.15.134:0/591178648 <== osd.3 v2:172.21.15.134:6801/3585115521 16 ==== osd_op_reply(73 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6fd0009050 con 0x560b8053b900 2024-04-24T02:12:28.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.280+0000 7f6fe844d640 1 -- 172.21.15.134:0/591178648 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(71 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.5 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f6fe0040040 con 0x7f6fd0044b60 2024-04-24T02:12:28.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.280+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(74 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.8 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f6fd8009d30 con 0x560b805357e0 2024-04-24T02:12:28.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.280+0000 7f6fdf44b640 1 -- 172.21.15.134:0/591178648 <== osd.3 v2:172.21.15.134:6801/3585115521 17 ==== osd_op_reply(76 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.10 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f6fd0009050 con 0x560b8053b900 2024-04-24T02:12:28.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.280+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(75 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6fd8009d30 con 0x7f6fe0031040 2024-04-24T02:12:28.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.281+0000 7f6e9dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:28.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.281+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94607397641808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560b8057d410 con 0x560b805357e0 2024-04-24T02:12:28.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.282+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94607397641808] v30'152 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6fd8009d30 con 0x560b805357e0 2024-04-24T02:12:28.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.282+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94607397617312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560b8057d410 con 0x7f6fd0044b60 2024-04-24T02:12:28.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.283+0000 7f6fe844d640 1 -- 172.21.15.134:0/591178648 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94607397617312] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fe0040040 con 0x7f6fd0044b60 2024-04-24T02:12:28.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.283+0000 7f6fea146800 20 remove_watcher() i=0 2024-04-24T02:12:28.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.283+0000 7f6fea146800 2 removed watcher, disabling cache 2024-04-24T02:12:28.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.283+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94607397621200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560b80564cb0 con 0x560b805357e0 2024-04-24T02:12:28.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.284+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94607397621200] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fd8009d30 con 0x560b805357e0 2024-04-24T02:12:28.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.284+0000 7f6fea146800 20 remove_watcher() i=1 2024-04-24T02:12:28.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.284+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94607397622768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560b80564cb0 con 0x560b8053b900 2024-04-24T02:12:28.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.285+0000 7f6fdf44b640 1 -- 172.21.15.134:0/591178648 <== osd.3 v2:172.21.15.134:6801/3585115521 18 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94607397622768] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fd0009050 con 0x560b8053b900 2024-04-24T02:12:28.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.285+0000 7f6fea146800 20 remove_watcher() i=2 2024-04-24T02:12:28.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.285+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94607397629104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560b80564cb0 con 0x7f6fd0044b60 2024-04-24T02:12:28.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.286+0000 7f6fe844d640 1 -- 172.21.15.134:0/591178648 <== osd.2 v2:172.21.15.134:6800/214480313 16 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94607397629104] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fe0040040 con 0x7f6fd0044b60 2024-04-24T02:12:28.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.286+0000 7f6fea146800 20 remove_watcher() i=3 2024-04-24T02:12:28.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.286+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94607397632656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560b80564cb0 con 0x560b805357e0 2024-04-24T02:12:28.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.287+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94607397632656] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fd8009d30 con 0x560b805357e0 2024-04-24T02:12:28.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.287+0000 7f6fea146800 20 remove_watcher() i=4 2024-04-24T02:12:28.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.287+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94607397636608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560b80564cb0 con 0x7f6fe0031040 2024-04-24T02:12:28.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.288+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.0 v2:172.21.15.104:6800/2419146313 20 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94607397636608] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fd8009d30 con 0x7f6fe0031040 2024-04-24T02:12:28.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.288+0000 7f6fea146800 20 remove_watcher() i=5 2024-04-24T02:12:28.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.288+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94607397630160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560b80564cb0 con 0x7f6fe0031040 2024-04-24T02:12:28.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.289+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.0 v2:172.21.15.104:6800/2419146313 21 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94607397630160] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fd8009d30 con 0x7f6fe0031040 2024-04-24T02:12:28.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.289+0000 7f6fea146800 20 remove_watcher() i=6 2024-04-24T02:12:28.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.289+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94607397638800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560b80564cb0 con 0x7f6fe0031040 2024-04-24T02:12:28.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.290+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 <== osd.0 v2:172.21.15.104:6800/2419146313 22 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94607397638800] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fd8009d30 con 0x7f6fe0031040 2024-04-24T02:12:28.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.290+0000 7f6fea146800 20 remove_watcher() i=7 2024-04-24T02:12:28.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.290+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f6fe0031040 msgr2=0x7f6fe0032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.290+0000 7f6fea146800 1 --2- 172.21.15.134:0/591178648 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f6fe0031040 0x7f6fe0032940 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.290+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560b805357e0 msgr2=0x560b80537c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.290+0000 7f6fea146800 1 --2- 172.21.15.134:0/591178648 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560b805357e0 0x560b80537c80 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.290+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f6fd0044b60 msgr2=0x7f6fd0015720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.290+0000 7f6fea146800 1 --2- 172.21.15.134:0/591178648 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f6fd0044b60 0x7f6fd0015720 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.290+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x560b8053b900 msgr2=0x560b8053dcf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.290+0000 7f6fea146800 1 --2- 172.21.15.134:0/591178648 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x560b8053b900 0x560b8053dcf0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.290+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6eb0036950 msgr2=0x7f6eb0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.290+0000 7f6fea146800 1 --2- 172.21.15.134:0/591178648 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6eb0036950 0x7f6eb0038e10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x560b80377100 tx=0x7f6fe001f000 comp rx=0 tx=0).stop 2024-04-24T02:12:28.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.290+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b80522880 msgr2=0x560b80529ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.290+0000 7f6fe7c4c640 1 -- 172.21.15.134:0/591178648 reap_dead start 2024-04-24T02:12:28.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.290+0000 7f6fea146800 1 --2- 172.21.15.134:0/591178648 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b80522880 0x560b80529ef0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f6fd0019d20 tx=0x7f6fd004cda0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.291+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 shutdown_connections 2024-04-24T02:12:28.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.291+0000 7f6fea146800 1 --2- 172.21.15.134:0/591178648 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b80522880 0x560b80529ef0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.291+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 >> 172.21.15.134:0/591178648 conn(0x560b8051ebe0 msgr2=0x560b8051c240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:28.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.291+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 shutdown_connections 2024-04-24T02:12:28.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.291+0000 7f6fea146800 1 -- 172.21.15.134:0/591178648 wait complete. 2024-04-24T02:12:28.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.291+0000 7f6fea146800 1 -- 172.21.15.134:0/432693019 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6ec0036950 msgr2=0x7f6ec0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.291+0000 7f6fea146800 1 --2- 172.21.15.134:0/432693019 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6ec0036950 0x7f6ec0038e10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x560b805055d0 tx=0x7f6fe0005840 comp rx=0 tx=0).stop 2024-04-24T02:12:28.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.291+0000 7f6fea146800 1 -- 172.21.15.134:0/432693019 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b80515540 msgr2=0x560b80515960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.291+0000 7f6fea146800 1 --2- 172.21.15.134:0/432693019 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b80515540 0x560b80515960 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f6fd0001ed0 tx=0x7f6fd000d7a0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.291+0000 7f6fea146800 1 -- 172.21.15.134:0/432693019 shutdown_connections 2024-04-24T02:12:28.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.291+0000 7f6fea146800 1 --2- 172.21.15.134:0/432693019 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6ec0036950 0x7f6ec0038e10 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.291+0000 7f6fea146800 1 --2- 172.21.15.134:0/432693019 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b80515540 0x560b80515960 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.291+0000 7f6fea146800 1 -- 172.21.15.134:0/432693019 >> 172.21.15.134:0/432693019 conn(0x560b805095e0 msgr2=0x560b805099e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:28.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.291+0000 7f6fea146800 1 -- 172.21.15.134:0/432693019 shutdown_connections 2024-04-24T02:12:28.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.291+0000 7f6fea146800 1 -- 172.21.15.134:0/432693019 wait complete. 2024-04-24T02:12:28.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.291+0000 7f6fea146800 1 -- 172.21.15.134:0/2410102268 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560b80403100 msgr2=0x560b805043d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.291+0000 7f6fea146800 1 --2- 172.21.15.134:0/2410102268 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560b80403100 0x560b805043d0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.291+0000 7f6fea146800 1 -- 172.21.15.134:0/2410102268 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6ed0036950 msgr2=0x7f6ed0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.291+0000 7f6fea146800 1 --2- 172.21.15.134:0/2410102268 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6ed0036950 0x7f6ed0038e10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6fd0000f60 tx=0x7f6fd00012b0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.291+0000 7f6fea146800 1 -- 172.21.15.134:0/2410102268 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b80401f90 msgr2=0x560b80377950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.291+0000 7f6fea146800 1 --2- 172.21.15.134:0/2410102268 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b80401f90 0x560b80377950 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8000c00 tx=0x7f6fd8002fb0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.291+0000 7f6fea146800 1 -- 172.21.15.134:0/2410102268 shutdown_connections 2024-04-24T02:12:28.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.291+0000 7f6fea146800 1 --2- 172.21.15.134:0/2410102268 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560b80403100 0x560b805043d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.291+0000 7f6fea146800 1 --2- 172.21.15.134:0/2410102268 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6ed0036950 0x7f6ed0038e10 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.291+0000 7f6fea146800 1 --2- 172.21.15.134:0/2410102268 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b80401f90 0x560b80377950 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.291+0000 7f6fea146800 1 -- 172.21.15.134:0/2410102268 >> 172.21.15.134:0/2410102268 conn(0x560b803fd530 msgr2=0x560b804ed620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:28.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.292+0000 7f6fea146800 1 -- 172.21.15.134:0/2410102268 shutdown_connections 2024-04-24T02:12:28.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.292+0000 7f6fea146800 1 -- 172.21.15.134:0/2410102268 wait complete. 2024-04-24T02:12:28.315 INFO:teuthology.orchestra.run.smithi134.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"b893fd8a-cafc-4918-98fa-f8aa8e20a508","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1","marker":"582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-04-24T02:12:27.828790Z","creation_time":"2024-04-24T02:12:24.901996Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-04-24T02:12:28.315 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'b893fd8a-cafc-4918-98fa-f8aa8e20a508', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1', 'marker': '582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-24T02:12:27.828790Z', 'creation_time': '2024-04-24T02:12:24.901996Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-04-24T02:12:28.315 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-04-24T02:12:28.315 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-04-24T02:12:28.316 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-04-24T02:12:28.396 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:28.396 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:28.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.396+0000 7fca1572e800 1 Processor -- start 2024-04-24T02:12:28.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.397+0000 7fca1572e800 1 -- start start 2024-04-24T02:12:28.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.397+0000 7fca1572e800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55c2d99fd770 0x55c2d99fdb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.397+0000 7fca1572e800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c2d98bdd40 con 0x55c2d99fe0d0 2024-04-24T02:12:28.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.397+0000 7fca1572e800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55c2d98904d0 con 0x55c2d99fd770 2024-04-24T02:12:28.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.397+0000 7fca11467640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55c2d99fd770 0x55c2d99fdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.397+0000 7fca11467640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55c2d99fd770 0x55c2d99fdb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56718/0 (socket says 172.21.15.134:56718) 2024-04-24T02:12:28.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.397+0000 7fca0bfff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55c2d99fe0d0 0x55c2d99fe580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:55348/0 (socket says 172.21.15.134:55348) 2024-04-24T02:12:28.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.397+0000 7fca11467640 1 -- 172.21.15.134:0/3862389762 learned_addr learned my addr 172.21.15.134:0/3862389762 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:28.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.397+0000 7fca11467640 1 -- 172.21.15.134:0/3862389762 >> v1:172.21.15.104:6789/0 conn(0x55c2d99fe0d0 legacy=0x55c2d99fe580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.397+0000 7fca11467640 1 -- 172.21.15.134:0/3862389762 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2d98bc590 con 0x55c2d99fd770 2024-04-24T02:12:28.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.399+0000 7fca11467640 1 --2- 172.21.15.134:0/3862389762 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2d99fd770 0x55c2d99fdb90 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fca0400a520 tx=0x7fca0401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=101a3dc39531372e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.399+0000 7fca10c66640 1 -- 172.21.15.134:0/3862389762 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca04057070 con 0x55c2d99fd770 2024-04-24T02:12:28.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.399+0000 7fca10c66640 1 -- 172.21.15.134:0/3862389762 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca04052570 con 0x55c2d99fd770 2024-04-24T02:12:28.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.399+0000 7fca10c66640 1 -- 172.21.15.134:0/3862389762 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca04052870 con 0x55c2d99fd770 2024-04-24T02:12:28.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.400+0000 7fca1572e800 1 -- 172.21.15.134:0/3862389762 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2d99fd770 msgr2=0x55c2d99fdb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.400+0000 7fca1572e800 1 --2- 172.21.15.134:0/3862389762 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2d99fd770 0x55c2d99fdb90 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fca0400a520 tx=0x7fca0401d010 comp rx=0 tx=0).stop 2024-04-24T02:12:28.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.400+0000 7fca1572e800 1 -- 172.21.15.134:0/3862389762 shutdown_connections 2024-04-24T02:12:28.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.400+0000 7fca1572e800 1 --2- 172.21.15.134:0/3862389762 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2d99fd770 0x55c2d99fdb90 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.400+0000 7fca1572e800 1 -- 172.21.15.134:0/3862389762 >> 172.21.15.134:0/3862389762 conn(0x55c2d99f9310 msgr2=0x55c2d99fb730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:28.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.400+0000 7fca1572e800 1 -- 172.21.15.134:0/3862389762 shutdown_connections 2024-04-24T02:12:28.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.400+0000 7fca1572e800 1 -- 172.21.15.134:0/3862389762 wait complete. 2024-04-24T02:12:28.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.411+0000 7fca1572e800 1 Processor -- start 2024-04-24T02:12:28.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.411+0000 7fca1572e800 1 -- start start 2024-04-24T02:12:28.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.411+0000 7fca1572e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2d99fd770 0x55c2d9af23e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.411+0000 7fca1572e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c2d994a3b0 con 0x55c2d99fd770 2024-04-24T02:12:28.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.412+0000 7fca11467640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2d99fd770 0x55c2d9af23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.412+0000 7fca11467640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2d99fd770 0x55c2d9af23e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56732/0 (socket says 172.21.15.134:56732) 2024-04-24T02:12:28.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.412+0000 7fca11467640 1 -- 172.21.15.134:0/4252733152 learned_addr learned my addr 172.21.15.134:0/4252733152 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:28.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.412+0000 7fca11467640 1 -- 172.21.15.134:0/4252733152 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2d9af29b0 con 0x55c2d99fd770 2024-04-24T02:12:28.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.412+0000 7fca11467640 1 --2- 172.21.15.134:0/4252733152 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2d99fd770 0x55c2d9af23e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fca04055040 tx=0x7fca0404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d78ab8884a9314f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.412+0000 7fc8ff606640 1 -- 172.21.15.134:0/4252733152 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca04057040 con 0x55c2d99fd770 2024-04-24T02:12:28.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.412+0000 7fc8ff606640 1 -- 172.21.15.134:0/4252733152 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca04052870 con 0x55c2d99fd770 2024-04-24T02:12:28.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.412+0000 7fc8ff606640 1 -- 172.21.15.134:0/4252733152 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca04052b90 con 0x55c2d99fd770 2024-04-24T02:12:28.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.413+0000 7fca1572e800 1 -- 172.21.15.134:0/4252733152 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2d99fd770 msgr2=0x55c2d9af23e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.413+0000 7fca1572e800 1 --2- 172.21.15.134:0/4252733152 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2d99fd770 0x55c2d9af23e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fca04055040 tx=0x7fca0404c000 comp rx=0 tx=0).stop 2024-04-24T02:12:28.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.413+0000 7fca1572e800 1 -- 172.21.15.134:0/4252733152 shutdown_connections 2024-04-24T02:12:28.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.413+0000 7fca1572e800 1 --2- 172.21.15.134:0/4252733152 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2d99fd770 0x55c2d9af23e0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.413+0000 7fca1572e800 1 -- 172.21.15.134:0/4252733152 >> 172.21.15.134:0/4252733152 conn(0x55c2d99f9310 msgr2=0x55c2d9aedd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:28.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.413+0000 7fca1572e800 1 -- 172.21.15.134:0/4252733152 shutdown_connections 2024-04-24T02:12:28.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.413+0000 7fca1572e800 1 -- 172.21.15.134:0/4252733152 wait complete. 2024-04-24T02:12:28.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.413+0000 7fca1572e800 1 Processor -- start 2024-04-24T02:12:28.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.413+0000 7fca1572e800 1 -- start start 2024-04-24T02:12:28.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.413+0000 7fca1572e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2d99fd770 0x55c2d9af9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.413+0000 7fca1572e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c2d99fef30 con 0x55c2d99fd770 2024-04-24T02:12:28.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.414+0000 7fca11467640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2d99fd770 0x55c2d9af9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.414+0000 7fca11467640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2d99fd770 0x55c2d9af9f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56740/0 (socket says 172.21.15.134:56740) 2024-04-24T02:12:28.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.414+0000 7fca11467640 1 -- 172.21.15.134:0/3229896866 learned_addr learned my addr 172.21.15.134:0/3229896866 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:28.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.414+0000 7fca11467640 1 -- 172.21.15.134:0/3229896866 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2d9afa460 con 0x55c2d99fd770 2024-04-24T02:12:28.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.414+0000 7fca11467640 1 --2- 172.21.15.134:0/3229896866 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2d99fd770 0x55c2d9af9f20 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fca04052540 tx=0x7fca04003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.414+0000 7fc8fde03640 1 -- 172.21.15.134:0/3229896866 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca04073070 con 0x55c2d99fd770 2024-04-24T02:12:28.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.414+0000 7fc8fde03640 1 -- 172.21.15.134:0/3229896866 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca0405d570 con 0x55c2d99fd770 2024-04-24T02:12:28.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.414+0000 7fca1572e800 1 -- 172.21.15.134:0/3229896866 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c2d9afa6f0 con 0x55c2d99fd770 2024-04-24T02:12:28.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.414+0000 7fc8fde03640 1 -- 172.21.15.134:0/3229896866 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca04057070 con 0x55c2d99fd770 2024-04-24T02:12:28.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.414+0000 7fca1572e800 1 -- 172.21.15.134:0/3229896866 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2d9afd300 con 0x55c2d99fd770 2024-04-24T02:12:28.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.415+0000 7fc8fde03640 1 -- 172.21.15.134:0/3229896866 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fca04076070 con 0x55c2d99fd770 2024-04-24T02:12:28.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.415+0000 7fc8fde03640 1 --2- 172.21.15.134:0/3229896866 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc8f8036900 0x7fc8f8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.415+0000 7fc8fde03640 1 -- 172.21.15.134:0/3229896866 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fca0408dc00 con 0x55c2d99fd770 2024-04-24T02:12:28.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.415+0000 7fca0bfff640 1 --2- 172.21.15.134:0/3229896866 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc8f8036900 0x7fc8f8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.415+0000 7fca1572e800 1 --2- 172.21.15.134:0/3229896866 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c2d99fe0d0 0x55c2d9b010c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.415+0000 7fca1572e800 1 -- 172.21.15.134:0/3229896866 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b01600 con 0x55c2d99fe0d0 2024-04-24T02:12:28.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.415+0000 7fca11c68640 1 --2- 172.21.15.134:0/3229896866 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c2d99fe0d0 0x55c2d9b010c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.416+0000 7fca0bfff640 1 --2- 172.21.15.134:0/3229896866 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc8f8036900 0x7fc8f8038dc0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc000f60 tx=0x7fc9fc001370 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.416+0000 7fca11c68640 1 --2- 172.21.15.134:0/3229896866 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c2d99fe0d0 0x55c2d9b010c0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.416+0000 7fca11c68640 1 -- 172.21.15.134:0/3229896866 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca0c00a4a0 con 0x55c2d99fe0d0 2024-04-24T02:12:28.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.416+0000 7fca1572e800 1 -- 172.21.15.134:0/3229896866 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9afe690 con 0x55c2d99fe0d0 2024-04-24T02:12:28.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.416+0000 7fca11c68640 1 -- 172.21.15.134:0/3229896866 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fca0c00a4a0 con 0x55c2d99fe0d0 2024-04-24T02:12:28.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.416+0000 7fca1572e800 1 -- 172.21.15.134:0/3229896866 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b03420 con 0x55c2d99fe0d0 2024-04-24T02:12:28.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.417+0000 7fca11c68640 1 -- 172.21.15.134:0/3229896866 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fca0c00a4a0 con 0x55c2d99fe0d0 2024-04-24T02:12:28.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.417+0000 7fca1572e800 1 -- 172.21.15.134:0/3229896866 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b02760 con 0x55c2d99fe0d0 2024-04-24T02:12:28.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.417+0000 7fca11c68640 1 -- 172.21.15.134:0/3229896866 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fca0c00a4a0 con 0x55c2d99fe0d0 2024-04-24T02:12:28.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.417+0000 7fca1572e800 1 -- 172.21.15.134:0/3229896866 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b02b80 con 0x55c2d99fe0d0 2024-04-24T02:12:28.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.417+0000 7fca11c68640 1 -- 172.21.15.134:0/3229896866 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fca0c00a4a0 con 0x55c2d99fe0d0 2024-04-24T02:12:28.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.417+0000 7fca1572e800 1 Processor -- start 2024-04-24T02:12:28.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.417+0000 7fca1572e800 1 -- start start 2024-04-24T02:12:28.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.418+0000 7fca1572e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2d9b12230 0x55c2d9b12650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.418+0000 7fca1572e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c2d98f06b0 con 0x55c2d9b12230 2024-04-24T02:12:28.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.418+0000 7fca0bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2d9b12230 0x55c2d9b12650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.418+0000 7fca0bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2d9b12230 0x55c2d9b12650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56754/0 (socket says 172.21.15.134:56754) 2024-04-24T02:12:28.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.418+0000 7fca0bfff640 1 -- 172.21.15.134:0/1624739384 learned_addr learned my addr 172.21.15.134:0/1624739384 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:28.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.418+0000 7fca0bfff640 1 -- 172.21.15.134:0/1624739384 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2d9b12b90 con 0x55c2d9b12230 2024-04-24T02:12:28.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.418+0000 7fca0bfff640 1 --2- 172.21.15.134:0/1624739384 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2d9b12230 0x55c2d9b12650 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc001ed0 tx=0x7fc9fc00ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.418+0000 7fc8f6ffd640 1 -- 172.21.15.134:0/1624739384 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9fc022070 con 0x55c2d9b12230 2024-04-24T02:12:28.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.419+0000 7fc8f6ffd640 1 -- 172.21.15.134:0/1624739384 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9fc00d520 con 0x55c2d9b12230 2024-04-24T02:12:28.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.419+0000 7fc8f6ffd640 1 -- 172.21.15.134:0/1624739384 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9fc00d800 con 0x55c2d9b12230 2024-04-24T02:12:28.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.419+0000 7fca1572e800 1 -- 172.21.15.134:0/1624739384 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c2d9b13600 con 0x55c2d9b12230 2024-04-24T02:12:28.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.419+0000 7fca1572e800 1 -- 172.21.15.134:0/1624739384 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2d9b13b00 con 0x55c2d9b12230 2024-04-24T02:12:28.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.419+0000 7fc8f6ffd640 1 -- 172.21.15.134:0/1624739384 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc9fc025070 con 0x55c2d9b12230 2024-04-24T02:12:28.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.419+0000 7fc8f6ffd640 1 --2- 172.21.15.134:0/1624739384 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc8e8036950 0x7fc8e8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.419+0000 7fc8f6ffd640 1 -- 172.21.15.134:0/1624739384 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc9fc04dba0 con 0x55c2d9b12230 2024-04-24T02:12:28.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.420+0000 7fca11c68640 1 --2- 172.21.15.134:0/1624739384 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc8e8036950 0x7fc8e8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.420+0000 7fca1572e800 1 Processor -- start 2024-04-24T02:12:28.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.420+0000 7fca1572e800 1 -- start start 2024-04-24T02:12:28.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.420+0000 7fca11c68640 1 --2- 172.21.15.134:0/1624739384 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc8e8036950 0x7fc8e8038e10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x55c2d9b02b00 tx=0x7fca0c005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.420+0000 7fca1572e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2d9b1f530 0x55c2d9b1f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.420+0000 7fca1572e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c2d9af2c70 con 0x55c2d9b1f530 2024-04-24T02:12:28.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.420+0000 7fca0bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2d9b1f530 0x55c2d9b1f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.420+0000 7fca0bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2d9b1f530 0x55c2d9b1f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56766/0 (socket says 172.21.15.134:56766) 2024-04-24T02:12:28.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.420+0000 7fca0bfff640 1 -- 172.21.15.134:0/898982332 learned_addr learned my addr 172.21.15.134:0/898982332 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:28.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.420+0000 7fca0bfff640 1 -- 172.21.15.134:0/898982332 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2d9b1ff20 con 0x55c2d9b1f530 2024-04-24T02:12:28.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.421+0000 7fca0bfff640 1 --2- 172.21.15.134:0/898982332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2d9b1f530 0x55c2d9b1f950 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc00eee0 tx=0x7fc9fc024740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d81b52b4734b587 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.421+0000 7fc8f4ff9640 1 -- 172.21.15.134:0/898982332 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9fc04a030 con 0x55c2d9b1f530 2024-04-24T02:12:28.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.421+0000 7fc8f4ff9640 1 -- 172.21.15.134:0/898982332 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9fc026730 con 0x55c2d9b1f530 2024-04-24T02:12:28.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.421+0000 7fc8f4ff9640 1 -- 172.21.15.134:0/898982332 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9fc025c50 con 0x55c2d9b1f530 2024-04-24T02:12:28.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.421+0000 7fca1572e800 1 -- 172.21.15.134:0/898982332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2d9b1f530 msgr2=0x55c2d9b1f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.421+0000 7fca1572e800 1 --2- 172.21.15.134:0/898982332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2d9b1f530 0x55c2d9b1f950 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc00eee0 tx=0x7fc9fc024740 comp rx=0 tx=0).stop 2024-04-24T02:12:28.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.421+0000 7fca1572e800 1 -- 172.21.15.134:0/898982332 shutdown_connections 2024-04-24T02:12:28.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.421+0000 7fca1572e800 1 --2- 172.21.15.134:0/898982332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2d9b1f530 0x55c2d9b1f950 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.421+0000 7fca1572e800 1 -- 172.21.15.134:0/898982332 >> 172.21.15.134:0/898982332 conn(0x55c2d9b1b890 msgr2=0x55c2d9b198f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:28.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.421+0000 7fca1572e800 1 -- 172.21.15.134:0/898982332 shutdown_connections 2024-04-24T02:12:28.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.421+0000 7fca1572e800 1 -- 172.21.15.134:0/898982332 wait complete. 2024-04-24T02:12:28.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.421+0000 7fca1572e800 1 Processor -- start 2024-04-24T02:12:28.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.422+0000 7fca1572e800 1 -- start start 2024-04-24T02:12:28.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.422+0000 7fca1572e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2d9b1f530 0x55c2d9b26b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.422+0000 7fca1572e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c2d9b20690 con 0x55c2d9b1f530 2024-04-24T02:12:28.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.422+0000 7fca0bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2d9b1f530 0x55c2d9b26b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.422+0000 7fca0bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2d9b1f530 0x55c2d9b26b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56782/0 (socket says 172.21.15.134:56782) 2024-04-24T02:12:28.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.422+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 learned_addr learned my addr 172.21.15.134:0/2377890792 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:28.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.422+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2d9b270d0 con 0x55c2d9b1f530 2024-04-24T02:12:28.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.422+0000 7fca0bfff640 1 --2- 172.21.15.134:0/2377890792 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2d9b1f530 0x55c2d9b26b90 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc024a50 tx=0x7fc9fc04c050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.422+0000 7fc8e6ffd640 1 -- 172.21.15.134:0/2377890792 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9fc00dbb0 con 0x55c2d9b1f530 2024-04-24T02:12:28.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.422+0000 7fc8e6ffd640 1 -- 172.21.15.134:0/2377890792 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9fc00dd50 con 0x55c2d9b1f530 2024-04-24T02:12:28.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.422+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c2d9b270d0 con 0x55c2d9b1f530 2024-04-24T02:12:28.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.422+0000 7fc8e6ffd640 1 -- 172.21.15.134:0/2377890792 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9fc01a320 con 0x55c2d9b1f530 2024-04-24T02:12:28.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.422+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2d9b270d0 con 0x55c2d9b1f530 2024-04-24T02:12:28.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.423+0000 7fc8e6ffd640 1 -- 172.21.15.134:0/2377890792 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc9fc01a4c0 con 0x55c2d9b1f530 2024-04-24T02:12:28.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.423+0000 7fc8e6ffd640 1 --2- 172.21.15.134:0/2377890792 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc8dc036950 0x7fc8dc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.423+0000 7fc8e6ffd640 1 -- 172.21.15.134:0/2377890792 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc9fc045070 con 0x55c2d9b1f530 2024-04-24T02:12:28.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.424+0000 7fca1572e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.424+0000 7fca11c68640 1 --2- 172.21.15.134:0/2377890792 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc8dc036950 0x7fc8dc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.424+0000 7fca1572e800 1 --2- 172.21.15.134:0/2377890792 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c2d9b32280 0x55c2d9b34740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.424+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b34e90 con 0x55c2d9b32280 2024-04-24T02:12:28.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.424+0000 7fca11467640 1 --2- 172.21.15.134:0/2377890792 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c2d9b32280 0x55c2d9b34740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.424+0000 7fca11c68640 1 --2- 172.21.15.134:0/2377890792 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc8dc036950 0x7fc8dc038e10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x55c2d9b02280 tx=0x7fca0c01f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.424+0000 7fca11467640 1 --2- 172.21.15.134:0/2377890792 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c2d9b32280 0x55c2d9b34740 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.424+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca04075030 con 0x55c2d9b32280 2024-04-24T02:12:28.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.424+0000 7fca1572e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:28.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.424+0000 7fca1572e800 20 realm 2024-04-24T02:12:28.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.424+0000 7fca1572e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.424+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b352a0 con 0x55c2d9b32280 2024-04-24T02:12:28.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.424+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca04075030 con 0x55c2d9b32280 2024-04-24T02:12:28.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.424+0000 7fca1572e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:28.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.425+0000 7fca1572e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:28.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.425+0000 7fca1572e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.425+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b35b40 con 0x55c2d9b32280 2024-04-24T02:12:28.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.425+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca04075030 con 0x55c2d9b32280 2024-04-24T02:12:28.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.425+0000 7fca1572e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:28.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.425+0000 7fca1572e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.425+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b35ee0 con 0x55c2d9b32280 2024-04-24T02:12:28.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.425+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fca04075030 con 0x55c2d9b32280 2024-04-24T02:12:28.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.425+0000 7fca1572e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:28.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.425+0000 7fca1572e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.425+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b36730 con 0x55c2d9b32280 2024-04-24T02:12:28.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.425+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fca04075030 con 0x55c2d9b32280 2024-04-24T02:12:28.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.425+0000 7fca1572e800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:28.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.425+0000 7fca1572e800 20 searching for the correct realm 2024-04-24T02:12:28.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.425+0000 7fca1572e800 1 --2- 172.21.15.134:0/2377890792 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55c2d9b384a0 0x55c2d9b3a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.425+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3ae70 con 0x55c2d9b384a0 2024-04-24T02:12:28.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.425+0000 7fca0bfff640 1 --2- 172.21.15.134:0/2377890792 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55c2d9b384a0 0x55c2d9b3a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.426+0000 7fca0bfff640 1 --2- 172.21.15.134:0/2377890792 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55c2d9b384a0 0x55c2d9b3a890 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.426+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9fc024030 con 0x55c2d9b384a0 2024-04-24T02:12:28.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.426+0000 7fca0bfff640 1 --2- 172.21.15.134:0/2377890792 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fc9fc01ac20 0x7fc9fc0456d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.426+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3ae70 con 0x7fc9fc01ac20 2024-04-24T02:12:28.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.426+0000 7fca11c68640 1 --2- 172.21.15.134:0/2377890792 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fc9fc01ac20 0x7fc9fc0456d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.427+0000 7fca11c68640 1 --2- 172.21.15.134:0/2377890792 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fc9fc01ac20 0x7fc9fc0456d0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.427+0000 7fca11c68640 1 -- 172.21.15.134:0/2377890792 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca0c01f070 con 0x7fc9fc01ac20 2024-04-24T02:12:28.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.427+0000 7fca11c68640 1 --2- 172.21.15.134:0/2377890792 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fca0c031040 0x7fca0c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.427+0000 7fca11c68640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3ae70 con 0x7fca0c031040 2024-04-24T02:12:28.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.427+0000 7fca11467640 1 --2- 172.21.15.134:0/2377890792 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fca0c031040 0x7fca0c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.427+0000 7fca11467640 1 --2- 172.21.15.134:0/2377890792 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fca0c031040 0x7fca0c032940 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.428+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca04075030 con 0x7fca0c031040 2024-04-24T02:12:28.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.428+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3ae70 con 0x55c2d9b32280 2024-04-24T02:12:28.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.428+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca04075030 con 0x55c2d9b32280 2024-04-24T02:12:28.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.428+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3ae70 con 0x55c2d9b32280 2024-04-24T02:12:28.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.428+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fca04075030 con 0x55c2d9b32280 2024-04-24T02:12:28.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.428+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3ae70 con 0x7fca0c031040 2024-04-24T02:12:28.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.428+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca04075030 con 0x7fca0c031040 2024-04-24T02:12:28.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.428+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3ae70 con 0x7fca0c031040 2024-04-24T02:12:28.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.429+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca04075030 con 0x7fca0c031040 2024-04-24T02:12:28.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.429+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3ae70 con 0x7fc9fc01ac20 2024-04-24T02:12:28.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.429+0000 7fca11c68640 1 -- 172.21.15.134:0/2377890792 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca0c01f070 con 0x7fc9fc01ac20 2024-04-24T02:12:28.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.429+0000 7fca11c68640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3ae70 con 0x55c2d9b384a0 2024-04-24T02:12:28.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.429+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9fc024030 con 0x55c2d9b384a0 2024-04-24T02:12:28.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.429+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3ae70 con 0x55c2d9b32280 2024-04-24T02:12:28.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.429+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca04075030 con 0x55c2d9b32280 2024-04-24T02:12:28.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.429+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3ae70 con 0x7fca0c031040 2024-04-24T02:12:28.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.430+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca04075030 con 0x7fca0c031040 2024-04-24T02:12:28.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.430+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3ae70 con 0x55c2d9b32280 2024-04-24T02:12:28.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.430+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca04075030 con 0x55c2d9b32280 2024-04-24T02:12:28.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.430+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3ae70 con 0x7fc9fc01ac20 2024-04-24T02:12:28.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.430+0000 7fca11c68640 1 -- 172.21.15.134:0/2377890792 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fca0c01f070 con 0x7fc9fc01ac20 2024-04-24T02:12:28.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.430+0000 7fca11c68640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3ae70 con 0x55c2d9b384a0 2024-04-24T02:12:28.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.430+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9fc024030 con 0x55c2d9b384a0 2024-04-24T02:12:28.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.430+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3ae70 con 0x55c2d9b384a0 2024-04-24T02:12:28.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.431+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9fc024030 con 0x55c2d9b384a0 2024-04-24T02:12:28.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.431+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3ae70 con 0x7fca0c031040 2024-04-24T02:12:28.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.431+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca04075030 con 0x7fca0c031040 2024-04-24T02:12:28.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.431+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3ae70 con 0x55c2d9b384a0 2024-04-24T02:12:28.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.431+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9fc024030 con 0x55c2d9b384a0 2024-04-24T02:12:28.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.431+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3ae70 con 0x55c2d9b384a0 2024-04-24T02:12:28.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.432+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9fc024030 con 0x55c2d9b384a0 2024-04-24T02:12:28.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.432+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3ae70 con 0x55c2d9b32280 2024-04-24T02:12:28.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.432+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca04075030 con 0x55c2d9b32280 2024-04-24T02:12:28.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.432+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3ae70 con 0x55c2d9b32280 2024-04-24T02:12:28.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.432+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fca04075030 con 0x55c2d9b32280 2024-04-24T02:12:28.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.432+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3ae70 con 0x7fca0c031040 2024-04-24T02:12:28.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.432+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca04075030 con 0x7fca0c031040 2024-04-24T02:12:28.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.432+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3ae70 con 0x55c2d9b384a0 2024-04-24T02:12:28.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.433+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9fc024030 con 0x55c2d9b384a0 2024-04-24T02:12:28.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.433+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3ae70 con 0x7fc9fc01ac20 2024-04-24T02:12:28.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.433+0000 7fca11c68640 1 -- 172.21.15.134:0/2377890792 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca0c01f070 con 0x7fc9fc01ac20 2024-04-24T02:12:28.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.433+0000 7fca11c68640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3ae70 con 0x55c2d9b32280 2024-04-24T02:12:28.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.433+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca04075030 con 0x55c2d9b32280 2024-04-24T02:12:28.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.433+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3ae70 con 0x7fca0c031040 2024-04-24T02:12:28.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.433+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca04075030 con 0x7fca0c031040 2024-04-24T02:12:28.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.433+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3ae70 con 0x55c2d9b384a0 2024-04-24T02:12:28.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.434+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9fc024030 con 0x55c2d9b384a0 2024-04-24T02:12:28.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.434+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3ae70 con 0x7fca0c031040 2024-04-24T02:12:28.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.434+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca04075030 con 0x7fca0c031040 2024-04-24T02:12:28.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.434+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3ae70 con 0x7fc9fc01ac20 2024-04-24T02:12:28.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.434+0000 7fca11c68640 1 -- 172.21.15.134:0/2377890792 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca0c01f070 con 0x7fc9fc01ac20 2024-04-24T02:12:28.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.434+0000 7fca11c68640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3ae70 con 0x55c2d9b384a0 2024-04-24T02:12:28.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.434+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9fc024030 con 0x55c2d9b384a0 2024-04-24T02:12:28.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.434+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3ae70 con 0x7fca0c031040 2024-04-24T02:12:28.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.435+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca04075030 con 0x7fca0c031040 2024-04-24T02:12:28.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.435+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3ae70 con 0x55c2d9b32280 2024-04-24T02:12:28.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.435+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fca04075030 con 0x55c2d9b32280 2024-04-24T02:12:28.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.435+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3ae70 con 0x7fc9fc01ac20 2024-04-24T02:12:28.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.435+0000 7fca11c68640 1 -- 172.21.15.134:0/2377890792 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca0c01f070 con 0x7fc9fc01ac20 2024-04-24T02:12:28.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.435+0000 7fca1572e800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:28.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.435+0000 7fca1572e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:28.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.435+0000 7fca1572e800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:28.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.435+0000 7fca1572e800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:28.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.435+0000 7fca1572e800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:28.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.435+0000 7fca1572e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:28.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.435+0000 7fca1572e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.435+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b370b0 con 0x55c2d9b32280 2024-04-24T02:12:28.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.435+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca04075030 con 0x55c2d9b32280 2024-04-24T02:12:28.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.435+0000 7fca1572e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:28.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.435+0000 7fca1572e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.435+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b37950 con 0x55c2d9b32280 2024-04-24T02:12:28.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.436+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fca04075030 con 0x55c2d9b32280 2024-04-24T02:12:28.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.436+0000 7fca1572e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:28.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.436+0000 7fca1572e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.436+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b36cf0 con 0x55c2d9b32280 2024-04-24T02:12:28.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.436+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fca04075030 con 0x55c2d9b32280 2024-04-24T02:12:28.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.436+0000 7fca1572e800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:28.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.436+0000 7fca1572e800 20 zone default found 2024-04-24T02:12:28.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.436+0000 7fca1572e800 4 Realm: () 2024-04-24T02:12:28.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.436+0000 7fca1572e800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:28.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.436+0000 7fca1572e800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:28.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.436+0000 7fca1572e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:28.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.436+0000 7fca1572e800 20 zonegroup default 2024-04-24T02:12:28.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.436+0000 7fca1572e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.436+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3b2f0 con 0x7fca0c031040 2024-04-24T02:12:28.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.436+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fca04075030 con 0x7fca0c031040 2024-04-24T02:12:28.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.436+0000 7fca1572e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:28.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.436+0000 7fca1572e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.436+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3d180 con 0x55c2d9b384a0 2024-04-24T02:12:28.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.436+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc9fc024030 con 0x55c2d9b384a0 2024-04-24T02:12:28.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.436+0000 7fca1572e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:28.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.436+0000 7fca1572e800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.436+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3d520 con 0x55c2d9b384a0 2024-04-24T02:12:28.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.437+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc9fc024030 con 0x55c2d9b384a0 2024-04-24T02:12:28.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.437+0000 7fca1572e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:28.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.437+0000 7fca1572e800 20 started sync module instance, tier type = 2024-04-24T02:12:28.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.437+0000 7fca1572e800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:28.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.437+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3c5c0 con 0x7fc9fc01ac20 2024-04-24T02:12:28.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.438+0000 7fca11c68640 1 -- 172.21.15.134:0/2377890792 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca0c040040 con 0x7fc9fc01ac20 2024-04-24T02:12:28.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.438+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94295364454832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3cdd0 con 0x7fc9fc01ac20 2024-04-24T02:12:28.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.438+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3e280 con 0x55c2d9b32280 2024-04-24T02:12:28.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.439+0000 7fca11c68640 1 -- 172.21.15.134:0/2377890792 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94295364454832] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca0c040040 con 0x7fc9fc01ac20 2024-04-24T02:12:28.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.439+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca04075030 con 0x55c2d9b32280 2024-04-24T02:12:28.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.439+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94295364458688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3e670 con 0x55c2d9b32280 2024-04-24T02:12:28.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.439+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3f0b0 con 0x55c2d9b384a0 2024-04-24T02:12:28.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.440+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94295364458688] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca04075030 con 0x55c2d9b32280 2024-04-24T02:12:28.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.440+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9fc024030 con 0x55c2d9b384a0 2024-04-24T02:12:28.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.440+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94295364463488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3f4a0 con 0x55c2d9b384a0 2024-04-24T02:12:28.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.440+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3fea0 con 0x7fc9fc01ac20 2024-04-24T02:12:28.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.441+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94295364463488] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9fc024030 con 0x55c2d9b384a0 2024-04-24T02:12:28.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.441+0000 7fca11c68640 1 -- 172.21.15.134:0/2377890792 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca0c040040 con 0x7fc9fc01ac20 2024-04-24T02:12:28.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.441+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94295364459744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b40290 con 0x7fc9fc01ac20 2024-04-24T02:12:28.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.441+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b40cd0 con 0x55c2d9b32280 2024-04-24T02:12:28.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.442+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca04075030 con 0x55c2d9b32280 2024-04-24T02:12:28.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.442+0000 7fca11c68640 1 -- 172.21.15.134:0/2377890792 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94295364459744] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca0c040040 con 0x7fc9fc01ac20 2024-04-24T02:12:28.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.442+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94295364470688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b40c90 con 0x55c2d9b32280 2024-04-24T02:12:28.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.442+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3f9b0 con 0x7fca0c031040 2024-04-24T02:12:28.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.443+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca04075030 con 0x7fca0c031040 2024-04-24T02:12:28.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.443+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94295364474768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3f9b0 con 0x7fca0c031040 2024-04-24T02:12:28.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.443+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94295364470688] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca04075030 con 0x55c2d9b32280 2024-04-24T02:12:28.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.443+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b426c0 con 0x7fca0c031040 2024-04-24T02:12:28.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.444+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(56 notify.6 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca04075030 con 0x7fca0c031040 2024-04-24T02:12:28.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.444+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94295364473072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b42680 con 0x7fca0c031040 2024-04-24T02:12:28.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.444+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b43100 con 0x7fca0c031040 2024-04-24T02:12:28.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.445+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94295364474768] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca04075030 con 0x7fca0c031040 2024-04-24T02:12:28.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.445+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94295364473072] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca04075030 con 0x7fca0c031040 2024-04-24T02:12:28.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.445+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(58 notify.7 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca04075030 con 0x7fca0c031040 2024-04-24T02:12:28.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.446+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94295364477392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b425f0 con 0x7fca0c031040 2024-04-24T02:12:28.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.446+0000 7fca1572e800 20 add_watcher() i=0 2024-04-24T02:12:28.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.446+0000 7fca1572e800 20 add_watcher() i=1 2024-04-24T02:12:28.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.446+0000 7fca1572e800 20 add_watcher() i=2 2024-04-24T02:12:28.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.446+0000 7fca1572e800 20 add_watcher() i=3 2024-04-24T02:12:28.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.446+0000 7fca1572e800 20 add_watcher() i=4 2024-04-24T02:12:28.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.446+0000 7fca1572e800 20 add_watcher() i=5 2024-04-24T02:12:28.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.446+0000 7fca1572e800 20 add_watcher() i=6 2024-04-24T02:12:28.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.446+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94295364477392] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca04075030 con 0x7fca0c031040 2024-04-24T02:12:28.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.446+0000 7fca1572e800 20 add_watcher() i=7 2024-04-24T02:12:28.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.446+0000 7fca1572e800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:28.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.446+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b46130 con 0x55c2d9b32280 2024-04-24T02:12:28.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.447+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fca04075030 con 0x55c2d9b32280 2024-04-24T02:12:28.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.447+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94295364480080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b43520 con 0x55c2d9b32280 2024-04-24T02:12:28.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.448+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94295364480080] v30'153 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fca04075030 con 0x55c2d9b32280 2024-04-24T02:12:28.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.448+0000 7fc8c77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:28.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.448+0000 7fca1572e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:28.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.448+0000 7fca1572e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:28.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.448+0000 7fca1572e800 5 note: GC not initialized 2024-04-24T02:12:28.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.448+0000 7fc8c67e4640 20 reqs_thread_entry: start 2024-04-24T02:12:28.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.448+0000 7fca1572e800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:28.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.448+0000 7fca1572e800 20 Filter name: none 2024-04-24T02:12:28.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.448+0000 7fc837fff640 20 reqs_thread_entry: start 2024-04-24T02:12:28.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.449+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:62 6.0 6:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b78850 con 0x7fca0c031040 2024-04-24T02:12:28.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.449+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(62 [pgnls start_epoch 30 out=254b] v30'46 uv30 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fca04075030 con 0x7fca0c031040 2024-04-24T02:12:28.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.449+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:63 6.10 6:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b37950 con 0x7fca0c031040 2024-04-24T02:12:28.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.450+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(63 [pgnls start_epoch 30 out=131b] v30'4 uv4 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7fca04075030 con 0x7fca0c031040 2024-04-24T02:12:28.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.450+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b37950 con 0x55c2d9b384a0 2024-04-24T02:12:28.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.450+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(64 [pgnls start_epoch 30 out=295b] v30'35 uv27 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fc9fc024030 con 0x55c2d9b384a0 2024-04-24T02:12:28.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.450+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:65 6.18 6:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b37950 con 0x7fca0c031040 2024-04-24T02:12:28.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.450+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(65 [pgnls start_epoch 30 out=172b] v30'24 uv15 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fca04075030 con 0x7fca0c031040 2024-04-24T02:12:28.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.450+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:66 6.4 6:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b37950 con 0x55c2d9b32280 2024-04-24T02:12:28.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.451+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(66 [pgnls start_epoch 30 out=335b] v30'153 uv29 ondisk = 1) ==== 144+0+335 (crc 0 0 0) 0x7fca040b9160 con 0x55c2d9b32280 2024-04-24T02:12:28.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.451+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:67 6.14 6:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b37950 con 0x7fc9fc01ac20 2024-04-24T02:12:28.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.451+0000 7fca11c68640 1 -- 172.21.15.134:0/2377890792 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(67 [pgnls start_epoch 30 out=213b] v30'22 uv22 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fca0c040040 con 0x7fc9fc01ac20 2024-04-24T02:12:28.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.451+0000 7fca11c68640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:68 6.c 6:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3c5c0 con 0x55c2d9b384a0 2024-04-24T02:12:28.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.451+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 <== osd.3 v2:172.21.15.134:6801/3585115521 15 ==== osd_op_reply(68 [pgnls start_epoch 30 out=254b] v30'11 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fc9fc024030 con 0x55c2d9b384a0 2024-04-24T02:12:28.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.451+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:69 6.1c 6:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3c5c0 con 0x55c2d9b384a0 2024-04-24T02:12:28.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.452+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 <== osd.3 v2:172.21.15.134:6801/3585115521 16 ==== osd_op_reply(69 [pgnls start_epoch 30 out=295b] v30'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fc9fc024030 con 0x55c2d9b384a0 2024-04-24T02:12:28.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.452+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:70 6.2 6:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3c5c0 con 0x55c2d9b384a0 2024-04-24T02:12:28.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.452+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 <== osd.3 v2:172.21.15.134:6801/3585115521 17 ==== osd_op_reply(70 [pgnls start_epoch 30 out=213b] v30'17 uv17 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fc9fc024030 con 0x55c2d9b384a0 2024-04-24T02:12:28.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.452+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:71 6.12 6:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3c5c0 con 0x7fc9fc01ac20 2024-04-24T02:12:28.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.452+0000 7fca11c68640 1 -- 172.21.15.134:0/2377890792 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(71 [pgnls start_epoch 30 out=172b] v30'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fca0c040040 con 0x7fc9fc01ac20 2024-04-24T02:12:28.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.452+0000 7fca11c68640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:72 6.a 6:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3c5c0 con 0x7fc9fc01ac20 2024-04-24T02:12:28.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.452+0000 7fca11c68640 1 -- 172.21.15.134:0/2377890792 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(72 [pgnls start_epoch 30 out=336b] v30'33 uv25 ondisk = 1) ==== 144+0+336 (crc 0 0 0) 0x7fca0c040040 con 0x7fc9fc01ac20 2024-04-24T02:12:28.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.453+0000 7fca11c68640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:73 6.1a 6:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3c5c0 con 0x55c2d9b384a0 2024-04-24T02:12:28.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.453+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 <== osd.3 v2:172.21.15.134:6801/3585115521 18 ==== osd_op_reply(73 [pgnls start_epoch 30 out=131b] v30'29 uv21 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7fc9fc024030 con 0x55c2d9b384a0 2024-04-24T02:12:28.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.453+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:74 6.6 6:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3c5c0 con 0x55c2d9b384a0 2024-04-24T02:12:28.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.453+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 <== osd.3 v2:172.21.15.134:6801/3585115521 19 ==== osd_op_reply(74 [pgnls start_epoch 30 out=254b] v30'12 uv12 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fc9fc024030 con 0x55c2d9b384a0 2024-04-24T02:12:28.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.453+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:75 6.16 6:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3c5c0 con 0x55c2d9b384a0 2024-04-24T02:12:28.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.453+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 <== osd.3 v2:172.21.15.134:6801/3585115521 20 ==== osd_op_reply(75 [pgnls start_epoch 30 out=90b] v30'29 uv21 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7fc9fc024030 con 0x55c2d9b384a0 2024-04-24T02:12:28.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.453+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:76 6.e 6:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3c5c0 con 0x55c2d9b32280 2024-04-24T02:12:28.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.454+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(76 [pgnls start_epoch 30 out=213b] v30'25 uv17 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fca040b9160 con 0x55c2d9b32280 2024-04-24T02:12:28.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.454+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:77 6.1e 6:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3c5c0 con 0x55c2d9b384a0 2024-04-24T02:12:28.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.454+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 <== osd.3 v2:172.21.15.134:6801/3585115521 21 ==== osd_op_reply(77 [pgnls start_epoch 30 out=254b] v30'16 uv16 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fc9fc024030 con 0x55c2d9b384a0 2024-04-24T02:12:28.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.454+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:78 6.1 6:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3c5c0 con 0x55c2d9b32280 2024-04-24T02:12:28.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.454+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(78 [pgnls start_epoch 30 out=254b] v30'20 uv20 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fca040b9160 con 0x55c2d9b32280 2024-04-24T02:12:28.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.454+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:79 6.11 6:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3c5c0 con 0x55c2d9b384a0 2024-04-24T02:12:28.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.455+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 <== osd.3 v2:172.21.15.134:6801/3585115521 22 ==== osd_op_reply(79 [pgnls start_epoch 30 out=213b] v30'25 uv17 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fc9fc024030 con 0x55c2d9b384a0 2024-04-24T02:12:28.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.455+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:80 6.9 6:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3c5c0 con 0x55c2d9b384a0 2024-04-24T02:12:28.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.455+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 <== osd.3 v2:172.21.15.134:6801/3585115521 23 ==== osd_op_reply(80 [pgnls start_epoch 30 out=172b] v30'42 uv26 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fc9fc024030 con 0x55c2d9b384a0 2024-04-24T02:12:28.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.455+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:81 6.19 6:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3c5c0 con 0x55c2d9b32280 2024-04-24T02:12:28.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.455+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(81 [pgnls start_epoch 30 out=295b] v30'47 uv39 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fca040b9160 con 0x55c2d9b32280 2024-04-24T02:12:28.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.455+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:82 6.5 6:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3c5c0 con 0x7fc9fc01ac20 2024-04-24T02:12:28.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.455+0000 7fca11c68640 1 -- 172.21.15.134:0/2377890792 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(82 [pgnls start_epoch 30 out=276b] v30'15 uv15 ondisk = 1) ==== 144+0+276 (crc 0 0 0) 0x7fca0c040040 con 0x7fc9fc01ac20 2024-04-24T02:12:28.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.455+0000 7fca11c68640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:83 6.15 6:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3c5c0 con 0x7fc9fc01ac20 2024-04-24T02:12:28.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.456+0000 7fca11c68640 1 -- 172.21.15.134:0/2377890792 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(83 [pgnls start_epoch 30 out=172b] v30'23 uv15 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fca0c040040 con 0x7fc9fc01ac20 2024-04-24T02:12:28.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.456+0000 7fca11c68640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:84 6.d 6:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3c5c0 con 0x55c2d9b32280 2024-04-24T02:12:28.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.456+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(84 [pgnls start_epoch 30 out=295b] v30'25 uv17 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fca040b9160 con 0x55c2d9b32280 2024-04-24T02:12:28.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.456+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:85 6.1d 6:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3c5c0 con 0x7fca0c031040 2024-04-24T02:12:28.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.456+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.0 v2:172.21.15.104:6800/2419146313 20 ==== osd_op_reply(85 [pgnls start_epoch 30 out=172b] v30'35 uv19 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fca040b9160 con 0x7fca0c031040 2024-04-24T02:12:28.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.456+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:86 6.3 6:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3c5c0 con 0x7fc9fc01ac20 2024-04-24T02:12:28.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.457+0000 7fca11c68640 1 -- 172.21.15.134:0/2377890792 <== osd.2 v2:172.21.15.134:6800/214480313 16 ==== osd_op_reply(86 [pgnls start_epoch 30 out=213b] v30'49 uv25 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fca0c040040 con 0x7fc9fc01ac20 2024-04-24T02:12:28.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.457+0000 7fca11c68640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:87 6.13 6:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3c5c0 con 0x7fca0c031040 2024-04-24T02:12:28.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.457+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.0 v2:172.21.15.104:6800/2419146313 21 ==== osd_op_reply(87 [pgnls start_epoch 30 out=172b] v30'19 uv11 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fca040b9160 con 0x7fca0c031040 2024-04-24T02:12:28.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.457+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:88 6.b 6:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3c5c0 con 0x55c2d9b384a0 2024-04-24T02:12:28.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.457+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 <== osd.3 v2:172.21.15.134:6801/3585115521 24 ==== osd_op_reply(88 [pgnls start_epoch 30 out=172b] v30'23 uv15 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fc9fc024030 con 0x55c2d9b384a0 2024-04-24T02:12:28.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.458+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:89 6.1b 6:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3c5c0 con 0x55c2d9b384a0 2024-04-24T02:12:28.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.458+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 <== osd.3 v2:172.21.15.134:6801/3585115521 25 ==== osd_op_reply(89 [pgnls start_epoch 30 out=90b] v30'19 uv11 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7fc9fc024030 con 0x55c2d9b384a0 2024-04-24T02:12:28.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.458+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:90 6.7 6:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3c5c0 con 0x55c2d9b384a0 2024-04-24T02:12:28.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.458+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 <== osd.3 v2:172.21.15.134:6801/3585115521 26 ==== osd_op_reply(90 [pgnls start_epoch 30 out=90b] v30'43 uv19 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7fc9fc024030 con 0x55c2d9b384a0 2024-04-24T02:12:28.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.458+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:91 6.17 6:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3c5c0 con 0x55c2d9b32280 2024-04-24T02:12:28.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.458+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(91 [pgnls start_epoch 30 out=131b] v30'12 uv12 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7fca040b9160 con 0x55c2d9b32280 2024-04-24T02:12:28.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.458+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:92 6.f 6:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3c5c0 con 0x7fc9fc01ac20 2024-04-24T02:12:28.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.459+0000 7fca11c68640 1 -- 172.21.15.134:0/2377890792 <== osd.2 v2:172.21.15.134:6800/214480313 17 ==== osd_op_reply(92 [pgnls start_epoch 30 out=295b] v30'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fca0c040040 con 0x7fc9fc01ac20 2024-04-24T02:12:28.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.459+0000 7fca11c68640 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:93 6.1f 6:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3c5c0 con 0x7fca0c031040 2024-04-24T02:12:28.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.459+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.0 v2:172.21.15.104:6800/2419146313 22 ==== osd_op_reply(93 [pgnls start_epoch 30 out=213b] v30'25 uv17 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fca040b9160 con 0x7fca0c031040 2024-04-24T02:12:28.476 INFO:teuthology.orchestra.run.smithi134.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-04-24T02:12:28.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.461+0000 7fc8c77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:28.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.461+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94295364480080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b782b0 con 0x55c2d9b32280 2024-04-24T02:12:28.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.462+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94295364480080] v30'154 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fca040b9160 con 0x55c2d9b32280 2024-04-24T02:12:28.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.462+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94295364454832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b76d20 con 0x7fc9fc01ac20 2024-04-24T02:12:28.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.463+0000 7fca11c68640 1 -- 172.21.15.134:0/2377890792 <== osd.2 v2:172.21.15.134:6800/214480313 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94295364454832] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca0c040040 con 0x7fc9fc01ac20 2024-04-24T02:12:28.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.463+0000 7fca1572e800 20 remove_watcher() i=0 2024-04-24T02:12:28.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.463+0000 7fca1572e800 2 removed watcher, disabling cache 2024-04-24T02:12:28.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.463+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94295364458688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3c9b0 con 0x55c2d9b32280 2024-04-24T02:12:28.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.464+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.1 v2:172.21.15.134:6804/1487076214 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94295364458688] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca040b9160 con 0x55c2d9b32280 2024-04-24T02:12:28.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.464+0000 7fca1572e800 20 remove_watcher() i=1 2024-04-24T02:12:28.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.464+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94295364463488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3c9b0 con 0x55c2d9b384a0 2024-04-24T02:12:28.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.465+0000 7fca0bfff640 1 -- 172.21.15.134:0/2377890792 <== osd.3 v2:172.21.15.134:6801/3585115521 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94295364463488] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9fc024030 con 0x55c2d9b384a0 2024-04-24T02:12:28.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.465+0000 7fca1572e800 20 remove_watcher() i=2 2024-04-24T02:12:28.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.465+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94295364459744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3eb80 con 0x7fc9fc01ac20 2024-04-24T02:12:28.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.466+0000 7fca11c68640 1 -- 172.21.15.134:0/2377890792 <== osd.2 v2:172.21.15.134:6800/214480313 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94295364459744] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca0c040040 con 0x7fc9fc01ac20 2024-04-24T02:12:28.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.466+0000 7fca1572e800 20 remove_watcher() i=3 2024-04-24T02:12:28.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.466+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94295364470688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b3eb80 con 0x55c2d9b32280 2024-04-24T02:12:28.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.467+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.1 v2:172.21.15.134:6804/1487076214 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94295364470688] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca040b9160 con 0x55c2d9b32280 2024-04-24T02:12:28.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.467+0000 7fca1572e800 20 remove_watcher() i=4 2024-04-24T02:12:28.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.467+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94295364474768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b407a0 con 0x7fca0c031040 2024-04-24T02:12:28.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.468+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.0 v2:172.21.15.104:6800/2419146313 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94295364474768] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca040b9160 con 0x7fca0c031040 2024-04-24T02:12:28.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.468+0000 7fca1572e800 20 remove_watcher() i=5 2024-04-24T02:12:28.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.468+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94295364473072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b407a0 con 0x7fca0c031040 2024-04-24T02:12:28.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.469+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.0 v2:172.21.15.104:6800/2419146313 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94295364473072] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca040b9160 con 0x7fca0c031040 2024-04-24T02:12:28.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.469+0000 7fca1572e800 20 remove_watcher() i=6 2024-04-24T02:12:28.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.469+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94295364477392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c2d9b410f0 con 0x7fca0c031040 2024-04-24T02:12:28.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.470+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 <== osd.0 v2:172.21.15.104:6800/2419146313 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94295364477392] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca040b9160 con 0x7fca0c031040 2024-04-24T02:12:28.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.470+0000 7fca1572e800 20 remove_watcher() i=7 2024-04-24T02:12:28.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.470+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fca0c031040 msgr2=0x7fca0c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.470+0000 7fca1572e800 1 --2- 172.21.15.134:0/2377890792 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fca0c031040 0x7fca0c032940 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.470+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c2d9b32280 msgr2=0x55c2d9b34740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.470+0000 7fca1572e800 1 --2- 172.21.15.134:0/2377890792 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c2d9b32280 0x55c2d9b34740 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.470+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fc9fc01ac20 msgr2=0x7fc9fc0456d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.470+0000 7fca1572e800 1 --2- 172.21.15.134:0/2377890792 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fc9fc01ac20 0x7fc9fc0456d0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.470+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55c2d9b384a0 msgr2=0x55c2d9b3a890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.470+0000 7fca1572e800 1 --2- 172.21.15.134:0/2377890792 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55c2d9b384a0 0x55c2d9b3a890 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.470+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc8dc036950 msgr2=0x7fc8dc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.470+0000 7fca1572e800 1 --2- 172.21.15.134:0/2377890792 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc8dc036950 0x7fc8dc038e10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x55c2d9b02280 tx=0x7fca0c01f000 comp rx=0 tx=0).stop 2024-04-24T02:12:28.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.470+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2d9b1f530 msgr2=0x55c2d9b26b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.470+0000 7fca11467640 1 -- 172.21.15.134:0/2377890792 reap_dead start 2024-04-24T02:12:28.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.470+0000 7fca1572e800 1 --2- 172.21.15.134:0/2377890792 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2d9b1f530 0x55c2d9b26b90 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc024a50 tx=0x7fc9fc04c050 comp rx=0 tx=0).stop 2024-04-24T02:12:28.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.471+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 shutdown_connections 2024-04-24T02:12:28.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.471+0000 7fca1572e800 1 --2- 172.21.15.134:0/2377890792 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2d9b1f530 0x55c2d9b26b90 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.471+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 >> 172.21.15.134:0/2377890792 conn(0x55c2d9b1b890 msgr2=0x55c2d9b18ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:28.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.471+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 shutdown_connections 2024-04-24T02:12:28.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.471+0000 7fca1572e800 1 -- 172.21.15.134:0/2377890792 wait complete. 2024-04-24T02:12:28.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.471+0000 7fca1572e800 1 -- 172.21.15.134:0/1624739384 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc8e8036950 msgr2=0x7fc8e8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.471+0000 7fca1572e800 1 --2- 172.21.15.134:0/1624739384 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc8e8036950 0x7fc8e8038e10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x55c2d9b02b00 tx=0x7fca0c005840 comp rx=0 tx=0).stop 2024-04-24T02:12:28.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.471+0000 7fca1572e800 1 -- 172.21.15.134:0/1624739384 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2d9b12230 msgr2=0x55c2d9b12650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.471+0000 7fca1572e800 1 --2- 172.21.15.134:0/1624739384 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2d9b12230 0x55c2d9b12650 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc001ed0 tx=0x7fc9fc00ea00 comp rx=0 tx=0).stop 2024-04-24T02:12:28.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.471+0000 7fca1572e800 1 -- 172.21.15.134:0/1624739384 shutdown_connections 2024-04-24T02:12:28.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.471+0000 7fca1572e800 1 --2- 172.21.15.134:0/1624739384 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc8e8036950 0x7fc8e8038e10 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.471+0000 7fca1572e800 1 --2- 172.21.15.134:0/1624739384 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2d9b12230 0x55c2d9b12650 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.471+0000 7fca1572e800 1 -- 172.21.15.134:0/1624739384 >> 172.21.15.134:0/1624739384 conn(0x55c2d9b062d0 msgr2=0x55c2d9b066d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:28.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.471+0000 7fca1572e800 1 -- 172.21.15.134:0/1624739384 shutdown_connections 2024-04-24T02:12:28.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.471+0000 7fca1572e800 1 -- 172.21.15.134:0/1624739384 wait complete. 2024-04-24T02:12:28.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.471+0000 7fca1572e800 1 -- 172.21.15.134:0/3229896866 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c2d99fe0d0 msgr2=0x55c2d9b010c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.471+0000 7fca1572e800 1 --2- 172.21.15.134:0/3229896866 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c2d99fe0d0 0x55c2d9b010c0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.471+0000 7fca1572e800 1 -- 172.21.15.134:0/3229896866 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc8f8036900 msgr2=0x7fc8f8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.471+0000 7fca1572e800 1 --2- 172.21.15.134:0/3229896866 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc8f8036900 0x7fc8f8038dc0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc000f60 tx=0x7fc9fc001370 comp rx=0 tx=0).stop 2024-04-24T02:12:28.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.471+0000 7fca1572e800 1 -- 172.21.15.134:0/3229896866 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2d99fd770 msgr2=0x55c2d9af9f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.471+0000 7fca1572e800 1 --2- 172.21.15.134:0/3229896866 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2d99fd770 0x55c2d9af9f20 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fca04052540 tx=0x7fca04003020 comp rx=0 tx=0).stop 2024-04-24T02:12:28.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.471+0000 7fca1572e800 1 -- 172.21.15.134:0/3229896866 shutdown_connections 2024-04-24T02:12:28.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.471+0000 7fca1572e800 1 --2- 172.21.15.134:0/3229896866 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c2d99fe0d0 0x55c2d9b010c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.471+0000 7fca1572e800 1 --2- 172.21.15.134:0/3229896866 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc8f8036900 0x7fc8f8038dc0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.471+0000 7fca1572e800 1 --2- 172.21.15.134:0/3229896866 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c2d99fd770 0x55c2d9af9f20 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.471+0000 7fca1572e800 1 -- 172.21.15.134:0/3229896866 >> 172.21.15.134:0/3229896866 conn(0x55c2d99f9310 msgr2=0x55c2d9aec520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:28.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.472+0000 7fca1572e800 1 -- 172.21.15.134:0/3229896866 shutdown_connections 2024-04-24T02:12:28.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.472+0000 7fca1572e800 1 -- 172.21.15.134:0/3229896866 wait complete. 2024-04-24T02:12:28.487 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-04-24T02:12:28.487 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-04-24T02:12:28.487 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-04-24T02:12:28.487 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-04-24T02:12:28.565 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:28.565 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:28.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.565+0000 7fc52232d800 1 Processor -- start 2024-04-24T02:12:28.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.565+0000 7fc52232d800 1 -- start start 2024-04-24T02:12:28.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.565+0000 7fc52232d800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55a8441e9780 0x55a8441e9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.566+0000 7fc52232d800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a8440a9d40 con 0x55a8441ea0e0 2024-04-24T02:12:28.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.566+0000 7fc52232d800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55a84407c4d0 con 0x55a8441e9780 2024-04-24T02:12:28.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.566+0000 7fc51e0c5640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55a8441e9780 0x55a8441e9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.566+0000 7fc51e0c5640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55a8441e9780 0x55a8441e9ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56798/0 (socket says 172.21.15.134:56798) 2024-04-24T02:12:28.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.566+0000 7fc51e0c5640 1 -- 172.21.15.134:0/2496694431 learned_addr learned my addr 172.21.15.134:0/2496694431 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:28.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.566+0000 7fc517fff640 1 --1- 172.21.15.134:0/2496694431 >> v1:172.21.15.104:6789/0 conn(0x55a8441ea0e0 0x55a8441ea590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:55362/0 (socket says 172.21.15.134:55362) 2024-04-24T02:12:28.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.566+0000 7fc51e0c5640 1 -- 172.21.15.134:0/2496694431 >> v1:172.21.15.104:6789/0 conn(0x55a8441ea0e0 legacy=0x55a8441ea590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.566+0000 7fc51e0c5640 1 -- 172.21.15.134:0/2496694431 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8440a8590 con 0x55a8441e9780 2024-04-24T02:12:28.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.568+0000 7fc51e0c5640 1 --2- 172.21.15.134:0/2496694431 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a8441e9780 0x55a8441e9ba0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc51000a520 tx=0x7fc51001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a3ae172b66360cd server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.568+0000 7fc51d8c4640 1 -- 172.21.15.134:0/2496694431 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc510057070 con 0x55a8441e9780 2024-04-24T02:12:28.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.568+0000 7fc51d8c4640 1 -- 172.21.15.134:0/2496694431 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc510052570 con 0x55a8441e9780 2024-04-24T02:12:28.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.568+0000 7fc51d8c4640 1 -- 172.21.15.134:0/2496694431 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc510052870 con 0x55a8441e9780 2024-04-24T02:12:28.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.569+0000 7fc52232d800 1 -- 172.21.15.134:0/2496694431 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a8441e9780 msgr2=0x55a8441e9ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.569+0000 7fc52232d800 1 --2- 172.21.15.134:0/2496694431 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a8441e9780 0x55a8441e9ba0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc51000a520 tx=0x7fc51001d010 comp rx=0 tx=0).stop 2024-04-24T02:12:28.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.569+0000 7fc52232d800 1 -- 172.21.15.134:0/2496694431 shutdown_connections 2024-04-24T02:12:28.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.569+0000 7fc52232d800 1 --2- 172.21.15.134:0/2496694431 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a8441e9780 0x55a8441e9ba0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.569+0000 7fc52232d800 1 -- 172.21.15.134:0/2496694431 >> 172.21.15.134:0/2496694431 conn(0x55a8441e5320 msgr2=0x55a8441e7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:28.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.569+0000 7fc52232d800 1 -- 172.21.15.134:0/2496694431 shutdown_connections 2024-04-24T02:12:28.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.569+0000 7fc52232d800 1 -- 172.21.15.134:0/2496694431 wait complete. 2024-04-24T02:12:28.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.580+0000 7fc52232d800 1 Processor -- start 2024-04-24T02:12:28.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.580+0000 7fc52232d800 1 -- start start 2024-04-24T02:12:28.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.580+0000 7fc52232d800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a8441e9780 0x55a8442de3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.580+0000 7fc52232d800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a8441363c0 con 0x55a8441e9780 2024-04-24T02:12:28.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.581+0000 7fc51e0c5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a8441e9780 0x55a8442de3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.581+0000 7fc51e0c5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a8441e9780 0x55a8442de3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56802/0 (socket says 172.21.15.134:56802) 2024-04-24T02:12:28.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.581+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1704563085 learned_addr learned my addr 172.21.15.134:0/1704563085 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:28.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.581+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1704563085 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8442de9c0 con 0x55a8441e9780 2024-04-24T02:12:28.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.581+0000 7fc51e0c5640 1 --2- 172.21.15.134:0/1704563085 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a8441e9780 0x55a8442de3f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fc510055040 tx=0x7fc51004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e378beef0a9f398d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.581+0000 7fc40c608640 1 -- 172.21.15.134:0/1704563085 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc510057040 con 0x55a8441e9780 2024-04-24T02:12:28.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.581+0000 7fc40c608640 1 -- 172.21.15.134:0/1704563085 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc510052870 con 0x55a8441e9780 2024-04-24T02:12:28.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.581+0000 7fc40c608640 1 -- 172.21.15.134:0/1704563085 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc510052b90 con 0x55a8441e9780 2024-04-24T02:12:28.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.582+0000 7fc52232d800 1 -- 172.21.15.134:0/1704563085 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a8441e9780 msgr2=0x55a8442de3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.582+0000 7fc52232d800 1 --2- 172.21.15.134:0/1704563085 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a8441e9780 0x55a8442de3f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fc510055040 tx=0x7fc51004c000 comp rx=0 tx=0).stop 2024-04-24T02:12:28.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.582+0000 7fc52232d800 1 -- 172.21.15.134:0/1704563085 shutdown_connections 2024-04-24T02:12:28.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.582+0000 7fc52232d800 1 --2- 172.21.15.134:0/1704563085 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a8441e9780 0x55a8442de3f0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.582+0000 7fc52232d800 1 -- 172.21.15.134:0/1704563085 >> 172.21.15.134:0/1704563085 conn(0x55a8441e5320 msgr2=0x55a8442d9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:28.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.582+0000 7fc52232d800 1 -- 172.21.15.134:0/1704563085 shutdown_connections 2024-04-24T02:12:28.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.582+0000 7fc52232d800 1 -- 172.21.15.134:0/1704563085 wait complete. 2024-04-24T02:12:28.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.582+0000 7fc52232d800 1 Processor -- start 2024-04-24T02:12:28.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.582+0000 7fc52232d800 1 -- start start 2024-04-24T02:12:28.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.582+0000 7fc52232d800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a8441e9780 0x55a8442e5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.583+0000 7fc52232d800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a8441eaf40 con 0x55a8441e9780 2024-04-24T02:12:28.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.583+0000 7fc51e0c5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a8441e9780 0x55a8442e5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.583+0000 7fc51e0c5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a8441e9780 0x55a8442e5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56818/0 (socket says 172.21.15.134:56818) 2024-04-24T02:12:28.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.583+0000 7fc51e0c5640 1 -- 172.21.15.134:0/3670274990 learned_addr learned my addr 172.21.15.134:0/3670274990 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:28.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.583+0000 7fc51e0c5640 1 -- 172.21.15.134:0/3670274990 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8442e6470 con 0x55a8441e9780 2024-04-24T02:12:28.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.583+0000 7fc51e0c5640 1 --2- 172.21.15.134:0/3670274990 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a8441e9780 0x55a8442e5f30 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fc510052540 tx=0x7fc510003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.583+0000 7fc40ae05640 1 -- 172.21.15.134:0/3670274990 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc510073070 con 0x55a8441e9780 2024-04-24T02:12:28.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.583+0000 7fc40ae05640 1 -- 172.21.15.134:0/3670274990 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc51005d570 con 0x55a8441e9780 2024-04-24T02:12:28.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.583+0000 7fc40ae05640 1 -- 172.21.15.134:0/3670274990 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc510057070 con 0x55a8441e9780 2024-04-24T02:12:28.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.583+0000 7fc52232d800 1 -- 172.21.15.134:0/3670274990 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a8442e6700 con 0x55a8441e9780 2024-04-24T02:12:28.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.583+0000 7fc52232d800 1 -- 172.21.15.134:0/3670274990 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8442e9310 con 0x55a8441e9780 2024-04-24T02:12:28.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.584+0000 7fc40ae05640 1 -- 172.21.15.134:0/3670274990 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc510076070 con 0x55a8441e9780 2024-04-24T02:12:28.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.584+0000 7fc40ae05640 1 --2- 172.21.15.134:0/3670274990 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc404036950 0x7fc404038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.584+0000 7fc40ae05640 1 -- 172.21.15.134:0/3670274990 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc51008db90 con 0x55a8441e9780 2024-04-24T02:12:28.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.584+0000 7fc517fff640 1 --2- 172.21.15.134:0/3670274990 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc404036950 0x7fc404038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.584+0000 7fc52232d800 1 --2- 172.21.15.134:0/3670274990 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55a8441ea0e0 0x55a8442ed0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.584+0000 7fc52232d800 1 -- 172.21.15.134:0/3670274990 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a8442ed610 con 0x55a8441ea0e0 2024-04-24T02:12:28.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.584+0000 7fc51e8c6640 1 --2- 172.21.15.134:0/3670274990 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55a8441ea0e0 0x55a8442ed0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.585+0000 7fc517fff640 1 --2- 172.21.15.134:0/3670274990 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc404036950 0x7fc404038e10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc508000f60 tx=0x7fc508001370 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.585+0000 7fc51e8c6640 1 --2- 172.21.15.134:0/3670274990 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55a8441ea0e0 0x55a8442ed0d0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.585+0000 7fc51e8c6640 1 -- 172.21.15.134:0/3670274990 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc51800a4a0 con 0x55a8441ea0e0 2024-04-24T02:12:28.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.585+0000 7fc52232d800 1 -- 172.21.15.134:0/3670274990 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a8442ea680 con 0x55a8441ea0e0 2024-04-24T02:12:28.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.585+0000 7fc51e8c6640 1 -- 172.21.15.134:0/3670274990 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc51800a4a0 con 0x55a8441ea0e0 2024-04-24T02:12:28.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.585+0000 7fc52232d800 1 -- 172.21.15.134:0/3670274990 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a8442ef3f0 con 0x55a8441ea0e0 2024-04-24T02:12:28.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.586+0000 7fc51e8c6640 1 -- 172.21.15.134:0/3670274990 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc51800a4a0 con 0x55a8441ea0e0 2024-04-24T02:12:28.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.586+0000 7fc52232d800 1 -- 172.21.15.134:0/3670274990 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a8442ee730 con 0x55a8441ea0e0 2024-04-24T02:12:28.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.586+0000 7fc51e8c6640 1 -- 172.21.15.134:0/3670274990 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc51800a4a0 con 0x55a8441ea0e0 2024-04-24T02:12:28.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.586+0000 7fc52232d800 1 -- 172.21.15.134:0/3670274990 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a8442eeb50 con 0x55a8441ea0e0 2024-04-24T02:12:28.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.586+0000 7fc51e8c6640 1 -- 172.21.15.134:0/3670274990 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc51800a4a0 con 0x55a8441ea0e0 2024-04-24T02:12:28.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.587+0000 7fc52232d800 1 Processor -- start 2024-04-24T02:12:28.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.587+0000 7fc52232d800 1 -- start start 2024-04-24T02:12:28.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.587+0000 7fc52232d800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a8442fe1e0 0x55a8442fe600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.587+0000 7fc52232d800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a8440dc6b0 con 0x55a8442fe1e0 2024-04-24T02:12:28.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.587+0000 7fc517fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a8442fe1e0 0x55a8442fe600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.587+0000 7fc517fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a8442fe1e0 0x55a8442fe600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56830/0 (socket says 172.21.15.134:56830) 2024-04-24T02:12:28.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.587+0000 7fc517fff640 1 -- 172.21.15.134:0/1829895972 learned_addr learned my addr 172.21.15.134:0/1829895972 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:28.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.587+0000 7fc517fff640 1 -- 172.21.15.134:0/1829895972 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8442feb40 con 0x55a8442fe1e0 2024-04-24T02:12:28.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.587+0000 7fc517fff640 1 --2- 172.21.15.134:0/1829895972 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a8442fe1e0 0x55a8442fe600 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc508001ed0 tx=0x7fc50800ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.588+0000 7fc403fff640 1 -- 172.21.15.134:0/1829895972 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc508022070 con 0x55a8442fe1e0 2024-04-24T02:12:28.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.588+0000 7fc403fff640 1 -- 172.21.15.134:0/1829895972 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc50800d520 con 0x55a8442fe1e0 2024-04-24T02:12:28.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.588+0000 7fc52232d800 1 -- 172.21.15.134:0/1829895972 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a8442ff5b0 con 0x55a8442fe1e0 2024-04-24T02:12:28.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.588+0000 7fc403fff640 1 -- 172.21.15.134:0/1829895972 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc50800d800 con 0x55a8442fe1e0 2024-04-24T02:12:28.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.588+0000 7fc52232d800 1 -- 172.21.15.134:0/1829895972 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8442ffab0 con 0x55a8442fe1e0 2024-04-24T02:12:28.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.588+0000 7fc403fff640 1 -- 172.21.15.134:0/1829895972 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc508025070 con 0x55a8442fe1e0 2024-04-24T02:12:28.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.589+0000 7fc403fff640 1 --2- 172.21.15.134:0/1829895972 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc3f8036950 0x7fc3f8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.589+0000 7fc403fff640 1 -- 172.21.15.134:0/1829895972 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc50804dbe0 con 0x55a8442fe1e0 2024-04-24T02:12:28.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.589+0000 7fc51e8c6640 1 --2- 172.21.15.134:0/1829895972 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc3f8036950 0x7fc3f8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.589+0000 7fc52232d800 1 Processor -- start 2024-04-24T02:12:28.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.589+0000 7fc51e8c6640 1 --2- 172.21.15.134:0/1829895972 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc3f8036950 0x7fc3f8038e10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x55a8442eead0 tx=0x7fc518005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.589+0000 7fc52232d800 1 -- start start 2024-04-24T02:12:28.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.589+0000 7fc52232d800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a84430b4e0 0x55a84430b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.589+0000 7fc52232d800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a8442dec80 con 0x55a84430b4e0 2024-04-24T02:12:28.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.589+0000 7fc517fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a84430b4e0 0x55a84430b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.589+0000 7fc517fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a84430b4e0 0x55a84430b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56836/0 (socket says 172.21.15.134:56836) 2024-04-24T02:12:28.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.589+0000 7fc517fff640 1 -- 172.21.15.134:0/2089118410 learned_addr learned my addr 172.21.15.134:0/2089118410 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:28.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.589+0000 7fc517fff640 1 -- 172.21.15.134:0/2089118410 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a84430bed0 con 0x55a84430b4e0 2024-04-24T02:12:28.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.590+0000 7fc517fff640 1 --2- 172.21.15.134:0/2089118410 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a84430b4e0 0x55a84430b900 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fc50800eee0 tx=0x7fc508024740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c491e9727ca66cb8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.590+0000 7fc401ffb640 1 -- 172.21.15.134:0/2089118410 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc50804a030 con 0x55a84430b4e0 2024-04-24T02:12:28.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.590+0000 7fc401ffb640 1 -- 172.21.15.134:0/2089118410 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc508026730 con 0x55a84430b4e0 2024-04-24T02:12:28.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.590+0000 7fc401ffb640 1 -- 172.21.15.134:0/2089118410 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc508025c50 con 0x55a84430b4e0 2024-04-24T02:12:28.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.590+0000 7fc52232d800 1 -- 172.21.15.134:0/2089118410 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a84430b4e0 msgr2=0x55a84430b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.590+0000 7fc52232d800 1 --2- 172.21.15.134:0/2089118410 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a84430b4e0 0x55a84430b900 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fc50800eee0 tx=0x7fc508024740 comp rx=0 tx=0).stop 2024-04-24T02:12:28.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.590+0000 7fc52232d800 1 -- 172.21.15.134:0/2089118410 shutdown_connections 2024-04-24T02:12:28.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.590+0000 7fc52232d800 1 --2- 172.21.15.134:0/2089118410 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a84430b4e0 0x55a84430b900 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.590+0000 7fc52232d800 1 -- 172.21.15.134:0/2089118410 >> 172.21.15.134:0/2089118410 conn(0x55a844307840 msgr2=0x55a8443058a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:28.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.590+0000 7fc52232d800 1 -- 172.21.15.134:0/2089118410 shutdown_connections 2024-04-24T02:12:28.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.590+0000 7fc52232d800 1 -- 172.21.15.134:0/2089118410 wait complete. 2024-04-24T02:12:28.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.591+0000 7fc52232d800 1 Processor -- start 2024-04-24T02:12:28.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.591+0000 7fc52232d800 1 -- start start 2024-04-24T02:12:28.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.591+0000 7fc52232d800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a84430b4e0 0x55a844312b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.591+0000 7fc52232d800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a84430c640 con 0x55a84430b4e0 2024-04-24T02:12:28.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.591+0000 7fc517fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a84430b4e0 0x55a844312b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.591+0000 7fc517fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a84430b4e0 0x55a844312b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56850/0 (socket says 172.21.15.134:56850) 2024-04-24T02:12:28.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.591+0000 7fc517fff640 1 -- 172.21.15.134:0/1675928210 learned_addr learned my addr 172.21.15.134:0/1675928210 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:28.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.591+0000 7fc517fff640 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a844313060 con 0x55a84430b4e0 2024-04-24T02:12:28.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.591+0000 7fc517fff640 1 --2- 172.21.15.134:0/1675928210 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a84430b4e0 0x55a844312b20 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fc508025be0 tx=0x7fc50804c050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.591+0000 7fc3effff640 1 -- 172.21.15.134:0/1675928210 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc50800dbb0 con 0x55a84430b4e0 2024-04-24T02:12:28.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.591+0000 7fc3effff640 1 -- 172.21.15.134:0/1675928210 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc50800dd50 con 0x55a84430b4e0 2024-04-24T02:12:28.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.591+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a844313060 con 0x55a84430b4e0 2024-04-24T02:12:28.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.591+0000 7fc3effff640 1 -- 172.21.15.134:0/1675928210 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc50801a320 con 0x55a84430b4e0 2024-04-24T02:12:28.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.591+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a844313060 con 0x55a84430b4e0 2024-04-24T02:12:28.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.592+0000 7fc3effff640 1 -- 172.21.15.134:0/1675928210 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc50801a4c0 con 0x55a84430b4e0 2024-04-24T02:12:28.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.592+0000 7fc3effff640 1 --2- 172.21.15.134:0/1675928210 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc3e8036900 0x7fc3e8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.592+0000 7fc3effff640 1 -- 172.21.15.134:0/1675928210 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc508045070 con 0x55a84430b4e0 2024-04-24T02:12:28.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.592+0000 7fc51e8c6640 1 --2- 172.21.15.134:0/1675928210 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc3e8036900 0x7fc3e8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.593+0000 7fc51e8c6640 1 --2- 172.21.15.134:0/1675928210 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc3e8036900 0x7fc3e8038dc0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x55a8442ee250 tx=0x7fc51801f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.593+0000 7fc52232d800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.593+0000 7fc52232d800 1 --2- 172.21.15.134:0/1675928210 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55a84431e2e0 0x55a8443207a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.593+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a844320ef0 con 0x55a84431e2e0 2024-04-24T02:12:28.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.593+0000 7fc51e0c5640 1 --2- 172.21.15.134:0/1675928210 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55a84431e2e0 0x55a8443207a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.593+0000 7fc51e0c5640 1 --2- 172.21.15.134:0/1675928210 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55a84431e2e0 0x55a8443207a0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.593+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc510075030 con 0x55a84431e2e0 2024-04-24T02:12:28.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.593+0000 7fc52232d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:28.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.594+0000 7fc52232d800 20 realm 2024-04-24T02:12:28.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.594+0000 7fc52232d800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.594+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a844321300 con 0x55a84431e2e0 2024-04-24T02:12:28.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.594+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc510075030 con 0x55a84431e2e0 2024-04-24T02:12:28.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.594+0000 7fc52232d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:28.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.594+0000 7fc52232d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:28.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.594+0000 7fc52232d800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.594+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a844321bd0 con 0x55a84431e2e0 2024-04-24T02:12:28.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.594+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc510075030 con 0x55a84431e2e0 2024-04-24T02:12:28.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.594+0000 7fc52232d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:28.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.594+0000 7fc52232d800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.594+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a844321f70 con 0x55a84431e2e0 2024-04-24T02:12:28.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.594+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc510075030 con 0x55a84431e2e0 2024-04-24T02:12:28.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.594+0000 7fc52232d800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:28.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.594+0000 7fc52232d800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.594+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a8443227c0 con 0x55a84431e2e0 2024-04-24T02:12:28.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.594+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc510075030 con 0x55a84431e2e0 2024-04-24T02:12:28.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.594+0000 7fc52232d800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:28.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.594+0000 7fc52232d800 20 searching for the correct realm 2024-04-24T02:12:28.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.594+0000 7fc52232d800 1 --2- 172.21.15.134:0/1675928210 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55a844324530 0x55a844326920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.595+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a844326f50 con 0x55a844324530 2024-04-24T02:12:28.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.595+0000 7fc517fff640 1 --2- 172.21.15.134:0/1675928210 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55a844324530 0x55a844326920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.595+0000 7fc517fff640 1 --2- 172.21.15.134:0/1675928210 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55a844324530 0x55a844326920 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.595+0000 7fc517fff640 1 -- 172.21.15.134:0/1675928210 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc508024030 con 0x55a844324530 2024-04-24T02:12:28.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.595+0000 7fc517fff640 1 --2- 172.21.15.134:0/1675928210 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fc50801ac20 0x7fc508045270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.595+0000 7fc517fff640 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a844326f50 con 0x7fc50801ac20 2024-04-24T02:12:28.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.595+0000 7fc51e8c6640 1 --2- 172.21.15.134:0/1675928210 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fc50801ac20 0x7fc508045270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.596+0000 7fc51e8c6640 1 --2- 172.21.15.134:0/1675928210 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fc50801ac20 0x7fc508045270 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.596+0000 7fc51e8c6640 1 -- 172.21.15.134:0/1675928210 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc51801f070 con 0x7fc50801ac20 2024-04-24T02:12:28.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.596+0000 7fc51e8c6640 1 --2- 172.21.15.134:0/1675928210 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fc518031040 0x7fc518032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.596+0000 7fc51e8c6640 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a844326f50 con 0x7fc518031040 2024-04-24T02:12:28.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.596+0000 7fc51e0c5640 1 --2- 172.21.15.134:0/1675928210 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fc518031040 0x7fc518032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.597+0000 7fc51e0c5640 1 --2- 172.21.15.134:0/1675928210 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fc518031040 0x7fc518032940 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.597+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc510086040 con 0x7fc518031040 2024-04-24T02:12:28.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.597+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a844326f50 con 0x55a84431e2e0 2024-04-24T02:12:28.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.597+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc510086040 con 0x55a84431e2e0 2024-04-24T02:12:28.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.597+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a844326f50 con 0x55a84431e2e0 2024-04-24T02:12:28.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.597+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc510086040 con 0x55a84431e2e0 2024-04-24T02:12:28.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.597+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a844326f50 con 0x7fc518031040 2024-04-24T02:12:28.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.597+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc510086040 con 0x7fc518031040 2024-04-24T02:12:28.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.597+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a844326f50 con 0x7fc518031040 2024-04-24T02:12:28.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.598+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc510086040 con 0x7fc518031040 2024-04-24T02:12:28.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.598+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a844326f50 con 0x7fc50801ac20 2024-04-24T02:12:28.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.598+0000 7fc51e8c6640 1 -- 172.21.15.134:0/1675928210 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc51801f070 con 0x7fc50801ac20 2024-04-24T02:12:28.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.598+0000 7fc51e8c6640 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a844326f50 con 0x55a844324530 2024-04-24T02:12:28.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.598+0000 7fc517fff640 1 -- 172.21.15.134:0/1675928210 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc508024030 con 0x55a844324530 2024-04-24T02:12:28.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.598+0000 7fc517fff640 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a844326f50 con 0x55a84431e2e0 2024-04-24T02:12:28.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.598+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc510086040 con 0x55a84431e2e0 2024-04-24T02:12:28.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.598+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a844326f50 con 0x7fc518031040 2024-04-24T02:12:28.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.599+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc510086040 con 0x7fc518031040 2024-04-24T02:12:28.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.599+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a844326f50 con 0x55a84431e2e0 2024-04-24T02:12:28.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.599+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc510086040 con 0x55a84431e2e0 2024-04-24T02:12:28.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.599+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a844326f50 con 0x7fc50801ac20 2024-04-24T02:12:28.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.599+0000 7fc51e8c6640 1 -- 172.21.15.134:0/1675928210 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc51801f070 con 0x7fc50801ac20 2024-04-24T02:12:28.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.599+0000 7fc51e8c6640 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a844326f50 con 0x55a844324530 2024-04-24T02:12:28.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.599+0000 7fc517fff640 1 -- 172.21.15.134:0/1675928210 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc508024030 con 0x55a844324530 2024-04-24T02:12:28.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.599+0000 7fc517fff640 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a844326f50 con 0x55a844324530 2024-04-24T02:12:28.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.599+0000 7fc517fff640 1 -- 172.21.15.134:0/1675928210 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc508024030 con 0x55a844324530 2024-04-24T02:12:28.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.599+0000 7fc517fff640 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a844326f50 con 0x7fc518031040 2024-04-24T02:12:28.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.600+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc510086040 con 0x7fc518031040 2024-04-24T02:12:28.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.600+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a844326f50 con 0x55a844324530 2024-04-24T02:12:28.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.600+0000 7fc517fff640 1 -- 172.21.15.134:0/1675928210 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc508024030 con 0x55a844324530 2024-04-24T02:12:28.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.600+0000 7fc517fff640 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a844326f50 con 0x55a844324530 2024-04-24T02:12:28.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.600+0000 7fc517fff640 1 -- 172.21.15.134:0/1675928210 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc508024030 con 0x55a844324530 2024-04-24T02:12:28.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.600+0000 7fc517fff640 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a844326f50 con 0x55a84431e2e0 2024-04-24T02:12:28.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.600+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc510086040 con 0x55a84431e2e0 2024-04-24T02:12:28.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.600+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a844326f50 con 0x55a84431e2e0 2024-04-24T02:12:28.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.601+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fc510086040 con 0x55a84431e2e0 2024-04-24T02:12:28.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.601+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a844326f50 con 0x7fc518031040 2024-04-24T02:12:28.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.601+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc510086040 con 0x7fc518031040 2024-04-24T02:12:28.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.601+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a844326f50 con 0x55a844324530 2024-04-24T02:12:28.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.601+0000 7fc517fff640 1 -- 172.21.15.134:0/1675928210 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc508024030 con 0x55a844324530 2024-04-24T02:12:28.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.601+0000 7fc517fff640 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a844326f50 con 0x7fc50801ac20 2024-04-24T02:12:28.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.601+0000 7fc51e8c6640 1 -- 172.21.15.134:0/1675928210 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc51801f070 con 0x7fc50801ac20 2024-04-24T02:12:28.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.601+0000 7fc51e8c6640 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a844326f50 con 0x55a84431e2e0 2024-04-24T02:12:28.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.602+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc510086040 con 0x55a84431e2e0 2024-04-24T02:12:28.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.602+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a844326f50 con 0x7fc518031040 2024-04-24T02:12:28.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.602+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc510086040 con 0x7fc518031040 2024-04-24T02:12:28.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.602+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a844326f50 con 0x55a844324530 2024-04-24T02:12:28.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.602+0000 7fc517fff640 1 -- 172.21.15.134:0/1675928210 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc508024030 con 0x55a844324530 2024-04-24T02:12:28.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.602+0000 7fc517fff640 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a844326f50 con 0x7fc518031040 2024-04-24T02:12:28.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.603+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc510086040 con 0x7fc518031040 2024-04-24T02:12:28.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.603+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a844326f50 con 0x7fc50801ac20 2024-04-24T02:12:28.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.603+0000 7fc51e8c6640 1 -- 172.21.15.134:0/1675928210 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc51801f070 con 0x7fc50801ac20 2024-04-24T02:12:28.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.603+0000 7fc51e8c6640 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a844326f50 con 0x55a844324530 2024-04-24T02:12:28.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.603+0000 7fc517fff640 1 -- 172.21.15.134:0/1675928210 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc508024030 con 0x55a844324530 2024-04-24T02:12:28.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.603+0000 7fc517fff640 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a844326f50 con 0x7fc518031040 2024-04-24T02:12:28.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.603+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc510086040 con 0x7fc518031040 2024-04-24T02:12:28.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.603+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a844326f50 con 0x55a84431e2e0 2024-04-24T02:12:28.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.604+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc510086040 con 0x55a84431e2e0 2024-04-24T02:12:28.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.604+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a844326f50 con 0x7fc50801ac20 2024-04-24T02:12:28.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.604+0000 7fc51e8c6640 1 -- 172.21.15.134:0/1675928210 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc51801f070 con 0x7fc50801ac20 2024-04-24T02:12:28.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.604+0000 7fc52232d800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:28.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.604+0000 7fc52232d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:28.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.604+0000 7fc52232d800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:28.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.604+0000 7fc52232d800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:28.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.604+0000 7fc52232d800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:28.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.604+0000 7fc52232d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:28.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.604+0000 7fc52232d800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.604+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a844323110 con 0x55a84431e2e0 2024-04-24T02:12:28.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.604+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc510086040 con 0x55a84431e2e0 2024-04-24T02:12:28.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.604+0000 7fc52232d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:28.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.604+0000 7fc52232d800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.604+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a8443239b0 con 0x55a84431e2e0 2024-04-24T02:12:28.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.604+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc510086040 con 0x55a84431e2e0 2024-04-24T02:12:28.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.604+0000 7fc52232d800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:28.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.604+0000 7fc52232d800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.604+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a8443273b0 con 0x55a84431e2e0 2024-04-24T02:12:28.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.605+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc510086040 con 0x55a84431e2e0 2024-04-24T02:12:28.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.605+0000 7fc52232d800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:28.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.605+0000 7fc52232d800 20 zone default found 2024-04-24T02:12:28.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.605+0000 7fc52232d800 4 Realm: () 2024-04-24T02:12:28.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.605+0000 7fc52232d800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:28.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.605+0000 7fc52232d800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:28.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.605+0000 7fc52232d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:28.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.605+0000 7fc52232d800 20 zonegroup default 2024-04-24T02:12:28.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.605+0000 7fc52232d800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.605+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a844327420 con 0x7fc518031040 2024-04-24T02:12:28.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.605+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc510086040 con 0x7fc518031040 2024-04-24T02:12:28.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.605+0000 7fc52232d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:28.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.605+0000 7fc52232d800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.605+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a844329240 con 0x55a844324530 2024-04-24T02:12:28.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.605+0000 7fc517fff640 1 -- 172.21.15.134:0/1675928210 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc508024030 con 0x55a844324530 2024-04-24T02:12:28.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.605+0000 7fc52232d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:28.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.605+0000 7fc52232d800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.605+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a844329630 con 0x55a844324530 2024-04-24T02:12:28.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.606+0000 7fc517fff640 1 -- 172.21.15.134:0/1675928210 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc508024030 con 0x55a844324530 2024-04-24T02:12:28.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.606+0000 7fc52232d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:28.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.606+0000 7fc52232d800 20 started sync module instance, tier type = 2024-04-24T02:12:28.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.606+0000 7fc52232d800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:28.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.606+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a8443286e0 con 0x7fc50801ac20 2024-04-24T02:12:28.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.607+0000 7fc51e8c6640 1 -- 172.21.15.134:0/1675928210 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc518040040 con 0x7fc50801ac20 2024-04-24T02:12:28.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.607+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94181187029712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a844329f40 con 0x7fc50801ac20 2024-04-24T02:12:28.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.607+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a84432a790 con 0x55a84431e2e0 2024-04-24T02:12:28.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.608+0000 7fc51e8c6640 1 -- 172.21.15.134:0/1675928210 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94181187029712] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc518040040 con 0x7fc50801ac20 2024-04-24T02:12:28.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.608+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc510086040 con 0x55a84431e2e0 2024-04-24T02:12:28.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.608+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94181187033744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a84432a420 con 0x55a84431e2e0 2024-04-24T02:12:28.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.608+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a84432af20 con 0x55a844324530 2024-04-24T02:12:28.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.609+0000 7fc517fff640 1 -- 172.21.15.134:0/1675928210 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc508024030 con 0x55a844324530 2024-04-24T02:12:28.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.609+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94181187037712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a84432b7f0 con 0x55a844324530 2024-04-24T02:12:28.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.609+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a84432c2e0 con 0x7fc50801ac20 2024-04-24T02:12:28.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.609+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94181187033744] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc510086040 con 0x55a84431e2e0 2024-04-24T02:12:28.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.610+0000 7fc51e8c6640 1 -- 172.21.15.134:0/1675928210 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc518040040 con 0x7fc50801ac20 2024-04-24T02:12:28.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.610+0000 7fc517fff640 1 -- 172.21.15.134:0/1675928210 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94181187037712] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc508024030 con 0x55a844324530 2024-04-24T02:12:28.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.610+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94181187042736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a844329eb0 con 0x7fc50801ac20 2024-04-24T02:12:28.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.610+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a84432ccf0 con 0x55a84431e2e0 2024-04-24T02:12:28.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.611+0000 7fc51e8c6640 1 -- 172.21.15.134:0/1675928210 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94181187042736] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc518040040 con 0x7fc50801ac20 2024-04-24T02:12:28.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.611+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc510086040 con 0x55a84431e2e0 2024-04-24T02:12:28.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.611+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94181187040064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a84432ccf0 con 0x55a84431e2e0 2024-04-24T02:12:28.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.611+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a84432d6b0 con 0x7fc518031040 2024-04-24T02:12:28.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.612+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94181187040064] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc510086040 con 0x55a84431e2e0 2024-04-24T02:12:28.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.612+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc510086040 con 0x7fc518031040 2024-04-24T02:12:28.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.612+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94181187045920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a84432d6b0 con 0x7fc518031040 2024-04-24T02:12:28.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.612+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a84432e070 con 0x7fc518031040 2024-04-24T02:12:28.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.613+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94181187045920] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc510086040 con 0x7fc518031040 2024-04-24T02:12:28.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.614+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(56 notify.6 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc510086040 con 0x7fc518031040 2024-04-24T02:12:28.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.614+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94181187048208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a84432e070 con 0x7fc518031040 2024-04-24T02:12:28.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.614+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a84432ea30 con 0x7fc518031040 2024-04-24T02:12:28.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.615+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(58 notify.7 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc510086040 con 0x7fc518031040 2024-04-24T02:12:28.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.615+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94181187052928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a84432ee50 con 0x7fc518031040 2024-04-24T02:12:28.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.615+0000 7fc52232d800 20 add_watcher() i=0 2024-04-24T02:12:28.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.615+0000 7fc52232d800 20 add_watcher() i=1 2024-04-24T02:12:28.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.615+0000 7fc52232d800 20 add_watcher() i=2 2024-04-24T02:12:28.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.615+0000 7fc52232d800 20 add_watcher() i=3 2024-04-24T02:12:28.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.615+0000 7fc52232d800 20 add_watcher() i=4 2024-04-24T02:12:28.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.615+0000 7fc52232d800 20 add_watcher() i=5 2024-04-24T02:12:28.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.615+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94181187048208] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc510086040 con 0x7fc518031040 2024-04-24T02:12:28.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.615+0000 7fc52232d800 20 add_watcher() i=6 2024-04-24T02:12:28.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.616+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94181187052928] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc510086040 con 0x7fc518031040 2024-04-24T02:12:28.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.616+0000 7fc52232d800 20 add_watcher() i=7 2024-04-24T02:12:28.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.616+0000 7fc52232d800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:28.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.616+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a84432ee50 con 0x55a84431e2e0 2024-04-24T02:12:28.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.616+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc510086040 con 0x55a84431e2e0 2024-04-24T02:12:28.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.616+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94181187053984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a84432edc0 con 0x55a84431e2e0 2024-04-24T02:12:28.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.617+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94181187053984] v30'155 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc510086040 con 0x55a84431e2e0 2024-04-24T02:12:28.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.617+0000 7fc3d4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:28.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.618+0000 7fc52232d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:28.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.618+0000 7fc52232d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:28.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.618+0000 7fc52232d800 5 note: GC not initialized 2024-04-24T02:12:28.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.618+0000 7fc34f7fe640 20 reqs_thread_entry: start 2024-04-24T02:12:28.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.618+0000 7fc52232d800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:28.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.618+0000 7fc52232d800 20 Filter name: none 2024-04-24T02:12:28.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.618+0000 7fc34d7fa640 20 reqs_thread_entry: start 2024-04-24T02:12:28.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.618+0000 7fc52232d800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T02:12:28.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.618+0000 7fc52232d800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.618+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a844365130 con 0x55a84431e2e0 2024-04-24T02:12:28.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.618+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc510086040 con 0x55a84431e2e0 2024-04-24T02:12:28.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.618+0000 7fc52232d800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T02:12:28.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.618+0000 7fc52232d800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T02:12:28.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.618+0000 7fc52232d800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:28.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.618+0000 7fc52232d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:12:28.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.618+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a844364c10 con 0x7fc50801ac20 2024-04-24T02:12:28.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.619+0000 7fc51e8c6640 1 -- 172.21.15.134:0/1675928210 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fc518040040 con 0x7fc50801ac20 2024-04-24T02:12:28.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.619+0000 7fc52232d800 20 disabling bucket name=myfoo 2024-04-24T02:12:28.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.619+0000 7fc52232d800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-24T02:12:28.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.619+0000 7fc52232d800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.619+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a844365ba0 con 0x7fc50801ac20 2024-04-24T02:12:28.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.619+0000 7fc51e8c6640 1 -- 172.21.15.134:0/1675928210 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7fc518040040 con 0x7fc50801ac20 2024-04-24T02:12:28.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.619+0000 7fc52232d800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T02:12:28.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.619+0000 7fc52232d800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-04-24T02:12:28.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.619+0000 7fc52232d800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T02:12:28.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.619+0000 7fc52232d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 : miss 2024-04-24T02:12:28.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.619+0000 7fc52232d800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.619+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:65 8.1d 8:be2d2b4a:root::.bucket.meta.myfoo%3a582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a844367480 con 0x7fc518031040 2024-04-24T02:12:28.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.620+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(65 .bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fc510086040 con 0x7fc518031040 2024-04-24T02:12:28.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.620+0000 7fc52232d800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T02:12:28.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.620+0000 7fc52232d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 info.flags=0x17 2024-04-24T02:12:28.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.620+0000 7fc52232d800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 to cache LRU end 2024-04-24T02:12:28.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.620+0000 7fc52232d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:12:28.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.620+0000 7fc52232d800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T02:12:28.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.620+0000 7fc52232d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 2024-04-24T02:12:28.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.620+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:66 8.1d 8:be2d2b4a:root::.bucket.meta.myfoo%3a582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a844370030 con 0x7fc518031040 2024-04-24T02:12:28.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.621+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(66 .bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v30'6 uv6 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7fc510086040 con 0x7fc518031040 2024-04-24T02:12:28.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.621+0000 7fc52232d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 info.flags=0x17 2024-04-24T02:12:28.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.621+0000 7fc52232d800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 to cache LRU end 2024-04-24T02:12:28.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.621+0000 7fc52232d800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T02:12:28.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.621+0000 7fc52232d800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1, ofs0, ns] 2024-04-24T02:12:28.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.621+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:67 7.9 7:93e5b521:::notify.7:head [notify cookie 94181187297680 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a84436aa60 con 0x7fc518031040 2024-04-24T02:12:28.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.621+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== watch-notify(notify (1) cookie 94181187052928 notify 128849018897 ret 0) ==== 794+0+0 (crc 0 0 0) 0x55a844367820 con 0x7fc518031040 2024-04-24T02:12:28.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.621+0000 7fc401ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018897 cookie 94181187052928 notifier 4586 bl.length()=752 2024-04-24T02:12:28.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.621+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.0 v2:172.21.15.104:6800/2419146313 20 ==== osd_op_reply(67 notify.7 [notify cookie 94181187297680 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc510086040 con 0x7fc518031040 2024-04-24T02:12:28.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.621+0000 7fc401ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 info.flags=0x17 2024-04-24T02:12:28.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.621+0000 7fc401ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 to cache LRU end 2024-04-24T02:12:28.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.621+0000 7fc401ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T02:12:28.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.621+0000 7fc401ffb640 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:68 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fc3e4003ea0 con 0x7fc518031040 2024-04-24T02:12:28.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.621+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.0 v2:172.21.15.104:6800/2419146313 21 ==== osd_op_reply(68 notify.7 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc510086040 con 0x7fc518031040 2024-04-24T02:12:28.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.621+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.0 v2:172.21.15.104:6800/2419146313 22 ==== watch-notify(notify_complete (2) cookie 94181187297680 notify 128849018897 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a8443658e0 con 0x7fc518031040 2024-04-24T02:12:28.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.621+0000 7fc52232d800 20 handle_bi_update(): bucket=:myfoo[582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1]): orig_sources= new_sources= 2024-04-24T02:12:28.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.621+0000 7fc52232d800 20 handle_bi_update(): bucket=:myfoo[582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1]): potential sources added=[] removed=[] 2024-04-24T02:12:28.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.621+0000 7fc52232d800 20 handle_bi_update(): bucket=:myfoo[582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1]): orig_dests= new_dests= 2024-04-24T02:12:28.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.621+0000 7fc52232d800 20 handle_bi_update(): bucket=:myfoo[582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1]): potential dests added=[] removed=[] 2024-04-24T02:12:28.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.622+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a84436b120 con 0x55a84431e2e0 2024-04-24T02:12:28.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.623+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v30'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fc510086040 con 0x55a84431e2e0 2024-04-24T02:12:28.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.623+0000 7fc52232d800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T02:12:28.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.623+0000 7fc52232d800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:28.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.623+0000 7fc52232d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-24T02:12:28.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.623+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94181187270800 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a84436cc50 con 0x55a84431e2e0 2024-04-24T02:12:28.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.623+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== watch-notify(notify (1) cookie 94181187040064 notify 128849018894 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55a8443658e0 con 0x55a84431e2e0 2024-04-24T02:12:28.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.623+0000 7fc401ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018894 cookie 94181187040064 notifier 4586 bl.length()=567 2024-04-24T02:12:28.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.623+0000 7fc401ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T02:12:28.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.623+0000 7fc401ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:28.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.623+0000 7fc401ffb640 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fc3e4003ea0 con 0x55a84431e2e0 2024-04-24T02:12:28.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.623+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(70 notify.4 [notify cookie 94181187270800 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc510086040 con 0x55a84431e2e0 2024-04-24T02:12:28.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.623+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== watch-notify(notify_complete (2) cookie 94181187270800 notify 128849018894 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a8442e9310 con 0x55a84431e2e0 2024-04-24T02:12:28.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.623+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc510086040 con 0x55a84431e2e0 2024-04-24T02:12:28.642 INFO:teuthology.orchestra.run.smithi134.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T02:12:21.778798Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T02:12:21.778786Z","tags":[],"group_ids":[]} 2024-04-24T02:12:28.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.624+0000 7fc3d4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:28.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.624+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94181187053984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a84436f090 con 0x55a84431e2e0 2024-04-24T02:12:28.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.625+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94181187053984] v30'156 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc510086040 con 0x55a84431e2e0 2024-04-24T02:12:28.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.625+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94181187029712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a84432e9a0 con 0x7fc50801ac20 2024-04-24T02:12:28.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.626+0000 7fc51e8c6640 1 -- 172.21.15.134:0/1675928210 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94181187029712] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc518040040 con 0x7fc50801ac20 2024-04-24T02:12:28.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.626+0000 7fc52232d800 20 remove_watcher() i=0 2024-04-24T02:12:28.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.626+0000 7fc52232d800 2 removed watcher, disabling cache 2024-04-24T02:12:28.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.626+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94181187033744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a84432e9a0 con 0x55a84431e2e0 2024-04-24T02:12:28.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.627+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.1 v2:172.21.15.134:6804/1487076214 30 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94181187033744] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc510086040 con 0x55a84431e2e0 2024-04-24T02:12:28.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.627+0000 7fc52232d800 20 remove_watcher() i=1 2024-04-24T02:12:28.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.627+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94181187037712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a84432e9a0 con 0x55a844324530 2024-04-24T02:12:28.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.628+0000 7fc517fff640 1 -- 172.21.15.134:0/1675928210 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94181187037712] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc508024030 con 0x55a844324530 2024-04-24T02:12:28.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.628+0000 7fc52232d800 20 remove_watcher() i=2 2024-04-24T02:12:28.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.628+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94181187042736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a84432aa10 con 0x7fc50801ac20 2024-04-24T02:12:28.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.629+0000 7fc51e8c6640 1 -- 172.21.15.134:0/1675928210 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94181187042736] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc518040040 con 0x7fc50801ac20 2024-04-24T02:12:28.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.629+0000 7fc52232d800 20 remove_watcher() i=3 2024-04-24T02:12:28.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.629+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94181187040064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a84432bdb0 con 0x55a84431e2e0 2024-04-24T02:12:28.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.630+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.1 v2:172.21.15.134:6804/1487076214 31 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94181187040064] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc510086040 con 0x55a84431e2e0 2024-04-24T02:12:28.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.630+0000 7fc52232d800 20 remove_watcher() i=4 2024-04-24T02:12:28.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.630+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94181187045920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a84432aa10 con 0x7fc518031040 2024-04-24T02:12:28.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.632+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.0 v2:172.21.15.104:6800/2419146313 23 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94181187045920] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc510086040 con 0x7fc518031040 2024-04-24T02:12:28.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.632+0000 7fc52232d800 20 remove_watcher() i=5 2024-04-24T02:12:28.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.632+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94181187048208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a84432ca20 con 0x7fc518031040 2024-04-24T02:12:28.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.633+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.0 v2:172.21.15.104:6800/2419146313 24 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94181187048208] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc510086040 con 0x7fc518031040 2024-04-24T02:12:28.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.633+0000 7fc52232d800 20 remove_watcher() i=6 2024-04-24T02:12:28.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.633+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94181187052928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a84432aa10 con 0x7fc518031040 2024-04-24T02:12:28.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.634+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 <== osd.0 v2:172.21.15.104:6800/2419146313 25 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94181187052928] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc510086040 con 0x7fc518031040 2024-04-24T02:12:28.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.634+0000 7fc52232d800 20 remove_watcher() i=7 2024-04-24T02:12:28.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.634+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fc518031040 msgr2=0x7fc518032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.634+0000 7fc52232d800 1 --2- 172.21.15.134:0/1675928210 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fc518031040 0x7fc518032940 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.634+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55a84431e2e0 msgr2=0x55a8443207a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.634+0000 7fc52232d800 1 --2- 172.21.15.134:0/1675928210 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55a84431e2e0 0x55a8443207a0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.634+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fc50801ac20 msgr2=0x7fc508045270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.634+0000 7fc52232d800 1 --2- 172.21.15.134:0/1675928210 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fc50801ac20 0x7fc508045270 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.634+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55a844324530 msgr2=0x55a844326920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.634+0000 7fc52232d800 1 --2- 172.21.15.134:0/1675928210 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55a844324530 0x55a844326920 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.634+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc3e8036900 msgr2=0x7fc3e8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.634+0000 7fc52232d800 1 --2- 172.21.15.134:0/1675928210 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc3e8036900 0x7fc3e8038dc0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x55a8442ee250 tx=0x7fc51801f000 comp rx=0 tx=0).stop 2024-04-24T02:12:28.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.634+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a84430b4e0 msgr2=0x55a844312b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.634+0000 7fc52232d800 1 --2- 172.21.15.134:0/1675928210 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a84430b4e0 0x55a844312b20 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fc508025be0 tx=0x7fc50804c050 comp rx=0 tx=0).stop 2024-04-24T02:12:28.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.634+0000 7fc51e0c5640 1 -- 172.21.15.134:0/1675928210 reap_dead start 2024-04-24T02:12:28.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.634+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 shutdown_connections 2024-04-24T02:12:28.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.634+0000 7fc52232d800 1 --2- 172.21.15.134:0/1675928210 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a84430b4e0 0x55a844312b20 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.634+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 >> 172.21.15.134:0/1675928210 conn(0x55a844307840 msgr2=0x55a844304ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:28.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.634+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 shutdown_connections 2024-04-24T02:12:28.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.634+0000 7fc52232d800 1 -- 172.21.15.134:0/1675928210 wait complete. 2024-04-24T02:12:28.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.635+0000 7fc52232d800 1 -- 172.21.15.134:0/1829895972 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc3f8036950 msgr2=0x7fc3f8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.635+0000 7fc52232d800 1 --2- 172.21.15.134:0/1829895972 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc3f8036950 0x7fc3f8038e10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x55a8442eead0 tx=0x7fc518005840 comp rx=0 tx=0).stop 2024-04-24T02:12:28.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.635+0000 7fc52232d800 1 -- 172.21.15.134:0/1829895972 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a8442fe1e0 msgr2=0x55a8442fe600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.635+0000 7fc52232d800 1 --2- 172.21.15.134:0/1829895972 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a8442fe1e0 0x55a8442fe600 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc508001ed0 tx=0x7fc50800ea00 comp rx=0 tx=0).stop 2024-04-24T02:12:28.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.635+0000 7fc52232d800 1 -- 172.21.15.134:0/1829895972 shutdown_connections 2024-04-24T02:12:28.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.635+0000 7fc52232d800 1 --2- 172.21.15.134:0/1829895972 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc3f8036950 0x7fc3f8038e10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.635+0000 7fc52232d800 1 --2- 172.21.15.134:0/1829895972 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a8442fe1e0 0x55a8442fe600 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.635+0000 7fc52232d800 1 -- 172.21.15.134:0/1829895972 >> 172.21.15.134:0/1829895972 conn(0x55a8442f2280 msgr2=0x55a8442f2680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:28.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.635+0000 7fc52232d800 1 -- 172.21.15.134:0/1829895972 shutdown_connections 2024-04-24T02:12:28.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.635+0000 7fc52232d800 1 -- 172.21.15.134:0/1829895972 wait complete. 2024-04-24T02:12:28.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.635+0000 7fc52232d800 1 -- 172.21.15.134:0/3670274990 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55a8441ea0e0 msgr2=0x55a8442ed0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.635+0000 7fc52232d800 1 --2- 172.21.15.134:0/3670274990 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55a8441ea0e0 0x55a8442ed0d0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.635+0000 7fc52232d800 1 -- 172.21.15.134:0/3670274990 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc404036950 msgr2=0x7fc404038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.635+0000 7fc52232d800 1 --2- 172.21.15.134:0/3670274990 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc404036950 0x7fc404038e10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc508000f60 tx=0x7fc508001370 comp rx=0 tx=0).stop 2024-04-24T02:12:28.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.635+0000 7fc52232d800 1 -- 172.21.15.134:0/3670274990 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a8441e9780 msgr2=0x55a8442e5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.635+0000 7fc52232d800 1 --2- 172.21.15.134:0/3670274990 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a8441e9780 0x55a8442e5f30 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fc510052540 tx=0x7fc510003020 comp rx=0 tx=0).stop 2024-04-24T02:12:28.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.635+0000 7fc52232d800 1 -- 172.21.15.134:0/3670274990 shutdown_connections 2024-04-24T02:12:28.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.635+0000 7fc52232d800 1 --2- 172.21.15.134:0/3670274990 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55a8441ea0e0 0x55a8442ed0d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.635+0000 7fc52232d800 1 --2- 172.21.15.134:0/3670274990 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc404036950 0x7fc404038e10 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.635+0000 7fc52232d800 1 --2- 172.21.15.134:0/3670274990 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a8441e9780 0x55a8442e5f30 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.635+0000 7fc52232d800 1 -- 172.21.15.134:0/3670274990 >> 172.21.15.134:0/3670274990 conn(0x55a8441e5320 msgr2=0x55a8442d8530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:28.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.635+0000 7fc52232d800 1 -- 172.21.15.134:0/3670274990 shutdown_connections 2024-04-24T02:12:28.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.635+0000 7fc52232d800 1 -- 172.21.15.134:0/3670274990 wait complete. 2024-04-24T02:12:28.653 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T02:12:21.778798Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:12:21.778786Z', 'tags': [], 'group_ids': []} 2024-04-24T02:12:28.655 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-04-24T02:12:28.655 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-04-24T02:12:28.656 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-04-24T02:12:28.731 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:28.731 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:28.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.731+0000 7f0a0071f800 1 Processor -- start 2024-04-24T02:12:28.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.731+0000 7f0a0071f800 1 -- start start 2024-04-24T02:12:28.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.731+0000 7f0a0071f800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x558f2f1a28b0 0x558f2f1a4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.731+0000 7f0a0071f800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558f2f060d40 con 0x558f2f1a51e0 2024-04-24T02:12:28.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.731+0000 7f0a0071f800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x558f2f0334d0 con 0x558f2f1a28b0 2024-04-24T02:12:28.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.732+0000 7f09fc3e7640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x558f2f1a28b0 0x558f2f1a4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.732+0000 7f09fc3e7640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x558f2f1a28b0 0x558f2f1a4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56860/0 (socket says 172.21.15.134:56860) 2024-04-24T02:12:28.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.732+0000 7f09fbbe6640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x558f2f1a51e0 0x558f2f1a75d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:55374/0 (socket says 172.21.15.134:55374) 2024-04-24T02:12:28.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.732+0000 7f09fc3e7640 1 -- 172.21.15.134:0/3638205175 learned_addr learned my addr 172.21.15.134:0/3638205175 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:28.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.732+0000 7f09fc3e7640 1 -- 172.21.15.134:0/3638205175 >> v1:172.21.15.104:6789/0 conn(0x558f2f1a51e0 legacy=0x558f2f1a75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.732+0000 7f09fc3e7640 1 -- 172.21.15.134:0/3638205175 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f2f05f590 con 0x558f2f1a28b0 2024-04-24T02:12:28.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.734+0000 7f09fc3e7640 1 --2- 172.21.15.134:0/3638205175 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f2f1a28b0 0x558f2f1a4ca0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f09f400a520 tx=0x7f09f401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7ddbb5f5cfd7605 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.734+0000 7f09fb3e5640 1 -- 172.21.15.134:0/3638205175 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09f4057070 con 0x558f2f1a28b0 2024-04-24T02:12:28.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.734+0000 7f09fb3e5640 1 -- 172.21.15.134:0/3638205175 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09f4052570 con 0x558f2f1a28b0 2024-04-24T02:12:28.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.734+0000 7f09fb3e5640 1 -- 172.21.15.134:0/3638205175 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09f404ae60 con 0x558f2f1a28b0 2024-04-24T02:12:28.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.734+0000 7f0a0071f800 1 -- 172.21.15.134:0/3638205175 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f2f1a28b0 msgr2=0x558f2f1a4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.734+0000 7f0a0071f800 1 --2- 172.21.15.134:0/3638205175 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f2f1a28b0 0x558f2f1a4ca0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f09f400a520 tx=0x7f09f401d010 comp rx=0 tx=0).stop 2024-04-24T02:12:28.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.734+0000 7f0a0071f800 1 -- 172.21.15.134:0/3638205175 shutdown_connections 2024-04-24T02:12:28.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.734+0000 7f0a0071f800 1 --2- 172.21.15.134:0/3638205175 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f2f1a28b0 0x558f2f1a4ca0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.734+0000 7f0a0071f800 1 -- 172.21.15.134:0/3638205175 >> 172.21.15.134:0/3638205175 conn(0x558f2f19c380 msgr2=0x558f2f19e7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:28.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.735+0000 7f0a0071f800 1 -- 172.21.15.134:0/3638205175 shutdown_connections 2024-04-24T02:12:28.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.735+0000 7f0a0071f800 1 -- 172.21.15.134:0/3638205175 wait complete. 2024-04-24T02:12:28.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.746+0000 7f0a0071f800 1 Processor -- start 2024-04-24T02:12:28.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.746+0000 7f0a0071f800 1 -- start start 2024-04-24T02:12:28.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.746+0000 7f0a0071f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f2f1a28b0 0x558f2f2930d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.746+0000 7f0a0071f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x558f2f0ed3c0 con 0x558f2f1a28b0 2024-04-24T02:12:28.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.747+0000 7f09fc3e7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f2f1a28b0 0x558f2f2930d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.747+0000 7f09fc3e7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f2f1a28b0 0x558f2f2930d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56874/0 (socket says 172.21.15.134:56874) 2024-04-24T02:12:28.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.747+0000 7f09fc3e7640 1 -- 172.21.15.134:0/3007010505 learned_addr learned my addr 172.21.15.134:0/3007010505 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:28.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.747+0000 7f09fc3e7640 1 -- 172.21.15.134:0/3007010505 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f2f2936a0 con 0x558f2f1a28b0 2024-04-24T02:12:28.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.747+0000 7f09fc3e7640 1 --2- 172.21.15.134:0/3007010505 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f2f1a28b0 0x558f2f2930d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f09f4055040 tx=0x7f09f404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f245aec530971e97 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.747+0000 7f08ea60c640 1 -- 172.21.15.134:0/3007010505 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09f4057040 con 0x558f2f1a28b0 2024-04-24T02:12:28.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.747+0000 7f08ea60c640 1 -- 172.21.15.134:0/3007010505 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09f4052720 con 0x558f2f1a28b0 2024-04-24T02:12:28.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.747+0000 7f08ea60c640 1 -- 172.21.15.134:0/3007010505 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09f4052a40 con 0x558f2f1a28b0 2024-04-24T02:12:28.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.748+0000 7f0a0071f800 1 -- 172.21.15.134:0/3007010505 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f2f1a28b0 msgr2=0x558f2f2930d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.748+0000 7f0a0071f800 1 --2- 172.21.15.134:0/3007010505 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f2f1a28b0 0x558f2f2930d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f09f4055040 tx=0x7f09f404c000 comp rx=0 tx=0).stop 2024-04-24T02:12:28.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.748+0000 7f0a0071f800 1 -- 172.21.15.134:0/3007010505 shutdown_connections 2024-04-24T02:12:28.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.748+0000 7f0a0071f800 1 --2- 172.21.15.134:0/3007010505 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f2f1a28b0 0x558f2f2930d0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.748+0000 7f0a0071f800 1 -- 172.21.15.134:0/3007010505 >> 172.21.15.134:0/3007010505 conn(0x558f2f19c380 msgr2=0x558f2f28e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:28.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.748+0000 7f0a0071f800 1 -- 172.21.15.134:0/3007010505 shutdown_connections 2024-04-24T02:12:28.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.748+0000 7f0a0071f800 1 -- 172.21.15.134:0/3007010505 wait complete. 2024-04-24T02:12:28.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.748+0000 7f0a0071f800 1 Processor -- start 2024-04-24T02:12:28.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.748+0000 7f0a0071f800 1 -- start start 2024-04-24T02:12:28.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.748+0000 7f0a0071f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f2f1a28b0 0x558f2f1a2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.748+0000 7f0a0071f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x558f2f1a8f90 con 0x558f2f1a28b0 2024-04-24T02:12:28.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.749+0000 7f09fc3e7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f2f1a28b0 0x558f2f1a2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.749+0000 7f09fc3e7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f2f1a28b0 0x558f2f1a2150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56876/0 (socket says 172.21.15.134:56876) 2024-04-24T02:12:28.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.749+0000 7f09fc3e7640 1 -- 172.21.15.134:0/397579372 learned_addr learned my addr 172.21.15.134:0/397579372 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:28.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.749+0000 7f09fc3e7640 1 -- 172.21.15.134:0/397579372 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f2f1a2690 con 0x558f2f1a28b0 2024-04-24T02:12:28.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.749+0000 7f09fc3e7640 1 --2- 172.21.15.134:0/397579372 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f2f1a28b0 0x558f2f1a2150 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f09f4052540 tx=0x7f09f4003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.749+0000 7f08e8e09640 1 -- 172.21.15.134:0/397579372 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09f4073070 con 0x558f2f1a28b0 2024-04-24T02:12:28.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.749+0000 7f08e8e09640 1 -- 172.21.15.134:0/397579372 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09f405d440 con 0x558f2f1a28b0 2024-04-24T02:12:28.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.749+0000 7f0a0071f800 1 -- 172.21.15.134:0/397579372 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558f2f1a08e0 con 0x558f2f1a28b0 2024-04-24T02:12:28.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.749+0000 7f08e8e09640 1 -- 172.21.15.134:0/397579372 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09f4057070 con 0x558f2f1a28b0 2024-04-24T02:12:28.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.749+0000 7f0a0071f800 1 -- 172.21.15.134:0/397579372 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f2f1a0e00 con 0x558f2f1a28b0 2024-04-24T02:12:28.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.750+0000 7f08e8e09640 1 -- 172.21.15.134:0/397579372 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f09f4076070 con 0x558f2f1a28b0 2024-04-24T02:12:28.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.750+0000 7f08e8e09640 1 --2- 172.21.15.134:0/397579372 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f08e4036900 0x7f08e4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.750+0000 7f08e8e09640 1 -- 172.21.15.134:0/397579372 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f09f408dab0 con 0x558f2f1a28b0 2024-04-24T02:12:28.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.750+0000 7f09fbbe6640 1 --2- 172.21.15.134:0/397579372 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f08e4036900 0x7f08e4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.751+0000 7f0a0071f800 1 --2- 172.21.15.134:0/397579372 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x558f2f1a51e0 0x558f2f2a4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.751+0000 7f0a0071f800 1 -- 172.21.15.134:0/397579372 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2a4540 con 0x558f2f1a51e0 2024-04-24T02:12:28.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.751+0000 7f09fcbe8640 1 --2- 172.21.15.134:0/397579372 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x558f2f1a51e0 0x558f2f2a4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.751+0000 7f09fbbe6640 1 --2- 172.21.15.134:0/397579372 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f08e4036900 0x7f08e4038dc0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f09e4000f60 tx=0x7f09e4001370 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.751+0000 7f09fcbe8640 1 --2- 172.21.15.134:0/397579372 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x558f2f1a51e0 0x558f2f2a4000 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.751+0000 7f09fcbe8640 1 -- 172.21.15.134:0/397579372 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f09ec00a4a0 con 0x558f2f1a51e0 2024-04-24T02:12:28.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.751+0000 7f0a0071f800 1 -- 172.21.15.134:0/397579372 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558f2f1a12b0 con 0x558f2f1a51e0 2024-04-24T02:12:28.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.752+0000 7f09fcbe8640 1 -- 172.21.15.134:0/397579372 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f09ec00a4a0 con 0x558f2f1a51e0 2024-04-24T02:12:28.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.752+0000 7f0a0071f800 1 -- 172.21.15.134:0/397579372 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2a6340 con 0x558f2f1a51e0 2024-04-24T02:12:28.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.752+0000 7f09fcbe8640 1 -- 172.21.15.134:0/397579372 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f09ec00a4a0 con 0x558f2f1a51e0 2024-04-24T02:12:28.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.752+0000 7f0a0071f800 1 -- 172.21.15.134:0/397579372 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2a5680 con 0x558f2f1a51e0 2024-04-24T02:12:28.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.752+0000 7f09fcbe8640 1 -- 172.21.15.134:0/397579372 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f09ec00a4a0 con 0x558f2f1a51e0 2024-04-24T02:12:28.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.752+0000 7f0a0071f800 1 -- 172.21.15.134:0/397579372 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2a5ad0 con 0x558f2f1a51e0 2024-04-24T02:12:28.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.752+0000 7f09fcbe8640 1 -- 172.21.15.134:0/397579372 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f09ec00a4a0 con 0x558f2f1a51e0 2024-04-24T02:12:28.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.753+0000 7f0a0071f800 1 Processor -- start 2024-04-24T02:12:28.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.753+0000 7f0a0071f800 1 -- start start 2024-04-24T02:12:28.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.753+0000 7f0a0071f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f2f2b5110 0x558f2f2b5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.753+0000 7f0a0071f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x558f2f0936b0 con 0x558f2f2b5110 2024-04-24T02:12:28.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.753+0000 7f09fbbe6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f2f2b5110 0x558f2f2b5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.753+0000 7f09fbbe6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f2f2b5110 0x558f2f2b5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56880/0 (socket says 172.21.15.134:56880) 2024-04-24T02:12:28.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.753+0000 7f09fbbe6640 1 -- 172.21.15.134:0/2888006395 learned_addr learned my addr 172.21.15.134:0/2888006395 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:28.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.753+0000 7f09fbbe6640 1 -- 172.21.15.134:0/2888006395 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f2f2b5a70 con 0x558f2f2b5110 2024-04-24T02:12:28.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.754+0000 7f09fbbe6640 1 --2- 172.21.15.134:0/2888006395 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f2f2b5110 0x558f2f2b5530 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f09e4001ed0 tx=0x7f09e400ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.754+0000 7f08e1ffb640 1 -- 172.21.15.134:0/2888006395 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09e4022070 con 0x558f2f2b5110 2024-04-24T02:12:28.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.754+0000 7f08e1ffb640 1 -- 172.21.15.134:0/2888006395 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09e400d520 con 0x558f2f2b5110 2024-04-24T02:12:28.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.754+0000 7f0a0071f800 1 -- 172.21.15.134:0/2888006395 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558f2f2b64e0 con 0x558f2f2b5110 2024-04-24T02:12:28.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.754+0000 7f08e1ffb640 1 -- 172.21.15.134:0/2888006395 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09e400d800 con 0x558f2f2b5110 2024-04-24T02:12:28.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.754+0000 7f0a0071f800 1 -- 172.21.15.134:0/2888006395 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f2f2b69e0 con 0x558f2f2b5110 2024-04-24T02:12:28.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.755+0000 7f08e1ffb640 1 -- 172.21.15.134:0/2888006395 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f09e4025070 con 0x558f2f2b5110 2024-04-24T02:12:28.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.755+0000 7f08e1ffb640 1 --2- 172.21.15.134:0/2888006395 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f08d4036900 0x7f08d4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.755+0000 7f08e1ffb640 1 -- 172.21.15.134:0/2888006395 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f09e404db50 con 0x558f2f2b5110 2024-04-24T02:12:28.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.755+0000 7f09fcbe8640 1 --2- 172.21.15.134:0/2888006395 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f08d4036900 0x7f08d4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.755+0000 7f0a0071f800 1 Processor -- start 2024-04-24T02:12:28.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.755+0000 7f0a0071f800 1 -- start start 2024-04-24T02:12:28.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.755+0000 7f09fcbe8640 1 --2- 172.21.15.134:0/2888006395 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f08d4036900 0x7f08d4038dc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x558f2f2a51a0 tx=0x7f09ec005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.755+0000 7f0a0071f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f2f2c2450 0x558f2f2c2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.755+0000 7f0a0071f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x558f2f293960 con 0x558f2f2c2450 2024-04-24T02:12:28.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.756+0000 7f09fbbe6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f2f2c2450 0x558f2f2c2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.756+0000 7f09fbbe6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f2f2c2450 0x558f2f2c2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56888/0 (socket says 172.21.15.134:56888) 2024-04-24T02:12:28.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.756+0000 7f09fbbe6640 1 -- 172.21.15.134:0/2183597647 learned_addr learned my addr 172.21.15.134:0/2183597647 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:28.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.756+0000 7f09fbbe6640 1 -- 172.21.15.134:0/2183597647 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f2f2c2e40 con 0x558f2f2c2450 2024-04-24T02:12:28.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.756+0000 7f09fbbe6640 1 --2- 172.21.15.134:0/2183597647 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f2f2c2450 0x558f2f2c2870 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f09e404c120 tx=0x7f09e4024740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fb375b99f1faef1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.756+0000 7f08db7fe640 1 -- 172.21.15.134:0/2183597647 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09e404a030 con 0x558f2f2c2450 2024-04-24T02:12:28.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.756+0000 7f08db7fe640 1 -- 172.21.15.134:0/2183597647 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09e4026730 con 0x558f2f2c2450 2024-04-24T02:12:28.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.756+0000 7f08db7fe640 1 -- 172.21.15.134:0/2183597647 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09e4025c50 con 0x558f2f2c2450 2024-04-24T02:12:28.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.757+0000 7f0a0071f800 1 -- 172.21.15.134:0/2183597647 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f2f2c2450 msgr2=0x558f2f2c2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.757+0000 7f0a0071f800 1 --2- 172.21.15.134:0/2183597647 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f2f2c2450 0x558f2f2c2870 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f09e404c120 tx=0x7f09e4024740 comp rx=0 tx=0).stop 2024-04-24T02:12:28.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.757+0000 7f0a0071f800 1 -- 172.21.15.134:0/2183597647 shutdown_connections 2024-04-24T02:12:28.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.757+0000 7f0a0071f800 1 --2- 172.21.15.134:0/2183597647 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f2f2c2450 0x558f2f2c2870 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.757+0000 7f0a0071f800 1 -- 172.21.15.134:0/2183597647 >> 172.21.15.134:0/2183597647 conn(0x558f2f2be7b0 msgr2=0x558f2f2bc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:28.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.757+0000 7f0a0071f800 1 -- 172.21.15.134:0/2183597647 shutdown_connections 2024-04-24T02:12:28.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.757+0000 7f0a0071f800 1 -- 172.21.15.134:0/2183597647 wait complete. 2024-04-24T02:12:28.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.757+0000 7f0a0071f800 1 Processor -- start 2024-04-24T02:12:28.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.757+0000 7f0a0071f800 1 -- start start 2024-04-24T02:12:28.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.757+0000 7f0a0071f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f2f2c2450 0x558f2f2c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.757+0000 7f0a0071f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x558f2f2c35b0 con 0x558f2f2c2450 2024-04-24T02:12:28.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.757+0000 7f09fbbe6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f2f2c2450 0x558f2f2c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.757+0000 7f09fbbe6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f2f2c2450 0x558f2f2c9ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:56896/0 (socket says 172.21.15.134:56896) 2024-04-24T02:12:28.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.757+0000 7f09fbbe6640 1 -- 172.21.15.134:0/2779043320 learned_addr learned my addr 172.21.15.134:0/2779043320 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:28.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.758+0000 7f09fbbe6640 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f2f2ca020 con 0x558f2f2c2450 2024-04-24T02:12:28.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.758+0000 7f09fbbe6640 1 --2- 172.21.15.134:0/2779043320 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f2f2c2450 0x558f2f2c9ae0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f09e4024fd0 tx=0x7f09e404c080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.758+0000 7f08d9ffb640 1 -- 172.21.15.134:0/2779043320 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09e400dbb0 con 0x558f2f2c2450 2024-04-24T02:12:28.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.758+0000 7f08d9ffb640 1 -- 172.21.15.134:0/2779043320 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09e400dd50 con 0x558f2f2c2450 2024-04-24T02:12:28.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.758+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558f2f2ca020 con 0x558f2f2c2450 2024-04-24T02:12:28.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.758+0000 7f08d9ffb640 1 -- 172.21.15.134:0/2779043320 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09e404d2d0 con 0x558f2f2c2450 2024-04-24T02:12:28.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.758+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f2f2ca020 con 0x558f2f2c2450 2024-04-24T02:12:28.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.759+0000 7f08d9ffb640 1 -- 172.21.15.134:0/2779043320 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f09e404d470 con 0x558f2f2c2450 2024-04-24T02:12:28.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.759+0000 7f08d9ffb640 1 --2- 172.21.15.134:0/2779043320 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f08cc036900 0x7f08cc038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.759+0000 7f08d9ffb640 1 -- 172.21.15.134:0/2779043320 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f09e4045070 con 0x558f2f2c2450 2024-04-24T02:12:28.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.759+0000 7f09fcbe8640 1 --2- 172.21.15.134:0/2779043320 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f08cc036900 0x7f08cc038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.759+0000 7f09fcbe8640 1 --2- 172.21.15.134:0/2779043320 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f08cc036900 0x7f08cc038dc0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x558f2f1a1cb0 tx=0x7f09ec01f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.759+0000 7f0a0071f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.760+0000 7f0a0071f800 1 --2- 172.21.15.134:0/2779043320 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x558f2f2d5220 0x558f2f2d76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.760+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2d7e30 con 0x558f2f2d5220 2024-04-24T02:12:28.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.760+0000 7f09fc3e7640 1 --2- 172.21.15.134:0/2779043320 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x558f2f2d5220 0x558f2f2d76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.760+0000 7f09fc3e7640 1 --2- 172.21.15.134:0/2779043320 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x558f2f2d5220 0x558f2f2d76e0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.760+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f09f4075030 con 0x558f2f2d5220 2024-04-24T02:12:28.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.760+0000 7f0a0071f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:28.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.760+0000 7f0a0071f800 20 realm 2024-04-24T02:12:28.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.760+0000 7f0a0071f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.760+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2d8240 con 0x558f2f2d5220 2024-04-24T02:12:28.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.761+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f09f4075030 con 0x558f2f2d5220 2024-04-24T02:12:28.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.761+0000 7f0a0071f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:28.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.761+0000 7f0a0071f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:28.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.761+0000 7f0a0071f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.761+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2d8b10 con 0x558f2f2d5220 2024-04-24T02:12:28.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.761+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f09f4075030 con 0x558f2f2d5220 2024-04-24T02:12:28.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.761+0000 7f0a0071f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:28.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.761+0000 7f0a0071f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.761+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2d8eb0 con 0x558f2f2d5220 2024-04-24T02:12:28.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.761+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f09f4075030 con 0x558f2f2d5220 2024-04-24T02:12:28.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.761+0000 7f0a0071f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:28.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.761+0000 7f0a0071f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.761+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2d9700 con 0x558f2f2d5220 2024-04-24T02:12:28.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.761+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f09f4075030 con 0x558f2f2d5220 2024-04-24T02:12:28.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.761+0000 7f0a0071f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:28.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.761+0000 7f0a0071f800 20 searching for the correct realm 2024-04-24T02:12:28.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.761+0000 7f0a0071f800 1 --2- 172.21.15.134:0/2779043320 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x558f2f2db470 0x558f2f2dd860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.761+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2dde40 con 0x558f2f2db470 2024-04-24T02:12:28.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.761+0000 7f09fbbe6640 1 --2- 172.21.15.134:0/2779043320 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x558f2f2db470 0x558f2f2dd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.762+0000 7f09fbbe6640 1 --2- 172.21.15.134:0/2779043320 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x558f2f2db470 0x558f2f2dd860 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.762+0000 7f09fbbe6640 1 -- 172.21.15.134:0/2779043320 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09e4024030 con 0x558f2f2db470 2024-04-24T02:12:28.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.762+0000 7f09fbbe6640 1 --2- 172.21.15.134:0/2779043320 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f09e401ac20 0x7f09e401c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.762+0000 7f09fbbe6640 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2dde40 con 0x7f09e401ac20 2024-04-24T02:12:28.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.762+0000 7f09fcbe8640 1 --2- 172.21.15.134:0/2779043320 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f09e401ac20 0x7f09e401c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.763+0000 7f09fcbe8640 1 --2- 172.21.15.134:0/2779043320 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f09e401ac20 0x7f09e401c420 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.763+0000 7f09fcbe8640 1 -- 172.21.15.134:0/2779043320 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09ec01f070 con 0x7f09e401ac20 2024-04-24T02:12:28.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.763+0000 7f09fcbe8640 1 --2- 172.21.15.134:0/2779043320 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f09ec031040 0x7f09ec032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:28.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.763+0000 7f09fcbe8640 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2dde40 con 0x7f09ec031040 2024-04-24T02:12:28.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.763+0000 7f09fc3e7640 1 --2- 172.21.15.134:0/2779043320 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f09ec031040 0x7f09ec032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:28.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.764+0000 7f09fc3e7640 1 --2- 172.21.15.134:0/2779043320 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f09ec031040 0x7f09ec032940 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:28.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.764+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f4075030 con 0x7f09ec031040 2024-04-24T02:12:28.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.764+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2dde40 con 0x558f2f2d5220 2024-04-24T02:12:28.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.764+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f4075030 con 0x558f2f2d5220 2024-04-24T02:12:28.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.764+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2dde40 con 0x558f2f2d5220 2024-04-24T02:12:28.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.765+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f09f4075030 con 0x558f2f2d5220 2024-04-24T02:12:28.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.765+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2dde40 con 0x7f09ec031040 2024-04-24T02:12:28.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.765+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f4075030 con 0x7f09ec031040 2024-04-24T02:12:28.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.765+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2dde40 con 0x7f09ec031040 2024-04-24T02:12:28.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.765+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f4075030 con 0x7f09ec031040 2024-04-24T02:12:28.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.765+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2dde40 con 0x7f09e401ac20 2024-04-24T02:12:28.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.765+0000 7f09fcbe8640 1 -- 172.21.15.134:0/2779043320 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09ec01f070 con 0x7f09e401ac20 2024-04-24T02:12:28.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.765+0000 7f09fcbe8640 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2dde40 con 0x558f2f2db470 2024-04-24T02:12:28.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.766+0000 7f09fbbe6640 1 -- 172.21.15.134:0/2779043320 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09e405c040 con 0x558f2f2db470 2024-04-24T02:12:28.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.766+0000 7f09fbbe6640 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2dde40 con 0x558f2f2d5220 2024-04-24T02:12:28.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.766+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f4075030 con 0x558f2f2d5220 2024-04-24T02:12:28.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.766+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2dde40 con 0x7f09ec031040 2024-04-24T02:12:28.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.766+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f4075030 con 0x7f09ec031040 2024-04-24T02:12:28.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.766+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2dde40 con 0x558f2f2d5220 2024-04-24T02:12:28.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.766+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f4075030 con 0x558f2f2d5220 2024-04-24T02:12:28.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.766+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2dde40 con 0x7f09e401ac20 2024-04-24T02:12:28.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.767+0000 7f09fcbe8640 1 -- 172.21.15.134:0/2779043320 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f09ec01f070 con 0x7f09e401ac20 2024-04-24T02:12:28.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.767+0000 7f09fcbe8640 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2dde40 con 0x558f2f2db470 2024-04-24T02:12:28.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.767+0000 7f09fbbe6640 1 -- 172.21.15.134:0/2779043320 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09e405c040 con 0x558f2f2db470 2024-04-24T02:12:28.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.767+0000 7f09fbbe6640 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2dde40 con 0x558f2f2db470 2024-04-24T02:12:28.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.767+0000 7f09fbbe6640 1 -- 172.21.15.134:0/2779043320 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09e405c040 con 0x558f2f2db470 2024-04-24T02:12:28.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.767+0000 7f09fbbe6640 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2dde40 con 0x7f09ec031040 2024-04-24T02:12:28.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.768+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f4075030 con 0x7f09ec031040 2024-04-24T02:12:28.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.768+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2dde40 con 0x558f2f2db470 2024-04-24T02:12:28.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.768+0000 7f09fbbe6640 1 -- 172.21.15.134:0/2779043320 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09e405c040 con 0x558f2f2db470 2024-04-24T02:12:28.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.768+0000 7f09fbbe6640 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2dde40 con 0x558f2f2db470 2024-04-24T02:12:28.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.768+0000 7f09fbbe6640 1 -- 172.21.15.134:0/2779043320 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09e405c040 con 0x558f2f2db470 2024-04-24T02:12:28.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.768+0000 7f09fbbe6640 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2dde40 con 0x558f2f2d5220 2024-04-24T02:12:28.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.769+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f4075030 con 0x558f2f2d5220 2024-04-24T02:12:28.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.769+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2dde40 con 0x558f2f2d5220 2024-04-24T02:12:28.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.769+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f09f4075030 con 0x558f2f2d5220 2024-04-24T02:12:28.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.769+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2dde40 con 0x7f09ec031040 2024-04-24T02:12:28.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.769+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f4075030 con 0x7f09ec031040 2024-04-24T02:12:28.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.769+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2dde40 con 0x558f2f2db470 2024-04-24T02:12:28.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.769+0000 7f09fbbe6640 1 -- 172.21.15.134:0/2779043320 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09e405c040 con 0x558f2f2db470 2024-04-24T02:12:28.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.769+0000 7f09fbbe6640 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2dde40 con 0x7f09e401ac20 2024-04-24T02:12:28.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.770+0000 7f09fcbe8640 1 -- 172.21.15.134:0/2779043320 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09ec01f070 con 0x7f09e401ac20 2024-04-24T02:12:28.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.770+0000 7f09fcbe8640 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2dde40 con 0x558f2f2d5220 2024-04-24T02:12:28.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.770+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f4075030 con 0x558f2f2d5220 2024-04-24T02:12:28.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.770+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2dde40 con 0x7f09ec031040 2024-04-24T02:12:28.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.770+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f4075030 con 0x7f09ec031040 2024-04-24T02:12:28.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.770+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2dde40 con 0x558f2f2db470 2024-04-24T02:12:28.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.771+0000 7f09fbbe6640 1 -- 172.21.15.134:0/2779043320 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09e405c040 con 0x558f2f2db470 2024-04-24T02:12:28.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.771+0000 7f09fbbe6640 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2dde40 con 0x7f09ec031040 2024-04-24T02:12:28.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.771+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f4075030 con 0x7f09ec031040 2024-04-24T02:12:28.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.771+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2dde40 con 0x7f09e401ac20 2024-04-24T02:12:28.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.771+0000 7f09fcbe8640 1 -- 172.21.15.134:0/2779043320 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09ec01f070 con 0x7f09e401ac20 2024-04-24T02:12:28.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.771+0000 7f09fcbe8640 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2dde40 con 0x558f2f2db470 2024-04-24T02:12:28.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.771+0000 7f09fbbe6640 1 -- 172.21.15.134:0/2779043320 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09e405c040 con 0x558f2f2db470 2024-04-24T02:12:28.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.771+0000 7f09fbbe6640 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2dde40 con 0x7f09ec031040 2024-04-24T02:12:28.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.772+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f4075030 con 0x7f09ec031040 2024-04-24T02:12:28.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.772+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2dde40 con 0x558f2f2d5220 2024-04-24T02:12:28.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.772+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f09f4075030 con 0x558f2f2d5220 2024-04-24T02:12:28.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.772+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2dde40 con 0x7f09e401ac20 2024-04-24T02:12:28.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.772+0000 7f09fcbe8640 1 -- 172.21.15.134:0/2779043320 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09ec01f070 con 0x7f09e401ac20 2024-04-24T02:12:28.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.772+0000 7f0a0071f800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:28.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.772+0000 7f0a0071f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:28.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.772+0000 7f0a0071f800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:28.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.772+0000 7f0a0071f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:28.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.772+0000 7f0a0071f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:28.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.772+0000 7f0a0071f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:28.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.772+0000 7f0a0071f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.772+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2da0b0 con 0x558f2f2d5220 2024-04-24T02:12:28.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.773+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f09f4075030 con 0x558f2f2d5220 2024-04-24T02:12:28.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.773+0000 7f0a0071f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:28.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.773+0000 7f0a0071f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.773+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2da950 con 0x558f2f2d5220 2024-04-24T02:12:28.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.773+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f09f4075030 con 0x558f2f2d5220 2024-04-24T02:12:28.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.773+0000 7f0a0071f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:28.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.773+0000 7f0a0071f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.773+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2de2c0 con 0x558f2f2d5220 2024-04-24T02:12:28.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.773+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f09f4075030 con 0x558f2f2d5220 2024-04-24T02:12:28.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.773+0000 7f0a0071f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:28.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.773+0000 7f0a0071f800 20 zone default found 2024-04-24T02:12:28.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.773+0000 7f0a0071f800 4 Realm: () 2024-04-24T02:12:28.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.773+0000 7f0a0071f800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:28.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.773+0000 7f0a0071f800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:28.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.773+0000 7f0a0071f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:28.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.773+0000 7f0a0071f800 20 zonegroup default 2024-04-24T02:12:28.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.773+0000 7f0a0071f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.773+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2de770 con 0x7f09ec031040 2024-04-24T02:12:28.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.773+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f09f4075030 con 0x7f09ec031040 2024-04-24T02:12:28.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.773+0000 7f0a0071f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:28.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.773+0000 7f0a0071f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.773+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2e0150 con 0x558f2f2db470 2024-04-24T02:12:28.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.774+0000 7f09fbbe6640 1 -- 172.21.15.134:0/2779043320 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f09e405c040 con 0x558f2f2db470 2024-04-24T02:12:28.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.774+0000 7f0a0071f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:28.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.774+0000 7f0a0071f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.774+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2e0560 con 0x558f2f2db470 2024-04-24T02:12:28.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.774+0000 7f09fbbe6640 1 -- 172.21.15.134:0/2779043320 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f09e405c040 con 0x558f2f2db470 2024-04-24T02:12:28.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.774+0000 7f0a0071f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:28.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.774+0000 7f0a0071f800 20 started sync module instance, tier type = 2024-04-24T02:12:28.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.774+0000 7f0a0071f800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:28.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.774+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2df5e0 con 0x7f09e401ac20 2024-04-24T02:12:28.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.775+0000 7f09fcbe8640 1 -- 172.21.15.134:0/2779043320 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09ec040040 con 0x7f09e401ac20 2024-04-24T02:12:28.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.775+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94073460226512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2df240 con 0x7f09e401ac20 2024-04-24T02:12:28.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.775+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2e1490 con 0x558f2f2d5220 2024-04-24T02:12:28.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.776+0000 7f09fcbe8640 1 -- 172.21.15.134:0/2779043320 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94073460226512] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09ec040040 con 0x7f09e401ac20 2024-04-24T02:12:28.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.776+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f4075030 con 0x558f2f2d5220 2024-04-24T02:12:28.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.777+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94073460230592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2e1490 con 0x558f2f2d5220 2024-04-24T02:12:28.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.777+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2e1eb0 con 0x558f2f2db470 2024-04-24T02:12:28.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.778+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94073460230592] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f4075030 con 0x558f2f2d5220 2024-04-24T02:12:28.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.778+0000 7f09fbbe6640 1 -- 172.21.15.134:0/2779043320 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09e405c040 con 0x558f2f2db470 2024-04-24T02:12:28.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.778+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94073460232160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2e1400 con 0x558f2f2db470 2024-04-24T02:12:28.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.778+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2e2d70 con 0x7f09e401ac20 2024-04-24T02:12:28.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.779+0000 7f09fbbe6640 1 -- 172.21.15.134:0/2779043320 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94073460232160] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09e405c040 con 0x558f2f2db470 2024-04-24T02:12:28.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.779+0000 7f09fcbe8640 1 -- 172.21.15.134:0/2779043320 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09ec040040 con 0x7f09e401ac20 2024-04-24T02:12:28.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.779+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94073460238528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2e2ce0 con 0x7f09e401ac20 2024-04-24T02:12:28.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.779+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2e3c30 con 0x558f2f2d5220 2024-04-24T02:12:28.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.780+0000 7f09fcbe8640 1 -- 172.21.15.134:0/2779043320 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94073460238528] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09ec040040 con 0x7f09e401ac20 2024-04-24T02:12:28.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.780+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f4075030 con 0x558f2f2d5220 2024-04-24T02:12:28.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.780+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94073460240736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2e3c30 con 0x558f2f2d5220 2024-04-24T02:12:28.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.780+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2e45f0 con 0x7f09ec031040 2024-04-24T02:12:28.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.781+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f4075030 con 0x7f09ec031040 2024-04-24T02:12:28.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.781+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94073460240736] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f4075030 con 0x558f2f2d5220 2024-04-24T02:12:28.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.781+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94073460244800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2e4560 con 0x7f09ec031040 2024-04-24T02:12:28.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.781+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2e3780 con 0x7f09ec031040 2024-04-24T02:12:28.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.783+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94073460244800] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f4075030 con 0x7f09ec031040 2024-04-24T02:12:28.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.784+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(56 notify.6 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f4075030 con 0x7f09ec031040 2024-04-24T02:12:28.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.784+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94073460247008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2e5080 con 0x7f09ec031040 2024-04-24T02:12:28.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.784+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2e5970 con 0x7f09ec031040 2024-04-24T02:12:28.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.785+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94073460247008] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f4075030 con 0x7f09ec031040 2024-04-24T02:12:28.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.785+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(58 notify.7 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f4075030 con 0x7f09ec031040 2024-04-24T02:12:28.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.785+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94073460242304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2e5b50 con 0x7f09ec031040 2024-04-24T02:12:28.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.785+0000 7f0a0071f800 20 add_watcher() i=0 2024-04-24T02:12:28.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.785+0000 7f0a0071f800 20 add_watcher() i=1 2024-04-24T02:12:28.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.785+0000 7f0a0071f800 20 add_watcher() i=2 2024-04-24T02:12:28.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.785+0000 7f0a0071f800 20 add_watcher() i=3 2024-04-24T02:12:28.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.785+0000 7f0a0071f800 20 add_watcher() i=4 2024-04-24T02:12:28.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.785+0000 7f0a0071f800 20 add_watcher() i=5 2024-04-24T02:12:28.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.785+0000 7f0a0071f800 20 add_watcher() i=6 2024-04-24T02:12:28.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.786+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94073460242304] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f4075030 con 0x7f09ec031040 2024-04-24T02:12:28.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.786+0000 7f0a0071f800 20 add_watcher() i=7 2024-04-24T02:12:28.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.786+0000 7f0a0071f800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:28.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.786+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2e8f20 con 0x558f2f2d5220 2024-04-24T02:12:28.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.787+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f09f4075030 con 0x558f2f2d5220 2024-04-24T02:12:28.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.787+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94073460251200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2e6310 con 0x558f2f2d5220 2024-04-24T02:12:28.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.788+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94073460251200] v30'157 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f09f4075030 con 0x558f2f2d5220 2024-04-24T02:12:28.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.788+0000 7f08b27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:28.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.788+0000 7f0a0071f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:28.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.788+0000 7f0a0071f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:28.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.788+0000 7f0a0071f800 5 note: GC not initialized 2024-04-24T02:12:28.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.788+0000 7f08b17e2640 20 reqs_thread_entry: start 2024-04-24T02:12:28.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.788+0000 7f0a0071f800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:28.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.788+0000 7f0a0071f800 20 Filter name: none 2024-04-24T02:12:28.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.788+0000 7f0822ffd640 20 reqs_thread_entry: start 2024-04-24T02:12:28.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.788+0000 7f0a0071f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T02:12:28.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.788+0000 7f0a0071f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.788+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558f2f31c0e0 con 0x558f2f2d5220 2024-04-24T02:12:28.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.789+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f09f4075030 con 0x558f2f2d5220 2024-04-24T02:12:28.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.789+0000 7f0a0071f800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T02:12:28.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.789+0000 7f0a0071f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T02:12:28.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.789+0000 7f0a0071f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:28.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.789+0000 7f0a0071f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:12:28.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.789+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558f2f31eb70 con 0x7f09e401ac20 2024-04-24T02:12:28.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.789+0000 7f09fcbe8640 1 -- 172.21.15.134:0/2779043320 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f09ec040040 con 0x7f09e401ac20 2024-04-24T02:12:28.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.789+0000 7f0a0071f800 20 enabling bucket name=myfoo 2024-04-24T02:12:28.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.789+0000 7f0a0071f800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-24T02:12:28.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.789+0000 7f0a0071f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.789+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558f2f31cb50 con 0x7f09e401ac20 2024-04-24T02:12:28.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.789+0000 7f09fcbe8640 1 -- 172.21.15.134:0/2779043320 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f09ec040040 con 0x7f09e401ac20 2024-04-24T02:12:28.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.789+0000 7f0a0071f800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T02:12:28.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.789+0000 7f0a0071f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-04-24T02:12:28.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.789+0000 7f0a0071f800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T02:12:28.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.789+0000 7f0a0071f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 : miss 2024-04-24T02:12:28.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.789+0000 7f0a0071f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:28.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.789+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:65 8.1d 8:be2d2b4a:root::.bucket.meta.myfoo%3a582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558f2f31f4b0 con 0x7f09ec031040 2024-04-24T02:12:28.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.790+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(65 .bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv6 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f09f4075030 con 0x7f09ec031040 2024-04-24T02:12:28.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.790+0000 7f0a0071f800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T02:12:28.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.790+0000 7f0a0071f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 info.flags=0x17 2024-04-24T02:12:28.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.790+0000 7f0a0071f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 to cache LRU end 2024-04-24T02:12:28.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.790+0000 7f0a0071f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:12:28.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.790+0000 7f0a0071f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T02:12:28.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.790+0000 7f0a0071f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 2024-04-24T02:12:28.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.790+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:66 8.1d 8:be2d2b4a:root::.bucket.meta.myfoo%3a582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558f2f326e70 con 0x7f09ec031040 2024-04-24T02:12:28.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.791+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(66 .bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v30'7 uv7 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f09f4075030 con 0x7f09ec031040 2024-04-24T02:12:28.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.791+0000 7f0a0071f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 info.flags=0x17 2024-04-24T02:12:28.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.791+0000 7f0a0071f800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 to cache LRU end 2024-04-24T02:12:28.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.791+0000 7f0a0071f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T02:12:28.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.791+0000 7f0a0071f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1, ofs0, ns] 2024-04-24T02:12:28.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.791+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:67 7.9 7:93e5b521:::notify.7:head [notify cookie 94073460485504 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558f2f3213f0 con 0x7f09ec031040 2024-04-24T02:12:28.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.792+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== watch-notify(notify (1) cookie 94073460242304 notify 128849018898 ret 0) ==== 794+0+0 (crc 0 0 0) 0x558f2f31ea20 con 0x7f09ec031040 2024-04-24T02:12:28.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.792+0000 7f08db7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018898 cookie 94073460242304 notifier 4593 bl.length()=752 2024-04-24T02:12:28.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.792+0000 7f08db7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 info.flags=0x17 2024-04-24T02:12:28.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.792+0000 7f08db7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1 to cache LRU end 2024-04-24T02:12:28.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.792+0000 7f08db7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T02:12:28.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.792+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.0 v2:172.21.15.104:6800/2419146313 20 ==== osd_op_reply(67 notify.7 [notify cookie 94073460485504 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f09f4075030 con 0x7f09ec031040 2024-04-24T02:12:28.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.792+0000 7f08db7fe640 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:68 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f08c0003ea0 con 0x7f09ec031040 2024-04-24T02:12:28.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.792+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.0 v2:172.21.15.104:6800/2419146313 21 ==== osd_op_reply(68 notify.7 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f4075030 con 0x7f09ec031040 2024-04-24T02:12:28.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.792+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.0 v2:172.21.15.104:6800/2419146313 22 ==== watch-notify(notify_complete (2) cookie 94073460485504 notify 128849018898 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f09f4095020 con 0x7f09ec031040 2024-04-24T02:12:28.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.792+0000 7f0a0071f800 20 handle_bi_update(): bucket=:myfoo[582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1]): orig_sources= new_sources= 2024-04-24T02:12:28.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.792+0000 7f0a0071f800 20 handle_bi_update(): bucket=:myfoo[582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1]): potential sources added=[] removed=[] 2024-04-24T02:12:28.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.792+0000 7f0a0071f800 20 handle_bi_update(): bucket=:myfoo[582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1]): orig_dests= new_dests= 2024-04-24T02:12:28.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.792+0000 7f0a0071f800 20 handle_bi_update(): bucket=:myfoo[582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1]): potential dests added=[] removed=[] 2024-04-24T02:12:28.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.792+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558f2f321fe0 con 0x558f2f2d5220 2024-04-24T02:12:28.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.793+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v30'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f09f4075030 con 0x558f2f2d5220 2024-04-24T02:12:28.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.793+0000 7f0a0071f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T02:12:28.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.793+0000 7f0a0071f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:28.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.793+0000 7f0a0071f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-24T02:12:28.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.793+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94073460494144 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558f2f321fe0 con 0x558f2f2d5220 2024-04-24T02:12:28.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.794+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== watch-notify(notify (1) cookie 94073460240736 notify 128849018895 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f09f4095020 con 0x558f2f2d5220 2024-04-24T02:12:28.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.794+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(70 notify.4 [notify cookie 94073460494144 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f09f4075030 con 0x558f2f2d5220 2024-04-24T02:12:28.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.794+0000 7f08db7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018895 cookie 94073460240736 notifier 4593 bl.length()=567 2024-04-24T02:12:28.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.794+0000 7f08db7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T02:12:28.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.794+0000 7f08db7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:28.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.794+0000 7f08db7fe640 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f08c0003ea0 con 0x558f2f2d5220 2024-04-24T02:12:28.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.794+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== watch-notify(notify_complete (2) cookie 94073460494144 notify 128849018895 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f09f408fe30 con 0x558f2f2d5220 2024-04-24T02:12:28.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.794+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f4075030 con 0x558f2f2d5220 2024-04-24T02:12:28.805 INFO:teuthology.orchestra.run.smithi134.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T02:12:21.778798Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T02:12:21.778786Z","tags":[],"group_ids":[]} 2024-04-24T02:12:28.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.795+0000 7f08b27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:28.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.795+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94073460251200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558f2f320520 con 0x558f2f2d5220 2024-04-24T02:12:28.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.796+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94073460251200] v30'158 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f09f4075030 con 0x558f2f2d5220 2024-04-24T02:12:28.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.796+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94073460226512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2e5a40 con 0x7f09e401ac20 2024-04-24T02:12:28.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.797+0000 7f09fcbe8640 1 -- 172.21.15.134:0/2779043320 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94073460226512] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09ec040040 con 0x7f09e401ac20 2024-04-24T02:12:28.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.797+0000 7f0a0071f800 20 remove_watcher() i=0 2024-04-24T02:12:28.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.798+0000 7f0a0071f800 2 removed watcher, disabling cache 2024-04-24T02:12:28.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.798+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94073460230592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2e5a40 con 0x558f2f2d5220 2024-04-24T02:12:28.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.798+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.1 v2:172.21.15.134:6804/1487076214 30 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94073460230592] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f4075030 con 0x558f2f2d5220 2024-04-24T02:12:28.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.798+0000 7f0a0071f800 20 remove_watcher() i=1 2024-04-24T02:12:28.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.798+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94073460232160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2e09c0 con 0x558f2f2db470 2024-04-24T02:12:28.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.799+0000 7f09fbbe6640 1 -- 172.21.15.134:0/2779043320 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94073460232160] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09e405c040 con 0x558f2f2db470 2024-04-24T02:12:28.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.799+0000 7f0a0071f800 20 remove_watcher() i=2 2024-04-24T02:12:28.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.799+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94073460238528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2e5a40 con 0x7f09e401ac20 2024-04-24T02:12:28.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.800+0000 7f09fcbe8640 1 -- 172.21.15.134:0/2779043320 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94073460238528] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09ec040040 con 0x7f09e401ac20 2024-04-24T02:12:28.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.800+0000 7f0a0071f800 20 remove_watcher() i=3 2024-04-24T02:12:28.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.800+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94073460240736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2e0fe0 con 0x558f2f2d5220 2024-04-24T02:12:28.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.802+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.1 v2:172.21.15.134:6804/1487076214 31 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94073460240736] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f4075030 con 0x558f2f2d5220 2024-04-24T02:12:28.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.802+0000 7f0a0071f800 20 remove_watcher() i=4 2024-04-24T02:12:28.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.802+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94073460244800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2e28c0 con 0x7f09ec031040 2024-04-24T02:12:28.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.803+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.0 v2:172.21.15.104:6800/2419146313 23 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94073460244800] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f4075030 con 0x7f09ec031040 2024-04-24T02:12:28.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.803+0000 7f0a0071f800 20 remove_watcher() i=5 2024-04-24T02:12:28.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.803+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94073460247008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2e5a40 con 0x7f09ec031040 2024-04-24T02:12:28.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.804+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.0 v2:172.21.15.104:6800/2419146313 24 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94073460247008] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f4075030 con 0x7f09ec031040 2024-04-24T02:12:28.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.804+0000 7f0a0071f800 20 remove_watcher() i=6 2024-04-24T02:12:28.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.804+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94073460242304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558f2f2e0fe0 con 0x7f09ec031040 2024-04-24T02:12:28.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.805+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 <== osd.0 v2:172.21.15.104:6800/2419146313 25 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94073460242304] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f4075030 con 0x7f09ec031040 2024-04-24T02:12:28.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.805+0000 7f0a0071f800 20 remove_watcher() i=7 2024-04-24T02:12:28.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.805+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f09ec031040 msgr2=0x7f09ec032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.805+0000 7f0a0071f800 1 --2- 172.21.15.134:0/2779043320 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f09ec031040 0x7f09ec032940 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.805+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x558f2f2d5220 msgr2=0x558f2f2d76e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.805+0000 7f0a0071f800 1 --2- 172.21.15.134:0/2779043320 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x558f2f2d5220 0x558f2f2d76e0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.805+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f09e401ac20 msgr2=0x7f09e401c420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.805+0000 7f0a0071f800 1 --2- 172.21.15.134:0/2779043320 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f09e401ac20 0x7f09e401c420 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.805+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x558f2f2db470 msgr2=0x558f2f2dd860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.805+0000 7f0a0071f800 1 --2- 172.21.15.134:0/2779043320 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x558f2f2db470 0x558f2f2dd860 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.805+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f08cc036900 msgr2=0x7f08cc038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.805+0000 7f0a0071f800 1 --2- 172.21.15.134:0/2779043320 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f08cc036900 0x7f08cc038dc0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x558f2f1a1cb0 tx=0x7f09ec01f000 comp rx=0 tx=0).stop 2024-04-24T02:12:28.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.805+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f2f2c2450 msgr2=0x558f2f2c9ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.805+0000 7f0a0071f800 1 --2- 172.21.15.134:0/2779043320 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f2f2c2450 0x558f2f2c9ae0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f09e4024fd0 tx=0x7f09e404c080 comp rx=0 tx=0).stop 2024-04-24T02:12:28.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.805+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 reap_dead start 2024-04-24T02:12:28.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.805+0000 7f09fc3e7640 1 -- 172.21.15.134:0/2779043320 reap_dead start 2024-04-24T02:12:28.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.805+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 shutdown_connections 2024-04-24T02:12:28.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.805+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 >> 172.21.15.134:0/2779043320 conn(0x558f2f2be7b0 msgr2=0x558f2f2bbe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:28.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.805+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 shutdown_connections 2024-04-24T02:12:28.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.805+0000 7f0a0071f800 1 -- 172.21.15.134:0/2779043320 wait complete. 2024-04-24T02:12:28.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.805+0000 7f0a0071f800 1 -- 172.21.15.134:0/2888006395 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f08d4036900 msgr2=0x7f08d4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.805+0000 7f0a0071f800 1 --2- 172.21.15.134:0/2888006395 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f08d4036900 0x7f08d4038dc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x558f2f2a51a0 tx=0x7f09ec005840 comp rx=0 tx=0).stop 2024-04-24T02:12:28.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.805+0000 7f0a0071f800 1 -- 172.21.15.134:0/2888006395 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f2f2b5110 msgr2=0x558f2f2b5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.805+0000 7f0a0071f800 1 --2- 172.21.15.134:0/2888006395 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f2f2b5110 0x558f2f2b5530 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f09e4001ed0 tx=0x7f09e400ea00 comp rx=0 tx=0).stop 2024-04-24T02:12:28.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.805+0000 7f0a0071f800 1 -- 172.21.15.134:0/2888006395 shutdown_connections 2024-04-24T02:12:28.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.805+0000 7f0a0071f800 1 --2- 172.21.15.134:0/2888006395 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f08d4036900 0x7f08d4038dc0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.805+0000 7f0a0071f800 1 --2- 172.21.15.134:0/2888006395 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f2f2b5110 0x558f2f2b5530 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.805+0000 7f0a0071f800 1 -- 172.21.15.134:0/2888006395 >> 172.21.15.134:0/2888006395 conn(0x558f2f2a91b0 msgr2=0x558f2f2a95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:28.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.806+0000 7f0a0071f800 1 -- 172.21.15.134:0/2888006395 shutdown_connections 2024-04-24T02:12:28.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.806+0000 7f0a0071f800 1 -- 172.21.15.134:0/2888006395 wait complete. 2024-04-24T02:12:28.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.806+0000 7f0a0071f800 1 -- 172.21.15.134:0/397579372 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x558f2f1a51e0 msgr2=0x558f2f2a4000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.806+0000 7f0a0071f800 1 --2- 172.21.15.134:0/397579372 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x558f2f1a51e0 0x558f2f2a4000 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.806+0000 7f0a0071f800 1 -- 172.21.15.134:0/397579372 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f08e4036900 msgr2=0x7f08e4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.806+0000 7f0a0071f800 1 --2- 172.21.15.134:0/397579372 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f08e4036900 0x7f08e4038dc0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f09e4000f60 tx=0x7f09e4001370 comp rx=0 tx=0).stop 2024-04-24T02:12:28.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.806+0000 7f0a0071f800 1 -- 172.21.15.134:0/397579372 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f2f1a28b0 msgr2=0x558f2f1a2150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:28.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.806+0000 7f0a0071f800 1 --2- 172.21.15.134:0/397579372 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f2f1a28b0 0x558f2f1a2150 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f09f4052540 tx=0x7f09f4003020 comp rx=0 tx=0).stop 2024-04-24T02:12:28.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.806+0000 7f0a0071f800 1 -- 172.21.15.134:0/397579372 shutdown_connections 2024-04-24T02:12:28.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.806+0000 7f0a0071f800 1 --2- 172.21.15.134:0/397579372 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x558f2f1a51e0 0x558f2f2a4000 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.806+0000 7f0a0071f800 1 --2- 172.21.15.134:0/397579372 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f08e4036900 0x7f08e4038dc0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.806+0000 7f0a0071f800 1 --2- 172.21.15.134:0/397579372 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558f2f1a28b0 0x558f2f1a2150 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:28.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.806+0000 7f0a0071f800 1 -- 172.21.15.134:0/397579372 >> 172.21.15.134:0/397579372 conn(0x558f2f19c380 msgr2=0x558f2f28d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:28.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.806+0000 7f0a0071f800 1 -- 172.21.15.134:0/397579372 shutdown_connections 2024-04-24T02:12:28.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:28.806+0000 7f0a0071f800 1 -- 172.21.15.134:0/397579372 wait complete. 2024-04-24T02:12:28.817 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T02:12:21.778798Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:12:21.778786Z', 'tags': [], 'group_ids': []} 2024-04-24T02:12:28.823 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-04-24T02:12:29.055 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-04-24T02:12:29.062 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T02:12:44.062 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-04-24T02:12:44.062 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-04-24T02:12:44.063 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-04-24T02:12:44.111 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:44.112 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:44.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.111+0000 7fee17b33800 1 Processor -- start 2024-04-24T02:12:44.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.111+0000 7fee17b33800 1 -- start start 2024-04-24T02:12:44.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.111+0000 7fee17b33800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x56409f3d71f0 0x56409f3d95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.111+0000 7fee17b33800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56409f292d40 con 0x56409f3d2d60 2024-04-24T02:12:44.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.111+0000 7fee17b33800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x56409f2654d0 con 0x56409f3d71f0 2024-04-24T02:12:44.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.112+0000 7fee130f1640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x56409f3d71f0 0x56409f3d95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.112+0000 7fee138f2640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x56409f3d2d60 0x56409f3d3180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:36548/0 (socket says 172.21.15.134:36548) 2024-04-24T02:12:44.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.112+0000 7fee138f2640 1 -- 172.21.15.134:0/9447335 learned_addr learned my addr 172.21.15.134:0/9447335 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:12:44.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.112+0000 7fee130f1640 1 -- 172.21.15.134:0/9447335 >> v1:172.21.15.104:6789/0 conn(0x56409f3d2d60 legacy=0x56409f3d3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:44.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.112+0000 7fee130f1640 1 -- 172.21.15.134:0/9447335 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56409f291590 con 0x56409f3d71f0 2024-04-24T02:12:44.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.114+0000 7fee130f1640 1 --2- 172.21.15.134:0/9447335 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56409f3d71f0 0x56409f3d95e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fee0800a470 tx=0x7fee0801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=266887849790a47f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.114+0000 7fee128f0640 1 -- 172.21.15.134:0/9447335 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee08057070 con 0x56409f3d71f0 2024-04-24T02:12:44.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.114+0000 7fee128f0640 1 -- 172.21.15.134:0/9447335 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee08052570 con 0x56409f3d71f0 2024-04-24T02:12:44.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.114+0000 7fee128f0640 1 -- 172.21.15.134:0/9447335 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee08052870 con 0x56409f3d71f0 2024-04-24T02:12:44.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.115+0000 7fee17b33800 1 -- 172.21.15.134:0/9447335 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56409f3d71f0 msgr2=0x56409f3d95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:44.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.115+0000 7fee17b33800 1 --2- 172.21.15.134:0/9447335 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56409f3d71f0 0x56409f3d95e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fee0800a470 tx=0x7fee0801ce90 comp rx=0 tx=0).stop 2024-04-24T02:12:44.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.115+0000 7fee17b33800 1 -- 172.21.15.134:0/9447335 shutdown_connections 2024-04-24T02:12:44.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.115+0000 7fee17b33800 1 --2- 172.21.15.134:0/9447335 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56409f3d71f0 0x56409f3d95e0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.115+0000 7fee17b33800 1 -- 172.21.15.134:0/9447335 >> 172.21.15.134:0/9447335 conn(0x56409f3ce320 msgr2=0x56409f3d0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:44.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.115+0000 7fee17b33800 1 -- 172.21.15.134:0/9447335 shutdown_connections 2024-04-24T02:12:44.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.115+0000 7fee17b33800 1 -- 172.21.15.134:0/9447335 wait complete. 2024-04-24T02:12:44.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.129+0000 7fee17b33800 1 Processor -- start 2024-04-24T02:12:44.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.129+0000 7fee17b33800 1 -- start start 2024-04-24T02:12:44.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.129+0000 7fee17b33800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56409f3d2d60 0x56409f4c50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.129+0000 7fee17b33800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56409f31f3c0 con 0x56409f3d2d60 2024-04-24T02:12:44.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.129+0000 7fee138f2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56409f3d2d60 0x56409f4c50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.129+0000 7fee138f2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56409f3d2d60 0x56409f4c50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:40530/0 (socket says 172.21.15.134:40530) 2024-04-24T02:12:44.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.129+0000 7fee138f2640 1 -- 172.21.15.134:0/2383955910 learned_addr learned my addr 172.21.15.134:0/2383955910 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:44.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.130+0000 7fee138f2640 1 -- 172.21.15.134:0/2383955910 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56409f4c56b0 con 0x56409f3d2d60 2024-04-24T02:12:44.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.130+0000 7fee138f2640 1 --2- 172.21.15.134:0/2383955910 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56409f3d2d60 0x56409f4c50e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fee04001e10 tx=0x7fee0400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c56c0f63dd1fb841 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.130+0000 7fed01e0b640 1 -- 172.21.15.134:0/2383955910 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee04012020 con 0x56409f3d2d60 2024-04-24T02:12:44.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.130+0000 7fed01e0b640 1 -- 172.21.15.134:0/2383955910 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee0400e5a0 con 0x56409f3d2d60 2024-04-24T02:12:44.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.130+0000 7fed01e0b640 1 -- 172.21.15.134:0/2383955910 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee0400e8e0 con 0x56409f3d2d60 2024-04-24T02:12:44.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.131+0000 7fee17b33800 1 -- 172.21.15.134:0/2383955910 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56409f3d2d60 msgr2=0x56409f4c50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:44.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.131+0000 7fee17b33800 1 --2- 172.21.15.134:0/2383955910 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56409f3d2d60 0x56409f4c50e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fee04001e10 tx=0x7fee0400b780 comp rx=0 tx=0).stop 2024-04-24T02:12:44.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.131+0000 7fee17b33800 1 -- 172.21.15.134:0/2383955910 shutdown_connections 2024-04-24T02:12:44.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.131+0000 7fee17b33800 1 --2- 172.21.15.134:0/2383955910 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56409f3d2d60 0x56409f4c50e0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.131+0000 7fee17b33800 1 -- 172.21.15.134:0/2383955910 >> 172.21.15.134:0/2383955910 conn(0x56409f3ce320 msgr2=0x56409f4c0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:44.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.131+0000 7fee17b33800 1 -- 172.21.15.134:0/2383955910 shutdown_connections 2024-04-24T02:12:44.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.131+0000 7fee17b33800 1 -- 172.21.15.134:0/2383955910 wait complete. 2024-04-24T02:12:44.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.131+0000 7fee17b33800 1 Processor -- start 2024-04-24T02:12:44.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.131+0000 7fee17b33800 1 -- start start 2024-04-24T02:12:44.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.131+0000 7fee17b33800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56409f3d2d60 0x56409f4ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.131+0000 7fee17b33800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56409f3d9eb0 con 0x56409f3d2d60 2024-04-24T02:12:44.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.132+0000 7fee138f2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56409f3d2d60 0x56409f4ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.132+0000 7fee138f2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56409f3d2d60 0x56409f4ccce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:40532/0 (socket says 172.21.15.134:40532) 2024-04-24T02:12:44.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.132+0000 7fee138f2640 1 -- 172.21.15.134:0/4071262053 learned_addr learned my addr 172.21.15.134:0/4071262053 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:44.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.132+0000 7fee138f2640 1 -- 172.21.15.134:0/4071262053 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56409f4cd220 con 0x56409f3d2d60 2024-04-24T02:12:44.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.132+0000 7fee138f2640 1 --2- 172.21.15.134:0/4071262053 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56409f3d2d60 0x56409f4ccce0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fee0400b7c0 tx=0x7fee04000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.133+0000 7fecfbfff640 1 -- 172.21.15.134:0/4071262053 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee04012030 con 0x56409f3d2d60 2024-04-24T02:12:44.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.133+0000 7fecfbfff640 1 -- 172.21.15.134:0/4071262053 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee04001470 con 0x56409f3d2d60 2024-04-24T02:12:44.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.133+0000 7fee17b33800 1 -- 172.21.15.134:0/4071262053 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56409f4cd4b0 con 0x56409f3d2d60 2024-04-24T02:12:44.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.133+0000 7fecfbfff640 1 -- 172.21.15.134:0/4071262053 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee0401a8d0 con 0x56409f3d2d60 2024-04-24T02:12:44.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.133+0000 7fee17b33800 1 -- 172.21.15.134:0/4071262053 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56409f4d0160 con 0x56409f3d2d60 2024-04-24T02:12:44.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.133+0000 7fecfbfff640 1 -- 172.21.15.134:0/4071262053 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fee04015020 con 0x56409f3d2d60 2024-04-24T02:12:44.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.134+0000 7fecfbfff640 1 --2- 172.21.15.134:0/4071262053 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fecfc036900 0x7fecfc038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.134+0000 7fecfbfff640 1 -- 172.21.15.134:0/4071262053 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fee04020030 con 0x56409f3d2d60 2024-04-24T02:12:44.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.134+0000 7fee130f1640 1 --2- 172.21.15.134:0/4071262053 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fecfc036900 0x7fecfc038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.134+0000 7fee17b33800 1 --2- 172.21.15.134:0/4071262053 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x56409f3d71f0 0x56409f4d3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.134+0000 7fee17b33800 1 -- 172.21.15.134:0/4071262053 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f4d44f0 con 0x56409f3d71f0 2024-04-24T02:12:44.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.134+0000 7fee140f3640 1 --2- 172.21.15.134:0/4071262053 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x56409f3d71f0 0x56409f4d3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.134+0000 7fee130f1640 1 --2- 172.21.15.134:0/4071262053 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fecfc036900 0x7fecfc038dc0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fee08054000 tx=0x7fee0804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.134+0000 7fee140f3640 1 --2- 172.21.15.134:0/4071262053 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x56409f3d71f0 0x56409f4d3f20 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.135+0000 7fee140f3640 1 -- 172.21.15.134:0/4071262053 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee0c00a4a0 con 0x56409f3d71f0 2024-04-24T02:12:44.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.135+0000 7fee17b33800 1 -- 172.21.15.134:0/4071262053 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f4d14f0 con 0x56409f3d71f0 2024-04-24T02:12:44.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.135+0000 7fee140f3640 1 -- 172.21.15.134:0/4071262053 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fee0c00a4a0 con 0x56409f3d71f0 2024-04-24T02:12:44.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.135+0000 7fee17b33800 1 -- 172.21.15.134:0/4071262053 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f4d62f0 con 0x56409f3d71f0 2024-04-24T02:12:44.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.135+0000 7fee140f3640 1 -- 172.21.15.134:0/4071262053 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fee0c00a4a0 con 0x56409f3d71f0 2024-04-24T02:12:44.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.135+0000 7fee17b33800 1 -- 172.21.15.134:0/4071262053 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f4d5630 con 0x56409f3d71f0 2024-04-24T02:12:44.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.136+0000 7fee140f3640 1 -- 172.21.15.134:0/4071262053 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fee0c00a4a0 con 0x56409f3d71f0 2024-04-24T02:12:44.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.136+0000 7fee17b33800 1 -- 172.21.15.134:0/4071262053 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f4d5a80 con 0x56409f3d71f0 2024-04-24T02:12:44.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.136+0000 7fee140f3640 1 -- 172.21.15.134:0/4071262053 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fee0c00a4a0 con 0x56409f3d71f0 2024-04-24T02:12:44.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.136+0000 7fee17b33800 1 Processor -- start 2024-04-24T02:12:44.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.136+0000 7fee17b33800 1 -- start start 2024-04-24T02:12:44.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.136+0000 7fee17b33800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56409f4e5060 0x56409f4e5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.136+0000 7fee17b33800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56409f2c56b0 con 0x56409f4e5060 2024-04-24T02:12:44.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.137+0000 7fee130f1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56409f4e5060 0x56409f4e5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.137+0000 7fee130f1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56409f4e5060 0x56409f4e5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:40544/0 (socket says 172.21.15.134:40544) 2024-04-24T02:12:44.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.137+0000 7fee130f1640 1 -- 172.21.15.134:0/782971729 learned_addr learned my addr 172.21.15.134:0/782971729 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:44.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.137+0000 7fee130f1640 1 -- 172.21.15.134:0/782971729 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56409f4e59c0 con 0x56409f4e5060 2024-04-24T02:12:44.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.137+0000 7fee130f1640 1 --2- 172.21.15.134:0/782971729 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56409f4e5060 0x56409f4e5480 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fee08044840 tx=0x7fee08002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.137+0000 7fecf97fa640 1 -- 172.21.15.134:0/782971729 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee0806f070 con 0x56409f4e5060 2024-04-24T02:12:44.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.137+0000 7fecf97fa640 1 -- 172.21.15.134:0/782971729 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee08058040 con 0x56409f4e5060 2024-04-24T02:12:44.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.137+0000 7fee17b33800 1 -- 172.21.15.134:0/782971729 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56409f4e6430 con 0x56409f4e5060 2024-04-24T02:12:44.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.137+0000 7fecf97fa640 1 -- 172.21.15.134:0/782971729 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee08057050 con 0x56409f4e5060 2024-04-24T02:12:44.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.138+0000 7fee17b33800 1 -- 172.21.15.134:0/782971729 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56409f4e68d0 con 0x56409f4e5060 2024-04-24T02:12:44.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.138+0000 7fecf97fa640 1 -- 172.21.15.134:0/782971729 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fee08072070 con 0x56409f4e5060 2024-04-24T02:12:44.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.138+0000 7fecf97fa640 1 --2- 172.21.15.134:0/782971729 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fecec036900 0x7fecec038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.139+0000 7fecf97fa640 1 -- 172.21.15.134:0/782971729 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fee0808f8c0 con 0x56409f4e5060 2024-04-24T02:12:44.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.139+0000 7fee140f3640 1 --2- 172.21.15.134:0/782971729 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fecec036900 0x7fecec038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.139+0000 7fee17b33800 1 Processor -- start 2024-04-24T02:12:44.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.139+0000 7fee140f3640 1 --2- 172.21.15.134:0/782971729 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fecec036900 0x7fecec038dc0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x56409f4d5150 tx=0x7fee0c005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.139+0000 7fee17b33800 1 -- start start 2024-04-24T02:12:44.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.139+0000 7fee17b33800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56409f4f2320 0x56409f4f2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.139+0000 7fee17b33800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56409f4c5a30 con 0x56409f4f2320 2024-04-24T02:12:44.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.139+0000 7fee130f1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56409f4f2320 0x56409f4f2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.139+0000 7fee130f1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56409f4f2320 0x56409f4f2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:40558/0 (socket says 172.21.15.134:40558) 2024-04-24T02:12:44.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.139+0000 7fee130f1640 1 -- 172.21.15.134:0/3779999312 learned_addr learned my addr 172.21.15.134:0/3779999312 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:44.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.140+0000 7fee130f1640 1 -- 172.21.15.134:0/3779999312 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56409f4f2d10 con 0x56409f4f2320 2024-04-24T02:12:44.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.140+0000 7fee130f1640 1 --2- 172.21.15.134:0/3779999312 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56409f4f2320 0x56409f4f2740 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fee0808dda0 tx=0x7fee0808e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd1b7dba3b4b9694 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.140+0000 7fecf2ffd640 1 -- 172.21.15.134:0/3779999312 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee08087070 con 0x56409f4f2320 2024-04-24T02:12:44.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.140+0000 7fecf2ffd640 1 -- 172.21.15.134:0/3779999312 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee0805e480 con 0x56409f4f2320 2024-04-24T02:12:44.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.140+0000 7fecf2ffd640 1 -- 172.21.15.134:0/3779999312 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee08072360 con 0x56409f4f2320 2024-04-24T02:12:44.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.140+0000 7fee17b33800 1 -- 172.21.15.134:0/3779999312 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56409f4f2320 msgr2=0x56409f4f2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:44.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.140+0000 7fee17b33800 1 --2- 172.21.15.134:0/3779999312 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56409f4f2320 0x56409f4f2740 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fee0808dda0 tx=0x7fee0808e050 comp rx=0 tx=0).stop 2024-04-24T02:12:44.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.140+0000 7fee17b33800 1 -- 172.21.15.134:0/3779999312 shutdown_connections 2024-04-24T02:12:44.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.140+0000 7fee17b33800 1 --2- 172.21.15.134:0/3779999312 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56409f4f2320 0x56409f4f2740 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.140+0000 7fee17b33800 1 -- 172.21.15.134:0/3779999312 >> 172.21.15.134:0/3779999312 conn(0x56409f4ee680 msgr2=0x56409f4ec6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:44.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.140+0000 7fee17b33800 1 -- 172.21.15.134:0/3779999312 shutdown_connections 2024-04-24T02:12:44.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.140+0000 7fee17b33800 1 -- 172.21.15.134:0/3779999312 wait complete. 2024-04-24T02:12:44.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.141+0000 7fee17b33800 1 Processor -- start 2024-04-24T02:12:44.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.141+0000 7fee17b33800 1 -- start start 2024-04-24T02:12:44.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.141+0000 7fee17b33800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56409f4f2320 0x56409f4f9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.141+0000 7fee17b33800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56409f4f3480 con 0x56409f4f2320 2024-04-24T02:12:44.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.141+0000 7fee130f1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56409f4f2320 0x56409f4f9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.141+0000 7fee130f1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56409f4f2320 0x56409f4f9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:40570/0 (socket says 172.21.15.134:40570) 2024-04-24T02:12:44.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.141+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 learned_addr learned my addr 172.21.15.134:0/1565741905 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:44.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.141+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56409f4f9eb0 con 0x56409f4f2320 2024-04-24T02:12:44.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.142+0000 7fee130f1640 1 --2- 172.21.15.134:0/1565741905 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56409f4f2320 0x56409f4f9970 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fee0808e090 tx=0x7fee0808dd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.142+0000 7fecf17fa640 1 -- 172.21.15.134:0/1565741905 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee08087030 con 0x56409f4f2320 2024-04-24T02:12:44.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.142+0000 7fecf17fa640 1 -- 172.21.15.134:0/1565741905 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee0808fdf0 con 0x56409f4f2320 2024-04-24T02:12:44.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.142+0000 7fecf17fa640 1 -- 172.21.15.134:0/1565741905 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee0805fb40 con 0x56409f4f2320 2024-04-24T02:12:44.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.142+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56409f4fa140 con 0x56409f4f2320 2024-04-24T02:12:44.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.142+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56409f4fcdf0 con 0x56409f4f2320 2024-04-24T02:12:44.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.142+0000 7fecf17fa640 1 -- 172.21.15.134:0/1565741905 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fee0805fce0 con 0x56409f4f2320 2024-04-24T02:12:44.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.143+0000 7fecf17fa640 1 --2- 172.21.15.134:0/1565741905 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fecdc036900 0x7fecdc038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.143+0000 7fecf17fa640 1 -- 172.21.15.134:0/1565741905 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fee08088070 con 0x56409f4f2320 2024-04-24T02:12:44.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.143+0000 7fee140f3640 1 --2- 172.21.15.134:0/1565741905 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fecdc036900 0x7fecdc038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.143+0000 7fee17b33800 20 rados->read ofs=0 len=0 2024-04-24T02:12:44.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.143+0000 7fee17b33800 1 --2- 172.21.15.134:0/1565741905 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x56409f505430 0x56409f5078f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.143+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f508040 con 0x56409f505430 2024-04-24T02:12:44.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.143+0000 7fee140f3640 1 --2- 172.21.15.134:0/1565741905 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fecdc036900 0x7fecdc038dc0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x56409f4cdf00 tx=0x7fee0c01f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.143+0000 7fee138f2640 1 --2- 172.21.15.134:0/1565741905 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x56409f505430 0x56409f5078f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.144+0000 7fee138f2640 1 --2- 172.21.15.134:0/1565741905 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x56409f505430 0x56409f5078f0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.144+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee04018950 con 0x56409f505430 2024-04-24T02:12:44.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.144+0000 7fee17b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:44.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.144+0000 7fee17b33800 20 realm 2024-04-24T02:12:44.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.144+0000 7fee17b33800 20 rados->read ofs=0 len=0 2024-04-24T02:12:44.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.144+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f508450 con 0x56409f505430 2024-04-24T02:12:44.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.144+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee04018950 con 0x56409f505430 2024-04-24T02:12:44.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.144+0000 7fee17b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:44.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.144+0000 7fee17b33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:44.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.144+0000 7fee17b33800 20 rados->read ofs=0 len=0 2024-04-24T02:12:44.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.144+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f508d20 con 0x56409f505430 2024-04-24T02:12:44.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.144+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee04018950 con 0x56409f505430 2024-04-24T02:12:44.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.144+0000 7fee17b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:44.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.144+0000 7fee17b33800 20 rados->read ofs=0 len=0 2024-04-24T02:12:44.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.144+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f5090c0 con 0x56409f505430 2024-04-24T02:12:44.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.145+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fee04018950 con 0x56409f505430 2024-04-24T02:12:44.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.145+0000 7fee17b33800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:44.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.145+0000 7fee17b33800 20 rados->read ofs=0 len=0 2024-04-24T02:12:44.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.145+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f509520 con 0x56409f505430 2024-04-24T02:12:44.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.145+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fee04018950 con 0x56409f505430 2024-04-24T02:12:44.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.145+0000 7fee17b33800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:44.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.145+0000 7fee17b33800 20 searching for the correct realm 2024-04-24T02:12:44.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.145+0000 7fee17b33800 1 --2- 172.21.15.134:0/1565741905 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x56409f50b570 0x56409f50d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.145+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56409f50e010 con 0x56409f50b570 2024-04-24T02:12:44.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.145+0000 7fee130f1640 1 --2- 172.21.15.134:0/1565741905 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x56409f50b570 0x56409f50d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.146+0000 7fee130f1640 1 --2- 172.21.15.134:0/1565741905 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x56409f50b570 0x56409f50d960 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.146+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.146+0000 7fee130f1640 1 --2- 172.21.15.134:0/1565741905 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fee08082070 0x7fee0806d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.146+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56409f50e010 con 0x7fee08082070 2024-04-24T02:12:44.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.146+0000 7fee140f3640 1 --2- 172.21.15.134:0/1565741905 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fee08082070 0x7fee0806d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.146+0000 7fee140f3640 1 --2- 172.21.15.134:0/1565741905 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fee08082070 0x7fee0806d120 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.147+0000 7fee140f3640 1 -- 172.21.15.134:0/1565741905 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee0c01f070 con 0x7fee08082070 2024-04-24T02:12:44.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.147+0000 7fee140f3640 1 --2- 172.21.15.134:0/1565741905 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fee0c031040 0x7fee0c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.147+0000 7fee140f3640 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56409f50e010 con 0x7fee0c031040 2024-04-24T02:12:44.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.147+0000 7fee138f2640 1 --2- 172.21.15.134:0/1565741905 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fee0c031040 0x7fee0c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.148+0000 7fee138f2640 1 --2- 172.21.15.134:0/1565741905 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fee0c031040 0x7fee0c032940 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.148+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee04018950 con 0x7fee0c031040 2024-04-24T02:12:44.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.148+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56409f50e010 con 0x56409f505430 2024-04-24T02:12:44.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.148+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee04018950 con 0x56409f505430 2024-04-24T02:12:44.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.148+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56409f50e010 con 0x56409f505430 2024-04-24T02:12:44.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.148+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fee04018950 con 0x56409f505430 2024-04-24T02:12:44.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.148+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56409f50e010 con 0x7fee0c031040 2024-04-24T02:12:44.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.149+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee04018950 con 0x7fee0c031040 2024-04-24T02:12:44.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.149+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56409f50e010 con 0x7fee0c031040 2024-04-24T02:12:44.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.149+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee04018950 con 0x7fee0c031040 2024-04-24T02:12:44.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.149+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56409f50e010 con 0x7fee08082070 2024-04-24T02:12:44.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.149+0000 7fee140f3640 1 -- 172.21.15.134:0/1565741905 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee0c01f070 con 0x7fee08082070 2024-04-24T02:12:44.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.149+0000 7fee140f3640 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56409f50e010 con 0x56409f50b570 2024-04-24T02:12:44.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.150+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.150+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56409f50e010 con 0x56409f505430 2024-04-24T02:12:44.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.150+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee04018950 con 0x56409f505430 2024-04-24T02:12:44.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.150+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56409f50e010 con 0x7fee0c031040 2024-04-24T02:12:44.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.150+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee04018950 con 0x7fee0c031040 2024-04-24T02:12:44.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.150+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56409f50e010 con 0x56409f505430 2024-04-24T02:12:44.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.150+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee04018950 con 0x56409f505430 2024-04-24T02:12:44.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.150+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56409f50e010 con 0x7fee08082070 2024-04-24T02:12:44.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.151+0000 7fee140f3640 1 -- 172.21.15.134:0/1565741905 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fee0c01f070 con 0x7fee08082070 2024-04-24T02:12:44.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.151+0000 7fee140f3640 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56409f50e010 con 0x56409f50b570 2024-04-24T02:12:44.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.151+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.151+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56409f50e010 con 0x56409f50b570 2024-04-24T02:12:44.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.151+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.151+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56409f50e010 con 0x7fee0c031040 2024-04-24T02:12:44.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.151+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee04018950 con 0x7fee0c031040 2024-04-24T02:12:44.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.151+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56409f50e010 con 0x56409f50b570 2024-04-24T02:12:44.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.152+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.152+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56409f50e010 con 0x56409f50b570 2024-04-24T02:12:44.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.152+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.152+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56409f50e010 con 0x56409f505430 2024-04-24T02:12:44.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.152+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee04018950 con 0x56409f505430 2024-04-24T02:12:44.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.152+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56409f50e010 con 0x56409f505430 2024-04-24T02:12:44.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.152+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fee04018950 con 0x56409f505430 2024-04-24T02:12:44.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.152+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56409f50e010 con 0x7fee0c031040 2024-04-24T02:12:44.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.153+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee04018950 con 0x7fee0c031040 2024-04-24T02:12:44.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.153+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56409f50e010 con 0x56409f50b570 2024-04-24T02:12:44.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.153+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.153+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56409f50e010 con 0x7fee08082070 2024-04-24T02:12:44.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.153+0000 7fee140f3640 1 -- 172.21.15.134:0/1565741905 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee0c01f070 con 0x7fee08082070 2024-04-24T02:12:44.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.153+0000 7fee140f3640 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56409f50e010 con 0x56409f505430 2024-04-24T02:12:44.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.154+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee04018950 con 0x56409f505430 2024-04-24T02:12:44.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.154+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56409f50e010 con 0x7fee0c031040 2024-04-24T02:12:44.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.154+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee04018950 con 0x7fee0c031040 2024-04-24T02:12:44.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.154+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56409f50e010 con 0x56409f50b570 2024-04-24T02:12:44.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.154+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.154+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56409f50e010 con 0x7fee0c031040 2024-04-24T02:12:44.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.155+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee04018950 con 0x7fee0c031040 2024-04-24T02:12:44.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.155+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56409f50e010 con 0x7fee08082070 2024-04-24T02:12:44.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.155+0000 7fee140f3640 1 -- 172.21.15.134:0/1565741905 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee0c01f070 con 0x7fee08082070 2024-04-24T02:12:44.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.155+0000 7fee140f3640 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56409f50e010 con 0x56409f50b570 2024-04-24T02:12:44.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.155+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.155+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56409f50e010 con 0x7fee0c031040 2024-04-24T02:12:44.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.155+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee04018950 con 0x7fee0c031040 2024-04-24T02:12:44.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.155+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56409f50e010 con 0x56409f505430 2024-04-24T02:12:44.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.156+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fee04018950 con 0x56409f505430 2024-04-24T02:12:44.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.156+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56409f50e010 con 0x7fee08082070 2024-04-24T02:12:44.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.156+0000 7fee140f3640 1 -- 172.21.15.134:0/1565741905 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee0c01f070 con 0x7fee08082070 2024-04-24T02:12:44.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.156+0000 7fee17b33800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:44.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.156+0000 7fee17b33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:44.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.156+0000 7fee17b33800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:44.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.156+0000 7fee17b33800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:44.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.156+0000 7fee17b33800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:44.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.156+0000 7fee17b33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:44.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.156+0000 7fee17b33800 20 rados->read ofs=0 len=0 2024-04-24T02:12:44.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.156+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f509ff0 con 0x56409f505430 2024-04-24T02:12:44.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.156+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee04018950 con 0x56409f505430 2024-04-24T02:12:44.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.156+0000 7fee17b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:44.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.156+0000 7fee17b33800 20 rados->read ofs=0 len=0 2024-04-24T02:12:44.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.156+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f50a890 con 0x56409f505430 2024-04-24T02:12:44.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.157+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fee04018950 con 0x56409f505430 2024-04-24T02:12:44.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.157+0000 7fee17b33800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:44.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.157+0000 7fee17b33800 20 rados->read ofs=0 len=0 2024-04-24T02:12:44.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.157+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f509c30 con 0x56409f505430 2024-04-24T02:12:44.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.157+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fee04018950 con 0x56409f505430 2024-04-24T02:12:44.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.157+0000 7fee17b33800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:44.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.157+0000 7fee17b33800 20 zone default found 2024-04-24T02:12:44.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.157+0000 7fee17b33800 4 Realm: () 2024-04-24T02:12:44.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.157+0000 7fee17b33800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:44.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.157+0000 7fee17b33800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:44.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.157+0000 7fee17b33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:44.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.157+0000 7fee17b33800 20 zonegroup default 2024-04-24T02:12:44.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.157+0000 7fee17b33800 20 rados->read ofs=0 len=0 2024-04-24T02:12:44.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.157+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f50e470 con 0x7fee0c031040 2024-04-24T02:12:44.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.157+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fee04018950 con 0x7fee0c031040 2024-04-24T02:12:44.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.157+0000 7fee17b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:44.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.157+0000 7fee17b33800 20 rados->read ofs=0 len=0 2024-04-24T02:12:44.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.157+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f510300 con 0x56409f50b570 2024-04-24T02:12:44.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.158+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.158+0000 7fee17b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:44.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.158+0000 7fee17b33800 20 rados->read ofs=0 len=0 2024-04-24T02:12:44.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.158+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f5106a0 con 0x56409f50b570 2024-04-24T02:12:44.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.158+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.158+0000 7fee17b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:44.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.158+0000 7fee17b33800 20 started sync module instance, tier type = 2024-04-24T02:12:44.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.158+0000 7fee17b33800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:44.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.158+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f50f740 con 0x7fee08082070 2024-04-24T02:12:44.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.159+0000 7fee140f3640 1 -- 172.21.15.134:0/1565741905 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee0c040040 con 0x7fee08082070 2024-04-24T02:12:44.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.159+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94835550780208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f50ff50 con 0x7fee08082070 2024-04-24T02:12:44.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.159+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f5113e0 con 0x56409f505430 2024-04-24T02:12:44.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.160+0000 7fee140f3640 1 -- 172.21.15.134:0/1565741905 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94835550780208] v30'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee0c040040 con 0x7fee08082070 2024-04-24T02:12:44.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.161+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee04018950 con 0x56409f505430 2024-04-24T02:12:44.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.161+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94835550784064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f511800 con 0x56409f505430 2024-04-24T02:12:44.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.161+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f512200 con 0x56409f50b570 2024-04-24T02:12:44.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.162+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94835550784064] v30'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee04018950 con 0x56409f505430 2024-04-24T02:12:44.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.162+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.162+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94835550785120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f5125f0 con 0x56409f50b570 2024-04-24T02:12:44.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.162+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f512ff0 con 0x7fee08082070 2024-04-24T02:12:44.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.163+0000 7fee140f3640 1 -- 172.21.15.134:0/1565741905 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee0c040040 con 0x7fee08082070 2024-04-24T02:12:44.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.163+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94835550792448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f513890 con 0x7fee08082070 2024-04-24T02:12:44.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.163+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f514390 con 0x56409f505430 2024-04-24T02:12:44.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.163+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94835550785120] v30'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.164+0000 7fee140f3640 1 -- 172.21.15.134:0/1565741905 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94835550792448] v30'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee0c040040 con 0x7fee08082070 2024-04-24T02:12:44.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.164+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee04018950 con 0x56409f505430 2024-04-24T02:12:44.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.164+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94835550797440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f5133e0 con 0x56409f505430 2024-04-24T02:12:44.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.165+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f514c60 con 0x7fee0c031040 2024-04-24T02:12:44.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.166+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94835550797440] v30'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee04018950 con 0x56409f505430 2024-04-24T02:12:44.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.166+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee04018950 con 0x7fee0c031040 2024-04-24T02:12:44.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.166+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94835550788880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f514b00 con 0x7fee0c031040 2024-04-24T02:12:44.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.166+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f515350 con 0x7fee0c031040 2024-04-24T02:12:44.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.167+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94835550788880] v30'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee04018950 con 0x7fee0c031040 2024-04-24T02:12:44.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.167+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(56 notify.6 [create] v30'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee04018950 con 0x7fee0c031040 2024-04-24T02:12:44.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.167+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94835550799632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f515140 con 0x7fee0c031040 2024-04-24T02:12:44.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.167+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f515c60 con 0x7fee0c031040 2024-04-24T02:12:44.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.168+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94835550799632] v30'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee04018950 con 0x7fee0c031040 2024-04-24T02:12:44.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.168+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(58 notify.7 [create] v30'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee04018950 con 0x7fee0c031040 2024-04-24T02:12:44.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.168+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94835550803760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f515c20 con 0x7fee0c031040 2024-04-24T02:12:44.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.168+0000 7fee17b33800 20 add_watcher() i=0 2024-04-24T02:12:44.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.168+0000 7fee17b33800 20 add_watcher() i=1 2024-04-24T02:12:44.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.168+0000 7fee17b33800 20 add_watcher() i=2 2024-04-24T02:12:44.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.168+0000 7fee17b33800 20 add_watcher() i=3 2024-04-24T02:12:44.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.168+0000 7fee17b33800 20 add_watcher() i=4 2024-04-24T02:12:44.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.168+0000 7fee17b33800 20 add_watcher() i=5 2024-04-24T02:12:44.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.168+0000 7fee17b33800 20 add_watcher() i=6 2024-04-24T02:12:44.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.169+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94835550803760] v30'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee04018950 con 0x7fee0c031040 2024-04-24T02:12:44.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.169+0000 7fee17b33800 20 add_watcher() i=7 2024-04-24T02:12:44.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.169+0000 7fee17b33800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:44.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.169+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f519110 con 0x56409f505430 2024-04-24T02:12:44.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.170+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fee04018950 con 0x56409f505430 2024-04-24T02:12:44.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.170+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94835550800784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f516630 con 0x56409f505430 2024-04-24T02:12:44.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.171+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94835550800784] v30'159 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fee04018950 con 0x56409f505430 2024-04-24T02:12:44.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.171+0000 7fecc9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:44.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.171+0000 7fee17b33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:44.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.171+0000 7fee17b33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:44.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.171+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f521760 con 0x56409f505430 2024-04-24T02:12:44.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.173+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'48 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee04018950 con 0x56409f505430 2024-04-24T02:12:44.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.173+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f521cd0 con 0x7fee0c031040 2024-04-24T02:12:44.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.174+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee04018950 con 0x7fee0c031040 2024-04-24T02:12:44.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.174+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f521bf0 con 0x56409f50b570 2024-04-24T02:12:44.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.175+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.175+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f5220d0 con 0x56409f505430 2024-04-24T02:12:44.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.176+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'160 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee04018950 con 0x56409f505430 2024-04-24T02:12:44.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.176+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f522210 con 0x7fee08082070 2024-04-24T02:12:44.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.177+0000 7fee140f3640 1 -- 172.21.15.134:0/1565741905 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'51 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee0c040040 con 0x7fee08082070 2024-04-24T02:12:44.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.177+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f5228d0 con 0x56409f50b570 2024-04-24T02:12:44.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.178+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'43 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.178+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f522c70 con 0x56409f505430 2024-04-24T02:12:44.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.179+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee04018950 con 0x56409f505430 2024-04-24T02:12:44.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.179+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f522c70 con 0x7fee0c031040 2024-04-24T02:12:44.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.180+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'36 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee04018950 con 0x7fee0c031040 2024-04-24T02:12:44.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.180+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f522c70 con 0x7fee08082070 2024-04-24T02:12:44.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.182+0000 7fee140f3640 1 -- 172.21.15.134:0/1565741905 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee0c040040 con 0x7fee08082070 2024-04-24T02:12:44.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.182+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f5232c0 con 0x56409f50b570 2024-04-24T02:12:44.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.183+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.183+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f523660 con 0x7fee08082070 2024-04-24T02:12:44.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.184+0000 7fee140f3640 1 -- 172.21.15.134:0/1565741905 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'52 uv50 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee0c040040 con 0x7fee08082070 2024-04-24T02:12:44.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.184+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f523bd0 con 0x7fee0c031040 2024-04-24T02:12:44.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.185+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee04018950 con 0x7fee0c031040 2024-04-24T02:12:44.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.185+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f523bd0 con 0x7fee08082070 2024-04-24T02:12:44.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.186+0000 7fee140f3640 1 -- 172.21.15.134:0/1565741905 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'24 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee0c040040 con 0x7fee08082070 2024-04-24T02:12:44.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.186+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f524080 con 0x7fee0c031040 2024-04-24T02:12:44.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.187+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.0 v2:172.21.15.104:6800/2419146313 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'47 uv16 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee04018950 con 0x7fee0c031040 2024-04-24T02:12:44.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.187+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f524080 con 0x56409f505430 2024-04-24T02:12:44.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.188+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'161 uv16 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee04018950 con 0x56409f505430 2024-04-24T02:12:44.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.188+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f524080 con 0x56409f50b570 2024-04-24T02:12:44.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.189+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'44 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.189+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f524080 con 0x7fee08082070 2024-04-24T02:12:44.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.191+0000 7fee140f3640 1 -- 172.21.15.134:0/1565741905 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'53 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee0c040040 con 0x7fee08082070 2024-04-24T02:12:44.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.191+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f524080 con 0x56409f50b570 2024-04-24T02:12:44.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.192+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'30 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.192+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f524080 con 0x56409f505430 2024-04-24T02:12:44.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.193+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee04018950 con 0x56409f505430 2024-04-24T02:12:44.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.193+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f524080 con 0x56409f505430 2024-04-24T02:12:44.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.194+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'162 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee04018950 con 0x56409f505430 2024-04-24T02:12:44.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.194+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f524080 con 0x56409f50b570 2024-04-24T02:12:44.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.195+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'45 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.195+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f524080 con 0x7fee08082070 2024-04-24T02:12:44.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.196+0000 7fee140f3640 1 -- 172.21.15.134:0/1565741905 <== osd.2 v2:172.21.15.134:6800/214480313 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'34 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee0c040040 con 0x7fee08082070 2024-04-24T02:12:44.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.196+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f524080 con 0x56409f50b570 2024-04-24T02:12:44.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.197+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.197+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f524080 con 0x56409f50b570 2024-04-24T02:12:44.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.198+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'36 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.198+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f524080 con 0x56409f50b570 2024-04-24T02:12:44.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.199+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.199+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f524080 con 0x56409f50b570 2024-04-24T02:12:44.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.200+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'44 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.200+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f524080 con 0x7fee0c031040 2024-04-24T02:12:44.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.201+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.0 v2:172.21.15.104:6800/2419146313 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'26 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee04018950 con 0x7fee0c031040 2024-04-24T02:12:44.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.201+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f524080 con 0x56409f50b570 2024-04-24T02:12:44.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.202+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'30 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.202+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f524080 con 0x7fee0c031040 2024-04-24T02:12:44.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.204+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.0 v2:172.21.15.104:6800/2419146313 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'37 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee04018950 con 0x7fee0c031040 2024-04-24T02:12:44.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.204+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f524080 con 0x56409f50b570 2024-04-24T02:12:44.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.205+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'46 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.205+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f524080 con 0x7fee0c031040 2024-04-24T02:12:44.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.206+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.0 v2:172.21.15.104:6800/2419146313 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'48 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee04018950 con 0x7fee0c031040 2024-04-24T02:12:44.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.206+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f524080 con 0x7fee08082070 2024-04-24T02:12:44.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.207+0000 7fee140f3640 1 -- 172.21.15.134:0/1565741905 <== osd.2 v2:172.21.15.134:6800/214480313 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee0c040040 con 0x7fee08082070 2024-04-24T02:12:44.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.207+0000 7fecc8fe1640 20 reqs_thread_entry: start 2024-04-24T02:12:44.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.207+0000 7fee17b33800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:44.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.207+0000 7fee17b33800 20 Filter name: none 2024-04-24T02:12:44.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.208+0000 7fec427fc640 20 reqs_thread_entry: start 2024-04-24T02:12:44.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.208+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54f870 con 0x56409f505430 2024-04-24T02:12:44.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.208+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fee04018950 con 0x56409f505430 2024-04-24T02:12:44.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.208+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54e860 con 0x56409f505430 2024-04-24T02:12:44.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.208+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.1 v2:172.21.15.134:6804/1487076214 30 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv7 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fee04018950 con 0x56409f505430 2024-04-24T02:12:44.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.208+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54f870 con 0x56409f505430 2024-04-24T02:12:44.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.208+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.1 v2:172.21.15.134:6804/1487076214 31 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fee04018950 con 0x56409f505430 2024-04-24T02:12:44.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.208+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54f870 con 0x7fee0c031040 2024-04-24T02:12:44.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.209+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.0 v2:172.21.15.104:6800/2419146313 24 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fee04018950 con 0x7fee0c031040 2024-04-24T02:12:44.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.209+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54e860 con 0x7fee0c031040 2024-04-24T02:12:44.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.209+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.0 v2:172.21.15.104:6800/2419146313 25 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fee04018950 con 0x7fee0c031040 2024-04-24T02:12:44.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.209+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54f870 con 0x7fee0c031040 2024-04-24T02:12:44.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.209+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.0 v2:172.21.15.104:6800/2419146313 26 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fee04018950 con 0x7fee0c031040 2024-04-24T02:12:44.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.209+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54f870 con 0x56409f50b570 2024-04-24T02:12:44.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.210+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.210+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54e860 con 0x56409f50b570 2024-04-24T02:12:44.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.210+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.210+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54f870 con 0x56409f50b570 2024-04-24T02:12:44.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.210+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.210+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54f870 con 0x56409f505430 2024-04-24T02:12:44.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.210+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.1 v2:172.21.15.134:6804/1487076214 32 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv11 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fee04018950 con 0x56409f505430 2024-04-24T02:12:44.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.211+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54e860 con 0x56409f505430 2024-04-24T02:12:44.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.211+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.1 v2:172.21.15.134:6804/1487076214 33 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv11 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fee04018950 con 0x56409f505430 2024-04-24T02:12:44.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.211+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54f870 con 0x56409f505430 2024-04-24T02:12:44.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.211+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.1 v2:172.21.15.134:6804/1487076214 34 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv11 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fee04018950 con 0x56409f505430 2024-04-24T02:12:44.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.211+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54f870 con 0x7fee08082070 2024-04-24T02:12:44.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.211+0000 7fee140f3640 1 -- 172.21.15.134:0/1565741905 <== osd.2 v2:172.21.15.134:6800/214480313 18 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fee0c040040 con 0x7fee08082070 2024-04-24T02:12:44.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.211+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54e860 con 0x7fee08082070 2024-04-24T02:12:44.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.211+0000 7fee140f3640 1 -- 172.21.15.134:0/1565741905 <== osd.2 v2:172.21.15.134:6800/214480313 19 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv9 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fee0c040040 con 0x7fee08082070 2024-04-24T02:12:44.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.211+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54f870 con 0x7fee08082070 2024-04-24T02:12:44.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.212+0000 7fee140f3640 1 -- 172.21.15.134:0/1565741905 <== osd.2 v2:172.21.15.134:6800/214480313 20 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fee0c040040 con 0x7fee08082070 2024-04-24T02:12:44.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.212+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54f870 con 0x56409f50b570 2024-04-24T02:12:44.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.212+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv10 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.212+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54e860 con 0x56409f50b570 2024-04-24T02:12:44.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.212+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv10 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.212+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54f870 con 0x56409f50b570 2024-04-24T02:12:44.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.212+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv10 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.212+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54f870 con 0x56409f505430 2024-04-24T02:12:44.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.213+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.1 v2:172.21.15.134:6804/1487076214 35 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fee04018950 con 0x56409f505430 2024-04-24T02:12:44.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.213+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54e860 con 0x56409f505430 2024-04-24T02:12:44.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.213+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.1 v2:172.21.15.134:6804/1487076214 36 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv7 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fee04018950 con 0x56409f505430 2024-04-24T02:12:44.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.213+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54f870 con 0x56409f505430 2024-04-24T02:12:44.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.213+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.1 v2:172.21.15.134:6804/1487076214 37 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fee04018950 con 0x56409f505430 2024-04-24T02:12:44.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.213+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54f870 con 0x7fee0c031040 2024-04-24T02:12:44.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.214+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.0 v2:172.21.15.104:6800/2419146313 27 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv6 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fee04018950 con 0x7fee0c031040 2024-04-24T02:12:44.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.214+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54e860 con 0x7fee0c031040 2024-04-24T02:12:44.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.214+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.0 v2:172.21.15.104:6800/2419146313 28 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv6 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fee04018950 con 0x7fee0c031040 2024-04-24T02:12:44.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.214+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54f870 con 0x7fee0c031040 2024-04-24T02:12:44.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.214+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.0 v2:172.21.15.104:6800/2419146313 29 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv6 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fee04018950 con 0x7fee0c031040 2024-04-24T02:12:44.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.214+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54f870 con 0x7fee08082070 2024-04-24T02:12:44.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.215+0000 7fee140f3640 1 -- 172.21.15.134:0/1565741905 <== osd.2 v2:172.21.15.134:6800/214480313 21 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fee0c040040 con 0x7fee08082070 2024-04-24T02:12:44.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.215+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54e860 con 0x7fee08082070 2024-04-24T02:12:44.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.215+0000 7fee140f3640 1 -- 172.21.15.134:0/1565741905 <== osd.2 v2:172.21.15.134:6800/214480313 22 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fee0c040040 con 0x7fee08082070 2024-04-24T02:12:44.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.215+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54f870 con 0x7fee08082070 2024-04-24T02:12:44.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.215+0000 7fee140f3640 1 -- 172.21.15.134:0/1565741905 <== osd.2 v2:172.21.15.134:6800/214480313 23 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fee0c040040 con 0x7fee08082070 2024-04-24T02:12:44.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.215+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54f870 con 0x56409f50b570 2024-04-24T02:12:44.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.215+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.215+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54e860 con 0x56409f50b570 2024-04-24T02:12:44.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.216+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.216+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54f870 con 0x56409f50b570 2024-04-24T02:12:44.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.216+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.216+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54f870 con 0x7fee08082070 2024-04-24T02:12:44.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.216+0000 7fee140f3640 1 -- 172.21.15.134:0/1565741905 <== osd.2 v2:172.21.15.134:6800/214480313 24 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee0c040040 con 0x7fee08082070 2024-04-24T02:12:44.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.216+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54e860 con 0x7fee08082070 2024-04-24T02:12:44.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.216+0000 7fee140f3640 1 -- 172.21.15.134:0/1565741905 <== osd.2 v2:172.21.15.134:6800/214480313 25 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv50 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fee0c040040 con 0x7fee08082070 2024-04-24T02:12:44.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.216+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54f870 con 0x7fee08082070 2024-04-24T02:12:44.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.217+0000 7fee140f3640 1 -- 172.21.15.134:0/1565741905 <== osd.2 v2:172.21.15.134:6800/214480313 26 ==== osd_op_reply(126 gc.10 [call out=1702b] v0'0 uv50 ondisk = 0) ==== 149+0+1702 (crc 0 0 0) 0x7fee0c040040 con 0x7fee08082070 2024-04-24T02:12:44.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.217+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f5504d0 con 0x7fee0c031040 2024-04-24T02:12:44.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.217+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.0 v2:172.21.15.104:6800/2419146313 30 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee04018950 con 0x7fee0c031040 2024-04-24T02:12:44.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.217+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54f4c0 con 0x7fee0c031040 2024-04-24T02:12:44.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.218+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.0 v2:172.21.15.104:6800/2419146313 31 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fee04018950 con 0x7fee0c031040 2024-04-24T02:12:44.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.218+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f5504d0 con 0x7fee0c031040 2024-04-24T02:12:44.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.218+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.0 v2:172.21.15.104:6800/2419146313 32 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee04018950 con 0x7fee0c031040 2024-04-24T02:12:44.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.218+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f5504d0 con 0x7fee08082070 2024-04-24T02:12:44.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.218+0000 7fee140f3640 1 -- 172.21.15.134:0/1565741905 <== osd.2 v2:172.21.15.134:6800/214480313 27 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee0c040040 con 0x7fee08082070 2024-04-24T02:12:44.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.218+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54f4c0 con 0x7fee08082070 2024-04-24T02:12:44.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.218+0000 7fee140f3640 1 -- 172.21.15.134:0/1565741905 <== osd.2 v2:172.21.15.134:6800/214480313 28 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv6 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fee0c040040 con 0x7fee08082070 2024-04-24T02:12:44.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.218+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f5504d0 con 0x7fee08082070 2024-04-24T02:12:44.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.218+0000 7fee140f3640 1 -- 172.21.15.134:0/1565741905 <== osd.2 v2:172.21.15.134:6800/214480313 29 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee0c040040 con 0x7fee08082070 2024-04-24T02:12:44.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.219+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f5504d0 con 0x7fee0c031040 2024-04-24T02:12:44.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.219+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.0 v2:172.21.15.104:6800/2419146313 33 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee04018950 con 0x7fee0c031040 2024-04-24T02:12:44.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.219+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54f4c0 con 0x7fee0c031040 2024-04-24T02:12:44.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.219+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.0 v2:172.21.15.104:6800/2419146313 34 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv16 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fee04018950 con 0x7fee0c031040 2024-04-24T02:12:44.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.219+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f5504d0 con 0x7fee0c031040 2024-04-24T02:12:44.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.220+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.0 v2:172.21.15.104:6800/2419146313 35 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee04018950 con 0x7fee0c031040 2024-04-24T02:12:44.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.220+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f5504d0 con 0x56409f505430 2024-04-24T02:12:44.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.220+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.1 v2:172.21.15.134:6804/1487076214 38 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee04018950 con 0x56409f505430 2024-04-24T02:12:44.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.220+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54f4c0 con 0x56409f505430 2024-04-24T02:12:44.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.220+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.1 v2:172.21.15.134:6804/1487076214 39 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv16 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fee04018950 con 0x56409f505430 2024-04-24T02:12:44.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.220+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f5504d0 con 0x56409f505430 2024-04-24T02:12:44.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.220+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.1 v2:172.21.15.134:6804/1487076214 40 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee04018950 con 0x56409f505430 2024-04-24T02:12:44.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.220+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f5504d0 con 0x56409f50b570 2024-04-24T02:12:44.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.221+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.221+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54f4c0 con 0x56409f50b570 2024-04-24T02:12:44.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.221+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv12 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.221+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f5504d0 con 0x56409f50b570 2024-04-24T02:12:44.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.221+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.221+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f5504d0 con 0x7fee08082070 2024-04-24T02:12:44.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.221+0000 7fee140f3640 1 -- 172.21.15.134:0/1565741905 <== osd.2 v2:172.21.15.134:6800/214480313 30 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee0c040040 con 0x7fee08082070 2024-04-24T02:12:44.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.221+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54f4c0 con 0x7fee08082070 2024-04-24T02:12:44.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.222+0000 7fee140f3640 1 -- 172.21.15.134:0/1565741905 <== osd.2 v2:172.21.15.134:6800/214480313 31 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv17 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fee0c040040 con 0x7fee08082070 2024-04-24T02:12:44.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.222+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f5504d0 con 0x7fee08082070 2024-04-24T02:12:44.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.222+0000 7fee140f3640 1 -- 172.21.15.134:0/1565741905 <== osd.2 v2:172.21.15.134:6800/214480313 32 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee0c040040 con 0x7fee08082070 2024-04-24T02:12:44.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.222+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f5504d0 con 0x56409f50b570 2024-04-24T02:12:44.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.222+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.222+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54f4c0 con 0x56409f50b570 2024-04-24T02:12:44.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.222+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv12 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.222+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f5504d0 con 0x56409f50b570 2024-04-24T02:12:44.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.223+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.223+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f5504d0 con 0x56409f505430 2024-04-24T02:12:44.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.223+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.1 v2:172.21.15.134:6804/1487076214 41 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee04018950 con 0x56409f505430 2024-04-24T02:12:44.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.223+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54f4c0 con 0x56409f505430 2024-04-24T02:12:44.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.223+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.1 v2:172.21.15.134:6804/1487076214 42 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fee04018950 con 0x56409f505430 2024-04-24T02:12:44.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.223+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f5504d0 con 0x56409f505430 2024-04-24T02:12:44.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.223+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.1 v2:172.21.15.134:6804/1487076214 43 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee04018950 con 0x56409f505430 2024-04-24T02:12:44.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.223+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f5504d0 con 0x56409f505430 2024-04-24T02:12:44.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.224+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.1 v2:172.21.15.134:6804/1487076214 44 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv19 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee04018950 con 0x56409f505430 2024-04-24T02:12:44.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.224+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54f4c0 con 0x56409f505430 2024-04-24T02:12:44.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.224+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.1 v2:172.21.15.134:6804/1487076214 45 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv19 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fee04018950 con 0x56409f505430 2024-04-24T02:12:44.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.224+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f5504d0 con 0x56409f505430 2024-04-24T02:12:44.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.224+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.1 v2:172.21.15.134:6804/1487076214 46 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv19 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee04018950 con 0x56409f505430 2024-04-24T02:12:44.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.224+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f5504d0 con 0x56409f50b570 2024-04-24T02:12:44.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.224+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.224+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54f4c0 con 0x56409f50b570 2024-04-24T02:12:44.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.224+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv15 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.224+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f5504d0 con 0x56409f50b570 2024-04-24T02:12:44.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.225+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.225+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f5504d0 con 0x7fee08082070 2024-04-24T02:12:44.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.225+0000 7fee140f3640 1 -- 172.21.15.134:0/1565741905 <== osd.2 v2:172.21.15.134:6800/214480313 33 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee0c040040 con 0x7fee08082070 2024-04-24T02:12:44.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.225+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54f4c0 con 0x7fee08082070 2024-04-24T02:12:44.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.225+0000 7fee140f3640 1 -- 172.21.15.134:0/1565741905 <== osd.2 v2:172.21.15.134:6800/214480313 34 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fee0c040040 con 0x7fee08082070 2024-04-24T02:12:44.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.225+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f5504d0 con 0x7fee08082070 2024-04-24T02:12:44.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.225+0000 7fee140f3640 1 -- 172.21.15.134:0/1565741905 <== osd.2 v2:172.21.15.134:6800/214480313 35 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee0c040040 con 0x7fee08082070 2024-04-24T02:12:44.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.225+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f5504d0 con 0x56409f50b570 2024-04-24T02:12:44.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.226+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.226+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54f4c0 con 0x56409f50b570 2024-04-24T02:12:44.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.226+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.226+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f5504d0 con 0x56409f50b570 2024-04-24T02:12:44.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.226+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.226+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f5504d0 con 0x56409f50b570 2024-04-24T02:12:44.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.226+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.226+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54f4c0 con 0x56409f50b570 2024-04-24T02:12:44.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.227+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv15 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.227+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f5504d0 con 0x56409f50b570 2024-04-24T02:12:44.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.227+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.227+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f5504d0 con 0x56409f50b570 2024-04-24T02:12:44.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.227+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.227+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54f4c0 con 0x56409f50b570 2024-04-24T02:12:44.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.227+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.227+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f5504d0 con 0x56409f50b570 2024-04-24T02:12:44.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.228+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.228+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f5504d0 con 0x56409f50b570 2024-04-24T02:12:44.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.228+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.228+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54f4c0 con 0x56409f50b570 2024-04-24T02:12:44.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.228+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv24 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.228+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f5504d0 con 0x56409f50b570 2024-04-24T02:12:44.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.228+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.228+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f5504d0 con 0x7fee0c031040 2024-04-24T02:12:44.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.229+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.0 v2:172.21.15.104:6800/2419146313 36 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv10 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee04018950 con 0x7fee0c031040 2024-04-24T02:12:44.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.229+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54f4c0 con 0x7fee0c031040 2024-04-24T02:12:44.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.229+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.0 v2:172.21.15.104:6800/2419146313 37 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv10 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fee04018950 con 0x7fee0c031040 2024-04-24T02:12:44.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.229+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f5504d0 con 0x7fee0c031040 2024-04-24T02:12:44.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.229+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.0 v2:172.21.15.104:6800/2419146313 38 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv10 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee04018950 con 0x7fee0c031040 2024-04-24T02:12:44.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.230+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f5504d0 con 0x56409f50b570 2024-04-24T02:12:44.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.230+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.230+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54f4c0 con 0x56409f50b570 2024-04-24T02:12:44.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.230+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv17 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.230+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f5504d0 con 0x56409f50b570 2024-04-24T02:12:44.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.230+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.230+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f5504d0 con 0x7fee0c031040 2024-04-24T02:12:44.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.231+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.0 v2:172.21.15.104:6800/2419146313 39 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee04018950 con 0x7fee0c031040 2024-04-24T02:12:44.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.231+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54f4c0 con 0x7fee0c031040 2024-04-24T02:12:44.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.231+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.0 v2:172.21.15.104:6800/2419146313 40 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fee04018950 con 0x7fee0c031040 2024-04-24T02:12:44.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.231+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f5504d0 con 0x7fee0c031040 2024-04-24T02:12:44.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.231+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.0 v2:172.21.15.104:6800/2419146313 41 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee04018950 con 0x7fee0c031040 2024-04-24T02:12:44.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.231+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f5504d0 con 0x56409f50b570 2024-04-24T02:12:44.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.232+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.232+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54f4c0 con 0x56409f50b570 2024-04-24T02:12:44.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.232+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.232+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f5504d0 con 0x56409f50b570 2024-04-24T02:12:44.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.232+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.232+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f5504d0 con 0x7fee0c031040 2024-04-24T02:12:44.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.233+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.0 v2:172.21.15.104:6800/2419146313 42 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee04018950 con 0x7fee0c031040 2024-04-24T02:12:44.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.233+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54f4c0 con 0x7fee0c031040 2024-04-24T02:12:44.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.233+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.0 v2:172.21.15.104:6800/2419146313 43 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fee04018950 con 0x7fee0c031040 2024-04-24T02:12:44.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.233+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f5504d0 con 0x7fee0c031040 2024-04-24T02:12:44.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.233+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.0 v2:172.21.15.104:6800/2419146313 44 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee04018950 con 0x7fee0c031040 2024-04-24T02:12:44.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.233+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f5504d0 con 0x7fee08082070 2024-04-24T02:12:44.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.234+0000 7fee140f3640 1 -- 172.21.15.134:0/1565741905 <== osd.2 v2:172.21.15.134:6800/214480313 36 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee0c040040 con 0x7fee08082070 2024-04-24T02:12:44.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.234+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f54f4c0 con 0x7fee08082070 2024-04-24T02:12:44.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.234+0000 7fee140f3640 1 -- 172.21.15.134:0/1565741905 <== osd.2 v2:172.21.15.134:6800/214480313 37 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fee0c040040 con 0x7fee08082070 2024-04-24T02:12:44.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.234+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56409f5504d0 con 0x7fee08082070 2024-04-24T02:12:44.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.234+0000 7fee140f3640 1 -- 172.21.15.134:0/1565741905 <== osd.2 v2:172.21.15.134:6800/214480313 38 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee0c040040 con 0x7fee08082070 2024-04-24T02:12:44.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.235+0000 7fecc9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:44.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.235+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94835550800784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f4bcaa0 con 0x56409f505430 2024-04-24T02:12:44.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.236+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.1 v2:172.21.15.134:6804/1487076214 47 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94835550800784] v30'163 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fee04018950 con 0x56409f505430 2024-04-24T02:12:44.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.236+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94835550780208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f514b90 con 0x7fee08082070 2024-04-24T02:12:44.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.237+0000 7fee140f3640 1 -- 172.21.15.134:0/1565741905 <== osd.2 v2:172.21.15.134:6800/214480313 39 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94835550780208] v30'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee0c040040 con 0x7fee08082070 2024-04-24T02:12:44.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.237+0000 7fee17b33800 20 remove_watcher() i=0 2024-04-24T02:12:44.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.237+0000 7fee17b33800 2 removed watcher, disabling cache 2024-04-24T02:12:44.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.237+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94835550784064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f50fb30 con 0x56409f505430 2024-04-24T02:12:44.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.238+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.1 v2:172.21.15.134:6804/1487076214 48 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94835550784064] v30'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee04018950 con 0x56409f505430 2024-04-24T02:12:44.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.238+0000 7fee17b33800 20 remove_watcher() i=1 2024-04-24T02:12:44.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.238+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94835550785120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f50fb30 con 0x56409f50b570 2024-04-24T02:12:44.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.240+0000 7fee130f1640 1 -- 172.21.15.134:0/1565741905 <== osd.3 v2:172.21.15.134:6801/3585115521 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94835550785120] v30'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee08071030 con 0x56409f50b570 2024-04-24T02:12:44.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.240+0000 7fee17b33800 20 remove_watcher() i=2 2024-04-24T02:12:44.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.240+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94835550792448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f50fb30 con 0x7fee08082070 2024-04-24T02:12:44.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.241+0000 7fee140f3640 1 -- 172.21.15.134:0/1565741905 <== osd.2 v2:172.21.15.134:6800/214480313 40 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94835550792448] v30'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee0c040040 con 0x7fee08082070 2024-04-24T02:12:44.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.241+0000 7fee17b33800 20 remove_watcher() i=3 2024-04-24T02:12:44.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.241+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94835550797440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f50fb30 con 0x56409f505430 2024-04-24T02:12:44.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.242+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.1 v2:172.21.15.134:6804/1487076214 49 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94835550797440] v30'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee04018950 con 0x56409f505430 2024-04-24T02:12:44.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.242+0000 7fee17b33800 20 remove_watcher() i=4 2024-04-24T02:12:44.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.242+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94835550788880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f50fb30 con 0x7fee0c031040 2024-04-24T02:12:44.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.243+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.0 v2:172.21.15.104:6800/2419146313 45 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94835550788880] v30'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee04018950 con 0x7fee0c031040 2024-04-24T02:12:44.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.243+0000 7fee17b33800 20 remove_watcher() i=5 2024-04-24T02:12:44.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.243+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94835550799632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f511d10 con 0x7fee0c031040 2024-04-24T02:12:44.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.245+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.0 v2:172.21.15.104:6800/2419146313 46 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94835550799632] v30'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee04018950 con 0x7fee0c031040 2024-04-24T02:12:44.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.245+0000 7fee17b33800 20 remove_watcher() i=6 2024-04-24T02:12:44.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.245+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94835550803760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56409f50fb30 con 0x7fee0c031040 2024-04-24T02:12:44.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.246+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 <== osd.0 v2:172.21.15.104:6800/2419146313 47 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94835550803760] v30'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee04018950 con 0x7fee0c031040 2024-04-24T02:12:44.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.246+0000 7fee17b33800 20 remove_watcher() i=7 2024-04-24T02:12:44.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.246+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fee0c031040 msgr2=0x7fee0c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:44.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.246+0000 7fee17b33800 1 --2- 172.21.15.134:0/1565741905 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fee0c031040 0x7fee0c032940 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.246+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x56409f505430 msgr2=0x56409f5078f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:44.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.246+0000 7fee17b33800 1 --2- 172.21.15.134:0/1565741905 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x56409f505430 0x56409f5078f0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.246+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fee08082070 msgr2=0x7fee0806d120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:44.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.246+0000 7fee17b33800 1 --2- 172.21.15.134:0/1565741905 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fee08082070 0x7fee0806d120 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.246+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x56409f50b570 msgr2=0x56409f50d960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:44.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.246+0000 7fee17b33800 1 --2- 172.21.15.134:0/1565741905 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x56409f50b570 0x56409f50d960 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.246+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fecdc036900 msgr2=0x7fecdc038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:44.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.246+0000 7fee17b33800 1 --2- 172.21.15.134:0/1565741905 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fecdc036900 0x7fecdc038dc0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x56409f4cdf00 tx=0x7fee0c01f000 comp rx=0 tx=0).stop 2024-04-24T02:12:44.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.246+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56409f4f2320 msgr2=0x56409f4f9970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:44.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.246+0000 7fee138f2640 1 -- 172.21.15.134:0/1565741905 reap_dead start 2024-04-24T02:12:44.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.246+0000 7fee17b33800 1 --2- 172.21.15.134:0/1565741905 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56409f4f2320 0x56409f4f9970 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fee0808e090 tx=0x7fee0808dd30 comp rx=0 tx=0).stop 2024-04-24T02:12:44.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.246+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 shutdown_connections 2024-04-24T02:12:44.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.246+0000 7fee17b33800 1 --2- 172.21.15.134:0/1565741905 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56409f4f2320 0x56409f4f9970 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.246+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 >> 172.21.15.134:0/1565741905 conn(0x56409f4ee680 msgr2=0x56409f4ebce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:44.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.246+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 shutdown_connections 2024-04-24T02:12:44.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.246+0000 7fee17b33800 1 -- 172.21.15.134:0/1565741905 wait complete. 2024-04-24T02:12:44.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.247+0000 7fee17b33800 1 -- 172.21.15.134:0/782971729 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fecec036900 msgr2=0x7fecec038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:44.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.247+0000 7fee17b33800 1 --2- 172.21.15.134:0/782971729 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fecec036900 0x7fecec038dc0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x56409f4d5150 tx=0x7fee0c005840 comp rx=0 tx=0).stop 2024-04-24T02:12:44.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.247+0000 7fee17b33800 1 -- 172.21.15.134:0/782971729 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56409f4e5060 msgr2=0x56409f4e5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:44.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.247+0000 7fee17b33800 1 --2- 172.21.15.134:0/782971729 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56409f4e5060 0x56409f4e5480 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fee08044840 tx=0x7fee08002fb0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.247+0000 7fee17b33800 1 -- 172.21.15.134:0/782971729 shutdown_connections 2024-04-24T02:12:44.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.247+0000 7fee17b33800 1 --2- 172.21.15.134:0/782971729 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fecec036900 0x7fecec038dc0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.247+0000 7fee17b33800 1 --2- 172.21.15.134:0/782971729 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56409f4e5060 0x56409f4e5480 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.247+0000 7fee17b33800 1 -- 172.21.15.134:0/782971729 >> 172.21.15.134:0/782971729 conn(0x56409f4d9100 msgr2=0x56409f4d9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:44.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.247+0000 7fee17b33800 1 -- 172.21.15.134:0/782971729 shutdown_connections 2024-04-24T02:12:44.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.247+0000 7fee17b33800 1 -- 172.21.15.134:0/782971729 wait complete. 2024-04-24T02:12:44.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.247+0000 7fee17b33800 1 -- 172.21.15.134:0/4071262053 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x56409f3d71f0 msgr2=0x56409f4d3f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:44.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.247+0000 7fee17b33800 1 --2- 172.21.15.134:0/4071262053 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x56409f3d71f0 0x56409f4d3f20 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.247+0000 7fee17b33800 1 -- 172.21.15.134:0/4071262053 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fecfc036900 msgr2=0x7fecfc038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:44.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.247+0000 7fee17b33800 1 --2- 172.21.15.134:0/4071262053 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fecfc036900 0x7fecfc038dc0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fee08054000 tx=0x7fee0804e000 comp rx=0 tx=0).stop 2024-04-24T02:12:44.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.247+0000 7fee17b33800 1 -- 172.21.15.134:0/4071262053 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56409f3d2d60 msgr2=0x56409f4ccce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:44.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.247+0000 7fee17b33800 1 --2- 172.21.15.134:0/4071262053 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56409f3d2d60 0x56409f4ccce0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fee0400b7c0 tx=0x7fee04000ed0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.247+0000 7fee17b33800 1 -- 172.21.15.134:0/4071262053 shutdown_connections 2024-04-24T02:12:44.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.247+0000 7fee17b33800 1 --2- 172.21.15.134:0/4071262053 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x56409f3d71f0 0x56409f4d3f20 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.247+0000 7fee17b33800 1 --2- 172.21.15.134:0/4071262053 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fecfc036900 0x7fecfc038dc0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.247+0000 7fee17b33800 1 --2- 172.21.15.134:0/4071262053 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56409f3d2d60 0x56409f4ccce0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.247+0000 7fee17b33800 1 -- 172.21.15.134:0/4071262053 >> 172.21.15.134:0/4071262053 conn(0x56409f3ce320 msgr2=0x56409f4bf200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:44.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.247+0000 7fee17b33800 1 -- 172.21.15.134:0/4071262053 shutdown_connections 2024-04-24T02:12:44.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.247+0000 7fee17b33800 1 -- 172.21.15.134:0/4071262053 wait complete. 2024-04-24T02:12:44.259 INFO:teuthology.orchestra.run.smithi134.stdout:[{"tag":"582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.15912855557186293686\u0000","time":"2024-04-24T02:12:44.061072+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1__shadow_.zZth32eWOoC-HujgL0pPG5mhvP6_0qF_1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1__shadow_.zZth32eWOoC-HujgL0pPG5mhvP6_0qF_2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1__shadow_.zZth32eWOoC-HujgL0pPG5mhvP6_0qF_3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1__shadow_.zZth32eWOoC-HujgL0pPG5mhvP6_0qF_4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1__shadow_.zZth32eWOoC-HujgL0pPG5mhvP6_0qF_5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1__shadow_.zZth32eWOoC-HujgL0pPG5mhvP6_0qF_6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1__shadow_.zZth32eWOoC-HujgL0pPG5mhvP6_0qF_7","key":"","instance":""}]}] 2024-04-24T02:12:44.260 DEBUG:tasks.util.rgw: json result: [{'tag': '582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.15912855557186293686\x00', 'time': '2024-04-24T02:12:44.061072+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': '582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1__shadow_.zZth32eWOoC-HujgL0pPG5mhvP6_0qF_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1__shadow_.zZth32eWOoC-HujgL0pPG5mhvP6_0qF_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1__shadow_.zZth32eWOoC-HujgL0pPG5mhvP6_0qF_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1__shadow_.zZth32eWOoC-HujgL0pPG5mhvP6_0qF_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1__shadow_.zZth32eWOoC-HujgL0pPG5mhvP6_0qF_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1__shadow_.zZth32eWOoC-HujgL0pPG5mhvP6_0qF_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1__shadow_.zZth32eWOoC-HujgL0pPG5mhvP6_0qF_7', 'key': '', 'instance': ''}]}] 2024-04-24T02:12:44.260 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-04-24T02:12:44.260 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-04-24T02:12:44.260 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-04-24T02:12:44.302 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:44.302 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:44.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.302+0000 7f3c0312f800 1 Processor -- start 2024-04-24T02:12:44.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.302+0000 7f3c0312f800 1 -- start start 2024-04-24T02:12:44.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.302+0000 7f3c0312f800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55fb17463980 0x55fb17465d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.302+0000 7f3c0312f800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fb17321d40 con 0x55fb174662b0 2024-04-24T02:12:44.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.302+0000 7f3c0312f800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55fb172f44d0 con 0x55fb17463980 2024-04-24T02:12:44.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.302+0000 7f3bfedb5640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55fb17463980 0x55fb17465d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.302+0000 7f3bfedb5640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55fb17463980 0x55fb17465d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:40582/0 (socket says 172.21.15.134:40582) 2024-04-24T02:12:44.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.302+0000 7f3bfedb5640 1 -- 172.21.15.134:0/609023129 learned_addr learned my addr 172.21.15.134:0/609023129 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:44.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.302+0000 7f3bfe5b4640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55fb174662b0 0x55fb174686a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:36552/0 (socket says 172.21.15.134:36552) 2024-04-24T02:12:44.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.302+0000 7f3bfedb5640 1 -- 172.21.15.134:0/609023129 >> v1:172.21.15.104:6789/0 conn(0x55fb174662b0 legacy=0x55fb174686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:44.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.302+0000 7f3bfedb5640 1 -- 172.21.15.134:0/609023129 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb17320590 con 0x55fb17463980 2024-04-24T02:12:44.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.304+0000 7f3bfedb5640 1 --2- 172.21.15.134:0/609023129 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fb17463980 0x55fb17465d70 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f3bf000a520 tx=0x7f3bf001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29dc9aa1fce64711 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.304+0000 7f3bfddb3640 1 -- 172.21.15.134:0/609023129 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bf0057070 con 0x55fb17463980 2024-04-24T02:12:44.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.304+0000 7f3bfddb3640 1 -- 172.21.15.134:0/609023129 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bf0052570 con 0x55fb17463980 2024-04-24T02:12:44.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.304+0000 7f3bfddb3640 1 -- 172.21.15.134:0/609023129 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bf004ae60 con 0x55fb17463980 2024-04-24T02:12:44.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.305+0000 7f3c0312f800 1 -- 172.21.15.134:0/609023129 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fb17463980 msgr2=0x55fb17465d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:44.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.305+0000 7f3c0312f800 1 --2- 172.21.15.134:0/609023129 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fb17463980 0x55fb17465d70 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f3bf000a520 tx=0x7f3bf001d010 comp rx=0 tx=0).stop 2024-04-24T02:12:44.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.305+0000 7f3c0312f800 1 -- 172.21.15.134:0/609023129 shutdown_connections 2024-04-24T02:12:44.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.305+0000 7f3c0312f800 1 --2- 172.21.15.134:0/609023129 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fb17463980 0x55fb17465d70 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.305+0000 7f3c0312f800 1 -- 172.21.15.134:0/609023129 >> 172.21.15.134:0/609023129 conn(0x55fb1745d310 msgr2=0x55fb1745f730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:44.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.305+0000 7f3c0312f800 1 -- 172.21.15.134:0/609023129 shutdown_connections 2024-04-24T02:12:44.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.305+0000 7f3c0312f800 1 -- 172.21.15.134:0/609023129 wait complete. 2024-04-24T02:12:44.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.316+0000 7f3c0312f800 1 Processor -- start 2024-04-24T02:12:44.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.317+0000 7f3c0312f800 1 -- start start 2024-04-24T02:12:44.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.317+0000 7f3c0312f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fb17463980 0x55fb174632c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.317+0000 7f3c0312f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55fb173ae3b0 con 0x55fb17463980 2024-04-24T02:12:44.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.317+0000 7f3bfedb5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fb17463980 0x55fb174632c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.317+0000 7f3bfedb5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fb17463980 0x55fb174632c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:40586/0 (socket says 172.21.15.134:40586) 2024-04-24T02:12:44.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.317+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2841196100 learned_addr learned my addr 172.21.15.134:0/2841196100 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:44.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.317+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2841196100 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb17461880 con 0x55fb17463980 2024-04-24T02:12:44.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.317+0000 7f3bfedb5640 1 --2- 172.21.15.134:0/2841196100 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fb17463980 0x55fb174632c0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f3bf001d050 tx=0x7f3bf004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd041d095e0fa408 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.318+0000 7f3aece09640 1 -- 172.21.15.134:0/2841196100 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bf0057040 con 0x55fb17463980 2024-04-24T02:12:44.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.318+0000 7f3aece09640 1 -- 172.21.15.134:0/2841196100 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bf0052720 con 0x55fb17463980 2024-04-24T02:12:44.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.318+0000 7f3aece09640 1 -- 172.21.15.134:0/2841196100 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bf0052a40 con 0x55fb17463980 2024-04-24T02:12:44.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.318+0000 7f3c0312f800 1 -- 172.21.15.134:0/2841196100 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fb17463980 msgr2=0x55fb174632c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:44.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.318+0000 7f3c0312f800 1 --2- 172.21.15.134:0/2841196100 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fb17463980 0x55fb174632c0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f3bf001d050 tx=0x7f3bf004c000 comp rx=0 tx=0).stop 2024-04-24T02:12:44.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.318+0000 7f3c0312f800 1 -- 172.21.15.134:0/2841196100 shutdown_connections 2024-04-24T02:12:44.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.318+0000 7f3c0312f800 1 --2- 172.21.15.134:0/2841196100 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fb17463980 0x55fb174632c0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.318+0000 7f3c0312f800 1 -- 172.21.15.134:0/2841196100 >> 172.21.15.134:0/2841196100 conn(0x55fb1745d310 msgr2=0x55fb1754f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:44.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.318+0000 7f3c0312f800 1 -- 172.21.15.134:0/2841196100 shutdown_connections 2024-04-24T02:12:44.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.318+0000 7f3c0312f800 1 -- 172.21.15.134:0/2841196100 wait complete. 2024-04-24T02:12:44.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.319+0000 7f3c0312f800 1 Processor -- start 2024-04-24T02:12:44.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.319+0000 7f3c0312f800 1 -- start start 2024-04-24T02:12:44.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.319+0000 7f3c0312f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fb17463980 0x55fb1755dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.319+0000 7f3c0312f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55fb1746c0d0 con 0x55fb17463980 2024-04-24T02:12:44.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.319+0000 7f3bfedb5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fb17463980 0x55fb1755dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.319+0000 7f3bfedb5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fb17463980 0x55fb1755dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:40590/0 (socket says 172.21.15.134:40590) 2024-04-24T02:12:44.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.319+0000 7f3bfedb5640 1 -- 172.21.15.134:0/607286194 learned_addr learned my addr 172.21.15.134:0/607286194 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:44.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.319+0000 7f3bfedb5640 1 -- 172.21.15.134:0/607286194 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb1755e210 con 0x55fb17463980 2024-04-24T02:12:44.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.319+0000 7f3bfedb5640 1 --2- 172.21.15.134:0/607286194 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fb17463980 0x55fb1755dcd0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f3bf001cfe0 tx=0x7f3bf0003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.320+0000 7f3aeb606640 1 -- 172.21.15.134:0/607286194 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bf0073070 con 0x55fb17463980 2024-04-24T02:12:44.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.320+0000 7f3aeb606640 1 -- 172.21.15.134:0/607286194 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bf005d440 con 0x55fb17463980 2024-04-24T02:12:44.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.320+0000 7f3aeb606640 1 -- 172.21.15.134:0/607286194 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bf0057070 con 0x55fb17463980 2024-04-24T02:12:44.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.320+0000 7f3c0312f800 1 -- 172.21.15.134:0/607286194 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fb1755e4a0 con 0x55fb17463980 2024-04-24T02:12:44.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.320+0000 7f3c0312f800 1 -- 172.21.15.134:0/607286194 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb17561150 con 0x55fb17463980 2024-04-24T02:12:44.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.320+0000 7f3aeb606640 1 -- 172.21.15.134:0/607286194 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3bf0076070 con 0x55fb17463980 2024-04-24T02:12:44.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.320+0000 7f3aeb606640 1 --2- 172.21.15.134:0/607286194 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3ae4036900 0x7f3ae4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.321+0000 7f3aeb606640 1 -- 172.21.15.134:0/607286194 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f3bf008dae0 con 0x55fb17463980 2024-04-24T02:12:44.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.321+0000 7f3bfe5b4640 1 --2- 172.21.15.134:0/607286194 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3ae4036900 0x7f3ae4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.321+0000 7f3c0312f800 1 --2- 172.21.15.134:0/607286194 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55fb174662b0 0x55fb17564f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.321+0000 7f3c0312f800 1 -- 172.21.15.134:0/607286194 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175654e0 con 0x55fb174662b0 2024-04-24T02:12:44.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.321+0000 7f3bff5b6640 1 --2- 172.21.15.134:0/607286194 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55fb174662b0 0x55fb17564f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.321+0000 7f3bfe5b4640 1 --2- 172.21.15.134:0/607286194 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3ae4036900 0x7f3ae4038dc0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4000f60 tx=0x7f3bf4001370 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.321+0000 7f3bff5b6640 1 --2- 172.21.15.134:0/607286194 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55fb174662b0 0x55fb17564f10 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.321+0000 7f3bff5b6640 1 -- 172.21.15.134:0/607286194 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3bf800a4a0 con 0x55fb174662b0 2024-04-24T02:12:44.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.321+0000 7f3c0312f800 1 -- 172.21.15.134:0/607286194 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175624c0 con 0x55fb174662b0 2024-04-24T02:12:44.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.322+0000 7f3bff5b6640 1 -- 172.21.15.134:0/607286194 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3bf800a4a0 con 0x55fb174662b0 2024-04-24T02:12:44.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.322+0000 7f3c0312f800 1 -- 172.21.15.134:0/607286194 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175672e0 con 0x55fb174662b0 2024-04-24T02:12:44.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.322+0000 7f3bff5b6640 1 -- 172.21.15.134:0/607286194 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3bf800a4a0 con 0x55fb174662b0 2024-04-24T02:12:44.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.322+0000 7f3c0312f800 1 -- 172.21.15.134:0/607286194 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb17566620 con 0x55fb174662b0 2024-04-24T02:12:44.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.322+0000 7f3bff5b6640 1 -- 172.21.15.134:0/607286194 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3bf800a4a0 con 0x55fb174662b0 2024-04-24T02:12:44.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.322+0000 7f3c0312f800 1 -- 172.21.15.134:0/607286194 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb17566a40 con 0x55fb174662b0 2024-04-24T02:12:44.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.322+0000 7f3bff5b6640 1 -- 172.21.15.134:0/607286194 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3bf800a4a0 con 0x55fb174662b0 2024-04-24T02:12:44.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.323+0000 7f3c0312f800 1 Processor -- start 2024-04-24T02:12:44.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.323+0000 7f3c0312f800 1 -- start start 2024-04-24T02:12:44.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.323+0000 7f3c0312f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fb175760f0 0x55fb17576510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.323+0000 7f3c0312f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55fb173546b0 con 0x55fb175760f0 2024-04-24T02:12:44.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.323+0000 7f3bfe5b4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fb175760f0 0x55fb17576510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.323+0000 7f3bfe5b4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fb175760f0 0x55fb17576510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:40594/0 (socket says 172.21.15.134:40594) 2024-04-24T02:12:44.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.323+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/1130349786 learned_addr learned my addr 172.21.15.134:0/1130349786 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:44.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.323+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/1130349786 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb17576a50 con 0x55fb175760f0 2024-04-24T02:12:44.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.324+0000 7f3bfe5b4640 1 --2- 172.21.15.134:0/1130349786 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fb175760f0 0x55fb17576510 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4001ed0 tx=0x7f3bf400ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.324+0000 7f3ae8e01640 1 -- 172.21.15.134:0/1130349786 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bf4022070 con 0x55fb175760f0 2024-04-24T02:12:44.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.324+0000 7f3ae8e01640 1 -- 172.21.15.134:0/1130349786 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bf400d520 con 0x55fb175760f0 2024-04-24T02:12:44.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.324+0000 7f3ae8e01640 1 -- 172.21.15.134:0/1130349786 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bf400d800 con 0x55fb175760f0 2024-04-24T02:12:44.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.324+0000 7f3c0312f800 1 -- 172.21.15.134:0/1130349786 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fb175774c0 con 0x55fb175760f0 2024-04-24T02:12:44.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.324+0000 7f3c0312f800 1 -- 172.21.15.134:0/1130349786 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb175779c0 con 0x55fb175760f0 2024-04-24T02:12:44.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.325+0000 7f3ae8e01640 1 -- 172.21.15.134:0/1130349786 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3bf4025070 con 0x55fb175760f0 2024-04-24T02:12:44.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.325+0000 7f3ae8e01640 1 --2- 172.21.15.134:0/1130349786 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3ad8036900 0x7f3ad8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.325+0000 7f3ae8e01640 1 -- 172.21.15.134:0/1130349786 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f3bf404db50 con 0x55fb175760f0 2024-04-24T02:12:44.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.325+0000 7f3bff5b6640 1 --2- 172.21.15.134:0/1130349786 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3ad8036900 0x7f3ad8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.325+0000 7f3c0312f800 1 Processor -- start 2024-04-24T02:12:44.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.325+0000 7f3c0312f800 1 -- start start 2024-04-24T02:12:44.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.325+0000 7f3bff5b6640 1 --2- 172.21.15.134:0/1130349786 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3ad8036900 0x7f3ad8038dc0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x55fb175669c0 tx=0x7f3bf8005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.325+0000 7f3c0312f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fb17583430 0x55fb17583850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.325+0000 7f3c0312f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55fb17461b40 con 0x55fb17583430 2024-04-24T02:12:44.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.325+0000 7f3bfe5b4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fb17583430 0x55fb17583850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.325+0000 7f3bfe5b4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fb17583430 0x55fb17583850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:40604/0 (socket says 172.21.15.134:40604) 2024-04-24T02:12:44.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.325+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/1476531669 learned_addr learned my addr 172.21.15.134:0/1476531669 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:44.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.326+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/1476531669 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb17583e20 con 0x55fb17583430 2024-04-24T02:12:44.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.326+0000 7f3bfe5b4640 1 --2- 172.21.15.134:0/1476531669 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fb17583430 0x55fb17583850 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f3bf404c120 tx=0x7f3bf4024740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aba7b3976f632d8f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.326+0000 7f3ae27fc640 1 -- 172.21.15.134:0/1476531669 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bf404a030 con 0x55fb17583430 2024-04-24T02:12:44.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.326+0000 7f3ae27fc640 1 -- 172.21.15.134:0/1476531669 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bf4026730 con 0x55fb17583430 2024-04-24T02:12:44.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.326+0000 7f3ae27fc640 1 -- 172.21.15.134:0/1476531669 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bf4025c50 con 0x55fb17583430 2024-04-24T02:12:44.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.326+0000 7f3c0312f800 1 -- 172.21.15.134:0/1476531669 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fb17583430 msgr2=0x55fb17583850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:44.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.326+0000 7f3c0312f800 1 --2- 172.21.15.134:0/1476531669 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fb17583430 0x55fb17583850 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f3bf404c120 tx=0x7f3bf4024740 comp rx=0 tx=0).stop 2024-04-24T02:12:44.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.326+0000 7f3c0312f800 1 -- 172.21.15.134:0/1476531669 shutdown_connections 2024-04-24T02:12:44.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.326+0000 7f3c0312f800 1 --2- 172.21.15.134:0/1476531669 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fb17583430 0x55fb17583850 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.326+0000 7f3c0312f800 1 -- 172.21.15.134:0/1476531669 >> 172.21.15.134:0/1476531669 conn(0x55fb1757f790 msgr2=0x55fb1757d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:44.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.326+0000 7f3c0312f800 1 -- 172.21.15.134:0/1476531669 shutdown_connections 2024-04-24T02:12:44.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.327+0000 7f3c0312f800 1 -- 172.21.15.134:0/1476531669 wait complete. 2024-04-24T02:12:44.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.327+0000 7f3c0312f800 1 Processor -- start 2024-04-24T02:12:44.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.327+0000 7f3c0312f800 1 -- start start 2024-04-24T02:12:44.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.327+0000 7f3c0312f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fb17583430 0x55fb1758aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.327+0000 7f3c0312f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55fb17584590 con 0x55fb17583430 2024-04-24T02:12:44.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.327+0000 7f3bfe5b4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fb17583430 0x55fb1758aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.327+0000 7f3bfe5b4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fb17583430 0x55fb1758aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:40614/0 (socket says 172.21.15.134:40614) 2024-04-24T02:12:44.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.327+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 learned_addr learned my addr 172.21.15.134:0/2617995573 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:44.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.327+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb1758afd0 con 0x55fb17583430 2024-04-24T02:12:44.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.327+0000 7f3bfe5b4640 1 --2- 172.21.15.134:0/2617995573 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fb17583430 0x55fb1758aa90 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4024fd0 tx=0x7f3bf404c080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.328+0000 7f3ae0ff9640 1 -- 172.21.15.134:0/2617995573 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bf400dbb0 con 0x55fb17583430 2024-04-24T02:12:44.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.328+0000 7f3ae0ff9640 1 -- 172.21.15.134:0/2617995573 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bf400dd50 con 0x55fb17583430 2024-04-24T02:12:44.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.328+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fb1758afd0 con 0x55fb17583430 2024-04-24T02:12:44.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.328+0000 7f3ae0ff9640 1 -- 172.21.15.134:0/2617995573 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bf404d2d0 con 0x55fb17583430 2024-04-24T02:12:44.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.328+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb1758afd0 con 0x55fb17583430 2024-04-24T02:12:44.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.328+0000 7f3ae0ff9640 1 -- 172.21.15.134:0/2617995573 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3bf404d470 con 0x55fb17583430 2024-04-24T02:12:44.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.329+0000 7f3ae0ff9640 1 --2- 172.21.15.134:0/2617995573 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3ac8036900 0x7f3ac8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.329+0000 7f3ae0ff9640 1 -- 172.21.15.134:0/2617995573 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f3bf4045070 con 0x55fb17583430 2024-04-24T02:12:44.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.329+0000 7f3bff5b6640 1 --2- 172.21.15.134:0/2617995573 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3ac8036900 0x7f3ac8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.329+0000 7f3bff5b6640 1 --2- 172.21.15.134:0/2617995573 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3ac8036900 0x7f3ac8038dc0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x55fb17566140 tx=0x7f3bf801f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.329+0000 7f3c0312f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:44.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.329+0000 7f3c0312f800 1 --2- 172.21.15.134:0/2617995573 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55fb175961d0 0x55fb17598690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.329+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb17598de0 con 0x55fb175961d0 2024-04-24T02:12:44.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.329+0000 7f3bfedb5640 1 --2- 172.21.15.134:0/2617995573 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55fb175961d0 0x55fb17598690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.330+0000 7f3bfedb5640 1 --2- 172.21.15.134:0/2617995573 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55fb175961d0 0x55fb17598690 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.330+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.330+0000 7f3c0312f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:44.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.330+0000 7f3c0312f800 20 realm 2024-04-24T02:12:44.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.330+0000 7f3c0312f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:44.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.330+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175991f0 con 0x55fb175961d0 2024-04-24T02:12:44.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.330+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.330+0000 7f3c0312f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:44.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.330+0000 7f3c0312f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:44.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.330+0000 7f3c0312f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:44.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.330+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb17599ac0 con 0x55fb175961d0 2024-04-24T02:12:44.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.330+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.330+0000 7f3c0312f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:44.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.330+0000 7f3c0312f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:44.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.330+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb17599e60 con 0x55fb175961d0 2024-04-24T02:12:44.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.330+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.330+0000 7f3c0312f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:44.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.330+0000 7f3c0312f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:44.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.330+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb1759a6b0 con 0x55fb175961d0 2024-04-24T02:12:44.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.331+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.331+0000 7f3c0312f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:44.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.331+0000 7f3c0312f800 20 searching for the correct realm 2024-04-24T02:12:44.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.331+0000 7f3c0312f800 1 --2- 172.21.15.134:0/2617995573 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55fb1759c420 0x55fb1759e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.331+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fb1759edf0 con 0x55fb1759c420 2024-04-24T02:12:44.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.331+0000 7f3bfe5b4640 1 --2- 172.21.15.134:0/2617995573 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55fb1759c420 0x55fb1759e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.331+0000 7f3bfe5b4640 1 --2- 172.21.15.134:0/2617995573 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55fb1759c420 0x55fb1759e810 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.331+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf4024030 con 0x55fb1759c420 2024-04-24T02:12:44.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.332+0000 7f3bfe5b4640 1 --2- 172.21.15.134:0/2617995573 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f3bf401ac20 0x7f3bf401c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.332+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fb1759edf0 con 0x7f3bf401ac20 2024-04-24T02:12:44.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.332+0000 7f3bff5b6640 1 --2- 172.21.15.134:0/2617995573 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f3bf401ac20 0x7f3bf401c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.332+0000 7f3bff5b6640 1 --2- 172.21.15.134:0/2617995573 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f3bf401ac20 0x7f3bf401c420 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.332+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.332+0000 7f3bff5b6640 1 --2- 172.21.15.134:0/2617995573 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f3bf8031040 0x7f3bf8032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.332+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fb1759edf0 con 0x7f3bf8031040 2024-04-24T02:12:44.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.332+0000 7f3bfedb5640 1 --2- 172.21.15.134:0/2617995573 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f3bf8031040 0x7f3bf8032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.333+0000 7f3bfedb5640 1 --2- 172.21.15.134:0/2617995573 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f3bf8031040 0x7f3bf8032940 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.333+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.333+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fb1759edf0 con 0x55fb175961d0 2024-04-24T02:12:44.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.333+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.333+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fb1759edf0 con 0x55fb175961d0 2024-04-24T02:12:44.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.333+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.333+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fb1759edf0 con 0x7f3bf8031040 2024-04-24T02:12:44.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.334+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.334+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fb1759edf0 con 0x7f3bf8031040 2024-04-24T02:12:44.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.334+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.334+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fb1759edf0 con 0x7f3bf401ac20 2024-04-24T02:12:44.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.334+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.334+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fb1759edf0 con 0x55fb1759c420 2024-04-24T02:12:44.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.334+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.334+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fb1759edf0 con 0x55fb175961d0 2024-04-24T02:12:44.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.335+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.335+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fb1759edf0 con 0x7f3bf8031040 2024-04-24T02:12:44.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.335+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.335+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fb1759edf0 con 0x55fb175961d0 2024-04-24T02:12:44.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.335+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.335+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fb1759edf0 con 0x7f3bf401ac20 2024-04-24T02:12:44.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.335+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.335+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fb1759edf0 con 0x55fb1759c420 2024-04-24T02:12:44.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.336+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.336+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fb1759edf0 con 0x55fb1759c420 2024-04-24T02:12:44.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.336+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.336+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fb1759edf0 con 0x7f3bf8031040 2024-04-24T02:12:44.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.336+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.336+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fb1759edf0 con 0x55fb1759c420 2024-04-24T02:12:44.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.336+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.336+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fb1759edf0 con 0x55fb1759c420 2024-04-24T02:12:44.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.337+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.337+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fb1759edf0 con 0x55fb175961d0 2024-04-24T02:12:44.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.337+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.337+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fb1759edf0 con 0x55fb175961d0 2024-04-24T02:12:44.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.337+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.337+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fb1759edf0 con 0x7f3bf8031040 2024-04-24T02:12:44.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.337+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.337+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fb1759edf0 con 0x55fb1759c420 2024-04-24T02:12:44.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.338+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.338+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fb1759edf0 con 0x7f3bf401ac20 2024-04-24T02:12:44.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.338+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.338+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fb1759edf0 con 0x55fb175961d0 2024-04-24T02:12:44.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.338+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.338+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fb1759edf0 con 0x7f3bf8031040 2024-04-24T02:12:44.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.338+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.338+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fb1759edf0 con 0x55fb1759c420 2024-04-24T02:12:44.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.339+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.339+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fb1759edf0 con 0x7f3bf8031040 2024-04-24T02:12:44.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.339+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.339+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fb1759edf0 con 0x7f3bf401ac20 2024-04-24T02:12:44.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.339+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.339+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fb1759edf0 con 0x55fb1759c420 2024-04-24T02:12:44.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.339+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.339+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fb1759edf0 con 0x7f3bf8031040 2024-04-24T02:12:44.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.340+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.340+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fb1759edf0 con 0x55fb175961d0 2024-04-24T02:12:44.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.340+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.340+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fb1759edf0 con 0x7f3bf401ac20 2024-04-24T02:12:44.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.340+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.340+0000 7f3c0312f800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:44.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.340+0000 7f3c0312f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:44.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.340+0000 7f3c0312f800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:44.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.340+0000 7f3c0312f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:44.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.340+0000 7f3c0312f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:44.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.340+0000 7f3c0312f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:44.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.340+0000 7f3c0312f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:44.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.340+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb1759b030 con 0x55fb175961d0 2024-04-24T02:12:44.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.340+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.340+0000 7f3c0312f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:44.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.340+0000 7f3c0312f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:44.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.340+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb1759b8d0 con 0x55fb175961d0 2024-04-24T02:12:44.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.341+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.341+0000 7f3c0312f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:44.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.341+0000 7f3c0312f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:44.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.341+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb1759f270 con 0x55fb175961d0 2024-04-24T02:12:44.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.341+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.341+0000 7f3c0312f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:44.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.341+0000 7f3c0312f800 20 zone default found 2024-04-24T02:12:44.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.341+0000 7f3c0312f800 4 Realm: () 2024-04-24T02:12:44.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.341+0000 7f3c0312f800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:44.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.341+0000 7f3c0312f800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:44.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.341+0000 7f3c0312f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:44.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.341+0000 7f3c0312f800 20 zonegroup default 2024-04-24T02:12:44.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.341+0000 7f3c0312f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:44.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.341+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb1759b530 con 0x7f3bf8031040 2024-04-24T02:12:44.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.341+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.341+0000 7f3c0312f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:44.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.341+0000 7f3c0312f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:44.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.341+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175a1180 con 0x55fb1759c420 2024-04-24T02:12:44.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.342+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.342+0000 7f3c0312f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:44.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.342+0000 7f3c0312f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:44.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.342+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175a1520 con 0x55fb1759c420 2024-04-24T02:12:44.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.342+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.342+0000 7f3c0312f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:44.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.342+0000 7f3c0312f800 20 started sync module instance, tier type = 2024-04-24T02:12:44.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.342+0000 7f3c0312f800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:44.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.342+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175a0620 con 0x7f3bf401ac20 2024-04-24T02:12:44.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.343+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.343+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94536916929040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175a1e00 con 0x7f3bf401ac20 2024-04-24T02:12:44.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.343+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175a2650 con 0x55fb175961d0 2024-04-24T02:12:44.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.344+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.344+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94536916934144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175a2890 con 0x55fb175961d0 2024-04-24T02:12:44.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.344+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175a33b0 con 0x55fb1759c420 2024-04-24T02:12:44.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.344+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94536916929040] v30'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.345+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.345+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94536916938368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175a37a0 con 0x55fb1759c420 2024-04-24T02:12:44.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.345+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175a41c0 con 0x7f3bf401ac20 2024-04-24T02:12:44.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.345+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94536916934144] v30'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.346+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.346+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94536916942000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175a45b0 con 0x7f3bf401ac20 2024-04-24T02:12:44.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.346+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94536916938368] v30'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.346+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175a4ff0 con 0x55fb175961d0 2024-04-24T02:12:44.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.347+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94536916942000] v30'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.347+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.347+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94536916933024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175a22e0 con 0x55fb175961d0 2024-04-24T02:12:44.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.347+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175a55d0 con 0x7f3bf8031040 2024-04-24T02:12:44.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.349+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.349+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94536916933024] v30'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.349+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94536916947232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175a59f0 con 0x7f3bf8031040 2024-04-24T02:12:44.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.349+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175a5f00 con 0x7f3bf8031040 2024-04-24T02:12:44.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.350+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94536916947232] v30'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.350+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(56 notify.6 [create] v30'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.350+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94536916948288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175a5960 con 0x7f3bf8031040 2024-04-24T02:12:44.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.350+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175a6860 con 0x7f3bf8031040 2024-04-24T02:12:44.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.351+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(58 notify.7 [create] v30'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.351+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94536916951984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175a6cc0 con 0x7f3bf8031040 2024-04-24T02:12:44.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.351+0000 7f3c0312f800 20 add_watcher() i=0 2024-04-24T02:12:44.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.351+0000 7f3c0312f800 20 add_watcher() i=1 2024-04-24T02:12:44.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.351+0000 7f3c0312f800 20 add_watcher() i=2 2024-04-24T02:12:44.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.351+0000 7f3c0312f800 20 add_watcher() i=3 2024-04-24T02:12:44.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.351+0000 7f3c0312f800 20 add_watcher() i=4 2024-04-24T02:12:44.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.351+0000 7f3c0312f800 20 add_watcher() i=5 2024-04-24T02:12:44.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.351+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94536916948288] v30'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.351+0000 7f3c0312f800 20 add_watcher() i=6 2024-04-24T02:12:44.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.351+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94536916951984] v30'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.352+0000 7f3c0312f800 20 add_watcher() i=7 2024-04-24T02:12:44.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.352+0000 7f3c0312f800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:44.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.352+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175a5f00 con 0x55fb175961d0 2024-04-24T02:12:44.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.352+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.352+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94536916950784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175a71d0 con 0x55fb175961d0 2024-04-24T02:12:44.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.353+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94536916950784] v30'164 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.353+0000 7f3ab57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:44.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.353+0000 7f3c0312f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:44.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.353+0000 7f3c0312f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:44.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.353+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175b26a0 con 0x55fb175961d0 2024-04-24T02:12:44.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.354+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'49 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.354+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175b2d70 con 0x7f3bf8031040 2024-04-24T02:12:44.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.355+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.355+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175b2d70 con 0x55fb1759c420 2024-04-24T02:12:44.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.356+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.356+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175b3170 con 0x55fb175961d0 2024-04-24T02:12:44.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.357+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'165 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.357+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175b35c0 con 0x7f3bf401ac20 2024-04-24T02:12:44.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.358+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'54 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.358+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175b0450 con 0x55fb1759c420 2024-04-24T02:12:44.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.359+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'45 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.359+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175b4120 con 0x55fb175961d0 2024-04-24T02:12:44.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.360+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.360+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175b4120 con 0x7f3bf8031040 2024-04-24T02:12:44.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.361+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'38 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.361+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175b4120 con 0x7f3bf401ac20 2024-04-24T02:12:44.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.362+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.363+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175b45d0 con 0x55fb1759c420 2024-04-24T02:12:44.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.363+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.364+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175b4970 con 0x7f3bf401ac20 2024-04-24T02:12:44.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.364+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'55 uv50 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.364+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175b4e20 con 0x7f3bf8031040 2024-04-24T02:12:44.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.366+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.366+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175b4e20 con 0x7f3bf401ac20 2024-04-24T02:12:44.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.367+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'25 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.367+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175af520 con 0x7f3bf8031040 2024-04-24T02:12:44.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.368+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'49 uv16 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.368+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175af520 con 0x55fb175961d0 2024-04-24T02:12:44.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.369+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'166 uv16 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.369+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175aedc0 con 0x55fb1759c420 2024-04-24T02:12:44.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.370+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'47 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.370+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175af520 con 0x7f3bf401ac20 2024-04-24T02:12:44.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.371+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'56 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.371+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175aedc0 con 0x55fb1759c420 2024-04-24T02:12:44.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.372+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'31 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.372+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175aedc0 con 0x55fb175961d0 2024-04-24T02:12:44.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.373+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.373+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175aedc0 con 0x55fb175961d0 2024-04-24T02:12:44.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.374+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'167 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.374+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175af520 con 0x55fb1759c420 2024-04-24T02:12:44.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.375+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'48 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.375+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175af520 con 0x7f3bf401ac20 2024-04-24T02:12:44.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.376+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'35 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.376+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175af520 con 0x55fb1759c420 2024-04-24T02:12:44.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.377+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.377+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175af520 con 0x55fb1759c420 2024-04-24T02:12:44.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.378+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'37 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.378+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175af520 con 0x55fb1759c420 2024-04-24T02:12:44.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.379+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.379+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175af520 con 0x55fb1759c420 2024-04-24T02:12:44.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.380+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'46 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.380+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175aedc0 con 0x7f3bf8031040 2024-04-24T02:12:44.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.381+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'27 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.381+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175aedc0 con 0x55fb1759c420 2024-04-24T02:12:44.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.382+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'31 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.382+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175aedc0 con 0x7f3bf8031040 2024-04-24T02:12:44.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.383+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'39 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.383+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175aedc0 con 0x55fb1759c420 2024-04-24T02:12:44.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.384+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'49 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.384+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175aedc0 con 0x7f3bf8031040 2024-04-24T02:12:44.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.386+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'50 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.386+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175aedc0 con 0x7f3bf401ac20 2024-04-24T02:12:44.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.387+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.387+0000 7f3a2ffff640 20 reqs_thread_entry: start 2024-04-24T02:12:44.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.387+0000 7f3c0312f800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:44.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.387+0000 7f3c0312f800 20 Filter name: none 2024-04-24T02:12:44.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.387+0000 7f3a2dffb640 20 reqs_thread_entry: start 2024-04-24T02:12:44.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.387+0000 7f3c0312f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-04-24T02:12:44.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.387+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:94 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e10e0 con 0x55fb1759c420 2024-04-24T02:12:44.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.388+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 26 ==== osd_op_reply(94 gc.2 [call] v30'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.388+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:95 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e10a0 con 0x55fb1759c420 2024-04-24T02:12:44.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.388+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 27 ==== osd_op_reply(95 gc.2 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.388+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.388+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:96 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e1030 con 0x55fb1759c420 2024-04-24T02:12:44.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.389+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 28 ==== osd_op_reply(96 gc.2 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.389+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:97 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e1010 con 0x55fb1759c420 2024-04-24T02:12:44.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.389+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 29 ==== osd_op_reply(97 gc.2 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.389+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:12:44.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.389+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:98 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e1010 con 0x55fb1759c420 2024-04-24T02:12:44.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.389+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 30 ==== osd_op_reply(98 gc.2 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.389+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.389+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:99 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e1010 con 0x55fb1759c420 2024-04-24T02:12:44.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.390+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 31 ==== osd_op_reply(99 gc.2 [call] v30'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.390+0000 7f3c0312f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-04-24T02:12:44.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.390+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:100 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e1010 con 0x55fb175961d0 2024-04-24T02:12:44.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.391+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(100 gc.3 [call] v30'168 uv168 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.391+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:101 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e1010 con 0x55fb175961d0 2024-04-24T02:12:44.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.391+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 30 ==== osd_op_reply(101 gc.3 [call out=15b] v0'0 uv168 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.391+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.391+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:102 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e0000 con 0x55fb175961d0 2024-04-24T02:12:44.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.391+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 31 ==== osd_op_reply(102 gc.3 [call out=24b] v0'0 uv168 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.391+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e1010 con 0x55fb175961d0 2024-04-24T02:12:44.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.392+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 32 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv168 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.392+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:12:44.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.392+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e1010 con 0x55fb175961d0 2024-04-24T02:12:44.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.392+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 33 ==== osd_op_reply(104 gc.3 [call out=15b] v0'0 uv168 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.392+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.392+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e1010 con 0x55fb175961d0 2024-04-24T02:12:44.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.393+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 34 ==== osd_op_reply(105 gc.3 [call] v30'169 uv169 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.393+0000 7f3c0312f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-04-24T02:12:44.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.393+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e1010 con 0x7f3bf401ac20 2024-04-24T02:12:44.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.394+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 18 ==== osd_op_reply(106 gc.4 [call] v30'57 uv57 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.394+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e1010 con 0x7f3bf401ac20 2024-04-24T02:12:44.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.394+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 19 ==== osd_op_reply(107 gc.4 [call out=15b] v0'0 uv57 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.394+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.394+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e0000 con 0x7f3bf401ac20 2024-04-24T02:12:44.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.394+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 20 ==== osd_op_reply(108 gc.4 [call out=24b] v0'0 uv57 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.394+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:109 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e1010 con 0x7f3bf401ac20 2024-04-24T02:12:44.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.394+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 21 ==== osd_op_reply(109 gc.4 [call out=15b] v0'0 uv57 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.394+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:12:44.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.394+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:110 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e1010 con 0x7f3bf401ac20 2024-04-24T02:12:44.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.395+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 22 ==== osd_op_reply(110 gc.4 [call out=15b] v0'0 uv57 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.395+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.395+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:111 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e1010 con 0x7f3bf401ac20 2024-04-24T02:12:44.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.395+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 23 ==== osd_op_reply(111 gc.4 [call] v30'58 uv58 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.395+0000 7f3c0312f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-04-24T02:12:44.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.395+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:112 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e1010 con 0x55fb1759c420 2024-04-24T02:12:44.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.396+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 32 ==== osd_op_reply(112 gc.5 [call] v30'47 uv47 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.396+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:113 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e1010 con 0x55fb1759c420 2024-04-24T02:12:44.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.397+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 33 ==== osd_op_reply(113 gc.5 [call out=15b] v0'0 uv47 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.397+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.397+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:114 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e0000 con 0x55fb1759c420 2024-04-24T02:12:44.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.397+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 34 ==== osd_op_reply(114 gc.5 [call out=24b] v0'0 uv47 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.397+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:115 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e1010 con 0x55fb1759c420 2024-04-24T02:12:44.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.397+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 35 ==== osd_op_reply(115 gc.5 [call out=15b] v0'0 uv47 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.397+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:12:44.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.397+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:116 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e1010 con 0x55fb1759c420 2024-04-24T02:12:44.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.397+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 36 ==== osd_op_reply(116 gc.5 [call out=15b] v0'0 uv47 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.397+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.397+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:117 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e1010 con 0x55fb1759c420 2024-04-24T02:12:44.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.398+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 37 ==== osd_op_reply(117 gc.5 [call] v30'48 uv48 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.398+0000 7f3c0312f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-04-24T02:12:44.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.398+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:118 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e1010 con 0x55fb175961d0 2024-04-24T02:12:44.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.400+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 35 ==== osd_op_reply(118 gc.6 [call] v30'28 uv28 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.400+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:119 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e1010 con 0x55fb175961d0 2024-04-24T02:12:44.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.400+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 36 ==== osd_op_reply(119 gc.6 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.400+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.400+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:120 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e0000 con 0x55fb175961d0 2024-04-24T02:12:44.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.400+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 37 ==== osd_op_reply(120 gc.6 [call out=24b] v0'0 uv28 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.400+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:121 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e0000 con 0x55fb175961d0 2024-04-24T02:12:44.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.400+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 38 ==== osd_op_reply(121 gc.6 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.400+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:12:44.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.400+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:122 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e0000 con 0x55fb175961d0 2024-04-24T02:12:44.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.401+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 39 ==== osd_op_reply(122 gc.6 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.401+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.401+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:123 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e1010 con 0x55fb175961d0 2024-04-24T02:12:44.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.402+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 40 ==== osd_op_reply(123 gc.6 [call] v30'29 uv29 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.402+0000 7f3c0312f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-04-24T02:12:44.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.402+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:124 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e1010 con 0x7f3bf8031040 2024-04-24T02:12:44.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.403+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 24 ==== osd_op_reply(124 gc.7 [call] v30'40 uv40 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.403+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:125 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e1010 con 0x7f3bf8031040 2024-04-24T02:12:44.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.403+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 25 ==== osd_op_reply(125 gc.7 [call out=15b] v0'0 uv40 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.403+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.403+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:126 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e0000 con 0x7f3bf8031040 2024-04-24T02:12:44.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.403+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 26 ==== osd_op_reply(126 gc.7 [call out=24b] v0'0 uv40 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.403+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:127 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e1010 con 0x7f3bf8031040 2024-04-24T02:12:44.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.404+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 27 ==== osd_op_reply(127 gc.7 [call out=15b] v0'0 uv40 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.404+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:12:44.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.404+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:128 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e1010 con 0x7f3bf8031040 2024-04-24T02:12:44.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.404+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 28 ==== osd_op_reply(128 gc.7 [call out=15b] v0'0 uv40 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.404+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.404+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:129 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e1010 con 0x7f3bf8031040 2024-04-24T02:12:44.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.405+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 29 ==== osd_op_reply(129 gc.7 [call] v30'41 uv41 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.405+0000 7f3c0312f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-04-24T02:12:44.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.405+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:130 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e1010 con 0x7f3bf401ac20 2024-04-24T02:12:44.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.406+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 24 ==== osd_op_reply(130 gc.8 [call] v30'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.406+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:131 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e1010 con 0x7f3bf401ac20 2024-04-24T02:12:44.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.406+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 25 ==== osd_op_reply(131 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.406+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.406+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:132 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e0000 con 0x7f3bf401ac20 2024-04-24T02:12:44.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.406+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 26 ==== osd_op_reply(132 gc.8 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.406+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:133 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e1010 con 0x7f3bf401ac20 2024-04-24T02:12:44.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.406+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 27 ==== osd_op_reply(133 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.406+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:12:44.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.406+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:134 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e1010 con 0x7f3bf401ac20 2024-04-24T02:12:44.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.407+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 28 ==== osd_op_reply(134 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.407+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.407+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:135 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e1010 con 0x7f3bf401ac20 2024-04-24T02:12:44.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.408+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 29 ==== osd_op_reply(135 gc.8 [call] v30'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.408+0000 7f3c0312f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-04-24T02:12:44.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.408+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:136 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e1010 con 0x55fb1759c420 2024-04-24T02:12:44.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.409+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 38 ==== osd_op_reply(136 gc.9 [call] v30'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.409+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:137 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e1010 con 0x55fb1759c420 2024-04-24T02:12:44.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.409+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 39 ==== osd_op_reply(137 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.409+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.409+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:138 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e0000 con 0x55fb1759c420 2024-04-24T02:12:44.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.409+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 40 ==== osd_op_reply(138 gc.9 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.409+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:139 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e1010 con 0x55fb1759c420 2024-04-24T02:12:44.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.409+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 41 ==== osd_op_reply(139 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.409+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:12:44.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.409+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:140 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e1010 con 0x55fb1759c420 2024-04-24T02:12:44.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.410+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 42 ==== osd_op_reply(140 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.410+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.410+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:141 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e1010 con 0x55fb1759c420 2024-04-24T02:12:44.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.411+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 43 ==== osd_op_reply(141 gc.9 [call] v30'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.411+0000 7f3c0312f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-04-24T02:12:44.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.411+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:142 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e1010 con 0x7f3bf401ac20 2024-04-24T02:12:44.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.412+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 30 ==== osd_op_reply(142 gc.10 [call] v30'59 uv59 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.412+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:143 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e1010 con 0x7f3bf401ac20 2024-04-24T02:12:44.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.412+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 31 ==== osd_op_reply(143 gc.10 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.412+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.412+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:144 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e0000 con 0x7f3bf401ac20 2024-04-24T02:12:44.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.412+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 32 ==== osd_op_reply(144 gc.10 [call out=24b] v0'0 uv59 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.412+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:145 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e1010 con 0x7f3bf401ac20 2024-04-24T02:12:44.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.412+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 33 ==== osd_op_reply(145 gc.10 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.412+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:12:44.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.412+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:146 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e1010 con 0x7f3bf401ac20 2024-04-24T02:12:44.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.412+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 34 ==== osd_op_reply(146 gc.10 [call out=1702b] v0'0 uv59 ondisk = 0) ==== 149+0+1702 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.412+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-04-24T02:12:44.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.412+0000 7f3c0312f800 20 garbage collection: RGWGC::process iterating over entry tag='582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.15912855557186293686', time=2024-04-24T02:12:44.061072+0000, chain.objs.size()=7 2024-04-24T02:12:44.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.412+0000 7f3c0312f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1__shadow_.zZth32eWOoC-HujgL0pPG5mhvP6_0qF_1 2024-04-24T02:12:44.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.412+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:147 3.1e 3:7a6947af:::582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1__shadow_.zZth32eWOoC-HujgL0pPG5mhvP6_0qF_1:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175df190 con 0x7f3bf8031040 2024-04-24T02:12:44.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.413+0000 7f3c0312f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1__shadow_.zZth32eWOoC-HujgL0pPG5mhvP6_0qF_2 2024-04-24T02:12:44.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.413+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:148 3.13 3:c9681302:::582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1__shadow_.zZth32eWOoC-HujgL0pPG5mhvP6_0qF_2:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175df6f0 con 0x55fb1759c420 2024-04-24T02:12:44.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.413+0000 7f3c0312f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1__shadow_.zZth32eWOoC-HujgL0pPG5mhvP6_0qF_3 2024-04-24T02:12:44.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.413+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:149 3.6 3:603245d3:::582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1__shadow_.zZth32eWOoC-HujgL0pPG5mhvP6_0qF_3:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e7060 con 0x55fb175961d0 2024-04-24T02:12:44.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.413+0000 7f3c0312f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1__shadow_.zZth32eWOoC-HujgL0pPG5mhvP6_0qF_4 2024-04-24T02:12:44.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.413+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:150 3.26 3:64681fec:::582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1__shadow_.zZth32eWOoC-HujgL0pPG5mhvP6_0qF_4:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175df6f0 con 0x7f3bf401ac20 2024-04-24T02:12:44.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.413+0000 7f3c0312f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1__shadow_.zZth32eWOoC-HujgL0pPG5mhvP6_0qF_5 2024-04-24T02:12:44.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.413+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:151 3.23 3:c59a42ad:::582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1__shadow_.zZth32eWOoC-HujgL0pPG5mhvP6_0qF_5:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175ebe90 con 0x7f3bf8031040 2024-04-24T02:12:44.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.413+0000 7f3c0312f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1__shadow_.zZth32eWOoC-HujgL0pPG5mhvP6_0qF_6 2024-04-24T02:12:44.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.413+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:152 3.11 3:8b50d11f:::582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1__shadow_.zZth32eWOoC-HujgL0pPG5mhvP6_0qF_6:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175ebe90 con 0x55fb1759c420 2024-04-24T02:12:44.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.413+0000 7f3c0312f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1__shadow_.zZth32eWOoC-HujgL0pPG5mhvP6_0qF_7 2024-04-24T02:12:44.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.413+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:153 3.1 3:80f7e875:::582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1__shadow_.zZth32eWOoC-HujgL0pPG5mhvP6_0qF_7:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175f0bd0 con 0x7f3bf8031040 2024-04-24T02:12:44.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.415+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 30 ==== osd_op_reply(153 582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1__shadow_.zZth32eWOoC-HujgL0pPG5mhvP6_0qF_7 [call] v30'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.416+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 44 ==== osd_op_reply(152 582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1__shadow_.zZth32eWOoC-HujgL0pPG5mhvP6_0qF_6 [call] v30'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.416+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 45 ==== osd_op_reply(148 582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1__shadow_.zZth32eWOoC-HujgL0pPG5mhvP6_0qF_2 [call] v30'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.417+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 35 ==== osd_op_reply(150 582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1__shadow_.zZth32eWOoC-HujgL0pPG5mhvP6_0qF_4 [call] v30'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.417+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 41 ==== osd_op_reply(149 582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1__shadow_.zZth32eWOoC-HujgL0pPG5mhvP6_0qF_3 [call] v30'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.417+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 31 ==== osd_op_reply(151 582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1__shadow_.zZth32eWOoC-HujgL0pPG5mhvP6_0qF_5 [call] v30'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.417+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 32 ==== osd_op_reply(147 582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.1__shadow_.zZth32eWOoC-HujgL0pPG5mhvP6_0qF_1 [call] v30'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.417+0000 7f3c0312f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-24T02:12:44.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.417+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:154 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e6af0 con 0x7f3bf401ac20 2024-04-24T02:12:44.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.418+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 36 ==== osd_op_reply(154 gc.10 [call] v30'60 uv60 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.418+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:155 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e6af0 con 0x7f3bf401ac20 2024-04-24T02:12:44.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.419+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 37 ==== osd_op_reply(155 gc.10 [call] v30'61 uv61 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.419+0000 7f3c0312f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-04-24T02:12:44.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.419+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:156 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e6af0 con 0x7f3bf8031040 2024-04-24T02:12:44.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.420+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 33 ==== osd_op_reply(156 gc.11 [call] v30'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.420+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:157 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e6af0 con 0x7f3bf8031040 2024-04-24T02:12:44.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.421+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 34 ==== osd_op_reply(157 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.421+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.421+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:158 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e6af0 con 0x7f3bf8031040 2024-04-24T02:12:44.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.421+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 35 ==== osd_op_reply(158 gc.11 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.421+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:159 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e6af0 con 0x7f3bf8031040 2024-04-24T02:12:44.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.421+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 36 ==== osd_op_reply(159 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.421+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:12:44.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.421+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:160 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e6af0 con 0x7f3bf8031040 2024-04-24T02:12:44.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.422+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 37 ==== osd_op_reply(160 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.422+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.422+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:161 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e6af0 con 0x7f3bf8031040 2024-04-24T02:12:44.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.423+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 38 ==== osd_op_reply(161 gc.11 [call] v30'24 uv24 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.423+0000 7f3c0312f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-04-24T02:12:44.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.423+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:162 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e6af0 con 0x7f3bf401ac20 2024-04-24T02:12:44.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.424+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 38 ==== osd_op_reply(162 gc.12 [call] v30'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.424+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:163 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e6af0 con 0x7f3bf401ac20 2024-04-24T02:12:44.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.424+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 39 ==== osd_op_reply(163 gc.12 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.424+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.424+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:164 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e6af0 con 0x7f3bf401ac20 2024-04-24T02:12:44.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.424+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 40 ==== osd_op_reply(164 gc.12 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.424+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:165 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e6af0 con 0x7f3bf401ac20 2024-04-24T02:12:44.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.424+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 41 ==== osd_op_reply(165 gc.12 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.425+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:12:44.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.425+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:166 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e6af0 con 0x7f3bf401ac20 2024-04-24T02:12:44.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.425+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 42 ==== osd_op_reply(166 gc.12 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.425+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.425+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:167 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e6af0 con 0x7f3bf401ac20 2024-04-24T02:12:44.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.426+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 43 ==== osd_op_reply(167 gc.12 [call] v30'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.426+0000 7f3c0312f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-04-24T02:12:44.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.426+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:168 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e6af0 con 0x7f3bf8031040 2024-04-24T02:12:44.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.427+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 39 ==== osd_op_reply(168 gc.13 [call] v30'51 uv51 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.427+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:169 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e6af0 con 0x7f3bf8031040 2024-04-24T02:12:44.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.427+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 40 ==== osd_op_reply(169 gc.13 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.427+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.427+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:170 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e6af0 con 0x7f3bf8031040 2024-04-24T02:12:44.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.427+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 41 ==== osd_op_reply(170 gc.13 [call out=24b] v0'0 uv51 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.427+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:171 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e6af0 con 0x7f3bf8031040 2024-04-24T02:12:44.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.428+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 42 ==== osd_op_reply(171 gc.13 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.428+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:12:44.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.428+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:172 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e6af0 con 0x7f3bf8031040 2024-04-24T02:12:44.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.428+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 43 ==== osd_op_reply(172 gc.13 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.428+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.428+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:173 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e6af0 con 0x7f3bf8031040 2024-04-24T02:12:44.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.429+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 44 ==== osd_op_reply(173 gc.13 [call] v30'52 uv52 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.429+0000 7f3c0312f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-04-24T02:12:44.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.429+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:174 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e6af0 con 0x55fb175961d0 2024-04-24T02:12:44.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.430+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 42 ==== osd_op_reply(174 gc.14 [call] v30'170 uv170 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.430+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:175 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb175961d0 2024-04-24T02:12:44.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.430+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 43 ==== osd_op_reply(175 gc.14 [call out=15b] v0'0 uv170 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.430+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.430+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:176 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e73e0 con 0x55fb175961d0 2024-04-24T02:12:44.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.430+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 44 ==== osd_op_reply(176 gc.14 [call out=24b] v0'0 uv170 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.430+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:177 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb175961d0 2024-04-24T02:12:44.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.431+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 45 ==== osd_op_reply(177 gc.14 [call out=15b] v0'0 uv170 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.431+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:12:44.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.431+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:178 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb175961d0 2024-04-24T02:12:44.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.431+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 46 ==== osd_op_reply(178 gc.14 [call out=15b] v0'0 uv170 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.431+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.431+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:179 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb175961d0 2024-04-24T02:12:44.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.432+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 47 ==== osd_op_reply(179 gc.14 [call] v30'171 uv171 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.432+0000 7f3c0312f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-04-24T02:12:44.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.432+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:180 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb1759c420 2024-04-24T02:12:44.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.433+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 46 ==== osd_op_reply(180 gc.15 [call] v30'50 uv50 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.433+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:181 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb1759c420 2024-04-24T02:12:44.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.433+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 47 ==== osd_op_reply(181 gc.15 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.433+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.433+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:182 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e73e0 con 0x55fb1759c420 2024-04-24T02:12:44.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.434+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 48 ==== osd_op_reply(182 gc.15 [call out=24b] v0'0 uv50 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.434+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:183 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e73e0 con 0x55fb1759c420 2024-04-24T02:12:44.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.434+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 49 ==== osd_op_reply(183 gc.15 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.434+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:12:44.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.434+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:184 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e73e0 con 0x55fb1759c420 2024-04-24T02:12:44.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.434+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 50 ==== osd_op_reply(184 gc.15 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.434+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.434+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:185 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb1759c420 2024-04-24T02:12:44.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.435+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 51 ==== osd_op_reply(185 gc.15 [call] v30'51 uv51 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.435+0000 7f3c0312f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-04-24T02:12:44.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.435+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:186 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x7f3bf401ac20 2024-04-24T02:12:44.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.436+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 44 ==== osd_op_reply(186 gc.16 [call] v30'62 uv62 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.436+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:187 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x7f3bf401ac20 2024-04-24T02:12:44.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.436+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 45 ==== osd_op_reply(187 gc.16 [call out=15b] v0'0 uv62 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.436+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.436+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:188 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e73e0 con 0x7f3bf401ac20 2024-04-24T02:12:44.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.436+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 46 ==== osd_op_reply(188 gc.16 [call out=24b] v0'0 uv62 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.436+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:189 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x7f3bf401ac20 2024-04-24T02:12:44.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.437+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 47 ==== osd_op_reply(189 gc.16 [call out=15b] v0'0 uv62 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.437+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:12:44.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.437+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:190 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x7f3bf401ac20 2024-04-24T02:12:44.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.437+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 48 ==== osd_op_reply(190 gc.16 [call out=15b] v0'0 uv62 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.437+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.437+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:191 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x7f3bf401ac20 2024-04-24T02:12:44.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.438+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 49 ==== osd_op_reply(191 gc.16 [call] v30'63 uv63 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.438+0000 7f3c0312f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-04-24T02:12:44.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.438+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:192 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb1759c420 2024-04-24T02:12:44.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.439+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 52 ==== osd_op_reply(192 gc.17 [call] v30'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.439+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:193 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb1759c420 2024-04-24T02:12:44.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.439+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 53 ==== osd_op_reply(193 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.439+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.439+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:194 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e73e0 con 0x55fb1759c420 2024-04-24T02:12:44.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.439+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 54 ==== osd_op_reply(194 gc.17 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.439+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:195 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb1759c420 2024-04-24T02:12:44.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.439+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 55 ==== osd_op_reply(195 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.439+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:12:44.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.439+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:196 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb1759c420 2024-04-24T02:12:44.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.440+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 56 ==== osd_op_reply(196 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.440+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.440+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:197 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb1759c420 2024-04-24T02:12:44.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.441+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 57 ==== osd_op_reply(197 gc.17 [call] v30'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.441+0000 7f3c0312f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-04-24T02:12:44.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.441+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:198 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb175961d0 2024-04-24T02:12:44.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.442+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 48 ==== osd_op_reply(198 gc.18 [call] v30'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.442+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:199 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb175961d0 2024-04-24T02:12:44.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.442+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 49 ==== osd_op_reply(199 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.442+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.442+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:200 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e73e0 con 0x55fb175961d0 2024-04-24T02:12:44.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.442+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 50 ==== osd_op_reply(200 gc.18 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.442+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:201 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb175961d0 2024-04-24T02:12:44.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.442+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 51 ==== osd_op_reply(201 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.442+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:12:44.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.442+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:202 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb175961d0 2024-04-24T02:12:44.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.443+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 52 ==== osd_op_reply(202 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.443+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.443+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:203 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb175961d0 2024-04-24T02:12:44.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.444+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 53 ==== osd_op_reply(203 gc.18 [call] v30'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.444+0000 7f3c0312f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-04-24T02:12:44.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.444+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:204 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb175961d0 2024-04-24T02:12:44.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.445+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 54 ==== osd_op_reply(204 gc.19 [call] v30'172 uv172 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.445+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:205 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb175961d0 2024-04-24T02:12:44.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.445+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 55 ==== osd_op_reply(205 gc.19 [call out=15b] v0'0 uv172 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.445+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.445+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:206 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e73e0 con 0x55fb175961d0 2024-04-24T02:12:44.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.445+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 56 ==== osd_op_reply(206 gc.19 [call out=24b] v0'0 uv172 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.445+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:207 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb175961d0 2024-04-24T02:12:44.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.445+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 57 ==== osd_op_reply(207 gc.19 [call out=15b] v0'0 uv172 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.445+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:12:44.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.445+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:208 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb175961d0 2024-04-24T02:12:44.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.445+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 58 ==== osd_op_reply(208 gc.19 [call out=15b] v0'0 uv172 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.445+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.445+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:209 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb175961d0 2024-04-24T02:12:44.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.446+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 59 ==== osd_op_reply(209 gc.19 [call] v30'173 uv173 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.446+0000 7f3c0312f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-04-24T02:12:44.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.446+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:210 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb1759c420 2024-04-24T02:12:44.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.447+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 58 ==== osd_op_reply(210 gc.20 [call] v30'52 uv52 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.447+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:211 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb1759c420 2024-04-24T02:12:44.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.448+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 59 ==== osd_op_reply(211 gc.20 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.448+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.448+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:212 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e73e0 con 0x55fb1759c420 2024-04-24T02:12:44.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.448+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 60 ==== osd_op_reply(212 gc.20 [call out=24b] v0'0 uv52 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.448+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:213 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e73e0 con 0x55fb1759c420 2024-04-24T02:12:44.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.448+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 61 ==== osd_op_reply(213 gc.20 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.448+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:12:44.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.448+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:214 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e73e0 con 0x55fb1759c420 2024-04-24T02:12:44.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.448+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 62 ==== osd_op_reply(214 gc.20 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.448+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.448+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:215 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e73e0 con 0x55fb1759c420 2024-04-24T02:12:44.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.449+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 63 ==== osd_op_reply(215 gc.20 [call] v30'53 uv53 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.449+0000 7f3c0312f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-04-24T02:12:44.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.449+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:216 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e73e0 con 0x7f3bf401ac20 2024-04-24T02:12:44.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.450+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 50 ==== osd_op_reply(216 gc.21 [call] v30'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.450+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:217 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e73e0 con 0x7f3bf401ac20 2024-04-24T02:12:44.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.451+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 51 ==== osd_op_reply(217 gc.21 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.451+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.451+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:218 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e73e0 con 0x7f3bf401ac20 2024-04-24T02:12:44.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.451+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 52 ==== osd_op_reply(218 gc.21 [call out=24b] v0'0 uv36 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.451+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:219 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e73e0 con 0x7f3bf401ac20 2024-04-24T02:12:44.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.451+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 53 ==== osd_op_reply(219 gc.21 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.451+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:12:44.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.451+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:220 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e73e0 con 0x7f3bf401ac20 2024-04-24T02:12:44.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.451+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 54 ==== osd_op_reply(220 gc.21 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.451+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.451+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:221 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e73e0 con 0x7f3bf401ac20 2024-04-24T02:12:44.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.452+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 55 ==== osd_op_reply(221 gc.21 [call] v30'37 uv37 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.452+0000 7f3c0312f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-04-24T02:12:44.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.452+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:222 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e73e0 con 0x55fb1759c420 2024-04-24T02:12:44.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.453+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 64 ==== osd_op_reply(222 gc.22 [call] v30'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.453+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:223 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e73e0 con 0x55fb1759c420 2024-04-24T02:12:44.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.453+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 65 ==== osd_op_reply(223 gc.22 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.453+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.453+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:224 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e73e0 con 0x55fb1759c420 2024-04-24T02:12:44.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.454+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 66 ==== osd_op_reply(224 gc.22 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.454+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:225 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb1759c420 2024-04-24T02:12:44.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.454+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 67 ==== osd_op_reply(225 gc.22 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.454+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:12:44.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.454+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:226 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb1759c420 2024-04-24T02:12:44.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.454+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 68 ==== osd_op_reply(226 gc.22 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.454+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.454+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:227 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb1759c420 2024-04-24T02:12:44.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.455+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 69 ==== osd_op_reply(227 gc.22 [call] v30'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.455+0000 7f3c0312f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-04-24T02:12:44.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.455+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:228 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb1759c420 2024-04-24T02:12:44.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.456+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 70 ==== osd_op_reply(228 gc.23 [call] v30'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.456+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:229 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb1759c420 2024-04-24T02:12:44.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.456+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 71 ==== osd_op_reply(229 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.456+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.456+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:230 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e73e0 con 0x55fb1759c420 2024-04-24T02:12:44.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.456+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 72 ==== osd_op_reply(230 gc.23 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.456+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:231 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb1759c420 2024-04-24T02:12:44.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.457+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 73 ==== osd_op_reply(231 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.457+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:12:44.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.457+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:232 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb1759c420 2024-04-24T02:12:44.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.457+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 74 ==== osd_op_reply(232 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.457+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.457+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:233 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb1759c420 2024-04-24T02:12:44.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.458+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 75 ==== osd_op_reply(233 gc.23 [call] v30'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.458+0000 7f3c0312f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-04-24T02:12:44.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.458+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:234 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb1759c420 2024-04-24T02:12:44.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.459+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 76 ==== osd_op_reply(234 gc.24 [call] v30'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.459+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:235 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb1759c420 2024-04-24T02:12:44.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.459+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 77 ==== osd_op_reply(235 gc.24 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.459+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.459+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:236 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e73e0 con 0x55fb1759c420 2024-04-24T02:12:44.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.459+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 78 ==== osd_op_reply(236 gc.24 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.459+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:237 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb1759c420 2024-04-24T02:12:44.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.459+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 79 ==== osd_op_reply(237 gc.24 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.459+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:12:44.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.459+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:238 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb1759c420 2024-04-24T02:12:44.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.460+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 80 ==== osd_op_reply(238 gc.24 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.460+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.460+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:239 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb1759c420 2024-04-24T02:12:44.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.460+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 81 ==== osd_op_reply(239 gc.24 [call] v30'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.460+0000 7f3c0312f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-04-24T02:12:44.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.460+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:240 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb1759c420 2024-04-24T02:12:44.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.461+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 82 ==== osd_op_reply(240 gc.25 [call] v30'49 uv49 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.461+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:241 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb1759c420 2024-04-24T02:12:44.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.462+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 83 ==== osd_op_reply(241 gc.25 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.462+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.462+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:242 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e73e0 con 0x55fb1759c420 2024-04-24T02:12:44.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.462+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 84 ==== osd_op_reply(242 gc.25 [call out=24b] v0'0 uv49 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.462+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:243 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb1759c420 2024-04-24T02:12:44.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.462+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 85 ==== osd_op_reply(243 gc.25 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.462+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:12:44.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.462+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:244 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb1759c420 2024-04-24T02:12:44.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.462+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 86 ==== osd_op_reply(244 gc.25 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.462+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.462+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:245 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb1759c420 2024-04-24T02:12:44.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.463+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 87 ==== osd_op_reply(245 gc.25 [call] v30'50 uv50 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.463+0000 7f3c0312f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-04-24T02:12:44.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.463+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:246 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x7f3bf8031040 2024-04-24T02:12:44.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.465+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 45 ==== osd_op_reply(246 gc.26 [call] v30'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.465+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:247 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x7f3bf8031040 2024-04-24T02:12:44.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.465+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 46 ==== osd_op_reply(247 gc.26 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.465+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.465+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:248 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e73e0 con 0x7f3bf8031040 2024-04-24T02:12:44.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.465+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 47 ==== osd_op_reply(248 gc.26 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.465+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:249 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x7f3bf8031040 2024-04-24T02:12:44.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.465+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 48 ==== osd_op_reply(249 gc.26 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.465+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:12:44.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.465+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:250 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x7f3bf8031040 2024-04-24T02:12:44.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.466+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 49 ==== osd_op_reply(250 gc.26 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.466+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.466+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:251 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x7f3bf8031040 2024-04-24T02:12:44.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.467+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 50 ==== osd_op_reply(251 gc.26 [call] v30'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.467+0000 7f3c0312f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-04-24T02:12:44.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.467+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:252 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb1759c420 2024-04-24T02:12:44.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.468+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 88 ==== osd_op_reply(252 gc.27 [call] v30'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.468+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:253 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb1759c420 2024-04-24T02:12:44.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.468+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 89 ==== osd_op_reply(253 gc.27 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.468+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.468+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:254 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e73e0 con 0x55fb1759c420 2024-04-24T02:12:44.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.468+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 90 ==== osd_op_reply(254 gc.27 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.468+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:255 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb1759c420 2024-04-24T02:12:44.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.468+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 91 ==== osd_op_reply(255 gc.27 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.468+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:12:44.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.468+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:256 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb1759c420 2024-04-24T02:12:44.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.469+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 92 ==== osd_op_reply(256 gc.27 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.469+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.469+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:257 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb1759c420 2024-04-24T02:12:44.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.470+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 93 ==== osd_op_reply(257 gc.27 [call] v30'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.470+0000 7f3c0312f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-04-24T02:12:44.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.470+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:258 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x7f3bf8031040 2024-04-24T02:12:44.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.471+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 51 ==== osd_op_reply(258 gc.28 [call] v30'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.471+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:259 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x7f3bf8031040 2024-04-24T02:12:44.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.471+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 52 ==== osd_op_reply(259 gc.28 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.471+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.471+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:260 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e73e0 con 0x7f3bf8031040 2024-04-24T02:12:44.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.471+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 53 ==== osd_op_reply(260 gc.28 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.471+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:261 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x7f3bf8031040 2024-04-24T02:12:44.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.472+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 54 ==== osd_op_reply(261 gc.28 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.472+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:12:44.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.472+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:262 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x7f3bf8031040 2024-04-24T02:12:44.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.472+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 55 ==== osd_op_reply(262 gc.28 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.472+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.472+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:263 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x7f3bf8031040 2024-04-24T02:12:44.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.473+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 56 ==== osd_op_reply(263 gc.28 [call] v30'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.473+0000 7f3c0312f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-04-24T02:12:44.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.473+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:264 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb1759c420 2024-04-24T02:12:44.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.474+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 94 ==== osd_op_reply(264 gc.29 [call] v30'54 uv54 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.474+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:265 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb1759c420 2024-04-24T02:12:44.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.474+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 95 ==== osd_op_reply(265 gc.29 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.474+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.474+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:266 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e73e0 con 0x55fb1759c420 2024-04-24T02:12:44.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.474+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 96 ==== osd_op_reply(266 gc.29 [call out=24b] v0'0 uv54 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.474+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:267 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb1759c420 2024-04-24T02:12:44.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.474+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 97 ==== osd_op_reply(267 gc.29 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.474+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:12:44.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.474+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:268 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb1759c420 2024-04-24T02:12:44.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.475+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 98 ==== osd_op_reply(268 gc.29 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.475+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.475+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:269 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb1759c420 2024-04-24T02:12:44.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.476+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 99 ==== osd_op_reply(269 gc.29 [call] v30'55 uv55 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.476+0000 7f3c0312f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-04-24T02:12:44.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.476+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:270 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x7f3bf8031040 2024-04-24T02:12:44.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.477+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 57 ==== osd_op_reply(270 gc.30 [call] v30'53 uv53 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.477+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:271 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x7f3bf8031040 2024-04-24T02:12:44.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.477+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 58 ==== osd_op_reply(271 gc.30 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.477+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.477+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:272 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e73e0 con 0x7f3bf8031040 2024-04-24T02:12:44.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.477+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 59 ==== osd_op_reply(272 gc.30 [call out=24b] v0'0 uv53 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.477+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:273 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x7f3bf8031040 2024-04-24T02:12:44.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.478+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 60 ==== osd_op_reply(273 gc.30 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.478+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:12:44.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.478+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:274 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x7f3bf8031040 2024-04-24T02:12:44.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.478+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 61 ==== osd_op_reply(274 gc.30 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.478+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.478+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:275 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x7f3bf8031040 2024-04-24T02:12:44.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.479+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 62 ==== osd_op_reply(275 gc.30 [call] v30'54 uv54 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.479+0000 7f3c0312f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-04-24T02:12:44.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.479+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:276 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x7f3bf401ac20 2024-04-24T02:12:44.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.480+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 56 ==== osd_op_reply(276 gc.31 [call] v30'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.480+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:277 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x7f3bf401ac20 2024-04-24T02:12:44.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.480+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 57 ==== osd_op_reply(277 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.480+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.480+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:278 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e73e0 con 0x7f3bf401ac20 2024-04-24T02:12:44.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.481+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 58 ==== osd_op_reply(278 gc.31 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.481+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:279 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x7f3bf401ac20 2024-04-24T02:12:44.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.481+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 59 ==== osd_op_reply(279 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.481+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:12:44.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.481+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:280 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x7f3bf401ac20 2024-04-24T02:12:44.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.481+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 60 ==== osd_op_reply(280 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.481+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.481+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:281 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x7f3bf401ac20 2024-04-24T02:12:44.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.482+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 61 ==== osd_op_reply(281 gc.31 [call] v30'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.482+0000 7f3c0312f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-04-24T02:12:44.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.482+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:282 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb175961d0 2024-04-24T02:12:44.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.484+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 60 ==== osd_op_reply(282 gc.0 [call] v30'50 uv50 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.484+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:283 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb175961d0 2024-04-24T02:12:44.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.484+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 61 ==== osd_op_reply(283 gc.0 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.484+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.484+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:284 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e73e0 con 0x55fb175961d0 2024-04-24T02:12:44.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.484+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 62 ==== osd_op_reply(284 gc.0 [call out=24b] v0'0 uv50 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.484+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:285 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb175961d0 2024-04-24T02:12:44.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.484+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 63 ==== osd_op_reply(285 gc.0 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.484+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:12:44.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.484+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:286 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb175961d0 2024-04-24T02:12:44.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.484+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 64 ==== osd_op_reply(286 gc.0 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.484+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.484+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:287 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x55fb175961d0 2024-04-24T02:12:44.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.486+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 65 ==== osd_op_reply(287 gc.0 [call] v30'51 uv51 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.486+0000 7f3c0312f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-04-24T02:12:44.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.486+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:288 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x7f3bf8031040 2024-04-24T02:12:44.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.487+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 63 ==== osd_op_reply(288 gc.1 [call] v30'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.487+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:289 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x7f3bf8031040 2024-04-24T02:12:44.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.487+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 64 ==== osd_op_reply(289 gc.1 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.487+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.487+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:290 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e73e0 con 0x7f3bf8031040 2024-04-24T02:12:44.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.487+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 65 ==== osd_op_reply(290 gc.1 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.487+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:291 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x7f3bf8031040 2024-04-24T02:12:44.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.487+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 66 ==== osd_op_reply(291 gc.1 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.487+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:12:44.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.487+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:292 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x7f3bf8031040 2024-04-24T02:12:44.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.488+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 67 ==== osd_op_reply(292 gc.1 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.488+0000 7f3c0312f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:12:44.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.488+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:293 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175e83f0 con 0x7f3bf8031040 2024-04-24T02:12:44.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.489+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 68 ==== osd_op_reply(293 gc.1 [call] v30'28 uv28 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.489+0000 7f3ab57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:44.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.489+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94536916950784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175de530 con 0x55fb175961d0 2024-04-24T02:12:44.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.490+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 66 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94536916950784] v30'174 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.490+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94536916929040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175a5f00 con 0x7f3bf401ac20 2024-04-24T02:12:44.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.491+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 62 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94536916929040] v30'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.491+0000 7f3c0312f800 20 remove_watcher() i=0 2024-04-24T02:12:44.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.491+0000 7f3c0312f800 2 removed watcher, disabling cache 2024-04-24T02:12:44.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.491+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94536916934144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175a0a10 con 0x55fb175961d0 2024-04-24T02:12:44.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.492+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 67 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94536916934144] v30'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.492+0000 7f3c0312f800 20 remove_watcher() i=1 2024-04-24T02:12:44.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.492+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94536916938368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175a0a10 con 0x55fb1759c420 2024-04-24T02:12:44.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.493+0000 7f3bfe5b4640 1 -- 172.21.15.134:0/2617995573 <== osd.3 v2:172.21.15.134:6801/3585115521 100 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94536916938368] v30'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bf405c040 con 0x55fb1759c420 2024-04-24T02:12:44.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.493+0000 7f3c0312f800 20 remove_watcher() i=2 2024-04-24T02:12:44.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.493+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94536916942000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175a2e80 con 0x7f3bf401ac20 2024-04-24T02:12:44.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.494+0000 7f3bff5b6640 1 -- 172.21.15.134:0/2617995573 <== osd.2 v2:172.21.15.134:6800/214480313 63 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94536916942000] v30'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bf801f070 con 0x7f3bf401ac20 2024-04-24T02:12:44.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.494+0000 7f3c0312f800 20 remove_watcher() i=3 2024-04-24T02:12:44.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.494+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94536916933024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175a0a10 con 0x55fb175961d0 2024-04-24T02:12:44.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.495+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.1 v2:172.21.15.134:6804/1487076214 68 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94536916933024] v30'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x55fb175961d0 2024-04-24T02:12:44.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.495+0000 7f3c0312f800 20 remove_watcher() i=4 2024-04-24T02:12:44.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.495+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94536916947232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175a3cb0 con 0x7f3bf8031040 2024-04-24T02:12:44.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.496+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 69 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94536916947232] v30'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.496+0000 7f3c0312f800 20 remove_watcher() i=5 2024-04-24T02:12:44.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.496+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94536916948288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175a2e80 con 0x7f3bf8031040 2024-04-24T02:12:44.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.497+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 70 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94536916948288] v30'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.497+0000 7f3c0312f800 20 remove_watcher() i=6 2024-04-24T02:12:44.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.497+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94536916951984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fb175a19a0 con 0x7f3bf8031040 2024-04-24T02:12:44.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.498+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 <== osd.0 v2:172.21.15.104:6800/2419146313 71 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94536916951984] v30'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bf0075030 con 0x7f3bf8031040 2024-04-24T02:12:44.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.498+0000 7f3c0312f800 20 remove_watcher() i=7 2024-04-24T02:12:44.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.498+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f3bf8031040 msgr2=0x7f3bf8032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:44.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.498+0000 7f3c0312f800 1 --2- 172.21.15.134:0/2617995573 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f3bf8031040 0x7f3bf8032940 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.498+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55fb175961d0 msgr2=0x55fb17598690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:44.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.498+0000 7f3c0312f800 1 --2- 172.21.15.134:0/2617995573 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55fb175961d0 0x55fb17598690 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.498+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f3bf401ac20 msgr2=0x7f3bf401c420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:44.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.498+0000 7f3c0312f800 1 --2- 172.21.15.134:0/2617995573 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f3bf401ac20 0x7f3bf401c420 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.498+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55fb1759c420 msgr2=0x55fb1759e810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:44.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.498+0000 7f3c0312f800 1 --2- 172.21.15.134:0/2617995573 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55fb1759c420 0x55fb1759e810 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.498+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3ac8036900 msgr2=0x7f3ac8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:44.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.498+0000 7f3c0312f800 1 --2- 172.21.15.134:0/2617995573 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3ac8036900 0x7f3ac8038dc0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x55fb17566140 tx=0x7f3bf801f000 comp rx=0 tx=0).stop 2024-04-24T02:12:44.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.499+0000 7f3bfedb5640 1 -- 172.21.15.134:0/2617995573 reap_dead start 2024-04-24T02:12:44.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.499+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fb17583430 msgr2=0x55fb1758aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:44.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.499+0000 7f3c0312f800 1 --2- 172.21.15.134:0/2617995573 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fb17583430 0x55fb1758aa90 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4024fd0 tx=0x7f3bf404c080 comp rx=0 tx=0).stop 2024-04-24T02:12:44.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.499+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 shutdown_connections 2024-04-24T02:12:44.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.499+0000 7f3c0312f800 1 --2- 172.21.15.134:0/2617995573 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fb17583430 0x55fb1758aa90 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.499+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 >> 172.21.15.134:0/2617995573 conn(0x55fb1757f790 msgr2=0x55fb1757cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:44.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.499+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 shutdown_connections 2024-04-24T02:12:44.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.499+0000 7f3c0312f800 1 -- 172.21.15.134:0/2617995573 wait complete. 2024-04-24T02:12:44.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.499+0000 7f3c0312f800 1 -- 172.21.15.134:0/1130349786 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3ad8036900 msgr2=0x7f3ad8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:44.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.499+0000 7f3c0312f800 1 --2- 172.21.15.134:0/1130349786 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3ad8036900 0x7f3ad8038dc0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x55fb175669c0 tx=0x7f3bf8005840 comp rx=0 tx=0).stop 2024-04-24T02:12:44.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.499+0000 7f3c0312f800 1 -- 172.21.15.134:0/1130349786 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fb175760f0 msgr2=0x55fb17576510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:44.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.499+0000 7f3c0312f800 1 --2- 172.21.15.134:0/1130349786 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fb175760f0 0x55fb17576510 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4001ed0 tx=0x7f3bf400ea00 comp rx=0 tx=0).stop 2024-04-24T02:12:44.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.499+0000 7f3c0312f800 1 -- 172.21.15.134:0/1130349786 shutdown_connections 2024-04-24T02:12:44.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.499+0000 7f3c0312f800 1 --2- 172.21.15.134:0/1130349786 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3ad8036900 0x7f3ad8038dc0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.499+0000 7f3c0312f800 1 --2- 172.21.15.134:0/1130349786 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fb175760f0 0x55fb17576510 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.499+0000 7f3c0312f800 1 -- 172.21.15.134:0/1130349786 >> 172.21.15.134:0/1130349786 conn(0x55fb1756a190 msgr2=0x55fb1756a590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:44.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.499+0000 7f3c0312f800 1 -- 172.21.15.134:0/1130349786 shutdown_connections 2024-04-24T02:12:44.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.499+0000 7f3c0312f800 1 -- 172.21.15.134:0/1130349786 wait complete. 2024-04-24T02:12:44.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.499+0000 7f3c0312f800 1 -- 172.21.15.134:0/607286194 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55fb174662b0 msgr2=0x55fb17564f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:44.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.499+0000 7f3c0312f800 1 --2- 172.21.15.134:0/607286194 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55fb174662b0 0x55fb17564f10 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.499+0000 7f3c0312f800 1 -- 172.21.15.134:0/607286194 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3ae4036900 msgr2=0x7f3ae4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:44.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.499+0000 7f3c0312f800 1 --2- 172.21.15.134:0/607286194 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3ae4036900 0x7f3ae4038dc0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4000f60 tx=0x7f3bf4001370 comp rx=0 tx=0).stop 2024-04-24T02:12:44.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.499+0000 7f3c0312f800 1 -- 172.21.15.134:0/607286194 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fb17463980 msgr2=0x55fb1755dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:44.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.499+0000 7f3c0312f800 1 --2- 172.21.15.134:0/607286194 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fb17463980 0x55fb1755dcd0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f3bf001cfe0 tx=0x7f3bf0003020 comp rx=0 tx=0).stop 2024-04-24T02:12:44.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.500+0000 7f3c0312f800 1 -- 172.21.15.134:0/607286194 shutdown_connections 2024-04-24T02:12:44.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.500+0000 7f3c0312f800 1 --2- 172.21.15.134:0/607286194 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55fb174662b0 0x55fb17564f10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.500+0000 7f3c0312f800 1 --2- 172.21.15.134:0/607286194 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3ae4036900 0x7f3ae4038dc0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.500+0000 7f3c0312f800 1 --2- 172.21.15.134:0/607286194 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fb17463980 0x55fb1755dcd0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.500+0000 7f3c0312f800 1 -- 172.21.15.134:0/607286194 >> 172.21.15.134:0/607286194 conn(0x55fb1745d310 msgr2=0x55fb174620a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:44.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.500+0000 7f3c0312f800 1 -- 172.21.15.134:0/607286194 shutdown_connections 2024-04-24T02:12:44.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.500+0000 7f3c0312f800 1 -- 172.21.15.134:0/607286194 wait complete. 2024-04-24T02:12:44.509 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-04-24T02:12:44.509 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-04-24T02:12:44.509 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-04-24T02:12:44.590 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:44.591 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:44.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.590+0000 7f8da5c1f800 1 Processor -- start 2024-04-24T02:12:44.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.590+0000 7f8da5c1f800 1 -- start start 2024-04-24T02:12:44.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.590+0000 7f8da5c1f800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5563d062ed20 0x5563d062f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.590+0000 7f8da5c1f800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5563d04eed40 con 0x5563d062ff80 2024-04-24T02:12:44.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.590+0000 7f8da5c1f800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x5563d04c14d0 con 0x5563d062ed20 2024-04-24T02:12:44.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.590+0000 7f8da371e640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5563d062ed20 0x5563d062f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.590+0000 7f8da2f1d640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x5563d062ff80 0x5563d0630400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:36566/0 (socket says 172.21.15.134:36566) 2024-04-24T02:12:44.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.590+0000 7f8da371e640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5563d062ed20 0x5563d062f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:40626/0 (socket says 172.21.15.134:40626) 2024-04-24T02:12:44.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.590+0000 7f8da2f1d640 1 -- 172.21.15.134:0/1499730452 learned_addr learned my addr 172.21.15.134:0/1499730452 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:12:44.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.591+0000 7f8da371e640 1 -- 172.21.15.134:0/1499730452 >> v1:172.21.15.104:6789/0 conn(0x5563d062ff80 legacy=0x5563d0630400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:44.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.591+0000 7f8da371e640 1 -- 172.21.15.134:0/1499730452 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563d04ed590 con 0x5563d062ed20 2024-04-24T02:12:44.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.592+0000 7f8da371e640 1 --2- 172.21.15.134:0/1499730452 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563d062ed20 0x5563d062f140 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8d9400a470 tx=0x7f8d9401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8d7f48e5094156d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.593+0000 7f8da271c640 1 -- 172.21.15.134:0/1499730452 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d94057070 con 0x5563d062ed20 2024-04-24T02:12:44.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.593+0000 7f8da271c640 1 -- 172.21.15.134:0/1499730452 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d94052570 con 0x5563d062ed20 2024-04-24T02:12:44.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.593+0000 7f8da271c640 1 -- 172.21.15.134:0/1499730452 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d94052870 con 0x5563d062ed20 2024-04-24T02:12:44.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.593+0000 7f8da5c1f800 1 -- 172.21.15.134:0/1499730452 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563d062ed20 msgr2=0x5563d062f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:44.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.593+0000 7f8da5c1f800 1 --2- 172.21.15.134:0/1499730452 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563d062ed20 0x5563d062f140 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8d9400a470 tx=0x7f8d9401ce90 comp rx=0 tx=0).stop 2024-04-24T02:12:44.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.593+0000 7f8da5c1f800 1 -- 172.21.15.134:0/1499730452 shutdown_connections 2024-04-24T02:12:44.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.593+0000 7f8da5c1f800 1 --2- 172.21.15.134:0/1499730452 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563d062ed20 0x5563d062f140 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.593+0000 7f8da5c1f800 1 -- 172.21.15.134:0/1499730452 >> 172.21.15.134:0/1499730452 conn(0x5563d062a380 msgr2=0x5563d062c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:44.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.593+0000 7f8da5c1f800 1 -- 172.21.15.134:0/1499730452 shutdown_connections 2024-04-24T02:12:44.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.593+0000 7f8da5c1f800 1 -- 172.21.15.134:0/1499730452 wait complete. 2024-04-24T02:12:44.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.605+0000 7f8da5c1f800 1 Processor -- start 2024-04-24T02:12:44.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.605+0000 7f8da5c1f800 1 -- start start 2024-04-24T02:12:44.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.605+0000 7f8da5c1f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563d062ed20 0x5563d0720410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.605+0000 7f8da5c1f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5563d057b3c0 con 0x5563d062ed20 2024-04-24T02:12:44.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.605+0000 7f8da371e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563d062ed20 0x5563d0720410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.605+0000 7f8da371e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563d062ed20 0x5563d0720410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:40642/0 (socket says 172.21.15.134:40642) 2024-04-24T02:12:44.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.605+0000 7f8da371e640 1 -- 172.21.15.134:0/4032871582 learned_addr learned my addr 172.21.15.134:0/4032871582 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:44.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.606+0000 7f8da371e640 1 -- 172.21.15.134:0/4032871582 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563d07209e0 con 0x5563d062ed20 2024-04-24T02:12:44.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.606+0000 7f8da371e640 1 --2- 172.21.15.134:0/4032871582 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563d062ed20 0x5563d0720410 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8d94055040 tx=0x7f8d9404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=675fae4457d6ddef server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.606+0000 7f8c9160a640 1 -- 172.21.15.134:0/4032871582 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d94057070 con 0x5563d062ed20 2024-04-24T02:12:44.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.606+0000 7f8c9160a640 1 -- 172.21.15.134:0/4032871582 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d94063070 con 0x5563d062ed20 2024-04-24T02:12:44.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.606+0000 7f8c9160a640 1 -- 172.21.15.134:0/4032871582 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d94052720 con 0x5563d062ed20 2024-04-24T02:12:44.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.607+0000 7f8da5c1f800 1 -- 172.21.15.134:0/4032871582 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563d062ed20 msgr2=0x5563d0720410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:44.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.607+0000 7f8da5c1f800 1 --2- 172.21.15.134:0/4032871582 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563d062ed20 0x5563d0720410 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8d94055040 tx=0x7f8d9404c000 comp rx=0 tx=0).stop 2024-04-24T02:12:44.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.607+0000 7f8da5c1f800 1 -- 172.21.15.134:0/4032871582 shutdown_connections 2024-04-24T02:12:44.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.607+0000 7f8da5c1f800 1 --2- 172.21.15.134:0/4032871582 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563d062ed20 0x5563d0720410 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.607+0000 7f8da5c1f800 1 -- 172.21.15.134:0/4032871582 >> 172.21.15.134:0/4032871582 conn(0x5563d062a380 msgr2=0x5563d071bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:44.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.607+0000 7f8da5c1f800 1 -- 172.21.15.134:0/4032871582 shutdown_connections 2024-04-24T02:12:44.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.607+0000 7f8da5c1f800 1 -- 172.21.15.134:0/4032871582 wait complete. 2024-04-24T02:12:44.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.607+0000 7f8da5c1f800 1 Processor -- start 2024-04-24T02:12:44.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.607+0000 7f8da5c1f800 1 -- start start 2024-04-24T02:12:44.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.607+0000 7f8da5c1f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563d062ed20 0x5563d0727db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.607+0000 7f8da5c1f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5563d06383f0 con 0x5563d062ed20 2024-04-24T02:12:44.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.607+0000 7f8da371e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563d062ed20 0x5563d0727db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.607+0000 7f8da371e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563d062ed20 0x5563d0727db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:40658/0 (socket says 172.21.15.134:40658) 2024-04-24T02:12:44.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.607+0000 7f8da371e640 1 -- 172.21.15.134:0/3094825853 learned_addr learned my addr 172.21.15.134:0/3094825853 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:44.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.608+0000 7f8da371e640 1 -- 172.21.15.134:0/3094825853 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563d07282f0 con 0x5563d062ed20 2024-04-24T02:12:44.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.608+0000 7f8da371e640 1 --2- 172.21.15.134:0/3094825853 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563d062ed20 0x5563d0727db0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f8d94055040 tx=0x7f8d94002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.608+0000 7f8c8fe07640 1 -- 172.21.15.134:0/3094825853 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d94052cd0 con 0x5563d062ed20 2024-04-24T02:12:44.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.608+0000 7f8c8fe07640 1 -- 172.21.15.134:0/3094825853 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d9406c070 con 0x5563d062ed20 2024-04-24T02:12:44.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.608+0000 7f8da5c1f800 1 -- 172.21.15.134:0/3094825853 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5563d0728580 con 0x5563d062ed20 2024-04-24T02:12:44.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.608+0000 7f8c8fe07640 1 -- 172.21.15.134:0/3094825853 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d9405e480 con 0x5563d062ed20 2024-04-24T02:12:44.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.608+0000 7f8da5c1f800 1 -- 172.21.15.134:0/3094825853 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563d072b230 con 0x5563d062ed20 2024-04-24T02:12:44.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.609+0000 7f8c8fe07640 1 -- 172.21.15.134:0/3094825853 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8d9405e620 con 0x5563d062ed20 2024-04-24T02:12:44.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.609+0000 7f8c8fe07640 1 --2- 172.21.15.134:0/3094825853 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8c88036900 0x7f8c88038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.609+0000 7f8c8fe07640 1 -- 172.21.15.134:0/3094825853 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f8d9408e6d0 con 0x5563d062ed20 2024-04-24T02:12:44.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.609+0000 7f8da2f1d640 1 --2- 172.21.15.134:0/3094825853 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8c88036900 0x7f8c88038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.609+0000 7f8da5c1f800 1 --2- 172.21.15.134:0/3094825853 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5563d062ff80 0x5563d072eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.609+0000 7f8da5c1f800 1 -- 172.21.15.134:0/3094825853 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d072f5c0 con 0x5563d062ff80 2024-04-24T02:12:44.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.609+0000 7f8da3f1f640 1 --2- 172.21.15.134:0/3094825853 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5563d062ff80 0x5563d072eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.610+0000 7f8da2f1d640 1 --2- 172.21.15.134:0/3094825853 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8c88036900 0x7f8c88038dc0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8d98000f60 tx=0x7f8d980012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.610+0000 7f8da3f1f640 1 --2- 172.21.15.134:0/3094825853 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5563d062ff80 0x5563d072eff0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.610+0000 7f8da3f1f640 1 -- 172.21.15.134:0/3094825853 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8d9c00a4a0 con 0x5563d062ff80 2024-04-24T02:12:44.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.610+0000 7f8da5c1f800 1 -- 172.21.15.134:0/3094825853 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d072c5c0 con 0x5563d062ff80 2024-04-24T02:12:44.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.610+0000 7f8da3f1f640 1 -- 172.21.15.134:0/3094825853 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8d9c00a4a0 con 0x5563d062ff80 2024-04-24T02:12:44.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.610+0000 7f8da5c1f800 1 -- 172.21.15.134:0/3094825853 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d0731430 con 0x5563d062ff80 2024-04-24T02:12:44.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.611+0000 7f8da3f1f640 1 -- 172.21.15.134:0/3094825853 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8d9c00a4a0 con 0x5563d062ff80 2024-04-24T02:12:44.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.611+0000 7f8da5c1f800 1 -- 172.21.15.134:0/3094825853 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d0730770 con 0x5563d062ff80 2024-04-24T02:12:44.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.611+0000 7f8da3f1f640 1 -- 172.21.15.134:0/3094825853 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8d9c00a4a0 con 0x5563d062ff80 2024-04-24T02:12:44.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.611+0000 7f8da5c1f800 1 -- 172.21.15.134:0/3094825853 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d0730bc0 con 0x5563d062ff80 2024-04-24T02:12:44.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.611+0000 7f8da3f1f640 1 -- 172.21.15.134:0/3094825853 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8d9c00a4a0 con 0x5563d062ff80 2024-04-24T02:12:44.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.611+0000 7f8da5c1f800 1 Processor -- start 2024-04-24T02:12:44.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.611+0000 7f8da5c1f800 1 -- start start 2024-04-24T02:12:44.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.612+0000 7f8da5c1f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563d0740200 0x5563d0740620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.612+0000 7f8da5c1f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5563d05216b0 con 0x5563d0740200 2024-04-24T02:12:44.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.612+0000 7f8da2f1d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563d0740200 0x5563d0740620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.612+0000 7f8da2f1d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563d0740200 0x5563d0740620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:40664/0 (socket says 172.21.15.134:40664) 2024-04-24T02:12:44.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.612+0000 7f8da2f1d640 1 -- 172.21.15.134:0/4258592273 learned_addr learned my addr 172.21.15.134:0/4258592273 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:44.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.612+0000 7f8da2f1d640 1 -- 172.21.15.134:0/4258592273 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563d0740b60 con 0x5563d0740200 2024-04-24T02:12:44.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.612+0000 7f8da2f1d640 1 --2- 172.21.15.134:0/4258592273 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563d0740200 0x5563d0740620 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f8d98001ed0 tx=0x7f8d9800d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.612+0000 7f8c8d602640 1 -- 172.21.15.134:0/4258592273 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d9801b550 con 0x5563d0740200 2024-04-24T02:12:44.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.612+0000 7f8c8d602640 1 -- 172.21.15.134:0/4258592273 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d9801b6f0 con 0x5563d0740200 2024-04-24T02:12:44.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.612+0000 7f8da5c1f800 1 -- 172.21.15.134:0/4258592273 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5563d07415d0 con 0x5563d0740200 2024-04-24T02:12:44.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.612+0000 7f8c8d602640 1 -- 172.21.15.134:0/4258592273 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d9801b9d0 con 0x5563d0740200 2024-04-24T02:12:44.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.613+0000 7f8da5c1f800 1 -- 172.21.15.134:0/4258592273 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563d0741ad0 con 0x5563d0740200 2024-04-24T02:12:44.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.613+0000 7f8c8d602640 1 -- 172.21.15.134:0/4258592273 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8d98023020 con 0x5563d0740200 2024-04-24T02:12:44.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.613+0000 7f8c8d602640 1 --2- 172.21.15.134:0/4258592273 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8c7c036950 0x7f8c7c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.613+0000 7f8c8d602640 1 -- 172.21.15.134:0/4258592273 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f8d98021020 con 0x5563d0740200 2024-04-24T02:12:44.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.613+0000 7f8da3f1f640 1 --2- 172.21.15.134:0/4258592273 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8c7c036950 0x7f8c7c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.614+0000 7f8da5c1f800 1 Processor -- start 2024-04-24T02:12:44.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.614+0000 7f8da3f1f640 1 --2- 172.21.15.134:0/4258592273 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8c7c036950 0x7f8c7c038e10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x5563d0730290 tx=0x7f8d9c005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.614+0000 7f8da5c1f800 1 -- start start 2024-04-24T02:12:44.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.614+0000 7f8da5c1f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563d05a2840 0x5563d05a2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.614+0000 7f8da5c1f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5563d0720ca0 con 0x5563d05a2840 2024-04-24T02:12:44.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.614+0000 7f8da2f1d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563d05a2840 0x5563d05a2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.614+0000 7f8da2f1d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563d05a2840 0x5563d05a2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:40666/0 (socket says 172.21.15.134:40666) 2024-04-24T02:12:44.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.614+0000 7f8da2f1d640 1 -- 172.21.15.134:0/581169075 learned_addr learned my addr 172.21.15.134:0/581169075 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:44.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.614+0000 7f8da2f1d640 1 -- 172.21.15.134:0/581169075 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563d05a3230 con 0x5563d05a2840 2024-04-24T02:12:44.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.614+0000 7f8da2f1d640 1 --2- 172.21.15.134:0/581169075 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563d05a2840 0x5563d05a2c60 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f8d9804ce10 tx=0x7f8d98019ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7c9a2ca6e9a0b75 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.615+0000 7f8c86ffd640 1 -- 172.21.15.134:0/581169075 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d98041070 con 0x5563d05a2840 2024-04-24T02:12:44.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.615+0000 7f8c86ffd640 1 -- 172.21.15.134:0/581169075 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d980258e0 con 0x5563d05a2840 2024-04-24T02:12:44.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.615+0000 7f8c86ffd640 1 -- 172.21.15.134:0/581169075 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d98025410 con 0x5563d05a2840 2024-04-24T02:12:44.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.615+0000 7f8da5c1f800 1 -- 172.21.15.134:0/581169075 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563d05a2840 msgr2=0x5563d05a2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:44.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.615+0000 7f8da5c1f800 1 --2- 172.21.15.134:0/581169075 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563d05a2840 0x5563d05a2c60 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f8d9804ce10 tx=0x7f8d98019ce0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.615+0000 7f8da5c1f800 1 -- 172.21.15.134:0/581169075 shutdown_connections 2024-04-24T02:12:44.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.615+0000 7f8da5c1f800 1 --2- 172.21.15.134:0/581169075 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563d05a2840 0x5563d05a2c60 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.615+0000 7f8da5c1f800 1 -- 172.21.15.134:0/581169075 >> 172.21.15.134:0/581169075 conn(0x5563d07498a0 msgr2=0x5563d0747900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:44.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.615+0000 7f8da5c1f800 1 -- 172.21.15.134:0/581169075 shutdown_connections 2024-04-24T02:12:44.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.615+0000 7f8da5c1f800 1 -- 172.21.15.134:0/581169075 wait complete. 2024-04-24T02:12:44.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.615+0000 7f8da5c1f800 1 Processor -- start 2024-04-24T02:12:44.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.615+0000 7f8da5c1f800 1 -- start start 2024-04-24T02:12:44.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.615+0000 7f8da5c1f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563d05a2840 0x5563d0755cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.615+0000 7f8da5c1f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5563d074f7f0 con 0x5563d05a2840 2024-04-24T02:12:44.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.616+0000 7f8da2f1d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563d05a2840 0x5563d0755cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.616+0000 7f8da2f1d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563d05a2840 0x5563d0755cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:40680/0 (socket says 172.21.15.134:40680) 2024-04-24T02:12:44.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.616+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 learned_addr learned my addr 172.21.15.134:0/2882557085 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:44.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.616+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563d0756230 con 0x5563d05a2840 2024-04-24T02:12:44.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.616+0000 7f8da2f1d640 1 --2- 172.21.15.134:0/2882557085 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563d05a2840 0x5563d0755cf0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f8d98019d20 tx=0x7f8d9804cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.616+0000 7f8c857fa640 1 -- 172.21.15.134:0/2882557085 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d98041070 con 0x5563d05a2840 2024-04-24T02:12:44.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.616+0000 7f8c857fa640 1 -- 172.21.15.134:0/2882557085 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d98024370 con 0x5563d05a2840 2024-04-24T02:12:44.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.616+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5563d07564c0 con 0x5563d05a2840 2024-04-24T02:12:44.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.616+0000 7f8c857fa640 1 -- 172.21.15.134:0/2882557085 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d98024650 con 0x5563d05a2840 2024-04-24T02:12:44.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.616+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563d07566d0 con 0x5563d05a2840 2024-04-24T02:12:44.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.617+0000 7f8c857fa640 1 -- 172.21.15.134:0/2882557085 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8d980247f0 con 0x5563d05a2840 2024-04-24T02:12:44.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.617+0000 7f8c857fa640 1 --2- 172.21.15.134:0/2882557085 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8c6c036900 0x7f8c6c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.617+0000 7f8c857fa640 1 -- 172.21.15.134:0/2882557085 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f8d98039ab0 con 0x5563d05a2840 2024-04-24T02:12:44.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.617+0000 7f8da3f1f640 1 --2- 172.21.15.134:0/2882557085 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8c6c036900 0x7f8c6c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.618+0000 7f8da5c1f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:44.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.618+0000 7f8da5c1f800 1 --2- 172.21.15.134:0/2882557085 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5563d0761610 0x5563d0763ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.618+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d0764220 con 0x5563d0761610 2024-04-24T02:12:44.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.618+0000 7f8da371e640 1 --2- 172.21.15.134:0/2882557085 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5563d0761610 0x5563d0763ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.618+0000 7f8da3f1f640 1 --2- 172.21.15.134:0/2882557085 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8c6c036900 0x7f8c6c038dc0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x5563d0728fd0 tx=0x7f8d9c01f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.618+0000 7f8da371e640 1 --2- 172.21.15.134:0/2882557085 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5563d0761610 0x5563d0763ad0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.618+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8d9407aef0 con 0x5563d0761610 2024-04-24T02:12:44.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.618+0000 7f8da5c1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:44.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.618+0000 7f8da5c1f800 20 realm 2024-04-24T02:12:44.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.618+0000 7f8da5c1f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:44.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.618+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d0764630 con 0x5563d0761610 2024-04-24T02:12:44.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.618+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8d9407aef0 con 0x5563d0761610 2024-04-24T02:12:44.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.618+0000 7f8da5c1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:44.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.618+0000 7f8da5c1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:44.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.619+0000 7f8da5c1f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:44.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.619+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d0764f00 con 0x5563d0761610 2024-04-24T02:12:44.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.619+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8d9407aef0 con 0x5563d0761610 2024-04-24T02:12:44.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.619+0000 7f8da5c1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:44.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.619+0000 7f8da5c1f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:44.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.619+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d07652a0 con 0x5563d0761610 2024-04-24T02:12:44.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.619+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8d9407aef0 con 0x5563d0761610 2024-04-24T02:12:44.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.619+0000 7f8da5c1f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:44.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.619+0000 7f8da5c1f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:44.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.619+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d0765700 con 0x5563d0761610 2024-04-24T02:12:44.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.619+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8d9407aef0 con 0x5563d0761610 2024-04-24T02:12:44.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.619+0000 7f8da5c1f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:44.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.619+0000 7f8da5c1f800 20 searching for the correct realm 2024-04-24T02:12:44.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.619+0000 7f8da5c1f800 1 --2- 172.21.15.134:0/2882557085 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5563d0767750 0x5563d0769b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.619+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563d076a1f0 con 0x5563d0767750 2024-04-24T02:12:44.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.619+0000 7f8da2f1d640 1 --2- 172.21.15.134:0/2882557085 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5563d0767750 0x5563d0769b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.620+0000 7f8da2f1d640 1 --2- 172.21.15.134:0/2882557085 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5563d0767750 0x5563d0769b40 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.620+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.620+0000 7f8da2f1d640 1 --2- 172.21.15.134:0/2882557085 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f8d98044b60 0x7f8d98051a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.620+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563d076a1f0 con 0x7f8d98044b60 2024-04-24T02:12:44.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.620+0000 7f8da3f1f640 1 --2- 172.21.15.134:0/2882557085 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f8d98044b60 0x7f8d98051a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.620+0000 7f8da3f1f640 1 --2- 172.21.15.134:0/2882557085 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f8d98044b60 0x7f8d98051a10 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.621+0000 7f8da3f1f640 1 -- 172.21.15.134:0/2882557085 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d9c01f070 con 0x7f8d98044b60 2024-04-24T02:12:44.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.621+0000 7f8da3f1f640 1 --2- 172.21.15.134:0/2882557085 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f8d9c031040 0x7f8d9c032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.621+0000 7f8da3f1f640 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563d076a1f0 con 0x7f8d9c031040 2024-04-24T02:12:44.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.621+0000 7f8da371e640 1 --2- 172.21.15.134:0/2882557085 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f8d9c031040 0x7f8d9c032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.621+0000 7f8da371e640 1 --2- 172.21.15.134:0/2882557085 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f8d9c031040 0x7f8d9c032430 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.621+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d9407aef0 con 0x7f8d9c031040 2024-04-24T02:12:44.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.621+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563d0765700 con 0x5563d0761610 2024-04-24T02:12:44.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.622+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d9407aef0 con 0x5563d0761610 2024-04-24T02:12:44.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.622+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563d0765700 con 0x5563d0761610 2024-04-24T02:12:44.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.622+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8d9407aef0 con 0x5563d0761610 2024-04-24T02:12:44.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.622+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563d0765700 con 0x7f8d9c031040 2024-04-24T02:12:44.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.622+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d9407aef0 con 0x7f8d9c031040 2024-04-24T02:12:44.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.622+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563d0765700 con 0x7f8d9c031040 2024-04-24T02:12:44.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.622+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d9407aef0 con 0x7f8d9c031040 2024-04-24T02:12:44.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.622+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563d0765700 con 0x7f8d98044b60 2024-04-24T02:12:44.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.623+0000 7f8da3f1f640 1 -- 172.21.15.134:0/2882557085 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d9c01f070 con 0x7f8d98044b60 2024-04-24T02:12:44.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.623+0000 7f8da3f1f640 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563d0765700 con 0x5563d0767750 2024-04-24T02:12:44.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.623+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.623+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563d0765700 con 0x5563d0761610 2024-04-24T02:12:44.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.623+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d9407aef0 con 0x5563d0761610 2024-04-24T02:12:44.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.623+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563d0765700 con 0x7f8d9c031040 2024-04-24T02:12:44.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.623+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d9407aef0 con 0x7f8d9c031040 2024-04-24T02:12:44.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.623+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563d0765700 con 0x5563d0761610 2024-04-24T02:12:44.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.624+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d9407aef0 con 0x5563d0761610 2024-04-24T02:12:44.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.624+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563d0765700 con 0x7f8d98044b60 2024-04-24T02:12:44.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.624+0000 7f8da3f1f640 1 -- 172.21.15.134:0/2882557085 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8d9c01f070 con 0x7f8d98044b60 2024-04-24T02:12:44.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.624+0000 7f8da3f1f640 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563d0765700 con 0x5563d0767750 2024-04-24T02:12:44.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.624+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.624+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563d0765700 con 0x5563d0767750 2024-04-24T02:12:44.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.624+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.624+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563d0765700 con 0x7f8d9c031040 2024-04-24T02:12:44.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.624+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d9407aef0 con 0x7f8d9c031040 2024-04-24T02:12:44.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.625+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563d0765700 con 0x5563d0767750 2024-04-24T02:12:44.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.625+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.625+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563d0765700 con 0x5563d0767750 2024-04-24T02:12:44.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.625+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.625+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563d0765700 con 0x5563d0761610 2024-04-24T02:12:44.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.625+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d9407aef0 con 0x5563d0761610 2024-04-24T02:12:44.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.625+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563d0765700 con 0x5563d0761610 2024-04-24T02:12:44.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.625+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f8d9407aef0 con 0x5563d0761610 2024-04-24T02:12:44.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.625+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563d0765700 con 0x7f8d9c031040 2024-04-24T02:12:44.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.626+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d9407aef0 con 0x7f8d9c031040 2024-04-24T02:12:44.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.626+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563d0765700 con 0x5563d0767750 2024-04-24T02:12:44.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.626+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.626+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563d0765700 con 0x7f8d98044b60 2024-04-24T02:12:44.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.626+0000 7f8da3f1f640 1 -- 172.21.15.134:0/2882557085 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d9c01f070 con 0x7f8d98044b60 2024-04-24T02:12:44.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.626+0000 7f8da3f1f640 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563d0765700 con 0x5563d0761610 2024-04-24T02:12:44.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.626+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d9407aef0 con 0x5563d0761610 2024-04-24T02:12:44.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.626+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563d0765700 con 0x7f8d9c031040 2024-04-24T02:12:44.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.627+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d9407aef0 con 0x7f8d9c031040 2024-04-24T02:12:44.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.627+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563d0765700 con 0x5563d0767750 2024-04-24T02:12:44.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.627+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.627+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563d0765700 con 0x7f8d9c031040 2024-04-24T02:12:44.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.627+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d9407aef0 con 0x7f8d9c031040 2024-04-24T02:12:44.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.627+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563d0765700 con 0x7f8d98044b60 2024-04-24T02:12:44.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.628+0000 7f8da3f1f640 1 -- 172.21.15.134:0/2882557085 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d9c01f070 con 0x7f8d98044b60 2024-04-24T02:12:44.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.628+0000 7f8da3f1f640 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563d0765700 con 0x5563d0767750 2024-04-24T02:12:44.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.628+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.628+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5563d0765700 con 0x7f8d9c031040 2024-04-24T02:12:44.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.628+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d9407aef0 con 0x7f8d9c031040 2024-04-24T02:12:44.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.628+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f8d940a7040 con 0x5563d0761610 2024-04-24T02:12:44.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.628+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8d9407aef0 con 0x5563d0761610 2024-04-24T02:12:44.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.628+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f8d940a7040 con 0x7f8d98044b60 2024-04-24T02:12:44.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.629+0000 7f8da3f1f640 1 -- 172.21.15.134:0/2882557085 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d9c01f070 con 0x7f8d98044b60 2024-04-24T02:12:44.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.629+0000 7f8da5c1f800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:44.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.629+0000 7f8da5c1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:44.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.629+0000 7f8da5c1f800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:44.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.629+0000 7f8da5c1f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:44.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.629+0000 7f8da5c1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:44.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.629+0000 7f8da5c1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:44.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.629+0000 7f8da5c1f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:44.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.629+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d0765700 con 0x5563d0761610 2024-04-24T02:12:44.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.629+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8d9407aef0 con 0x5563d0761610 2024-04-24T02:12:44.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.629+0000 7f8da5c1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:44.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.629+0000 7f8da5c1f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:44.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.629+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d0766070 con 0x5563d0761610 2024-04-24T02:12:44.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.629+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8d9407aef0 con 0x5563d0761610 2024-04-24T02:12:44.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.629+0000 7f8da5c1f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:44.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.629+0000 7f8da5c1f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:44.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.629+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d0766070 con 0x5563d0761610 2024-04-24T02:12:44.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.629+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8d9407aef0 con 0x5563d0761610 2024-04-24T02:12:44.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.629+0000 7f8da5c1f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:44.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.629+0000 7f8da5c1f800 20 zone default found 2024-04-24T02:12:44.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.629+0000 7f8da5c1f800 4 Realm: () 2024-04-24T02:12:44.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.629+0000 7f8da5c1f800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:44.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.629+0000 7f8da5c1f800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:44.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.629+0000 7f8da5c1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:44.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.629+0000 7f8da5c1f800 20 zonegroup default 2024-04-24T02:12:44.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.629+0000 7f8da5c1f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:44.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.629+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d0766490 con 0x7f8d9c031040 2024-04-24T02:12:44.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.630+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8d9407aef0 con 0x7f8d9c031040 2024-04-24T02:12:44.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.630+0000 7f8da5c1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:44.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.630+0000 7f8da5c1f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:44.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.630+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d07668b0 con 0x5563d0767750 2024-04-24T02:12:44.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.630+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.630+0000 7f8da5c1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:44.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.630+0000 7f8da5c1f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:44.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.630+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d076c030 con 0x5563d0767750 2024-04-24T02:12:44.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.631+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.631+0000 7f8da5c1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:44.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.631+0000 7f8da5c1f800 20 started sync module instance, tier type = 2024-04-24T02:12:44.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.631+0000 7f8da5c1f800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:44.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.631+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d076b4d0 con 0x7f8d98044b60 2024-04-24T02:12:44.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.632+0000 7f8da3f1f640 1 -- 172.21.15.134:0/2882557085 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(44 notify.0 [create] v30'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d9c040040 con 0x7f8d98044b60 2024-04-24T02:12:44.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.632+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93887187562528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d076c3d0 con 0x7f8d98044b60 2024-04-24T02:12:44.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.632+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d076cc20 con 0x5563d0761610 2024-04-24T02:12:44.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.633+0000 7f8da3f1f640 1 -- 172.21.15.134:0/2882557085 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93887187562528] v30'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d9c040040 con 0x7f8d98044b60 2024-04-24T02:12:44.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.633+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v30'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d9407aef0 con 0x5563d0761610 2024-04-24T02:12:44.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.633+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93887187567568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d076cca0 con 0x5563d0761610 2024-04-24T02:12:44.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.633+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d076d530 con 0x5563d0767750 2024-04-24T02:12:44.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.634+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93887187567568] v30'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d9407aef0 con 0x5563d0761610 2024-04-24T02:12:44.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.634+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v30'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.634+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93887187569104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d076d920 con 0x5563d0767750 2024-04-24T02:12:44.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.634+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d076e340 con 0x7f8d98044b60 2024-04-24T02:12:44.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.635+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93887187569104] v30'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.635+0000 7f8da3f1f640 1 -- 172.21.15.134:0/2882557085 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(50 notify.3 [create] v30'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d9c040040 con 0x7f8d98044b60 2024-04-24T02:12:44.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.635+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93887187574320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d076e730 con 0x7f8d98044b60 2024-04-24T02:12:44.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.635+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d076f150 con 0x5563d0761610 2024-04-24T02:12:44.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.636+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v30'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d9407aef0 con 0x5563d0761610 2024-04-24T02:12:44.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.636+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93887187577920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d076f110 con 0x5563d0761610 2024-04-24T02:12:44.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.636+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d0770100 con 0x7f8d9c031040 2024-04-24T02:12:44.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.636+0000 7f8da3f1f640 1 -- 172.21.15.134:0/2882557085 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93887187574320] v30'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d9c040040 con 0x7f8d98044b60 2024-04-24T02:12:44.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.637+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93887187577920] v30'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d9407aef0 con 0x5563d0761610 2024-04-24T02:12:44.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.637+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(54 notify.5 [create] v30'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d9407aef0 con 0x7f8d9c031040 2024-04-24T02:12:44.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.637+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93887187581968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d0770100 con 0x7f8d9c031040 2024-04-24T02:12:44.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.637+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d0770580 con 0x7f8d9c031040 2024-04-24T02:12:44.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.639+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93887187581968] v30'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d9407aef0 con 0x7f8d9c031040 2024-04-24T02:12:44.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.639+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(56 notify.6 [create] v30'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d9407aef0 con 0x7f8d9c031040 2024-04-24T02:12:44.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.639+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93887187570352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d0770100 con 0x7f8d9c031040 2024-04-24T02:12:44.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.639+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d0771010 con 0x7f8d9c031040 2024-04-24T02:12:44.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.640+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93887187570352] v30'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d9407aef0 con 0x7f8d9c031040 2024-04-24T02:12:44.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.640+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(58 notify.7 [create] v30'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d9407aef0 con 0x7f8d9c031040 2024-04-24T02:12:44.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.640+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93887187584320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d0771010 con 0x7f8d9c031040 2024-04-24T02:12:44.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.640+0000 7f8da5c1f800 20 add_watcher() i=0 2024-04-24T02:12:44.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.640+0000 7f8da5c1f800 20 add_watcher() i=1 2024-04-24T02:12:44.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.640+0000 7f8da5c1f800 20 add_watcher() i=2 2024-04-24T02:12:44.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.640+0000 7f8da5c1f800 20 add_watcher() i=3 2024-04-24T02:12:44.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.640+0000 7f8da5c1f800 20 add_watcher() i=4 2024-04-24T02:12:44.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.640+0000 7f8da5c1f800 20 add_watcher() i=5 2024-04-24T02:12:44.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.640+0000 7f8da5c1f800 20 add_watcher() i=6 2024-04-24T02:12:44.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.641+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93887187584320] v30'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d9407aef0 con 0x7f8d9c031040 2024-04-24T02:12:44.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.641+0000 7f8da5c1f800 20 add_watcher() i=7 2024-04-24T02:12:44.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.641+0000 7f8da5c1f800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:44.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.641+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d07742d0 con 0x5563d0761610 2024-04-24T02:12:44.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.641+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8d9407aef0 con 0x5563d0761610 2024-04-24T02:12:44.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.641+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93887187586256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d07715a0 con 0x5563d0761610 2024-04-24T02:12:44.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.642+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93887187586256] v30'175 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8d9407aef0 con 0x5563d0761610 2024-04-24T02:12:44.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.642+0000 7f8c59fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:44.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.642+0000 7f8da5c1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:44.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.642+0000 7f8da5c1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:44.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.642+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d07738c0 con 0x5563d0761610 2024-04-24T02:12:44.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.643+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'52 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8d9407aef0 con 0x5563d0761610 2024-04-24T02:12:44.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.643+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d0773830 con 0x7f8d9c031040 2024-04-24T02:12:44.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.644+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'29 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8d9407aef0 con 0x7f8d9c031040 2024-04-24T02:12:44.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.644+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d0773830 con 0x5563d0767750 2024-04-24T02:12:44.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.645+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.645+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d077d390 con 0x5563d0761610 2024-04-24T02:12:44.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.646+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'176 uv169 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8d9407aef0 con 0x5563d0761610 2024-04-24T02:12:44.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.646+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d077d390 con 0x7f8d98044b60 2024-04-24T02:12:44.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.647+0000 7f8da3f1f640 1 -- 172.21.15.134:0/2882557085 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'64 uv58 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8d9c040040 con 0x7f8d98044b60 2024-04-24T02:12:44.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.647+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d077d390 con 0x5563d0767750 2024-04-24T02:12:44.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.648+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'51 uv48 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.648+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d077ddb0 con 0x5563d0761610 2024-04-24T02:12:44.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.650+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8d9407aef0 con 0x5563d0761610 2024-04-24T02:12:44.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.650+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d077ddb0 con 0x7f8d9c031040 2024-04-24T02:12:44.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.651+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'44 uv41 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8d9407aef0 con 0x7f8d9c031040 2024-04-24T02:12:44.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.651+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d077ddb0 con 0x7f8d98044b60 2024-04-24T02:12:44.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.652+0000 7f8da3f1f640 1 -- 172.21.15.134:0/2882557085 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8d9c040040 con 0x7f8d98044b60 2024-04-24T02:12:44.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.652+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d077e1b0 con 0x5563d0767750 2024-04-24T02:12:44.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.652+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.653+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d077e1b0 con 0x7f8d98044b60 2024-04-24T02:12:44.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.653+0000 7f8da3f1f640 1 -- 172.21.15.134:0/2882557085 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'65 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d9c040040 con 0x7f8d98044b60 2024-04-24T02:12:44.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.653+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d077e720 con 0x7f8d9c031040 2024-04-24T02:12:44.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.654+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'25 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d9407aef0 con 0x7f8d9c031040 2024-04-24T02:12:44.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.654+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d077e720 con 0x7f8d98044b60 2024-04-24T02:12:44.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.655+0000 7f8da3f1f640 1 -- 172.21.15.134:0/2882557085 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d9c040040 con 0x7f8d98044b60 2024-04-24T02:12:44.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.655+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d077ebd0 con 0x7f8d9c031040 2024-04-24T02:12:44.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.656+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.0 v2:172.21.15.104:6800/2419146313 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'55 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d9407aef0 con 0x7f8d9c031040 2024-04-24T02:12:44.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.656+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d077ebd0 con 0x5563d0761610 2024-04-24T02:12:44.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.657+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'177 uv171 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d9407aef0 con 0x5563d0761610 2024-04-24T02:12:44.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.657+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d077ebd0 con 0x5563d0767750 2024-04-24T02:12:44.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.658+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'56 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.658+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d077ebd0 con 0x7f8d98044b60 2024-04-24T02:12:44.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.659+0000 7f8da3f1f640 1 -- 172.21.15.134:0/2882557085 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'66 uv63 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d9c040040 con 0x7f8d98044b60 2024-04-24T02:12:44.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.659+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d077ebd0 con 0x5563d0767750 2024-04-24T02:12:44.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.660+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'34 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.660+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d077ebd0 con 0x5563d0761610 2024-04-24T02:12:44.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.661+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d9407aef0 con 0x5563d0761610 2024-04-24T02:12:44.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.661+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d077ebd0 con 0x5563d0761610 2024-04-24T02:12:44.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.662+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'178 uv173 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d9407aef0 con 0x5563d0761610 2024-04-24T02:12:44.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.662+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d077ebd0 con 0x5563d0767750 2024-04-24T02:12:44.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.663+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'57 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.663+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d077ebd0 con 0x7f8d98044b60 2024-04-24T02:12:44.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.664+0000 7f8da3f1f640 1 -- 172.21.15.134:0/2882557085 <== osd.2 v2:172.21.15.134:6800/214480313 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'38 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d9c040040 con 0x7f8d98044b60 2024-04-24T02:12:44.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.664+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d077ebd0 con 0x5563d0767750 2024-04-24T02:12:44.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.665+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.665+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d077ebd0 con 0x5563d0767750 2024-04-24T02:12:44.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.666+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'40 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.666+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d077ebd0 con 0x5563d0767750 2024-04-24T02:12:44.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.667+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.667+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d077ebd0 con 0x5563d0767750 2024-04-24T02:12:44.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.668+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'52 uv50 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.668+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d077ebd0 con 0x7f8d9c031040 2024-04-24T02:12:44.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.669+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.0 v2:172.21.15.104:6800/2419146313 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d9407aef0 con 0x7f8d9c031040 2024-04-24T02:12:44.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.669+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d077ebd0 con 0x5563d0767750 2024-04-24T02:12:44.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.670+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'34 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.670+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d077ebd0 con 0x7f8d9c031040 2024-04-24T02:12:44.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.671+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.0 v2:172.21.15.104:6800/2419146313 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'45 uv43 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d9407aef0 con 0x7f8d9c031040 2024-04-24T02:12:44.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.671+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d077ebd0 con 0x5563d0767750 2024-04-24T02:12:44.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.672+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'58 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.672+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d077ebd0 con 0x7f8d9c031040 2024-04-24T02:12:44.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.673+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.0 v2:172.21.15.104:6800/2419146313 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'56 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d9407aef0 con 0x7f8d9c031040 2024-04-24T02:12:44.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.673+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d077ebd0 con 0x7f8d98044b60 2024-04-24T02:12:44.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.674+0000 7f8da3f1f640 1 -- 172.21.15.134:0/2882557085 <== osd.2 v2:172.21.15.134:6800/214480313 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d9c040040 con 0x7f8d98044b60 2024-04-24T02:12:44.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.674+0000 7f8c58fe1640 20 reqs_thread_entry: start 2024-04-24T02:12:44.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.675+0000 7f8da5c1f800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:44.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.675+0000 7f8da5c1f800 20 Filter name: none 2024-04-24T02:12:44.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.675+0000 7f8bd27fc640 20 reqs_thread_entry: start 2024-04-24T02:12:44.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.675+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0761610 2024-04-24T02:12:44.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.675+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8d9407aef0 con 0x5563d0761610 2024-04-24T02:12:44.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.675+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0761610 2024-04-24T02:12:44.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.675+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.1 v2:172.21.15.134:6804/1487076214 30 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv51 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8d9407aef0 con 0x5563d0761610 2024-04-24T02:12:44.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.675+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0761610 2024-04-24T02:12:44.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.676+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.1 v2:172.21.15.134:6804/1487076214 31 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8d9407aef0 con 0x5563d0761610 2024-04-24T02:12:44.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.676+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x7f8d9c031040 2024-04-24T02:12:44.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.676+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.0 v2:172.21.15.104:6800/2419146313 24 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8d9407aef0 con 0x7f8d9c031040 2024-04-24T02:12:44.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.676+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x7f8d9c031040 2024-04-24T02:12:44.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.676+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.0 v2:172.21.15.104:6800/2419146313 25 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv28 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8d9407aef0 con 0x7f8d9c031040 2024-04-24T02:12:44.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.676+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x7f8d9c031040 2024-04-24T02:12:44.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.677+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.0 v2:172.21.15.104:6800/2419146313 26 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8d9407aef0 con 0x7f8d9c031040 2024-04-24T02:12:44.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.677+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0767750 2024-04-24T02:12:44.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.677+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.677+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0767750 2024-04-24T02:12:44.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.677+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.677+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0767750 2024-04-24T02:12:44.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.677+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.677+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0761610 2024-04-24T02:12:44.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.678+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.1 v2:172.21.15.134:6804/1487076214 32 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv169 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8d9407aef0 con 0x5563d0761610 2024-04-24T02:12:44.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.678+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0761610 2024-04-24T02:12:44.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.678+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.1 v2:172.21.15.134:6804/1487076214 33 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv169 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8d9407aef0 con 0x5563d0761610 2024-04-24T02:12:44.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.678+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0761610 2024-04-24T02:12:44.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.678+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.1 v2:172.21.15.134:6804/1487076214 34 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv169 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8d9407aef0 con 0x5563d0761610 2024-04-24T02:12:44.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.678+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x7f8d98044b60 2024-04-24T02:12:44.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.678+0000 7f8da3f1f640 1 -- 172.21.15.134:0/2882557085 <== osd.2 v2:172.21.15.134:6800/214480313 18 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv58 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8d9c040040 con 0x7f8d98044b60 2024-04-24T02:12:44.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.678+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x7f8d98044b60 2024-04-24T02:12:44.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.678+0000 7f8da3f1f640 1 -- 172.21.15.134:0/2882557085 <== osd.2 v2:172.21.15.134:6800/214480313 19 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv58 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8d9c040040 con 0x7f8d98044b60 2024-04-24T02:12:44.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.678+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x7f8d98044b60 2024-04-24T02:12:44.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.679+0000 7f8da3f1f640 1 -- 172.21.15.134:0/2882557085 <== osd.2 v2:172.21.15.134:6800/214480313 20 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv58 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8d9c040040 con 0x7f8d98044b60 2024-04-24T02:12:44.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.679+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0767750 2024-04-24T02:12:44.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.679+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv48 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.679+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0767750 2024-04-24T02:12:44.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.679+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv48 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.679+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0767750 2024-04-24T02:12:44.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.680+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv48 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.680+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0761610 2024-04-24T02:12:44.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.680+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.1 v2:172.21.15.134:6804/1487076214 35 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv29 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8d9407aef0 con 0x5563d0761610 2024-04-24T02:12:44.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.680+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0761610 2024-04-24T02:12:44.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.680+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.1 v2:172.21.15.134:6804/1487076214 36 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv29 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8d9407aef0 con 0x5563d0761610 2024-04-24T02:12:44.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.680+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0761610 2024-04-24T02:12:44.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.680+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.1 v2:172.21.15.134:6804/1487076214 37 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv29 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8d9407aef0 con 0x5563d0761610 2024-04-24T02:12:44.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.680+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x7f8d9c031040 2024-04-24T02:12:44.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.681+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.0 v2:172.21.15.104:6800/2419146313 27 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv41 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8d9407aef0 con 0x7f8d9c031040 2024-04-24T02:12:44.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.681+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x7f8d9c031040 2024-04-24T02:12:44.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.681+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.0 v2:172.21.15.104:6800/2419146313 28 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv41 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8d9407aef0 con 0x7f8d9c031040 2024-04-24T02:12:44.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.681+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x7f8d9c031040 2024-04-24T02:12:44.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.681+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.0 v2:172.21.15.104:6800/2419146313 29 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv41 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8d9407aef0 con 0x7f8d9c031040 2024-04-24T02:12:44.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.681+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x7f8d98044b60 2024-04-24T02:12:44.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.682+0000 7f8da3f1f640 1 -- 172.21.15.134:0/2882557085 <== osd.2 v2:172.21.15.134:6800/214480313 21 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8d9c040040 con 0x7f8d98044b60 2024-04-24T02:12:44.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.682+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x7f8d98044b60 2024-04-24T02:12:44.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.682+0000 7f8da3f1f640 1 -- 172.21.15.134:0/2882557085 <== osd.2 v2:172.21.15.134:6800/214480313 22 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8d9c040040 con 0x7f8d98044b60 2024-04-24T02:12:44.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.682+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x7f8d98044b60 2024-04-24T02:12:44.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.682+0000 7f8da3f1f640 1 -- 172.21.15.134:0/2882557085 <== osd.2 v2:172.21.15.134:6800/214480313 23 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8d9c040040 con 0x7f8d98044b60 2024-04-24T02:12:44.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.682+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0767750 2024-04-24T02:12:44.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.682+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.682+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0767750 2024-04-24T02:12:44.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.682+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.683+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0767750 2024-04-24T02:12:44.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.683+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.683+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x7f8d98044b60 2024-04-24T02:12:44.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.683+0000 7f8da3f1f640 1 -- 172.21.15.134:0/2882557085 <== osd.2 v2:172.21.15.134:6800/214480313 24 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv61 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d9c040040 con 0x7f8d98044b60 2024-04-24T02:12:44.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.683+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x7f8d98044b60 2024-04-24T02:12:44.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.683+0000 7f8da3f1f640 1 -- 172.21.15.134:0/2882557085 <== osd.2 v2:172.21.15.134:6800/214480313 25 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv61 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8d9c040040 con 0x7f8d98044b60 2024-04-24T02:12:44.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.683+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x7f8d98044b60 2024-04-24T02:12:44.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.683+0000 7f8da3f1f640 1 -- 172.21.15.134:0/2882557085 <== osd.2 v2:172.21.15.134:6800/214480313 26 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv61 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d9c040040 con 0x7f8d98044b60 2024-04-24T02:12:44.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.684+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x7f8d9c031040 2024-04-24T02:12:44.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.684+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.0 v2:172.21.15.104:6800/2419146313 30 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d9407aef0 con 0x7f8d9c031040 2024-04-24T02:12:44.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.684+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x7f8d9c031040 2024-04-24T02:12:44.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.684+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.0 v2:172.21.15.104:6800/2419146313 31 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv24 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8d9407aef0 con 0x7f8d9c031040 2024-04-24T02:12:44.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.684+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x7f8d9c031040 2024-04-24T02:12:44.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.684+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.0 v2:172.21.15.104:6800/2419146313 32 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d9407aef0 con 0x7f8d9c031040 2024-04-24T02:12:44.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.684+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x7f8d98044b60 2024-04-24T02:12:44.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.685+0000 7f8da3f1f640 1 -- 172.21.15.134:0/2882557085 <== osd.2 v2:172.21.15.134:6800/214480313 27 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d9c040040 con 0x7f8d98044b60 2024-04-24T02:12:44.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.685+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x7f8d98044b60 2024-04-24T02:12:44.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.685+0000 7f8da3f1f640 1 -- 172.21.15.134:0/2882557085 <== osd.2 v2:172.21.15.134:6800/214480313 28 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8d9c040040 con 0x7f8d98044b60 2024-04-24T02:12:44.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.685+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x7f8d98044b60 2024-04-24T02:12:44.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.685+0000 7f8da3f1f640 1 -- 172.21.15.134:0/2882557085 <== osd.2 v2:172.21.15.134:6800/214480313 29 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d9c040040 con 0x7f8d98044b60 2024-04-24T02:12:44.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.685+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x7f8d9c031040 2024-04-24T02:12:44.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.685+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.0 v2:172.21.15.104:6800/2419146313 33 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d9407aef0 con 0x7f8d9c031040 2024-04-24T02:12:44.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.685+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x7f8d9c031040 2024-04-24T02:12:44.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.686+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.0 v2:172.21.15.104:6800/2419146313 34 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv52 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8d9407aef0 con 0x7f8d9c031040 2024-04-24T02:12:44.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.686+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x7f8d9c031040 2024-04-24T02:12:44.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.686+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.0 v2:172.21.15.104:6800/2419146313 35 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d9407aef0 con 0x7f8d9c031040 2024-04-24T02:12:44.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.686+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0761610 2024-04-24T02:12:44.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.686+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.1 v2:172.21.15.134:6804/1487076214 38 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv171 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d9407aef0 con 0x5563d0761610 2024-04-24T02:12:44.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.686+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0761610 2024-04-24T02:12:44.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.686+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.1 v2:172.21.15.134:6804/1487076214 39 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv171 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8d9407aef0 con 0x5563d0761610 2024-04-24T02:12:44.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.686+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0761610 2024-04-24T02:12:44.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.687+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.1 v2:172.21.15.134:6804/1487076214 40 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv171 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d9407aef0 con 0x5563d0761610 2024-04-24T02:12:44.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.687+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0767750 2024-04-24T02:12:44.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.687+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.687+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0767750 2024-04-24T02:12:44.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.687+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv51 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.687+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0767750 2024-04-24T02:12:44.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.687+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.687+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x7f8d98044b60 2024-04-24T02:12:44.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.688+0000 7f8da3f1f640 1 -- 172.21.15.134:0/2882557085 <== osd.2 v2:172.21.15.134:6800/214480313 30 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv63 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d9c040040 con 0x7f8d98044b60 2024-04-24T02:12:44.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.688+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x7f8d98044b60 2024-04-24T02:12:44.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.688+0000 7f8da3f1f640 1 -- 172.21.15.134:0/2882557085 <== osd.2 v2:172.21.15.134:6800/214480313 31 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv63 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8d9c040040 con 0x7f8d98044b60 2024-04-24T02:12:44.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.688+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x7f8d98044b60 2024-04-24T02:12:44.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.688+0000 7f8da3f1f640 1 -- 172.21.15.134:0/2882557085 <== osd.2 v2:172.21.15.134:6800/214480313 32 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv63 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d9c040040 con 0x7f8d98044b60 2024-04-24T02:12:44.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.688+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0767750 2024-04-24T02:12:44.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.688+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.688+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0767750 2024-04-24T02:12:44.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.689+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.689+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0767750 2024-04-24T02:12:44.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.689+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.689+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0761610 2024-04-24T02:12:44.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.689+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.1 v2:172.21.15.134:6804/1487076214 41 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d9407aef0 con 0x5563d0761610 2024-04-24T02:12:44.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.689+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0761610 2024-04-24T02:12:44.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.689+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.1 v2:172.21.15.134:6804/1487076214 42 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8d9407aef0 con 0x5563d0761610 2024-04-24T02:12:44.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.689+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0761610 2024-04-24T02:12:44.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.690+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.1 v2:172.21.15.134:6804/1487076214 43 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d9407aef0 con 0x5563d0761610 2024-04-24T02:12:44.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.690+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0761610 2024-04-24T02:12:44.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.690+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.1 v2:172.21.15.134:6804/1487076214 44 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv173 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d9407aef0 con 0x5563d0761610 2024-04-24T02:12:44.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.690+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0761610 2024-04-24T02:12:44.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.690+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.1 v2:172.21.15.134:6804/1487076214 45 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv173 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8d9407aef0 con 0x5563d0761610 2024-04-24T02:12:44.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.690+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0761610 2024-04-24T02:12:44.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.690+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.1 v2:172.21.15.134:6804/1487076214 46 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv173 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d9407aef0 con 0x5563d0761610 2024-04-24T02:12:44.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.690+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0767750 2024-04-24T02:12:44.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.690+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.691+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0767750 2024-04-24T02:12:44.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.691+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv53 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.691+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0767750 2024-04-24T02:12:44.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.691+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.691+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x7f8d98044b60 2024-04-24T02:12:44.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.691+0000 7f8da3f1f640 1 -- 172.21.15.134:0/2882557085 <== osd.2 v2:172.21.15.134:6800/214480313 33 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv37 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d9c040040 con 0x7f8d98044b60 2024-04-24T02:12:44.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.691+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x7f8d98044b60 2024-04-24T02:12:44.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.691+0000 7f8da3f1f640 1 -- 172.21.15.134:0/2882557085 <== osd.2 v2:172.21.15.134:6800/214480313 34 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv37 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8d9c040040 con 0x7f8d98044b60 2024-04-24T02:12:44.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.691+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x7f8d98044b60 2024-04-24T02:12:44.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.692+0000 7f8da3f1f640 1 -- 172.21.15.134:0/2882557085 <== osd.2 v2:172.21.15.134:6800/214480313 35 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv37 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d9c040040 con 0x7f8d98044b60 2024-04-24T02:12:44.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.692+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0767750 2024-04-24T02:12:44.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.692+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.692+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0767750 2024-04-24T02:12:44.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.692+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.692+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0767750 2024-04-24T02:12:44.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.692+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.692+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0767750 2024-04-24T02:12:44.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.693+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.693+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0767750 2024-04-24T02:12:44.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.693+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.693+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0767750 2024-04-24T02:12:44.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.693+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.693+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0767750 2024-04-24T02:12:44.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.693+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.693+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0767750 2024-04-24T02:12:44.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.693+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.694+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0767750 2024-04-24T02:12:44.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.694+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.694+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0767750 2024-04-24T02:12:44.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.694+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.694+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0767750 2024-04-24T02:12:44.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.694+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv50 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.694+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0767750 2024-04-24T02:12:44.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.694+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.694+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x7f8d9c031040 2024-04-24T02:12:44.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.695+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.0 v2:172.21.15.104:6800/2419146313 36 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d9407aef0 con 0x7f8d9c031040 2024-04-24T02:12:44.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.695+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x7f8d9c031040 2024-04-24T02:12:44.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.695+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.0 v2:172.21.15.104:6800/2419146313 37 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8d9407aef0 con 0x7f8d9c031040 2024-04-24T02:12:44.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.695+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x7f8d9c031040 2024-04-24T02:12:44.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.695+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.0 v2:172.21.15.104:6800/2419146313 38 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d9407aef0 con 0x7f8d9c031040 2024-04-24T02:12:44.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.695+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0767750 2024-04-24T02:12:44.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.695+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.695+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0767750 2024-04-24T02:12:44.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.696+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.696+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0767750 2024-04-24T02:12:44.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.696+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.696+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x7f8d9c031040 2024-04-24T02:12:44.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.696+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.0 v2:172.21.15.104:6800/2419146313 39 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d9407aef0 con 0x7f8d9c031040 2024-04-24T02:12:44.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.696+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x7f8d9c031040 2024-04-24T02:12:44.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.696+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.0 v2:172.21.15.104:6800/2419146313 40 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv43 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8d9407aef0 con 0x7f8d9c031040 2024-04-24T02:12:44.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.697+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x7f8d9c031040 2024-04-24T02:12:44.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.697+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.0 v2:172.21.15.104:6800/2419146313 41 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d9407aef0 con 0x7f8d9c031040 2024-04-24T02:12:44.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.697+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0767750 2024-04-24T02:12:44.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.697+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.697+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0767750 2024-04-24T02:12:44.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.697+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv55 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.697+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x5563d0767750 2024-04-24T02:12:44.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.697+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.697+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x7f8d9c031040 2024-04-24T02:12:44.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.698+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.0 v2:172.21.15.104:6800/2419146313 42 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d9407aef0 con 0x7f8d9c031040 2024-04-24T02:12:44.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.698+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x7f8d9c031040 2024-04-24T02:12:44.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.698+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.0 v2:172.21.15.104:6800/2419146313 43 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv54 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8d9407aef0 con 0x7f8d9c031040 2024-04-24T02:12:44.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.698+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x7f8d9c031040 2024-04-24T02:12:44.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.698+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.0 v2:172.21.15.104:6800/2419146313 44 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d9407aef0 con 0x7f8d9c031040 2024-04-24T02:12:44.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.698+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x7f8d98044b60 2024-04-24T02:12:44.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.699+0000 7f8da3f1f640 1 -- 172.21.15.134:0/2882557085 <== osd.2 v2:172.21.15.134:6800/214480313 36 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d9c040040 con 0x7f8d98044b60 2024-04-24T02:12:44.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.699+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x7f8d98044b60 2024-04-24T02:12:44.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.699+0000 7f8da3f1f640 1 -- 172.21.15.134:0/2882557085 <== osd.2 v2:172.21.15.134:6800/214480313 37 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8d9c040040 con 0x7f8d98044b60 2024-04-24T02:12:44.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.699+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cf00 con 0x7f8d98044b60 2024-04-24T02:12:44.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.699+0000 7f8da3f1f640 1 -- 172.21.15.134:0/2882557085 <== osd.2 v2:172.21.15.134:6800/214480313 38 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8d9c040040 con 0x7f8d98044b60 2024-04-24T02:12:44.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.700+0000 7f8c59fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:44.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.700+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93887187586256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d077cea0 con 0x5563d0761610 2024-04-24T02:12:44.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.701+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.1 v2:172.21.15.134:6804/1487076214 47 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 93887187586256] v30'179 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8d9407aef0 con 0x5563d0761610 2024-04-24T02:12:44.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.701+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93887187562528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d0770cd0 con 0x7f8d98044b60 2024-04-24T02:12:44.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.702+0000 7f8da3f1f640 1 -- 172.21.15.134:0/2882557085 <== osd.2 v2:172.21.15.134:6800/214480313 39 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 93887187562528] v30'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d9c040040 con 0x7f8d98044b60 2024-04-24T02:12:44.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.702+0000 7f8da5c1f800 20 remove_watcher() i=0 2024-04-24T02:12:44.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.702+0000 7f8da5c1f800 2 removed watcher, disabling cache 2024-04-24T02:12:44.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.702+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93887187567568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d0770cd0 con 0x5563d0761610 2024-04-24T02:12:44.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.703+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.1 v2:172.21.15.134:6804/1487076214 48 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 93887187567568] v30'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d9407aef0 con 0x5563d0761610 2024-04-24T02:12:44.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.703+0000 7f8da5c1f800 20 remove_watcher() i=1 2024-04-24T02:12:44.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.703+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93887187569104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d076c3d0 con 0x5563d0767750 2024-04-24T02:12:44.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.704+0000 7f8da2f1d640 1 -- 172.21.15.134:0/2882557085 <== osd.3 v2:172.21.15.134:6801/3585115521 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 93887187569104] v30'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d98009050 con 0x5563d0767750 2024-04-24T02:12:44.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.704+0000 7f8da5c1f800 20 remove_watcher() i=2 2024-04-24T02:12:44.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.704+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93887187574320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d0770cd0 con 0x7f8d98044b60 2024-04-24T02:12:44.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.705+0000 7f8da3f1f640 1 -- 172.21.15.134:0/2882557085 <== osd.2 v2:172.21.15.134:6800/214480313 40 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 93887187574320] v30'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d9c040040 con 0x7f8d98044b60 2024-04-24T02:12:44.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.705+0000 7f8da5c1f800 20 remove_watcher() i=3 2024-04-24T02:12:44.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.705+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93887187577920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d076c9d0 con 0x5563d0761610 2024-04-24T02:12:44.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.706+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.1 v2:172.21.15.134:6804/1487076214 49 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 93887187577920] v30'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d9407aef0 con 0x5563d0761610 2024-04-24T02:12:44.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.706+0000 7f8da5c1f800 20 remove_watcher() i=4 2024-04-24T02:12:44.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.706+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93887187581968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d076c3d0 con 0x7f8d9c031040 2024-04-24T02:12:44.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.707+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.0 v2:172.21.15.104:6800/2419146313 45 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 93887187581968] v30'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d9407aef0 con 0x7f8d9c031040 2024-04-24T02:12:44.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.707+0000 7f8da5c1f800 20 remove_watcher() i=5 2024-04-24T02:12:44.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.707+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93887187570352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d076de30 con 0x7f8d9c031040 2024-04-24T02:12:44.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.708+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.0 v2:172.21.15.104:6800/2419146313 46 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 93887187570352] v30'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d9407aef0 con 0x7f8d9c031040 2024-04-24T02:12:44.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.708+0000 7f8da5c1f800 20 remove_watcher() i=6 2024-04-24T02:12:44.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.708+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93887187584320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5563d0770cd0 con 0x7f8d9c031040 2024-04-24T02:12:44.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.709+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 <== osd.0 v2:172.21.15.104:6800/2419146313 47 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 93887187584320] v30'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d9407aef0 con 0x7f8d9c031040 2024-04-24T02:12:44.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.709+0000 7f8da5c1f800 20 remove_watcher() i=7 2024-04-24T02:12:44.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.709+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f8d9c031040 msgr2=0x7f8d9c032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:44.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.709+0000 7f8da5c1f800 1 --2- 172.21.15.134:0/2882557085 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f8d9c031040 0x7f8d9c032430 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.709+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5563d0761610 msgr2=0x5563d0763ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:44.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.709+0000 7f8da5c1f800 1 --2- 172.21.15.134:0/2882557085 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5563d0761610 0x5563d0763ad0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.709+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f8d98044b60 msgr2=0x7f8d98051a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:44.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.709+0000 7f8da5c1f800 1 --2- 172.21.15.134:0/2882557085 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f8d98044b60 0x7f8d98051a10 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.709+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5563d0767750 msgr2=0x5563d0769b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:44.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.709+0000 7f8da5c1f800 1 --2- 172.21.15.134:0/2882557085 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5563d0767750 0x5563d0769b40 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.710+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8c6c036900 msgr2=0x7f8c6c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:44.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.710+0000 7f8da5c1f800 1 --2- 172.21.15.134:0/2882557085 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8c6c036900 0x7f8c6c038dc0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x5563d0728fd0 tx=0x7f8d9c01f000 comp rx=0 tx=0).stop 2024-04-24T02:12:44.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.710+0000 7f8da371e640 1 -- 172.21.15.134:0/2882557085 reap_dead start 2024-04-24T02:12:44.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.710+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563d05a2840 msgr2=0x5563d0755cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:44.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.710+0000 7f8da5c1f800 1 --2- 172.21.15.134:0/2882557085 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563d05a2840 0x5563d0755cf0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f8d98019d20 tx=0x7f8d9804cda0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.710+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 shutdown_connections 2024-04-24T02:12:44.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.710+0000 7f8da5c1f800 1 --2- 172.21.15.134:0/2882557085 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563d05a2840 0x5563d0755cf0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.710+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 >> 172.21.15.134:0/2882557085 conn(0x5563d07498a0 msgr2=0x5563d0746f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:44.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.710+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 shutdown_connections 2024-04-24T02:12:44.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.710+0000 7f8da5c1f800 1 -- 172.21.15.134:0/2882557085 wait complete. 2024-04-24T02:12:44.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.710+0000 7f8da5c1f800 1 -- 172.21.15.134:0/4258592273 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8c7c036950 msgr2=0x7f8c7c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:44.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.710+0000 7f8da5c1f800 1 --2- 172.21.15.134:0/4258592273 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8c7c036950 0x7f8c7c038e10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x5563d0730290 tx=0x7f8d9c005840 comp rx=0 tx=0).stop 2024-04-24T02:12:44.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.710+0000 7f8da5c1f800 1 -- 172.21.15.134:0/4258592273 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563d0740200 msgr2=0x5563d0740620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:44.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.710+0000 7f8da5c1f800 1 --2- 172.21.15.134:0/4258592273 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563d0740200 0x5563d0740620 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f8d98001ed0 tx=0x7f8d9800d7a0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.710+0000 7f8da5c1f800 1 -- 172.21.15.134:0/4258592273 shutdown_connections 2024-04-24T02:12:44.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.710+0000 7f8da5c1f800 1 --2- 172.21.15.134:0/4258592273 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8c7c036950 0x7f8c7c038e10 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.710+0000 7f8da5c1f800 1 --2- 172.21.15.134:0/4258592273 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563d0740200 0x5563d0740620 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.710+0000 7f8da5c1f800 1 -- 172.21.15.134:0/4258592273 >> 172.21.15.134:0/4258592273 conn(0x5563d07342a0 msgr2=0x5563d07346a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:44.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.710+0000 7f8da5c1f800 1 -- 172.21.15.134:0/4258592273 shutdown_connections 2024-04-24T02:12:44.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.710+0000 7f8da5c1f800 1 -- 172.21.15.134:0/4258592273 wait complete. 2024-04-24T02:12:44.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.710+0000 7f8da5c1f800 1 -- 172.21.15.134:0/3094825853 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5563d062ff80 msgr2=0x5563d072eff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:44.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.710+0000 7f8da5c1f800 1 --2- 172.21.15.134:0/3094825853 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5563d062ff80 0x5563d072eff0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.710+0000 7f8da5c1f800 1 -- 172.21.15.134:0/3094825853 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8c88036900 msgr2=0x7f8c88038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:44.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.710+0000 7f8da5c1f800 1 --2- 172.21.15.134:0/3094825853 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8c88036900 0x7f8c88038dc0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8d98000f60 tx=0x7f8d980012b0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.710+0000 7f8da5c1f800 1 -- 172.21.15.134:0/3094825853 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563d062ed20 msgr2=0x5563d0727db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:44.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.710+0000 7f8da5c1f800 1 --2- 172.21.15.134:0/3094825853 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563d062ed20 0x5563d0727db0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f8d94055040 tx=0x7f8d94002fb0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.711+0000 7f8da5c1f800 1 -- 172.21.15.134:0/3094825853 shutdown_connections 2024-04-24T02:12:44.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.711+0000 7f8da5c1f800 1 --2- 172.21.15.134:0/3094825853 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5563d062ff80 0x5563d072eff0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.711+0000 7f8da5c1f800 1 --2- 172.21.15.134:0/3094825853 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8c88036900 0x7f8c88038dc0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.711+0000 7f8da5c1f800 1 --2- 172.21.15.134:0/3094825853 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5563d062ed20 0x5563d0727db0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.711+0000 7f8da5c1f800 1 -- 172.21.15.134:0/3094825853 >> 172.21.15.134:0/3094825853 conn(0x5563d062a380 msgr2=0x5563d071a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:44.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.711+0000 7f8da5c1f800 1 -- 172.21.15.134:0/3094825853 shutdown_connections 2024-04-24T02:12:44.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.711+0000 7f8da5c1f800 1 -- 172.21.15.134:0/3094825853 wait complete. 2024-04-24T02:12:44.724 INFO:teuthology.orchestra.run.smithi134.stdout:[] 2024-04-24T02:12:44.724 DEBUG:tasks.util.rgw: json result: [] 2024-04-24T02:12:44.724 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-04-24T02:12:44.724 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-04-24T02:12:44.724 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-04-24T02:12:44.814 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:44.814 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:44.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.813+0000 7efe56b36800 1 Processor -- start 2024-04-24T02:12:44.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.813+0000 7efe56b36800 1 -- start start 2024-04-24T02:12:44.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.813+0000 7efe56b36800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5651c9fce090 0x5651c9fce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.813+0000 7efe56b36800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5651c9e8ad40 con 0x5651c9fcf2a0 2024-04-24T02:12:44.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.813+0000 7efe56b36800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x5651c9e5d4d0 con 0x5651c9fce090 2024-04-24T02:12:44.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.814+0000 7efe528cc640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5651c9fce090 0x5651c9fce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.814+0000 7efe520cb640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x5651c9fcf2a0 0x5651c9fcf720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:36572/0 (socket says 172.21.15.134:36572) 2024-04-24T02:12:44.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.814+0000 7efe528cc640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5651c9fce090 0x5651c9fce4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:40688/0 (socket says 172.21.15.134:40688) 2024-04-24T02:12:44.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.814+0000 7efe520cb640 1 -- 172.21.15.134:0/2469964408 learned_addr learned my addr 172.21.15.134:0/2469964408 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:12:44.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.814+0000 7efe528cc640 1 -- 172.21.15.134:0/2469964408 >> v1:172.21.15.104:6789/0 conn(0x5651c9fcf2a0 legacy=0x5651c9fcf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:44.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.814+0000 7efe528cc640 1 -- 172.21.15.134:0/2469964408 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651c9e89590 con 0x5651c9fce090 2024-04-24T02:12:44.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.816+0000 7efe528cc640 1 --2- 172.21.15.134:0/2469964408 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651c9fce090 0x5651c9fce4b0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7efe4400a470 tx=0x7efe4401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=464be25ea6c71985 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.816+0000 7efe518ca640 1 -- 172.21.15.134:0/2469964408 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe44057070 con 0x5651c9fce090 2024-04-24T02:12:44.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.816+0000 7efe518ca640 1 -- 172.21.15.134:0/2469964408 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe44052570 con 0x5651c9fce090 2024-04-24T02:12:44.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.816+0000 7efe518ca640 1 -- 172.21.15.134:0/2469964408 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe44052870 con 0x5651c9fce090 2024-04-24T02:12:44.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.816+0000 7efe56b36800 1 -- 172.21.15.134:0/2469964408 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651c9fce090 msgr2=0x5651c9fce4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:44.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.816+0000 7efe56b36800 1 --2- 172.21.15.134:0/2469964408 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651c9fce090 0x5651c9fce4b0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7efe4400a470 tx=0x7efe4401ce90 comp rx=0 tx=0).stop 2024-04-24T02:12:44.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.817+0000 7efe56b36800 1 -- 172.21.15.134:0/2469964408 shutdown_connections 2024-04-24T02:12:44.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.817+0000 7efe56b36800 1 --2- 172.21.15.134:0/2469964408 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651c9fce090 0x5651c9fce4b0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.817+0000 7efe56b36800 1 -- 172.21.15.134:0/2469964408 >> 172.21.15.134:0/2469964408 conn(0x5651c9f415f0 msgr2=0x5651c9fcc240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:44.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.817+0000 7efe56b36800 1 -- 172.21.15.134:0/2469964408 shutdown_connections 2024-04-24T02:12:44.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.817+0000 7efe56b36800 1 -- 172.21.15.134:0/2469964408 wait complete. 2024-04-24T02:12:44.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.828+0000 7efe56b36800 1 Processor -- start 2024-04-24T02:12:44.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.828+0000 7efe56b36800 1 -- start start 2024-04-24T02:12:44.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.828+0000 7efe56b36800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651c9fce090 0x5651ca0bf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.828+0000 7efe56b36800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5651c9f173c0 con 0x5651c9fce090 2024-04-24T02:12:44.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.829+0000 7efe528cc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651c9fce090 0x5651ca0bf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.829+0000 7efe528cc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651c9fce090 0x5651ca0bf750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:40690/0 (socket says 172.21.15.134:40690) 2024-04-24T02:12:44.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.829+0000 7efe528cc640 1 -- 172.21.15.134:0/632827391 learned_addr learned my addr 172.21.15.134:0/632827391 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:44.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.829+0000 7efe528cc640 1 -- 172.21.15.134:0/632827391 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651ca0bfd20 con 0x5651c9fce090 2024-04-24T02:12:44.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.829+0000 7efe528cc640 1 --2- 172.21.15.134:0/632827391 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651c9fce090 0x5651ca0bf750 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7efe44055040 tx=0x7efe4404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75b6659b5cb9b270 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.829+0000 7efd40e09640 1 -- 172.21.15.134:0/632827391 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe44057070 con 0x5651c9fce090 2024-04-24T02:12:44.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.829+0000 7efd40e09640 1 -- 172.21.15.134:0/632827391 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe44063070 con 0x5651c9fce090 2024-04-24T02:12:44.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.829+0000 7efd40e09640 1 -- 172.21.15.134:0/632827391 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe44052720 con 0x5651c9fce090 2024-04-24T02:12:44.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.830+0000 7efe56b36800 1 -- 172.21.15.134:0/632827391 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651c9fce090 msgr2=0x5651ca0bf750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:44.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.830+0000 7efe56b36800 1 --2- 172.21.15.134:0/632827391 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651c9fce090 0x5651ca0bf750 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7efe44055040 tx=0x7efe4404c000 comp rx=0 tx=0).stop 2024-04-24T02:12:44.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.830+0000 7efe56b36800 1 -- 172.21.15.134:0/632827391 shutdown_connections 2024-04-24T02:12:44.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.830+0000 7efe56b36800 1 --2- 172.21.15.134:0/632827391 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651c9fce090 0x5651ca0bf750 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.830+0000 7efe56b36800 1 -- 172.21.15.134:0/632827391 >> 172.21.15.134:0/632827391 conn(0x5651c9f415f0 msgr2=0x5651ca0bb070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:44.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.830+0000 7efe56b36800 1 -- 172.21.15.134:0/632827391 shutdown_connections 2024-04-24T02:12:44.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.830+0000 7efe56b36800 1 -- 172.21.15.134:0/632827391 wait complete. 2024-04-24T02:12:44.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.830+0000 7efe56b36800 1 Processor -- start 2024-04-24T02:12:44.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.830+0000 7efe56b36800 1 -- start start 2024-04-24T02:12:44.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.830+0000 7efe56b36800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651c9fce090 0x5651ca0c71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.831+0000 7efe56b36800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5651c9fd7710 con 0x5651c9fce090 2024-04-24T02:12:44.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.831+0000 7efe528cc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651c9fce090 0x5651ca0c71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.831+0000 7efe528cc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651c9fce090 0x5651ca0c71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:40694/0 (socket says 172.21.15.134:40694) 2024-04-24T02:12:44.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.831+0000 7efe528cc640 1 -- 172.21.15.134:0/2489334325 learned_addr learned my addr 172.21.15.134:0/2489334325 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:44.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.831+0000 7efe528cc640 1 -- 172.21.15.134:0/2489334325 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651ca0c7720 con 0x5651c9fce090 2024-04-24T02:12:44.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.831+0000 7efe528cc640 1 --2- 172.21.15.134:0/2489334325 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651c9fce090 0x5651ca0c71e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7efe44060040 tx=0x7efe44002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.831+0000 7efd3f606640 1 -- 172.21.15.134:0/2489334325 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe44052c70 con 0x5651c9fce090 2024-04-24T02:12:44.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.831+0000 7efd3f606640 1 -- 172.21.15.134:0/2489334325 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe4406c070 con 0x5651c9fce090 2024-04-24T02:12:44.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.831+0000 7efe56b36800 1 -- 172.21.15.134:0/2489334325 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5651ca0c79b0 con 0x5651c9fce090 2024-04-24T02:12:44.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.831+0000 7efd3f606640 1 -- 172.21.15.134:0/2489334325 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe4405e480 con 0x5651c9fce090 2024-04-24T02:12:44.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.831+0000 7efe56b36800 1 -- 172.21.15.134:0/2489334325 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651ca0ca660 con 0x5651c9fce090 2024-04-24T02:12:44.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.832+0000 7efd3f606640 1 -- 172.21.15.134:0/2489334325 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7efe4405e620 con 0x5651c9fce090 2024-04-24T02:12:44.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.832+0000 7efd3f606640 1 --2- 172.21.15.134:0/2489334325 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7efd38036950 0x7efd38038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.832+0000 7efd3f606640 1 -- 172.21.15.134:0/2489334325 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7efe4408e5b0 con 0x5651c9fce090 2024-04-24T02:12:44.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.832+0000 7efe520cb640 1 --2- 172.21.15.134:0/2489334325 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7efd38036950 0x7efd38038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.832+0000 7efe56b36800 1 --2- 172.21.15.134:0/2489334325 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5651c9fcf2a0 0x5651ca0ce420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.832+0000 7efe56b36800 1 -- 172.21.15.134:0/2489334325 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5651ca0ce9b0 con 0x5651c9fcf2a0 2024-04-24T02:12:44.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.833+0000 7efe530cd640 1 --2- 172.21.15.134:0/2489334325 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5651c9fcf2a0 0x5651ca0ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.833+0000 7efe520cb640 1 --2- 172.21.15.134:0/2489334325 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7efd38036950 0x7efd38038e10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efe48000f60 tx=0x7efe480012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.833+0000 7efe530cd640 1 --2- 172.21.15.134:0/2489334325 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5651c9fcf2a0 0x5651ca0ce420 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.833+0000 7efe530cd640 1 -- 172.21.15.134:0/2489334325 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efe4c00a540 con 0x5651c9fcf2a0 2024-04-24T02:12:44.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.833+0000 7efe56b36800 1 -- 172.21.15.134:0/2489334325 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5651ca0cb9d0 con 0x5651c9fcf2a0 2024-04-24T02:12:44.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.833+0000 7efe530cd640 1 -- 172.21.15.134:0/2489334325 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efe4c00a540 con 0x5651c9fcf2a0 2024-04-24T02:12:44.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.833+0000 7efe56b36800 1 -- 172.21.15.134:0/2489334325 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5651ca0d07d0 con 0x5651c9fcf2a0 2024-04-24T02:12:44.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.834+0000 7efe530cd640 1 -- 172.21.15.134:0/2489334325 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7efe4c00a540 con 0x5651c9fcf2a0 2024-04-24T02:12:44.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.834+0000 7efe56b36800 1 -- 172.21.15.134:0/2489334325 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5651ca0cfb10 con 0x5651c9fcf2a0 2024-04-24T02:12:44.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.834+0000 7efe530cd640 1 -- 172.21.15.134:0/2489334325 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efe4c00a540 con 0x5651c9fcf2a0 2024-04-24T02:12:44.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.834+0000 7efe56b36800 1 -- 172.21.15.134:0/2489334325 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5651ca0cff60 con 0x5651c9fcf2a0 2024-04-24T02:12:44.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.834+0000 7efe530cd640 1 -- 172.21.15.134:0/2489334325 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7efe4c00a540 con 0x5651c9fcf2a0 2024-04-24T02:12:44.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.834+0000 7efe56b36800 1 Processor -- start 2024-04-24T02:12:44.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.834+0000 7efe56b36800 1 -- start start 2024-04-24T02:12:44.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.835+0000 7efe56b36800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651ca0df5a0 0x5651ca0df9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.835+0000 7efe56b36800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5651c9ebd6b0 con 0x5651ca0df5a0 2024-04-24T02:12:44.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.835+0000 7efe520cb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651ca0df5a0 0x5651ca0df9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.835+0000 7efe520cb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651ca0df5a0 0x5651ca0df9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:40704/0 (socket says 172.21.15.134:40704) 2024-04-24T02:12:44.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.835+0000 7efe520cb640 1 -- 172.21.15.134:0/2537402077 learned_addr learned my addr 172.21.15.134:0/2537402077 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:44.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.835+0000 7efe520cb640 1 -- 172.21.15.134:0/2537402077 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651ca0dff00 con 0x5651ca0df5a0 2024-04-24T02:12:44.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.835+0000 7efe520cb640 1 --2- 172.21.15.134:0/2537402077 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651ca0df5a0 0x5651ca0df9c0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7efe48001ed0 tx=0x7efe4800d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.836+0000 7efd3ce01640 1 -- 172.21.15.134:0/2537402077 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe4801b550 con 0x5651ca0df5a0 2024-04-24T02:12:44.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.836+0000 7efd3ce01640 1 -- 172.21.15.134:0/2537402077 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe4801b6f0 con 0x5651ca0df5a0 2024-04-24T02:12:44.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.836+0000 7efd3ce01640 1 -- 172.21.15.134:0/2537402077 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe4801b9d0 con 0x5651ca0df5a0 2024-04-24T02:12:44.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.836+0000 7efe56b36800 1 -- 172.21.15.134:0/2537402077 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5651ca0e0970 con 0x5651ca0df5a0 2024-04-24T02:12:44.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.836+0000 7efe56b36800 1 -- 172.21.15.134:0/2537402077 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651ca0e0e70 con 0x5651ca0df5a0 2024-04-24T02:12:44.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.836+0000 7efd3ce01640 1 -- 172.21.15.134:0/2537402077 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7efe48023020 con 0x5651ca0df5a0 2024-04-24T02:12:44.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.837+0000 7efd3ce01640 1 --2- 172.21.15.134:0/2537402077 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7efd2c036950 0x7efd2c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.837+0000 7efd3ce01640 1 -- 172.21.15.134:0/2537402077 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7efe48021020 con 0x5651ca0df5a0 2024-04-24T02:12:44.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.837+0000 7efe530cd640 1 --2- 172.21.15.134:0/2537402077 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7efd2c036950 0x7efd2c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.837+0000 7efe56b36800 1 Processor -- start 2024-04-24T02:12:44.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.837+0000 7efe56b36800 1 -- start start 2024-04-24T02:12:44.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.837+0000 7efe530cd640 1 --2- 172.21.15.134:0/2537402077 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7efd2c036950 0x7efd2c038e10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x5651ca0cf630 tx=0x7efe4c0058e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.837+0000 7efe56b36800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651ca0ec8b0 0x5651ca0eccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.837+0000 7efe56b36800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5651ca0bffe0 con 0x5651ca0ec8b0 2024-04-24T02:12:44.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.837+0000 7efe520cb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651ca0ec8b0 0x5651ca0eccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.837+0000 7efe520cb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651ca0ec8b0 0x5651ca0eccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:40710/0 (socket says 172.21.15.134:40710) 2024-04-24T02:12:44.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.837+0000 7efe520cb640 1 -- 172.21.15.134:0/761410553 learned_addr learned my addr 172.21.15.134:0/761410553 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:44.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.837+0000 7efe520cb640 1 -- 172.21.15.134:0/761410553 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651ca0ed2a0 con 0x5651ca0ec8b0 2024-04-24T02:12:44.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.838+0000 7efe520cb640 1 --2- 172.21.15.134:0/761410553 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651ca0ec8b0 0x5651ca0eccd0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7efe4804ce10 tx=0x7efe48019ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca09d8fb70e4caee server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.838+0000 7efd367fc640 1 -- 172.21.15.134:0/761410553 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe48041070 con 0x5651ca0ec8b0 2024-04-24T02:12:44.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.838+0000 7efd367fc640 1 -- 172.21.15.134:0/761410553 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe4801bd50 con 0x5651ca0ec8b0 2024-04-24T02:12:44.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.838+0000 7efd367fc640 1 -- 172.21.15.134:0/761410553 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe48025a30 con 0x5651ca0ec8b0 2024-04-24T02:12:44.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.838+0000 7efe56b36800 1 -- 172.21.15.134:0/761410553 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651ca0ec8b0 msgr2=0x5651ca0eccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:44.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.838+0000 7efe56b36800 1 --2- 172.21.15.134:0/761410553 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651ca0ec8b0 0x5651ca0eccd0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7efe4804ce10 tx=0x7efe48019ce0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.838+0000 7efe56b36800 1 -- 172.21.15.134:0/761410553 shutdown_connections 2024-04-24T02:12:44.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.838+0000 7efe56b36800 1 --2- 172.21.15.134:0/761410553 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651ca0ec8b0 0x5651ca0eccd0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:44.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.838+0000 7efe56b36800 1 -- 172.21.15.134:0/761410553 >> 172.21.15.134:0/761410553 conn(0x5651ca0e8c10 msgr2=0x5651ca0e6c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:44.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.838+0000 7efe56b36800 1 -- 172.21.15.134:0/761410553 shutdown_connections 2024-04-24T02:12:44.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.838+0000 7efe56b36800 1 -- 172.21.15.134:0/761410553 wait complete. 2024-04-24T02:12:44.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.838+0000 7efe56b36800 1 Processor -- start 2024-04-24T02:12:44.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.839+0000 7efe56b36800 1 -- start start 2024-04-24T02:12:44.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.839+0000 7efe56b36800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651ca0ec8b0 0x5651ca0f3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.839+0000 7efe56b36800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5651ca0eda10 con 0x5651ca0ec8b0 2024-04-24T02:12:44.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.839+0000 7efe520cb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651ca0ec8b0 0x5651ca0f3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.839+0000 7efe520cb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651ca0ec8b0 0x5651ca0f3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:40724/0 (socket says 172.21.15.134:40724) 2024-04-24T02:12:44.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.839+0000 7efe520cb640 1 -- 172.21.15.134:0/1382526172 learned_addr learned my addr 172.21.15.134:0/1382526172 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:44.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.839+0000 7efe520cb640 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651ca0f4460 con 0x5651ca0ec8b0 2024-04-24T02:12:44.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.839+0000 7efe520cb640 1 --2- 172.21.15.134:0/1382526172 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651ca0ec8b0 0x5651ca0f3f20 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7efe48019f50 tx=0x7efe4804cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.839+0000 7efd34ff9640 1 -- 172.21.15.134:0/1382526172 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe48041070 con 0x5651ca0ec8b0 2024-04-24T02:12:44.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.839+0000 7efd34ff9640 1 -- 172.21.15.134:0/1382526172 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe4800cc60 con 0x5651ca0ec8b0 2024-04-24T02:12:44.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.839+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5651ca0f46f0 con 0x5651ca0ec8b0 2024-04-24T02:12:44.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.839+0000 7efd34ff9640 1 -- 172.21.15.134:0/1382526172 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe4804e7f0 con 0x5651ca0ec8b0 2024-04-24T02:12:44.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.839+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651ca0f46f0 con 0x5651ca0ec8b0 2024-04-24T02:12:44.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.840+0000 7efd34ff9640 1 -- 172.21.15.134:0/1382526172 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7efe4804ea90 con 0x5651ca0ec8b0 2024-04-24T02:12:44.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.840+0000 7efd34ff9640 1 --2- 172.21.15.134:0/1382526172 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7efd1c036950 0x7efd1c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.840+0000 7efd34ff9640 1 -- 172.21.15.134:0/1382526172 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7efe48039bb0 con 0x5651ca0ec8b0 2024-04-24T02:12:44.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.840+0000 7efe530cd640 1 --2- 172.21.15.134:0/1382526172 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7efd1c036950 0x7efd1c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.841+0000 7efe530cd640 1 --2- 172.21.15.134:0/1382526172 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7efd1c036950 0x7efd1c038e10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7efe4c00b010 tx=0x7efe4c01f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.841+0000 7efe56b36800 20 rados->read ofs=0 len=0 2024-04-24T02:12:44.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.841+0000 7efe56b36800 1 --2- 172.21.15.134:0/1382526172 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5651ca0ff820 0x5651ca101ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.841+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5651ca102430 con 0x5651ca0ff820 2024-04-24T02:12:44.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.841+0000 7efe528cc640 1 --2- 172.21.15.134:0/1382526172 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5651ca0ff820 0x5651ca101ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.841+0000 7efe528cc640 1 --2- 172.21.15.134:0/1382526172 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5651ca0ff820 0x5651ca101ce0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.842+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efe44009d10 con 0x5651ca0ff820 2024-04-24T02:12:44.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.842+0000 7efe56b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:44.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.842+0000 7efe56b36800 20 realm 2024-04-24T02:12:44.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.842+0000 7efe56b36800 20 rados->read ofs=0 len=0 2024-04-24T02:12:44.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.842+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5651ca102840 con 0x5651ca0ff820 2024-04-24T02:12:44.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.842+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efe44009d10 con 0x5651ca0ff820 2024-04-24T02:12:44.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.842+0000 7efe56b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:44.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.842+0000 7efe56b36800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:44.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.842+0000 7efe56b36800 20 rados->read ofs=0 len=0 2024-04-24T02:12:44.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.842+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5651ca103110 con 0x5651ca0ff820 2024-04-24T02:12:44.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.842+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efe44009d10 con 0x5651ca0ff820 2024-04-24T02:12:44.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.842+0000 7efe56b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:44.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.842+0000 7efe56b36800 20 rados->read ofs=0 len=0 2024-04-24T02:12:44.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.842+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5651ca1034b0 con 0x5651ca0ff820 2024-04-24T02:12:44.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.842+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efe44009d10 con 0x5651ca0ff820 2024-04-24T02:12:44.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.842+0000 7efe56b36800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:44.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.842+0000 7efe56b36800 20 rados->read ofs=0 len=0 2024-04-24T02:12:44.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.842+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5651ca103d00 con 0x5651ca0ff820 2024-04-24T02:12:44.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.842+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7efe44009d10 con 0x5651ca0ff820 2024-04-24T02:12:44.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.842+0000 7efe56b36800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:44.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.842+0000 7efe56b36800 20 searching for the correct realm 2024-04-24T02:12:44.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.843+0000 7efe56b36800 1 --2- 172.21.15.134:0/1382526172 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5651ca105a70 0x5651ca107e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.843+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5651ca108470 con 0x5651ca105a70 2024-04-24T02:12:44.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.843+0000 7efe520cb640 1 --2- 172.21.15.134:0/1382526172 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5651ca105a70 0x5651ca107e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.843+0000 7efe520cb640 1 --2- 172.21.15.134:0/1382526172 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5651ca105a70 0x5651ca107e60 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.843+0000 7efe520cb640 1 -- 172.21.15.134:0/1382526172 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe48056040 con 0x5651ca105a70 2024-04-24T02:12:44.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.843+0000 7efe520cb640 1 --2- 172.21.15.134:0/1382526172 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7efe480462b0 0x7efe480306d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.843+0000 7efe520cb640 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5651ca108470 con 0x7efe480462b0 2024-04-24T02:12:44.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.843+0000 7efe530cd640 1 --2- 172.21.15.134:0/1382526172 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7efe480462b0 0x7efe480306d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.844+0000 7efe530cd640 1 --2- 172.21.15.134:0/1382526172 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7efe480462b0 0x7efe480306d0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.844+0000 7efe530cd640 1 -- 172.21.15.134:0/1382526172 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe4c01f070 con 0x7efe480462b0 2024-04-24T02:12:44.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.844+0000 7efe530cd640 1 --2- 172.21.15.134:0/1382526172 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7efe4c031040 0x7efe4c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:44.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.844+0000 7efe530cd640 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5651ca108470 con 0x7efe4c031040 2024-04-24T02:12:44.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.844+0000 7efe528cc640 1 --2- 172.21.15.134:0/1382526172 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7efe4c031040 0x7efe4c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:44.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.844+0000 7efe528cc640 1 --2- 172.21.15.134:0/1382526172 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7efe4c031040 0x7efe4c032940 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:44.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.845+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe44009d10 con 0x7efe4c031040 2024-04-24T02:12:44.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.845+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5651ca108470 con 0x5651ca0ff820 2024-04-24T02:12:44.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.845+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe44009d10 con 0x5651ca0ff820 2024-04-24T02:12:44.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.845+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5651ca108470 con 0x5651ca0ff820 2024-04-24T02:12:44.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.845+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7efe44009d10 con 0x5651ca0ff820 2024-04-24T02:12:44.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.845+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5651ca108470 con 0x7efe4c031040 2024-04-24T02:12:44.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.845+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe44009d10 con 0x7efe4c031040 2024-04-24T02:12:44.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:44.845+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5651ca108470 con 0x7efe480462b0 2024-04-24T02:12:45.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.813+0000 7efd34ff9640 1 -- 172.21.15.134:0/1382526172 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_map(32..32 src has 1..32) ==== 312+0+0 (crc 0 0 0) 0x7efe4c02b070 con 0x7efe480462b0 2024-04-24T02:12:45.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.814+0000 7efe530cd640 1 -- 172.21.15.134:0/1382526172 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe4c01f070 con 0x7efe480462b0 2024-04-24T02:12:45.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.814+0000 7efe530cd640 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651ca108470 con 0x7efe480462b0 2024-04-24T02:12:45.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.815+0000 7efe530cd640 1 -- 172.21.15.134:0/1382526172 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe4c01f070 con 0x7efe480462b0 2024-04-24T02:12:45.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.815+0000 7efe530cd640 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651ca108470 con 0x5651ca105a70 2024-04-24T02:12:45.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.815+0000 7efe520cb640 1 -- 172.21.15.134:0/1382526172 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe48056040 con 0x5651ca105a70 2024-04-24T02:12:45.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.815+0000 7efe520cb640 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651ca108470 con 0x5651ca0ff820 2024-04-24T02:12:45.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.816+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe44009d10 con 0x5651ca0ff820 2024-04-24T02:12:45.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.816+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651ca108470 con 0x7efe4c031040 2024-04-24T02:12:45.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.817+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe44009d10 con 0x7efe4c031040 2024-04-24T02:12:45.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.817+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651ca108470 con 0x5651ca0ff820 2024-04-24T02:12:45.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.817+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe44009d10 con 0x5651ca0ff820 2024-04-24T02:12:45.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.817+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651ca108470 con 0x7efe480462b0 2024-04-24T02:12:45.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.817+0000 7efe530cd640 1 -- 172.21.15.134:0/1382526172 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7efe4c01f070 con 0x7efe480462b0 2024-04-24T02:12:45.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.817+0000 7efe530cd640 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651ca108470 con 0x5651ca105a70 2024-04-24T02:12:45.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.818+0000 7efe520cb640 1 -- 172.21.15.134:0/1382526172 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe48056040 con 0x5651ca105a70 2024-04-24T02:12:45.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.818+0000 7efe520cb640 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651ca108470 con 0x5651ca105a70 2024-04-24T02:12:45.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.818+0000 7efe520cb640 1 -- 172.21.15.134:0/1382526172 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe48056040 con 0x5651ca105a70 2024-04-24T02:12:45.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.818+0000 7efe520cb640 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651ca108470 con 0x7efe480462b0 2024-04-24T02:12:45.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.819+0000 7efe530cd640 1 -- 172.21.15.134:0/1382526172 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe4c01f070 con 0x7efe480462b0 2024-04-24T02:12:45.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.819+0000 7efe530cd640 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651ca108470 con 0x5651ca105a70 2024-04-24T02:12:45.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.819+0000 7efe520cb640 1 -- 172.21.15.134:0/1382526172 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe48056040 con 0x5651ca105a70 2024-04-24T02:12:45.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.819+0000 7efe520cb640 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651ca108470 con 0x5651ca105a70 2024-04-24T02:12:45.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.819+0000 7efe520cb640 1 -- 172.21.15.134:0/1382526172 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe48056040 con 0x5651ca105a70 2024-04-24T02:12:45.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.819+0000 7efe520cb640 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651ca108470 con 0x5651ca0ff820 2024-04-24T02:12:45.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.820+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe44009d10 con 0x5651ca0ff820 2024-04-24T02:12:45.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.820+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651ca108470 con 0x5651ca0ff820 2024-04-24T02:12:45.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.820+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7efe44009d10 con 0x5651ca0ff820 2024-04-24T02:12:45.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.820+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651ca108470 con 0x7efe4c031040 2024-04-24T02:12:45.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.820+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe44009d10 con 0x7efe4c031040 2024-04-24T02:12:45.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.820+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651ca108470 con 0x5651ca105a70 2024-04-24T02:12:45.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.821+0000 7efe520cb640 1 -- 172.21.15.134:0/1382526172 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe48056040 con 0x5651ca105a70 2024-04-24T02:12:45.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.821+0000 7efe520cb640 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651ca108470 con 0x7efe480462b0 2024-04-24T02:12:45.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.821+0000 7efe530cd640 1 -- 172.21.15.134:0/1382526172 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe4c01f070 con 0x7efe480462b0 2024-04-24T02:12:45.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.821+0000 7efe530cd640 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651ca108470 con 0x5651ca0ff820 2024-04-24T02:12:45.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.821+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe44009d10 con 0x5651ca0ff820 2024-04-24T02:12:45.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.821+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651ca108470 con 0x7efe4c031040 2024-04-24T02:12:45.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.822+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe44009d10 con 0x7efe4c031040 2024-04-24T02:12:45.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.822+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651ca108470 con 0x5651ca105a70 2024-04-24T02:12:45.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.822+0000 7efe520cb640 1 -- 172.21.15.134:0/1382526172 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe48056040 con 0x5651ca105a70 2024-04-24T02:12:45.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.822+0000 7efe520cb640 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651ca108470 con 0x7efe4c031040 2024-04-24T02:12:45.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.822+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe44009d10 con 0x7efe4c031040 2024-04-24T02:12:45.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.822+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651ca108470 con 0x7efe480462b0 2024-04-24T02:12:45.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.823+0000 7efe530cd640 1 -- 172.21.15.134:0/1382526172 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe4c01f070 con 0x7efe480462b0 2024-04-24T02:12:45.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.823+0000 7efe530cd640 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651ca108470 con 0x5651ca105a70 2024-04-24T02:12:45.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.823+0000 7efe520cb640 1 -- 172.21.15.134:0/1382526172 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe48056040 con 0x5651ca105a70 2024-04-24T02:12:45.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.823+0000 7efe520cb640 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651ca108470 con 0x7efe480462b0 2024-04-24T02:12:45.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.823+0000 7efe530cd640 1 -- 172.21.15.134:0/1382526172 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe4c01f070 con 0x7efe480462b0 2024-04-24T02:12:45.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.823+0000 7efe530cd640 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651ca108470 con 0x5651ca0ff820 2024-04-24T02:12:45.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.824+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7efe44009d10 con 0x5651ca0ff820 2024-04-24T02:12:45.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.824+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651ca108470 con 0x7efe480462b0 2024-04-24T02:12:45.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.824+0000 7efe530cd640 1 -- 172.21.15.134:0/1382526172 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe4c01f070 con 0x7efe480462b0 2024-04-24T02:12:45.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.824+0000 7efe56b36800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:45.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.824+0000 7efe56b36800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:45.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.824+0000 7efe56b36800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:45.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.824+0000 7efe56b36800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:45.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.824+0000 7efe56b36800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:45.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.824+0000 7efe56b36800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:45.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.824+0000 7efe56b36800 20 rados->read ofs=0 len=0 2024-04-24T02:12:45.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.824+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651ca104680 con 0x5651ca0ff820 2024-04-24T02:12:45.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.824+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efe44009d10 con 0x5651ca0ff820 2024-04-24T02:12:45.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.824+0000 7efe56b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:45.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.824+0000 7efe56b36800 20 rados->read ofs=0 len=0 2024-04-24T02:12:45.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.824+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651ca104f20 con 0x5651ca0ff820 2024-04-24T02:12:45.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.825+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efe44009d10 con 0x5651ca0ff820 2024-04-24T02:12:45.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.825+0000 7efe56b36800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:45.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.825+0000 7efe56b36800 20 rados->read ofs=0 len=0 2024-04-24T02:12:45.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.825+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651ca104f20 con 0x5651ca0ff820 2024-04-24T02:12:45.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.825+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7efe44009d10 con 0x5651ca0ff820 2024-04-24T02:12:45.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.825+0000 7efe56b36800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:45.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.825+0000 7efe56b36800 20 zone default found 2024-04-24T02:12:45.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.825+0000 7efe56b36800 4 Realm: () 2024-04-24T02:12:45.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.825+0000 7efe56b36800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:45.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.825+0000 7efe56b36800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:45.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.825+0000 7efe56b36800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:45.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.825+0000 7efe56b36800 20 zonegroup default 2024-04-24T02:12:45.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.825+0000 7efe56b36800 20 rados->read ofs=0 len=0 2024-04-24T02:12:45.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.825+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651ca1088f0 con 0x7efe4c031040 2024-04-24T02:12:45.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.826+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7efe44009d10 con 0x7efe4c031040 2024-04-24T02:12:45.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.826+0000 7efe56b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:45.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.826+0000 7efe56b36800 20 rados->read ofs=0 len=0 2024-04-24T02:12:45.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.826+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651ca10a330 con 0x5651ca105a70 2024-04-24T02:12:45.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.826+0000 7efe520cb640 1 -- 172.21.15.134:0/1382526172 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efe48056040 con 0x5651ca105a70 2024-04-24T02:12:45.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.826+0000 7efe56b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:45.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.826+0000 7efe56b36800 20 rados->read ofs=0 len=0 2024-04-24T02:12:45.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.826+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651ca10a7c0 con 0x5651ca105a70 2024-04-24T02:12:45.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.826+0000 7efe520cb640 1 -- 172.21.15.134:0/1382526172 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efe48056040 con 0x5651ca105a70 2024-04-24T02:12:45.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.826+0000 7efe56b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:45.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.826+0000 7efe56b36800 20 started sync module instance, tier type = 2024-04-24T02:12:45.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.826+0000 7efe56b36800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:45.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.826+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca109770 con 0x7efe480462b0 2024-04-24T02:12:45.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.828+0000 7efe530cd640 1 -- 172.21.15.134:0/1382526172 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(44 notify.0 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe4c01f070 con 0x7efe480462b0 2024-04-24T02:12:45.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.828+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94909282425696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca1093d0 con 0x7efe480462b0 2024-04-24T02:12:45.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.828+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca10b6f0 con 0x5651ca0ff820 2024-04-24T02:12:45.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.829+0000 7efe530cd640 1 -- 172.21.15.134:0/1382526172 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(45 notify.0 [watch watch cookie 94909282425696] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe4c01f070 con 0x7efe480462b0 2024-04-24T02:12:45.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.829+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe44009d10 con 0x5651ca0ff820 2024-04-24T02:12:45.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.829+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94909282429984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca10b6f0 con 0x5651ca0ff820 2024-04-24T02:12:45.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.829+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca10c0b0 con 0x5651ca105a70 2024-04-24T02:12:45.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.830+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94909282429984] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe44009d10 con 0x5651ca0ff820 2024-04-24T02:12:45.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.831+0000 7efe520cb640 1 -- 172.21.15.134:0/1382526172 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe48056040 con 0x5651ca105a70 2024-04-24T02:12:45.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.831+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94909282434048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca10c450 con 0x5651ca105a70 2024-04-24T02:12:45.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.831+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca10ce80 con 0x7efe480462b0 2024-04-24T02:12:45.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.832+0000 7efe520cb640 1 -- 172.21.15.134:0/1382526172 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94909282434048] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe48056040 con 0x5651ca105a70 2024-04-24T02:12:45.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.832+0000 7efe530cd640 1 -- 172.21.15.134:0/1382526172 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(50 notify.3 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe4c01f070 con 0x7efe480462b0 2024-04-24T02:12:45.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.832+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94909282431552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca10d2a0 con 0x7efe480462b0 2024-04-24T02:12:45.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.832+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca10dce0 con 0x5651ca0ff820 2024-04-24T02:12:45.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.833+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe44009d10 con 0x5651ca0ff820 2024-04-24T02:12:45.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.833+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94909282441136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca10dca0 con 0x5651ca0ff820 2024-04-24T02:12:45.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.833+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca10ec90 con 0x7efe4c031040 2024-04-24T02:12:45.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.833+0000 7efe530cd640 1 -- 172.21.15.134:0/1382526172 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(51 notify.3 [watch watch cookie 94909282431552] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe4c01f070 con 0x7efe480462b0 2024-04-24T02:12:45.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.834+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94909282441136] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe44009d10 con 0x5651ca0ff820 2024-04-24T02:12:45.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.834+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(54 notify.5 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe44009d10 con 0x7efe4c031040 2024-04-24T02:12:45.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.834+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94909282445216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca10de80 con 0x7efe4c031040 2024-04-24T02:12:45.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.834+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca10f560 con 0x7efe4c031040 2024-04-24T02:12:45.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.836+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94909282445216] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe44009d10 con 0x7efe4c031040 2024-04-24T02:12:45.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.836+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(56 notify.6 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe44009d10 con 0x7efe4c031040 2024-04-24T02:12:45.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.836+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94909282437520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca10ec90 con 0x7efe4c031040 2024-04-24T02:12:45.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.836+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca10fb80 con 0x7efe4c031040 2024-04-24T02:12:45.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.837+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(58 notify.7 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe44009d10 con 0x7efe4c031040 2024-04-24T02:12:45.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.837+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94909282437520] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe44009d10 con 0x7efe4c031040 2024-04-24T02:12:45.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.837+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94909282449104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca10ffa0 con 0x7efe4c031040 2024-04-24T02:12:45.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.837+0000 7efe56b36800 20 add_watcher() i=0 2024-04-24T02:12:45.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.837+0000 7efe56b36800 20 add_watcher() i=1 2024-04-24T02:12:45.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.837+0000 7efe56b36800 20 add_watcher() i=2 2024-04-24T02:12:45.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.837+0000 7efe56b36800 20 add_watcher() i=3 2024-04-24T02:12:45.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.837+0000 7efe56b36800 20 add_watcher() i=4 2024-04-24T02:12:45.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.837+0000 7efe56b36800 20 add_watcher() i=5 2024-04-24T02:12:45.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.837+0000 7efe56b36800 20 add_watcher() i=6 2024-04-24T02:12:45.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.838+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94909282449104] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe44009d10 con 0x7efe4c031040 2024-04-24T02:12:45.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.838+0000 7efe56b36800 20 add_watcher() i=7 2024-04-24T02:12:45.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.838+0000 7efe56b36800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:45.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.838+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651ca10ffa0 con 0x5651ca0ff820 2024-04-24T02:12:45.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.838+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7efe44009d10 con 0x5651ca0ff820 2024-04-24T02:12:45.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.839+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94909282450160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca10ff10 con 0x5651ca0ff820 2024-04-24T02:12:45.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.840+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94909282450160] v32'180 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efe44009d10 con 0x5651ca0ff820 2024-04-24T02:12:45.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.840+0000 7efd097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:45.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.840+0000 7efe56b36800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:45.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.840+0000 7efe56b36800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:45.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.840+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca11b890 con 0x5651ca0ff820 2024-04-24T02:12:45.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.842+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'53 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efe44009d10 con 0x5651ca0ff820 2024-04-24T02:12:45.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.842+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca11bf60 con 0x7efe4c031040 2024-04-24T02:12:45.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.843+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'30 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efe44009d10 con 0x7efe4c031040 2024-04-24T02:12:45.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.843+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca11bf60 con 0x5651ca105a70 2024-04-24T02:12:45.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.844+0000 7efe520cb640 1 -- 172.21.15.134:0/1382526172 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efe48056040 con 0x5651ca105a70 2024-04-24T02:12:45.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.844+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca11c300 con 0x5651ca0ff820 2024-04-24T02:12:45.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.845+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'181 uv169 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efe44009d10 con 0x5651ca0ff820 2024-04-24T02:12:45.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.845+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca11b240 con 0x7efe480462b0 2024-04-24T02:12:45.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.847+0000 7efe530cd640 1 -- 172.21.15.134:0/1382526172 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'67 uv58 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efe4c01f070 con 0x7efe480462b0 2024-04-24T02:12:45.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.847+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca11c350 con 0x5651ca105a70 2024-04-24T02:12:45.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.848+0000 7efe520cb640 1 -- 172.21.15.134:0/1382526172 <== osd.3 v2:172.21.15.134:6801/3585115521 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'53 uv48 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efe48056040 con 0x5651ca105a70 2024-04-24T02:12:45.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.848+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca11cdc0 con 0x5651ca0ff820 2024-04-24T02:12:45.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.849+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efe44009d10 con 0x5651ca0ff820 2024-04-24T02:12:45.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.849+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca11cdc0 con 0x7efe4c031040 2024-04-24T02:12:45.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.850+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'46 uv41 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efe44009d10 con 0x7efe4c031040 2024-04-24T02:12:45.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.850+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca11cdc0 con 0x7efe480462b0 2024-04-24T02:12:45.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.852+0000 7efe530cd640 1 -- 172.21.15.134:0/1382526172 <== osd.2 v2:172.21.15.134:6800/214480313 16 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efe4c01f070 con 0x7efe480462b0 2024-04-24T02:12:45.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.852+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca11d330 con 0x5651ca105a70 2024-04-24T02:12:45.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.853+0000 7efe520cb640 1 -- 172.21.15.134:0/1382526172 <== osd.3 v2:172.21.15.134:6801/3585115521 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efe48056040 con 0x5651ca105a70 2024-04-24T02:12:45.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.853+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca11d3c0 con 0x7efe480462b0 2024-04-24T02:12:45.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.854+0000 7efe530cd640 1 -- 172.21.15.134:0/1382526172 <== osd.2 v2:172.21.15.134:6800/214480313 17 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'68 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe4c01f070 con 0x7efe480462b0 2024-04-24T02:12:45.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.854+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca11d930 con 0x7efe4c031040 2024-04-24T02:12:45.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.855+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'26 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe44009d10 con 0x7efe4c031040 2024-04-24T02:12:45.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.855+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca11d930 con 0x7efe480462b0 2024-04-24T02:12:45.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.856+0000 7efe530cd640 1 -- 172.21.15.134:0/1382526172 <== osd.2 v2:172.21.15.134:6800/214480313 18 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe4c01f070 con 0x7efe480462b0 2024-04-24T02:12:45.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.856+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca11dde0 con 0x7efe4c031040 2024-04-24T02:12:45.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.858+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'57 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe44009d10 con 0x7efe4c031040 2024-04-24T02:12:45.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.858+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca11dde0 con 0x5651ca0ff820 2024-04-24T02:12:45.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.859+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'182 uv171 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe44009d10 con 0x5651ca0ff820 2024-04-24T02:12:45.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.859+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca11dde0 con 0x5651ca105a70 2024-04-24T02:12:45.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.860+0000 7efe520cb640 1 -- 172.21.15.134:0/1382526172 <== osd.3 v2:172.21.15.134:6801/3585115521 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'59 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe48056040 con 0x5651ca105a70 2024-04-24T02:12:45.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.860+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca11dde0 con 0x7efe480462b0 2024-04-24T02:12:45.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.862+0000 7efe530cd640 1 -- 172.21.15.134:0/1382526172 <== osd.2 v2:172.21.15.134:6800/214480313 19 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'69 uv63 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe4c01f070 con 0x7efe480462b0 2024-04-24T02:12:45.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.862+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca11dde0 con 0x5651ca105a70 2024-04-24T02:12:45.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.863+0000 7efe520cb640 1 -- 172.21.15.134:0/1382526172 <== osd.3 v2:172.21.15.134:6801/3585115521 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'35 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe48056040 con 0x5651ca105a70 2024-04-24T02:12:45.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.863+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca11dde0 con 0x5651ca0ff820 2024-04-24T02:12:45.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.864+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe44009d10 con 0x5651ca0ff820 2024-04-24T02:12:45.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.864+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca11dde0 con 0x5651ca0ff820 2024-04-24T02:12:45.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.865+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'183 uv173 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe44009d10 con 0x5651ca0ff820 2024-04-24T02:12:45.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.865+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca11dde0 con 0x5651ca105a70 2024-04-24T02:12:45.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.866+0000 7efe520cb640 1 -- 172.21.15.134:0/1382526172 <== osd.3 v2:172.21.15.134:6801/3585115521 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'60 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe48056040 con 0x5651ca105a70 2024-04-24T02:12:45.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.866+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca11dde0 con 0x7efe480462b0 2024-04-24T02:12:45.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.867+0000 7efe530cd640 1 -- 172.21.15.134:0/1382526172 <== osd.2 v2:172.21.15.134:6800/214480313 20 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'39 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe4c01f070 con 0x7efe480462b0 2024-04-24T02:12:45.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.867+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca11dde0 con 0x5651ca105a70 2024-04-24T02:12:45.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.868+0000 7efe520cb640 1 -- 172.21.15.134:0/1382526172 <== osd.3 v2:172.21.15.134:6801/3585115521 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe48056040 con 0x5651ca105a70 2024-04-24T02:12:45.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.868+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca11dde0 con 0x5651ca105a70 2024-04-24T02:12:45.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.870+0000 7efe520cb640 1 -- 172.21.15.134:0/1382526172 <== osd.3 v2:172.21.15.134:6801/3585115521 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'41 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe48056040 con 0x5651ca105a70 2024-04-24T02:12:45.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.870+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca11dde0 con 0x5651ca105a70 2024-04-24T02:12:45.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.871+0000 7efe520cb640 1 -- 172.21.15.134:0/1382526172 <== osd.3 v2:172.21.15.134:6801/3585115521 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe48056040 con 0x5651ca105a70 2024-04-24T02:12:45.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.871+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca11dde0 con 0x5651ca105a70 2024-04-24T02:12:45.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.872+0000 7efe520cb640 1 -- 172.21.15.134:0/1382526172 <== osd.3 v2:172.21.15.134:6801/3585115521 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'54 uv50 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe48056040 con 0x5651ca105a70 2024-04-24T02:12:45.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.872+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca11dde0 con 0x7efe4c031040 2024-04-24T02:12:45.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.873+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe44009d10 con 0x7efe4c031040 2024-04-24T02:12:45.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.873+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca11dde0 con 0x5651ca105a70 2024-04-24T02:12:45.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.874+0000 7efe520cb640 1 -- 172.21.15.134:0/1382526172 <== osd.3 v2:172.21.15.134:6801/3585115521 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'35 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe48056040 con 0x5651ca105a70 2024-04-24T02:12:45.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.874+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca11dde0 con 0x7efe4c031040 2024-04-24T02:12:45.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.875+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'47 uv43 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe44009d10 con 0x7efe4c031040 2024-04-24T02:12:45.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.875+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca11dde0 con 0x5651ca105a70 2024-04-24T02:12:45.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.877+0000 7efe520cb640 1 -- 172.21.15.134:0/1382526172 <== osd.3 v2:172.21.15.134:6801/3585115521 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'61 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe48056040 con 0x5651ca105a70 2024-04-24T02:12:45.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.877+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca11dde0 con 0x7efe4c031040 2024-04-24T02:12:45.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.878+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.0 v2:172.21.15.104:6800/2419146313 20 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'58 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe44009d10 con 0x7efe4c031040 2024-04-24T02:12:45.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.878+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca11dde0 con 0x7efe480462b0 2024-04-24T02:12:45.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.879+0000 7efe530cd640 1 -- 172.21.15.134:0/1382526172 <== osd.2 v2:172.21.15.134:6800/214480313 21 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe4c01f070 con 0x7efe480462b0 2024-04-24T02:12:45.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.879+0000 7efc83fff640 20 reqs_thread_entry: start 2024-04-24T02:12:45.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.879+0000 7efe56b36800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:45.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.880+0000 7efe56b36800 20 Filter name: none 2024-04-24T02:12:45.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.880+0000 7efc81ffb640 20 reqs_thread_entry: start 2024-04-24T02:12:45.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.880+0000 7efe56b36800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T02:12:45.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.880+0000 7efe56b36800 20 rados->read ofs=0 len=0 2024-04-24T02:12:45.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.880+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651ca148b10 con 0x5651ca0ff820 2024-04-24T02:12:45.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.880+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7efe44009d10 con 0x5651ca0ff820 2024-04-24T02:12:45.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.880+0000 7efe56b36800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T02:12:45.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.880+0000 7efe56b36800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T02:12:45.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.880+0000 7efe56b36800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:45.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.880+0000 7efe56b36800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:12:45.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.880+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651ca148b00 con 0x7efe480462b0 2024-04-24T02:12:45.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.881+0000 7efe530cd640 1 -- 172.21.15.134:0/1382526172 <== osd.2 v2:172.21.15.134:6800/214480313 22 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7efe4c01f070 con 0x7efe480462b0 2024-04-24T02:12:45.883 INFO:teuthology.orchestra.run.smithi134.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-04-24T02:12:45.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.881+0000 7efd097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:45.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.881+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94909282450160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca11a6e0 con 0x5651ca0ff820 2024-04-24T02:12:45.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.883+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.1 v2:172.21.15.134:6804/1487076214 30 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94909282450160] v32'184 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efe44009d10 con 0x5651ca0ff820 2024-04-24T02:12:45.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.883+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94909282425696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca10faf0 con 0x7efe480462b0 2024-04-24T02:12:45.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.884+0000 7efe530cd640 1 -- 172.21.15.134:0/1382526172 <== osd.2 v2:172.21.15.134:6800/214480313 23 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94909282425696] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe4c01f070 con 0x7efe480462b0 2024-04-24T02:12:45.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.884+0000 7efe56b36800 20 remove_watcher() i=0 2024-04-24T02:12:45.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.884+0000 7efe56b36800 2 removed watcher, disabling cache 2024-04-24T02:12:45.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.884+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94909282429984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca10faf0 con 0x5651ca0ff820 2024-04-24T02:12:45.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.885+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.1 v2:172.21.15.134:6804/1487076214 31 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94909282429984] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe44009d10 con 0x5651ca0ff820 2024-04-24T02:12:45.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.885+0000 7efe56b36800 20 remove_watcher() i=1 2024-04-24T02:12:45.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.885+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94909282434048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca10ac20 con 0x5651ca105a70 2024-04-24T02:12:45.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.886+0000 7efe520cb640 1 -- 172.21.15.134:0/1382526172 <== osd.3 v2:172.21.15.134:6801/3585115521 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94909282434048] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe48056040 con 0x5651ca105a70 2024-04-24T02:12:45.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.886+0000 7efe56b36800 20 remove_watcher() i=2 2024-04-24T02:12:45.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.886+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94909282431552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca10faf0 con 0x7efe480462b0 2024-04-24T02:12:45.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.887+0000 7efe530cd640 1 -- 172.21.15.134:0/1382526172 <== osd.2 v2:172.21.15.134:6800/214480313 24 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94909282431552] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe4c01f070 con 0x7efe480462b0 2024-04-24T02:12:45.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.887+0000 7efe56b36800 20 remove_watcher() i=3 2024-04-24T02:12:45.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.887+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94909282441136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca10bc00 con 0x5651ca0ff820 2024-04-24T02:12:45.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.888+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.1 v2:172.21.15.134:6804/1487076214 32 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94909282441136] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe44009d10 con 0x5651ca0ff820 2024-04-24T02:12:45.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.888+0000 7efe56b36800 20 remove_watcher() i=4 2024-04-24T02:12:45.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.888+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94909282445216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca10b240 con 0x7efe4c031040 2024-04-24T02:12:45.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.890+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.0 v2:172.21.15.104:6800/2419146313 21 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94909282445216] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe44009d10 con 0x7efe4c031040 2024-04-24T02:12:45.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.890+0000 7efe56b36800 20 remove_watcher() i=5 2024-04-24T02:12:45.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.890+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94909282437520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca10faf0 con 0x7efe4c031040 2024-04-24T02:12:45.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.891+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.0 v2:172.21.15.104:6800/2419146313 22 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94909282437520] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe44009d10 con 0x7efe4c031040 2024-04-24T02:12:45.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.891+0000 7efe56b36800 20 remove_watcher() i=6 2024-04-24T02:12:45.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.891+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94909282449104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651ca10bc00 con 0x7efe4c031040 2024-04-24T02:12:45.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.892+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 <== osd.0 v2:172.21.15.104:6800/2419146313 23 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94909282449104] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe44009d10 con 0x7efe4c031040 2024-04-24T02:12:45.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.892+0000 7efe56b36800 20 remove_watcher() i=7 2024-04-24T02:12:45.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.892+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7efe4c031040 msgr2=0x7efe4c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:45.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.892+0000 7efe56b36800 1 --2- 172.21.15.134:0/1382526172 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7efe4c031040 0x7efe4c032940 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:45.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.892+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5651ca0ff820 msgr2=0x5651ca101ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:45.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.892+0000 7efe56b36800 1 --2- 172.21.15.134:0/1382526172 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5651ca0ff820 0x5651ca101ce0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:45.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.892+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7efe480462b0 msgr2=0x7efe480306d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:45.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.892+0000 7efe56b36800 1 --2- 172.21.15.134:0/1382526172 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7efe480462b0 0x7efe480306d0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:45.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.892+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5651ca105a70 msgr2=0x5651ca107e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:45.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.892+0000 7efe56b36800 1 --2- 172.21.15.134:0/1382526172 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5651ca105a70 0x5651ca107e60 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:45.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.892+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7efd1c036950 msgr2=0x7efd1c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:45.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.892+0000 7efe56b36800 1 --2- 172.21.15.134:0/1382526172 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7efd1c036950 0x7efd1c038e10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7efe4c00b010 tx=0x7efe4c01f000 comp rx=0 tx=0).stop 2024-04-24T02:12:45.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.892+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651ca0ec8b0 msgr2=0x5651ca0f3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:45.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.892+0000 7efe56b36800 1 --2- 172.21.15.134:0/1382526172 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651ca0ec8b0 0x5651ca0f3f20 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7efe48019f50 tx=0x7efe4804cda0 comp rx=0 tx=0).stop 2024-04-24T02:12:45.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.892+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 reap_dead start 2024-04-24T02:12:45.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.892+0000 7efe528cc640 1 -- 172.21.15.134:0/1382526172 reap_dead start 2024-04-24T02:12:45.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.892+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 shutdown_connections 2024-04-24T02:12:45.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.892+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 >> 172.21.15.134:0/1382526172 conn(0x5651ca0e8c10 msgr2=0x5651ca0e6270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:45.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.892+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 shutdown_connections 2024-04-24T02:12:45.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.892+0000 7efe56b36800 1 -- 172.21.15.134:0/1382526172 wait complete. 2024-04-24T02:12:45.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.893+0000 7efe56b36800 1 -- 172.21.15.134:0/2537402077 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7efd2c036950 msgr2=0x7efd2c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:45.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.893+0000 7efe56b36800 1 --2- 172.21.15.134:0/2537402077 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7efd2c036950 0x7efd2c038e10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x5651ca0cf630 tx=0x7efe4c0058e0 comp rx=0 tx=0).stop 2024-04-24T02:12:45.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.893+0000 7efe56b36800 1 -- 172.21.15.134:0/2537402077 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651ca0df5a0 msgr2=0x5651ca0df9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:45.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.893+0000 7efe56b36800 1 --2- 172.21.15.134:0/2537402077 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651ca0df5a0 0x5651ca0df9c0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7efe48001ed0 tx=0x7efe4800d7a0 comp rx=0 tx=0).stop 2024-04-24T02:12:45.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.893+0000 7efe56b36800 1 -- 172.21.15.134:0/2537402077 shutdown_connections 2024-04-24T02:12:45.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.893+0000 7efe56b36800 1 --2- 172.21.15.134:0/2537402077 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7efd2c036950 0x7efd2c038e10 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:45.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.893+0000 7efe56b36800 1 --2- 172.21.15.134:0/2537402077 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651ca0df5a0 0x5651ca0df9c0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:45.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.893+0000 7efe56b36800 1 -- 172.21.15.134:0/2537402077 >> 172.21.15.134:0/2537402077 conn(0x5651ca0d3640 msgr2=0x5651ca0d3a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:45.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.893+0000 7efe56b36800 1 -- 172.21.15.134:0/2537402077 shutdown_connections 2024-04-24T02:12:45.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.893+0000 7efe56b36800 1 -- 172.21.15.134:0/2537402077 wait complete. 2024-04-24T02:12:45.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.893+0000 7efe56b36800 1 -- 172.21.15.134:0/2489334325 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5651c9fcf2a0 msgr2=0x5651ca0ce420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:45.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.893+0000 7efe56b36800 1 --2- 172.21.15.134:0/2489334325 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5651c9fcf2a0 0x5651ca0ce420 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:45.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.893+0000 7efe56b36800 1 -- 172.21.15.134:0/2489334325 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7efd38036950 msgr2=0x7efd38038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:45.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.893+0000 7efe56b36800 1 --2- 172.21.15.134:0/2489334325 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7efd38036950 0x7efd38038e10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efe48000f60 tx=0x7efe480012b0 comp rx=0 tx=0).stop 2024-04-24T02:12:45.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.893+0000 7efe56b36800 1 -- 172.21.15.134:0/2489334325 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651c9fce090 msgr2=0x5651ca0c71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:45.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.893+0000 7efe56b36800 1 --2- 172.21.15.134:0/2489334325 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651c9fce090 0x5651ca0c71e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7efe44060040 tx=0x7efe44002fb0 comp rx=0 tx=0).stop 2024-04-24T02:12:45.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.893+0000 7efe56b36800 1 -- 172.21.15.134:0/2489334325 shutdown_connections 2024-04-24T02:12:45.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.893+0000 7efe56b36800 1 --2- 172.21.15.134:0/2489334325 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5651c9fcf2a0 0x5651ca0ce420 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:45.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.893+0000 7efe56b36800 1 --2- 172.21.15.134:0/2489334325 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7efd38036950 0x7efd38038e10 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:45.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.893+0000 7efe56b36800 1 --2- 172.21.15.134:0/2489334325 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5651c9fce090 0x5651ca0c71e0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:45.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.893+0000 7efe56b36800 1 -- 172.21.15.134:0/2489334325 >> 172.21.15.134:0/2489334325 conn(0x5651c9f415f0 msgr2=0x5651ca0b9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:45.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.893+0000 7efe56b36800 1 -- 172.21.15.134:0/2489334325 shutdown_connections 2024-04-24T02:12:45.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:45.893+0000 7efe56b36800 1 -- 172.21.15.134:0/2489334325 wait complete. 2024-04-24T02:12:45.902 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-04-24T02:12:45.912 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-04-24T02:12:45.916 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T02:12:45.943 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T02:12:45.954 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T02:12:45.999 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-04-24T02:12:46.003 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T02:12:46.003 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-04-24T02:12:46.003 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-04-24T02:12:46.003 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-04-24T02:12:46.047 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:46.048 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:46.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.047+0000 7faf4b03f800 1 Processor -- start 2024-04-24T02:12:46.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.047+0000 7faf4b03f800 1 -- start start 2024-04-24T02:12:46.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.047+0000 7faf4b03f800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x56193bc66320 0x56193bc6ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.047+0000 7faf4b03f800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56193bb24d40 con 0x56193bc647e0 2024-04-24T02:12:46.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.047+0000 7faf4b03f800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x56193baf74d0 con 0x56193bc66320 2024-04-24T02:12:46.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.047+0000 7faf4833d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x56193bc66320 0x56193bc6ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.047+0000 7faf48b3e640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x56193bc647e0 0x56193bc64c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:42190/0 (socket says 172.21.15.134:42190) 2024-04-24T02:12:46.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.047+0000 7faf4833d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x56193bc66320 0x56193bc6ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:35656/0 (socket says 172.21.15.134:35656) 2024-04-24T02:12:46.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.047+0000 7faf48b3e640 1 -- 172.21.15.134:0/4249601879 learned_addr learned my addr 172.21.15.134:0/4249601879 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:12:46.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.048+0000 7faf4833d640 1 -- 172.21.15.134:0/4249601879 >> v1:172.21.15.104:6789/0 conn(0x56193bc647e0 legacy=0x56193bc64c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.048+0000 7faf4833d640 1 -- 172.21.15.134:0/4249601879 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56193bb23590 con 0x56193bc66320 2024-04-24T02:12:46.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.049+0000 7faf4833d640 1 --2- 172.21.15.134:0/4249601879 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56193bc66320 0x56193bc6ee20 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7faf3c00a470 tx=0x7faf3c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=816de310a4f971d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.050+0000 7faf47b3c640 1 -- 172.21.15.134:0/4249601879 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf3c057070 con 0x56193bc66320 2024-04-24T02:12:46.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.050+0000 7faf47b3c640 1 -- 172.21.15.134:0/4249601879 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf3c052570 con 0x56193bc66320 2024-04-24T02:12:46.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.050+0000 7faf47b3c640 1 -- 172.21.15.134:0/4249601879 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf3c052870 con 0x56193bc66320 2024-04-24T02:12:46.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.050+0000 7faf4b03f800 1 -- 172.21.15.134:0/4249601879 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56193bc66320 msgr2=0x56193bc6ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.050+0000 7faf4b03f800 1 --2- 172.21.15.134:0/4249601879 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56193bc66320 0x56193bc6ee20 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7faf3c00a470 tx=0x7faf3c01ce90 comp rx=0 tx=0).stop 2024-04-24T02:12:46.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.050+0000 7faf4b03f800 1 -- 172.21.15.134:0/4249601879 shutdown_connections 2024-04-24T02:12:46.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.050+0000 7faf4b03f800 1 --2- 172.21.15.134:0/4249601879 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56193bc66320 0x56193bc6ee20 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.050+0000 7faf4b03f800 1 -- 172.21.15.134:0/4249601879 >> 172.21.15.134:0/4249601879 conn(0x56193bc60340 msgr2=0x56193bc62760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:46.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.050+0000 7faf4b03f800 1 -- 172.21.15.134:0/4249601879 shutdown_connections 2024-04-24T02:12:46.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.050+0000 7faf4b03f800 1 -- 172.21.15.134:0/4249601879 wait complete. 2024-04-24T02:12:46.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.062+0000 7faf4b03f800 1 Processor -- start 2024-04-24T02:12:46.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.062+0000 7faf4b03f800 1 -- start start 2024-04-24T02:12:46.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.062+0000 7faf4b03f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56193bc647e0 0x56193bd596f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.062+0000 7faf4b03f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56193bbb13b0 con 0x56193bc647e0 2024-04-24T02:12:46.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.062+0000 7faf48b3e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56193bc647e0 0x56193bd596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.062+0000 7faf48b3e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56193bc647e0 0x56193bd596f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:35666/0 (socket says 172.21.15.134:35666) 2024-04-24T02:12:46.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.062+0000 7faf48b3e640 1 -- 172.21.15.134:0/1965269112 learned_addr learned my addr 172.21.15.134:0/1965269112 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:46.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.063+0000 7faf48b3e640 1 -- 172.21.15.134:0/1965269112 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56193bd59cc0 con 0x56193bc647e0 2024-04-24T02:12:46.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.063+0000 7faf48b3e640 1 --2- 172.21.15.134:0/1965269112 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56193bc647e0 0x56193bd596f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7faf38001de0 tx=0x7faf3800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ada63ee0c43dcdb4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.063+0000 7fae36e0d640 1 -- 172.21.15.134:0/1965269112 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf38012020 con 0x56193bc647e0 2024-04-24T02:12:46.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.063+0000 7fae36e0d640 1 -- 172.21.15.134:0/1965269112 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf3800e5a0 con 0x56193bc647e0 2024-04-24T02:12:46.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.063+0000 7fae36e0d640 1 -- 172.21.15.134:0/1965269112 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf3800e8c0 con 0x56193bc647e0 2024-04-24T02:12:46.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.064+0000 7faf4b03f800 1 -- 172.21.15.134:0/1965269112 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56193bc647e0 msgr2=0x56193bd596f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.064+0000 7faf4b03f800 1 --2- 172.21.15.134:0/1965269112 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56193bc647e0 0x56193bd596f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7faf38001de0 tx=0x7faf3800b6c0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.064+0000 7faf4b03f800 1 -- 172.21.15.134:0/1965269112 shutdown_connections 2024-04-24T02:12:46.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.064+0000 7faf4b03f800 1 --2- 172.21.15.134:0/1965269112 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56193bc647e0 0x56193bd596f0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.064+0000 7faf4b03f800 1 -- 172.21.15.134:0/1965269112 >> 172.21.15.134:0/1965269112 conn(0x56193bc60340 msgr2=0x56193bd55010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:46.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.064+0000 7faf4b03f800 1 -- 172.21.15.134:0/1965269112 shutdown_connections 2024-04-24T02:12:46.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.064+0000 7faf4b03f800 1 -- 172.21.15.134:0/1965269112 wait complete. 2024-04-24T02:12:46.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.064+0000 7faf4b03f800 1 Processor -- start 2024-04-24T02:12:46.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.064+0000 7faf4b03f800 1 -- start start 2024-04-24T02:12:46.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.064+0000 7faf4b03f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56193bc647e0 0x56193bd61230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.064+0000 7faf4b03f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56193bc71640 con 0x56193bc647e0 2024-04-24T02:12:46.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.064+0000 7faf48b3e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56193bc647e0 0x56193bd61230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.064+0000 7faf48b3e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56193bc647e0 0x56193bd61230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:35680/0 (socket says 172.21.15.134:35680) 2024-04-24T02:12:46.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.064+0000 7faf48b3e640 1 -- 172.21.15.134:0/2183247033 learned_addr learned my addr 172.21.15.134:0/2183247033 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:46.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.065+0000 7faf48b3e640 1 -- 172.21.15.134:0/2183247033 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56193bd61770 con 0x56193bc647e0 2024-04-24T02:12:46.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.065+0000 7faf48b3e640 1 --2- 172.21.15.134:0/2183247033 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56193bc647e0 0x56193bd61230 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7faf3800c010 tx=0x7faf38000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.065+0000 7fae3560a640 1 -- 172.21.15.134:0/2183247033 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf38012070 con 0x56193bc647e0 2024-04-24T02:12:46.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.065+0000 7fae3560a640 1 -- 172.21.15.134:0/2183247033 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf3801a7a0 con 0x56193bc647e0 2024-04-24T02:12:46.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.065+0000 7fae3560a640 1 -- 172.21.15.134:0/2183247033 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf3801aa80 con 0x56193bc647e0 2024-04-24T02:12:46.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.065+0000 7faf4b03f800 1 -- 172.21.15.134:0/2183247033 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56193bd61a00 con 0x56193bc647e0 2024-04-24T02:12:46.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.065+0000 7faf4b03f800 1 -- 172.21.15.134:0/2183247033 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56193bd646b0 con 0x56193bc647e0 2024-04-24T02:12:46.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.066+0000 7fae3560a640 1 -- 172.21.15.134:0/2183247033 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7faf38015020 con 0x56193bc647e0 2024-04-24T02:12:46.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.066+0000 7fae3560a640 1 --2- 172.21.15.134:0/2183247033 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fae30036900 0x7fae30038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.066+0000 7fae3560a640 1 -- 172.21.15.134:0/2183247033 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7faf38020070 con 0x56193bc647e0 2024-04-24T02:12:46.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.066+0000 7faf4833d640 1 --2- 172.21.15.134:0/2183247033 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fae30036900 0x7fae30038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.066+0000 7faf4b03f800 1 --2- 172.21.15.134:0/2183247033 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x56193bc66320 0x56193bd68470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.066+0000 7faf4b03f800 1 -- 172.21.15.134:0/2183247033 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56193bd689b0 con 0x56193bc66320 2024-04-24T02:12:46.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.066+0000 7faf4933f640 1 --2- 172.21.15.134:0/2183247033 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x56193bc66320 0x56193bd68470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.066+0000 7faf4833d640 1 --2- 172.21.15.134:0/2183247033 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fae30036900 0x7fae30038dc0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7faf3c054000 tx=0x7faf3c04e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.067+0000 7faf4933f640 1 --2- 172.21.15.134:0/2183247033 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x56193bc66320 0x56193bd68470 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.067+0000 7faf4933f640 1 -- 172.21.15.134:0/2183247033 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf4000a4a0 con 0x56193bc66320 2024-04-24T02:12:46.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.067+0000 7faf4b03f800 1 -- 172.21.15.134:0/2183247033 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56193bd65a40 con 0x56193bc66320 2024-04-24T02:12:46.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.067+0000 7faf4933f640 1 -- 172.21.15.134:0/2183247033 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faf4000a4a0 con 0x56193bc66320 2024-04-24T02:12:46.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.067+0000 7faf4b03f800 1 -- 172.21.15.134:0/2183247033 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56193bd6a840 con 0x56193bc66320 2024-04-24T02:12:46.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.067+0000 7faf4933f640 1 -- 172.21.15.134:0/2183247033 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7faf4000a4a0 con 0x56193bc66320 2024-04-24T02:12:46.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.067+0000 7faf4b03f800 1 -- 172.21.15.134:0/2183247033 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56193bd69b80 con 0x56193bc66320 2024-04-24T02:12:46.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.068+0000 7faf4933f640 1 -- 172.21.15.134:0/2183247033 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faf4000a4a0 con 0x56193bc66320 2024-04-24T02:12:46.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.068+0000 7faf4b03f800 1 -- 172.21.15.134:0/2183247033 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56193bd69f20 con 0x56193bc66320 2024-04-24T02:12:46.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.068+0000 7faf4933f640 1 -- 172.21.15.134:0/2183247033 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7faf4000a4a0 con 0x56193bc66320 2024-04-24T02:12:46.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.068+0000 7faf4b03f800 1 Processor -- start 2024-04-24T02:12:46.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.068+0000 7faf4b03f800 1 -- start start 2024-04-24T02:12:46.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.068+0000 7faf4b03f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56193bd79650 0x56193bd79a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.068+0000 7faf4b03f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56193bb576b0 con 0x56193bd79650 2024-04-24T02:12:46.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.069+0000 7faf4833d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56193bd79650 0x56193bd79a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.069+0000 7faf4833d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56193bd79650 0x56193bd79a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:35688/0 (socket says 172.21.15.134:35688) 2024-04-24T02:12:46.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.069+0000 7faf4833d640 1 -- 172.21.15.134:0/3199013618 learned_addr learned my addr 172.21.15.134:0/3199013618 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:46.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.069+0000 7faf4833d640 1 -- 172.21.15.134:0/3199013618 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56193bd79fb0 con 0x56193bd79650 2024-04-24T02:12:46.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.069+0000 7faf4833d640 1 --2- 172.21.15.134:0/3199013618 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56193bd79650 0x56193bd79a70 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7faf3c044840 tx=0x7faf3c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.069+0000 7fae2e7fc640 1 -- 172.21.15.134:0/3199013618 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf3c06f070 con 0x56193bd79650 2024-04-24T02:12:46.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.069+0000 7fae2e7fc640 1 -- 172.21.15.134:0/3199013618 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf3c058040 con 0x56193bd79650 2024-04-24T02:12:46.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.069+0000 7faf4b03f800 1 -- 172.21.15.134:0/3199013618 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56193bd7aa20 con 0x56193bd79650 2024-04-24T02:12:46.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.069+0000 7fae2e7fc640 1 -- 172.21.15.134:0/3199013618 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf3c057050 con 0x56193bd79650 2024-04-24T02:12:46.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.069+0000 7faf4b03f800 1 -- 172.21.15.134:0/3199013618 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56193bd7aec0 con 0x56193bd79650 2024-04-24T02:12:46.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.070+0000 7fae2e7fc640 1 -- 172.21.15.134:0/3199013618 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7faf3c072070 con 0x56193bd79650 2024-04-24T02:12:46.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.070+0000 7fae2e7fc640 1 --2- 172.21.15.134:0/3199013618 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fae20036950 0x7fae20038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.070+0000 7fae2e7fc640 1 -- 172.21.15.134:0/3199013618 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7faf3c08f7a0 con 0x56193bd79650 2024-04-24T02:12:46.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.070+0000 7faf4933f640 1 --2- 172.21.15.134:0/3199013618 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fae20036950 0x7fae20038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.070+0000 7faf4b03f800 1 Processor -- start 2024-04-24T02:12:46.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.071+0000 7faf4933f640 1 --2- 172.21.15.134:0/3199013618 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fae20036950 0x7fae20038e10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x56193bd696a0 tx=0x7faf40005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.071+0000 7faf4b03f800 1 -- start start 2024-04-24T02:12:46.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.071+0000 7faf4b03f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56193bc66c90 0x56193bc670b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.071+0000 7faf4b03f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56193bd5a040 con 0x56193bc66c90 2024-04-24T02:12:46.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.071+0000 7faf4833d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56193bc66c90 0x56193bc670b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.071+0000 7faf4833d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56193bc66c90 0x56193bc670b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:35702/0 (socket says 172.21.15.134:35702) 2024-04-24T02:12:46.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.071+0000 7faf4833d640 1 -- 172.21.15.134:0/1053010812 learned_addr learned my addr 172.21.15.134:0/1053010812 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:46.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.071+0000 7faf4833d640 1 -- 172.21.15.134:0/1053010812 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56193bc67680 con 0x56193bc66c90 2024-04-24T02:12:46.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.071+0000 7faf4833d640 1 --2- 172.21.15.134:0/1053010812 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56193bc66c90 0x56193bc670b0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7faf3c052e50 tx=0x7faf3c069480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f65c7ffe8c4009e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.071+0000 7fae1ffff640 1 -- 172.21.15.134:0/1053010812 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf3c05e4d0 con 0x56193bc66c90 2024-04-24T02:12:46.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.072+0000 7fae1ffff640 1 -- 172.21.15.134:0/1053010812 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf3c05fc90 con 0x56193bc66c90 2024-04-24T02:12:46.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.072+0000 7fae1ffff640 1 -- 172.21.15.134:0/1053010812 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf3c05e670 con 0x56193bc66c90 2024-04-24T02:12:46.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.072+0000 7faf4b03f800 1 -- 172.21.15.134:0/1053010812 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56193bc66c90 msgr2=0x56193bc670b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.072+0000 7faf4b03f800 1 --2- 172.21.15.134:0/1053010812 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56193bc66c90 0x56193bc670b0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7faf3c052e50 tx=0x7faf3c069480 comp rx=0 tx=0).stop 2024-04-24T02:12:46.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.072+0000 7faf4b03f800 1 -- 172.21.15.134:0/1053010812 shutdown_connections 2024-04-24T02:12:46.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.072+0000 7faf4b03f800 1 --2- 172.21.15.134:0/1053010812 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56193bc66c90 0x56193bc670b0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.072+0000 7faf4b03f800 1 -- 172.21.15.134:0/1053010812 >> 172.21.15.134:0/1053010812 conn(0x56193bd82be0 msgr2=0x56193bd80c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:46.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.072+0000 7faf4b03f800 1 -- 172.21.15.134:0/1053010812 shutdown_connections 2024-04-24T02:12:46.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.072+0000 7faf4b03f800 1 -- 172.21.15.134:0/1053010812 wait complete. 2024-04-24T02:12:46.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.072+0000 7faf4b03f800 1 Processor -- start 2024-04-24T02:12:46.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.072+0000 7faf4b03f800 1 -- start start 2024-04-24T02:12:46.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.073+0000 7faf4b03f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56193bc66c90 0x56193bd92280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.073+0000 7faf4b03f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56193bc67dd0 con 0x56193bc66c90 2024-04-24T02:12:46.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.073+0000 7faf4833d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56193bc66c90 0x56193bd92280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.073+0000 7faf4833d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56193bc66c90 0x56193bd92280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:35716/0 (socket says 172.21.15.134:35716) 2024-04-24T02:12:46.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.073+0000 7faf4833d640 1 -- 172.21.15.134:0/210640131 learned_addr learned my addr 172.21.15.134:0/210640131 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:46.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.073+0000 7faf4833d640 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56193bd927c0 con 0x56193bc66c90 2024-04-24T02:12:46.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.073+0000 7faf4833d640 1 --2- 172.21.15.134:0/210640131 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56193bc66c90 0x56193bd92280 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7faf3c0695d0 tx=0x7faf3c08db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.073+0000 7fae1e7fc640 1 -- 172.21.15.134:0/210640131 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf3c093020 con 0x56193bc66c90 2024-04-24T02:12:46.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.073+0000 7fae1e7fc640 1 -- 172.21.15.134:0/210640131 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf3c0698e0 con 0x56193bc66c90 2024-04-24T02:12:46.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.073+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56193bd92a50 con 0x56193bc66c90 2024-04-24T02:12:46.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.073+0000 7fae1e7fc640 1 -- 172.21.15.134:0/210640131 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf3c069c00 con 0x56193bc66c90 2024-04-24T02:12:46.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.073+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56193bd95700 con 0x56193bc66c90 2024-04-24T02:12:46.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.074+0000 7fae1e7fc640 1 -- 172.21.15.134:0/210640131 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7faf3c096020 con 0x56193bc66c90 2024-04-24T02:12:46.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.074+0000 7fae1e7fc640 1 --2- 172.21.15.134:0/210640131 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fae14036950 0x7fae14038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.074+0000 7fae1e7fc640 1 -- 172.21.15.134:0/210640131 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7faf3c099bb0 con 0x56193bc66c90 2024-04-24T02:12:46.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.074+0000 7faf4933f640 1 --2- 172.21.15.134:0/210640131 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fae14036950 0x7fae14038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.075+0000 7faf4933f640 1 --2- 172.21.15.134:0/210640131 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fae14036950 0x7fae14038e10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x56193bd62450 tx=0x7faf4001f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.075+0000 7faf4b03f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.075+0000 7faf4b03f800 1 --2- 172.21.15.134:0/210640131 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x56193bd9dde0 0x56193bda02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.075+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56193bda09f0 con 0x56193bd9dde0 2024-04-24T02:12:46.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.075+0000 7faf48b3e640 1 --2- 172.21.15.134:0/210640131 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x56193bd9dde0 0x56193bda02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.075+0000 7faf48b3e640 1 --2- 172.21.15.134:0/210640131 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x56193bd9dde0 0x56193bda02a0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.075+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf3802b070 con 0x56193bd9dde0 2024-04-24T02:12:46.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.075+0000 7faf4b03f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:46.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.075+0000 7faf4b03f800 20 realm 2024-04-24T02:12:46.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.075+0000 7faf4b03f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.075+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56193bda0e00 con 0x56193bd9dde0 2024-04-24T02:12:46.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.075+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf3802b070 con 0x56193bd9dde0 2024-04-24T02:12:46.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.075+0000 7faf4b03f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:46.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.075+0000 7faf4b03f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:46.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.075+0000 7faf4b03f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.075+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56193bda16d0 con 0x56193bd9dde0 2024-04-24T02:12:46.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.076+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf3802b070 con 0x56193bd9dde0 2024-04-24T02:12:46.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.076+0000 7faf4b03f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:46.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.076+0000 7faf4b03f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.076+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56193bda1a70 con 0x56193bd9dde0 2024-04-24T02:12:46.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.076+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faf3802b070 con 0x56193bd9dde0 2024-04-24T02:12:46.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.076+0000 7faf4b03f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:46.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.076+0000 7faf4b03f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.076+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56193bda22c0 con 0x56193bd9dde0 2024-04-24T02:12:46.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.076+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7faf3802b070 con 0x56193bd9dde0 2024-04-24T02:12:46.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.076+0000 7faf4b03f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:46.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.076+0000 7faf4b03f800 20 searching for the correct realm 2024-04-24T02:12:46.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.076+0000 7faf4b03f800 1 --2- 172.21.15.134:0/210640131 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x56193bda4030 0x56193bda6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.076+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193bda6a00 con 0x56193bda4030 2024-04-24T02:12:46.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.076+0000 7faf4833d640 1 --2- 172.21.15.134:0/210640131 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x56193bda4030 0x56193bda6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.077+0000 7faf4833d640 1 --2- 172.21.15.134:0/210640131 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x56193bda4030 0x56193bda6420 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.077+0000 7faf4833d640 1 -- 172.21.15.134:0/210640131 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf3c071030 con 0x56193bda4030 2024-04-24T02:12:46.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.077+0000 7faf4833d640 1 --2- 172.21.15.134:0/210640131 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7faf3c098020 0x7faf3c08c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.077+0000 7faf4833d640 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193bda6a00 con 0x7faf3c098020 2024-04-24T02:12:46.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.077+0000 7faf4933f640 1 --2- 172.21.15.134:0/210640131 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7faf3c098020 0x7faf3c08c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.077+0000 7faf4933f640 1 --2- 172.21.15.134:0/210640131 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7faf3c098020 0x7faf3c08c2d0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.078+0000 7faf4933f640 1 -- 172.21.15.134:0/210640131 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf4001f070 con 0x7faf3c098020 2024-04-24T02:12:46.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.078+0000 7faf4933f640 1 --2- 172.21.15.134:0/210640131 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7faf40031040 0x7faf40032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.078+0000 7faf4933f640 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193bda6a00 con 0x7faf40031040 2024-04-24T02:12:46.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.078+0000 7faf48b3e640 1 --2- 172.21.15.134:0/210640131 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7faf40031040 0x7faf40032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.078+0000 7faf48b3e640 1 --2- 172.21.15.134:0/210640131 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7faf40031040 0x7faf40032430 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.079+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf3802b070 con 0x7faf40031040 2024-04-24T02:12:46.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.079+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193bda6a00 con 0x56193bd9dde0 2024-04-24T02:12:46.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.079+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf3802b070 con 0x56193bd9dde0 2024-04-24T02:12:46.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.079+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193bda6a00 con 0x56193bd9dde0 2024-04-24T02:12:46.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.079+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7faf3802b070 con 0x56193bd9dde0 2024-04-24T02:12:46.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.079+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193bda6a00 con 0x7faf40031040 2024-04-24T02:12:46.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.079+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf3802b070 con 0x7faf40031040 2024-04-24T02:12:46.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.079+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193bda6a00 con 0x7faf3c098020 2024-04-24T02:12:46.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.079+0000 7faf4933f640 1 -- 172.21.15.134:0/210640131 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf4001f070 con 0x7faf3c098020 2024-04-24T02:12:46.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.079+0000 7faf4933f640 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193bda6a00 con 0x7faf3c098020 2024-04-24T02:12:46.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.080+0000 7faf4933f640 1 -- 172.21.15.134:0/210640131 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf4001f070 con 0x7faf3c098020 2024-04-24T02:12:46.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.080+0000 7faf4933f640 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193bda6a00 con 0x56193bda4030 2024-04-24T02:12:46.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.080+0000 7faf4833d640 1 -- 172.21.15.134:0/210640131 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf3c071030 con 0x56193bda4030 2024-04-24T02:12:46.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.080+0000 7faf4833d640 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193bda6a00 con 0x56193bd9dde0 2024-04-24T02:12:46.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.080+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf3802b070 con 0x56193bd9dde0 2024-04-24T02:12:46.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.080+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193bda6a00 con 0x7faf40031040 2024-04-24T02:12:46.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.080+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf3802b070 con 0x7faf40031040 2024-04-24T02:12:46.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.080+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193bda6a00 con 0x56193bd9dde0 2024-04-24T02:12:46.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.081+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf3802b070 con 0x56193bd9dde0 2024-04-24T02:12:46.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.081+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193bda6a00 con 0x7faf3c098020 2024-04-24T02:12:46.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.081+0000 7faf4933f640 1 -- 172.21.15.134:0/210640131 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7faf4001f070 con 0x7faf3c098020 2024-04-24T02:12:46.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.081+0000 7faf4933f640 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193bda6a00 con 0x56193bda4030 2024-04-24T02:12:46.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.081+0000 7faf4833d640 1 -- 172.21.15.134:0/210640131 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf3c071030 con 0x56193bda4030 2024-04-24T02:12:46.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.081+0000 7faf4833d640 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193bda6a00 con 0x56193bda4030 2024-04-24T02:12:46.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.081+0000 7faf4833d640 1 -- 172.21.15.134:0/210640131 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf3c071030 con 0x56193bda4030 2024-04-24T02:12:46.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.081+0000 7faf4833d640 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193bda6a00 con 0x7faf3c098020 2024-04-24T02:12:46.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.082+0000 7faf4933f640 1 -- 172.21.15.134:0/210640131 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf4001f070 con 0x7faf3c098020 2024-04-24T02:12:46.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.082+0000 7faf4933f640 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193bda6a00 con 0x56193bda4030 2024-04-24T02:12:46.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.082+0000 7faf4833d640 1 -- 172.21.15.134:0/210640131 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf3c071030 con 0x56193bda4030 2024-04-24T02:12:46.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.082+0000 7faf4833d640 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193bda6a00 con 0x56193bda4030 2024-04-24T02:12:46.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.082+0000 7faf4833d640 1 -- 172.21.15.134:0/210640131 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf3c071030 con 0x56193bda4030 2024-04-24T02:12:46.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.082+0000 7faf4833d640 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193bda6a00 con 0x56193bd9dde0 2024-04-24T02:12:46.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.082+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf3802b070 con 0x56193bd9dde0 2024-04-24T02:12:46.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.082+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193bda6a00 con 0x56193bd9dde0 2024-04-24T02:12:46.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.082+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7faf3802b070 con 0x56193bd9dde0 2024-04-24T02:12:46.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.083+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193bda6a00 con 0x7faf40031040 2024-04-24T02:12:46.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.083+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf3802b070 con 0x7faf40031040 2024-04-24T02:12:46.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.083+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193bda6a00 con 0x56193bda4030 2024-04-24T02:12:46.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.083+0000 7faf4833d640 1 -- 172.21.15.134:0/210640131 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf3c071030 con 0x56193bda4030 2024-04-24T02:12:46.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.083+0000 7faf4833d640 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193bda6a00 con 0x7faf3c098020 2024-04-24T02:12:46.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.083+0000 7faf4933f640 1 -- 172.21.15.134:0/210640131 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf4001f070 con 0x7faf3c098020 2024-04-24T02:12:46.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.083+0000 7faf4933f640 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193bda6a00 con 0x56193bd9dde0 2024-04-24T02:12:46.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.084+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf3802b070 con 0x56193bd9dde0 2024-04-24T02:12:46.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.084+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193bda6a00 con 0x7faf40031040 2024-04-24T02:12:46.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.084+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf3802b070 con 0x7faf40031040 2024-04-24T02:12:46.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.084+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193bda6a00 con 0x56193bda4030 2024-04-24T02:12:46.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.084+0000 7faf4833d640 1 -- 172.21.15.134:0/210640131 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf3c071030 con 0x56193bda4030 2024-04-24T02:12:46.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.084+0000 7faf4833d640 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193bda6a00 con 0x7faf40031040 2024-04-24T02:12:46.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.085+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf3802b070 con 0x7faf40031040 2024-04-24T02:12:46.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.085+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193bda6a00 con 0x7faf3c098020 2024-04-24T02:12:46.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.085+0000 7faf4933f640 1 -- 172.21.15.134:0/210640131 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf40040040 con 0x7faf3c098020 2024-04-24T02:12:46.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.085+0000 7faf4933f640 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193bda6a00 con 0x56193bda4030 2024-04-24T02:12:46.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.085+0000 7faf4833d640 1 -- 172.21.15.134:0/210640131 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf3c071030 con 0x56193bda4030 2024-04-24T02:12:46.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.085+0000 7faf4833d640 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193bda6a00 con 0x7faf3c098020 2024-04-24T02:12:46.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.085+0000 7faf4933f640 1 -- 172.21.15.134:0/210640131 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf40040040 con 0x7faf3c098020 2024-04-24T02:12:46.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.085+0000 7faf4933f640 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193bda6a00 con 0x56193bd9dde0 2024-04-24T02:12:46.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.086+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7faf3802b070 con 0x56193bd9dde0 2024-04-24T02:12:46.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.086+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193bda6a00 con 0x7faf3c098020 2024-04-24T02:12:46.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.086+0000 7faf4933f640 1 -- 172.21.15.134:0/210640131 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf40040040 con 0x7faf3c098020 2024-04-24T02:12:46.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.086+0000 7faf4b03f800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:46.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.086+0000 7faf4b03f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:46.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.086+0000 7faf4b03f800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:46.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.086+0000 7faf4b03f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:46.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.086+0000 7faf4b03f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:46.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.086+0000 7faf4b03f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:46.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.086+0000 7faf4b03f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.086+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56193bda2c10 con 0x56193bd9dde0 2024-04-24T02:12:46.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.086+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf3802b070 con 0x56193bd9dde0 2024-04-24T02:12:46.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.086+0000 7faf4b03f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:46.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.086+0000 7faf4b03f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.086+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56193bda34b0 con 0x56193bd9dde0 2024-04-24T02:12:46.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.086+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faf3802b070 con 0x56193bd9dde0 2024-04-24T02:12:46.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.086+0000 7faf4b03f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:46.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.086+0000 7faf4b03f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.086+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56193bda34b0 con 0x56193bd9dde0 2024-04-24T02:12:46.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.087+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7faf3802b070 con 0x56193bd9dde0 2024-04-24T02:12:46.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.087+0000 7faf4b03f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:46.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.087+0000 7faf4b03f800 20 zone default found 2024-04-24T02:12:46.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.087+0000 7faf4b03f800 4 Realm: () 2024-04-24T02:12:46.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.087+0000 7faf4b03f800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:46.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.087+0000 7faf4b03f800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:46.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.087+0000 7faf4b03f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:46.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.087+0000 7faf4b03f800 20 zonegroup default 2024-04-24T02:12:46.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.087+0000 7faf4b03f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.087+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56193bda6e80 con 0x7faf40031040 2024-04-24T02:12:46.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.087+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7faf3802b070 con 0x7faf40031040 2024-04-24T02:12:46.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.087+0000 7faf4b03f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:46.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.087+0000 7faf4b03f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.087+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56193bda88c0 con 0x56193bda4030 2024-04-24T02:12:46.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.087+0000 7faf4833d640 1 -- 172.21.15.134:0/210640131 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faf3c071030 con 0x56193bda4030 2024-04-24T02:12:46.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.087+0000 7faf4b03f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:46.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.087+0000 7faf4b03f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.087+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56193bda8dd0 con 0x56193bda4030 2024-04-24T02:12:46.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.088+0000 7faf4833d640 1 -- 172.21.15.134:0/210640131 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faf3c071030 con 0x56193bda4030 2024-04-24T02:12:46.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.088+0000 7faf4b03f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:46.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.088+0000 7faf4b03f800 20 started sync module instance, tier type = 2024-04-24T02:12:46.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.088+0000 7faf4b03f800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:46.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.088+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56193bda7d00 con 0x7faf3c098020 2024-04-24T02:12:46.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.089+0000 7faf4933f640 1 -- 172.21.15.134:0/210640131 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(44 notify.0 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf40040040 con 0x7faf3c098020 2024-04-24T02:12:46.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.089+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94666378346736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56193bda96e0 con 0x7faf3c098020 2024-04-24T02:12:46.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.089+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56193bda9f30 con 0x56193bd9dde0 2024-04-24T02:12:46.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.090+0000 7faf4933f640 1 -- 172.21.15.134:0/210640131 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94666378346736] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf40040040 con 0x7faf3c098020 2024-04-24T02:12:46.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.090+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf3802b070 con 0x56193bd9dde0 2024-04-24T02:12:46.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.090+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94666378351152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56193bda9b60 con 0x56193bd9dde0 2024-04-24T02:12:46.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.090+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56193bdaa670 con 0x56193bda4030 2024-04-24T02:12:46.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.091+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94666378351152] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf3802b070 con 0x56193bd9dde0 2024-04-24T02:12:46.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.092+0000 7faf4833d640 1 -- 172.21.15.134:0/210640131 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf3c071030 con 0x56193bda4030 2024-04-24T02:12:46.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.092+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94666378354976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56193bdaaa60 con 0x56193bda4030 2024-04-24T02:12:46.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.092+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56193bdab480 con 0x7faf3c098020 2024-04-24T02:12:46.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.093+0000 7faf4933f640 1 -- 172.21.15.134:0/210640131 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(50 notify.3 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf40040040 con 0x7faf3c098020 2024-04-24T02:12:46.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.093+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94666378358640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56193bdabd20 con 0x7faf3c098020 2024-04-24T02:12:46.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.093+0000 7faf4833d640 1 -- 172.21.15.134:0/210640131 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94666378354976] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf3c071030 con 0x56193bda4030 2024-04-24T02:12:46.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.093+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56193bda9650 con 0x56193bd9dde0 2024-04-24T02:12:46.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.094+0000 7faf4933f640 1 -- 172.21.15.134:0/210640131 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94666378358640] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf40040040 con 0x7faf3c098020 2024-04-24T02:12:46.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.094+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf3802b070 con 0x56193bd9dde0 2024-04-24T02:12:46.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.094+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94666378360944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56193bdabc90 con 0x56193bd9dde0 2024-04-24T02:12:46.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.094+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56193bdacde0 con 0x7faf40031040 2024-04-24T02:12:46.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.095+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94666378360944] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf3802b070 con 0x56193bd9dde0 2024-04-24T02:12:46.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.095+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(54 notify.5 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf3802b070 con 0x7faf40031040 2024-04-24T02:12:46.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.095+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94666378363664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56193bdacde0 con 0x7faf40031040 2024-04-24T02:12:46.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.095+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56193bdad7a0 con 0x7faf40031040 2024-04-24T02:12:46.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.096+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94666378363664] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf3802b070 con 0x7faf40031040 2024-04-24T02:12:46.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.096+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(56 notify.6 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf3802b070 con 0x7faf40031040 2024-04-24T02:12:46.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.096+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94666378365232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56193bdad980 con 0x7faf40031040 2024-04-24T02:12:46.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.096+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56193bdae1d0 con 0x7faf40031040 2024-04-24T02:12:46.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.097+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(58 notify.7 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf3802b070 con 0x7faf40031040 2024-04-24T02:12:46.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.097+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94666378365232] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf3802b070 con 0x7faf40031040 2024-04-24T02:12:46.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.097+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94666378369888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56193bdae5b0 con 0x7faf40031040 2024-04-24T02:12:46.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.097+0000 7faf4b03f800 20 add_watcher() i=0 2024-04-24T02:12:46.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.097+0000 7faf4b03f800 20 add_watcher() i=1 2024-04-24T02:12:46.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.097+0000 7faf4b03f800 20 add_watcher() i=2 2024-04-24T02:12:46.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.097+0000 7faf4b03f800 20 add_watcher() i=3 2024-04-24T02:12:46.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.097+0000 7faf4b03f800 20 add_watcher() i=4 2024-04-24T02:12:46.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.097+0000 7faf4b03f800 20 add_watcher() i=5 2024-04-24T02:12:46.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.097+0000 7faf4b03f800 20 add_watcher() i=6 2024-04-24T02:12:46.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.098+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94666378369888] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf3802b070 con 0x7faf40031040 2024-04-24T02:12:46.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.098+0000 7faf4b03f800 20 add_watcher() i=7 2024-04-24T02:12:46.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.098+0000 7faf4b03f800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:46.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.098+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56193bdad5c0 con 0x56193bd9dde0 2024-04-24T02:12:46.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.099+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7faf3802b070 con 0x56193bd9dde0 2024-04-24T02:12:46.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.099+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94666378371136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56193bdad5c0 con 0x56193bd9dde0 2024-04-24T02:12:46.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.100+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94666378371136] v32'185 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faf3802b070 con 0x56193bd9dde0 2024-04-24T02:12:46.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.100+0000 7fadfefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:46.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.100+0000 7faf4b03f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:46.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.100+0000 7faf4b03f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:46.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.100+0000 7faf4b03f800 5 note: GC not initialized 2024-04-24T02:12:46.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.100+0000 7fadfdfe3640 20 reqs_thread_entry: start 2024-04-24T02:12:46.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.100+0000 7faf4b03f800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:46.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.100+0000 7faf4b03f800 20 Filter name: none 2024-04-24T02:12:46.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.100+0000 7fad6f7fe640 20 reqs_thread_entry: start 2024-04-24T02:12:46.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.100+0000 7faf4b03f800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-24T02:12:46.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.100+0000 7faf4b03f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.100+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56193bde4ef0 con 0x7faf3c098020 2024-04-24T02:12:46.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.101+0000 7faf4933f640 1 -- 172.21.15.134:0/210640131 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7faf40040040 con 0x7faf3c098020 2024-04-24T02:12:46.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.101+0000 7faf4b03f800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T02:12:46.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.101+0000 7faf4b03f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-24T02:12:46.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.101+0000 7faf4b03f800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T02:12:46.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.101+0000 7faf4b03f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5 : miss 2024-04-24T02:12:46.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.101+0000 7faf4b03f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.101+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:63 8.f 8:f20f32b0:root::.bucket.meta.myfoo%3a582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56193bde69b0 con 0x56193bda4030 2024-04-24T02:12:46.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.101+0000 7faf4833d640 1 -- 172.21.15.134:0/210640131 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(63 .bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7faf3c071030 con 0x56193bda4030 2024-04-24T02:12:46.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.101+0000 7faf4b03f800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T02:12:46.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.101+0000 7faf4b03f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5 info.flags=0x17 2024-04-24T02:12:46.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.101+0000 7faf4b03f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5 to cache LRU end 2024-04-24T02:12:46.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.101+0000 7faf4b03f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:12:46.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.101+0000 7faf4b03f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T02:12:46.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.101+0000 7faf4b03f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5 2024-04-24T02:12:46.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.101+0000 7faf4b03f800 20 get_obj_state: octx=0x7faf380013e0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x56193bde9058 s->prefetch_data=0 2024-04-24T02:12:46.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.101+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:64 3.8 3:136c56d8:::582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56193bdea170 con 0x56193bda4030 2024-04-24T02:12:46.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.102+0000 7faf4833d640 1 -- 172.21.15.134:0/210640131 <== osd.3 v2:172.21.15.134:6801/3585115521 15 ==== osd_op_reply(64 582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=849b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 262+0+865 (crc 0 0 0) 0x7faf3c071030 con 0x56193bda4030 2024-04-24T02:12:46.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.102+0000 7faf4b03f800 10 manifest: total_size = 5 2024-04-24T02:12:46.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.102+0000 7faf4b03f800 20 get_obj_state: setting s->obj_tag to _xIsgsFOqa2Gt-25MiQmulQ0SWqPi2tL 2024-04-24T02:12:46.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.102+0000 7fadfefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:46.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.102+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94666378371136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56193bde2840 con 0x56193bd9dde0 2024-04-24T02:12:46.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.103+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94666378371136] v32'186 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faf3802b070 con 0x56193bd9dde0 2024-04-24T02:12:46.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.103+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94666378346736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56193bde2840 con 0x7faf3c098020 2024-04-24T02:12:46.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.104+0000 7faf4933f640 1 -- 172.21.15.134:0/210640131 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94666378346736] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf40040040 con 0x7faf3c098020 2024-04-24T02:12:46.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.104+0000 7faf4b03f800 20 remove_watcher() i=0 2024-04-24T02:12:46.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.104+0000 7faf4b03f800 2 removed watcher, disabling cache 2024-04-24T02:12:46.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.104+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94666378351152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56193bde2840 con 0x56193bd9dde0 2024-04-24T02:12:46.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.105+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94666378351152] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf3802b070 con 0x56193bd9dde0 2024-04-24T02:12:46.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.105+0000 7faf4b03f800 20 remove_watcher() i=1 2024-04-24T02:12:46.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.105+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94666378354976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56193bde2840 con 0x56193bda4030 2024-04-24T02:12:46.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.106+0000 7faf4833d640 1 -- 172.21.15.134:0/210640131 <== osd.3 v2:172.21.15.134:6801/3585115521 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94666378354976] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf3c071030 con 0x56193bda4030 2024-04-24T02:12:46.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.106+0000 7faf4b03f800 20 remove_watcher() i=2 2024-04-24T02:12:46.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.106+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94666378358640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56193bda9230 con 0x7faf3c098020 2024-04-24T02:12:46.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.107+0000 7faf4933f640 1 -- 172.21.15.134:0/210640131 <== osd.2 v2:172.21.15.134:6800/214480313 16 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94666378358640] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf40040040 con 0x7faf3c098020 2024-04-24T02:12:46.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.107+0000 7faf4b03f800 20 remove_watcher() i=3 2024-04-24T02:12:46.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.107+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94666378360944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56193bda9230 con 0x56193bd9dde0 2024-04-24T02:12:46.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.109+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94666378360944] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf3802b070 con 0x56193bd9dde0 2024-04-24T02:12:46.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.109+0000 7faf4b03f800 20 remove_watcher() i=4 2024-04-24T02:12:46.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.109+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94666378363664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56193bdab870 con 0x7faf40031040 2024-04-24T02:12:46.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.110+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94666378363664] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf3802b070 con 0x7faf40031040 2024-04-24T02:12:46.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.110+0000 7faf4b03f800 20 remove_watcher() i=5 2024-04-24T02:12:46.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.110+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94666378365232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56193bda9230 con 0x7faf40031040 2024-04-24T02:12:46.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.111+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94666378365232] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf3802b070 con 0x7faf40031040 2024-04-24T02:12:46.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.111+0000 7faf4b03f800 20 remove_watcher() i=6 2024-04-24T02:12:46.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.111+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94666378369888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56193bdac310 con 0x7faf40031040 2024-04-24T02:12:46.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.112+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94666378369888] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf3802b070 con 0x7faf40031040 2024-04-24T02:12:46.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.112+0000 7faf4b03f800 20 remove_watcher() i=7 2024-04-24T02:12:46.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.112+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7faf40031040 msgr2=0x7faf40032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.112+0000 7faf4b03f800 1 --2- 172.21.15.134:0/210640131 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7faf40031040 0x7faf40032430 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.112+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x56193bd9dde0 msgr2=0x56193bda02a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.112+0000 7faf4b03f800 1 --2- 172.21.15.134:0/210640131 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x56193bd9dde0 0x56193bda02a0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.112+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7faf3c098020 msgr2=0x7faf3c08c2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.112+0000 7faf4b03f800 1 --2- 172.21.15.134:0/210640131 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7faf3c098020 0x7faf3c08c2d0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.112+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x56193bda4030 msgr2=0x56193bda6420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.112+0000 7faf4b03f800 1 --2- 172.21.15.134:0/210640131 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x56193bda4030 0x56193bda6420 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.112+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fae14036950 msgr2=0x7fae14038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.112+0000 7faf4b03f800 1 --2- 172.21.15.134:0/210640131 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fae14036950 0x7fae14038e10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x56193bd62450 tx=0x7faf4001f000 comp rx=0 tx=0).stop 2024-04-24T02:12:46.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.112+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56193bc66c90 msgr2=0x56193bd92280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.112+0000 7faf4b03f800 1 --2- 172.21.15.134:0/210640131 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56193bc66c90 0x56193bd92280 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7faf3c0695d0 tx=0x7faf3c08db10 comp rx=0 tx=0).stop 2024-04-24T02:12:46.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.112+0000 7faf48b3e640 1 -- 172.21.15.134:0/210640131 reap_dead start 2024-04-24T02:12:46.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.112+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 shutdown_connections 2024-04-24T02:12:46.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.112+0000 7faf4b03f800 1 --2- 172.21.15.134:0/210640131 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56193bc66c90 0x56193bd92280 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.112+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 >> 172.21.15.134:0/210640131 conn(0x56193bd82be0 msgr2=0x56193bd80240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:46.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.112+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 shutdown_connections 2024-04-24T02:12:46.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.112+0000 7faf4b03f800 1 -- 172.21.15.134:0/210640131 wait complete. 2024-04-24T02:12:46.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.112+0000 7faf4b03f800 1 -- 172.21.15.134:0/3199013618 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fae20036950 msgr2=0x7fae20038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.112+0000 7faf4b03f800 1 --2- 172.21.15.134:0/3199013618 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fae20036950 0x7fae20038e10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x56193bd696a0 tx=0x7faf40005840 comp rx=0 tx=0).stop 2024-04-24T02:12:46.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.112+0000 7faf4b03f800 1 -- 172.21.15.134:0/3199013618 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56193bd79650 msgr2=0x56193bd79a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.112+0000 7faf4b03f800 1 --2- 172.21.15.134:0/3199013618 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56193bd79650 0x56193bd79a70 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7faf3c044840 tx=0x7faf3c002fb0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.112+0000 7faf4b03f800 1 -- 172.21.15.134:0/3199013618 shutdown_connections 2024-04-24T02:12:46.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.112+0000 7faf4b03f800 1 --2- 172.21.15.134:0/3199013618 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fae20036950 0x7fae20038e10 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.112+0000 7faf4b03f800 1 --2- 172.21.15.134:0/3199013618 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56193bd79650 0x56193bd79a70 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.112+0000 7faf4b03f800 1 -- 172.21.15.134:0/3199013618 >> 172.21.15.134:0/3199013618 conn(0x56193bd6d6f0 msgr2=0x56193bd6daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:46.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.112+0000 7faf4b03f800 1 -- 172.21.15.134:0/3199013618 shutdown_connections 2024-04-24T02:12:46.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.113+0000 7faf4b03f800 1 -- 172.21.15.134:0/3199013618 wait complete. 2024-04-24T02:12:46.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.113+0000 7faf4b03f800 1 -- 172.21.15.134:0/2183247033 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x56193bc66320 msgr2=0x56193bd68470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.113+0000 7faf4b03f800 1 --2- 172.21.15.134:0/2183247033 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x56193bc66320 0x56193bd68470 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.113+0000 7faf4b03f800 1 -- 172.21.15.134:0/2183247033 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fae30036900 msgr2=0x7fae30038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.113+0000 7faf4b03f800 1 --2- 172.21.15.134:0/2183247033 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fae30036900 0x7fae30038dc0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7faf3c054000 tx=0x7faf3c04e000 comp rx=0 tx=0).stop 2024-04-24T02:12:46.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.113+0000 7faf4b03f800 1 -- 172.21.15.134:0/2183247033 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56193bc647e0 msgr2=0x56193bd61230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.113+0000 7faf4b03f800 1 --2- 172.21.15.134:0/2183247033 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56193bc647e0 0x56193bd61230 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7faf3800c010 tx=0x7faf38000ed0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.113+0000 7faf4b03f800 1 -- 172.21.15.134:0/2183247033 shutdown_connections 2024-04-24T02:12:46.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.113+0000 7faf4b03f800 1 --2- 172.21.15.134:0/2183247033 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x56193bc66320 0x56193bd68470 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.113+0000 7faf4b03f800 1 --2- 172.21.15.134:0/2183247033 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fae30036900 0x7fae30038dc0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.113+0000 7faf4b03f800 1 --2- 172.21.15.134:0/2183247033 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56193bc647e0 0x56193bd61230 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.113+0000 7faf4b03f800 1 -- 172.21.15.134:0/2183247033 >> 172.21.15.134:0/2183247033 conn(0x56193bc60340 msgr2=0x56193bd53810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:46.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.113+0000 7faf4b03f800 1 -- 172.21.15.134:0/2183247033 shutdown_connections 2024-04-24T02:12:46.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.113+0000 7faf4b03f800 1 -- 172.21.15.134:0/2183247033 wait complete. 2024-04-24T02:12:46.143 INFO:teuthology.orchestra.run.smithi134.stdout:fooFoofooFooFULL_CONTROL 2024-04-24T02:12:46.143 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-04-24T02:12:46.145 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-04-24T02:12:46.150 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T02:12:46.150 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-04-24T02:12:46.150 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-04-24T02:12:46.150 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-04-24T02:12:46.227 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:46.228 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:46.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.227+0000 7fa365a16800 1 Processor -- start 2024-04-24T02:12:46.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.227+0000 7fa365a16800 1 -- start start 2024-04-24T02:12:46.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.227+0000 7fa365a16800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x562b421df480 0x562b421df8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.227+0000 7fa365a16800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562b4209cd40 con 0x562b421dfde0 2024-04-24T02:12:46.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.227+0000 7fa365a16800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x562b4206f4d0 con 0x562b421df480 2024-04-24T02:12:46.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.227+0000 7fa36115c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x562b421df480 0x562b421df8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.227+0000 7fa36115c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x562b421df480 0x562b421df8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:35728/0 (socket says 172.21.15.134:35728) 2024-04-24T02:12:46.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.227+0000 7fa36115c640 1 -- 172.21.15.134:0/2999004237 learned_addr learned my addr 172.21.15.134:0/2999004237 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:46.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.227+0000 7fa36095b640 1 --1- 172.21.15.134:0/2999004237 >> v1:172.21.15.104:6789/0 conn(0x562b421dfde0 0x562b421dbee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:42202/0 (socket says 172.21.15.134:42202) 2024-04-24T02:12:46.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.228+0000 7fa36115c640 1 -- 172.21.15.134:0/2999004237 >> v1:172.21.15.104:6789/0 conn(0x562b421dfde0 legacy=0x562b421dbee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.228+0000 7fa36115c640 1 -- 172.21.15.134:0/2999004237 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b4209b590 con 0x562b421df480 2024-04-24T02:12:46.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.228+0000 7fa353fff640 1 -- 172.21.15.134:0/2999004237 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3647122077 0 0) 0x562b4209cd40 con 0x562b421dfde0 2024-04-24T02:12:46.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.230+0000 7fa36115c640 1 --2- 172.21.15.134:0/2999004237 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562b421df480 0x562b421df8a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fa35400a520 tx=0x7fa35401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ba62d3a472ec2e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.230+0000 7fa353fff640 1 -- 172.21.15.134:0/2999004237 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa354057070 con 0x562b421df480 2024-04-24T02:12:46.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.230+0000 7fa353fff640 1 -- 172.21.15.134:0/2999004237 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa354052570 con 0x562b421df480 2024-04-24T02:12:46.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.230+0000 7fa353fff640 1 -- 172.21.15.134:0/2999004237 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa35404ae60 con 0x562b421df480 2024-04-24T02:12:46.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.230+0000 7fa365a16800 1 -- 172.21.15.134:0/2999004237 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562b421df480 msgr2=0x562b421df8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.230+0000 7fa365a16800 1 --2- 172.21.15.134:0/2999004237 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562b421df480 0x562b421df8a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fa35400a520 tx=0x7fa35401d010 comp rx=0 tx=0).stop 2024-04-24T02:12:46.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.230+0000 7fa365a16800 1 -- 172.21.15.134:0/2999004237 shutdown_connections 2024-04-24T02:12:46.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.230+0000 7fa365a16800 1 --2- 172.21.15.134:0/2999004237 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562b421df480 0x562b421df8a0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.230+0000 7fa365a16800 1 -- 172.21.15.134:0/2999004237 >> 172.21.15.134:0/2999004237 conn(0x562b421d7b20 msgr2=0x562b421d9f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:46.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.230+0000 7fa365a16800 1 -- 172.21.15.134:0/2999004237 shutdown_connections 2024-04-24T02:12:46.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.230+0000 7fa365a16800 1 -- 172.21.15.134:0/2999004237 wait complete. 2024-04-24T02:12:46.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.242+0000 7fa365a16800 1 Processor -- start 2024-04-24T02:12:46.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.242+0000 7fa365a16800 1 -- start start 2024-04-24T02:12:46.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.242+0000 7fa365a16800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562b421df480 0x562b422cf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.242+0000 7fa365a16800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x562b421293b0 con 0x562b421df480 2024-04-24T02:12:46.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.242+0000 7fa36115c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562b421df480 0x562b422cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.242+0000 7fa36115c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562b421df480 0x562b422cf570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:35734/0 (socket says 172.21.15.134:35734) 2024-04-24T02:12:46.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.242+0000 7fa36115c640 1 -- 172.21.15.134:0/3164140065 learned_addr learned my addr 172.21.15.134:0/3164140065 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:46.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.243+0000 7fa36115c640 1 -- 172.21.15.134:0/3164140065 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b422cfb40 con 0x562b421df480 2024-04-24T02:12:46.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.243+0000 7fa36115c640 1 --2- 172.21.15.134:0/3164140065 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562b421df480 0x562b422cf570 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fa354055040 tx=0x7fa35404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=facc8d17ab57e455 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.243+0000 7fa24f606640 1 -- 172.21.15.134:0/3164140065 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa354062070 con 0x562b421df480 2024-04-24T02:12:46.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.243+0000 7fa24f606640 1 -- 172.21.15.134:0/3164140065 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa354052720 con 0x562b421df480 2024-04-24T02:12:46.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.243+0000 7fa24f606640 1 -- 172.21.15.134:0/3164140065 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa354057040 con 0x562b421df480 2024-04-24T02:12:46.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.244+0000 7fa365a16800 1 -- 172.21.15.134:0/3164140065 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562b421df480 msgr2=0x562b422cf570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.244+0000 7fa365a16800 1 --2- 172.21.15.134:0/3164140065 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562b421df480 0x562b422cf570 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fa354055040 tx=0x7fa35404c000 comp rx=0 tx=0).stop 2024-04-24T02:12:46.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.244+0000 7fa365a16800 1 -- 172.21.15.134:0/3164140065 shutdown_connections 2024-04-24T02:12:46.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.244+0000 7fa365a16800 1 --2- 172.21.15.134:0/3164140065 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562b421df480 0x562b422cf570 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.244+0000 7fa365a16800 1 -- 172.21.15.134:0/3164140065 >> 172.21.15.134:0/3164140065 conn(0x562b421d7b20 msgr2=0x562b422cae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:46.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.244+0000 7fa365a16800 1 -- 172.21.15.134:0/3164140065 shutdown_connections 2024-04-24T02:12:46.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.244+0000 7fa365a16800 1 -- 172.21.15.134:0/3164140065 wait complete. 2024-04-24T02:12:46.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.244+0000 7fa365a16800 1 Processor -- start 2024-04-24T02:12:46.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.244+0000 7fa365a16800 1 -- start start 2024-04-24T02:12:46.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.244+0000 7fa365a16800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562b421df480 0x562b421deb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.244+0000 7fa365a16800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x562b421e7740 con 0x562b421df480 2024-04-24T02:12:46.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.244+0000 7fa36115c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562b421df480 0x562b421deb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.244+0000 7fa36115c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562b421df480 0x562b421deb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:35742/0 (socket says 172.21.15.134:35742) 2024-04-24T02:12:46.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.244+0000 7fa36115c640 1 -- 172.21.15.134:0/2137392896 learned_addr learned my addr 172.21.15.134:0/2137392896 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:46.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.245+0000 7fa36115c640 1 -- 172.21.15.134:0/2137392896 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b421dd210 con 0x562b421df480 2024-04-24T02:12:46.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.245+0000 7fa36115c640 1 --2- 172.21.15.134:0/2137392896 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562b421df480 0x562b421deb20 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fa3540057e0 tx=0x7fa354002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.245+0000 7fa24de03640 1 -- 172.21.15.134:0/2137392896 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa354057050 con 0x562b421df480 2024-04-24T02:12:46.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.245+0000 7fa24de03640 1 -- 172.21.15.134:0/2137392896 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa354067450 con 0x562b421df480 2024-04-24T02:12:46.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.245+0000 7fa365a16800 1 -- 172.21.15.134:0/2137392896 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562b421dd4a0 con 0x562b421df480 2024-04-24T02:12:46.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.245+0000 7fa24de03640 1 -- 172.21.15.134:0/2137392896 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa354062040 con 0x562b421df480 2024-04-24T02:12:46.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.245+0000 7fa365a16800 1 -- 172.21.15.134:0/2137392896 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b421dda20 con 0x562b421df480 2024-04-24T02:12:46.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.246+0000 7fa24de03640 1 -- 172.21.15.134:0/2137392896 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa354067750 con 0x562b421df480 2024-04-24T02:12:46.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.246+0000 7fa24de03640 1 --2- 172.21.15.134:0/2137392896 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa248036900 0x7fa248038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.246+0000 7fa24de03640 1 -- 172.21.15.134:0/2137392896 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fa35408e100 con 0x562b421df480 2024-04-24T02:12:46.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.246+0000 7fa36095b640 1 --2- 172.21.15.134:0/2137392896 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa248036900 0x7fa248038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.246+0000 7fa365a16800 1 --2- 172.21.15.134:0/2137392896 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x562b421dfde0 0x562b422e05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.246+0000 7fa365a16800 1 -- 172.21.15.134:0/2137392896 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b422e0af0 con 0x562b421dfde0 2024-04-24T02:12:46.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.246+0000 7fa36195d640 1 --2- 172.21.15.134:0/2137392896 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x562b421dfde0 0x562b422e05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.246+0000 7fa36095b640 1 --2- 172.21.15.134:0/2137392896 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa248036900 0x7fa248038dc0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa358000c00 tx=0x7fa3580013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.246+0000 7fa36195d640 1 --2- 172.21.15.134:0/2137392896 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x562b421dfde0 0x562b422e05b0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.247+0000 7fa36195d640 1 -- 172.21.15.134:0/2137392896 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa35c00a4a0 con 0x562b421dfde0 2024-04-24T02:12:46.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.247+0000 7fa365a16800 1 -- 172.21.15.134:0/2137392896 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b422e1340 con 0x562b421dfde0 2024-04-24T02:12:46.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.247+0000 7fa36195d640 1 -- 172.21.15.134:0/2137392896 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa35c00a4a0 con 0x562b421dfde0 2024-04-24T02:12:46.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.247+0000 7fa365a16800 1 -- 172.21.15.134:0/2137392896 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b422e26f0 con 0x562b421dfde0 2024-04-24T02:12:46.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.247+0000 7fa36195d640 1 -- 172.21.15.134:0/2137392896 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa35c00a4a0 con 0x562b421dfde0 2024-04-24T02:12:46.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.247+0000 7fa365a16800 1 -- 172.21.15.134:0/2137392896 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b422e1b90 con 0x562b421dfde0 2024-04-24T02:12:46.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.247+0000 7fa36195d640 1 -- 172.21.15.134:0/2137392896 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa35c00a4a0 con 0x562b421dfde0 2024-04-24T02:12:46.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.248+0000 7fa365a16800 1 -- 172.21.15.134:0/2137392896 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b422e1fe0 con 0x562b421dfde0 2024-04-24T02:12:46.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.248+0000 7fa36195d640 1 -- 172.21.15.134:0/2137392896 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa35c00a4a0 con 0x562b421dfde0 2024-04-24T02:12:46.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.248+0000 7fa365a16800 1 Processor -- start 2024-04-24T02:12:46.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.248+0000 7fa365a16800 1 -- start start 2024-04-24T02:12:46.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.248+0000 7fa365a16800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562b422f16e0 0x562b422f1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.248+0000 7fa365a16800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x562b421df060 con 0x562b422f16e0 2024-04-24T02:12:46.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.248+0000 7fa36095b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562b422f16e0 0x562b422f1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.248+0000 7fa36095b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562b422f16e0 0x562b422f1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:35754/0 (socket says 172.21.15.134:35754) 2024-04-24T02:12:46.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.248+0000 7fa36095b640 1 -- 172.21.15.134:0/1133434579 learned_addr learned my addr 172.21.15.134:0/1133434579 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:46.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.249+0000 7fa36095b640 1 -- 172.21.15.134:0/1133434579 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b422f2040 con 0x562b422f16e0 2024-04-24T02:12:46.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.249+0000 7fa36095b640 1 --2- 172.21.15.134:0/1133434579 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562b422f16e0 0x562b422f1b00 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fa35800e610 tx=0x7fa35800ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.249+0000 7fa246ffd640 1 -- 172.21.15.134:0/1133434579 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa358022070 con 0x562b422f16e0 2024-04-24T02:12:46.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.249+0000 7fa246ffd640 1 -- 172.21.15.134:0/1133434579 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa358009050 con 0x562b422f16e0 2024-04-24T02:12:46.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.249+0000 7fa365a16800 1 -- 172.21.15.134:0/1133434579 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562b422f2ab0 con 0x562b422f16e0 2024-04-24T02:12:46.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.249+0000 7fa246ffd640 1 -- 172.21.15.134:0/1133434579 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa35800d500 con 0x562b422f16e0 2024-04-24T02:12:46.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.249+0000 7fa365a16800 1 -- 172.21.15.134:0/1133434579 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b422f2fb0 con 0x562b422f16e0 2024-04-24T02:12:46.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.250+0000 7fa246ffd640 1 -- 172.21.15.134:0/1133434579 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa358025070 con 0x562b422f16e0 2024-04-24T02:12:46.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.250+0000 7fa246ffd640 1 --2- 172.21.15.134:0/1133434579 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa238036950 0x7fa238038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.250+0000 7fa246ffd640 1 -- 172.21.15.134:0/1133434579 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fa35804d9f0 con 0x562b422f16e0 2024-04-24T02:12:46.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.250+0000 7fa36195d640 1 --2- 172.21.15.134:0/1133434579 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa238036950 0x7fa238038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.250+0000 7fa365a16800 1 Processor -- start 2024-04-24T02:12:46.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.250+0000 7fa36195d640 1 --2- 172.21.15.134:0/1133434579 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa238036950 0x7fa238038e10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x562b422e12d0 tx=0x7fa35c005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.250+0000 7fa365a16800 1 -- start start 2024-04-24T02:12:46.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.250+0000 7fa365a16800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562b422fea20 0x562b422fee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.251+0000 7fa365a16800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x562b420cf6b0 con 0x562b422fea20 2024-04-24T02:12:46.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.251+0000 7fa36095b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562b422fea20 0x562b422fee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.251+0000 7fa36095b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562b422fea20 0x562b422fee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:35770/0 (socket says 172.21.15.134:35770) 2024-04-24T02:12:46.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.251+0000 7fa36095b640 1 -- 172.21.15.134:0/4215616892 learned_addr learned my addr 172.21.15.134:0/4215616892 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:46.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.251+0000 7fa36095b640 1 -- 172.21.15.134:0/4215616892 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b422ff410 con 0x562b422fea20 2024-04-24T02:12:46.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.251+0000 7fa36095b640 1 --2- 172.21.15.134:0/4215616892 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562b422fea20 0x562b422fee40 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fa35800ee80 tx=0x7fa358026680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=558088a2fd14466b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.251+0000 7fa244ff9640 1 -- 172.21.15.134:0/4215616892 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa358049020 con 0x562b422fea20 2024-04-24T02:12:46.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.251+0000 7fa244ff9640 1 -- 172.21.15.134:0/4215616892 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa35801ac20 con 0x562b422fea20 2024-04-24T02:12:46.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.251+0000 7fa244ff9640 1 -- 172.21.15.134:0/4215616892 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa358025360 con 0x562b422fea20 2024-04-24T02:12:46.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.252+0000 7fa365a16800 1 -- 172.21.15.134:0/4215616892 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562b422fea20 msgr2=0x562b422fee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.252+0000 7fa365a16800 1 --2- 172.21.15.134:0/4215616892 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562b422fea20 0x562b422fee40 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fa35800ee80 tx=0x7fa358026680 comp rx=0 tx=0).stop 2024-04-24T02:12:46.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.252+0000 7fa365a16800 1 -- 172.21.15.134:0/4215616892 shutdown_connections 2024-04-24T02:12:46.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.252+0000 7fa365a16800 1 --2- 172.21.15.134:0/4215616892 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562b422fea20 0x562b422fee40 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.252+0000 7fa365a16800 1 -- 172.21.15.134:0/4215616892 >> 172.21.15.134:0/4215616892 conn(0x562b422fad80 msgr2=0x562b422f8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:46.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.252+0000 7fa365a16800 1 -- 172.21.15.134:0/4215616892 shutdown_connections 2024-04-24T02:12:46.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.252+0000 7fa365a16800 1 -- 172.21.15.134:0/4215616892 wait complete. 2024-04-24T02:12:46.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.252+0000 7fa365a16800 1 Processor -- start 2024-04-24T02:12:46.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.252+0000 7fa365a16800 1 -- start start 2024-04-24T02:12:46.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.252+0000 7fa365a16800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562b422fea20 0x562b42305f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.252+0000 7fa365a16800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x562b422ffa00 con 0x562b422fea20 2024-04-24T02:12:46.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.252+0000 7fa36095b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562b422fea20 0x562b42305f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.252+0000 7fa36095b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562b422fea20 0x562b42305f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:35786/0 (socket says 172.21.15.134:35786) 2024-04-24T02:12:46.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.252+0000 7fa36095b640 1 -- 172.21.15.134:0/992421975 learned_addr learned my addr 172.21.15.134:0/992421975 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:46.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.253+0000 7fa36095b640 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b42306480 con 0x562b422fea20 2024-04-24T02:12:46.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.253+0000 7fa36095b640 1 --2- 172.21.15.134:0/992421975 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562b422fea20 0x562b42305f40 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa358025ff0 tx=0x7fa35804be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.253+0000 7fa236ffd640 1 -- 172.21.15.134:0/992421975 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa358049070 con 0x562b422fea20 2024-04-24T02:12:46.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.253+0000 7fa236ffd640 1 -- 172.21.15.134:0/992421975 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa35801add0 con 0x562b422fea20 2024-04-24T02:12:46.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.253+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562b42306710 con 0x562b422fea20 2024-04-24T02:12:46.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.253+0000 7fa236ffd640 1 -- 172.21.15.134:0/992421975 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa35804d0f0 con 0x562b422fea20 2024-04-24T02:12:46.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.253+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b423093c0 con 0x562b422fea20 2024-04-24T02:12:46.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.253+0000 7fa236ffd640 1 -- 172.21.15.134:0/992421975 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa358033070 con 0x562b422fea20 2024-04-24T02:12:46.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.254+0000 7fa236ffd640 1 --2- 172.21.15.134:0/992421975 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa22c036890 0x7fa22c038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.254+0000 7fa236ffd640 1 -- 172.21.15.134:0/992421975 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fa358043b80 con 0x562b422fea20 2024-04-24T02:12:46.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.254+0000 7fa36195d640 1 --2- 172.21.15.134:0/992421975 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa22c036890 0x7fa22c038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.254+0000 7fa36195d640 1 --2- 172.21.15.134:0/992421975 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa22c036890 0x7fa22c038d50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x562b421de4e0 tx=0x7fa35c01f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.254+0000 7fa365a16800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.254+0000 7fa365a16800 1 --2- 172.21.15.134:0/992421975 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x562b42311ae0 0x562b42313fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.254+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b423146f0 con 0x562b42311ae0 2024-04-24T02:12:46.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.254+0000 7fa36115c640 1 --2- 172.21.15.134:0/992421975 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x562b42311ae0 0x562b42313fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.255+0000 7fa36115c640 1 --2- 172.21.15.134:0/992421975 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x562b42311ae0 0x562b42313fa0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.255+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa354064070 con 0x562b42311ae0 2024-04-24T02:12:46.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.255+0000 7fa365a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:46.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.255+0000 7fa365a16800 20 realm 2024-04-24T02:12:46.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.255+0000 7fa365a16800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.255+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b42314b00 con 0x562b42311ae0 2024-04-24T02:12:46.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.255+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa354064070 con 0x562b42311ae0 2024-04-24T02:12:46.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.255+0000 7fa365a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:46.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.255+0000 7fa365a16800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:46.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.255+0000 7fa365a16800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.255+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b423153d0 con 0x562b42311ae0 2024-04-24T02:12:46.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.255+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa354064070 con 0x562b42311ae0 2024-04-24T02:12:46.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.255+0000 7fa365a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:46.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.255+0000 7fa365a16800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.255+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b42315770 con 0x562b42311ae0 2024-04-24T02:12:46.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.256+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa354064070 con 0x562b42311ae0 2024-04-24T02:12:46.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.256+0000 7fa365a16800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:46.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.256+0000 7fa365a16800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.256+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b42315fc0 con 0x562b42311ae0 2024-04-24T02:12:46.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.256+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa354064070 con 0x562b42311ae0 2024-04-24T02:12:46.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.256+0000 7fa365a16800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:46.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.256+0000 7fa365a16800 20 searching for the correct realm 2024-04-24T02:12:46.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.256+0000 7fa365a16800 1 --2- 172.21.15.134:0/992421975 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x562b42317d30 0x562b4231a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.256+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b4231a700 con 0x562b42317d30 2024-04-24T02:12:46.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.256+0000 7fa36095b640 1 --2- 172.21.15.134:0/992421975 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x562b42317d30 0x562b4231a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.256+0000 7fa36095b640 1 --2- 172.21.15.134:0/992421975 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x562b42317d30 0x562b4231a120 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.257+0000 7fa36095b640 1 -- 172.21.15.134:0/992421975 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa358032030 con 0x562b42317d30 2024-04-24T02:12:46.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.257+0000 7fa36095b640 1 --2- 172.21.15.134:0/992421975 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fa358035070 0x7fa35804d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.257+0000 7fa36095b640 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b4231a700 con 0x7fa358035070 2024-04-24T02:12:46.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.257+0000 7fa36195d640 1 --2- 172.21.15.134:0/992421975 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fa358035070 0x7fa35804d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.257+0000 7fa36195d640 1 --2- 172.21.15.134:0/992421975 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fa358035070 0x7fa35804d3a0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.257+0000 7fa36195d640 1 -- 172.21.15.134:0/992421975 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa35c01f070 con 0x7fa358035070 2024-04-24T02:12:46.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.257+0000 7fa36195d640 1 --2- 172.21.15.134:0/992421975 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fa35c031040 0x7fa35c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.257+0000 7fa36195d640 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b4231a700 con 0x7fa35c031040 2024-04-24T02:12:46.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.257+0000 7fa36115c640 1 --2- 172.21.15.134:0/992421975 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fa35c031040 0x7fa35c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.258+0000 7fa36115c640 1 --2- 172.21.15.134:0/992421975 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fa35c031040 0x7fa35c032940 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.258+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa354064070 con 0x7fa35c031040 2024-04-24T02:12:46.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.258+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b4231a700 con 0x562b42311ae0 2024-04-24T02:12:46.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.258+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa354064070 con 0x562b42311ae0 2024-04-24T02:12:46.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.258+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b4231a700 con 0x562b42311ae0 2024-04-24T02:12:46.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.258+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa354064070 con 0x562b42311ae0 2024-04-24T02:12:46.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.258+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b4231a700 con 0x7fa35c031040 2024-04-24T02:12:46.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.259+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa354064070 con 0x7fa35c031040 2024-04-24T02:12:46.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.259+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b4231a700 con 0x7fa358035070 2024-04-24T02:12:46.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.259+0000 7fa36195d640 1 -- 172.21.15.134:0/992421975 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa35c01f070 con 0x7fa358035070 2024-04-24T02:12:46.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.259+0000 7fa36195d640 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b4231a700 con 0x7fa358035070 2024-04-24T02:12:46.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.259+0000 7fa36195d640 1 -- 172.21.15.134:0/992421975 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa35c01f070 con 0x7fa358035070 2024-04-24T02:12:46.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.259+0000 7fa36195d640 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b4231a700 con 0x562b42317d30 2024-04-24T02:12:46.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.259+0000 7fa36095b640 1 -- 172.21.15.134:0/992421975 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa358032030 con 0x562b42317d30 2024-04-24T02:12:46.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.259+0000 7fa36095b640 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b4231a700 con 0x562b42311ae0 2024-04-24T02:12:46.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.260+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa354064070 con 0x562b42311ae0 2024-04-24T02:12:46.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.260+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b4231a700 con 0x7fa35c031040 2024-04-24T02:12:46.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.260+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa354064070 con 0x7fa35c031040 2024-04-24T02:12:46.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.260+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b4231a700 con 0x562b42311ae0 2024-04-24T02:12:46.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.260+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa354064070 con 0x562b42311ae0 2024-04-24T02:12:46.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.260+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b4231a700 con 0x7fa358035070 2024-04-24T02:12:46.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.260+0000 7fa36195d640 1 -- 172.21.15.134:0/992421975 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa35c01f070 con 0x7fa358035070 2024-04-24T02:12:46.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.261+0000 7fa36195d640 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b4231a700 con 0x562b42317d30 2024-04-24T02:12:46.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.261+0000 7fa36095b640 1 -- 172.21.15.134:0/992421975 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa358032030 con 0x562b42317d30 2024-04-24T02:12:46.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.261+0000 7fa36095b640 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b4231a700 con 0x562b42317d30 2024-04-24T02:12:46.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.261+0000 7fa36095b640 1 -- 172.21.15.134:0/992421975 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa358032030 con 0x562b42317d30 2024-04-24T02:12:46.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.261+0000 7fa36095b640 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b4231a700 con 0x7fa358035070 2024-04-24T02:12:46.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.261+0000 7fa36195d640 1 -- 172.21.15.134:0/992421975 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa35c01f070 con 0x7fa358035070 2024-04-24T02:12:46.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.261+0000 7fa36195d640 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b4231a700 con 0x562b42317d30 2024-04-24T02:12:46.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.261+0000 7fa36095b640 1 -- 172.21.15.134:0/992421975 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa358032030 con 0x562b42317d30 2024-04-24T02:12:46.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.261+0000 7fa36095b640 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b4231a700 con 0x562b42317d30 2024-04-24T02:12:46.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.262+0000 7fa36095b640 1 -- 172.21.15.134:0/992421975 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa358032030 con 0x562b42317d30 2024-04-24T02:12:46.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.262+0000 7fa36095b640 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b4231a700 con 0x562b42311ae0 2024-04-24T02:12:46.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.262+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa354064070 con 0x562b42311ae0 2024-04-24T02:12:46.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.262+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b4231a700 con 0x562b42311ae0 2024-04-24T02:12:46.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.262+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fa354064070 con 0x562b42311ae0 2024-04-24T02:12:46.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.262+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b4231a700 con 0x7fa35c031040 2024-04-24T02:12:46.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.262+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa354064070 con 0x7fa35c031040 2024-04-24T02:12:46.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.262+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b4231a700 con 0x562b42317d30 2024-04-24T02:12:46.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.263+0000 7fa36095b640 1 -- 172.21.15.134:0/992421975 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa358032030 con 0x562b42317d30 2024-04-24T02:12:46.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.263+0000 7fa36095b640 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b4231a700 con 0x7fa358035070 2024-04-24T02:12:46.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.263+0000 7fa36195d640 1 -- 172.21.15.134:0/992421975 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa35c01f070 con 0x7fa358035070 2024-04-24T02:12:46.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.263+0000 7fa36195d640 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b4231a700 con 0x562b42311ae0 2024-04-24T02:12:46.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.263+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa354064070 con 0x562b42311ae0 2024-04-24T02:12:46.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.263+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b4231a700 con 0x7fa35c031040 2024-04-24T02:12:46.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.264+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa354064070 con 0x7fa35c031040 2024-04-24T02:12:46.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.264+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b4231a700 con 0x562b42317d30 2024-04-24T02:12:46.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.264+0000 7fa36095b640 1 -- 172.21.15.134:0/992421975 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa358032030 con 0x562b42317d30 2024-04-24T02:12:46.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.264+0000 7fa36095b640 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b4231a700 con 0x7fa35c031040 2024-04-24T02:12:46.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.264+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa354064070 con 0x7fa35c031040 2024-04-24T02:12:46.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.264+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b4231a700 con 0x7fa358035070 2024-04-24T02:12:46.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.264+0000 7fa36195d640 1 -- 172.21.15.134:0/992421975 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa35c040040 con 0x7fa358035070 2024-04-24T02:12:46.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.264+0000 7fa36195d640 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b4231a700 con 0x562b42317d30 2024-04-24T02:12:46.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.264+0000 7fa36095b640 1 -- 172.21.15.134:0/992421975 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa358032030 con 0x562b42317d30 2024-04-24T02:12:46.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.264+0000 7fa36095b640 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b4231a700 con 0x7fa358035070 2024-04-24T02:12:46.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.265+0000 7fa36195d640 1 -- 172.21.15.134:0/992421975 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa35c040040 con 0x7fa358035070 2024-04-24T02:12:46.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.265+0000 7fa36195d640 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b4231a700 con 0x562b42311ae0 2024-04-24T02:12:46.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.265+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa354064070 con 0x562b42311ae0 2024-04-24T02:12:46.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.265+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b4231a700 con 0x7fa358035070 2024-04-24T02:12:46.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.265+0000 7fa36195d640 1 -- 172.21.15.134:0/992421975 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa35c040040 con 0x7fa358035070 2024-04-24T02:12:46.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.265+0000 7fa365a16800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:46.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.265+0000 7fa365a16800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:46.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.265+0000 7fa365a16800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:46.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.265+0000 7fa365a16800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:46.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.265+0000 7fa365a16800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:46.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.265+0000 7fa365a16800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:46.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.265+0000 7fa365a16800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.265+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b42316940 con 0x562b42311ae0 2024-04-24T02:12:46.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.265+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa354064070 con 0x562b42311ae0 2024-04-24T02:12:46.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.265+0000 7fa365a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:46.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.265+0000 7fa365a16800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.265+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b423171e0 con 0x562b42311ae0 2024-04-24T02:12:46.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.266+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa354064070 con 0x562b42311ae0 2024-04-24T02:12:46.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.266+0000 7fa365a16800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:46.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.266+0000 7fa365a16800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.266+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b423171e0 con 0x562b42311ae0 2024-04-24T02:12:46.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.266+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa354064070 con 0x562b42311ae0 2024-04-24T02:12:46.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.266+0000 7fa365a16800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:46.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.266+0000 7fa365a16800 20 zone default found 2024-04-24T02:12:46.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.266+0000 7fa365a16800 4 Realm: () 2024-04-24T02:12:46.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.266+0000 7fa365a16800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:46.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.266+0000 7fa365a16800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:46.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.266+0000 7fa365a16800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:46.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.266+0000 7fa365a16800 20 zonegroup default 2024-04-24T02:12:46.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.266+0000 7fa365a16800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.266+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b4231ab80 con 0x7fa35c031040 2024-04-24T02:12:46.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.267+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa354064070 con 0x7fa35c031040 2024-04-24T02:12:46.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.267+0000 7fa365a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:46.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.267+0000 7fa365a16800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.267+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b4231c5e0 con 0x562b42317d30 2024-04-24T02:12:46.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.267+0000 7fa36095b640 1 -- 172.21.15.134:0/992421975 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa358032030 con 0x562b42317d30 2024-04-24T02:12:46.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.267+0000 7fa365a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:46.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.267+0000 7fa365a16800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.267+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b4231cb20 con 0x562b42317d30 2024-04-24T02:12:46.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.267+0000 7fa36095b640 1 -- 172.21.15.134:0/992421975 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa358032030 con 0x562b42317d30 2024-04-24T02:12:46.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.267+0000 7fa365a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:46.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.267+0000 7fa365a16800 20 started sync module instance, tier type = 2024-04-24T02:12:46.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.267+0000 7fa365a16800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:46.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.267+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b4231ba00 con 0x7fa358035070 2024-04-24T02:12:46.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.268+0000 7fa36195d640 1 -- 172.21.15.134:0/992421975 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(44 notify.0 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa35c040040 con 0x7fa358035070 2024-04-24T02:12:46.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.268+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94743794138608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b4231d430 con 0x7fa358035070 2024-04-24T02:12:46.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.268+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b4231dc80 con 0x562b42311ae0 2024-04-24T02:12:46.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.269+0000 7fa36195d640 1 -- 172.21.15.134:0/992421975 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94743794138608] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa35c040040 con 0x7fa358035070 2024-04-24T02:12:46.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.269+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa354064070 con 0x562b42311ae0 2024-04-24T02:12:46.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.269+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94743794143104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b4231d930 con 0x562b42311ae0 2024-04-24T02:12:46.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.269+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b4231e450 con 0x562b42317d30 2024-04-24T02:12:46.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.270+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94743794143104] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa354064070 con 0x562b42311ae0 2024-04-24T02:12:46.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.271+0000 7fa36095b640 1 -- 172.21.15.134:0/992421975 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa358032030 con 0x562b42317d30 2024-04-24T02:12:46.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.271+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94743794147104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b4231e840 con 0x562b42317d30 2024-04-24T02:12:46.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.271+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b4231f240 con 0x7fa358035070 2024-04-24T02:12:46.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.272+0000 7fa36195d640 1 -- 172.21.15.134:0/992421975 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(50 notify.3 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa35c040040 con 0x7fa358035070 2024-04-24T02:12:46.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.272+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94743794150736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b4231fae0 con 0x7fa358035070 2024-04-24T02:12:46.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.272+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b423205a0 con 0x562b42311ae0 2024-04-24T02:12:46.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.272+0000 7fa36095b640 1 -- 172.21.15.134:0/992421975 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94743794147104] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa358032030 con 0x562b42317d30 2024-04-24T02:12:46.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.273+0000 7fa36195d640 1 -- 172.21.15.134:0/992421975 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94743794150736] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa35c040040 con 0x7fa358035070 2024-04-24T02:12:46.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.273+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa354064070 con 0x562b42311ae0 2024-04-24T02:12:46.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.273+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94743794155728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b4231f630 con 0x562b42311ae0 2024-04-24T02:12:46.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.273+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b42320e70 con 0x7fa35c031040 2024-04-24T02:12:46.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.274+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(54 notify.5 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa354064070 con 0x7fa35c031040 2024-04-24T02:12:46.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.274+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94743794157648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b42321120 con 0x7fa35c031040 2024-04-24T02:12:46.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.274+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b423219b0 con 0x7fa35c031040 2024-04-24T02:12:46.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.274+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94743794155728] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa354064070 con 0x562b42311ae0 2024-04-24T02:12:46.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.275+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94743794157648] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa354064070 con 0x7fa35c031040 2024-04-24T02:12:46.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.275+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(56 notify.6 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa354064070 con 0x7fa35c031040 2024-04-24T02:12:46.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.275+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94743794144160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b42321180 con 0x7fa35c031040 2024-04-24T02:12:46.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.275+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b42321180 con 0x7fa35c031040 2024-04-24T02:12:46.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.277+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94743794144160] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa354064070 con 0x7fa35c031040 2024-04-24T02:12:46.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.277+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(58 notify.7 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa354064070 con 0x7fa35c031040 2024-04-24T02:12:46.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.277+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94743794158704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b42322040 con 0x7fa35c031040 2024-04-24T02:12:46.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.277+0000 7fa365a16800 20 add_watcher() i=0 2024-04-24T02:12:46.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.277+0000 7fa365a16800 20 add_watcher() i=1 2024-04-24T02:12:46.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.277+0000 7fa365a16800 20 add_watcher() i=2 2024-04-24T02:12:46.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.277+0000 7fa365a16800 20 add_watcher() i=3 2024-04-24T02:12:46.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.277+0000 7fa365a16800 20 add_watcher() i=4 2024-04-24T02:12:46.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.277+0000 7fa365a16800 20 add_watcher() i=5 2024-04-24T02:12:46.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.277+0000 7fa365a16800 20 add_watcher() i=6 2024-04-24T02:12:46.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.278+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94743794158704] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa354064070 con 0x7fa35c031040 2024-04-24T02:12:46.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.278+0000 7fa365a16800 20 add_watcher() i=7 2024-04-24T02:12:46.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.278+0000 7fa365a16800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:46.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.278+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b42325200 con 0x562b42311ae0 2024-04-24T02:12:46.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.278+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa354064070 con 0x562b42311ae0 2024-04-24T02:12:46.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.278+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94743794175024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b42322040 con 0x562b42311ae0 2024-04-24T02:12:46.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.279+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94743794175024] v32'187 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa354064070 con 0x562b42311ae0 2024-04-24T02:12:46.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.279+0000 7fa2177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:46.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.279+0000 7fa365a16800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:46.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.279+0000 7fa365a16800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:46.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.279+0000 7fa365a16800 5 note: GC not initialized 2024-04-24T02:12:46.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.280+0000 7fa2167e4640 20 reqs_thread_entry: start 2024-04-24T02:12:46.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.280+0000 7fa365a16800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:46.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.280+0000 7fa365a16800 20 Filter name: none 2024-04-24T02:12:46.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.280+0000 7fa187fff640 20 reqs_thread_entry: start 2024-04-24T02:12:46.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.280+0000 7fa365a16800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-24T02:12:46.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.280+0000 7fa365a16800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.280+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b42358ba0 con 0x7fa358035070 2024-04-24T02:12:46.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.280+0000 7fa36195d640 1 -- 172.21.15.134:0/992421975 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fa35c040040 con 0x7fa358035070 2024-04-24T02:12:46.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.280+0000 7fa365a16800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T02:12:46.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.280+0000 7fa365a16800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-24T02:12:46.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.280+0000 7fa365a16800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T02:12:46.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.280+0000 7fa365a16800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5 : miss 2024-04-24T02:12:46.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.280+0000 7fa365a16800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.280+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:63 8.f 8:f20f32b0:root::.bucket.meta.myfoo%3a582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b4235a6b0 con 0x562b42317d30 2024-04-24T02:12:46.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.281+0000 7fa36095b640 1 -- 172.21.15.134:0/992421975 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(63 .bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fa358032030 con 0x562b42317d30 2024-04-24T02:12:46.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.281+0000 7fa365a16800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T02:12:46.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.281+0000 7fa365a16800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5 info.flags=0x17 2024-04-24T02:12:46.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.281+0000 7fa365a16800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5 to cache LRU end 2024-04-24T02:12:46.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.281+0000 7fa365a16800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:12:46.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.281+0000 7fa365a16800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T02:12:46.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.281+0000 7fa365a16800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5 2024-04-24T02:12:46.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.281+0000 7fa365a16800 20 get_obj_state: octx=0x7fa354006fb0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x562b4235cd78 s->prefetch_data=0 2024-04-24T02:12:46.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.281+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:64 3.8 3:136c56d8:::582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b4235de90 con 0x562b42317d30 2024-04-24T02:12:46.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.281+0000 7fa36095b640 1 -- 172.21.15.134:0/992421975 <== osd.3 v2:172.21.15.134:6801/3585115521 15 ==== osd_op_reply(64 582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=911b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+927 (crc 0 0 0) 0x7fa358032030 con 0x562b42317d30 2024-04-24T02:12:46.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.281+0000 7fa365a16800 10 manifest: total_size = 5 2024-04-24T02:12:46.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.281+0000 7fa365a16800 20 get_obj_state: setting s->obj_tag to _DzHSO98t-UgXgD-85J7T1a7ocwvEgd9 2024-04-24T02:12:46.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.282+0000 7fa2177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:46.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.282+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94743794175024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b42356510 con 0x562b42311ae0 2024-04-24T02:12:46.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.283+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94743794175024] v32'188 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa354064070 con 0x562b42311ae0 2024-04-24T02:12:46.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.283+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94743794138608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b42356510 con 0x7fa358035070 2024-04-24T02:12:46.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.284+0000 7fa36195d640 1 -- 172.21.15.134:0/992421975 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94743794138608] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa35c040040 con 0x7fa358035070 2024-04-24T02:12:46.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.284+0000 7fa365a16800 20 remove_watcher() i=0 2024-04-24T02:12:46.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.284+0000 7fa365a16800 2 removed watcher, disabling cache 2024-04-24T02:12:46.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.284+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94743794143104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b42356510 con 0x562b42311ae0 2024-04-24T02:12:46.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.285+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94743794143104] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa354064070 con 0x562b42311ae0 2024-04-24T02:12:46.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.285+0000 7fa365a16800 20 remove_watcher() i=1 2024-04-24T02:12:46.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.285+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94743794147104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b42356510 con 0x562b42317d30 2024-04-24T02:12:46.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.286+0000 7fa36095b640 1 -- 172.21.15.134:0/992421975 <== osd.3 v2:172.21.15.134:6801/3585115521 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94743794147104] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa358032030 con 0x562b42317d30 2024-04-24T02:12:46.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.286+0000 7fa365a16800 20 remove_watcher() i=2 2024-04-24T02:12:46.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.286+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94743794150736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b4231cf80 con 0x7fa358035070 2024-04-24T02:12:46.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.287+0000 7fa36195d640 1 -- 172.21.15.134:0/992421975 <== osd.2 v2:172.21.15.134:6800/214480313 16 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94743794150736] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa35c040040 con 0x7fa358035070 2024-04-24T02:12:46.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.287+0000 7fa365a16800 20 remove_watcher() i=3 2024-04-24T02:12:46.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.287+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94743794155728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b4231df20 con 0x562b42311ae0 2024-04-24T02:12:46.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.288+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94743794155728] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa354064070 con 0x562b42311ae0 2024-04-24T02:12:46.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.288+0000 7fa365a16800 20 remove_watcher() i=4 2024-04-24T02:12:46.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.288+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94743794157648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b4231cf80 con 0x7fa35c031040 2024-04-24T02:12:46.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.289+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94743794157648] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa354064070 con 0x7fa35c031040 2024-04-24T02:12:46.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.289+0000 7fa365a16800 20 remove_watcher() i=5 2024-04-24T02:12:46.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.289+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94743794144160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b423200d0 con 0x7fa35c031040 2024-04-24T02:12:46.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.290+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94743794144160] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa354064070 con 0x7fa35c031040 2024-04-24T02:12:46.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.290+0000 7fa365a16800 20 remove_watcher() i=6 2024-04-24T02:12:46.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.290+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94743794158704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b4231df20 con 0x7fa35c031040 2024-04-24T02:12:46.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.291+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94743794158704] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa354064070 con 0x7fa35c031040 2024-04-24T02:12:46.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.291+0000 7fa365a16800 20 remove_watcher() i=7 2024-04-24T02:12:46.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.291+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fa35c031040 msgr2=0x7fa35c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.291+0000 7fa365a16800 1 --2- 172.21.15.134:0/992421975 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fa35c031040 0x7fa35c032940 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.291+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x562b42311ae0 msgr2=0x562b42313fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.291+0000 7fa365a16800 1 --2- 172.21.15.134:0/992421975 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x562b42311ae0 0x562b42313fa0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.291+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fa358035070 msgr2=0x7fa35804d3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.291+0000 7fa365a16800 1 --2- 172.21.15.134:0/992421975 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fa358035070 0x7fa35804d3a0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.291+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x562b42317d30 msgr2=0x562b4231a120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.292+0000 7fa365a16800 1 --2- 172.21.15.134:0/992421975 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x562b42317d30 0x562b4231a120 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.292+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa22c036890 msgr2=0x7fa22c038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.292+0000 7fa365a16800 1 --2- 172.21.15.134:0/992421975 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa22c036890 0x7fa22c038d50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x562b421de4e0 tx=0x7fa35c01f000 comp rx=0 tx=0).stop 2024-04-24T02:12:46.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.292+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562b422fea20 msgr2=0x562b42305f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.292+0000 7fa365a16800 1 --2- 172.21.15.134:0/992421975 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562b422fea20 0x562b42305f40 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa358025ff0 tx=0x7fa35804be20 comp rx=0 tx=0).stop 2024-04-24T02:12:46.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.292+0000 7fa36115c640 1 -- 172.21.15.134:0/992421975 reap_dead start 2024-04-24T02:12:46.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.292+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 shutdown_connections 2024-04-24T02:12:46.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.292+0000 7fa365a16800 1 --2- 172.21.15.134:0/992421975 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562b422fea20 0x562b42305f40 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.292+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 >> 172.21.15.134:0/992421975 conn(0x562b422fad80 msgr2=0x562b422f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:46.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.292+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 shutdown_connections 2024-04-24T02:12:46.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.292+0000 7fa365a16800 1 -- 172.21.15.134:0/992421975 wait complete. 2024-04-24T02:12:46.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.292+0000 7fa365a16800 1 -- 172.21.15.134:0/1133434579 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa238036950 msgr2=0x7fa238038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.292+0000 7fa365a16800 1 --2- 172.21.15.134:0/1133434579 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa238036950 0x7fa238038e10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x562b422e12d0 tx=0x7fa35c005840 comp rx=0 tx=0).stop 2024-04-24T02:12:46.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.292+0000 7fa365a16800 1 -- 172.21.15.134:0/1133434579 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562b422f16e0 msgr2=0x562b422f1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.292+0000 7fa365a16800 1 --2- 172.21.15.134:0/1133434579 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562b422f16e0 0x562b422f1b00 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fa35800e610 tx=0x7fa35800ff90 comp rx=0 tx=0).stop 2024-04-24T02:12:46.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.292+0000 7fa365a16800 1 -- 172.21.15.134:0/1133434579 shutdown_connections 2024-04-24T02:12:46.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.292+0000 7fa365a16800 1 --2- 172.21.15.134:0/1133434579 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa238036950 0x7fa238038e10 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.292+0000 7fa365a16800 1 --2- 172.21.15.134:0/1133434579 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562b422f16e0 0x562b422f1b00 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.292+0000 7fa365a16800 1 -- 172.21.15.134:0/1133434579 >> 172.21.15.134:0/1133434579 conn(0x562b422e5780 msgr2=0x562b422e5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:46.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.292+0000 7fa365a16800 1 -- 172.21.15.134:0/1133434579 shutdown_connections 2024-04-24T02:12:46.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.292+0000 7fa365a16800 1 -- 172.21.15.134:0/1133434579 wait complete. 2024-04-24T02:12:46.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.292+0000 7fa365a16800 1 -- 172.21.15.134:0/2137392896 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x562b421dfde0 msgr2=0x562b422e05b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.292+0000 7fa365a16800 1 --2- 172.21.15.134:0/2137392896 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x562b421dfde0 0x562b422e05b0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.292+0000 7fa365a16800 1 -- 172.21.15.134:0/2137392896 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa248036900 msgr2=0x7fa248038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.292+0000 7fa365a16800 1 --2- 172.21.15.134:0/2137392896 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa248036900 0x7fa248038dc0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa358000c00 tx=0x7fa3580013b0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.292+0000 7fa365a16800 1 -- 172.21.15.134:0/2137392896 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562b421df480 msgr2=0x562b421deb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.292+0000 7fa365a16800 1 --2- 172.21.15.134:0/2137392896 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562b421df480 0x562b421deb20 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fa3540057e0 tx=0x7fa354002fb0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.293+0000 7fa365a16800 1 -- 172.21.15.134:0/2137392896 shutdown_connections 2024-04-24T02:12:46.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.293+0000 7fa365a16800 1 --2- 172.21.15.134:0/2137392896 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x562b421dfde0 0x562b422e05b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.293+0000 7fa365a16800 1 --2- 172.21.15.134:0/2137392896 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa248036900 0x7fa248038dc0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.293+0000 7fa365a16800 1 --2- 172.21.15.134:0/2137392896 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562b421df480 0x562b421deb20 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.293+0000 7fa365a16800 1 -- 172.21.15.134:0/2137392896 >> 172.21.15.134:0/2137392896 conn(0x562b421d7b20 msgr2=0x562b422c96d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:46.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.293+0000 7fa365a16800 1 -- 172.21.15.134:0/2137392896 shutdown_connections 2024-04-24T02:12:46.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.293+0000 7fa365a16800 1 -- 172.21.15.134:0/2137392896 wait complete. 2024-04-24T02:12:46.330 INFO:teuthology.orchestra.run.smithi134.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-04-24T02:12:46.330 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-04-24T02:12:46.333 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-04-24T02:12:46.346 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T02:12:46.403 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-04-24T02:12:46.403 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-04-24T02:12:46.403 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-04-24T02:12:46.403 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-04-24T02:12:46.403 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-04-24T02:12:46.403 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-04-24T02:12:46.404 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-04-24T02:12:46.447 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:46.448 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:46.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.447+0000 7fe0d9805800 1 Processor -- start 2024-04-24T02:12:46.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.447+0000 7fe0d9805800 1 -- start start 2024-04-24T02:12:46.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.447+0000 7fe0d9805800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55cdc9593390 0x55cdc9595780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.447+0000 7fe0d9805800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cdc944dd40 con 0x55cdc958d120 2024-04-24T02:12:46.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.447+0000 7fe0d9805800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55cdc94204d0 con 0x55cdc9593390 2024-04-24T02:12:46.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.447+0000 7fe0d6b03640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55cdc9593390 0x55cdc9595780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.447+0000 7fe0d7304640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55cdc958d120 0x55cdc958d540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:42212/0 (socket says 172.21.15.134:42212) 2024-04-24T02:12:46.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.447+0000 7fe0d7304640 1 -- 172.21.15.134:0/2905613528 learned_addr learned my addr 172.21.15.134:0/2905613528 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:12:46.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.447+0000 7fe0d6b03640 1 --2- 172.21.15.134:0/2905613528 >> v2:172.21.15.104:3300/0 conn(0x55cdc9593390 0x55cdc9595780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:35790/0 (socket says 172.21.15.134:35790) 2024-04-24T02:12:46.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.448+0000 7fe0d6b03640 1 -- 172.21.15.134:0/2905613528 >> v1:172.21.15.104:6789/0 conn(0x55cdc958d120 legacy=0x55cdc958d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.448+0000 7fe0d6b03640 1 -- 172.21.15.134:0/2905613528 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdc944c590 con 0x55cdc9593390 2024-04-24T02:12:46.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.449+0000 7fe0d6b03640 1 --2- 172.21.15.134:0/2905613528 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdc9593390 0x55cdc9595780 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc00a470 tx=0x7fe0cc01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93bb2a357ab5f70b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.449+0000 7fe0d6302640 1 -- 172.21.15.134:0/2905613528 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0cc057070 con 0x55cdc9593390 2024-04-24T02:12:46.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.449+0000 7fe0d6302640 1 -- 172.21.15.134:0/2905613528 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0cc052570 con 0x55cdc9593390 2024-04-24T02:12:46.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.450+0000 7fe0d6302640 1 -- 172.21.15.134:0/2905613528 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0cc052870 con 0x55cdc9593390 2024-04-24T02:12:46.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.450+0000 7fe0d9805800 1 -- 172.21.15.134:0/2905613528 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdc9593390 msgr2=0x55cdc9595780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.450+0000 7fe0d9805800 1 --2- 172.21.15.134:0/2905613528 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdc9593390 0x55cdc9595780 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc00a470 tx=0x7fe0cc01ce90 comp rx=0 tx=0).stop 2024-04-24T02:12:46.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.450+0000 7fe0d9805800 1 -- 172.21.15.134:0/2905613528 shutdown_connections 2024-04-24T02:12:46.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.450+0000 7fe0d9805800 1 --2- 172.21.15.134:0/2905613528 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdc9593390 0x55cdc9595780 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.450+0000 7fe0d9805800 1 -- 172.21.15.134:0/2905613528 >> 172.21.15.134:0/2905613528 conn(0x55cdc9588b20 msgr2=0x55cdc958af40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:46.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.450+0000 7fe0d9805800 1 -- 172.21.15.134:0/2905613528 shutdown_connections 2024-04-24T02:12:46.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.450+0000 7fe0d9805800 1 -- 172.21.15.134:0/2905613528 wait complete. 2024-04-24T02:12:46.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.462+0000 7fe0d9805800 1 Processor -- start 2024-04-24T02:12:46.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.462+0000 7fe0d9805800 1 -- start start 2024-04-24T02:12:46.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.462+0000 7fe0d9805800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdc958d120 0x55cdc958faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.462+0000 7fe0d9805800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55cdc94da3b0 con 0x55cdc958d120 2024-04-24T02:12:46.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.462+0000 7fe0d7304640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdc958d120 0x55cdc958faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.462+0000 7fe0d7304640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdc958d120 0x55cdc958faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:35798/0 (socket says 172.21.15.134:35798) 2024-04-24T02:12:46.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.462+0000 7fe0d7304640 1 -- 172.21.15.134:0/4094778343 learned_addr learned my addr 172.21.15.134:0/4094778343 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:46.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.462+0000 7fe0d7304640 1 -- 172.21.15.134:0/4094778343 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdc958e060 con 0x55cdc958d120 2024-04-24T02:12:46.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.463+0000 7fe0d7304640 1 --2- 172.21.15.134:0/4094778343 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdc958d120 0x55cdc958faa0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fe0c80017a0 tx=0x7fe0c8001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a313c10fbf837172 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.463+0000 7fdfc560a640 1 -- 172.21.15.134:0/4094778343 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0c8016070 con 0x55cdc958d120 2024-04-24T02:12:46.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.463+0000 7fdfc560a640 1 -- 172.21.15.134:0/4094778343 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0c8004520 con 0x55cdc958d120 2024-04-24T02:12:46.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.463+0000 7fdfc560a640 1 -- 172.21.15.134:0/4094778343 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0c8004820 con 0x55cdc958d120 2024-04-24T02:12:46.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.463+0000 7fe0d9805800 1 -- 172.21.15.134:0/4094778343 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdc958d120 msgr2=0x55cdc958faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.463+0000 7fe0d9805800 1 --2- 172.21.15.134:0/4094778343 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdc958d120 0x55cdc958faa0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fe0c80017a0 tx=0x7fe0c8001c60 comp rx=0 tx=0).stop 2024-04-24T02:12:46.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.463+0000 7fe0d9805800 1 -- 172.21.15.134:0/4094778343 shutdown_connections 2024-04-24T02:12:46.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.463+0000 7fe0d9805800 1 --2- 172.21.15.134:0/4094778343 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdc958d120 0x55cdc958faa0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.463+0000 7fe0d9805800 1 -- 172.21.15.134:0/4094778343 >> 172.21.15.134:0/4094778343 conn(0x55cdc9588b20 msgr2=0x55cdc967b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:46.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.463+0000 7fe0d9805800 1 -- 172.21.15.134:0/4094778343 shutdown_connections 2024-04-24T02:12:46.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.463+0000 7fe0d9805800 1 -- 172.21.15.134:0/4094778343 wait complete. 2024-04-24T02:12:46.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.464+0000 7fe0d9805800 1 Processor -- start 2024-04-24T02:12:46.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.464+0000 7fe0d9805800 1 -- start start 2024-04-24T02:12:46.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.464+0000 7fe0d9805800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdc958d120 0x55cdc9689e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.464+0000 7fe0d9805800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55cdc9595fc0 con 0x55cdc958d120 2024-04-24T02:12:46.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.464+0000 7fe0d7304640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdc958d120 0x55cdc9689e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.464+0000 7fe0d7304640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdc958d120 0x55cdc9689e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:35810/0 (socket says 172.21.15.134:35810) 2024-04-24T02:12:46.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.464+0000 7fe0d7304640 1 -- 172.21.15.134:0/1864232147 learned_addr learned my addr 172.21.15.134:0/1864232147 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:46.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.464+0000 7fe0d7304640 1 -- 172.21.15.134:0/1864232147 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdc968a3b0 con 0x55cdc958d120 2024-04-24T02:12:46.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.465+0000 7fe0d7304640 1 --2- 172.21.15.134:0/1864232147 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdc958d120 0x55cdc9689e70 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8000f80 tx=0x7fe0c8001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.465+0000 7fdfc3e07640 1 -- 172.21.15.134:0/1864232147 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0c8016040 con 0x55cdc958d120 2024-04-24T02:12:46.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.465+0000 7fdfc3e07640 1 -- 172.21.15.134:0/1864232147 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0c8011530 con 0x55cdc958d120 2024-04-24T02:12:46.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.465+0000 7fdfc3e07640 1 -- 172.21.15.134:0/1864232147 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0c8011890 con 0x55cdc958d120 2024-04-24T02:12:46.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.465+0000 7fe0d9805800 1 -- 172.21.15.134:0/1864232147 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cdc968a640 con 0x55cdc958d120 2024-04-24T02:12:46.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.465+0000 7fe0d9805800 1 -- 172.21.15.134:0/1864232147 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cdc968d2f0 con 0x55cdc958d120 2024-04-24T02:12:46.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.466+0000 7fdfc3e07640 1 -- 172.21.15.134:0/1864232147 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe0c801c3f0 con 0x55cdc958d120 2024-04-24T02:12:46.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.466+0000 7fdfc3e07640 1 --2- 172.21.15.134:0/1864232147 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdfbc036950 0x7fdfbc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.466+0000 7fdfc3e07640 1 -- 172.21.15.134:0/1864232147 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fe0c804b8f0 con 0x55cdc958d120 2024-04-24T02:12:46.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.466+0000 7fe0d6b03640 1 --2- 172.21.15.134:0/1864232147 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdfbc036950 0x7fdfbc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.466+0000 7fe0d9805800 1 --2- 172.21.15.134:0/1864232147 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55cdc9593390 0x55cdc96910b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.466+0000 7fe0d9805800 1 -- 172.21.15.134:0/1864232147 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc9691630 con 0x55cdc9593390 2024-04-24T02:12:46.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.466+0000 7fe0d7b05640 1 --2- 172.21.15.134:0/1864232147 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55cdc9593390 0x55cdc96910b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.466+0000 7fe0d6b03640 1 --2- 172.21.15.134:0/1864232147 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdfbc036950 0x7fdfbc038e10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc054000 tx=0x7fe0cc04e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.466+0000 7fe0d7b05640 1 --2- 172.21.15.134:0/1864232147 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55cdc9593390 0x55cdc96910b0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.467+0000 7fe0d7b05640 1 -- 172.21.15.134:0/1864232147 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe0d00083e0 con 0x55cdc9593390 2024-04-24T02:12:46.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.467+0000 7fe0d9805800 1 -- 172.21.15.134:0/1864232147 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc968e660 con 0x55cdc9593390 2024-04-24T02:12:46.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.467+0000 7fe0d7b05640 1 -- 172.21.15.134:0/1864232147 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe0d00083e0 con 0x55cdc9593390 2024-04-24T02:12:46.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.467+0000 7fe0d9805800 1 -- 172.21.15.134:0/1864232147 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc9693430 con 0x55cdc9593390 2024-04-24T02:12:46.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.467+0000 7fe0d7b05640 1 -- 172.21.15.134:0/1864232147 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe0d00083e0 con 0x55cdc9593390 2024-04-24T02:12:46.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.467+0000 7fe0d9805800 1 -- 172.21.15.134:0/1864232147 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc9692770 con 0x55cdc9593390 2024-04-24T02:12:46.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.467+0000 7fe0d7b05640 1 -- 172.21.15.134:0/1864232147 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe0d00083e0 con 0x55cdc9593390 2024-04-24T02:12:46.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.467+0000 7fe0d9805800 1 -- 172.21.15.134:0/1864232147 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc9692b90 con 0x55cdc9593390 2024-04-24T02:12:46.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.468+0000 7fe0d7b05640 1 -- 172.21.15.134:0/1864232147 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe0d00083e0 con 0x55cdc9593390 2024-04-24T02:12:46.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.468+0000 7fe0d9805800 1 Processor -- start 2024-04-24T02:12:46.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.468+0000 7fe0d9805800 1 -- start start 2024-04-24T02:12:46.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.468+0000 7fe0d9805800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdc96a22c0 0x55cdc96a26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.468+0000 7fe0d9805800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55cdc94806b0 con 0x55cdc96a22c0 2024-04-24T02:12:46.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.468+0000 7fe0d6b03640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdc96a22c0 0x55cdc96a26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.468+0000 7fe0d6b03640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdc96a22c0 0x55cdc96a26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:35826/0 (socket says 172.21.15.134:35826) 2024-04-24T02:12:46.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.468+0000 7fe0d6b03640 1 -- 172.21.15.134:0/3798071809 learned_addr learned my addr 172.21.15.134:0/3798071809 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:46.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.469+0000 7fe0d6b03640 1 -- 172.21.15.134:0/3798071809 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdc96a2c20 con 0x55cdc96a22c0 2024-04-24T02:12:46.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.469+0000 7fe0d6b03640 1 --2- 172.21.15.134:0/3798071809 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdc96a22c0 0x55cdc96a26e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc044840 tx=0x7fe0cc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.469+0000 7fdfc1602640 1 -- 172.21.15.134:0/3798071809 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0cc06f070 con 0x55cdc96a22c0 2024-04-24T02:12:46.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.469+0000 7fdfc1602640 1 -- 172.21.15.134:0/3798071809 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0cc058040 con 0x55cdc96a22c0 2024-04-24T02:12:46.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.469+0000 7fe0d9805800 1 -- 172.21.15.134:0/3798071809 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cdc96a3690 con 0x55cdc96a22c0 2024-04-24T02:12:46.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.469+0000 7fdfc1602640 1 -- 172.21.15.134:0/3798071809 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0cc057050 con 0x55cdc96a22c0 2024-04-24T02:12:46.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.469+0000 7fe0d9805800 1 -- 172.21.15.134:0/3798071809 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cdc96a3b30 con 0x55cdc96a22c0 2024-04-24T02:12:46.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.470+0000 7fdfc1602640 1 -- 172.21.15.134:0/3798071809 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe0cc072070 con 0x55cdc96a22c0 2024-04-24T02:12:46.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.470+0000 7fdfc1602640 1 --2- 172.21.15.134:0/3798071809 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdfb0036950 0x7fdfb0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.470+0000 7fdfc1602640 1 -- 172.21.15.134:0/3798071809 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fe0cc08f8b0 con 0x55cdc96a22c0 2024-04-24T02:12:46.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.470+0000 7fe0d7b05640 1 --2- 172.21.15.134:0/3798071809 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdfb0036950 0x7fdfb0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.470+0000 7fe0d9805800 1 Processor -- start 2024-04-24T02:12:46.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.470+0000 7fe0d9805800 1 -- start start 2024-04-24T02:12:46.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.470+0000 7fe0d7b05640 1 --2- 172.21.15.134:0/3798071809 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdfb0036950 0x7fdfb0038e10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x55cdc9692b10 tx=0x7fe0d0000f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.470+0000 7fe0d9805800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdc96af520 0x55cdc96af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.470+0000 7fe0d9805800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55cdc958e3e0 con 0x55cdc96af520 2024-04-24T02:12:46.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.471+0000 7fe0d6b03640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdc96af520 0x55cdc96af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.471+0000 7fe0d6b03640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdc96af520 0x55cdc96af940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:35836/0 (socket says 172.21.15.134:35836) 2024-04-24T02:12:46.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.471+0000 7fe0d6b03640 1 -- 172.21.15.134:0/2539316678 learned_addr learned my addr 172.21.15.134:0/2539316678 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:46.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.471+0000 7fe0d6b03640 1 -- 172.21.15.134:0/2539316678 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdc96aff10 con 0x55cdc96af520 2024-04-24T02:12:46.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.471+0000 7fe0d6b03640 1 --2- 172.21.15.134:0/2539316678 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdc96af520 0x55cdc96af940 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc05f4a0 tx=0x7fe0cc069960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dac0a4444fc1fa2d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.471+0000 7fdfbaffd640 1 -- 172.21.15.134:0/2539316678 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0cc05e480 con 0x55cdc96af520 2024-04-24T02:12:46.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.471+0000 7fdfbaffd640 1 -- 172.21.15.134:0/2539316678 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0cc072360 con 0x55cdc96af520 2024-04-24T02:12:46.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.471+0000 7fdfbaffd640 1 -- 172.21.15.134:0/2539316678 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0cc05e620 con 0x55cdc96af520 2024-04-24T02:12:46.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.471+0000 7fe0d9805800 1 -- 172.21.15.134:0/2539316678 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdc96af520 msgr2=0x55cdc96af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.471+0000 7fe0d9805800 1 --2- 172.21.15.134:0/2539316678 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdc96af520 0x55cdc96af940 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc05f4a0 tx=0x7fe0cc069960 comp rx=0 tx=0).stop 2024-04-24T02:12:46.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.471+0000 7fe0d9805800 1 -- 172.21.15.134:0/2539316678 shutdown_connections 2024-04-24T02:12:46.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.471+0000 7fe0d9805800 1 --2- 172.21.15.134:0/2539316678 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdc96af520 0x55cdc96af940 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.471+0000 7fe0d9805800 1 -- 172.21.15.134:0/2539316678 >> 172.21.15.134:0/2539316678 conn(0x55cdc96ab880 msgr2=0x55cdc96a98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:46.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.471+0000 7fe0d9805800 1 -- 172.21.15.134:0/2539316678 shutdown_connections 2024-04-24T02:12:46.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.472+0000 7fe0d9805800 1 -- 172.21.15.134:0/2539316678 wait complete. 2024-04-24T02:12:46.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.472+0000 7fe0d9805800 1 Processor -- start 2024-04-24T02:12:46.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.472+0000 7fe0d9805800 1 -- start start 2024-04-24T02:12:46.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.472+0000 7fe0d9805800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdc96af520 0x55cdc96b6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.472+0000 7fe0d9805800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55cdc96b0680 con 0x55cdc96af520 2024-04-24T02:12:46.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.472+0000 7fe0d6b03640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdc96af520 0x55cdc96b6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.472+0000 7fe0d6b03640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdc96af520 0x55cdc96b6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:35838/0 (socket says 172.21.15.134:35838) 2024-04-24T02:12:46.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.472+0000 7fe0d6b03640 1 -- 172.21.15.134:0/170420487 learned_addr learned my addr 172.21.15.134:0/170420487 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:46.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.472+0000 7fe0d6b03640 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdc96b7090 con 0x55cdc96af520 2024-04-24T02:12:46.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.473+0000 7fe0d6b03640 1 --2- 172.21.15.134:0/170420487 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdc96af520 0x55cdc96b6b50 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc072f90 tx=0x7fe0cc08dce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.473+0000 7fdfb97fa640 1 -- 172.21.15.134:0/170420487 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0cc093070 con 0x55cdc96af520 2024-04-24T02:12:46.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.473+0000 7fdfb97fa640 1 -- 172.21.15.134:0/170420487 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0cc08fbd0 con 0x55cdc96af520 2024-04-24T02:12:46.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.473+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cdc96b7320 con 0x55cdc96af520 2024-04-24T02:12:46.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.473+0000 7fdfb97fa640 1 -- 172.21.15.134:0/170420487 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0cc05fb40 con 0x55cdc96af520 2024-04-24T02:12:46.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.473+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cdc96b9fd0 con 0x55cdc96af520 2024-04-24T02:12:46.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.473+0000 7fdfb97fa640 1 -- 172.21.15.134:0/170420487 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe0cc096070 con 0x55cdc96af520 2024-04-24T02:12:46.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.474+0000 7fdfb97fa640 1 --2- 172.21.15.134:0/170420487 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdfa0036900 0x7fdfa0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.474+0000 7fdfb97fa640 1 -- 172.21.15.134:0/170420487 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fe0cc099c00 con 0x55cdc96af520 2024-04-24T02:12:46.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.474+0000 7fe0d7b05640 1 --2- 172.21.15.134:0/170420487 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdfa0036900 0x7fdfa0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.474+0000 7fe0d7b05640 1 --2- 172.21.15.134:0/170420487 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdfa0036900 0x7fdfa0038dc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55cdc9692290 tx=0x7fe0d000c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.474+0000 7fe0d9805800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.474+0000 7fe0d9805800 1 --2- 172.21.15.134:0/170420487 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55cdc96c2670 0x55cdc96c4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.474+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96c5280 con 0x55cdc96c2670 2024-04-24T02:12:46.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.474+0000 7fe0d7304640 1 --2- 172.21.15.134:0/170420487 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55cdc96c2670 0x55cdc96c4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.475+0000 7fe0d7304640 1 --2- 172.21.15.134:0/170420487 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55cdc96c2670 0x55cdc96c4b30 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.475+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x55cdc96c2670 2024-04-24T02:12:46.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.475+0000 7fe0d9805800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:46.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.475+0000 7fe0d9805800 20 realm 2024-04-24T02:12:46.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.475+0000 7fe0d9805800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.475+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96c5690 con 0x55cdc96c2670 2024-04-24T02:12:46.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.475+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x55cdc96c2670 2024-04-24T02:12:46.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.475+0000 7fe0d9805800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:46.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.475+0000 7fe0d9805800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:46.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.475+0000 7fe0d9805800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.475+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96c5f60 con 0x55cdc96c2670 2024-04-24T02:12:46.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.475+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x55cdc96c2670 2024-04-24T02:12:46.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.475+0000 7fe0d9805800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:46.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.475+0000 7fe0d9805800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.475+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96c6300 con 0x55cdc96c2670 2024-04-24T02:12:46.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.475+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe0c8019050 con 0x55cdc96c2670 2024-04-24T02:12:46.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.475+0000 7fe0d9805800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:46.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.475+0000 7fe0d9805800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.475+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96c6b50 con 0x55cdc96c2670 2024-04-24T02:12:46.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.476+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe0c8019050 con 0x55cdc96c2670 2024-04-24T02:12:46.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.476+0000 7fe0d9805800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:46.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.476+0000 7fe0d9805800 20 searching for the correct realm 2024-04-24T02:12:46.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.476+0000 7fe0d9805800 1 --2- 172.21.15.134:0/170420487 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55cdc96c88c0 0x55cdc96cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.476+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96cb270 con 0x55cdc96c88c0 2024-04-24T02:12:46.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.476+0000 7fe0d6b03640 1 --2- 172.21.15.134:0/170420487 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55cdc96c88c0 0x55cdc96cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.476+0000 7fe0d6b03640 1 --2- 172.21.15.134:0/170420487 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55cdc96c88c0 0x55cdc96cacb0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.476+0000 7fe0d6b03640 1 -- 172.21.15.134:0/170420487 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0cc09f070 con 0x55cdc96c88c0 2024-04-24T02:12:46.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.476+0000 7fe0d6b03640 1 --2- 172.21.15.134:0/170420487 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fe0cc098070 0x7fe0cc05c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.476+0000 7fe0d6b03640 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96cb270 con 0x7fe0cc098070 2024-04-24T02:12:46.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.477+0000 7fe0d7b05640 1 --2- 172.21.15.134:0/170420487 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fe0cc098070 0x7fe0cc05c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.477+0000 7fe0d7b05640 1 --2- 172.21.15.134:0/170420487 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fe0cc098070 0x7fe0cc05c790 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.477+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0d002f040 con 0x7fe0cc098070 2024-04-24T02:12:46.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.477+0000 7fe0d7b05640 1 --2- 172.21.15.134:0/170420487 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fe0d0019040 0x7fe0d0019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.477+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96cb270 con 0x7fe0d0019040 2024-04-24T02:12:46.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.477+0000 7fe0d7304640 1 --2- 172.21.15.134:0/170420487 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fe0d0019040 0x7fe0d0019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.478+0000 7fe0d7304640 1 --2- 172.21.15.134:0/170420487 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fe0d0019040 0x7fe0d0019930 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.478+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.478+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96cb270 con 0x55cdc96c2670 2024-04-24T02:12:46.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.478+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0c8019050 con 0x55cdc96c2670 2024-04-24T02:12:46.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.478+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96cb270 con 0x55cdc96c2670 2024-04-24T02:12:46.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.478+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe0c8019050 con 0x55cdc96c2670 2024-04-24T02:12:46.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.478+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96cb270 con 0x7fe0d0019040 2024-04-24T02:12:46.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.479+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.479+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96cb270 con 0x7fe0cc098070 2024-04-24T02:12:46.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.479+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0d002f040 con 0x7fe0cc098070 2024-04-24T02:12:46.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.479+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96cb270 con 0x7fe0cc098070 2024-04-24T02:12:46.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.479+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0d002f040 con 0x7fe0cc098070 2024-04-24T02:12:46.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.479+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96cb270 con 0x55cdc96c88c0 2024-04-24T02:12:46.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.479+0000 7fe0d6b03640 1 -- 172.21.15.134:0/170420487 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0cc09f070 con 0x55cdc96c88c0 2024-04-24T02:12:46.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.479+0000 7fe0d6b03640 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96cb270 con 0x55cdc96c2670 2024-04-24T02:12:46.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.479+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0c8019050 con 0x55cdc96c2670 2024-04-24T02:12:46.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.480+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96cb270 con 0x7fe0d0019040 2024-04-24T02:12:46.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.480+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.480+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96cb270 con 0x55cdc96c2670 2024-04-24T02:12:46.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.480+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0c8019050 con 0x55cdc96c2670 2024-04-24T02:12:46.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.480+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96cb270 con 0x7fe0cc098070 2024-04-24T02:12:46.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.480+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe0d002f040 con 0x7fe0cc098070 2024-04-24T02:12:46.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.480+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96cb270 con 0x55cdc96c88c0 2024-04-24T02:12:46.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.481+0000 7fe0d6b03640 1 -- 172.21.15.134:0/170420487 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0cc09f070 con 0x55cdc96c88c0 2024-04-24T02:12:46.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.481+0000 7fe0d6b03640 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96cb270 con 0x55cdc96c88c0 2024-04-24T02:12:46.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.481+0000 7fe0d6b03640 1 -- 172.21.15.134:0/170420487 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0cc09f070 con 0x55cdc96c88c0 2024-04-24T02:12:46.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.481+0000 7fe0d6b03640 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96cb270 con 0x7fe0cc098070 2024-04-24T02:12:46.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.481+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0d002f040 con 0x7fe0cc098070 2024-04-24T02:12:46.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.481+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96cb270 con 0x55cdc96c88c0 2024-04-24T02:12:46.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.481+0000 7fe0d6b03640 1 -- 172.21.15.134:0/170420487 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0cc09f070 con 0x55cdc96c88c0 2024-04-24T02:12:46.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.481+0000 7fe0d6b03640 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96cb270 con 0x55cdc96c88c0 2024-04-24T02:12:46.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.482+0000 7fe0d6b03640 1 -- 172.21.15.134:0/170420487 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0cc09f070 con 0x55cdc96c88c0 2024-04-24T02:12:46.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.482+0000 7fe0d6b03640 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96cb270 con 0x55cdc96c2670 2024-04-24T02:12:46.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.482+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0c8019050 con 0x55cdc96c2670 2024-04-24T02:12:46.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.482+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96cb270 con 0x55cdc96c2670 2024-04-24T02:12:46.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.482+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fe0c8019050 con 0x55cdc96c2670 2024-04-24T02:12:46.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.482+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96cb270 con 0x7fe0d0019040 2024-04-24T02:12:46.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.482+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.482+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96cb270 con 0x55cdc96c88c0 2024-04-24T02:12:46.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.482+0000 7fe0d6b03640 1 -- 172.21.15.134:0/170420487 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0cc09f070 con 0x55cdc96c88c0 2024-04-24T02:12:46.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.482+0000 7fe0d6b03640 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96cb270 con 0x7fe0cc098070 2024-04-24T02:12:46.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.483+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0d002f040 con 0x7fe0cc098070 2024-04-24T02:12:46.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.483+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96cb270 con 0x55cdc96c2670 2024-04-24T02:12:46.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.483+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0c8019050 con 0x55cdc96c2670 2024-04-24T02:12:46.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.483+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96cb270 con 0x7fe0d0019040 2024-04-24T02:12:46.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.483+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.483+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96cb270 con 0x55cdc96c88c0 2024-04-24T02:12:46.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.483+0000 7fe0d6b03640 1 -- 172.21.15.134:0/170420487 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0cc09f070 con 0x55cdc96c88c0 2024-04-24T02:12:46.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.483+0000 7fe0d6b03640 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96cb270 con 0x7fe0d0019040 2024-04-24T02:12:46.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.484+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.484+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96cb270 con 0x7fe0cc098070 2024-04-24T02:12:46.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.484+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0d002f040 con 0x7fe0cc098070 2024-04-24T02:12:46.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.484+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96cb270 con 0x55cdc96c88c0 2024-04-24T02:12:46.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.484+0000 7fe0d6b03640 1 -- 172.21.15.134:0/170420487 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0cc09f070 con 0x55cdc96c88c0 2024-04-24T02:12:46.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.484+0000 7fe0d6b03640 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96cb270 con 0x7fe0cc098070 2024-04-24T02:12:46.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.484+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0d002f040 con 0x7fe0cc098070 2024-04-24T02:12:46.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.484+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96cb270 con 0x55cdc96c2670 2024-04-24T02:12:46.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.485+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe0c8019050 con 0x55cdc96c2670 2024-04-24T02:12:46.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.485+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96cb270 con 0x7fe0cc098070 2024-04-24T02:12:46.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.485+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0d002f040 con 0x7fe0cc098070 2024-04-24T02:12:46.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.485+0000 7fe0d9805800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:46.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.485+0000 7fe0d9805800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:46.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.485+0000 7fe0d9805800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:46.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.485+0000 7fe0d9805800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:46.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.485+0000 7fe0d9805800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:46.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.485+0000 7fe0d9805800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:46.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.485+0000 7fe0d9805800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.485+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96c7500 con 0x55cdc96c2670 2024-04-24T02:12:46.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.485+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x55cdc96c2670 2024-04-24T02:12:46.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.485+0000 7fe0d9805800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:46.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.485+0000 7fe0d9805800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.485+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96c7da0 con 0x55cdc96c2670 2024-04-24T02:12:46.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.485+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe0c8019050 con 0x55cdc96c2670 2024-04-24T02:12:46.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.485+0000 7fe0d9805800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:46.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.485+0000 7fe0d9805800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.485+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96cb6f0 con 0x55cdc96c2670 2024-04-24T02:12:46.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.486+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe0c8019050 con 0x55cdc96c2670 2024-04-24T02:12:46.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.486+0000 7fe0d9805800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:46.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.486+0000 7fe0d9805800 20 zone default found 2024-04-24T02:12:46.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.486+0000 7fe0d9805800 4 Realm: () 2024-04-24T02:12:46.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.486+0000 7fe0d9805800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:46.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.486+0000 7fe0d9805800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:46.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.486+0000 7fe0d9805800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:46.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.486+0000 7fe0d9805800 20 zonegroup default 2024-04-24T02:12:46.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.486+0000 7fe0d9805800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.486+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96cbba0 con 0x7fe0d0019040 2024-04-24T02:12:46.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.486+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.486+0000 7fe0d9805800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:46.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.486+0000 7fe0d9805800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.486+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96cd580 con 0x55cdc96c88c0 2024-04-24T02:12:46.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.486+0000 7fe0d6b03640 1 -- 172.21.15.134:0/170420487 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe0cc09f070 con 0x55cdc96c88c0 2024-04-24T02:12:46.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.486+0000 7fe0d9805800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:46.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.486+0000 7fe0d9805800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.486+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96cde40 con 0x55cdc96c88c0 2024-04-24T02:12:46.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.486+0000 7fe0d6b03640 1 -- 172.21.15.134:0/170420487 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe0cc09f070 con 0x55cdc96c88c0 2024-04-24T02:12:46.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.487+0000 7fe0d9805800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:46.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.487+0000 7fe0d9805800 20 started sync module instance, tier type = 2024-04-24T02:12:46.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.487+0000 7fe0d9805800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:46.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.487+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96cc570 con 0x7fe0cc098070 2024-04-24T02:12:46.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.488+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(44 notify.0 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0d002f040 con 0x7fe0cc098070 2024-04-24T02:12:46.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.488+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94342336006496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96cc570 con 0x7fe0cc098070 2024-04-24T02:12:46.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.488+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96ce690 con 0x55cdc96c2670 2024-04-24T02:12:46.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.489+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94342336006496] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0d002f040 con 0x7fe0cc098070 2024-04-24T02:12:46.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.489+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x55cdc96c2670 2024-04-24T02:12:46.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.489+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94342336004560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96ce690 con 0x55cdc96c2670 2024-04-24T02:12:46.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.489+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96cef40 con 0x55cdc96c88c0 2024-04-24T02:12:46.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.490+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94342336004560] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x55cdc96c2670 2024-04-24T02:12:46.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.490+0000 7fe0d6b03640 1 -- 172.21.15.134:0/170420487 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0cc09f070 con 0x55cdc96c88c0 2024-04-24T02:12:46.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.490+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94342336012768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96cf2e0 con 0x55cdc96c88c0 2024-04-24T02:12:46.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.490+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96cfd10 con 0x7fe0cc098070 2024-04-24T02:12:46.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.491+0000 7fe0d6b03640 1 -- 172.21.15.134:0/170420487 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94342336012768] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0cc09f070 con 0x55cdc96c88c0 2024-04-24T02:12:46.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.491+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(50 notify.3 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0d002f040 con 0x7fe0cc098070 2024-04-24T02:12:46.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.491+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94342336014496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96d0130 con 0x7fe0cc098070 2024-04-24T02:12:46.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.491+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96d0b50 con 0x55cdc96c2670 2024-04-24T02:12:46.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.492+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x55cdc96c2670 2024-04-24T02:12:46.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.492+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94342336022080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96d0b10 con 0x55cdc96c2670 2024-04-24T02:12:46.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.492+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96d1b00 con 0x7fe0d0019040 2024-04-24T02:12:46.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.492+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94342336014496] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0d002f040 con 0x7fe0cc098070 2024-04-24T02:12:46.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.493+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94342336022080] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x55cdc96c2670 2024-04-24T02:12:46.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.493+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(54 notify.5 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.493+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94342336026128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96d0cf0 con 0x7fe0d0019040 2024-04-24T02:12:46.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.493+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96d23d0 con 0x7fe0d0019040 2024-04-24T02:12:46.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.494+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94342336026128] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.494+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(56 notify.6 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.494+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94342336018464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96d1fb0 con 0x7fe0d0019040 2024-04-24T02:12:46.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.494+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96d2970 con 0x7fe0d0019040 2024-04-24T02:12:46.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.495+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94342336018464] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.495+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(58 notify.7 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.495+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94342336027664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96d2970 con 0x7fe0d0019040 2024-04-24T02:12:46.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.495+0000 7fe0d9805800 20 add_watcher() i=0 2024-04-24T02:12:46.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.495+0000 7fe0d9805800 20 add_watcher() i=1 2024-04-24T02:12:46.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.495+0000 7fe0d9805800 20 add_watcher() i=2 2024-04-24T02:12:46.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.495+0000 7fe0d9805800 20 add_watcher() i=3 2024-04-24T02:12:46.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.495+0000 7fe0d9805800 20 add_watcher() i=4 2024-04-24T02:12:46.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.495+0000 7fe0d9805800 20 add_watcher() i=5 2024-04-24T02:12:46.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.495+0000 7fe0d9805800 20 add_watcher() i=6 2024-04-24T02:12:46.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.496+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94342336027664] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.496+0000 7fe0d9805800 20 add_watcher() i=7 2024-04-24T02:12:46.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.496+0000 7fe0d9805800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:46.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.496+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96d5ce0 con 0x55cdc96c2670 2024-04-24T02:12:46.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.497+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe0c8019050 con 0x55cdc96c2670 2024-04-24T02:12:46.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.497+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94342336042704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96d2ae0 con 0x55cdc96c2670 2024-04-24T02:12:46.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.498+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94342336042704] v32'189 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x55cdc96c2670 2024-04-24T02:12:46.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.498+0000 7fdf8dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:46.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.498+0000 7fe0d9805800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:46.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.498+0000 7fe0d9805800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:46.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.498+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96d4fd0 con 0x55cdc96c2670 2024-04-24T02:12:46.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.499+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'54 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x55cdc96c2670 2024-04-24T02:12:46.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.499+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96deda0 con 0x7fe0d0019040 2024-04-24T02:12:46.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.500+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'31 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.500+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96deda0 con 0x55cdc96c88c0 2024-04-24T02:12:46.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.501+0000 7fe0d6b03640 1 -- 172.21.15.134:0/170420487 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe0cc09f070 con 0x55cdc96c88c0 2024-04-24T02:12:46.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.501+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96df1d0 con 0x55cdc96c2670 2024-04-24T02:12:46.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.502+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'190 uv169 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x55cdc96c2670 2024-04-24T02:12:46.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.502+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96df260 con 0x7fe0cc098070 2024-04-24T02:12:46.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.503+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'70 uv58 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe0d002f040 con 0x7fe0cc098070 2024-04-24T02:12:46.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.503+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96df810 con 0x55cdc96c88c0 2024-04-24T02:12:46.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.504+0000 7fe0d6b03640 1 -- 172.21.15.134:0/170420487 <== osd.3 v2:172.21.15.134:6801/3585115521 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'55 uv48 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe0cc09f070 con 0x55cdc96c88c0 2024-04-24T02:12:46.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.504+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96dfc40 con 0x55cdc96c2670 2024-04-24T02:12:46.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.506+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x55cdc96c2670 2024-04-24T02:12:46.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.506+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96dfc40 con 0x7fe0d0019040 2024-04-24T02:12:46.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.507+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'48 uv41 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.507+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96dfc40 con 0x7fe0cc098070 2024-04-24T02:12:46.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.508+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe0d002f040 con 0x7fe0cc098070 2024-04-24T02:12:46.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.508+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96e0290 con 0x55cdc96c88c0 2024-04-24T02:12:46.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.510+0000 7fe0d6b03640 1 -- 172.21.15.134:0/170420487 <== osd.3 v2:172.21.15.134:6801/3585115521 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe0cc09f070 con 0x55cdc96c88c0 2024-04-24T02:12:46.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.510+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96e0290 con 0x7fe0cc098070 2024-04-24T02:12:46.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.511+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 <== osd.2 v2:172.21.15.134:6800/214480313 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'71 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe0d002f040 con 0x7fe0cc098070 2024-04-24T02:12:46.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.511+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96e0800 con 0x7fe0d0019040 2024-04-24T02:12:46.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.512+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'27 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.512+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96e0800 con 0x7fe0cc098070 2024-04-24T02:12:46.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.513+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 <== osd.2 v2:172.21.15.134:6800/214480313 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe0d002f040 con 0x7fe0cc098070 2024-04-24T02:12:46.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.513+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96e0a80 con 0x7fe0d0019040 2024-04-24T02:12:46.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.514+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'59 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.514+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96e0a80 con 0x55cdc96c2670 2024-04-24T02:12:46.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.515+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'191 uv171 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x55cdc96c2670 2024-04-24T02:12:46.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.515+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96e0a80 con 0x55cdc96c88c0 2024-04-24T02:12:46.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.516+0000 7fe0d6b03640 1 -- 172.21.15.134:0/170420487 <== osd.3 v2:172.21.15.134:6801/3585115521 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'62 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe0cc09f070 con 0x55cdc96c88c0 2024-04-24T02:12:46.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.516+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96e0a80 con 0x7fe0cc098070 2024-04-24T02:12:46.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.517+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 <== osd.2 v2:172.21.15.134:6800/214480313 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'72 uv63 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe0d002f040 con 0x7fe0cc098070 2024-04-24T02:12:46.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.517+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96e0a80 con 0x55cdc96c88c0 2024-04-24T02:12:46.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.518+0000 7fe0d6b03640 1 -- 172.21.15.134:0/170420487 <== osd.3 v2:172.21.15.134:6801/3585115521 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'37 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe0cc09f070 con 0x55cdc96c88c0 2024-04-24T02:12:46.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.518+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96e0a80 con 0x55cdc96c2670 2024-04-24T02:12:46.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.519+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x55cdc96c2670 2024-04-24T02:12:46.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.519+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96e0a80 con 0x55cdc96c2670 2024-04-24T02:12:46.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.520+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'192 uv173 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x55cdc96c2670 2024-04-24T02:12:46.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.520+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96e0a80 con 0x55cdc96c88c0 2024-04-24T02:12:46.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.521+0000 7fe0d6b03640 1 -- 172.21.15.134:0/170420487 <== osd.3 v2:172.21.15.134:6801/3585115521 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'63 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe0cc09f070 con 0x55cdc96c88c0 2024-04-24T02:12:46.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.522+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96e0a80 con 0x7fe0cc098070 2024-04-24T02:12:46.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.522+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 <== osd.2 v2:172.21.15.134:6800/214480313 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'40 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe0d002f040 con 0x7fe0cc098070 2024-04-24T02:12:46.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.522+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96e0a80 con 0x55cdc96c88c0 2024-04-24T02:12:46.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.523+0000 7fe0d6b03640 1 -- 172.21.15.134:0/170420487 <== osd.3 v2:172.21.15.134:6801/3585115521 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe0cc09f070 con 0x55cdc96c88c0 2024-04-24T02:12:46.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.523+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96e0a80 con 0x55cdc96c88c0 2024-04-24T02:12:46.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.524+0000 7fe0d6b03640 1 -- 172.21.15.134:0/170420487 <== osd.3 v2:172.21.15.134:6801/3585115521 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'42 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe0cc09f070 con 0x55cdc96c88c0 2024-04-24T02:12:46.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.524+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96e0a80 con 0x55cdc96c88c0 2024-04-24T02:12:46.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.525+0000 7fe0d6b03640 1 -- 172.21.15.134:0/170420487 <== osd.3 v2:172.21.15.134:6801/3585115521 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe0cc09f070 con 0x55cdc96c88c0 2024-04-24T02:12:46.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.525+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96e0a80 con 0x55cdc96c88c0 2024-04-24T02:12:46.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.526+0000 7fe0d6b03640 1 -- 172.21.15.134:0/170420487 <== osd.3 v2:172.21.15.134:6801/3585115521 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'56 uv50 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe0cc09f070 con 0x55cdc96c88c0 2024-04-24T02:12:46.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.526+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96e0a80 con 0x7fe0d0019040 2024-04-24T02:12:46.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.528+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.528+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96e0a80 con 0x55cdc96c88c0 2024-04-24T02:12:46.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.529+0000 7fe0d6b03640 1 -- 172.21.15.134:0/170420487 <== osd.3 v2:172.21.15.134:6801/3585115521 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'36 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe0cc09f070 con 0x55cdc96c88c0 2024-04-24T02:12:46.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.529+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96e0a80 con 0x7fe0d0019040 2024-04-24T02:12:46.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.530+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'49 uv43 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.530+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96e0a80 con 0x55cdc96c88c0 2024-04-24T02:12:46.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.531+0000 7fe0d6b03640 1 -- 172.21.15.134:0/170420487 <== osd.3 v2:172.21.15.134:6801/3585115521 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'64 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe0cc09f070 con 0x55cdc96c88c0 2024-04-24T02:12:46.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.531+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96e0a80 con 0x7fe0d0019040 2024-04-24T02:12:46.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.532+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 20 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'60 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.532+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96e0a80 con 0x7fe0cc098070 2024-04-24T02:12:46.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.533+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 <== osd.2 v2:172.21.15.134:6800/214480313 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe0d002f040 con 0x7fe0cc098070 2024-04-24T02:12:46.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.533+0000 7fdf8cfe1640 20 reqs_thread_entry: start 2024-04-24T02:12:46.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.534+0000 7fe0d9805800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:46.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.534+0000 7fe0d9805800 20 Filter name: none 2024-04-24T02:12:46.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.534+0000 7fdf067fc640 20 reqs_thread_entry: start 2024-04-24T02:12:46.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.534+0000 7fe0d9805800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-24T02:12:46.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.534+0000 7fe0d9805800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.534+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc970ba70 con 0x7fe0cc098070 2024-04-24T02:12:46.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.534+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 <== osd.2 v2:172.21.15.134:6800/214480313 21 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fe0d002f040 con 0x7fe0cc098070 2024-04-24T02:12:46.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.534+0000 7fe0d9805800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T02:12:46.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.534+0000 7fe0d9805800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-24T02:12:46.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.534+0000 7fe0d9805800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T02:12:46.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.534+0000 7fe0d9805800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5 : miss 2024-04-24T02:12:46.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.534+0000 7fe0d9805800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.534+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:95 8.f 8:f20f32b0:root::.bucket.meta.myfoo%3a582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc970d4b0 con 0x55cdc96c88c0 2024-04-24T02:12:46.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.534+0000 7fe0d6b03640 1 -- 172.21.15.134:0/170420487 <== osd.3 v2:172.21.15.134:6801/3585115521 26 ==== osd_op_reply(95 .bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fe0cc09f070 con 0x55cdc96c88c0 2024-04-24T02:12:46.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.534+0000 7fe0d9805800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T02:12:46.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.534+0000 7fe0d9805800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5 info.flags=0x17 2024-04-24T02:12:46.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.534+0000 7fe0d9805800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5 to cache LRU end 2024-04-24T02:12:46.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.534+0000 7fe0d9805800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:12:46.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.534+0000 7fe0d9805800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T02:12:46.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.534+0000 7fe0d9805800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5 2024-04-24T02:12:46.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.535+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:96 4.1e 4:790c4b38:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc978acc0 con 0x7fe0d0019040 2024-04-24T02:12:46.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.535+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 21 ==== osd_op_reply(96 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.0 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.535+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:97 4.2c 4:34263e12:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc978acc0 con 0x55cdc96c2670 2024-04-24T02:12:46.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.535+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(97 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe0c8019050 con 0x55cdc96c2670 2024-04-24T02:12:46.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.535+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:98 4.7 4:e0e12daf:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc978acc0 con 0x7fe0d0019040 2024-04-24T02:12:46.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.536+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 22 ==== osd_op_reply(98 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.2 [call out=425b] v0'0 uv3 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.536+0000 7fe0d9805800 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-04-24T02:12:46.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.536+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:99 4.11 4:8ba1579a:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc978b0b0 con 0x7fe0d0019040 2024-04-24T02:12:46.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.536+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 23 ==== osd_op_reply(99 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.536+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:100 4.2d 4:b708063a:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc978b0b0 con 0x7fe0d0019040 2024-04-24T02:12:46.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.537+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 24 ==== osd_op_reply(100 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.537+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:101 4.18 4:198a8284:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc978b0b0 con 0x7fe0cc098070 2024-04-24T02:12:46.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.537+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 <== osd.2 v2:172.21.15.134:6800/214480313 22 ==== osd_op_reply(101 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe0d002f040 con 0x7fe0cc098070 2024-04-24T02:12:46.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.537+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:102 4.b 4:d0065d8e:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc978b0b0 con 0x7fe0cc098070 2024-04-24T02:12:46.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.537+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 <== osd.2 v2:172.21.15.134:6800/214480313 23 ==== osd_op_reply(102 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.6 [call out=425b] v0'0 uv9 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7fe0d002f040 con 0x7fe0cc098070 2024-04-24T02:12:46.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.537+0000 7fe0d9805800 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-04-24T02:12:46.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.537+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:103 4.18 4:1a164e0b:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc978b0b0 con 0x7fe0cc098070 2024-04-24T02:12:46.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.538+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 <== osd.2 v2:172.21.15.134:6800/214480313 24 ==== osd_op_reply(103 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.7 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe0d002f040 con 0x7fe0cc098070 2024-04-24T02:12:46.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.538+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:104 4.17 4:e81b6358:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc978b0b0 con 0x7fe0d0019040 2024-04-24T02:12:46.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.538+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 25 ==== osd_op_reply(104 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.8 [call out=425b] v0'0 uv3 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.538+0000 7fe0d9805800 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-04-24T02:12:46.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.538+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:105 4.21 4:87793242:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc978b0b0 con 0x7fe0d0019040 2024-04-24T02:12:46.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.538+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 26 ==== osd_op_reply(105 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.539+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:106 4.3f 4:feba10bb:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc978b0b0 con 0x7fe0cc098070 2024-04-24T02:12:46.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.539+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 <== osd.2 v2:172.21.15.134:6800/214480313 25 ==== osd_op_reply(106 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.10 [call out=697b] v0'0 uv9 ondisk = 0) ==== 195+0+697 (crc 0 0 0) 0x7fe0d002f040 con 0x7fe0cc098070 2024-04-24T02:12:46.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.539+0000 7fe0d9805800 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-04-24T02:12:46.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.539+0000 7fe0d9805800 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-04-24T02:12:46.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.539+0000 7fe0d9805800 20 get_obj_state: octx=0x7fe0c803a050 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x55cdc978a328 s->prefetch_data=0 2024-04-24T02:12:46.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.539+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:107 3.3a 3:5c762104:::582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5_9c8454ddf7aa50116496bac348d7550d:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc9788820 con 0x7fe0cc098070 2024-04-24T02:12:46.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.539+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 <== osd.2 v2:172.21.15.134:6800/214480313 26 ==== osd_op_reply(107 582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5_9c8454ddf7aa50116496bac348d7550d [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7fe0d002f040 con 0x7fe0cc098070 2024-04-24T02:12:46.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.539+0000 7fe0d9805800 10 manifest: total_size = 6 2024-04-24T02:12:46.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.539+0000 7fe0d9805800 20 get_obj_state: setting s->obj_tag to 582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.8247286158021716457 2024-04-24T02:12:46.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.539+0000 7fe0d9805800 20 get_obj_state: octx=0x7fe0c803a050 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x55cdc978a328 s->prefetch_data=0 2024-04-24T02:12:46.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.539+0000 7fe0d9805800 20 prepare_atomic_modification: state is not atomic. state=0x55cdc978a328 2024-04-24T02:12:46.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.539+0000 7fe0d9805800 20 bucket index object: :.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.2 2024-04-24T02:12:46.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.539+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:108 4.7 4:e0e12daf:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc9712a80 con 0x7fe0d0019040 2024-04-24T02:12:46.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.540+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 27 ==== osd_op_reply(108 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.2 [stat,call,call] v32'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.540+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:109 3.3a 3:5c762104:::582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc9712a80 con 0x7fe0cc098070 2024-04-24T02:12:46.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.541+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 <== osd.2 v2:172.21.15.134:6800/214480313 27 ==== osd_op_reply(109 582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5_9c8454ddf7aa50116496bac348d7550d [call] v32'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fe0d002f040 con 0x7fe0cc098070 2024-04-24T02:12:46.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.541+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:110 4.7 4:e0e12daf:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc9713510 con 0x7fe0d0019040 2024-04-24T02:12:46.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.542+0000 7fe0d9805800 20 get_obj_state: octx=0x7fe0c803a050 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x55cdc978a328 s->prefetch_data=0 2024-04-24T02:12:46.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.542+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:111 3.2a 3:560a5e7d:::582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5_b1b9a972ccd8c962a473909b97007eb4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc9713510 con 0x55cdc96c2670 2024-04-24T02:12:46.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.542+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.1 v2:172.21.15.134:6804/1487076214 30 ==== osd_op_reply(111 582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5_b1b9a972ccd8c962a473909b97007eb4 [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7fe0c8019050 con 0x55cdc96c2670 2024-04-24T02:12:46.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.542+0000 7fe0d9805800 10 manifest: total_size = 3 2024-04-24T02:12:46.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.542+0000 7fe0d9805800 20 get_obj_state: setting s->obj_tag to 582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.2316369819136172135 2024-04-24T02:12:46.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.542+0000 7fe0d9805800 20 get_obj_state: octx=0x7fe0c803a050 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x55cdc978a328 s->prefetch_data=0 2024-04-24T02:12:46.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.542+0000 7fe0d9805800 20 prepare_atomic_modification: state is not atomic. state=0x55cdc978a328 2024-04-24T02:12:46.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.542+0000 7fe0d9805800 20 bucket index object: :.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.6 2024-04-24T02:12:46.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.542+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:112 4.b 4:d0065d8e:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc97181b0 con 0x7fe0cc098070 2024-04-24T02:12:46.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.543+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 28 ==== osd_op_reply(110 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.2 [stat,call,call] v32'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.543+0000 7fdfbaffd640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-04-24T02:12:46.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.543+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 <== osd.2 v2:172.21.15.134:6800/214480313 28 ==== osd_op_reply(112 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.6 [stat,call,call] v32'10 uv10 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fe0d002f040 con 0x7fe0cc098070 2024-04-24T02:12:46.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.543+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:113 3.2a 3:560a5e7d:::582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc970e370 con 0x55cdc96c2670 2024-04-24T02:12:46.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.544+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.1 v2:172.21.15.134:6804/1487076214 31 ==== osd_op_reply(113 582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5_b1b9a972ccd8c962a473909b97007eb4 [call] v32'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x55cdc96c2670 2024-04-24T02:12:46.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.544+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:114 4.b 4:d0065d8e:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc9714170 con 0x7fe0cc098070 2024-04-24T02:12:46.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.544+0000 7fe0d9805800 20 get_obj_state: octx=0x7fe0c803a050 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x55cdc978a328 s->prefetch_data=0 2024-04-24T02:12:46.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.544+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:115 3.1e 3:782860d9:::582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5_c785e1ed2950e3e36b1e2ca01f299a54:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc9714ca0 con 0x7fe0d0019040 2024-04-24T02:12:46.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.544+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 29 ==== osd_op_reply(115 582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5_c785e1ed2950e3e36b1e2ca01f299a54 [getxattrs out=877b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.544+0000 7fe0d9805800 10 manifest: total_size = 4 2024-04-24T02:12:46.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.544+0000 7fe0d9805800 20 get_obj_state: setting s->obj_tag to 582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.4250753491244179961 2024-04-24T02:12:46.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.544+0000 7fe0d9805800 20 get_obj_state: octx=0x7fe0c803a050 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x55cdc978a328 s->prefetch_data=0 2024-04-24T02:12:46.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.544+0000 7fe0d9805800 20 prepare_atomic_modification: state is not atomic. state=0x55cdc978a328 2024-04-24T02:12:46.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.544+0000 7fe0d9805800 20 bucket index object: :.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.8 2024-04-24T02:12:46.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.544+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:116 4.17 4:e81b6358:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc9714170 con 0x7fe0d0019040 2024-04-24T02:12:46.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.545+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 <== osd.2 v2:172.21.15.134:6800/214480313 29 ==== osd_op_reply(114 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.6 [stat,call,call] v32'11 uv11 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fe0d002f040 con 0x7fe0cc098070 2024-04-24T02:12:46.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.545+0000 7fdfba7fc640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-04-24T02:12:46.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.546+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 30 ==== osd_op_reply(116 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.8 [stat,call,call] v32'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.546+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:117 3.1e 3:782860d9:::582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc97138d0 con 0x7fe0d0019040 2024-04-24T02:12:46.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.548+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 31 ==== osd_op_reply(117 582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v32'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.549+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:118 4.17 4:e81b6358:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc97140f0 con 0x7fe0d0019040 2024-04-24T02:12:46.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.549+0000 7fe0d9805800 20 get_obj_state: octx=0x7fe0c803a050 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x55cdc978a328 s->prefetch_data=0 2024-04-24T02:12:46.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.549+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:119 3.13 3:cbe96d1e:::582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5_24d27c169c2c881eb09a065116f2aa5c:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc97140f0 con 0x55cdc96c88c0 2024-04-24T02:12:46.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.549+0000 7fe0d6b03640 1 -- 172.21.15.134:0/170420487 <== osd.3 v2:172.21.15.134:6801/3585115521 27 ==== osd_op_reply(119 582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5_24d27c169c2c881eb09a065116f2aa5c [getxattrs out=877b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7fe0cc09f070 con 0x55cdc96c88c0 2024-04-24T02:12:46.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.549+0000 7fe0d9805800 10 manifest: total_size = 5 2024-04-24T02:12:46.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.549+0000 7fe0d9805800 20 get_obj_state: setting s->obj_tag to 582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.6059185920323468613 2024-04-24T02:12:46.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.549+0000 7fe0d9805800 20 get_obj_state: octx=0x7fe0c803a050 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x55cdc978a328 s->prefetch_data=0 2024-04-24T02:12:46.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.549+0000 7fe0d9805800 20 prepare_atomic_modification: state is not atomic. state=0x55cdc978a328 2024-04-24T02:12:46.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.549+0000 7fe0d9805800 20 bucket index object: :.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.10 2024-04-24T02:12:46.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.549+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:120 4.3f 4:feba10bb:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc97181c0 con 0x7fe0cc098070 2024-04-24T02:12:46.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.550+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 32 ==== osd_op_reply(118 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.8 [stat,call,call] v32'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.550+0000 7fdfbaffd640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-04-24T02:12:46.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.550+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 <== osd.2 v2:172.21.15.134:6800/214480313 30 ==== osd_op_reply(120 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.10 [stat,call,call] v32'10 uv10 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fe0d002f040 con 0x7fe0cc098070 2024-04-24T02:12:46.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.550+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:121 3.13 3:cbe96d1e:::582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc97181c0 con 0x55cdc96c88c0 2024-04-24T02:12:46.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.553+0000 7fe0d6b03640 1 -- 172.21.15.134:0/170420487 <== osd.3 v2:172.21.15.134:6801/3585115521 28 ==== osd_op_reply(121 582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5_24d27c169c2c881eb09a065116f2aa5c [call] v32'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fe0cc09f070 con 0x55cdc96c88c0 2024-04-24T02:12:46.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.553+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:122 4.3f 4:feba10bb:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc970f830 con 0x7fe0cc098070 2024-04-24T02:12:46.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.553+0000 7fe0d9805800 20 get_obj_state: octx=0x7fe0c803a050 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55cdc978a328 s->prefetch_data=0 2024-04-24T02:12:46.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.553+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:123 3.8 3:136c56d8:::582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc97147f0 con 0x55cdc96c88c0 2024-04-24T02:12:46.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.553+0000 7fe0d6b03640 1 -- 172.21.15.134:0/170420487 <== osd.3 v2:172.21.15.134:6801/3585115521 29 ==== osd_op_reply(123 582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=911b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+927 (crc 0 0 0) 0x7fe0cc09f070 con 0x55cdc96c88c0 2024-04-24T02:12:46.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.553+0000 7fe0d9805800 10 manifest: total_size = 5 2024-04-24T02:12:46.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.553+0000 7fe0d9805800 20 get_obj_state: setting s->obj_tag to _DzHSO98t-UgXgD-85J7T1a7ocwvEgd9 2024-04-24T02:12:46.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.553+0000 7fe0d9805800 20 get_obj_state: octx=0x7fe0c803a050 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55cdc978a328 s->prefetch_data=0 2024-04-24T02:12:46.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.553+0000 7fe0d9805800 20 prepare_atomic_modification: state is not atomic. state=0x55cdc978a328 2024-04-24T02:12:46.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.553+0000 7fe0d9805800 20 bucket index object: :.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.10 2024-04-24T02:12:46.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.553+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:124 4.3f 4:feba10bb:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc9717820 con 0x7fe0cc098070 2024-04-24T02:12:46.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.554+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 <== osd.2 v2:172.21.15.134:6800/214480313 31 ==== osd_op_reply(122 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.10 [stat,call,call] v32'11 uv11 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fe0d002f040 con 0x7fe0cc098070 2024-04-24T02:12:46.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.554+0000 7fdfba7fc640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-04-24T02:12:46.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.554+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 <== osd.2 v2:172.21.15.134:6800/214480313 32 ==== osd_op_reply(124 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.10 [stat,call,call] v32'12 uv12 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fe0d002f040 con 0x7fe0cc098070 2024-04-24T02:12:46.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.554+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:125 3.8 3:136c56d8:::582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc9718c20 con 0x55cdc96c88c0 2024-04-24T02:12:46.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.555+0000 7fe0d6b03640 1 -- 172.21.15.134:0/170420487 <== osd.3 v2:172.21.15.134:6801/3585115521 30 ==== osd_op_reply(125 582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5_bb3aec0fdcdbc2974890f805c585d432 [call] v32'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fe0cc09f070 con 0x55cdc96c88c0 2024-04-24T02:12:46.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.555+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:126 4.3f 4:feba10bb:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc97147f0 con 0x7fe0cc098070 2024-04-24T02:12:46.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.555+0000 7fe0d9805800 20 list_objects_ordered: starting attempt 1 2024-04-24T02:12:46.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.555+0000 7fe0d9805800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-04-24T02:12:46.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.555+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:127 4.1e 4:790c4b38:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc9717e00 con 0x7fe0d0019040 2024-04-24T02:12:46.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.555+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:128 4.2c 4:34263e12:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc978a140 con 0x55cdc96c2670 2024-04-24T02:12:46.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.555+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:129 4.7 4:e0e12daf:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc9717e00 con 0x7fe0d0019040 2024-04-24T02:12:46.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.555+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:130 4.11 4:8ba1579a:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc978a140 con 0x7fe0d0019040 2024-04-24T02:12:46.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.555+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:131 4.2d 4:b708063a:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc9717880 con 0x7fe0d0019040 2024-04-24T02:12:46.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.555+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:132 4.18 4:198a8284:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc9724200 con 0x7fe0cc098070 2024-04-24T02:12:46.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.555+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:133 4.b 4:d0065d8e:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc9726fd0 con 0x7fe0cc098070 2024-04-24T02:12:46.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.555+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:134 4.18 4:1a164e0b:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc9729e30 con 0x7fe0cc098070 2024-04-24T02:12:46.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.555+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:135 4.17 4:e81b6358:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc9726fd0 con 0x7fe0d0019040 2024-04-24T02:12:46.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.555+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:136 4.21 4:87793242:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc972eea0 con 0x7fe0d0019040 2024-04-24T02:12:46.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.555+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:137 4.3f 4:feba10bb:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc9731bc0 con 0x7fe0cc098070 2024-04-24T02:12:46.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.556+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.1 v2:172.21.15.134:6804/1487076214 32 ==== osd_op_reply(128 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe0c8019050 con 0x55cdc96c2670 2024-04-24T02:12:46.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.556+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 33 ==== osd_op_reply(129 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.2 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.556+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 <== osd.2 v2:172.21.15.134:6800/214480313 33 ==== osd_op_reply(132 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe0d002f040 con 0x7fe0cc098070 2024-04-24T02:12:46.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.556+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 34 ==== osd_op_reply(127 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.0 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.556+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 <== osd.2 v2:172.21.15.134:6800/214480313 34 ==== osd_op_reply(133 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.6 [call out=124b] v0'0 uv11 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fe0d002f040 con 0x7fe0cc098070 2024-04-24T02:12:46.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.556+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 35 ==== osd_op_reply(130 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.556+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 36 ==== osd_op_reply(131 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.556+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 37 ==== osd_op_reply(135 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.8 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.556+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 38 ==== osd_op_reply(136 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.556+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 <== osd.2 v2:172.21.15.134:6800/214480313 35 ==== osd_op_reply(134 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.7 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe0d002f040 con 0x7fe0cc098070 2024-04-24T02:12:46.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.556+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 <== osd.2 v2:172.21.15.134:6800/214480313 36 ==== osd_op_reply(126 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.10 [stat,call,call] v32'13 uv13 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fe0d002f040 con 0x7fe0cc098070 2024-04-24T02:12:46.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.556+0000 7fdfba7fc640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-04-24T02:12:46.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.556+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 <== osd.2 v2:172.21.15.134:6800/214480313 37 ==== osd_op_reply(137 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.10 [call out=124b] v0'0 uv13 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7fe0d002f040 con 0x7fe0cc098070 2024-04-24T02:12:46.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.556+0000 7fe0d9805800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-04-24T02:12:46.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.556+0000 7fe0d9805800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-04-24T02:12:46.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.557+0000 7fe0d9805800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-04-24T02:12:46.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.557+0000 7fe0d9805800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-04-24T02:12:46.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.557+0000 7fe0d9805800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5])"; uploads.size()=0; is_truncated=0 2024-04-24T02:12:46.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.557+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:138 4.1e 4:790c4b38:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc9724260 con 0x7fe0d0019040 2024-04-24T02:12:46.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.557+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:139 4.2c 4:34263e12:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc978a140 con 0x55cdc96c2670 2024-04-24T02:12:46.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.557+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:140 4.7 4:e0e12daf:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc9731bc0 con 0x7fe0d0019040 2024-04-24T02:12:46.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.557+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:141 4.11 4:8ba1579a:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc9726980 con 0x7fe0d0019040 2024-04-24T02:12:46.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.557+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:142 4.2d 4:b708063a:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc9724260 con 0x7fe0d0019040 2024-04-24T02:12:46.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.557+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:143 4.18 4:198a8284:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc970f750 con 0x7fe0cc098070 2024-04-24T02:12:46.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.557+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:144 4.b 4:d0065d8e:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc9726980 con 0x7fe0cc098070 2024-04-24T02:12:46.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.557+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:145 4.18 4:1a164e0b:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc9724260 con 0x7fe0cc098070 2024-04-24T02:12:46.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.557+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:146 4.17 4:e81b6358:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc970fb30 con 0x7fe0d0019040 2024-04-24T02:12:46.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.557+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:147 4.21 4:87793242:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc9726980 con 0x7fe0d0019040 2024-04-24T02:12:46.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.557+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:148 4.3f 4:feba10bb:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc970fb30 con 0x7fe0cc098070 2024-04-24T02:12:46.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.557+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 39 ==== osd_op_reply(138 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.0 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.557+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 <== osd.2 v2:172.21.15.134:6800/214480313 38 ==== osd_op_reply(143 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe0d002f040 con 0x7fe0cc098070 2024-04-24T02:12:46.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.557+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 40 ==== osd_op_reply(140 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.2 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.557+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 41 ==== osd_op_reply(141 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.557+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 <== osd.2 v2:172.21.15.134:6800/214480313 39 ==== osd_op_reply(148 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.10 [call out=124b] v0'0 uv13 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7fe0d002f040 con 0x7fe0cc098070 2024-04-24T02:12:46.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.557+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 42 ==== osd_op_reply(146 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.8 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.557+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 43 ==== osd_op_reply(147 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.557+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 <== osd.2 v2:172.21.15.134:6800/214480313 40 ==== osd_op_reply(144 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.6 [call out=124b] v0'0 uv11 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fe0d002f040 con 0x7fe0cc098070 2024-04-24T02:12:46.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.557+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 44 ==== osd_op_reply(142 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.557+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 <== osd.2 v2:172.21.15.134:6800/214480313 41 ==== osd_op_reply(145 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.7 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe0d002f040 con 0x7fe0cc098070 2024-04-24T02:12:46.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.557+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.1 v2:172.21.15.134:6804/1487076214 33 ==== osd_op_reply(139 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe0c8019050 con 0x55cdc96c2670 2024-04-24T02:12:46.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.557+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc9724260 con 0x7fe0cc098070 2024-04-24T02:12:46.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.558+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 <== osd.2 v2:172.21.15.134:6800/214480313 42 ==== osd_op_reply(149 foo.buckets [call] v32'37 uv37 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fe0d002f040 con 0x7fe0cc098070 2024-04-24T02:12:46.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.558+0000 7fe0d9805800 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2024-04-24T02:12:46.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.558+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:150 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc9724260 con 0x7fe0cc098070 2024-04-24T02:12:46.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.559+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 <== osd.2 v2:172.21.15.134:6800/214480313 43 ==== osd_op_reply(150 myfoo [call,call,delete] v32'38 uv38 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7fe0d002f040 con 0x7fe0cc098070 2024-04-24T02:12:46.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.559+0000 7fe0d9805800 10 removing default.rgw.meta+root+myfoo from cache 2024-04-24T02:12:46.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.559+0000 7fe0d9805800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-24T02:12:46.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.559+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94342336281200 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc9724260 con 0x7fe0d0019040 2024-04-24T02:12:46.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.559+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 45 ==== watch-notify(notify (1) cookie 94342336018464 notify 137438953497 ret 0) ==== 191+0+0 (crc 0 0 0) 0x55cdc96e02e0 con 0x7fe0d0019040 2024-04-24T02:12:46.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.559+0000 7fdfbaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953497 cookie 94342336018464 notifier 4642 bl.length()=149 2024-04-24T02:12:46.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.559+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 46 ==== osd_op_reply(151 notify.6 [notify cookie 94342336281200 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.559+0000 7fdfbaffd640 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:152 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fdf9c003d60 con 0x7fe0d0019040 2024-04-24T02:12:46.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.560+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 47 ==== osd_op_reply(152 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.560+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 48 ==== watch-notify(notify_complete (2) cookie 94342336281200 notify 137438953497 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cdc96d4740 con 0x7fe0d0019040 2024-04-24T02:12:46.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.560+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:153 8.f 8:f20f32b0:root::.bucket.meta.myfoo%3a582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc9724260 con 0x55cdc96c88c0 2024-04-24T02:12:46.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.561+0000 7fe0d6b03640 1 -- 172.21.15.134:0/170420487 <== osd.3 v2:172.21.15.134:6801/3585115521 31 ==== osd_op_reply(153 .bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5 [call,call,delete] v32'2 uv2 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7fe0cc09f070 con 0x55cdc96c88c0 2024-04-24T02:12:46.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.561+0000 7fe0d9805800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5 from cache 2024-04-24T02:12:46.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.561+0000 7fe0d9805800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5, ofs0, ns] 2024-04-24T02:12:46.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.561+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:154 7.9 7:93e5b521:::notify.7:head [notify cookie 94342336281200 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc9724260 con 0x7fe0d0019040 2024-04-24T02:12:46.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.561+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 49 ==== watch-notify(notify (1) cookie 94342336027664 notify 137438953498 ret 0) ==== 248+0+0 (crc 0 0 0) 0x55cdc96d4740 con 0x7fe0d0019040 2024-04-24T02:12:46.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.561+0000 7fdfbaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953498 cookie 94342336027664 notifier 4642 bl.length()=206 2024-04-24T02:12:46.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.561+0000 7fdfbaffd640 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:155 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fdf9c003d60 con 0x7fe0d0019040 2024-04-24T02:12:46.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.561+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 50 ==== osd_op_reply(154 notify.7 [notify cookie 94342336281200 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.561+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 51 ==== osd_op_reply(155 notify.7 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.562+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 52 ==== watch-notify(notify_complete (2) cookie 94342336281200 notify 137438953498 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cdc968d2f0 con 0x7fe0d0019040 2024-04-24T02:12:46.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.562+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:156 4.1e 4:790c4b38:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc9724260 con 0x7fe0d0019040 2024-04-24T02:12:46.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.562+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:157 4.2c 4:34263e12:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc970fa70 con 0x55cdc96c2670 2024-04-24T02:12:46.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.562+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:158 4.7 4:e0e12daf:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc970e370 con 0x7fe0d0019040 2024-04-24T02:12:46.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.562+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:159 4.11 4:8ba1579a:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc970ec00 con 0x7fe0d0019040 2024-04-24T02:12:46.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.562+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:160 4.2d 4:b708063a:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc970efe0 con 0x7fe0d0019040 2024-04-24T02:12:46.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.562+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:161 4.18 4:198a8284:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc9724260 con 0x7fe0cc098070 2024-04-24T02:12:46.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.562+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:162 4.b 4:d0065d8e:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc970e370 con 0x7fe0cc098070 2024-04-24T02:12:46.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.562+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:163 4.18 4:1a164e0b:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc970ec00 con 0x7fe0cc098070 2024-04-24T02:12:46.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.562+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:164 4.17 4:e81b6358:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc970efe0 con 0x7fe0d0019040 2024-04-24T02:12:46.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.562+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:165 4.21 4:87793242:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc9724260 con 0x7fe0d0019040 2024-04-24T02:12:46.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.562+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:166 4.3f 4:feba10bb:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc970fa70 con 0x7fe0cc098070 2024-04-24T02:12:46.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.563+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 <== osd.2 v2:172.21.15.134:6800/214480313 44 ==== osd_op_reply(162 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.6 [delete] v32'12 uv12 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe0d002f040 con 0x7fe0cc098070 2024-04-24T02:12:46.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.563+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 <== osd.2 v2:172.21.15.134:6800/214480313 45 ==== osd_op_reply(161 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.5 [delete] v32'7 uv7 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe0d002f040 con 0x7fe0cc098070 2024-04-24T02:12:46.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.563+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 53 ==== osd_op_reply(160 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.4 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.563+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 <== osd.2 v2:172.21.15.134:6800/214480313 46 ==== osd_op_reply(163 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.7 [delete] v32'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe0d002f040 con 0x7fe0cc098070 2024-04-24T02:12:46.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.563+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 54 ==== osd_op_reply(156 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.0 [delete] v32'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.563+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 55 ==== osd_op_reply(165 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.9 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.563+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 56 ==== osd_op_reply(158 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.2 [delete] v32'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.563+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 57 ==== osd_op_reply(164 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.8 [delete] v32'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.563+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 58 ==== osd_op_reply(159 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.3 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.564+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 <== osd.2 v2:172.21.15.134:6800/214480313 47 ==== osd_op_reply(166 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.10 [delete] v32'14 uv14 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fe0d002f040 con 0x7fe0cc098070 2024-04-24T02:12:46.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.566+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.1 v2:172.21.15.134:6804/1487076214 34 ==== osd_op_reply(157 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5.1 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x55cdc96c2670 2024-04-24T02:12:46.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.566+0000 7fe0d9805800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5 : miss 2024-04-24T02:12:46.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.566+0000 7fe0d9805800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.566+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:167 6.10 6:08bf66ef:::pubsub..bucket.myfoo%2f582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdc970e370 con 0x7fe0d0019040 2024-04-24T02:12:46.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.566+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 59 ==== osd_op_reply(167 pubsub..bucket.myfoo/582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.566+0000 7fe0d9805800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:46.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.566+0000 7fe0d9805800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5 info.flags=0x0 2024-04-24T02:12:46.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.566+0000 7fe0d9805800 10 adding default.rgw.log++pubsub..bucket.myfoo/582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5 to cache LRU end 2024-04-24T02:12:46.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.566+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:168 6.10 6:08bf66ef:::pubsub..bucket.myfoo%2f582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc970fa70 con 0x7fe0d0019040 2024-04-24T02:12:46.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.567+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 60 ==== osd_op_reply(168 pubsub..bucket.myfoo/582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.5 [delete] v32'6 uv5 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.567+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:169 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc970fa70 con 0x7fe0cc098070 2024-04-24T02:12:46.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.568+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 <== osd.2 v2:172.21.15.134:6800/214480313 48 ==== osd_op_reply(169 foo.buckets [call] v32'39 uv39 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fe0d002f040 con 0x7fe0cc098070 2024-04-24T02:12:46.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.569+0000 7fdf8dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:46.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.569+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94342336042704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96db130 con 0x55cdc96c2670 2024-04-24T02:12:46.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.570+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.1 v2:172.21.15.134:6804/1487076214 35 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 94342336042704] v32'193 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x55cdc96c2670 2024-04-24T02:12:46.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.570+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94342336006496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96db130 con 0x7fe0cc098070 2024-04-24T02:12:46.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.571+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 <== osd.2 v2:172.21.15.134:6800/214480313 49 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 94342336006496] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0d002f040 con 0x7fe0cc098070 2024-04-24T02:12:46.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.571+0000 7fe0d9805800 20 remove_watcher() i=0 2024-04-24T02:12:46.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.571+0000 7fe0d9805800 2 removed watcher, disabling cache 2024-04-24T02:12:46.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.571+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94342336004560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96db130 con 0x55cdc96c2670 2024-04-24T02:12:46.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.572+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.1 v2:172.21.15.134:6804/1487076214 36 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 94342336004560] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x55cdc96c2670 2024-04-24T02:12:46.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.572+0000 7fe0d9805800 20 remove_watcher() i=1 2024-04-24T02:12:46.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.572+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94342336012768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96cc1d0 con 0x55cdc96c88c0 2024-04-24T02:12:46.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.573+0000 7fe0d6b03640 1 -- 172.21.15.134:0/170420487 <== osd.3 v2:172.21.15.134:6801/3585115521 32 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 94342336012768] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0cc09f070 con 0x55cdc96c88c0 2024-04-24T02:12:46.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.573+0000 7fe0d9805800 20 remove_watcher() i=2 2024-04-24T02:12:46.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.573+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94342336014496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96ce1e0 con 0x7fe0cc098070 2024-04-24T02:12:46.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.574+0000 7fe0d7b05640 1 -- 172.21.15.134:0/170420487 <== osd.2 v2:172.21.15.134:6800/214480313 50 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 94342336014496] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0d002f040 con 0x7fe0cc098070 2024-04-24T02:12:46.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.574+0000 7fe0d9805800 20 remove_watcher() i=3 2024-04-24T02:12:46.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.574+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94342336022080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96cc1d0 con 0x55cdc96c2670 2024-04-24T02:12:46.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.575+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.1 v2:172.21.15.134:6804/1487076214 37 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 94342336022080] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x55cdc96c2670 2024-04-24T02:12:46.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.575+0000 7fe0d9805800 20 remove_watcher() i=4 2024-04-24T02:12:46.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.575+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94342336026128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96ce1e0 con 0x7fe0d0019040 2024-04-24T02:12:46.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.576+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 61 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 94342336026128] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.576+0000 7fe0d9805800 20 remove_watcher() i=5 2024-04-24T02:12:46.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.576+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94342336018464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96cc1d0 con 0x7fe0d0019040 2024-04-24T02:12:46.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.577+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 62 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 94342336018464] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.577+0000 7fe0d9805800 20 remove_watcher() i=6 2024-04-24T02:12:46.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.577+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94342336027664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdc96d1610 con 0x7fe0d0019040 2024-04-24T02:12:46.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.578+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 <== osd.0 v2:172.21.15.104:6800/2419146313 63 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 94342336027664] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0c8019050 con 0x7fe0d0019040 2024-04-24T02:12:46.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.578+0000 7fe0d9805800 20 remove_watcher() i=7 2024-04-24T02:12:46.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.578+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fe0d0019040 msgr2=0x7fe0d0019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.578+0000 7fe0d9805800 1 --2- 172.21.15.134:0/170420487 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fe0d0019040 0x7fe0d0019930 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.578+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55cdc96c2670 msgr2=0x55cdc96c4b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.578+0000 7fe0d9805800 1 --2- 172.21.15.134:0/170420487 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55cdc96c2670 0x55cdc96c4b30 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.578+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fe0cc098070 msgr2=0x7fe0cc05c790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.578+0000 7fe0d9805800 1 --2- 172.21.15.134:0/170420487 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fe0cc098070 0x7fe0cc05c790 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.578+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55cdc96c88c0 msgr2=0x55cdc96cacb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.578+0000 7fe0d9805800 1 --2- 172.21.15.134:0/170420487 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55cdc96c88c0 0x55cdc96cacb0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.578+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdfa0036900 msgr2=0x7fdfa0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.578+0000 7fe0d9805800 1 --2- 172.21.15.134:0/170420487 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdfa0036900 0x7fdfa0038dc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55cdc9692290 tx=0x7fe0d000c040 comp rx=0 tx=0).stop 2024-04-24T02:12:46.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.578+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdc96af520 msgr2=0x55cdc96b6b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.578+0000 7fe0d7304640 1 -- 172.21.15.134:0/170420487 reap_dead start 2024-04-24T02:12:46.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.578+0000 7fe0d9805800 1 --2- 172.21.15.134:0/170420487 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdc96af520 0x55cdc96b6b50 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc072f90 tx=0x7fe0cc08dce0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.578+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 shutdown_connections 2024-04-24T02:12:46.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.578+0000 7fe0d9805800 1 --2- 172.21.15.134:0/170420487 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdc96af520 0x55cdc96b6b50 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.578+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 >> 172.21.15.134:0/170420487 conn(0x55cdc96ab880 msgr2=0x55cdc96a8ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:46.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.578+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 shutdown_connections 2024-04-24T02:12:46.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.578+0000 7fe0d9805800 1 -- 172.21.15.134:0/170420487 wait complete. 2024-04-24T02:12:46.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.579+0000 7fe0d9805800 1 -- 172.21.15.134:0/3798071809 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdfb0036950 msgr2=0x7fdfb0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.579+0000 7fe0d9805800 1 --2- 172.21.15.134:0/3798071809 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdfb0036950 0x7fdfb0038e10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x55cdc9692b10 tx=0x7fe0d0000f90 comp rx=0 tx=0).stop 2024-04-24T02:12:46.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.579+0000 7fe0d9805800 1 -- 172.21.15.134:0/3798071809 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdc96a22c0 msgr2=0x55cdc96a26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.579+0000 7fe0d9805800 1 --2- 172.21.15.134:0/3798071809 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdc96a22c0 0x55cdc96a26e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc044840 tx=0x7fe0cc002fb0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.579+0000 7fe0d9805800 1 -- 172.21.15.134:0/3798071809 shutdown_connections 2024-04-24T02:12:46.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.579+0000 7fe0d9805800 1 --2- 172.21.15.134:0/3798071809 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdfb0036950 0x7fdfb0038e10 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.579+0000 7fe0d9805800 1 --2- 172.21.15.134:0/3798071809 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdc96a22c0 0x55cdc96a26e0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.579+0000 7fe0d9805800 1 -- 172.21.15.134:0/3798071809 >> 172.21.15.134:0/3798071809 conn(0x55cdc9696360 msgr2=0x55cdc9696760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:46.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.579+0000 7fe0d9805800 1 -- 172.21.15.134:0/3798071809 shutdown_connections 2024-04-24T02:12:46.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.579+0000 7fe0d9805800 1 -- 172.21.15.134:0/3798071809 wait complete. 2024-04-24T02:12:46.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.579+0000 7fe0d9805800 1 -- 172.21.15.134:0/1864232147 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55cdc9593390 msgr2=0x55cdc96910b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.579+0000 7fe0d9805800 1 --2- 172.21.15.134:0/1864232147 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55cdc9593390 0x55cdc96910b0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.579+0000 7fe0d9805800 1 -- 172.21.15.134:0/1864232147 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdfbc036950 msgr2=0x7fdfbc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.579+0000 7fe0d9805800 1 --2- 172.21.15.134:0/1864232147 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdfbc036950 0x7fdfbc038e10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc054000 tx=0x7fe0cc04e000 comp rx=0 tx=0).stop 2024-04-24T02:12:46.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.579+0000 7fe0d9805800 1 -- 172.21.15.134:0/1864232147 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdc958d120 msgr2=0x55cdc9689e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.579+0000 7fe0d9805800 1 --2- 172.21.15.134:0/1864232147 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdc958d120 0x55cdc9689e70 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8000f80 tx=0x7fe0c8001250 comp rx=0 tx=0).stop 2024-04-24T02:12:46.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.579+0000 7fe0d9805800 1 -- 172.21.15.134:0/1864232147 shutdown_connections 2024-04-24T02:12:46.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.579+0000 7fe0d9805800 1 --2- 172.21.15.134:0/1864232147 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55cdc9593390 0x55cdc96910b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.579+0000 7fe0d9805800 1 --2- 172.21.15.134:0/1864232147 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fdfbc036950 0x7fdfbc038e10 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.579+0000 7fe0d9805800 1 --2- 172.21.15.134:0/1864232147 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdc958d120 0x55cdc9689e70 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.579+0000 7fe0d9805800 1 -- 172.21.15.134:0/1864232147 >> 172.21.15.134:0/1864232147 conn(0x55cdc9588b20 msgr2=0x55cdc958e940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:46.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.579+0000 7fe0d9805800 1 -- 172.21.15.134:0/1864232147 shutdown_connections 2024-04-24T02:12:46.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.579+0000 7fe0d9805800 1 -- 172.21.15.134:0/1864232147 wait complete. 2024-04-24T02:12:46.588 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-04-24T02:12:46.588 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-04-24T02:12:46.589 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-04-24T02:12:46.675 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:46.675 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:46.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.674+0000 7f75c2a87800 1 Processor -- start 2024-04-24T02:12:46.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.674+0000 7f75c2a87800 1 -- start start 2024-04-24T02:12:46.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.675+0000 7f75c2a87800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55667f3f1190 0x55667f3f3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.675+0000 7f75c2a87800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55667f2abd40 con 0x55667f360a70 2024-04-24T02:12:46.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.675+0000 7f75c2a87800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55667f27e4d0 con 0x55667f3f1190 2024-04-24T02:12:46.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.675+0000 7f75b7d85640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55667f3f1190 0x55667f3f3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.675+0000 7f75b7d85640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55667f3f1190 0x55667f3f3650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:35844/0 (socket says 172.21.15.134:35844) 2024-04-24T02:12:46.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.675+0000 7f75c0586640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55667f360a70 0x55667f3efa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:42224/0 (socket says 172.21.15.134:42224) 2024-04-24T02:12:46.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.675+0000 7f75b7d85640 1 -- 172.21.15.134:0/2924540404 learned_addr learned my addr 172.21.15.134:0/2924540404 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:46.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.675+0000 7f75b7d85640 1 -- 172.21.15.134:0/2924540404 >> v1:172.21.15.104:6789/0 conn(0x55667f360a70 legacy=0x55667f3efa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.675+0000 7f75b7d85640 1 -- 172.21.15.134:0/2924540404 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55667f2aa590 con 0x55667f3f1190 2024-04-24T02:12:46.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.677+0000 7f75b7d85640 1 --2- 172.21.15.134:0/2924540404 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55667f3f1190 0x55667f3f3650 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f75a800a520 tx=0x7f75a801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c90c5033ea9d29bf server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.677+0000 7f75bfd85640 1 -- 172.21.15.134:0/2924540404 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75a8057070 con 0x55667f3f1190 2024-04-24T02:12:46.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.677+0000 7f75bfd85640 1 -- 172.21.15.134:0/2924540404 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75a8052570 con 0x55667f3f1190 2024-04-24T02:12:46.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.677+0000 7f75bfd85640 1 -- 172.21.15.134:0/2924540404 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75a804ae60 con 0x55667f3f1190 2024-04-24T02:12:46.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.678+0000 7f75c2a87800 1 -- 172.21.15.134:0/2924540404 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55667f3f1190 msgr2=0x55667f3f3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.678+0000 7f75c2a87800 1 --2- 172.21.15.134:0/2924540404 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55667f3f1190 0x55667f3f3650 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f75a800a520 tx=0x7f75a801d010 comp rx=0 tx=0).stop 2024-04-24T02:12:46.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.678+0000 7f75c2a87800 1 -- 172.21.15.134:0/2924540404 shutdown_connections 2024-04-24T02:12:46.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.678+0000 7f75c2a87800 1 --2- 172.21.15.134:0/2924540404 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55667f3f1190 0x55667f3f3650 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.678+0000 7f75c2a87800 1 -- 172.21.15.134:0/2924540404 >> 172.21.15.134:0/2924540404 conn(0x55667f3e7340 msgr2=0x55667f3e9760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:46.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.678+0000 7f75c2a87800 1 -- 172.21.15.134:0/2924540404 shutdown_connections 2024-04-24T02:12:46.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.678+0000 7f75c2a87800 1 -- 172.21.15.134:0/2924540404 wait complete. 2024-04-24T02:12:46.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.689+0000 7f75c2a87800 1 Processor -- start 2024-04-24T02:12:46.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.689+0000 7f75c2a87800 1 -- start start 2024-04-24T02:12:46.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.689+0000 7f75c2a87800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55667f360a70 0x55667f4de0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.689+0000 7f75c2a87800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55667f3383b0 con 0x55667f360a70 2024-04-24T02:12:46.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.690+0000 7f75c0586640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55667f360a70 0x55667f4de0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.690+0000 7f75c0586640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55667f360a70 0x55667f4de0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:35860/0 (socket says 172.21.15.134:35860) 2024-04-24T02:12:46.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.690+0000 7f75c0586640 1 -- 172.21.15.134:0/4182386300 learned_addr learned my addr 172.21.15.134:0/4182386300 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:46.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.690+0000 7f75c0586640 1 -- 172.21.15.134:0/4182386300 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55667f4de690 con 0x55667f360a70 2024-04-24T02:12:46.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.690+0000 7f75c0586640 1 --2- 172.21.15.134:0/4182386300 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55667f360a70 0x55667f4de0c0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f75b0001e10 tx=0x7f75b000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74ccbbf7075f7a73 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.690+0000 7f74ae60c640 1 -- 172.21.15.134:0/4182386300 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75b000e5c0 con 0x55667f360a70 2024-04-24T02:12:46.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.690+0000 7f74ae60c640 1 -- 172.21.15.134:0/4182386300 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75b0006070 con 0x55667f360a70 2024-04-24T02:12:46.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.690+0000 7f74ae60c640 1 -- 172.21.15.134:0/4182386300 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75b000e930 con 0x55667f360a70 2024-04-24T02:12:46.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.691+0000 7f75c2a87800 1 -- 172.21.15.134:0/4182386300 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55667f360a70 msgr2=0x55667f4de0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.691+0000 7f75c2a87800 1 --2- 172.21.15.134:0/4182386300 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55667f360a70 0x55667f4de0c0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f75b0001e10 tx=0x7f75b000b6c0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.691+0000 7f75c2a87800 1 -- 172.21.15.134:0/4182386300 shutdown_connections 2024-04-24T02:12:46.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.691+0000 7f75c2a87800 1 --2- 172.21.15.134:0/4182386300 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55667f360a70 0x55667f4de0c0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.691+0000 7f75c2a87800 1 -- 172.21.15.134:0/4182386300 >> 172.21.15.134:0/4182386300 conn(0x55667f3e7340 msgr2=0x55667f4d99e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:46.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.691+0000 7f75c2a87800 1 -- 172.21.15.134:0/4182386300 shutdown_connections 2024-04-24T02:12:46.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.691+0000 7f75c2a87800 1 -- 172.21.15.134:0/4182386300 wait complete. 2024-04-24T02:12:46.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.691+0000 7f75c2a87800 1 Processor -- start 2024-04-24T02:12:46.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.691+0000 7f75c2a87800 1 -- start start 2024-04-24T02:12:46.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.691+0000 7f75c2a87800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55667f360a70 0x55667f3ed370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.691+0000 7f75c2a87800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55667f3f4000 con 0x55667f360a70 2024-04-24T02:12:46.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.692+0000 7f75c0586640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55667f360a70 0x55667f3ed370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.692+0000 7f75c0586640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55667f360a70 0x55667f3ed370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:35872/0 (socket says 172.21.15.134:35872) 2024-04-24T02:12:46.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.692+0000 7f75c0586640 1 -- 172.21.15.134:0/1526324698 learned_addr learned my addr 172.21.15.134:0/1526324698 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:46.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.692+0000 7f75c0586640 1 -- 172.21.15.134:0/1526324698 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55667f3eba60 con 0x55667f360a70 2024-04-24T02:12:46.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.692+0000 7f75c0586640 1 --2- 172.21.15.134:0/1526324698 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55667f360a70 0x55667f3ed370 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f75b0004000 tx=0x7f75b0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.692+0000 7f74ace09640 1 -- 172.21.15.134:0/1526324698 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75b001a880 con 0x55667f360a70 2024-04-24T02:12:46.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.692+0000 7f74ace09640 1 -- 172.21.15.134:0/1526324698 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75b001aa20 con 0x55667f360a70 2024-04-24T02:12:46.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.692+0000 7f74ace09640 1 -- 172.21.15.134:0/1526324698 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75b001ad20 con 0x55667f360a70 2024-04-24T02:12:46.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.692+0000 7f75c2a87800 1 -- 172.21.15.134:0/1526324698 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55667f3ebcf0 con 0x55667f360a70 2024-04-24T02:12:46.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.692+0000 7f75c2a87800 1 -- 172.21.15.134:0/1526324698 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55667f3ec1b0 con 0x55667f360a70 2024-04-24T02:12:46.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.693+0000 7f74ace09640 1 -- 172.21.15.134:0/1526324698 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f75b0017070 con 0x55667f360a70 2024-04-24T02:12:46.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.693+0000 7f74ace09640 1 --2- 172.21.15.134:0/1526324698 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f74a8036950 0x7f74a8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.693+0000 7f74ace09640 1 -- 172.21.15.134:0/1526324698 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f75b0015020 con 0x55667f360a70 2024-04-24T02:12:46.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.693+0000 7f75b7d85640 1 --2- 172.21.15.134:0/1526324698 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f74a8036950 0x7f74a8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.693+0000 7f75c2a87800 1 --2- 172.21.15.134:0/1526324698 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55667f3f1190 0x55667f4ef0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.693+0000 7f75c2a87800 1 -- 172.21.15.134:0/1526324698 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55667f4ef680 con 0x55667f3f1190 2024-04-24T02:12:46.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.693+0000 7f75c0d87640 1 --2- 172.21.15.134:0/1526324698 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55667f3f1190 0x55667f4ef0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.694+0000 7f75b7d85640 1 --2- 172.21.15.134:0/1526324698 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f74a8036950 0x7f74a8038e10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f75a8054000 tx=0x7f75a804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.694+0000 7f75c0d87640 1 --2- 172.21.15.134:0/1526324698 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55667f3f1190 0x55667f4ef0b0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.694+0000 7f75c0d87640 1 -- 172.21.15.134:0/1526324698 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f75b800a4a0 con 0x55667f3f1190 2024-04-24T02:12:46.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.694+0000 7f75c2a87800 1 -- 172.21.15.134:0/1526324698 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55667f4eff20 con 0x55667f3f1190 2024-04-24T02:12:46.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.694+0000 7f75c0d87640 1 -- 172.21.15.134:0/1526324698 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f75b800a4a0 con 0x55667f3f1190 2024-04-24T02:12:46.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.694+0000 7f75c2a87800 1 -- 172.21.15.134:0/1526324698 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55667f4f12d0 con 0x55667f3f1190 2024-04-24T02:12:46.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.695+0000 7f75c0d87640 1 -- 172.21.15.134:0/1526324698 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f75b800a4a0 con 0x55667f3f1190 2024-04-24T02:12:46.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.695+0000 7f75c2a87800 1 -- 172.21.15.134:0/1526324698 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55667f4f0770 con 0x55667f3f1190 2024-04-24T02:12:46.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.695+0000 7f75c0d87640 1 -- 172.21.15.134:0/1526324698 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f75b800a4a0 con 0x55667f3f1190 2024-04-24T02:12:46.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.695+0000 7f75c2a87800 1 -- 172.21.15.134:0/1526324698 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55667f4f0b90 con 0x55667f3f1190 2024-04-24T02:12:46.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.695+0000 7f75c0d87640 1 -- 172.21.15.134:0/1526324698 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f75b800a4a0 con 0x55667f3f1190 2024-04-24T02:12:46.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.695+0000 7f75c2a87800 1 Processor -- start 2024-04-24T02:12:46.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.696+0000 7f75c2a87800 1 -- start start 2024-04-24T02:12:46.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.696+0000 7f75c2a87800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55667f500360 0x55667f500780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.696+0000 7f75c2a87800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55667f3ed8b0 con 0x55667f500360 2024-04-24T02:12:46.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.696+0000 7f75b7d85640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55667f500360 0x55667f500780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.696+0000 7f75b7d85640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55667f500360 0x55667f500780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:35874/0 (socket says 172.21.15.134:35874) 2024-04-24T02:12:46.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.696+0000 7f75b7d85640 1 -- 172.21.15.134:0/872047773 learned_addr learned my addr 172.21.15.134:0/872047773 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:46.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.696+0000 7f75b7d85640 1 -- 172.21.15.134:0/872047773 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55667f500cc0 con 0x55667f500360 2024-04-24T02:12:46.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.697+0000 7f75b7d85640 1 --2- 172.21.15.134:0/872047773 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55667f500360 0x55667f500780 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f75a8055040 tx=0x7f75a8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.697+0000 7f74a5ffb640 1 -- 172.21.15.134:0/872047773 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75a8057040 con 0x55667f500360 2024-04-24T02:12:46.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.697+0000 7f74a5ffb640 1 -- 172.21.15.134:0/872047773 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75a805d710 con 0x55667f500360 2024-04-24T02:12:46.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.697+0000 7f74a5ffb640 1 -- 172.21.15.134:0/872047773 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75a805da30 con 0x55667f500360 2024-04-24T02:12:46.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.697+0000 7f75c2a87800 1 -- 172.21.15.134:0/872047773 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55667f501730 con 0x55667f500360 2024-04-24T02:12:46.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.697+0000 7f75c2a87800 1 -- 172.21.15.134:0/872047773 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55667f501bd0 con 0x55667f500360 2024-04-24T02:12:46.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.697+0000 7f74a5ffb640 1 -- 172.21.15.134:0/872047773 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f75a8067070 con 0x55667f500360 2024-04-24T02:12:46.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.698+0000 7f74a5ffb640 1 --2- 172.21.15.134:0/872047773 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7498036950 0x7f7498038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.698+0000 7f74a5ffb640 1 -- 172.21.15.134:0/872047773 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f75a808f630 con 0x55667f500360 2024-04-24T02:12:46.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.698+0000 7f75c0d87640 1 --2- 172.21.15.134:0/872047773 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7498036950 0x7f7498038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.698+0000 7f75c2a87800 1 Processor -- start 2024-04-24T02:12:46.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.698+0000 7f75c0d87640 1 --2- 172.21.15.134:0/872047773 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7498036950 0x7f7498038e10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x55667f4f0b10 tx=0x7f75b8005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.698+0000 7f75c2a87800 1 -- start start 2024-04-24T02:12:46.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.698+0000 7f75c2a87800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55667f50d5a0 0x55667f50d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.698+0000 7f75c2a87800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55667f2de6b0 con 0x55667f50d5a0 2024-04-24T02:12:46.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.698+0000 7f75b7d85640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55667f50d5a0 0x55667f50d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.698+0000 7f75b7d85640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55667f50d5a0 0x55667f50d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:35880/0 (socket says 172.21.15.134:35880) 2024-04-24T02:12:46.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.698+0000 7f75b7d85640 1 -- 172.21.15.134:0/1819154830 learned_addr learned my addr 172.21.15.134:0/1819154830 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:46.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.698+0000 7f75b7d85640 1 -- 172.21.15.134:0/1819154830 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55667f50df90 con 0x55667f50d5a0 2024-04-24T02:12:46.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.699+0000 7f75b7d85640 1 --2- 172.21.15.134:0/1819154830 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55667f50d5a0 0x55667f50d9c0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f75a8005a60 tx=0x7f75a8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5a0b368bc455ed9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.699+0000 7f74977fe640 1 -- 172.21.15.134:0/1819154830 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75a8082070 con 0x55667f50d5a0 2024-04-24T02:12:46.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.699+0000 7f74977fe640 1 -- 172.21.15.134:0/1819154830 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75a8071400 con 0x55667f50d5a0 2024-04-24T02:12:46.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.699+0000 7f74977fe640 1 -- 172.21.15.134:0/1819154830 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75a808b070 con 0x55667f50d5a0 2024-04-24T02:12:46.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.699+0000 7f75c2a87800 1 -- 172.21.15.134:0/1819154830 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55667f50d5a0 msgr2=0x55667f50d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.699+0000 7f75c2a87800 1 --2- 172.21.15.134:0/1819154830 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55667f50d5a0 0x55667f50d9c0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f75a8005a60 tx=0x7f75a8000ed0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.699+0000 7f75c2a87800 1 -- 172.21.15.134:0/1819154830 shutdown_connections 2024-04-24T02:12:46.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.699+0000 7f75c2a87800 1 --2- 172.21.15.134:0/1819154830 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55667f50d5a0 0x55667f50d9c0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.699+0000 7f75c2a87800 1 -- 172.21.15.134:0/1819154830 >> 172.21.15.134:0/1819154830 conn(0x55667f509900 msgr2=0x55667f507960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:46.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.699+0000 7f75c2a87800 1 -- 172.21.15.134:0/1819154830 shutdown_connections 2024-04-24T02:12:46.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.699+0000 7f75c2a87800 1 -- 172.21.15.134:0/1819154830 wait complete. 2024-04-24T02:12:46.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.699+0000 7f75c2a87800 1 Processor -- start 2024-04-24T02:12:46.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.700+0000 7f75c2a87800 1 -- start start 2024-04-24T02:12:46.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.700+0000 7f75c2a87800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55667f50d5a0 0x55667f514a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.700+0000 7f75c2a87800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55667f50e580 con 0x55667f50d5a0 2024-04-24T02:12:46.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.700+0000 7f75b7d85640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55667f50d5a0 0x55667f514a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.700+0000 7f75b7d85640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55667f50d5a0 0x55667f514a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:35894/0 (socket says 172.21.15.134:35894) 2024-04-24T02:12:46.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.700+0000 7f75b7d85640 1 -- 172.21.15.134:0/3166966460 learned_addr learned my addr 172.21.15.134:0/3166966460 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:46.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.700+0000 7f75b7d85640 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55667f514fd0 con 0x55667f50d5a0 2024-04-24T02:12:46.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.700+0000 7f75b7d85640 1 --2- 172.21.15.134:0/3166966460 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55667f50d5a0 0x55667f514a90 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f75a8080040 tx=0x7f75a808da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.700+0000 7f7495ffb640 1 -- 172.21.15.134:0/3166966460 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75a808b070 con 0x55667f50d5a0 2024-04-24T02:12:46.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.700+0000 7f7495ffb640 1 -- 172.21.15.134:0/3166966460 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75a805ebb0 con 0x55667f50d5a0 2024-04-24T02:12:46.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.700+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55667f515260 con 0x55667f50d5a0 2024-04-24T02:12:46.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.700+0000 7f7495ffb640 1 -- 172.21.15.134:0/3166966460 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75a8082040 con 0x55667f50d5a0 2024-04-24T02:12:46.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.700+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55667f517f10 con 0x55667f50d5a0 2024-04-24T02:12:46.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.701+0000 7f7495ffb640 1 -- 172.21.15.134:0/3166966460 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f75a808f950 con 0x55667f50d5a0 2024-04-24T02:12:46.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.701+0000 7f7495ffb640 1 --2- 172.21.15.134:0/3166966460 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7488036950 0x7f7488038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.701+0000 7f7495ffb640 1 -- 172.21.15.134:0/3166966460 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f75a8092880 con 0x55667f50d5a0 2024-04-24T02:12:46.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.701+0000 7f75c0d87640 1 --2- 172.21.15.134:0/3166966460 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7488036950 0x7f7488038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.702+0000 7f75c0d87640 1 --2- 172.21.15.134:0/3166966460 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7488036950 0x7f7488038e10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x55667f3ec790 tx=0x7f75b801f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.702+0000 7f75c2a87800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.702+0000 7f75c2a87800 1 --2- 172.21.15.134:0/3166966460 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55667f5205d0 0x55667f522a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.702+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55667f5231e0 con 0x55667f5205d0 2024-04-24T02:12:46.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.702+0000 7f75c0586640 1 --2- 172.21.15.134:0/3166966460 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55667f5205d0 0x55667f522a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.702+0000 7f75c0586640 1 --2- 172.21.15.134:0/3166966460 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55667f5205d0 0x55667f522a90 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.702+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f75b002e070 con 0x55667f5205d0 2024-04-24T02:12:46.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.702+0000 7f75c2a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:46.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.702+0000 7f75c2a87800 20 realm 2024-04-24T02:12:46.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.702+0000 7f75c2a87800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.702+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55667f5235f0 con 0x55667f5205d0 2024-04-24T02:12:46.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.703+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f75b002e070 con 0x55667f5205d0 2024-04-24T02:12:46.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.703+0000 7f75c2a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:46.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.703+0000 7f75c2a87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:46.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.703+0000 7f75c2a87800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.703+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55667f523ec0 con 0x55667f5205d0 2024-04-24T02:12:46.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.703+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f75b002e070 con 0x55667f5205d0 2024-04-24T02:12:46.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.703+0000 7f75c2a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:46.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.703+0000 7f75c2a87800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.703+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55667f524260 con 0x55667f5205d0 2024-04-24T02:12:46.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.703+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f75b002e070 con 0x55667f5205d0 2024-04-24T02:12:46.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.703+0000 7f75c2a87800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:46.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.703+0000 7f75c2a87800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.703+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55667f524ab0 con 0x55667f5205d0 2024-04-24T02:12:46.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.703+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f75b002e070 con 0x55667f5205d0 2024-04-24T02:12:46.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.703+0000 7f75c2a87800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:46.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.703+0000 7f75c2a87800 20 searching for the correct realm 2024-04-24T02:12:46.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.703+0000 7f75c2a87800 1 --2- 172.21.15.134:0/3166966460 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55667f526820 0x55667f528c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.703+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55667f529220 con 0x55667f526820 2024-04-24T02:12:46.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.704+0000 7f75b7d85640 1 --2- 172.21.15.134:0/3166966460 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55667f526820 0x55667f528c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.704+0000 7f75b7d85640 1 --2- 172.21.15.134:0/3166966460 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55667f526820 0x55667f528c10 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.704+0000 7f75b7d85640 1 -- 172.21.15.134:0/3166966460 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75a8085040 con 0x55667f526820 2024-04-24T02:12:46.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.704+0000 7f75b7d85640 1 --2- 172.21.15.134:0/3166966460 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f75a8092b20 0x7f75a8087820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.704+0000 7f75b7d85640 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55667f529220 con 0x7f75a8092b20 2024-04-24T02:12:46.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.704+0000 7f75c0d87640 1 --2- 172.21.15.134:0/3166966460 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f75a8092b20 0x7f75a8087820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.704+0000 7f75c0d87640 1 --2- 172.21.15.134:0/3166966460 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f75a8092b20 0x7f75a8087820 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.705+0000 7f75c0d87640 1 -- 172.21.15.134:0/3166966460 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75b801f070 con 0x7f75a8092b20 2024-04-24T02:12:46.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.705+0000 7f75c0d87640 1 --2- 172.21.15.134:0/3166966460 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f75b8031040 0x7f75b8032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.705+0000 7f75c0d87640 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55667f529220 con 0x7f75b8031040 2024-04-24T02:12:46.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.705+0000 7f75c0586640 1 --2- 172.21.15.134:0/3166966460 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f75b8031040 0x7f75b8032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.705+0000 7f75c0586640 1 --2- 172.21.15.134:0/3166966460 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f75b8031040 0x7f75b8032940 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.705+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75b002e070 con 0x7f75b8031040 2024-04-24T02:12:46.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.705+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55667f529220 con 0x55667f5205d0 2024-04-24T02:12:46.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.706+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75b002e070 con 0x55667f5205d0 2024-04-24T02:12:46.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.706+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55667f529220 con 0x55667f5205d0 2024-04-24T02:12:46.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.706+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f75b002e070 con 0x55667f5205d0 2024-04-24T02:12:46.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.706+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55667f529220 con 0x7f75b8031040 2024-04-24T02:12:46.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.706+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75b002e070 con 0x7f75b8031040 2024-04-24T02:12:46.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.706+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55667f529220 con 0x7f75a8092b20 2024-04-24T02:12:46.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.706+0000 7f75c0d87640 1 -- 172.21.15.134:0/3166966460 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75b801f070 con 0x7f75a8092b20 2024-04-24T02:12:46.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.706+0000 7f75c0d87640 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55667f529220 con 0x7f75a8092b20 2024-04-24T02:12:46.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.706+0000 7f75c0d87640 1 -- 172.21.15.134:0/3166966460 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75b801f070 con 0x7f75a8092b20 2024-04-24T02:12:46.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.707+0000 7f75c0d87640 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55667f529220 con 0x55667f526820 2024-04-24T02:12:46.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.707+0000 7f75b7d85640 1 -- 172.21.15.134:0/3166966460 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75a8085040 con 0x55667f526820 2024-04-24T02:12:46.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.707+0000 7f75b7d85640 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55667f529220 con 0x55667f5205d0 2024-04-24T02:12:46.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.707+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75b002e070 con 0x55667f5205d0 2024-04-24T02:12:46.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.707+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55667f529220 con 0x7f75b8031040 2024-04-24T02:12:46.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.707+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75b002e070 con 0x7f75b8031040 2024-04-24T02:12:46.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.707+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55667f529220 con 0x55667f5205d0 2024-04-24T02:12:46.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.707+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75b002e070 con 0x55667f5205d0 2024-04-24T02:12:46.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.707+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55667f529220 con 0x7f75a8092b20 2024-04-24T02:12:46.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.708+0000 7f75c0d87640 1 -- 172.21.15.134:0/3166966460 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f75b801f070 con 0x7f75a8092b20 2024-04-24T02:12:46.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.708+0000 7f75c0d87640 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55667f529220 con 0x55667f526820 2024-04-24T02:12:46.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.708+0000 7f75b7d85640 1 -- 172.21.15.134:0/3166966460 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75a8085040 con 0x55667f526820 2024-04-24T02:12:46.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.708+0000 7f75b7d85640 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55667f529220 con 0x55667f526820 2024-04-24T02:12:46.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.708+0000 7f75b7d85640 1 -- 172.21.15.134:0/3166966460 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75a8085040 con 0x55667f526820 2024-04-24T02:12:46.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.708+0000 7f75b7d85640 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55667f529220 con 0x7f75a8092b20 2024-04-24T02:12:46.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.708+0000 7f75c0d87640 1 -- 172.21.15.134:0/3166966460 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75b801f070 con 0x7f75a8092b20 2024-04-24T02:12:46.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.708+0000 7f75c0d87640 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55667f529220 con 0x55667f526820 2024-04-24T02:12:46.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.709+0000 7f75b7d85640 1 -- 172.21.15.134:0/3166966460 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75a8085040 con 0x55667f526820 2024-04-24T02:12:46.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.709+0000 7f75b7d85640 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55667f529220 con 0x55667f526820 2024-04-24T02:12:46.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.709+0000 7f75b7d85640 1 -- 172.21.15.134:0/3166966460 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75a8085040 con 0x55667f526820 2024-04-24T02:12:46.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.709+0000 7f75b7d85640 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55667f529220 con 0x55667f5205d0 2024-04-24T02:12:46.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.709+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75b002e070 con 0x55667f5205d0 2024-04-24T02:12:46.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.709+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55667f529220 con 0x55667f5205d0 2024-04-24T02:12:46.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.709+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f75b002e070 con 0x55667f5205d0 2024-04-24T02:12:46.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.709+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55667f529220 con 0x7f75b8031040 2024-04-24T02:12:46.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.710+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75b002e070 con 0x7f75b8031040 2024-04-24T02:12:46.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.710+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55667f529220 con 0x55667f526820 2024-04-24T02:12:46.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.710+0000 7f75b7d85640 1 -- 172.21.15.134:0/3166966460 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75a8085040 con 0x55667f526820 2024-04-24T02:12:46.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.710+0000 7f75b7d85640 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55667f529220 con 0x7f75a8092b20 2024-04-24T02:12:46.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.710+0000 7f75c0d87640 1 -- 172.21.15.134:0/3166966460 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75b801f070 con 0x7f75a8092b20 2024-04-24T02:12:46.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.710+0000 7f75c0d87640 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55667f529220 con 0x55667f5205d0 2024-04-24T02:12:46.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.710+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75b002e070 con 0x55667f5205d0 2024-04-24T02:12:46.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.710+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55667f529220 con 0x7f75b8031040 2024-04-24T02:12:46.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.711+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75b002e070 con 0x7f75b8031040 2024-04-24T02:12:46.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.711+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55667f529220 con 0x55667f526820 2024-04-24T02:12:46.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.711+0000 7f75b7d85640 1 -- 172.21.15.134:0/3166966460 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75a8085040 con 0x55667f526820 2024-04-24T02:12:46.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.711+0000 7f75b7d85640 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55667f529220 con 0x7f75b8031040 2024-04-24T02:12:46.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.711+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75b002e070 con 0x7f75b8031040 2024-04-24T02:12:46.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.711+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55667f529220 con 0x7f75a8092b20 2024-04-24T02:12:46.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.711+0000 7f75c0d87640 1 -- 172.21.15.134:0/3166966460 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75b8040040 con 0x7f75a8092b20 2024-04-24T02:12:46.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.711+0000 7f75c0d87640 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55667f529220 con 0x55667f526820 2024-04-24T02:12:46.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.712+0000 7f75b7d85640 1 -- 172.21.15.134:0/3166966460 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75a8085040 con 0x55667f526820 2024-04-24T02:12:46.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.712+0000 7f75b7d85640 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55667f529220 con 0x7f75a8092b20 2024-04-24T02:12:46.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.712+0000 7f75c0d87640 1 -- 172.21.15.134:0/3166966460 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75b8040040 con 0x7f75a8092b20 2024-04-24T02:12:46.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.712+0000 7f75c0d87640 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55667f529220 con 0x55667f5205d0 2024-04-24T02:12:46.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.712+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f75b002e070 con 0x55667f5205d0 2024-04-24T02:12:46.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.712+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55667f529220 con 0x7f75a8092b20 2024-04-24T02:12:46.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.712+0000 7f75c0d87640 1 -- 172.21.15.134:0/3166966460 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75b8040040 con 0x7f75a8092b20 2024-04-24T02:12:46.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.712+0000 7f75c2a87800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:46.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.712+0000 7f75c2a87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:46.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.712+0000 7f75c2a87800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:46.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.712+0000 7f75c2a87800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:46.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.712+0000 7f75c2a87800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:46.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.712+0000 7f75c2a87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:46.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.712+0000 7f75c2a87800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.712+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55667f525400 con 0x55667f5205d0 2024-04-24T02:12:46.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.713+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f75b002e070 con 0x55667f5205d0 2024-04-24T02:12:46.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.713+0000 7f75c2a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:46.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.713+0000 7f75c2a87800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.713+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55667f525ca0 con 0x55667f5205d0 2024-04-24T02:12:46.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.713+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f75b002e070 con 0x55667f5205d0 2024-04-24T02:12:46.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.713+0000 7f75c2a87800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:46.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.713+0000 7f75c2a87800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.713+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55667f529680 con 0x55667f5205d0 2024-04-24T02:12:46.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.713+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f75b002e070 con 0x55667f5205d0 2024-04-24T02:12:46.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.713+0000 7f75c2a87800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:46.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.713+0000 7f75c2a87800 20 zone default found 2024-04-24T02:12:46.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.713+0000 7f75c2a87800 4 Realm: () 2024-04-24T02:12:46.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.713+0000 7f75c2a87800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:46.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.713+0000 7f75c2a87800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:46.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.713+0000 7f75c2a87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:46.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.713+0000 7f75c2a87800 20 zonegroup default 2024-04-24T02:12:46.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.713+0000 7f75c2a87800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.713+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55667f529710 con 0x7f75b8031040 2024-04-24T02:12:46.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.713+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f75b002e070 con 0x7f75b8031040 2024-04-24T02:12:46.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.714+0000 7f75c2a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:46.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.714+0000 7f75c2a87800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.714+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55667f52b530 con 0x55667f526820 2024-04-24T02:12:46.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.714+0000 7f75b7d85640 1 -- 172.21.15.134:0/3166966460 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f75a8085040 con 0x55667f526820 2024-04-24T02:12:46.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.714+0000 7f75c2a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:46.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.714+0000 7f75c2a87800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.714+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55667f52b950 con 0x55667f526820 2024-04-24T02:12:46.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.714+0000 7f75b7d85640 1 -- 172.21.15.134:0/3166966460 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f75a8085040 con 0x55667f526820 2024-04-24T02:12:46.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.714+0000 7f75c2a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:46.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.714+0000 7f75c2a87800 20 started sync module instance, tier type = 2024-04-24T02:12:46.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.714+0000 7f75c2a87800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:46.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.714+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55667f52a9d0 con 0x7f75a8092b20 2024-04-24T02:12:46.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.715+0000 7f75c0d87640 1 -- 172.21.15.134:0/3166966460 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(44 notify.0 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75b8040040 con 0x7f75a8092b20 2024-04-24T02:12:46.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.715+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93898711150016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55667f52c260 con 0x7f75a8092b20 2024-04-24T02:12:46.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.715+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55667f52cab0 con 0x55667f5205d0 2024-04-24T02:12:46.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.716+0000 7f75c0d87640 1 -- 172.21.15.134:0/3166966460 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93898711150016] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75b8040040 con 0x7f75a8092b20 2024-04-24T02:12:46.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.716+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75b002e070 con 0x55667f5205d0 2024-04-24T02:12:46.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.716+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93898711154096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55667f52c740 con 0x55667f5205d0 2024-04-24T02:12:46.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.716+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55667f52d230 con 0x55667f526820 2024-04-24T02:12:46.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.717+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93898711154096] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75b002e070 con 0x55667f5205d0 2024-04-24T02:12:46.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.718+0000 7f75b7d85640 1 -- 172.21.15.134:0/3166966460 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75a8085040 con 0x55667f526820 2024-04-24T02:12:46.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.718+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93898711158016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55667f52d620 con 0x55667f526820 2024-04-24T02:12:46.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.718+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55667f52e020 con 0x7f75a8092b20 2024-04-24T02:12:46.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.719+0000 7f75c0d87640 1 -- 172.21.15.134:0/3166966460 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(50 notify.3 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75b8040040 con 0x7f75a8092b20 2024-04-24T02:12:46.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.719+0000 7f75b7d85640 1 -- 172.21.15.134:0/3166966460 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93898711158016] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75a8085040 con 0x55667f526820 2024-04-24T02:12:46.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.719+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93898711161648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55667f52e8c0 con 0x7f75a8092b20 2024-04-24T02:12:46.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.719+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55667f52c1d0 con 0x55667f5205d0 2024-04-24T02:12:46.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.719+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75b002e070 con 0x55667f5205d0 2024-04-24T02:12:46.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.720+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93898711166640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55667f52c1d0 con 0x55667f5205d0 2024-04-24T02:12:46.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.720+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55667f52fda0 con 0x7f75b8031040 2024-04-24T02:12:46.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.720+0000 7f75c0d87640 1 -- 172.21.15.134:0/3166966460 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93898711161648] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75b8040040 con 0x7f75a8092b20 2024-04-24T02:12:46.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.721+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(54 notify.5 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75b002e070 con 0x7f75b8031040 2024-04-24T02:12:46.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.721+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93898711163920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55667f52fda0 con 0x7f75b8031040 2024-04-24T02:12:46.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.721+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55667f5307b0 con 0x7f75b8031040 2024-04-24T02:12:46.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.721+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93898711166640] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75b002e070 con 0x55667f5205d0 2024-04-24T02:12:46.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.721+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 93898711163920] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75b002e070 con 0x7f75b8031040 2024-04-24T02:12:46.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.722+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(56 notify.6 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75b002e070 con 0x7f75b8031040 2024-04-24T02:12:46.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.722+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93898711169264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55667f52fd10 con 0x7f75b8031040 2024-04-24T02:12:46.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.722+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55667f530c60 con 0x7f75b8031040 2024-04-24T02:12:46.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.722+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 93898711169264] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75b002e070 con 0x7f75b8031040 2024-04-24T02:12:46.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.722+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(58 notify.7 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75b002e070 con 0x7f75b8031040 2024-04-24T02:12:46.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.722+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93898711171840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55667f530bd0 con 0x7f75b8031040 2024-04-24T02:12:46.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.723+0000 7f75c2a87800 20 add_watcher() i=0 2024-04-24T02:12:46.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.723+0000 7f75c2a87800 20 add_watcher() i=1 2024-04-24T02:12:46.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.723+0000 7f75c2a87800 20 add_watcher() i=2 2024-04-24T02:12:46.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.723+0000 7f75c2a87800 20 add_watcher() i=3 2024-04-24T02:12:46.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.723+0000 7f75c2a87800 20 add_watcher() i=4 2024-04-24T02:12:46.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.723+0000 7f75c2a87800 20 add_watcher() i=5 2024-04-24T02:12:46.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.723+0000 7f75c2a87800 20 add_watcher() i=6 2024-04-24T02:12:46.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.723+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 93898711171840] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75b002e070 con 0x7f75b8031040 2024-04-24T02:12:46.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.723+0000 7f75c2a87800 20 add_watcher() i=7 2024-04-24T02:12:46.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.723+0000 7f75c2a87800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:46.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.723+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55667f534060 con 0x55667f5205d0 2024-04-24T02:12:46.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.724+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f75b002e070 con 0x55667f5205d0 2024-04-24T02:12:46.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.724+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93898711173360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55667f5315b0 con 0x55667f5205d0 2024-04-24T02:12:46.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.725+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93898711173360] v32'194 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f75b002e070 con 0x55667f5205d0 2024-04-24T02:12:46.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.725+0000 7f74767e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:46.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.725+0000 7f75c2a87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:46.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.725+0000 7f75c2a87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:46.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.725+0000 7f75c2a87800 5 note: GC not initialized 2024-04-24T02:12:46.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.725+0000 7f74757e2640 20 reqs_thread_entry: start 2024-04-24T02:12:46.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.725+0000 7f75c2a87800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:46.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.725+0000 7f75c2a87800 20 Filter name: none 2024-04-24T02:12:46.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.725+0000 7f73e6ffd640 20 reqs_thread_entry: start 2024-04-24T02:12:46.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.725+0000 7f75c2a87800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T02:12:46.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.725+0000 7f75c2a87800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.725+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55667f567390 con 0x55667f5205d0 2024-04-24T02:12:46.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.726+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f75b002e070 con 0x55667f5205d0 2024-04-24T02:12:46.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.726+0000 7f75c2a87800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T02:12:46.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.726+0000 7f75c2a87800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T02:12:46.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.726+0000 7f75c2a87800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:46.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.726+0000 7f75c2a87800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:12:46.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.726+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~403 in=403b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55667f56d530 con 0x55667f5205d0 2024-04-24T02:12:46.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.727+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~403] v32'14 uv14 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f75b002e070 con 0x55667f5205d0 2024-04-24T02:12:46.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.727+0000 7f75c2a87800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T02:12:46.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.727+0000 7f75c2a87800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:46.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.727+0000 7f75c2a87800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-24T02:12:46.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.727+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93898711420864 in=591b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55667f568e10 con 0x55667f5205d0 2024-04-24T02:12:46.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.727+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== watch-notify(notify (1) cookie 93898711166640 notify 137438953488 ret 0) ==== 621+0+0 (crc 0 0 0) 0x7f75b0050040 con 0x55667f5205d0 2024-04-24T02:12:46.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.727+0000 7f74977fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953488 cookie 93898711166640 notifier 4649 bl.length()=579 2024-04-24T02:12:46.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.727+0000 7f74977fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T02:12:46.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.727+0000 7f74977fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:46.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.727+0000 7f74977fe640 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f7484003ea0 con 0x55667f5205d0 2024-04-24T02:12:46.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.727+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(64 notify.4 [notify cookie 93898711420864 out=8b] v0'0 uv180 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f75b002e070 con 0x55667f5205d0 2024-04-24T02:12:46.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.727+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75b002e070 con 0x55667f5205d0 2024-04-24T02:12:46.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.728+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== watch-notify(notify_complete (2) cookie 93898711420864 notify 137438953488 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f75b0037040 con 0x55667f5205d0 2024-04-24T02:12:46.744 INFO:teuthology.orchestra.run.smithi134.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T02:12:21.778798Z"}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T02:12:21.778786Z","tags":[],"group_ids":[]} 2024-04-24T02:12:46.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.728+0000 7f74767e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:46.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.728+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93898711173360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55667f56c3c0 con 0x55667f5205d0 2024-04-24T02:12:46.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.729+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93898711173360] v32'195 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f75b002e070 con 0x55667f5205d0 2024-04-24T02:12:46.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.729+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93898711150016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55667f5308c0 con 0x7f75a8092b20 2024-04-24T02:12:46.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.730+0000 7f75c0d87640 1 -- 172.21.15.134:0/3166966460 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93898711150016] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75b8040040 con 0x7f75a8092b20 2024-04-24T02:12:46.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.730+0000 7f75c2a87800 20 remove_watcher() i=0 2024-04-24T02:12:46.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.730+0000 7f75c2a87800 2 removed watcher, disabling cache 2024-04-24T02:12:46.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.730+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93898711154096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55667f52adc0 con 0x55667f5205d0 2024-04-24T02:12:46.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.731+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 <== osd.1 v2:172.21.15.134:6804/1487076214 30 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93898711154096] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75b002e070 con 0x55667f5205d0 2024-04-24T02:12:46.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.732+0000 7f75c2a87800 20 remove_watcher() i=1 2024-04-24T02:12:46.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.732+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93898711158016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55667f52bdb0 con 0x55667f526820 2024-04-24T02:12:46.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.733+0000 7f75b7d85640 1 -- 172.21.15.134:0/3166966460 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93898711158016] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75a8085040 con 0x55667f526820 2024-04-24T02:12:46.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.733+0000 7f75c2a87800 20 remove_watcher() i=2 2024-04-24T02:12:46.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.733+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93898711161648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55667f52bdb0 con 0x7f75a8092b20 2024-04-24T02:12:46.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.734+0000 7f75c0d87640 1 -- 172.21.15.134:0/3166966460 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93898711161648] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75b8040040 con 0x7f75a8092b20 2024-04-24T02:12:46.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.734+0000 7f75c2a87800 20 remove_watcher() i=3 2024-04-24T02:12:46.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.734+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93898711166640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55667f52bdb0 con 0x55667f5205d0 2024-04-24T02:12:46.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.735+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 <== osd.1 v2:172.21.15.134:6804/1487076214 31 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93898711166640] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75b002e070 con 0x55667f5205d0 2024-04-24T02:12:46.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.735+0000 7f75c2a87800 20 remove_watcher() i=4 2024-04-24T02:12:46.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.735+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93898711163920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55667f52eeb0 con 0x7f75b8031040 2024-04-24T02:12:46.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.736+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93898711163920] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75b002e070 con 0x7f75b8031040 2024-04-24T02:12:46.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.736+0000 7f75c2a87800 20 remove_watcher() i=5 2024-04-24T02:12:46.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.736+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93898711169264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55667f52bdb0 con 0x7f75b8031040 2024-04-24T02:12:46.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.737+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93898711169264] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75b002e070 con 0x7f75b8031040 2024-04-24T02:12:46.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.737+0000 7f75c2a87800 20 remove_watcher() i=6 2024-04-24T02:12:46.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.737+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93898711171840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55667f52eeb0 con 0x7f75b8031040 2024-04-24T02:12:46.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.738+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93898711171840] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75b002e070 con 0x7f75b8031040 2024-04-24T02:12:46.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.738+0000 7f75c2a87800 20 remove_watcher() i=7 2024-04-24T02:12:46.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.738+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f75b8031040 msgr2=0x7f75b8032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.738+0000 7f75c2a87800 1 --2- 172.21.15.134:0/3166966460 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f75b8031040 0x7f75b8032940 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.738+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55667f5205d0 msgr2=0x55667f522a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.738+0000 7f75c2a87800 1 --2- 172.21.15.134:0/3166966460 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55667f5205d0 0x55667f522a90 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.738+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f75a8092b20 msgr2=0x7f75a8087820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.738+0000 7f75c2a87800 1 --2- 172.21.15.134:0/3166966460 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f75a8092b20 0x7f75a8087820 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.738+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55667f526820 msgr2=0x55667f528c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.738+0000 7f75c2a87800 1 --2- 172.21.15.134:0/3166966460 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55667f526820 0x55667f528c10 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.738+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7488036950 msgr2=0x7f7488038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.738+0000 7f75c2a87800 1 --2- 172.21.15.134:0/3166966460 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7488036950 0x7f7488038e10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x55667f3ec790 tx=0x7f75b801f000 comp rx=0 tx=0).stop 2024-04-24T02:12:46.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.738+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55667f50d5a0 msgr2=0x55667f514a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.738+0000 7f75c0586640 1 -- 172.21.15.134:0/3166966460 reap_dead start 2024-04-24T02:12:46.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.738+0000 7f75c2a87800 1 --2- 172.21.15.134:0/3166966460 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55667f50d5a0 0x55667f514a90 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f75a8080040 tx=0x7f75a808da60 comp rx=0 tx=0).stop 2024-04-24T02:12:46.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.738+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 shutdown_connections 2024-04-24T02:12:46.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.738+0000 7f75c2a87800 1 --2- 172.21.15.134:0/3166966460 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55667f50d5a0 0x55667f514a90 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.738+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 >> 172.21.15.134:0/3166966460 conn(0x55667f509900 msgr2=0x55667f506f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:46.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.738+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 shutdown_connections 2024-04-24T02:12:46.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.738+0000 7f75c2a87800 1 -- 172.21.15.134:0/3166966460 wait complete. 2024-04-24T02:12:46.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.738+0000 7f75c2a87800 1 -- 172.21.15.134:0/872047773 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7498036950 msgr2=0x7f7498038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.738+0000 7f75c2a87800 1 --2- 172.21.15.134:0/872047773 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7498036950 0x7f7498038e10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x55667f4f0b10 tx=0x7f75b8005840 comp rx=0 tx=0).stop 2024-04-24T02:12:46.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.738+0000 7f75c2a87800 1 -- 172.21.15.134:0/872047773 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55667f500360 msgr2=0x55667f500780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.738+0000 7f75c2a87800 1 --2- 172.21.15.134:0/872047773 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55667f500360 0x55667f500780 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f75a8055040 tx=0x7f75a8002fb0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.738+0000 7f75c2a87800 1 -- 172.21.15.134:0/872047773 shutdown_connections 2024-04-24T02:12:46.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.738+0000 7f75c2a87800 1 --2- 172.21.15.134:0/872047773 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7498036950 0x7f7498038e10 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.738+0000 7f75c2a87800 1 --2- 172.21.15.134:0/872047773 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55667f500360 0x55667f500780 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.738+0000 7f75c2a87800 1 -- 172.21.15.134:0/872047773 >> 172.21.15.134:0/872047773 conn(0x55667f4f4400 msgr2=0x55667f4f4800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:46.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.738+0000 7f75c2a87800 1 -- 172.21.15.134:0/872047773 shutdown_connections 2024-04-24T02:12:46.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.738+0000 7f75c2a87800 1 -- 172.21.15.134:0/872047773 wait complete. 2024-04-24T02:12:46.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.739+0000 7f75c2a87800 1 -- 172.21.15.134:0/1526324698 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55667f3f1190 msgr2=0x55667f4ef0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.739+0000 7f75c2a87800 1 --2- 172.21.15.134:0/1526324698 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55667f3f1190 0x55667f4ef0b0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.739+0000 7f75c2a87800 1 -- 172.21.15.134:0/1526324698 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f74a8036950 msgr2=0x7f74a8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.739+0000 7f75c2a87800 1 --2- 172.21.15.134:0/1526324698 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f74a8036950 0x7f74a8038e10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f75a8054000 tx=0x7f75a804e000 comp rx=0 tx=0).stop 2024-04-24T02:12:46.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.739+0000 7f75c2a87800 1 -- 172.21.15.134:0/1526324698 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55667f360a70 msgr2=0x55667f3ed370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.739+0000 7f75c2a87800 1 --2- 172.21.15.134:0/1526324698 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55667f360a70 0x55667f3ed370 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f75b0004000 tx=0x7f75b0000bc0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.739+0000 7f75c2a87800 1 -- 172.21.15.134:0/1526324698 shutdown_connections 2024-04-24T02:12:46.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.739+0000 7f75c2a87800 1 --2- 172.21.15.134:0/1526324698 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55667f3f1190 0x55667f4ef0b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.739+0000 7f75c2a87800 1 --2- 172.21.15.134:0/1526324698 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f74a8036950 0x7f74a8038e10 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.739+0000 7f75c2a87800 1 --2- 172.21.15.134:0/1526324698 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55667f360a70 0x55667f3ed370 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.739+0000 7f75c2a87800 1 -- 172.21.15.134:0/1526324698 >> 172.21.15.134:0/1526324698 conn(0x55667f3e7340 msgr2=0x55667f4d81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:46.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.739+0000 7f75c2a87800 1 -- 172.21.15.134:0/1526324698 shutdown_connections 2024-04-24T02:12:46.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.739+0000 7f75c2a87800 1 -- 172.21.15.134:0/1526324698 wait complete. 2024-04-24T02:12:46.757 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T02:12:21.778798Z'}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:12:21.778786Z', 'tags': [], 'group_ids': []} 2024-04-24T02:12:46.757 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-04-24T02:12:46.758 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-04-24T02:12:46.758 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-04-24T02:12:46.802 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:46.802 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:46.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.801+0000 7fd6a2b33800 1 Processor -- start 2024-04-24T02:12:46.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.801+0000 7fd6a2b33800 1 -- start start 2024-04-24T02:12:46.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.801+0000 7fd6a2b33800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55f4fa8f2350 0x55f4fa8f4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.801+0000 7fd6a2b33800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f4fa7acd40 con 0x55f4fa8edfb0 2024-04-24T02:12:46.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.801+0000 7fd6a2b33800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55f4fa77f4d0 con 0x55f4fa8f2350 2024-04-24T02:12:46.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.802+0000 7fd695fd7640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55f4fa8f2350 0x55f4fa8f4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.802+0000 7fd69e7d8640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55f4fa8edfb0 0x55f4fa8ee3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:42226/0 (socket says 172.21.15.134:42226) 2024-04-24T02:12:46.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.802+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2219951070 learned_addr learned my addr 172.21.15.134:0/2219951070 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:12:46.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.802+0000 7fd695fd7640 1 -- 172.21.15.134:0/2219951070 >> v1:172.21.15.104:6789/0 conn(0x55f4fa8edfb0 legacy=0x55f4fa8ee3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.802+0000 7fd695fd7640 1 -- 172.21.15.134:0/2219951070 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4fa7ab590 con 0x55f4fa8f2350 2024-04-24T02:12:46.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.804+0000 7fd695fd7640 1 --2- 172.21.15.134:0/2219951070 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f4fa8f2350 0x55f4fa8f4740 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fd68800a470 tx=0x7fd68801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30a17bcfb109ada9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.805+0000 7fd69dfd7640 1 -- 172.21.15.134:0/2219951070 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd688057070 con 0x55f4fa8f2350 2024-04-24T02:12:46.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.805+0000 7fd69dfd7640 1 -- 172.21.15.134:0/2219951070 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd688052570 con 0x55f4fa8f2350 2024-04-24T02:12:46.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.805+0000 7fd69dfd7640 1 -- 172.21.15.134:0/2219951070 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd688052870 con 0x55f4fa8f2350 2024-04-24T02:12:46.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.805+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2219951070 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f4fa8f2350 msgr2=0x55f4fa8f4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.805+0000 7fd6a2b33800 1 --2- 172.21.15.134:0/2219951070 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f4fa8f2350 0x55f4fa8f4740 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fd68800a470 tx=0x7fd68801ce90 comp rx=0 tx=0).stop 2024-04-24T02:12:46.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.805+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2219951070 shutdown_connections 2024-04-24T02:12:46.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.805+0000 7fd6a2b33800 1 --2- 172.21.15.134:0/2219951070 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f4fa8f2350 0x55f4fa8f4740 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.805+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2219951070 >> 172.21.15.134:0/2219951070 conn(0x55f4fa8e9550 msgr2=0x55f4fa8eb970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:46.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.805+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2219951070 shutdown_connections 2024-04-24T02:12:46.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.805+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2219951070 wait complete. 2024-04-24T02:12:46.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.817+0000 7fd6a2b33800 1 Processor -- start 2024-04-24T02:12:46.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.817+0000 7fd6a2b33800 1 -- start start 2024-04-24T02:12:46.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.817+0000 7fd6a2b33800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f4fa8edfb0 0x55f4fa8639c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.817+0000 7fd6a2b33800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55f4fa8393b0 con 0x55f4fa8edfb0 2024-04-24T02:12:46.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.817+0000 7fd69e7d8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f4fa8edfb0 0x55f4fa8639c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.817+0000 7fd69e7d8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f4fa8edfb0 0x55f4fa8639c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:35898/0 (socket says 172.21.15.134:35898) 2024-04-24T02:12:46.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.817+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2658032413 learned_addr learned my addr 172.21.15.134:0/2658032413 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:46.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.818+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2658032413 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4fa861f80 con 0x55f4fa8edfb0 2024-04-24T02:12:46.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.818+0000 7fd69e7d8640 1 --2- 172.21.15.134:0/2658032413 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f4fa8edfb0 0x55f4fa8639c0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fd690001e10 tx=0x7fd69000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d4a89b47c04818e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.818+0000 7fd58c608640 1 -- 172.21.15.134:0/2658032413 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd690012020 con 0x55f4fa8edfb0 2024-04-24T02:12:46.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.818+0000 7fd58c608640 1 -- 172.21.15.134:0/2658032413 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd69000e5a0 con 0x55f4fa8edfb0 2024-04-24T02:12:46.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.818+0000 7fd58c608640 1 -- 172.21.15.134:0/2658032413 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd69000e8e0 con 0x55f4fa8edfb0 2024-04-24T02:12:46.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.819+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2658032413 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f4fa8edfb0 msgr2=0x55f4fa8639c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.819+0000 7fd6a2b33800 1 --2- 172.21.15.134:0/2658032413 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f4fa8edfb0 0x55f4fa8639c0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fd690001e10 tx=0x7fd69000b780 comp rx=0 tx=0).stop 2024-04-24T02:12:46.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.819+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2658032413 shutdown_connections 2024-04-24T02:12:46.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.819+0000 7fd6a2b33800 1 --2- 172.21.15.134:0/2658032413 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f4fa8edfb0 0x55f4fa8639c0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.819+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2658032413 >> 172.21.15.134:0/2658032413 conn(0x55f4fa8e9550 msgr2=0x55f4fa9daa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:46.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.819+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2658032413 shutdown_connections 2024-04-24T02:12:46.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.819+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2658032413 wait complete. 2024-04-24T02:12:46.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.819+0000 7fd6a2b33800 1 Processor -- start 2024-04-24T02:12:46.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.819+0000 7fd6a2b33800 1 -- start start 2024-04-24T02:12:46.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.819+0000 7fd6a2b33800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f4fa8edfb0 0x55f4fa9e8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.819+0000 7fd6a2b33800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55f4fa8f5010 con 0x55f4fa8edfb0 2024-04-24T02:12:46.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.819+0000 7fd69e7d8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f4fa8edfb0 0x55f4fa9e8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.819+0000 7fd69e7d8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f4fa8edfb0 0x55f4fa9e8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:35906/0 (socket says 172.21.15.134:35906) 2024-04-24T02:12:46.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.819+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2831448561 learned_addr learned my addr 172.21.15.134:0/2831448561 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:46.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.820+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2831448561 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4fa9e9400 con 0x55f4fa8edfb0 2024-04-24T02:12:46.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.820+0000 7fd69e7d8640 1 --2- 172.21.15.134:0/2831448561 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f4fa8edfb0 0x55f4fa9e8ec0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fd69000b7c0 tx=0x7fd690000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.820+0000 7fd58ae05640 1 -- 172.21.15.134:0/2831448561 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd690012030 con 0x55f4fa8edfb0 2024-04-24T02:12:46.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.820+0000 7fd58ae05640 1 -- 172.21.15.134:0/2831448561 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd690001470 con 0x55f4fa8edfb0 2024-04-24T02:12:46.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.820+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2831448561 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f4fa9e9690 con 0x55f4fa8edfb0 2024-04-24T02:12:46.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.820+0000 7fd58ae05640 1 -- 172.21.15.134:0/2831448561 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd69001a8d0 con 0x55f4fa8edfb0 2024-04-24T02:12:46.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.820+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2831448561 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4fa9ec2f0 con 0x55f4fa8edfb0 2024-04-24T02:12:46.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.821+0000 7fd58ae05640 1 -- 172.21.15.134:0/2831448561 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd690015020 con 0x55f4fa8edfb0 2024-04-24T02:12:46.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.821+0000 7fd58ae05640 1 --2- 172.21.15.134:0/2831448561 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd584036950 0x7fd584038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.821+0000 7fd58ae05640 1 -- 172.21.15.134:0/2831448561 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fd690020030 con 0x55f4fa8edfb0 2024-04-24T02:12:46.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.821+0000 7fd695fd7640 1 --2- 172.21.15.134:0/2831448561 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd584036950 0x7fd584038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.821+0000 7fd6a2b33800 1 --2- 172.21.15.134:0/2831448561 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f4fa8f2350 0x55f4fa9f00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.821+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2831448561 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4fa9f0630 con 0x55f4fa8f2350 2024-04-24T02:12:46.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.821+0000 7fd69efd9640 1 --2- 172.21.15.134:0/2831448561 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f4fa8f2350 0x55f4fa9f00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.821+0000 7fd695fd7640 1 --2- 172.21.15.134:0/2831448561 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd584036950 0x7fd584038e10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd688054000 tx=0x7fd68804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.822+0000 7fd69efd9640 1 --2- 172.21.15.134:0/2831448561 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f4fa8f2350 0x55f4fa9f00b0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.822+0000 7fd69efd9640 1 -- 172.21.15.134:0/2831448561 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd69800a4a0 con 0x55f4fa8f2350 2024-04-24T02:12:46.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.822+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2831448561 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4fa9ed660 con 0x55f4fa8f2350 2024-04-24T02:12:46.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.822+0000 7fd69efd9640 1 -- 172.21.15.134:0/2831448561 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd69800a4a0 con 0x55f4fa8f2350 2024-04-24T02:12:46.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.822+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2831448561 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4fa9f2430 con 0x55f4fa8f2350 2024-04-24T02:12:46.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.822+0000 7fd69efd9640 1 -- 172.21.15.134:0/2831448561 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd69800a4a0 con 0x55f4fa8f2350 2024-04-24T02:12:46.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.822+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2831448561 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4fa9f1770 con 0x55f4fa8f2350 2024-04-24T02:12:46.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.823+0000 7fd69efd9640 1 -- 172.21.15.134:0/2831448561 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd69800a4a0 con 0x55f4fa8f2350 2024-04-24T02:12:46.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.823+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2831448561 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4fa9f1bc0 con 0x55f4fa8f2350 2024-04-24T02:12:46.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.823+0000 7fd69efd9640 1 -- 172.21.15.134:0/2831448561 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd69800a4a0 con 0x55f4fa8f2350 2024-04-24T02:12:46.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.823+0000 7fd6a2b33800 1 Processor -- start 2024-04-24T02:12:46.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.823+0000 7fd6a2b33800 1 -- start start 2024-04-24T02:12:46.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.823+0000 7fd6a2b33800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f4faa01220 0x55f4faa01640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.823+0000 7fd6a2b33800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55f4fa7df6b0 con 0x55f4faa01220 2024-04-24T02:12:46.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.824+0000 7fd695fd7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f4faa01220 0x55f4faa01640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.824+0000 7fd695fd7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f4faa01220 0x55f4faa01640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:35922/0 (socket says 172.21.15.134:35922) 2024-04-24T02:12:46.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.824+0000 7fd695fd7640 1 -- 172.21.15.134:0/2032061196 learned_addr learned my addr 172.21.15.134:0/2032061196 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:46.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.824+0000 7fd695fd7640 1 -- 172.21.15.134:0/2032061196 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4faa01b80 con 0x55f4faa01220 2024-04-24T02:12:46.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.824+0000 7fd695fd7640 1 --2- 172.21.15.134:0/2032061196 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f4faa01220 0x55f4faa01640 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fd688044840 tx=0x7fd688002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.824+0000 7fd583fff640 1 -- 172.21.15.134:0/2032061196 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd68806f070 con 0x55f4faa01220 2024-04-24T02:12:46.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.824+0000 7fd583fff640 1 -- 172.21.15.134:0/2032061196 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd688058040 con 0x55f4faa01220 2024-04-24T02:12:46.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.824+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2032061196 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f4faa025f0 con 0x55f4faa01220 2024-04-24T02:12:46.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.824+0000 7fd583fff640 1 -- 172.21.15.134:0/2032061196 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd688057050 con 0x55f4faa01220 2024-04-24T02:12:46.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.824+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2032061196 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4faa02a90 con 0x55f4faa01220 2024-04-24T02:12:46.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.825+0000 7fd583fff640 1 -- 172.21.15.134:0/2032061196 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd688072070 con 0x55f4faa01220 2024-04-24T02:12:46.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.825+0000 7fd583fff640 1 --2- 172.21.15.134:0/2032061196 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd578036900 0x7fd578038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.825+0000 7fd583fff640 1 -- 172.21.15.134:0/2032061196 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fd68808f9c0 con 0x55f4faa01220 2024-04-24T02:12:46.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.825+0000 7fd69efd9640 1 --2- 172.21.15.134:0/2032061196 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd578036900 0x7fd578038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.826+0000 7fd6a2b33800 1 Processor -- start 2024-04-24T02:12:46.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.826+0000 7fd69efd9640 1 --2- 172.21.15.134:0/2032061196 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd578036900 0x7fd578038dc0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x55f4fa9f1290 tx=0x7fd698005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.826+0000 7fd6a2b33800 1 -- start start 2024-04-24T02:12:46.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.826+0000 7fd6a2b33800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f4faa0e4c0 0x55f4faa0e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.826+0000 7fd6a2b33800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55f4fa862300 con 0x55f4faa0e4c0 2024-04-24T02:12:46.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.826+0000 7fd695fd7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f4faa0e4c0 0x55f4faa0e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.826+0000 7fd695fd7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f4faa0e4c0 0x55f4faa0e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:35936/0 (socket says 172.21.15.134:35936) 2024-04-24T02:12:46.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.826+0000 7fd695fd7640 1 -- 172.21.15.134:0/836497998 learned_addr learned my addr 172.21.15.134:0/836497998 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:46.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.826+0000 7fd695fd7640 1 -- 172.21.15.134:0/836497998 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4faa0eeb0 con 0x55f4faa0e4c0 2024-04-24T02:12:46.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.827+0000 7fd695fd7640 1 --2- 172.21.15.134:0/836497998 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f4faa0e4c0 0x55f4faa0e8e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fd68808dda0 tx=0x7fd68808e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92f112c2d64b97a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.827+0000 7fd581ffb640 1 -- 172.21.15.134:0/836497998 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd688087070 con 0x55f4faa0e4c0 2024-04-24T02:12:46.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.827+0000 7fd581ffb640 1 -- 172.21.15.134:0/836497998 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd68805e480 con 0x55f4faa0e4c0 2024-04-24T02:12:46.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.827+0000 7fd581ffb640 1 -- 172.21.15.134:0/836497998 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd688072360 con 0x55f4faa0e4c0 2024-04-24T02:12:46.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.827+0000 7fd6a2b33800 1 -- 172.21.15.134:0/836497998 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f4faa0e4c0 msgr2=0x55f4faa0e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.827+0000 7fd6a2b33800 1 --2- 172.21.15.134:0/836497998 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f4faa0e4c0 0x55f4faa0e8e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fd68808dda0 tx=0x7fd68808e050 comp rx=0 tx=0).stop 2024-04-24T02:12:46.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.827+0000 7fd6a2b33800 1 -- 172.21.15.134:0/836497998 shutdown_connections 2024-04-24T02:12:46.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.827+0000 7fd6a2b33800 1 --2- 172.21.15.134:0/836497998 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f4faa0e4c0 0x55f4faa0e8e0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.827+0000 7fd6a2b33800 1 -- 172.21.15.134:0/836497998 >> 172.21.15.134:0/836497998 conn(0x55f4faa0a820 msgr2=0x55f4faa08880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:46.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.827+0000 7fd6a2b33800 1 -- 172.21.15.134:0/836497998 shutdown_connections 2024-04-24T02:12:46.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.827+0000 7fd6a2b33800 1 -- 172.21.15.134:0/836497998 wait complete. 2024-04-24T02:12:46.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.827+0000 7fd6a2b33800 1 Processor -- start 2024-04-24T02:12:46.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.827+0000 7fd6a2b33800 1 -- start start 2024-04-24T02:12:46.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.828+0000 7fd6a2b33800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f4faa0e4c0 0x55f4faa15b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.828+0000 7fd6a2b33800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55f4faa0f620 con 0x55f4faa0e4c0 2024-04-24T02:12:46.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.828+0000 7fd695fd7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f4faa0e4c0 0x55f4faa15b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.828+0000 7fd695fd7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f4faa0e4c0 0x55f4faa15b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:35946/0 (socket says 172.21.15.134:35946) 2024-04-24T02:12:46.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.828+0000 7fd695fd7640 1 -- 172.21.15.134:0/2788865790 learned_addr learned my addr 172.21.15.134:0/2788865790 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:46.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.828+0000 7fd695fd7640 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4faa160c0 con 0x55f4faa0e4c0 2024-04-24T02:12:46.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.828+0000 7fd695fd7640 1 --2- 172.21.15.134:0/2788865790 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f4faa0e4c0 0x55f4faa15b80 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fd68808ccc0 tx=0x7fd68808dd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.828+0000 7fd56ffff640 1 -- 172.21.15.134:0/2788865790 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd688087030 con 0x55f4faa0e4c0 2024-04-24T02:12:46.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.828+0000 7fd56ffff640 1 -- 172.21.15.134:0/2788865790 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd68805fd50 con 0x55f4faa0e4c0 2024-04-24T02:12:46.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.828+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f4faa16350 con 0x55f4faa0e4c0 2024-04-24T02:12:46.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.828+0000 7fd56ffff640 1 -- 172.21.15.134:0/2788865790 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd688072810 con 0x55f4faa0e4c0 2024-04-24T02:12:46.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.828+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4faa19000 con 0x55f4faa0e4c0 2024-04-24T02:12:46.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.829+0000 7fd56ffff640 1 -- 172.21.15.134:0/2788865790 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd6880693a0 con 0x55f4faa0e4c0 2024-04-24T02:12:46.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.829+0000 7fd56ffff640 1 --2- 172.21.15.134:0/2788865790 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd568036950 0x7fd568038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.829+0000 7fd56ffff640 1 -- 172.21.15.134:0/2788865790 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fd688088070 con 0x55f4faa0e4c0 2024-04-24T02:12:46.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.829+0000 7fd69efd9640 1 --2- 172.21.15.134:0/2788865790 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd568036950 0x7fd568038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.830+0000 7fd69efd9640 1 --2- 172.21.15.134:0/2788865790 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd568036950 0x7fd568038e10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x55f4fa9ed5d0 tx=0x7fd69801f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.830+0000 7fd6a2b33800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.830+0000 7fd6a2b33800 1 --2- 172.21.15.134:0/2788865790 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f4faa21610 0x55f4faa23ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.830+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa24220 con 0x55f4faa21610 2024-04-24T02:12:46.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.830+0000 7fd69e7d8640 1 --2- 172.21.15.134:0/2788865790 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f4faa21610 0x55f4faa23ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.830+0000 7fd69e7d8640 1 --2- 172.21.15.134:0/2788865790 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f4faa21610 0x55f4faa23ad0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.830+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd69002dcf0 con 0x55f4faa21610 2024-04-24T02:12:46.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.830+0000 7fd6a2b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:46.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.830+0000 7fd6a2b33800 20 realm 2024-04-24T02:12:46.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.830+0000 7fd6a2b33800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.830+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa24630 con 0x55f4faa21610 2024-04-24T02:12:46.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.831+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd690018950 con 0x55f4faa21610 2024-04-24T02:12:46.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.831+0000 7fd6a2b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:46.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.831+0000 7fd6a2b33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:46.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.831+0000 7fd6a2b33800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.831+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa24f00 con 0x55f4faa21610 2024-04-24T02:12:46.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.831+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd690018950 con 0x55f4faa21610 2024-04-24T02:12:46.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.831+0000 7fd6a2b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:46.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.831+0000 7fd6a2b33800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.831+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa252a0 con 0x55f4faa21610 2024-04-24T02:12:46.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.831+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd690018950 con 0x55f4faa21610 2024-04-24T02:12:46.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.831+0000 7fd6a2b33800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:46.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.831+0000 7fd6a2b33800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.831+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa25af0 con 0x55f4faa21610 2024-04-24T02:12:46.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.831+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd690018950 con 0x55f4faa21610 2024-04-24T02:12:46.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.831+0000 7fd6a2b33800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:46.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.831+0000 7fd6a2b33800 20 searching for the correct realm 2024-04-24T02:12:46.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.831+0000 7fd6a2b33800 1 --2- 172.21.15.134:0/2788865790 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55f4faa27860 0x55f4faa29c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.831+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2a230 con 0x55f4faa27860 2024-04-24T02:12:46.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.832+0000 7fd695fd7640 1 --2- 172.21.15.134:0/2788865790 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55f4faa27860 0x55f4faa29c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.832+0000 7fd695fd7640 1 --2- 172.21.15.134:0/2788865790 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55f4faa27860 0x55f4faa29c50 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.832+0000 7fd695fd7640 1 -- 172.21.15.134:0/2788865790 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd688071030 con 0x55f4faa27860 2024-04-24T02:12:46.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.832+0000 7fd695fd7640 1 --2- 172.21.15.134:0/2788865790 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fd688082070 0x7fd68805c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.832+0000 7fd695fd7640 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2a230 con 0x7fd688082070 2024-04-24T02:12:46.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.832+0000 7fd69efd9640 1 --2- 172.21.15.134:0/2788865790 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fd688082070 0x7fd68805c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.833+0000 7fd69efd9640 1 --2- 172.21.15.134:0/2788865790 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fd688082070 0x7fd68805c5b0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.833+0000 7fd69efd9640 1 -- 172.21.15.134:0/2788865790 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd69801f070 con 0x7fd688082070 2024-04-24T02:12:46.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.833+0000 7fd69efd9640 1 --2- 172.21.15.134:0/2788865790 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fd698031040 0x7fd698032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.833+0000 7fd69efd9640 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2a230 con 0x7fd698031040 2024-04-24T02:12:46.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.833+0000 7fd69e7d8640 1 --2- 172.21.15.134:0/2788865790 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fd698031040 0x7fd698032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.834+0000 7fd69e7d8640 1 --2- 172.21.15.134:0/2788865790 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fd698031040 0x7fd698032940 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.834+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd690018950 con 0x7fd698031040 2024-04-24T02:12:46.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.834+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2a230 con 0x55f4faa21610 2024-04-24T02:12:46.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.834+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd690018950 con 0x55f4faa21610 2024-04-24T02:12:46.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.834+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2a230 con 0x55f4faa21610 2024-04-24T02:12:46.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.834+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd690018950 con 0x55f4faa21610 2024-04-24T02:12:46.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.834+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2a230 con 0x7fd698031040 2024-04-24T02:12:46.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.835+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd690018950 con 0x7fd698031040 2024-04-24T02:12:46.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.835+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2a230 con 0x7fd688082070 2024-04-24T02:12:46.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.835+0000 7fd69efd9640 1 -- 172.21.15.134:0/2788865790 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd69801f070 con 0x7fd688082070 2024-04-24T02:12:46.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.835+0000 7fd69efd9640 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2a230 con 0x7fd688082070 2024-04-24T02:12:46.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.835+0000 7fd69efd9640 1 -- 172.21.15.134:0/2788865790 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd69801f070 con 0x7fd688082070 2024-04-24T02:12:46.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.835+0000 7fd69efd9640 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2a230 con 0x55f4faa27860 2024-04-24T02:12:46.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.835+0000 7fd695fd7640 1 -- 172.21.15.134:0/2788865790 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd688071030 con 0x55f4faa27860 2024-04-24T02:12:46.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.835+0000 7fd695fd7640 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2a230 con 0x55f4faa21610 2024-04-24T02:12:46.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.835+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd690018950 con 0x55f4faa21610 2024-04-24T02:12:46.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.835+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2a230 con 0x7fd698031040 2024-04-24T02:12:46.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.836+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd690018950 con 0x7fd698031040 2024-04-24T02:12:46.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.836+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2a230 con 0x55f4faa21610 2024-04-24T02:12:46.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.836+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd690054040 con 0x55f4faa21610 2024-04-24T02:12:46.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.836+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2a230 con 0x7fd688082070 2024-04-24T02:12:46.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.836+0000 7fd69efd9640 1 -- 172.21.15.134:0/2788865790 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd69801f070 con 0x7fd688082070 2024-04-24T02:12:46.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.836+0000 7fd69efd9640 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2a230 con 0x55f4faa27860 2024-04-24T02:12:46.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.836+0000 7fd695fd7640 1 -- 172.21.15.134:0/2788865790 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd688071030 con 0x55f4faa27860 2024-04-24T02:12:46.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.836+0000 7fd695fd7640 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2a230 con 0x55f4faa27860 2024-04-24T02:12:46.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.837+0000 7fd695fd7640 1 -- 172.21.15.134:0/2788865790 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd688071030 con 0x55f4faa27860 2024-04-24T02:12:46.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.837+0000 7fd695fd7640 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2a230 con 0x7fd688082070 2024-04-24T02:12:46.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.837+0000 7fd69efd9640 1 -- 172.21.15.134:0/2788865790 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd69801f070 con 0x7fd688082070 2024-04-24T02:12:46.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.837+0000 7fd69efd9640 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2a230 con 0x55f4faa27860 2024-04-24T02:12:46.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.837+0000 7fd695fd7640 1 -- 172.21.15.134:0/2788865790 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd688071030 con 0x55f4faa27860 2024-04-24T02:12:46.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.837+0000 7fd695fd7640 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2a230 con 0x55f4faa27860 2024-04-24T02:12:46.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.837+0000 7fd695fd7640 1 -- 172.21.15.134:0/2788865790 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd688071030 con 0x55f4faa27860 2024-04-24T02:12:46.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.837+0000 7fd695fd7640 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2a230 con 0x55f4faa21610 2024-04-24T02:12:46.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.838+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd690054040 con 0x55f4faa21610 2024-04-24T02:12:46.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.838+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2a230 con 0x55f4faa21610 2024-04-24T02:12:46.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.838+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fd690054040 con 0x55f4faa21610 2024-04-24T02:12:46.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.838+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2a230 con 0x7fd698031040 2024-04-24T02:12:46.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.838+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd690054040 con 0x7fd698031040 2024-04-24T02:12:46.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.838+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2a230 con 0x55f4faa27860 2024-04-24T02:12:46.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.838+0000 7fd695fd7640 1 -- 172.21.15.134:0/2788865790 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd688071030 con 0x55f4faa27860 2024-04-24T02:12:46.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.838+0000 7fd695fd7640 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2a230 con 0x7fd688082070 2024-04-24T02:12:46.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.839+0000 7fd69efd9640 1 -- 172.21.15.134:0/2788865790 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd69801f070 con 0x7fd688082070 2024-04-24T02:12:46.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.839+0000 7fd69efd9640 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2a230 con 0x55f4faa21610 2024-04-24T02:12:46.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.839+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd690054040 con 0x55f4faa21610 2024-04-24T02:12:46.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.839+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2a230 con 0x7fd698031040 2024-04-24T02:12:46.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.839+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd690054040 con 0x7fd698031040 2024-04-24T02:12:46.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.839+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2a230 con 0x55f4faa27860 2024-04-24T02:12:46.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.839+0000 7fd695fd7640 1 -- 172.21.15.134:0/2788865790 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd688071030 con 0x55f4faa27860 2024-04-24T02:12:46.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.839+0000 7fd695fd7640 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2a230 con 0x7fd698031040 2024-04-24T02:12:46.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.840+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd690054040 con 0x7fd698031040 2024-04-24T02:12:46.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.840+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2a230 con 0x7fd688082070 2024-04-24T02:12:46.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.840+0000 7fd69efd9640 1 -- 172.21.15.134:0/2788865790 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd698040040 con 0x7fd688082070 2024-04-24T02:12:46.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.840+0000 7fd69efd9640 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2a230 con 0x55f4faa27860 2024-04-24T02:12:46.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.840+0000 7fd695fd7640 1 -- 172.21.15.134:0/2788865790 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd688071030 con 0x55f4faa27860 2024-04-24T02:12:46.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.840+0000 7fd695fd7640 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2a230 con 0x7fd688082070 2024-04-24T02:12:46.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.840+0000 7fd69efd9640 1 -- 172.21.15.134:0/2788865790 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd698040040 con 0x7fd688082070 2024-04-24T02:12:46.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.840+0000 7fd69efd9640 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2a230 con 0x55f4faa21610 2024-04-24T02:12:46.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.841+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd690054040 con 0x55f4faa21610 2024-04-24T02:12:46.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.841+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2a230 con 0x7fd688082070 2024-04-24T02:12:46.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.841+0000 7fd69efd9640 1 -- 172.21.15.134:0/2788865790 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd698040040 con 0x7fd688082070 2024-04-24T02:12:46.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.841+0000 7fd6a2b33800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:46.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.841+0000 7fd6a2b33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:46.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.841+0000 7fd6a2b33800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:46.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.841+0000 7fd6a2b33800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:46.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.841+0000 7fd6a2b33800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:46.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.841+0000 7fd6a2b33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:46.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.841+0000 7fd6a2b33800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.841+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa26470 con 0x55f4faa21610 2024-04-24T02:12:46.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.841+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd690054040 con 0x55f4faa21610 2024-04-24T02:12:46.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.841+0000 7fd6a2b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:46.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.841+0000 7fd6a2b33800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.841+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa26d10 con 0x55f4faa21610 2024-04-24T02:12:46.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.841+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd690054040 con 0x55f4faa21610 2024-04-24T02:12:46.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.841+0000 7fd6a2b33800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:46.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.841+0000 7fd6a2b33800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.841+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2a6b0 con 0x55f4faa21610 2024-04-24T02:12:46.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.842+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd690054040 con 0x55f4faa21610 2024-04-24T02:12:46.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.842+0000 7fd6a2b33800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:46.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.842+0000 7fd6a2b33800 20 zone default found 2024-04-24T02:12:46.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.842+0000 7fd6a2b33800 4 Realm: () 2024-04-24T02:12:46.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.842+0000 7fd6a2b33800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:46.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.842+0000 7fd6a2b33800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:46.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.842+0000 7fd6a2b33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:46.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.842+0000 7fd6a2b33800 20 zonegroup default 2024-04-24T02:12:46.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.842+0000 7fd6a2b33800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.842+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa26970 con 0x7fd698031040 2024-04-24T02:12:46.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.842+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd690054040 con 0x7fd698031040 2024-04-24T02:12:46.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.842+0000 7fd6a2b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:46.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.842+0000 7fd6a2b33800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.842+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2c5c0 con 0x55f4faa27860 2024-04-24T02:12:46.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.842+0000 7fd695fd7640 1 -- 172.21.15.134:0/2788865790 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd688071030 con 0x55f4faa27860 2024-04-24T02:12:46.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.842+0000 7fd6a2b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:46.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.842+0000 7fd6a2b33800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.842+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2c9d0 con 0x55f4faa27860 2024-04-24T02:12:46.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.842+0000 7fd695fd7640 1 -- 172.21.15.134:0/2788865790 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd688071030 con 0x55f4faa27860 2024-04-24T02:12:46.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.843+0000 7fd6a2b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:46.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.843+0000 7fd6a2b33800 20 started sync module instance, tier type = 2024-04-24T02:12:46.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.843+0000 7fd6a2b33800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:46.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.843+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2ba60 con 0x7fd688082070 2024-04-24T02:12:46.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.844+0000 7fd69efd9640 1 -- 172.21.15.134:0/2788865790 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(44 notify.0 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd698040040 con 0x7fd688082070 2024-04-24T02:12:46.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.844+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94510665350736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2d2e0 con 0x7fd688082070 2024-04-24T02:12:46.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.844+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2db30 con 0x55f4faa21610 2024-04-24T02:12:46.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.845+0000 7fd69efd9640 1 -- 172.21.15.134:0/2788865790 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94510665350736] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd698040040 con 0x7fd688082070 2024-04-24T02:12:46.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.845+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd690054040 con 0x55f4faa21610 2024-04-24T02:12:46.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.845+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94510665354800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2d760 con 0x55f4faa21610 2024-04-24T02:12:46.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.845+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2e250 con 0x55f4faa27860 2024-04-24T02:12:46.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.846+0000 7fd695fd7640 1 -- 172.21.15.134:0/2788865790 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd688071030 con 0x55f4faa27860 2024-04-24T02:12:46.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.846+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94510665358624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2eb20 con 0x55f4faa27860 2024-04-24T02:12:46.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.846+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2f5a0 con 0x7fd688082070 2024-04-24T02:12:46.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.846+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94510665354800] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd690054040 con 0x55f4faa21610 2024-04-24T02:12:46.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.847+0000 7fd695fd7640 1 -- 172.21.15.134:0/2788865790 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94510665358624] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd688071030 con 0x55f4faa27860 2024-04-24T02:12:46.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.847+0000 7fd69efd9640 1 -- 172.21.15.134:0/2788865790 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(50 notify.3 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd698040040 con 0x7fd688082070 2024-04-24T02:12:46.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.847+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94510665361008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2d250 con 0x7fd688082070 2024-04-24T02:12:46.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.847+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2fe70 con 0x55f4faa21610 2024-04-24T02:12:46.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.848+0000 7fd69efd9640 1 -- 172.21.15.134:0/2788865790 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94510665361008] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd698040040 con 0x7fd688082070 2024-04-24T02:12:46.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.848+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd690054040 con 0x55f4faa21610 2024-04-24T02:12:46.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.848+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94510665363600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2fe70 con 0x55f4faa21610 2024-04-24T02:12:46.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.848+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa30930 con 0x7fd698031040 2024-04-24T02:12:46.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.849+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(54 notify.5 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd690054040 con 0x7fd698031040 2024-04-24T02:12:46.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.849+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94510665368576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa308f0 con 0x7fd698031040 2024-04-24T02:12:46.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.849+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa31890 con 0x7fd698031040 2024-04-24T02:12:46.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.849+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94510665363600] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd690054040 con 0x55f4faa21610 2024-04-24T02:12:46.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.850+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94510665368576] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd690054040 con 0x7fd698031040 2024-04-24T02:12:46.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.850+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(56 notify.6 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd690054040 con 0x7fd698031040 2024-04-24T02:12:46.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.850+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94510665372576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa31890 con 0x7fd698031040 2024-04-24T02:12:46.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.850+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa31cf0 con 0x7fd698031040 2024-04-24T02:12:46.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.851+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(58 notify.7 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd690054040 con 0x7fd698031040 2024-04-24T02:12:46.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.851+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94510665372576] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd690054040 con 0x7fd698031040 2024-04-24T02:12:46.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.851+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94510665370832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa31cb0 con 0x7fd698031040 2024-04-24T02:12:46.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.851+0000 7fd6a2b33800 20 add_watcher() i=0 2024-04-24T02:12:46.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.851+0000 7fd6a2b33800 20 add_watcher() i=1 2024-04-24T02:12:46.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.851+0000 7fd6a2b33800 20 add_watcher() i=2 2024-04-24T02:12:46.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.851+0000 7fd6a2b33800 20 add_watcher() i=3 2024-04-24T02:12:46.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.851+0000 7fd6a2b33800 20 add_watcher() i=4 2024-04-24T02:12:46.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.851+0000 7fd6a2b33800 20 add_watcher() i=5 2024-04-24T02:12:46.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.851+0000 7fd6a2b33800 20 add_watcher() i=6 2024-04-24T02:12:46.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.852+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94510665370832] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd690054040 con 0x7fd698031040 2024-04-24T02:12:46.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.852+0000 7fd6a2b33800 20 add_watcher() i=7 2024-04-24T02:12:46.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.852+0000 7fd6a2b33800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:46.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.852+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2fa20 con 0x55f4faa21610 2024-04-24T02:12:46.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.853+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd690054040 con 0x55f4faa21610 2024-04-24T02:12:46.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.853+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94510665366048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa32650 con 0x55f4faa21610 2024-04-24T02:12:46.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.854+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94510665366048] v32'196 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd690054040 con 0x55f4faa21610 2024-04-24T02:12:46.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.854+0000 7fd554fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:46.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.854+0000 7fd6a2b33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:46.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.854+0000 7fd6a2b33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:46.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.854+0000 7fd6a2b33800 5 note: GC not initialized 2024-04-24T02:12:46.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.854+0000 7fd4cf7fe640 20 reqs_thread_entry: start 2024-04-24T02:12:46.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.854+0000 7fd6a2b33800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:46.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.854+0000 7fd6a2b33800 20 Filter name: none 2024-04-24T02:12:46.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.854+0000 7fd4cd7fa640 20 reqs_thread_entry: start 2024-04-24T02:12:46.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.854+0000 7fd6a2b33800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T02:12:46.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.854+0000 7fd6a2b33800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.855+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa68490 con 0x55f4faa21610 2024-04-24T02:12:46.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.855+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 foo [call out=48b,read 0~403 out=403b,getxattrs out=75b] v0'0 uv14 ondisk = 0) ==== 231+0+526 (crc 0 0 0) 0x7fd690054040 con 0x55f4faa21610 2024-04-24T02:12:46.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.855+0000 7fd6a2b33800 20 rados_obj.operate() r=0 bl.length=403 2024-04-24T02:12:46.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.855+0000 7fd6a2b33800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T02:12:46.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.855+0000 7fd6a2b33800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:46.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.855+0000 7fd6a2b33800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:12:46.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.855+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa6e680 con 0x55f4faa21610 2024-04-24T02:12:46.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.856+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v32'15 uv15 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fd690054040 con 0x55f4faa21610 2024-04-24T02:12:46.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.856+0000 7fd6a2b33800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T02:12:46.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.856+0000 7fd6a2b33800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:46.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.856+0000 7fd6a2b33800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-24T02:12:46.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.856+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94510665621744 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa69f10 con 0x55f4faa21610 2024-04-24T02:12:46.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.856+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== watch-notify(notify (1) cookie 94510665363600 notify 137438953489 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7fd690060040 con 0x55f4faa21610 2024-04-24T02:12:46.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.856+0000 7fd581ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953489 cookie 94510665363600 notifier 4655 bl.length()=567 2024-04-24T02:12:46.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.856+0000 7fd581ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T02:12:46.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.856+0000 7fd581ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:46.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.856+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(64 notify.4 [notify cookie 94510665621744 out=8b] v0'0 uv183 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd690054040 con 0x55f4faa21610 2024-04-24T02:12:46.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.856+0000 7fd581ffb640 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fd564003ea0 con 0x55f4faa21610 2024-04-24T02:12:46.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.857+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== watch-notify(notify_complete (2) cookie 94510665621744 notify 137438953489 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f4fa9ec2f0 con 0x55f4faa21610 2024-04-24T02:12:46.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.857+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd690054040 con 0x55f4faa21610 2024-04-24T02:12:46.871 INFO:teuthology.orchestra.run.smithi134.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T02:12:21.778798Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T02:12:21.778786Z","tags":[],"group_ids":[]} 2024-04-24T02:12:46.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.858+0000 7fd554fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:46.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.858+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94510665366048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa6d8e0 con 0x55f4faa21610 2024-04-24T02:12:46.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.859+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94510665366048] v32'197 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd690054040 con 0x55f4faa21610 2024-04-24T02:12:46.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.859+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94510665350736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa6d8e0 con 0x7fd688082070 2024-04-24T02:12:46.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.860+0000 7fd69efd9640 1 -- 172.21.15.134:0/2788865790 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94510665350736] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd698040040 con 0x7fd688082070 2024-04-24T02:12:46.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.860+0000 7fd6a2b33800 20 remove_watcher() i=0 2024-04-24T02:12:46.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.860+0000 7fd6a2b33800 2 removed watcher, disabling cache 2024-04-24T02:12:46.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.860+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94510665354800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2be50 con 0x55f4faa21610 2024-04-24T02:12:46.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.861+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 <== osd.1 v2:172.21.15.134:6804/1487076214 30 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94510665354800] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd690054040 con 0x55f4faa21610 2024-04-24T02:12:46.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.861+0000 7fd6a2b33800 20 remove_watcher() i=1 2024-04-24T02:12:46.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.861+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94510665358624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2ce30 con 0x55f4faa27860 2024-04-24T02:12:46.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.862+0000 7fd695fd7640 1 -- 172.21.15.134:0/2788865790 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94510665358624] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd688071030 con 0x55f4faa27860 2024-04-24T02:12:46.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.862+0000 7fd6a2b33800 20 remove_watcher() i=2 2024-04-24T02:12:46.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.862+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94510665361008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2dd20 con 0x7fd688082070 2024-04-24T02:12:46.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.863+0000 7fd69efd9640 1 -- 172.21.15.134:0/2788865790 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94510665361008] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd698040040 con 0x7fd688082070 2024-04-24T02:12:46.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.863+0000 7fd6a2b33800 20 remove_watcher() i=3 2024-04-24T02:12:46.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.863+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94510665363600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2dd20 con 0x55f4faa21610 2024-04-24T02:12:46.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.864+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 <== osd.1 v2:172.21.15.134:6804/1487076214 31 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94510665363600] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd690054040 con 0x55f4faa21610 2024-04-24T02:12:46.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.864+0000 7fd6a2b33800 20 remove_watcher() i=4 2024-04-24T02:12:46.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.864+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94510665368576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2dd20 con 0x7fd698031040 2024-04-24T02:12:46.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.865+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94510665368576] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd690054040 con 0x7fd698031040 2024-04-24T02:12:46.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.865+0000 7fd6a2b33800 20 remove_watcher() i=5 2024-04-24T02:12:46.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.865+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94510665372576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2dd20 con 0x7fd698031040 2024-04-24T02:12:46.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.866+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94510665372576] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd690054040 con 0x7fd698031040 2024-04-24T02:12:46.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.866+0000 7fd6a2b33800 20 remove_watcher() i=6 2024-04-24T02:12:46.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.866+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94510665370832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4faa2dd20 con 0x7fd698031040 2024-04-24T02:12:46.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.867+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94510665370832] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd690054040 con 0x7fd698031040 2024-04-24T02:12:46.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.867+0000 7fd6a2b33800 20 remove_watcher() i=7 2024-04-24T02:12:46.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.867+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fd698031040 msgr2=0x7fd698032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.867+0000 7fd6a2b33800 1 --2- 172.21.15.134:0/2788865790 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fd698031040 0x7fd698032940 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.867+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f4faa21610 msgr2=0x55f4faa23ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.867+0000 7fd6a2b33800 1 --2- 172.21.15.134:0/2788865790 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f4faa21610 0x55f4faa23ad0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.867+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fd688082070 msgr2=0x7fd68805c5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.867+0000 7fd6a2b33800 1 --2- 172.21.15.134:0/2788865790 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fd688082070 0x7fd68805c5b0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.867+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55f4faa27860 msgr2=0x55f4faa29c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.867+0000 7fd6a2b33800 1 --2- 172.21.15.134:0/2788865790 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55f4faa27860 0x55f4faa29c50 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.867+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd568036950 msgr2=0x7fd568038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.867+0000 7fd6a2b33800 1 --2- 172.21.15.134:0/2788865790 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd568036950 0x7fd568038e10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x55f4fa9ed5d0 tx=0x7fd69801f000 comp rx=0 tx=0).stop 2024-04-24T02:12:46.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.867+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f4faa0e4c0 msgr2=0x55f4faa15b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.867+0000 7fd6a2b33800 1 --2- 172.21.15.134:0/2788865790 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f4faa0e4c0 0x55f4faa15b80 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fd68808ccc0 tx=0x7fd68808dd30 comp rx=0 tx=0).stop 2024-04-24T02:12:46.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.867+0000 7fd69e7d8640 1 -- 172.21.15.134:0/2788865790 reap_dead start 2024-04-24T02:12:46.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.867+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 shutdown_connections 2024-04-24T02:12:46.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.867+0000 7fd6a2b33800 1 --2- 172.21.15.134:0/2788865790 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f4faa0e4c0 0x55f4faa15b80 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.867+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 >> 172.21.15.134:0/2788865790 conn(0x55f4faa0a820 msgr2=0x55f4faa07ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:46.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.867+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 shutdown_connections 2024-04-24T02:12:46.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.867+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2788865790 wait complete. 2024-04-24T02:12:46.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.868+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2032061196 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd578036900 msgr2=0x7fd578038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.868+0000 7fd6a2b33800 1 --2- 172.21.15.134:0/2032061196 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd578036900 0x7fd578038dc0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x55f4fa9f1290 tx=0x7fd698005840 comp rx=0 tx=0).stop 2024-04-24T02:12:46.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.868+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2032061196 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f4faa01220 msgr2=0x55f4faa01640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.868+0000 7fd6a2b33800 1 --2- 172.21.15.134:0/2032061196 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f4faa01220 0x55f4faa01640 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fd688044840 tx=0x7fd688002fb0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.868+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2032061196 shutdown_connections 2024-04-24T02:12:46.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.868+0000 7fd6a2b33800 1 --2- 172.21.15.134:0/2032061196 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd578036900 0x7fd578038dc0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.868+0000 7fd6a2b33800 1 --2- 172.21.15.134:0/2032061196 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f4faa01220 0x55f4faa01640 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.868+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2032061196 >> 172.21.15.134:0/2032061196 conn(0x55f4fa9f52c0 msgr2=0x55f4fa9f56c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:46.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.868+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2032061196 shutdown_connections 2024-04-24T02:12:46.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.868+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2032061196 wait complete. 2024-04-24T02:12:46.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.868+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2831448561 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f4fa8f2350 msgr2=0x55f4fa9f00b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.868+0000 7fd6a2b33800 1 --2- 172.21.15.134:0/2831448561 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f4fa8f2350 0x55f4fa9f00b0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.868+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2831448561 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd584036950 msgr2=0x7fd584038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.868+0000 7fd6a2b33800 1 --2- 172.21.15.134:0/2831448561 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd584036950 0x7fd584038e10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd688054000 tx=0x7fd68804e000 comp rx=0 tx=0).stop 2024-04-24T02:12:46.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.868+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2831448561 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f4fa8edfb0 msgr2=0x55f4fa9e8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.868+0000 7fd6a2b33800 1 --2- 172.21.15.134:0/2831448561 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f4fa8edfb0 0x55f4fa9e8ec0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fd69000b7c0 tx=0x7fd690000ed0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.868+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2831448561 shutdown_connections 2024-04-24T02:12:46.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.868+0000 7fd6a2b33800 1 --2- 172.21.15.134:0/2831448561 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55f4fa8f2350 0x55f4fa9f00b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.868+0000 7fd6a2b33800 1 --2- 172.21.15.134:0/2831448561 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd584036950 0x7fd584038e10 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.868+0000 7fd6a2b33800 1 --2- 172.21.15.134:0/2831448561 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f4fa8edfb0 0x55f4fa9e8ec0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.868+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2831448561 >> 172.21.15.134:0/2831448561 conn(0x55f4fa8e9550 msgr2=0x55f4fa862860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:46.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.868+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2831448561 shutdown_connections 2024-04-24T02:12:46.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.868+0000 7fd6a2b33800 1 -- 172.21.15.134:0/2831448561 wait complete. 2024-04-24T02:12:46.882 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T02:12:21.778798Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:12:21.778786Z', 'tags': [], 'group_ids': []} 2024-04-24T02:12:46.893 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T02:12:46.893 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-04-24T02:12:46.893 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-04-24T02:12:46.893 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-04-24T02:12:46.936 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:12:46.936 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:12:46.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.935+0000 7f1d8892f800 1 Processor -- start 2024-04-24T02:12:46.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.935+0000 7f1d8892f800 1 -- start start 2024-04-24T02:12:46.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.935+0000 7f1d8892f800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55b8206101b0 0x55b8206125a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.935+0000 7f1d8892f800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b8204cbd40 con 0x55b82060bd20 2024-04-24T02:12:46.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.935+0000 7f1d8892f800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55b82049e4d0 con 0x55b8206101b0 2024-04-24T02:12:46.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.935+0000 7f1d7bfff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55b8206101b0 0x55b8206125a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.935+0000 7f1d8462f640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55b82060bd20 0x55b82060c140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:42240/0 (socket says 172.21.15.134:42240) 2024-04-24T02:12:46.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.935+0000 7f1d8462f640 1 -- 172.21.15.134:0/412476763 learned_addr learned my addr 172.21.15.134:0/412476763 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:12:46.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.936+0000 7f1d7bfff640 1 -- 172.21.15.134:0/412476763 >> v1:172.21.15.104:6789/0 conn(0x55b82060bd20 legacy=0x55b82060c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.936+0000 7f1d7bfff640 1 -- 172.21.15.134:0/412476763 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8204ca590 con 0x55b8206101b0 2024-04-24T02:12:46.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.938+0000 7f1d7bfff640 1 --2- 172.21.15.134:0/412476763 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b8206101b0 0x55b8206125a0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c00a470 tx=0x7f1d6c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2b2f6ed7c1a51c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.938+0000 7f1d83e2e640 1 -- 172.21.15.134:0/412476763 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d6c057070 con 0x55b8206101b0 2024-04-24T02:12:46.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.938+0000 7f1d83e2e640 1 -- 172.21.15.134:0/412476763 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d6c052570 con 0x55b8206101b0 2024-04-24T02:12:46.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.938+0000 7f1d83e2e640 1 -- 172.21.15.134:0/412476763 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d6c052870 con 0x55b8206101b0 2024-04-24T02:12:46.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.938+0000 7f1d8892f800 1 -- 172.21.15.134:0/412476763 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b8206101b0 msgr2=0x55b8206125a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.938+0000 7f1d8892f800 1 --2- 172.21.15.134:0/412476763 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b8206101b0 0x55b8206125a0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c00a470 tx=0x7f1d6c01ce90 comp rx=0 tx=0).stop 2024-04-24T02:12:46.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.938+0000 7f1d8892f800 1 -- 172.21.15.134:0/412476763 shutdown_connections 2024-04-24T02:12:46.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.938+0000 7f1d8892f800 1 --2- 172.21.15.134:0/412476763 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b8206101b0 0x55b8206125a0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.938+0000 7f1d8892f800 1 -- 172.21.15.134:0/412476763 >> 172.21.15.134:0/412476763 conn(0x55b820607380 msgr2=0x55b8206097a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:46.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.938+0000 7f1d8892f800 1 -- 172.21.15.134:0/412476763 shutdown_connections 2024-04-24T02:12:46.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.938+0000 7f1d8892f800 1 -- 172.21.15.134:0/412476763 wait complete. 2024-04-24T02:12:46.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.950+0000 7f1d8892f800 1 Processor -- start 2024-04-24T02:12:46.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.950+0000 7f1d8892f800 1 -- start start 2024-04-24T02:12:46.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.950+0000 7f1d8892f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b82060bd20 0x55b8206f9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.950+0000 7f1d8892f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b8205583c0 con 0x55b82060bd20 2024-04-24T02:12:46.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.950+0000 7f1d8462f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b82060bd20 0x55b8206f9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.950+0000 7f1d8462f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b82060bd20 0x55b8206f9d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:35962/0 (socket says 172.21.15.134:35962) 2024-04-24T02:12:46.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.950+0000 7f1d8462f640 1 -- 172.21.15.134:0/1822196020 learned_addr learned my addr 172.21.15.134:0/1822196020 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:46.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.950+0000 7f1d8462f640 1 -- 172.21.15.134:0/1822196020 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8206f8330 con 0x55b82060bd20 2024-04-24T02:12:46.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.951+0000 7f1d8462f640 1 --2- 172.21.15.134:0/1822196020 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b82060bd20 0x55b8206f9d70 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f1d74001d80 tx=0x7f1d74001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cf8d53c950cee8a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.951+0000 7f1c7260c640 1 -- 172.21.15.134:0/1822196020 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d74013030 con 0x55b82060bd20 2024-04-24T02:12:46.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.951+0000 7f1c7260c640 1 -- 172.21.15.134:0/1822196020 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d7400e470 con 0x55b82060bd20 2024-04-24T02:12:46.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.951+0000 7f1c7260c640 1 -- 172.21.15.134:0/1822196020 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d7400e810 con 0x55b82060bd20 2024-04-24T02:12:46.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.951+0000 7f1d8892f800 1 -- 172.21.15.134:0/1822196020 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b82060bd20 msgr2=0x55b8206f9d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.951+0000 7f1d8892f800 1 --2- 172.21.15.134:0/1822196020 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b82060bd20 0x55b8206f9d70 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f1d74001d80 tx=0x7f1d74001e70 comp rx=0 tx=0).stop 2024-04-24T02:12:46.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.951+0000 7f1d8892f800 1 -- 172.21.15.134:0/1822196020 shutdown_connections 2024-04-24T02:12:46.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.951+0000 7f1d8892f800 1 --2- 172.21.15.134:0/1822196020 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b82060bd20 0x55b8206f9d70 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.951+0000 7f1d8892f800 1 -- 172.21.15.134:0/1822196020 >> 172.21.15.134:0/1822196020 conn(0x55b820607380 msgr2=0x55b8206fc400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:46.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.951+0000 7f1d8892f800 1 -- 172.21.15.134:0/1822196020 shutdown_connections 2024-04-24T02:12:46.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.951+0000 7f1d8892f800 1 -- 172.21.15.134:0/1822196020 wait complete. 2024-04-24T02:12:46.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.952+0000 7f1d8892f800 1 Processor -- start 2024-04-24T02:12:46.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.952+0000 7f1d8892f800 1 -- start start 2024-04-24T02:12:46.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.952+0000 7f1d8892f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b82060bd20 0x55b820707d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.952+0000 7f1d8892f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b820612e70 con 0x55b82060bd20 2024-04-24T02:12:46.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.952+0000 7f1d8462f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b82060bd20 0x55b820707d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.952+0000 7f1d8462f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b82060bd20 0x55b820707d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:35978/0 (socket says 172.21.15.134:35978) 2024-04-24T02:12:46.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.952+0000 7f1d8462f640 1 -- 172.21.15.134:0/464141447 learned_addr learned my addr 172.21.15.134:0/464141447 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:46.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.952+0000 7f1d8462f640 1 -- 172.21.15.134:0/464141447 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8207082c0 con 0x55b82060bd20 2024-04-24T02:12:46.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.952+0000 7f1d8462f640 1 --2- 172.21.15.134:0/464141447 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b82060bd20 0x55b820707d80 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f1d74004000 tx=0x7f1d74000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.953+0000 7f1c70e09640 1 -- 172.21.15.134:0/464141447 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d74027070 con 0x55b82060bd20 2024-04-24T02:12:46.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.953+0000 7f1c70e09640 1 -- 172.21.15.134:0/464141447 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d740198b0 con 0x55b82060bd20 2024-04-24T02:12:46.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.953+0000 7f1d8892f800 1 -- 172.21.15.134:0/464141447 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b820708550 con 0x55b82060bd20 2024-04-24T02:12:46.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.953+0000 7f1c70e09640 1 -- 172.21.15.134:0/464141447 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d74019bd0 con 0x55b82060bd20 2024-04-24T02:12:46.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.953+0000 7f1d8892f800 1 -- 172.21.15.134:0/464141447 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b82070b200 con 0x55b82060bd20 2024-04-24T02:12:46.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.953+0000 7f1c70e09640 1 -- 172.21.15.134:0/464141447 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1d7402a070 con 0x55b82060bd20 2024-04-24T02:12:46.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.954+0000 7f1c70e09640 1 --2- 172.21.15.134:0/464141447 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1c6c036950 0x7f1c6c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.954+0000 7f1c70e09640 1 -- 172.21.15.134:0/464141447 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f1d7401f070 con 0x55b82060bd20 2024-04-24T02:12:46.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.954+0000 7f1d7bfff640 1 --2- 172.21.15.134:0/464141447 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1c6c036950 0x7f1c6c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.954+0000 7f1d8892f800 1 --2- 172.21.15.134:0/464141447 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b8206101b0 0x55b82070efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.954+0000 7f1d8892f800 1 -- 172.21.15.134:0/464141447 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b82070f540 con 0x55b8206101b0 2024-04-24T02:12:46.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.954+0000 7f1d84e30640 1 --2- 172.21.15.134:0/464141447 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b8206101b0 0x55b82070efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.954+0000 7f1d7bfff640 1 --2- 172.21.15.134:0/464141447 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1c6c036950 0x7f1c6c038e10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c054000 tx=0x7f1d6c04e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.954+0000 7f1d84e30640 1 --2- 172.21.15.134:0/464141447 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b8206101b0 0x55b82070efc0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.954+0000 7f1d84e30640 1 -- 172.21.15.134:0/464141447 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d7c00a4a0 con 0x55b8206101b0 2024-04-24T02:12:46.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.954+0000 7f1d8892f800 1 -- 172.21.15.134:0/464141447 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b82070c590 con 0x55b8206101b0 2024-04-24T02:12:46.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.955+0000 7f1d84e30640 1 -- 172.21.15.134:0/464141447 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1d7c00a4a0 con 0x55b8206101b0 2024-04-24T02:12:46.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.955+0000 7f1d8892f800 1 -- 172.21.15.134:0/464141447 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b820711380 con 0x55b8206101b0 2024-04-24T02:12:46.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.955+0000 7f1d84e30640 1 -- 172.21.15.134:0/464141447 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1d7c00a4a0 con 0x55b8206101b0 2024-04-24T02:12:46.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.955+0000 7f1d8892f800 1 -- 172.21.15.134:0/464141447 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b8207106c0 con 0x55b8206101b0 2024-04-24T02:12:46.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.955+0000 7f1d84e30640 1 -- 172.21.15.134:0/464141447 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1d7c00a4a0 con 0x55b8206101b0 2024-04-24T02:12:46.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.955+0000 7f1d8892f800 1 -- 172.21.15.134:0/464141447 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b820710b10 con 0x55b8206101b0 2024-04-24T02:12:46.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.956+0000 7f1d84e30640 1 -- 172.21.15.134:0/464141447 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1d7c00a4a0 con 0x55b8206101b0 2024-04-24T02:12:46.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.956+0000 7f1d8892f800 1 Processor -- start 2024-04-24T02:12:46.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.956+0000 7f1d8892f800 1 -- start start 2024-04-24T02:12:46.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.956+0000 7f1d8892f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b820720150 0x55b820720570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.956+0000 7f1d8892f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b8204fe6b0 con 0x55b820720150 2024-04-24T02:12:46.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.956+0000 7f1d7bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b820720150 0x55b820720570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.956+0000 7f1d7bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b820720150 0x55b820720570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:35988/0 (socket says 172.21.15.134:35988) 2024-04-24T02:12:46.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.956+0000 7f1d7bfff640 1 -- 172.21.15.134:0/3874180849 learned_addr learned my addr 172.21.15.134:0/3874180849 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:46.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.957+0000 7f1d7bfff640 1 -- 172.21.15.134:0/3874180849 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b820720ab0 con 0x55b820720150 2024-04-24T02:12:46.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.957+0000 7f1d7bfff640 1 --2- 172.21.15.134:0/3874180849 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b820720150 0x55b820720570 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c052540 tx=0x7f1d6c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.957+0000 7f1c69ffb640 1 -- 172.21.15.134:0/3874180849 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d6c06f070 con 0x55b820720150 2024-04-24T02:12:46.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.957+0000 7f1c69ffb640 1 -- 172.21.15.134:0/3874180849 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d6c058040 con 0x55b820720150 2024-04-24T02:12:46.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.957+0000 7f1d8892f800 1 -- 172.21.15.134:0/3874180849 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b820721520 con 0x55b820720150 2024-04-24T02:12:46.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.957+0000 7f1c69ffb640 1 -- 172.21.15.134:0/3874180849 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d6c057050 con 0x55b820720150 2024-04-24T02:12:46.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.957+0000 7f1d8892f800 1 -- 172.21.15.134:0/3874180849 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8207219c0 con 0x55b820720150 2024-04-24T02:12:46.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.958+0000 7f1c69ffb640 1 -- 172.21.15.134:0/3874180849 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1d6c072070 con 0x55b820720150 2024-04-24T02:12:46.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.958+0000 7f1c69ffb640 1 --2- 172.21.15.134:0/3874180849 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1c5c036950 0x7f1c5c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.958+0000 7f1c69ffb640 1 -- 172.21.15.134:0/3874180849 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f1d6c08f9e0 con 0x55b820720150 2024-04-24T02:12:46.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.958+0000 7f1d84e30640 1 --2- 172.21.15.134:0/3874180849 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1c5c036950 0x7f1c5c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.958+0000 7f1d8892f800 1 Processor -- start 2024-04-24T02:12:46.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.958+0000 7f1d8892f800 1 -- start start 2024-04-24T02:12:46.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.958+0000 7f1d84e30640 1 --2- 172.21.15.134:0/3874180849 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1c5c036950 0x7f1c5c038e10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x55b8207101e0 tx=0x7f1d7c005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.958+0000 7f1d8892f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b82072d3d0 0x55b82072d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.958+0000 7f1d8892f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b8206f86b0 con 0x55b82072d3d0 2024-04-24T02:12:46.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.958+0000 7f1d7bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b82072d3d0 0x55b82072d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.958+0000 7f1d7bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b82072d3d0 0x55b82072d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:35994/0 (socket says 172.21.15.134:35994) 2024-04-24T02:12:46.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.958+0000 7f1d7bfff640 1 -- 172.21.15.134:0/1300580082 learned_addr learned my addr 172.21.15.134:0/1300580082 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:46.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.959+0000 7f1d7bfff640 1 -- 172.21.15.134:0/1300580082 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b82072ddc0 con 0x55b82072d3d0 2024-04-24T02:12:46.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.959+0000 7f1d7bfff640 1 --2- 172.21.15.134:0/1300580082 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b82072d3d0 0x55b82072d7f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c05f870 tx=0x7f1d6c08e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e7d326f01001412 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.959+0000 7f1c637fe640 1 -- 172.21.15.134:0/1300580082 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d6c07f040 con 0x55b82072d3d0 2024-04-24T02:12:46.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.959+0000 7f1c637fe640 1 -- 172.21.15.134:0/1300580082 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d6c069cc0 con 0x55b82072d3d0 2024-04-24T02:12:46.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.959+0000 7f1c637fe640 1 -- 172.21.15.134:0/1300580082 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d6c05e9a0 con 0x55b82072d3d0 2024-04-24T02:12:46.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.959+0000 7f1d8892f800 1 -- 172.21.15.134:0/1300580082 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b82072d3d0 msgr2=0x55b82072d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:46.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.959+0000 7f1d8892f800 1 --2- 172.21.15.134:0/1300580082 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b82072d3d0 0x55b82072d7f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c05f870 tx=0x7f1d6c08e050 comp rx=0 tx=0).stop 2024-04-24T02:12:46.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.959+0000 7f1d8892f800 1 -- 172.21.15.134:0/1300580082 shutdown_connections 2024-04-24T02:12:46.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.959+0000 7f1d8892f800 1 --2- 172.21.15.134:0/1300580082 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b82072d3d0 0x55b82072d7f0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:46.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.959+0000 7f1d8892f800 1 -- 172.21.15.134:0/1300580082 >> 172.21.15.134:0/1300580082 conn(0x55b820729730 msgr2=0x55b820727790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:46.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.959+0000 7f1d8892f800 1 -- 172.21.15.134:0/1300580082 shutdown_connections 2024-04-24T02:12:46.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.959+0000 7f1d8892f800 1 -- 172.21.15.134:0/1300580082 wait complete. 2024-04-24T02:12:46.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.960+0000 7f1d8892f800 1 Processor -- start 2024-04-24T02:12:46.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.960+0000 7f1d8892f800 1 -- start start 2024-04-24T02:12:46.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.960+0000 7f1d8892f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b82072d3d0 0x55b820734a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.960+0000 7f1d8892f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b82072e530 con 0x55b82072d3d0 2024-04-24T02:12:46.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.960+0000 7f1d7bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b82072d3d0 0x55b820734a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.960+0000 7f1d7bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b82072d3d0 0x55b820734a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:35996/0 (socket says 172.21.15.134:35996) 2024-04-24T02:12:46.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.960+0000 7f1d7bfff640 1 -- 172.21.15.134:0/1359865613 learned_addr learned my addr 172.21.15.134:0/1359865613 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:12:46.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.960+0000 7f1d7bfff640 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b820734f70 con 0x55b82072d3d0 2024-04-24T02:12:46.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.960+0000 7f1d7bfff640 1 --2- 172.21.15.134:0/1359865613 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b82072d3d0 0x55b820734a30 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c08cce0 tx=0x7f1d6c08dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.961+0000 7f1c61ffb640 1 -- 172.21.15.134:0/1359865613 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d6c05eae0 con 0x55b82072d3d0 2024-04-24T02:12:46.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.961+0000 7f1c61ffb640 1 -- 172.21.15.134:0/1359865613 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d6c093030 con 0x55b82072d3d0 2024-04-24T02:12:46.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.961+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b820735200 con 0x55b82072d3d0 2024-04-24T02:12:46.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.961+0000 7f1c61ffb640 1 -- 172.21.15.134:0/1359865613 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d6c05fd10 con 0x55b82072d3d0 2024-04-24T02:12:46.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.961+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b820737eb0 con 0x55b82072d3d0 2024-04-24T02:12:46.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.961+0000 7f1c61ffb640 1 -- 172.21.15.134:0/1359865613 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1d6c05d760 con 0x55b82072d3d0 2024-04-24T02:12:46.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.961+0000 7f1c61ffb640 1 --2- 172.21.15.134:0/1359865613 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1c54036950 0x7f1c54038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.962+0000 7f1c61ffb640 1 -- 172.21.15.134:0/1359865613 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f1d6c08f050 con 0x55b82072d3d0 2024-04-24T02:12:46.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.962+0000 7f1d84e30640 1 --2- 172.21.15.134:0/1359865613 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1c54036950 0x7f1c54038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.962+0000 7f1d84e30640 1 --2- 172.21.15.134:0/1359865613 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1c54036950 0x7f1c54038e10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x55b82070c4e0 tx=0x7f1d7c01f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.962+0000 7f1d8892f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.962+0000 7f1d8892f800 1 --2- 172.21.15.134:0/1359865613 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b8207404d0 0x55b820742990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.962+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b8207430e0 con 0x55b8207404d0 2024-04-24T02:12:46.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.962+0000 7f1d8462f640 1 --2- 172.21.15.134:0/1359865613 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b8207404d0 0x55b820742990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.963+0000 7f1d8462f640 1 --2- 172.21.15.134:0/1359865613 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b8207404d0 0x55b820742990 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.963+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d74029030 con 0x55b8207404d0 2024-04-24T02:12:46.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.963+0000 7f1d8892f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:46.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.963+0000 7f1d8892f800 20 realm 2024-04-24T02:12:46.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.963+0000 7f1d8892f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.963+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b8207434f0 con 0x55b8207404d0 2024-04-24T02:12:46.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.963+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d74029030 con 0x55b8207404d0 2024-04-24T02:12:46.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.963+0000 7f1d8892f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:46.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.963+0000 7f1d8892f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:12:46.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.963+0000 7f1d8892f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.963+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b820743dc0 con 0x55b8207404d0 2024-04-24T02:12:46.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.963+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d74029030 con 0x55b8207404d0 2024-04-24T02:12:46.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.963+0000 7f1d8892f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:46.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.963+0000 7f1d8892f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.963+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b820744160 con 0x55b8207404d0 2024-04-24T02:12:46.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.963+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1d74029030 con 0x55b8207404d0 2024-04-24T02:12:46.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.963+0000 7f1d8892f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:46.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.963+0000 7f1d8892f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.963+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b8207449b0 con 0x55b8207404d0 2024-04-24T02:12:46.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.964+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1d74029030 con 0x55b8207404d0 2024-04-24T02:12:46.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.964+0000 7f1d8892f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:12:46.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.964+0000 7f1d8892f800 20 searching for the correct realm 2024-04-24T02:12:46.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.964+0000 7f1d8892f800 1 --2- 172.21.15.134:0/1359865613 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55b820746720 0x55b820748b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.964+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b8207490f0 con 0x55b820746720 2024-04-24T02:12:46.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.964+0000 7f1d7bfff640 1 --2- 172.21.15.134:0/1359865613 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55b820746720 0x55b820748b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.964+0000 7f1d7bfff640 1 --2- 172.21.15.134:0/1359865613 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55b820746720 0x55b820748b10 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.964+0000 7f1d7bfff640 1 -- 172.21.15.134:0/1359865613 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d6c09f070 con 0x55b820746720 2024-04-24T02:12:46.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.964+0000 7f1d7bfff640 1 --2- 172.21.15.134:0/1359865613 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f1d6c074060 0x7f1d6c06a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.964+0000 7f1d7bfff640 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b8207490f0 con 0x7f1d6c074060 2024-04-24T02:12:46.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.965+0000 7f1d84e30640 1 --2- 172.21.15.134:0/1359865613 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f1d6c074060 0x7f1d6c06a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.965+0000 7f1d84e30640 1 --2- 172.21.15.134:0/1359865613 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f1d6c074060 0x7f1d6c06a910 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.965+0000 7f1d84e30640 1 -- 172.21.15.134:0/1359865613 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d7c01f070 con 0x7f1d6c074060 2024-04-24T02:12:46.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.965+0000 7f1d84e30640 1 --2- 172.21.15.134:0/1359865613 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f1d7c031040 0x7f1d7c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:12:46.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.965+0000 7f1d84e30640 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b8207490f0 con 0x7f1d7c031040 2024-04-24T02:12:46.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.965+0000 7f1d8462f640 1 --2- 172.21.15.134:0/1359865613 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f1d7c031040 0x7f1d7c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:12:46.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.966+0000 7f1d8462f640 1 --2- 172.21.15.134:0/1359865613 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f1d7c031040 0x7f1d7c032940 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:12:46.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.966+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d74029030 con 0x7f1d7c031040 2024-04-24T02:12:46.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.966+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b8207490f0 con 0x55b8207404d0 2024-04-24T02:12:46.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.966+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d74029030 con 0x55b8207404d0 2024-04-24T02:12:46.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.966+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b8207490f0 con 0x55b8207404d0 2024-04-24T02:12:46.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.967+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1d74029030 con 0x55b8207404d0 2024-04-24T02:12:46.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.967+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b8207490f0 con 0x7f1d7c031040 2024-04-24T02:12:46.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.967+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d74029030 con 0x7f1d7c031040 2024-04-24T02:12:46.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.967+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b8207490f0 con 0x7f1d6c074060 2024-04-24T02:12:46.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.967+0000 7f1d84e30640 1 -- 172.21.15.134:0/1359865613 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d7c01f070 con 0x7f1d6c074060 2024-04-24T02:12:46.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.967+0000 7f1d84e30640 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b8207490f0 con 0x7f1d6c074060 2024-04-24T02:12:46.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.967+0000 7f1d84e30640 1 -- 172.21.15.134:0/1359865613 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d7c01f070 con 0x7f1d6c074060 2024-04-24T02:12:46.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.967+0000 7f1d84e30640 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b8207490f0 con 0x55b820746720 2024-04-24T02:12:46.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.968+0000 7f1d7bfff640 1 -- 172.21.15.134:0/1359865613 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d6c09f070 con 0x55b820746720 2024-04-24T02:12:46.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.968+0000 7f1d7bfff640 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b8207490f0 con 0x55b8207404d0 2024-04-24T02:12:46.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.968+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d74029030 con 0x55b8207404d0 2024-04-24T02:12:46.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.968+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b8207490f0 con 0x7f1d7c031040 2024-04-24T02:12:46.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.968+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d74029030 con 0x7f1d7c031040 2024-04-24T02:12:46.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.968+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b8207490f0 con 0x55b8207404d0 2024-04-24T02:12:46.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.968+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d74029030 con 0x55b8207404d0 2024-04-24T02:12:46.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.968+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b8207490f0 con 0x7f1d6c074060 2024-04-24T02:12:46.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.968+0000 7f1d84e30640 1 -- 172.21.15.134:0/1359865613 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1d7c01f070 con 0x7f1d6c074060 2024-04-24T02:12:46.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.969+0000 7f1d84e30640 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b8207490f0 con 0x55b820746720 2024-04-24T02:12:46.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.969+0000 7f1d7bfff640 1 -- 172.21.15.134:0/1359865613 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d6c09f070 con 0x55b820746720 2024-04-24T02:12:46.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.969+0000 7f1d7bfff640 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b8207490f0 con 0x55b820746720 2024-04-24T02:12:46.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.969+0000 7f1d7bfff640 1 -- 172.21.15.134:0/1359865613 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d6c09f070 con 0x55b820746720 2024-04-24T02:12:46.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.969+0000 7f1d7bfff640 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1d6c0af040 con 0x7f1d6c074060 2024-04-24T02:12:46.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.969+0000 7f1d84e30640 1 -- 172.21.15.134:0/1359865613 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d7c01f070 con 0x7f1d6c074060 2024-04-24T02:12:46.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.969+0000 7f1d84e30640 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1d6c0af040 con 0x55b820746720 2024-04-24T02:12:46.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.969+0000 7f1d7bfff640 1 -- 172.21.15.134:0/1359865613 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d6c09f070 con 0x55b820746720 2024-04-24T02:12:46.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.969+0000 7f1d7bfff640 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1d6c0af040 con 0x55b820746720 2024-04-24T02:12:46.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.970+0000 7f1d7bfff640 1 -- 172.21.15.134:0/1359865613 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d6c09f070 con 0x55b820746720 2024-04-24T02:12:46.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.970+0000 7f1d7bfff640 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1d6c0af040 con 0x55b8207404d0 2024-04-24T02:12:46.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.970+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d74029030 con 0x55b8207404d0 2024-04-24T02:12:46.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.970+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1d6c0af040 con 0x55b8207404d0 2024-04-24T02:12:46.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.970+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f1d74029030 con 0x55b8207404d0 2024-04-24T02:12:46.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.970+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1d6c0af040 con 0x7f1d7c031040 2024-04-24T02:12:46.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.970+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d74029030 con 0x7f1d7c031040 2024-04-24T02:12:46.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.970+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1d6c0af040 con 0x55b820746720 2024-04-24T02:12:46.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.971+0000 7f1d7bfff640 1 -- 172.21.15.134:0/1359865613 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d6c09f070 con 0x55b820746720 2024-04-24T02:12:46.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.971+0000 7f1d7bfff640 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1d6c0af040 con 0x7f1d6c074060 2024-04-24T02:12:46.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.971+0000 7f1d84e30640 1 -- 172.21.15.134:0/1359865613 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d7c01f070 con 0x7f1d6c074060 2024-04-24T02:12:46.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.971+0000 7f1d84e30640 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1d6c0af040 con 0x55b8207404d0 2024-04-24T02:12:46.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.971+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d74029030 con 0x55b8207404d0 2024-04-24T02:12:46.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.971+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1d6c0af040 con 0x7f1d7c031040 2024-04-24T02:12:46.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.971+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d74029030 con 0x7f1d7c031040 2024-04-24T02:12:46.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.971+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1d6c0af040 con 0x55b820746720 2024-04-24T02:12:46.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.972+0000 7f1d7bfff640 1 -- 172.21.15.134:0/1359865613 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d6c09f070 con 0x55b820746720 2024-04-24T02:12:46.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.972+0000 7f1d7bfff640 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1d6c0af040 con 0x7f1d7c031040 2024-04-24T02:12:46.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.972+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d74029030 con 0x7f1d7c031040 2024-04-24T02:12:46.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.972+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1d6c0af040 con 0x7f1d6c074060 2024-04-24T02:12:46.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.972+0000 7f1d84e30640 1 -- 172.21.15.134:0/1359865613 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d7c040040 con 0x7f1d6c074060 2024-04-24T02:12:46.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.972+0000 7f1d84e30640 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1d6c0af040 con 0x55b820746720 2024-04-24T02:12:46.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.972+0000 7f1d7bfff640 1 -- 172.21.15.134:0/1359865613 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d6c09f070 con 0x55b820746720 2024-04-24T02:12:46.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.972+0000 7f1d7bfff640 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1d6c0af040 con 0x7f1d6c074060 2024-04-24T02:12:46.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.973+0000 7f1d84e30640 1 -- 172.21.15.134:0/1359865613 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d7c040040 con 0x7f1d6c074060 2024-04-24T02:12:46.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.973+0000 7f1d84e30640 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1d6c0af040 con 0x55b8207404d0 2024-04-24T02:12:46.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.973+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1d74029030 con 0x55b8207404d0 2024-04-24T02:12:46.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.973+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1d6c0af040 con 0x7f1d6c074060 2024-04-24T02:12:46.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.973+0000 7f1d84e30640 1 -- 172.21.15.134:0/1359865613 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d7c040040 con 0x7f1d6c074060 2024-04-24T02:12:46.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.973+0000 7f1d8892f800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:12:46.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.973+0000 7f1d8892f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:12:46.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.973+0000 7f1d8892f800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:12:46.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.973+0000 7f1d8892f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:12:46.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.973+0000 7f1d8892f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:12:46.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.973+0000 7f1d8892f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:12:46.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.973+0000 7f1d8892f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.973+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b820745300 con 0x55b8207404d0 2024-04-24T02:12:46.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.973+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d74029030 con 0x55b8207404d0 2024-04-24T02:12:46.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.973+0000 7f1d8892f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:46.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.973+0000 7f1d8892f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.973+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b820745ba0 con 0x55b8207404d0 2024-04-24T02:12:46.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.974+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1d74029030 con 0x55b8207404d0 2024-04-24T02:12:46.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.974+0000 7f1d8892f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:12:46.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.974+0000 7f1d8892f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.974+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b820745ba0 con 0x55b8207404d0 2024-04-24T02:12:46.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.974+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1d74029030 con 0x55b8207404d0 2024-04-24T02:12:46.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.974+0000 7f1d8892f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:12:46.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.974+0000 7f1d8892f800 20 zone default found 2024-04-24T02:12:46.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.974+0000 7f1d8892f800 4 Realm: () 2024-04-24T02:12:46.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.974+0000 7f1d8892f800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:12:46.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.974+0000 7f1d8892f800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:12:46.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.974+0000 7f1d8892f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:12:46.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.974+0000 7f1d8892f800 20 zonegroup default 2024-04-24T02:12:46.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.974+0000 7f1d8892f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.974+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b820749570 con 0x7f1d7c031040 2024-04-24T02:12:46.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.974+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1d74029030 con 0x7f1d7c031040 2024-04-24T02:12:46.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.974+0000 7f1d8892f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:46.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.974+0000 7f1d8892f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.974+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b82074af80 con 0x55b820746720 2024-04-24T02:12:46.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.975+0000 7f1d7bfff640 1 -- 172.21.15.134:0/1359865613 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1d6c09f070 con 0x55b820746720 2024-04-24T02:12:46.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.975+0000 7f1d8892f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:46.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.975+0000 7f1d8892f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:46.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.975+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b82074b890 con 0x55b820746720 2024-04-24T02:12:46.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.975+0000 7f1d7bfff640 1 -- 172.21.15.134:0/1359865613 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1d6c09f070 con 0x55b820746720 2024-04-24T02:12:46.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.975+0000 7f1d8892f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:12:46.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.975+0000 7f1d8892f800 20 started sync module instance, tier type = 2024-04-24T02:12:46.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.975+0000 7f1d8892f800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:12:46.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.975+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82074a3f0 con 0x7f1d6c074060 2024-04-24T02:12:46.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.976+0000 7f1d84e30640 1 -- 172.21.15.134:0/1359865613 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(44 notify.0 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d7c040040 con 0x7f1d6c074060 2024-04-24T02:12:46.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.976+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94249306857280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82074bc30 con 0x7f1d6c074060 2024-04-24T02:12:46.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.976+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82074c480 con 0x55b8207404d0 2024-04-24T02:12:46.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.977+0000 7f1d84e30640 1 -- 172.21.15.134:0/1359865613 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94249306857280] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d7c040040 con 0x7f1d6c074060 2024-04-24T02:12:46.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.977+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d74029030 con 0x55b8207404d0 2024-04-24T02:12:46.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.977+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94249306864688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82074c500 con 0x55b8207404d0 2024-04-24T02:12:46.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.977+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82074cec0 con 0x55b820746720 2024-04-24T02:12:46.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.978+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94249306864688] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d74029030 con 0x55b8207404d0 2024-04-24T02:12:46.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.978+0000 7f1d7bfff640 1 -- 172.21.15.134:0/1359865613 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d6c09f070 con 0x55b820746720 2024-04-24T02:12:46.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.978+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94249306865744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82074c470 con 0x55b820746720 2024-04-24T02:12:46.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.978+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82074dd30 con 0x7f1d6c074060 2024-04-24T02:12:46.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.979+0000 7f1d84e30640 1 -- 172.21.15.134:0/1359865613 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(50 notify.3 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d7c040040 con 0x7f1d6c074060 2024-04-24T02:12:46.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.979+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94249306872416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82074e510 con 0x7f1d6c074060 2024-04-24T02:12:46.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.979+0000 7f1d7bfff640 1 -- 172.21.15.134:0/1359865613 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94249306865744] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d6c09f070 con 0x55b820746720 2024-04-24T02:12:46.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.979+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82074f030 con 0x55b8207404d0 2024-04-24T02:12:47.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.980+0000 7f1d84e30640 1 -- 172.21.15.134:0/1359865613 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94249306872416] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d7c040040 con 0x7f1d6c074060 2024-04-24T02:12:47.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.981+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d74029030 con 0x55b8207404d0 2024-04-24T02:12:47.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.981+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94249306870448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82074df60 con 0x55b8207404d0 2024-04-24T02:12:47.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.981+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82074f610 con 0x7f1d7c031040 2024-04-24T02:12:47.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.982+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94249306870448] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d74029030 con 0x55b8207404d0 2024-04-24T02:12:47.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.982+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(54 notify.5 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d74029030 con 0x7f1d7c031040 2024-04-24T02:12:47.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.982+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94249306876672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82074f610 con 0x7f1d7c031040 2024-04-24T02:12:47.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.982+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82074fec0 con 0x7f1d7c031040 2024-04-24T02:12:47.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.983+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(56 notify.6 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d74029030 con 0x7f1d7c031040 2024-04-24T02:12:47.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.983+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94249306879504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82074fa30 con 0x7f1d7c031040 2024-04-24T02:12:47.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.983+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b820750e90 con 0x7f1d7c031040 2024-04-24T02:12:47.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.983+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94249306876672] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d74029030 con 0x7f1d7c031040 2024-04-24T02:12:47.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.984+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94249306879504] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d74029030 con 0x7f1d7c031040 2024-04-24T02:12:47.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.984+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(58 notify.7 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d74029030 con 0x7f1d7c031040 2024-04-24T02:12:47.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.984+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94249306884480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b820750260 con 0x7f1d7c031040 2024-04-24T02:12:47.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.984+0000 7f1d8892f800 20 add_watcher() i=0 2024-04-24T02:12:47.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.984+0000 7f1d8892f800 20 add_watcher() i=1 2024-04-24T02:12:47.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.984+0000 7f1d8892f800 20 add_watcher() i=2 2024-04-24T02:12:47.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.984+0000 7f1d8892f800 20 add_watcher() i=3 2024-04-24T02:12:47.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.984+0000 7f1d8892f800 20 add_watcher() i=4 2024-04-24T02:12:47.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.984+0000 7f1d8892f800 20 add_watcher() i=5 2024-04-24T02:12:47.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.984+0000 7f1d8892f800 20 add_watcher() i=6 2024-04-24T02:12:47.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.984+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94249306884480] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d74029030 con 0x7f1d7c031040 2024-04-24T02:12:47.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.984+0000 7f1d8892f800 20 add_watcher() i=7 2024-04-24T02:12:47.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.984+0000 7f1d8892f800 2 all 8 watchers are set, enabling cache 2024-04-24T02:12:47.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.985+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b820753e80 con 0x55b8207404d0 2024-04-24T02:12:47.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.985+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1d74029030 con 0x55b8207404d0 2024-04-24T02:12:47.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.985+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94249306878304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b820751300 con 0x55b8207404d0 2024-04-24T02:12:47.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.986+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94249306878304] v32'198 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1d74029030 con 0x55b8207404d0 2024-04-24T02:12:47.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.986+0000 7f1c3a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:47.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.986+0000 7f1d8892f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:12:47.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.986+0000 7f1d8892f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:12:47.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.986+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82075c6a0 con 0x55b8207404d0 2024-04-24T02:12:47.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.987+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'55 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1d74029030 con 0x55b8207404d0 2024-04-24T02:12:47.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.987+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82075ccf0 con 0x7f1d7c031040 2024-04-24T02:12:47.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.988+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'32 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1d74029030 con 0x7f1d7c031040 2024-04-24T02:12:47.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.988+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82075ccf0 con 0x55b820746720 2024-04-24T02:12:47.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.989+0000 7f1d7bfff640 1 -- 172.21.15.134:0/1359865613 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1d6c09f070 con 0x55b820746720 2024-04-24T02:12:47.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.989+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82075d0b0 con 0x55b8207404d0 2024-04-24T02:12:47.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.990+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'199 uv169 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1d74029030 con 0x55b8207404d0 2024-04-24T02:12:47.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.990+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82075d1a0 con 0x7f1d6c074060 2024-04-24T02:12:47.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.991+0000 7f1d84e30640 1 -- 172.21.15.134:0/1359865613 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'73 uv58 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1d7c040040 con 0x7f1d6c074060 2024-04-24T02:12:47.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.991+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82075d810 con 0x55b820746720 2024-04-24T02:12:47.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.992+0000 7f1d7bfff640 1 -- 172.21.15.134:0/1359865613 <== osd.3 v2:172.21.15.134:6801/3585115521 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'57 uv48 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1d6c09f070 con 0x55b820746720 2024-04-24T02:12:47.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.992+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82075dbf0 con 0x55b8207404d0 2024-04-24T02:12:47.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.993+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1d74029030 con 0x55b8207404d0 2024-04-24T02:12:47.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.993+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82075dbf0 con 0x7f1d7c031040 2024-04-24T02:12:47.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.994+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'50 uv41 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1d74029030 con 0x7f1d7c031040 2024-04-24T02:12:47.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.994+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82075dbf0 con 0x7f1d6c074060 2024-04-24T02:12:47.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.995+0000 7f1d84e30640 1 -- 172.21.15.134:0/1359865613 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1d7c040040 con 0x7f1d6c074060 2024-04-24T02:12:47.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.995+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82075e200 con 0x55b820746720 2024-04-24T02:12:47.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.996+0000 7f1d7bfff640 1 -- 172.21.15.134:0/1359865613 <== osd.3 v2:172.21.15.134:6801/3585115521 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1d6c09f070 con 0x55b820746720 2024-04-24T02:12:47.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.996+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82075e200 con 0x7f1d6c074060 2024-04-24T02:12:47.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.997+0000 7f1d84e30640 1 -- 172.21.15.134:0/1359865613 <== osd.2 v2:172.21.15.134:6800/214480313 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'74 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d7c040040 con 0x7f1d6c074060 2024-04-24T02:12:47.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.997+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82075e770 con 0x7f1d7c031040 2024-04-24T02:12:47.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.998+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'28 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d74029030 con 0x7f1d7c031040 2024-04-24T02:12:47.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.998+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82075e770 con 0x7f1d6c074060 2024-04-24T02:12:47.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.999+0000 7f1d84e30640 1 -- 172.21.15.134:0/1359865613 <== osd.2 v2:172.21.15.134:6800/214480313 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d7c040040 con 0x7f1d6c074060 2024-04-24T02:12:47.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:46.999+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82075ec20 con 0x7f1d7c031040 2024-04-24T02:12:47.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.000+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'61 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d74029030 con 0x7f1d7c031040 2024-04-24T02:12:47.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.000+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82075ec20 con 0x55b8207404d0 2024-04-24T02:12:47.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.001+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'200 uv171 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d74029030 con 0x55b8207404d0 2024-04-24T02:12:47.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.001+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82075ec20 con 0x55b820746720 2024-04-24T02:12:47.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.003+0000 7f1d7bfff640 1 -- 172.21.15.134:0/1359865613 <== osd.3 v2:172.21.15.134:6801/3585115521 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'65 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d6c09f070 con 0x55b820746720 2024-04-24T02:12:47.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.003+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82075ec20 con 0x7f1d6c074060 2024-04-24T02:12:47.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.004+0000 7f1d84e30640 1 -- 172.21.15.134:0/1359865613 <== osd.2 v2:172.21.15.134:6800/214480313 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'75 uv63 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d7c040040 con 0x7f1d6c074060 2024-04-24T02:12:47.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.004+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82075ec20 con 0x55b820746720 2024-04-24T02:12:47.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.005+0000 7f1d7bfff640 1 -- 172.21.15.134:0/1359865613 <== osd.3 v2:172.21.15.134:6801/3585115521 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'38 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d6c09f070 con 0x55b820746720 2024-04-24T02:12:47.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.005+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82075ec20 con 0x55b8207404d0 2024-04-24T02:12:47.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.006+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d74029030 con 0x55b8207404d0 2024-04-24T02:12:47.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.006+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82075ec20 con 0x55b8207404d0 2024-04-24T02:12:47.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.007+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'201 uv173 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d74029030 con 0x55b8207404d0 2024-04-24T02:12:47.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.007+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82075ec20 con 0x55b820746720 2024-04-24T02:12:47.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.008+0000 7f1d7bfff640 1 -- 172.21.15.134:0/1359865613 <== osd.3 v2:172.21.15.134:6801/3585115521 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'66 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d6c09f070 con 0x55b820746720 2024-04-24T02:12:47.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.008+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82075ec20 con 0x7f1d6c074060 2024-04-24T02:12:47.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.009+0000 7f1d84e30640 1 -- 172.21.15.134:0/1359865613 <== osd.2 v2:172.21.15.134:6800/214480313 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'41 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d7c040040 con 0x7f1d6c074060 2024-04-24T02:12:47.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.009+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82075ec20 con 0x55b820746720 2024-04-24T02:12:47.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.010+0000 7f1d7bfff640 1 -- 172.21.15.134:0/1359865613 <== osd.3 v2:172.21.15.134:6801/3585115521 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d6c09f070 con 0x55b820746720 2024-04-24T02:12:47.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.010+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82075ec20 con 0x55b820746720 2024-04-24T02:12:47.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.011+0000 7f1d7bfff640 1 -- 172.21.15.134:0/1359865613 <== osd.3 v2:172.21.15.134:6801/3585115521 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'43 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d6c09f070 con 0x55b820746720 2024-04-24T02:12:47.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.011+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82075ec20 con 0x55b820746720 2024-04-24T02:12:47.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.012+0000 7f1d7bfff640 1 -- 172.21.15.134:0/1359865613 <== osd.3 v2:172.21.15.134:6801/3585115521 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d6c09f070 con 0x55b820746720 2024-04-24T02:12:47.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.012+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82075ec20 con 0x55b820746720 2024-04-24T02:12:47.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.012+0000 7f1d7bfff640 1 -- 172.21.15.134:0/1359865613 <== osd.3 v2:172.21.15.134:6801/3585115521 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'58 uv50 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d6c09f070 con 0x55b820746720 2024-04-24T02:12:47.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.012+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82075ec20 con 0x7f1d7c031040 2024-04-24T02:12:47.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.013+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d74029030 con 0x7f1d7c031040 2024-04-24T02:12:47.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.014+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82075ec20 con 0x55b820746720 2024-04-24T02:12:47.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.014+0000 7f1d7bfff640 1 -- 172.21.15.134:0/1359865613 <== osd.3 v2:172.21.15.134:6801/3585115521 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'37 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d6c09f070 con 0x55b820746720 2024-04-24T02:12:47.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.014+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82075ec20 con 0x7f1d7c031040 2024-04-24T02:12:47.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.015+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'51 uv43 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d74029030 con 0x7f1d7c031040 2024-04-24T02:12:47.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.016+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82075ec20 con 0x55b820746720 2024-04-24T02:12:47.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.016+0000 7f1d7bfff640 1 -- 172.21.15.134:0/1359865613 <== osd.3 v2:172.21.15.134:6801/3585115521 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'67 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d6c09f070 con 0x55b820746720 2024-04-24T02:12:47.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.017+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82075ec20 con 0x7f1d7c031040 2024-04-24T02:12:47.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.017+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.0 v2:172.21.15.104:6800/2419146313 20 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'62 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d74029030 con 0x7f1d7c031040 2024-04-24T02:12:47.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.017+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82075ec20 con 0x7f1d6c074060 2024-04-24T02:12:47.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.018+0000 7f1d84e30640 1 -- 172.21.15.134:0/1359865613 <== osd.2 v2:172.21.15.134:6800/214480313 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d7c040040 con 0x7f1d6c074060 2024-04-24T02:12:47.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.019+0000 7f1c397e2640 20 reqs_thread_entry: start 2024-04-24T02:12:47.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.019+0000 7f1d8892f800 20 init_complete bucket index max shards: 11 2024-04-24T02:12:47.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.019+0000 7f1d8892f800 20 Filter name: none 2024-04-24T02:12:47.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.019+0000 7f1baaffd640 20 reqs_thread_entry: start 2024-04-24T02:12:47.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.019+0000 7f1d8892f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T02:12:47.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.019+0000 7f1d8892f800 20 rados->read ofs=0 len=0 2024-04-24T02:12:47.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.019+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b820789b00 con 0x55b8207404d0 2024-04-24T02:12:47.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.020+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f1d74029030 con 0x55b8207404d0 2024-04-24T02:12:47.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.020+0000 7f1d8892f800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T02:12:47.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.020+0000 7f1d8892f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T02:12:47.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.020+0000 7f1d8892f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:12:47.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.020+0000 7f1d8892f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:12:47.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.020+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b820789a80 con 0x7f1d6c074060 2024-04-24T02:12:47.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.020+0000 7f1d84e30640 1 -- 172.21.15.134:0/1359865613 <== osd.2 v2:172.21.15.134:6800/214480313 21 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv41 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f1d7c040040 con 0x7f1d6c074060 2024-04-24T02:12:47.023 INFO:teuthology.orchestra.run.smithi134.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-04-24T02:12:47.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.021+0000 7f1c3a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:12:47.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.021+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94249306878304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82075b520 con 0x55b8207404d0 2024-04-24T02:12:47.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.022+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.1 v2:172.21.15.134:6804/1487076214 30 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94249306878304] v32'202 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1d74029030 con 0x55b8207404d0 2024-04-24T02:12:47.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.022+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94249306857280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82074f160 con 0x7f1d6c074060 2024-04-24T02:12:47.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.023+0000 7f1d84e30640 1 -- 172.21.15.134:0/1359865613 <== osd.2 v2:172.21.15.134:6800/214480313 22 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94249306857280] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d7c040040 con 0x7f1d6c074060 2024-04-24T02:12:47.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.023+0000 7f1d8892f800 20 remove_watcher() i=0 2024-04-24T02:12:47.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.023+0000 7f1d8892f800 2 removed watcher, disabling cache 2024-04-24T02:12:47.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.023+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94249306864688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82074f160 con 0x55b8207404d0 2024-04-24T02:12:47.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.024+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.1 v2:172.21.15.134:6804/1487076214 31 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94249306864688] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d74029030 con 0x55b8207404d0 2024-04-24T02:12:47.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.024+0000 7f1d8892f800 20 remove_watcher() i=1 2024-04-24T02:12:47.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.024+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94249306865744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82074bc30 con 0x55b820746720 2024-04-24T02:12:47.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.025+0000 7f1d7bfff640 1 -- 172.21.15.134:0/1359865613 <== osd.3 v2:172.21.15.134:6801/3585115521 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94249306865744] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d6c09f070 con 0x55b820746720 2024-04-24T02:12:47.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.025+0000 7f1d8892f800 20 remove_watcher() i=2 2024-04-24T02:12:47.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.025+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94249306872416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82074f160 con 0x7f1d6c074060 2024-04-24T02:12:47.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.026+0000 7f1d84e30640 1 -- 172.21.15.134:0/1359865613 <== osd.2 v2:172.21.15.134:6800/214480313 23 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94249306872416] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d7c040040 con 0x7f1d6c074060 2024-04-24T02:12:47.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.026+0000 7f1d8892f800 20 remove_watcher() i=3 2024-04-24T02:12:47.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.026+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94249306870448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82074f160 con 0x55b8207404d0 2024-04-24T02:12:47.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.027+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.1 v2:172.21.15.134:6804/1487076214 32 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94249306870448] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d74029030 con 0x55b8207404d0 2024-04-24T02:12:47.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.027+0000 7f1d8892f800 20 remove_watcher() i=4 2024-04-24T02:12:47.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.027+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94249306876672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82074d2b0 con 0x7f1d7c031040 2024-04-24T02:12:47.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.028+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.0 v2:172.21.15.104:6800/2419146313 21 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94249306876672] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d74029030 con 0x7f1d7c031040 2024-04-24T02:12:47.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.028+0000 7f1d8892f800 20 remove_watcher() i=5 2024-04-24T02:12:47.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.028+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94249306879504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82074f160 con 0x7f1d7c031040 2024-04-24T02:12:47.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.029+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.0 v2:172.21.15.104:6800/2419146313 22 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94249306879504] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d74029030 con 0x7f1d7c031040 2024-04-24T02:12:47.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.029+0000 7f1d8892f800 20 remove_watcher() i=6 2024-04-24T02:12:47.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.029+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94249306884480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b82074f610 con 0x7f1d7c031040 2024-04-24T02:12:47.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.030+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 <== osd.0 v2:172.21.15.104:6800/2419146313 23 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94249306884480] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d74029030 con 0x7f1d7c031040 2024-04-24T02:12:47.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.030+0000 7f1d8892f800 20 remove_watcher() i=7 2024-04-24T02:12:47.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.030+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f1d7c031040 msgr2=0x7f1d7c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:47.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.030+0000 7f1d8892f800 1 --2- 172.21.15.134:0/1359865613 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f1d7c031040 0x7f1d7c032940 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:47.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.030+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b8207404d0 msgr2=0x55b820742990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:47.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.030+0000 7f1d8892f800 1 --2- 172.21.15.134:0/1359865613 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b8207404d0 0x55b820742990 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:47.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.030+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f1d6c074060 msgr2=0x7f1d6c06a910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:47.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.030+0000 7f1d8892f800 1 --2- 172.21.15.134:0/1359865613 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f1d6c074060 0x7f1d6c06a910 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:47.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.030+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55b820746720 msgr2=0x55b820748b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:47.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.030+0000 7f1d8892f800 1 --2- 172.21.15.134:0/1359865613 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55b820746720 0x55b820748b10 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:47.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.030+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1c54036950 msgr2=0x7f1c54038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:47.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.030+0000 7f1d8892f800 1 --2- 172.21.15.134:0/1359865613 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1c54036950 0x7f1c54038e10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x55b82070c4e0 tx=0x7f1d7c01f000 comp rx=0 tx=0).stop 2024-04-24T02:12:47.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.030+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b82072d3d0 msgr2=0x55b820734a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:47.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.030+0000 7f1d8462f640 1 -- 172.21.15.134:0/1359865613 reap_dead start 2024-04-24T02:12:47.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.030+0000 7f1d8892f800 1 --2- 172.21.15.134:0/1359865613 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b82072d3d0 0x55b820734a30 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c08cce0 tx=0x7f1d6c08dd50 comp rx=0 tx=0).stop 2024-04-24T02:12:47.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.030+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 shutdown_connections 2024-04-24T02:12:47.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.030+0000 7f1d8892f800 1 --2- 172.21.15.134:0/1359865613 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b82072d3d0 0x55b820734a30 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:47.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.030+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 >> 172.21.15.134:0/1359865613 conn(0x55b820729730 msgr2=0x55b820726d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:47.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.030+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 shutdown_connections 2024-04-24T02:12:47.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.030+0000 7f1d8892f800 1 -- 172.21.15.134:0/1359865613 wait complete. 2024-04-24T02:12:47.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.031+0000 7f1d8892f800 1 -- 172.21.15.134:0/3874180849 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1c5c036950 msgr2=0x7f1c5c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:47.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.031+0000 7f1d8892f800 1 --2- 172.21.15.134:0/3874180849 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1c5c036950 0x7f1c5c038e10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x55b8207101e0 tx=0x7f1d7c005840 comp rx=0 tx=0).stop 2024-04-24T02:12:47.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.031+0000 7f1d8892f800 1 -- 172.21.15.134:0/3874180849 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b820720150 msgr2=0x55b820720570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:47.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.031+0000 7f1d8892f800 1 --2- 172.21.15.134:0/3874180849 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b820720150 0x55b820720570 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c052540 tx=0x7f1d6c002fb0 comp rx=0 tx=0).stop 2024-04-24T02:12:47.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.031+0000 7f1d8892f800 1 -- 172.21.15.134:0/3874180849 shutdown_connections 2024-04-24T02:12:47.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.031+0000 7f1d8892f800 1 --2- 172.21.15.134:0/3874180849 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1c5c036950 0x7f1c5c038e10 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:47.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.031+0000 7f1d8892f800 1 --2- 172.21.15.134:0/3874180849 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b820720150 0x55b820720570 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:47.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.031+0000 7f1d8892f800 1 -- 172.21.15.134:0/3874180849 >> 172.21.15.134:0/3874180849 conn(0x55b8207141f0 msgr2=0x55b8207145f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:47.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.031+0000 7f1d8892f800 1 -- 172.21.15.134:0/3874180849 shutdown_connections 2024-04-24T02:12:47.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.031+0000 7f1d8892f800 1 -- 172.21.15.134:0/3874180849 wait complete. 2024-04-24T02:12:47.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.031+0000 7f1d8892f800 1 -- 172.21.15.134:0/464141447 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b8206101b0 msgr2=0x55b82070efc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:47.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.031+0000 7f1d8892f800 1 --2- 172.21.15.134:0/464141447 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b8206101b0 0x55b82070efc0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:47.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.031+0000 7f1d8892f800 1 -- 172.21.15.134:0/464141447 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1c6c036950 msgr2=0x7f1c6c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:47.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.031+0000 7f1d8892f800 1 --2- 172.21.15.134:0/464141447 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1c6c036950 0x7f1c6c038e10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c054000 tx=0x7f1d6c04e000 comp rx=0 tx=0).stop 2024-04-24T02:12:47.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.031+0000 7f1d8892f800 1 -- 172.21.15.134:0/464141447 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b82060bd20 msgr2=0x55b820707d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:12:47.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.031+0000 7f1d8892f800 1 --2- 172.21.15.134:0/464141447 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b82060bd20 0x55b820707d80 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f1d74004000 tx=0x7f1d74000bc0 comp rx=0 tx=0).stop 2024-04-24T02:12:47.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.031+0000 7f1d8892f800 1 -- 172.21.15.134:0/464141447 shutdown_connections 2024-04-24T02:12:47.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.031+0000 7f1d8892f800 1 --2- 172.21.15.134:0/464141447 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b8206101b0 0x55b82070efc0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:47.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.031+0000 7f1d8892f800 1 --2- 172.21.15.134:0/464141447 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1c6c036950 0x7f1c6c038e10 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:47.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.031+0000 7f1d8892f800 1 --2- 172.21.15.134:0/464141447 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b82060bd20 0x55b820707d80 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:12:47.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.031+0000 7f1d8892f800 1 -- 172.21.15.134:0/464141447 >> 172.21.15.134:0/464141447 conn(0x55b820607380 msgr2=0x55b8206f8c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:12:47.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.031+0000 7f1d8892f800 1 -- 172.21.15.134:0/464141447 shutdown_connections 2024-04-24T02:12:47.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:12:47.031+0000 7f1d8892f800 1 -- 172.21.15.134:0/464141447 wait complete. 2024-04-24T02:12:47.040 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-04-24T02:12:47.058 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T02:12:47.103 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-04-24T02:13:22.104 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-04-24T02:13:22.104 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-04-24T02:13:22.104 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-04-24T02:13:22.155 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:13:22.155 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:13:22.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.155+0000 7f4bbff36800 1 Processor -- start 2024-04-24T02:13:22.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.155+0000 7f4bbff36800 1 -- start start 2024-04-24T02:13:22.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.156+0000 7f4bbff36800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x561845e30210 0x561845e32600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.156+0000 7f4bbff36800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561845cebd40 con 0x561845e2c260 2024-04-24T02:13:22.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.156+0000 7f4bbff36800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x561845cbe4d0 con 0x561845e30210 2024-04-24T02:13:22.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.156+0000 7f4bbb4cb640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x561845e30210 0x561845e32600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.156+0000 7f4bbb4cb640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x561845e30210 0x561845e32600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55048/0 (socket says 172.21.15.134:55048) 2024-04-24T02:13:22.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.156+0000 7f4bbb4cb640 1 -- 172.21.15.134:0/918088863 learned_addr learned my addr 172.21.15.134:0/918088863 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:22.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.156+0000 7f4bbb4cb640 1 -- 172.21.15.134:0/918088863 >> v1:172.21.15.104:6789/0 conn(0x561845e2c260 legacy=0x561845e2c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.156+0000 7f4bbb4cb640 1 -- 172.21.15.134:0/918088863 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561845cea590 con 0x561845e30210 2024-04-24T02:13:22.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.158+0000 7f4bbb4cb640 1 --2- 172.21.15.134:0/918088863 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561845e30210 0x561845e32600 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f4bb000a520 tx=0x7f4bb001d0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f946c06d42ef79fc server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.158+0000 7f4bbacca640 1 -- 172.21.15.134:0/918088863 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bb0057070 con 0x561845e30210 2024-04-24T02:13:22.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.159+0000 7f4bbacca640 1 -- 172.21.15.134:0/918088863 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bb004ae50 con 0x561845e30210 2024-04-24T02:13:22.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.159+0000 7f4bbacca640 1 -- 172.21.15.134:0/918088863 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bb00526c0 con 0x561845e30210 2024-04-24T02:13:22.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.159+0000 7f4bbff36800 1 -- 172.21.15.134:0/918088863 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561845e30210 msgr2=0x561845e32600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.159+0000 7f4bbff36800 1 --2- 172.21.15.134:0/918088863 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561845e30210 0x561845e32600 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f4bb000a520 tx=0x7f4bb001d0a0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.159+0000 7f4bbff36800 1 -- 172.21.15.134:0/918088863 shutdown_connections 2024-04-24T02:13:22.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.159+0000 7f4bbff36800 1 --2- 172.21.15.134:0/918088863 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561845e30210 0x561845e32600 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.159+0000 7f4bbff36800 1 -- 172.21.15.134:0/918088863 >> 172.21.15.134:0/918088863 conn(0x561845e26b00 msgr2=0x561845e28f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:22.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.159+0000 7f4bbff36800 1 -- 172.21.15.134:0/918088863 shutdown_connections 2024-04-24T02:13:22.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.159+0000 7f4bbff36800 1 -- 172.21.15.134:0/918088863 wait complete. 2024-04-24T02:13:22.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.173+0000 7f4bbff36800 1 Processor -- start 2024-04-24T02:13:22.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.173+0000 7f4bbff36800 1 -- start start 2024-04-24T02:13:22.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.173+0000 7f4bbff36800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561845e2c260 0x561845e2b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.173+0000 7f4bbff36800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x561845d783c0 con 0x561845e2c260 2024-04-24T02:13:22.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.173+0000 7f4bbbccc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561845e2c260 0x561845e2b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.173+0000 7f4bbbccc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561845e2c260 0x561845e2b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55052/0 (socket says 172.21.15.134:55052) 2024-04-24T02:13:22.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.173+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3429863790 learned_addr learned my addr 172.21.15.134:0/3429863790 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:22.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.173+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3429863790 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561845f1ec10 con 0x561845e2c260 2024-04-24T02:13:22.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.174+0000 7f4bbbccc640 1 --2- 172.21.15.134:0/3429863790 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561845e2c260 0x561845e2b960 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f4bac001620 tx=0x7f4bac001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31e7eee29c49ab76 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.174+0000 7f4aa9e0b640 1 -- 172.21.15.134:0/3429863790 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bac016070 con 0x561845e2c260 2024-04-24T02:13:22.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.174+0000 7f4aa9e0b640 1 -- 172.21.15.134:0/3429863790 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bac00f640 con 0x561845e2c260 2024-04-24T02:13:22.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.174+0000 7f4aa9e0b640 1 -- 172.21.15.134:0/3429863790 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bac00f9a0 con 0x561845e2c260 2024-04-24T02:13:22.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.175+0000 7f4bbff36800 1 -- 172.21.15.134:0/3429863790 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561845e2c260 msgr2=0x561845e2b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.175+0000 7f4bbff36800 1 --2- 172.21.15.134:0/3429863790 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561845e2c260 0x561845e2b960 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f4bac001620 tx=0x7f4bac001ae0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.175+0000 7f4bbff36800 1 -- 172.21.15.134:0/3429863790 shutdown_connections 2024-04-24T02:13:22.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.175+0000 7f4bbff36800 1 --2- 172.21.15.134:0/3429863790 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561845e2c260 0x561845e2b960 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.175+0000 7f4bbff36800 1 -- 172.21.15.134:0/3429863790 >> 172.21.15.134:0/3429863790 conn(0x561845e26b00 msgr2=0x561845f18910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:22.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.175+0000 7f4bbff36800 1 -- 172.21.15.134:0/3429863790 shutdown_connections 2024-04-24T02:13:22.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.175+0000 7f4bbff36800 1 -- 172.21.15.134:0/3429863790 wait complete. 2024-04-24T02:13:22.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.175+0000 7f4bbff36800 1 Processor -- start 2024-04-24T02:13:22.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.175+0000 7f4bbff36800 1 -- start start 2024-04-24T02:13:22.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.175+0000 7f4bbff36800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561845e2c260 0x561845f27f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.175+0000 7f4bbff36800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x561845e32e40 con 0x561845e2c260 2024-04-24T02:13:22.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.175+0000 7f4bbbccc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561845e2c260 0x561845f27f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.175+0000 7f4bbbccc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561845e2c260 0x561845f27f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55058/0 (socket says 172.21.15.134:55058) 2024-04-24T02:13:22.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.175+0000 7f4bbbccc640 1 -- 172.21.15.134:0/226788234 learned_addr learned my addr 172.21.15.134:0/226788234 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:22.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.176+0000 7f4bbbccc640 1 -- 172.21.15.134:0/226788234 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561845f28440 con 0x561845e2c260 2024-04-24T02:13:22.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.176+0000 7f4bbbccc640 1 --2- 172.21.15.134:0/226788234 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561845e2c260 0x561845f27f00 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f4bac00f610 tx=0x7f4bac001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.176+0000 7f4aa3fff640 1 -- 172.21.15.134:0/226788234 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bac021020 con 0x561845e2c260 2024-04-24T02:13:22.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.176+0000 7f4aa3fff640 1 -- 172.21.15.134:0/226788234 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bac0117c0 con 0x561845e2c260 2024-04-24T02:13:22.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.176+0000 7f4aa3fff640 1 -- 172.21.15.134:0/226788234 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bac016040 con 0x561845e2c260 2024-04-24T02:13:22.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.176+0000 7f4bbff36800 1 -- 172.21.15.134:0/226788234 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561845f286d0 con 0x561845e2c260 2024-04-24T02:13:22.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.176+0000 7f4bbff36800 1 -- 172.21.15.134:0/226788234 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561845f2b380 con 0x561845e2c260 2024-04-24T02:13:22.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.177+0000 7f4aa3fff640 1 -- 172.21.15.134:0/226788234 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4bac024020 con 0x561845e2c260 2024-04-24T02:13:22.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.177+0000 7f4aa3fff640 1 --2- 172.21.15.134:0/226788234 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4aa4036900 0x7f4aa4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.178+0000 7f4aa3fff640 1 -- 172.21.15.134:0/226788234 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f4bac04bf20 con 0x561845e2c260 2024-04-24T02:13:22.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.178+0000 7f4bbb4cb640 1 --2- 172.21.15.134:0/226788234 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4aa4036900 0x7f4aa4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.178+0000 7f4bbff36800 1 --2- 172.21.15.134:0/226788234 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x561845e30210 0x561845f2f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.178+0000 7f4bbff36800 1 -- 172.21.15.134:0/226788234 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561845f2f680 con 0x561845e30210 2024-04-24T02:13:22.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.178+0000 7f4bbc4cd640 1 --2- 172.21.15.134:0/226788234 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x561845e30210 0x561845f2f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.178+0000 7f4bbb4cb640 1 --2- 172.21.15.134:0/226788234 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4aa4036900 0x7f4aa4038dc0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4bb0054000 tx=0x7f4bb004e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.178+0000 7f4bbc4cd640 1 --2- 172.21.15.134:0/226788234 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x561845e30210 0x561845f2f140 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.179+0000 7f4bbc4cd640 1 -- 172.21.15.134:0/226788234 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4bb40083e0 con 0x561845e30210 2024-04-24T02:13:22.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.179+0000 7f4bbff36800 1 -- 172.21.15.134:0/226788234 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561845f2c6f0 con 0x561845e30210 2024-04-24T02:13:22.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.179+0000 7f4bbc4cd640 1 -- 172.21.15.134:0/226788234 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4bb40083e0 con 0x561845e30210 2024-04-24T02:13:22.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.179+0000 7f4bbff36800 1 -- 172.21.15.134:0/226788234 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561845f31480 con 0x561845e30210 2024-04-24T02:13:22.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.179+0000 7f4bbc4cd640 1 -- 172.21.15.134:0/226788234 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4bb40083e0 con 0x561845e30210 2024-04-24T02:13:22.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.179+0000 7f4bbff36800 1 -- 172.21.15.134:0/226788234 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561845f307c0 con 0x561845e30210 2024-04-24T02:13:22.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.179+0000 7f4bbc4cd640 1 -- 172.21.15.134:0/226788234 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4bb40083e0 con 0x561845e30210 2024-04-24T02:13:22.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.179+0000 7f4bbff36800 1 -- 172.21.15.134:0/226788234 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561845f30be0 con 0x561845e30210 2024-04-24T02:13:22.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.180+0000 7f4bbc4cd640 1 -- 172.21.15.134:0/226788234 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4bb40083e0 con 0x561845e30210 2024-04-24T02:13:22.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.180+0000 7f4bbff36800 1 Processor -- start 2024-04-24T02:13:22.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.180+0000 7f4bbff36800 1 -- start start 2024-04-24T02:13:22.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.180+0000 7f4bbff36800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561845f40310 0x561845f40730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.180+0000 7f4bbff36800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x561845d1e6b0 con 0x561845f40310 2024-04-24T02:13:22.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.181+0000 7f4bbb4cb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561845f40310 0x561845f40730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.181+0000 7f4bbb4cb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561845f40310 0x561845f40730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55066/0 (socket says 172.21.15.134:55066) 2024-04-24T02:13:22.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.181+0000 7f4bbb4cb640 1 -- 172.21.15.134:0/3862772050 learned_addr learned my addr 172.21.15.134:0/3862772050 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:22.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.181+0000 7f4bbb4cb640 1 -- 172.21.15.134:0/3862772050 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561845f40c70 con 0x561845f40310 2024-04-24T02:13:22.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.181+0000 7f4bbb4cb640 1 --2- 172.21.15.134:0/3862772050 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561845f40310 0x561845f40730 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f4bb0000c00 tx=0x7f4bb0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.181+0000 7f4aa17fa640 1 -- 172.21.15.134:0/3862772050 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bb0057040 con 0x561845f40310 2024-04-24T02:13:22.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.181+0000 7f4aa17fa640 1 -- 172.21.15.134:0/3862772050 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bb006d070 con 0x561845f40310 2024-04-24T02:13:22.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.181+0000 7f4bbff36800 1 -- 172.21.15.134:0/3862772050 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561845f416e0 con 0x561845f40310 2024-04-24T02:13:22.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.181+0000 7f4aa17fa640 1 -- 172.21.15.134:0/3862772050 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bb005d970 con 0x561845f40310 2024-04-24T02:13:22.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.181+0000 7f4bbff36800 1 -- 172.21.15.134:0/3862772050 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561845f41b80 con 0x561845f40310 2024-04-24T02:13:22.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.182+0000 7f4aa17fa640 1 -- 172.21.15.134:0/3862772050 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4bb0067070 con 0x561845f40310 2024-04-24T02:13:22.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.182+0000 7f4aa17fa640 1 --2- 172.21.15.134:0/3862772050 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4a94036950 0x7f4a94038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.182+0000 7f4aa17fa640 1 -- 172.21.15.134:0/3862772050 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f4bb008f6c0 con 0x561845f40310 2024-04-24T02:13:22.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.183+0000 7f4bbc4cd640 1 --2- 172.21.15.134:0/3862772050 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4a94036950 0x7f4a94038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.183+0000 7f4bbff36800 1 Processor -- start 2024-04-24T02:13:22.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.183+0000 7f4bbff36800 1 -- start start 2024-04-24T02:13:22.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.183+0000 7f4bbc4cd640 1 --2- 172.21.15.134:0/3862772050 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4a94036950 0x7f4a94038e10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x561845f30b60 tx=0x7f4bb4000f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.183+0000 7f4bbff36800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561845f4d590 0x561845f4d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.183+0000 7f4bbff36800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x561845f233a0 con 0x561845f4d590 2024-04-24T02:13:22.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.183+0000 7f4bbb4cb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561845f4d590 0x561845f4d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.183+0000 7f4bbb4cb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561845f4d590 0x561845f4d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55082/0 (socket says 172.21.15.134:55082) 2024-04-24T02:13:22.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.183+0000 7f4bbb4cb640 1 -- 172.21.15.134:0/2875384266 learned_addr learned my addr 172.21.15.134:0/2875384266 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:22.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.183+0000 7f4bbb4cb640 1 -- 172.21.15.134:0/2875384266 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561845f4df80 con 0x561845f4d590 2024-04-24T02:13:22.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.184+0000 7f4bbb4cb640 1 --2- 172.21.15.134:0/2875384266 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561845f4d590 0x561845f4d9b0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f4bb0052fd0 tx=0x7f4bb0067cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33579cc22c8b4e0a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.184+0000 7f4a9affd640 1 -- 172.21.15.134:0/2875384266 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bb0080070 con 0x561845f4d590 2024-04-24T02:13:22.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.184+0000 7f4a9affd640 1 -- 172.21.15.134:0/2875384266 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bb0072980 con 0x561845f4d590 2024-04-24T02:13:22.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.184+0000 7f4a9affd640 1 -- 172.21.15.134:0/2875384266 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bb008b030 con 0x561845f4d590 2024-04-24T02:13:22.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.184+0000 7f4bbff36800 1 -- 172.21.15.134:0/2875384266 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561845f4d590 msgr2=0x561845f4d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.184+0000 7f4bbff36800 1 --2- 172.21.15.134:0/2875384266 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561845f4d590 0x561845f4d9b0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f4bb0052fd0 tx=0x7f4bb0067cb0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.184+0000 7f4bbff36800 1 -- 172.21.15.134:0/2875384266 shutdown_connections 2024-04-24T02:13:22.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.184+0000 7f4bbff36800 1 --2- 172.21.15.134:0/2875384266 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561845f4d590 0x561845f4d9b0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.184+0000 7f4bbff36800 1 -- 172.21.15.134:0/2875384266 >> 172.21.15.134:0/2875384266 conn(0x561845f498f0 msgr2=0x561845f47950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:22.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.184+0000 7f4bbff36800 1 -- 172.21.15.134:0/2875384266 shutdown_connections 2024-04-24T02:13:22.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.184+0000 7f4bbff36800 1 -- 172.21.15.134:0/2875384266 wait complete. 2024-04-24T02:13:22.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.185+0000 7f4bbff36800 1 Processor -- start 2024-04-24T02:13:22.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.185+0000 7f4bbff36800 1 -- start start 2024-04-24T02:13:22.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.185+0000 7f4bbff36800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561845f4d590 0x561845f54c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.185+0000 7f4bbff36800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x561845f4e6f0 con 0x561845f4d590 2024-04-24T02:13:22.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.185+0000 7f4bbb4cb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561845f4d590 0x561845f54c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.185+0000 7f4bbb4cb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561845f4d590 0x561845f54c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55088/0 (socket says 172.21.15.134:55088) 2024-04-24T02:13:22.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.185+0000 7f4bbb4cb640 1 -- 172.21.15.134:0/3030913965 learned_addr learned my addr 172.21.15.134:0/3030913965 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:22.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.186+0000 7f4bbb4cb640 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561845f55140 con 0x561845f4d590 2024-04-24T02:13:22.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.186+0000 7f4bbb4cb640 1 --2- 172.21.15.134:0/3030913965 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561845f4d590 0x561845f54c00 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f4bb0052fd0 tx=0x7f4bb008da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.186+0000 7f4a997fa640 1 -- 172.21.15.134:0/3030913965 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bb0080040 con 0x561845f4d590 2024-04-24T02:13:22.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.186+0000 7f4a997fa640 1 -- 172.21.15.134:0/3030913965 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bb0094070 con 0x561845f4d590 2024-04-24T02:13:22.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.186+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561845f553d0 con 0x561845f4d590 2024-04-24T02:13:22.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.186+0000 7f4a997fa640 1 -- 172.21.15.134:0/3030913965 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bb008f4c0 con 0x561845f4d590 2024-04-24T02:13:22.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.186+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561845f58080 con 0x561845f4d590 2024-04-24T02:13:22.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.187+0000 7f4a997fa640 1 -- 172.21.15.134:0/3030913965 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4bb0083070 con 0x561845f4d590 2024-04-24T02:13:22.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.187+0000 7f4bbff36800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.187+0000 7f4a997fa640 1 --2- 172.21.15.134:0/3030913965 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4a84036950 0x7f4a84038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.187+0000 7f4a997fa640 1 -- 172.21.15.134:0/3030913965 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f4bb009ac10 con 0x561845f4d590 2024-04-24T02:13:22.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.187+0000 7f4bbc4cd640 1 --2- 172.21.15.134:0/3030913965 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4a84036950 0x7f4a84038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.187+0000 7f4bbff36800 1 --2- 172.21.15.134:0/3030913965 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x561845f60730 0x561845f62bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.187+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561845f63320 con 0x561845f60730 2024-04-24T02:13:22.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.187+0000 7f4bbbccc640 1 --2- 172.21.15.134:0/3030913965 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x561845f60730 0x561845f62bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.188+0000 7f4bbc4cd640 1 --2- 172.21.15.134:0/3030913965 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4a84036950 0x7f4a84038e10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4bb400f010 tx=0x7f4bb400c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.188+0000 7f4bbbccc640 1 --2- 172.21.15.134:0/3030913965 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x561845f60730 0x561845f62bd0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.188+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4bac00f070 con 0x561845f60730 2024-04-24T02:13:22.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.188+0000 7f4bbff36800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:22.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.188+0000 7f4bbff36800 20 realm 2024-04-24T02:13:22.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.188+0000 7f4bbff36800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.188+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561845f63730 con 0x561845f60730 2024-04-24T02:13:22.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.188+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4bac00f070 con 0x561845f60730 2024-04-24T02:13:22.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.188+0000 7f4bbff36800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:22.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.188+0000 7f4bbff36800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:13:22.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.188+0000 7f4bbff36800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.188+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561845f64000 con 0x561845f60730 2024-04-24T02:13:22.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.188+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4bac00f070 con 0x561845f60730 2024-04-24T02:13:22.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.189+0000 7f4bbff36800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:22.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.189+0000 7f4bbff36800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.189+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561845f643a0 con 0x561845f60730 2024-04-24T02:13:22.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.189+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4bac00f070 con 0x561845f60730 2024-04-24T02:13:22.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.189+0000 7f4bbff36800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:13:22.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.189+0000 7f4bbff36800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.189+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561845f64800 con 0x561845f60730 2024-04-24T02:13:22.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.189+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4bac00f070 con 0x561845f60730 2024-04-24T02:13:22.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.189+0000 7f4bbff36800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:13:22.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.189+0000 7f4bbff36800 20 searching for the correct realm 2024-04-24T02:13:22.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.189+0000 7f4bbff36800 1 --2- 172.21.15.134:0/3030913965 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x561845f66850 0x561845f68c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.189+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561845f692f0 con 0x561845f66850 2024-04-24T02:13:22.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.189+0000 7f4bbb4cb640 1 --2- 172.21.15.134:0/3030913965 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x561845f66850 0x561845f68c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.190+0000 7f4bbb4cb640 1 --2- 172.21.15.134:0/3030913965 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x561845f66850 0x561845f68c40 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.190+0000 7f4bbb4cb640 1 -- 172.21.15.134:0/3030913965 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb0066030 con 0x561845f66850 2024-04-24T02:13:22.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.190+0000 7f4bbb4cb640 1 --2- 172.21.15.134:0/3030913965 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f4bb0068c20 0x7f4bb007b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.190+0000 7f4bbb4cb640 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561845f692f0 con 0x7f4bb0068c20 2024-04-24T02:13:22.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.190+0000 7f4bbc4cd640 1 --2- 172.21.15.134:0/3030913965 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f4bb0068c20 0x7f4bb007b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.190+0000 7f4bbc4cd640 1 --2- 172.21.15.134:0/3030913965 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f4bb0068c20 0x7f4bb007b420 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.191+0000 7f4bbc4cd640 1 -- 172.21.15.134:0/3030913965 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb402f040 con 0x7f4bb0068c20 2024-04-24T02:13:22.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.191+0000 7f4bbc4cd640 1 --2- 172.21.15.134:0/3030913965 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f4bb4019040 0x7f4bb4019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.191+0000 7f4bbc4cd640 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561845f692f0 con 0x7f4bb4019040 2024-04-24T02:13:22.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.191+0000 7f4bbbccc640 1 --2- 172.21.15.134:0/3030913965 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f4bb4019040 0x7f4bb4019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.191+0000 7f4bbbccc640 1 --2- 172.21.15.134:0/3030913965 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f4bb4019040 0x7f4bb4019930 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.192+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bac00f070 con 0x7f4bb4019040 2024-04-24T02:13:22.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.192+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561845f692f0 con 0x561845f60730 2024-04-24T02:13:22.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.192+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bac00f070 con 0x561845f60730 2024-04-24T02:13:22.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.192+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561845f692f0 con 0x561845f60730 2024-04-24T02:13:22.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.192+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4bac00f070 con 0x561845f60730 2024-04-24T02:13:22.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.192+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561845f692f0 con 0x7f4bb4019040 2024-04-24T02:13:22.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.193+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bac00f070 con 0x7f4bb4019040 2024-04-24T02:13:22.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.193+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561845f692f0 con 0x7f4bb0068c20 2024-04-24T02:13:22.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.193+0000 7f4bbc4cd640 1 -- 172.21.15.134:0/3030913965 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb402f040 con 0x7f4bb0068c20 2024-04-24T02:13:22.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.193+0000 7f4bbc4cd640 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561845f692f0 con 0x7f4bb0068c20 2024-04-24T02:13:22.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.193+0000 7f4bbc4cd640 1 -- 172.21.15.134:0/3030913965 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb402f040 con 0x7f4bb0068c20 2024-04-24T02:13:22.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.193+0000 7f4bbc4cd640 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561845f692f0 con 0x561845f66850 2024-04-24T02:13:22.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.193+0000 7f4bbb4cb640 1 -- 172.21.15.134:0/3030913965 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb0066030 con 0x561845f66850 2024-04-24T02:13:22.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.193+0000 7f4bbb4cb640 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561845f692f0 con 0x561845f60730 2024-04-24T02:13:22.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.194+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bac00f070 con 0x561845f60730 2024-04-24T02:13:22.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.194+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561845f692f0 con 0x7f4bb4019040 2024-04-24T02:13:22.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.194+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bac00f070 con 0x7f4bb4019040 2024-04-24T02:13:22.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.194+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561845f692f0 con 0x561845f60730 2024-04-24T02:13:22.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.194+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bac00f070 con 0x561845f60730 2024-04-24T02:13:22.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.194+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561845f692f0 con 0x7f4bb0068c20 2024-04-24T02:13:22.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.194+0000 7f4bbc4cd640 1 -- 172.21.15.134:0/3030913965 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4bb402f040 con 0x7f4bb0068c20 2024-04-24T02:13:22.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.194+0000 7f4bbc4cd640 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561845f692f0 con 0x561845f66850 2024-04-24T02:13:22.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.195+0000 7f4bbb4cb640 1 -- 172.21.15.134:0/3030913965 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb0066030 con 0x561845f66850 2024-04-24T02:13:22.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.195+0000 7f4bbb4cb640 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561845f692f0 con 0x561845f66850 2024-04-24T02:13:22.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.195+0000 7f4bbb4cb640 1 -- 172.21.15.134:0/3030913965 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb0066030 con 0x561845f66850 2024-04-24T02:13:22.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.195+0000 7f4bbb4cb640 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561845f692f0 con 0x7f4bb0068c20 2024-04-24T02:13:22.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.195+0000 7f4bbc4cd640 1 -- 172.21.15.134:0/3030913965 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb402f040 con 0x7f4bb0068c20 2024-04-24T02:13:22.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.195+0000 7f4bbc4cd640 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561845f692f0 con 0x561845f66850 2024-04-24T02:13:22.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.195+0000 7f4bbb4cb640 1 -- 172.21.15.134:0/3030913965 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb0066030 con 0x561845f66850 2024-04-24T02:13:22.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.195+0000 7f4bbb4cb640 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561845f692f0 con 0x561845f66850 2024-04-24T02:13:22.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.196+0000 7f4bbb4cb640 1 -- 172.21.15.134:0/3030913965 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb0066030 con 0x561845f66850 2024-04-24T02:13:22.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.196+0000 7f4bbb4cb640 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561845f692f0 con 0x561845f60730 2024-04-24T02:13:22.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.196+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bac00f070 con 0x561845f60730 2024-04-24T02:13:22.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.196+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561845f692f0 con 0x561845f60730 2024-04-24T02:13:22.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.196+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f4bac00f070 con 0x561845f60730 2024-04-24T02:13:22.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.196+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561845f692f0 con 0x7f4bb4019040 2024-04-24T02:13:22.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.196+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bac00f070 con 0x7f4bb4019040 2024-04-24T02:13:22.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.196+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561845f692f0 con 0x561845f66850 2024-04-24T02:13:22.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.197+0000 7f4bbb4cb640 1 -- 172.21.15.134:0/3030913965 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb0066030 con 0x561845f66850 2024-04-24T02:13:22.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.197+0000 7f4bbb4cb640 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561845f692f0 con 0x7f4bb0068c20 2024-04-24T02:13:22.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.197+0000 7f4bbc4cd640 1 -- 172.21.15.134:0/3030913965 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb402f040 con 0x7f4bb0068c20 2024-04-24T02:13:22.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.197+0000 7f4bbc4cd640 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561845f692f0 con 0x561845f60730 2024-04-24T02:13:22.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.197+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bac00f070 con 0x561845f60730 2024-04-24T02:13:22.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.197+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561845f692f0 con 0x7f4bb4019040 2024-04-24T02:13:22.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.198+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bac00f070 con 0x7f4bb4019040 2024-04-24T02:13:22.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.198+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561845f692f0 con 0x561845f66850 2024-04-24T02:13:22.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.198+0000 7f4bbb4cb640 1 -- 172.21.15.134:0/3030913965 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb0066030 con 0x561845f66850 2024-04-24T02:13:22.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.198+0000 7f4bbb4cb640 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561845f692f0 con 0x7f4bb4019040 2024-04-24T02:13:22.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.198+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bac00f070 con 0x7f4bb4019040 2024-04-24T02:13:22.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.198+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561845f692f0 con 0x7f4bb0068c20 2024-04-24T02:13:22.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.198+0000 7f4bbc4cd640 1 -- 172.21.15.134:0/3030913965 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb402f040 con 0x7f4bb0068c20 2024-04-24T02:13:22.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.198+0000 7f4bbc4cd640 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561845f692f0 con 0x561845f66850 2024-04-24T02:13:22.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.199+0000 7f4bbb4cb640 1 -- 172.21.15.134:0/3030913965 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb0066030 con 0x561845f66850 2024-04-24T02:13:22.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.199+0000 7f4bbb4cb640 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561845f692f0 con 0x7f4bb0068c20 2024-04-24T02:13:22.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.199+0000 7f4bbc4cd640 1 -- 172.21.15.134:0/3030913965 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb402f040 con 0x7f4bb0068c20 2024-04-24T02:13:22.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.199+0000 7f4bbc4cd640 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561845f692f0 con 0x561845f60730 2024-04-24T02:13:22.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.199+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4bac00f070 con 0x561845f60730 2024-04-24T02:13:22.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.199+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561845f692f0 con 0x7f4bb0068c20 2024-04-24T02:13:22.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.199+0000 7f4bbc4cd640 1 -- 172.21.15.134:0/3030913965 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb402f040 con 0x7f4bb0068c20 2024-04-24T02:13:22.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.199+0000 7f4bbff36800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:13:22.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.199+0000 7f4bbff36800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:13:22.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.199+0000 7f4bbff36800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:13:22.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.199+0000 7f4bbff36800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:13:22.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.199+0000 7f4bbff36800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:13:22.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.199+0000 7f4bbff36800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:13:22.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.199+0000 7f4bbff36800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.199+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561845f652d0 con 0x561845f60730 2024-04-24T02:13:22.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.200+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4bac00f070 con 0x561845f60730 2024-04-24T02:13:22.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.200+0000 7f4bbff36800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:22.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.200+0000 7f4bbff36800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.200+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561845f65b70 con 0x561845f60730 2024-04-24T02:13:22.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.200+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4bac00f070 con 0x561845f60730 2024-04-24T02:13:22.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.200+0000 7f4bbff36800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:13:22.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.200+0000 7f4bbff36800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.200+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561845f64f10 con 0x561845f60730 2024-04-24T02:13:22.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.200+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4bac00f070 con 0x561845f60730 2024-04-24T02:13:22.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.200+0000 7f4bbff36800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:13:22.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.200+0000 7f4bbff36800 20 zone default found 2024-04-24T02:13:22.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.200+0000 7f4bbff36800 4 Realm: () 2024-04-24T02:13:22.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.200+0000 7f4bbff36800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:13:22.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.200+0000 7f4bbff36800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:13:22.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.200+0000 7f4bbff36800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:13:22.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.200+0000 7f4bbff36800 20 zonegroup default 2024-04-24T02:13:22.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.200+0000 7f4bbff36800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.200+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561845f65b70 con 0x7f4bb4019040 2024-04-24T02:13:22.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.201+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4bac00f070 con 0x7f4bb4019040 2024-04-24T02:13:22.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.201+0000 7f4bbff36800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:22.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.201+0000 7f4bbff36800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.201+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561845f6b130 con 0x561845f66850 2024-04-24T02:13:22.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.201+0000 7f4bbb4cb640 1 -- 172.21.15.134:0/3030913965 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4bb0066030 con 0x561845f66850 2024-04-24T02:13:22.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.201+0000 7f4bbff36800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:22.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.201+0000 7f4bbff36800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.201+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561845f6b520 con 0x561845f66850 2024-04-24T02:13:22.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.201+0000 7f4bbb4cb640 1 -- 172.21.15.134:0/3030913965 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4bb0066030 con 0x561845f66850 2024-04-24T02:13:22.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.201+0000 7f4bbff36800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:22.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.201+0000 7f4bbff36800 20 started sync module instance, tier type = 2024-04-24T02:13:22.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.201+0000 7f4bbff36800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:13:22.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.201+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561845f6a5d0 con 0x7f4bb0068c20 2024-04-24T02:13:22.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.202+0000 7f4bbc4cd640 1 -- 172.21.15.134:0/3030913965 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(44 notify.0 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bb402f040 con 0x7f4bb0068c20 2024-04-24T02:13:22.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.202+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94662252997328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561845f6a5d0 con 0x7f4bb0068c20 2024-04-24T02:13:22.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.202+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561845f6c060 con 0x561845f60730 2024-04-24T02:13:22.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.203+0000 7f4bbc4cd640 1 -- 172.21.15.134:0/3030913965 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94662252997328] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bb402f040 con 0x7f4bb0068c20 2024-04-24T02:13:22.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.204+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bac00f070 con 0x561845f60730 2024-04-24T02:13:22.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.204+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94662253001552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561845f6a5d0 con 0x561845f60730 2024-04-24T02:13:22.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.204+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561845f6cab0 con 0x561845f66850 2024-04-24T02:13:22.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.205+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94662253001552] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bac00f070 con 0x561845f60730 2024-04-24T02:13:22.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.205+0000 7f4bbb4cb640 1 -- 172.21.15.134:0/3030913965 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bb0066030 con 0x561845f66850 2024-04-24T02:13:22.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.205+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94662252994848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561845f6a540 con 0x561845f66850 2024-04-24T02:13:22.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.206+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561845f6d9a0 con 0x7f4bb0068c20 2024-04-24T02:13:22.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.207+0000 7f4bbc4cd640 1 -- 172.21.15.134:0/3030913965 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(50 notify.3 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bb402f040 con 0x7f4bb0068c20 2024-04-24T02:13:22.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.207+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94662253008592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561845f6e120 con 0x7f4bb0068c20 2024-04-24T02:13:22.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.207+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561845f6ec40 con 0x561845f60730 2024-04-24T02:13:22.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.207+0000 7f4bbb4cb640 1 -- 172.21.15.134:0/3030913965 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94662252994848] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bb0066030 con 0x561845f66850 2024-04-24T02:13:22.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.208+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bac00f070 con 0x561845f60730 2024-04-24T02:13:22.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.208+0000 7f4bbc4cd640 1 -- 172.21.15.134:0/3030913965 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94662253008592] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bb402f040 con 0x7f4bb0068c20 2024-04-24T02:13:22.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.208+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94662253012752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561845f6ec00 con 0x561845f60730 2024-04-24T02:13:22.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.208+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561845f6dbb0 con 0x7f4bb4019040 2024-04-24T02:13:22.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.209+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(54 notify.5 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bac00f070 con 0x7f4bb4019040 2024-04-24T02:13:22.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.209+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94662253014016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561845f6f680 con 0x7f4bb4019040 2024-04-24T02:13:22.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.209+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561845f700a0 con 0x7f4bb4019040 2024-04-24T02:13:22.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.209+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94662253012752] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bac00f070 con 0x561845f60730 2024-04-24T02:13:22.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.210+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94662253014016] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bac00f070 con 0x7f4bb4019040 2024-04-24T02:13:22.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.210+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(56 notify.6 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bac00f070 con 0x7f4bb4019040 2024-04-24T02:13:22.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.210+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94662253006544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561845f6f680 con 0x7f4bb4019040 2024-04-24T02:13:22.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.210+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561845f70510 con 0x7f4bb4019040 2024-04-24T02:13:22.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.211+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(58 notify.7 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bac00f070 con 0x7f4bb4019040 2024-04-24T02:13:22.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.211+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94662253019232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561845f70930 con 0x7f4bb4019040 2024-04-24T02:13:22.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.211+0000 7f4bbff36800 20 add_watcher() i=0 2024-04-24T02:13:22.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.211+0000 7f4bbff36800 20 add_watcher() i=1 2024-04-24T02:13:22.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.211+0000 7f4bbff36800 20 add_watcher() i=2 2024-04-24T02:13:22.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.211+0000 7f4bbff36800 20 add_watcher() i=3 2024-04-24T02:13:22.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.211+0000 7f4bbff36800 20 add_watcher() i=4 2024-04-24T02:13:22.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.211+0000 7f4bbff36800 20 add_watcher() i=5 2024-04-24T02:13:22.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.211+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94662253006544] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bac00f070 con 0x7f4bb4019040 2024-04-24T02:13:22.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.211+0000 7f4bbff36800 20 add_watcher() i=6 2024-04-24T02:13:22.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.212+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94662253019232] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bac00f070 con 0x7f4bb4019040 2024-04-24T02:13:22.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.212+0000 7f4bbff36800 20 add_watcher() i=7 2024-04-24T02:13:22.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.212+0000 7f4bbff36800 2 all 8 watchers are set, enabling cache 2024-04-24T02:13:22.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.212+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561845f70930 con 0x561845f60730 2024-04-24T02:13:22.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.213+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4bac00f070 con 0x561845f60730 2024-04-24T02:13:22.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.213+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94662253020288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561845f708a0 con 0x561845f60730 2024-04-24T02:13:22.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.214+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94662253020288] v32'203 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4bac00f070 con 0x561845f60730 2024-04-24T02:13:22.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.214+0000 7f4a71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:13:22.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.214+0000 7f4bbff36800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:13:22.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.214+0000 7f4bbff36800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:13:22.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.214+0000 7f4bbff36800 5 note: GC not initialized 2024-04-24T02:13:22.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.214+0000 7f4a70fe1640 20 reqs_thread_entry: start 2024-04-24T02:13:22.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.214+0000 7f4bbff36800 20 init_complete bucket index max shards: 11 2024-04-24T02:13:22.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.214+0000 7f4bbff36800 20 Filter name: none 2024-04-24T02:13:22.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.214+0000 7f49ea7fc640 20 reqs_thread_entry: start 2024-04-24T02:13:22.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.214+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561845fa7280 con 0x561845f60730 2024-04-24T02:13:22.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.215+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4bac00f070 con 0x561845f60730 2024-04-24T02:13:22.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.215+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561845fa7280 con 0x7f4bb0068c20 2024-04-24T02:13:22.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.215+0000 7f4bbc4cd640 1 -- 172.21.15.134:0/3030913965 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4bb402f040 con 0x7f4bb0068c20 2024-04-24T02:13:22.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.215+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561845fa72a0 con 0x561845f60730 2024-04-24T02:13:22.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.215+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4bac00f070 con 0x561845f60730 2024-04-24T02:13:22.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.215+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561845fa7260 con 0x561845f66850 2024-04-24T02:13:22.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.215+0000 7f4bbb4cb640 1 -- 172.21.15.134:0/3030913965 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4bb0066030 con 0x561845f66850 2024-04-24T02:13:22.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.215+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561845fa77b0 con 0x561845f66850 2024-04-24T02:13:22.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.216+0000 7f4bbb4cb640 1 -- 172.21.15.134:0/3030913965 <== osd.3 v2:172.21.15.134:6801/3585115521 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4bb0066030 con 0x561845f66850 2024-04-24T02:13:22.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.216+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561845fa7b70 con 0x561845f66850 2024-04-24T02:13:22.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.216+0000 7f4bbb4cb640 1 -- 172.21.15.134:0/3030913965 <== osd.3 v2:172.21.15.134:6801/3585115521 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4bb0066030 con 0x561845f66850 2024-04-24T02:13:22.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.216+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561845fa7b70 con 0x561845f60730 2024-04-24T02:13:22.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.216+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4bac00f070 con 0x561845f60730 2024-04-24T02:13:22.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.216+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561845fa7b70 con 0x561845f60730 2024-04-24T02:13:22.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.216+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4bac00f070 con 0x561845f60730 2024-04-24T02:13:22.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.216+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561845fa7b70 con 0x561845f66850 2024-04-24T02:13:22.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.217+0000 7f4bbb4cb640 1 -- 172.21.15.134:0/3030913965 <== osd.3 v2:172.21.15.134:6801/3585115521 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4bb0066030 con 0x561845f66850 2024-04-24T02:13:22.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.217+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561845fa7b70 con 0x561845f66850 2024-04-24T02:13:22.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.217+0000 7f4bbb4cb640 1 -- 172.21.15.134:0/3030913965 <== osd.3 v2:172.21.15.134:6801/3585115521 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4bb0066030 con 0x561845f66850 2024-04-24T02:13:22.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.217+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561845fa7b50 con 0x7f4bb4019040 2024-04-24T02:13:22.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.218+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f4bac00f070 con 0x7f4bb4019040 2024-04-24T02:13:22.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.218+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561845fa96f0 con 0x561845f60730 2024-04-24T02:13:22.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.218+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4bac00f070 con 0x561845f60730 2024-04-24T02:13:22.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.218+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561845fa96f0 con 0x7f4bb0068c20 2024-04-24T02:13:22.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.218+0000 7f4bbc4cd640 1 -- 172.21.15.134:0/3030913965 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4bb402f040 con 0x7f4bb0068c20 2024-04-24T02:13:22.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.218+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561845fa96f0 con 0x561845f66850 2024-04-24T02:13:22.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.218+0000 7f4bbb4cb640 1 -- 172.21.15.134:0/3030913965 <== osd.3 v2:172.21.15.134:6801/3585115521 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4bb0066030 con 0x561845f66850 2024-04-24T02:13:22.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.218+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561845fa96f0 con 0x7f4bb4019040 2024-04-24T02:13:22.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.219+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4bac00f070 con 0x7f4bb4019040 2024-04-24T02:13:22.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.219+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561845fa96f0 con 0x7f4bb4019040 2024-04-24T02:13:22.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.219+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4bac00f070 con 0x7f4bb4019040 2024-04-24T02:13:22.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.219+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561845fa96f0 con 0x561845f66850 2024-04-24T02:13:22.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.219+0000 7f4bbb4cb640 1 -- 172.21.15.134:0/3030913965 <== osd.3 v2:172.21.15.134:6801/3585115521 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4bb0066030 con 0x561845f66850 2024-04-24T02:13:22.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.219+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561845fa96f0 con 0x7f4bb4019040 2024-04-24T02:13:22.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.219+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) ==== 152+0+163 (crc 0 0 0) 0x7f4bac00f070 con 0x7f4bb4019040 2024-04-24T02:13:22.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.219+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561845fa96f0 con 0x561845f60730 2024-04-24T02:13:22.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.219+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4bac00f070 con 0x561845f60730 2024-04-24T02:13:22.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.220+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561845fa96f0 con 0x561845f66850 2024-04-24T02:13:22.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.220+0000 7f4bbb4cb640 1 -- 172.21.15.134:0/3030913965 <== osd.3 v2:172.21.15.134:6801/3585115521 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4bb0066030 con 0x561845f66850 2024-04-24T02:13:22.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.220+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561845fa96f0 con 0x7f4bb4019040 2024-04-24T02:13:22.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.220+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4bac00f070 con 0x7f4bb4019040 2024-04-24T02:13:22.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.220+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561845fa96f0 con 0x7f4bb0068c20 2024-04-24T02:13:22.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.220+0000 7f4bbc4cd640 1 -- 172.21.15.134:0/3030913965 <== osd.2 v2:172.21.15.134:6800/214480313 16 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4bb402f040 con 0x7f4bb0068c20 2024-04-24T02:13:22.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.220+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561845fa96f0 con 0x7f4bb4019040 2024-04-24T02:13:22.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.221+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4bac00f070 con 0x7f4bb4019040 2024-04-24T02:13:22.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.221+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561845fa96f0 con 0x561845f60730 2024-04-24T02:13:22.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.221+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4bac00f070 con 0x561845f60730 2024-04-24T02:13:22.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.221+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561845fa96f0 con 0x561845f60730 2024-04-24T02:13:22.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.221+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.1 v2:172.21.15.134:6804/1487076214 30 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4bac00f070 con 0x561845f60730 2024-04-24T02:13:22.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.221+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561845fa96f0 con 0x561845f66850 2024-04-24T02:13:22.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.221+0000 7f4bbb4cb640 1 -- 172.21.15.134:0/3030913965 <== osd.3 v2:172.21.15.134:6801/3585115521 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4bb0066030 con 0x561845f66850 2024-04-24T02:13:22.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.221+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561845fa96f0 con 0x561845f60730 2024-04-24T02:13:22.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.221+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.1 v2:172.21.15.134:6804/1487076214 31 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4bac00f070 con 0x561845f60730 2024-04-24T02:13:22.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.221+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561845fa96f0 con 0x561845f60730 2024-04-24T02:13:22.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.222+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.1 v2:172.21.15.134:6804/1487076214 32 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4bac00f070 con 0x561845f60730 2024-04-24T02:13:22.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.222+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561845fa96f0 con 0x561845f66850 2024-04-24T02:13:22.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.222+0000 7f4bbb4cb640 1 -- 172.21.15.134:0/3030913965 <== osd.3 v2:172.21.15.134:6801/3585115521 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4bb0066030 con 0x561845f66850 2024-04-24T02:13:22.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.222+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561845fa96f0 con 0x561845f66850 2024-04-24T02:13:22.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.222+0000 7f4bbb4cb640 1 -- 172.21.15.134:0/3030913965 <== osd.3 v2:172.21.15.134:6801/3585115521 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4bb0066030 con 0x561845f66850 2024-04-24T02:13:22.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.222+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561845fa96f0 con 0x561845f66850 2024-04-24T02:13:22.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.222+0000 7f4bbb4cb640 1 -- 172.21.15.134:0/3030913965 <== osd.3 v2:172.21.15.134:6801/3585115521 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4bb0066030 con 0x561845f66850 2024-04-24T02:13:22.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.222+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561845fa96f0 con 0x7f4bb4019040 2024-04-24T02:13:22.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.223+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.0 v2:172.21.15.104:6800/2419146313 20 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4bac00f070 con 0x7f4bb4019040 2024-04-24T02:13:22.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.223+0000 7f4a71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:13:22.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.223+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94662253020288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561845fa4e90 con 0x561845f60730 2024-04-24T02:13:22.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.224+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.1 v2:172.21.15.134:6804/1487076214 33 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94662253020288] v32'204 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4bac00f070 con 0x561845f60730 2024-04-24T02:13:22.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.224+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94662252997328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561845f70480 con 0x7f4bb0068c20 2024-04-24T02:13:22.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.225+0000 7f4bbc4cd640 1 -- 172.21.15.134:0/3030913965 <== osd.2 v2:172.21.15.134:6800/214480313 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94662252997328] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bb402f040 con 0x7f4bb0068c20 2024-04-24T02:13:22.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.225+0000 7f4bbff36800 20 remove_watcher() i=0 2024-04-24T02:13:22.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.225+0000 7f4bbff36800 2 removed watcher, disabling cache 2024-04-24T02:13:22.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.225+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94662253001552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561845f70480 con 0x561845f60730 2024-04-24T02:13:22.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.227+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.1 v2:172.21.15.134:6804/1487076214 34 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94662253001552] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bac00f070 con 0x561845f60730 2024-04-24T02:13:22.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.227+0000 7f4bbff36800 20 remove_watcher() i=1 2024-04-24T02:13:22.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.227+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94662252994848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561845f6bb50 con 0x561845f66850 2024-04-24T02:13:22.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.228+0000 7f4bbb4cb640 1 -- 172.21.15.134:0/3030913965 <== osd.3 v2:172.21.15.134:6801/3585115521 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94662252994848] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bb0066030 con 0x561845f66850 2024-04-24T02:13:22.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.228+0000 7f4bbff36800 20 remove_watcher() i=2 2024-04-24T02:13:22.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.228+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94662253008592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561845f70480 con 0x7f4bb0068c20 2024-04-24T02:13:22.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.229+0000 7f4bbc4cd640 1 -- 172.21.15.134:0/3030913965 <== osd.2 v2:172.21.15.134:6800/214480313 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94662253008592] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bb402f040 con 0x7f4bb0068c20 2024-04-24T02:13:22.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.229+0000 7f4bbff36800 20 remove_watcher() i=3 2024-04-24T02:13:22.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.229+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94662253012752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561845f6a120 con 0x561845f60730 2024-04-24T02:13:22.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.230+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.1 v2:172.21.15.134:6804/1487076214 35 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94662253012752] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bac00f070 con 0x561845f60730 2024-04-24T02:13:22.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.231+0000 7f4bbff36800 20 remove_watcher() i=4 2024-04-24T02:13:22.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.231+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94662253014016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561845f70480 con 0x7f4bb4019040 2024-04-24T02:13:22.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.232+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.0 v2:172.21.15.104:6800/2419146313 21 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94662253014016] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bac00f070 con 0x7f4bb4019040 2024-04-24T02:13:22.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.232+0000 7f4bbff36800 20 remove_watcher() i=5 2024-04-24T02:13:22.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.232+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94662253006544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561845f6e710 con 0x7f4bb4019040 2024-04-24T02:13:22.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.233+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.0 v2:172.21.15.104:6800/2419146313 22 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94662253006544] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bac00f070 con 0x7f4bb4019040 2024-04-24T02:13:22.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.233+0000 7f4bbff36800 20 remove_watcher() i=6 2024-04-24T02:13:22.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.233+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94662253019232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561845f6e710 con 0x7f4bb4019040 2024-04-24T02:13:22.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.234+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 <== osd.0 v2:172.21.15.104:6800/2419146313 23 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94662253019232] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bac00f070 con 0x7f4bb4019040 2024-04-24T02:13:22.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.234+0000 7f4bbff36800 20 remove_watcher() i=7 2024-04-24T02:13:22.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.234+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f4bb4019040 msgr2=0x7f4bb4019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.234+0000 7f4bbff36800 1 --2- 172.21.15.134:0/3030913965 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f4bb4019040 0x7f4bb4019930 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.234+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x561845f60730 msgr2=0x561845f62bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.234+0000 7f4bbff36800 1 --2- 172.21.15.134:0/3030913965 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x561845f60730 0x561845f62bd0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.234+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f4bb0068c20 msgr2=0x7f4bb007b420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.234+0000 7f4bbff36800 1 --2- 172.21.15.134:0/3030913965 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f4bb0068c20 0x7f4bb007b420 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.234+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x561845f66850 msgr2=0x561845f68c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.234+0000 7f4bbff36800 1 --2- 172.21.15.134:0/3030913965 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x561845f66850 0x561845f68c40 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.235+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4a84036950 msgr2=0x7f4a84038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.235+0000 7f4bbff36800 1 --2- 172.21.15.134:0/3030913965 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4a84036950 0x7f4a84038e10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4bb400f010 tx=0x7f4bb400c040 comp rx=0 tx=0).stop 2024-04-24T02:13:22.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.235+0000 7f4bbbccc640 1 -- 172.21.15.134:0/3030913965 reap_dead start 2024-04-24T02:13:22.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.235+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561845f4d590 msgr2=0x561845f54c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.235+0000 7f4bbff36800 1 --2- 172.21.15.134:0/3030913965 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561845f4d590 0x561845f54c00 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f4bb0052fd0 tx=0x7f4bb008da30 comp rx=0 tx=0).stop 2024-04-24T02:13:22.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.235+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 shutdown_connections 2024-04-24T02:13:22.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.235+0000 7f4bbff36800 1 --2- 172.21.15.134:0/3030913965 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561845f4d590 0x561845f54c00 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.235+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 >> 172.21.15.134:0/3030913965 conn(0x561845f498f0 msgr2=0x561845f46f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:22.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.235+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 shutdown_connections 2024-04-24T02:13:22.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.235+0000 7f4bbff36800 1 -- 172.21.15.134:0/3030913965 wait complete. 2024-04-24T02:13:22.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.235+0000 7f4bbff36800 1 -- 172.21.15.134:0/3862772050 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4a94036950 msgr2=0x7f4a94038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.235+0000 7f4bbff36800 1 --2- 172.21.15.134:0/3862772050 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4a94036950 0x7f4a94038e10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x561845f30b60 tx=0x7f4bb4000f90 comp rx=0 tx=0).stop 2024-04-24T02:13:22.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.235+0000 7f4bbff36800 1 -- 172.21.15.134:0/3862772050 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561845f40310 msgr2=0x561845f40730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.235+0000 7f4bbff36800 1 --2- 172.21.15.134:0/3862772050 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561845f40310 0x561845f40730 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f4bb0000c00 tx=0x7f4bb0002fb0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.235+0000 7f4bbff36800 1 -- 172.21.15.134:0/3862772050 shutdown_connections 2024-04-24T02:13:22.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.235+0000 7f4bbff36800 1 --2- 172.21.15.134:0/3862772050 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4a94036950 0x7f4a94038e10 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.235+0000 7f4bbff36800 1 --2- 172.21.15.134:0/3862772050 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561845f40310 0x561845f40730 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.235+0000 7f4bbff36800 1 -- 172.21.15.134:0/3862772050 >> 172.21.15.134:0/3862772050 conn(0x561845f343b0 msgr2=0x561845f347b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:22.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.235+0000 7f4bbff36800 1 -- 172.21.15.134:0/3862772050 shutdown_connections 2024-04-24T02:13:22.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.235+0000 7f4bbff36800 1 -- 172.21.15.134:0/3862772050 wait complete. 2024-04-24T02:13:22.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.235+0000 7f4bbff36800 1 -- 172.21.15.134:0/226788234 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x561845e30210 msgr2=0x561845f2f140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.235+0000 7f4bbff36800 1 --2- 172.21.15.134:0/226788234 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x561845e30210 0x561845f2f140 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.235+0000 7f4bbff36800 1 -- 172.21.15.134:0/226788234 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4aa4036900 msgr2=0x7f4aa4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.236+0000 7f4bbff36800 1 --2- 172.21.15.134:0/226788234 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4aa4036900 0x7f4aa4038dc0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4bb0054000 tx=0x7f4bb004e000 comp rx=0 tx=0).stop 2024-04-24T02:13:22.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.236+0000 7f4bbff36800 1 -- 172.21.15.134:0/226788234 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561845e2c260 msgr2=0x561845f27f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.236+0000 7f4bbff36800 1 --2- 172.21.15.134:0/226788234 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561845e2c260 0x561845f27f00 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f4bac00f610 tx=0x7f4bac001250 comp rx=0 tx=0).stop 2024-04-24T02:13:22.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.236+0000 7f4bbff36800 1 -- 172.21.15.134:0/226788234 shutdown_connections 2024-04-24T02:13:22.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.236+0000 7f4bbff36800 1 --2- 172.21.15.134:0/226788234 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x561845e30210 0x561845f2f140 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.236+0000 7f4bbff36800 1 --2- 172.21.15.134:0/226788234 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4aa4036900 0x7f4aa4038dc0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.236+0000 7f4bbff36800 1 --2- 172.21.15.134:0/226788234 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561845e2c260 0x561845f27f00 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.236+0000 7f4bbff36800 1 -- 172.21.15.134:0/226788234 >> 172.21.15.134:0/226788234 conn(0x561845e26b00 msgr2=0x561845f17230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:22.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.236+0000 7f4bbff36800 1 -- 172.21.15.134:0/226788234 shutdown_connections 2024-04-24T02:13:22.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.236+0000 7f4bbff36800 1 -- 172.21.15.134:0/226788234 wait complete. 2024-04-24T02:13:22.284 INFO:teuthology.orchestra.run.smithi134.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-04-24T02:00:00.000000Z","epoch":1713924000,"owner":"anonymous","categories":[]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-04-24T02:00:00.000000Z","epoch":1713924000,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-04-24T02:00:00.000000Z","epoch":1713924000,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-04-24T02:00:00.000000Z","epoch":1713924000,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-04-24T02:00:00.000000Z","epoch":1713924000,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-04-24T02:00:00.000000Z","epoch":1713924000,"owner":"foo","categories":[]}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-04-24T02:13:22.284 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'anonymous', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-04-24T02:13:22.285 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-04-24T02:13:22.285 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-04-24T02:13:22.285 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-04-24T02:13:22.326 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:13:22.326 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:13:22.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.326+0000 7fdb5bd19800 1 Processor -- start 2024-04-24T02:13:22.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.326+0000 7fdb5bd19800 1 -- start start 2024-04-24T02:13:22.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.326+0000 7fdb5bd19800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5594f1e93320 0x5594f1e95710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.326+0000 7fdb5bd19800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5594f1d4dd40 con 0x5594f1e8ef80 2024-04-24T02:13:22.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.326+0000 7fdb5bd19800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x5594f1d204d0 con 0x5594f1e93320 2024-04-24T02:13:22.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.327+0000 7fdb51017640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5594f1e93320 0x5594f1e95710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.327+0000 7fdb59818640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x5594f1e8ef80 0x5594f1e8f3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:57800/0 (socket says 172.21.15.134:57800) 2024-04-24T02:13:22.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.327+0000 7fdb59818640 1 -- 172.21.15.134:0/1206156886 learned_addr learned my addr 172.21.15.134:0/1206156886 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:13:22.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.327+0000 7fdb51017640 1 -- 172.21.15.134:0/1206156886 >> v1:172.21.15.104:6789/0 conn(0x5594f1e8ef80 legacy=0x5594f1e8f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.327+0000 7fdb51017640 1 -- 172.21.15.134:0/1206156886 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594f1d4c590 con 0x5594f1e93320 2024-04-24T02:13:22.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.329+0000 7fdb51017640 1 --2- 172.21.15.134:0/1206156886 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5594f1e93320 0x5594f1e95710 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fdb4400a470 tx=0x7fdb4401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c45725535952bde server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.329+0000 7fdb59017640 1 -- 172.21.15.134:0/1206156886 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb44057070 con 0x5594f1e93320 2024-04-24T02:13:22.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.329+0000 7fdb59017640 1 -- 172.21.15.134:0/1206156886 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb44052570 con 0x5594f1e93320 2024-04-24T02:13:22.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.329+0000 7fdb59017640 1 -- 172.21.15.134:0/1206156886 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb44052870 con 0x5594f1e93320 2024-04-24T02:13:22.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.330+0000 7fdb5bd19800 1 -- 172.21.15.134:0/1206156886 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5594f1e93320 msgr2=0x5594f1e95710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.330+0000 7fdb5bd19800 1 --2- 172.21.15.134:0/1206156886 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5594f1e93320 0x5594f1e95710 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fdb4400a470 tx=0x7fdb4401ce90 comp rx=0 tx=0).stop 2024-04-24T02:13:22.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.330+0000 7fdb5bd19800 1 -- 172.21.15.134:0/1206156886 shutdown_connections 2024-04-24T02:13:22.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.330+0000 7fdb5bd19800 1 --2- 172.21.15.134:0/1206156886 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5594f1e93320 0x5594f1e95710 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.330+0000 7fdb5bd19800 1 -- 172.21.15.134:0/1206156886 >> 172.21.15.134:0/1206156886 conn(0x5594f1e8a520 msgr2=0x5594f1e8c940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:22.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.330+0000 7fdb5bd19800 1 -- 172.21.15.134:0/1206156886 shutdown_connections 2024-04-24T02:13:22.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.330+0000 7fdb5bd19800 1 -- 172.21.15.134:0/1206156886 wait complete. 2024-04-24T02:13:22.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.341+0000 7fdb5bd19800 1 Processor -- start 2024-04-24T02:13:22.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.341+0000 7fdb5bd19800 1 -- start start 2024-04-24T02:13:22.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.341+0000 7fdb5bd19800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5594f1e8ef80 0x5594f1e04990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.341+0000 7fdb5bd19800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5594f1dda3b0 con 0x5594f1e8ef80 2024-04-24T02:13:22.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.342+0000 7fdb59818640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5594f1e8ef80 0x5594f1e04990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.342+0000 7fdb59818640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5594f1e8ef80 0x5594f1e04990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55116/0 (socket says 172.21.15.134:55116) 2024-04-24T02:13:22.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.342+0000 7fdb59818640 1 -- 172.21.15.134:0/1949345516 learned_addr learned my addr 172.21.15.134:0/1949345516 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:22.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.342+0000 7fdb59818640 1 -- 172.21.15.134:0/1949345516 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594f1e02f50 con 0x5594f1e8ef80 2024-04-24T02:13:22.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.342+0000 7fdb59818640 1 --2- 172.21.15.134:0/1949345516 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5594f1e8ef80 0x5594f1e04990 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c001d80 tx=0x7fdb4c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ce7c8b876b6ce22 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.342+0000 7fda47e07640 1 -- 172.21.15.134:0/1949345516 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb4c013030 con 0x5594f1e8ef80 2024-04-24T02:13:22.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.342+0000 7fda47e07640 1 -- 172.21.15.134:0/1949345516 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb4c00e470 con 0x5594f1e8ef80 2024-04-24T02:13:22.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.342+0000 7fda47e07640 1 -- 172.21.15.134:0/1949345516 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb4c00e810 con 0x5594f1e8ef80 2024-04-24T02:13:22.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.343+0000 7fdb5bd19800 1 -- 172.21.15.134:0/1949345516 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5594f1e8ef80 msgr2=0x5594f1e04990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.343+0000 7fdb5bd19800 1 --2- 172.21.15.134:0/1949345516 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5594f1e8ef80 0x5594f1e04990 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c001d80 tx=0x7fdb4c001e70 comp rx=0 tx=0).stop 2024-04-24T02:13:22.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.343+0000 7fdb5bd19800 1 -- 172.21.15.134:0/1949345516 shutdown_connections 2024-04-24T02:13:22.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.343+0000 7fdb5bd19800 1 --2- 172.21.15.134:0/1949345516 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5594f1e8ef80 0x5594f1e04990 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.343+0000 7fdb5bd19800 1 -- 172.21.15.134:0/1949345516 >> 172.21.15.134:0/1949345516 conn(0x5594f1e8a520 msgr2=0x5594f1f7b980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:22.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.343+0000 7fdb5bd19800 1 -- 172.21.15.134:0/1949345516 shutdown_connections 2024-04-24T02:13:22.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.343+0000 7fdb5bd19800 1 -- 172.21.15.134:0/1949345516 wait complete. 2024-04-24T02:13:22.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.343+0000 7fdb5bd19800 1 Processor -- start 2024-04-24T02:13:22.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.343+0000 7fdb5bd19800 1 -- start start 2024-04-24T02:13:22.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.344+0000 7fdb5bd19800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5594f1e8ef80 0x5594f1f89e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.344+0000 7fdb5bd19800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5594f1e95fe0 con 0x5594f1e8ef80 2024-04-24T02:13:22.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.344+0000 7fdb59818640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5594f1e8ef80 0x5594f1f89e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.344+0000 7fdb59818640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5594f1e8ef80 0x5594f1f89e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55120/0 (socket says 172.21.15.134:55120) 2024-04-24T02:13:22.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.344+0000 7fdb59818640 1 -- 172.21.15.134:0/2476030114 learned_addr learned my addr 172.21.15.134:0/2476030114 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:22.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.344+0000 7fdb59818640 1 -- 172.21.15.134:0/2476030114 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594f1f8a390 con 0x5594f1e8ef80 2024-04-24T02:13:22.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.344+0000 7fdb59818640 1 --2- 172.21.15.134:0/2476030114 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5594f1e8ef80 0x5594f1f89e50 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c004000 tx=0x7fdb4c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.344+0000 7fda46604640 1 -- 172.21.15.134:0/2476030114 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb4c027070 con 0x5594f1e8ef80 2024-04-24T02:13:22.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.344+0000 7fda46604640 1 -- 172.21.15.134:0/2476030114 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb4c001400 con 0x5594f1e8ef80 2024-04-24T02:13:22.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.344+0000 7fdb5bd19800 1 -- 172.21.15.134:0/2476030114 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5594f1f8a620 con 0x5594f1e8ef80 2024-04-24T02:13:22.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.344+0000 7fda46604640 1 -- 172.21.15.134:0/2476030114 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb4c019a70 con 0x5594f1e8ef80 2024-04-24T02:13:22.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.344+0000 7fdb5bd19800 1 -- 172.21.15.134:0/2476030114 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594f1f8d280 con 0x5594f1e8ef80 2024-04-24T02:13:22.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.345+0000 7fda46604640 1 -- 172.21.15.134:0/2476030114 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdb4c02a070 con 0x5594f1e8ef80 2024-04-24T02:13:22.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.345+0000 7fda46604640 1 --2- 172.21.15.134:0/2476030114 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fda40036900 0x7fda40038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.345+0000 7fda46604640 1 -- 172.21.15.134:0/2476030114 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fdb4c01f070 con 0x5594f1e8ef80 2024-04-24T02:13:22.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.346+0000 7fdb51017640 1 --2- 172.21.15.134:0/2476030114 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fda40036900 0x7fda40038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.346+0000 7fdb5bd19800 1 --2- 172.21.15.134:0/2476030114 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5594f1e93320 0x5594f1f91040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.346+0000 7fdb5bd19800 1 -- 172.21.15.134:0/2476030114 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594f1f915d0 con 0x5594f1e93320 2024-04-24T02:13:22.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.346+0000 7fdb5a019640 1 --2- 172.21.15.134:0/2476030114 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5594f1e93320 0x5594f1f91040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.346+0000 7fdb51017640 1 --2- 172.21.15.134:0/2476030114 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fda40036900 0x7fda40038dc0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fdb44054000 tx=0x7fdb4404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.346+0000 7fdb5a019640 1 --2- 172.21.15.134:0/2476030114 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5594f1e93320 0x5594f1f91040 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.346+0000 7fdb5a019640 1 -- 172.21.15.134:0/2476030114 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb5400a4a0 con 0x5594f1e93320 2024-04-24T02:13:22.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.346+0000 7fdb5bd19800 1 -- 172.21.15.134:0/2476030114 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594f1f8e610 con 0x5594f1e93320 2024-04-24T02:13:22.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.347+0000 7fdb5a019640 1 -- 172.21.15.134:0/2476030114 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdb5400a4a0 con 0x5594f1e93320 2024-04-24T02:13:22.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.347+0000 7fdb5bd19800 1 -- 172.21.15.134:0/2476030114 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594f1f93410 con 0x5594f1e93320 2024-04-24T02:13:22.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.347+0000 7fdb5a019640 1 -- 172.21.15.134:0/2476030114 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdb5400a4a0 con 0x5594f1e93320 2024-04-24T02:13:22.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.347+0000 7fdb5bd19800 1 -- 172.21.15.134:0/2476030114 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594f1f92750 con 0x5594f1e93320 2024-04-24T02:13:22.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.347+0000 7fdb5a019640 1 -- 172.21.15.134:0/2476030114 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdb5400a4a0 con 0x5594f1e93320 2024-04-24T02:13:22.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.347+0000 7fdb5bd19800 1 -- 172.21.15.134:0/2476030114 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594f1f92ba0 con 0x5594f1e93320 2024-04-24T02:13:22.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.347+0000 7fdb5a019640 1 -- 172.21.15.134:0/2476030114 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdb5400a4a0 con 0x5594f1e93320 2024-04-24T02:13:22.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.348+0000 7fdb5bd19800 1 Processor -- start 2024-04-24T02:13:22.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.348+0000 7fdb5bd19800 1 -- start start 2024-04-24T02:13:22.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.348+0000 7fdb5bd19800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5594f1fa2200 0x5594f1fa2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.348+0000 7fdb5bd19800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5594f1d806b0 con 0x5594f1fa2200 2024-04-24T02:13:22.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.348+0000 7fdb51017640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5594f1fa2200 0x5594f1fa2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.348+0000 7fdb51017640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5594f1fa2200 0x5594f1fa2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55132/0 (socket says 172.21.15.134:55132) 2024-04-24T02:13:22.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.348+0000 7fdb51017640 1 -- 172.21.15.134:0/3740736800 learned_addr learned my addr 172.21.15.134:0/3740736800 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:22.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.348+0000 7fdb51017640 1 -- 172.21.15.134:0/3740736800 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594f1fa2b60 con 0x5594f1fa2200 2024-04-24T02:13:22.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.349+0000 7fdb51017640 1 --2- 172.21.15.134:0/3740736800 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5594f1fa2200 0x5594f1fa2620 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fdb44052540 tx=0x7fdb44002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.349+0000 7fda3f7fe640 1 -- 172.21.15.134:0/3740736800 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb4406f070 con 0x5594f1fa2200 2024-04-24T02:13:22.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.349+0000 7fda3f7fe640 1 -- 172.21.15.134:0/3740736800 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb44058040 con 0x5594f1fa2200 2024-04-24T02:13:22.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.349+0000 7fda3f7fe640 1 -- 172.21.15.134:0/3740736800 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb44057050 con 0x5594f1fa2200 2024-04-24T02:13:22.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.349+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3740736800 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5594f1fa35d0 con 0x5594f1fa2200 2024-04-24T02:13:22.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.349+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3740736800 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594f1fa3a70 con 0x5594f1fa2200 2024-04-24T02:13:22.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.350+0000 7fda3f7fe640 1 -- 172.21.15.134:0/3740736800 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdb44072070 con 0x5594f1fa2200 2024-04-24T02:13:22.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.350+0000 7fda3f7fe640 1 --2- 172.21.15.134:0/3740736800 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fda34036900 0x7fda34038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.350+0000 7fda3f7fe640 1 -- 172.21.15.134:0/3740736800 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fdb4408fa50 con 0x5594f1fa2200 2024-04-24T02:13:22.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.350+0000 7fdb5a019640 1 --2- 172.21.15.134:0/3740736800 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fda34036900 0x7fda34038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.350+0000 7fdb5bd19800 1 Processor -- start 2024-04-24T02:13:22.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.350+0000 7fdb5a019640 1 --2- 172.21.15.134:0/3740736800 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fda34036900 0x7fda34038dc0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x5594f1f92270 tx=0x7fdb54005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.350+0000 7fdb5bd19800 1 -- start start 2024-04-24T02:13:22.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.350+0000 7fdb5bd19800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5594f1faf480 0x5594f1faf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.350+0000 7fdb5bd19800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5594f1e032d0 con 0x5594f1faf480 2024-04-24T02:13:22.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.350+0000 7fdb51017640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5594f1faf480 0x5594f1faf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.351+0000 7fdb51017640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5594f1faf480 0x5594f1faf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55148/0 (socket says 172.21.15.134:55148) 2024-04-24T02:13:22.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.351+0000 7fdb51017640 1 -- 172.21.15.134:0/3600766883 learned_addr learned my addr 172.21.15.134:0/3600766883 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:22.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.351+0000 7fdb51017640 1 -- 172.21.15.134:0/3600766883 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594f1fafe70 con 0x5594f1faf480 2024-04-24T02:13:22.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.351+0000 7fdb51017640 1 --2- 172.21.15.134:0/3600766883 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5594f1faf480 0x5594f1faf8a0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fdb4408de60 tx=0x7fdb4408e0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d95a8671a6faa265 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.351+0000 7fda3d7fa640 1 -- 172.21.15.134:0/3600766883 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb4407f040 con 0x5594f1faf480 2024-04-24T02:13:22.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.351+0000 7fda3d7fa640 1 -- 172.21.15.134:0/3600766883 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb44069cc0 con 0x5594f1faf480 2024-04-24T02:13:22.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.351+0000 7fda3d7fa640 1 -- 172.21.15.134:0/3600766883 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb4405e9a0 con 0x5594f1faf480 2024-04-24T02:13:22.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.351+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3600766883 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5594f1faf480 msgr2=0x5594f1faf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.351+0000 7fdb5bd19800 1 --2- 172.21.15.134:0/3600766883 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5594f1faf480 0x5594f1faf8a0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fdb4408de60 tx=0x7fdb4408e0c0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.351+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3600766883 shutdown_connections 2024-04-24T02:13:22.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.351+0000 7fdb5bd19800 1 --2- 172.21.15.134:0/3600766883 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5594f1faf480 0x5594f1faf8a0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.352+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3600766883 >> 172.21.15.134:0/3600766883 conn(0x5594f1fab7e0 msgr2=0x5594f1fa9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:22.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.352+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3600766883 shutdown_connections 2024-04-24T02:13:22.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.352+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3600766883 wait complete. 2024-04-24T02:13:22.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.352+0000 7fdb5bd19800 1 Processor -- start 2024-04-24T02:13:22.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.352+0000 7fdb5bd19800 1 -- start start 2024-04-24T02:13:22.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.352+0000 7fdb5bd19800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5594f1faf480 0x5594f1fb6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.352+0000 7fdb5bd19800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5594f1fb05e0 con 0x5594f1faf480 2024-04-24T02:13:22.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.352+0000 7fdb51017640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5594f1faf480 0x5594f1fb6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.352+0000 7fdb51017640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5594f1faf480 0x5594f1fb6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55152/0 (socket says 172.21.15.134:55152) 2024-04-24T02:13:22.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.352+0000 7fdb51017640 1 -- 172.21.15.134:0/3674680920 learned_addr learned my addr 172.21.15.134:0/3674680920 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:22.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.353+0000 7fdb51017640 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594f1fb70b0 con 0x5594f1faf480 2024-04-24T02:13:22.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.353+0000 7fdb51017640 1 --2- 172.21.15.134:0/3674680920 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5594f1faf480 0x5594f1fb6b70 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fdb4405f820 tx=0x7fdb4408ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.353+0000 7fda2b7fe640 1 -- 172.21.15.134:0/3674680920 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb4405cdb0 con 0x5594f1faf480 2024-04-24T02:13:22.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.353+0000 7fda2b7fe640 1 -- 172.21.15.134:0/3674680920 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb44094070 con 0x5594f1faf480 2024-04-24T02:13:22.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.353+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5594f1fb7340 con 0x5594f1faf480 2024-04-24T02:13:22.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.353+0000 7fda2b7fe640 1 -- 172.21.15.134:0/3674680920 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb4405fd30 con 0x5594f1faf480 2024-04-24T02:13:22.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.353+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594f1fb7340 con 0x5594f1faf480 2024-04-24T02:13:22.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.354+0000 7fda2b7fe640 1 -- 172.21.15.134:0/3674680920 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdb4405d760 con 0x5594f1faf480 2024-04-24T02:13:22.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.354+0000 7fda2b7fe640 1 --2- 172.21.15.134:0/3674680920 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fda24036950 0x7fda24038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.354+0000 7fda2b7fe640 1 -- 172.21.15.134:0/3674680920 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fdb440630d0 con 0x5594f1faf480 2024-04-24T02:13:22.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.354+0000 7fdb5bd19800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.354+0000 7fdb5a019640 1 --2- 172.21.15.134:0/3674680920 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fda24036950 0x7fda24038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.354+0000 7fdb5bd19800 1 --2- 172.21.15.134:0/3674680920 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5594f1fc2440 0x5594f1fc48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.354+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fc5030 con 0x5594f1fc2440 2024-04-24T02:13:22.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.354+0000 7fdb59818640 1 --2- 172.21.15.134:0/3674680920 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5594f1fc2440 0x5594f1fc48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.355+0000 7fdb5a019640 1 --2- 172.21.15.134:0/3674680920 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fda24036950 0x7fda24038e10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x5594f1f8e560 tx=0x7fdb5401f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.355+0000 7fdb59818640 1 --2- 172.21.15.134:0/3674680920 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5594f1fc2440 0x5594f1fc48e0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.355+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb4c029030 con 0x5594f1fc2440 2024-04-24T02:13:22.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.355+0000 7fdb5bd19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:22.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.355+0000 7fdb5bd19800 20 realm 2024-04-24T02:13:22.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.355+0000 7fdb5bd19800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.355+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fc5440 con 0x5594f1fc2440 2024-04-24T02:13:22.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.355+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb4c029030 con 0x5594f1fc2440 2024-04-24T02:13:22.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.355+0000 7fdb5bd19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:22.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.355+0000 7fdb5bd19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:13:22.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.355+0000 7fdb5bd19800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.355+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fc5d10 con 0x5594f1fc2440 2024-04-24T02:13:22.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.355+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb4c029030 con 0x5594f1fc2440 2024-04-24T02:13:22.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.355+0000 7fdb5bd19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:22.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.355+0000 7fdb5bd19800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.355+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fc60b0 con 0x5594f1fc2440 2024-04-24T02:13:22.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.355+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdb4c029030 con 0x5594f1fc2440 2024-04-24T02:13:22.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.356+0000 7fdb5bd19800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:13:22.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.356+0000 7fdb5bd19800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.356+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fc6510 con 0x5594f1fc2440 2024-04-24T02:13:22.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.356+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdb4c029030 con 0x5594f1fc2440 2024-04-24T02:13:22.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.356+0000 7fdb5bd19800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:13:22.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.356+0000 7fdb5bd19800 20 searching for the correct realm 2024-04-24T02:13:22.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.356+0000 7fdb5bd19800 1 --2- 172.21.15.134:0/3674680920 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5594f1fc8500 0x5594f1fca950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.356+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fcb020 con 0x5594f1fc8500 2024-04-24T02:13:22.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.356+0000 7fdb51017640 1 --2- 172.21.15.134:0/3674680920 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5594f1fc8500 0x5594f1fca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.356+0000 7fdb51017640 1 --2- 172.21.15.134:0/3674680920 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5594f1fc8500 0x5594f1fca950 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.356+0000 7fdb51017640 1 -- 172.21.15.134:0/3674680920 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb44071030 con 0x5594f1fc8500 2024-04-24T02:13:22.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.356+0000 7fdb51017640 1 --2- 172.21.15.134:0/3674680920 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fdb44074060 0x7fdb440693a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.356+0000 7fdb51017640 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fcb020 con 0x7fdb44074060 2024-04-24T02:13:22.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.357+0000 7fdb5a019640 1 --2- 172.21.15.134:0/3674680920 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fdb44074060 0x7fdb440693a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.357+0000 7fdb5a019640 1 --2- 172.21.15.134:0/3674680920 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fdb44074060 0x7fdb440693a0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.357+0000 7fdb5a019640 1 -- 172.21.15.134:0/3674680920 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb5401f070 con 0x7fdb44074060 2024-04-24T02:13:22.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.357+0000 7fdb5a019640 1 --2- 172.21.15.134:0/3674680920 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fdb54031040 0x7fdb54032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.357+0000 7fdb5a019640 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fcb020 con 0x7fdb54031040 2024-04-24T02:13:22.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.357+0000 7fdb59818640 1 --2- 172.21.15.134:0/3674680920 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fdb54031040 0x7fdb54032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.358+0000 7fdb59818640 1 --2- 172.21.15.134:0/3674680920 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fdb54031040 0x7fdb54032940 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.358+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb4c029030 con 0x7fdb54031040 2024-04-24T02:13:22.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.358+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fcb020 con 0x5594f1fc2440 2024-04-24T02:13:22.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.358+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb4c029030 con 0x5594f1fc2440 2024-04-24T02:13:22.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.358+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fcb020 con 0x5594f1fc2440 2024-04-24T02:13:22.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.358+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdb4c029030 con 0x5594f1fc2440 2024-04-24T02:13:22.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.358+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fcb020 con 0x7fdb54031040 2024-04-24T02:13:22.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.359+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb4c029030 con 0x7fdb54031040 2024-04-24T02:13:22.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.359+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fcb020 con 0x7fdb44074060 2024-04-24T02:13:22.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.359+0000 7fdb5a019640 1 -- 172.21.15.134:0/3674680920 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb5401f070 con 0x7fdb44074060 2024-04-24T02:13:22.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.359+0000 7fdb5a019640 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fcb020 con 0x7fdb44074060 2024-04-24T02:13:22.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.359+0000 7fdb5a019640 1 -- 172.21.15.134:0/3674680920 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb5401f070 con 0x7fdb44074060 2024-04-24T02:13:22.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.359+0000 7fdb5a019640 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fcb020 con 0x5594f1fc8500 2024-04-24T02:13:22.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.359+0000 7fdb51017640 1 -- 172.21.15.134:0/3674680920 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb44071030 con 0x5594f1fc8500 2024-04-24T02:13:22.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.359+0000 7fdb51017640 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fcb020 con 0x5594f1fc2440 2024-04-24T02:13:22.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.360+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb4c029030 con 0x5594f1fc2440 2024-04-24T02:13:22.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.360+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fcb020 con 0x7fdb54031040 2024-04-24T02:13:22.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.360+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb4c029030 con 0x7fdb54031040 2024-04-24T02:13:22.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.360+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fcb020 con 0x5594f1fc2440 2024-04-24T02:13:22.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.360+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb4c029030 con 0x5594f1fc2440 2024-04-24T02:13:22.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.360+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fcb020 con 0x7fdb44074060 2024-04-24T02:13:22.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.360+0000 7fdb5a019640 1 -- 172.21.15.134:0/3674680920 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdb5401f070 con 0x7fdb44074060 2024-04-24T02:13:22.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.360+0000 7fdb5a019640 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fcb020 con 0x5594f1fc8500 2024-04-24T02:13:22.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.361+0000 7fdb51017640 1 -- 172.21.15.134:0/3674680920 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb44071030 con 0x5594f1fc8500 2024-04-24T02:13:22.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.361+0000 7fdb51017640 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fcb020 con 0x5594f1fc8500 2024-04-24T02:13:22.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.361+0000 7fdb51017640 1 -- 172.21.15.134:0/3674680920 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb44071030 con 0x5594f1fc8500 2024-04-24T02:13:22.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.361+0000 7fdb51017640 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fcb020 con 0x7fdb44074060 2024-04-24T02:13:22.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.361+0000 7fdb5a019640 1 -- 172.21.15.134:0/3674680920 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb5401f070 con 0x7fdb44074060 2024-04-24T02:13:22.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.361+0000 7fdb5a019640 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fcb020 con 0x5594f1fc8500 2024-04-24T02:13:22.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.361+0000 7fdb51017640 1 -- 172.21.15.134:0/3674680920 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb44071030 con 0x5594f1fc8500 2024-04-24T02:13:22.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.361+0000 7fdb51017640 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fcb020 con 0x5594f1fc8500 2024-04-24T02:13:22.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.361+0000 7fdb51017640 1 -- 172.21.15.134:0/3674680920 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb44071030 con 0x5594f1fc8500 2024-04-24T02:13:22.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.361+0000 7fdb51017640 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fcb020 con 0x5594f1fc2440 2024-04-24T02:13:22.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.362+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb4c029030 con 0x5594f1fc2440 2024-04-24T02:13:22.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.362+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fcb020 con 0x5594f1fc2440 2024-04-24T02:13:22.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.362+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fdb4c029030 con 0x5594f1fc2440 2024-04-24T02:13:22.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.362+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fcb020 con 0x7fdb54031040 2024-04-24T02:13:22.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.362+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb4c029030 con 0x7fdb54031040 2024-04-24T02:13:22.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.362+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fcb020 con 0x5594f1fc8500 2024-04-24T02:13:22.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.362+0000 7fdb51017640 1 -- 172.21.15.134:0/3674680920 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb44071030 con 0x5594f1fc8500 2024-04-24T02:13:22.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.362+0000 7fdb51017640 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fcb020 con 0x7fdb44074060 2024-04-24T02:13:22.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.363+0000 7fdb5a019640 1 -- 172.21.15.134:0/3674680920 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb5401f070 con 0x7fdb44074060 2024-04-24T02:13:22.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.363+0000 7fdb5a019640 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fcb020 con 0x5594f1fc2440 2024-04-24T02:13:22.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.363+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb4c029030 con 0x5594f1fc2440 2024-04-24T02:13:22.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.363+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fcb020 con 0x7fdb54031040 2024-04-24T02:13:22.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.363+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb4c029030 con 0x7fdb54031040 2024-04-24T02:13:22.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.363+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fcb020 con 0x5594f1fc8500 2024-04-24T02:13:22.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.364+0000 7fdb51017640 1 -- 172.21.15.134:0/3674680920 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb44071030 con 0x5594f1fc8500 2024-04-24T02:13:22.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.364+0000 7fdb51017640 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fcb020 con 0x7fdb54031040 2024-04-24T02:13:22.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.364+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb4c029030 con 0x7fdb54031040 2024-04-24T02:13:22.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.364+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fcb020 con 0x7fdb44074060 2024-04-24T02:13:22.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.364+0000 7fdb5a019640 1 -- 172.21.15.134:0/3674680920 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb54040040 con 0x7fdb44074060 2024-04-24T02:13:22.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.364+0000 7fdb5a019640 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fcb020 con 0x5594f1fc8500 2024-04-24T02:13:22.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.364+0000 7fdb51017640 1 -- 172.21.15.134:0/3674680920 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb44071030 con 0x5594f1fc8500 2024-04-24T02:13:22.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.364+0000 7fdb51017640 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fcb020 con 0x7fdb44074060 2024-04-24T02:13:22.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.365+0000 7fdb5a019640 1 -- 172.21.15.134:0/3674680920 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb54040040 con 0x7fdb44074060 2024-04-24T02:13:22.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.365+0000 7fdb5a019640 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fcb020 con 0x5594f1fc2440 2024-04-24T02:13:22.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.365+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdb4c029030 con 0x5594f1fc2440 2024-04-24T02:13:22.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.365+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fcb020 con 0x7fdb44074060 2024-04-24T02:13:22.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.365+0000 7fdb5a019640 1 -- 172.21.15.134:0/3674680920 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb54040040 con 0x7fdb44074060 2024-04-24T02:13:22.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.365+0000 7fdb5bd19800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:13:22.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.365+0000 7fdb5bd19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:13:22.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.365+0000 7fdb5bd19800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:13:22.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.365+0000 7fdb5bd19800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:13:22.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.365+0000 7fdb5bd19800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:13:22.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.365+0000 7fdb5bd19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:13:22.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.365+0000 7fdb5bd19800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.365+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fc6f80 con 0x5594f1fc2440 2024-04-24T02:13:22.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.365+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb4c029030 con 0x5594f1fc2440 2024-04-24T02:13:22.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.365+0000 7fdb5bd19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:22.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.365+0000 7fdb5bd19800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.365+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fc7820 con 0x5594f1fc2440 2024-04-24T02:13:22.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.366+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdb4c029030 con 0x5594f1fc2440 2024-04-24T02:13:22.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.366+0000 7fdb5bd19800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:13:22.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.366+0000 7fdb5bd19800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.366+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fc6bc0 con 0x5594f1fc2440 2024-04-24T02:13:22.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.366+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdb4c029030 con 0x5594f1fc2440 2024-04-24T02:13:22.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.366+0000 7fdb5bd19800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:13:22.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.366+0000 7fdb5bd19800 20 zone default found 2024-04-24T02:13:22.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.366+0000 7fdb5bd19800 4 Realm: () 2024-04-24T02:13:22.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.366+0000 7fdb5bd19800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:13:22.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.366+0000 7fdb5bd19800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:13:22.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.366+0000 7fdb5bd19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:13:22.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.366+0000 7fdb5bd19800 20 zonegroup default 2024-04-24T02:13:22.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.366+0000 7fdb5bd19800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.366+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fc7820 con 0x7fdb54031040 2024-04-24T02:13:22.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.366+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdb4c029030 con 0x7fdb54031040 2024-04-24T02:13:22.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.366+0000 7fdb5bd19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:22.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.367+0000 7fdb5bd19800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.367+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fcce80 con 0x5594f1fc8500 2024-04-24T02:13:22.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.367+0000 7fdb51017640 1 -- 172.21.15.134:0/3674680920 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdb44071030 con 0x5594f1fc8500 2024-04-24T02:13:22.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.367+0000 7fdb5bd19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:22.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.367+0000 7fdb5bd19800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.367+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fcd220 con 0x5594f1fc8500 2024-04-24T02:13:22.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.367+0000 7fdb51017640 1 -- 172.21.15.134:0/3674680920 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdb44071030 con 0x5594f1fc8500 2024-04-24T02:13:22.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.367+0000 7fdb5bd19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:22.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.367+0000 7fdb5bd19800 20 started sync module instance, tier type = 2024-04-24T02:13:22.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.367+0000 7fdb5bd19800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:13:22.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.367+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fcc320 con 0x7fdb44074060 2024-04-24T02:13:22.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.368+0000 7fdb5a019640 1 -- 172.21.15.134:0/3674680920 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(44 notify.0 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb54040040 con 0x7fdb44074060 2024-04-24T02:13:22.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.368+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94098203395856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fcdae0 con 0x7fdb44074060 2024-04-24T02:13:22.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.368+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fce330 con 0x5594f1fc2440 2024-04-24T02:13:22.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.369+0000 7fdb5a019640 1 -- 172.21.15.134:0/3674680920 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94098203395856] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb54040040 con 0x7fdb44074060 2024-04-24T02:13:22.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.369+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb4c029030 con 0x5594f1fc2440 2024-04-24T02:13:22.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.369+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94098203399728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fcdf80 con 0x5594f1fc2440 2024-04-24T02:13:22.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.369+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fceaa0 con 0x5594f1fc8500 2024-04-24T02:13:22.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.371+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94098203399728] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb4c029030 con 0x5594f1fc2440 2024-04-24T02:13:22.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.371+0000 7fdb51017640 1 -- 172.21.15.134:0/3674680920 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb44071030 con 0x5594f1fc8500 2024-04-24T02:13:22.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.371+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94098203403632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fcee90 con 0x5594f1fc8500 2024-04-24T02:13:22.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.371+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fcf850 con 0x7fdb44074060 2024-04-24T02:13:22.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.372+0000 7fdb51017640 1 -- 172.21.15.134:0/3674680920 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94098203403632] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb44071030 con 0x5594f1fc8500 2024-04-24T02:13:22.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.372+0000 7fdb5a019640 1 -- 172.21.15.134:0/3674680920 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(50 notify.3 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb54040040 con 0x7fdb44074060 2024-04-24T02:13:22.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.372+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94098203407264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fcf7c0 con 0x7fdb44074060 2024-04-24T02:13:22.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.372+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fd0740 con 0x5594f1fc2440 2024-04-24T02:13:22.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.373+0000 7fdb5a019640 1 -- 172.21.15.134:0/3674680920 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94098203407264] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb54040040 con 0x7fdb44074060 2024-04-24T02:13:22.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.373+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb4c029030 con 0x5594f1fc2440 2024-04-24T02:13:22.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.373+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94098203409520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fd0740 con 0x5594f1fc2440 2024-04-24T02:13:22.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.373+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fd1100 con 0x7fdb54031040 2024-04-24T02:13:22.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.374+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(54 notify.5 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb4c029030 con 0x7fdb54031040 2024-04-24T02:13:22.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.374+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94098203413584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fd1070 con 0x7fdb54031040 2024-04-24T02:13:22.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.374+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fd2050 con 0x7fdb54031040 2024-04-24T02:13:22.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.374+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94098203409520] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb4c029030 con 0x5594f1fc2440 2024-04-24T02:13:22.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.375+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94098203413584] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb4c029030 con 0x7fdb54031040 2024-04-24T02:13:22.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.375+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(56 notify.6 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb4c029030 con 0x7fdb54031040 2024-04-24T02:13:22.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.375+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94098203417408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fd14a0 con 0x7fdb54031040 2024-04-24T02:13:22.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.375+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fd2630 con 0x7fdb54031040 2024-04-24T02:13:22.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.376+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94098203417408] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb4c029030 con 0x7fdb54031040 2024-04-24T02:13:22.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.377+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(58 notify.7 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb4c029030 con 0x7fdb54031040 2024-04-24T02:13:22.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.377+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94098203411088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fd2630 con 0x7fdb54031040 2024-04-24T02:13:22.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.377+0000 7fdb5bd19800 20 add_watcher() i=0 2024-04-24T02:13:22.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.377+0000 7fdb5bd19800 20 add_watcher() i=1 2024-04-24T02:13:22.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.377+0000 7fdb5bd19800 20 add_watcher() i=2 2024-04-24T02:13:22.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.377+0000 7fdb5bd19800 20 add_watcher() i=3 2024-04-24T02:13:22.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.377+0000 7fdb5bd19800 20 add_watcher() i=4 2024-04-24T02:13:22.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.377+0000 7fdb5bd19800 20 add_watcher() i=5 2024-04-24T02:13:22.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.377+0000 7fdb5bd19800 20 add_watcher() i=6 2024-04-24T02:13:22.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.377+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94098203411088] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb4c029030 con 0x7fdb54031040 2024-04-24T02:13:22.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.377+0000 7fdb5bd19800 20 add_watcher() i=7 2024-04-24T02:13:22.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.377+0000 7fdb5bd19800 2 all 8 watchers are set, enabling cache 2024-04-24T02:13:22.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.377+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fd5880 con 0x5594f1fc2440 2024-04-24T02:13:22.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.378+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdb4c029030 con 0x5594f1fc2440 2024-04-24T02:13:22.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.378+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94098203419376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fd2bc0 con 0x5594f1fc2440 2024-04-24T02:13:22.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.379+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94098203419376] v32'205 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdb4c029030 con 0x5594f1fc2440 2024-04-24T02:13:22.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.379+0000 7fda0b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:13:22.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.379+0000 7fdb5bd19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:13:22.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.379+0000 7fdb5bd19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:13:22.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.379+0000 7fdb5bd19800 5 note: GC not initialized 2024-04-24T02:13:22.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.379+0000 7fda0a7fc640 20 reqs_thread_entry: start 2024-04-24T02:13:22.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.379+0000 7fdb5bd19800 20 init_complete bucket index max shards: 11 2024-04-24T02:13:22.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.379+0000 7fdb5bd19800 20 Filter name: none 2024-04-24T02:13:22.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.380+0000 7fd97bfff640 20 reqs_thread_entry: start 2024-04-24T02:13:22.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.380+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594f20091a0 con 0x5594f1fc2440 2024-04-24T02:13:22.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.380+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fdb4c029030 con 0x5594f1fc2440 2024-04-24T02:13:22.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.380+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594f20091a0 con 0x7fdb44074060 2024-04-24T02:13:22.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.380+0000 7fdb5a019640 1 -- 172.21.15.134:0/3674680920 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fdb54040040 con 0x7fdb44074060 2024-04-24T02:13:22.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.380+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594f2009620 con 0x5594f1fc2440 2024-04-24T02:13:22.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.380+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fdb4c029030 con 0x5594f1fc2440 2024-04-24T02:13:22.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.380+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594f2009620 con 0x5594f1fc8500 2024-04-24T02:13:22.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.381+0000 7fdb51017640 1 -- 172.21.15.134:0/3674680920 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fdb44071030 con 0x5594f1fc8500 2024-04-24T02:13:22.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.381+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594f20099c0 con 0x5594f1fc8500 2024-04-24T02:13:22.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.381+0000 7fdb51017640 1 -- 172.21.15.134:0/3674680920 <== osd.3 v2:172.21.15.134:6801/3585115521 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fdb44071030 con 0x5594f1fc8500 2024-04-24T02:13:22.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.381+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594f2009d60 con 0x5594f1fc8500 2024-04-24T02:13:22.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.381+0000 7fdb51017640 1 -- 172.21.15.134:0/3674680920 <== osd.3 v2:172.21.15.134:6801/3585115521 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fdb44071030 con 0x5594f1fc8500 2024-04-24T02:13:22.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.381+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594f200a100 con 0x5594f1fc2440 2024-04-24T02:13:22.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.381+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fdb4c029030 con 0x5594f1fc2440 2024-04-24T02:13:22.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.381+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594f200a100 con 0x5594f1fc2440 2024-04-24T02:13:22.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.381+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fdb4c029030 con 0x5594f1fc2440 2024-04-24T02:13:22.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.381+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594f200a100 con 0x5594f1fc8500 2024-04-24T02:13:22.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.382+0000 7fdb51017640 1 -- 172.21.15.134:0/3674680920 <== osd.3 v2:172.21.15.134:6801/3585115521 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fdb44071030 con 0x5594f1fc8500 2024-04-24T02:13:22.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.382+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594f200a100 con 0x5594f1fc8500 2024-04-24T02:13:22.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.382+0000 7fdb51017640 1 -- 172.21.15.134:0/3674680920 <== osd.3 v2:172.21.15.134:6801/3585115521 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fdb44071030 con 0x5594f1fc8500 2024-04-24T02:13:22.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.382+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594f200a100 con 0x7fdb54031040 2024-04-24T02:13:22.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.382+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7fdb4c029030 con 0x7fdb54031040 2024-04-24T02:13:22.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.382+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594f200b9e0 con 0x5594f1fc2440 2024-04-24T02:13:22.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.383+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdb4c029030 con 0x5594f1fc2440 2024-04-24T02:13:22.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.383+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594f200b9e0 con 0x7fdb44074060 2024-04-24T02:13:22.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.383+0000 7fdb5a019640 1 -- 172.21.15.134:0/3674680920 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdb54040040 con 0x7fdb44074060 2024-04-24T02:13:22.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.383+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594f200b9e0 con 0x5594f1fc8500 2024-04-24T02:13:22.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.383+0000 7fdb51017640 1 -- 172.21.15.134:0/3674680920 <== osd.3 v2:172.21.15.134:6801/3585115521 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdb44071030 con 0x5594f1fc8500 2024-04-24T02:13:22.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.383+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594f200b9e0 con 0x7fdb54031040 2024-04-24T02:13:22.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.383+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdb4c029030 con 0x7fdb54031040 2024-04-24T02:13:22.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.383+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594f200b9e0 con 0x7fdb54031040 2024-04-24T02:13:22.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.384+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdb4c029030 con 0x7fdb54031040 2024-04-24T02:13:22.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.384+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594f200b9e0 con 0x5594f1fc8500 2024-04-24T02:13:22.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.384+0000 7fdb51017640 1 -- 172.21.15.134:0/3674680920 <== osd.3 v2:172.21.15.134:6801/3585115521 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdb44071030 con 0x5594f1fc8500 2024-04-24T02:13:22.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.384+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594f200b9e0 con 0x7fdb54031040 2024-04-24T02:13:22.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.385+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) ==== 152+0+163 (crc 0 0 0) 0x7fdb4c029030 con 0x7fdb54031040 2024-04-24T02:13:22.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.385+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594f200b9e0 con 0x5594f1fc2440 2024-04-24T02:13:22.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.385+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdb4c029030 con 0x5594f1fc2440 2024-04-24T02:13:22.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.385+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594f200b9e0 con 0x5594f1fc8500 2024-04-24T02:13:22.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.385+0000 7fdb51017640 1 -- 172.21.15.134:0/3674680920 <== osd.3 v2:172.21.15.134:6801/3585115521 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdb44071030 con 0x5594f1fc8500 2024-04-24T02:13:22.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.385+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594f200b9e0 con 0x7fdb54031040 2024-04-24T02:13:22.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.385+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdb4c029030 con 0x7fdb54031040 2024-04-24T02:13:22.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.385+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594f200b9e0 con 0x7fdb44074060 2024-04-24T02:13:22.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.386+0000 7fdb5a019640 1 -- 172.21.15.134:0/3674680920 <== osd.2 v2:172.21.15.134:6800/214480313 16 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdb54040040 con 0x7fdb44074060 2024-04-24T02:13:22.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.386+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594f200b9e0 con 0x7fdb54031040 2024-04-24T02:13:22.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.386+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdb4c029030 con 0x7fdb54031040 2024-04-24T02:13:22.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.386+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594f200b9e0 con 0x5594f1fc2440 2024-04-24T02:13:22.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.386+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdb4c029030 con 0x5594f1fc2440 2024-04-24T02:13:22.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.386+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594f200b9e0 con 0x5594f1fc2440 2024-04-24T02:13:22.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.386+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.1 v2:172.21.15.134:6804/1487076214 30 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdb4c029030 con 0x5594f1fc2440 2024-04-24T02:13:22.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.386+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594f200b9e0 con 0x5594f1fc8500 2024-04-24T02:13:22.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.387+0000 7fdb51017640 1 -- 172.21.15.134:0/3674680920 <== osd.3 v2:172.21.15.134:6801/3585115521 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdb44071030 con 0x5594f1fc8500 2024-04-24T02:13:22.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.387+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594f200b9e0 con 0x5594f1fc2440 2024-04-24T02:13:22.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.387+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.1 v2:172.21.15.134:6804/1487076214 31 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdb4c029030 con 0x5594f1fc2440 2024-04-24T02:13:22.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.387+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594f200b9e0 con 0x5594f1fc2440 2024-04-24T02:13:22.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.387+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.1 v2:172.21.15.134:6804/1487076214 32 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdb4c029030 con 0x5594f1fc2440 2024-04-24T02:13:22.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.387+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594f200b9e0 con 0x5594f1fc8500 2024-04-24T02:13:22.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.387+0000 7fdb51017640 1 -- 172.21.15.134:0/3674680920 <== osd.3 v2:172.21.15.134:6801/3585115521 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdb44071030 con 0x5594f1fc8500 2024-04-24T02:13:22.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.387+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594f200b9e0 con 0x5594f1fc8500 2024-04-24T02:13:22.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.387+0000 7fdb51017640 1 -- 172.21.15.134:0/3674680920 <== osd.3 v2:172.21.15.134:6801/3585115521 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdb44071030 con 0x5594f1fc8500 2024-04-24T02:13:22.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.387+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594f200b9e0 con 0x5594f1fc8500 2024-04-24T02:13:22.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.387+0000 7fdb51017640 1 -- 172.21.15.134:0/3674680920 <== osd.3 v2:172.21.15.134:6801/3585115521 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdb44071030 con 0x5594f1fc8500 2024-04-24T02:13:22.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.388+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594f200b9e0 con 0x7fdb54031040 2024-04-24T02:13:22.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.388+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.0 v2:172.21.15.104:6800/2419146313 20 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdb4c029030 con 0x7fdb54031040 2024-04-24T02:13:22.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.389+0000 7fda0b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:13:22.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.389+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94098203419376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594f2007060 con 0x5594f1fc2440 2024-04-24T02:13:22.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.390+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.1 v2:172.21.15.134:6804/1487076214 33 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94098203419376] v32'206 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdb4c029030 con 0x5594f1fc2440 2024-04-24T02:13:22.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.390+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94098203395856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fd22f0 con 0x7fdb44074060 2024-04-24T02:13:22.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.391+0000 7fdb5a019640 1 -- 172.21.15.134:0/3674680920 <== osd.2 v2:172.21.15.134:6800/214480313 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94098203395856] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb54040040 con 0x7fdb44074060 2024-04-24T02:13:22.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.391+0000 7fdb5bd19800 20 remove_watcher() i=0 2024-04-24T02:13:22.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.391+0000 7fdb5bd19800 2 removed watcher, disabling cache 2024-04-24T02:13:22.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.391+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94098203399728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fd22f0 con 0x5594f1fc2440 2024-04-24T02:13:22.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.392+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.1 v2:172.21.15.134:6804/1487076214 34 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94098203399728] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb4c029030 con 0x5594f1fc2440 2024-04-24T02:13:22.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.392+0000 7fdb5bd19800 20 remove_watcher() i=1 2024-04-24T02:13:22.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.392+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94098203403632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fcd630 con 0x5594f1fc8500 2024-04-24T02:13:22.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.393+0000 7fdb51017640 1 -- 172.21.15.134:0/3674680920 <== osd.3 v2:172.21.15.134:6801/3585115521 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94098203403632] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb44071030 con 0x5594f1fc8500 2024-04-24T02:13:22.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.393+0000 7fdb5bd19800 20 remove_watcher() i=2 2024-04-24T02:13:22.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.393+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94098203407264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fd22f0 con 0x7fdb44074060 2024-04-24T02:13:22.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.394+0000 7fdb5a019640 1 -- 172.21.15.134:0/3674680920 <== osd.2 v2:172.21.15.134:6800/214480313 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94098203407264] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb54040040 con 0x7fdb44074060 2024-04-24T02:13:22.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.394+0000 7fdb5bd19800 20 remove_watcher() i=3 2024-04-24T02:13:22.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.394+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94098203409520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fcd630 con 0x5594f1fc2440 2024-04-24T02:13:22.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.395+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.1 v2:172.21.15.134:6804/1487076214 35 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94098203409520] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb4c029030 con 0x5594f1fc2440 2024-04-24T02:13:22.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.395+0000 7fdb5bd19800 20 remove_watcher() i=4 2024-04-24T02:13:22.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.395+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94098203413584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fcf3a0 con 0x7fdb54031040 2024-04-24T02:13:22.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.396+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.0 v2:172.21.15.104:6800/2419146313 21 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94098203413584] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb4c029030 con 0x7fdb54031040 2024-04-24T02:13:22.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.396+0000 7fdb5bd19800 20 remove_watcher() i=5 2024-04-24T02:13:22.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.396+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94098203417408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fd22f0 con 0x7fdb54031040 2024-04-24T02:13:22.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.397+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.0 v2:172.21.15.104:6800/2419146313 22 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94098203417408] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb4c029030 con 0x7fdb54031040 2024-04-24T02:13:22.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.397+0000 7fdb5bd19800 20 remove_watcher() i=6 2024-04-24T02:13:22.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.397+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94098203411088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594f1fcfc70 con 0x7fdb54031040 2024-04-24T02:13:22.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.398+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 <== osd.0 v2:172.21.15.104:6800/2419146313 23 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94098203411088] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb4c029030 con 0x7fdb54031040 2024-04-24T02:13:22.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.398+0000 7fdb5bd19800 20 remove_watcher() i=7 2024-04-24T02:13:22.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.398+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fdb54031040 msgr2=0x7fdb54032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.398+0000 7fdb5bd19800 1 --2- 172.21.15.134:0/3674680920 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fdb54031040 0x7fdb54032940 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.398+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5594f1fc2440 msgr2=0x5594f1fc48e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.398+0000 7fdb5bd19800 1 --2- 172.21.15.134:0/3674680920 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5594f1fc2440 0x5594f1fc48e0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.398+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fdb44074060 msgr2=0x7fdb440693a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.398+0000 7fdb5bd19800 1 --2- 172.21.15.134:0/3674680920 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fdb44074060 0x7fdb440693a0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.398+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5594f1fc8500 msgr2=0x5594f1fca950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.398+0000 7fdb5bd19800 1 --2- 172.21.15.134:0/3674680920 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5594f1fc8500 0x5594f1fca950 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.399+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fda24036950 msgr2=0x7fda24038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.399+0000 7fdb5bd19800 1 --2- 172.21.15.134:0/3674680920 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fda24036950 0x7fda24038e10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x5594f1f8e560 tx=0x7fdb5401f000 comp rx=0 tx=0).stop 2024-04-24T02:13:22.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.399+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5594f1faf480 msgr2=0x5594f1fb6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.399+0000 7fdb5bd19800 1 --2- 172.21.15.134:0/3674680920 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5594f1faf480 0x5594f1fb6b70 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fdb4405f820 tx=0x7fdb4408ddc0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.399+0000 7fdb59818640 1 -- 172.21.15.134:0/3674680920 reap_dead start 2024-04-24T02:13:22.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.399+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 shutdown_connections 2024-04-24T02:13:22.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.399+0000 7fdb5bd19800 1 --2- 172.21.15.134:0/3674680920 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5594f1faf480 0x5594f1fb6b70 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.399+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 >> 172.21.15.134:0/3674680920 conn(0x5594f1fab7e0 msgr2=0x5594f1fa8e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:22.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.399+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 shutdown_connections 2024-04-24T02:13:22.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.399+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3674680920 wait complete. 2024-04-24T02:13:22.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.399+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3740736800 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fda34036900 msgr2=0x7fda34038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.399+0000 7fdb5bd19800 1 --2- 172.21.15.134:0/3740736800 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fda34036900 0x7fda34038dc0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x5594f1f92270 tx=0x7fdb54005840 comp rx=0 tx=0).stop 2024-04-24T02:13:22.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.399+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3740736800 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5594f1fa2200 msgr2=0x5594f1fa2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.399+0000 7fdb5bd19800 1 --2- 172.21.15.134:0/3740736800 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5594f1fa2200 0x5594f1fa2620 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fdb44052540 tx=0x7fdb44002fb0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.399+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3740736800 shutdown_connections 2024-04-24T02:13:22.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.399+0000 7fdb5bd19800 1 --2- 172.21.15.134:0/3740736800 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fda34036900 0x7fda34038dc0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.399+0000 7fdb5bd19800 1 --2- 172.21.15.134:0/3740736800 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5594f1fa2200 0x5594f1fa2620 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.399+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3740736800 >> 172.21.15.134:0/3740736800 conn(0x5594f1f962a0 msgr2=0x5594f1f966a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:22.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.399+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3740736800 shutdown_connections 2024-04-24T02:13:22.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.399+0000 7fdb5bd19800 1 -- 172.21.15.134:0/3740736800 wait complete. 2024-04-24T02:13:22.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.399+0000 7fdb5bd19800 1 -- 172.21.15.134:0/2476030114 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5594f1e93320 msgr2=0x5594f1f91040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.399+0000 7fdb5bd19800 1 --2- 172.21.15.134:0/2476030114 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5594f1e93320 0x5594f1f91040 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.399+0000 7fdb5bd19800 1 -- 172.21.15.134:0/2476030114 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fda40036900 msgr2=0x7fda40038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.399+0000 7fdb5bd19800 1 --2- 172.21.15.134:0/2476030114 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fda40036900 0x7fda40038dc0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fdb44054000 tx=0x7fdb4404e000 comp rx=0 tx=0).stop 2024-04-24T02:13:22.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.399+0000 7fdb5bd19800 1 -- 172.21.15.134:0/2476030114 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5594f1e8ef80 msgr2=0x5594f1f89e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.399+0000 7fdb5bd19800 1 --2- 172.21.15.134:0/2476030114 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5594f1e8ef80 0x5594f1f89e50 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c004000 tx=0x7fdb4c000bc0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.400+0000 7fdb5bd19800 1 -- 172.21.15.134:0/2476030114 shutdown_connections 2024-04-24T02:13:22.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.400+0000 7fdb5bd19800 1 --2- 172.21.15.134:0/2476030114 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5594f1e93320 0x5594f1f91040 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.400+0000 7fdb5bd19800 1 --2- 172.21.15.134:0/2476030114 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fda40036900 0x7fda40038dc0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.400+0000 7fdb5bd19800 1 --2- 172.21.15.134:0/2476030114 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5594f1e8ef80 0x5594f1f89e50 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.400+0000 7fdb5bd19800 1 -- 172.21.15.134:0/2476030114 >> 172.21.15.134:0/2476030114 conn(0x5594f1e8a520 msgr2=0x5594f1e03830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:22.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.400+0000 7fdb5bd19800 1 -- 172.21.15.134:0/2476030114 shutdown_connections 2024-04-24T02:13:22.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.400+0000 7fdb5bd19800 1 -- 172.21.15.134:0/2476030114 wait complete. 2024-04-24T02:13:22.419 INFO:teuthology.orchestra.run.smithi134.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-04-24T02:00:00.000000Z","epoch":1713924000,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-04-24T02:00:00.000000Z","epoch":1713924000,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-04-24T02:00:00.000000Z","epoch":1713924000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-04-24T02:00:00.000000Z","epoch":1713924000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-04-24T02:00:00.000000Z","epoch":1713924000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-04-24T02:00:00.000000Z","epoch":1713924000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-04-24T02:13:22.420 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-04-24T02:13:22.420 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-04-24T02:13:22.420 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-04-24T02:13:22.420 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-04-24T02:13:22.502 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:13:22.502 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:13:22.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.502+0000 7f6254e16800 1 Processor -- start 2024-04-24T02:13:22.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.502+0000 7f6254e16800 1 -- start start 2024-04-24T02:13:22.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.503+0000 7f6254e16800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55e4c9f7f480 0x55e4c9f81870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.503+0000 7f6254e16800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e4c9e39d40 con 0x55e4c9f7b970 2024-04-24T02:13:22.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.503+0000 7f6254e16800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55e4c9e0c4d0 con 0x55e4c9f7f480 2024-04-24T02:13:22.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.503+0000 7f624fc83640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55e4c9f7f480 0x55e4c9f81870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.503+0000 7f6250484640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55e4c9f7b970 0x55e4c9f7dd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:57808/0 (socket says 172.21.15.134:57808) 2024-04-24T02:13:22.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.503+0000 7f624fc83640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55e4c9f7f480 0x55e4c9f81870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55166/0 (socket says 172.21.15.134:55166) 2024-04-24T02:13:22.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.503+0000 7f6250484640 1 -- 172.21.15.134:0/263396436 learned_addr learned my addr 172.21.15.134:0/263396436 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:13:22.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.503+0000 7f624fc83640 1 -- 172.21.15.134:0/263396436 >> v1:172.21.15.104:6789/0 conn(0x55e4c9f7b970 legacy=0x55e4c9f7dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.503+0000 7f624fc83640 1 -- 172.21.15.134:0/263396436 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4c9e38590 con 0x55e4c9f7f480 2024-04-24T02:13:22.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.505+0000 7f624fc83640 1 --2- 172.21.15.134:0/263396436 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4c9f7f480 0x55e4c9f81870 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f624400a470 tx=0x7f624401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f42fcade0aa40ac8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.505+0000 7f624f482640 1 -- 172.21.15.134:0/263396436 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6244057070 con 0x55e4c9f7f480 2024-04-24T02:13:22.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.505+0000 7f624f482640 1 -- 172.21.15.134:0/263396436 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6244052570 con 0x55e4c9f7f480 2024-04-24T02:13:22.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.505+0000 7f624f482640 1 -- 172.21.15.134:0/263396436 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6244052870 con 0x55e4c9f7f480 2024-04-24T02:13:22.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.506+0000 7f6254e16800 1 -- 172.21.15.134:0/263396436 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4c9f7f480 msgr2=0x55e4c9f81870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.506+0000 7f6254e16800 1 --2- 172.21.15.134:0/263396436 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4c9f7f480 0x55e4c9f81870 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f624400a470 tx=0x7f624401ce90 comp rx=0 tx=0).stop 2024-04-24T02:13:22.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.506+0000 7f6254e16800 1 -- 172.21.15.134:0/263396436 shutdown_connections 2024-04-24T02:13:22.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.506+0000 7f6254e16800 1 --2- 172.21.15.134:0/263396436 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4c9f7f480 0x55e4c9f81870 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.506+0000 7f6254e16800 1 -- 172.21.15.134:0/263396436 >> 172.21.15.134:0/263396436 conn(0x55e4c9f75320 msgr2=0x55e4c9f77740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:22.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.506+0000 7f6254e16800 1 -- 172.21.15.134:0/263396436 shutdown_connections 2024-04-24T02:13:22.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.506+0000 7f6254e16800 1 -- 172.21.15.134:0/263396436 wait complete. 2024-04-24T02:13:22.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.517+0000 7f6254e16800 1 Processor -- start 2024-04-24T02:13:22.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.517+0000 7f6254e16800 1 -- start start 2024-04-24T02:13:22.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.517+0000 7f6254e16800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4c9f7b970 0x55e4c9f7b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.517+0000 7f6254e16800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e4c9ec63c0 con 0x55e4c9f7b970 2024-04-24T02:13:22.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.518+0000 7f6250484640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4c9f7b970 0x55e4c9f7b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.518+0000 7f6250484640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4c9f7b970 0x55e4c9f7b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55170/0 (socket says 172.21.15.134:55170) 2024-04-24T02:13:22.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.518+0000 7f6250484640 1 -- 172.21.15.134:0/237891459 learned_addr learned my addr 172.21.15.134:0/237891459 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:22.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.518+0000 7f6250484640 1 -- 172.21.15.134:0/237891459 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4c9f79870 con 0x55e4c9f7b970 2024-04-24T02:13:22.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.518+0000 7f6250484640 1 --2- 172.21.15.134:0/237891459 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4c9f7b970 0x55e4c9f7b2b0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f62400017a0 tx=0x7f6240001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c93ff426e66fe732 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.518+0000 7f613e60c640 1 -- 172.21.15.134:0/237891459 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6240004520 con 0x55e4c9f7b970 2024-04-24T02:13:22.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.519+0000 7f613e60c640 1 -- 172.21.15.134:0/237891459 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62400046c0 con 0x55e4c9f7b970 2024-04-24T02:13:22.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.519+0000 7f613e60c640 1 -- 172.21.15.134:0/237891459 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6240004a00 con 0x55e4c9f7b970 2024-04-24T02:13:22.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.519+0000 7f6254e16800 1 -- 172.21.15.134:0/237891459 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4c9f7b970 msgr2=0x55e4c9f7b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.519+0000 7f6254e16800 1 --2- 172.21.15.134:0/237891459 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4c9f7b970 0x55e4c9f7b2b0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f62400017a0 tx=0x7f6240001c60 comp rx=0 tx=0).stop 2024-04-24T02:13:22.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.519+0000 7f6254e16800 1 -- 172.21.15.134:0/237891459 shutdown_connections 2024-04-24T02:13:22.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.519+0000 7f6254e16800 1 --2- 172.21.15.134:0/237891459 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4c9f7b970 0x55e4c9f7b2b0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.519+0000 7f6254e16800 1 -- 172.21.15.134:0/237891459 >> 172.21.15.134:0/237891459 conn(0x55e4c9f75320 msgr2=0x55e4ca067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:22.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.519+0000 7f6254e16800 1 -- 172.21.15.134:0/237891459 shutdown_connections 2024-04-24T02:13:22.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.519+0000 7f6254e16800 1 -- 172.21.15.134:0/237891459 wait complete. 2024-04-24T02:13:22.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.520+0000 7f6254e16800 1 Processor -- start 2024-04-24T02:13:22.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.520+0000 7f6254e16800 1 -- start start 2024-04-24T02:13:22.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.520+0000 7f6254e16800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4c9f7b970 0x55e4ca075e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.520+0000 7f6254e16800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e4c9f840c0 con 0x55e4c9f7b970 2024-04-24T02:13:22.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.520+0000 7f6250484640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4c9f7b970 0x55e4ca075e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.520+0000 7f6250484640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4c9f7b970 0x55e4ca075e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55180/0 (socket says 172.21.15.134:55180) 2024-04-24T02:13:22.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.520+0000 7f6250484640 1 -- 172.21.15.134:0/3339209756 learned_addr learned my addr 172.21.15.134:0/3339209756 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:22.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.520+0000 7f6250484640 1 -- 172.21.15.134:0/3339209756 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4ca0763b0 con 0x55e4c9f7b970 2024-04-24T02:13:22.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.520+0000 7f6250484640 1 --2- 172.21.15.134:0/3339209756 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4c9f7b970 0x55e4ca075e70 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f6240000f80 tx=0x7f6240001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.520+0000 7f613ce09640 1 -- 172.21.15.134:0/3339209756 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6240022020 con 0x55e4c9f7b970 2024-04-24T02:13:22.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.521+0000 7f613ce09640 1 -- 172.21.15.134:0/3339209756 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6240014870 con 0x55e4c9f7b970 2024-04-24T02:13:22.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.521+0000 7f6254e16800 1 -- 172.21.15.134:0/3339209756 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e4ca076640 con 0x55e4c9f7b970 2024-04-24T02:13:22.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.521+0000 7f613ce09640 1 -- 172.21.15.134:0/3339209756 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6240014bb0 con 0x55e4c9f7b970 2024-04-24T02:13:22.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.521+0000 7f6254e16800 1 -- 172.21.15.134:0/3339209756 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4ca0792f0 con 0x55e4c9f7b970 2024-04-24T02:13:22.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.521+0000 7f613ce09640 1 -- 172.21.15.134:0/3339209756 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6240025020 con 0x55e4c9f7b970 2024-04-24T02:13:22.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.522+0000 7f613ce09640 1 --2- 172.21.15.134:0/3339209756 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6138036950 0x7f6138038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.522+0000 7f613ce09640 1 -- 172.21.15.134:0/3339209756 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f6240018030 con 0x55e4c9f7b970 2024-04-24T02:13:22.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.522+0000 7f624fc83640 1 --2- 172.21.15.134:0/3339209756 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6138036950 0x7f6138038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.522+0000 7f6254e16800 1 --2- 172.21.15.134:0/3339209756 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e4c9f7f480 0x55e4ca07d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.522+0000 7f6254e16800 1 -- 172.21.15.134:0/3339209756 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca07d640 con 0x55e4c9f7f480 2024-04-24T02:13:22.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.522+0000 7f6250c85640 1 --2- 172.21.15.134:0/3339209756 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e4c9f7f480 0x55e4ca07d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.522+0000 7f624fc83640 1 --2- 172.21.15.134:0/3339209756 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6138036950 0x7f6138038e10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6244054000 tx=0x7f624404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.522+0000 7f6250c85640 1 --2- 172.21.15.134:0/3339209756 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e4c9f7f480 0x55e4ca07d0b0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.522+0000 7f6250c85640 1 -- 172.21.15.134:0/3339209756 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f62480083e0 con 0x55e4c9f7f480 2024-04-24T02:13:22.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.522+0000 7f6254e16800 1 -- 172.21.15.134:0/3339209756 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca07a660 con 0x55e4c9f7f480 2024-04-24T02:13:22.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.523+0000 7f6250c85640 1 -- 172.21.15.134:0/3339209756 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f62480083e0 con 0x55e4c9f7f480 2024-04-24T02:13:22.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.523+0000 7f6254e16800 1 -- 172.21.15.134:0/3339209756 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca07f460 con 0x55e4c9f7f480 2024-04-24T02:13:22.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.523+0000 7f6250c85640 1 -- 172.21.15.134:0/3339209756 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f62480083e0 con 0x55e4c9f7f480 2024-04-24T02:13:22.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.523+0000 7f6254e16800 1 -- 172.21.15.134:0/3339209756 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca07e7a0 con 0x55e4c9f7f480 2024-04-24T02:13:22.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.523+0000 7f6250c85640 1 -- 172.21.15.134:0/3339209756 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f62480083e0 con 0x55e4c9f7f480 2024-04-24T02:13:22.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.523+0000 7f6254e16800 1 -- 172.21.15.134:0/3339209756 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca07eb90 con 0x55e4c9f7f480 2024-04-24T02:13:22.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.524+0000 7f6250c85640 1 -- 172.21.15.134:0/3339209756 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f62480083e0 con 0x55e4c9f7f480 2024-04-24T02:13:22.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.524+0000 7f6254e16800 1 Processor -- start 2024-04-24T02:13:22.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.524+0000 7f6254e16800 1 -- start start 2024-04-24T02:13:22.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.524+0000 7f6254e16800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4ca08e270 0x55e4ca08e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.524+0000 7f6254e16800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e4c9e6c6b0 con 0x55e4ca08e270 2024-04-24T02:13:22.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.524+0000 7f624fc83640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4ca08e270 0x55e4ca08e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.524+0000 7f624fc83640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4ca08e270 0x55e4ca08e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55192/0 (socket says 172.21.15.134:55192) 2024-04-24T02:13:22.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.524+0000 7f624fc83640 1 -- 172.21.15.134:0/1056378184 learned_addr learned my addr 172.21.15.134:0/1056378184 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:22.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.525+0000 7f624fc83640 1 -- 172.21.15.134:0/1056378184 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4ca08ebd0 con 0x55e4ca08e270 2024-04-24T02:13:22.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.525+0000 7f624fc83640 1 --2- 172.21.15.134:0/1056378184 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4ca08e270 0x55e4ca08e690 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f6244044840 tx=0x7f6244002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.525+0000 7f6135ffb640 1 -- 172.21.15.134:0/1056378184 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f624406f070 con 0x55e4ca08e270 2024-04-24T02:13:22.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.525+0000 7f6135ffb640 1 -- 172.21.15.134:0/1056378184 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6244058040 con 0x55e4ca08e270 2024-04-24T02:13:22.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.525+0000 7f6254e16800 1 -- 172.21.15.134:0/1056378184 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e4ca08f640 con 0x55e4ca08e270 2024-04-24T02:13:22.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.525+0000 7f6135ffb640 1 -- 172.21.15.134:0/1056378184 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6244057050 con 0x55e4ca08e270 2024-04-24T02:13:22.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.525+0000 7f6254e16800 1 -- 172.21.15.134:0/1056378184 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4ca08fae0 con 0x55e4ca08e270 2024-04-24T02:13:22.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.526+0000 7f6135ffb640 1 -- 172.21.15.134:0/1056378184 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6244072070 con 0x55e4ca08e270 2024-04-24T02:13:22.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.526+0000 7f6135ffb640 1 --2- 172.21.15.134:0/1056378184 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6128036900 0x7f6128038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.526+0000 7f6135ffb640 1 -- 172.21.15.134:0/1056378184 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f624408f980 con 0x55e4ca08e270 2024-04-24T02:13:22.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.526+0000 7f6250c85640 1 --2- 172.21.15.134:0/1056378184 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6128036900 0x7f6128038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.526+0000 7f6254e16800 1 Processor -- start 2024-04-24T02:13:22.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.526+0000 7f6254e16800 1 -- start start 2024-04-24T02:13:22.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.526+0000 7f6250c85640 1 --2- 172.21.15.134:0/1056378184 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6128036900 0x7f6128038dc0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x55e4ca07e2c0 tx=0x7f6248000f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.526+0000 7f6254e16800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4ca09b530 0x55e4ca09b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.526+0000 7f6254e16800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e4c9f79bf0 con 0x55e4ca09b530 2024-04-24T02:13:22.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.527+0000 7f624fc83640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4ca09b530 0x55e4ca09b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.527+0000 7f624fc83640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4ca09b530 0x55e4ca09b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55204/0 (socket says 172.21.15.134:55204) 2024-04-24T02:13:22.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.527+0000 7f624fc83640 1 -- 172.21.15.134:0/3275064770 learned_addr learned my addr 172.21.15.134:0/3275064770 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:22.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.527+0000 7f624fc83640 1 -- 172.21.15.134:0/3275064770 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4ca09bf20 con 0x55e4ca09b530 2024-04-24T02:13:22.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.527+0000 7f624fc83640 1 --2- 172.21.15.134:0/3275064770 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4ca09b530 0x55e4ca09b950 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f624408dda0 tx=0x7f624408e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1794674041bc33fc server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.527+0000 7f612f7fe640 1 -- 172.21.15.134:0/3275064770 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6244087070 con 0x55e4ca09b530 2024-04-24T02:13:22.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.527+0000 7f612f7fe640 1 -- 172.21.15.134:0/3275064770 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f624405e480 con 0x55e4ca09b530 2024-04-24T02:13:22.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.527+0000 7f612f7fe640 1 -- 172.21.15.134:0/3275064770 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f624408f040 con 0x55e4ca09b530 2024-04-24T02:13:22.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.528+0000 7f6254e16800 1 -- 172.21.15.134:0/3275064770 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4ca09b530 msgr2=0x55e4ca09b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.528+0000 7f6254e16800 1 --2- 172.21.15.134:0/3275064770 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4ca09b530 0x55e4ca09b950 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f624408dda0 tx=0x7f624408e050 comp rx=0 tx=0).stop 2024-04-24T02:13:22.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.528+0000 7f6254e16800 1 -- 172.21.15.134:0/3275064770 shutdown_connections 2024-04-24T02:13:22.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.528+0000 7f6254e16800 1 --2- 172.21.15.134:0/3275064770 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4ca09b530 0x55e4ca09b950 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.528+0000 7f6254e16800 1 -- 172.21.15.134:0/3275064770 >> 172.21.15.134:0/3275064770 conn(0x55e4ca097890 msgr2=0x55e4ca0958f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:22.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.528+0000 7f6254e16800 1 -- 172.21.15.134:0/3275064770 shutdown_connections 2024-04-24T02:13:22.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.528+0000 7f6254e16800 1 -- 172.21.15.134:0/3275064770 wait complete. 2024-04-24T02:13:22.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.528+0000 7f6254e16800 1 Processor -- start 2024-04-24T02:13:22.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.528+0000 7f6254e16800 1 -- start start 2024-04-24T02:13:22.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.528+0000 7f6254e16800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4ca09b530 0x55e4ca0a2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.528+0000 7f6254e16800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e4ca09c690 con 0x55e4ca09b530 2024-04-24T02:13:22.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.528+0000 7f624fc83640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4ca09b530 0x55e4ca0a2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.528+0000 7f624fc83640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4ca09b530 0x55e4ca0a2bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55206/0 (socket says 172.21.15.134:55206) 2024-04-24T02:13:22.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.528+0000 7f624fc83640 1 -- 172.21.15.134:0/931565196 learned_addr learned my addr 172.21.15.134:0/931565196 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:22.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.529+0000 7f624fc83640 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4ca0a3110 con 0x55e4ca09b530 2024-04-24T02:13:22.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.529+0000 7f624fc83640 1 --2- 172.21.15.134:0/931565196 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4ca09b530 0x55e4ca0a2bd0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f624408ccc0 tx=0x7f624408dd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.529+0000 7f612dffb640 1 -- 172.21.15.134:0/931565196 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6244093070 con 0x55e4ca09b530 2024-04-24T02:13:22.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.529+0000 7f612dffb640 1 -- 172.21.15.134:0/931565196 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6244088040 con 0x55e4ca09b530 2024-04-24T02:13:22.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.529+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e4ca0a33a0 con 0x55e4ca09b530 2024-04-24T02:13:22.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.529+0000 7f612dffb640 1 -- 172.21.15.134:0/931565196 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6244087070 con 0x55e4ca09b530 2024-04-24T02:13:22.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.529+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4ca0a6050 con 0x55e4ca09b530 2024-04-24T02:13:22.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.530+0000 7f612dffb640 1 -- 172.21.15.134:0/931565196 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6244096070 con 0x55e4ca09b530 2024-04-24T02:13:22.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.530+0000 7f6254e16800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.530+0000 7f612dffb640 1 --2- 172.21.15.134:0/931565196 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6120036950 0x7f6120038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.530+0000 7f612dffb640 1 -- 172.21.15.134:0/931565196 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f624407f070 con 0x55e4ca09b530 2024-04-24T02:13:22.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.530+0000 7f6250c85640 1 --2- 172.21.15.134:0/931565196 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6120036950 0x7f6120038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.530+0000 7f6254e16800 1 --2- 172.21.15.134:0/931565196 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e4ca0ae6a0 0x55e4ca0b0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.530+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b1280 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.530+0000 7f6250484640 1 --2- 172.21.15.134:0/931565196 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e4ca0ae6a0 0x55e4ca0b0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.531+0000 7f6250c85640 1 --2- 172.21.15.134:0/931565196 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6120036950 0x7f6120038e10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f624800f010 tx=0x7f624800c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.531+0000 7f6250484640 1 --2- 172.21.15.134:0/931565196 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e4ca0ae6a0 0x55e4ca0b0b30 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.531+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f624001b070 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.531+0000 7f6254e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:22.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.531+0000 7f6254e16800 20 realm 2024-04-24T02:13:22.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.531+0000 7f6254e16800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.531+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b1690 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.531+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f624001b070 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.531+0000 7f6254e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:22.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.531+0000 7f6254e16800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:13:22.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.531+0000 7f6254e16800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.531+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b1f60 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.531+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f624001b070 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.531+0000 7f6254e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:22.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.531+0000 7f6254e16800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.531+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b2300 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.532+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f624001b070 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.532+0000 7f6254e16800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:13:22.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.532+0000 7f6254e16800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.532+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b27a0 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.532+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f624001b070 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.532+0000 7f6254e16800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:13:22.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.532+0000 7f6254e16800 20 searching for the correct realm 2024-04-24T02:13:22.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.532+0000 7f6254e16800 1 --2- 172.21.15.134:0/931565196 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55e4ca0b47a0 0x55e4ca0b6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.532+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b7260 con 0x55e4ca0b47a0 2024-04-24T02:13:22.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.532+0000 7f624fc83640 1 --2- 172.21.15.134:0/931565196 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55e4ca0b47a0 0x55e4ca0b6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.532+0000 7f624fc83640 1 --2- 172.21.15.134:0/931565196 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55e4ca0b47a0 0x55e4ca0b6b90 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.533+0000 7f624fc83640 1 -- 172.21.15.134:0/931565196 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f624409f070 con 0x55e4ca0b47a0 2024-04-24T02:13:22.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.533+0000 7f624fc83640 1 --2- 172.21.15.134:0/931565196 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f6244098070 0x7f62440649a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.533+0000 7f624fc83640 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b7260 con 0x7f6244098070 2024-04-24T02:13:22.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.533+0000 7f6250c85640 1 --2- 172.21.15.134:0/931565196 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f6244098070 0x7f62440649a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.533+0000 7f6250c85640 1 --2- 172.21.15.134:0/931565196 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f6244098070 0x7f62440649a0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.533+0000 7f6250c85640 1 -- 172.21.15.134:0/931565196 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f624802f040 con 0x7f6244098070 2024-04-24T02:13:22.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.533+0000 7f6250c85640 1 --2- 172.21.15.134:0/931565196 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f6248019040 0x7f6248019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.533+0000 7f6250c85640 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b7260 con 0x7f6248019040 2024-04-24T02:13:22.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.533+0000 7f6250484640 1 --2- 172.21.15.134:0/931565196 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f6248019040 0x7f6248019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.534+0000 7f6250484640 1 --2- 172.21.15.134:0/931565196 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f6248019040 0x7f6248019930 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.534+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f624001b070 con 0x7f6248019040 2024-04-24T02:13:22.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.534+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b7260 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.534+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f624001b070 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.534+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b7260 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.534+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f624001b070 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.534+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b7260 con 0x7f6248019040 2024-04-24T02:13:22.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.535+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f624001b070 con 0x7f6248019040 2024-04-24T02:13:22.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.535+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b7260 con 0x7f6244098070 2024-04-24T02:13:22.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.535+0000 7f6250c85640 1 -- 172.21.15.134:0/931565196 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f624802f040 con 0x7f6244098070 2024-04-24T02:13:22.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.535+0000 7f6250c85640 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b7260 con 0x7f6244098070 2024-04-24T02:13:22.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.535+0000 7f6250c85640 1 -- 172.21.15.134:0/931565196 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f624802f040 con 0x7f6244098070 2024-04-24T02:13:22.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.535+0000 7f6250c85640 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b7260 con 0x55e4ca0b47a0 2024-04-24T02:13:22.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.535+0000 7f624fc83640 1 -- 172.21.15.134:0/931565196 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f624409f070 con 0x55e4ca0b47a0 2024-04-24T02:13:22.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.535+0000 7f624fc83640 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b7260 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.536+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f624001b070 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.536+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b7260 con 0x7f6248019040 2024-04-24T02:13:22.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.536+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f624001b070 con 0x7f6248019040 2024-04-24T02:13:22.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.536+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b7260 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.536+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f624001b070 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.536+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b7260 con 0x7f6244098070 2024-04-24T02:13:22.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.536+0000 7f6250c85640 1 -- 172.21.15.134:0/931565196 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f624802f040 con 0x7f6244098070 2024-04-24T02:13:22.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.536+0000 7f6250c85640 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b7260 con 0x55e4ca0b47a0 2024-04-24T02:13:22.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.537+0000 7f624fc83640 1 -- 172.21.15.134:0/931565196 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f624409f070 con 0x55e4ca0b47a0 2024-04-24T02:13:22.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.537+0000 7f624fc83640 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b7260 con 0x55e4ca0b47a0 2024-04-24T02:13:22.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.537+0000 7f624fc83640 1 -- 172.21.15.134:0/931565196 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f624409f070 con 0x55e4ca0b47a0 2024-04-24T02:13:22.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.537+0000 7f624fc83640 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b7260 con 0x7f6244098070 2024-04-24T02:13:22.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.537+0000 7f6250c85640 1 -- 172.21.15.134:0/931565196 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f624802f040 con 0x7f6244098070 2024-04-24T02:13:22.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.537+0000 7f6250c85640 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b7260 con 0x55e4ca0b47a0 2024-04-24T02:13:22.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.537+0000 7f624fc83640 1 -- 172.21.15.134:0/931565196 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f624409f070 con 0x55e4ca0b47a0 2024-04-24T02:13:22.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.537+0000 7f624fc83640 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b7260 con 0x55e4ca0b47a0 2024-04-24T02:13:22.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.537+0000 7f624fc83640 1 -- 172.21.15.134:0/931565196 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f624409f070 con 0x55e4ca0b47a0 2024-04-24T02:13:22.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.537+0000 7f624fc83640 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b7260 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.538+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f624001b070 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.538+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b7260 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.538+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f624001b070 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.538+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b7260 con 0x7f6248019040 2024-04-24T02:13:22.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.538+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f624001b070 con 0x7f6248019040 2024-04-24T02:13:22.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.538+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b7260 con 0x55e4ca0b47a0 2024-04-24T02:13:22.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.538+0000 7f624fc83640 1 -- 172.21.15.134:0/931565196 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f624409f070 con 0x55e4ca0b47a0 2024-04-24T02:13:22.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.538+0000 7f624fc83640 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b7260 con 0x7f6244098070 2024-04-24T02:13:22.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.539+0000 7f6250c85640 1 -- 172.21.15.134:0/931565196 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f624802f040 con 0x7f6244098070 2024-04-24T02:13:22.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.539+0000 7f6250c85640 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b7260 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.539+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f624001b070 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.539+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b7260 con 0x7f6248019040 2024-04-24T02:13:22.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.539+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f624001b070 con 0x7f6248019040 2024-04-24T02:13:22.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.539+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b7260 con 0x55e4ca0b47a0 2024-04-24T02:13:22.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.539+0000 7f624fc83640 1 -- 172.21.15.134:0/931565196 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f624409f070 con 0x55e4ca0b47a0 2024-04-24T02:13:22.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.539+0000 7f624fc83640 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b7260 con 0x7f6248019040 2024-04-24T02:13:22.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.540+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f624001b070 con 0x7f6248019040 2024-04-24T02:13:22.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.540+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b7260 con 0x7f6244098070 2024-04-24T02:13:22.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.540+0000 7f6250c85640 1 -- 172.21.15.134:0/931565196 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f624802f040 con 0x7f6244098070 2024-04-24T02:13:22.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.540+0000 7f6250c85640 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b7260 con 0x55e4ca0b47a0 2024-04-24T02:13:22.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.540+0000 7f624fc83640 1 -- 172.21.15.134:0/931565196 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f624409f070 con 0x55e4ca0b47a0 2024-04-24T02:13:22.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.540+0000 7f624fc83640 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b7260 con 0x7f6244098070 2024-04-24T02:13:22.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.540+0000 7f6250c85640 1 -- 172.21.15.134:0/931565196 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f624802f040 con 0x7f6244098070 2024-04-24T02:13:22.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.540+0000 7f6250c85640 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b7260 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.541+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f624001b070 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.541+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b7260 con 0x7f6244098070 2024-04-24T02:13:22.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.541+0000 7f6250c85640 1 -- 172.21.15.134:0/931565196 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f624802f040 con 0x7f6244098070 2024-04-24T02:13:22.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.541+0000 7f6254e16800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:13:22.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.541+0000 7f6254e16800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:13:22.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.541+0000 7f6254e16800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:13:22.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.541+0000 7f6254e16800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:13:22.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.541+0000 7f6254e16800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:13:22.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.541+0000 7f6254e16800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:13:22.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.541+0000 7f6254e16800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.541+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b3270 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.541+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f624001b070 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.541+0000 7f6254e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:22.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.541+0000 7f6254e16800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.541+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b2eb0 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.541+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f624001b070 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.541+0000 7f6254e16800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:13:22.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.541+0000 7f6254e16800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.541+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b2ec0 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.542+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f624001b070 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.542+0000 7f6254e16800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:13:22.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.542+0000 7f6254e16800 20 zone default found 2024-04-24T02:13:22.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.542+0000 7f6254e16800 4 Realm: () 2024-04-24T02:13:22.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.542+0000 7f6254e16800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:13:22.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.542+0000 7f6254e16800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:13:22.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.542+0000 7f6254e16800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:13:22.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.542+0000 7f6254e16800 20 zonegroup default 2024-04-24T02:13:22.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.542+0000 7f6254e16800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.542+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b76e0 con 0x7f6248019040 2024-04-24T02:13:22.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.542+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f624001b070 con 0x7f6248019040 2024-04-24T02:13:22.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.542+0000 7f6254e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:22.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.542+0000 7f6254e16800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.542+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b9570 con 0x55e4ca0b47a0 2024-04-24T02:13:22.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.542+0000 7f624fc83640 1 -- 172.21.15.134:0/931565196 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f624409f070 con 0x55e4ca0b47a0 2024-04-24T02:13:22.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.542+0000 7f6254e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:22.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.542+0000 7f6254e16800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.542+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b9910 con 0x55e4ca0b47a0 2024-04-24T02:13:22.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.543+0000 7f624fc83640 1 -- 172.21.15.134:0/931565196 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f624409f070 con 0x55e4ca0b47a0 2024-04-24T02:13:22.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.543+0000 7f6254e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:22.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.543+0000 7f6254e16800 20 started sync module instance, tier type = 2024-04-24T02:13:22.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.543+0000 7f6254e16800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:13:22.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.543+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b89b0 con 0x7f6244098070 2024-04-24T02:13:22.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.544+0000 7f6250c85640 1 -- 172.21.15.134:0/931565196 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(44 notify.0 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f624802f040 con 0x7f6244098070 2024-04-24T02:13:22.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.544+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94441130659536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b89b0 con 0x7f6244098070 2024-04-24T02:13:22.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.544+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0ba330 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.545+0000 7f6250c85640 1 -- 172.21.15.134:0/931565196 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94441130659536] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f624802f040 con 0x7f6244098070 2024-04-24T02:13:22.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.545+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f624001b070 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.545+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94441130663456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b89b0 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.545+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0bad80 con 0x55e4ca0b47a0 2024-04-24T02:13:22.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.547+0000 7f624fc83640 1 -- 172.21.15.134:0/931565196 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f624409f070 con 0x55e4ca0b47a0 2024-04-24T02:13:22.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.547+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94441130666128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0bb620 con 0x55e4ca0b47a0 2024-04-24T02:13:22.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.547+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0bc0e0 con 0x7f6244098070 2024-04-24T02:13:22.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.547+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94441130663456] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f624001b070 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.548+0000 7f6250c85640 1 -- 172.21.15.134:0/931565196 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(50 notify.3 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f624802f040 con 0x7f6244098070 2024-04-24T02:13:22.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.548+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94441130671024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0bc4d0 con 0x7f6244098070 2024-04-24T02:13:22.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.548+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0bcf10 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.548+0000 7f624fc83640 1 -- 172.21.15.134:0/931565196 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94441130666128] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f624409f070 con 0x55e4ca0b47a0 2024-04-24T02:13:22.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.549+0000 7f6250c85640 1 -- 172.21.15.134:0/931565196 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94441130671024] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f624802f040 con 0x7f6244098070 2024-04-24T02:13:22.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.549+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f624001b070 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.549+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94441130657024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0bc4d0 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.549+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0bd7b0 con 0x7f6248019040 2024-04-24T02:13:22.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.550+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(54 notify.5 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f624001b070 con 0x7f6248019040 2024-04-24T02:13:22.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.550+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94441130676912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0bdb80 con 0x7f6248019040 2024-04-24T02:13:22.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.550+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0be3d0 con 0x7f6248019040 2024-04-24T02:13:22.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.550+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94441130657024] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f624001b070 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.551+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94441130676912] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f624001b070 con 0x7f6248019040 2024-04-24T02:13:22.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.551+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(56 notify.6 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f624001b070 con 0x7f6248019040 2024-04-24T02:13:22.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.551+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94441130677968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0bdfa0 con 0x7f6248019040 2024-04-24T02:13:22.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.551+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0be830 con 0x7f6248019040 2024-04-24T02:13:22.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.552+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(58 notify.7 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f624001b070 con 0x7f6248019040 2024-04-24T02:13:22.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.552+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94441130677968] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f624001b070 con 0x7f6248019040 2024-04-24T02:13:22.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.552+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94441130680224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0beec0 con 0x7f6248019040 2024-04-24T02:13:22.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.552+0000 7f6254e16800 20 add_watcher() i=0 2024-04-24T02:13:22.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.552+0000 7f6254e16800 20 add_watcher() i=1 2024-04-24T02:13:22.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.552+0000 7f6254e16800 20 add_watcher() i=2 2024-04-24T02:13:22.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.552+0000 7f6254e16800 20 add_watcher() i=3 2024-04-24T02:13:22.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.552+0000 7f6254e16800 20 add_watcher() i=4 2024-04-24T02:13:22.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.552+0000 7f6254e16800 20 add_watcher() i=5 2024-04-24T02:13:22.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.552+0000 7f6254e16800 20 add_watcher() i=6 2024-04-24T02:13:22.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.553+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94441130680224] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f624001b070 con 0x7f6248019040 2024-04-24T02:13:22.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.553+0000 7f6254e16800 20 add_watcher() i=7 2024-04-24T02:13:22.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.553+0000 7f6254e16800 2 all 8 watchers are set, enabling cache 2024-04-24T02:13:22.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.553+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0c1de0 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.553+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f624001b070 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.554+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94441130682624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0bf1d0 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.555+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94441130682624] v32'207 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f624001b070 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.555+0000 7f61067e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:13:22.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.555+0000 7f6254e16800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:13:22.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.555+0000 7f6254e16800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:13:22.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.555+0000 7f6254e16800 5 note: GC not initialized 2024-04-24T02:13:22.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.555+0000 7f61057e2640 20 reqs_thread_entry: start 2024-04-24T02:13:22.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.555+0000 7f6254e16800 20 init_complete bucket index max shards: 11 2024-04-24T02:13:22.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.555+0000 7f6254e16800 20 Filter name: none 2024-04-24T02:13:22.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.555+0000 7f607effd640 20 reqs_thread_entry: start 2024-04-24T02:13:22.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.555+0000 7f6254e16800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.555+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0f4b10 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.556+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f624001b070 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.556+0000 7f6254e16800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T02:13:22.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.556+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0f6060 con 0x7f6248019040 2024-04-24T02:13:22.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.556+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f624001b070 con 0x7f6248019040 2024-04-24T02:13:22.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.557+0000 7f61067e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:13:22.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.557+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94441130682624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0bed20 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.558+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94441130682624] v32'208 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f624001b070 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.558+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94441130659536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0be900 con 0x7f6244098070 2024-04-24T02:13:22.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.559+0000 7f6250c85640 1 -- 172.21.15.134:0/931565196 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94441130659536] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f624802f040 con 0x7f6244098070 2024-04-24T02:13:22.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.559+0000 7f6254e16800 20 remove_watcher() i=0 2024-04-24T02:13:22.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.559+0000 7f6254e16800 2 removed watcher, disabling cache 2024-04-24T02:13:22.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.559+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94441130663456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b8eb0 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.560+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94441130663456] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f624001b070 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.560+0000 7f6254e16800 20 remove_watcher() i=1 2024-04-24T02:13:22.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.560+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94441130666128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b9e20 con 0x55e4ca0b47a0 2024-04-24T02:13:22.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.561+0000 7f624fc83640 1 -- 172.21.15.134:0/931565196 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94441130666128] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f624409f070 con 0x55e4ca0b47a0 2024-04-24T02:13:22.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.561+0000 7f6254e16800 20 remove_watcher() i=2 2024-04-24T02:13:22.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.561+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94441130671024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b8eb0 con 0x7f6244098070 2024-04-24T02:13:22.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.562+0000 7f6250c85640 1 -- 172.21.15.134:0/931565196 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94441130671024] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f624802f040 con 0x7f6244098070 2024-04-24T02:13:22.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.562+0000 7f6254e16800 20 remove_watcher() i=3 2024-04-24T02:13:22.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.562+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94441130657024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0bbbb0 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.564+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94441130657024] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f624001b070 con 0x55e4ca0ae6a0 2024-04-24T02:13:22.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.564+0000 7f6254e16800 20 remove_watcher() i=4 2024-04-24T02:13:22.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.564+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94441130676912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b8500 con 0x7f6248019040 2024-04-24T02:13:22.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.565+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94441130676912] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f624001b070 con 0x7f6248019040 2024-04-24T02:13:22.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.565+0000 7f6254e16800 20 remove_watcher() i=5 2024-04-24T02:13:22.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.565+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94441130677968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b8500 con 0x7f6248019040 2024-04-24T02:13:22.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.566+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94441130677968] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f624001b070 con 0x7f6248019040 2024-04-24T02:13:22.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.566+0000 7f6254e16800 20 remove_watcher() i=6 2024-04-24T02:13:22.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.566+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94441130680224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e4ca0b8500 con 0x7f6248019040 2024-04-24T02:13:22.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.567+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94441130680224] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f624001b070 con 0x7f6248019040 2024-04-24T02:13:22.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.567+0000 7f6254e16800 20 remove_watcher() i=7 2024-04-24T02:13:22.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.567+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f6248019040 msgr2=0x7f6248019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.567+0000 7f6254e16800 1 --2- 172.21.15.134:0/931565196 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f6248019040 0x7f6248019930 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.567+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e4ca0ae6a0 msgr2=0x55e4ca0b0b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.567+0000 7f6254e16800 1 --2- 172.21.15.134:0/931565196 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e4ca0ae6a0 0x55e4ca0b0b30 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.567+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f6244098070 msgr2=0x7f62440649a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.567+0000 7f6254e16800 1 --2- 172.21.15.134:0/931565196 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f6244098070 0x7f62440649a0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.567+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55e4ca0b47a0 msgr2=0x55e4ca0b6b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.567+0000 7f6254e16800 1 --2- 172.21.15.134:0/931565196 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55e4ca0b47a0 0x55e4ca0b6b90 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.567+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6120036950 msgr2=0x7f6120038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.567+0000 7f6254e16800 1 --2- 172.21.15.134:0/931565196 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6120036950 0x7f6120038e10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f624800f010 tx=0x7f624800c040 comp rx=0 tx=0).stop 2024-04-24T02:13:22.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.567+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4ca09b530 msgr2=0x55e4ca0a2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.567+0000 7f6254e16800 1 --2- 172.21.15.134:0/931565196 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4ca09b530 0x55e4ca0a2bd0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f624408ccc0 tx=0x7f624408dd30 comp rx=0 tx=0).stop 2024-04-24T02:13:22.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.567+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 reap_dead start 2024-04-24T02:13:22.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.567+0000 7f6250484640 1 -- 172.21.15.134:0/931565196 reap_dead start 2024-04-24T02:13:22.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.567+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 shutdown_connections 2024-04-24T02:13:22.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.567+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 >> 172.21.15.134:0/931565196 conn(0x55e4ca097890 msgr2=0x55e4ca094ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:22.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.567+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 shutdown_connections 2024-04-24T02:13:22.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.567+0000 7f6254e16800 1 -- 172.21.15.134:0/931565196 wait complete. 2024-04-24T02:13:22.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.567+0000 7f6254e16800 1 -- 172.21.15.134:0/1056378184 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6128036900 msgr2=0x7f6128038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.567+0000 7f6254e16800 1 --2- 172.21.15.134:0/1056378184 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6128036900 0x7f6128038dc0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x55e4ca07e2c0 tx=0x7f6248000f90 comp rx=0 tx=0).stop 2024-04-24T02:13:22.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.567+0000 7f6254e16800 1 -- 172.21.15.134:0/1056378184 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4ca08e270 msgr2=0x55e4ca08e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.567+0000 7f6254e16800 1 --2- 172.21.15.134:0/1056378184 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4ca08e270 0x55e4ca08e690 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f6244044840 tx=0x7f6244002fb0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.568+0000 7f6254e16800 1 -- 172.21.15.134:0/1056378184 shutdown_connections 2024-04-24T02:13:22.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.568+0000 7f6254e16800 1 --2- 172.21.15.134:0/1056378184 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6128036900 0x7f6128038dc0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.568+0000 7f6254e16800 1 --2- 172.21.15.134:0/1056378184 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4ca08e270 0x55e4ca08e690 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.568+0000 7f6254e16800 1 -- 172.21.15.134:0/1056378184 >> 172.21.15.134:0/1056378184 conn(0x55e4ca082360 msgr2=0x55e4ca082760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:22.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.568+0000 7f6254e16800 1 -- 172.21.15.134:0/1056378184 shutdown_connections 2024-04-24T02:13:22.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.568+0000 7f6254e16800 1 -- 172.21.15.134:0/1056378184 wait complete. 2024-04-24T02:13:22.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.568+0000 7f6254e16800 1 -- 172.21.15.134:0/3339209756 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e4c9f7f480 msgr2=0x55e4ca07d0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.568+0000 7f6254e16800 1 --2- 172.21.15.134:0/3339209756 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e4c9f7f480 0x55e4ca07d0b0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.568+0000 7f6254e16800 1 -- 172.21.15.134:0/3339209756 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6138036950 msgr2=0x7f6138038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.568+0000 7f6254e16800 1 --2- 172.21.15.134:0/3339209756 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6138036950 0x7f6138038e10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6244054000 tx=0x7f624404e000 comp rx=0 tx=0).stop 2024-04-24T02:13:22.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.568+0000 7f6254e16800 1 -- 172.21.15.134:0/3339209756 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4c9f7b970 msgr2=0x55e4ca075e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.568+0000 7f6254e16800 1 --2- 172.21.15.134:0/3339209756 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4c9f7b970 0x55e4ca075e70 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f6240000f80 tx=0x7f6240001250 comp rx=0 tx=0).stop 2024-04-24T02:13:22.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.568+0000 7f6254e16800 1 -- 172.21.15.134:0/3339209756 shutdown_connections 2024-04-24T02:13:22.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.568+0000 7f6254e16800 1 --2- 172.21.15.134:0/3339209756 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55e4c9f7f480 0x55e4ca07d0b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.568+0000 7f6254e16800 1 --2- 172.21.15.134:0/3339209756 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6138036950 0x7f6138038e10 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.568+0000 7f6254e16800 1 --2- 172.21.15.134:0/3339209756 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4c9f7b970 0x55e4ca075e70 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.568+0000 7f6254e16800 1 -- 172.21.15.134:0/3339209756 >> 172.21.15.134:0/3339209756 conn(0x55e4c9f75320 msgr2=0x55e4c9f7a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:22.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.568+0000 7f6254e16800 1 -- 172.21.15.134:0/3339209756 shutdown_connections 2024-04-24T02:13:22.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.568+0000 7f6254e16800 1 -- 172.21.15.134:0/3339209756 wait complete. 2024-04-24T02:13:22.581 INFO:teuthology.orchestra.run.smithi134.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-04-24T02:00:00.000000Z","epoch":1713924000,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-04-24T02:00:00.000000Z","epoch":1713924000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-04-24T02:00:00.000000Z","epoch":1713924000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-04-24T02:00:00.000000Z","epoch":1713924000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-04-24T02:00:00.000000Z","epoch":1713924000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-04-24T02:13:22.582 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-04-24T02:13:22.582 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-04-24T02:13:22.582 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-04-24T02:13:22.582 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-04-24T02:13:22.667 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:13:22.667 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:13:22.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.667+0000 7f3feb50c800 1 Processor -- start 2024-04-24T02:13:22.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.667+0000 7f3feb50c800 1 -- start start 2024-04-24T02:13:22.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.668+0000 7f3feb50c800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55b96edf4fb0 0x55b96edf53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.668+0000 7f3feb50c800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b96ecb3d40 con 0x55b96edf6120 2024-04-24T02:13:22.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.668+0000 7f3feb50c800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55b96ec864d0 con 0x55b96edf4fb0 2024-04-24T02:13:22.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.668+0000 7f3fe9012640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55b96edf4fb0 0x55b96edf53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.668+0000 7f3fe9012640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55b96edf4fb0 0x55b96edf53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55214/0 (socket says 172.21.15.134:55214) 2024-04-24T02:13:22.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.668+0000 7f3fe9012640 1 -- 172.21.15.134:0/1232983381 learned_addr learned my addr 172.21.15.134:0/1232983381 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:22.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.668+0000 7f3fe8811640 1 --1- 172.21.15.134:0/1232983381 >> v1:172.21.15.104:6789/0 conn(0x55b96edf6120 0x55b96edf65a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:57820/0 (socket says 172.21.15.134:57820) 2024-04-24T02:13:22.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.668+0000 7f3fe9012640 1 -- 172.21.15.134:0/1232983381 >> v1:172.21.15.104:6789/0 conn(0x55b96edf6120 legacy=0x55b96edf65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.668+0000 7f3fe9012640 1 -- 172.21.15.134:0/1232983381 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b96ecb2590 con 0x55b96edf4fb0 2024-04-24T02:13:22.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.670+0000 7f3fe9012640 1 --2- 172.21.15.134:0/1232983381 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b96edf4fb0 0x55b96edf53d0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc00a520 tx=0x7f3fdc01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e82459f4348d9cc9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.670+0000 7f3fdbfff640 1 -- 172.21.15.134:0/1232983381 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fdc057070 con 0x55b96edf4fb0 2024-04-24T02:13:22.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.670+0000 7f3fdbfff640 1 -- 172.21.15.134:0/1232983381 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fdc052570 con 0x55b96edf4fb0 2024-04-24T02:13:22.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.670+0000 7f3fdbfff640 1 -- 172.21.15.134:0/1232983381 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fdc04ae60 con 0x55b96edf4fb0 2024-04-24T02:13:22.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.671+0000 7f3feb50c800 1 -- 172.21.15.134:0/1232983381 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b96edf4fb0 msgr2=0x55b96edf53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.671+0000 7f3feb50c800 1 --2- 172.21.15.134:0/1232983381 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b96edf4fb0 0x55b96edf53d0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc00a520 tx=0x7f3fdc01d010 comp rx=0 tx=0).stop 2024-04-24T02:13:22.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.671+0000 7f3feb50c800 1 -- 172.21.15.134:0/1232983381 shutdown_connections 2024-04-24T02:13:22.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.671+0000 7f3feb50c800 1 --2- 172.21.15.134:0/1232983381 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b96edf4fb0 0x55b96edf53d0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.671+0000 7f3feb50c800 1 -- 172.21.15.134:0/1232983381 >> 172.21.15.134:0/1232983381 conn(0x55b96edf0550 msgr2=0x55b96edf2970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:22.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.671+0000 7f3feb50c800 1 -- 172.21.15.134:0/1232983381 shutdown_connections 2024-04-24T02:13:22.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.671+0000 7f3feb50c800 1 -- 172.21.15.134:0/1232983381 wait complete. 2024-04-24T02:13:22.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.682+0000 7f3feb50c800 1 Processor -- start 2024-04-24T02:13:22.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.682+0000 7f3feb50c800 1 -- start start 2024-04-24T02:13:22.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.683+0000 7f3feb50c800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b96edf4fb0 0x55b96eee65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.683+0000 7f3feb50c800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b96ed403b0 con 0x55b96edf4fb0 2024-04-24T02:13:22.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.683+0000 7f3fe9012640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b96edf4fb0 0x55b96eee65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.683+0000 7f3fe9012640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b96edf4fb0 0x55b96eee65f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55222/0 (socket says 172.21.15.134:55222) 2024-04-24T02:13:22.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.683+0000 7f3fe9012640 1 -- 172.21.15.134:0/736186865 learned_addr learned my addr 172.21.15.134:0/736186865 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:22.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.683+0000 7f3fe9012640 1 -- 172.21.15.134:0/736186865 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b96eee6bc0 con 0x55b96edf4fb0 2024-04-24T02:13:22.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.683+0000 7f3fe9012640 1 --2- 172.21.15.134:0/736186865 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b96edf4fb0 0x55b96eee65f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc055040 tx=0x7f3fdc04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6025aa37113395c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.684+0000 7f3ed7606640 1 -- 172.21.15.134:0/736186865 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fdc057040 con 0x55b96edf4fb0 2024-04-24T02:13:22.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.684+0000 7f3ed7606640 1 -- 172.21.15.134:0/736186865 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fdc052720 con 0x55b96edf4fb0 2024-04-24T02:13:22.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.684+0000 7f3ed7606640 1 -- 172.21.15.134:0/736186865 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fdc052a40 con 0x55b96edf4fb0 2024-04-24T02:13:22.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.684+0000 7f3feb50c800 1 -- 172.21.15.134:0/736186865 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b96edf4fb0 msgr2=0x55b96eee65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.684+0000 7f3feb50c800 1 --2- 172.21.15.134:0/736186865 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b96edf4fb0 0x55b96eee65f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc055040 tx=0x7f3fdc04c000 comp rx=0 tx=0).stop 2024-04-24T02:13:22.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.684+0000 7f3feb50c800 1 -- 172.21.15.134:0/736186865 shutdown_connections 2024-04-24T02:13:22.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.684+0000 7f3feb50c800 1 --2- 172.21.15.134:0/736186865 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b96edf4fb0 0x55b96eee65f0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.684+0000 7f3feb50c800 1 -- 172.21.15.134:0/736186865 >> 172.21.15.134:0/736186865 conn(0x55b96edf0550 msgr2=0x55b96eee1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:22.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.684+0000 7f3feb50c800 1 -- 172.21.15.134:0/736186865 shutdown_connections 2024-04-24T02:13:22.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.684+0000 7f3feb50c800 1 -- 172.21.15.134:0/736186865 wait complete. 2024-04-24T02:13:22.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.685+0000 7f3feb50c800 1 Processor -- start 2024-04-24T02:13:22.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.685+0000 7f3feb50c800 1 -- start start 2024-04-24T02:13:22.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.685+0000 7f3feb50c800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b96edf4fb0 0x55b96ed6a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.685+0000 7f3feb50c800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b96edfe590 con 0x55b96edf4fb0 2024-04-24T02:13:22.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.685+0000 7f3fe9012640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b96edf4fb0 0x55b96ed6a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.685+0000 7f3fe9012640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b96edf4fb0 0x55b96ed6a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55236/0 (socket says 172.21.15.134:55236) 2024-04-24T02:13:22.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.685+0000 7f3fe9012640 1 -- 172.21.15.134:0/2270449562 learned_addr learned my addr 172.21.15.134:0/2270449562 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:22.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.685+0000 7f3fe9012640 1 -- 172.21.15.134:0/2270449562 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b96ed690b0 con 0x55b96edf4fb0 2024-04-24T02:13:22.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.686+0000 7f3fe9012640 1 --2- 172.21.15.134:0/2270449562 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b96edf4fb0 0x55b96ed6a9c0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc052540 tx=0x7f3fdc003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.686+0000 7f3ed5e03640 1 -- 172.21.15.134:0/2270449562 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fdc073070 con 0x55b96edf4fb0 2024-04-24T02:13:22.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.686+0000 7f3ed5e03640 1 -- 172.21.15.134:0/2270449562 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fdc052c90 con 0x55b96edf4fb0 2024-04-24T02:13:22.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.686+0000 7f3feb50c800 1 -- 172.21.15.134:0/2270449562 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b96ed69340 con 0x55b96edf4fb0 2024-04-24T02:13:22.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.686+0000 7f3ed5e03640 1 -- 172.21.15.134:0/2270449562 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fdc057070 con 0x55b96edf4fb0 2024-04-24T02:13:22.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.686+0000 7f3feb50c800 1 -- 172.21.15.134:0/2270449562 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b96ed69860 con 0x55b96edf4fb0 2024-04-24T02:13:22.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.687+0000 7f3ed5e03640 1 -- 172.21.15.134:0/2270449562 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3fdc076070 con 0x55b96edf4fb0 2024-04-24T02:13:22.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.687+0000 7f3ed5e03640 1 --2- 172.21.15.134:0/2270449562 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3ed0036900 0x7f3ed0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.687+0000 7f3ed5e03640 1 -- 172.21.15.134:0/2270449562 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f3fdc08d8f0 con 0x55b96edf4fb0 2024-04-24T02:13:22.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.687+0000 7f3fe8811640 1 --2- 172.21.15.134:0/2270449562 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3ed0036900 0x7f3ed0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.687+0000 7f3feb50c800 1 --2- 172.21.15.134:0/2270449562 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b96edf6120 0x55b96eef7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.687+0000 7f3feb50c800 1 -- 172.21.15.134:0/2270449562 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b96eef7a50 con 0x55b96edf6120 2024-04-24T02:13:22.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.687+0000 7f3fe9813640 1 --2- 172.21.15.134:0/2270449562 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b96edf6120 0x55b96eef7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.687+0000 7f3fe8811640 1 --2- 172.21.15.134:0/2270449562 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3ed0036900 0x7f3ed0038dc0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0000f60 tx=0x7f3fe0001370 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.688+0000 7f3fe9813640 1 --2- 172.21.15.134:0/2270449562 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b96edf6120 0x55b96eef7480 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.688+0000 7f3fe9813640 1 -- 172.21.15.134:0/2270449562 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3fe400a4a0 con 0x55b96edf6120 2024-04-24T02:13:22.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.688+0000 7f3feb50c800 1 -- 172.21.15.134:0/2270449562 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b96eef8340 con 0x55b96edf6120 2024-04-24T02:13:22.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.688+0000 7f3fe9813640 1 -- 172.21.15.134:0/2270449562 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3fe400a4a0 con 0x55b96edf6120 2024-04-24T02:13:22.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.688+0000 7f3feb50c800 1 -- 172.21.15.134:0/2270449562 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b96eef96f0 con 0x55b96edf6120 2024-04-24T02:13:22.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.688+0000 7f3fe9813640 1 -- 172.21.15.134:0/2270449562 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3fe400a4a0 con 0x55b96edf6120 2024-04-24T02:13:22.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.688+0000 7f3feb50c800 1 -- 172.21.15.134:0/2270449562 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b96eef8b90 con 0x55b96edf6120 2024-04-24T02:13:22.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.689+0000 7f3fe9813640 1 -- 172.21.15.134:0/2270449562 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3fe400a4a0 con 0x55b96edf6120 2024-04-24T02:13:22.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.689+0000 7f3feb50c800 1 -- 172.21.15.134:0/2270449562 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b96eef8fb0 con 0x55b96edf6120 2024-04-24T02:13:22.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.689+0000 7f3fe9813640 1 -- 172.21.15.134:0/2270449562 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3fe400a4a0 con 0x55b96edf6120 2024-04-24T02:13:22.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.689+0000 7f3feb50c800 1 Processor -- start 2024-04-24T02:13:22.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.689+0000 7f3feb50c800 1 -- start start 2024-04-24T02:13:22.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.689+0000 7f3feb50c800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b96ef087f0 0x55b96ef08c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.689+0000 7f3feb50c800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b96ed6af00 con 0x55b96ef087f0 2024-04-24T02:13:22.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.690+0000 7f3fe8811640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b96ef087f0 0x55b96ef08c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.690+0000 7f3fe8811640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b96ef087f0 0x55b96ef08c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55244/0 (socket says 172.21.15.134:55244) 2024-04-24T02:13:22.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.690+0000 7f3fe8811640 1 -- 172.21.15.134:0/620515707 learned_addr learned my addr 172.21.15.134:0/620515707 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:22.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.690+0000 7f3fe8811640 1 -- 172.21.15.134:0/620515707 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b96ef09150 con 0x55b96ef087f0 2024-04-24T02:13:22.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.690+0000 7f3fe8811640 1 --2- 172.21.15.134:0/620515707 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b96ef087f0 0x55b96ef08c10 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0001ed0 tx=0x7f3fe000ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.690+0000 7f3eceffd640 1 -- 172.21.15.134:0/620515707 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fe0022070 con 0x55b96ef087f0 2024-04-24T02:13:22.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.690+0000 7f3eceffd640 1 -- 172.21.15.134:0/620515707 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fe000d520 con 0x55b96ef087f0 2024-04-24T02:13:22.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.690+0000 7f3feb50c800 1 -- 172.21.15.134:0/620515707 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b96ef09bc0 con 0x55b96ef087f0 2024-04-24T02:13:22.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.690+0000 7f3eceffd640 1 -- 172.21.15.134:0/620515707 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fe000d800 con 0x55b96ef087f0 2024-04-24T02:13:22.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.690+0000 7f3feb50c800 1 -- 172.21.15.134:0/620515707 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b96ef0a0c0 con 0x55b96ef087f0 2024-04-24T02:13:22.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.691+0000 7f3eceffd640 1 -- 172.21.15.134:0/620515707 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3fe0025070 con 0x55b96ef087f0 2024-04-24T02:13:22.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.691+0000 7f3eceffd640 1 --2- 172.21.15.134:0/620515707 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3ec0036900 0x7f3ec0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.691+0000 7f3eceffd640 1 -- 172.21.15.134:0/620515707 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f3fe004dd10 con 0x55b96ef087f0 2024-04-24T02:13:22.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.691+0000 7f3fe9813640 1 --2- 172.21.15.134:0/620515707 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3ec0036900 0x7f3ec0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.692+0000 7f3feb50c800 1 Processor -- start 2024-04-24T02:13:22.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.692+0000 7f3feb50c800 1 -- start start 2024-04-24T02:13:22.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.692+0000 7f3fe9813640 1 --2- 172.21.15.134:0/620515707 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3ec0036900 0x7f3ec0038dc0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x55b96eef8f30 tx=0x7f3fe4005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.692+0000 7f3feb50c800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b96ef15b30 0x55b96ef15f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.692+0000 7f3feb50c800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b96ece66b0 con 0x55b96ef15b30 2024-04-24T02:13:22.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.692+0000 7f3fe8811640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b96ef15b30 0x55b96ef15f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.692+0000 7f3fe8811640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b96ef15b30 0x55b96ef15f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55252/0 (socket says 172.21.15.134:55252) 2024-04-24T02:13:22.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.692+0000 7f3fe8811640 1 -- 172.21.15.134:0/2965103702 learned_addr learned my addr 172.21.15.134:0/2965103702 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:22.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.692+0000 7f3fe8811640 1 -- 172.21.15.134:0/2965103702 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b96ef16520 con 0x55b96ef15b30 2024-04-24T02:13:22.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.692+0000 7f3fe8811640 1 --2- 172.21.15.134:0/2965103702 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b96ef15b30 0x55b96ef15f50 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f3fe004c120 tx=0x7f3fe0024740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4184d09be75ccf0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.693+0000 7f3eccff9640 1 -- 172.21.15.134:0/2965103702 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fe004a030 con 0x55b96ef15b30 2024-04-24T02:13:22.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.693+0000 7f3eccff9640 1 -- 172.21.15.134:0/2965103702 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fe0025990 con 0x55b96ef15b30 2024-04-24T02:13:22.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.693+0000 7f3eccff9640 1 -- 172.21.15.134:0/2965103702 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fe0026730 con 0x55b96ef15b30 2024-04-24T02:13:22.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.693+0000 7f3feb50c800 1 -- 172.21.15.134:0/2965103702 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b96ef15b30 msgr2=0x55b96ef15f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.693+0000 7f3feb50c800 1 --2- 172.21.15.134:0/2965103702 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b96ef15b30 0x55b96ef15f50 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f3fe004c120 tx=0x7f3fe0024740 comp rx=0 tx=0).stop 2024-04-24T02:13:22.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.693+0000 7f3feb50c800 1 -- 172.21.15.134:0/2965103702 shutdown_connections 2024-04-24T02:13:22.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.693+0000 7f3feb50c800 1 --2- 172.21.15.134:0/2965103702 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b96ef15b30 0x55b96ef15f50 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.693+0000 7f3feb50c800 1 -- 172.21.15.134:0/2965103702 >> 172.21.15.134:0/2965103702 conn(0x55b96ef11e90 msgr2=0x55b96ef0fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:22.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.693+0000 7f3feb50c800 1 -- 172.21.15.134:0/2965103702 shutdown_connections 2024-04-24T02:13:22.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.693+0000 7f3feb50c800 1 -- 172.21.15.134:0/2965103702 wait complete. 2024-04-24T02:13:22.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.693+0000 7f3feb50c800 1 Processor -- start 2024-04-24T02:13:22.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.693+0000 7f3feb50c800 1 -- start start 2024-04-24T02:13:22.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.693+0000 7f3feb50c800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b96ef15b30 0x55b96ef1d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.693+0000 7f3feb50c800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b96ef16b10 con 0x55b96ef15b30 2024-04-24T02:13:22.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.694+0000 7f3fe8811640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b96ef15b30 0x55b96ef1d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.694+0000 7f3fe8811640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b96ef15b30 0x55b96ef1d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55258/0 (socket says 172.21.15.134:55258) 2024-04-24T02:13:22.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.694+0000 7f3fe8811640 1 -- 172.21.15.134:0/51822908 learned_addr learned my addr 172.21.15.134:0/51822908 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:22.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.694+0000 7f3fe8811640 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b96ef1d590 con 0x55b96ef15b30 2024-04-24T02:13:22.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.694+0000 7f3fe8811640 1 --2- 172.21.15.134:0/51822908 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b96ef15b30 0x55b96ef1d050 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0024a50 tx=0x7f3fe004c080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.694+0000 7f3ebeffd640 1 -- 172.21.15.134:0/51822908 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fe0025570 con 0x55b96ef15b30 2024-04-24T02:13:22.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.694+0000 7f3ebeffd640 1 -- 172.21.15.134:0/51822908 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fe000d9a0 con 0x55b96ef15b30 2024-04-24T02:13:22.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.694+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b96ef1d590 con 0x55b96ef15b30 2024-04-24T02:13:22.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.694+0000 7f3ebeffd640 1 -- 172.21.15.134:0/51822908 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fe000dca0 con 0x55b96ef15b30 2024-04-24T02:13:22.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.694+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b96ef1d590 con 0x55b96ef15b30 2024-04-24T02:13:22.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.695+0000 7f3ebeffd640 1 -- 172.21.15.134:0/51822908 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3fe001a320 con 0x55b96ef15b30 2024-04-24T02:13:22.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.695+0000 7f3ebeffd640 1 --2- 172.21.15.134:0/51822908 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3eb4036900 0x7f3eb4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.695+0000 7f3ebeffd640 1 -- 172.21.15.134:0/51822908 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f3fe0045070 con 0x55b96ef15b30 2024-04-24T02:13:22.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.695+0000 7f3fe9813640 1 --2- 172.21.15.134:0/51822908 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3eb4036900 0x7f3eb4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.696+0000 7f3feb50c800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.696+0000 7f3feb50c800 1 --2- 172.21.15.134:0/51822908 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b96ef28740 0x55b96ef2ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.696+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef2b350 con 0x55b96ef28740 2024-04-24T02:13:22.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.696+0000 7f3fe9012640 1 --2- 172.21.15.134:0/51822908 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b96ef28740 0x55b96ef2ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.696+0000 7f3fe9813640 1 --2- 172.21.15.134:0/51822908 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3eb4036900 0x7f3eb4038dc0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x55b96ed69e40 tx=0x7f3fe401f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.696+0000 7f3fe9012640 1 --2- 172.21.15.134:0/51822908 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b96ef28740 0x55b96ef2ac00 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.696+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3fdc075030 con 0x55b96ef28740 2024-04-24T02:13:22.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.696+0000 7f3feb50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:22.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.696+0000 7f3feb50c800 20 realm 2024-04-24T02:13:22.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.696+0000 7f3feb50c800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.696+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef2b760 con 0x55b96ef28740 2024-04-24T02:13:22.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.696+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3fdc075030 con 0x55b96ef28740 2024-04-24T02:13:22.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.696+0000 7f3feb50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:22.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.696+0000 7f3feb50c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:13:22.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.696+0000 7f3feb50c800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.696+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef2c030 con 0x55b96ef28740 2024-04-24T02:13:22.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.697+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3fdc075030 con 0x55b96ef28740 2024-04-24T02:13:22.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.697+0000 7f3feb50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:22.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.697+0000 7f3feb50c800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.697+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef2c3d0 con 0x55b96ef28740 2024-04-24T02:13:22.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.697+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3fdc075030 con 0x55b96ef28740 2024-04-24T02:13:22.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.697+0000 7f3feb50c800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:13:22.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.697+0000 7f3feb50c800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.697+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef2c830 con 0x55b96ef28740 2024-04-24T02:13:22.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.697+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3fdc075030 con 0x55b96ef28740 2024-04-24T02:13:22.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.697+0000 7f3feb50c800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:13:22.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.697+0000 7f3feb50c800 20 searching for the correct realm 2024-04-24T02:13:22.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.697+0000 7f3feb50c800 1 --2- 172.21.15.134:0/51822908 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55b96ef2e880 0x55b96ef30c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.697+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef31320 con 0x55b96ef2e880 2024-04-24T02:13:22.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.697+0000 7f3fe8811640 1 --2- 172.21.15.134:0/51822908 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55b96ef2e880 0x55b96ef30c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.698+0000 7f3fe8811640 1 --2- 172.21.15.134:0/51822908 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55b96ef2e880 0x55b96ef30c70 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.698+0000 7f3fe8811640 1 -- 172.21.15.134:0/51822908 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fe0024030 con 0x55b96ef2e880 2024-04-24T02:13:22.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.698+0000 7f3fe8811640 1 --2- 172.21.15.134:0/51822908 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f3fe001ac20 0x7f3fe001c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.698+0000 7f3fe8811640 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef31320 con 0x7f3fe001ac20 2024-04-24T02:13:22.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.698+0000 7f3fe9813640 1 --2- 172.21.15.134:0/51822908 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f3fe001ac20 0x7f3fe001c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.698+0000 7f3fe9813640 1 --2- 172.21.15.134:0/51822908 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f3fe001ac20 0x7f3fe001c420 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.698+0000 7f3fe9813640 1 -- 172.21.15.134:0/51822908 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fe401f070 con 0x7f3fe001ac20 2024-04-24T02:13:22.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.698+0000 7f3fe9813640 1 --2- 172.21.15.134:0/51822908 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f3fe4031040 0x7f3fe4032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.698+0000 7f3fe9813640 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef31320 con 0x7f3fe4031040 2024-04-24T02:13:22.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.699+0000 7f3fe9012640 1 --2- 172.21.15.134:0/51822908 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f3fe4031040 0x7f3fe4032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.699+0000 7f3fe9012640 1 --2- 172.21.15.134:0/51822908 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f3fe4031040 0x7f3fe4032430 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.699+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fdc075030 con 0x7f3fe4031040 2024-04-24T02:13:22.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.699+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef31320 con 0x55b96ef28740 2024-04-24T02:13:22.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.700+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fdc075030 con 0x55b96ef28740 2024-04-24T02:13:22.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.700+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef31320 con 0x55b96ef28740 2024-04-24T02:13:22.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.700+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3fdc075030 con 0x55b96ef28740 2024-04-24T02:13:22.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.700+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef31320 con 0x7f3fe4031040 2024-04-24T02:13:22.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.700+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fdc075030 con 0x7f3fe4031040 2024-04-24T02:13:22.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.700+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef31320 con 0x7f3fe001ac20 2024-04-24T02:13:22.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.700+0000 7f3fe9813640 1 -- 172.21.15.134:0/51822908 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fe401f070 con 0x7f3fe001ac20 2024-04-24T02:13:22.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.700+0000 7f3fe9813640 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef31320 con 0x7f3fe001ac20 2024-04-24T02:13:22.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.701+0000 7f3fe9813640 1 -- 172.21.15.134:0/51822908 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fe401f070 con 0x7f3fe001ac20 2024-04-24T02:13:22.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.701+0000 7f3fe9813640 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef31320 con 0x55b96ef2e880 2024-04-24T02:13:22.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.701+0000 7f3fe8811640 1 -- 172.21.15.134:0/51822908 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fe005c040 con 0x55b96ef2e880 2024-04-24T02:13:22.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.701+0000 7f3fe8811640 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef31320 con 0x55b96ef28740 2024-04-24T02:13:22.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.701+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fdc075030 con 0x55b96ef28740 2024-04-24T02:13:22.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.701+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef31320 con 0x7f3fe4031040 2024-04-24T02:13:22.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.702+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fdc075030 con 0x7f3fe4031040 2024-04-24T02:13:22.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.702+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef31320 con 0x55b96ef28740 2024-04-24T02:13:22.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.702+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fdc075030 con 0x55b96ef28740 2024-04-24T02:13:22.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.702+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef31320 con 0x7f3fe001ac20 2024-04-24T02:13:22.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.702+0000 7f3fe9813640 1 -- 172.21.15.134:0/51822908 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3fe401f070 con 0x7f3fe001ac20 2024-04-24T02:13:22.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.702+0000 7f3fe9813640 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef31320 con 0x55b96ef2e880 2024-04-24T02:13:22.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.702+0000 7f3fe8811640 1 -- 172.21.15.134:0/51822908 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fe005c040 con 0x55b96ef2e880 2024-04-24T02:13:22.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.702+0000 7f3fe8811640 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef31320 con 0x55b96ef2e880 2024-04-24T02:13:22.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.702+0000 7f3fe8811640 1 -- 172.21.15.134:0/51822908 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fe005c040 con 0x55b96ef2e880 2024-04-24T02:13:22.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.702+0000 7f3fe8811640 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef31320 con 0x7f3fe001ac20 2024-04-24T02:13:22.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.703+0000 7f3fe9813640 1 -- 172.21.15.134:0/51822908 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fe401f070 con 0x7f3fe001ac20 2024-04-24T02:13:22.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.703+0000 7f3fe9813640 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef31320 con 0x55b96ef2e880 2024-04-24T02:13:22.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.703+0000 7f3fe8811640 1 -- 172.21.15.134:0/51822908 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fe005c040 con 0x55b96ef2e880 2024-04-24T02:13:22.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.703+0000 7f3fe8811640 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef31320 con 0x55b96ef2e880 2024-04-24T02:13:22.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.703+0000 7f3fe8811640 1 -- 172.21.15.134:0/51822908 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fe005c040 con 0x55b96ef2e880 2024-04-24T02:13:22.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.703+0000 7f3fe8811640 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef31320 con 0x55b96ef28740 2024-04-24T02:13:22.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.703+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fdc075030 con 0x55b96ef28740 2024-04-24T02:13:22.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.703+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef31320 con 0x55b96ef28740 2024-04-24T02:13:22.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.704+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f3fdc075030 con 0x55b96ef28740 2024-04-24T02:13:22.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.704+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef31320 con 0x7f3fe4031040 2024-04-24T02:13:22.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.704+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fdc075030 con 0x7f3fe4031040 2024-04-24T02:13:22.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.704+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef31320 con 0x55b96ef2e880 2024-04-24T02:13:22.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.704+0000 7f3fe8811640 1 -- 172.21.15.134:0/51822908 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fe005c040 con 0x55b96ef2e880 2024-04-24T02:13:22.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.704+0000 7f3fe8811640 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef31320 con 0x7f3fe001ac20 2024-04-24T02:13:22.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.704+0000 7f3fe9813640 1 -- 172.21.15.134:0/51822908 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fe401f070 con 0x7f3fe001ac20 2024-04-24T02:13:22.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.704+0000 7f3fe9813640 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef31320 con 0x55b96ef28740 2024-04-24T02:13:22.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.705+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fdc075030 con 0x55b96ef28740 2024-04-24T02:13:22.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.705+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef31320 con 0x7f3fe4031040 2024-04-24T02:13:22.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.705+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fdc075030 con 0x7f3fe4031040 2024-04-24T02:13:22.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.705+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef31320 con 0x55b96ef2e880 2024-04-24T02:13:22.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.705+0000 7f3fe8811640 1 -- 172.21.15.134:0/51822908 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fe005c040 con 0x55b96ef2e880 2024-04-24T02:13:22.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.705+0000 7f3fe8811640 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef31320 con 0x7f3fe4031040 2024-04-24T02:13:22.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.706+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fdc075030 con 0x7f3fe4031040 2024-04-24T02:13:22.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.706+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef31320 con 0x7f3fe001ac20 2024-04-24T02:13:22.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.706+0000 7f3fe9813640 1 -- 172.21.15.134:0/51822908 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fe4040040 con 0x7f3fe001ac20 2024-04-24T02:13:22.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.706+0000 7f3fe9813640 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef31320 con 0x55b96ef2e880 2024-04-24T02:13:22.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.706+0000 7f3fe8811640 1 -- 172.21.15.134:0/51822908 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fe005c040 con 0x55b96ef2e880 2024-04-24T02:13:22.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.706+0000 7f3fe8811640 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef31320 con 0x7f3fe001ac20 2024-04-24T02:13:22.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.706+0000 7f3fe9813640 1 -- 172.21.15.134:0/51822908 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fe4040040 con 0x7f3fe001ac20 2024-04-24T02:13:22.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.706+0000 7f3fe9813640 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef31320 con 0x55b96ef28740 2024-04-24T02:13:22.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.706+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3fdc075030 con 0x55b96ef28740 2024-04-24T02:13:22.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.707+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef31320 con 0x7f3fe001ac20 2024-04-24T02:13:22.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.707+0000 7f3fe9813640 1 -- 172.21.15.134:0/51822908 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fe4040040 con 0x7f3fe001ac20 2024-04-24T02:13:22.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.707+0000 7f3feb50c800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:13:22.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.707+0000 7f3feb50c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:13:22.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.707+0000 7f3feb50c800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:13:22.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.707+0000 7f3feb50c800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:13:22.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.707+0000 7f3feb50c800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:13:22.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.707+0000 7f3feb50c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:13:22.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.707+0000 7f3feb50c800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.707+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef2d300 con 0x55b96ef28740 2024-04-24T02:13:22.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.707+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3fdc075030 con 0x55b96ef28740 2024-04-24T02:13:22.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.707+0000 7f3feb50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:22.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.707+0000 7f3feb50c800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.707+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef2dba0 con 0x55b96ef28740 2024-04-24T02:13:22.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.707+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3fdc075030 con 0x55b96ef28740 2024-04-24T02:13:22.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.707+0000 7f3feb50c800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:13:22.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.707+0000 7f3feb50c800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.707+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef2cf40 con 0x55b96ef28740 2024-04-24T02:13:22.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.707+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3fdc075030 con 0x55b96ef28740 2024-04-24T02:13:22.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.707+0000 7f3feb50c800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:13:22.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.708+0000 7f3feb50c800 20 zone default found 2024-04-24T02:13:22.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.708+0000 7f3feb50c800 4 Realm: () 2024-04-24T02:13:22.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.708+0000 7f3feb50c800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:13:22.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.708+0000 7f3feb50c800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:13:22.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.708+0000 7f3feb50c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:13:22.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.708+0000 7f3feb50c800 20 zonegroup default 2024-04-24T02:13:22.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.708+0000 7f3feb50c800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.708+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef31780 con 0x7f3fe4031040 2024-04-24T02:13:22.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.708+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3fdc075030 con 0x7f3fe4031040 2024-04-24T02:13:22.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.708+0000 7f3feb50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:22.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.708+0000 7f3feb50c800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.708+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef33610 con 0x55b96ef2e880 2024-04-24T02:13:22.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.708+0000 7f3fe8811640 1 -- 172.21.15.134:0/51822908 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3fe005c040 con 0x55b96ef2e880 2024-04-24T02:13:22.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.708+0000 7f3feb50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:22.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.708+0000 7f3feb50c800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.708+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef339b0 con 0x55b96ef2e880 2024-04-24T02:13:22.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.708+0000 7f3fe8811640 1 -- 172.21.15.134:0/51822908 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3fe005c040 con 0x55b96ef2e880 2024-04-24T02:13:22.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.708+0000 7f3feb50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:22.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.708+0000 7f3feb50c800 20 started sync module instance, tier type = 2024-04-24T02:13:22.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.708+0000 7f3feb50c800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:13:22.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.708+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef32a50 con 0x7f3fe001ac20 2024-04-24T02:13:22.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.709+0000 7f3fe9813640 1 -- 172.21.15.134:0/51822908 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(44 notify.0 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fe4040040 con 0x7f3fe001ac20 2024-04-24T02:13:22.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.709+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94254918741616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef326b0 con 0x7f3fe001ac20 2024-04-24T02:13:22.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.709+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef346f0 con 0x55b96ef28740 2024-04-24T02:13:22.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.710+0000 7f3fe9813640 1 -- 172.21.15.134:0/51822908 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94254918741616] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fe4040040 con 0x7f3fe001ac20 2024-04-24T02:13:22.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.711+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fdc075030 con 0x55b96ef28740 2024-04-24T02:13:22.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.711+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94254918745424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef34620 con 0x55b96ef28740 2024-04-24T02:13:22.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.711+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef35150 con 0x55b96ef2e880 2024-04-24T02:13:22.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.712+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94254918745424] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fdc075030 con 0x55b96ef28740 2024-04-24T02:13:22.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.712+0000 7f3fe8811640 1 -- 172.21.15.134:0/51822908 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fe005c040 con 0x55b96ef2e880 2024-04-24T02:13:22.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.712+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94254918746480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef34590 con 0x55b96ef2e880 2024-04-24T02:13:22.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.712+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef36010 con 0x7f3fe001ac20 2024-04-24T02:13:22.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.713+0000 7f3fe9813640 1 -- 172.21.15.134:0/51822908 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(50 notify.3 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fe4040040 con 0x7f3fe001ac20 2024-04-24T02:13:22.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.713+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94254918753600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef36770 con 0x7f3fe001ac20 2024-04-24T02:13:22.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.713+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef37290 con 0x55b96ef28740 2024-04-24T02:13:22.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.713+0000 7f3fe8811640 1 -- 172.21.15.134:0/51822908 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94254918746480] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fe005c040 con 0x55b96ef2e880 2024-04-24T02:13:22.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.714+0000 7f3fe9813640 1 -- 172.21.15.134:0/51822908 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94254918753600] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fe4040040 con 0x7f3fe001ac20 2024-04-24T02:13:22.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.714+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fdc075030 con 0x55b96ef28740 2024-04-24T02:13:22.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.714+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94254918757728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef37250 con 0x55b96ef28740 2024-04-24T02:13:22.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.714+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef37b30 con 0x7f3fe4031040 2024-04-24T02:13:22.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.715+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(54 notify.5 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fdc075030 con 0x7f3fe4031040 2024-04-24T02:13:22.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.715+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94254918758992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef37ba0 con 0x7f3fe4031040 2024-04-24T02:13:22.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.715+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef386a0 con 0x7f3fe4031040 2024-04-24T02:13:22.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.716+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94254918757728] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fdc075030 con 0x55b96ef28740 2024-04-24T02:13:22.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.716+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94254918758992] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fdc075030 con 0x7f3fe4031040 2024-04-24T02:13:22.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.717+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(56 notify.6 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fdc075030 con 0x7f3fe4031040 2024-04-24T02:13:22.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.717+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94254918760048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef35540 con 0x7f3fe4031040 2024-04-24T02:13:22.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.717+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef38b10 con 0x7f3fe4031040 2024-04-24T02:13:22.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.718+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(58 notify.7 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fdc075030 con 0x7f3fe4031040 2024-04-24T02:13:22.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.718+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94254918764128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef38f70 con 0x7f3fe4031040 2024-04-24T02:13:22.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.718+0000 7f3feb50c800 20 add_watcher() i=0 2024-04-24T02:13:22.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.718+0000 7f3feb50c800 20 add_watcher() i=1 2024-04-24T02:13:22.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.718+0000 7f3feb50c800 20 add_watcher() i=2 2024-04-24T02:13:22.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.718+0000 7f3feb50c800 20 add_watcher() i=3 2024-04-24T02:13:22.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.718+0000 7f3feb50c800 20 add_watcher() i=4 2024-04-24T02:13:22.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.718+0000 7f3feb50c800 20 add_watcher() i=5 2024-04-24T02:13:22.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.718+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94254918760048] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fdc075030 con 0x7f3fe4031040 2024-04-24T02:13:22.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.718+0000 7f3feb50c800 20 add_watcher() i=6 2024-04-24T02:13:22.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.719+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94254918764128] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fdc075030 con 0x7f3fe4031040 2024-04-24T02:13:22.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.719+0000 7f3feb50c800 20 add_watcher() i=7 2024-04-24T02:13:22.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.719+0000 7f3feb50c800 2 all 8 watchers are set, enabling cache 2024-04-24T02:13:22.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.719+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef38190 con 0x55b96ef28740 2024-04-24T02:13:22.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.719+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3fdc075030 con 0x55b96ef28740 2024-04-24T02:13:22.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.720+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94254918765184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef38190 con 0x55b96ef28740 2024-04-24T02:13:22.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.721+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94254918765184] v32'209 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3fdc075030 con 0x55b96ef28740 2024-04-24T02:13:22.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.721+0000 7f3e9f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:13:22.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.721+0000 7f3feb50c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:13:22.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.721+0000 7f3feb50c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:13:22.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.721+0000 7f3feb50c800 5 note: GC not initialized 2024-04-24T02:13:22.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.721+0000 7f3e9e7e4640 20 reqs_thread_entry: start 2024-04-24T02:13:22.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.721+0000 7f3feb50c800 20 init_complete bucket index max shards: 11 2024-04-24T02:13:22.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.721+0000 7f3feb50c800 20 Filter name: none 2024-04-24T02:13:22.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.721+0000 7f3e0ffff640 20 reqs_thread_entry: start 2024-04-24T02:13:22.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.721+0000 7f3feb50c800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.721+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef6ee10 con 0x55b96ef28740 2024-04-24T02:13:22.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.722+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3fdc075030 con 0x55b96ef28740 2024-04-24T02:13:22.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.722+0000 7f3feb50c800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T02:13:22.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.722+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef70360 con 0x7f3fe4031040 2024-04-24T02:13:22.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.722+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f3fdc075030 con 0x7f3fe4031040 2024-04-24T02:13:22.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.723+0000 7f3e9f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:13:22.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.723+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94254918765184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef25c70 con 0x55b96ef28740 2024-04-24T02:13:22.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.724+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94254918765184] v32'210 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3fdc075030 con 0x55b96ef28740 2024-04-24T02:13:22.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.724+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94254918741616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef38a80 con 0x7f3fe001ac20 2024-04-24T02:13:22.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.725+0000 7f3fe9813640 1 -- 172.21.15.134:0/51822908 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94254918741616] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fe4040040 con 0x7f3fe001ac20 2024-04-24T02:13:22.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.725+0000 7f3feb50c800 20 remove_watcher() i=0 2024-04-24T02:13:22.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.725+0000 7f3feb50c800 2 removed watcher, disabling cache 2024-04-24T02:13:22.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.725+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94254918745424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef38a80 con 0x55b96ef28740 2024-04-24T02:13:22.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.726+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94254918745424] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fdc075030 con 0x55b96ef28740 2024-04-24T02:13:22.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.726+0000 7f3feb50c800 20 remove_watcher() i=1 2024-04-24T02:13:22.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.726+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94254918746480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef38a80 con 0x55b96ef2e880 2024-04-24T02:13:22.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.728+0000 7f3fe8811640 1 -- 172.21.15.134:0/51822908 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94254918746480] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fe005c040 con 0x55b96ef2e880 2024-04-24T02:13:22.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.728+0000 7f3feb50c800 20 remove_watcher() i=2 2024-04-24T02:13:22.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.728+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94254918753600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef32e70 con 0x7f3fe001ac20 2024-04-24T02:13:22.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.729+0000 7f3fe9813640 1 -- 172.21.15.134:0/51822908 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94254918753600] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fe4040040 con 0x7f3fe001ac20 2024-04-24T02:13:22.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.729+0000 7f3feb50c800 20 remove_watcher() i=3 2024-04-24T02:13:22.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.729+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94254918757728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef35d40 con 0x55b96ef28740 2024-04-24T02:13:22.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.730+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94254918757728] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fdc075030 con 0x55b96ef28740 2024-04-24T02:13:22.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.730+0000 7f3feb50c800 20 remove_watcher() i=4 2024-04-24T02:13:22.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.730+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94254918758992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef35d40 con 0x7f3fe4031040 2024-04-24T02:13:22.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.731+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94254918758992] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fdc075030 con 0x7f3fe4031040 2024-04-24T02:13:22.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.731+0000 7f3feb50c800 20 remove_watcher() i=5 2024-04-24T02:13:22.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.731+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94254918760048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef35d40 con 0x7f3fe4031040 2024-04-24T02:13:22.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.732+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94254918760048] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fdc075030 con 0x7f3fe4031040 2024-04-24T02:13:22.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.732+0000 7f3feb50c800 20 remove_watcher() i=6 2024-04-24T02:13:22.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.732+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94254918764128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b96ef35d40 con 0x7f3fe4031040 2024-04-24T02:13:22.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.733+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94254918764128] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fdc075030 con 0x7f3fe4031040 2024-04-24T02:13:22.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.733+0000 7f3feb50c800 20 remove_watcher() i=7 2024-04-24T02:13:22.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.733+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f3fe4031040 msgr2=0x7f3fe4032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.733+0000 7f3feb50c800 1 --2- 172.21.15.134:0/51822908 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f3fe4031040 0x7f3fe4032430 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.733+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b96ef28740 msgr2=0x55b96ef2ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.733+0000 7f3feb50c800 1 --2- 172.21.15.134:0/51822908 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b96ef28740 0x55b96ef2ac00 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.733+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f3fe001ac20 msgr2=0x7f3fe001c420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.733+0000 7f3feb50c800 1 --2- 172.21.15.134:0/51822908 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f3fe001ac20 0x7f3fe001c420 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.733+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55b96ef2e880 msgr2=0x55b96ef30c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.733+0000 7f3feb50c800 1 --2- 172.21.15.134:0/51822908 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55b96ef2e880 0x55b96ef30c70 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.733+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3eb4036900 msgr2=0x7f3eb4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.733+0000 7f3feb50c800 1 --2- 172.21.15.134:0/51822908 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3eb4036900 0x7f3eb4038dc0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x55b96ed69e40 tx=0x7f3fe401f000 comp rx=0 tx=0).stop 2024-04-24T02:13:22.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.733+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b96ef15b30 msgr2=0x55b96ef1d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.733+0000 7f3fe9012640 1 -- 172.21.15.134:0/51822908 reap_dead start 2024-04-24T02:13:22.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.733+0000 7f3feb50c800 1 --2- 172.21.15.134:0/51822908 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b96ef15b30 0x55b96ef1d050 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0024a50 tx=0x7f3fe004c080 comp rx=0 tx=0).stop 2024-04-24T02:13:22.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.733+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 shutdown_connections 2024-04-24T02:13:22.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.733+0000 7f3feb50c800 1 --2- 172.21.15.134:0/51822908 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b96ef15b30 0x55b96ef1d050 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.733+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 >> 172.21.15.134:0/51822908 conn(0x55b96ef11e90 msgr2=0x55b96ef0f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:22.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.733+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 shutdown_connections 2024-04-24T02:13:22.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.733+0000 7f3feb50c800 1 -- 172.21.15.134:0/51822908 wait complete. 2024-04-24T02:13:22.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.733+0000 7f3feb50c800 1 -- 172.21.15.134:0/620515707 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3ec0036900 msgr2=0x7f3ec0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.733+0000 7f3feb50c800 1 --2- 172.21.15.134:0/620515707 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3ec0036900 0x7f3ec0038dc0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x55b96eef8f30 tx=0x7f3fe4005840 comp rx=0 tx=0).stop 2024-04-24T02:13:22.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.733+0000 7f3feb50c800 1 -- 172.21.15.134:0/620515707 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b96ef087f0 msgr2=0x55b96ef08c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.733+0000 7f3feb50c800 1 --2- 172.21.15.134:0/620515707 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b96ef087f0 0x55b96ef08c10 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0001ed0 tx=0x7f3fe000ea00 comp rx=0 tx=0).stop 2024-04-24T02:13:22.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.733+0000 7f3feb50c800 1 -- 172.21.15.134:0/620515707 shutdown_connections 2024-04-24T02:13:22.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.733+0000 7f3feb50c800 1 --2- 172.21.15.134:0/620515707 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3ec0036900 0x7f3ec0038dc0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.733+0000 7f3feb50c800 1 --2- 172.21.15.134:0/620515707 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b96ef087f0 0x55b96ef08c10 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.733+0000 7f3feb50c800 1 -- 172.21.15.134:0/620515707 >> 172.21.15.134:0/620515707 conn(0x55b96eefc890 msgr2=0x55b96eefcc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:22.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.733+0000 7f3feb50c800 1 -- 172.21.15.134:0/620515707 shutdown_connections 2024-04-24T02:13:22.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.733+0000 7f3feb50c800 1 -- 172.21.15.134:0/620515707 wait complete. 2024-04-24T02:13:22.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.734+0000 7f3feb50c800 1 -- 172.21.15.134:0/2270449562 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b96edf6120 msgr2=0x55b96eef7480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.734+0000 7f3feb50c800 1 --2- 172.21.15.134:0/2270449562 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b96edf6120 0x55b96eef7480 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.734+0000 7f3feb50c800 1 -- 172.21.15.134:0/2270449562 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3ed0036900 msgr2=0x7f3ed0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.734+0000 7f3feb50c800 1 --2- 172.21.15.134:0/2270449562 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3ed0036900 0x7f3ed0038dc0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0000f60 tx=0x7f3fe0001370 comp rx=0 tx=0).stop 2024-04-24T02:13:22.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.734+0000 7f3feb50c800 1 -- 172.21.15.134:0/2270449562 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b96edf4fb0 msgr2=0x55b96ed6a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.734+0000 7f3feb50c800 1 --2- 172.21.15.134:0/2270449562 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b96edf4fb0 0x55b96ed6a9c0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc052540 tx=0x7f3fdc003020 comp rx=0 tx=0).stop 2024-04-24T02:13:22.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.734+0000 7f3feb50c800 1 -- 172.21.15.134:0/2270449562 shutdown_connections 2024-04-24T02:13:22.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.734+0000 7f3feb50c800 1 --2- 172.21.15.134:0/2270449562 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b96edf6120 0x55b96eef7480 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.734+0000 7f3feb50c800 1 --2- 172.21.15.134:0/2270449562 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3ed0036900 0x7f3ed0038dc0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.734+0000 7f3feb50c800 1 --2- 172.21.15.134:0/2270449562 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b96edf4fb0 0x55b96ed6a9c0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.734+0000 7f3feb50c800 1 -- 172.21.15.134:0/2270449562 >> 172.21.15.134:0/2270449562 conn(0x55b96edf0550 msgr2=0x55b96eee0710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:22.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.734+0000 7f3feb50c800 1 -- 172.21.15.134:0/2270449562 shutdown_connections 2024-04-24T02:13:22.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.734+0000 7f3feb50c800 1 -- 172.21.15.134:0/2270449562 wait complete. 2024-04-24T02:13:22.748 INFO:teuthology.orchestra.run.smithi134.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-04-24T02:00:00.000000Z","epoch":1713924000,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-04-24T02:00:00.000000Z","epoch":1713924000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}]},{"bucket":"myfoo2","time":"2024-04-24T02:00:00.000000Z","epoch":1713924000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-04-24T02:00:00.000000Z","epoch":1713924000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-04-24T02:00:00.000000Z","epoch":1713924000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}}]} 2024-04-24T02:13:22.748 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}]}, {'bucket': 'myfoo2', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}}]} 2024-04-24T02:13:22.748 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-04-24T02:13:22.748 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-04-24T02:13:22.748 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-04-24T02:13:22.794 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:13:22.795 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:13:22.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.795+0000 7f7ab0937800 1 Processor -- start 2024-04-24T02:13:22.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.795+0000 7f7ab0937800 1 -- start start 2024-04-24T02:13:22.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.795+0000 7f7ab0937800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x560d69a888d0 0x560d69a8acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.795+0000 7f7ab0937800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560d69946d40 con 0x560d69a8b200 2024-04-24T02:13:22.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.795+0000 7f7ab0937800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x560d699194d0 con 0x560d69a888d0 2024-04-24T02:13:22.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.795+0000 7f7aac6f9640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x560d69a888d0 0x560d69a8acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.795+0000 7f7aabef8640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x560d69a8b200 0x560d69a8d5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:57826/0 (socket says 172.21.15.134:57826) 2024-04-24T02:13:22.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.795+0000 7f7aabef8640 1 -- 172.21.15.134:0/3029575436 learned_addr learned my addr 172.21.15.134:0/3029575436 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:13:22.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.796+0000 7f7aac6f9640 1 -- 172.21.15.134:0/3029575436 >> v1:172.21.15.104:6789/0 conn(0x560d69a8b200 legacy=0x560d69a8d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.796+0000 7f7aac6f9640 1 -- 172.21.15.134:0/3029575436 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d69945590 con 0x560d69a888d0 2024-04-24T02:13:22.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.798+0000 7f7aac6f9640 1 --2- 172.21.15.134:0/3029575436 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d69a888d0 0x560d69a8acc0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f7aa400a470 tx=0x7f7aa401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1a9b847345e5cf3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.798+0000 7f7aab6f7640 1 -- 172.21.15.134:0/3029575436 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7aa4057070 con 0x560d69a888d0 2024-04-24T02:13:22.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.798+0000 7f7aab6f7640 1 -- 172.21.15.134:0/3029575436 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7aa4052570 con 0x560d69a888d0 2024-04-24T02:13:22.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.798+0000 7f7aab6f7640 1 -- 172.21.15.134:0/3029575436 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7aa4052870 con 0x560d69a888d0 2024-04-24T02:13:22.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.798+0000 7f7ab0937800 1 -- 172.21.15.134:0/3029575436 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d69a888d0 msgr2=0x560d69a8acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.798+0000 7f7ab0937800 1 --2- 172.21.15.134:0/3029575436 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d69a888d0 0x560d69a8acc0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f7aa400a470 tx=0x7f7aa401ce90 comp rx=0 tx=0).stop 2024-04-24T02:13:22.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.798+0000 7f7ab0937800 1 -- 172.21.15.134:0/3029575436 shutdown_connections 2024-04-24T02:13:22.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.798+0000 7f7ab0937800 1 --2- 172.21.15.134:0/3029575436 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d69a888d0 0x560d69a8acc0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.798+0000 7f7ab0937800 1 -- 172.21.15.134:0/3029575436 >> 172.21.15.134:0/3029575436 conn(0x560d69a823a0 msgr2=0x560d69a847c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:22.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.798+0000 7f7ab0937800 1 -- 172.21.15.134:0/3029575436 shutdown_connections 2024-04-24T02:13:22.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.798+0000 7f7ab0937800 1 -- 172.21.15.134:0/3029575436 wait complete. 2024-04-24T02:13:22.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.810+0000 7f7ab0937800 1 Processor -- start 2024-04-24T02:13:22.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.810+0000 7f7ab0937800 1 -- start start 2024-04-24T02:13:22.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.810+0000 7f7ab0937800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d69a888d0 0x560d69b79090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.810+0000 7f7ab0937800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560d699d33b0 con 0x560d69a888d0 2024-04-24T02:13:22.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.810+0000 7f7aac6f9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d69a888d0 0x560d69b79090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.810+0000 7f7aac6f9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d69a888d0 0x560d69b79090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55280/0 (socket says 172.21.15.134:55280) 2024-04-24T02:13:22.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.810+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2504228583 learned_addr learned my addr 172.21.15.134:0/2504228583 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:22.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.811+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2504228583 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d69b79660 con 0x560d69a888d0 2024-04-24T02:13:22.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.811+0000 7f7aac6f9640 1 --2- 172.21.15.134:0/2504228583 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d69a888d0 0x560d69b79090 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4055040 tx=0x7f7aa404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80307c83ddbd978b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.811+0000 7f799a60c640 1 -- 172.21.15.134:0/2504228583 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7aa4057070 con 0x560d69a888d0 2024-04-24T02:13:22.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.811+0000 7f799a60c640 1 -- 172.21.15.134:0/2504228583 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7aa4063070 con 0x560d69a888d0 2024-04-24T02:13:22.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.811+0000 7f799a60c640 1 -- 172.21.15.134:0/2504228583 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7aa4052720 con 0x560d69a888d0 2024-04-24T02:13:22.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.812+0000 7f7ab0937800 1 -- 172.21.15.134:0/2504228583 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d69a888d0 msgr2=0x560d69b79090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.812+0000 7f7ab0937800 1 --2- 172.21.15.134:0/2504228583 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d69a888d0 0x560d69b79090 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4055040 tx=0x7f7aa404c000 comp rx=0 tx=0).stop 2024-04-24T02:13:22.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.812+0000 7f7ab0937800 1 -- 172.21.15.134:0/2504228583 shutdown_connections 2024-04-24T02:13:22.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.812+0000 7f7ab0937800 1 --2- 172.21.15.134:0/2504228583 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d69a888d0 0x560d69b79090 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.812+0000 7f7ab0937800 1 -- 172.21.15.134:0/2504228583 >> 172.21.15.134:0/2504228583 conn(0x560d69a823a0 msgr2=0x560d69b749b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:22.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.812+0000 7f7ab0937800 1 -- 172.21.15.134:0/2504228583 shutdown_connections 2024-04-24T02:13:22.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.812+0000 7f7ab0937800 1 -- 172.21.15.134:0/2504228583 wait complete. 2024-04-24T02:13:22.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.812+0000 7f7ab0937800 1 Processor -- start 2024-04-24T02:13:22.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.812+0000 7f7ab0937800 1 -- start start 2024-04-24T02:13:22.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.812+0000 7f7ab0937800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d69a888d0 0x560d69b80b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.812+0000 7f7ab0937800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560d69a8efb0 con 0x560d69a888d0 2024-04-24T02:13:22.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.813+0000 7f7aac6f9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d69a888d0 0x560d69b80b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.813+0000 7f7aac6f9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d69a888d0 0x560d69b80b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55286/0 (socket says 172.21.15.134:55286) 2024-04-24T02:13:22.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.813+0000 7f7aac6f9640 1 -- 172.21.15.134:0/3713540394 learned_addr learned my addr 172.21.15.134:0/3713540394 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:22.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.813+0000 7f7aac6f9640 1 -- 172.21.15.134:0/3713540394 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d69b81080 con 0x560d69a888d0 2024-04-24T02:13:22.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.813+0000 7f7aac6f9640 1 --2- 172.21.15.134:0/3713540394 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d69a888d0 0x560d69b80b40 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4000c00 tx=0x7f7aa4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.813+0000 7f7998e09640 1 -- 172.21.15.134:0/3713540394 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7aa4052db0 con 0x560d69a888d0 2024-04-24T02:13:22.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.813+0000 7f7998e09640 1 -- 172.21.15.134:0/3713540394 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7aa406c070 con 0x560d69a888d0 2024-04-24T02:13:22.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.813+0000 7f7ab0937800 1 -- 172.21.15.134:0/3713540394 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560d69b81310 con 0x560d69a888d0 2024-04-24T02:13:22.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.813+0000 7f7998e09640 1 -- 172.21.15.134:0/3713540394 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7aa405e5b0 con 0x560d69a888d0 2024-04-24T02:13:22.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.813+0000 7f7ab0937800 1 -- 172.21.15.134:0/3713540394 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d69b83fc0 con 0x560d69a888d0 2024-04-24T02:13:22.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.814+0000 7f7998e09640 1 -- 172.21.15.134:0/3713540394 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7aa4077060 con 0x560d69a888d0 2024-04-24T02:13:22.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.814+0000 7f7998e09640 1 --2- 172.21.15.134:0/3713540394 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7994036900 0x7f7994038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.814+0000 7f7998e09640 1 -- 172.21.15.134:0/3713540394 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f7aa408e440 con 0x560d69a888d0 2024-04-24T02:13:22.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.814+0000 7f7aabef8640 1 --2- 172.21.15.134:0/3713540394 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7994036900 0x7f7994038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.814+0000 7f7ab0937800 1 --2- 172.21.15.134:0/3713540394 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560d69a8b200 0x560d69b87d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.814+0000 7f7ab0937800 1 -- 172.21.15.134:0/3713540394 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560d69b88310 con 0x560d69a8b200 2024-04-24T02:13:22.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.815+0000 7f7aacefa640 1 --2- 172.21.15.134:0/3713540394 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560d69a8b200 0x560d69b87d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.815+0000 7f7aabef8640 1 --2- 172.21.15.134:0/3713540394 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7994036900 0x7f7994038dc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7a94001d90 tx=0x7f7a940012f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.815+0000 7f7aacefa640 1 --2- 172.21.15.134:0/3713540394 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560d69a8b200 0x560d69b87d80 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.815+0000 7f7aacefa640 1 -- 172.21.15.134:0/3713540394 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7a9c00a4a0 con 0x560d69a8b200 2024-04-24T02:13:22.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.815+0000 7f7ab0937800 1 -- 172.21.15.134:0/3713540394 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560d69b88bb0 con 0x560d69a8b200 2024-04-24T02:13:22.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.815+0000 7f7aacefa640 1 -- 172.21.15.134:0/3713540394 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7a9c00a4a0 con 0x560d69a8b200 2024-04-24T02:13:22.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.815+0000 7f7ab0937800 1 -- 172.21.15.134:0/3713540394 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560d69b89f60 con 0x560d69a8b200 2024-04-24T02:13:22.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.816+0000 7f7aacefa640 1 -- 172.21.15.134:0/3713540394 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7a9c00a4a0 con 0x560d69a8b200 2024-04-24T02:13:22.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.816+0000 7f7ab0937800 1 -- 172.21.15.134:0/3713540394 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560d69b89400 con 0x560d69a8b200 2024-04-24T02:13:22.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.816+0000 7f7aacefa640 1 -- 172.21.15.134:0/3713540394 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7a9c00a4a0 con 0x560d69a8b200 2024-04-24T02:13:22.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.816+0000 7f7ab0937800 1 -- 172.21.15.134:0/3713540394 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560d69b89820 con 0x560d69a8b200 2024-04-24T02:13:22.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.816+0000 7f7aacefa640 1 -- 172.21.15.134:0/3713540394 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7a9c00a4a0 con 0x560d69a8b200 2024-04-24T02:13:22.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.816+0000 7f7ab0937800 1 Processor -- start 2024-04-24T02:13:22.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.816+0000 7f7ab0937800 1 -- start start 2024-04-24T02:13:22.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.817+0000 7f7ab0937800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d69b98f40 0x560d69b99360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.817+0000 7f7ab0937800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560d699796b0 con 0x560d69b98f40 2024-04-24T02:13:22.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.817+0000 7f7aabef8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d69b98f40 0x560d69b99360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.817+0000 7f7aabef8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d69b98f40 0x560d69b99360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55294/0 (socket says 172.21.15.134:55294) 2024-04-24T02:13:22.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.817+0000 7f7aabef8640 1 -- 172.21.15.134:0/1820632480 learned_addr learned my addr 172.21.15.134:0/1820632480 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:22.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.817+0000 7f7aabef8640 1 -- 172.21.15.134:0/1820632480 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d69b998a0 con 0x560d69b98f40 2024-04-24T02:13:22.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.817+0000 7f7aabef8640 1 --2- 172.21.15.134:0/1820632480 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d69b98f40 0x560d69b99360 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f7a9400efd0 tx=0x7f7a9400d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.817+0000 7f7991ffb640 1 -- 172.21.15.134:0/1820632480 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a9401b550 con 0x560d69b98f40 2024-04-24T02:13:22.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.817+0000 7f7991ffb640 1 -- 172.21.15.134:0/1820632480 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a9401b6f0 con 0x560d69b98f40 2024-04-24T02:13:22.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.817+0000 7f7ab0937800 1 -- 172.21.15.134:0/1820632480 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560d69b9a310 con 0x560d69b98f40 2024-04-24T02:13:22.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.817+0000 7f7991ffb640 1 -- 172.21.15.134:0/1820632480 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a9401b9f0 con 0x560d69b98f40 2024-04-24T02:13:22.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.818+0000 7f7ab0937800 1 -- 172.21.15.134:0/1820632480 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d69b9a810 con 0x560d69b98f40 2024-04-24T02:13:22.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.818+0000 7f7991ffb640 1 -- 172.21.15.134:0/1820632480 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7a94023020 con 0x560d69b98f40 2024-04-24T02:13:22.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.818+0000 7f7991ffb640 1 --2- 172.21.15.134:0/1820632480 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7984036950 0x7f7984038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.818+0000 7f7991ffb640 1 -- 172.21.15.134:0/1820632480 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f7a94021020 con 0x560d69b98f40 2024-04-24T02:13:22.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.818+0000 7f7aacefa640 1 --2- 172.21.15.134:0/1820632480 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7984036950 0x7f7984038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.819+0000 7f7ab0937800 1 Processor -- start 2024-04-24T02:13:22.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.819+0000 7f7ab0937800 1 -- start start 2024-04-24T02:13:22.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.819+0000 7f7aacefa640 1 --2- 172.21.15.134:0/1820632480 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7984036950 0x7f7984038e10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x560d69b897a0 tx=0x7f7a9c005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.819+0000 7f7ab0937800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d69ba62e0 0x560d69ba6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.819+0000 7f7ab0937800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560d69b79920 con 0x560d69ba62e0 2024-04-24T02:13:22.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.819+0000 7f7aabef8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d69ba62e0 0x560d69ba6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.819+0000 7f7aabef8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d69ba62e0 0x560d69ba6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55308/0 (socket says 172.21.15.134:55308) 2024-04-24T02:13:22.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.819+0000 7f7aabef8640 1 -- 172.21.15.134:0/676591690 learned_addr learned my addr 172.21.15.134:0/676591690 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:22.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.819+0000 7f7aabef8640 1 -- 172.21.15.134:0/676591690 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d69ba6cd0 con 0x560d69ba62e0 2024-04-24T02:13:22.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.820+0000 7f7aabef8640 1 --2- 172.21.15.134:0/676591690 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d69ba62e0 0x560d69ba6700 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f7a9404d050 tx=0x7f7a9404d080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59853f3f8fe32947 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.820+0000 7f798b7fe640 1 -- 172.21.15.134:0/676591690 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a940259f0 con 0x560d69ba62e0 2024-04-24T02:13:22.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.820+0000 7f798b7fe640 1 -- 172.21.15.134:0/676591690 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a94025410 con 0x560d69ba62e0 2024-04-24T02:13:22.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.820+0000 7f798b7fe640 1 -- 172.21.15.134:0/676591690 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a940460c0 con 0x560d69ba62e0 2024-04-24T02:13:22.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.820+0000 7f7ab0937800 1 -- 172.21.15.134:0/676591690 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d69ba62e0 msgr2=0x560d69ba6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.820+0000 7f7ab0937800 1 --2- 172.21.15.134:0/676591690 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d69ba62e0 0x560d69ba6700 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f7a9404d050 tx=0x7f7a9404d080 comp rx=0 tx=0).stop 2024-04-24T02:13:22.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.820+0000 7f7ab0937800 1 -- 172.21.15.134:0/676591690 shutdown_connections 2024-04-24T02:13:22.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.820+0000 7f7ab0937800 1 --2- 172.21.15.134:0/676591690 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d69ba62e0 0x560d69ba6700 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.820+0000 7f7ab0937800 1 -- 172.21.15.134:0/676591690 >> 172.21.15.134:0/676591690 conn(0x560d69ba2640 msgr2=0x560d69ba06a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:22.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.820+0000 7f7ab0937800 1 -- 172.21.15.134:0/676591690 shutdown_connections 2024-04-24T02:13:22.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.820+0000 7f7ab0937800 1 -- 172.21.15.134:0/676591690 wait complete. 2024-04-24T02:13:22.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.821+0000 7f7ab0937800 1 Processor -- start 2024-04-24T02:13:22.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.821+0000 7f7ab0937800 1 -- start start 2024-04-24T02:13:22.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.821+0000 7f7ab0937800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d69ba62e0 0x560d69bad950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.821+0000 7f7ab0937800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560d69ba7440 con 0x560d69ba62e0 2024-04-24T02:13:22.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.821+0000 7f7aabef8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d69ba62e0 0x560d69bad950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.821+0000 7f7aabef8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d69ba62e0 0x560d69bad950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55312/0 (socket says 172.21.15.134:55312) 2024-04-24T02:13:22.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.821+0000 7f7aabef8640 1 -- 172.21.15.134:0/2445780801 learned_addr learned my addr 172.21.15.134:0/2445780801 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:22.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.821+0000 7f7aabef8640 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d69bade90 con 0x560d69ba62e0 2024-04-24T02:13:22.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.822+0000 7f7aabef8640 1 --2- 172.21.15.134:0/2445780801 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d69ba62e0 0x560d69bad950 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f7a94049010 tx=0x7f7a9404cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.822+0000 7f7989ffb640 1 -- 172.21.15.134:0/2445780801 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a94019530 con 0x560d69ba62e0 2024-04-24T02:13:22.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.822+0000 7f7989ffb640 1 -- 172.21.15.134:0/2445780801 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a9404e280 con 0x560d69ba62e0 2024-04-24T02:13:22.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.822+0000 7f7989ffb640 1 -- 172.21.15.134:0/2445780801 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a9404e5e0 con 0x560d69ba62e0 2024-04-24T02:13:22.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.822+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560d69bae120 con 0x560d69ba62e0 2024-04-24T02:13:22.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.822+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d69bae120 con 0x560d69ba62e0 2024-04-24T02:13:22.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.823+0000 7f7989ffb640 1 -- 172.21.15.134:0/2445780801 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7a9404ea40 con 0x560d69ba62e0 2024-04-24T02:13:22.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.823+0000 7f7989ffb640 1 --2- 172.21.15.134:0/2445780801 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f797c036950 0x7f797c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.823+0000 7f7989ffb640 1 -- 172.21.15.134:0/2445780801 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f7a94039bf0 con 0x560d69ba62e0 2024-04-24T02:13:22.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.823+0000 7f7ab0937800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.823+0000 7f7aacefa640 1 --2- 172.21.15.134:0/2445780801 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f797c036950 0x7f797c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.823+0000 7f7ab0937800 1 --2- 172.21.15.134:0/2445780801 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560d69bb91f0 0x560d69bbb680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.823+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560d69bbbdd0 con 0x560d69bb91f0 2024-04-24T02:13:22.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.823+0000 7f7aac6f9640 1 --2- 172.21.15.134:0/2445780801 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560d69bb91f0 0x560d69bbb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.823+0000 7f7aacefa640 1 --2- 172.21.15.134:0/2445780801 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f797c036950 0x7f797c038e10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x560d69b88b10 tx=0x7f7a9c01f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.823+0000 7f7aac6f9640 1 --2- 172.21.15.134:0/2445780801 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560d69bb91f0 0x560d69bbb680 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.824+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7aa408e0b0 con 0x560d69bb91f0 2024-04-24T02:13:22.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.824+0000 7f7ab0937800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:22.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.824+0000 7f7ab0937800 20 realm 2024-04-24T02:13:22.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.824+0000 7f7ab0937800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.824+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560d69bbc1e0 con 0x560d69bb91f0 2024-04-24T02:13:22.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.824+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7aa408e0b0 con 0x560d69bb91f0 2024-04-24T02:13:22.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.824+0000 7f7ab0937800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:22.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.824+0000 7f7ab0937800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:13:22.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.824+0000 7f7ab0937800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.824+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560d69bbcab0 con 0x560d69bb91f0 2024-04-24T02:13:22.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.824+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7aa408e0b0 con 0x560d69bb91f0 2024-04-24T02:13:22.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.824+0000 7f7ab0937800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:22.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.824+0000 7f7ab0937800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.824+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560d69bbce50 con 0x560d69bb91f0 2024-04-24T02:13:22.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.824+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7aa408e0b0 con 0x560d69bb91f0 2024-04-24T02:13:22.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.824+0000 7f7ab0937800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:13:22.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.824+0000 7f7ab0937800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.824+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560d69bbd2b0 con 0x560d69bb91f0 2024-04-24T02:13:22.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.824+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7aa408e0b0 con 0x560d69bb91f0 2024-04-24T02:13:22.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.825+0000 7f7ab0937800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:13:22.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.825+0000 7f7ab0937800 20 searching for the correct realm 2024-04-24T02:13:22.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.825+0000 7f7ab0937800 1 --2- 172.21.15.134:0/2445780801 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x560d69bbf300 0x560d69bc16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.825+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc1da0 con 0x560d69bbf300 2024-04-24T02:13:22.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.825+0000 7f7aabef8640 1 --2- 172.21.15.134:0/2445780801 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x560d69bbf300 0x560d69bc16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.825+0000 7f7aabef8640 1 --2- 172.21.15.134:0/2445780801 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x560d69bbf300 0x560d69bc16f0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.825+0000 7f7aabef8640 1 -- 172.21.15.134:0/2445780801 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a94009050 con 0x560d69bbf300 2024-04-24T02:13:22.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.825+0000 7f7aabef8640 1 --2- 172.21.15.134:0/2445780801 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f7a94040b60 0x7f7a940490b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.825+0000 7f7aabef8640 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc1da0 con 0x7f7a94040b60 2024-04-24T02:13:22.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.825+0000 7f7aacefa640 1 --2- 172.21.15.134:0/2445780801 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f7a94040b60 0x7f7a940490b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.826+0000 7f7aacefa640 1 --2- 172.21.15.134:0/2445780801 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f7a94040b60 0x7f7a940490b0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.826+0000 7f7aacefa640 1 -- 172.21.15.134:0/2445780801 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a9c01f070 con 0x7f7a94040b60 2024-04-24T02:13:22.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.826+0000 7f7aacefa640 1 --2- 172.21.15.134:0/2445780801 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f7a9c031040 0x7f7a9c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.826+0000 7f7aacefa640 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc1da0 con 0x7f7a9c031040 2024-04-24T02:13:22.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.826+0000 7f7aac6f9640 1 --2- 172.21.15.134:0/2445780801 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f7a9c031040 0x7f7a9c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.826+0000 7f7aac6f9640 1 --2- 172.21.15.134:0/2445780801 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f7a9c031040 0x7f7a9c032940 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.827+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7aa408e0b0 con 0x7f7a9c031040 2024-04-24T02:13:22.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.827+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc1da0 con 0x560d69bb91f0 2024-04-24T02:13:22.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.827+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7aa408e0b0 con 0x560d69bb91f0 2024-04-24T02:13:22.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.827+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc1da0 con 0x560d69bb91f0 2024-04-24T02:13:22.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.827+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7aa408e0b0 con 0x560d69bb91f0 2024-04-24T02:13:22.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.827+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc1da0 con 0x7f7a9c031040 2024-04-24T02:13:22.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.827+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7aa408e0b0 con 0x7f7a9c031040 2024-04-24T02:13:22.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.827+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc1da0 con 0x7f7a94040b60 2024-04-24T02:13:22.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.828+0000 7f7aacefa640 1 -- 172.21.15.134:0/2445780801 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a9c01f070 con 0x7f7a94040b60 2024-04-24T02:13:22.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.828+0000 7f7aacefa640 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc1da0 con 0x7f7a94040b60 2024-04-24T02:13:22.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.828+0000 7f7aacefa640 1 -- 172.21.15.134:0/2445780801 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a9c01f070 con 0x7f7a94040b60 2024-04-24T02:13:22.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.828+0000 7f7aacefa640 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc1da0 con 0x560d69bbf300 2024-04-24T02:13:22.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.828+0000 7f7aabef8640 1 -- 172.21.15.134:0/2445780801 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a94009050 con 0x560d69bbf300 2024-04-24T02:13:22.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.828+0000 7f7aabef8640 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc1da0 con 0x560d69bb91f0 2024-04-24T02:13:22.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.828+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7aa408e0b0 con 0x560d69bb91f0 2024-04-24T02:13:22.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.828+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc1da0 con 0x7f7a9c031040 2024-04-24T02:13:22.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.829+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7aa408e0b0 con 0x7f7a9c031040 2024-04-24T02:13:22.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.829+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc1da0 con 0x560d69bb91f0 2024-04-24T02:13:22.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.829+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7aa408e0b0 con 0x560d69bb91f0 2024-04-24T02:13:22.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.829+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc1da0 con 0x7f7a94040b60 2024-04-24T02:13:22.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.829+0000 7f7aacefa640 1 -- 172.21.15.134:0/2445780801 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7a9c01f070 con 0x7f7a94040b60 2024-04-24T02:13:22.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.829+0000 7f7aacefa640 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc1da0 con 0x560d69bbf300 2024-04-24T02:13:22.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.829+0000 7f7aabef8640 1 -- 172.21.15.134:0/2445780801 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a94009050 con 0x560d69bbf300 2024-04-24T02:13:22.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.829+0000 7f7aabef8640 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc1da0 con 0x560d69bbf300 2024-04-24T02:13:22.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.830+0000 7f7aabef8640 1 -- 172.21.15.134:0/2445780801 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a94009050 con 0x560d69bbf300 2024-04-24T02:13:22.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.830+0000 7f7aabef8640 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc1da0 con 0x7f7a94040b60 2024-04-24T02:13:22.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.830+0000 7f7aacefa640 1 -- 172.21.15.134:0/2445780801 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a9c01f070 con 0x7f7a94040b60 2024-04-24T02:13:22.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.830+0000 7f7aacefa640 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc1da0 con 0x560d69bbf300 2024-04-24T02:13:22.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.830+0000 7f7aabef8640 1 -- 172.21.15.134:0/2445780801 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a94009050 con 0x560d69bbf300 2024-04-24T02:13:22.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.830+0000 7f7aabef8640 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc1da0 con 0x560d69bbf300 2024-04-24T02:13:22.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.830+0000 7f7aabef8640 1 -- 172.21.15.134:0/2445780801 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a94009050 con 0x560d69bbf300 2024-04-24T02:13:22.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.830+0000 7f7aabef8640 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc1da0 con 0x560d69bb91f0 2024-04-24T02:13:22.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.830+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7aa408e0b0 con 0x560d69bb91f0 2024-04-24T02:13:22.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.830+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc1da0 con 0x560d69bb91f0 2024-04-24T02:13:22.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.831+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f7aa408e0b0 con 0x560d69bb91f0 2024-04-24T02:13:22.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.831+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc1da0 con 0x7f7a9c031040 2024-04-24T02:13:22.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.831+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7aa408e0b0 con 0x7f7a9c031040 2024-04-24T02:13:22.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.831+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc1da0 con 0x560d69bbf300 2024-04-24T02:13:22.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.831+0000 7f7aabef8640 1 -- 172.21.15.134:0/2445780801 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a94009050 con 0x560d69bbf300 2024-04-24T02:13:22.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.831+0000 7f7aabef8640 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc1da0 con 0x7f7a94040b60 2024-04-24T02:13:22.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.831+0000 7f7aacefa640 1 -- 172.21.15.134:0/2445780801 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a9c01f070 con 0x7f7a94040b60 2024-04-24T02:13:22.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.832+0000 7f7aacefa640 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc1da0 con 0x560d69bb91f0 2024-04-24T02:13:22.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.832+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7aa408e0b0 con 0x560d69bb91f0 2024-04-24T02:13:22.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.832+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc1da0 con 0x7f7a9c031040 2024-04-24T02:13:22.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.832+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7aa408e0b0 con 0x7f7a9c031040 2024-04-24T02:13:22.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.832+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc1da0 con 0x560d69bbf300 2024-04-24T02:13:22.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.833+0000 7f7aabef8640 1 -- 172.21.15.134:0/2445780801 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a94009050 con 0x560d69bbf300 2024-04-24T02:13:22.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.833+0000 7f7aabef8640 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc1da0 con 0x7f7a9c031040 2024-04-24T02:13:22.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.833+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7aa408e0b0 con 0x7f7a9c031040 2024-04-24T02:13:22.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.833+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc1da0 con 0x7f7a94040b60 2024-04-24T02:13:22.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.833+0000 7f7aacefa640 1 -- 172.21.15.134:0/2445780801 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a9c040040 con 0x7f7a94040b60 2024-04-24T02:13:22.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.833+0000 7f7aacefa640 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc1da0 con 0x560d69bbf300 2024-04-24T02:13:22.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.833+0000 7f7aabef8640 1 -- 172.21.15.134:0/2445780801 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a94009050 con 0x560d69bbf300 2024-04-24T02:13:22.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.833+0000 7f7aabef8640 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc1da0 con 0x7f7a94040b60 2024-04-24T02:13:22.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.834+0000 7f7aacefa640 1 -- 172.21.15.134:0/2445780801 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a9c040040 con 0x7f7a94040b60 2024-04-24T02:13:22.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.834+0000 7f7aacefa640 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc1da0 con 0x560d69bb91f0 2024-04-24T02:13:22.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.834+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7aa408e0b0 con 0x560d69bb91f0 2024-04-24T02:13:22.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.834+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc1da0 con 0x7f7a94040b60 2024-04-24T02:13:22.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.834+0000 7f7aacefa640 1 -- 172.21.15.134:0/2445780801 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a9c040040 con 0x7f7a94040b60 2024-04-24T02:13:22.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.834+0000 7f7ab0937800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:13:22.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.834+0000 7f7ab0937800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:13:22.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.834+0000 7f7ab0937800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:13:22.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.834+0000 7f7ab0937800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:13:22.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.834+0000 7f7ab0937800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:13:22.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.834+0000 7f7ab0937800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:13:22.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.834+0000 7f7ab0937800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.834+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560d69bbdd80 con 0x560d69bb91f0 2024-04-24T02:13:22.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.834+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7aa408e0b0 con 0x560d69bb91f0 2024-04-24T02:13:22.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.834+0000 7f7ab0937800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:22.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.834+0000 7f7ab0937800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.834+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560d69bbe620 con 0x560d69bb91f0 2024-04-24T02:13:22.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.835+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7aa408e0b0 con 0x560d69bb91f0 2024-04-24T02:13:22.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.835+0000 7f7ab0937800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:13:22.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.835+0000 7f7ab0937800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.835+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560d69bbd9c0 con 0x560d69bb91f0 2024-04-24T02:13:22.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.835+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7aa408e0b0 con 0x560d69bb91f0 2024-04-24T02:13:22.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.835+0000 7f7ab0937800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:13:22.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.835+0000 7f7ab0937800 20 zone default found 2024-04-24T02:13:22.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.835+0000 7f7ab0937800 4 Realm: () 2024-04-24T02:13:22.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.835+0000 7f7ab0937800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:13:22.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.835+0000 7f7ab0937800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:13:22.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.835+0000 7f7ab0937800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:13:22.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.835+0000 7f7ab0937800 20 zonegroup default 2024-04-24T02:13:22.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.835+0000 7f7ab0937800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.835+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc2200 con 0x7f7a9c031040 2024-04-24T02:13:22.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.835+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7aa408e0b0 con 0x7f7a9c031040 2024-04-24T02:13:22.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.835+0000 7f7ab0937800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:22.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.835+0000 7f7ab0937800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.835+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc4090 con 0x560d69bbf300 2024-04-24T02:13:22.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.835+0000 7f7aabef8640 1 -- 172.21.15.134:0/2445780801 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7a94009050 con 0x560d69bbf300 2024-04-24T02:13:22.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.836+0000 7f7ab0937800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:22.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.836+0000 7f7ab0937800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.836+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc4430 con 0x560d69bbf300 2024-04-24T02:13:22.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.836+0000 7f7aabef8640 1 -- 172.21.15.134:0/2445780801 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7a94009050 con 0x560d69bbf300 2024-04-24T02:13:22.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.836+0000 7f7ab0937800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:22.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.836+0000 7f7ab0937800 20 started sync module instance, tier type = 2024-04-24T02:13:22.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.836+0000 7f7ab0937800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:13:22.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.836+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc3520 con 0x7f7a94040b60 2024-04-24T02:13:22.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.837+0000 7f7aacefa640 1 -- 172.21.15.134:0/2445780801 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(44 notify.0 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a9c040040 con 0x7f7a94040b60 2024-04-24T02:13:22.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.837+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94615608506688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc3180 con 0x7f7a94040b60 2024-04-24T02:13:22.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.837+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc5190 con 0x560d69bb91f0 2024-04-24T02:13:22.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.838+0000 7f7aacefa640 1 -- 172.21.15.134:0/2445780801 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94615608506688] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a9c040040 con 0x7f7a94040b60 2024-04-24T02:13:22.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.838+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7aa408e0b0 con 0x560d69bb91f0 2024-04-24T02:13:22.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.838+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94615608510416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc5150 con 0x560d69bb91f0 2024-04-24T02:13:22.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.838+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc5bd0 con 0x560d69bbf300 2024-04-24T02:13:22.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.839+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94615608510416] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7aa408e0b0 con 0x560d69bb91f0 2024-04-24T02:13:22.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.839+0000 7f7aabef8640 1 -- 172.21.15.134:0/2445780801 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a94009050 con 0x560d69bbf300 2024-04-24T02:13:22.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.839+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94615608514336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc5fc0 con 0x560d69bbf300 2024-04-24T02:13:22.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.839+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc6a00 con 0x7f7a94040b60 2024-04-24T02:13:22.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.840+0000 7f7aacefa640 1 -- 172.21.15.134:0/2445780801 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(50 notify.3 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a9c040040 con 0x7f7a94040b60 2024-04-24T02:13:22.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.840+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94615608517840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc72a0 con 0x7f7a94040b60 2024-04-24T02:13:22.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.840+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc7d80 con 0x560d69bb91f0 2024-04-24T02:13:22.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.841+0000 7f7aabef8640 1 -- 172.21.15.134:0/2445780801 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94615608514336] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a94009050 con 0x560d69bbf300 2024-04-24T02:13:22.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.842+0000 7f7aacefa640 1 -- 172.21.15.134:0/2445780801 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94615608517840] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a9c040040 con 0x7f7a94040b60 2024-04-24T02:13:22.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.842+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7aa408e0b0 con 0x560d69bb91f0 2024-04-24T02:13:22.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.842+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94615608522896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc6df0 con 0x560d69bb91f0 2024-04-24T02:13:22.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.842+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc8620 con 0x7f7a9c031040 2024-04-24T02:13:22.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.843+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(54 notify.5 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7aa408e0b0 con 0x7f7a9c031040 2024-04-24T02:13:22.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.843+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94615608524848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc8900 con 0x7f7a9c031040 2024-04-24T02:13:22.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.843+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc91d0 con 0x7f7a9c031040 2024-04-24T02:13:22.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.843+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94615608522896] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7aa408e0b0 con 0x560d69bb91f0 2024-04-24T02:13:22.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.844+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94615608524848] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7aa408e0b0 con 0x7f7a9c031040 2024-04-24T02:13:22.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.844+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(56 notify.6 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7aa408e0b0 con 0x7f7a9c031040 2024-04-24T02:13:22.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.844+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94615608511472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc8900 con 0x7f7a9c031040 2024-04-24T02:13:22.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.844+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc9860 con 0x7f7a9c031040 2024-04-24T02:13:22.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.845+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(58 notify.7 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7aa408e0b0 con 0x7f7a9c031040 2024-04-24T02:13:22.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.845+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94615608511472] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7aa408e0b0 con 0x7f7a9c031040 2024-04-24T02:13:22.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.845+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94615608529840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc9c80 con 0x7f7a9c031040 2024-04-24T02:13:22.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.845+0000 7f7ab0937800 20 add_watcher() i=0 2024-04-24T02:13:22.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.845+0000 7f7ab0937800 20 add_watcher() i=1 2024-04-24T02:13:22.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.845+0000 7f7ab0937800 20 add_watcher() i=2 2024-04-24T02:13:22.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.845+0000 7f7ab0937800 20 add_watcher() i=3 2024-04-24T02:13:22.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.845+0000 7f7ab0937800 20 add_watcher() i=4 2024-04-24T02:13:22.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.845+0000 7f7ab0937800 20 add_watcher() i=5 2024-04-24T02:13:22.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.845+0000 7f7ab0937800 20 add_watcher() i=6 2024-04-24T02:13:22.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.846+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94615608529840] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7aa408e0b0 con 0x7f7a9c031040 2024-04-24T02:13:22.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.846+0000 7f7ab0937800 20 add_watcher() i=7 2024-04-24T02:13:22.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.846+0000 7f7ab0937800 2 all 8 watchers are set, enabling cache 2024-04-24T02:13:22.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.846+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560d69bcccb0 con 0x560d69bb91f0 2024-04-24T02:13:22.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.846+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7aa408e0b0 con 0x560d69bb91f0 2024-04-24T02:13:22.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.846+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94615608530896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d69bca0a0 con 0x560d69bb91f0 2024-04-24T02:13:22.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.847+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94615608530896] v32'211 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7aa408e0b0 con 0x560d69bb91f0 2024-04-24T02:13:22.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.847+0000 7f79627e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:13:22.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.847+0000 7f7ab0937800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:13:22.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.847+0000 7f7ab0937800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:13:22.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.847+0000 7f7ab0937800 5 note: GC not initialized 2024-04-24T02:13:22.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.848+0000 7f79617e2640 20 reqs_thread_entry: start 2024-04-24T02:13:22.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.848+0000 7f7ab0937800 20 init_complete bucket index max shards: 11 2024-04-24T02:13:22.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.848+0000 7f7ab0937800 20 Filter name: none 2024-04-24T02:13:22.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.848+0000 7f78d2ffd640 20 reqs_thread_entry: start 2024-04-24T02:13:22.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.848+0000 7f7ab0937800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.848+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560d69bff8f0 con 0x560d69bb91f0 2024-04-24T02:13:22.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.848+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f7aa408e0b0 con 0x560d69bb91f0 2024-04-24T02:13:22.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.848+0000 7f7ab0937800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T02:13:22.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.848+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560d69c00e40 con 0x7f7a9c031040 2024-04-24T02:13:22.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.849+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f7aa408e0b0 con 0x7f7a9c031040 2024-04-24T02:13:22.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.850+0000 7f79627e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:13:22.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.850+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94615608530896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d69bfe050 con 0x560d69bb91f0 2024-04-24T02:13:22.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.851+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94615608530896] v32'212 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7aa408e0b0 con 0x560d69bb91f0 2024-04-24T02:13:22.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.851+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94615608506688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d69bfe050 con 0x7f7a94040b60 2024-04-24T02:13:22.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.852+0000 7f7aacefa640 1 -- 172.21.15.134:0/2445780801 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94615608506688] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a9c040040 con 0x7f7a94040b60 2024-04-24T02:13:22.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.852+0000 7f7ab0937800 20 remove_watcher() i=0 2024-04-24T02:13:22.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.852+0000 7f7ab0937800 2 removed watcher, disabling cache 2024-04-24T02:13:22.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.852+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94615608510416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc3940 con 0x560d69bb91f0 2024-04-24T02:13:22.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.853+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94615608510416] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7aa408e0b0 con 0x560d69bb91f0 2024-04-24T02:13:22.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.853+0000 7f7ab0937800 20 remove_watcher() i=1 2024-04-24T02:13:22.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.853+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94615608514336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc3940 con 0x560d69bbf300 2024-04-24T02:13:22.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.854+0000 7f7aabef8640 1 -- 172.21.15.134:0/2445780801 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94615608514336] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a94009050 con 0x560d69bbf300 2024-04-24T02:13:22.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.854+0000 7f7ab0937800 20 remove_watcher() i=2 2024-04-24T02:13:22.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.854+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94615608517840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc47d0 con 0x7f7a94040b60 2024-04-24T02:13:22.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.855+0000 7f7aacefa640 1 -- 172.21.15.134:0/2445780801 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94615608517840] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a9c040040 con 0x7f7a94040b60 2024-04-24T02:13:22.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.855+0000 7f7ab0937800 20 remove_watcher() i=3 2024-04-24T02:13:22.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.855+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94615608522896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc47d0 con 0x560d69bb91f0 2024-04-24T02:13:22.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.856+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94615608522896] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7aa408e0b0 con 0x560d69bb91f0 2024-04-24T02:13:22.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.856+0000 7f7ab0937800 20 remove_watcher() i=4 2024-04-24T02:13:22.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.856+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94615608524848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc47d0 con 0x7f7a9c031040 2024-04-24T02:13:22.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.857+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94615608524848] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7aa408e0b0 con 0x7f7a9c031040 2024-04-24T02:13:22.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.857+0000 7f7ab0937800 20 remove_watcher() i=5 2024-04-24T02:13:22.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.857+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94615608511472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc47d0 con 0x7f7a9c031040 2024-04-24T02:13:22.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.858+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94615608511472] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7aa408e0b0 con 0x7f7a9c031040 2024-04-24T02:13:22.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.858+0000 7f7ab0937800 20 remove_watcher() i=6 2024-04-24T02:13:22.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.858+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94615608529840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d69bc47d0 con 0x7f7a9c031040 2024-04-24T02:13:22.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.859+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94615608529840] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7aa408e0b0 con 0x7f7a9c031040 2024-04-24T02:13:22.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.859+0000 7f7ab0937800 20 remove_watcher() i=7 2024-04-24T02:13:22.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.859+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f7a9c031040 msgr2=0x7f7a9c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.859+0000 7f7ab0937800 1 --2- 172.21.15.134:0/2445780801 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f7a9c031040 0x7f7a9c032940 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.859+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560d69bb91f0 msgr2=0x560d69bbb680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.859+0000 7f7ab0937800 1 --2- 172.21.15.134:0/2445780801 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560d69bb91f0 0x560d69bbb680 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.859+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f7a94040b60 msgr2=0x7f7a940490b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.859+0000 7f7ab0937800 1 --2- 172.21.15.134:0/2445780801 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f7a94040b60 0x7f7a940490b0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.859+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x560d69bbf300 msgr2=0x560d69bc16f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.859+0000 7f7ab0937800 1 --2- 172.21.15.134:0/2445780801 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x560d69bbf300 0x560d69bc16f0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.859+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f797c036950 msgr2=0x7f797c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.859+0000 7f7ab0937800 1 --2- 172.21.15.134:0/2445780801 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f797c036950 0x7f797c038e10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x560d69b88b10 tx=0x7f7a9c01f000 comp rx=0 tx=0).stop 2024-04-24T02:13:22.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.859+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d69ba62e0 msgr2=0x560d69bad950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.859+0000 7f7ab0937800 1 --2- 172.21.15.134:0/2445780801 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d69ba62e0 0x560d69bad950 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f7a94049010 tx=0x7f7a9404cd60 comp rx=0 tx=0).stop 2024-04-24T02:13:22.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.859+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 reap_dead start 2024-04-24T02:13:22.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.859+0000 7f7aac6f9640 1 -- 172.21.15.134:0/2445780801 reap_dead start 2024-04-24T02:13:22.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.859+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 shutdown_connections 2024-04-24T02:13:22.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.859+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 >> 172.21.15.134:0/2445780801 conn(0x560d69ba2640 msgr2=0x560d69b9fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:22.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.860+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 shutdown_connections 2024-04-24T02:13:22.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.860+0000 7f7ab0937800 1 -- 172.21.15.134:0/2445780801 wait complete. 2024-04-24T02:13:22.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.860+0000 7f7ab0937800 1 -- 172.21.15.134:0/1820632480 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7984036950 msgr2=0x7f7984038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.860+0000 7f7ab0937800 1 --2- 172.21.15.134:0/1820632480 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7984036950 0x7f7984038e10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x560d69b897a0 tx=0x7f7a9c005840 comp rx=0 tx=0).stop 2024-04-24T02:13:22.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.860+0000 7f7ab0937800 1 -- 172.21.15.134:0/1820632480 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d69b98f40 msgr2=0x560d69b99360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.860+0000 7f7ab0937800 1 --2- 172.21.15.134:0/1820632480 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d69b98f40 0x560d69b99360 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f7a9400efd0 tx=0x7f7a9400d7a0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.860+0000 7f7ab0937800 1 -- 172.21.15.134:0/1820632480 shutdown_connections 2024-04-24T02:13:22.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.860+0000 7f7ab0937800 1 --2- 172.21.15.134:0/1820632480 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7984036950 0x7f7984038e10 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.860+0000 7f7ab0937800 1 --2- 172.21.15.134:0/1820632480 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d69b98f40 0x560d69b99360 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.860+0000 7f7ab0937800 1 -- 172.21.15.134:0/1820632480 >> 172.21.15.134:0/1820632480 conn(0x560d69b8cfe0 msgr2=0x560d69b8d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:22.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.860+0000 7f7ab0937800 1 -- 172.21.15.134:0/1820632480 shutdown_connections 2024-04-24T02:13:22.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.860+0000 7f7ab0937800 1 -- 172.21.15.134:0/1820632480 wait complete. 2024-04-24T02:13:22.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.860+0000 7f7ab0937800 1 -- 172.21.15.134:0/3713540394 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560d69a8b200 msgr2=0x560d69b87d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.860+0000 7f7ab0937800 1 --2- 172.21.15.134:0/3713540394 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560d69a8b200 0x560d69b87d80 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.860+0000 7f7ab0937800 1 -- 172.21.15.134:0/3713540394 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7994036900 msgr2=0x7f7994038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.860+0000 7f7ab0937800 1 --2- 172.21.15.134:0/3713540394 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7994036900 0x7f7994038dc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7a94001d90 tx=0x7f7a940012f0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.860+0000 7f7ab0937800 1 -- 172.21.15.134:0/3713540394 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d69a888d0 msgr2=0x560d69b80b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.860+0000 7f7ab0937800 1 --2- 172.21.15.134:0/3713540394 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d69a888d0 0x560d69b80b40 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4000c00 tx=0x7f7aa4002fb0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.860+0000 7f7ab0937800 1 -- 172.21.15.134:0/3713540394 shutdown_connections 2024-04-24T02:13:22.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.860+0000 7f7ab0937800 1 --2- 172.21.15.134:0/3713540394 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560d69a8b200 0x560d69b87d80 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.860+0000 7f7ab0937800 1 --2- 172.21.15.134:0/3713540394 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7994036900 0x7f7994038dc0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.860+0000 7f7ab0937800 1 --2- 172.21.15.134:0/3713540394 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560d69a888d0 0x560d69b80b40 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.860+0000 7f7ab0937800 1 -- 172.21.15.134:0/3713540394 >> 172.21.15.134:0/3713540394 conn(0x560d69a823a0 msgr2=0x560d69b731b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:22.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.860+0000 7f7ab0937800 1 -- 172.21.15.134:0/3713540394 shutdown_connections 2024-04-24T02:13:22.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.860+0000 7f7ab0937800 1 -- 172.21.15.134:0/3713540394 wait complete. 2024-04-24T02:13:22.872 INFO:teuthology.orchestra.run.smithi134.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-04-24T02:00:00.000000Z","epoch":1713924000,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-04-24T02:00:00.000000Z","epoch":1713924000,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-04-24T02:00:00.000000Z","epoch":1713924000,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-04-24T02:00:00.000000Z","epoch":1713924000,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-04-24T02:00:00.000000Z","epoch":1713924000,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}}]} 2024-04-24T02:13:22.873 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}}]} 2024-04-24T02:13:22.873 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-04-24T02:13:22.873 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-04-24T02:13:22.873 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-04-24T02:13:22.917 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:13:22.917 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:13:22.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.918+0000 7f06b240f800 1 Processor -- start 2024-04-24T02:13:22.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.918+0000 7f06b240f800 1 -- start start 2024-04-24T02:13:22.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.918+0000 7f06b240f800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55c63617f760 0x55c63617fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.918+0000 7f06b240f800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c63603fd40 con 0x55c6361800c0 2024-04-24T02:13:22.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.918+0000 7f06b240f800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55c6360124d0 con 0x55c63617f760 2024-04-24T02:13:22.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.918+0000 7f06ada21640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55c63617f760 0x55c63617fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.918+0000 7f06ad220640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55c6361800c0 0x55c636180570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:57834/0 (socket says 172.21.15.134:57834) 2024-04-24T02:13:22.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.918+0000 7f06ada21640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55c63617f760 0x55c63617fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55324/0 (socket says 172.21.15.134:55324) 2024-04-24T02:13:22.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.918+0000 7f06ad220640 1 -- 172.21.15.134:0/1525005993 learned_addr learned my addr 172.21.15.134:0/1525005993 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:13:22.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.918+0000 7f06ada21640 1 -- 172.21.15.134:0/1525005993 >> v1:172.21.15.104:6789/0 conn(0x55c6361800c0 legacy=0x55c636180570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.918+0000 7f06ada21640 1 -- 172.21.15.134:0/1525005993 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c63603e590 con 0x55c63617f760 2024-04-24T02:13:22.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.920+0000 7f06ada21640 1 --2- 172.21.15.134:0/1525005993 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c63617f760 0x55c63617fb80 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f06a000a470 tx=0x7f06a001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e061ae42d88cf21 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.920+0000 7f06aca1f640 1 -- 172.21.15.134:0/1525005993 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06a0057070 con 0x55c63617f760 2024-04-24T02:13:22.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.920+0000 7f06aca1f640 1 -- 172.21.15.134:0/1525005993 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06a004adc0 con 0x55c63617f760 2024-04-24T02:13:22.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.920+0000 7f06aca1f640 1 -- 172.21.15.134:0/1525005993 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06a0052590 con 0x55c63617f760 2024-04-24T02:13:22.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.921+0000 7f06b240f800 1 -- 172.21.15.134:0/1525005993 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c63617f760 msgr2=0x55c63617fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.921+0000 7f06b240f800 1 --2- 172.21.15.134:0/1525005993 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c63617f760 0x55c63617fb80 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f06a000a470 tx=0x7f06a001ce90 comp rx=0 tx=0).stop 2024-04-24T02:13:22.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.921+0000 7f06b240f800 1 -- 172.21.15.134:0/1525005993 shutdown_connections 2024-04-24T02:13:22.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.921+0000 7f06b240f800 1 --2- 172.21.15.134:0/1525005993 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c63617f760 0x55c63617fb80 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.921+0000 7f06b240f800 1 -- 172.21.15.134:0/1525005993 >> 172.21.15.134:0/1525005993 conn(0x55c63617b3a0 msgr2=0x55c63617d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:22.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.921+0000 7f06b240f800 1 -- 172.21.15.134:0/1525005993 shutdown_connections 2024-04-24T02:13:22.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.921+0000 7f06b240f800 1 -- 172.21.15.134:0/1525005993 wait complete. 2024-04-24T02:13:22.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.933+0000 7f06b240f800 1 Processor -- start 2024-04-24T02:13:22.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.933+0000 7f06b240f800 1 -- start start 2024-04-24T02:13:22.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.933+0000 7f06b240f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c63617f760 0x55c636274460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.933+0000 7f06b240f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c6360cc3b0 con 0x55c63617f760 2024-04-24T02:13:22.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.933+0000 7f06ada21640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c63617f760 0x55c636274460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.933+0000 7f06ada21640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c63617f760 0x55c636274460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55340/0 (socket says 172.21.15.134:55340) 2024-04-24T02:13:22.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.933+0000 7f06ada21640 1 -- 172.21.15.134:0/2435393278 learned_addr learned my addr 172.21.15.134:0/2435393278 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:22.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.933+0000 7f06ada21640 1 -- 172.21.15.134:0/2435393278 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c636274a30 con 0x55c63617f760 2024-04-24T02:13:22.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.934+0000 7f06ada21640 1 --2- 172.21.15.134:0/2435393278 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c63617f760 0x55c636274460 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f06a0055040 tx=0x7f06a004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa3418c0fbbdbd92 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.934+0000 7f059be07640 1 -- 172.21.15.134:0/2435393278 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06a0057040 con 0x55c63617f760 2024-04-24T02:13:22.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.934+0000 7f059be07640 1 -- 172.21.15.134:0/2435393278 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06a0062070 con 0x55c63617f760 2024-04-24T02:13:22.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.934+0000 7f059be07640 1 -- 172.21.15.134:0/2435393278 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06a005d470 con 0x55c63617f760 2024-04-24T02:13:22.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.935+0000 7f06b240f800 1 -- 172.21.15.134:0/2435393278 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c63617f760 msgr2=0x55c636274460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.935+0000 7f06b240f800 1 --2- 172.21.15.134:0/2435393278 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c63617f760 0x55c636274460 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f06a0055040 tx=0x7f06a004c000 comp rx=0 tx=0).stop 2024-04-24T02:13:22.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.935+0000 7f06b240f800 1 -- 172.21.15.134:0/2435393278 shutdown_connections 2024-04-24T02:13:22.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.935+0000 7f06b240f800 1 --2- 172.21.15.134:0/2435393278 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c63617f760 0x55c636274460 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.935+0000 7f06b240f800 1 -- 172.21.15.134:0/2435393278 >> 172.21.15.134:0/2435393278 conn(0x55c63617b3a0 msgr2=0x55c63626fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:22.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.935+0000 7f06b240f800 1 -- 172.21.15.134:0/2435393278 shutdown_connections 2024-04-24T02:13:22.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.935+0000 7f06b240f800 1 -- 172.21.15.134:0/2435393278 wait complete. 2024-04-24T02:13:22.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.935+0000 7f06b240f800 1 Processor -- start 2024-04-24T02:13:22.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.935+0000 7f06b240f800 1 -- start start 2024-04-24T02:13:22.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.935+0000 7f06b240f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c6361800c0 0x55c63627c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.935+0000 7f06b240f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c636180f20 con 0x55c6361800c0 2024-04-24T02:13:22.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.935+0000 7f06ada21640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c6361800c0 0x55c63627c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.935+0000 7f06ada21640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c6361800c0 0x55c63627c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55354/0 (socket says 172.21.15.134:55354) 2024-04-24T02:13:22.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.936+0000 7f06ada21640 1 -- 172.21.15.134:0/2540794391 learned_addr learned my addr 172.21.15.134:0/2540794391 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:22.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.936+0000 7f06ada21640 1 -- 172.21.15.134:0/2540794391 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c63627c670 con 0x55c6361800c0 2024-04-24T02:13:22.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.936+0000 7f06ada21640 1 --2- 172.21.15.134:0/2540794391 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c6361800c0 0x55c63627c130 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f06a001ce60 tx=0x7f06a0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.936+0000 7f059a604640 1 -- 172.21.15.134:0/2540794391 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06a006b070 con 0x55c6361800c0 2024-04-24T02:13:22.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.936+0000 7f059a604640 1 -- 172.21.15.134:0/2540794391 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06a005d830 con 0x55c6361800c0 2024-04-24T02:13:22.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.936+0000 7f06b240f800 1 -- 172.21.15.134:0/2540794391 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c63627c900 con 0x55c6361800c0 2024-04-24T02:13:22.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.936+0000 7f059a604640 1 -- 172.21.15.134:0/2540794391 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06a0057070 con 0x55c6361800c0 2024-04-24T02:13:22.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.936+0000 7f06b240f800 1 -- 172.21.15.134:0/2540794391 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c63627f5b0 con 0x55c6361800c0 2024-04-24T02:13:22.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.937+0000 7f059a604640 1 -- 172.21.15.134:0/2540794391 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f06a005db50 con 0x55c6361800c0 2024-04-24T02:13:22.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.937+0000 7f059a604640 1 --2- 172.21.15.134:0/2540794391 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0594036900 0x7f0594038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.937+0000 7f059a604640 1 -- 172.21.15.134:0/2540794391 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f06a008dfd0 con 0x55c6361800c0 2024-04-24T02:13:22.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.937+0000 7f06ad220640 1 --2- 172.21.15.134:0/2540794391 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0594036900 0x7f0594038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.937+0000 7f06b240f800 1 --2- 172.21.15.134:0/2540794391 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c636281360 0x55c636283750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.937+0000 7f06b240f800 1 -- 172.21.15.134:0/2540794391 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c636283c90 con 0x55c636281360 2024-04-24T02:13:22.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.937+0000 7f06ae222640 1 --2- 172.21.15.134:0/2540794391 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c636281360 0x55c636283750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.938+0000 7f06ad220640 1 --2- 172.21.15.134:0/2540794391 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0594036900 0x7f0594038dc0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f06a4000f60 tx=0x7f06a40012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.938+0000 7f06ae222640 1 --2- 172.21.15.134:0/2540794391 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c636281360 0x55c636283750 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.938+0000 7f06ae222640 1 -- 172.21.15.134:0/2540794391 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06a800a4a0 con 0x55c636281360 2024-04-24T02:13:22.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.938+0000 7f06b240f800 1 -- 172.21.15.134:0/2540794391 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c636280940 con 0x55c636281360 2024-04-24T02:13:22.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.938+0000 7f06ae222640 1 -- 172.21.15.134:0/2540794391 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f06a800a4a0 con 0x55c636281360 2024-04-24T02:13:22.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.938+0000 7f06b240f800 1 -- 172.21.15.134:0/2540794391 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c636285a90 con 0x55c636281360 2024-04-24T02:13:22.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.939+0000 7f06ae222640 1 -- 172.21.15.134:0/2540794391 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f06a800a4a0 con 0x55c636281360 2024-04-24T02:13:22.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.939+0000 7f06b240f800 1 -- 172.21.15.134:0/2540794391 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c636284dd0 con 0x55c636281360 2024-04-24T02:13:22.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.939+0000 7f06ae222640 1 -- 172.21.15.134:0/2540794391 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f06a800a4a0 con 0x55c636281360 2024-04-24T02:13:22.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.939+0000 7f06b240f800 1 -- 172.21.15.134:0/2540794391 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c6362851f0 con 0x55c636281360 2024-04-24T02:13:22.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.939+0000 7f06ae222640 1 -- 172.21.15.134:0/2540794391 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f06a800a4a0 con 0x55c636281360 2024-04-24T02:13:22.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.939+0000 7f06b240f800 1 Processor -- start 2024-04-24T02:13:22.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.939+0000 7f06b240f800 1 -- start start 2024-04-24T02:13:22.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.940+0000 7f06b240f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c6362948a0 0x55c636294cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.940+0000 7f06b240f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c6360726b0 con 0x55c6362948a0 2024-04-24T02:13:22.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.940+0000 7f06ad220640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c6362948a0 0x55c636294cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.940+0000 7f06ad220640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c6362948a0 0x55c636294cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55366/0 (socket says 172.21.15.134:55366) 2024-04-24T02:13:22.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.940+0000 7f06ad220640 1 -- 172.21.15.134:0/281813622 learned_addr learned my addr 172.21.15.134:0/281813622 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:22.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.940+0000 7f06ad220640 1 -- 172.21.15.134:0/281813622 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c636295200 con 0x55c6362948a0 2024-04-24T02:13:22.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.940+0000 7f06ad220640 1 --2- 172.21.15.134:0/281813622 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c6362948a0 0x55c636294cc0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f06a4001ed0 tx=0x7f06a400d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.941+0000 7f05937fe640 1 -- 172.21.15.134:0/281813622 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06a401b550 con 0x55c6362948a0 2024-04-24T02:13:22.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.941+0000 7f05937fe640 1 -- 172.21.15.134:0/281813622 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06a401b6f0 con 0x55c6362948a0 2024-04-24T02:13:22.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.941+0000 7f06b240f800 1 -- 172.21.15.134:0/281813622 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c636295c70 con 0x55c6362948a0 2024-04-24T02:13:22.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.941+0000 7f05937fe640 1 -- 172.21.15.134:0/281813622 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06a401b9d0 con 0x55c6362948a0 2024-04-24T02:13:22.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.941+0000 7f06b240f800 1 -- 172.21.15.134:0/281813622 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c636296170 con 0x55c6362948a0 2024-04-24T02:13:22.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.941+0000 7f05937fe640 1 -- 172.21.15.134:0/281813622 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f06a4023020 con 0x55c6362948a0 2024-04-24T02:13:22.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.941+0000 7f05937fe640 1 --2- 172.21.15.134:0/281813622 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0588036950 0x7f0588038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.942+0000 7f05937fe640 1 -- 172.21.15.134:0/281813622 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f06a4021020 con 0x55c6362948a0 2024-04-24T02:13:22.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.942+0000 7f06ae222640 1 --2- 172.21.15.134:0/281813622 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0588036950 0x7f0588038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.942+0000 7f06b240f800 1 Processor -- start 2024-04-24T02:13:22.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.942+0000 7f06ae222640 1 --2- 172.21.15.134:0/281813622 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0588036950 0x7f0588038e10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x55c636285170 tx=0x7f06a8005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.942+0000 7f06b240f800 1 -- start start 2024-04-24T02:13:22.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.942+0000 7f06b240f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c6362a1be0 0x55c6362a2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.942+0000 7f06b240f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c636274cf0 con 0x55c6362a1be0 2024-04-24T02:13:22.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.942+0000 7f06ad220640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c6362a1be0 0x55c6362a2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.942+0000 7f06ad220640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c6362a1be0 0x55c6362a2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55368/0 (socket says 172.21.15.134:55368) 2024-04-24T02:13:22.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.942+0000 7f06ad220640 1 -- 172.21.15.134:0/2301640331 learned_addr learned my addr 172.21.15.134:0/2301640331 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:22.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.943+0000 7f06ad220640 1 -- 172.21.15.134:0/2301640331 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6362a25d0 con 0x55c6362a1be0 2024-04-24T02:13:22.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.943+0000 7f06ad220640 1 --2- 172.21.15.134:0/2301640331 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c6362a1be0 0x55c6362a2000 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f06a404ce10 tx=0x7f06a4019ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26b58e97187327a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.943+0000 7f05917fa640 1 -- 172.21.15.134:0/2301640331 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06a4041070 con 0x55c6362a1be0 2024-04-24T02:13:22.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.943+0000 7f05917fa640 1 -- 172.21.15.134:0/2301640331 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06a40258e0 con 0x55c6362a1be0 2024-04-24T02:13:22.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.943+0000 7f05917fa640 1 -- 172.21.15.134:0/2301640331 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06a4025410 con 0x55c6362a1be0 2024-04-24T02:13:22.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.943+0000 7f06b240f800 1 -- 172.21.15.134:0/2301640331 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c6362a1be0 msgr2=0x55c6362a2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.943+0000 7f06b240f800 1 --2- 172.21.15.134:0/2301640331 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c6362a1be0 0x55c6362a2000 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f06a404ce10 tx=0x7f06a4019ce0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.943+0000 7f06b240f800 1 -- 172.21.15.134:0/2301640331 shutdown_connections 2024-04-24T02:13:22.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.943+0000 7f06b240f800 1 --2- 172.21.15.134:0/2301640331 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c6362a1be0 0x55c6362a2000 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.943+0000 7f06b240f800 1 -- 172.21.15.134:0/2301640331 >> 172.21.15.134:0/2301640331 conn(0x55c63629df40 msgr2=0x55c63629bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:22.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.943+0000 7f06b240f800 1 -- 172.21.15.134:0/2301640331 shutdown_connections 2024-04-24T02:13:22.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.943+0000 7f06b240f800 1 -- 172.21.15.134:0/2301640331 wait complete. 2024-04-24T02:13:22.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.944+0000 7f06b240f800 1 Processor -- start 2024-04-24T02:13:22.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.944+0000 7f06b240f800 1 -- start start 2024-04-24T02:13:22.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.944+0000 7f06b240f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c6362a1be0 0x55c6362a9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.944+0000 7f06b240f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c6362a2d40 con 0x55c6362a1be0 2024-04-24T02:13:22.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.944+0000 7f06ad220640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c6362a1be0 0x55c6362a9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.944+0000 7f06ad220640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c6362a1be0 0x55c6362a9250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55384/0 (socket says 172.21.15.134:55384) 2024-04-24T02:13:22.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.944+0000 7f06ad220640 1 -- 172.21.15.134:0/2586771673 learned_addr learned my addr 172.21.15.134:0/2586771673 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:22.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.944+0000 7f06ad220640 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6362a9790 con 0x55c6362a1be0 2024-04-24T02:13:22.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.944+0000 7f06ad220640 1 --2- 172.21.15.134:0/2586771673 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c6362a1be0 0x55c6362a9250 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f06a4019d20 tx=0x7f06a404cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.944+0000 7f057f7fe640 1 -- 172.21.15.134:0/2586771673 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06a4041070 con 0x55c6362a1be0 2024-04-24T02:13:22.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.945+0000 7f057f7fe640 1 -- 172.21.15.134:0/2586771673 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06a404e810 con 0x55c6362a1be0 2024-04-24T02:13:22.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.945+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c6362a9a20 con 0x55c6362a1be0 2024-04-24T02:13:22.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.945+0000 7f057f7fe640 1 -- 172.21.15.134:0/2586771673 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06a4024370 con 0x55c6362a1be0 2024-04-24T02:13:22.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.945+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6362a9a20 con 0x55c6362a1be0 2024-04-24T02:13:22.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.945+0000 7f057f7fe640 1 -- 172.21.15.134:0/2586771673 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f06a404ea80 con 0x55c6362a1be0 2024-04-24T02:13:22.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.945+0000 7f057f7fe640 1 --2- 172.21.15.134:0/2586771673 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0578036950 0x7f0578038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.945+0000 7f057f7fe640 1 -- 172.21.15.134:0/2586771673 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f06a404f060 con 0x55c6362a1be0 2024-04-24T02:13:22.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.946+0000 7f06ae222640 1 --2- 172.21.15.134:0/2586771673 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0578036950 0x7f0578038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.946+0000 7f06b240f800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.946+0000 7f06b240f800 1 --2- 172.21.15.134:0/2586771673 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c6362b4b10 0x55c6362b6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.946+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c6362b7720 con 0x55c6362b4b10 2024-04-24T02:13:22.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.946+0000 7f06ada21640 1 --2- 172.21.15.134:0/2586771673 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c6362b4b10 0x55c6362b6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.946+0000 7f06ae222640 1 --2- 172.21.15.134:0/2586771673 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0578036950 0x7f0578038e10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x55c6362848f0 tx=0x7f06a801f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.946+0000 7f06ada21640 1 --2- 172.21.15.134:0/2586771673 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c6362b4b10 0x55c6362b6fd0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.946+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06a005a040 con 0x55c6362b4b10 2024-04-24T02:13:22.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.946+0000 7f06b240f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:22.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.946+0000 7f06b240f800 20 realm 2024-04-24T02:13:22.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.946+0000 7f06b240f800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.946+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c6362b7b30 con 0x55c6362b4b10 2024-04-24T02:13:22.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.947+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06a005a040 con 0x55c6362b4b10 2024-04-24T02:13:22.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.947+0000 7f06b240f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:22.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.947+0000 7f06b240f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:13:22.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.947+0000 7f06b240f800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.947+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c6362b8400 con 0x55c6362b4b10 2024-04-24T02:13:22.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.947+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06a005a040 con 0x55c6362b4b10 2024-04-24T02:13:22.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.947+0000 7f06b240f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:22.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.947+0000 7f06b240f800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.947+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c6362b87a0 con 0x55c6362b4b10 2024-04-24T02:13:22.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.947+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f06a005a040 con 0x55c6362b4b10 2024-04-24T02:13:22.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.947+0000 7f06b240f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:13:22.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.947+0000 7f06b240f800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.947+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c6362b8c00 con 0x55c6362b4b10 2024-04-24T02:13:22.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.947+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f06a005a040 con 0x55c6362b4b10 2024-04-24T02:13:22.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.947+0000 7f06b240f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:13:22.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.947+0000 7f06b240f800 20 searching for the correct realm 2024-04-24T02:13:22.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.947+0000 7f06b240f800 1 --2- 172.21.15.134:0/2586771673 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55c6362bac50 0x55c6362bd040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.947+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c6362bd710 con 0x55c6362bac50 2024-04-24T02:13:22.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.947+0000 7f06ad220640 1 --2- 172.21.15.134:0/2586771673 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55c6362bac50 0x55c6362bd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.948+0000 7f06ad220640 1 --2- 172.21.15.134:0/2586771673 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55c6362bac50 0x55c6362bd040 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.948+0000 7f06ad220640 1 -- 172.21.15.134:0/2586771673 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06a4009050 con 0x55c6362bac50 2024-04-24T02:13:22.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.948+0000 7f06ad220640 1 --2- 172.21.15.134:0/2586771673 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f06a4015500 0x7f06a40462d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.948+0000 7f06ad220640 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c6362bd710 con 0x7f06a4015500 2024-04-24T02:13:22.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.948+0000 7f06ae222640 1 --2- 172.21.15.134:0/2586771673 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f06a4015500 0x7f06a40462d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.948+0000 7f06ae222640 1 --2- 172.21.15.134:0/2586771673 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f06a4015500 0x7f06a40462d0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.949+0000 7f06ae222640 1 -- 172.21.15.134:0/2586771673 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06a801f070 con 0x7f06a4015500 2024-04-24T02:13:22.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.949+0000 7f06ae222640 1 --2- 172.21.15.134:0/2586771673 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f06a8031040 0x7f06a8032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:22.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.949+0000 7f06ae222640 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c6362bd710 con 0x7f06a8031040 2024-04-24T02:13:22.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.949+0000 7f06ada21640 1 --2- 172.21.15.134:0/2586771673 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f06a8031040 0x7f06a8032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:22.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.949+0000 7f06ada21640 1 --2- 172.21.15.134:0/2586771673 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f06a8031040 0x7f06a8032940 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:22.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.950+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06a005a040 con 0x7f06a8031040 2024-04-24T02:13:22.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.950+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c6362bd710 con 0x55c6362b4b10 2024-04-24T02:13:22.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.950+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06a005a040 con 0x55c6362b4b10 2024-04-24T02:13:22.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.950+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c6362bd710 con 0x55c6362b4b10 2024-04-24T02:13:22.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.950+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f06a005a040 con 0x55c6362b4b10 2024-04-24T02:13:22.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.950+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c6362bd710 con 0x7f06a8031040 2024-04-24T02:13:22.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.950+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06a005a040 con 0x7f06a8031040 2024-04-24T02:13:22.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.950+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c6362bd710 con 0x7f06a4015500 2024-04-24T02:13:22.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.951+0000 7f06ae222640 1 -- 172.21.15.134:0/2586771673 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06a801f070 con 0x7f06a4015500 2024-04-24T02:13:22.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.951+0000 7f06ae222640 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c6362bd710 con 0x7f06a4015500 2024-04-24T02:13:22.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.951+0000 7f06ae222640 1 -- 172.21.15.134:0/2586771673 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06a801f070 con 0x7f06a4015500 2024-04-24T02:13:22.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.951+0000 7f06ae222640 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c6362bd710 con 0x55c6362bac50 2024-04-24T02:13:22.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.951+0000 7f06ad220640 1 -- 172.21.15.134:0/2586771673 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06a4009050 con 0x55c6362bac50 2024-04-24T02:13:22.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.951+0000 7f06ad220640 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c6362bd710 con 0x55c6362b4b10 2024-04-24T02:13:22.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.951+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06a005a040 con 0x55c6362b4b10 2024-04-24T02:13:22.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.951+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c6362bd710 con 0x7f06a8031040 2024-04-24T02:13:22.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.951+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06a005a040 con 0x7f06a8031040 2024-04-24T02:13:22.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.951+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c6362bd710 con 0x55c6362b4b10 2024-04-24T02:13:22.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.952+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06a005a040 con 0x55c6362b4b10 2024-04-24T02:13:22.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.952+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c6362bd710 con 0x7f06a4015500 2024-04-24T02:13:22.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.952+0000 7f06ae222640 1 -- 172.21.15.134:0/2586771673 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f06a801f070 con 0x7f06a4015500 2024-04-24T02:13:22.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.952+0000 7f06ae222640 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c6362bd710 con 0x55c6362bac50 2024-04-24T02:13:22.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.952+0000 7f06ad220640 1 -- 172.21.15.134:0/2586771673 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06a4009050 con 0x55c6362bac50 2024-04-24T02:13:22.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.952+0000 7f06ad220640 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c6362bd710 con 0x55c6362bac50 2024-04-24T02:13:22.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.952+0000 7f06ad220640 1 -- 172.21.15.134:0/2586771673 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06a4009050 con 0x55c6362bac50 2024-04-24T02:13:22.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.952+0000 7f06ad220640 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c6362bd710 con 0x7f06a4015500 2024-04-24T02:13:22.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.953+0000 7f06ae222640 1 -- 172.21.15.134:0/2586771673 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06a801f070 con 0x7f06a4015500 2024-04-24T02:13:22.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.953+0000 7f06ae222640 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c6362bd710 con 0x55c6362bac50 2024-04-24T02:13:22.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.953+0000 7f06ad220640 1 -- 172.21.15.134:0/2586771673 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06a4009050 con 0x55c6362bac50 2024-04-24T02:13:22.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.953+0000 7f06ad220640 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c6362bd710 con 0x55c6362bac50 2024-04-24T02:13:22.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.953+0000 7f06ad220640 1 -- 172.21.15.134:0/2586771673 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06a4009050 con 0x55c6362bac50 2024-04-24T02:13:22.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.953+0000 7f06ad220640 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c6362bd710 con 0x55c6362b4b10 2024-04-24T02:13:22.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.953+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06a005a040 con 0x55c6362b4b10 2024-04-24T02:13:22.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.953+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c6362bd710 con 0x55c6362b4b10 2024-04-24T02:13:22.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.953+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f06a005a040 con 0x55c6362b4b10 2024-04-24T02:13:22.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.954+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c6362bd710 con 0x7f06a8031040 2024-04-24T02:13:22.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.954+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06a005a040 con 0x7f06a8031040 2024-04-24T02:13:22.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.954+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c6362bd710 con 0x55c6362bac50 2024-04-24T02:13:22.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.954+0000 7f06ad220640 1 -- 172.21.15.134:0/2586771673 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06a4009050 con 0x55c6362bac50 2024-04-24T02:13:22.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.954+0000 7f06ad220640 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c6362bd710 con 0x7f06a4015500 2024-04-24T02:13:22.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.954+0000 7f06ae222640 1 -- 172.21.15.134:0/2586771673 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06a801f070 con 0x7f06a4015500 2024-04-24T02:13:22.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.955+0000 7f06ae222640 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c6362bd710 con 0x55c6362b4b10 2024-04-24T02:13:22.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.955+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06a005a040 con 0x55c6362b4b10 2024-04-24T02:13:22.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.955+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c6362bd710 con 0x7f06a8031040 2024-04-24T02:13:22.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.955+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06a005a040 con 0x7f06a8031040 2024-04-24T02:13:22.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.955+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c6362bd710 con 0x55c6362bac50 2024-04-24T02:13:22.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.955+0000 7f06ad220640 1 -- 172.21.15.134:0/2586771673 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06a4009050 con 0x55c6362bac50 2024-04-24T02:13:22.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.955+0000 7f06ad220640 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c6362bd710 con 0x7f06a8031040 2024-04-24T02:13:22.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.956+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06a005a040 con 0x7f06a8031040 2024-04-24T02:13:22.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.956+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c6362bd710 con 0x7f06a4015500 2024-04-24T02:13:22.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.956+0000 7f06ae222640 1 -- 172.21.15.134:0/2586771673 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06a8040040 con 0x7f06a4015500 2024-04-24T02:13:22.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.956+0000 7f06ae222640 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c6362bd710 con 0x55c6362bac50 2024-04-24T02:13:22.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.956+0000 7f06ad220640 1 -- 172.21.15.134:0/2586771673 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06a4009050 con 0x55c6362bac50 2024-04-24T02:13:22.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.956+0000 7f06ad220640 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c6362bd710 con 0x7f06a4015500 2024-04-24T02:13:22.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.956+0000 7f06ae222640 1 -- 172.21.15.134:0/2586771673 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06a8040040 con 0x7f06a4015500 2024-04-24T02:13:22.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.956+0000 7f06ae222640 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c6362bd710 con 0x55c6362b4b10 2024-04-24T02:13:22.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.957+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f06a005a040 con 0x55c6362b4b10 2024-04-24T02:13:22.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.957+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c6362bd710 con 0x7f06a4015500 2024-04-24T02:13:22.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.957+0000 7f06ae222640 1 -- 172.21.15.134:0/2586771673 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06a8040040 con 0x7f06a4015500 2024-04-24T02:13:22.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.957+0000 7f06b240f800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:13:22.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.957+0000 7f06b240f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:13:22.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.957+0000 7f06b240f800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:13:22.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.957+0000 7f06b240f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:13:22.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.957+0000 7f06b240f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:13:22.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.957+0000 7f06b240f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:13:22.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.957+0000 7f06b240f800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.957+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c6362b96a0 con 0x55c6362b4b10 2024-04-24T02:13:22.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.957+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06a005a040 con 0x55c6362b4b10 2024-04-24T02:13:22.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.957+0000 7f06b240f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:22.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.957+0000 7f06b240f800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.957+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c6362b9f40 con 0x55c6362b4b10 2024-04-24T02:13:22.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.957+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f06a005a040 con 0x55c6362b4b10 2024-04-24T02:13:22.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.957+0000 7f06b240f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:13:22.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.957+0000 7f06b240f800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.957+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c6362b92e0 con 0x55c6362b4b10 2024-04-24T02:13:22.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.958+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f06a005a040 con 0x55c6362b4b10 2024-04-24T02:13:22.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.958+0000 7f06b240f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:13:22.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.958+0000 7f06b240f800 20 zone default found 2024-04-24T02:13:22.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.958+0000 7f06b240f800 4 Realm: () 2024-04-24T02:13:22.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.958+0000 7f06b240f800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:13:22.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.958+0000 7f06b240f800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:13:22.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.958+0000 7f06b240f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:13:22.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.958+0000 7f06b240f800 20 zonegroup default 2024-04-24T02:13:22.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.958+0000 7f06b240f800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.958+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c6362b9f40 con 0x7f06a8031040 2024-04-24T02:13:22.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.958+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f06a005a040 con 0x7f06a8031040 2024-04-24T02:13:22.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.958+0000 7f06b240f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:22.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.958+0000 7f06b240f800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.958+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c6362bf570 con 0x55c6362bac50 2024-04-24T02:13:22.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.958+0000 7f06ad220640 1 -- 172.21.15.134:0/2586771673 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f06a4009050 con 0x55c6362bac50 2024-04-24T02:13:22.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.958+0000 7f06b240f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:22.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.958+0000 7f06b240f800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.958+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c6362bf910 con 0x55c6362bac50 2024-04-24T02:13:22.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.958+0000 7f06ad220640 1 -- 172.21.15.134:0/2586771673 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f06a4009050 con 0x55c6362bac50 2024-04-24T02:13:22.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.958+0000 7f06b240f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:22.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.958+0000 7f06b240f800 20 started sync module instance, tier type = 2024-04-24T02:13:22.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.958+0000 7f06b240f800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:13:22.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.958+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c6362bea10 con 0x7f06a4015500 2024-04-24T02:13:22.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.959+0000 7f06ae222640 1 -- 172.21.15.134:0/2586771673 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(44 notify.0 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06a8040040 con 0x7f06a4015500 2024-04-24T02:13:22.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.959+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94309800734256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c6362c01d0 con 0x7f06a4015500 2024-04-24T02:13:22.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.959+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c6362c0a20 con 0x55c6362b4b10 2024-04-24T02:13:22.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.960+0000 7f06ae222640 1 -- 172.21.15.134:0/2586771673 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94309800734256] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06a8040040 con 0x7f06a4015500 2024-04-24T02:13:22.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.961+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06a005a040 con 0x55c6362b4b10 2024-04-24T02:13:22.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.961+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94309800738080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c6362c0710 con 0x55c6362b4b10 2024-04-24T02:13:22.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.961+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c6362c11b0 con 0x55c6362bac50 2024-04-24T02:13:22.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.962+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94309800738080] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06a005a040 con 0x55c6362b4b10 2024-04-24T02:13:22.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.962+0000 7f06ad220640 1 -- 172.21.15.134:0/2586771673 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06a4009050 con 0x55c6362bac50 2024-04-24T02:13:22.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.962+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94309800742048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c6362c1550 con 0x55c6362bac50 2024-04-24T02:13:22.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.962+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c6362c1fa0 con 0x7f06a4015500 2024-04-24T02:13:22.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.963+0000 7f06ad220640 1 -- 172.21.15.134:0/2586771673 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94309800742048] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06a4009050 con 0x55c6362bac50 2024-04-24T02:13:22.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.963+0000 7f06ae222640 1 -- 172.21.15.134:0/2586771673 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(50 notify.3 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06a8040040 con 0x7f06a4015500 2024-04-24T02:13:22.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.963+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94309800745616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c6362c2390 con 0x7f06a4015500 2024-04-24T02:13:22.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.963+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c6362c2df0 con 0x55c6362b4b10 2024-04-24T02:13:22.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.964+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06a005a040 con 0x55c6362b4b10 2024-04-24T02:13:22.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.964+0000 7f06ae222640 1 -- 172.21.15.134:0/2586771673 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94309800745616] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06a8040040 con 0x7f06a4015500 2024-04-24T02:13:22.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.965+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94309800739200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c6362c2df0 con 0x55c6362b4b10 2024-04-24T02:13:22.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.965+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c6362c3840 con 0x7f06a8031040 2024-04-24T02:13:22.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.966+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(54 notify.5 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06a005a040 con 0x7f06a8031040 2024-04-24T02:13:22.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.966+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94309800751952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c6362c3770 con 0x7f06a8031040 2024-04-24T02:13:22.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.966+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94309800739200] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06a005a040 con 0x55c6362b4b10 2024-04-24T02:13:22.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.966+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c6362c28f0 con 0x7f06a8031040 2024-04-24T02:13:22.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.967+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94309800751952] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06a005a040 con 0x7f06a8031040 2024-04-24T02:13:22.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.967+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(56 notify.6 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06a005a040 con 0x7f06a8031040 2024-04-24T02:13:22.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.967+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94309800749296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c6362c4280 con 0x7f06a8031040 2024-04-24T02:13:22.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.967+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c6362c4c40 con 0x7f06a8031040 2024-04-24T02:13:22.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.968+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(58 notify.7 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06a005a040 con 0x7f06a8031040 2024-04-24T02:13:22.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.968+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94309800749296] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06a005a040 con 0x7f06a8031040 2024-04-24T02:13:22.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.968+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94309800757136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c6362c5060 con 0x7f06a8031040 2024-04-24T02:13:22.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.968+0000 7f06b240f800 20 add_watcher() i=0 2024-04-24T02:13:22.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.968+0000 7f06b240f800 20 add_watcher() i=1 2024-04-24T02:13:22.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.968+0000 7f06b240f800 20 add_watcher() i=2 2024-04-24T02:13:22.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.968+0000 7f06b240f800 20 add_watcher() i=3 2024-04-24T02:13:22.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.968+0000 7f06b240f800 20 add_watcher() i=4 2024-04-24T02:13:22.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.968+0000 7f06b240f800 20 add_watcher() i=5 2024-04-24T02:13:22.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.968+0000 7f06b240f800 20 add_watcher() i=6 2024-04-24T02:13:22.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.969+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94309800757136] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06a005a040 con 0x7f06a8031040 2024-04-24T02:13:22.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.969+0000 7f06b240f800 20 add_watcher() i=7 2024-04-24T02:13:22.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.969+0000 7f06b240f800 2 all 8 watchers are set, enabling cache 2024-04-24T02:13:22.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.969+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c6362c5060 con 0x55c6362b4b10 2024-04-24T02:13:22.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.969+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f06a005a040 con 0x55c6362b4b10 2024-04-24T02:13:22.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.970+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94309800758192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c6362c5040 con 0x55c6362b4b10 2024-04-24T02:13:22.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.970+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94309800758192] v32'213 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f06a005a040 con 0x55c6362b4b10 2024-04-24T02:13:22.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.971+0000 7f055f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:13:22.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.971+0000 7f06b240f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:13:22.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.971+0000 7f06b240f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:13:22.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.971+0000 7f06b240f800 5 note: GC not initialized 2024-04-24T02:13:22.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.971+0000 7f055e7fc640 20 reqs_thread_entry: start 2024-04-24T02:13:22.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.971+0000 7f06b240f800 20 init_complete bucket index max shards: 11 2024-04-24T02:13:22.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.971+0000 7f06b240f800 20 Filter name: none 2024-04-24T02:13:22.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.971+0000 7f04cffff640 20 reqs_thread_entry: start 2024-04-24T02:13:22.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.971+0000 7f06b240f800 20 rados->read ofs=0 len=0 2024-04-24T02:13:22.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.971+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c6362fae80 con 0x55c6362b4b10 2024-04-24T02:13:22.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.971+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f06a005a040 con 0x55c6362b4b10 2024-04-24T02:13:22.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.971+0000 7f06b240f800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T02:13:22.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.972+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c6362fc3d0 con 0x7f06a8031040 2024-04-24T02:13:22.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.972+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f06a005a040 con 0x7f06a8031040 2024-04-24T02:13:22.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.973+0000 7f055f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:13:22.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.973+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94309800758192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c6362b1f40 con 0x55c6362b4b10 2024-04-24T02:13:22.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.974+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94309800758192] v32'214 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f06a005a040 con 0x55c6362b4b10 2024-04-24T02:13:22.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.974+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94309800734256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c6362c4bb0 con 0x7f06a4015500 2024-04-24T02:13:22.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.975+0000 7f06ae222640 1 -- 172.21.15.134:0/2586771673 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94309800734256] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06a8040040 con 0x7f06a4015500 2024-04-24T02:13:22.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.975+0000 7f06b240f800 20 remove_watcher() i=0 2024-04-24T02:13:22.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.975+0000 7f06b240f800 2 removed watcher, disabling cache 2024-04-24T02:13:22.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.975+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94309800738080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c6362c4bb0 con 0x55c6362b4b10 2024-04-24T02:13:22.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.976+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94309800738080] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06a005a040 con 0x55c6362b4b10 2024-04-24T02:13:22.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.976+0000 7f06b240f800 20 remove_watcher() i=1 2024-04-24T02:13:22.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.976+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94309800742048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c6362c4bb0 con 0x55c6362bac50 2024-04-24T02:13:22.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.977+0000 7f06ad220640 1 -- 172.21.15.134:0/2586771673 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94309800742048] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06a4009050 con 0x55c6362bac50 2024-04-24T02:13:22.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.977+0000 7f06b240f800 20 remove_watcher() i=2 2024-04-24T02:13:22.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.977+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94309800745616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c6362c0ca0 con 0x7f06a4015500 2024-04-24T02:13:22.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.978+0000 7f06ae222640 1 -- 172.21.15.134:0/2586771673 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94309800745616] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06a8040040 con 0x7f06a4015500 2024-04-24T02:13:22.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.978+0000 7f06b240f800 20 remove_watcher() i=3 2024-04-24T02:13:22.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.978+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94309800739200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c6362c0ca0 con 0x55c6362b4b10 2024-04-24T02:13:22.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.980+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94309800739200] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06a005a040 con 0x55c6362b4b10 2024-04-24T02:13:22.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.980+0000 7f06b240f800 20 remove_watcher() i=4 2024-04-24T02:13:22.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.980+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94309800751952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c6362c0ca0 con 0x7f06a8031040 2024-04-24T02:13:22.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.981+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94309800751952] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06a005a040 con 0x7f06a8031040 2024-04-24T02:13:22.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.981+0000 7f06b240f800 20 remove_watcher() i=5 2024-04-24T02:13:22.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.981+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94309800749296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c6362c3350 con 0x7f06a8031040 2024-04-24T02:13:22.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.982+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94309800749296] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06a005a040 con 0x7f06a8031040 2024-04-24T02:13:22.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.982+0000 7f06b240f800 20 remove_watcher() i=6 2024-04-24T02:13:22.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.982+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94309800757136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c6362c3350 con 0x7f06a8031040 2024-04-24T02:13:22.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.983+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94309800757136] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06a005a040 con 0x7f06a8031040 2024-04-24T02:13:22.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.983+0000 7f06b240f800 20 remove_watcher() i=7 2024-04-24T02:13:22.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.983+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f06a8031040 msgr2=0x7f06a8032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.983+0000 7f06b240f800 1 --2- 172.21.15.134:0/2586771673 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f06a8031040 0x7f06a8032940 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.983+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c6362b4b10 msgr2=0x55c6362b6fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.983+0000 7f06b240f800 1 --2- 172.21.15.134:0/2586771673 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c6362b4b10 0x55c6362b6fd0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.983+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f06a4015500 msgr2=0x7f06a40462d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.983+0000 7f06b240f800 1 --2- 172.21.15.134:0/2586771673 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f06a4015500 0x7f06a40462d0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.983+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55c6362bac50 msgr2=0x55c6362bd040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.983+0000 7f06b240f800 1 --2- 172.21.15.134:0/2586771673 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55c6362bac50 0x55c6362bd040 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.983+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0578036950 msgr2=0x7f0578038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.983+0000 7f06b240f800 1 --2- 172.21.15.134:0/2586771673 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0578036950 0x7f0578038e10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x55c6362848f0 tx=0x7f06a801f000 comp rx=0 tx=0).stop 2024-04-24T02:13:22.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.983+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c6362a1be0 msgr2=0x55c6362a9250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.983+0000 7f06b240f800 1 --2- 172.21.15.134:0/2586771673 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c6362a1be0 0x55c6362a9250 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f06a4019d20 tx=0x7f06a404cda0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.983+0000 7f06ada21640 1 -- 172.21.15.134:0/2586771673 reap_dead start 2024-04-24T02:13:22.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.983+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 shutdown_connections 2024-04-24T02:13:22.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.983+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 >> 172.21.15.134:0/2586771673 conn(0x55c63629df40 msgr2=0x55c63629b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:22.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.983+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 shutdown_connections 2024-04-24T02:13:22.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.983+0000 7f06b240f800 1 -- 172.21.15.134:0/2586771673 wait complete. 2024-04-24T02:13:22.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.983+0000 7f06b240f800 1 -- 172.21.15.134:0/281813622 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0588036950 msgr2=0x7f0588038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.983+0000 7f06b240f800 1 --2- 172.21.15.134:0/281813622 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0588036950 0x7f0588038e10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x55c636285170 tx=0x7f06a8005840 comp rx=0 tx=0).stop 2024-04-24T02:13:22.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.983+0000 7f06b240f800 1 -- 172.21.15.134:0/281813622 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c6362948a0 msgr2=0x55c636294cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.983+0000 7f06b240f800 1 --2- 172.21.15.134:0/281813622 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c6362948a0 0x55c636294cc0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f06a4001ed0 tx=0x7f06a400d7a0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.983+0000 7f06b240f800 1 -- 172.21.15.134:0/281813622 shutdown_connections 2024-04-24T02:13:22.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.983+0000 7f06b240f800 1 --2- 172.21.15.134:0/281813622 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0588036950 0x7f0588038e10 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.983+0000 7f06b240f800 1 --2- 172.21.15.134:0/281813622 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c6362948a0 0x55c636294cc0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.983+0000 7f06b240f800 1 -- 172.21.15.134:0/281813622 >> 172.21.15.134:0/281813622 conn(0x55c636288940 msgr2=0x55c636288d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:22.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.983+0000 7f06b240f800 1 -- 172.21.15.134:0/281813622 shutdown_connections 2024-04-24T02:13:22.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.983+0000 7f06b240f800 1 -- 172.21.15.134:0/281813622 wait complete. 2024-04-24T02:13:22.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.984+0000 7f06b240f800 1 -- 172.21.15.134:0/2540794391 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c636281360 msgr2=0x55c636283750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.984+0000 7f06b240f800 1 --2- 172.21.15.134:0/2540794391 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c636281360 0x55c636283750 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.984+0000 7f06b240f800 1 -- 172.21.15.134:0/2540794391 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0594036900 msgr2=0x7f0594038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.984+0000 7f06b240f800 1 --2- 172.21.15.134:0/2540794391 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0594036900 0x7f0594038dc0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f06a4000f60 tx=0x7f06a40012b0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.984+0000 7f06b240f800 1 -- 172.21.15.134:0/2540794391 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c6361800c0 msgr2=0x55c63627c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:22.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.984+0000 7f06b240f800 1 --2- 172.21.15.134:0/2540794391 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c6361800c0 0x55c63627c130 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f06a001ce60 tx=0x7f06a0002fb0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.984+0000 7f06b240f800 1 -- 172.21.15.134:0/2540794391 shutdown_connections 2024-04-24T02:13:22.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.984+0000 7f06b240f800 1 --2- 172.21.15.134:0/2540794391 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c636281360 0x55c636283750 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.984+0000 7f06b240f800 1 --2- 172.21.15.134:0/2540794391 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0594036900 0x7f0594038dc0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.984+0000 7f06b240f800 1 --2- 172.21.15.134:0/2540794391 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c6361800c0 0x55c63627c130 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:22.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.984+0000 7f06b240f800 1 -- 172.21.15.134:0/2540794391 >> 172.21.15.134:0/2540794391 conn(0x55c63617b3a0 msgr2=0x55c63626e640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:22.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.984+0000 7f06b240f800 1 -- 172.21.15.134:0/2540794391 shutdown_connections 2024-04-24T02:13:22.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:22.984+0000 7f06b240f800 1 -- 172.21.15.134:0/2540794391 wait complete. 2024-04-24T02:13:22.996 INFO:teuthology.orchestra.run.smithi134.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-04-24T02:00:00.000000Z","epoch":1713924000,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-04-24T02:00:00.000000Z","epoch":1713924000,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-04-24T02:00:00.000000Z","epoch":1713924000,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-04-24T02:00:00.000000Z","epoch":1713924000,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-04-24T02:00:00.000000Z","epoch":1713924000,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-04-24T02:13:22.996 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-04-24T02:13:22.996 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-04-24T02:13:22.996 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-04-24T02:13:22.996 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-04-24T02:13:23.041 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:13:23.041 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:13:23.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.042+0000 7f720340e800 1 Processor -- start 2024-04-24T02:13:23.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.042+0000 7f720340e800 1 -- start start 2024-04-24T02:13:23.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.042+0000 7f720340e800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x557594b5e120 0x557594b5e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:23.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.042+0000 7f720340e800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557594a1ed40 con 0x557594b61160 2024-04-24T02:13:23.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.042+0000 7f720340e800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x5575949f14d0 con 0x557594b5e120 2024-04-24T02:13:23.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.042+0000 7f7200f0d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x557594b5e120 0x557594b5e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:23.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.042+0000 7f720070c640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x557594b61160 0x557594b61610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:57836/0 (socket says 172.21.15.134:57836) 2024-04-24T02:13:23.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.042+0000 7f7200f0d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x557594b5e120 0x557594b5e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55392/0 (socket says 172.21.15.134:55392) 2024-04-24T02:13:23.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.042+0000 7f720070c640 1 -- 172.21.15.134:0/1062881353 learned_addr learned my addr 172.21.15.134:0/1062881353 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:13:23.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.043+0000 7f7200f0d640 1 -- 172.21.15.134:0/1062881353 >> v1:172.21.15.104:6789/0 conn(0x557594b61160 legacy=0x557594b61610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:23.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.043+0000 7f7200f0d640 1 -- 172.21.15.134:0/1062881353 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557594a1d590 con 0x557594b5e120 2024-04-24T02:13:23.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.044+0000 7f7200f0d640 1 --2- 172.21.15.134:0/1062881353 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557594b5e120 0x557594b5e540 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f71f8005fd0 tx=0x7f71f801cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1802fb41776f7fb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:23.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.044+0000 7f71fff0b640 1 -- 172.21.15.134:0/1062881353 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71f8052560 con 0x557594b5e120 2024-04-24T02:13:23.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.045+0000 7f71fff0b640 1 -- 172.21.15.134:0/1062881353 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71f8052700 con 0x557594b5e120 2024-04-24T02:13:23.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.045+0000 7f71fff0b640 1 -- 172.21.15.134:0/1062881353 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71f8052a60 con 0x557594b5e120 2024-04-24T02:13:23.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.045+0000 7f720340e800 1 -- 172.21.15.134:0/1062881353 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557594b5e120 msgr2=0x557594b5e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:23.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.045+0000 7f720340e800 1 --2- 172.21.15.134:0/1062881353 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557594b5e120 0x557594b5e540 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f71f8005fd0 tx=0x7f71f801cc80 comp rx=0 tx=0).stop 2024-04-24T02:13:23.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.045+0000 7f720340e800 1 -- 172.21.15.134:0/1062881353 shutdown_connections 2024-04-24T02:13:23.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.045+0000 7f720340e800 1 --2- 172.21.15.134:0/1062881353 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557594b5e120 0x557594b5e540 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.045+0000 7f720340e800 1 -- 172.21.15.134:0/1062881353 >> 172.21.15.134:0/1062881353 conn(0x557594b59b20 msgr2=0x557594b5bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:23.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.045+0000 7f720340e800 1 -- 172.21.15.134:0/1062881353 shutdown_connections 2024-04-24T02:13:23.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.045+0000 7f720340e800 1 -- 172.21.15.134:0/1062881353 wait complete. 2024-04-24T02:13:23.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.057+0000 7f720340e800 1 Processor -- start 2024-04-24T02:13:23.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.057+0000 7f720340e800 1 -- start start 2024-04-24T02:13:23.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.057+0000 7f720340e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557594b5e120 0x557594c51600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:23.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.057+0000 7f720340e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x557594aab3b0 con 0x557594b5e120 2024-04-24T02:13:23.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.057+0000 7f7200f0d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557594b5e120 0x557594c51600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:23.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.057+0000 7f7200f0d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557594b5e120 0x557594c51600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55402/0 (socket says 172.21.15.134:55402) 2024-04-24T02:13:23.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.057+0000 7f7200f0d640 1 -- 172.21.15.134:0/2736493381 learned_addr learned my addr 172.21.15.134:0/2736493381 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:23.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.058+0000 7f7200f0d640 1 -- 172.21.15.134:0/2736493381 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557594c51bd0 con 0x557594b5e120 2024-04-24T02:13:23.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.058+0000 7f7200f0d640 1 --2- 172.21.15.134:0/2736493381 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557594b5e120 0x557594c51600 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f71f8054040 tx=0x7f71f804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f8c250e157aecc5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:23.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.058+0000 7f70eee0d640 1 -- 172.21.15.134:0/2736493381 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71f80529e0 con 0x557594b5e120 2024-04-24T02:13:23.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.058+0000 7f70eee0d640 1 -- 172.21.15.134:0/2736493381 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71f8052b80 con 0x557594b5e120 2024-04-24T02:13:23.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.058+0000 7f70eee0d640 1 -- 172.21.15.134:0/2736493381 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71f805c430 con 0x557594b5e120 2024-04-24T02:13:23.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.059+0000 7f720340e800 1 -- 172.21.15.134:0/2736493381 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557594b5e120 msgr2=0x557594c51600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:23.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.059+0000 7f720340e800 1 --2- 172.21.15.134:0/2736493381 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557594b5e120 0x557594c51600 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f71f8054040 tx=0x7f71f804c000 comp rx=0 tx=0).stop 2024-04-24T02:13:23.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.059+0000 7f720340e800 1 -- 172.21.15.134:0/2736493381 shutdown_connections 2024-04-24T02:13:23.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.059+0000 7f720340e800 1 --2- 172.21.15.134:0/2736493381 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557594b5e120 0x557594c51600 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.059+0000 7f720340e800 1 -- 172.21.15.134:0/2736493381 >> 172.21.15.134:0/2736493381 conn(0x557594b59b20 msgr2=0x557594c4cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:23.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.059+0000 7f720340e800 1 -- 172.21.15.134:0/2736493381 shutdown_connections 2024-04-24T02:13:23.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.059+0000 7f720340e800 1 -- 172.21.15.134:0/2736493381 wait complete. 2024-04-24T02:13:23.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.059+0000 7f720340e800 1 Processor -- start 2024-04-24T02:13:23.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.059+0000 7f720340e800 1 -- start start 2024-04-24T02:13:23.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.059+0000 7f720340e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557594b5e120 0x557594c59060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:23.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.059+0000 7f720340e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x557594b695d0 con 0x557594b5e120 2024-04-24T02:13:23.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.059+0000 7f7200f0d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557594b5e120 0x557594c59060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:23.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.059+0000 7f7200f0d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557594b5e120 0x557594c59060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55406/0 (socket says 172.21.15.134:55406) 2024-04-24T02:13:23.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.059+0000 7f7200f0d640 1 -- 172.21.15.134:0/647356563 learned_addr learned my addr 172.21.15.134:0/647356563 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:23.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.060+0000 7f7200f0d640 1 -- 172.21.15.134:0/647356563 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557594c595a0 con 0x557594b5e120 2024-04-24T02:13:23.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.060+0000 7f7200f0d640 1 --2- 172.21.15.134:0/647356563 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557594b5e120 0x557594c59060 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f71f80447d0 tx=0x7f71f8003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:23.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.060+0000 7f70ed60a640 1 -- 172.21.15.134:0/647356563 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71f8066540 con 0x557594b5e120 2024-04-24T02:13:23.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.060+0000 7f70ed60a640 1 -- 172.21.15.134:0/647356563 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71f80666e0 con 0x557594b5e120 2024-04-24T02:13:23.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.060+0000 7f720340e800 1 -- 172.21.15.134:0/647356563 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557594c59830 con 0x557594b5e120 2024-04-24T02:13:23.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.060+0000 7f70ed60a640 1 -- 172.21.15.134:0/647356563 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71f8066a00 con 0x557594b5e120 2024-04-24T02:13:23.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.060+0000 7f720340e800 1 -- 172.21.15.134:0/647356563 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557594c5c490 con 0x557594b5e120 2024-04-24T02:13:23.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.061+0000 7f70ed60a640 1 -- 172.21.15.134:0/647356563 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f71f8078020 con 0x557594b5e120 2024-04-24T02:13:23.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.061+0000 7f70ed60a640 1 --2- 172.21.15.134:0/647356563 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f70e8036950 0x7f70e8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:23.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.061+0000 7f70ed60a640 1 -- 172.21.15.134:0/647356563 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f71f808e9c0 con 0x557594b5e120 2024-04-24T02:13:23.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.061+0000 7f720070c640 1 --2- 172.21.15.134:0/647356563 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f70e8036950 0x7f70e8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:23.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.061+0000 7f720340e800 1 --2- 172.21.15.134:0/647356563 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x557594b61160 0x557594c60250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:23.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.061+0000 7f720340e800 1 -- 172.21.15.134:0/647356563 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557594c60830 con 0x557594b61160 2024-04-24T02:13:23.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.061+0000 7f720170e640 1 --2- 172.21.15.134:0/647356563 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x557594b61160 0x557594c60250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:23.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.061+0000 7f720070c640 1 --2- 172.21.15.134:0/647356563 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f70e8036950 0x7f70e8038e10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f71e8000f60 tx=0x7f71e80012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:23.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.061+0000 7f720170e640 1 --2- 172.21.15.134:0/647356563 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x557594b61160 0x557594c60250 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:23.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.062+0000 7f720170e640 1 -- 172.21.15.134:0/647356563 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f71f00083e0 con 0x557594b61160 2024-04-24T02:13:23.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.062+0000 7f720340e800 1 -- 172.21.15.134:0/647356563 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557594c5d800 con 0x557594b61160 2024-04-24T02:13:23.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.062+0000 7f720170e640 1 -- 172.21.15.134:0/647356563 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f71f00083e0 con 0x557594b61160 2024-04-24T02:13:23.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.062+0000 7f720340e800 1 -- 172.21.15.134:0/647356563 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557594c62650 con 0x557594b61160 2024-04-24T02:13:23.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.062+0000 7f720170e640 1 -- 172.21.15.134:0/647356563 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f71f00083e0 con 0x557594b61160 2024-04-24T02:13:23.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.062+0000 7f720340e800 1 -- 172.21.15.134:0/647356563 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557594c61990 con 0x557594b61160 2024-04-24T02:13:23.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.063+0000 7f720170e640 1 -- 172.21.15.134:0/647356563 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f71f00083e0 con 0x557594b61160 2024-04-24T02:13:23.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.063+0000 7f720340e800 1 -- 172.21.15.134:0/647356563 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557594c61d80 con 0x557594b61160 2024-04-24T02:13:23.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.063+0000 7f720170e640 1 -- 172.21.15.134:0/647356563 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f71f00083e0 con 0x557594b61160 2024-04-24T02:13:23.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.063+0000 7f720340e800 1 Processor -- start 2024-04-24T02:13:23.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.063+0000 7f720340e800 1 -- start start 2024-04-24T02:13:23.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.063+0000 7f720340e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557594b60ce0 0x557594b5f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:23.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.063+0000 7f720340e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x557594a516b0 con 0x557594b60ce0 2024-04-24T02:13:23.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.064+0000 7f720070c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557594b60ce0 0x557594b5f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:23.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.064+0000 7f720070c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557594b60ce0 0x557594b5f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55420/0 (socket says 172.21.15.134:55420) 2024-04-24T02:13:23.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.064+0000 7f720070c640 1 -- 172.21.15.134:0/3827266445 learned_addr learned my addr 172.21.15.134:0/3827266445 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:23.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.064+0000 7f720070c640 1 -- 172.21.15.134:0/3827266445 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557594b5f690 con 0x557594b60ce0 2024-04-24T02:13:23.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.064+0000 7f720070c640 1 --2- 172.21.15.134:0/3827266445 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557594b60ce0 0x557594b5f150 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f71e8001ed0 tx=0x7f71e800d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:23.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.064+0000 7f70e67fc640 1 -- 172.21.15.134:0/3827266445 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71e801b550 con 0x557594b60ce0 2024-04-24T02:13:23.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.065+0000 7f70e67fc640 1 -- 172.21.15.134:0/3827266445 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71e801b6f0 con 0x557594b60ce0 2024-04-24T02:13:23.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.065+0000 7f720340e800 1 -- 172.21.15.134:0/3827266445 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557594b5f8c0 con 0x557594b60ce0 2024-04-24T02:13:23.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.065+0000 7f70e67fc640 1 -- 172.21.15.134:0/3827266445 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71e801b9d0 con 0x557594b60ce0 2024-04-24T02:13:23.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.065+0000 7f720340e800 1 -- 172.21.15.134:0/3827266445 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557594b5fdc0 con 0x557594b60ce0 2024-04-24T02:13:23.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.065+0000 7f70e67fc640 1 -- 172.21.15.134:0/3827266445 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f71e8023020 con 0x557594b60ce0 2024-04-24T02:13:23.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.065+0000 7f70e67fc640 1 --2- 172.21.15.134:0/3827266445 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f70d8036950 0x7f70d8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:23.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.065+0000 7f70e67fc640 1 -- 172.21.15.134:0/3827266445 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f71e8021020 con 0x557594b60ce0 2024-04-24T02:13:23.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.065+0000 7f720170e640 1 --2- 172.21.15.134:0/3827266445 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f70d8036950 0x7f70d8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:23.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.066+0000 7f720340e800 1 Processor -- start 2024-04-24T02:13:23.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.066+0000 7f720340e800 1 -- start start 2024-04-24T02:13:23.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.066+0000 7f720170e640 1 --2- 172.21.15.134:0/3827266445 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f70d8036950 0x7f70d8038e10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x557594c614b0 tx=0x7f71f0000f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:23.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.066+0000 7f720340e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557594c80990 0x557594c80db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:23.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.066+0000 7f720340e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x557594c51e90 con 0x557594c80990 2024-04-24T02:13:23.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.066+0000 7f720070c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557594c80990 0x557594c80db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:23.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.066+0000 7f720070c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557594c80990 0x557594c80db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55428/0 (socket says 172.21.15.134:55428) 2024-04-24T02:13:23.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.066+0000 7f720070c640 1 -- 172.21.15.134:0/500794373 learned_addr learned my addr 172.21.15.134:0/500794373 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:23.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.066+0000 7f720070c640 1 -- 172.21.15.134:0/500794373 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557594c81380 con 0x557594c80990 2024-04-24T02:13:23.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.067+0000 7f720070c640 1 --2- 172.21.15.134:0/500794373 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557594c80990 0x557594c80db0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f71e804ce10 tx=0x7f71e8019ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c86acd0515cc3083 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:23.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.067+0000 7f70d7fff640 1 -- 172.21.15.134:0/500794373 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71e8041070 con 0x557594c80990 2024-04-24T02:13:23.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.067+0000 7f70d7fff640 1 -- 172.21.15.134:0/500794373 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71e801bd50 con 0x557594c80990 2024-04-24T02:13:23.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.067+0000 7f70d7fff640 1 -- 172.21.15.134:0/500794373 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71e8025a30 con 0x557594c80990 2024-04-24T02:13:23.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.067+0000 7f720340e800 1 -- 172.21.15.134:0/500794373 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557594c80990 msgr2=0x557594c80db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:23.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.067+0000 7f720340e800 1 --2- 172.21.15.134:0/500794373 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557594c80990 0x557594c80db0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f71e804ce10 tx=0x7f71e8019ce0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.067+0000 7f720340e800 1 -- 172.21.15.134:0/500794373 shutdown_connections 2024-04-24T02:13:23.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.067+0000 7f720340e800 1 --2- 172.21.15.134:0/500794373 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557594c80990 0x557594c80db0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.067+0000 7f720340e800 1 -- 172.21.15.134:0/500794373 >> 172.21.15.134:0/500794373 conn(0x557594c7ccf0 msgr2=0x557594c7ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:23.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.067+0000 7f720340e800 1 -- 172.21.15.134:0/500794373 shutdown_connections 2024-04-24T02:13:23.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.067+0000 7f720340e800 1 -- 172.21.15.134:0/500794373 wait complete. 2024-04-24T02:13:23.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.067+0000 7f720340e800 1 Processor -- start 2024-04-24T02:13:23.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.068+0000 7f720340e800 1 -- start start 2024-04-24T02:13:23.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.068+0000 7f720340e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557594c80990 0x557594c88050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:23.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.068+0000 7f720340e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x557594c81af0 con 0x557594c80990 2024-04-24T02:13:23.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.068+0000 7f720070c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557594c80990 0x557594c88050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:23.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.068+0000 7f720070c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557594c80990 0x557594c88050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55438/0 (socket says 172.21.15.134:55438) 2024-04-24T02:13:23.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.068+0000 7f720070c640 1 -- 172.21.15.134:0/2212966270 learned_addr learned my addr 172.21.15.134:0/2212966270 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:23.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.068+0000 7f720070c640 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557594c88590 con 0x557594c80990 2024-04-24T02:13:23.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.068+0000 7f720070c640 1 --2- 172.21.15.134:0/2212966270 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557594c80990 0x557594c88050 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f71e8019f50 tx=0x7f71e804cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:23.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.068+0000 7f70d67fc640 1 -- 172.21.15.134:0/2212966270 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71e8041070 con 0x557594c80990 2024-04-24T02:13:23.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.068+0000 7f70d67fc640 1 -- 172.21.15.134:0/2212966270 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71e800cc60 con 0x557594c80990 2024-04-24T02:13:23.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.068+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557594c88820 con 0x557594c80990 2024-04-24T02:13:23.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.068+0000 7f70d67fc640 1 -- 172.21.15.134:0/2212966270 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71e804e7f0 con 0x557594c80990 2024-04-24T02:13:23.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.068+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557594c88820 con 0x557594c80990 2024-04-24T02:13:23.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.069+0000 7f70d67fc640 1 -- 172.21.15.134:0/2212966270 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f71e804ea90 con 0x557594c80990 2024-04-24T02:13:23.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.069+0000 7f70d67fc640 1 --2- 172.21.15.134:0/2212966270 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f70cc036950 0x7f70cc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:23.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.069+0000 7f70d67fc640 1 -- 172.21.15.134:0/2212966270 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f71e8039bb0 con 0x557594c80990 2024-04-24T02:13:23.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.070+0000 7f720170e640 1 --2- 172.21.15.134:0/2212966270 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f70cc036950 0x7f70cc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:23.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.070+0000 7f720340e800 20 rados->read ofs=0 len=0 2024-04-24T02:13:23.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.070+0000 7f720340e800 1 --2- 172.21.15.134:0/2212966270 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x557594c93900 0x557594c95dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:23.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.070+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557594c96510 con 0x557594c93900 2024-04-24T02:13:23.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.070+0000 7f7200f0d640 1 --2- 172.21.15.134:0/2212966270 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x557594c93900 0x557594c95dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:23.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.070+0000 7f720170e640 1 --2- 172.21.15.134:0/2212966270 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f70cc036950 0x7f70cc038e10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f71f000f010 tx=0x7f71f000c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:23.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.070+0000 7f7200f0d640 1 --2- 172.21.15.134:0/2212966270 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x557594c93900 0x557594c95dc0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:23.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.070+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f71f8071910 con 0x557594c93900 2024-04-24T02:13:23.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.070+0000 7f720340e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:23.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.070+0000 7f720340e800 20 realm 2024-04-24T02:13:23.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.070+0000 7f720340e800 20 rados->read ofs=0 len=0 2024-04-24T02:13:23.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.070+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557594c96920 con 0x557594c93900 2024-04-24T02:13:23.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.070+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f71f8071910 con 0x557594c93900 2024-04-24T02:13:23.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.070+0000 7f720340e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:23.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.070+0000 7f720340e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:13:23.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.070+0000 7f720340e800 20 rados->read ofs=0 len=0 2024-04-24T02:13:23.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.071+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557594c971f0 con 0x557594c93900 2024-04-24T02:13:23.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.071+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f71f8071910 con 0x557594c93900 2024-04-24T02:13:23.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.071+0000 7f720340e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:23.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.071+0000 7f720340e800 20 rados->read ofs=0 len=0 2024-04-24T02:13:23.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.071+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557594c97590 con 0x557594c93900 2024-04-24T02:13:23.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.071+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f71f8071910 con 0x557594c93900 2024-04-24T02:13:23.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.071+0000 7f720340e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:13:23.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.071+0000 7f720340e800 20 rados->read ofs=0 len=0 2024-04-24T02:13:23.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.071+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557594c979f0 con 0x557594c93900 2024-04-24T02:13:23.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.071+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f71f8071910 con 0x557594c93900 2024-04-24T02:13:23.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.071+0000 7f720340e800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:13:23.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.071+0000 7f720340e800 20 searching for the correct realm 2024-04-24T02:13:23.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.071+0000 7f720340e800 1 --2- 172.21.15.134:0/2212966270 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x557594c99a40 0x557594c9be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:23.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.071+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557594c9c4e0 con 0x557594c99a40 2024-04-24T02:13:23.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.071+0000 7f720070c640 1 --2- 172.21.15.134:0/2212966270 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x557594c99a40 0x557594c9be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:23.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.072+0000 7f720070c640 1 --2- 172.21.15.134:0/2212966270 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x557594c99a40 0x557594c9be30 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:23.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.072+0000 7f720070c640 1 -- 172.21.15.134:0/2212966270 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71e8056040 con 0x557594c99a40 2024-04-24T02:13:23.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.072+0000 7f720070c640 1 --2- 172.21.15.134:0/2212966270 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f71e80462b0 0x7f71e80306d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:23.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.072+0000 7f720070c640 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557594c9c4e0 con 0x7f71e80462b0 2024-04-24T02:13:23.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.072+0000 7f720170e640 1 --2- 172.21.15.134:0/2212966270 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f71e80462b0 0x7f71e80306d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:23.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.072+0000 7f720170e640 1 --2- 172.21.15.134:0/2212966270 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f71e80462b0 0x7f71e80306d0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:23.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.072+0000 7f720170e640 1 -- 172.21.15.134:0/2212966270 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71f002f040 con 0x7f71e80462b0 2024-04-24T02:13:23.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.072+0000 7f720170e640 1 --2- 172.21.15.134:0/2212966270 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f71f0019040 0x7f71f0019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:23.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.073+0000 7f720170e640 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557594c9c4e0 con 0x7f71f0019040 2024-04-24T02:13:23.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.073+0000 7f7200f0d640 1 --2- 172.21.15.134:0/2212966270 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f71f0019040 0x7f71f0019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:23.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.073+0000 7f7200f0d640 1 --2- 172.21.15.134:0/2212966270 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f71f0019040 0x7f71f0019930 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:23.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.073+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71f8071910 con 0x7f71f0019040 2024-04-24T02:13:23.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.073+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557594c9c4e0 con 0x557594c93900 2024-04-24T02:13:23.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.074+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71f8071910 con 0x557594c93900 2024-04-24T02:13:23.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.074+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557594c9c4e0 con 0x557594c93900 2024-04-24T02:13:23.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.074+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f71f8071910 con 0x557594c93900 2024-04-24T02:13:23.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.074+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557594c9c4e0 con 0x7f71f0019040 2024-04-24T02:13:23.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.074+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71f8071910 con 0x7f71f0019040 2024-04-24T02:13:23.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.074+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557594c9c4e0 con 0x7f71e80462b0 2024-04-24T02:13:23.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.074+0000 7f720170e640 1 -- 172.21.15.134:0/2212966270 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71f002f040 con 0x7f71e80462b0 2024-04-24T02:13:23.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.074+0000 7f720170e640 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557594c9c4e0 con 0x7f71e80462b0 2024-04-24T02:13:23.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.075+0000 7f720170e640 1 -- 172.21.15.134:0/2212966270 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71f002f040 con 0x7f71e80462b0 2024-04-24T02:13:23.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.075+0000 7f720170e640 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557594c9c4e0 con 0x557594c99a40 2024-04-24T02:13:23.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.075+0000 7f720070c640 1 -- 172.21.15.134:0/2212966270 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71e8056040 con 0x557594c99a40 2024-04-24T02:13:23.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.075+0000 7f720070c640 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557594c9c4e0 con 0x557594c93900 2024-04-24T02:13:23.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.075+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71f8071910 con 0x557594c93900 2024-04-24T02:13:23.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.075+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557594c9c4e0 con 0x7f71f0019040 2024-04-24T02:13:23.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.075+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71f8071910 con 0x7f71f0019040 2024-04-24T02:13:23.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.075+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557594c9c4e0 con 0x557594c93900 2024-04-24T02:13:23.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.076+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71f8071910 con 0x557594c93900 2024-04-24T02:13:23.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.076+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557594c9c4e0 con 0x7f71e80462b0 2024-04-24T02:13:23.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.076+0000 7f720170e640 1 -- 172.21.15.134:0/2212966270 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f71f002f040 con 0x7f71e80462b0 2024-04-24T02:13:23.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.076+0000 7f720170e640 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557594c9c4e0 con 0x557594c99a40 2024-04-24T02:13:23.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.076+0000 7f720070c640 1 -- 172.21.15.134:0/2212966270 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71e8056040 con 0x557594c99a40 2024-04-24T02:13:23.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.076+0000 7f720070c640 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557594c9c4e0 con 0x557594c99a40 2024-04-24T02:13:23.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.076+0000 7f720070c640 1 -- 172.21.15.134:0/2212966270 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71e8056040 con 0x557594c99a40 2024-04-24T02:13:23.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.076+0000 7f720070c640 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557594c9c4e0 con 0x7f71e80462b0 2024-04-24T02:13:23.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.076+0000 7f720170e640 1 -- 172.21.15.134:0/2212966270 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71f002f040 con 0x7f71e80462b0 2024-04-24T02:13:23.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.076+0000 7f720170e640 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557594c9c4e0 con 0x557594c99a40 2024-04-24T02:13:23.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.077+0000 7f720070c640 1 -- 172.21.15.134:0/2212966270 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71e8056040 con 0x557594c99a40 2024-04-24T02:13:23.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.077+0000 7f720070c640 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557594c9c4e0 con 0x557594c99a40 2024-04-24T02:13:23.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.077+0000 7f720070c640 1 -- 172.21.15.134:0/2212966270 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71e8056040 con 0x557594c99a40 2024-04-24T02:13:23.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.077+0000 7f720070c640 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557594c9c4e0 con 0x557594c93900 2024-04-24T02:13:23.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.077+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71f8071910 con 0x557594c93900 2024-04-24T02:13:23.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.077+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557594c9c4e0 con 0x557594c93900 2024-04-24T02:13:23.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.077+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f71f8071910 con 0x557594c93900 2024-04-24T02:13:23.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.077+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557594c9c4e0 con 0x7f71f0019040 2024-04-24T02:13:23.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.078+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71f8071910 con 0x7f71f0019040 2024-04-24T02:13:23.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.078+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557594c9c4e0 con 0x557594c99a40 2024-04-24T02:13:23.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.078+0000 7f720070c640 1 -- 172.21.15.134:0/2212966270 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71e8056040 con 0x557594c99a40 2024-04-24T02:13:23.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.078+0000 7f720070c640 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557594c9c4e0 con 0x7f71e80462b0 2024-04-24T02:13:23.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.078+0000 7f720170e640 1 -- 172.21.15.134:0/2212966270 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71f002f040 con 0x7f71e80462b0 2024-04-24T02:13:23.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.078+0000 7f720170e640 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557594c9c4e0 con 0x557594c93900 2024-04-24T02:13:23.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.079+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71f8071910 con 0x557594c93900 2024-04-24T02:13:23.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.079+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557594c9c4e0 con 0x7f71f0019040 2024-04-24T02:13:23.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.079+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71f8071910 con 0x7f71f0019040 2024-04-24T02:13:23.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.079+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557594c9c4e0 con 0x557594c99a40 2024-04-24T02:13:23.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.079+0000 7f720070c640 1 -- 172.21.15.134:0/2212966270 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71e8056040 con 0x557594c99a40 2024-04-24T02:13:23.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.079+0000 7f720070c640 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557594c9c4e0 con 0x7f71f0019040 2024-04-24T02:13:23.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.079+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71f8071910 con 0x7f71f0019040 2024-04-24T02:13:23.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.080+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557594c9c4e0 con 0x7f71e80462b0 2024-04-24T02:13:23.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.080+0000 7f720170e640 1 -- 172.21.15.134:0/2212966270 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71f002f040 con 0x7f71e80462b0 2024-04-24T02:13:23.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.080+0000 7f720170e640 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557594c9c4e0 con 0x557594c99a40 2024-04-24T02:13:23.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.080+0000 7f720070c640 1 -- 172.21.15.134:0/2212966270 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71e8056040 con 0x557594c99a40 2024-04-24T02:13:23.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.080+0000 7f720070c640 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557594c9c4e0 con 0x7f71e80462b0 2024-04-24T02:13:23.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.080+0000 7f720170e640 1 -- 172.21.15.134:0/2212966270 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71f002f040 con 0x7f71e80462b0 2024-04-24T02:13:23.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.080+0000 7f720170e640 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557594c9c4e0 con 0x557594c93900 2024-04-24T02:13:23.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.080+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f71f8071910 con 0x557594c93900 2024-04-24T02:13:23.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.080+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557594c9c4e0 con 0x7f71e80462b0 2024-04-24T02:13:23.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.081+0000 7f720170e640 1 -- 172.21.15.134:0/2212966270 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71f002f040 con 0x7f71e80462b0 2024-04-24T02:13:23.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.081+0000 7f720340e800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:13:23.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.081+0000 7f720340e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:13:23.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.081+0000 7f720340e800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:13:23.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.081+0000 7f720340e800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:13:23.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.081+0000 7f720340e800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:13:23.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.081+0000 7f720340e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:13:23.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.081+0000 7f720340e800 20 rados->read ofs=0 len=0 2024-04-24T02:13:23.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.081+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557594c984c0 con 0x557594c93900 2024-04-24T02:13:23.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.081+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f71f8071910 con 0x557594c93900 2024-04-24T02:13:23.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.081+0000 7f720340e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:23.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.081+0000 7f720340e800 20 rados->read ofs=0 len=0 2024-04-24T02:13:23.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.081+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557594c98d60 con 0x557594c93900 2024-04-24T02:13:23.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.081+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f71f8071910 con 0x557594c93900 2024-04-24T02:13:23.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.081+0000 7f720340e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:13:23.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.081+0000 7f720340e800 20 rados->read ofs=0 len=0 2024-04-24T02:13:23.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.081+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557594c98100 con 0x557594c93900 2024-04-24T02:13:23.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.081+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f71f8071910 con 0x557594c93900 2024-04-24T02:13:23.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.081+0000 7f720340e800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:13:23.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.081+0000 7f720340e800 20 zone default found 2024-04-24T02:13:23.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.081+0000 7f720340e800 4 Realm: () 2024-04-24T02:13:23.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.081+0000 7f720340e800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:13:23.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.081+0000 7f720340e800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:13:23.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.081+0000 7f720340e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:13:23.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.081+0000 7f720340e800 20 zonegroup default 2024-04-24T02:13:23.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.081+0000 7f720340e800 20 rados->read ofs=0 len=0 2024-04-24T02:13:23.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.081+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557594c9c940 con 0x7f71f0019040 2024-04-24T02:13:23.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.082+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f71f8071910 con 0x7f71f0019040 2024-04-24T02:13:23.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.082+0000 7f720340e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:23.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.082+0000 7f720340e800 20 rados->read ofs=0 len=0 2024-04-24T02:13:23.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.082+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557594c9e7d0 con 0x557594c99a40 2024-04-24T02:13:23.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.082+0000 7f720070c640 1 -- 172.21.15.134:0/2212966270 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f71e8056040 con 0x557594c99a40 2024-04-24T02:13:23.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.082+0000 7f720340e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:23.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.082+0000 7f720340e800 20 rados->read ofs=0 len=0 2024-04-24T02:13:23.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.082+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557594c9eb70 con 0x557594c99a40 2024-04-24T02:13:23.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.082+0000 7f720070c640 1 -- 172.21.15.134:0/2212966270 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f71e8056040 con 0x557594c99a40 2024-04-24T02:13:23.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.082+0000 7f720340e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:23.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.082+0000 7f720340e800 20 started sync module instance, tier type = 2024-04-24T02:13:23.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.082+0000 7f720340e800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:13:23.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.082+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557594c9dc10 con 0x7f71e80462b0 2024-04-24T02:13:23.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.083+0000 7f720170e640 1 -- 172.21.15.134:0/2212966270 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(44 notify.0 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71f002f040 con 0x7f71e80462b0 2024-04-24T02:13:23.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.083+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93963495792992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557594c9dc10 con 0x7f71e80462b0 2024-04-24T02:13:23.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.083+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557594c9f570 con 0x557594c93900 2024-04-24T02:13:23.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.084+0000 7f720170e640 1 -- 172.21.15.134:0/2212966270 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93963495792992] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71f002f040 con 0x7f71e80462b0 2024-04-24T02:13:23.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.085+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71f8071910 con 0x557594c93900 2024-04-24T02:13:23.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.085+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93963495796864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557594c9dc10 con 0x557594c93900 2024-04-24T02:13:23.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.085+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557594c9ffb0 con 0x557594c99a40 2024-04-24T02:13:23.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.086+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93963495796864] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71f8071910 con 0x557594c93900 2024-04-24T02:13:23.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.086+0000 7f720070c640 1 -- 172.21.15.134:0/2212966270 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71e8056040 con 0x557594c99a40 2024-04-24T02:13:23.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.086+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93963495790432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557594c9db80 con 0x557594c99a40 2024-04-24T02:13:23.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.086+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557594ca0e70 con 0x7f71e80462b0 2024-04-24T02:13:23.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.087+0000 7f720070c640 1 -- 172.21.15.134:0/2212966270 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93963495790432] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71e8056040 con 0x557594c99a40 2024-04-24T02:13:23.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.087+0000 7f720170e640 1 -- 172.21.15.134:0/2212966270 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(50 notify.3 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71f002f040 con 0x7f71e80462b0 2024-04-24T02:13:23.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.087+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93963495803328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557594ca1290 con 0x7f71e80462b0 2024-04-24T02:13:23.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.087+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557594ca1c50 con 0x557594c93900 2024-04-24T02:13:23.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.088+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71f8071910 con 0x557594c93900 2024-04-24T02:13:23.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.089+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93963495806880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557594ca2070 con 0x557594c93900 2024-04-24T02:13:23.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.089+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557594ca2b50 con 0x7f71f0019040 2024-04-24T02:13:23.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.089+0000 7f720170e640 1 -- 172.21.15.134:0/2212966270 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93963495803328] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71f002f040 con 0x7f71e80462b0 2024-04-24T02:13:23.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.090+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(54 notify.5 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71f8071910 con 0x7f71f0019040 2024-04-24T02:13:23.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.090+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93963495810656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557594ca2b50 con 0x7f71f0019040 2024-04-24T02:13:23.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.090+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557594ca3560 con 0x7f71f0019040 2024-04-24T02:13:23.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.090+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93963495806880] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71f8071910 con 0x557594c93900 2024-04-24T02:13:23.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.091+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 93963495810656] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71f8071910 con 0x7f71f0019040 2024-04-24T02:13:23.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.091+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(56 notify.6 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71f8071910 con 0x7f71f0019040 2024-04-24T02:13:23.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.091+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93963495804384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557594ca30b0 con 0x7f71f0019040 2024-04-24T02:13:23.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.091+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557594ca3a70 con 0x7f71f0019040 2024-04-24T02:13:23.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.092+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(58 notify.7 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71f8071910 con 0x7f71f0019040 2024-04-24T02:13:23.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.092+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 93963495804384] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71f8071910 con 0x7f71f0019040 2024-04-24T02:13:23.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.092+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93963495814592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557594ca3e90 con 0x7f71f0019040 2024-04-24T02:13:23.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.092+0000 7f720340e800 20 add_watcher() i=0 2024-04-24T02:13:23.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.092+0000 7f720340e800 20 add_watcher() i=1 2024-04-24T02:13:23.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.092+0000 7f720340e800 20 add_watcher() i=2 2024-04-24T02:13:23.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.092+0000 7f720340e800 20 add_watcher() i=3 2024-04-24T02:13:23.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.092+0000 7f720340e800 20 add_watcher() i=4 2024-04-24T02:13:23.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.092+0000 7f720340e800 20 add_watcher() i=5 2024-04-24T02:13:23.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.092+0000 7f720340e800 20 add_watcher() i=6 2024-04-24T02:13:23.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.093+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 93963495814592] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71f8071910 con 0x7f71f0019040 2024-04-24T02:13:23.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.093+0000 7f720340e800 20 add_watcher() i=7 2024-04-24T02:13:23.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.093+0000 7f720340e800 2 all 8 watchers are set, enabling cache 2024-04-24T02:13:23.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.093+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557594ca6ec0 con 0x557594c93900 2024-04-24T02:13:23.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.093+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f71f8071910 con 0x557594c93900 2024-04-24T02:13:23.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.093+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93963495815648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557594ca42e0 con 0x557594c93900 2024-04-24T02:13:23.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.094+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93963495815648] v32'215 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f71f8071910 con 0x557594c93900 2024-04-24T02:13:23.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.094+0000 7f70b6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:13:23.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.094+0000 7f720340e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:13:23.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.094+0000 7f720340e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:13:23.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.095+0000 7f720340e800 5 note: GC not initialized 2024-04-24T02:13:23.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.095+0000 7f70b5fe3640 20 reqs_thread_entry: start 2024-04-24T02:13:23.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.095+0000 7f720340e800 20 init_complete bucket index max shards: 11 2024-04-24T02:13:23.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.095+0000 7f720340e800 20 Filter name: none 2024-04-24T02:13:23.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.095+0000 7f70277fe640 20 reqs_thread_entry: start 2024-04-24T02:13:23.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.095+0000 7f720340e800 20 rados->read ofs=0 len=0 2024-04-24T02:13:23.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.095+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557594cd9c60 con 0x557594c93900 2024-04-24T02:13:23.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.095+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f71f8071910 con 0x557594c93900 2024-04-24T02:13:23.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.095+0000 7f720340e800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T02:13:23.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.095+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557594cdb1b0 con 0x7f71f0019040 2024-04-24T02:13:23.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.096+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f71f8071910 con 0x7f71f0019040 2024-04-24T02:13:23.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.097+0000 7f70b6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:13:23.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.097+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93963495815648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557594cd83c0 con 0x557594c93900 2024-04-24T02:13:23.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.098+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93963495815648] v32'216 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f71f8071910 con 0x557594c93900 2024-04-24T02:13:23.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.098+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93963495792992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557594ca39e0 con 0x7f71e80462b0 2024-04-24T02:13:23.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.099+0000 7f720170e640 1 -- 172.21.15.134:0/2212966270 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93963495792992] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71f002f040 con 0x7f71e80462b0 2024-04-24T02:13:23.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.099+0000 7f720340e800 20 remove_watcher() i=0 2024-04-24T02:13:23.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.099+0000 7f720340e800 2 removed watcher, disabling cache 2024-04-24T02:13:23.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.099+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93963495796864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557594ca39e0 con 0x557594c93900 2024-04-24T02:13:23.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.100+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93963495796864] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71f8071910 con 0x557594c93900 2024-04-24T02:13:23.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.100+0000 7f720340e800 20 remove_watcher() i=1 2024-04-24T02:13:23.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.100+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93963495790432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557594ca39e0 con 0x557594c99a40 2024-04-24T02:13:23.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.101+0000 7f720070c640 1 -- 172.21.15.134:0/2212966270 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93963495790432] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71e8056040 con 0x557594c99a40 2024-04-24T02:13:23.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.101+0000 7f720340e800 20 remove_watcher() i=2 2024-04-24T02:13:23.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.101+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93963495803328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557594c9d760 con 0x7f71e80462b0 2024-04-24T02:13:23.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.102+0000 7f720170e640 1 -- 172.21.15.134:0/2212966270 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93963495803328] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71f002f040 con 0x7f71e80462b0 2024-04-24T02:13:23.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.102+0000 7f720340e800 20 remove_watcher() i=3 2024-04-24T02:13:23.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.102+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93963495806880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557594c9d760 con 0x557594c93900 2024-04-24T02:13:23.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.103+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93963495806880] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71f8071910 con 0x557594c93900 2024-04-24T02:13:23.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.103+0000 7f720340e800 20 remove_watcher() i=4 2024-04-24T02:13:23.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.103+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93963495810656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557594c9d760 con 0x7f71f0019040 2024-04-24T02:13:23.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.104+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93963495810656] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71f8071910 con 0x7f71f0019040 2024-04-24T02:13:23.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.104+0000 7f720340e800 20 remove_watcher() i=5 2024-04-24T02:13:23.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.104+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93963495804384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557594c9d760 con 0x7f71f0019040 2024-04-24T02:13:23.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.105+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93963495804384] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71f8071910 con 0x7f71f0019040 2024-04-24T02:13:23.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.105+0000 7f720340e800 20 remove_watcher() i=6 2024-04-24T02:13:23.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.105+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93963495814592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557594c9d760 con 0x7f71f0019040 2024-04-24T02:13:23.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.106+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93963495814592] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71f8071910 con 0x7f71f0019040 2024-04-24T02:13:23.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.106+0000 7f720340e800 20 remove_watcher() i=7 2024-04-24T02:13:23.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.106+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f71f0019040 msgr2=0x7f71f0019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:23.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.106+0000 7f720340e800 1 --2- 172.21.15.134:0/2212966270 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f71f0019040 0x7f71f0019930 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.106+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x557594c93900 msgr2=0x557594c95dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:23.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.106+0000 7f720340e800 1 --2- 172.21.15.134:0/2212966270 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x557594c93900 0x557594c95dc0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.106+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f71e80462b0 msgr2=0x7f71e80306d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:23.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.106+0000 7f720340e800 1 --2- 172.21.15.134:0/2212966270 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f71e80462b0 0x7f71e80306d0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.106+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x557594c99a40 msgr2=0x557594c9be30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:23.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.106+0000 7f720340e800 1 --2- 172.21.15.134:0/2212966270 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x557594c99a40 0x557594c9be30 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.107+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f70cc036950 msgr2=0x7f70cc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:23.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.107+0000 7f720340e800 1 --2- 172.21.15.134:0/2212966270 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f70cc036950 0x7f70cc038e10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f71f000f010 tx=0x7f71f000c040 comp rx=0 tx=0).stop 2024-04-24T02:13:23.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.107+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557594c80990 msgr2=0x557594c88050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:23.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.107+0000 7f720340e800 1 --2- 172.21.15.134:0/2212966270 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557594c80990 0x557594c88050 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f71e8019f50 tx=0x7f71e804cda0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.107+0000 7f7200f0d640 1 -- 172.21.15.134:0/2212966270 reap_dead start 2024-04-24T02:13:23.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.107+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 shutdown_connections 2024-04-24T02:13:23.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.107+0000 7f720340e800 1 --2- 172.21.15.134:0/2212966270 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557594c80990 0x557594c88050 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.107+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 >> 172.21.15.134:0/2212966270 conn(0x557594c7ccf0 msgr2=0x557594c7a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:23.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.107+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 shutdown_connections 2024-04-24T02:13:23.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.107+0000 7f720340e800 1 -- 172.21.15.134:0/2212966270 wait complete. 2024-04-24T02:13:23.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.107+0000 7f720340e800 1 -- 172.21.15.134:0/3827266445 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f70d8036950 msgr2=0x7f70d8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:23.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.107+0000 7f720340e800 1 --2- 172.21.15.134:0/3827266445 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f70d8036950 0x7f70d8038e10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x557594c614b0 tx=0x7f71f0000f90 comp rx=0 tx=0).stop 2024-04-24T02:13:23.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.107+0000 7f720340e800 1 -- 172.21.15.134:0/3827266445 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557594b60ce0 msgr2=0x557594b5f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:23.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.107+0000 7f720340e800 1 --2- 172.21.15.134:0/3827266445 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557594b60ce0 0x557594b5f150 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f71e8001ed0 tx=0x7f71e800d7a0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.107+0000 7f720340e800 1 -- 172.21.15.134:0/3827266445 shutdown_connections 2024-04-24T02:13:23.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.107+0000 7f720340e800 1 --2- 172.21.15.134:0/3827266445 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f70d8036950 0x7f70d8038e10 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.107+0000 7f720340e800 1 --2- 172.21.15.134:0/3827266445 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557594b60ce0 0x557594b5f150 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.107+0000 7f720340e800 1 -- 172.21.15.134:0/3827266445 >> 172.21.15.134:0/3827266445 conn(0x557594c65500 msgr2=0x557594c65900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:23.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.107+0000 7f720340e800 1 -- 172.21.15.134:0/3827266445 shutdown_connections 2024-04-24T02:13:23.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.107+0000 7f720340e800 1 -- 172.21.15.134:0/3827266445 wait complete. 2024-04-24T02:13:23.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.107+0000 7f720340e800 1 -- 172.21.15.134:0/647356563 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x557594b61160 msgr2=0x557594c60250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:23.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.107+0000 7f720340e800 1 --2- 172.21.15.134:0/647356563 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x557594b61160 0x557594c60250 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.108+0000 7f720340e800 1 -- 172.21.15.134:0/647356563 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f70e8036950 msgr2=0x7f70e8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:23.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.108+0000 7f720340e800 1 --2- 172.21.15.134:0/647356563 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f70e8036950 0x7f70e8038e10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f71e8000f60 tx=0x7f71e80012b0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.108+0000 7f720340e800 1 -- 172.21.15.134:0/647356563 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557594b5e120 msgr2=0x557594c59060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:23.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.108+0000 7f720340e800 1 --2- 172.21.15.134:0/647356563 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557594b5e120 0x557594c59060 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f71f80447d0 tx=0x7f71f8003330 comp rx=0 tx=0).stop 2024-04-24T02:13:23.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.108+0000 7f720340e800 1 -- 172.21.15.134:0/647356563 shutdown_connections 2024-04-24T02:13:23.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.108+0000 7f720340e800 1 --2- 172.21.15.134:0/647356563 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x557594b61160 0x557594c60250 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.108+0000 7f720340e800 1 --2- 172.21.15.134:0/647356563 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f70e8036950 0x7f70e8038e10 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.108+0000 7f720340e800 1 --2- 172.21.15.134:0/647356563 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557594b5e120 0x557594c59060 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.108+0000 7f720340e800 1 -- 172.21.15.134:0/647356563 >> 172.21.15.134:0/647356563 conn(0x557594b59b20 msgr2=0x557594c4b780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:23.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.108+0000 7f720340e800 1 -- 172.21.15.134:0/647356563 shutdown_connections 2024-04-24T02:13:23.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.108+0000 7f720340e800 1 -- 172.21.15.134:0/647356563 wait complete. 2024-04-24T02:13:23.121 INFO:teuthology.orchestra.run.smithi134.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-04-24T02:00:00.000000Z","epoch":1713924000,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-04-24T02:00:00.000000Z","epoch":1713924000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}]},{"bucket":"myfoo2","time":"2024-04-24T02:00:00.000000Z","epoch":1713924000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-04-24T02:00:00.000000Z","epoch":1713924000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-04-24T02:00:00.000000Z","epoch":1713924000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}}]} 2024-04-24T02:13:23.121 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}]}, {'bucket': 'myfoo2', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}}]} 2024-04-24T02:13:23.122 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-04-24T02:13:23.122 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-04-24T02:13:23.122 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-04-24T02:13:23.172 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:13:23.172 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:13:23.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.173+0000 7f534cf27800 1 Processor -- start 2024-04-24T02:13:23.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.173+0000 7f534cf27800 1 -- start start 2024-04-24T02:13:23.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.173+0000 7f534cf27800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55c7d565c4f0 0x55c7d565e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:23.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.173+0000 7f534cf27800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c7d5516d40 con 0x55c7d56589e0 2024-04-24T02:13:23.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.173+0000 7f534cf27800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55c7d54e94d0 con 0x55c7d565c4f0 2024-04-24T02:13:23.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.173+0000 7f5343fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55c7d565c4f0 0x55c7d565e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:23.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.173+0000 7f5343fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55c7d565c4f0 0x55c7d565e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55450/0 (socket says 172.21.15.134:55450) 2024-04-24T02:13:23.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.173+0000 7f5343fff640 1 -- 172.21.15.134:0/240196043 learned_addr learned my addr 172.21.15.134:0/240196043 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:23.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.173+0000 7f5348ba7640 1 --1- 172.21.15.134:0/240196043 >> v1:172.21.15.104:6789/0 conn(0x55c7d56589e0 0x55c7d565add0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:57840/0 (socket says 172.21.15.134:57840) 2024-04-24T02:13:23.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.174+0000 7f5343fff640 1 -- 172.21.15.134:0/240196043 >> v1:172.21.15.104:6789/0 conn(0x55c7d56589e0 legacy=0x55c7d565add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:23.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.174+0000 7f53437fe640 1 -- 172.21.15.134:0/240196043 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3762195717 0 0) 0x55c7d5516d40 con 0x55c7d56589e0 2024-04-24T02:13:23.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.174+0000 7f5343fff640 1 -- 172.21.15.134:0/240196043 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7d5515590 con 0x55c7d565c4f0 2024-04-24T02:13:23.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.175+0000 7f5343fff640 1 --2- 172.21.15.134:0/240196043 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7d565c4f0 0x55c7d565e8e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f533400a520 tx=0x7f533401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b327b1b5196bc247 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:23.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.175+0000 7f53437fe640 1 -- 172.21.15.134:0/240196043 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5334057070 con 0x55c7d565c4f0 2024-04-24T02:13:23.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.176+0000 7f53437fe640 1 -- 172.21.15.134:0/240196043 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5334052570 con 0x55c7d565c4f0 2024-04-24T02:13:23.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.176+0000 7f53437fe640 1 -- 172.21.15.134:0/240196043 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f533404ae60 con 0x55c7d565c4f0 2024-04-24T02:13:23.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.176+0000 7f534cf27800 1 -- 172.21.15.134:0/240196043 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7d565c4f0 msgr2=0x55c7d565e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:23.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.176+0000 7f534cf27800 1 --2- 172.21.15.134:0/240196043 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7d565c4f0 0x55c7d565e8e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f533400a520 tx=0x7f533401d010 comp rx=0 tx=0).stop 2024-04-24T02:13:23.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.176+0000 7f534cf27800 1 -- 172.21.15.134:0/240196043 shutdown_connections 2024-04-24T02:13:23.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.176+0000 7f534cf27800 1 --2- 172.21.15.134:0/240196043 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7d565c4f0 0x55c7d565e8e0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.176+0000 7f534cf27800 1 -- 172.21.15.134:0/240196043 >> 172.21.15.134:0/240196043 conn(0x55c7d5652350 msgr2=0x55c7d5654770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:23.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.176+0000 7f534cf27800 1 -- 172.21.15.134:0/240196043 shutdown_connections 2024-04-24T02:13:23.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.176+0000 7f534cf27800 1 -- 172.21.15.134:0/240196043 wait complete. 2024-04-24T02:13:23.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.187+0000 7f534cf27800 1 Processor -- start 2024-04-24T02:13:23.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.188+0000 7f534cf27800 1 -- start start 2024-04-24T02:13:23.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.188+0000 7f534cf27800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7d56589e0 0x55c7d5658320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:23.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.188+0000 7f534cf27800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c7d55a33e0 con 0x55c7d56589e0 2024-04-24T02:13:23.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.188+0000 7f5348ba7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7d56589e0 0x55c7d5658320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:23.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.188+0000 7f5348ba7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7d56589e0 0x55c7d5658320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55452/0 (socket says 172.21.15.134:55452) 2024-04-24T02:13:23.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.188+0000 7f5348ba7640 1 -- 172.21.15.134:0/4042664921 learned_addr learned my addr 172.21.15.134:0/4042664921 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:23.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.188+0000 7f5348ba7640 1 -- 172.21.15.134:0/4042664921 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7d56568e0 con 0x55c7d56589e0 2024-04-24T02:13:23.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.189+0000 7f5348ba7640 1 --2- 172.21.15.134:0/4042664921 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7d56589e0 0x55c7d5658320 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f533c00b210 tx=0x7f533c00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=279c01fac81c6dd6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:23.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.189+0000 7f5236e05640 1 -- 172.21.15.134:0/4042664921 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f533c008070 con 0x55c7d56589e0 2024-04-24T02:13:23.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.189+0000 7f5236e05640 1 -- 172.21.15.134:0/4042664921 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f533c00d500 con 0x55c7d56589e0 2024-04-24T02:13:23.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.189+0000 7f5236e05640 1 -- 172.21.15.134:0/4042664921 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f533c00d840 con 0x55c7d56589e0 2024-04-24T02:13:23.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.189+0000 7f534cf27800 1 -- 172.21.15.134:0/4042664921 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7d56589e0 msgr2=0x55c7d5658320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:23.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.189+0000 7f534cf27800 1 --2- 172.21.15.134:0/4042664921 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7d56589e0 0x55c7d5658320 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f533c00b210 tx=0x7f533c00b6d0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.189+0000 7f534cf27800 1 -- 172.21.15.134:0/4042664921 shutdown_connections 2024-04-24T02:13:23.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.189+0000 7f534cf27800 1 --2- 172.21.15.134:0/4042664921 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7d56589e0 0x55c7d5658320 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.189+0000 7f534cf27800 1 -- 172.21.15.134:0/4042664921 >> 172.21.15.134:0/4042664921 conn(0x55c7d5652350 msgr2=0x55c7d5744890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:23.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.189+0000 7f534cf27800 1 -- 172.21.15.134:0/4042664921 shutdown_connections 2024-04-24T02:13:23.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.189+0000 7f534cf27800 1 -- 172.21.15.134:0/4042664921 wait complete. 2024-04-24T02:13:23.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.190+0000 7f534cf27800 1 Processor -- start 2024-04-24T02:13:23.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.190+0000 7f534cf27800 1 -- start start 2024-04-24T02:13:23.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.190+0000 7f534cf27800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7d56589e0 0x55c7d5752d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:23.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.190+0000 7f534cf27800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c7d5661130 con 0x55c7d56589e0 2024-04-24T02:13:23.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.190+0000 7f5348ba7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7d56589e0 0x55c7d5752d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:23.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.190+0000 7f5348ba7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7d56589e0 0x55c7d5752d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55460/0 (socket says 172.21.15.134:55460) 2024-04-24T02:13:23.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.190+0000 7f5348ba7640 1 -- 172.21.15.134:0/472402452 learned_addr learned my addr 172.21.15.134:0/472402452 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:23.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.190+0000 7f5348ba7640 1 -- 172.21.15.134:0/472402452 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7d57532a0 con 0x55c7d56589e0 2024-04-24T02:13:23.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.191+0000 7f5348ba7640 1 --2- 172.21.15.134:0/472402452 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7d56589e0 0x55c7d5752d60 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f533c00b210 tx=0x7f533c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:23.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.191+0000 7f5235602640 1 -- 172.21.15.134:0/472402452 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f533c00f950 con 0x55c7d56589e0 2024-04-24T02:13:23.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.191+0000 7f5235602640 1 -- 172.21.15.134:0/472402452 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f533c00faf0 con 0x55c7d56589e0 2024-04-24T02:13:23.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.191+0000 7f534cf27800 1 -- 172.21.15.134:0/472402452 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c7d5753530 con 0x55c7d56589e0 2024-04-24T02:13:23.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.191+0000 7f5235602640 1 -- 172.21.15.134:0/472402452 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f533c00fdd0 con 0x55c7d56589e0 2024-04-24T02:13:23.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.191+0000 7f534cf27800 1 -- 172.21.15.134:0/472402452 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7d57561e0 con 0x55c7d56589e0 2024-04-24T02:13:23.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.191+0000 7f5235602640 1 -- 172.21.15.134:0/472402452 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f533c017040 con 0x55c7d56589e0 2024-04-24T02:13:23.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.192+0000 7f5235602640 1 --2- 172.21.15.134:0/472402452 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f52300368b0 0x7f5230038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:23.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.192+0000 7f5235602640 1 -- 172.21.15.134:0/472402452 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f533c015020 con 0x55c7d56589e0 2024-04-24T02:13:23.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.192+0000 7f5343fff640 1 --2- 172.21.15.134:0/472402452 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f52300368b0 0x7f5230038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:23.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.192+0000 7f534cf27800 1 --2- 172.21.15.134:0/472402452 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c7d565c4f0 0x55c7d5759fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:23.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.192+0000 7f534cf27800 1 -- 172.21.15.134:0/472402452 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7d575a520 con 0x55c7d565c4f0 2024-04-24T02:13:23.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.192+0000 7f53493a8640 1 --2- 172.21.15.134:0/472402452 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c7d565c4f0 0x55c7d5759fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:23.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.192+0000 7f5343fff640 1 --2- 172.21.15.134:0/472402452 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f52300368b0 0x7f5230038d70 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5334054000 tx=0x7f533404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:23.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.192+0000 7f53493a8640 1 --2- 172.21.15.134:0/472402452 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c7d565c4f0 0x55c7d5759fa0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:23.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.193+0000 7f53493a8640 1 -- 172.21.15.134:0/472402452 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f534400a4a0 con 0x55c7d565c4f0 2024-04-24T02:13:23.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.193+0000 7f534cf27800 1 -- 172.21.15.134:0/472402452 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7d5757570 con 0x55c7d565c4f0 2024-04-24T02:13:23.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.193+0000 7f53493a8640 1 -- 172.21.15.134:0/472402452 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f534400a4a0 con 0x55c7d565c4f0 2024-04-24T02:13:23.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.193+0000 7f534cf27800 1 -- 172.21.15.134:0/472402452 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7d575c340 con 0x55c7d565c4f0 2024-04-24T02:13:23.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.193+0000 7f53493a8640 1 -- 172.21.15.134:0/472402452 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f534400a4a0 con 0x55c7d565c4f0 2024-04-24T02:13:23.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.193+0000 7f534cf27800 1 -- 172.21.15.134:0/472402452 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7d575b680 con 0x55c7d565c4f0 2024-04-24T02:13:23.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.193+0000 7f53493a8640 1 -- 172.21.15.134:0/472402452 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f534400a4a0 con 0x55c7d565c4f0 2024-04-24T02:13:23.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.193+0000 7f534cf27800 1 -- 172.21.15.134:0/472402452 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7d575bad0 con 0x55c7d565c4f0 2024-04-24T02:13:23.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.194+0000 7f53493a8640 1 -- 172.21.15.134:0/472402452 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f534400a4a0 con 0x55c7d565c4f0 2024-04-24T02:13:23.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.194+0000 7f534cf27800 1 Processor -- start 2024-04-24T02:13:23.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.194+0000 7f534cf27800 1 -- start start 2024-04-24T02:13:23.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.194+0000 7f534cf27800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7d576b130 0x55c7d576b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:23.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.194+0000 7f534cf27800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c7d55496b0 con 0x55c7d576b130 2024-04-24T02:13:23.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.194+0000 7f5343fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7d576b130 0x55c7d576b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:23.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.194+0000 7f5343fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7d576b130 0x55c7d576b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55466/0 (socket says 172.21.15.134:55466) 2024-04-24T02:13:23.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.194+0000 7f5343fff640 1 -- 172.21.15.134:0/2418742045 learned_addr learned my addr 172.21.15.134:0/2418742045 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:23.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.195+0000 7f5343fff640 1 -- 172.21.15.134:0/2418742045 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7d576ba90 con 0x55c7d576b130 2024-04-24T02:13:23.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.195+0000 7f5343fff640 1 --2- 172.21.15.134:0/2418742045 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7d576b130 0x55c7d576b550 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f5334055040 tx=0x7f5334002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:23.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.195+0000 7f522e7fc640 1 -- 172.21.15.134:0/2418742045 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5334057040 con 0x55c7d576b130 2024-04-24T02:13:23.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.195+0000 7f522e7fc640 1 -- 172.21.15.134:0/2418742045 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f533406d070 con 0x55c7d576b130 2024-04-24T02:13:23.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.195+0000 7f522e7fc640 1 -- 172.21.15.134:0/2418742045 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f533405d650 con 0x55c7d576b130 2024-04-24T02:13:23.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.195+0000 7f534cf27800 1 -- 172.21.15.134:0/2418742045 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c7d576c500 con 0x55c7d576b130 2024-04-24T02:13:23.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.195+0000 7f534cf27800 1 -- 172.21.15.134:0/2418742045 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7d576c9a0 con 0x55c7d576b130 2024-04-24T02:13:23.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.196+0000 7f522e7fc640 1 -- 172.21.15.134:0/2418742045 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5334067070 con 0x55c7d576b130 2024-04-24T02:13:23.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.196+0000 7f522e7fc640 1 --2- 172.21.15.134:0/2418742045 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5220036950 0x7f5220038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:23.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.196+0000 7f522e7fc640 1 -- 172.21.15.134:0/2418742045 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f533408f650 con 0x55c7d576b130 2024-04-24T02:13:23.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.196+0000 7f53493a8640 1 --2- 172.21.15.134:0/2418742045 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5220036950 0x7f5220038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:23.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.196+0000 7f534cf27800 1 Processor -- start 2024-04-24T02:13:23.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.196+0000 7f534cf27800 1 -- start start 2024-04-24T02:13:23.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.196+0000 7f53493a8640 1 --2- 172.21.15.134:0/2418742045 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5220036950 0x7f5220038e10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x55c7d575b1a0 tx=0x7f5344005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:23.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.197+0000 7f534cf27800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7d57783b0 0x55c7d57787d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:23.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.197+0000 7f534cf27800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c7d5656c60 con 0x55c7d57783b0 2024-04-24T02:13:23.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.197+0000 7f5343fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7d57783b0 0x55c7d57787d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:23.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.197+0000 7f5343fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7d57783b0 0x55c7d57787d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55476/0 (socket says 172.21.15.134:55476) 2024-04-24T02:13:23.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.197+0000 7f5343fff640 1 -- 172.21.15.134:0/1423449522 learned_addr learned my addr 172.21.15.134:0/1423449522 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:23.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.197+0000 7f5343fff640 1 -- 172.21.15.134:0/1423449522 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7d5778da0 con 0x55c7d57783b0 2024-04-24T02:13:23.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.197+0000 7f5343fff640 1 --2- 172.21.15.134:0/1423449522 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7d57783b0 0x55c7d57787d0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f533408da70 tx=0x7f5334067ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f52855408158c2e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:23.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.197+0000 7f521ffff640 1 -- 172.21.15.134:0/1423449522 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5334081070 con 0x55c7d57783b0 2024-04-24T02:13:23.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.197+0000 7f521ffff640 1 -- 172.21.15.134:0/1423449522 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f533405cc70 con 0x55c7d57783b0 2024-04-24T02:13:23.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.197+0000 7f521ffff640 1 -- 172.21.15.134:0/1423449522 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5334072910 con 0x55c7d57783b0 2024-04-24T02:13:23.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.198+0000 7f534cf27800 1 -- 172.21.15.134:0/1423449522 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7d57783b0 msgr2=0x55c7d57787d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:23.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.198+0000 7f534cf27800 1 --2- 172.21.15.134:0/1423449522 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7d57783b0 0x55c7d57787d0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f533408da70 tx=0x7f5334067ab0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.198+0000 7f534cf27800 1 -- 172.21.15.134:0/1423449522 shutdown_connections 2024-04-24T02:13:23.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.198+0000 7f534cf27800 1 --2- 172.21.15.134:0/1423449522 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7d57783b0 0x55c7d57787d0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.198+0000 7f534cf27800 1 -- 172.21.15.134:0/1423449522 >> 172.21.15.134:0/1423449522 conn(0x55c7d5774710 msgr2=0x55c7d5772770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:23.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.198+0000 7f534cf27800 1 -- 172.21.15.134:0/1423449522 shutdown_connections 2024-04-24T02:13:23.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.198+0000 7f534cf27800 1 -- 172.21.15.134:0/1423449522 wait complete. 2024-04-24T02:13:23.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.198+0000 7f534cf27800 1 Processor -- start 2024-04-24T02:13:23.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.198+0000 7f534cf27800 1 -- start start 2024-04-24T02:13:23.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.198+0000 7f534cf27800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7d57783b0 0x55c7d577fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:23.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.198+0000 7f534cf27800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c7d5779510 con 0x55c7d57783b0 2024-04-24T02:13:23.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.199+0000 7f5343fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7d57783b0 0x55c7d577fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:23.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.199+0000 7f5343fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7d57783b0 0x55c7d577fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55492/0 (socket says 172.21.15.134:55492) 2024-04-24T02:13:23.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.199+0000 7f5343fff640 1 -- 172.21.15.134:0/4125636990 learned_addr learned my addr 172.21.15.134:0/4125636990 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:23.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.199+0000 7f5343fff640 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7d577ffd0 con 0x55c7d57783b0 2024-04-24T02:13:23.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.199+0000 7f5343fff640 1 --2- 172.21.15.134:0/4125636990 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7d57783b0 0x55c7d577fa90 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f533408c990 tx=0x7f533408da00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:23.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.199+0000 7f521e7fc640 1 -- 172.21.15.134:0/4125636990 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5334081040 con 0x55c7d57783b0 2024-04-24T02:13:23.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.199+0000 7f521e7fc640 1 -- 172.21.15.134:0/4125636990 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5334094070 con 0x55c7d57783b0 2024-04-24T02:13:23.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.199+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c7d5780260 con 0x55c7d57783b0 2024-04-24T02:13:23.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.199+0000 7f521e7fc640 1 -- 172.21.15.134:0/4125636990 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f533408b040 con 0x55c7d57783b0 2024-04-24T02:13:23.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.199+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7d5782f10 con 0x55c7d57783b0 2024-04-24T02:13:23.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.200+0000 7f521e7fc640 1 -- 172.21.15.134:0/4125636990 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5334084070 con 0x55c7d57783b0 2024-04-24T02:13:23.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.200+0000 7f521e7fc640 1 --2- 172.21.15.134:0/4125636990 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5214036950 0x7f5214038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:23.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.200+0000 7f521e7fc640 1 -- 172.21.15.134:0/4125636990 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f53340610d0 con 0x55c7d57783b0 2024-04-24T02:13:23.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.200+0000 7f53493a8640 1 --2- 172.21.15.134:0/4125636990 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5214036950 0x7f5214038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:23.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.200+0000 7f53493a8640 1 --2- 172.21.15.134:0/4125636990 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5214036950 0x7f5214038e10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x55c7d57574c0 tx=0x7f534401f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:23.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.200+0000 7f534cf27800 20 rados->read ofs=0 len=0 2024-04-24T02:13:23.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.201+0000 7f534cf27800 1 --2- 172.21.15.134:0/4125636990 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c7d578b5c0 0x55c7d578da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:23.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.201+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7d578e1d0 con 0x55c7d578b5c0 2024-04-24T02:13:23.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.201+0000 7f5348ba7640 1 --2- 172.21.15.134:0/4125636990 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c7d578b5c0 0x55c7d578da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:23.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.201+0000 7f5348ba7640 1 --2- 172.21.15.134:0/4125636990 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c7d578b5c0 0x55c7d578da80 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:23.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.201+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f533c02d070 con 0x55c7d578b5c0 2024-04-24T02:13:23.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.201+0000 7f534cf27800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:23.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.201+0000 7f534cf27800 20 realm 2024-04-24T02:13:23.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.201+0000 7f534cf27800 20 rados->read ofs=0 len=0 2024-04-24T02:13:23.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.201+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7d578e5e0 con 0x55c7d578b5c0 2024-04-24T02:13:23.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.201+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f533c02d070 con 0x55c7d578b5c0 2024-04-24T02:13:23.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.201+0000 7f534cf27800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:23.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.201+0000 7f534cf27800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:13:23.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.201+0000 7f534cf27800 20 rados->read ofs=0 len=0 2024-04-24T02:13:23.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.201+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7d578eeb0 con 0x55c7d578b5c0 2024-04-24T02:13:23.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.201+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f533c02d070 con 0x55c7d578b5c0 2024-04-24T02:13:23.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.201+0000 7f534cf27800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:23.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.201+0000 7f534cf27800 20 rados->read ofs=0 len=0 2024-04-24T02:13:23.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.201+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7d578f250 con 0x55c7d578b5c0 2024-04-24T02:13:23.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.202+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f533c02d070 con 0x55c7d578b5c0 2024-04-24T02:13:23.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.202+0000 7f534cf27800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:13:23.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.202+0000 7f534cf27800 20 rados->read ofs=0 len=0 2024-04-24T02:13:23.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.202+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7d578faa0 con 0x55c7d578b5c0 2024-04-24T02:13:23.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.202+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f533c02d070 con 0x55c7d578b5c0 2024-04-24T02:13:23.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.202+0000 7f534cf27800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:13:23.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.202+0000 7f534cf27800 20 searching for the correct realm 2024-04-24T02:13:23.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.202+0000 7f534cf27800 1 --2- 172.21.15.134:0/4125636990 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55c7d5791810 0x55c7d5793c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:23.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.202+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7d57941c0 con 0x55c7d5791810 2024-04-24T02:13:23.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.202+0000 7f5343fff640 1 --2- 172.21.15.134:0/4125636990 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55c7d5791810 0x55c7d5793c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:23.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.202+0000 7f5343fff640 1 --2- 172.21.15.134:0/4125636990 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55c7d5791810 0x55c7d5793c00 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:23.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.203+0000 7f5343fff640 1 -- 172.21.15.134:0/4125636990 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5334066030 con 0x55c7d5791810 2024-04-24T02:13:23.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.203+0000 7f5343fff640 1 --2- 172.21.15.134:0/4125636990 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f53340065b0 0x7f533408f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:23.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.203+0000 7f5343fff640 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7d57941c0 con 0x7f53340065b0 2024-04-24T02:13:23.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.203+0000 7f53493a8640 1 --2- 172.21.15.134:0/4125636990 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f53340065b0 0x7f533408f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:23.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.203+0000 7f53493a8640 1 --2- 172.21.15.134:0/4125636990 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f53340065b0 0x7f533408f8a0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:23.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.203+0000 7f53493a8640 1 -- 172.21.15.134:0/4125636990 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f534401f070 con 0x7f53340065b0 2024-04-24T02:13:23.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.203+0000 7f53493a8640 1 --2- 172.21.15.134:0/4125636990 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f5344031040 0x7f5344032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:23.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.203+0000 7f53493a8640 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7d57941c0 con 0x7f5344031040 2024-04-24T02:13:23.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.204+0000 7f5348ba7640 1 --2- 172.21.15.134:0/4125636990 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f5344031040 0x7f5344032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:23.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.204+0000 7f5348ba7640 1 --2- 172.21.15.134:0/4125636990 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f5344031040 0x7f5344032940 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:23.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.204+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f533c02d070 con 0x7f5344031040 2024-04-24T02:13:23.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.204+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7d57941c0 con 0x55c7d578b5c0 2024-04-24T02:13:23.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.204+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f533c02d070 con 0x55c7d578b5c0 2024-04-24T02:13:23.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.204+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7d57941c0 con 0x55c7d578b5c0 2024-04-24T02:13:23.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.204+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f533c02d070 con 0x55c7d578b5c0 2024-04-24T02:13:23.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.204+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7d57941c0 con 0x7f5344031040 2024-04-24T02:13:23.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.205+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f533c02d070 con 0x7f5344031040 2024-04-24T02:13:23.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.205+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7d57941c0 con 0x7f53340065b0 2024-04-24T02:13:23.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.205+0000 7f53493a8640 1 -- 172.21.15.134:0/4125636990 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f534401f070 con 0x7f53340065b0 2024-04-24T02:13:23.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.205+0000 7f53493a8640 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7d57941c0 con 0x7f53340065b0 2024-04-24T02:13:23.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.205+0000 7f53493a8640 1 -- 172.21.15.134:0/4125636990 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f534401f070 con 0x7f53340065b0 2024-04-24T02:13:23.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.205+0000 7f53493a8640 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7d57941c0 con 0x55c7d5791810 2024-04-24T02:13:23.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.205+0000 7f5343fff640 1 -- 172.21.15.134:0/4125636990 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5334066030 con 0x55c7d5791810 2024-04-24T02:13:23.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.205+0000 7f5343fff640 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7d57941c0 con 0x55c7d578b5c0 2024-04-24T02:13:23.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.206+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f533c02d070 con 0x55c7d578b5c0 2024-04-24T02:13:23.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.206+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7d57941c0 con 0x7f5344031040 2024-04-24T02:13:23.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.206+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f533c02d070 con 0x7f5344031040 2024-04-24T02:13:23.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.206+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7d57941c0 con 0x55c7d578b5c0 2024-04-24T02:13:23.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.206+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f533c02d070 con 0x55c7d578b5c0 2024-04-24T02:13:23.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.206+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7d57941c0 con 0x7f53340065b0 2024-04-24T02:13:23.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.206+0000 7f53493a8640 1 -- 172.21.15.134:0/4125636990 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f534401f070 con 0x7f53340065b0 2024-04-24T02:13:23.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.206+0000 7f53493a8640 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7d57941c0 con 0x55c7d5791810 2024-04-24T02:13:23.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.207+0000 7f5343fff640 1 -- 172.21.15.134:0/4125636990 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5334066030 con 0x55c7d5791810 2024-04-24T02:13:23.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.207+0000 7f5343fff640 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7d57941c0 con 0x55c7d5791810 2024-04-24T02:13:23.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.207+0000 7f5343fff640 1 -- 172.21.15.134:0/4125636990 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5334066030 con 0x55c7d5791810 2024-04-24T02:13:23.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.207+0000 7f5343fff640 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7d57941c0 con 0x7f53340065b0 2024-04-24T02:13:23.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.207+0000 7f53493a8640 1 -- 172.21.15.134:0/4125636990 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f534401f070 con 0x7f53340065b0 2024-04-24T02:13:23.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.207+0000 7f53493a8640 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7d57941c0 con 0x55c7d5791810 2024-04-24T02:13:23.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.207+0000 7f5343fff640 1 -- 172.21.15.134:0/4125636990 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5334066030 con 0x55c7d5791810 2024-04-24T02:13:23.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.207+0000 7f5343fff640 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7d57941c0 con 0x55c7d5791810 2024-04-24T02:13:23.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.207+0000 7f5343fff640 1 -- 172.21.15.134:0/4125636990 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5334066030 con 0x55c7d5791810 2024-04-24T02:13:23.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.207+0000 7f5343fff640 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7d57941c0 con 0x55c7d578b5c0 2024-04-24T02:13:23.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.208+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f533c02d070 con 0x55c7d578b5c0 2024-04-24T02:13:23.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.208+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7d57941c0 con 0x55c7d578b5c0 2024-04-24T02:13:23.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.208+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f533c02d070 con 0x55c7d578b5c0 2024-04-24T02:13:23.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.208+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7d57941c0 con 0x7f5344031040 2024-04-24T02:13:23.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.208+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f533c02d070 con 0x7f5344031040 2024-04-24T02:13:23.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.208+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7d57941c0 con 0x55c7d5791810 2024-04-24T02:13:23.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.209+0000 7f5343fff640 1 -- 172.21.15.134:0/4125636990 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5334066030 con 0x55c7d5791810 2024-04-24T02:13:23.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.209+0000 7f5343fff640 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7d57941c0 con 0x7f53340065b0 2024-04-24T02:13:23.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.209+0000 7f53493a8640 1 -- 172.21.15.134:0/4125636990 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f534401f070 con 0x7f53340065b0 2024-04-24T02:13:23.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.209+0000 7f53493a8640 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7d57941c0 con 0x55c7d578b5c0 2024-04-24T02:13:23.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.209+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f533c02d070 con 0x55c7d578b5c0 2024-04-24T02:13:23.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.209+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7d57941c0 con 0x7f5344031040 2024-04-24T02:13:23.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.209+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f533c02d070 con 0x7f5344031040 2024-04-24T02:13:23.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.209+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7d57941c0 con 0x55c7d5791810 2024-04-24T02:13:23.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.210+0000 7f5343fff640 1 -- 172.21.15.134:0/4125636990 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5334066030 con 0x55c7d5791810 2024-04-24T02:13:23.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.210+0000 7f5343fff640 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7d57941c0 con 0x7f5344031040 2024-04-24T02:13:23.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.210+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f533c02d070 con 0x7f5344031040 2024-04-24T02:13:23.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.210+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7d57941c0 con 0x7f53340065b0 2024-04-24T02:13:23.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.210+0000 7f53493a8640 1 -- 172.21.15.134:0/4125636990 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5344040040 con 0x7f53340065b0 2024-04-24T02:13:23.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.210+0000 7f53493a8640 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7d57941c0 con 0x55c7d5791810 2024-04-24T02:13:23.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.210+0000 7f5343fff640 1 -- 172.21.15.134:0/4125636990 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5334066030 con 0x55c7d5791810 2024-04-24T02:13:23.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.210+0000 7f5343fff640 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7d57941c0 con 0x7f53340065b0 2024-04-24T02:13:23.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.210+0000 7f53493a8640 1 -- 172.21.15.134:0/4125636990 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5344040040 con 0x7f53340065b0 2024-04-24T02:13:23.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.210+0000 7f53493a8640 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7d57941c0 con 0x55c7d578b5c0 2024-04-24T02:13:23.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.211+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f533c02d070 con 0x55c7d578b5c0 2024-04-24T02:13:23.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.211+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7d57941c0 con 0x7f53340065b0 2024-04-24T02:13:23.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.211+0000 7f53493a8640 1 -- 172.21.15.134:0/4125636990 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5344040040 con 0x7f53340065b0 2024-04-24T02:13:23.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.211+0000 7f534cf27800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:13:23.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.211+0000 7f534cf27800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:13:23.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.211+0000 7f534cf27800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:13:23.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.211+0000 7f534cf27800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:13:23.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.211+0000 7f534cf27800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:13:23.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.211+0000 7f534cf27800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:13:23.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.211+0000 7f534cf27800 20 rados->read ofs=0 len=0 2024-04-24T02:13:23.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.211+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7d5790450 con 0x55c7d578b5c0 2024-04-24T02:13:23.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.211+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f533c02d070 con 0x55c7d578b5c0 2024-04-24T02:13:23.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.211+0000 7f534cf27800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:23.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.211+0000 7f534cf27800 20 rados->read ofs=0 len=0 2024-04-24T02:13:23.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.211+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7d5790cf0 con 0x55c7d578b5c0 2024-04-24T02:13:23.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.211+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f533c02d070 con 0x55c7d578b5c0 2024-04-24T02:13:23.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.211+0000 7f534cf27800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:13:23.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.211+0000 7f534cf27800 20 rados->read ofs=0 len=0 2024-04-24T02:13:23.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.211+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7d5794640 con 0x55c7d578b5c0 2024-04-24T02:13:23.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.212+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f533c02d070 con 0x55c7d578b5c0 2024-04-24T02:13:23.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.212+0000 7f534cf27800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:13:23.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.212+0000 7f534cf27800 20 zone default found 2024-04-24T02:13:23.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.212+0000 7f534cf27800 4 Realm: () 2024-04-24T02:13:23.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.212+0000 7f534cf27800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:13:23.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.212+0000 7f534cf27800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:13:23.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.212+0000 7f534cf27800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:13:23.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.212+0000 7f534cf27800 20 zonegroup default 2024-04-24T02:13:23.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.212+0000 7f534cf27800 20 rados->read ofs=0 len=0 2024-04-24T02:13:23.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.212+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7d5794af0 con 0x7f5344031040 2024-04-24T02:13:23.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.212+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f533c02d070 con 0x7f5344031040 2024-04-24T02:13:23.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.212+0000 7f534cf27800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:23.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.212+0000 7f534cf27800 20 rados->read ofs=0 len=0 2024-04-24T02:13:23.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.212+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7d57964d0 con 0x55c7d5791810 2024-04-24T02:13:23.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.212+0000 7f5343fff640 1 -- 172.21.15.134:0/4125636990 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5334066030 con 0x55c7d5791810 2024-04-24T02:13:23.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.212+0000 7f534cf27800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:23.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.212+0000 7f534cf27800 20 rados->read ofs=0 len=0 2024-04-24T02:13:23.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.212+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7d57969c0 con 0x55c7d5791810 2024-04-24T02:13:23.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.213+0000 7f5343fff640 1 -- 172.21.15.134:0/4125636990 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5334066030 con 0x55c7d5791810 2024-04-24T02:13:23.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.213+0000 7f534cf27800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:23.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.213+0000 7f534cf27800 20 started sync module instance, tier type = 2024-04-24T02:13:23.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.213+0000 7f534cf27800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:13:23.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.213+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7d5795960 con 0x7f53340065b0 2024-04-24T02:13:23.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.214+0000 7f53493a8640 1 -- 172.21.15.134:0/4125636990 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(44 notify.0 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5344040040 con 0x7f53340065b0 2024-04-24T02:13:23.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.214+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94316768353616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7d57955c0 con 0x7f53340065b0 2024-04-24T02:13:23.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.214+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7d57978f0 con 0x55c7d578b5c0 2024-04-24T02:13:23.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.215+0000 7f53493a8640 1 -- 172.21.15.134:0/4125636990 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94316768353616] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5344040040 con 0x7f53340065b0 2024-04-24T02:13:23.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.215+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f533c02d070 con 0x55c7d578b5c0 2024-04-24T02:13:23.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.215+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94316768357920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7d57978f0 con 0x55c7d578b5c0 2024-04-24T02:13:23.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.215+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7d57982b0 con 0x55c7d5791810 2024-04-24T02:13:23.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.216+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94316768357920] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f533c02d070 con 0x55c7d578b5c0 2024-04-24T02:13:23.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.216+0000 7f5343fff640 1 -- 172.21.15.134:0/4125636990 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5334066030 con 0x55c7d5791810 2024-04-24T02:13:23.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.216+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94316768359488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7d5797860 con 0x55c7d5791810 2024-04-24T02:13:23.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.216+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7d5799070 con 0x7f53340065b0 2024-04-24T02:13:23.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.217+0000 7f53493a8640 1 -- 172.21.15.134:0/4125636990 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(50 notify.3 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5344040040 con 0x7f53340065b0 2024-04-24T02:13:23.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.217+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94316768365392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7d5799910 con 0x7f53340065b0 2024-04-24T02:13:23.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.217+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7d579a3d0 con 0x55c7d578b5c0 2024-04-24T02:13:23.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.217+0000 7f5343fff640 1 -- 172.21.15.134:0/4125636990 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94316768359488] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5334066030 con 0x55c7d5791810 2024-04-24T02:13:23.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.218+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f533c02d070 con 0x55c7d578b5c0 2024-04-24T02:13:23.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.218+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94316768370336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7d579a390 con 0x55c7d578b5c0 2024-04-24T02:13:23.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.218+0000 7f53493a8640 1 -- 172.21.15.134:0/4125636990 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94316768365392] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5344040040 con 0x7f53340065b0 2024-04-24T02:13:23.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.218+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7d579a930 con 0x7f5344031040 2024-04-24T02:13:23.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.219+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94316768370336] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f533c02d070 con 0x55c7d578b5c0 2024-04-24T02:13:23.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.219+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(54 notify.5 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f533c02d070 con 0x7f5344031040 2024-04-24T02:13:23.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.219+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94316768367712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7d579a930 con 0x7f5344031040 2024-04-24T02:13:23.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.219+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7d579b340 con 0x7f5344031040 2024-04-24T02:13:23.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.220+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94316768367712] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f533c02d070 con 0x7f5344031040 2024-04-24T02:13:23.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.221+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(56 notify.6 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f533c02d070 con 0x7f5344031040 2024-04-24T02:13:23.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.221+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94316768364192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7d579b340 con 0x7f5344031040 2024-04-24T02:13:23.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.221+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7d579bd00 con 0x7f5344031040 2024-04-24T02:13:23.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.222+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(58 notify.7 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f533c02d070 con 0x7f5344031040 2024-04-24T02:13:23.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.222+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94316768376912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7d579c120 con 0x7f5344031040 2024-04-24T02:13:23.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.222+0000 7f534cf27800 20 add_watcher() i=0 2024-04-24T02:13:23.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.222+0000 7f534cf27800 20 add_watcher() i=1 2024-04-24T02:13:23.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.222+0000 7f534cf27800 20 add_watcher() i=2 2024-04-24T02:13:23.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.222+0000 7f534cf27800 20 add_watcher() i=3 2024-04-24T02:13:23.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.222+0000 7f534cf27800 20 add_watcher() i=4 2024-04-24T02:13:23.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.222+0000 7f534cf27800 20 add_watcher() i=5 2024-04-24T02:13:23.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.222+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94316768364192] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f533c02d070 con 0x7f5344031040 2024-04-24T02:13:23.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.222+0000 7f534cf27800 20 add_watcher() i=6 2024-04-24T02:13:23.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.222+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94316768376912] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f533c02d070 con 0x7f5344031040 2024-04-24T02:13:23.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.222+0000 7f534cf27800 20 add_watcher() i=7 2024-04-24T02:13:23.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.222+0000 7f534cf27800 2 all 8 watchers are set, enabling cache 2024-04-24T02:13:23.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.222+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7d579c120 con 0x55c7d578b5c0 2024-04-24T02:13:23.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.223+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f533c02d070 con 0x55c7d578b5c0 2024-04-24T02:13:23.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.223+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94316768377968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7d579c090 con 0x55c7d578b5c0 2024-04-24T02:13:23.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.224+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94316768377968] v32'217 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f533c02d070 con 0x55c7d578b5c0 2024-04-24T02:13:23.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.224+0000 7f51fefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:13:23.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.224+0000 7f534cf27800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:13:23.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.224+0000 7f534cf27800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:13:23.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.224+0000 7f534cf27800 5 note: GC not initialized 2024-04-24T02:13:23.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.224+0000 7f51fdfe3640 20 reqs_thread_entry: start 2024-04-24T02:13:23.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.224+0000 7f534cf27800 20 init_complete bucket index max shards: 11 2024-04-24T02:13:23.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.224+0000 7f534cf27800 20 Filter name: none 2024-04-24T02:13:23.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.224+0000 7f516f7fe640 20 reqs_thread_entry: start 2024-04-24T02:13:23.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.225+0000 7f534cf27800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-04-24T02:13:23.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.225+0000 7f534cf27800 20 rados->read ofs=0 len=0 2024-04-24T02:13:23.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.225+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7d57d2400 con 0x7f5344031040 2024-04-24T02:13:23.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.225+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f533c02d070 con 0x7f5344031040 2024-04-24T02:13:23.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.225+0000 7f534cf27800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:23.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.225+0000 7f534cf27800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-04-24T02:13:23.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.225+0000 7f534cf27800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-04-24T02:13:23.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.225+0000 7f534cf27800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-04-24T02:13:23.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.225+0000 7f534cf27800 20 rados->read ofs=0 len=0 2024-04-24T02:13:23.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.225+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7d57d0ba0 con 0x55c7d578b5c0 2024-04-24T02:13:23.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.225+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f533c02d070 con 0x55c7d578b5c0 2024-04-24T02:13:23.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.225+0000 7f534cf27800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:23.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.225+0000 7f534cf27800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-04-24T02:13:23.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.225+0000 7f534cf27800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-04-24T02:13:23.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.225+0000 7f534cf27800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-04-24T02:13:23.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.225+0000 7f534cf27800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-04-24T02:13:23.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.225+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7d57d1470 con 0x7f5344031040 2024-04-24T02:13:23.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.226+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~380] v32'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f533c02d070 con 0x7f5344031040 2024-04-24T02:13:23.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.226+0000 7f534cf27800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-04-24T02:13:23.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.226+0000 7f534cf27800 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-04-24T02:13:23.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.226+0000 7f534cf27800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-04-24T02:13:23.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.226+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 94316768595904 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7d57d5ea0 con 0x7f5344031040 2024-04-24T02:13:23.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.227+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== watch-notify(notify (1) cookie 94316768376912 notify 137438953503 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55c7d57d1810 con 0x7f5344031040 2024-04-24T02:13:23.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.227+0000 7f521ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953503 cookie 94316768376912 notifier 4718 bl.length()=556 2024-04-24T02:13:23.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.227+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(65 notify.7 [notify cookie 94316768595904 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f533c02d070 con 0x7f5344031040 2024-04-24T02:13:23.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.227+0000 7f521ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-04-24T02:13:23.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.227+0000 7f521ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-04-24T02:13:23.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.227+0000 7f521ffff640 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f520c003ea0 con 0x7f5344031040 2024-04-24T02:13:23.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.227+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f533c02d070 con 0x7f5344031040 2024-04-24T02:13:23.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.227+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== watch-notify(notify_complete (2) cookie 94316768595904 notify 137438953503 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c7d57d1e50 con 0x7f5344031040 2024-04-24T02:13:23.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.227+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7d57d39d0 con 0x55c7d578b5c0 2024-04-24T02:13:23.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.228+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f533c02d070 con 0x55c7d578b5c0 2024-04-24T02:13:23.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.228+0000 7f534cf27800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-04-24T02:13:23.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.228+0000 7f534cf27800 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-04-24T02:13:23.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.228+0000 7f534cf27800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-04-24T02:13:23.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.228+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94316768595776 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7d57d5ea0 con 0x7f5344031040 2024-04-24T02:13:23.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.228+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.0 v2:172.21.15.104:6800/2419146313 20 ==== watch-notify(notify (1) cookie 94316768367712 notify 137438953504 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55c7d57d1e50 con 0x7f5344031040 2024-04-24T02:13:23.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.228+0000 7f521ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953504 cookie 94316768367712 notifier 4718 bl.length()=177 2024-04-24T02:13:23.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.228+0000 7f521ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-04-24T02:13:23.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.228+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.0 v2:172.21.15.104:6800/2419146313 21 ==== osd_op_reply(68 notify.5 [notify cookie 94316768595776 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f533c02d070 con 0x7f5344031040 2024-04-24T02:13:23.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.228+0000 7f521ffff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-04-24T02:13:23.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.228+0000 7f521ffff640 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f520c003ea0 con 0x7f5344031040 2024-04-24T02:13:23.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.229+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.0 v2:172.21.15.104:6800/2419146313 22 ==== watch-notify(notify_complete (2) cookie 94316768595776 notify 137438953504 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c7d57561e0 con 0x7f5344031040 2024-04-24T02:13:23.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.229+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.0 v2:172.21.15.104:6800/2419146313 23 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f533c02d070 con 0x7f5344031040 2024-04-24T02:13:23.246 INFO:teuthology.orchestra.run.smithi134.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-04-24T02:13:23.225943Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T02:13:23.225928Z","tags":[],"group_ids":[]} 2024-04-24T02:13:23.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.229+0000 7f51fefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:13:23.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.229+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94316768377968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7d57879f0 con 0x55c7d578b5c0 2024-04-24T02:13:23.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.231+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94316768377968] v32'218 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f533c02d070 con 0x55c7d578b5c0 2024-04-24T02:13:23.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.231+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94316768353616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7d579bc70 con 0x7f53340065b0 2024-04-24T02:13:23.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.232+0000 7f53493a8640 1 -- 172.21.15.134:0/4125636990 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94316768353616] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5344040040 con 0x7f53340065b0 2024-04-24T02:13:23.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.232+0000 7f534cf27800 20 remove_watcher() i=0 2024-04-24T02:13:23.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.232+0000 7f534cf27800 2 removed watcher, disabling cache 2024-04-24T02:13:23.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.232+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94316768357920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7d579bc70 con 0x55c7d578b5c0 2024-04-24T02:13:23.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.233+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94316768357920] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f533c02d070 con 0x55c7d578b5c0 2024-04-24T02:13:23.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.233+0000 7f534cf27800 20 remove_watcher() i=1 2024-04-24T02:13:23.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.233+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94316768359488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7d5796e20 con 0x55c7d5791810 2024-04-24T02:13:23.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.234+0000 7f5343fff640 1 -- 172.21.15.134:0/4125636990 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94316768359488] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5334066030 con 0x55c7d5791810 2024-04-24T02:13:23.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.234+0000 7f534cf27800 20 remove_watcher() i=2 2024-04-24T02:13:23.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.234+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94316768365392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7d579bc70 con 0x7f53340065b0 2024-04-24T02:13:23.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.235+0000 7f53493a8640 1 -- 172.21.15.134:0/4125636990 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94316768365392] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5344040040 con 0x7f53340065b0 2024-04-24T02:13:23.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.235+0000 7f534cf27800 20 remove_watcher() i=3 2024-04-24T02:13:23.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.235+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94316768370336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7d5797440 con 0x55c7d578b5c0 2024-04-24T02:13:23.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.236+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94316768370336] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f533c02d070 con 0x55c7d578b5c0 2024-04-24T02:13:23.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.236+0000 7f534cf27800 20 remove_watcher() i=4 2024-04-24T02:13:23.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.236+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94316768367712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7d579bc70 con 0x7f5344031040 2024-04-24T02:13:23.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.237+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.0 v2:172.21.15.104:6800/2419146313 24 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94316768367712] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f533c02d070 con 0x7f5344031040 2024-04-24T02:13:23.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.237+0000 7f534cf27800 20 remove_watcher() i=5 2024-04-24T02:13:23.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.237+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94316768364192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7d5797440 con 0x7f5344031040 2024-04-24T02:13:23.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.238+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.0 v2:172.21.15.104:6800/2419146313 25 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94316768364192] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f533c02d070 con 0x7f5344031040 2024-04-24T02:13:23.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.238+0000 7f534cf27800 20 remove_watcher() i=6 2024-04-24T02:13:23.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.238+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94316768376912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7d579bc70 con 0x7f5344031040 2024-04-24T02:13:23.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.239+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 <== osd.0 v2:172.21.15.104:6800/2419146313 26 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94316768376912] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f533c02d070 con 0x7f5344031040 2024-04-24T02:13:23.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.239+0000 7f534cf27800 20 remove_watcher() i=7 2024-04-24T02:13:23.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.239+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f5344031040 msgr2=0x7f5344032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:23.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.239+0000 7f534cf27800 1 --2- 172.21.15.134:0/4125636990 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f5344031040 0x7f5344032940 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.239+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c7d578b5c0 msgr2=0x55c7d578da80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:23.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.239+0000 7f534cf27800 1 --2- 172.21.15.134:0/4125636990 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c7d578b5c0 0x55c7d578da80 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.239+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f53340065b0 msgr2=0x7f533408f8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:23.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.239+0000 7f534cf27800 1 --2- 172.21.15.134:0/4125636990 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f53340065b0 0x7f533408f8a0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.239+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55c7d5791810 msgr2=0x55c7d5793c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:23.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.239+0000 7f534cf27800 1 --2- 172.21.15.134:0/4125636990 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55c7d5791810 0x55c7d5793c00 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.239+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5214036950 msgr2=0x7f5214038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:23.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.239+0000 7f534cf27800 1 --2- 172.21.15.134:0/4125636990 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5214036950 0x7f5214038e10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x55c7d57574c0 tx=0x7f534401f000 comp rx=0 tx=0).stop 2024-04-24T02:13:23.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.239+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7d57783b0 msgr2=0x55c7d577fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:23.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.239+0000 7f5348ba7640 1 -- 172.21.15.134:0/4125636990 reap_dead start 2024-04-24T02:13:23.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.239+0000 7f534cf27800 1 --2- 172.21.15.134:0/4125636990 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7d57783b0 0x55c7d577fa90 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f533408c990 tx=0x7f533408da00 comp rx=0 tx=0).stop 2024-04-24T02:13:23.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.239+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 shutdown_connections 2024-04-24T02:13:23.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.239+0000 7f534cf27800 1 --2- 172.21.15.134:0/4125636990 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7d57783b0 0x55c7d577fa90 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.240+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 >> 172.21.15.134:0/4125636990 conn(0x55c7d5774710 msgr2=0x55c7d5771d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:23.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.240+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 shutdown_connections 2024-04-24T02:13:23.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.240+0000 7f534cf27800 1 -- 172.21.15.134:0/4125636990 wait complete. 2024-04-24T02:13:23.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.240+0000 7f534cf27800 1 -- 172.21.15.134:0/2418742045 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5220036950 msgr2=0x7f5220038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:23.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.240+0000 7f534cf27800 1 --2- 172.21.15.134:0/2418742045 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5220036950 0x7f5220038e10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x55c7d575b1a0 tx=0x7f5344005840 comp rx=0 tx=0).stop 2024-04-24T02:13:23.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.240+0000 7f534cf27800 1 -- 172.21.15.134:0/2418742045 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7d576b130 msgr2=0x55c7d576b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:23.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.240+0000 7f534cf27800 1 --2- 172.21.15.134:0/2418742045 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7d576b130 0x55c7d576b550 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f5334055040 tx=0x7f5334002fb0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.240+0000 7f534cf27800 1 -- 172.21.15.134:0/2418742045 shutdown_connections 2024-04-24T02:13:23.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.240+0000 7f534cf27800 1 --2- 172.21.15.134:0/2418742045 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5220036950 0x7f5220038e10 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.240+0000 7f534cf27800 1 --2- 172.21.15.134:0/2418742045 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7d576b130 0x55c7d576b550 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.240+0000 7f534cf27800 1 -- 172.21.15.134:0/2418742045 >> 172.21.15.134:0/2418742045 conn(0x55c7d575f1d0 msgr2=0x55c7d575f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:23.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.240+0000 7f534cf27800 1 -- 172.21.15.134:0/2418742045 shutdown_connections 2024-04-24T02:13:23.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.240+0000 7f534cf27800 1 -- 172.21.15.134:0/2418742045 wait complete. 2024-04-24T02:13:23.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.240+0000 7f534cf27800 1 -- 172.21.15.134:0/472402452 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c7d565c4f0 msgr2=0x55c7d5759fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:23.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.240+0000 7f534cf27800 1 --2- 172.21.15.134:0/472402452 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c7d565c4f0 0x55c7d5759fa0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.240+0000 7f534cf27800 1 -- 172.21.15.134:0/472402452 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f52300368b0 msgr2=0x7f5230038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:23.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.240+0000 7f534cf27800 1 --2- 172.21.15.134:0/472402452 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f52300368b0 0x7f5230038d70 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5334054000 tx=0x7f533404e000 comp rx=0 tx=0).stop 2024-04-24T02:13:23.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.240+0000 7f534cf27800 1 -- 172.21.15.134:0/472402452 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7d56589e0 msgr2=0x55c7d5752d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:23.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.240+0000 7f534cf27800 1 --2- 172.21.15.134:0/472402452 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7d56589e0 0x55c7d5752d60 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f533c00b210 tx=0x7f533c000ed0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.240+0000 7f534cf27800 1 -- 172.21.15.134:0/472402452 shutdown_connections 2024-04-24T02:13:23.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.240+0000 7f534cf27800 1 --2- 172.21.15.134:0/472402452 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c7d565c4f0 0x55c7d5759fa0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.240+0000 7f534cf27800 1 --2- 172.21.15.134:0/472402452 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f52300368b0 0x7f5230038d70 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.240+0000 7f534cf27800 1 --2- 172.21.15.134:0/472402452 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7d56589e0 0x55c7d5752d60 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.240+0000 7f534cf27800 1 -- 172.21.15.134:0/472402452 >> 172.21.15.134:0/472402452 conn(0x55c7d5652350 msgr2=0x55c7d56571c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:23.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.240+0000 7f534cf27800 1 -- 172.21.15.134:0/472402452 shutdown_connections 2024-04-24T02:13:23.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.240+0000 7f534cf27800 1 -- 172.21.15.134:0/472402452 wait complete. 2024-04-24T02:13:23.257 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-04-24T02:13:23.225943Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:13:23.225928Z', 'tags': [], 'group_ids': []} 2024-04-24T02:13:23.271 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-04-24T02:13:23.276 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-04-24T02:13:23.276 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-04-24T02:13:23.276 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-04-24T02:13:23.276 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-04-24T02:13:23.323 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:13:23.323 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:13:23.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.324+0000 7fa60fe12800 1 Processor -- start 2024-04-24T02:13:23.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.324+0000 7fa60fe12800 1 -- start start 2024-04-24T02:13:23.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.324+0000 7fa60fe12800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55c7fbc226c0 0x55c7fbc24af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:23.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.324+0000 7fa60fe12800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c7fbae2d40 con 0x55c7fbc25030 2024-04-24T02:13:23.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.324+0000 7fa60fe12800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55c7fbab54d0 con 0x55c7fbc226c0 2024-04-24T02:13:23.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.324+0000 7fa60b3ee640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55c7fbc226c0 0x55c7fbc24af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:23.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.324+0000 7fa602bed640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55c7fbc25030 0x55c7fbc274f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:57850/0 (socket says 172.21.15.134:57850) 2024-04-24T02:13:23.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.324+0000 7fa60b3ee640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55c7fbc226c0 0x55c7fbc24af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55508/0 (socket says 172.21.15.134:55508) 2024-04-24T02:13:23.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.324+0000 7fa602bed640 1 -- 172.21.15.134:0/2879357222 learned_addr learned my addr 172.21.15.134:0/2879357222 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:13:23.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.324+0000 7fa60b3ee640 1 -- 172.21.15.134:0/2879357222 >> v1:172.21.15.104:6789/0 conn(0x55c7fbc25030 legacy=0x55c7fbc274f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:23.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.325+0000 7fa60b3ee640 1 -- 172.21.15.134:0/2879357222 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7fbae1590 con 0x55c7fbc226c0 2024-04-24T02:13:23.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.326+0000 7fa60b3ee640 1 --2- 172.21.15.134:0/2879357222 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7fbc226c0 0x55c7fbc24af0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc005fd0 tx=0x7fa5fc01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b3af01ee7eba052 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:23.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.326+0000 7fa60abed640 1 -- 172.21.15.134:0/2879357222 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5fc052560 con 0x55c7fbc226c0 2024-04-24T02:13:23.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.326+0000 7fa60abed640 1 -- 172.21.15.134:0/2879357222 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5fc052700 con 0x55c7fbc226c0 2024-04-24T02:13:23.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.326+0000 7fa60abed640 1 -- 172.21.15.134:0/2879357222 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5fc052a60 con 0x55c7fbc226c0 2024-04-24T02:13:23.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.327+0000 7fa60fe12800 1 -- 172.21.15.134:0/2879357222 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7fbc226c0 msgr2=0x55c7fbc24af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:23.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.327+0000 7fa60fe12800 1 --2- 172.21.15.134:0/2879357222 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7fbc226c0 0x55c7fbc24af0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc005fd0 tx=0x7fa5fc01ccc0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.327+0000 7fa60fe12800 1 -- 172.21.15.134:0/2879357222 shutdown_connections 2024-04-24T02:13:23.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.327+0000 7fa60fe12800 1 --2- 172.21.15.134:0/2879357222 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7fbc226c0 0x55c7fbc24af0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.327+0000 7fa60fe12800 1 -- 172.21.15.134:0/2879357222 >> 172.21.15.134:0/2879357222 conn(0x55c7fbc1e3a0 msgr2=0x55c7fbc207c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:23.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.327+0000 7fa60fe12800 1 -- 172.21.15.134:0/2879357222 shutdown_connections 2024-04-24T02:13:23.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.327+0000 7fa60fe12800 1 -- 172.21.15.134:0/2879357222 wait complete. 2024-04-24T02:13:23.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.338+0000 7fa60fe12800 1 Processor -- start 2024-04-24T02:13:23.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.339+0000 7fa60fe12800 1 -- start start 2024-04-24T02:13:23.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.339+0000 7fa60fe12800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7fbc226c0 0x55c7fbd1b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:23.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.339+0000 7fa60fe12800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c7fbb6f3b0 con 0x55c7fbc226c0 2024-04-24T02:13:23.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.339+0000 7fa60b3ee640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7fbc226c0 0x55c7fbd1b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:23.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.339+0000 7fa60b3ee640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7fbc226c0 0x55c7fbd1b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55516/0 (socket says 172.21.15.134:55516) 2024-04-24T02:13:23.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.339+0000 7fa60b3ee640 1 -- 172.21.15.134:0/2002947629 learned_addr learned my addr 172.21.15.134:0/2002947629 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:23.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.339+0000 7fa60b3ee640 1 -- 172.21.15.134:0/2002947629 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7fbd1bd70 con 0x55c7fbc226c0 2024-04-24T02:13:23.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.339+0000 7fa60b3ee640 1 --2- 172.21.15.134:0/2002947629 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7fbc226c0 0x55c7fbd1b7a0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc00a3f0 tx=0x7fa5fc04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bd4553772fcc936 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:23.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.340+0000 7fa4f960a640 1 -- 172.21.15.134:0/2002947629 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5fc052cd0 con 0x55c7fbc226c0 2024-04-24T02:13:23.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.340+0000 7fa4f960a640 1 -- 172.21.15.134:0/2002947629 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5fc0528b0 con 0x55c7fbc226c0 2024-04-24T02:13:23.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.340+0000 7fa4f960a640 1 -- 172.21.15.134:0/2002947629 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5fc05c430 con 0x55c7fbc226c0 2024-04-24T02:13:23.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.340+0000 7fa60fe12800 1 -- 172.21.15.134:0/2002947629 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7fbc226c0 msgr2=0x55c7fbd1b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:23.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.340+0000 7fa60fe12800 1 --2- 172.21.15.134:0/2002947629 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7fbc226c0 0x55c7fbd1b7a0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc00a3f0 tx=0x7fa5fc04c000 comp rx=0 tx=0).stop 2024-04-24T02:13:23.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.340+0000 7fa60fe12800 1 -- 172.21.15.134:0/2002947629 shutdown_connections 2024-04-24T02:13:23.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.340+0000 7fa60fe12800 1 --2- 172.21.15.134:0/2002947629 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7fbc226c0 0x55c7fbd1b7a0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.340+0000 7fa60fe12800 1 -- 172.21.15.134:0/2002947629 >> 172.21.15.134:0/2002947629 conn(0x55c7fbc1e3a0 msgr2=0x55c7fbd170c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:23.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.340+0000 7fa60fe12800 1 -- 172.21.15.134:0/2002947629 shutdown_connections 2024-04-24T02:13:23.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.340+0000 7fa60fe12800 1 -- 172.21.15.134:0/2002947629 wait complete. 2024-04-24T02:13:23.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.341+0000 7fa60fe12800 1 Processor -- start 2024-04-24T02:13:23.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.341+0000 7fa60fe12800 1 -- start start 2024-04-24T02:13:23.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.341+0000 7fa60fe12800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7fbc226c0 0x55c7fbd23230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:23.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.341+0000 7fa60fe12800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c7fbc337d0 con 0x55c7fbc226c0 2024-04-24T02:13:23.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.341+0000 7fa60b3ee640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7fbc226c0 0x55c7fbd23230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:23.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.341+0000 7fa60b3ee640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7fbc226c0 0x55c7fbd23230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55524/0 (socket says 172.21.15.134:55524) 2024-04-24T02:13:23.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.341+0000 7fa60b3ee640 1 -- 172.21.15.134:0/83992896 learned_addr learned my addr 172.21.15.134:0/83992896 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:23.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.341+0000 7fa60b3ee640 1 -- 172.21.15.134:0/83992896 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7fbd23770 con 0x55c7fbc226c0 2024-04-24T02:13:23.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.341+0000 7fa60b3ee640 1 --2- 172.21.15.134:0/83992896 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7fbc226c0 0x55c7fbd23230 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc000f80 tx=0x7fa5fc003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:23.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.341+0000 7fa4f7e07640 1 -- 172.21.15.134:0/83992896 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5fc075070 con 0x55c7fbc226c0 2024-04-24T02:13:23.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.341+0000 7fa4f7e07640 1 -- 172.21.15.134:0/83992896 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5fc05c560 con 0x55c7fbc226c0 2024-04-24T02:13:23.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.341+0000 7fa4f7e07640 1 -- 172.21.15.134:0/83992896 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5fc05c880 con 0x55c7fbc226c0 2024-04-24T02:13:23.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.341+0000 7fa60fe12800 1 -- 172.21.15.134:0/83992896 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c7fbd23a00 con 0x55c7fbc226c0 2024-04-24T02:13:23.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.342+0000 7fa60fe12800 1 -- 172.21.15.134:0/83992896 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7fbd26660 con 0x55c7fbc226c0 2024-04-24T02:13:23.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.342+0000 7fa4f7e07640 1 -- 172.21.15.134:0/83992896 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa5fc05cc30 con 0x55c7fbc226c0 2024-04-24T02:13:23.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.342+0000 7fa4f7e07640 1 --2- 172.21.15.134:0/83992896 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa4f0036950 0x7fa4f0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:23.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.342+0000 7fa4f7e07640 1 -- 172.21.15.134:0/83992896 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fa5fc08ec90 con 0x55c7fbc226c0 2024-04-24T02:13:23.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.343+0000 7fa602bed640 1 --2- 172.21.15.134:0/83992896 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa4f0036950 0x7fa4f0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:23.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.343+0000 7fa60fe12800 1 --2- 172.21.15.134:0/83992896 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c7fbc25030 0x55c7fbd2a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:23.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.343+0000 7fa60fe12800 1 -- 172.21.15.134:0/83992896 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd2a9f0 con 0x55c7fbc25030 2024-04-24T02:13:23.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.343+0000 7fa60bbef640 1 --2- 172.21.15.134:0/83992896 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c7fbc25030 0x55c7fbd2a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:23.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.343+0000 7fa602bed640 1 --2- 172.21.15.134:0/83992896 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa4f0036950 0x7fa4f0038e10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa5f4000f60 tx=0x7fa5f40012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:23.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.343+0000 7fa60bbef640 1 --2- 172.21.15.134:0/83992896 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c7fbc25030 0x55c7fbd2a420 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:23.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.343+0000 7fa60bbef640 1 -- 172.21.15.134:0/83992896 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa6040083e0 con 0x55c7fbc25030 2024-04-24T02:13:23.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.343+0000 7fa60fe12800 1 -- 172.21.15.134:0/83992896 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd279d0 con 0x55c7fbc25030 2024-04-24T02:13:23.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.344+0000 7fa60bbef640 1 -- 172.21.15.134:0/83992896 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa6040083e0 con 0x55c7fbc25030 2024-04-24T02:13:23.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.344+0000 7fa60fe12800 1 -- 172.21.15.134:0/83992896 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd2c810 con 0x55c7fbc25030 2024-04-24T02:13:23.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.344+0000 7fa60bbef640 1 -- 172.21.15.134:0/83992896 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa6040083e0 con 0x55c7fbc25030 2024-04-24T02:13:23.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.344+0000 7fa60fe12800 1 -- 172.21.15.134:0/83992896 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd2bb50 con 0x55c7fbc25030 2024-04-24T02:13:23.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.344+0000 7fa60bbef640 1 -- 172.21.15.134:0/83992896 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa6040083e0 con 0x55c7fbc25030 2024-04-24T02:13:23.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.344+0000 7fa60fe12800 1 -- 172.21.15.134:0/83992896 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd2bf40 con 0x55c7fbc25030 2024-04-24T02:13:23.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.344+0000 7fa60bbef640 1 -- 172.21.15.134:0/83992896 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa6040083e0 con 0x55c7fbc25030 2024-04-24T02:13:23.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.345+0000 7fa60fe12800 1 Processor -- start 2024-04-24T02:13:23.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.345+0000 7fa60fe12800 1 -- start start 2024-04-24T02:13:23.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.345+0000 7fa60fe12800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7fbd3b620 0x55c7fbd3ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:23.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.345+0000 7fa60fe12800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c7fbb156b0 con 0x55c7fbd3b620 2024-04-24T02:13:23.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.345+0000 7fa602bed640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7fbd3b620 0x55c7fbd3ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:23.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.345+0000 7fa602bed640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7fbd3b620 0x55c7fbd3ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55540/0 (socket says 172.21.15.134:55540) 2024-04-24T02:13:23.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.345+0000 7fa602bed640 1 -- 172.21.15.134:0/1429578596 learned_addr learned my addr 172.21.15.134:0/1429578596 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:23.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.346+0000 7fa602bed640 1 -- 172.21.15.134:0/1429578596 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7fbd3bf80 con 0x55c7fbd3b620 2024-04-24T02:13:23.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.346+0000 7fa602bed640 1 --2- 172.21.15.134:0/1429578596 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7fbd3b620 0x55c7fbd3ba40 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fa5f4001ed0 tx=0x7fa5f400d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:23.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.346+0000 7fa4f5602640 1 -- 172.21.15.134:0/1429578596 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5f401b550 con 0x55c7fbd3b620 2024-04-24T02:13:23.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.346+0000 7fa4f5602640 1 -- 172.21.15.134:0/1429578596 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5f401b6f0 con 0x55c7fbd3b620 2024-04-24T02:13:23.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.346+0000 7fa60fe12800 1 -- 172.21.15.134:0/1429578596 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c7fbd3c9f0 con 0x55c7fbd3b620 2024-04-24T02:13:23.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.346+0000 7fa4f5602640 1 -- 172.21.15.134:0/1429578596 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5f401b9d0 con 0x55c7fbd3b620 2024-04-24T02:13:23.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.346+0000 7fa60fe12800 1 -- 172.21.15.134:0/1429578596 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7fbd3cef0 con 0x55c7fbd3b620 2024-04-24T02:13:23.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.347+0000 7fa4f5602640 1 -- 172.21.15.134:0/1429578596 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa5f4023020 con 0x55c7fbd3b620 2024-04-24T02:13:23.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.347+0000 7fa4f5602640 1 --2- 172.21.15.134:0/1429578596 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa4e4036900 0x7fa4e4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:23.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.347+0000 7fa4f5602640 1 -- 172.21.15.134:0/1429578596 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fa5f4021020 con 0x55c7fbd3b620 2024-04-24T02:13:23.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.347+0000 7fa60bbef640 1 --2- 172.21.15.134:0/1429578596 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa4e4036900 0x7fa4e4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:23.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.347+0000 7fa60fe12800 1 Processor -- start 2024-04-24T02:13:23.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.347+0000 7fa60fe12800 1 -- start start 2024-04-24T02:13:23.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.347+0000 7fa60bbef640 1 --2- 172.21.15.134:0/1429578596 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa4e4036900 0x7fa4e4038dc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x55c7fbd2b670 tx=0x7fa604000f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:23.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.347+0000 7fa60fe12800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7fbd48960 0x55c7fbd48d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:23.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.347+0000 7fa60fe12800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c7fbd1c030 con 0x55c7fbd48960 2024-04-24T02:13:23.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.348+0000 7fa602bed640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7fbd48960 0x55c7fbd48d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:23.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.348+0000 7fa602bed640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7fbd48960 0x55c7fbd48d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55550/0 (socket says 172.21.15.134:55550) 2024-04-24T02:13:23.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.348+0000 7fa602bed640 1 -- 172.21.15.134:0/214901503 learned_addr learned my addr 172.21.15.134:0/214901503 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:23.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.348+0000 7fa602bed640 1 -- 172.21.15.134:0/214901503 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7fbd49350 con 0x55c7fbd48960 2024-04-24T02:13:23.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.348+0000 7fa602bed640 1 --2- 172.21.15.134:0/214901503 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7fbd48960 0x55c7fbd48d80 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fa5f404cec0 tx=0x7fa5f40468f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f4ab1cc6493be6c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:23.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.348+0000 7fa4eeffd640 1 -- 172.21.15.134:0/214901503 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5f401be20 con 0x55c7fbd48960 2024-04-24T02:13:23.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.348+0000 7fa4eeffd640 1 -- 172.21.15.134:0/214901503 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5f400c360 con 0x55c7fbd48960 2024-04-24T02:13:23.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.348+0000 7fa4eeffd640 1 -- 172.21.15.134:0/214901503 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5f4041130 con 0x55c7fbd48960 2024-04-24T02:13:23.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.348+0000 7fa60fe12800 1 -- 172.21.15.134:0/214901503 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7fbd48960 msgr2=0x55c7fbd48d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:23.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.348+0000 7fa60fe12800 1 --2- 172.21.15.134:0/214901503 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7fbd48960 0x55c7fbd48d80 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fa5f404cec0 tx=0x7fa5f40468f0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.349+0000 7fa60fe12800 1 -- 172.21.15.134:0/214901503 shutdown_connections 2024-04-24T02:13:23.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.349+0000 7fa60fe12800 1 --2- 172.21.15.134:0/214901503 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7fbd48960 0x55c7fbd48d80 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.349+0000 7fa60fe12800 1 -- 172.21.15.134:0/214901503 >> 172.21.15.134:0/214901503 conn(0x55c7fbd44cc0 msgr2=0x55c7fbd42d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:23.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.349+0000 7fa60fe12800 1 -- 172.21.15.134:0/214901503 shutdown_connections 2024-04-24T02:13:23.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.349+0000 7fa60fe12800 1 -- 172.21.15.134:0/214901503 wait complete. 2024-04-24T02:13:23.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.349+0000 7fa60fe12800 1 Processor -- start 2024-04-24T02:13:23.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.349+0000 7fa60fe12800 1 -- start start 2024-04-24T02:13:23.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.349+0000 7fa60fe12800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7fbd48960 0x55c7fbd4ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:23.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.349+0000 7fa60fe12800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c7fbd49ac0 con 0x55c7fbd48960 2024-04-24T02:13:23.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.349+0000 7fa602bed640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7fbd48960 0x55c7fbd4ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:23.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.349+0000 7fa602bed640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7fbd48960 0x55c7fbd4ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:55552/0 (socket says 172.21.15.134:55552) 2024-04-24T02:13:23.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.349+0000 7fa602bed640 1 -- 172.21.15.134:0/3991009630 learned_addr learned my addr 172.21.15.134:0/3991009630 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:23.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.350+0000 7fa602bed640 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7fbd50500 con 0x55c7fbd48960 2024-04-24T02:13:23.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.350+0000 7fa602bed640 1 --2- 172.21.15.134:0/3991009630 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7fbd48960 0x55c7fbd4ffc0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fa5f404cf20 tx=0x7fa5f404ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:23.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.350+0000 7fa4ed7fa640 1 -- 172.21.15.134:0/3991009630 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5f4034020 con 0x55c7fbd48960 2024-04-24T02:13:23.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.350+0000 7fa4ed7fa640 1 -- 172.21.15.134:0/3991009630 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5f40460d0 con 0x55c7fbd48960 2024-04-24T02:13:23.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.350+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c7fbd50790 con 0x55c7fbd48960 2024-04-24T02:13:23.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.350+0000 7fa4ed7fa640 1 -- 172.21.15.134:0/3991009630 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5f4024370 con 0x55c7fbd48960 2024-04-24T02:13:23.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.350+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7fbd50790 con 0x55c7fbd48960 2024-04-24T02:13:23.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.351+0000 7fa4ed7fa640 1 -- 172.21.15.134:0/3991009630 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa5f4037020 con 0x55c7fbd48960 2024-04-24T02:13:23.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.351+0000 7fa4ed7fa640 1 --2- 172.21.15.134:0/3991009630 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa4d4036950 0x7fa4d4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:23.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.351+0000 7fa4ed7fa640 1 -- 172.21.15.134:0/3991009630 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fa5f400f380 con 0x55c7fbd48960 2024-04-24T02:13:23.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.351+0000 7fa60bbef640 1 --2- 172.21.15.134:0/3991009630 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa4d4036950 0x7fa4d4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:23.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.351+0000 7fa60bbef640 1 --2- 172.21.15.134:0/3991009630 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa4d4036950 0x7fa4d4038e10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa60400f010 tx=0x7fa60400c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:23.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.351+0000 7fa60fe12800 20 rados->read ofs=0 len=0 2024-04-24T02:13:23.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.351+0000 7fa60fe12800 1 --2- 172.21.15.134:0/3991009630 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c7fbd5b940 0x55c7fbd5de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:23.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.351+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd5e550 con 0x55c7fbd5b940 2024-04-24T02:13:23.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.351+0000 7fa60b3ee640 1 --2- 172.21.15.134:0/3991009630 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c7fbd5b940 0x55c7fbd5de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:23.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.352+0000 7fa60b3ee640 1 --2- 172.21.15.134:0/3991009630 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c7fbd5b940 0x55c7fbd5de00 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:23.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.352+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa5fc05f070 con 0x55c7fbd5b940 2024-04-24T02:13:23.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.352+0000 7fa60fe12800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:23.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.352+0000 7fa60fe12800 20 realm 2024-04-24T02:13:23.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.352+0000 7fa60fe12800 20 rados->read ofs=0 len=0 2024-04-24T02:13:23.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.352+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd5e960 con 0x55c7fbd5b940 2024-04-24T02:13:23.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.352+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa5fc05f070 con 0x55c7fbd5b940 2024-04-24T02:13:23.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.352+0000 7fa60fe12800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:23.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.352+0000 7fa60fe12800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:13:23.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.352+0000 7fa60fe12800 20 rados->read ofs=0 len=0 2024-04-24T02:13:23.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.352+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd5f230 con 0x55c7fbd5b940 2024-04-24T02:13:23.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.352+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa5fc05f070 con 0x55c7fbd5b940 2024-04-24T02:13:23.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.352+0000 7fa60fe12800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:23.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.352+0000 7fa60fe12800 20 rados->read ofs=0 len=0 2024-04-24T02:13:23.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.352+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd5f5d0 con 0x55c7fbd5b940 2024-04-24T02:13:23.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.353+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa5fc05f070 con 0x55c7fbd5b940 2024-04-24T02:13:23.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.353+0000 7fa60fe12800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:13:23.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.353+0000 7fa60fe12800 20 rados->read ofs=0 len=0 2024-04-24T02:13:23.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.353+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd5fe20 con 0x55c7fbd5b940 2024-04-24T02:13:23.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.353+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa5fc05f070 con 0x55c7fbd5b940 2024-04-24T02:13:23.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.353+0000 7fa60fe12800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:13:23.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.353+0000 7fa60fe12800 20 searching for the correct realm 2024-04-24T02:13:23.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.353+0000 7fa60fe12800 1 --2- 172.21.15.134:0/3991009630 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55c7fbd61b90 0x55c7fbd63f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:23.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.353+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd64560 con 0x55c7fbd61b90 2024-04-24T02:13:23.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.353+0000 7fa602bed640 1 --2- 172.21.15.134:0/3991009630 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55c7fbd61b90 0x55c7fbd63f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:23.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.353+0000 7fa602bed640 1 --2- 172.21.15.134:0/3991009630 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55c7fbd61b90 0x55c7fbd63f80 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:23.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.353+0000 7fa602bed640 1 -- 172.21.15.134:0/3991009630 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5f4009050 con 0x55c7fbd61b90 2024-04-24T02:13:23.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.354+0000 7fa602bed640 1 --2- 172.21.15.134:0/3991009630 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fa5f4039020 0x7fa5f401e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:23.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.354+0000 7fa602bed640 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd64560 con 0x7fa5f4039020 2024-04-24T02:13:23.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.354+0000 7fa60bbef640 1 --2- 172.21.15.134:0/3991009630 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fa5f4039020 0x7fa5f401e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:23.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.354+0000 7fa60bbef640 1 --2- 172.21.15.134:0/3991009630 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fa5f4039020 0x7fa5f401e970 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:23.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.354+0000 7fa60bbef640 1 -- 172.21.15.134:0/3991009630 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa60402f040 con 0x7fa5f4039020 2024-04-24T02:13:23.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.354+0000 7fa60bbef640 1 --2- 172.21.15.134:0/3991009630 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fa604019040 0x7fa604019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:23.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.354+0000 7fa60bbef640 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd64560 con 0x7fa604019040 2024-04-24T02:13:23.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.354+0000 7fa60b3ee640 1 --2- 172.21.15.134:0/3991009630 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fa604019040 0x7fa604019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:23.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.355+0000 7fa60b3ee640 1 --2- 172.21.15.134:0/3991009630 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fa604019040 0x7fa604019930 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:23.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.355+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5fc05f070 con 0x7fa604019040 2024-04-24T02:13:23.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.355+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd64560 con 0x55c7fbd5b940 2024-04-24T02:13:23.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.355+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5fc05f070 con 0x55c7fbd5b940 2024-04-24T02:13:23.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.355+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd64560 con 0x55c7fbd5b940 2024-04-24T02:13:23.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.355+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa5fc05f070 con 0x55c7fbd5b940 2024-04-24T02:13:23.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.356+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd64560 con 0x7fa604019040 2024-04-24T02:13:23.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.356+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5fc05f070 con 0x7fa604019040 2024-04-24T02:13:23.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.356+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd64560 con 0x7fa5f4039020 2024-04-24T02:13:23.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.356+0000 7fa60bbef640 1 -- 172.21.15.134:0/3991009630 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa60402f040 con 0x7fa5f4039020 2024-04-24T02:13:23.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.356+0000 7fa60bbef640 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd64560 con 0x7fa5f4039020 2024-04-24T02:13:23.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.356+0000 7fa60bbef640 1 -- 172.21.15.134:0/3991009630 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa60402f040 con 0x7fa5f4039020 2024-04-24T02:13:23.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.356+0000 7fa60bbef640 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd64560 con 0x55c7fbd61b90 2024-04-24T02:13:23.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.356+0000 7fa602bed640 1 -- 172.21.15.134:0/3991009630 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5f4009050 con 0x55c7fbd61b90 2024-04-24T02:13:23.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.356+0000 7fa602bed640 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd64560 con 0x55c7fbd5b940 2024-04-24T02:13:23.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.357+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5fc05f070 con 0x55c7fbd5b940 2024-04-24T02:13:23.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.357+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd64560 con 0x7fa604019040 2024-04-24T02:13:23.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.357+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5fc05f070 con 0x7fa604019040 2024-04-24T02:13:23.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.357+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd64560 con 0x55c7fbd5b940 2024-04-24T02:13:23.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.357+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5fc05f070 con 0x55c7fbd5b940 2024-04-24T02:13:23.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.357+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd64560 con 0x7fa5f4039020 2024-04-24T02:13:23.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.357+0000 7fa60bbef640 1 -- 172.21.15.134:0/3991009630 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa60402f040 con 0x7fa5f4039020 2024-04-24T02:13:23.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.357+0000 7fa60bbef640 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd64560 con 0x55c7fbd61b90 2024-04-24T02:13:23.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.358+0000 7fa602bed640 1 -- 172.21.15.134:0/3991009630 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5f4009050 con 0x55c7fbd61b90 2024-04-24T02:13:23.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.358+0000 7fa602bed640 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd64560 con 0x55c7fbd61b90 2024-04-24T02:13:23.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.358+0000 7fa602bed640 1 -- 172.21.15.134:0/3991009630 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5f4009050 con 0x55c7fbd61b90 2024-04-24T02:13:23.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.358+0000 7fa602bed640 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd64560 con 0x7fa5f4039020 2024-04-24T02:13:23.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.358+0000 7fa60bbef640 1 -- 172.21.15.134:0/3991009630 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa60402f040 con 0x7fa5f4039020 2024-04-24T02:13:23.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.358+0000 7fa60bbef640 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd64560 con 0x55c7fbd61b90 2024-04-24T02:13:23.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.358+0000 7fa602bed640 1 -- 172.21.15.134:0/3991009630 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5f4009050 con 0x55c7fbd61b90 2024-04-24T02:13:23.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.358+0000 7fa602bed640 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd64560 con 0x55c7fbd61b90 2024-04-24T02:13:23.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.358+0000 7fa602bed640 1 -- 172.21.15.134:0/3991009630 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5f4009050 con 0x55c7fbd61b90 2024-04-24T02:13:23.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.359+0000 7fa602bed640 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd64560 con 0x55c7fbd5b940 2024-04-24T02:13:23.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.359+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5fc05f070 con 0x55c7fbd5b940 2024-04-24T02:13:23.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.359+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd64560 con 0x55c7fbd5b940 2024-04-24T02:13:23.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.359+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fa5fc05f070 con 0x55c7fbd5b940 2024-04-24T02:13:23.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.359+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd64560 con 0x7fa604019040 2024-04-24T02:13:23.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.359+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5fc05f070 con 0x7fa604019040 2024-04-24T02:13:23.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.359+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd64560 con 0x55c7fbd61b90 2024-04-24T02:13:23.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.360+0000 7fa602bed640 1 -- 172.21.15.134:0/3991009630 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5f4009050 con 0x55c7fbd61b90 2024-04-24T02:13:23.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.360+0000 7fa602bed640 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd64560 con 0x7fa5f4039020 2024-04-24T02:13:23.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.360+0000 7fa60bbef640 1 -- 172.21.15.134:0/3991009630 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa60402f040 con 0x7fa5f4039020 2024-04-24T02:13:23.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.360+0000 7fa60bbef640 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd64560 con 0x55c7fbd5b940 2024-04-24T02:13:23.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.360+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5fc05f070 con 0x55c7fbd5b940 2024-04-24T02:13:23.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.360+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd64560 con 0x7fa604019040 2024-04-24T02:13:23.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.360+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5fc05f070 con 0x7fa604019040 2024-04-24T02:13:23.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.360+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd64560 con 0x55c7fbd61b90 2024-04-24T02:13:23.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.361+0000 7fa602bed640 1 -- 172.21.15.134:0/3991009630 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5f4009050 con 0x55c7fbd61b90 2024-04-24T02:13:23.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.361+0000 7fa602bed640 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd64560 con 0x7fa604019040 2024-04-24T02:13:23.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.361+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5fc05f070 con 0x7fa604019040 2024-04-24T02:13:23.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.361+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd64560 con 0x7fa5f4039020 2024-04-24T02:13:23.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.361+0000 7fa60bbef640 1 -- 172.21.15.134:0/3991009630 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa60402f040 con 0x7fa5f4039020 2024-04-24T02:13:23.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.361+0000 7fa60bbef640 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd64560 con 0x55c7fbd61b90 2024-04-24T02:13:23.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.361+0000 7fa602bed640 1 -- 172.21.15.134:0/3991009630 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5f4009050 con 0x55c7fbd61b90 2024-04-24T02:13:23.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.361+0000 7fa602bed640 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd64560 con 0x7fa5f4039020 2024-04-24T02:13:23.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.362+0000 7fa60bbef640 1 -- 172.21.15.134:0/3991009630 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa60402f040 con 0x7fa5f4039020 2024-04-24T02:13:23.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.362+0000 7fa60bbef640 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd64560 con 0x55c7fbd5b940 2024-04-24T02:13:23.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.362+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa5fc05f070 con 0x55c7fbd5b940 2024-04-24T02:13:23.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.362+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd64560 con 0x7fa5f4039020 2024-04-24T02:13:23.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.362+0000 7fa60bbef640 1 -- 172.21.15.134:0/3991009630 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa60402f040 con 0x7fa5f4039020 2024-04-24T02:13:23.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.362+0000 7fa60fe12800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:13:23.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.362+0000 7fa60fe12800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:13:23.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.362+0000 7fa60fe12800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:13:23.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.362+0000 7fa60fe12800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:13:23.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.362+0000 7fa60fe12800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:13:23.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.362+0000 7fa60fe12800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:13:23.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.362+0000 7fa60fe12800 20 rados->read ofs=0 len=0 2024-04-24T02:13:23.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.362+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd607a0 con 0x55c7fbd5b940 2024-04-24T02:13:23.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.362+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa5fc05f070 con 0x55c7fbd5b940 2024-04-24T02:13:23.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.362+0000 7fa60fe12800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:23.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.362+0000 7fa60fe12800 20 rados->read ofs=0 len=0 2024-04-24T02:13:23.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.362+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd61040 con 0x55c7fbd5b940 2024-04-24T02:13:23.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.363+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa5fc05f070 con 0x55c7fbd5b940 2024-04-24T02:13:23.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.363+0000 7fa60fe12800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:13:23.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.363+0000 7fa60fe12800 20 rados->read ofs=0 len=0 2024-04-24T02:13:23.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.363+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd649e0 con 0x55c7fbd5b940 2024-04-24T02:13:23.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.363+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa5fc05f070 con 0x55c7fbd5b940 2024-04-24T02:13:23.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.363+0000 7fa60fe12800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:13:23.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.363+0000 7fa60fe12800 20 zone default found 2024-04-24T02:13:23.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.363+0000 7fa60fe12800 4 Realm: () 2024-04-24T02:13:23.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.363+0000 7fa60fe12800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:13:23.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.363+0000 7fa60fe12800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:13:23.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.363+0000 7fa60fe12800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:13:23.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.363+0000 7fa60fe12800 20 zonegroup default 2024-04-24T02:13:23.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.363+0000 7fa60fe12800 20 rados->read ofs=0 len=0 2024-04-24T02:13:23.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.363+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd60ca0 con 0x7fa604019040 2024-04-24T02:13:23.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.363+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa5fc05f070 con 0x7fa604019040 2024-04-24T02:13:23.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.363+0000 7fa60fe12800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:23.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.363+0000 7fa60fe12800 20 rados->read ofs=0 len=0 2024-04-24T02:13:23.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.363+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd668f0 con 0x55c7fbd61b90 2024-04-24T02:13:23.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.363+0000 7fa602bed640 1 -- 172.21.15.134:0/3991009630 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa5f4009050 con 0x55c7fbd61b90 2024-04-24T02:13:23.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.363+0000 7fa60fe12800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:23.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.363+0000 7fa60fe12800 20 rados->read ofs=0 len=0 2024-04-24T02:13:23.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.363+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd66cc0 con 0x55c7fbd61b90 2024-04-24T02:13:23.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.364+0000 7fa602bed640 1 -- 172.21.15.134:0/3991009630 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa5f4009050 con 0x55c7fbd61b90 2024-04-24T02:13:23.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.364+0000 7fa60fe12800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:23.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.364+0000 7fa60fe12800 20 started sync module instance, tier type = 2024-04-24T02:13:23.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.364+0000 7fa60fe12800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:13:23.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.364+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd65d90 con 0x7fa5f4039020 2024-04-24T02:13:23.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.365+0000 7fa60bbef640 1 -- 172.21.15.134:0/3991009630 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(44 notify.0 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa60402f040 con 0x7fa5f4039020 2024-04-24T02:13:23.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.365+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94317411984048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd65d90 con 0x7fa5f4039020 2024-04-24T02:13:23.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.365+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd67780 con 0x55c7fbd5b940 2024-04-24T02:13:23.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.366+0000 7fa60bbef640 1 -- 172.21.15.134:0/3991009630 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94317411984048] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa60402f040 con 0x7fa5f4039020 2024-04-24T02:13:23.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.366+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5fc05f070 con 0x55c7fbd5b940 2024-04-24T02:13:23.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.366+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94317411988112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd65d90 con 0x55c7fbd5b940 2024-04-24T02:13:23.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.366+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd681d0 con 0x55c7fbd61b90 2024-04-24T02:13:23.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.367+0000 7fa602bed640 1 -- 172.21.15.134:0/3991009630 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5f4009050 con 0x55c7fbd61b90 2024-04-24T02:13:23.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.367+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94317411990752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd68a60 con 0x55c7fbd61b90 2024-04-24T02:13:23.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.367+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd69530 con 0x7fa5f4039020 2024-04-24T02:13:23.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.367+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94317411988112] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5fc05f070 con 0x55c7fbd5b940 2024-04-24T02:13:23.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.368+0000 7fa602bed640 1 -- 172.21.15.134:0/3991009630 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94317411990752] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5f4009050 con 0x55c7fbd61b90 2024-04-24T02:13:23.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.368+0000 7fa60bbef640 1 -- 172.21.15.134:0/3991009630 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(50 notify.3 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa60402f040 con 0x7fa5f4039020 2024-04-24T02:13:23.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.368+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94317411995680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd68570 con 0x7fa5f4039020 2024-04-24T02:13:23.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.368+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd69f70 con 0x55c7fbd5b940 2024-04-24T02:13:23.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.369+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5fc05f070 con 0x55c7fbd5b940 2024-04-24T02:13:23.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.369+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94317411998400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd6a390 con 0x55c7fbd5b940 2024-04-24T02:13:23.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.369+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd6ad90 con 0x7fa604019040 2024-04-24T02:13:23.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.369+0000 7fa60bbef640 1 -- 172.21.15.134:0/3991009630 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94317411995680] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa60402f040 con 0x7fa5f4039020 2024-04-24T02:13:23.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.370+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94317411998400] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5fc05f070 con 0x55c7fbd5b940 2024-04-24T02:13:23.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.370+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(54 notify.5 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5fc05f070 con 0x7fa604019040 2024-04-24T02:13:23.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.370+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94317411981536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd69ee0 con 0x7fa604019040 2024-04-24T02:13:23.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.370+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd6b630 con 0x7fa604019040 2024-04-24T02:13:23.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.371+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94317411981536] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5fc05f070 con 0x7fa604019040 2024-04-24T02:13:23.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.371+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(56 notify.6 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5fc05f070 con 0x7fa604019040 2024-04-24T02:13:23.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.371+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94317412001952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd69ee0 con 0x7fa604019040 2024-04-24T02:13:23.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.371+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd6bc50 con 0x7fa604019040 2024-04-24T02:13:23.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.372+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(58 notify.7 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5fc05f070 con 0x7fa604019040 2024-04-24T02:13:23.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.372+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94317412005792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd6c070 con 0x7fa604019040 2024-04-24T02:13:23.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.372+0000 7fa60fe12800 20 add_watcher() i=0 2024-04-24T02:13:23.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.372+0000 7fa60fe12800 20 add_watcher() i=1 2024-04-24T02:13:23.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.372+0000 7fa60fe12800 20 add_watcher() i=2 2024-04-24T02:13:23.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.372+0000 7fa60fe12800 20 add_watcher() i=3 2024-04-24T02:13:23.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.372+0000 7fa60fe12800 20 add_watcher() i=4 2024-04-24T02:13:23.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.372+0000 7fa60fe12800 20 add_watcher() i=5 2024-04-24T02:13:23.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.372+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94317412001952] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5fc05f070 con 0x7fa604019040 2024-04-24T02:13:23.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.372+0000 7fa60fe12800 20 add_watcher() i=6 2024-04-24T02:13:23.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.373+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94317412005792] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5fc05f070 con 0x7fa604019040 2024-04-24T02:13:23.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.373+0000 7fa60fe12800 20 add_watcher() i=7 2024-04-24T02:13:23.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.373+0000 7fa60fe12800 2 all 8 watchers are set, enabling cache 2024-04-24T02:13:23.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.373+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd6b180 con 0x55c7fbd5b940 2024-04-24T02:13:23.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.374+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa5fc05f070 con 0x55c7fbd5b940 2024-04-24T02:13:23.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.374+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94317412004224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbd6c560 con 0x55c7fbd5b940 2024-04-24T02:13:23.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.375+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94317412004224] v32'219 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa5fc05f070 con 0x55c7fbd5b940 2024-04-24T02:13:23.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.375+0000 7fa4c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:13:23.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.375+0000 7fa60fe12800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:13:23.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.375+0000 7fa60fe12800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:13:23.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.375+0000 7fa60fe12800 5 note: GC not initialized 2024-04-24T02:13:23.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.375+0000 7fa4c0fe1640 20 reqs_thread_entry: start 2024-04-24T02:13:23.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.375+0000 7fa60fe12800 20 init_complete bucket index max shards: 11 2024-04-24T02:13:23.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.375+0000 7fa60fe12800 20 Filter name: none 2024-04-24T02:13:23.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.375+0000 7fa43a7fc640 20 reqs_thread_entry: start 2024-04-24T02:13:23.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.375+0000 7fa60fe12800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-04-24T02:13:23.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.375+0000 7fa60fe12800 20 rados->read ofs=0 len=0 2024-04-24T02:13:23.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.375+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbda2400 con 0x7fa604019040 2024-04-24T02:13:23.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.376+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(62 bar [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fa5fc05f070 con 0x7fa604019040 2024-04-24T02:13:23.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.376+0000 7fa60fe12800 20 rados_obj.operate() r=0 bl.length=380 2024-04-24T02:13:23.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.376+0000 7fa60fe12800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-04-24T02:13:23.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.376+0000 7fa60fe12800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-04-24T02:13:23.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.376+0000 7fa60fe12800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:13:23.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.376+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbda6730 con 0x7fa5f4039020 2024-04-24T02:13:23.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.377+0000 7fa60bbef640 1 -- 172.21.15.134:0/3991009630 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(63 bud [create,call,writefull 0~206] v32'3 uv3 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fa60402f040 con 0x7fa5f4039020 2024-04-24T02:13:23.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.377+0000 7fa60fe12800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-04-24T02:13:23.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.377+0000 7fa60fe12800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-04-24T02:13:23.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.377+0000 7fa60fe12800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-04-24T02:13:23.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.377+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 94317412241664 in=394b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbda7420 con 0x7fa604019040 2024-04-24T02:13:23.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.378+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== watch-notify(notify (1) cookie 94317411981536 notify 137438953505 ret 0) ==== 424+0+0 (crc 0 0 0) 0x55c7fbd26660 con 0x7fa604019040 2024-04-24T02:13:23.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.378+0000 7fa4eeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953505 cookie 94317411981536 notifier 4725 bl.length()=382 2024-04-24T02:13:23.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.378+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(64 notify.5 [notify cookie 94317412241664 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa5fc05f070 con 0x7fa604019040 2024-04-24T02:13:23.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.378+0000 7fa4eeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-04-24T02:13:23.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.378+0000 7fa4eeffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-04-24T02:13:23.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.378+0000 7fa4eeffd640 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fa4d0003ea0 con 0x7fa604019040 2024-04-24T02:13:23.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.378+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5fc05f070 con 0x7fa604019040 2024-04-24T02:13:23.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.378+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== watch-notify(notify_complete (2) cookie 94317412241664 notify 137438953505 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c7fbd23a00 con 0x7fa604019040 2024-04-24T02:13:23.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.378+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbda72c0 con 0x55c7fbd5b940 2024-04-24T02:13:23.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.379+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv3 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7fa5fc05f070 con 0x55c7fbd5b940 2024-04-24T02:13:23.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.379+0000 7fa60fe12800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9 : miss 2024-04-24T02:13:23.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.379+0000 7fa60fe12800 20 rados->read ofs=0 len=0 2024-04-24T02:13:23.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.379+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:67 8.10 8:0fe20272:root::.bucket.meta.myfoo6%3a582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbda48a0 con 0x55c7fbd61b90 2024-04-24T02:13:23.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.379+0000 7fa602bed640 1 -- 172.21.15.134:0/3991009630 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(67 .bucket.meta.myfoo6:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 333+0+662 (crc 0 0 0) 0x7fa5f4009050 con 0x55c7fbd61b90 2024-04-24T02:13:23.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.379+0000 7fa60fe12800 20 rados_obj.operate() r=0 bl.length=380 2024-04-24T02:13:23.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.379+0000 7fa60fe12800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9 info.flags=0x17 2024-04-24T02:13:23.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.379+0000 7fa60fe12800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9 to cache LRU end 2024-04-24T02:13:23.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.379+0000 7fa60fe12800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:13:23.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.379+0000 7fa60fe12800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T02:13:23.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.379+0000 7fa60fe12800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9 2024-04-24T02:13:23.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.379+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:68 8.10 8:0fe20272:root::.bucket.meta.myfoo6%3a582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbdae6e0 con 0x55c7fbd61b90 2024-04-24T02:13:23.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.380+0000 7fa602bed640 1 -- 172.21.15.134:0/3991009630 <== osd.3 v2:172.21.15.134:6801/3585115521 15 ==== osd_op_reply(68 .bucket.meta.myfoo6:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v32'2 uv2 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7fa5f4009050 con 0x55c7fbd61b90 2024-04-24T02:13:23.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.380+0000 7fa60fe12800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9 info.flags=0x17 2024-04-24T02:13:23.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.380+0000 7fa60fe12800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9 to cache LRU end 2024-04-24T02:13:23.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.380+0000 7fa60fe12800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-04-24T02:13:23.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.380+0000 7fa60fe12800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9, ofs0, ns] 2024-04-24T02:13:23.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.380+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify cookie 94317412241184 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbda8d10 con 0x55c7fbd61b90 2024-04-24T02:13:23.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.381+0000 7fa602bed640 1 -- 172.21.15.134:0/3991009630 <== osd.3 v2:172.21.15.134:6801/3585115521 16 ==== watch-notify(notify (1) cookie 94317411990752 notify 137438953485 ret 0) ==== 790+0+0 (crc 0 0 0) 0x55c7fbda40f0 con 0x55c7fbd61b90 2024-04-24T02:13:23.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.381+0000 7fa4eeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953485 cookie 94317411990752 notifier 4725 bl.length()=748 2024-04-24T02:13:23.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.381+0000 7fa4eeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9 info.flags=0x17 2024-04-24T02:13:23.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.381+0000 7fa4eeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9 to cache LRU end 2024-04-24T02:13:23.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.381+0000 7fa4eeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-04-24T02:13:23.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.381+0000 7fa602bed640 1 -- 172.21.15.134:0/3991009630 <== osd.3 v2:172.21.15.134:6801/3585115521 17 ==== osd_op_reply(69 notify.2 [notify cookie 94317412241184 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa5f4009050 con 0x55c7fbd61b90 2024-04-24T02:13:23.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.381+0000 7fa4eeffd640 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fa4d0003ea0 con 0x55c7fbd61b90 2024-04-24T02:13:23.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.381+0000 7fa602bed640 1 -- 172.21.15.134:0/3991009630 <== osd.3 v2:172.21.15.134:6801/3585115521 18 ==== watch-notify(notify_complete (2) cookie 94317412241184 notify 137438953485 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c7fbd49350 con 0x55c7fbd61b90 2024-04-24T02:13:23.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.381+0000 7fa602bed640 1 -- 172.21.15.134:0/3991009630 <== osd.3 v2:172.21.15.134:6801/3585115521 19 ==== osd_op_reply(70 notify.2 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5f4009050 con 0x55c7fbd61b90 2024-04-24T02:13:23.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.381+0000 7fa60fe12800 20 handle_bi_update(): bucket=:myfoo6[582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9]): orig_sources= new_sources= 2024-04-24T02:13:23.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.381+0000 7fa60fe12800 20 handle_bi_update(): bucket=:myfoo6[582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9]): potential sources added=[] removed=[] 2024-04-24T02:13:23.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.381+0000 7fa60fe12800 20 handle_bi_update(): bucket=:myfoo6[582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9]): orig_dests= new_dests= 2024-04-24T02:13:23.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.381+0000 7fa60fe12800 20 handle_bi_update(): bucket=:myfoo6[582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9]): potential dests added=[] removed=[] 2024-04-24T02:13:23.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.381+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:71 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbda4f20 con 0x55c7fbd5b940 2024-04-24T02:13:23.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.382+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(71 bud.buckets [call] v32'3 uv0 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa5fc05f070 con 0x55c7fbd5b940 2024-04-24T02:13:23.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.382+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:72 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbda4f20 con 0x55c7fbd5b940 2024-04-24T02:13:23.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.383+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(72 bud.buckets [call] v32'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa5fc05f070 con 0x55c7fbd5b940 2024-04-24T02:13:23.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.383+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:73 8.18 8:1944a257:root::myfoo6:head [delete,create,call version.inc in=38b,writefull 0~166 in=166b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbda4f20 con 0x55c7fbd5b940 2024-04-24T02:13:23.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.384+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(73 myfoo6 [delete,create,call,writefull 0~166] v32'17 uv17 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7fa5fc05f070 con 0x55c7fbd5b940 2024-04-24T02:13:23.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.384+0000 7fa60fe12800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-04-24T02:13:23.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.384+0000 7fa60fe12800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-04-24T02:13:23.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.384+0000 7fa60fe12800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-04-24T02:13:23.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.384+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [notify cookie 94317412241184 in=328b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbda7d00 con 0x7fa5f4039020 2024-04-24T02:13:23.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.384+0000 7fa60bbef640 1 -- 172.21.15.134:0/3991009630 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== watch-notify(notify (1) cookie 94317411995680 notify 137438953487 ret 0) ==== 358+0+0 (crc 0 0 0) 0x7fa6040268c0 con 0x7fa5f4039020 2024-04-24T02:13:23.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.384+0000 7fa4ee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953487 cookie 94317411995680 notifier 4725 bl.length()=316 2024-04-24T02:13:23.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.384+0000 7fa4ee7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-04-24T02:13:23.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.384+0000 7fa4ee7fc640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo6 to cache LRU end 2024-04-24T02:13:23.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.384+0000 7fa60bbef640 1 -- 172.21.15.134:0/3991009630 <== osd.2 v2:172.21.15.134:6800/214480313 16 ==== osd_op_reply(74 notify.3 [notify cookie 94317412241184 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa60402f040 con 0x7fa5f4039020 2024-04-24T02:13:23.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.384+0000 7fa4ee7fc640 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:75 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fa440003400 con 0x7fa5f4039020 2024-04-24T02:13:23.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.385+0000 7fa60bbef640 1 -- 172.21.15.134:0/3991009630 <== osd.2 v2:172.21.15.134:6800/214480313 17 ==== watch-notify(notify_complete (2) cookie 94317412241184 notify 137438953487 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa604026b60 con 0x7fa5f4039020 2024-04-24T02:13:23.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.385+0000 7fa60bbef640 1 -- 172.21.15.134:0/3991009630 <== osd.2 v2:172.21.15.134:6800/214480313 18 ==== osd_op_reply(75 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa60402f040 con 0x7fa5f4039020 2024-04-24T02:13:23.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.385+0000 7fa60fe12800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9 : hit (requested=0x17, cached=0x17) 2024-04-24T02:13:23.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.385+0000 7fa60fe12800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9 2024-04-24T02:13:23.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.385+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:76 8.10 8:0fe20272:root::.bucket.meta.myfoo6%3a582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbdadb50 con 0x55c7fbd61b90 2024-04-24T02:13:23.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.386+0000 7fa602bed640 1 -- 172.21.15.134:0/3991009630 <== osd.3 v2:172.21.15.134:6801/3585115521 20 ==== osd_op_reply(76 .bucket.meta.myfoo6:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v32'3 uv3 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7fa5f4009050 con 0x55c7fbd61b90 2024-04-24T02:13:23.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.386+0000 7fa60fe12800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9 info.flags=0x17 2024-04-24T02:13:23.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.386+0000 7fa60fe12800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9 to cache LRU end 2024-04-24T02:13:23.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.386+0000 7fa60fe12800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-04-24T02:13:23.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.386+0000 7fa60fe12800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9, ofs0, ns] 2024-04-24T02:13:23.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.386+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [notify cookie 94317412273792 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbda8860 con 0x55c7fbd61b90 2024-04-24T02:13:23.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.386+0000 7fa602bed640 1 -- 172.21.15.134:0/3991009630 <== osd.3 v2:172.21.15.134:6801/3585115521 21 ==== watch-notify(notify (1) cookie 94317411990752 notify 137438953486 ret 0) ==== 790+0+0 (crc 0 0 0) 0x55c7fbd49350 con 0x55c7fbd61b90 2024-04-24T02:13:23.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.386+0000 7fa4eeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953486 cookie 94317411990752 notifier 4725 bl.length()=748 2024-04-24T02:13:23.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.386+0000 7fa4eeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9 info.flags=0x17 2024-04-24T02:13:23.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.386+0000 7fa4eeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9 to cache LRU end 2024-04-24T02:13:23.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.386+0000 7fa4eeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-04-24T02:13:23.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.386+0000 7fa4eeffd640 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:78 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fa4d0003ea0 con 0x55c7fbd61b90 2024-04-24T02:13:23.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.386+0000 7fa602bed640 1 -- 172.21.15.134:0/3991009630 <== osd.3 v2:172.21.15.134:6801/3585115521 22 ==== osd_op_reply(77 notify.2 [notify cookie 94317412273792 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa5f4009050 con 0x55c7fbd61b90 2024-04-24T02:13:23.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.386+0000 7fa602bed640 1 -- 172.21.15.134:0/3991009630 <== osd.3 v2:172.21.15.134:6801/3585115521 23 ==== watch-notify(notify_complete (2) cookie 94317412273792 notify 137438953486 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c7fbd3cef0 con 0x55c7fbd61b90 2024-04-24T02:13:23.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.387+0000 7fa60fe12800 20 handle_bi_update(): bucket=:myfoo6[582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9]): orig_sources= new_sources= 2024-04-24T02:13:23.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.387+0000 7fa60fe12800 20 handle_bi_update(): bucket=:myfoo6[582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9]): potential sources added=[] removed=[] 2024-04-24T02:13:23.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.387+0000 7fa60fe12800 20 handle_bi_update(): bucket=:myfoo6[582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9]): orig_dests= new_dests= 2024-04-24T02:13:23.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.387+0000 7fa60fe12800 20 handle_bi_update(): bucket=:myfoo6[582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9]): potential dests added=[] removed=[] 2024-04-24T02:13:23.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.387+0000 7fa602bed640 1 -- 172.21.15.134:0/3991009630 <== osd.3 v2:172.21.15.134:6801/3585115521 24 ==== osd_op_reply(78 notify.2 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5f4009050 con 0x55c7fbd61b90 2024-04-24T02:13:23.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.387+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:79 4.2 4:43700786:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbdace80 con 0x55c7fbd5b940 2024-04-24T02:13:23.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.387+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(79 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa5fc05f070 con 0x55c7fbd5b940 2024-04-24T02:13:23.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.387+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:80 4.19 4:99b23a2c:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbdace80 con 0x55c7fbd61b90 2024-04-24T02:13:23.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.387+0000 7fa602bed640 1 -- 172.21.15.134:0/3991009630 <== osd.3 v2:172.21.15.134:6801/3585115521 25 ==== osd_op_reply(80 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa5f4009050 con 0x55c7fbd61b90 2024-04-24T02:13:23.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.387+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:81 4.9 4:936fe5c7:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbdad7e0 con 0x55c7fbd5b940 2024-04-24T02:13:23.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.387+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(81 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa5fc05f070 con 0x55c7fbd5b940 2024-04-24T02:13:23.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.387+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:82 4.1d 4:b965fd86:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbdad7e0 con 0x55c7fbd61b90 2024-04-24T02:13:23.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.388+0000 7fa602bed640 1 -- 172.21.15.134:0/3991009630 <== osd.3 v2:172.21.15.134:6801/3585115521 26 ==== osd_op_reply(82 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa5f4009050 con 0x55c7fbd61b90 2024-04-24T02:13:23.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.388+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:83 4.c 4:32e81382:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbdad7e0 con 0x55c7fbd5b940 2024-04-24T02:13:23.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.388+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(83 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa5fc05f070 con 0x55c7fbd5b940 2024-04-24T02:13:23.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.388+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:84 4.4 4:20e31cdf:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbdad7e0 con 0x7fa604019040 2024-04-24T02:13:23.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.389+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(84 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa5fc0ad040 con 0x7fa604019040 2024-04-24T02:13:23.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.389+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:85 4.2e 4:75e8498a:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbdad7e0 con 0x55c7fbd61b90 2024-04-24T02:13:23.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.389+0000 7fa602bed640 1 -- 172.21.15.134:0/3991009630 <== osd.3 v2:172.21.15.134:6801/3585115521 27 ==== osd_op_reply(85 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.6 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa5f4009050 con 0x55c7fbd61b90 2024-04-24T02:13:23.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.389+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:86 4.34 4:2c534dbe:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbdad7e0 con 0x7fa5f4039020 2024-04-24T02:13:23.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.389+0000 7fa60bbef640 1 -- 172.21.15.134:0/3991009630 <== osd.2 v2:172.21.15.134:6800/214480313 19 ==== osd_op_reply(86 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa60402f040 con 0x7fa5f4039020 2024-04-24T02:13:23.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.389+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:87 4.37 4:efbe90b3:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbdad7e0 con 0x7fa604019040 2024-04-24T02:13:23.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.390+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.0 v2:172.21.15.104:6800/2419146313 20 ==== osd_op_reply(87 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa5fc0ad040 con 0x7fa604019040 2024-04-24T02:13:23.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.390+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:88 4.7 4:e2dae6c0:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbdad7e0 con 0x7fa604019040 2024-04-24T02:13:23.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.390+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.0 v2:172.21.15.104:6800/2419146313 21 ==== osd_op_reply(88 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.9 [call out=377b] v0'0 uv9 ondisk = 0) ==== 194+0+377 (crc 0 0 0) 0x7fa5fc0ad040 con 0x7fa604019040 2024-04-24T02:13:23.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.390+0000 7fa60fe12800 10 cls_bucket_list_unordered: got thirteen 2024-04-24T02:13:23.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.390+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:89 4.35 4:ad0b0f32:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbdad7e0 con 0x55c7fbd5b940 2024-04-24T02:13:23.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.391+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.1 v2:172.21.15.134:6804/1487076214 30 ==== osd_op_reply(89 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.10 [call out=85b] v0'0 uv9 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa5fc0ad040 con 0x55c7fbd5b940 2024-04-24T02:13:23.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.391+0000 7fa60fe12800 20 get_obj_state: octx=0x7fa5fc077310 obj=myfoo6:thirteen state=0x55c7fbda5548 s->prefetch_data=0 2024-04-24T02:13:23.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.391+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:90 3.f 3:f14cd3bc:::582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbdad7e0 con 0x7fa5f4039020 2024-04-24T02:13:23.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.391+0000 7fa60bbef640 1 -- 172.21.15.134:0/3991009630 <== osd.2 v2:172.21.15.134:6800/214480313 20 ==== osd_op_reply(90 582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9_thirteen [getxattrs out=854b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 238+0+870 (crc 0 0 0) 0x7fa60402f040 con 0x7fa5f4039020 2024-04-24T02:13:23.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.391+0000 7fa60fe12800 10 manifest: total_size = 8 2024-04-24T02:13:23.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.391+0000 7fa60fe12800 20 get_obj_state: setting s->obj_tag to 582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9521414837173194702 2024-04-24T02:13:23.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.391+0000 7fa60fe12800 20 Read xattr rgw_rados: user.rgw.acl 2024-04-24T02:13:23.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.391+0000 7fa60fe12800 20 Read xattr rgw_rados: user.rgw.content_type 2024-04-24T02:13:23.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.391+0000 7fa60fe12800 20 Read xattr rgw_rados: user.rgw.etag 2024-04-24T02:13:23.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.391+0000 7fa60fe12800 20 Read xattr rgw_rados: user.rgw.idtag 2024-04-24T02:13:23.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.391+0000 7fa60fe12800 20 Read xattr rgw_rados: user.rgw.manifest 2024-04-24T02:13:23.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.391+0000 7fa60fe12800 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-04-24T02:13:23.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.391+0000 7fa60fe12800 20 Read xattr rgw_rados: user.rgw.source_zone 2024-04-24T02:13:23.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.391+0000 7fa60fe12800 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-04-24T02:13:23.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.391+0000 7fa60fe12800 20 get_obj_state: octx=0x7fa5fc077310 obj=myfoo6:thirteen state=0x55c7fbda5548 s->prefetch_data=0 2024-04-24T02:13:23.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.391+0000 7fa60fe12800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9 : hit (requested=0x17, cached=0x17) 2024-04-24T02:13:23.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.391+0000 7fa60fe12800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9 2024-04-24T02:13:23.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.391+0000 7fa60fe12800 20 bucket index object: :.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.9 2024-04-24T02:13:23.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.391+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:91 4.7 4:e2dae6c0:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbdb2060 con 0x7fa604019040 2024-04-24T02:13:23.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.392+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.0 v2:172.21.15.104:6800/2419146313 22 ==== osd_op_reply(91 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.9 [stat,call,call] v32'10 uv10 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fa5fc0ad040 con 0x7fa604019040 2024-04-24T02:13:23.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.392+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:92 3.f 3:f14cd3bc:::582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9_thirteen:head [cmpxattr user.rgw.idtag (62) op 1 mode 1 in=76b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbdb04f0 con 0x7fa5f4039020 2024-04-24T02:13:23.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.393+0000 7fa60bbef640 1 -- 172.21.15.134:0/3991009630 <== osd.2 v2:172.21.15.134:6800/214480313 21 ==== osd_op_reply(92 582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9_thirteen [cmpxattr (62) op 1 mode 1,setxattr (117),setxattr (33)] v32'2 uv2 ondisk = 0) ==== 280+0+0 (crc 0 0 0) 0x7fa60402f040 con 0x7fa5f4039020 2024-04-24T02:13:23.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.393+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:93 4.7 4:e2dae6c0:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=267b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbdb1a30 con 0x7fa604019040 2024-04-24T02:13:23.422 INFO:teuthology.orchestra.run.smithi134.stderr:1 objects processed in :myfoo6[582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9]). Next marker thirteen 2024-04-24T02:13:23.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.394+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbda6df0 con 0x7fa5f4039020 2024-04-24T02:13:23.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.395+0000 7fa60bbef640 1 -- 172.21.15.134:0/3991009630 <== osd.2 v2:172.21.15.134:6800/214480313 22 ==== osd_op_reply(94 bud [delete,create,call,writefull 0~380] v32'4 uv4 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fa60402f040 con 0x7fa5f4039020 2024-04-24T02:13:23.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.395+0000 7fa60fe12800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-04-24T02:13:23.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.395+0000 7fa60fe12800 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-04-24T02:13:23.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.395+0000 7fa60fe12800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-04-24T02:13:23.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.395+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [notify cookie 94317412268736 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbda6df0 con 0x7fa604019040 2024-04-24T02:13:23.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.395+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.0 v2:172.21.15.104:6800/2419146313 23 ==== osd_op_reply(93 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.9 [stat,call,call] v32'11 uv11 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fa5fc0ad040 con 0x7fa604019040 2024-04-24T02:13:23.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.395+0000 7fa4ee7fc640 20 handle_completion(): completion ok for obj=thirteen 2024-04-24T02:13:23.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.395+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.0 v2:172.21.15.104:6800/2419146313 24 ==== watch-notify(notify (1) cookie 94317411981536 notify 137438953506 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55c7fbd23a00 con 0x7fa604019040 2024-04-24T02:13:23.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.395+0000 7fa4eeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953506 cookie 94317411981536 notifier 4725 bl.length()=556 2024-04-24T02:13:23.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.395+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.0 v2:172.21.15.104:6800/2419146313 25 ==== osd_op_reply(95 notify.5 [notify cookie 94317412268736 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa5fc0ad040 con 0x7fa604019040 2024-04-24T02:13:23.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.395+0000 7fa4eeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-04-24T02:13:23.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.395+0000 7fa4eeffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-04-24T02:13:23.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.395+0000 7fa4eeffd640 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fa4d0003ea0 con 0x7fa604019040 2024-04-24T02:13:23.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.395+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.0 v2:172.21.15.104:6800/2419146313 26 ==== watch-notify(notify_complete (2) cookie 94317412268736 notify 137438953506 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c7fbdab8f0 con 0x7fa604019040 2024-04-24T02:13:23.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.395+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.0 v2:172.21.15.104:6800/2419146313 27 ==== osd_op_reply(96 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5fc0ad040 con 0x7fa604019040 2024-04-24T02:13:23.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.395+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:97 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbda6df0 con 0x55c7fbd5b940 2024-04-24T02:13:23.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.396+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.1 v2:172.21.15.134:6804/1487076214 31 ==== osd_op_reply(97 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v32'2 uv2 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fa5fc0ad040 con 0x55c7fbd5b940 2024-04-24T02:13:23.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.397+0000 7fa60fe12800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-04-24T02:13:23.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.397+0000 7fa60fe12800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-04-24T02:13:23.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.397+0000 7fa60fe12800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-04-24T02:13:23.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.397+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify cookie 94317412268736 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbda6df0 con 0x7fa604019040 2024-04-24T02:13:23.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.397+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.0 v2:172.21.15.104:6800/2419146313 28 ==== watch-notify(notify (1) cookie 94317411981536 notify 137438953507 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55c7fbdab8f0 con 0x7fa604019040 2024-04-24T02:13:23.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.397+0000 7fa4eeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953507 cookie 94317411981536 notifier 4725 bl.length()=177 2024-04-24T02:13:23.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.397+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.0 v2:172.21.15.104:6800/2419146313 29 ==== osd_op_reply(98 notify.5 [notify cookie 94317412268736 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa5fc0ad040 con 0x7fa604019040 2024-04-24T02:13:23.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.397+0000 7fa4eeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-04-24T02:13:23.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.397+0000 7fa4eeffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-04-24T02:13:23.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.397+0000 7fa4eeffd640 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:99 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fa4d0003ea0 con 0x7fa604019040 2024-04-24T02:13:23.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.397+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.0 v2:172.21.15.104:6800/2419146313 30 ==== osd_op_reply(99 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5fc0ad040 con 0x7fa604019040 2024-04-24T02:13:23.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.397+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.0 v2:172.21.15.104:6800/2419146313 31 ==== watch-notify(notify_complete (2) cookie 94317412268736 notify 137438953507 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c7fbd23770 con 0x7fa604019040 2024-04-24T02:13:23.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.397+0000 7fa60fe12800 10 removing user index: bar 2024-04-24T02:13:23.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.397+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:100 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbda6df0 con 0x7fa604019040 2024-04-24T02:13:23.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.398+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.0 v2:172.21.15.104:6800/2419146313 32 ==== osd_op_reply(100 bar [delete] v32'4 uv4 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7fa5fc0ad040 con 0x7fa604019040 2024-04-24T02:13:23.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.398+0000 7fa60fe12800 10 removing default.rgw.meta+users.uid+bar from cache 2024-04-24T02:13:23.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.398+0000 7fa60fe12800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-04-24T02:13:23.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.398+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:101 7.9 7:93e5b521:::notify.7:head [notify cookie 94317412268736 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbda6df0 con 0x7fa604019040 2024-04-24T02:13:23.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.398+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.0 v2:172.21.15.104:6800/2419146313 33 ==== watch-notify(notify (1) cookie 94317412005792 notify 137438953508 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55c7fbd23770 con 0x7fa604019040 2024-04-24T02:13:23.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.398+0000 7fa4eeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953508 cookie 94317412005792 notifier 4725 bl.length()=152 2024-04-24T02:13:23.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.399+0000 7fa4eeffd640 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fa4d0003ea0 con 0x7fa604019040 2024-04-24T02:13:23.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.399+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.0 v2:172.21.15.104:6800/2419146313 34 ==== osd_op_reply(101 notify.7 [notify cookie 94317412268736 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa5fc0ad040 con 0x7fa604019040 2024-04-24T02:13:23.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.399+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.0 v2:172.21.15.104:6800/2419146313 35 ==== osd_op_reply(102 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5fc0ad040 con 0x7fa604019040 2024-04-24T02:13:23.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.399+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.0 v2:172.21.15.104:6800/2419146313 36 ==== watch-notify(notify_complete (2) cookie 94317412268736 notify 137438953508 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c7fbd1bd70 con 0x7fa604019040 2024-04-24T02:13:23.426 INFO:teuthology.orchestra.run.smithi134.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-04-24T02:13:23.225943Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T02:13:23.225928Z","tags":[],"group_ids":[]} 2024-04-24T02:13:23.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.400+0000 7fa4c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:13:23.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.400+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94317412004224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbda6df0 con 0x55c7fbd5b940 2024-04-24T02:13:23.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.401+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.1 v2:172.21.15.134:6804/1487076214 32 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94317412004224] v32'220 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa5fc0ad040 con 0x55c7fbd5b940 2024-04-24T02:13:23.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.401+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94317411984048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbda6df0 con 0x7fa5f4039020 2024-04-24T02:13:23.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.402+0000 7fa60bbef640 1 -- 172.21.15.134:0/3991009630 <== osd.2 v2:172.21.15.134:6800/214480313 23 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94317411984048] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa60402f040 con 0x7fa5f4039020 2024-04-24T02:13:23.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.402+0000 7fa60fe12800 20 remove_watcher() i=0 2024-04-24T02:13:23.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.402+0000 7fa60fe12800 2 removed watcher, disabling cache 2024-04-24T02:13:23.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.402+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94317411988112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbda6df0 con 0x55c7fbd5b940 2024-04-24T02:13:23.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.403+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.1 v2:172.21.15.134:6804/1487076214 33 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94317411988112] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5fc0ad040 con 0x55c7fbd5b940 2024-04-24T02:13:23.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.403+0000 7fa60fe12800 20 remove_watcher() i=1 2024-04-24T02:13:23.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.403+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94317411990752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbda6df0 con 0x55c7fbd61b90 2024-04-24T02:13:23.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.404+0000 7fa602bed640 1 -- 172.21.15.134:0/3991009630 <== osd.3 v2:172.21.15.134:6801/3585115521 28 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94317411990752] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5f4009050 con 0x55c7fbd61b90 2024-04-24T02:13:23.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.404+0000 7fa60fe12800 20 remove_watcher() i=2 2024-04-24T02:13:23.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.404+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94317411995680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbda6df0 con 0x7fa5f4039020 2024-04-24T02:13:23.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.405+0000 7fa60bbef640 1 -- 172.21.15.134:0/3991009630 <== osd.2 v2:172.21.15.134:6800/214480313 24 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94317411995680] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa60402f040 con 0x7fa5f4039020 2024-04-24T02:13:23.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.405+0000 7fa60fe12800 20 remove_watcher() i=3 2024-04-24T02:13:23.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.405+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94317411998400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbda6df0 con 0x55c7fbd5b940 2024-04-24T02:13:23.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.406+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.1 v2:172.21.15.134:6804/1487076214 34 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94317411998400] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5fc0ad040 con 0x55c7fbd5b940 2024-04-24T02:13:23.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.406+0000 7fa60fe12800 20 remove_watcher() i=4 2024-04-24T02:13:23.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.406+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94317411981536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbda6df0 con 0x7fa604019040 2024-04-24T02:13:23.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.407+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.0 v2:172.21.15.104:6800/2419146313 37 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94317411981536] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5fc0ad040 con 0x7fa604019040 2024-04-24T02:13:23.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.407+0000 7fa60fe12800 20 remove_watcher() i=5 2024-04-24T02:13:23.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.407+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94317412001952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbda6df0 con 0x7fa604019040 2024-04-24T02:13:23.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.408+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.0 v2:172.21.15.104:6800/2419146313 38 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94317412001952] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5fc0ad040 con 0x7fa604019040 2024-04-24T02:13:23.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.408+0000 7fa60fe12800 20 remove_watcher() i=6 2024-04-24T02:13:23.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.408+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94317412005792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7fbda6df0 con 0x7fa604019040 2024-04-24T02:13:23.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.409+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 <== osd.0 v2:172.21.15.104:6800/2419146313 39 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94317412005792] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5fc0ad040 con 0x7fa604019040 2024-04-24T02:13:23.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.409+0000 7fa60fe12800 20 remove_watcher() i=7 2024-04-24T02:13:23.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.409+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fa604019040 msgr2=0x7fa604019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:23.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.409+0000 7fa60fe12800 1 --2- 172.21.15.134:0/3991009630 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fa604019040 0x7fa604019930 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.409+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c7fbd5b940 msgr2=0x55c7fbd5de00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:23.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.409+0000 7fa60fe12800 1 --2- 172.21.15.134:0/3991009630 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c7fbd5b940 0x55c7fbd5de00 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.409+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fa5f4039020 msgr2=0x7fa5f401e970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:23.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.409+0000 7fa60fe12800 1 --2- 172.21.15.134:0/3991009630 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fa5f4039020 0x7fa5f401e970 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.409+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55c7fbd61b90 msgr2=0x55c7fbd63f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:23.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.409+0000 7fa60fe12800 1 --2- 172.21.15.134:0/3991009630 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55c7fbd61b90 0x55c7fbd63f80 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.409+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa4d4036950 msgr2=0x7fa4d4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:23.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.409+0000 7fa60fe12800 1 --2- 172.21.15.134:0/3991009630 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa4d4036950 0x7fa4d4038e10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa60400f010 tx=0x7fa60400c040 comp rx=0 tx=0).stop 2024-04-24T02:13:23.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.409+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7fbd48960 msgr2=0x55c7fbd4ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:23.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.409+0000 7fa60fe12800 1 --2- 172.21.15.134:0/3991009630 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7fbd48960 0x55c7fbd4ffc0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fa5f404cf20 tx=0x7fa5f404ce20 comp rx=0 tx=0).stop 2024-04-24T02:13:23.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.409+0000 7fa60b3ee640 1 -- 172.21.15.134:0/3991009630 reap_dead start 2024-04-24T02:13:23.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.409+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 shutdown_connections 2024-04-24T02:13:23.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.409+0000 7fa60fe12800 1 --2- 172.21.15.134:0/3991009630 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7fbd48960 0x55c7fbd4ffc0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.409+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 >> 172.21.15.134:0/3991009630 conn(0x55c7fbd44cc0 msgr2=0x55c7fbd42320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:23.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.409+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 shutdown_connections 2024-04-24T02:13:23.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.409+0000 7fa60fe12800 1 -- 172.21.15.134:0/3991009630 wait complete. 2024-04-24T02:13:23.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.409+0000 7fa60fe12800 1 -- 172.21.15.134:0/1429578596 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa4e4036900 msgr2=0x7fa4e4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:23.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.409+0000 7fa60fe12800 1 --2- 172.21.15.134:0/1429578596 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa4e4036900 0x7fa4e4038dc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x55c7fbd2b670 tx=0x7fa604000f90 comp rx=0 tx=0).stop 2024-04-24T02:13:23.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.409+0000 7fa60fe12800 1 -- 172.21.15.134:0/1429578596 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7fbd3b620 msgr2=0x55c7fbd3ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:23.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.409+0000 7fa60fe12800 1 --2- 172.21.15.134:0/1429578596 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7fbd3b620 0x55c7fbd3ba40 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fa5f4001ed0 tx=0x7fa5f400d7a0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.410+0000 7fa60fe12800 1 -- 172.21.15.134:0/1429578596 shutdown_connections 2024-04-24T02:13:23.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.410+0000 7fa60fe12800 1 --2- 172.21.15.134:0/1429578596 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa4e4036900 0x7fa4e4038dc0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.410+0000 7fa60fe12800 1 --2- 172.21.15.134:0/1429578596 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7fbd3b620 0x55c7fbd3ba40 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.410+0000 7fa60fe12800 1 -- 172.21.15.134:0/1429578596 >> 172.21.15.134:0/1429578596 conn(0x55c7fbd2f6c0 msgr2=0x55c7fbd2fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:23.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.410+0000 7fa60fe12800 1 -- 172.21.15.134:0/1429578596 shutdown_connections 2024-04-24T02:13:23.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.410+0000 7fa60fe12800 1 -- 172.21.15.134:0/1429578596 wait complete. 2024-04-24T02:13:23.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.410+0000 7fa60fe12800 1 -- 172.21.15.134:0/83992896 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c7fbc25030 msgr2=0x55c7fbd2a420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:23.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.410+0000 7fa60fe12800 1 --2- 172.21.15.134:0/83992896 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c7fbc25030 0x55c7fbd2a420 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.410+0000 7fa60fe12800 1 -- 172.21.15.134:0/83992896 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa4f0036950 msgr2=0x7fa4f0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:23.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.410+0000 7fa60fe12800 1 --2- 172.21.15.134:0/83992896 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa4f0036950 0x7fa4f0038e10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa5f4000f60 tx=0x7fa5f40012b0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.410+0000 7fa60fe12800 1 -- 172.21.15.134:0/83992896 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7fbc226c0 msgr2=0x55c7fbd23230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:23.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.410+0000 7fa60fe12800 1 --2- 172.21.15.134:0/83992896 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7fbc226c0 0x55c7fbd23230 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc000f80 tx=0x7fa5fc003330 comp rx=0 tx=0).stop 2024-04-24T02:13:23.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.410+0000 7fa60fe12800 1 -- 172.21.15.134:0/83992896 shutdown_connections 2024-04-24T02:13:23.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.410+0000 7fa60fe12800 1 --2- 172.21.15.134:0/83992896 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55c7fbc25030 0x55c7fbd2a420 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.410+0000 7fa60fe12800 1 --2- 172.21.15.134:0/83992896 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa4f0036950 0x7fa4f0038e10 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.410+0000 7fa60fe12800 1 --2- 172.21.15.134:0/83992896 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c7fbc226c0 0x55c7fbd23230 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:23.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.410+0000 7fa60fe12800 1 -- 172.21.15.134:0/83992896 >> 172.21.15.134:0/83992896 conn(0x55c7fbc1e3a0 msgr2=0x55c7fbd15920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:23.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.410+0000 7fa60fe12800 1 -- 172.21.15.134:0/83992896 shutdown_connections 2024-04-24T02:13:23.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:23.410+0000 7fa60fe12800 1 -- 172.21.15.134:0/83992896 wait complete. 2024-04-24T02:13:23.439 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-04-24T02:13:23.225943Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:13:23.225928Z', 'tags': [], 'group_ids': []} 2024-04-24T02:13:28.445 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-04-24T02:13:28.446 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-04-24T02:13:28.446 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-04-24T02:13:28.446 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-04-24T02:13:28.446 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-04-24T02:13:28.504 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:13:28.537 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:13:28.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.504+0000 7f97deb2d800 1 Processor -- start 2024-04-24T02:13:28.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.504+0000 7f97deb2d800 1 -- start start 2024-04-24T02:13:28.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.504+0000 7f97deb2d800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5649dbbc2940 0x5649dbbc4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:28.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.504+0000 7f97deb2d800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5649dba80d40 con 0x5649dbbc5270 2024-04-24T02:13:28.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.504+0000 7f97deb2d800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x5649dba534d0 con 0x5649dbbc2940 2024-04-24T02:13:28.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.504+0000 7f97da77f640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5649dbbc2940 0x5649dbbc4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:28.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.504+0000 7f97d9f7e640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x5649dbbc5270 0x5649dbbc7660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:43410/0 (socket says 172.21.15.134:43410) 2024-04-24T02:13:28.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.504+0000 7f97da77f640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5649dbbc2940 0x5649dbbc4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:48600/0 (socket says 172.21.15.134:48600) 2024-04-24T02:13:28.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.504+0000 7f97d9f7e640 1 -- 172.21.15.134:0/3946930915 learned_addr learned my addr 172.21.15.134:0/3946930915 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:13:28.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.505+0000 7f97da77f640 1 -- 172.21.15.134:0/3946930915 >> v1:172.21.15.104:6789/0 conn(0x5649dbbc5270 legacy=0x5649dbbc7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:28.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.505+0000 7f97da77f640 1 -- 172.21.15.134:0/3946930915 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649dba7f590 con 0x5649dbbc2940 2024-04-24T02:13:28.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.507+0000 7f97da77f640 1 --2- 172.21.15.134:0/3946930915 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5649dbbc2940 0x5649dbbc4d30 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f97cc00a470 tx=0x7f97cc01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42eac5e5fb2331b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:28.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.507+0000 7f97d977d640 1 -- 172.21.15.134:0/3946930915 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97cc057070 con 0x5649dbbc2940 2024-04-24T02:13:28.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.507+0000 7f97d977d640 1 -- 172.21.15.134:0/3946930915 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97cc052570 con 0x5649dbbc2940 2024-04-24T02:13:28.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.507+0000 7f97d977d640 1 -- 172.21.15.134:0/3946930915 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97cc052870 con 0x5649dbbc2940 2024-04-24T02:13:28.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.507+0000 7f97deb2d800 1 -- 172.21.15.134:0/3946930915 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5649dbbc2940 msgr2=0x5649dbbc4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:28.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.507+0000 7f97deb2d800 1 --2- 172.21.15.134:0/3946930915 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5649dbbc2940 0x5649dbbc4d30 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f97cc00a470 tx=0x7f97cc01ce90 comp rx=0 tx=0).stop 2024-04-24T02:13:28.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.507+0000 7f97deb2d800 1 -- 172.21.15.134:0/3946930915 shutdown_connections 2024-04-24T02:13:28.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.507+0000 7f97deb2d800 1 --2- 172.21.15.134:0/3946930915 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5649dbbc2940 0x5649dbbc4d30 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.507+0000 7f97deb2d800 1 -- 172.21.15.134:0/3946930915 >> 172.21.15.134:0/3946930915 conn(0x5649dbbbc370 msgr2=0x5649dbbbe790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:28.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.507+0000 7f97deb2d800 1 -- 172.21.15.134:0/3946930915 shutdown_connections 2024-04-24T02:13:28.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.507+0000 7f97deb2d800 1 -- 172.21.15.134:0/3946930915 wait complete. 2024-04-24T02:13:28.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.521+0000 7f97deb2d800 1 Processor -- start 2024-04-24T02:13:28.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.521+0000 7f97deb2d800 1 -- start start 2024-04-24T02:13:28.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.521+0000 7f97deb2d800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5649dbbc2940 0x5649dbcb31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:28.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.521+0000 7f97deb2d800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5649dbb0d3e0 con 0x5649dbbc2940 2024-04-24T02:13:28.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.521+0000 7f97da77f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5649dbbc2940 0x5649dbcb31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:28.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.521+0000 7f97da77f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5649dbbc2940 0x5649dbcb31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:48606/0 (socket says 172.21.15.134:48606) 2024-04-24T02:13:28.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.521+0000 7f97da77f640 1 -- 172.21.15.134:0/1428655863 learned_addr learned my addr 172.21.15.134:0/1428655863 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:28.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.522+0000 7f97da77f640 1 -- 172.21.15.134:0/1428655863 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649dbcb37c0 con 0x5649dbbc2940 2024-04-24T02:13:28.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.522+0000 7f97da77f640 1 --2- 172.21.15.134:0/1428655863 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5649dbbc2940 0x5649dbcb31f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f97cc055040 tx=0x7f97cc04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdafe66fd7c8c96 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:28.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.522+0000 7f96c8608640 1 -- 172.21.15.134:0/1428655863 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97cc057070 con 0x5649dbbc2940 2024-04-24T02:13:28.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.522+0000 7f96c8608640 1 -- 172.21.15.134:0/1428655863 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97cc063070 con 0x5649dbbc2940 2024-04-24T02:13:28.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.522+0000 7f96c8608640 1 -- 172.21.15.134:0/1428655863 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97cc052720 con 0x5649dbbc2940 2024-04-24T02:13:28.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.523+0000 7f97deb2d800 1 -- 172.21.15.134:0/1428655863 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5649dbbc2940 msgr2=0x5649dbcb31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:28.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.523+0000 7f97deb2d800 1 --2- 172.21.15.134:0/1428655863 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5649dbbc2940 0x5649dbcb31f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f97cc055040 tx=0x7f97cc04c000 comp rx=0 tx=0).stop 2024-04-24T02:13:28.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.523+0000 7f97deb2d800 1 -- 172.21.15.134:0/1428655863 shutdown_connections 2024-04-24T02:13:28.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.523+0000 7f97deb2d800 1 --2- 172.21.15.134:0/1428655863 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5649dbbc2940 0x5649dbcb31f0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.523+0000 7f97deb2d800 1 -- 172.21.15.134:0/1428655863 >> 172.21.15.134:0/1428655863 conn(0x5649dbbbc370 msgr2=0x5649dbcaeb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:28.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.523+0000 7f97deb2d800 1 -- 172.21.15.134:0/1428655863 shutdown_connections 2024-04-24T02:13:28.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.523+0000 7f97deb2d800 1 -- 172.21.15.134:0/1428655863 wait complete. 2024-04-24T02:13:28.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.523+0000 7f97deb2d800 1 Processor -- start 2024-04-24T02:13:28.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.523+0000 7f97deb2d800 1 -- start start 2024-04-24T02:13:28.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.523+0000 7f97deb2d800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5649dbbc2940 0x5649dbcbac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:28.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.523+0000 7f97deb2d800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5649dbbc9020 con 0x5649dbbc2940 2024-04-24T02:13:28.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.524+0000 7f97da77f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5649dbbc2940 0x5649dbcbac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:28.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.524+0000 7f97da77f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5649dbbc2940 0x5649dbcbac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:48616/0 (socket says 172.21.15.134:48616) 2024-04-24T02:13:28.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.524+0000 7f97da77f640 1 -- 172.21.15.134:0/4058554354 learned_addr learned my addr 172.21.15.134:0/4058554354 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:28.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.524+0000 7f97da77f640 1 -- 172.21.15.134:0/4058554354 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649dbcbb180 con 0x5649dbbc2940 2024-04-24T02:13:28.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.524+0000 7f97da77f640 1 --2- 172.21.15.134:0/4058554354 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5649dbbc2940 0x5649dbcbac40 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f97cc060040 tx=0x7f97cc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:28.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.524+0000 7f96c6e05640 1 -- 172.21.15.134:0/4058554354 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97cc052e30 con 0x5649dbbc2940 2024-04-24T02:13:28.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.524+0000 7f96c6e05640 1 -- 172.21.15.134:0/4058554354 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97cc06c070 con 0x5649dbbc2940 2024-04-24T02:13:28.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.524+0000 7f96c6e05640 1 -- 172.21.15.134:0/4058554354 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97cc05e5f0 con 0x5649dbbc2940 2024-04-24T02:13:28.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.524+0000 7f97deb2d800 1 -- 172.21.15.134:0/4058554354 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5649dbcbb410 con 0x5649dbbc2940 2024-04-24T02:13:28.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.525+0000 7f97deb2d800 1 -- 172.21.15.134:0/4058554354 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649dbcbe0c0 con 0x5649dbbc2940 2024-04-24T02:13:28.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.526+0000 7f96c6e05640 1 -- 172.21.15.134:0/4058554354 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f97cc05e790 con 0x5649dbbc2940 2024-04-24T02:13:28.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.526+0000 7f96c6e05640 1 --2- 172.21.15.134:0/4058554354 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f96c0036900 0x7f96c0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:28.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.526+0000 7f96c6e05640 1 -- 172.21.15.134:0/4058554354 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f97cc08e8e0 con 0x5649dbbc2940 2024-04-24T02:13:28.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.526+0000 7f97d9f7e640 1 --2- 172.21.15.134:0/4058554354 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f96c0036900 0x7f96c0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:28.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.526+0000 7f97deb2d800 1 --2- 172.21.15.134:0/4058554354 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5649dbbc5270 0x5649dbcc1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:28.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.526+0000 7f97deb2d800 1 -- 172.21.15.134:0/4058554354 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcc2450 con 0x5649dbbc5270 2024-04-24T02:13:28.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.526+0000 7f97daf80640 1 --2- 172.21.15.134:0/4058554354 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5649dbbc5270 0x5649dbcc1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:28.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.527+0000 7f97d9f7e640 1 --2- 172.21.15.134:0/4058554354 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f96c0036900 0x7f96c0038dc0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f97d0001d90 tx=0x7f97d00012f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:28.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.527+0000 7f97daf80640 1 --2- 172.21.15.134:0/4058554354 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5649dbbc5270 0x5649dbcc1e80 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:28.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.527+0000 7f97daf80640 1 -- 172.21.15.134:0/4058554354 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f97d400a4a0 con 0x5649dbbc5270 2024-04-24T02:13:28.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.527+0000 7f97deb2d800 1 -- 172.21.15.134:0/4058554354 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcbf430 con 0x5649dbbc5270 2024-04-24T02:13:28.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.527+0000 7f97daf80640 1 -- 172.21.15.134:0/4058554354 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f97d400a4a0 con 0x5649dbbc5270 2024-04-24T02:13:28.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.527+0000 7f97deb2d800 1 -- 172.21.15.134:0/4058554354 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcc4250 con 0x5649dbbc5270 2024-04-24T02:13:28.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.528+0000 7f97daf80640 1 -- 172.21.15.134:0/4058554354 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f97d400a4a0 con 0x5649dbbc5270 2024-04-24T02:13:28.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.528+0000 7f97deb2d800 1 -- 172.21.15.134:0/4058554354 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcc3590 con 0x5649dbbc5270 2024-04-24T02:13:28.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.528+0000 7f97daf80640 1 -- 172.21.15.134:0/4058554354 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f97d400a4a0 con 0x5649dbbc5270 2024-04-24T02:13:28.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.528+0000 7f97deb2d800 1 -- 172.21.15.134:0/4058554354 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcc39e0 con 0x5649dbbc5270 2024-04-24T02:13:28.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.528+0000 7f97daf80640 1 -- 172.21.15.134:0/4058554354 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f97d400a4a0 con 0x5649dbbc5270 2024-04-24T02:13:28.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.528+0000 7f97deb2d800 1 Processor -- start 2024-04-24T02:13:28.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.528+0000 7f97deb2d800 1 -- start start 2024-04-24T02:13:28.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.529+0000 7f97deb2d800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5649dbbc2500 0x5649dbbc0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:28.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.529+0000 7f97deb2d800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5649dbab36b0 con 0x5649dbbc2500 2024-04-24T02:13:28.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.529+0000 7f97d9f7e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5649dbbc2500 0x5649dbbc0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:28.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.529+0000 7f97d9f7e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5649dbbc2500 0x5649dbbc0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:48626/0 (socket says 172.21.15.134:48626) 2024-04-24T02:13:28.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.529+0000 7f97d9f7e640 1 -- 172.21.15.134:0/465677125 learned_addr learned my addr 172.21.15.134:0/465677125 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:28.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.529+0000 7f97d9f7e640 1 -- 172.21.15.134:0/465677125 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649dbbc0eb0 con 0x5649dbbc2500 2024-04-24T02:13:28.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.529+0000 7f97d9f7e640 1 --2- 172.21.15.134:0/465677125 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5649dbbc2500 0x5649dbbc0970 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f97d000efd0 tx=0x7f97d000d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:28.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.530+0000 7f96bffff640 1 -- 172.21.15.134:0/465677125 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97d001b550 con 0x5649dbbc2500 2024-04-24T02:13:28.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.530+0000 7f96bffff640 1 -- 172.21.15.134:0/465677125 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97d001b6f0 con 0x5649dbbc2500 2024-04-24T02:13:28.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.530+0000 7f96bffff640 1 -- 172.21.15.134:0/465677125 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97d001b9f0 con 0x5649dbbc2500 2024-04-24T02:13:28.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.530+0000 7f97deb2d800 1 -- 172.21.15.134:0/465677125 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5649dbbc1140 con 0x5649dbbc2500 2024-04-24T02:13:28.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.530+0000 7f97deb2d800 1 -- 172.21.15.134:0/465677125 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649dbbc1640 con 0x5649dbbc2500 2024-04-24T02:13:28.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.531+0000 7f96bffff640 1 -- 172.21.15.134:0/465677125 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f97d0023020 con 0x5649dbbc2500 2024-04-24T02:13:28.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.531+0000 7f96bffff640 1 --2- 172.21.15.134:0/465677125 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f96b4036950 0x7f96b4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:28.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.531+0000 7f96bffff640 1 -- 172.21.15.134:0/465677125 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f97d0021020 con 0x5649dbbc2500 2024-04-24T02:13:28.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.531+0000 7f97daf80640 1 --2- 172.21.15.134:0/465677125 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f96b4036950 0x7f96b4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:28.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.531+0000 7f97deb2d800 1 Processor -- start 2024-04-24T02:13:28.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.531+0000 7f97daf80640 1 --2- 172.21.15.134:0/465677125 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f96b4036950 0x7f96b4038e10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x5649dbcc30b0 tx=0x7f97d4005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:28.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.531+0000 7f97deb2d800 1 -- start start 2024-04-24T02:13:28.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.531+0000 7f97deb2d800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5649dbce25d0 0x5649dbce29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:28.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.531+0000 7f97deb2d800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5649dbcb3a80 con 0x5649dbce25d0 2024-04-24T02:13:28.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.532+0000 7f97d9f7e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5649dbce25d0 0x5649dbce29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:28.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.532+0000 7f97d9f7e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5649dbce25d0 0x5649dbce29f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:48628/0 (socket says 172.21.15.134:48628) 2024-04-24T02:13:28.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.532+0000 7f97d9f7e640 1 -- 172.21.15.134:0/3260800467 learned_addr learned my addr 172.21.15.134:0/3260800467 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:28.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.532+0000 7f97d9f7e640 1 -- 172.21.15.134:0/3260800467 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649dbce2fc0 con 0x5649dbce25d0 2024-04-24T02:13:28.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.532+0000 7f97d9f7e640 1 --2- 172.21.15.134:0/3260800467 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5649dbce25d0 0x5649dbce29f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f97d004d030 tx=0x7f97d004d060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=814e15b3d5af7090 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:28.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.532+0000 7f96bdffb640 1 -- 172.21.15.134:0/3260800467 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97d0025930 con 0x5649dbce25d0 2024-04-24T02:13:28.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.532+0000 7f96bdffb640 1 -- 172.21.15.134:0/3260800467 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97d0025410 con 0x5649dbce25d0 2024-04-24T02:13:28.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.532+0000 7f96bdffb640 1 -- 172.21.15.134:0/3260800467 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97d0025ad0 con 0x5649dbce25d0 2024-04-24T02:13:28.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.533+0000 7f97deb2d800 1 -- 172.21.15.134:0/3260800467 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5649dbce25d0 msgr2=0x5649dbce29f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:28.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.533+0000 7f97deb2d800 1 --2- 172.21.15.134:0/3260800467 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5649dbce25d0 0x5649dbce29f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f97d004d030 tx=0x7f97d004d060 comp rx=0 tx=0).stop 2024-04-24T02:13:28.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.533+0000 7f97deb2d800 1 -- 172.21.15.134:0/3260800467 shutdown_connections 2024-04-24T02:13:28.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.533+0000 7f97deb2d800 1 --2- 172.21.15.134:0/3260800467 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5649dbce25d0 0x5649dbce29f0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.533+0000 7f97deb2d800 1 -- 172.21.15.134:0/3260800467 >> 172.21.15.134:0/3260800467 conn(0x5649dbcde930 msgr2=0x5649dbcdc990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:28.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.533+0000 7f97deb2d800 1 -- 172.21.15.134:0/3260800467 shutdown_connections 2024-04-24T02:13:28.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.533+0000 7f97deb2d800 1 -- 172.21.15.134:0/3260800467 wait complete. 2024-04-24T02:13:28.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.533+0000 7f97deb2d800 1 Processor -- start 2024-04-24T02:13:28.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.533+0000 7f97deb2d800 1 -- start start 2024-04-24T02:13:28.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.533+0000 7f97deb2d800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5649dbce25d0 0x5649dbce9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:28.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.533+0000 7f97deb2d800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5649dbce3730 con 0x5649dbce25d0 2024-04-24T02:13:28.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.534+0000 7f97d9f7e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5649dbce25d0 0x5649dbce9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:28.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.534+0000 7f97d9f7e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5649dbce25d0 0x5649dbce9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:48640/0 (socket says 172.21.15.134:48640) 2024-04-24T02:13:28.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.534+0000 7f97d9f7e640 1 -- 172.21.15.134:0/2559827488 learned_addr learned my addr 172.21.15.134:0/2559827488 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:28.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.534+0000 7f97d9f7e640 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649dbcea140 con 0x5649dbce25d0 2024-04-24T02:13:28.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.534+0000 7f97d9f7e640 1 --2- 172.21.15.134:0/2559827488 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5649dbce25d0 0x5649dbce9c00 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f97d001afd0 tx=0x7f97d004cd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:28.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.535+0000 7f96abfff640 1 -- 172.21.15.134:0/2559827488 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97d00196a0 con 0x5649dbce25d0 2024-04-24T02:13:28.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.535+0000 7f96abfff640 1 -- 172.21.15.134:0/2559827488 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97d0033070 con 0x5649dbce25d0 2024-04-24T02:13:28.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.535+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5649dbcea3d0 con 0x5649dbce25d0 2024-04-24T02:13:28.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.535+0000 7f96abfff640 1 -- 172.21.15.134:0/2559827488 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97d00199b0 con 0x5649dbce25d0 2024-04-24T02:13:28.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.535+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649dbcea3d0 con 0x5649dbce25d0 2024-04-24T02:13:28.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.535+0000 7f96abfff640 1 -- 172.21.15.134:0/2559827488 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f97d004ea70 con 0x5649dbce25d0 2024-04-24T02:13:28.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.536+0000 7f96abfff640 1 --2- 172.21.15.134:0/2559827488 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f96a40368b0 0x7f96a4038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:28.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.536+0000 7f96abfff640 1 -- 172.21.15.134:0/2559827488 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f97d0053950 con 0x5649dbce25d0 2024-04-24T02:13:28.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.536+0000 7f97daf80640 1 --2- 172.21.15.134:0/2559827488 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f96a40368b0 0x7f96a4038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:28.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.536+0000 7f97deb2d800 20 rados->read ofs=0 len=0 2024-04-24T02:13:28.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.536+0000 7f97deb2d800 1 --2- 172.21.15.134:0/2559827488 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5649dbcf5580 0x5649dbcf7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:28.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.536+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcf8190 con 0x5649dbcf5580 2024-04-24T02:13:28.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.536+0000 7f97daf80640 1 --2- 172.21.15.134:0/2559827488 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f96a40368b0 0x7f96a4038d70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x5649dbcbf3a0 tx=0x7f97d401f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:28.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.536+0000 7f97da77f640 1 --2- 172.21.15.134:0/2559827488 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5649dbcf5580 0x5649dbcf7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:28.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.537+0000 7f97da77f640 1 --2- 172.21.15.134:0/2559827488 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5649dbcf5580 0x5649dbcf7a40 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:28.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.537+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f97cc071990 con 0x5649dbcf5580 2024-04-24T02:13:28.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.537+0000 7f97deb2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:28.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.537+0000 7f97deb2d800 20 realm 2024-04-24T02:13:28.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.537+0000 7f97deb2d800 20 rados->read ofs=0 len=0 2024-04-24T02:13:28.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.537+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcf85a0 con 0x5649dbcf5580 2024-04-24T02:13:28.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.537+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f97cc071990 con 0x5649dbcf5580 2024-04-24T02:13:28.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.537+0000 7f97deb2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:28.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.537+0000 7f97deb2d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:13:28.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.537+0000 7f97deb2d800 20 rados->read ofs=0 len=0 2024-04-24T02:13:28.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.537+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcf8e70 con 0x5649dbcf5580 2024-04-24T02:13:28.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.537+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f97cc071990 con 0x5649dbcf5580 2024-04-24T02:13:28.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.537+0000 7f97deb2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:28.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.537+0000 7f97deb2d800 20 rados->read ofs=0 len=0 2024-04-24T02:13:28.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.537+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcf9210 con 0x5649dbcf5580 2024-04-24T02:13:28.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.537+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f97cc071990 con 0x5649dbcf5580 2024-04-24T02:13:28.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.538+0000 7f97deb2d800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:13:28.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.538+0000 7f97deb2d800 20 rados->read ofs=0 len=0 2024-04-24T02:13:28.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.538+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcf9a60 con 0x5649dbcf5580 2024-04-24T02:13:28.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.538+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f97cc071990 con 0x5649dbcf5580 2024-04-24T02:13:28.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.538+0000 7f97deb2d800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:13:28.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.538+0000 7f97deb2d800 20 searching for the correct realm 2024-04-24T02:13:28.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.538+0000 7f97deb2d800 1 --2- 172.21.15.134:0/2559827488 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5649dbcfb7d0 0x5649dbcfdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:28.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.538+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcfe1a0 con 0x5649dbcfb7d0 2024-04-24T02:13:28.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.538+0000 7f97d9f7e640 1 --2- 172.21.15.134:0/2559827488 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5649dbcfb7d0 0x5649dbcfdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:28.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.538+0000 7f97d9f7e640 1 --2- 172.21.15.134:0/2559827488 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5649dbcfb7d0 0x5649dbcfdbc0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:28.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.539+0000 7f97d9f7e640 1 -- 172.21.15.134:0/2559827488 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97d0009050 con 0x5649dbcfb7d0 2024-04-24T02:13:28.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.539+0000 7f97d9f7e640 1 --2- 172.21.15.134:0/2559827488 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f97d0047130 0x7f97d004b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:28.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.539+0000 7f97d9f7e640 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcfe1a0 con 0x7f97d0047130 2024-04-24T02:13:28.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.539+0000 7f97daf80640 1 --2- 172.21.15.134:0/2559827488 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f97d0047130 0x7f97d004b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:28.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.539+0000 7f97daf80640 1 --2- 172.21.15.134:0/2559827488 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f97d0047130 0x7f97d004b530 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:28.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.539+0000 7f97daf80640 1 -- 172.21.15.134:0/2559827488 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97d401f070 con 0x7f97d0047130 2024-04-24T02:13:28.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.539+0000 7f97daf80640 1 --2- 172.21.15.134:0/2559827488 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f97d4031040 0x7f97d4032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:28.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.539+0000 7f97daf80640 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcfe1a0 con 0x7f97d4031040 2024-04-24T02:13:28.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.540+0000 7f97da77f640 1 --2- 172.21.15.134:0/2559827488 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f97d4031040 0x7f97d4032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:28.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.540+0000 7f97da77f640 1 --2- 172.21.15.134:0/2559827488 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f97d4031040 0x7f97d4032940 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:28.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.540+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97cc071990 con 0x7f97d4031040 2024-04-24T02:13:28.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.540+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcf9a60 con 0x5649dbcf5580 2024-04-24T02:13:28.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.541+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97cc071990 con 0x5649dbcf5580 2024-04-24T02:13:28.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.541+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcf9a60 con 0x5649dbcf5580 2024-04-24T02:13:28.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.541+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f97cc071990 con 0x5649dbcf5580 2024-04-24T02:13:28.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.541+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcf9a60 con 0x7f97d4031040 2024-04-24T02:13:28.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.541+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97cc071990 con 0x7f97d4031040 2024-04-24T02:13:28.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.541+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcf9a60 con 0x7f97d0047130 2024-04-24T02:13:28.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.541+0000 7f97daf80640 1 -- 172.21.15.134:0/2559827488 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97d401f070 con 0x7f97d0047130 2024-04-24T02:13:28.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.541+0000 7f97daf80640 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcf9a60 con 0x7f97d0047130 2024-04-24T02:13:28.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.542+0000 7f97daf80640 1 -- 172.21.15.134:0/2559827488 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97d401f070 con 0x7f97d0047130 2024-04-24T02:13:28.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.542+0000 7f97daf80640 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcf9a60 con 0x5649dbcfb7d0 2024-04-24T02:13:28.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.542+0000 7f97d9f7e640 1 -- 172.21.15.134:0/2559827488 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97d0009050 con 0x5649dbcfb7d0 2024-04-24T02:13:28.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.542+0000 7f97d9f7e640 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcf9a60 con 0x5649dbcf5580 2024-04-24T02:13:28.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.542+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97cc071990 con 0x5649dbcf5580 2024-04-24T02:13:28.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.542+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcf9a60 con 0x7f97d4031040 2024-04-24T02:13:28.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.543+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97cc071990 con 0x7f97d4031040 2024-04-24T02:13:28.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.543+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcf9a60 con 0x5649dbcf5580 2024-04-24T02:13:28.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.543+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97cc071990 con 0x5649dbcf5580 2024-04-24T02:13:28.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.543+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcf9a60 con 0x7f97d0047130 2024-04-24T02:13:28.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.543+0000 7f97daf80640 1 -- 172.21.15.134:0/2559827488 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f97d401f070 con 0x7f97d0047130 2024-04-24T02:13:28.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.543+0000 7f97daf80640 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcf9a60 con 0x5649dbcfb7d0 2024-04-24T02:13:28.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.543+0000 7f97d9f7e640 1 -- 172.21.15.134:0/2559827488 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97d0009050 con 0x5649dbcfb7d0 2024-04-24T02:13:28.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.543+0000 7f97d9f7e640 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcf9a60 con 0x5649dbcfb7d0 2024-04-24T02:13:28.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.544+0000 7f97d9f7e640 1 -- 172.21.15.134:0/2559827488 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97d0009050 con 0x5649dbcfb7d0 2024-04-24T02:13:28.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.544+0000 7f97d9f7e640 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcf9a60 con 0x7f97d0047130 2024-04-24T02:13:28.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.544+0000 7f97daf80640 1 -- 172.21.15.134:0/2559827488 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97d401f070 con 0x7f97d0047130 2024-04-24T02:13:28.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.544+0000 7f97daf80640 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcf9a60 con 0x5649dbcfb7d0 2024-04-24T02:13:28.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.544+0000 7f97d9f7e640 1 -- 172.21.15.134:0/2559827488 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97d0009050 con 0x5649dbcfb7d0 2024-04-24T02:13:28.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.544+0000 7f97d9f7e640 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcf9a60 con 0x5649dbcfb7d0 2024-04-24T02:13:28.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.544+0000 7f97d9f7e640 1 -- 172.21.15.134:0/2559827488 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97d0009050 con 0x5649dbcfb7d0 2024-04-24T02:13:28.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.544+0000 7f97d9f7e640 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcf9a60 con 0x5649dbcf5580 2024-04-24T02:13:28.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.545+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97cc071990 con 0x5649dbcf5580 2024-04-24T02:13:28.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.545+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcf9a60 con 0x5649dbcf5580 2024-04-24T02:13:28.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.545+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f97cc071990 con 0x5649dbcf5580 2024-04-24T02:13:28.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.545+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcf9a60 con 0x7f97d4031040 2024-04-24T02:13:28.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.545+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97cc071990 con 0x7f97d4031040 2024-04-24T02:13:28.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.545+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcf9a60 con 0x5649dbcfb7d0 2024-04-24T02:13:28.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.545+0000 7f97d9f7e640 1 -- 172.21.15.134:0/2559827488 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97d0009050 con 0x5649dbcfb7d0 2024-04-24T02:13:28.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.546+0000 7f97d9f7e640 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcf9a60 con 0x7f97d0047130 2024-04-24T02:13:28.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.546+0000 7f97daf80640 1 -- 172.21.15.134:0/2559827488 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97d401f070 con 0x7f97d0047130 2024-04-24T02:13:28.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.546+0000 7f97daf80640 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcf9a60 con 0x5649dbcf5580 2024-04-24T02:13:28.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.546+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97cc071990 con 0x5649dbcf5580 2024-04-24T02:13:28.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.546+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcf9a60 con 0x7f97d4031040 2024-04-24T02:13:28.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.546+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97cc071990 con 0x7f97d4031040 2024-04-24T02:13:28.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.546+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcf9a60 con 0x5649dbcfb7d0 2024-04-24T02:13:28.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.547+0000 7f97d9f7e640 1 -- 172.21.15.134:0/2559827488 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97d0009050 con 0x5649dbcfb7d0 2024-04-24T02:13:28.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.547+0000 7f97d9f7e640 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcf9a60 con 0x7f97d4031040 2024-04-24T02:13:28.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.547+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97cc071990 con 0x7f97d4031040 2024-04-24T02:13:28.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.547+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcf9a60 con 0x7f97d0047130 2024-04-24T02:13:28.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.548+0000 7f97daf80640 1 -- 172.21.15.134:0/2559827488 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97d4040040 con 0x7f97d0047130 2024-04-24T02:13:28.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.548+0000 7f97daf80640 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcf9a60 con 0x5649dbcfb7d0 2024-04-24T02:13:28.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.548+0000 7f97d9f7e640 1 -- 172.21.15.134:0/2559827488 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97d0009050 con 0x5649dbcfb7d0 2024-04-24T02:13:28.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.548+0000 7f97d9f7e640 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcf9a60 con 0x7f97d0047130 2024-04-24T02:13:28.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.548+0000 7f97daf80640 1 -- 172.21.15.134:0/2559827488 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97d4040040 con 0x7f97d0047130 2024-04-24T02:13:28.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.548+0000 7f97daf80640 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcf9a60 con 0x5649dbcf5580 2024-04-24T02:13:28.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.548+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f97cc071990 con 0x5649dbcf5580 2024-04-24T02:13:28.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.548+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcf9a60 con 0x7f97d0047130 2024-04-24T02:13:28.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.549+0000 7f97daf80640 1 -- 172.21.15.134:0/2559827488 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97d4040040 con 0x7f97d0047130 2024-04-24T02:13:28.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.549+0000 7f97deb2d800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:13:28.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.549+0000 7f97deb2d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:13:28.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.549+0000 7f97deb2d800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:13:28.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.549+0000 7f97deb2d800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:13:28.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.549+0000 7f97deb2d800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:13:28.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.549+0000 7f97deb2d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:13:28.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.549+0000 7f97deb2d800 20 rados->read ofs=0 len=0 2024-04-24T02:13:28.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.549+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcfa2b0 con 0x5649dbcf5580 2024-04-24T02:13:28.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.549+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f97cc071990 con 0x5649dbcf5580 2024-04-24T02:13:28.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.549+0000 7f97deb2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:28.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.549+0000 7f97deb2d800 20 rados->read ofs=0 len=0 2024-04-24T02:13:28.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.549+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcfa6a0 con 0x5649dbcf5580 2024-04-24T02:13:28.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.549+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f97cc071990 con 0x5649dbcf5580 2024-04-24T02:13:28.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.549+0000 7f97deb2d800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:13:28.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.549+0000 7f97deb2d800 20 rados->read ofs=0 len=0 2024-04-24T02:13:28.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.549+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcfa6a0 con 0x5649dbcf5580 2024-04-24T02:13:28.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.550+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f97cc071990 con 0x5649dbcf5580 2024-04-24T02:13:28.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.550+0000 7f97deb2d800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:13:28.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.550+0000 7f97deb2d800 20 zone default found 2024-04-24T02:13:28.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.550+0000 7f97deb2d800 4 Realm: () 2024-04-24T02:13:28.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.550+0000 7f97deb2d800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:13:28.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.550+0000 7f97deb2d800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:13:28.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.550+0000 7f97deb2d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:13:28.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.550+0000 7f97deb2d800 20 zonegroup default 2024-04-24T02:13:28.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.550+0000 7f97deb2d800 20 rados->read ofs=0 len=0 2024-04-24T02:13:28.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.550+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcfe620 con 0x7f97d4031040 2024-04-24T02:13:28.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.550+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f97cc071990 con 0x7f97d4031040 2024-04-24T02:13:28.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.550+0000 7f97deb2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:28.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.550+0000 7f97deb2d800 20 rados->read ofs=0 len=0 2024-04-24T02:13:28.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.550+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649dbd00000 con 0x5649dbcfb7d0 2024-04-24T02:13:28.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.551+0000 7f97d9f7e640 1 -- 172.21.15.134:0/2559827488 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f97d0009050 con 0x5649dbcfb7d0 2024-04-24T02:13:28.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.551+0000 7f97deb2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:28.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.551+0000 7f97deb2d800 20 rados->read ofs=0 len=0 2024-04-24T02:13:28.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.551+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649dbd003a0 con 0x5649dbcfb7d0 2024-04-24T02:13:28.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.551+0000 7f97d9f7e640 1 -- 172.21.15.134:0/2559827488 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f97d0009050 con 0x5649dbcfb7d0 2024-04-24T02:13:28.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.551+0000 7f97deb2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:28.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.551+0000 7f97deb2d800 20 started sync module instance, tier type = 2024-04-24T02:13:28.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.551+0000 7f97deb2d800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:13:28.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.551+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcff4a0 con 0x7f97d0047130 2024-04-24T02:13:28.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.552+0000 7f97daf80640 1 -- 172.21.15.134:0/2559827488 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(44 notify.0 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97d4040040 con 0x7f97d0047130 2024-04-24T02:13:28.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.552+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94875220441280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcff100 con 0x7f97d0047130 2024-04-24T02:13:28.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.552+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649dbd010e0 con 0x5649dbcf5580 2024-04-24T02:13:28.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.553+0000 7f97daf80640 1 -- 172.21.15.134:0/2559827488 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94875220441280] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97d4040040 con 0x7f97d0047130 2024-04-24T02:13:28.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.554+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97cc071990 con 0x5649dbcf5580 2024-04-24T02:13:28.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.554+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94875220444992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649dbd01010 con 0x5649dbcf5580 2024-04-24T02:13:28.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.554+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649dbd01b30 con 0x5649dbcfb7d0 2024-04-24T02:13:28.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.555+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94875220444992] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97cc071990 con 0x5649dbcf5580 2024-04-24T02:13:28.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.555+0000 7f97d9f7e640 1 -- 172.21.15.134:0/2559827488 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97d0009050 con 0x5649dbcfb7d0 2024-04-24T02:13:28.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.555+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94875220446048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649dbd00f80 con 0x5649dbcfb7d0 2024-04-24T02:13:28.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.555+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649dbd029f0 con 0x7f97d0047130 2024-04-24T02:13:28.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.556+0000 7f97daf80640 1 -- 172.21.15.134:0/2559827488 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(50 notify.3 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97d4040040 con 0x7f97d0047130 2024-04-24T02:13:28.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.556+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94875220453152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649dbd03170 con 0x7f97d0047130 2024-04-24T02:13:28.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.556+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649dbd03c70 con 0x5649dbcf5580 2024-04-24T02:13:28.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.556+0000 7f97d9f7e640 1 -- 172.21.15.134:0/2559827488 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94875220446048] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97d0009050 con 0x5649dbcfb7d0 2024-04-24T02:13:28.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.557+0000 7f97daf80640 1 -- 172.21.15.134:0/2559827488 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94875220453152] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97d4040040 con 0x7f97d0047130 2024-04-24T02:13:28.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.558+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97cc071990 con 0x5649dbcf5580 2024-04-24T02:13:28.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.558+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94875220457312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649dbd03c30 con 0x5649dbcf5580 2024-04-24T02:13:28.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.558+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649dbd04540 con 0x7f97d4031040 2024-04-24T02:13:28.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.559+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(54 notify.5 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97cc071990 con 0x7f97d4031040 2024-04-24T02:13:28.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.559+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94875220459584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649dbd04910 con 0x7f97d4031040 2024-04-24T02:13:28.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.559+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649dbd05160 con 0x7f97d4031040 2024-04-24T02:13:28.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.559+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94875220457312] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97cc071990 con 0x5649dbcf5580 2024-04-24T02:13:28.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.560+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94875220459584] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97cc071990 con 0x7f97d4031040 2024-04-24T02:13:28.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.560+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(56 notify.6 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97cc071990 con 0x7f97d4031040 2024-04-24T02:13:28.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.560+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94875220460640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649dbd04d30 con 0x7f97d4031040 2024-04-24T02:13:28.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.560+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649dbd05580 con 0x7f97d4031040 2024-04-24T02:13:28.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.562+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(58 notify.7 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97cc071990 con 0x7f97d4031040 2024-04-24T02:13:28.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.562+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94875220463408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649dbd059b0 con 0x7f97d4031040 2024-04-24T02:13:28.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.562+0000 7f97deb2d800 20 add_watcher() i=0 2024-04-24T02:13:28.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.562+0000 7f97deb2d800 20 add_watcher() i=1 2024-04-24T02:13:28.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.562+0000 7f97deb2d800 20 add_watcher() i=2 2024-04-24T02:13:28.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.562+0000 7f97deb2d800 20 add_watcher() i=3 2024-04-24T02:13:28.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.562+0000 7f97deb2d800 20 add_watcher() i=4 2024-04-24T02:13:28.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.562+0000 7f97deb2d800 20 add_watcher() i=5 2024-04-24T02:13:28.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.562+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94875220460640] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97cc071990 con 0x7f97d4031040 2024-04-24T02:13:28.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.562+0000 7f97deb2d800 20 add_watcher() i=6 2024-04-24T02:13:28.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.564+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94875220463408] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97cc071990 con 0x7f97d4031040 2024-04-24T02:13:28.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.564+0000 7f97deb2d800 20 add_watcher() i=7 2024-04-24T02:13:28.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.564+0000 7f97deb2d800 2 all 8 watchers are set, enabling cache 2024-04-24T02:13:28.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.564+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649dbd04880 con 0x5649dbcf5580 2024-04-24T02:13:28.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.564+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f97cc071990 con 0x5649dbcf5580 2024-04-24T02:13:28.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.564+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94875220461696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649dbd05ec0 con 0x5649dbcf5580 2024-04-24T02:13:28.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.565+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94875220461696] v32'221 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f97cc071990 con 0x5649dbcf5580 2024-04-24T02:13:28.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.565+0000 7f9690fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:13:28.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.566+0000 7f97deb2d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:13:28.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.566+0000 7f97deb2d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:13:28.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.566+0000 7f97deb2d800 5 note: GC not initialized 2024-04-24T02:13:28.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.566+0000 7f960b7fe640 20 reqs_thread_entry: start 2024-04-24T02:13:28.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.566+0000 7f97deb2d800 20 init_complete bucket index max shards: 11 2024-04-24T02:13:28.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.566+0000 7f97deb2d800 20 Filter name: none 2024-04-24T02:13:28.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.566+0000 7f96097fa640 20 reqs_thread_entry: start 2024-04-24T02:13:28.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.566+0000 7f97deb2d800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-24T02:13:28.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.566+0000 7f97deb2d800 20 rados->read ofs=0 len=0 2024-04-24T02:13:28.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.566+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649dbd3bd70 con 0x7f97d4031040 2024-04-24T02:13:28.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.567+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f97cc071990 con 0x7f97d4031040 2024-04-24T02:13:28.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.567+0000 7f97deb2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:28.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.567+0000 7f97deb2d800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-04-24T02:13:28.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.567+0000 7f97deb2d800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-24T02:13:28.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.567+0000 7f97deb2d800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-04-24T02:13:28.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.567+0000 7f97deb2d800 20 rados->read ofs=0 len=0 2024-04-24T02:13:28.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.567+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649dbd3a510 con 0x7f97d4031040 2024-04-24T02:13:28.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.567+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f97cc071990 con 0x7f97d4031040 2024-04-24T02:13:28.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.567+0000 7f97deb2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:28.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.567+0000 7f97deb2d800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-04-24T02:13:28.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.567+0000 7f97deb2d800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-24T02:13:28.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.567+0000 7f97deb2d800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-24T02:13:28.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.567+0000 7f97deb2d800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-24T02:13:28.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.567+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649dbd3ae00 con 0x7f97d4031040 2024-04-24T02:13:28.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.569+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v32'5 uv5 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f97cc071990 con 0x7f97d4031040 2024-04-24T02:13:28.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.569+0000 7f97deb2d800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-04-24T02:13:28.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.569+0000 7f97deb2d800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-04-24T02:13:28.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.569+0000 7f97deb2d800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-04-24T02:13:28.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.569+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94875220683088 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649dbd3f810 con 0x7f97d4031040 2024-04-24T02:13:28.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.569+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== watch-notify(notify (1) cookie 94875220459584 notify 137438953509 ret 0) ==== 598+0+0 (crc 0 0 0) 0x5649dbd3b1a0 con 0x7f97d4031040 2024-04-24T02:13:28.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.569+0000 7f96bdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953509 cookie 94875220459584 notifier 4732 bl.length()=556 2024-04-24T02:13:28.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.569+0000 7f96bdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-04-24T02:13:28.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.569+0000 7f96bdffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-04-24T02:13:28.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.569+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(65 notify.5 [notify cookie 94875220683088 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f97cc071990 con 0x7f97d4031040 2024-04-24T02:13:28.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.569+0000 7f96bdffb640 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f96a0003ea0 con 0x7f97d4031040 2024-04-24T02:13:28.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.569+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97cc071990 con 0x7f97d4031040 2024-04-24T02:13:28.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.569+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 <== osd.0 v2:172.21.15.104:6800/2419146313 20 ==== watch-notify(notify_complete (2) cookie 94875220683088 notify 137438953509 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5649dbd3b7c0 con 0x7f97d4031040 2024-04-24T02:13:28.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.569+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649dbd3a900 con 0x7f97d4031040 2024-04-24T02:13:28.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.571+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 <== osd.0 v2:172.21.15.104:6800/2419146313 21 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v32'11 uv11 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f97cc071990 con 0x7f97d4031040 2024-04-24T02:13:28.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.571+0000 7f97deb2d800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-24T02:13:28.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.571+0000 7f97deb2d800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-24T02:13:28.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.571+0000 7f97deb2d800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-24T02:13:28.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.571+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94875220697936 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649dbd3a900 con 0x5649dbcfb7d0 2024-04-24T02:13:28.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.571+0000 7f97d9f7e640 1 -- 172.21.15.134:0/2559827488 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== watch-notify(notify (1) cookie 94875220446048 notify 137438953487 ret 0) ==== 219+0+0 (crc 0 0 0) 0x5649dbcea140 con 0x5649dbcfb7d0 2024-04-24T02:13:28.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.571+0000 7f96bdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953487 cookie 94875220446048 notifier 4732 bl.length()=177 2024-04-24T02:13:28.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.571+0000 7f96bdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-24T02:13:28.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.571+0000 7f96bdffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-24T02:13:28.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.571+0000 7f97d9f7e640 1 -- 172.21.15.134:0/2559827488 <== osd.3 v2:172.21.15.134:6801/3585115521 15 ==== osd_op_reply(68 notify.2 [notify cookie 94875220697936 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f97d0009050 con 0x5649dbcfb7d0 2024-04-24T02:13:28.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.571+0000 7f96bdffb640 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f96a0003ea0 con 0x5649dbcfb7d0 2024-04-24T02:13:28.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.571+0000 7f97d9f7e640 1 -- 172.21.15.134:0/2559827488 <== osd.3 v2:172.21.15.134:6801/3585115521 16 ==== watch-notify(notify_complete (2) cookie 94875220697936 notify 137438953487 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5649dbce2fc0 con 0x5649dbcfb7d0 2024-04-24T02:13:28.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.571+0000 7f97d9f7e640 1 -- 172.21.15.134:0/2559827488 <== osd.3 v2:172.21.15.134:6801/3585115521 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97d0009050 con 0x5649dbcfb7d0 2024-04-24T02:13:28.599 INFO:teuthology.orchestra.run.smithi134.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-04-24T02:13:28.569057Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T02:13:28.569029Z","tags":[],"group_ids":[]} 2024-04-24T02:13:28.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.572+0000 7f9690fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:13:28.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.572+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94875220461696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcf2160 con 0x5649dbcf5580 2024-04-24T02:13:28.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.573+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94875220461696] v32'222 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f97cc071990 con 0x5649dbcf5580 2024-04-24T02:13:28.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.573+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94875220441280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649dbd04880 con 0x7f97d0047130 2024-04-24T02:13:28.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.574+0000 7f97daf80640 1 -- 172.21.15.134:0/2559827488 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94875220441280] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97d4040040 con 0x7f97d0047130 2024-04-24T02:13:28.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.574+0000 7f97deb2d800 20 remove_watcher() i=0 2024-04-24T02:13:28.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.574+0000 7f97deb2d800 2 removed watcher, disabling cache 2024-04-24T02:13:28.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.574+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94875220444992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcff8c0 con 0x5649dbcf5580 2024-04-24T02:13:28.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.576+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94875220444992] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97cc071990 con 0x5649dbcf5580 2024-04-24T02:13:28.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.576+0000 7f97deb2d800 20 remove_watcher() i=1 2024-04-24T02:13:28.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.576+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94875220446048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcff8c0 con 0x5649dbcfb7d0 2024-04-24T02:13:28.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.577+0000 7f97d9f7e640 1 -- 172.21.15.134:0/2559827488 <== osd.3 v2:172.21.15.134:6801/3585115521 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94875220446048] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97d0009050 con 0x5649dbcfb7d0 2024-04-24T02:13:28.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.577+0000 7f97deb2d800 20 remove_watcher() i=2 2024-04-24T02:13:28.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.577+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94875220453152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcff8c0 con 0x7f97d0047130 2024-04-24T02:13:28.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.578+0000 7f97daf80640 1 -- 172.21.15.134:0/2559827488 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94875220453152] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97d4040040 con 0x7f97d0047130 2024-04-24T02:13:28.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.578+0000 7f97deb2d800 20 remove_watcher() i=3 2024-04-24T02:13:28.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.578+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94875220457312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcff8c0 con 0x5649dbcf5580 2024-04-24T02:13:28.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.579+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94875220457312] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97cc071990 con 0x5649dbcf5580 2024-04-24T02:13:28.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.579+0000 7f97deb2d800 20 remove_watcher() i=4 2024-04-24T02:13:28.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.579+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94875220459584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcff8c0 con 0x7f97d4031040 2024-04-24T02:13:28.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.581+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 <== osd.0 v2:172.21.15.104:6800/2419146313 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94875220459584] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97cc071990 con 0x7f97d4031040 2024-04-24T02:13:28.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.581+0000 7f97deb2d800 20 remove_watcher() i=5 2024-04-24T02:13:28.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.581+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94875220460640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649dbd04040 con 0x7f97d4031040 2024-04-24T02:13:28.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.582+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 <== osd.0 v2:172.21.15.104:6800/2419146313 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94875220460640] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97cc071990 con 0x7f97d4031040 2024-04-24T02:13:28.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.582+0000 7f97deb2d800 20 remove_watcher() i=6 2024-04-24T02:13:28.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.582+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94875220463408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649dbcff8c0 con 0x7f97d4031040 2024-04-24T02:13:28.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.583+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 <== osd.0 v2:172.21.15.104:6800/2419146313 24 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94875220463408] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97cc071990 con 0x7f97d4031040 2024-04-24T02:13:28.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.583+0000 7f97deb2d800 20 remove_watcher() i=7 2024-04-24T02:13:28.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.583+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f97d4031040 msgr2=0x7f97d4032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:28.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.583+0000 7f97deb2d800 1 --2- 172.21.15.134:0/2559827488 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f97d4031040 0x7f97d4032940 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.583+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5649dbcf5580 msgr2=0x5649dbcf7a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:28.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.583+0000 7f97deb2d800 1 --2- 172.21.15.134:0/2559827488 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5649dbcf5580 0x5649dbcf7a40 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.583+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f97d0047130 msgr2=0x7f97d004b530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:28.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.583+0000 7f97deb2d800 1 --2- 172.21.15.134:0/2559827488 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f97d0047130 0x7f97d004b530 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.583+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5649dbcfb7d0 msgr2=0x5649dbcfdbc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:28.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.583+0000 7f97deb2d800 1 --2- 172.21.15.134:0/2559827488 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5649dbcfb7d0 0x5649dbcfdbc0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.583+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f96a40368b0 msgr2=0x7f96a4038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:28.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.583+0000 7f97deb2d800 1 --2- 172.21.15.134:0/2559827488 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f96a40368b0 0x7f96a4038d70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x5649dbcbf3a0 tx=0x7f97d401f000 comp rx=0 tx=0).stop 2024-04-24T02:13:28.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.583+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5649dbce25d0 msgr2=0x5649dbce9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:28.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.583+0000 7f97da77f640 1 -- 172.21.15.134:0/2559827488 reap_dead start 2024-04-24T02:13:28.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.583+0000 7f97deb2d800 1 --2- 172.21.15.134:0/2559827488 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5649dbce25d0 0x5649dbce9c00 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f97d001afd0 tx=0x7f97d004cd40 comp rx=0 tx=0).stop 2024-04-24T02:13:28.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.583+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 shutdown_connections 2024-04-24T02:13:28.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.583+0000 7f97deb2d800 1 --2- 172.21.15.134:0/2559827488 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5649dbce25d0 0x5649dbce9c00 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.583+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 >> 172.21.15.134:0/2559827488 conn(0x5649dbcde930 msgr2=0x5649dbcdbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:28.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.583+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 shutdown_connections 2024-04-24T02:13:28.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.583+0000 7f97deb2d800 1 -- 172.21.15.134:0/2559827488 wait complete. 2024-04-24T02:13:28.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.584+0000 7f97deb2d800 1 -- 172.21.15.134:0/465677125 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f96b4036950 msgr2=0x7f96b4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:28.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.584+0000 7f97deb2d800 1 --2- 172.21.15.134:0/465677125 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f96b4036950 0x7f96b4038e10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x5649dbcc30b0 tx=0x7f97d4005840 comp rx=0 tx=0).stop 2024-04-24T02:13:28.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.584+0000 7f97deb2d800 1 -- 172.21.15.134:0/465677125 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5649dbbc2500 msgr2=0x5649dbbc0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:28.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.584+0000 7f97deb2d800 1 --2- 172.21.15.134:0/465677125 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5649dbbc2500 0x5649dbbc0970 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f97d000efd0 tx=0x7f97d000d7a0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.584+0000 7f97deb2d800 1 -- 172.21.15.134:0/465677125 shutdown_connections 2024-04-24T02:13:28.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.584+0000 7f97deb2d800 1 --2- 172.21.15.134:0/465677125 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f96b4036950 0x7f96b4038e10 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.584+0000 7f97deb2d800 1 --2- 172.21.15.134:0/465677125 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5649dbbc2500 0x5649dbbc0970 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.584+0000 7f97deb2d800 1 -- 172.21.15.134:0/465677125 >> 172.21.15.134:0/465677125 conn(0x5649dbcc70c0 msgr2=0x5649dbcc74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:28.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.584+0000 7f97deb2d800 1 -- 172.21.15.134:0/465677125 shutdown_connections 2024-04-24T02:13:28.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.584+0000 7f97deb2d800 1 -- 172.21.15.134:0/465677125 wait complete. 2024-04-24T02:13:28.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.584+0000 7f97deb2d800 1 -- 172.21.15.134:0/4058554354 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5649dbbc5270 msgr2=0x5649dbcc1e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:28.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.584+0000 7f97deb2d800 1 --2- 172.21.15.134:0/4058554354 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5649dbbc5270 0x5649dbcc1e80 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.584+0000 7f97deb2d800 1 -- 172.21.15.134:0/4058554354 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f96c0036900 msgr2=0x7f96c0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:28.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.584+0000 7f97deb2d800 1 --2- 172.21.15.134:0/4058554354 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f96c0036900 0x7f96c0038dc0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f97d0001d90 tx=0x7f97d00012f0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.584+0000 7f97deb2d800 1 -- 172.21.15.134:0/4058554354 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5649dbbc2940 msgr2=0x5649dbcbac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:28.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.584+0000 7f97deb2d800 1 --2- 172.21.15.134:0/4058554354 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5649dbbc2940 0x5649dbcbac40 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f97cc060040 tx=0x7f97cc002fb0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.584+0000 7f97deb2d800 1 -- 172.21.15.134:0/4058554354 shutdown_connections 2024-04-24T02:13:28.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.584+0000 7f97deb2d800 1 --2- 172.21.15.134:0/4058554354 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5649dbbc5270 0x5649dbcc1e80 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.584+0000 7f97deb2d800 1 --2- 172.21.15.134:0/4058554354 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f96c0036900 0x7f96c0038dc0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.584+0000 7f97deb2d800 1 --2- 172.21.15.134:0/4058554354 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5649dbbc2940 0x5649dbcbac40 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.584+0000 7f97deb2d800 1 -- 172.21.15.134:0/4058554354 >> 172.21.15.134:0/4058554354 conn(0x5649dbbbc370 msgr2=0x5649dbcad310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:28.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.584+0000 7f97deb2d800 1 -- 172.21.15.134:0/4058554354 shutdown_connections 2024-04-24T02:13:28.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.584+0000 7f97deb2d800 1 -- 172.21.15.134:0/4058554354 wait complete. 2024-04-24T02:13:28.610 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-04-24T02:13:28.569057Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:13:28.569029Z', 'tags': [], 'group_ids': []} 2024-04-24T02:13:28.623 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-04-24T02:13:28.627 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-04-24T02:13:28.627 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-04-24T02:13:28.628 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-04-24T02:13:28.628 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-04-24T02:13:28.672 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:13:28.673 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:13:28.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.672+0000 7f3499731800 1 Processor -- start 2024-04-24T02:13:28.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.672+0000 7f3499731800 1 -- start start 2024-04-24T02:13:28.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.672+0000 7f3499731800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x557165256970 0x557165258d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:28.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.672+0000 7f3499731800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557165114d40 con 0x5571652592a0 2024-04-24T02:13:28.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.672+0000 7f3499731800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x5571650e74d0 con 0x557165256970 2024-04-24T02:13:28.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.672+0000 7f34954f2640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x557165256970 0x557165258d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:28.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.672+0000 7f3494cf1640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x5571652592a0 0x55716525b690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:43422/0 (socket says 172.21.15.134:43422) 2024-04-24T02:13:28.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.672+0000 7f34954f2640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x557165256970 0x557165258d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:48648/0 (socket says 172.21.15.134:48648) 2024-04-24T02:13:28.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.672+0000 7f3494cf1640 1 -- 172.21.15.134:0/1359156748 learned_addr learned my addr 172.21.15.134:0/1359156748 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:13:28.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.673+0000 7f34954f2640 1 -- 172.21.15.134:0/1359156748 >> v1:172.21.15.104:6789/0 conn(0x5571652592a0 legacy=0x55716525b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:28.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.673+0000 7f34954f2640 1 -- 172.21.15.134:0/1359156748 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557165113590 con 0x557165256970 2024-04-24T02:13:28.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.673+0000 7f3487fff640 1 -- 172.21.15.134:0/1359156748 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1951795542 0 0) 0x557165114d40 con 0x5571652592a0 2024-04-24T02:13:28.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.674+0000 7f34954f2640 1 --2- 172.21.15.134:0/1359156748 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557165256970 0x557165258d60 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f348c00a470 tx=0x7f348c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cceac6355f68787 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:28.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.675+0000 7f3487fff640 1 -- 172.21.15.134:0/1359156748 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f348c057070 con 0x557165256970 2024-04-24T02:13:28.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.675+0000 7f3487fff640 1 -- 172.21.15.134:0/1359156748 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f348c052570 con 0x557165256970 2024-04-24T02:13:28.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.675+0000 7f3487fff640 1 -- 172.21.15.134:0/1359156748 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f348c052870 con 0x557165256970 2024-04-24T02:13:28.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.675+0000 7f3499731800 1 -- 172.21.15.134:0/1359156748 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557165256970 msgr2=0x557165258d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:28.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.675+0000 7f3499731800 1 --2- 172.21.15.134:0/1359156748 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557165256970 0x557165258d60 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f348c00a470 tx=0x7f348c01ce90 comp rx=0 tx=0).stop 2024-04-24T02:13:28.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.675+0000 7f3499731800 1 -- 172.21.15.134:0/1359156748 shutdown_connections 2024-04-24T02:13:28.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.675+0000 7f3499731800 1 --2- 172.21.15.134:0/1359156748 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557165256970 0x557165258d60 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.675+0000 7f3499731800 1 -- 172.21.15.134:0/1359156748 >> 172.21.15.134:0/1359156748 conn(0x5571652503a0 msgr2=0x5571652527c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:28.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.675+0000 7f3499731800 1 -- 172.21.15.134:0/1359156748 shutdown_connections 2024-04-24T02:13:28.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.675+0000 7f3499731800 1 -- 172.21.15.134:0/1359156748 wait complete. 2024-04-24T02:13:28.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.687+0000 7f3499731800 1 Processor -- start 2024-04-24T02:13:28.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.687+0000 7f3499731800 1 -- start start 2024-04-24T02:13:28.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.687+0000 7f3499731800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557165256970 0x557165346e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:28.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.687+0000 7f3499731800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5571651a13b0 con 0x557165256970 2024-04-24T02:13:28.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.687+0000 7f34954f2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557165256970 0x557165346e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:28.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.687+0000 7f34954f2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557165256970 0x557165346e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:48662/0 (socket says 172.21.15.134:48662) 2024-04-24T02:13:28.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.687+0000 7f34954f2640 1 -- 172.21.15.134:0/1949097126 learned_addr learned my addr 172.21.15.134:0/1949097126 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:28.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.688+0000 7f34954f2640 1 -- 172.21.15.134:0/1949097126 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557165347430 con 0x557165256970 2024-04-24T02:13:28.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.688+0000 7f34954f2640 1 --2- 172.21.15.134:0/1949097126 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557165256970 0x557165346e60 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f348c055040 tx=0x7f348c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54db83f15bfa15f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:28.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.688+0000 7f3383606640 1 -- 172.21.15.134:0/1949097126 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f348c063070 con 0x557165256970 2024-04-24T02:13:28.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.688+0000 7f3383606640 1 -- 172.21.15.134:0/1949097126 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f348c058040 con 0x557165256970 2024-04-24T02:13:28.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.688+0000 7f3383606640 1 -- 172.21.15.134:0/1949097126 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f348c057070 con 0x557165256970 2024-04-24T02:13:28.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.689+0000 7f3499731800 1 -- 172.21.15.134:0/1949097126 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557165256970 msgr2=0x557165346e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:28.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.689+0000 7f3499731800 1 --2- 172.21.15.134:0/1949097126 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557165256970 0x557165346e60 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f348c055040 tx=0x7f348c04c000 comp rx=0 tx=0).stop 2024-04-24T02:13:28.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.689+0000 7f3499731800 1 -- 172.21.15.134:0/1949097126 shutdown_connections 2024-04-24T02:13:28.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.689+0000 7f3499731800 1 --2- 172.21.15.134:0/1949097126 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557165256970 0x557165346e60 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.689+0000 7f3499731800 1 -- 172.21.15.134:0/1949097126 >> 172.21.15.134:0/1949097126 conn(0x5571652503a0 msgr2=0x557165342780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:28.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.689+0000 7f3499731800 1 -- 172.21.15.134:0/1949097126 shutdown_connections 2024-04-24T02:13:28.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.689+0000 7f3499731800 1 -- 172.21.15.134:0/1949097126 wait complete. 2024-04-24T02:13:28.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.689+0000 7f3499731800 1 Processor -- start 2024-04-24T02:13:28.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.689+0000 7f3499731800 1 -- start start 2024-04-24T02:13:28.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.689+0000 7f3499731800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557165256970 0x55716534e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:28.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.689+0000 7f3499731800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55716525f0c0 con 0x557165256970 2024-04-24T02:13:28.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.689+0000 7f34954f2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557165256970 0x55716534e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:28.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.689+0000 7f34954f2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557165256970 0x55716534e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:48672/0 (socket says 172.21.15.134:48672) 2024-04-24T02:13:28.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.689+0000 7f34954f2640 1 -- 172.21.15.134:0/3020605605 learned_addr learned my addr 172.21.15.134:0/3020605605 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:28.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.690+0000 7f34954f2640 1 -- 172.21.15.134:0/3020605605 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55716534ee10 con 0x557165256970 2024-04-24T02:13:28.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.690+0000 7f34954f2640 1 --2- 172.21.15.134:0/3020605605 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557165256970 0x55716534e8d0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f348c005870 tx=0x7f348c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:28.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.690+0000 7f3381e03640 1 -- 172.21.15.134:0/3020605605 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f348c063030 con 0x557165256970 2024-04-24T02:13:28.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.690+0000 7f3381e03640 1 -- 172.21.15.134:0/3020605605 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f348c052cb0 con 0x557165256970 2024-04-24T02:13:28.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.690+0000 7f3499731800 1 -- 172.21.15.134:0/3020605605 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55716534f0a0 con 0x557165256970 2024-04-24T02:13:28.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.690+0000 7f3381e03640 1 -- 172.21.15.134:0/3020605605 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f348c05e480 con 0x557165256970 2024-04-24T02:13:28.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.690+0000 7f3499731800 1 -- 172.21.15.134:0/3020605605 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557165351d50 con 0x557165256970 2024-04-24T02:13:28.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.691+0000 7f3381e03640 1 -- 172.21.15.134:0/3020605605 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f348c05e620 con 0x557165256970 2024-04-24T02:13:28.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.691+0000 7f3381e03640 1 --2- 172.21.15.134:0/3020605605 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f337c036900 0x7f337c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:28.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.691+0000 7f3381e03640 1 -- 172.21.15.134:0/3020605605 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f348c064070 con 0x557165256970 2024-04-24T02:13:28.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.691+0000 7f3494cf1640 1 --2- 172.21.15.134:0/3020605605 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f337c036900 0x7f337c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:28.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.691+0000 7f3499731800 1 --2- 172.21.15.134:0/3020605605 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5571652592a0 0x557165355b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:28.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.691+0000 7f3499731800 1 -- 172.21.15.134:0/3020605605 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557165356050 con 0x5571652592a0 2024-04-24T02:13:28.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.691+0000 7f3495cf3640 1 --2- 172.21.15.134:0/3020605605 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5571652592a0 0x557165355b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:28.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.692+0000 7f3494cf1640 1 --2- 172.21.15.134:0/3020605605 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f337c036900 0x7f337c038dc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3488000c00 tx=0x7f34880013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:28.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.692+0000 7f3495cf3640 1 --2- 172.21.15.134:0/3020605605 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5571652592a0 0x557165355b10 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:28.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.692+0000 7f3495cf3640 1 -- 172.21.15.134:0/3020605605 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f349000a4a0 con 0x5571652592a0 2024-04-24T02:13:28.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.692+0000 7f3499731800 1 -- 172.21.15.134:0/3020605605 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5571653530c0 con 0x5571652592a0 2024-04-24T02:13:28.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.692+0000 7f3495cf3640 1 -- 172.21.15.134:0/3020605605 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f349000a4a0 con 0x5571652592a0 2024-04-24T02:13:28.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.692+0000 7f3499731800 1 -- 172.21.15.134:0/3020605605 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557165357e80 con 0x5571652592a0 2024-04-24T02:13:28.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.693+0000 7f3495cf3640 1 -- 172.21.15.134:0/3020605605 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f349000a4a0 con 0x5571652592a0 2024-04-24T02:13:28.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.693+0000 7f3499731800 1 -- 172.21.15.134:0/3020605605 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5571653571c0 con 0x5571652592a0 2024-04-24T02:13:28.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.693+0000 7f3495cf3640 1 -- 172.21.15.134:0/3020605605 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f349000a4a0 con 0x5571652592a0 2024-04-24T02:13:28.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.693+0000 7f3499731800 1 -- 172.21.15.134:0/3020605605 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5571653575e0 con 0x5571652592a0 2024-04-24T02:13:28.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.693+0000 7f3495cf3640 1 -- 172.21.15.134:0/3020605605 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f349000a4a0 con 0x5571652592a0 2024-04-24T02:13:28.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.693+0000 7f3499731800 1 Processor -- start 2024-04-24T02:13:28.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.694+0000 7f3499731800 1 -- start start 2024-04-24T02:13:28.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.694+0000 7f3499731800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557165256510 0x557165254980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:28.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.694+0000 7f3499731800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5571651476b0 con 0x557165256510 2024-04-24T02:13:28.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.694+0000 7f3494cf1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557165256510 0x557165254980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:28.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.694+0000 7f3494cf1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557165256510 0x557165254980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:48682/0 (socket says 172.21.15.134:48682) 2024-04-24T02:13:28.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.694+0000 7f3494cf1640 1 -- 172.21.15.134:0/264854113 learned_addr learned my addr 172.21.15.134:0/264854113 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:28.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.694+0000 7f3494cf1640 1 -- 172.21.15.134:0/264854113 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557165254ec0 con 0x557165256510 2024-04-24T02:13:28.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.694+0000 7f3494cf1640 1 --2- 172.21.15.134:0/264854113 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557165256510 0x557165254980 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f348800e610 tx=0x7f348800ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:28.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.695+0000 7f337affd640 1 -- 172.21.15.134:0/264854113 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3488022070 con 0x557165256510 2024-04-24T02:13:28.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.695+0000 7f337affd640 1 -- 172.21.15.134:0/264854113 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3488009050 con 0x557165256510 2024-04-24T02:13:28.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.695+0000 7f3499731800 1 -- 172.21.15.134:0/264854113 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557165255150 con 0x557165256510 2024-04-24T02:13:28.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.695+0000 7f337affd640 1 -- 172.21.15.134:0/264854113 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f348800d500 con 0x557165256510 2024-04-24T02:13:28.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.695+0000 7f3499731800 1 -- 172.21.15.134:0/264854113 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557165255650 con 0x557165256510 2024-04-24T02:13:28.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.695+0000 7f337affd640 1 -- 172.21.15.134:0/264854113 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3488025070 con 0x557165256510 2024-04-24T02:13:28.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.696+0000 7f337affd640 1 --2- 172.21.15.134:0/264854113 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f336c036900 0x7f336c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:28.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.696+0000 7f337affd640 1 -- 172.21.15.134:0/264854113 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f348804db30 con 0x557165256510 2024-04-24T02:13:28.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.696+0000 7f3495cf3640 1 --2- 172.21.15.134:0/264854113 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f336c036900 0x7f336c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:28.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.696+0000 7f3499731800 1 Processor -- start 2024-04-24T02:13:28.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.696+0000 7f3499731800 1 -- start start 2024-04-24T02:13:28.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.696+0000 7f3495cf3640 1 --2- 172.21.15.134:0/264854113 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f336c036900 0x7f336c038dc0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x557165357560 tx=0x7f3490005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:28.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.696+0000 7f3499731800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5571653761c0 0x5571653765e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:28.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.696+0000 7f3499731800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5571653476f0 con 0x5571653761c0 2024-04-24T02:13:28.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.696+0000 7f3494cf1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5571653761c0 0x5571653765e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:28.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.696+0000 7f3494cf1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5571653761c0 0x5571653765e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:48692/0 (socket says 172.21.15.134:48692) 2024-04-24T02:13:28.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.696+0000 7f3494cf1640 1 -- 172.21.15.134:0/1659120364 learned_addr learned my addr 172.21.15.134:0/1659120364 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:28.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.697+0000 7f3494cf1640 1 -- 172.21.15.134:0/1659120364 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557165376bb0 con 0x5571653761c0 2024-04-24T02:13:28.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.697+0000 7f3494cf1640 1 --2- 172.21.15.134:0/1659120364 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5571653761c0 0x5571653765e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f348804bf40 tx=0x7f34880243f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8338ad89ef6bccf server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:28.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.697+0000 7f3378ff9640 1 -- 172.21.15.134:0/1659120364 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f348804a030 con 0x5571653761c0 2024-04-24T02:13:28.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.697+0000 7f3378ff9640 1 -- 172.21.15.134:0/1659120364 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3488025e30 con 0x5571653761c0 2024-04-24T02:13:28.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.697+0000 7f3378ff9640 1 -- 172.21.15.134:0/1659120364 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f348801ad50 con 0x5571653761c0 2024-04-24T02:13:28.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.697+0000 7f3499731800 1 -- 172.21.15.134:0/1659120364 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5571653761c0 msgr2=0x5571653765e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:28.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.697+0000 7f3499731800 1 --2- 172.21.15.134:0/1659120364 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5571653761c0 0x5571653765e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f348804bf40 tx=0x7f34880243f0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.697+0000 7f3499731800 1 -- 172.21.15.134:0/1659120364 shutdown_connections 2024-04-24T02:13:28.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.697+0000 7f3499731800 1 --2- 172.21.15.134:0/1659120364 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5571653761c0 0x5571653765e0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.697+0000 7f3499731800 1 -- 172.21.15.134:0/1659120364 >> 172.21.15.134:0/1659120364 conn(0x557165372520 msgr2=0x557165370580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:28.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.698+0000 7f3499731800 1 -- 172.21.15.134:0/1659120364 shutdown_connections 2024-04-24T02:13:28.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.698+0000 7f3499731800 1 -- 172.21.15.134:0/1659120364 wait complete. 2024-04-24T02:13:28.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.698+0000 7f3499731800 1 Processor -- start 2024-04-24T02:13:28.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.698+0000 7f3499731800 1 -- start start 2024-04-24T02:13:28.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.698+0000 7f3499731800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5571653761c0 0x55716537d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:28.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.698+0000 7f3499731800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x557165377320 con 0x5571653761c0 2024-04-24T02:13:28.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.698+0000 7f3494cf1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5571653761c0 0x55716537d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:28.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.698+0000 7f3494cf1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5571653761c0 0x55716537d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:48694/0 (socket says 172.21.15.134:48694) 2024-04-24T02:13:28.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.698+0000 7f3494cf1640 1 -- 172.21.15.134:0/3531553158 learned_addr learned my addr 172.21.15.134:0/3531553158 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:28.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.698+0000 7f3494cf1640 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55716537ddc0 con 0x5571653761c0 2024-04-24T02:13:28.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.699+0000 7f3494cf1640 1 --2- 172.21.15.134:0/3531553158 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5571653761c0 0x55716537d880 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f34880266c0 tx=0x7f348804bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:28.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.699+0000 7f336affd640 1 -- 172.21.15.134:0/3531553158 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3488045040 con 0x5571653761c0 2024-04-24T02:13:28.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.699+0000 7f336affd640 1 -- 172.21.15.134:0/3531553158 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f348800d6a0 con 0x5571653761c0 2024-04-24T02:13:28.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.699+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55716537e050 con 0x5571653761c0 2024-04-24T02:13:28.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.699+0000 7f336affd640 1 -- 172.21.15.134:0/3531553158 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f348800d980 con 0x5571653761c0 2024-04-24T02:13:28.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.699+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557165380d00 con 0x5571653761c0 2024-04-24T02:13:28.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.700+0000 7f336affd640 1 -- 172.21.15.134:0/3531553158 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f348804d3c0 con 0x5571653761c0 2024-04-24T02:13:28.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.700+0000 7f336affd640 1 --2- 172.21.15.134:0/3531553158 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3360036900 0x7f3360038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:28.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.700+0000 7f336affd640 1 -- 172.21.15.134:0/3531553158 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f348804de00 con 0x5571653761c0 2024-04-24T02:13:28.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.700+0000 7f3495cf3640 1 --2- 172.21.15.134:0/3531553158 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3360036900 0x7f3360038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:28.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.700+0000 7f3495cf3640 1 --2- 172.21.15.134:0/3531553158 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3360036900 0x7f3360038dc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x557165356ce0 tx=0x7f349001f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:28.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.700+0000 7f3499731800 20 rados->read ofs=0 len=0 2024-04-24T02:13:28.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.700+0000 7f3499731800 1 --2- 172.21.15.134:0/3531553158 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5571653893a0 0x55716538b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:28.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.700+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55716538bfb0 con 0x5571653893a0 2024-04-24T02:13:28.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.700+0000 7f34954f2640 1 --2- 172.21.15.134:0/3531553158 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5571653893a0 0x55716538b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:28.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.701+0000 7f34954f2640 1 --2- 172.21.15.134:0/3531553158 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5571653893a0 0x55716538b860 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:28.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.701+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f348c070020 con 0x5571653893a0 2024-04-24T02:13:28.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.701+0000 7f3499731800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:28.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.701+0000 7f3499731800 20 realm 2024-04-24T02:13:28.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.701+0000 7f3499731800 20 rados->read ofs=0 len=0 2024-04-24T02:13:28.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.701+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55716538c3c0 con 0x5571653893a0 2024-04-24T02:13:28.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.701+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f348c070020 con 0x5571653893a0 2024-04-24T02:13:28.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.701+0000 7f3499731800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:28.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.701+0000 7f3499731800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:13:28.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.701+0000 7f3499731800 20 rados->read ofs=0 len=0 2024-04-24T02:13:28.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.701+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55716538cc90 con 0x5571653893a0 2024-04-24T02:13:28.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.701+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f348c070020 con 0x5571653893a0 2024-04-24T02:13:28.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.701+0000 7f3499731800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:28.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.701+0000 7f3499731800 20 rados->read ofs=0 len=0 2024-04-24T02:13:28.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.701+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55716538d030 con 0x5571653893a0 2024-04-24T02:13:28.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.702+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f348c070020 con 0x5571653893a0 2024-04-24T02:13:28.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.702+0000 7f3499731800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:13:28.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.702+0000 7f3499731800 20 rados->read ofs=0 len=0 2024-04-24T02:13:28.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.702+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55716538d880 con 0x5571653893a0 2024-04-24T02:13:28.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.702+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f348c070020 con 0x5571653893a0 2024-04-24T02:13:28.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.702+0000 7f3499731800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:13:28.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.702+0000 7f3499731800 20 searching for the correct realm 2024-04-24T02:13:28.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.702+0000 7f3499731800 1 --2- 172.21.15.134:0/3531553158 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55716538f5f0 0x5571653919e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:28.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.702+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557165391fc0 con 0x55716538f5f0 2024-04-24T02:13:28.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.702+0000 7f3494cf1640 1 --2- 172.21.15.134:0/3531553158 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55716538f5f0 0x5571653919e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:28.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.702+0000 7f3494cf1640 1 --2- 172.21.15.134:0/3531553158 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55716538f5f0 0x5571653919e0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:28.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.703+0000 7f3494cf1640 1 -- 172.21.15.134:0/3531553158 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3488024030 con 0x55716538f5f0 2024-04-24T02:13:28.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.703+0000 7f3494cf1640 1 --2- 172.21.15.134:0/3531553158 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f3488036070 0x7f3488045520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:28.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.703+0000 7f3494cf1640 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557165391fc0 con 0x7f3488036070 2024-04-24T02:13:28.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.703+0000 7f3495cf3640 1 --2- 172.21.15.134:0/3531553158 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f3488036070 0x7f3488045520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:28.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.703+0000 7f3495cf3640 1 --2- 172.21.15.134:0/3531553158 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f3488036070 0x7f3488045520 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:28.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.703+0000 7f3495cf3640 1 -- 172.21.15.134:0/3531553158 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f349001f070 con 0x7f3488036070 2024-04-24T02:13:28.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.703+0000 7f3495cf3640 1 --2- 172.21.15.134:0/3531553158 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f3490031040 0x7f3490032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:28.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.703+0000 7f3495cf3640 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557165391fc0 con 0x7f3490031040 2024-04-24T02:13:28.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.703+0000 7f34954f2640 1 --2- 172.21.15.134:0/3531553158 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f3490031040 0x7f3490032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:28.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.704+0000 7f34954f2640 1 --2- 172.21.15.134:0/3531553158 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f3490031040 0x7f3490032430 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:28.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.704+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f348c070020 con 0x7f3490031040 2024-04-24T02:13:28.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.704+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557165391fc0 con 0x5571653893a0 2024-04-24T02:13:28.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.704+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f348c070020 con 0x5571653893a0 2024-04-24T02:13:28.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.704+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557165391fc0 con 0x5571653893a0 2024-04-24T02:13:28.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.705+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f348c070020 con 0x5571653893a0 2024-04-24T02:13:28.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.705+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557165391fc0 con 0x7f3490031040 2024-04-24T02:13:28.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.705+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f348c070020 con 0x7f3490031040 2024-04-24T02:13:28.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.705+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557165391fc0 con 0x7f3488036070 2024-04-24T02:13:28.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.705+0000 7f3495cf3640 1 -- 172.21.15.134:0/3531553158 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f349001f070 con 0x7f3488036070 2024-04-24T02:13:28.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.705+0000 7f3495cf3640 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557165391fc0 con 0x7f3488036070 2024-04-24T02:13:28.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.705+0000 7f3495cf3640 1 -- 172.21.15.134:0/3531553158 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f349001f070 con 0x7f3488036070 2024-04-24T02:13:28.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.705+0000 7f3495cf3640 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557165391fc0 con 0x55716538f5f0 2024-04-24T02:13:28.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.706+0000 7f3494cf1640 1 -- 172.21.15.134:0/3531553158 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3488024030 con 0x55716538f5f0 2024-04-24T02:13:28.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.706+0000 7f3494cf1640 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557165391fc0 con 0x5571653893a0 2024-04-24T02:13:28.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.706+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f348c070020 con 0x5571653893a0 2024-04-24T02:13:28.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.706+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557165391fc0 con 0x7f3490031040 2024-04-24T02:13:28.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.706+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f348c070020 con 0x7f3490031040 2024-04-24T02:13:28.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.706+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557165391fc0 con 0x5571653893a0 2024-04-24T02:13:28.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.706+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f348c070020 con 0x5571653893a0 2024-04-24T02:13:28.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.706+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557165391fc0 con 0x7f3488036070 2024-04-24T02:13:28.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.707+0000 7f3495cf3640 1 -- 172.21.15.134:0/3531553158 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f349001f070 con 0x7f3488036070 2024-04-24T02:13:28.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.707+0000 7f3495cf3640 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557165391fc0 con 0x55716538f5f0 2024-04-24T02:13:28.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.707+0000 7f3494cf1640 1 -- 172.21.15.134:0/3531553158 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3488024030 con 0x55716538f5f0 2024-04-24T02:13:28.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.707+0000 7f3494cf1640 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557165391fc0 con 0x55716538f5f0 2024-04-24T02:13:28.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.707+0000 7f3494cf1640 1 -- 172.21.15.134:0/3531553158 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3488024030 con 0x55716538f5f0 2024-04-24T02:13:28.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.707+0000 7f3494cf1640 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557165391fc0 con 0x7f3488036070 2024-04-24T02:13:28.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.707+0000 7f3495cf3640 1 -- 172.21.15.134:0/3531553158 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f349001f070 con 0x7f3488036070 2024-04-24T02:13:28.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.707+0000 7f3495cf3640 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557165391fc0 con 0x55716538f5f0 2024-04-24T02:13:28.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.708+0000 7f3494cf1640 1 -- 172.21.15.134:0/3531553158 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3488024030 con 0x55716538f5f0 2024-04-24T02:13:28.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.708+0000 7f3494cf1640 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557165391fc0 con 0x55716538f5f0 2024-04-24T02:13:28.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.708+0000 7f3494cf1640 1 -- 172.21.15.134:0/3531553158 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3488024030 con 0x55716538f5f0 2024-04-24T02:13:28.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.708+0000 7f3494cf1640 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557165391fc0 con 0x5571653893a0 2024-04-24T02:13:28.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.708+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f348c070020 con 0x5571653893a0 2024-04-24T02:13:28.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.708+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557165391fc0 con 0x5571653893a0 2024-04-24T02:13:28.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.708+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f348c070020 con 0x5571653893a0 2024-04-24T02:13:28.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.708+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557165391fc0 con 0x7f3490031040 2024-04-24T02:13:28.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.709+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f348c070020 con 0x7f3490031040 2024-04-24T02:13:28.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.709+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557165391fc0 con 0x55716538f5f0 2024-04-24T02:13:28.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.709+0000 7f3494cf1640 1 -- 172.21.15.134:0/3531553158 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3488024030 con 0x55716538f5f0 2024-04-24T02:13:28.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.709+0000 7f3494cf1640 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557165391fc0 con 0x7f3488036070 2024-04-24T02:13:28.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.709+0000 7f3495cf3640 1 -- 172.21.15.134:0/3531553158 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f349001f070 con 0x7f3488036070 2024-04-24T02:13:28.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.709+0000 7f3495cf3640 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557165391fc0 con 0x5571653893a0 2024-04-24T02:13:28.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.709+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f348c070020 con 0x5571653893a0 2024-04-24T02:13:28.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.709+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557165391fc0 con 0x7f3490031040 2024-04-24T02:13:28.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.710+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f348c070020 con 0x7f3490031040 2024-04-24T02:13:28.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.710+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557165391fc0 con 0x55716538f5f0 2024-04-24T02:13:28.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.710+0000 7f3494cf1640 1 -- 172.21.15.134:0/3531553158 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3488024030 con 0x55716538f5f0 2024-04-24T02:13:28.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.710+0000 7f3494cf1640 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557165391fc0 con 0x7f3490031040 2024-04-24T02:13:28.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.710+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f348c070020 con 0x7f3490031040 2024-04-24T02:13:28.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.710+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557165391fc0 con 0x7f3488036070 2024-04-24T02:13:28.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.711+0000 7f3495cf3640 1 -- 172.21.15.134:0/3531553158 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3490040040 con 0x7f3488036070 2024-04-24T02:13:28.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.711+0000 7f3495cf3640 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557165391fc0 con 0x55716538f5f0 2024-04-24T02:13:28.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.711+0000 7f3494cf1640 1 -- 172.21.15.134:0/3531553158 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3488024030 con 0x55716538f5f0 2024-04-24T02:13:28.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.711+0000 7f3494cf1640 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557165391fc0 con 0x7f3488036070 2024-04-24T02:13:28.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.711+0000 7f3495cf3640 1 -- 172.21.15.134:0/3531553158 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3490040040 con 0x7f3488036070 2024-04-24T02:13:28.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.711+0000 7f3495cf3640 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557165391fc0 con 0x5571653893a0 2024-04-24T02:13:28.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.711+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f348c070020 con 0x5571653893a0 2024-04-24T02:13:28.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.711+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557165391fc0 con 0x7f3488036070 2024-04-24T02:13:28.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.712+0000 7f3495cf3640 1 -- 172.21.15.134:0/3531553158 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3490040040 con 0x7f3488036070 2024-04-24T02:13:28.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.712+0000 7f3499731800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:13:28.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.712+0000 7f3499731800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:13:28.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.712+0000 7f3499731800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:13:28.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.712+0000 7f3499731800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:13:28.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.712+0000 7f3499731800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:13:28.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.712+0000 7f3499731800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:13:28.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.712+0000 7f3499731800 20 rados->read ofs=0 len=0 2024-04-24T02:13:28.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.712+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55716538e1d0 con 0x5571653893a0 2024-04-24T02:13:28.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.712+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f348c070020 con 0x5571653893a0 2024-04-24T02:13:28.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.712+0000 7f3499731800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:28.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.712+0000 7f3499731800 20 rados->read ofs=0 len=0 2024-04-24T02:13:28.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.712+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55716538ea70 con 0x5571653893a0 2024-04-24T02:13:28.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.712+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f348c070020 con 0x5571653893a0 2024-04-24T02:13:28.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.712+0000 7f3499731800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:13:28.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.712+0000 7f3499731800 20 rados->read ofs=0 len=0 2024-04-24T02:13:28.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.712+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55716538ea70 con 0x5571653893a0 2024-04-24T02:13:28.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.712+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f348c070020 con 0x5571653893a0 2024-04-24T02:13:28.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.712+0000 7f3499731800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:13:28.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.713+0000 7f3499731800 20 zone default found 2024-04-24T02:13:28.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.713+0000 7f3499731800 4 Realm: () 2024-04-24T02:13:28.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.713+0000 7f3499731800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:13:28.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.713+0000 7f3499731800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:13:28.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.713+0000 7f3499731800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:13:28.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.713+0000 7f3499731800 20 zonegroup default 2024-04-24T02:13:28.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.713+0000 7f3499731800 20 rados->read ofs=0 len=0 2024-04-24T02:13:28.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.713+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557165392440 con 0x7f3490031040 2024-04-24T02:13:28.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.713+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f348c070020 con 0x7f3490031040 2024-04-24T02:13:28.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.713+0000 7f3499731800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:28.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.713+0000 7f3499731800 20 rados->read ofs=0 len=0 2024-04-24T02:13:28.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.713+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557165393e50 con 0x55716538f5f0 2024-04-24T02:13:28.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.713+0000 7f3494cf1640 1 -- 172.21.15.134:0/3531553158 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3488024030 con 0x55716538f5f0 2024-04-24T02:13:28.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.713+0000 7f3499731800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:28.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.713+0000 7f3499731800 20 rados->read ofs=0 len=0 2024-04-24T02:13:28.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.713+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557165394360 con 0x55716538f5f0 2024-04-24T02:13:28.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.713+0000 7f3494cf1640 1 -- 172.21.15.134:0/3531553158 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3488024030 con 0x55716538f5f0 2024-04-24T02:13:28.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.713+0000 7f3499731800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:28.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.713+0000 7f3499731800 20 started sync module instance, tier type = 2024-04-24T02:13:28.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.713+0000 7f3499731800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:13:28.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.713+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571653932c0 con 0x7f3488036070 2024-04-24T02:13:28.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.714+0000 7f3495cf3640 1 -- 172.21.15.134:0/3531553158 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(44 notify.0 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3490040040 con 0x7f3488036070 2024-04-24T02:13:28.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.714+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93945517913776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557165392f20 con 0x7f3488036070 2024-04-24T02:13:28.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.714+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557165395290 con 0x5571653893a0 2024-04-24T02:13:28.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.715+0000 7f3495cf3640 1 -- 172.21.15.134:0/3531553158 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93945517913776] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3490040040 con 0x7f3488036070 2024-04-24T02:13:28.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.716+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f348c070020 con 0x5571653893a0 2024-04-24T02:13:28.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.716+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93945517918144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557165395290 con 0x5571653893a0 2024-04-24T02:13:28.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.716+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557165395c90 con 0x55716538f5f0 2024-04-24T02:13:28.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.717+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93945517918144] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f348c070020 con 0x5571653893a0 2024-04-24T02:13:28.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.717+0000 7f3494cf1640 1 -- 172.21.15.134:0/3531553158 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3488024030 con 0x55716538f5f0 2024-04-24T02:13:28.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.717+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93945517919712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557165396030 con 0x55716538f5f0 2024-04-24T02:13:28.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.717+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557165396a30 con 0x7f3488036070 2024-04-24T02:13:28.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.718+0000 7f3494cf1640 1 -- 172.21.15.134:0/3531553158 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93945517919712] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3488024030 con 0x55716538f5f0 2024-04-24T02:13:28.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.719+0000 7f3495cf3640 1 -- 172.21.15.134:0/3531553158 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(50 notify.3 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3490040040 con 0x7f3488036070 2024-04-24T02:13:28.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.719+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93945517922208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557165396e50 con 0x7f3488036070 2024-04-24T02:13:28.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.719+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557165397870 con 0x5571653893a0 2024-04-24T02:13:28.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.720+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f348c070020 con 0x5571653893a0 2024-04-24T02:13:28.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.720+0000 7f3495cf3640 1 -- 172.21.15.134:0/3531553158 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93945517922208] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3490040040 con 0x7f3488036070 2024-04-24T02:13:28.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.720+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93945517929312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557165397830 con 0x5571653893a0 2024-04-24T02:13:28.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.720+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557165398670 con 0x7f3490031040 2024-04-24T02:13:28.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.721+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(54 notify.5 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f348c070020 con 0x7f3490031040 2024-04-24T02:13:28.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.721+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93945517932992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557165397830 con 0x7f3490031040 2024-04-24T02:13:28.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.721+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557165399210 con 0x7f3490031040 2024-04-24T02:13:28.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.721+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93945517929312] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f348c070020 con 0x5571653893a0 2024-04-24T02:13:28.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.722+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 93945517932992] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f348c070020 con 0x7f3490031040 2024-04-24T02:13:28.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.722+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(56 notify.6 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f348c070020 con 0x7f3490031040 2024-04-24T02:13:28.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.722+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93945517935840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571653985e0 con 0x7f3490031040 2024-04-24T02:13:28.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.722+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571653997f0 con 0x7f3490031040 2024-04-24T02:13:28.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.723+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(58 notify.7 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f348c070020 con 0x7f3490031040 2024-04-24T02:13:28.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.723+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93945517937472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557165399c10 con 0x7f3490031040 2024-04-24T02:13:28.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.723+0000 7f3499731800 20 add_watcher() i=0 2024-04-24T02:13:28.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.723+0000 7f3499731800 20 add_watcher() i=1 2024-04-24T02:13:28.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.723+0000 7f3499731800 20 add_watcher() i=2 2024-04-24T02:13:28.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.723+0000 7f3499731800 20 add_watcher() i=3 2024-04-24T02:13:28.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.723+0000 7f3499731800 20 add_watcher() i=4 2024-04-24T02:13:28.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.723+0000 7f3499731800 20 add_watcher() i=5 2024-04-24T02:13:28.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.723+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 93945517935840] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f348c070020 con 0x7f3490031040 2024-04-24T02:13:28.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.723+0000 7f3499731800 20 add_watcher() i=6 2024-04-24T02:13:28.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.724+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 93945517937472] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f348c070020 con 0x7f3490031040 2024-04-24T02:13:28.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.724+0000 7f3499731800 20 add_watcher() i=7 2024-04-24T02:13:28.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.724+0000 7f3499731800 2 all 8 watchers are set, enabling cache 2024-04-24T02:13:28.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.724+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557165399c10 con 0x5571653893a0 2024-04-24T02:13:28.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.725+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f348c070020 con 0x5571653893a0 2024-04-24T02:13:28.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.725+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93945517938528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557165399b80 con 0x5571653893a0 2024-04-24T02:13:28.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.726+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93945517938528] v32'223 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f348c070020 con 0x5571653893a0 2024-04-24T02:13:28.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.726+0000 7f334b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:13:28.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.726+0000 7f3499731800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:13:28.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.726+0000 7f3499731800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:13:28.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.726+0000 7f3499731800 5 note: GC not initialized 2024-04-24T02:13:28.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.726+0000 7f334a7e4640 20 reqs_thread_entry: start 2024-04-24T02:13:28.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.726+0000 7f3499731800 20 init_complete bucket index max shards: 11 2024-04-24T02:13:28.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.726+0000 7f3499731800 20 Filter name: none 2024-04-24T02:13:28.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.727+0000 7f32bbfff640 20 reqs_thread_entry: start 2024-04-24T02:13:28.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.727+0000 7f3499731800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-04-24T02:13:28.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.727+0000 7f3499731800 20 rados->read ofs=0 len=0 2024-04-24T02:13:28.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.727+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5571653cfe60 con 0x7f3488036070 2024-04-24T02:13:28.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.727+0000 7f3495cf3640 1 -- 172.21.15.134:0/3531553158 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(62 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f3490040040 con 0x7f3488036070 2024-04-24T02:13:28.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.727+0000 7f3499731800 20 rados_obj.operate() r=0 bl.length=380 2024-04-24T02:13:28.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.727+0000 7f3499731800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-04-24T02:13:28.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.727+0000 7f3499731800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-04-24T02:13:28.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.727+0000 7f3499731800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:13:28.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.727+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571653d4210 con 0x7f3490031040 2024-04-24T02:13:28.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.728+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(63 fud [create,call,writefull 0~206] v32'6 uv5 ondisk = -17 ((17) File exists)) ==== 231+0+0 (crc 0 0 0) 0x7f348c070020 con 0x7f3490031040 2024-04-24T02:13:28.746 INFO:teuthology.orchestra.run.smithi134.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-04-24T02:13:28.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.729+0000 7f334b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:13:28.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.729+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93945517938528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557165385b30 con 0x5571653893a0 2024-04-24T02:13:28.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.730+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93945517938528] v32'224 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f348c070020 con 0x5571653893a0 2024-04-24T02:13:28.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.730+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93945517913776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557165399760 con 0x7f3488036070 2024-04-24T02:13:28.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.731+0000 7f3495cf3640 1 -- 172.21.15.134:0/3531553158 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93945517913776] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3490040040 con 0x7f3488036070 2024-04-24T02:13:28.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.731+0000 7f3499731800 20 remove_watcher() i=0 2024-04-24T02:13:28.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.731+0000 7f3499731800 2 removed watcher, disabling cache 2024-04-24T02:13:28.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.731+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93945517918144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557165399760 con 0x5571653893a0 2024-04-24T02:13:28.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.732+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93945517918144] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f348c070020 con 0x5571653893a0 2024-04-24T02:13:28.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.732+0000 7f3499731800 20 remove_watcher() i=1 2024-04-24T02:13:28.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.732+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93945517919712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571653947c0 con 0x55716538f5f0 2024-04-24T02:13:28.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.733+0000 7f3494cf1640 1 -- 172.21.15.134:0/3531553158 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93945517919712] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3488024030 con 0x55716538f5f0 2024-04-24T02:13:28.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.733+0000 7f3499731800 20 remove_watcher() i=2 2024-04-24T02:13:28.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.733+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93945517922208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557165399760 con 0x7f3488036070 2024-04-24T02:13:28.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.734+0000 7f3495cf3640 1 -- 172.21.15.134:0/3531553158 <== osd.2 v2:172.21.15.134:6800/214480313 16 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93945517922208] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3490040040 con 0x7f3488036070 2024-04-24T02:13:28.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.734+0000 7f3499731800 20 remove_watcher() i=3 2024-04-24T02:13:28.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.734+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93945517929312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557165394de0 con 0x5571653893a0 2024-04-24T02:13:28.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.735+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93945517929312] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f348c070020 con 0x5571653893a0 2024-04-24T02:13:28.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.735+0000 7f3499731800 20 remove_watcher() i=4 2024-04-24T02:13:28.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.735+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93945517932992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571653957a0 con 0x7f3490031040 2024-04-24T02:13:28.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.736+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93945517932992] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f348c070020 con 0x7f3490031040 2024-04-24T02:13:28.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.736+0000 7f3499731800 20 remove_watcher() i=5 2024-04-24T02:13:28.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.736+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93945517935840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557165399760 con 0x7f3490031040 2024-04-24T02:13:28.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.737+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93945517935840] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f348c070020 con 0x7f3490031040 2024-04-24T02:13:28.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.737+0000 7f3499731800 20 remove_watcher() i=6 2024-04-24T02:13:28.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.737+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93945517937472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557165394de0 con 0x7f3490031040 2024-04-24T02:13:28.751 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-04-24T02:13:28.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.738+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93945517937472] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f348c070020 con 0x7f3490031040 2024-04-24T02:13:28.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.738+0000 7f3499731800 20 remove_watcher() i=7 2024-04-24T02:13:28.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.739+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f3490031040 msgr2=0x7f3490032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:28.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.739+0000 7f3499731800 1 --2- 172.21.15.134:0/3531553158 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f3490031040 0x7f3490032430 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.739+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5571653893a0 msgr2=0x55716538b860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:28.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.739+0000 7f3499731800 1 --2- 172.21.15.134:0/3531553158 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5571653893a0 0x55716538b860 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.739+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f3488036070 msgr2=0x7f3488045520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:28.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.739+0000 7f3499731800 1 --2- 172.21.15.134:0/3531553158 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f3488036070 0x7f3488045520 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.739+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55716538f5f0 msgr2=0x5571653919e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:28.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.739+0000 7f3499731800 1 --2- 172.21.15.134:0/3531553158 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55716538f5f0 0x5571653919e0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.739+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3360036900 msgr2=0x7f3360038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:28.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.739+0000 7f3499731800 1 --2- 172.21.15.134:0/3531553158 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3360036900 0x7f3360038dc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x557165356ce0 tx=0x7f349001f000 comp rx=0 tx=0).stop 2024-04-24T02:13:28.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.739+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5571653761c0 msgr2=0x55716537d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:28.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.739+0000 7f34954f2640 1 -- 172.21.15.134:0/3531553158 reap_dead start 2024-04-24T02:13:28.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.739+0000 7f3499731800 1 --2- 172.21.15.134:0/3531553158 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5571653761c0 0x55716537d880 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f34880266c0 tx=0x7f348804bea0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.739+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 shutdown_connections 2024-04-24T02:13:28.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.739+0000 7f3499731800 1 --2- 172.21.15.134:0/3531553158 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5571653761c0 0x55716537d880 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.739+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 >> 172.21.15.134:0/3531553158 conn(0x557165372520 msgr2=0x55716536fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:28.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.739+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 shutdown_connections 2024-04-24T02:13:28.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.739+0000 7f3499731800 1 -- 172.21.15.134:0/3531553158 wait complete. 2024-04-24T02:13:28.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.739+0000 7f3499731800 1 -- 172.21.15.134:0/264854113 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f336c036900 msgr2=0x7f336c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:28.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.739+0000 7f3499731800 1 --2- 172.21.15.134:0/264854113 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f336c036900 0x7f336c038dc0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x557165357560 tx=0x7f3490005840 comp rx=0 tx=0).stop 2024-04-24T02:13:28.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.739+0000 7f3499731800 1 -- 172.21.15.134:0/264854113 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557165256510 msgr2=0x557165254980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:28.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.739+0000 7f3499731800 1 --2- 172.21.15.134:0/264854113 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557165256510 0x557165254980 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f348800e610 tx=0x7f348800ff90 comp rx=0 tx=0).stop 2024-04-24T02:13:28.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.739+0000 7f3499731800 1 -- 172.21.15.134:0/264854113 shutdown_connections 2024-04-24T02:13:28.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.739+0000 7f3499731800 1 --2- 172.21.15.134:0/264854113 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f336c036900 0x7f336c038dc0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.739+0000 7f3499731800 1 --2- 172.21.15.134:0/264854113 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557165256510 0x557165254980 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.739+0000 7f3499731800 1 -- 172.21.15.134:0/264854113 >> 172.21.15.134:0/264854113 conn(0x55716535acb0 msgr2=0x55716535b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:28.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.739+0000 7f3499731800 1 -- 172.21.15.134:0/264854113 shutdown_connections 2024-04-24T02:13:28.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.739+0000 7f3499731800 1 -- 172.21.15.134:0/264854113 wait complete. 2024-04-24T02:13:28.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.740+0000 7f3499731800 1 -- 172.21.15.134:0/3020605605 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5571652592a0 msgr2=0x557165355b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:28.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.740+0000 7f3499731800 1 --2- 172.21.15.134:0/3020605605 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5571652592a0 0x557165355b10 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.740+0000 7f3499731800 1 -- 172.21.15.134:0/3020605605 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f337c036900 msgr2=0x7f337c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:28.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.740+0000 7f3499731800 1 --2- 172.21.15.134:0/3020605605 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f337c036900 0x7f337c038dc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3488000c00 tx=0x7f34880013b0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.740+0000 7f3499731800 1 -- 172.21.15.134:0/3020605605 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557165256970 msgr2=0x55716534e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:28.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.740+0000 7f3499731800 1 --2- 172.21.15.134:0/3020605605 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557165256970 0x55716534e8d0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f348c005870 tx=0x7f348c002fb0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.740+0000 7f3499731800 1 -- 172.21.15.134:0/3020605605 shutdown_connections 2024-04-24T02:13:28.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.740+0000 7f3499731800 1 --2- 172.21.15.134:0/3020605605 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5571652592a0 0x557165355b10 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.740+0000 7f3499731800 1 --2- 172.21.15.134:0/3020605605 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f337c036900 0x7f337c038dc0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.740+0000 7f3499731800 1 --2- 172.21.15.134:0/3020605605 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557165256970 0x55716534e8d0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.740+0000 7f3499731800 1 -- 172.21.15.134:0/3020605605 >> 172.21.15.134:0/3020605605 conn(0x5571652503a0 msgr2=0x557165340fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:28.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.740+0000 7f3499731800 1 -- 172.21.15.134:0/3020605605 shutdown_connections 2024-04-24T02:13:28.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.740+0000 7f3499731800 1 -- 172.21.15.134:0/3020605605 wait complete. 2024-04-24T02:13:28.759 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-04-24T02:13:28.759 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-04-24T02:13:28.763 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-04-24T02:13:28.763 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-04-24T02:13:28.763 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-04-24T02:13:28.763 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-04-24T02:13:28.763 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-04-24T02:13:28.808 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:13:28.808 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:13:28.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.807+0000 7faa35936800 1 Processor -- start 2024-04-24T02:13:28.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.807+0000 7faa35936800 1 -- start start 2024-04-24T02:13:28.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.807+0000 7faa35936800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55cdb8b90160 0x55cdb8b92600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:28.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.807+0000 7faa35936800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cdb8a4ad40 con 0x55cdb8aff200 2024-04-24T02:13:28.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.807+0000 7faa35936800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55cdb8a1d4d0 con 0x55cdb8b90160 2024-04-24T02:13:28.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.807+0000 7faa30ecb640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55cdb8b90160 0x55cdb8b92600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:28.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.807+0000 7faa316cc640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55cdb8aff200 0x55cdb8b8e9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:43432/0 (socket says 172.21.15.134:43432) 2024-04-24T02:13:28.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.807+0000 7faa30ecb640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55cdb8b90160 0x55cdb8b92600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:48698/0 (socket says 172.21.15.134:48698) 2024-04-24T02:13:28.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.807+0000 7faa316cc640 1 -- 172.21.15.134:0/1806175340 learned_addr learned my addr 172.21.15.134:0/1806175340 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:13:28.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.808+0000 7faa30ecb640 1 -- 172.21.15.134:0/1806175340 >> v1:172.21.15.104:6789/0 conn(0x55cdb8aff200 legacy=0x55cdb8b8e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:28.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.808+0000 7faa30ecb640 1 -- 172.21.15.134:0/1806175340 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdb8a49590 con 0x55cdb8b90160 2024-04-24T02:13:28.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.810+0000 7faa30ecb640 1 --2- 172.21.15.134:0/1806175340 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdb8b90160 0x55cdb8b92600 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7faa1c00a470 tx=0x7faa1c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39ecb5dadf7c6105 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:28.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.810+0000 7faa2bfff640 1 -- 172.21.15.134:0/1806175340 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa1c057070 con 0x55cdb8b90160 2024-04-24T02:13:28.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.810+0000 7faa2bfff640 1 -- 172.21.15.134:0/1806175340 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa1c052570 con 0x55cdb8b90160 2024-04-24T02:13:28.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.810+0000 7faa2bfff640 1 -- 172.21.15.134:0/1806175340 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa1c052870 con 0x55cdb8b90160 2024-04-24T02:13:28.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.810+0000 7faa35936800 1 -- 172.21.15.134:0/1806175340 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdb8b90160 msgr2=0x55cdb8b92600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:28.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.810+0000 7faa35936800 1 --2- 172.21.15.134:0/1806175340 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdb8b90160 0x55cdb8b92600 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7faa1c00a470 tx=0x7faa1c01ce90 comp rx=0 tx=0).stop 2024-04-24T02:13:28.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.810+0000 7faa35936800 1 -- 172.21.15.134:0/1806175340 shutdown_connections 2024-04-24T02:13:28.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.810+0000 7faa35936800 1 --2- 172.21.15.134:0/1806175340 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdb8b90160 0x55cdb8b92600 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.810+0000 7faa35936800 1 -- 172.21.15.134:0/1806175340 >> 172.21.15.134:0/1806175340 conn(0x55cdb8b863a0 msgr2=0x55cdb8b887c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:28.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.810+0000 7faa35936800 1 -- 172.21.15.134:0/1806175340 shutdown_connections 2024-04-24T02:13:28.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.810+0000 7faa35936800 1 -- 172.21.15.134:0/1806175340 wait complete. 2024-04-24T02:13:28.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.822+0000 7faa35936800 1 Processor -- start 2024-04-24T02:13:28.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.822+0000 7faa35936800 1 -- start start 2024-04-24T02:13:28.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.822+0000 7faa35936800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdb8aff200 0x55cdb8c7d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:28.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.822+0000 7faa35936800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55cdb8ad73b0 con 0x55cdb8aff200 2024-04-24T02:13:28.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.822+0000 7faa316cc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdb8aff200 0x55cdb8c7d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:28.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.822+0000 7faa316cc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdb8aff200 0x55cdb8c7d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:48710/0 (socket says 172.21.15.134:48710) 2024-04-24T02:13:28.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.822+0000 7faa316cc640 1 -- 172.21.15.134:0/3383325600 learned_addr learned my addr 172.21.15.134:0/3383325600 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:28.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.823+0000 7faa316cc640 1 -- 172.21.15.134:0/3383325600 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdb8c7d6e0 con 0x55cdb8aff200 2024-04-24T02:13:28.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.823+0000 7faa316cc640 1 --2- 172.21.15.134:0/3383325600 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdb8aff200 0x55cdb8c7d110 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7faa24001de0 tx=0x7faa2400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e41f47ddf2d76b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:28.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.823+0000 7fa91f606640 1 -- 172.21.15.134:0/3383325600 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa24012020 con 0x55cdb8aff200 2024-04-24T02:13:28.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.823+0000 7fa91f606640 1 -- 172.21.15.134:0/3383325600 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa2400e5a0 con 0x55cdb8aff200 2024-04-24T02:13:28.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.823+0000 7fa91f606640 1 -- 172.21.15.134:0/3383325600 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa2400e8c0 con 0x55cdb8aff200 2024-04-24T02:13:28.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.824+0000 7faa35936800 1 -- 172.21.15.134:0/3383325600 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdb8aff200 msgr2=0x55cdb8c7d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:28.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.824+0000 7faa35936800 1 --2- 172.21.15.134:0/3383325600 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdb8aff200 0x55cdb8c7d110 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7faa24001de0 tx=0x7faa2400b6c0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.824+0000 7faa35936800 1 -- 172.21.15.134:0/3383325600 shutdown_connections 2024-04-24T02:13:28.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.824+0000 7faa35936800 1 --2- 172.21.15.134:0/3383325600 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdb8aff200 0x55cdb8c7d110 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.824+0000 7faa35936800 1 -- 172.21.15.134:0/3383325600 >> 172.21.15.134:0/3383325600 conn(0x55cdb8b863a0 msgr2=0x55cdb8c78a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:28.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.824+0000 7faa35936800 1 -- 172.21.15.134:0/3383325600 shutdown_connections 2024-04-24T02:13:28.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.824+0000 7faa35936800 1 -- 172.21.15.134:0/3383325600 wait complete. 2024-04-24T02:13:28.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.824+0000 7faa35936800 1 Processor -- start 2024-04-24T02:13:28.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.824+0000 7faa35936800 1 -- start start 2024-04-24T02:13:28.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.824+0000 7faa35936800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdb8aff200 0x55cdb8c84d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:28.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.824+0000 7faa35936800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55cdb8b92f80 con 0x55cdb8aff200 2024-04-24T02:13:28.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.825+0000 7faa316cc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdb8aff200 0x55cdb8c84d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:28.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.825+0000 7faa316cc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdb8aff200 0x55cdb8c84d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:48716/0 (socket says 172.21.15.134:48716) 2024-04-24T02:13:28.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.825+0000 7faa316cc640 1 -- 172.21.15.134:0/3794701460 learned_addr learned my addr 172.21.15.134:0/3794701460 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:28.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.825+0000 7faa316cc640 1 -- 172.21.15.134:0/3794701460 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdb8c85280 con 0x55cdb8aff200 2024-04-24T02:13:28.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.825+0000 7faa316cc640 1 --2- 172.21.15.134:0/3794701460 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdb8aff200 0x55cdb8c84d40 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7faa2400c010 tx=0x7faa24000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:28.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.825+0000 7fa91de03640 1 -- 172.21.15.134:0/3794701460 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa24012070 con 0x55cdb8aff200 2024-04-24T02:13:28.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.825+0000 7fa91de03640 1 -- 172.21.15.134:0/3794701460 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa2401a7a0 con 0x55cdb8aff200 2024-04-24T02:13:28.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.825+0000 7faa35936800 1 -- 172.21.15.134:0/3794701460 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cdb8c85510 con 0x55cdb8aff200 2024-04-24T02:13:28.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.825+0000 7fa91de03640 1 -- 172.21.15.134:0/3794701460 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa2401aa80 con 0x55cdb8aff200 2024-04-24T02:13:28.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.825+0000 7faa35936800 1 -- 172.21.15.134:0/3794701460 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cdb8c88120 con 0x55cdb8aff200 2024-04-24T02:13:28.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.826+0000 7fa91de03640 1 -- 172.21.15.134:0/3794701460 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7faa24015020 con 0x55cdb8aff200 2024-04-24T02:13:28.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.826+0000 7fa91de03640 1 --2- 172.21.15.134:0/3794701460 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa918036950 0x7fa918038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:28.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.826+0000 7fa91de03640 1 -- 172.21.15.134:0/3794701460 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7faa24020070 con 0x55cdb8aff200 2024-04-24T02:13:28.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.826+0000 7faa30ecb640 1 --2- 172.21.15.134:0/3794701460 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa918036950 0x7fa918038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:28.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.827+0000 7faa35936800 1 --2- 172.21.15.134:0/3794701460 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55cdb8b90160 0x55cdb8c8bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:28.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.827+0000 7faa35936800 1 -- 172.21.15.134:0/3794701460 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8c8c420 con 0x55cdb8b90160 2024-04-24T02:13:28.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.827+0000 7faa31ecd640 1 --2- 172.21.15.134:0/3794701460 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55cdb8b90160 0x55cdb8c8bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:28.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.827+0000 7faa30ecb640 1 --2- 172.21.15.134:0/3794701460 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa918036950 0x7fa918038e10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7faa1c054000 tx=0x7faa1c04e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:28.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.827+0000 7faa31ecd640 1 --2- 172.21.15.134:0/3794701460 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55cdb8b90160 0x55cdb8c8bee0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:28.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.827+0000 7faa31ecd640 1 -- 172.21.15.134:0/3794701460 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faa2c00a4a0 con 0x55cdb8b90160 2024-04-24T02:13:28.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.827+0000 7faa35936800 1 -- 172.21.15.134:0/3794701460 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8c894b0 con 0x55cdb8b90160 2024-04-24T02:13:28.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.828+0000 7faa31ecd640 1 -- 172.21.15.134:0/3794701460 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faa2c00a4a0 con 0x55cdb8b90160 2024-04-24T02:13:28.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.828+0000 7faa35936800 1 -- 172.21.15.134:0/3794701460 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8c8e260 con 0x55cdb8b90160 2024-04-24T02:13:28.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.828+0000 7faa31ecd640 1 -- 172.21.15.134:0/3794701460 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7faa2c00a4a0 con 0x55cdb8b90160 2024-04-24T02:13:28.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.828+0000 7faa35936800 1 -- 172.21.15.134:0/3794701460 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8c8d5a0 con 0x55cdb8b90160 2024-04-24T02:13:28.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.828+0000 7faa31ecd640 1 -- 172.21.15.134:0/3794701460 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faa2c00a4a0 con 0x55cdb8b90160 2024-04-24T02:13:28.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.828+0000 7faa35936800 1 -- 172.21.15.134:0/3794701460 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8c8d940 con 0x55cdb8b90160 2024-04-24T02:13:28.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.828+0000 7faa31ecd640 1 -- 172.21.15.134:0/3794701460 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7faa2c00a4a0 con 0x55cdb8b90160 2024-04-24T02:13:28.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.829+0000 7faa35936800 1 Processor -- start 2024-04-24T02:13:28.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.829+0000 7faa35936800 1 -- start start 2024-04-24T02:13:28.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.829+0000 7faa35936800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdb8b8c590 0x55cdb8b8aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:28.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.829+0000 7faa35936800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55cdb8a7d6b0 con 0x55cdb8b8c590 2024-04-24T02:13:28.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.829+0000 7faa30ecb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdb8b8c590 0x55cdb8b8aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:28.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.829+0000 7faa30ecb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdb8b8c590 0x55cdb8b8aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:48726/0 (socket says 172.21.15.134:48726) 2024-04-24T02:13:28.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.829+0000 7faa30ecb640 1 -- 172.21.15.134:0/108334176 learned_addr learned my addr 172.21.15.134:0/108334176 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:28.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.829+0000 7faa30ecb640 1 -- 172.21.15.134:0/108334176 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdb8b8af40 con 0x55cdb8b8c590 2024-04-24T02:13:28.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.830+0000 7faa30ecb640 1 --2- 172.21.15.134:0/108334176 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdb8b8c590 0x55cdb8b8aa00 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7faa1c044840 tx=0x7faa1c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:28.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.831+0000 7fa916ffd640 1 -- 172.21.15.134:0/108334176 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa1c06f070 con 0x55cdb8b8c590 2024-04-24T02:13:28.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.831+0000 7fa916ffd640 1 -- 172.21.15.134:0/108334176 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa1c058040 con 0x55cdb8b8c590 2024-04-24T02:13:28.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.831+0000 7fa916ffd640 1 -- 172.21.15.134:0/108334176 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa1c057050 con 0x55cdb8b8c590 2024-04-24T02:13:28.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.831+0000 7faa35936800 1 -- 172.21.15.134:0/108334176 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cdb8b8b170 con 0x55cdb8b8c590 2024-04-24T02:13:28.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.831+0000 7faa35936800 1 -- 172.21.15.134:0/108334176 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cdb8b8b610 con 0x55cdb8b8c590 2024-04-24T02:13:28.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.832+0000 7fa916ffd640 1 -- 172.21.15.134:0/108334176 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7faa1c072070 con 0x55cdb8b8c590 2024-04-24T02:13:28.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.832+0000 7fa916ffd640 1 --2- 172.21.15.134:0/108334176 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa908036950 0x7fa908038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:28.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.832+0000 7fa916ffd640 1 -- 172.21.15.134:0/108334176 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7faa1c08f970 con 0x55cdb8b8c590 2024-04-24T02:13:28.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.832+0000 7faa31ecd640 1 --2- 172.21.15.134:0/108334176 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa908036950 0x7fa908038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:28.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.832+0000 7faa35936800 1 Processor -- start 2024-04-24T02:13:28.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.832+0000 7faa31ecd640 1 --2- 172.21.15.134:0/108334176 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa908036950 0x7fa908038e10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x55cdb8c8d0c0 tx=0x7faa2c005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:28.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.832+0000 7faa35936800 1 -- start start 2024-04-24T02:13:28.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.833+0000 7faa35936800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdb8cac460 0x55cdb8cac880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:28.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.833+0000 7faa35936800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55cdb8c7da60 con 0x55cdb8cac460 2024-04-24T02:13:28.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.833+0000 7faa30ecb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdb8cac460 0x55cdb8cac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:28.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.833+0000 7faa30ecb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdb8cac460 0x55cdb8cac880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:48742/0 (socket says 172.21.15.134:48742) 2024-04-24T02:13:28.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.833+0000 7faa30ecb640 1 -- 172.21.15.134:0/2306844048 learned_addr learned my addr 172.21.15.134:0/2306844048 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:28.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.833+0000 7faa30ecb640 1 -- 172.21.15.134:0/2306844048 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdb8cace50 con 0x55cdb8cac460 2024-04-24T02:13:28.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.833+0000 7faa30ecb640 1 --2- 172.21.15.134:0/2306844048 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdb8cac460 0x55cdb8cac880 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7faa1c05f4a0 tx=0x7faa1c08e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83a571f73726a8fa server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:28.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.833+0000 7fa914ff9640 1 -- 172.21.15.134:0/2306844048 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa1c087070 con 0x55cdb8cac460 2024-04-24T02:13:28.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.833+0000 7fa914ff9640 1 -- 172.21.15.134:0/2306844048 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa1c05e480 con 0x55cdb8cac460 2024-04-24T02:13:28.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.833+0000 7fa914ff9640 1 -- 172.21.15.134:0/2306844048 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa1c072360 con 0x55cdb8cac460 2024-04-24T02:13:28.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.834+0000 7faa35936800 1 -- 172.21.15.134:0/2306844048 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdb8cac460 msgr2=0x55cdb8cac880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:28.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.834+0000 7faa35936800 1 --2- 172.21.15.134:0/2306844048 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdb8cac460 0x55cdb8cac880 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7faa1c05f4a0 tx=0x7faa1c08e000 comp rx=0 tx=0).stop 2024-04-24T02:13:28.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.834+0000 7faa35936800 1 -- 172.21.15.134:0/2306844048 shutdown_connections 2024-04-24T02:13:28.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.834+0000 7faa35936800 1 --2- 172.21.15.134:0/2306844048 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdb8cac460 0x55cdb8cac880 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.834+0000 7faa35936800 1 -- 172.21.15.134:0/2306844048 >> 172.21.15.134:0/2306844048 conn(0x55cdb8ca87c0 msgr2=0x55cdb8ca6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:28.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.834+0000 7faa35936800 1 -- 172.21.15.134:0/2306844048 shutdown_connections 2024-04-24T02:13:28.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.834+0000 7faa35936800 1 -- 172.21.15.134:0/2306844048 wait complete. 2024-04-24T02:13:28.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.834+0000 7faa35936800 1 Processor -- start 2024-04-24T02:13:28.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.834+0000 7faa35936800 1 -- start start 2024-04-24T02:13:28.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.834+0000 7faa35936800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdb8cac460 0x55cdb8cb3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:28.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.834+0000 7faa35936800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55cdb8cad5c0 con 0x55cdb8cac460 2024-04-24T02:13:28.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.834+0000 7faa30ecb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdb8cac460 0x55cdb8cb3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:28.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.834+0000 7faa30ecb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdb8cac460 0x55cdb8cb3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:48754/0 (socket says 172.21.15.134:48754) 2024-04-24T02:13:28.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.834+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 learned_addr learned my addr 172.21.15.134:0/1308038222 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:28.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.835+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdb8cb3fd0 con 0x55cdb8cac460 2024-04-24T02:13:28.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.835+0000 7faa30ecb640 1 --2- 172.21.15.134:0/1308038222 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdb8cac460 0x55cdb8cb3a90 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7faa1c073fd0 tx=0x7faa1c08dce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:28.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.835+0000 7fa906ffd640 1 -- 172.21.15.134:0/1308038222 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa1c087030 con 0x55cdb8cac460 2024-04-24T02:13:28.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.835+0000 7fa906ffd640 1 -- 172.21.15.134:0/1308038222 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa1c05fd50 con 0x55cdb8cac460 2024-04-24T02:13:28.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.835+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cdb8cb4260 con 0x55cdb8cac460 2024-04-24T02:13:28.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.835+0000 7fa906ffd640 1 -- 172.21.15.134:0/1308038222 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa1c0726e0 con 0x55cdb8cac460 2024-04-24T02:13:28.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.835+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cdb8cb6f10 con 0x55cdb8cac460 2024-04-24T02:13:28.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.836+0000 7fa906ffd640 1 -- 172.21.15.134:0/1308038222 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7faa1c0728a0 con 0x55cdb8cac460 2024-04-24T02:13:28.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.836+0000 7fa906ffd640 1 --2- 172.21.15.134:0/1308038222 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa8fc036900 0x7fa8fc038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:28.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.836+0000 7fa906ffd640 1 -- 172.21.15.134:0/1308038222 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7faa1c088070 con 0x55cdb8cac460 2024-04-24T02:13:28.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.836+0000 7faa31ecd640 1 --2- 172.21.15.134:0/1308038222 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa8fc036900 0x7fa8fc038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:28.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.837+0000 7faa31ecd640 1 --2- 172.21.15.134:0/1308038222 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa8fc036900 0x7fa8fc038dc0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x55cdb8c89400 tx=0x7faa2c01f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:28.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.837+0000 7faa35936800 20 rados->read ofs=0 len=0 2024-04-24T02:13:28.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.837+0000 7faa35936800 1 --2- 172.21.15.134:0/1308038222 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55cdb8cbf620 0x55cdb8cc1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:28.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.837+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cc2230 con 0x55cdb8cbf620 2024-04-24T02:13:28.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.837+0000 7faa316cc640 1 --2- 172.21.15.134:0/1308038222 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55cdb8cbf620 0x55cdb8cc1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:28.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.837+0000 7faa316cc640 1 --2- 172.21.15.134:0/1308038222 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55cdb8cbf620 0x55cdb8cc1ae0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:28.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.837+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faa2402b070 con 0x55cdb8cbf620 2024-04-24T02:13:28.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.837+0000 7faa35936800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:28.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.837+0000 7faa35936800 20 realm 2024-04-24T02:13:28.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.838+0000 7faa35936800 20 rados->read ofs=0 len=0 2024-04-24T02:13:28.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.838+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cc2640 con 0x55cdb8cbf620 2024-04-24T02:13:28.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.838+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faa2402b070 con 0x55cdb8cbf620 2024-04-24T02:13:28.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.838+0000 7faa35936800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:28.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.838+0000 7faa35936800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:13:28.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.838+0000 7faa35936800 20 rados->read ofs=0 len=0 2024-04-24T02:13:28.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.838+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cc2f10 con 0x55cdb8cbf620 2024-04-24T02:13:28.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.838+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faa2402b070 con 0x55cdb8cbf620 2024-04-24T02:13:28.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.838+0000 7faa35936800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:28.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.838+0000 7faa35936800 20 rados->read ofs=0 len=0 2024-04-24T02:13:28.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.838+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cc32b0 con 0x55cdb8cbf620 2024-04-24T02:13:28.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.838+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faa2402b070 con 0x55cdb8cbf620 2024-04-24T02:13:28.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.838+0000 7faa35936800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:13:28.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.838+0000 7faa35936800 20 rados->read ofs=0 len=0 2024-04-24T02:13:28.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.838+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cc3b00 con 0x55cdb8cbf620 2024-04-24T02:13:28.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.838+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7faa2402b070 con 0x55cdb8cbf620 2024-04-24T02:13:28.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.838+0000 7faa35936800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:13:28.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.838+0000 7faa35936800 20 searching for the correct realm 2024-04-24T02:13:28.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.839+0000 7faa35936800 1 --2- 172.21.15.134:0/1308038222 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55cdb8cc5870 0x55cdb8cc7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:28.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.839+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cc8240 con 0x55cdb8cc5870 2024-04-24T02:13:28.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.839+0000 7faa30ecb640 1 --2- 172.21.15.134:0/1308038222 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55cdb8cc5870 0x55cdb8cc7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:28.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.839+0000 7faa30ecb640 1 --2- 172.21.15.134:0/1308038222 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55cdb8cc5870 0x55cdb8cc7c60 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:28.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.839+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa1c071030 con 0x55cdb8cc5870 2024-04-24T02:13:28.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.839+0000 7faa30ecb640 1 --2- 172.21.15.134:0/1308038222 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7faa1c082070 0x7faa1c06d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:28.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.839+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cc8240 con 0x7faa1c082070 2024-04-24T02:13:28.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.839+0000 7faa31ecd640 1 --2- 172.21.15.134:0/1308038222 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7faa1c082070 0x7faa1c06d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:28.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.840+0000 7faa31ecd640 1 --2- 172.21.15.134:0/1308038222 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7faa1c082070 0x7faa1c06d880 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:28.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.840+0000 7faa31ecd640 1 -- 172.21.15.134:0/1308038222 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa2c01f070 con 0x7faa1c082070 2024-04-24T02:13:28.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.840+0000 7faa31ecd640 1 --2- 172.21.15.134:0/1308038222 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7faa2c031040 0x7faa2c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:28.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.840+0000 7faa31ecd640 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cc8240 con 0x7faa2c031040 2024-04-24T02:13:28.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.840+0000 7faa316cc640 1 --2- 172.21.15.134:0/1308038222 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7faa2c031040 0x7faa2c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:28.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.841+0000 7faa316cc640 1 --2- 172.21.15.134:0/1308038222 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7faa2c031040 0x7faa2c032940 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:28.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.841+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa2402b070 con 0x7faa2c031040 2024-04-24T02:13:28.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.841+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cc8240 con 0x55cdb8cbf620 2024-04-24T02:13:28.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.841+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa2402b070 con 0x55cdb8cbf620 2024-04-24T02:13:28.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.841+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cc8240 con 0x55cdb8cbf620 2024-04-24T02:13:28.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.841+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7faa2402b070 con 0x55cdb8cbf620 2024-04-24T02:13:28.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.841+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cc8240 con 0x7faa2c031040 2024-04-24T02:13:28.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.842+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa2402b070 con 0x7faa2c031040 2024-04-24T02:13:28.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.842+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cc8240 con 0x7faa1c082070 2024-04-24T02:13:28.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.842+0000 7faa31ecd640 1 -- 172.21.15.134:0/1308038222 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa2c01f070 con 0x7faa1c082070 2024-04-24T02:13:28.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.842+0000 7faa31ecd640 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cc8240 con 0x7faa1c082070 2024-04-24T02:13:28.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.842+0000 7faa31ecd640 1 -- 172.21.15.134:0/1308038222 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa2c01f070 con 0x7faa1c082070 2024-04-24T02:13:28.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.842+0000 7faa31ecd640 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cc8240 con 0x55cdb8cc5870 2024-04-24T02:13:28.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.842+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa1c071030 con 0x55cdb8cc5870 2024-04-24T02:13:28.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.842+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cc8240 con 0x55cdb8cbf620 2024-04-24T02:13:28.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.842+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa2402b070 con 0x55cdb8cbf620 2024-04-24T02:13:28.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.842+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cc8240 con 0x7faa2c031040 2024-04-24T02:13:28.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.843+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa2402b070 con 0x7faa2c031040 2024-04-24T02:13:28.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.843+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cc8240 con 0x55cdb8cbf620 2024-04-24T02:13:28.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.843+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa2402b070 con 0x55cdb8cbf620 2024-04-24T02:13:28.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.843+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cc8240 con 0x7faa1c082070 2024-04-24T02:13:28.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.843+0000 7faa31ecd640 1 -- 172.21.15.134:0/1308038222 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7faa2c01f070 con 0x7faa1c082070 2024-04-24T02:13:28.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.843+0000 7faa31ecd640 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cc8240 con 0x55cdb8cc5870 2024-04-24T02:13:28.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.843+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa1c071030 con 0x55cdb8cc5870 2024-04-24T02:13:28.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.843+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cc8240 con 0x55cdb8cc5870 2024-04-24T02:13:28.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.844+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa1c071030 con 0x55cdb8cc5870 2024-04-24T02:13:28.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.844+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cc8240 con 0x7faa1c082070 2024-04-24T02:13:28.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.844+0000 7faa31ecd640 1 -- 172.21.15.134:0/1308038222 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa2c01f070 con 0x7faa1c082070 2024-04-24T02:13:28.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.844+0000 7faa31ecd640 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cc8240 con 0x55cdb8cc5870 2024-04-24T02:13:28.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.844+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa1c071030 con 0x55cdb8cc5870 2024-04-24T02:13:28.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.844+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cc8240 con 0x55cdb8cc5870 2024-04-24T02:13:28.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.844+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa1c071030 con 0x55cdb8cc5870 2024-04-24T02:13:28.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.844+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cc8240 con 0x55cdb8cbf620 2024-04-24T02:13:28.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.844+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa2402b070 con 0x55cdb8cbf620 2024-04-24T02:13:28.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.844+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cc8240 con 0x55cdb8cbf620 2024-04-24T02:13:28.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.845+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7faa2402b070 con 0x55cdb8cbf620 2024-04-24T02:13:28.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.845+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cc8240 con 0x7faa2c031040 2024-04-24T02:13:28.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.845+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa2402b070 con 0x7faa2c031040 2024-04-24T02:13:28.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.845+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cc8240 con 0x55cdb8cc5870 2024-04-24T02:13:28.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.845+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa1c071030 con 0x55cdb8cc5870 2024-04-24T02:13:28.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.845+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cc8240 con 0x7faa1c082070 2024-04-24T02:13:28.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.846+0000 7faa31ecd640 1 -- 172.21.15.134:0/1308038222 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa2c01f070 con 0x7faa1c082070 2024-04-24T02:13:28.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.846+0000 7faa31ecd640 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cc8240 con 0x55cdb8cbf620 2024-04-24T02:13:28.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.846+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa2402b070 con 0x55cdb8cbf620 2024-04-24T02:13:28.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.846+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cc8240 con 0x7faa2c031040 2024-04-24T02:13:28.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.846+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa2402b070 con 0x7faa2c031040 2024-04-24T02:13:28.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.846+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cc8240 con 0x55cdb8cc5870 2024-04-24T02:13:28.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.847+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa1c071030 con 0x55cdb8cc5870 2024-04-24T02:13:28.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.847+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cc8240 con 0x7faa2c031040 2024-04-24T02:13:28.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.847+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa2402b070 con 0x7faa2c031040 2024-04-24T02:13:28.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.847+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cc8240 con 0x7faa1c082070 2024-04-24T02:13:28.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.847+0000 7faa31ecd640 1 -- 172.21.15.134:0/1308038222 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa2c040040 con 0x7faa1c082070 2024-04-24T02:13:28.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.847+0000 7faa31ecd640 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cc8240 con 0x55cdb8cc5870 2024-04-24T02:13:28.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.847+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa1c071030 con 0x55cdb8cc5870 2024-04-24T02:13:28.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.847+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cc8240 con 0x7faa1c082070 2024-04-24T02:13:28.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.847+0000 7faa31ecd640 1 -- 172.21.15.134:0/1308038222 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa2c040040 con 0x7faa1c082070 2024-04-24T02:13:28.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.848+0000 7faa31ecd640 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cc8240 con 0x55cdb8cbf620 2024-04-24T02:13:28.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.848+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7faa2402b070 con 0x55cdb8cbf620 2024-04-24T02:13:28.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.848+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cc8240 con 0x7faa1c082070 2024-04-24T02:13:28.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.848+0000 7faa31ecd640 1 -- 172.21.15.134:0/1308038222 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa2c040040 con 0x7faa1c082070 2024-04-24T02:13:28.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.848+0000 7faa35936800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:13:28.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.848+0000 7faa35936800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:13:28.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.848+0000 7faa35936800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:13:28.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.848+0000 7faa35936800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:13:28.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.848+0000 7faa35936800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:13:28.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.848+0000 7faa35936800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:13:28.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.848+0000 7faa35936800 20 rados->read ofs=0 len=0 2024-04-24T02:13:28.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.848+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cc4450 con 0x55cdb8cbf620 2024-04-24T02:13:28.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.848+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faa2402b070 con 0x55cdb8cbf620 2024-04-24T02:13:28.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.848+0000 7faa35936800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:28.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.848+0000 7faa35936800 20 rados->read ofs=0 len=0 2024-04-24T02:13:28.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.848+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cc4cf0 con 0x55cdb8cbf620 2024-04-24T02:13:28.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.848+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faa2402b070 con 0x55cdb8cbf620 2024-04-24T02:13:28.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.848+0000 7faa35936800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:13:28.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.849+0000 7faa35936800 20 rados->read ofs=0 len=0 2024-04-24T02:13:28.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.849+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cc4cf0 con 0x55cdb8cbf620 2024-04-24T02:13:28.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.849+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7faa2402b070 con 0x55cdb8cbf620 2024-04-24T02:13:28.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.849+0000 7faa35936800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:13:28.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.849+0000 7faa35936800 20 zone default found 2024-04-24T02:13:28.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.849+0000 7faa35936800 4 Realm: () 2024-04-24T02:13:28.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.849+0000 7faa35936800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:13:28.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.849+0000 7faa35936800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:13:28.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.849+0000 7faa35936800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:13:28.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.849+0000 7faa35936800 20 zonegroup default 2024-04-24T02:13:28.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.849+0000 7faa35936800 20 rados->read ofs=0 len=0 2024-04-24T02:13:28.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.849+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cc86c0 con 0x7faa2c031040 2024-04-24T02:13:28.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.849+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7faa2402b070 con 0x7faa2c031040 2024-04-24T02:13:28.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.849+0000 7faa35936800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:28.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.849+0000 7faa35936800 20 rados->read ofs=0 len=0 2024-04-24T02:13:28.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.849+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cca0d0 con 0x55cdb8cc5870 2024-04-24T02:13:28.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.849+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faa1c071030 con 0x55cdb8cc5870 2024-04-24T02:13:28.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.849+0000 7faa35936800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:28.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.849+0000 7faa35936800 20 rados->read ofs=0 len=0 2024-04-24T02:13:28.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.850+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cca640 con 0x55cdb8cc5870 2024-04-24T02:13:28.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.850+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faa1c071030 con 0x55cdb8cc5870 2024-04-24T02:13:28.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.850+0000 7faa35936800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:28.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.850+0000 7faa35936800 20 started sync module instance, tier type = 2024-04-24T02:13:28.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.850+0000 7faa35936800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:13:28.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.850+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cc9540 con 0x7faa1c082070 2024-04-24T02:13:28.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.851+0000 7faa31ecd640 1 -- 172.21.15.134:0/1308038222 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(44 notify.0 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa2c040040 con 0x7faa1c082070 2024-04-24T02:13:28.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.851+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94342057072944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cc91a0 con 0x7faa1c082070 2024-04-24T02:13:28.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.851+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8ccb570 con 0x55cdb8cbf620 2024-04-24T02:13:28.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.852+0000 7faa31ecd640 1 -- 172.21.15.134:0/1308038222 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94342057072944] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa2c040040 con 0x7faa1c082070 2024-04-24T02:13:28.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.852+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa2402b070 con 0x55cdb8cbf620 2024-04-24T02:13:28.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.852+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94342057077408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8ccb570 con 0x55cdb8cbf620 2024-04-24T02:13:28.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.852+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8ccbf30 con 0x55cdb8cc5870 2024-04-24T02:13:28.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.853+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94342057077408] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa2402b070 con 0x55cdb8cbf620 2024-04-24T02:13:28.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.853+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa1c071030 con 0x55cdb8cc5870 2024-04-24T02:13:28.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.853+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94342057078976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8ccb4e0 con 0x55cdb8cc5870 2024-04-24T02:13:28.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.853+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cccdf0 con 0x7faa1c082070 2024-04-24T02:13:28.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.855+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94342057078976] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa1c071030 con 0x55cdb8cc5870 2024-04-24T02:13:28.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.855+0000 7faa31ecd640 1 -- 172.21.15.134:0/1308038222 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(50 notify.3 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa2c040040 con 0x7faa1c082070 2024-04-24T02:13:28.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.855+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94342057085248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8ccd210 con 0x7faa1c082070 2024-04-24T02:13:28.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.855+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8ccdbd0 con 0x55cdb8cbf620 2024-04-24T02:13:28.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.855+0000 7faa31ecd640 1 -- 172.21.15.134:0/1308038222 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94342057085248] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa2c040040 con 0x7faa1c082070 2024-04-24T02:13:28.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.856+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa2402b070 con 0x55cdb8cbf620 2024-04-24T02:13:28.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.856+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94342057086784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8ccdbd0 con 0x55cdb8cbf620 2024-04-24T02:13:28.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.856+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cce5d0 con 0x7faa2c031040 2024-04-24T02:13:28.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.857+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(54 notify.5 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa2402b070 con 0x7faa2c031040 2024-04-24T02:13:28.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.857+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94342057091296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cce500 con 0x7faa2c031040 2024-04-24T02:13:28.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.857+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8ccf500 con 0x7faa2c031040 2024-04-24T02:13:28.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.857+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94342057086784] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa2402b070 con 0x55cdb8cbf620 2024-04-24T02:13:28.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.858+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94342057091296] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa2402b070 con 0x7faa2c031040 2024-04-24T02:13:28.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.858+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(56 notify.6 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa2402b070 con 0x7faa2c031040 2024-04-24T02:13:28.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.858+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94342057088800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8ccf010 con 0x7faa2c031040 2024-04-24T02:13:28.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.858+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8ccfdd0 con 0x7faa2c031040 2024-04-24T02:13:28.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.859+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(58 notify.7 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa2402b070 con 0x7faa2c031040 2024-04-24T02:13:28.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.859+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94342057097504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8ccf010 con 0x7faa2c031040 2024-04-24T02:13:28.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.859+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94342057088800] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa2402b070 con 0x7faa2c031040 2024-04-24T02:13:28.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.859+0000 7faa35936800 20 add_watcher() i=0 2024-04-24T02:13:28.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.859+0000 7faa35936800 20 add_watcher() i=1 2024-04-24T02:13:28.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.859+0000 7faa35936800 20 add_watcher() i=2 2024-04-24T02:13:28.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.859+0000 7faa35936800 20 add_watcher() i=3 2024-04-24T02:13:28.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.859+0000 7faa35936800 20 add_watcher() i=4 2024-04-24T02:13:28.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.859+0000 7faa35936800 20 add_watcher() i=5 2024-04-24T02:13:28.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.859+0000 7faa35936800 20 add_watcher() i=6 2024-04-24T02:13:28.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.860+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94342057097504] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa2402b070 con 0x7faa2c031040 2024-04-24T02:13:28.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.860+0000 7faa35936800 20 add_watcher() i=7 2024-04-24T02:13:28.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.860+0000 7faa35936800 2 all 8 watchers are set, enabling cache 2024-04-24T02:13:28.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.860+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cce9a0 con 0x55cdb8cbf620 2024-04-24T02:13:28.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.860+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7faa2402b070 con 0x55cdb8cbf620 2024-04-24T02:13:28.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.860+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94342057093536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cd0340 con 0x55cdb8cbf620 2024-04-24T02:13:28.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.861+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94342057093536] v32'225 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faa2402b070 con 0x55cdb8cbf620 2024-04-24T02:13:28.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.861+0000 7fa8e77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:13:28.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.862+0000 7faa35936800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:13:28.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.862+0000 7faa35936800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:13:28.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.862+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cdb7c0 con 0x55cdb8cbf620 2024-04-24T02:13:28.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.863+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'56 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faa2402b070 con 0x55cdb8cbf620 2024-04-24T02:13:28.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.863+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cdbdf0 con 0x7faa2c031040 2024-04-24T02:13:28.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.864+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'33 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faa2402b070 con 0x7faa2c031040 2024-04-24T02:13:28.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.864+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cdb950 con 0x55cdb8cc5870 2024-04-24T02:13:28.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.865+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faa1c071030 con 0x55cdb8cc5870 2024-04-24T02:13:28.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.865+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cdc210 con 0x55cdb8cbf620 2024-04-24T02:13:28.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.866+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'226 uv169 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faa2402b070 con 0x55cdb8cbf620 2024-04-24T02:13:28.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.866+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cdc3e0 con 0x7faa1c082070 2024-04-24T02:13:28.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.867+0000 7faa31ecd640 1 -- 172.21.15.134:0/1308038222 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'76 uv58 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faa2c040040 con 0x7faa1c082070 2024-04-24T02:13:28.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.867+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cdc880 con 0x55cdb8cc5870 2024-04-24T02:13:28.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.868+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 <== osd.3 v2:172.21.15.134:6801/3585115521 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'59 uv48 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faa1c071030 con 0x55cdb8cc5870 2024-04-24T02:13:28.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.868+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cdccb0 con 0x55cdb8cbf620 2024-04-24T02:13:28.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.869+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faa2402b070 con 0x55cdb8cbf620 2024-04-24T02:13:28.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.869+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cdccb0 con 0x7faa2c031040 2024-04-24T02:13:28.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.870+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'52 uv41 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faa2402b070 con 0x7faa2c031040 2024-04-24T02:13:28.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.870+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cdccb0 con 0x7faa1c082070 2024-04-24T02:13:28.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.871+0000 7faa31ecd640 1 -- 172.21.15.134:0/1308038222 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faa2c040040 con 0x7faa1c082070 2024-04-24T02:13:28.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.871+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cdd260 con 0x55cdb8cc5870 2024-04-24T02:13:28.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.872+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 <== osd.3 v2:172.21.15.134:6801/3585115521 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faa1c071030 con 0x55cdb8cc5870 2024-04-24T02:13:28.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.872+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cdd600 con 0x7faa1c082070 2024-04-24T02:13:28.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.873+0000 7faa31ecd640 1 -- 172.21.15.134:0/1308038222 <== osd.2 v2:172.21.15.134:6800/214480313 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'77 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa2c040040 con 0x7faa1c082070 2024-04-24T02:13:28.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.873+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cddc10 con 0x7faa2c031040 2024-04-24T02:13:28.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.874+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'30 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa2402b070 con 0x7faa2c031040 2024-04-24T02:13:28.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.874+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cddc10 con 0x7faa1c082070 2024-04-24T02:13:28.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.875+0000 7faa31ecd640 1 -- 172.21.15.134:0/1308038222 <== osd.2 v2:172.21.15.134:6800/214480313 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa2c040040 con 0x7faa1c082070 2024-04-24T02:13:28.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.875+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cde0c0 con 0x7faa2c031040 2024-04-24T02:13:28.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.876+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'63 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa2402b070 con 0x7faa2c031040 2024-04-24T02:13:28.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.877+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cde0c0 con 0x55cdb8cbf620 2024-04-24T02:13:28.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.878+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'227 uv171 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa2402b070 con 0x55cdb8cbf620 2024-04-24T02:13:28.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.878+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cde0c0 con 0x55cdb8cc5870 2024-04-24T02:13:28.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.879+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 <== osd.3 v2:172.21.15.134:6801/3585115521 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'68 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa1c071030 con 0x55cdb8cc5870 2024-04-24T02:13:28.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.879+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cde0c0 con 0x7faa1c082070 2024-04-24T02:13:28.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.880+0000 7faa31ecd640 1 -- 172.21.15.134:0/1308038222 <== osd.2 v2:172.21.15.134:6800/214480313 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'78 uv63 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa2c040040 con 0x7faa1c082070 2024-04-24T02:13:28.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.880+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cde0c0 con 0x55cdb8cc5870 2024-04-24T02:13:28.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.881+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 <== osd.3 v2:172.21.15.134:6801/3585115521 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'39 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa1c071030 con 0x55cdb8cc5870 2024-04-24T02:13:28.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.881+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cde0c0 con 0x55cdb8cbf620 2024-04-24T02:13:28.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.882+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa2402b070 con 0x55cdb8cbf620 2024-04-24T02:13:28.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.882+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cde0c0 con 0x55cdb8cbf620 2024-04-24T02:13:28.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.883+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'228 uv173 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa2402b070 con 0x55cdb8cbf620 2024-04-24T02:13:28.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.883+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cde0c0 con 0x55cdb8cc5870 2024-04-24T02:13:28.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.884+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 <== osd.3 v2:172.21.15.134:6801/3585115521 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'69 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa1c071030 con 0x55cdb8cc5870 2024-04-24T02:13:28.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.884+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cde0c0 con 0x7faa1c082070 2024-04-24T02:13:28.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.885+0000 7faa31ecd640 1 -- 172.21.15.134:0/1308038222 <== osd.2 v2:172.21.15.134:6800/214480313 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'42 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa2c040040 con 0x7faa1c082070 2024-04-24T02:13:28.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.885+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cde0c0 con 0x55cdb8cc5870 2024-04-24T02:13:28.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.886+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 <== osd.3 v2:172.21.15.134:6801/3585115521 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa1c071030 con 0x55cdb8cc5870 2024-04-24T02:13:28.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.886+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cde0c0 con 0x55cdb8cc5870 2024-04-24T02:13:28.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.887+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 <== osd.3 v2:172.21.15.134:6801/3585115521 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'44 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa1c071030 con 0x55cdb8cc5870 2024-04-24T02:13:28.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.887+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cde0c0 con 0x55cdb8cc5870 2024-04-24T02:13:28.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.887+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 <== osd.3 v2:172.21.15.134:6801/3585115521 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa1c071030 con 0x55cdb8cc5870 2024-04-24T02:13:28.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.887+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cde0c0 con 0x55cdb8cc5870 2024-04-24T02:13:28.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.888+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 <== osd.3 v2:172.21.15.134:6801/3585115521 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'60 uv50 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa1c071030 con 0x55cdb8cc5870 2024-04-24T02:13:28.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.888+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cde0c0 con 0x7faa2c031040 2024-04-24T02:13:28.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.889+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa2402b070 con 0x7faa2c031040 2024-04-24T02:13:28.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.889+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cde0c0 con 0x55cdb8cc5870 2024-04-24T02:13:28.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.890+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 <== osd.3 v2:172.21.15.134:6801/3585115521 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'38 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa1c071030 con 0x55cdb8cc5870 2024-04-24T02:13:28.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.890+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cde0c0 con 0x7faa2c031040 2024-04-24T02:13:28.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.892+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'53 uv43 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa2402b070 con 0x7faa2c031040 2024-04-24T02:13:28.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.892+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cde0c0 con 0x55cdb8cc5870 2024-04-24T02:13:28.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.893+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 <== osd.3 v2:172.21.15.134:6801/3585115521 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'70 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa1c071030 con 0x55cdb8cc5870 2024-04-24T02:13:28.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.893+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cde0c0 con 0x7faa2c031040 2024-04-24T02:13:28.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.894+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.0 v2:172.21.15.104:6800/2419146313 20 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'64 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa2402b070 con 0x7faa2c031040 2024-04-24T02:13:28.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.894+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8cde0c0 con 0x7faa1c082070 2024-04-24T02:13:28.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.895+0000 7faa31ecd640 1 -- 172.21.15.134:0/1308038222 <== osd.2 v2:172.21.15.134:6800/214480313 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa2c040040 con 0x7faa1c082070 2024-04-24T02:13:28.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.895+0000 7fa8e67e4640 20 reqs_thread_entry: start 2024-04-24T02:13:28.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.895+0000 7faa35936800 20 init_complete bucket index max shards: 11 2024-04-24T02:13:28.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.895+0000 7faa35936800 20 Filter name: none 2024-04-24T02:13:28.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.896+0000 7fa857fff640 20 reqs_thread_entry: start 2024-04-24T02:13:28.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.896+0000 7faa35936800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-04-24T02:13:28.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.896+0000 7faa35936800 20 rados->read ofs=0 len=0 2024-04-24T02:13:28.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.896+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8d08f20 con 0x7faa1c082070 2024-04-24T02:13:28.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.896+0000 7faa31ecd640 1 -- 172.21.15.134:0/1308038222 <== osd.2 v2:172.21.15.134:6800/214480313 21 ==== osd_op_reply(94 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7faa2c040040 con 0x7faa1c082070 2024-04-24T02:13:28.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.896+0000 7faa35936800 20 rados_obj.operate() r=0 bl.length=380 2024-04-24T02:13:28.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.896+0000 7faa35936800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-04-24T02:13:28.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.896+0000 7faa35936800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-04-24T02:13:28.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.896+0000 7faa35936800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:13:28.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.896+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8d0b940 con 0x55cdb8cbf620 2024-04-24T02:13:28.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.896+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(95 bud.buckets [call out=184b] v0'0 uv4 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7faa2402b070 con 0x55cdb8cbf620 2024-04-24T02:13:28.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.896+0000 7faa35936800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9 : miss 2024-04-24T02:13:28.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.896+0000 7faa35936800 20 rados->read ofs=0 len=0 2024-04-24T02:13:28.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.896+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:96 8.10 8:0fe20272:root::.bucket.meta.myfoo6%3a582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8d0b830 con 0x55cdb8cc5870 2024-04-24T02:13:28.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.897+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 <== osd.3 v2:172.21.15.134:6801/3585115521 26 ==== osd_op_reply(96 .bucket.meta.myfoo6:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=212b] v0'0 uv3 ondisk = 0) ==== 333+0+656 (crc 0 0 0) 0x7faa1c071030 con 0x55cdb8cc5870 2024-04-24T02:13:28.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.897+0000 7faa35936800 20 rados_obj.operate() r=0 bl.length=380 2024-04-24T02:13:28.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.897+0000 7faa35936800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9 info.flags=0x17 2024-04-24T02:13:28.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.897+0000 7faa35936800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9 to cache LRU end 2024-04-24T02:13:28.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.897+0000 7faa35936800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:13:28.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.897+0000 7faa35936800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-04-24T02:13:28.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.897+0000 7faa35936800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9 2024-04-24T02:13:28.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.897+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:97 4.2 4:43700786:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8af4360 con 0x55cdb8cbf620 2024-04-24T02:13:28.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.897+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 30 ==== osd_op_reply(97 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7faa2402b070 con 0x55cdb8cbf620 2024-04-24T02:13:28.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.897+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:98 4.19 4:99b23a2c:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8af43a0 con 0x55cdb8cc5870 2024-04-24T02:13:28.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.897+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 <== osd.3 v2:172.21.15.134:6801/3585115521 27 ==== osd_op_reply(98 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7faa1c071030 con 0x55cdb8cc5870 2024-04-24T02:13:28.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.897+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:99 4.9 4:936fe5c7:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8af43a0 con 0x55cdb8cbf620 2024-04-24T02:13:28.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.898+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 31 ==== osd_op_reply(99 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7faa2402b070 con 0x55cdb8cbf620 2024-04-24T02:13:28.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.898+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:100 4.1d 4:b965fd86:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8af43e0 con 0x55cdb8cc5870 2024-04-24T02:13:28.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.898+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 <== osd.3 v2:172.21.15.134:6801/3585115521 28 ==== osd_op_reply(100 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7faa1c071030 con 0x55cdb8cc5870 2024-04-24T02:13:28.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.898+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:101 4.c 4:32e81382:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8af43e0 con 0x55cdb8cbf620 2024-04-24T02:13:28.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.898+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 32 ==== osd_op_reply(101 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7faa2402b070 con 0x55cdb8cbf620 2024-04-24T02:13:28.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.898+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:102 4.4 4:20e31cdf:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8af43e0 con 0x7faa2c031040 2024-04-24T02:13:28.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.899+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.0 v2:172.21.15.104:6800/2419146313 21 ==== osd_op_reply(102 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7faa2402b070 con 0x7faa2c031040 2024-04-24T02:13:28.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.899+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:103 4.2e 4:75e8498a:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8af43e0 con 0x55cdb8cc5870 2024-04-24T02:13:28.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.899+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 <== osd.3 v2:172.21.15.134:6801/3585115521 29 ==== osd_op_reply(103 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.6 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7faa1c071030 con 0x55cdb8cc5870 2024-04-24T02:13:28.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.899+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:104 4.34 4:2c534dbe:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8af43e0 con 0x7faa1c082070 2024-04-24T02:13:28.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.899+0000 7faa31ecd640 1 -- 172.21.15.134:0/1308038222 <== osd.2 v2:172.21.15.134:6800/214480313 22 ==== osd_op_reply(104 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7faa2c040040 con 0x7faa1c082070 2024-04-24T02:13:28.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.899+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:105 4.37 4:efbe90b3:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8af43e0 con 0x7faa2c031040 2024-04-24T02:13:28.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.900+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.0 v2:172.21.15.104:6800/2419146313 22 ==== osd_op_reply(105 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7faa24061060 con 0x7faa2c031040 2024-04-24T02:13:28.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.900+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:106 4.7 4:e2dae6c0:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8af43a0 con 0x7faa2c031040 2024-04-24T02:13:28.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.900+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.0 v2:172.21.15.104:6800/2419146313 23 ==== osd_op_reply(106 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.9 [call out=289b] v0'0 uv11 ondisk = 0) ==== 194+0+289 (crc 0 0 0) 0x7faa24061060 con 0x7faa2c031040 2024-04-24T02:13:28.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.900+0000 7faa35936800 10 cls_bucket_list_unordered: got thirteen 2024-04-24T02:13:28.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.900+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:107 4.35 4:ad0b0f32:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8af43a0 con 0x55cdb8cbf620 2024-04-24T02:13:28.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.901+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 33 ==== osd_op_reply(107 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.10 [call out=85b] v0'0 uv9 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7faa24061060 con 0x55cdb8cbf620 2024-04-24T02:13:28.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.901+0000 7faa35936800 20 get_obj_state: octx=0x7faa240013c0 obj=myfoo6:thirteen state=0x55cdb8af2428 s->prefetch_data=0 2024-04-24T02:13:28.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.901+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:108 3.f 3:f14cd3bc:::582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8af3250 con 0x7faa1c082070 2024-04-24T02:13:28.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.901+0000 7faa31ecd640 1 -- 172.21.15.134:0/1308038222 <== osd.2 v2:172.21.15.134:6800/214480313 23 ==== osd_op_reply(108 582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9_thirteen [getxattrs out=819b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 238+0+835 (crc 0 0 0) 0x7faa2c040040 con 0x7faa1c082070 2024-04-24T02:13:28.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.901+0000 7faa35936800 10 manifest: total_size = 8 2024-04-24T02:13:28.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.901+0000 7faa35936800 20 get_obj_state: setting s->obj_tag to _gQVFJukDFJhIgwkddaUVtY9DO4UDfHm 2024-04-24T02:13:28.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.901+0000 7faa35936800 20 get_obj_state: octx=0x7faa240013c0 obj=myfoo6:thirteen state=0x55cdb8af2428 s->prefetch_data=0 2024-04-24T02:13:28.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.901+0000 7faa35936800 20 prepare_atomic_modification: state is not atomic. state=0x55cdb8af2428 2024-04-24T02:13:28.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.901+0000 7faa35936800 20 bucket index object: :.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.9 2024-04-24T02:13:28.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.901+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:109 4.7 4:e2dae6c0:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8af3b10 con 0x7faa2c031040 2024-04-24T02:13:28.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.902+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.0 v2:172.21.15.104:6800/2419146313 24 ==== osd_op_reply(109 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.9 [stat,call,call] v32'13 uv13 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7faa24061060 con 0x7faa2c031040 2024-04-24T02:13:28.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.902+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:110 3.f 3:f14cd3bc:::582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9_thirteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8af3b10 con 0x7faa1c082070 2024-04-24T02:13:28.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.903+0000 7faa31ecd640 1 -- 172.21.15.134:0/1308038222 <== osd.2 v2:172.21.15.134:6800/214480313 24 ==== osd_op_reply(110 582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9_thirteen [call] v32'3 uv3 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7faa2c040040 con 0x7faa1c082070 2024-04-24T02:13:28.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.903+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:111 4.7 4:e2dae6c0:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=264b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8af3a50 con 0x7faa2c031040 2024-04-24T02:13:28.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.903+0000 7faa35936800 20 list_objects_ordered: starting attempt 1 2024-04-24T02:13:28.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.903+0000 7faa35936800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-04-24T02:13:28.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.903+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:112 4.2 4:43700786:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8af3a50 con 0x55cdb8cbf620 2024-04-24T02:13:28.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.903+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:113 4.19 4:99b23a2c:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8af9ee0 con 0x55cdb8cc5870 2024-04-24T02:13:28.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.903+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:114 4.9 4:936fe5c7:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8d113f0 con 0x55cdb8cbf620 2024-04-24T02:13:28.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.903+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:115 4.1d 4:b965fd86:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8d13ce0 con 0x55cdb8cc5870 2024-04-24T02:13:28.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.903+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:116 4.c 4:32e81382:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8d167f0 con 0x55cdb8cbf620 2024-04-24T02:13:28.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.903+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:117 4.4 4:20e31cdf:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8d19190 con 0x7faa2c031040 2024-04-24T02:13:28.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.903+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:118 4.2e 4:75e8498a:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8d167f0 con 0x55cdb8cc5870 2024-04-24T02:13:28.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.903+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:119 4.34 4:2c534dbe:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8d1cb60 con 0x7faa1c082070 2024-04-24T02:13:28.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.903+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:120 4.37 4:efbe90b3:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8d19190 con 0x7faa2c031040 2024-04-24T02:13:28.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.903+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:121 4.7 4:e2dae6c0:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8d19190 con 0x7faa2c031040 2024-04-24T02:13:28.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.903+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:122 4.35 4:ad0b0f32:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8dbe780 con 0x55cdb8cbf620 2024-04-24T02:13:28.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.903+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.0 v2:172.21.15.104:6800/2419146313 25 ==== osd_op_reply(120 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7faa24061060 con 0x7faa2c031040 2024-04-24T02:13:28.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.903+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.0 v2:172.21.15.104:6800/2419146313 26 ==== osd_op_reply(117 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7faa24061060 con 0x7faa2c031040 2024-04-24T02:13:28.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.903+0000 7faa31ecd640 1 -- 172.21.15.134:0/1308038222 <== osd.2 v2:172.21.15.134:6800/214480313 25 ==== osd_op_reply(119 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7faa2c040040 con 0x7faa1c082070 2024-04-24T02:13:28.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.903+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 <== osd.3 v2:172.21.15.134:6801/3585115521 30 ==== osd_op_reply(113 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7faa1c071030 con 0x55cdb8cc5870 2024-04-24T02:13:28.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.903+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 <== osd.3 v2:172.21.15.134:6801/3585115521 31 ==== osd_op_reply(115 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7faa1c071030 con 0x55cdb8cc5870 2024-04-24T02:13:28.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.903+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 <== osd.3 v2:172.21.15.134:6801/3585115521 32 ==== osd_op_reply(118 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.6 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7faa1c071030 con 0x55cdb8cc5870 2024-04-24T02:13:28.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.904+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 34 ==== osd_op_reply(112 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7faa24061060 con 0x55cdb8cbf620 2024-04-24T02:13:28.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.904+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 35 ==== osd_op_reply(114 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7faa24061060 con 0x55cdb8cbf620 2024-04-24T02:13:28.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.904+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 36 ==== osd_op_reply(116 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7faa24061060 con 0x55cdb8cbf620 2024-04-24T02:13:28.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.904+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 37 ==== osd_op_reply(122 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.10 [call out=85b] v0'0 uv9 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7faa24061060 con 0x55cdb8cbf620 2024-04-24T02:13:28.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.904+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.0 v2:172.21.15.104:6800/2419146313 27 ==== osd_op_reply(111 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.9 [stat,call,call] v32'14 uv14 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7faa24061060 con 0x7faa2c031040 2024-04-24T02:13:28.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.904+0000 7fa914ff9640 20 handle_completion(): completion ok for obj=thirteen 2024-04-24T02:13:28.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.904+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.0 v2:172.21.15.104:6800/2419146313 28 ==== osd_op_reply(121 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.9 [call out=124b] v0'0 uv14 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7faa24061060 con 0x7faa2c031040 2024-04-24T02:13:28.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.904+0000 7faa35936800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-04-24T02:13:28.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.904+0000 7faa35936800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-04-24T02:13:28.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.904+0000 7faa35936800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-04-24T02:13:28.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.904+0000 7faa35936800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-04-24T02:13:28.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.904+0000 7faa35936800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo6[582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9])"; uploads.size()=0; is_truncated=0 2024-04-24T02:13:28.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.904+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:123 4.2 4:43700786:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8dbe7e0 con 0x55cdb8cbf620 2024-04-24T02:13:28.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.904+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:124 4.19 4:99b23a2c:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8af9a30 con 0x55cdb8cc5870 2024-04-24T02:13:28.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.904+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:125 4.9 4:936fe5c7:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8dbc230 con 0x55cdb8cbf620 2024-04-24T02:13:28.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.904+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:126 4.1d 4:b965fd86:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8dbe7e0 con 0x55cdb8cc5870 2024-04-24T02:13:28.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.904+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:127 4.c 4:32e81382:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8dba0c0 con 0x55cdb8cbf620 2024-04-24T02:13:28.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.904+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:128 4.4 4:20e31cdf:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8dbc230 con 0x7faa2c031040 2024-04-24T02:13:28.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.904+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:129 4.2e 4:75e8498a:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8dbe7e0 con 0x55cdb8cc5870 2024-04-24T02:13:28.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.904+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:130 4.34 4:2c534dbe:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8dbc230 con 0x7faa1c082070 2024-04-24T02:13:28.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.904+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:131 4.37 4:efbe90b3:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8dbe7e0 con 0x7faa2c031040 2024-04-24T02:13:28.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.904+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:132 4.7 4:e2dae6c0:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8dbc230 con 0x7faa2c031040 2024-04-24T02:13:28.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.904+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:133 4.35 4:ad0b0f32:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8dbe7e0 con 0x55cdb8cbf620 2024-04-24T02:13:28.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.905+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 38 ==== osd_op_reply(127 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7faa24061060 con 0x55cdb8cbf620 2024-04-24T02:13:28.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.905+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 39 ==== osd_op_reply(123 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7faa24061060 con 0x55cdb8cbf620 2024-04-24T02:13:28.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.905+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 <== osd.3 v2:172.21.15.134:6801/3585115521 33 ==== osd_op_reply(124 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7faa1c071030 con 0x55cdb8cc5870 2024-04-24T02:13:28.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.905+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 40 ==== osd_op_reply(125 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7faa24061060 con 0x55cdb8cbf620 2024-04-24T02:13:28.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.905+0000 7faa31ecd640 1 -- 172.21.15.134:0/1308038222 <== osd.2 v2:172.21.15.134:6800/214480313 26 ==== osd_op_reply(130 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7faa2c040040 con 0x7faa1c082070 2024-04-24T02:13:28.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.905+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 <== osd.3 v2:172.21.15.134:6801/3585115521 34 ==== osd_op_reply(126 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7faa1c071030 con 0x55cdb8cc5870 2024-04-24T02:13:28.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.905+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.0 v2:172.21.15.104:6800/2419146313 29 ==== osd_op_reply(131 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7faa24061060 con 0x7faa2c031040 2024-04-24T02:13:28.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.905+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.0 v2:172.21.15.104:6800/2419146313 30 ==== osd_op_reply(132 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.9 [call out=124b] v0'0 uv14 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7faa24061060 con 0x7faa2c031040 2024-04-24T02:13:28.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.905+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.0 v2:172.21.15.104:6800/2419146313 31 ==== osd_op_reply(128 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7faa24061060 con 0x7faa2c031040 2024-04-24T02:13:28.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.905+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 <== osd.3 v2:172.21.15.134:6801/3585115521 35 ==== osd_op_reply(129 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.6 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7faa1c071030 con 0x55cdb8cc5870 2024-04-24T02:13:28.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.905+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 41 ==== osd_op_reply(133 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.10 [call out=85b] v0'0 uv9 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7faa24061060 con 0x55cdb8cbf620 2024-04-24T02:13:28.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.905+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:134 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8dbe7e0 con 0x55cdb8cbf620 2024-04-24T02:13:28.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.937+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 42 ==== osd_op_reply(134 bud.buckets [call] v32'5 uv5 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7faa24061060 con 0x55cdb8cbf620 2024-04-24T02:13:28.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.937+0000 7faa35936800 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-04-24T02:13:28.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.937+0000 7faa35936800 20 rados->read ofs=0 len=0 2024-04-24T02:13:28.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.938+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:135 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8dbe7e0 con 0x55cdb8cbf620 2024-04-24T02:13:28.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.938+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 43 ==== osd_op_reply(135 myfoo6 [call out=48b,read 0~166 out=166b] v0'0 uv17 ondisk = 0) ==== 192+0+214 (crc 0 0 0) 0x7faa24061060 con 0x55cdb8cbf620 2024-04-24T02:13:28.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.938+0000 7faa35936800 20 rados_obj.operate() r=0 bl.length=166 2024-04-24T02:13:28.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.938+0000 7faa35936800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x11 2024-04-24T02:13:28.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.938+0000 7faa35936800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-04-24T02:13:28.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.938+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:136 8.18 8:1944a257:root::myfoo6:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8dbe7e0 con 0x55cdb8cbf620 2024-04-24T02:13:28.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.939+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 44 ==== osd_op_reply(136 myfoo6 [call,call,delete] v32'18 uv18 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7faa24061060 con 0x55cdb8cbf620 2024-04-24T02:13:28.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.939+0000 7faa35936800 10 removing default.rgw.meta+root+myfoo6 from cache 2024-04-24T02:13:28.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.939+0000 7faa35936800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-04-24T02:13:28.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.939+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94342055171456 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8dbe7e0 con 0x7faa1c082070 2024-04-24T02:13:28.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.939+0000 7faa31ecd640 1 -- 172.21.15.134:0/1308038222 <== osd.2 v2:172.21.15.134:6800/214480313 27 ==== watch-notify(notify (1) cookie 94342057085248 notify 137438953489 ret 0) ==== 192+0+0 (crc 0 0 0) 0x55cdb8cdb2d0 con 0x7faa1c082070 2024-04-24T02:13:28.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.939+0000 7fa907fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953489 cookie 94342057085248 notifier 4746 bl.length()=150 2024-04-24T02:13:28.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.939+0000 7faa31ecd640 1 -- 172.21.15.134:0/1308038222 <== osd.2 v2:172.21.15.134:6800/214480313 28 ==== osd_op_reply(137 notify.3 [notify cookie 94342055171456 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7faa2c040040 con 0x7faa1c082070 2024-04-24T02:13:28.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.939+0000 7fa907fff640 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fa864003320 con 0x7faa1c082070 2024-04-24T02:13:28.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.940+0000 7faa31ecd640 1 -- 172.21.15.134:0/1308038222 <== osd.2 v2:172.21.15.134:6800/214480313 29 ==== watch-notify(notify_complete (2) cookie 94342055171456 notify 137438953489 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cdb8cdd9a0 con 0x7faa1c082070 2024-04-24T02:13:28.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.940+0000 7faa31ecd640 1 -- 172.21.15.134:0/1308038222 <== osd.2 v2:172.21.15.134:6800/214480313 30 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa2c040040 con 0x7faa1c082070 2024-04-24T02:13:28.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.940+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:139 8.10 8:0fe20272:root::.bucket.meta.myfoo6%3a582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8dbe7e0 con 0x55cdb8cc5870 2024-04-24T02:13:28.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.941+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 <== osd.3 v2:172.21.15.134:6801/3585115521 36 ==== osd_op_reply(139 .bucket.meta.myfoo6:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9 [call,call,delete] v32'4 uv4 ondisk = 0) ==== 291+0+0 (crc 0 0 0) 0x7faa1c071030 con 0x55cdb8cc5870 2024-04-24T02:13:28.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.941+0000 7faa35936800 10 removing default.rgw.meta+root+.bucket.meta.myfoo6:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9 from cache 2024-04-24T02:13:28.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.941+0000 7faa35936800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo6:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9, ofs0, ns] 2024-04-24T02:13:28.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.941+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:140 7.15 7:a93a5511:::notify.2:head [notify cookie 94342057342880 in=219b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8dbe7e0 con 0x55cdb8cc5870 2024-04-24T02:13:28.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.941+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 <== osd.3 v2:172.21.15.134:6801/3585115521 37 ==== watch-notify(notify (1) cookie 94342057078976 notify 137438953488 ret 0) ==== 249+0+0 (crc 0 0 0) 0x55cdb8d0ad20 con 0x55cdb8cc5870 2024-04-24T02:13:28.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.941+0000 7fa907fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953488 cookie 94342057078976 notifier 4746 bl.length()=207 2024-04-24T02:13:28.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.941+0000 7fa907fff640 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:141 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fa864003320 con 0x55cdb8cc5870 2024-04-24T02:13:28.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.941+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 <== osd.3 v2:172.21.15.134:6801/3585115521 38 ==== osd_op_reply(140 notify.2 [notify cookie 94342057342880 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7faa1c071030 con 0x55cdb8cc5870 2024-04-24T02:13:28.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.941+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 <== osd.3 v2:172.21.15.134:6801/3585115521 39 ==== watch-notify(notify_complete (2) cookie 94342057342880 notify 137438953488 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cdb8cb3fd0 con 0x55cdb8cc5870 2024-04-24T02:13:28.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.941+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 <== osd.3 v2:172.21.15.134:6801/3585115521 40 ==== osd_op_reply(141 notify.2 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa1c071030 con 0x55cdb8cc5870 2024-04-24T02:13:28.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.941+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:142 4.2 4:43700786:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8dbe7e0 con 0x55cdb8cbf620 2024-04-24T02:13:28.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.941+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:143 4.19 4:99b23a2c:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8af9a30 con 0x55cdb8cc5870 2024-04-24T02:13:28.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.941+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:144 4.9 4:936fe5c7:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8af2110 con 0x55cdb8cbf620 2024-04-24T02:13:28.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.941+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:145 4.1d 4:b965fd86:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8d09b70 con 0x55cdb8cc5870 2024-04-24T02:13:28.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.941+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:146 4.c 4:32e81382:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8dbe7e0 con 0x55cdb8cbf620 2024-04-24T02:13:28.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.941+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:147 4.4 4:20e31cdf:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8af9a30 con 0x7faa2c031040 2024-04-24T02:13:28.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.941+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:148 4.2e 4:75e8498a:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8af2110 con 0x55cdb8cc5870 2024-04-24T02:13:28.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.941+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:149 4.34 4:2c534dbe:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8dbe7e0 con 0x7faa1c082070 2024-04-24T02:13:28.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.941+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:150 4.37 4:efbe90b3:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8af9a30 con 0x7faa2c031040 2024-04-24T02:13:28.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.941+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:151 4.7 4:e2dae6c0:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8d09b70 con 0x7faa2c031040 2024-04-24T02:13:28.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.942+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:152 4.35 4:ad0b0f32:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8af2110 con 0x55cdb8cbf620 2024-04-24T02:13:28.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.943+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 45 ==== osd_op_reply(144 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.2 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7faa24061060 con 0x55cdb8cbf620 2024-04-24T02:13:28.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.943+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.0 v2:172.21.15.104:6800/2419146313 32 ==== osd_op_reply(150 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.8 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7faa24061060 con 0x7faa2c031040 2024-04-24T02:13:28.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.943+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.0 v2:172.21.15.104:6800/2419146313 33 ==== osd_op_reply(151 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.9 [delete] v32'15 uv15 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7faa24061060 con 0x7faa2c031040 2024-04-24T02:13:28.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.943+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 <== osd.3 v2:172.21.15.134:6801/3585115521 41 ==== osd_op_reply(143 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.1 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7faa1c071030 con 0x55cdb8cc5870 2024-04-24T02:13:28.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.943+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 <== osd.3 v2:172.21.15.134:6801/3585115521 42 ==== osd_op_reply(145 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.3 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7faa1c071030 con 0x55cdb8cc5870 2024-04-24T02:13:28.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.943+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 46 ==== osd_op_reply(146 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.4 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7faa24061060 con 0x55cdb8cbf620 2024-04-24T02:13:28.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.943+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 <== osd.3 v2:172.21.15.134:6801/3585115521 43 ==== osd_op_reply(148 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.6 [delete] v32'7 uv7 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7faa1c071030 con 0x55cdb8cc5870 2024-04-24T02:13:28.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.943+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 47 ==== osd_op_reply(142 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.0 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7faa24061060 con 0x55cdb8cbf620 2024-04-24T02:13:28.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.943+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 48 ==== osd_op_reply(152 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.10 [delete] v32'10 uv10 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7faa24061060 con 0x55cdb8cbf620 2024-04-24T02:13:28.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.945+0000 7faa31ecd640 1 -- 172.21.15.134:0/1308038222 <== osd.2 v2:172.21.15.134:6800/214480313 31 ==== osd_op_reply(149 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.7 [delete] v32'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7faa2c040040 con 0x7faa1c082070 2024-04-24T02:13:28.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.945+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.0 v2:172.21.15.104:6800/2419146313 34 ==== osd_op_reply(147 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9.5 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7faa24061060 con 0x7faa2c031040 2024-04-24T02:13:28.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.945+0000 7faa35936800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo6/582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9 : miss 2024-04-24T02:13:28.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.945+0000 7faa35936800 20 rados->read ofs=0 len=0 2024-04-24T02:13:28.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.945+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:153 6.9 6:93b427f4:::pubsub..bucket.myfoo6%2f582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8d09b70 con 0x55cdb8cc5870 2024-04-24T02:13:28.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.945+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 <== osd.3 v2:172.21.15.134:6801/3585115521 44 ==== osd_op_reply(153 pubsub..bucket.myfoo6/582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7faa1c071030 con 0x55cdb8cc5870 2024-04-24T02:13:28.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.946+0000 7faa35936800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:28.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.946+0000 7faa35936800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo6/582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9 info.flags=0x0 2024-04-24T02:13:28.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.946+0000 7faa35936800 10 adding default.rgw.log++pubsub..bucket.myfoo6/582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9 to cache LRU end 2024-04-24T02:13:28.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.946+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:154 6.9 6:93b427f4:::pubsub..bucket.myfoo6%2f582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8af9a30 con 0x55cdb8cc5870 2024-04-24T02:13:28.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.948+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 <== osd.3 v2:172.21.15.134:6801/3585115521 45 ==== osd_op_reply(154 pubsub..bucket.myfoo6/582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.9 [delete] v32'61 uv50 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7faa1c071030 con 0x55cdb8cc5870 2024-04-24T02:13:28.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.948+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:155 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8dbe7e0 con 0x55cdb8cbf620 2024-04-24T02:13:28.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.949+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 49 ==== osd_op_reply(155 bud.buckets [call] v32'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7faa24061060 con 0x55cdb8cbf620 2024-04-24T02:13:28.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.949+0000 7faa35936800 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-04-24T02:13:28.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.949+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:156 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8dbe7e0 con 0x55cdb8cbf620 2024-04-24T02:13:28.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.950+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 50 ==== osd_op_reply(156 NX5QOQKC6BH2IDN8HC7A [delete] v32'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7faa24061060 con 0x55cdb8cbf620 2024-04-24T02:13:28.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.950+0000 7faa35936800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-04-24T02:13:28.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.950+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:157 7.3 7:c609908c:::notify.5:head [notify cookie 94342057342880 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8dbe7e0 con 0x7faa2c031040 2024-04-24T02:13:28.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.950+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.0 v2:172.21.15.104:6800/2419146313 35 ==== watch-notify(notify (1) cookie 94342057091296 notify 137438953511 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55cdb8cdd650 con 0x7faa2c031040 2024-04-24T02:13:28.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.950+0000 7fa907fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953511 cookie 94342057091296 notifier 4746 bl.length()=170 2024-04-24T02:13:28.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.950+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.0 v2:172.21.15.104:6800/2419146313 36 ==== osd_op_reply(157 notify.5 [notify cookie 94342057342880 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7faa24061060 con 0x7faa2c031040 2024-04-24T02:13:28.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.950+0000 7fa907fff640 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:158 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fa864003320 con 0x7faa2c031040 2024-04-24T02:13:28.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.950+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.0 v2:172.21.15.104:6800/2419146313 37 ==== osd_op_reply(158 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa24061060 con 0x7faa2c031040 2024-04-24T02:13:28.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.950+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.0 v2:172.21.15.104:6800/2419146313 38 ==== watch-notify(notify_complete (2) cookie 94342057342880 notify 137438953511 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cdb8cda0f0 con 0x7faa2c031040 2024-04-24T02:13:28.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.951+0000 7faa35936800 10 removing email index: 2024-04-24T02:13:28.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.951+0000 7faa35936800 10 removing user buckets index 2024-04-24T02:13:28.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.951+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:159 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8dbe7e0 con 0x55cdb8cbf620 2024-04-24T02:13:28.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.951+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 51 ==== osd_op_reply(159 bud.buckets [delete] v32'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7faa24061060 con 0x55cdb8cbf620 2024-04-24T02:13:28.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.951+0000 7faa35936800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-04-24T02:13:28.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.952+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94342057342880 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8dbe7e0 con 0x7faa2c031040 2024-04-24T02:13:28.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.952+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.0 v2:172.21.15.104:6800/2419146313 39 ==== watch-notify(notify (1) cookie 94342057088800 notify 137438953512 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55cdb8cda0f0 con 0x7faa2c031040 2024-04-24T02:13:28.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.952+0000 7fa907fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953512 cookie 94342057088800 notifier 4746 bl.length()=160 2024-04-24T02:13:28.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.952+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.0 v2:172.21.15.104:6800/2419146313 40 ==== osd_op_reply(160 notify.6 [notify cookie 94342057342880 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7faa24061060 con 0x7faa2c031040 2024-04-24T02:13:28.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.952+0000 7fa907fff640 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fa864003320 con 0x7faa2c031040 2024-04-24T02:13:28.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.952+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.0 v2:172.21.15.104:6800/2419146313 41 ==== watch-notify(notify_complete (2) cookie 94342057342880 notify 137438953512 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cdb8c88120 con 0x7faa2c031040 2024-04-24T02:13:28.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.952+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.0 v2:172.21.15.104:6800/2419146313 42 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa24061060 con 0x7faa2c031040 2024-04-24T02:13:28.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.952+0000 7faa35936800 10 removing user index: bud 2024-04-24T02:13:28.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.952+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:162 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8dbe7e0 con 0x7faa1c082070 2024-04-24T02:13:28.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.953+0000 7faa31ecd640 1 -- 172.21.15.134:0/1308038222 <== osd.2 v2:172.21.15.134:6800/214480313 32 ==== osd_op_reply(162 bud [call,call,delete] v32'5 uv5 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7faa2c051040 con 0x7faa1c082070 2024-04-24T02:13:28.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.953+0000 7faa35936800 10 removing default.rgw.meta+users.uid+bud from cache 2024-04-24T02:13:28.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.953+0000 7faa35936800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-04-24T02:13:28.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.953+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94342057342880 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8dbe7e0 con 0x7faa2c031040 2024-04-24T02:13:28.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.953+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.0 v2:172.21.15.104:6800/2419146313 43 ==== watch-notify(notify (1) cookie 94342057091296 notify 137438953513 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55cdb8c88120 con 0x7faa2c031040 2024-04-24T02:13:28.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.953+0000 7fa907fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953513 cookie 94342057091296 notifier 4746 bl.length()=152 2024-04-24T02:13:28.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.954+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.0 v2:172.21.15.104:6800/2419146313 44 ==== osd_op_reply(163 notify.5 [notify cookie 94342057342880 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7faa24061060 con 0x7faa2c031040 2024-04-24T02:13:28.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.954+0000 7fa907fff640 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fa864003320 con 0x7faa2c031040 2024-04-24T02:13:28.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.954+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.0 v2:172.21.15.104:6800/2419146313 45 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa24061060 con 0x7faa2c031040 2024-04-24T02:13:28.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.954+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.0 v2:172.21.15.104:6800/2419146313 46 ==== watch-notify(notify_complete (2) cookie 94342057342880 notify 137438953513 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cdb8c85510 con 0x7faa2c031040 2024-04-24T02:13:28.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.955+0000 7fa8e77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:13:28.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.955+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94342057093536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8dbe7e0 con 0x55cdb8cbf620 2024-04-24T02:13:28.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.956+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 52 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94342057093536] v32'229 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faa24061060 con 0x55cdb8cbf620 2024-04-24T02:13:28.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.956+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94342057072944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8dbe7e0 con 0x7faa1c082070 2024-04-24T02:13:28.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.957+0000 7faa31ecd640 1 -- 172.21.15.134:0/1308038222 <== osd.2 v2:172.21.15.134:6800/214480313 33 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94342057072944] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa2c051040 con 0x7faa1c082070 2024-04-24T02:13:28.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.957+0000 7faa35936800 20 remove_watcher() i=0 2024-04-24T02:13:28.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.957+0000 7faa35936800 2 removed watcher, disabling cache 2024-04-24T02:13:28.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.957+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94342057077408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8dbe7e0 con 0x55cdb8cbf620 2024-04-24T02:13:28.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.958+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 53 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94342057077408] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa24061060 con 0x55cdb8cbf620 2024-04-24T02:13:28.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.958+0000 7faa35936800 20 remove_watcher() i=1 2024-04-24T02:13:28.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.958+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94342057078976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8dbe7e0 con 0x55cdb8cc5870 2024-04-24T02:13:28.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.959+0000 7faa30ecb640 1 -- 172.21.15.134:0/1308038222 <== osd.3 v2:172.21.15.134:6801/3585115521 46 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94342057078976] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa1c071030 con 0x55cdb8cc5870 2024-04-24T02:13:28.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.959+0000 7faa35936800 20 remove_watcher() i=2 2024-04-24T02:13:28.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.959+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94342057085248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8dbe7e0 con 0x7faa1c082070 2024-04-24T02:13:28.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.960+0000 7faa31ecd640 1 -- 172.21.15.134:0/1308038222 <== osd.2 v2:172.21.15.134:6800/214480313 34 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94342057085248] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa2c051040 con 0x7faa1c082070 2024-04-24T02:13:28.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.960+0000 7faa35936800 20 remove_watcher() i=3 2024-04-24T02:13:28.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.960+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94342057086784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8dbe7e0 con 0x55cdb8cbf620 2024-04-24T02:13:28.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.961+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.1 v2:172.21.15.134:6804/1487076214 54 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94342057086784] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa24061060 con 0x55cdb8cbf620 2024-04-24T02:13:28.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.961+0000 7faa35936800 20 remove_watcher() i=4 2024-04-24T02:13:28.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.961+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94342057091296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8dbe7e0 con 0x7faa2c031040 2024-04-24T02:13:28.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.962+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.0 v2:172.21.15.104:6800/2419146313 47 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94342057091296] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa24061060 con 0x7faa2c031040 2024-04-24T02:13:28.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.962+0000 7faa35936800 20 remove_watcher() i=5 2024-04-24T02:13:28.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.962+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94342057088800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8dbe7e0 con 0x7faa2c031040 2024-04-24T02:13:28.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.963+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.0 v2:172.21.15.104:6800/2419146313 48 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94342057088800] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa24061060 con 0x7faa2c031040 2024-04-24T02:13:28.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.963+0000 7faa35936800 20 remove_watcher() i=6 2024-04-24T02:13:28.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.963+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94342057097504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cdb8dbe7e0 con 0x7faa2c031040 2024-04-24T02:13:28.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.964+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 <== osd.0 v2:172.21.15.104:6800/2419146313 49 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94342057097504] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa24061060 con 0x7faa2c031040 2024-04-24T02:13:28.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.965+0000 7faa35936800 20 remove_watcher() i=7 2024-04-24T02:13:28.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.965+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7faa2c031040 msgr2=0x7faa2c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:28.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.965+0000 7faa35936800 1 --2- 172.21.15.134:0/1308038222 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7faa2c031040 0x7faa2c032940 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.965+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55cdb8cbf620 msgr2=0x55cdb8cc1ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:28.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.965+0000 7faa35936800 1 --2- 172.21.15.134:0/1308038222 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55cdb8cbf620 0x55cdb8cc1ae0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.965+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7faa1c082070 msgr2=0x7faa1c06d880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:28.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.965+0000 7faa35936800 1 --2- 172.21.15.134:0/1308038222 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7faa1c082070 0x7faa1c06d880 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.965+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55cdb8cc5870 msgr2=0x55cdb8cc7c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:28.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.965+0000 7faa35936800 1 --2- 172.21.15.134:0/1308038222 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55cdb8cc5870 0x55cdb8cc7c60 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.965+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa8fc036900 msgr2=0x7fa8fc038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:28.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.965+0000 7faa35936800 1 --2- 172.21.15.134:0/1308038222 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa8fc036900 0x7fa8fc038dc0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x55cdb8c89400 tx=0x7faa2c01f000 comp rx=0 tx=0).stop 2024-04-24T02:13:28.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.965+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdb8cac460 msgr2=0x55cdb8cb3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:28.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.965+0000 7faa316cc640 1 -- 172.21.15.134:0/1308038222 reap_dead start 2024-04-24T02:13:28.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.965+0000 7faa35936800 1 --2- 172.21.15.134:0/1308038222 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdb8cac460 0x55cdb8cb3a90 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7faa1c073fd0 tx=0x7faa1c08dce0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.965+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 shutdown_connections 2024-04-24T02:13:28.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.965+0000 7faa35936800 1 --2- 172.21.15.134:0/1308038222 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdb8cac460 0x55cdb8cb3a90 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.965+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 >> 172.21.15.134:0/1308038222 conn(0x55cdb8ca87c0 msgr2=0x55cdb8ca5e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:28.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.965+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 shutdown_connections 2024-04-24T02:13:28.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.965+0000 7faa35936800 1 -- 172.21.15.134:0/1308038222 wait complete. 2024-04-24T02:13:28.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.965+0000 7faa35936800 1 -- 172.21.15.134:0/108334176 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa908036950 msgr2=0x7fa908038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:28.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.965+0000 7faa35936800 1 --2- 172.21.15.134:0/108334176 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa908036950 0x7fa908038e10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x55cdb8c8d0c0 tx=0x7faa2c005840 comp rx=0 tx=0).stop 2024-04-24T02:13:28.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.965+0000 7faa35936800 1 -- 172.21.15.134:0/108334176 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdb8b8c590 msgr2=0x55cdb8b8aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:28.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.965+0000 7faa35936800 1 --2- 172.21.15.134:0/108334176 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdb8b8c590 0x55cdb8b8aa00 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7faa1c044840 tx=0x7faa1c002fb0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.965+0000 7faa35936800 1 -- 172.21.15.134:0/108334176 shutdown_connections 2024-04-24T02:13:28.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.965+0000 7faa35936800 1 --2- 172.21.15.134:0/108334176 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa908036950 0x7fa908038e10 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.965+0000 7faa35936800 1 --2- 172.21.15.134:0/108334176 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdb8b8c590 0x55cdb8b8aa00 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.965+0000 7faa35936800 1 -- 172.21.15.134:0/108334176 >> 172.21.15.134:0/108334176 conn(0x55cdb8c910b0 msgr2=0x55cdb8c914b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:28.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.965+0000 7faa35936800 1 -- 172.21.15.134:0/108334176 shutdown_connections 2024-04-24T02:13:28.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.965+0000 7faa35936800 1 -- 172.21.15.134:0/108334176 wait complete. 2024-04-24T02:13:28.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.966+0000 7faa35936800 1 -- 172.21.15.134:0/3794701460 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55cdb8b90160 msgr2=0x55cdb8c8bee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:28.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.966+0000 7faa35936800 1 --2- 172.21.15.134:0/3794701460 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55cdb8b90160 0x55cdb8c8bee0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.966+0000 7faa35936800 1 -- 172.21.15.134:0/3794701460 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa918036950 msgr2=0x7fa918038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:28.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.966+0000 7faa35936800 1 --2- 172.21.15.134:0/3794701460 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa918036950 0x7fa918038e10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7faa1c054000 tx=0x7faa1c04e000 comp rx=0 tx=0).stop 2024-04-24T02:13:28.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.966+0000 7faa35936800 1 -- 172.21.15.134:0/3794701460 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdb8aff200 msgr2=0x55cdb8c84d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:28.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.966+0000 7faa35936800 1 --2- 172.21.15.134:0/3794701460 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdb8aff200 0x55cdb8c84d40 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7faa2400c010 tx=0x7faa24000ed0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.966+0000 7faa35936800 1 -- 172.21.15.134:0/3794701460 shutdown_connections 2024-04-24T02:13:28.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.966+0000 7faa35936800 1 --2- 172.21.15.134:0/3794701460 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55cdb8b90160 0x55cdb8c8bee0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.966+0000 7faa35936800 1 --2- 172.21.15.134:0/3794701460 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa918036950 0x7fa918038e10 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.966+0000 7faa35936800 1 --2- 172.21.15.134:0/3794701460 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cdb8aff200 0x55cdb8c84d40 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:28.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.966+0000 7faa35936800 1 -- 172.21.15.134:0/3794701460 >> 172.21.15.134:0/3794701460 conn(0x55cdb8b863a0 msgr2=0x55cdb8c77290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:28.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.966+0000 7faa35936800 1 -- 172.21.15.134:0/3794701460 shutdown_connections 2024-04-24T02:13:28.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:28.966+0000 7faa35936800 1 -- 172.21.15.134:0/3794701460 wait complete. 2024-04-24T02:13:28.976 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-04-24T02:13:28.977 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-04-24T02:13:28.977 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-04-24T02:13:29.020 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:13:29.020 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:13:29.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.019+0000 7f80aad0a800 1 Processor -- start 2024-04-24T02:13:29.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.019+0000 7f80aad0a800 1 -- start start 2024-04-24T02:13:29.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.020+0000 7f80aad0a800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55d8b1e3d9b0 0x55d8b1e3fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:29.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.020+0000 7f80aad0a800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d8b1cfbd40 con 0x55d8b1e402e0 2024-04-24T02:13:29.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.020+0000 7f80aad0a800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55d8b1cce4d0 con 0x55d8b1e3d9b0 2024-04-24T02:13:29.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.020+0000 7f80a8809640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55d8b1e3d9b0 0x55d8b1e3fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:29.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.020+0000 7f80a8809640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55d8b1e3d9b0 0x55d8b1e3fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:48756/0 (socket says 172.21.15.134:48756) 2024-04-24T02:13:29.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.020+0000 7f80a8809640 1 -- 172.21.15.134:0/3335651599 learned_addr learned my addr 172.21.15.134:0/3335651599 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:29.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.020+0000 7f80a8809640 1 -- 172.21.15.134:0/3335651599 >> v1:172.21.15.104:6789/0 conn(0x55d8b1e402e0 legacy=0x55d8b1e426d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:29.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.020+0000 7f80a8809640 1 -- 172.21.15.134:0/3335651599 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8b1cfa590 con 0x55d8b1e3d9b0 2024-04-24T02:13:29.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.022+0000 7f80a8809640 1 --2- 172.21.15.134:0/3335651599 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8b1e3d9b0 0x55d8b1e3fda0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f809800a520 tx=0x7f809801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d75894cc93c878a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:29.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.022+0000 7f80a7807640 1 -- 172.21.15.134:0/3335651599 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8098057070 con 0x55d8b1e3d9b0 2024-04-24T02:13:29.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.022+0000 7f80a7807640 1 -- 172.21.15.134:0/3335651599 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8098052570 con 0x55d8b1e3d9b0 2024-04-24T02:13:29.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.022+0000 7f80a7807640 1 -- 172.21.15.134:0/3335651599 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f809804ae60 con 0x55d8b1e3d9b0 2024-04-24T02:13:29.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.023+0000 7f80aad0a800 1 -- 172.21.15.134:0/3335651599 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8b1e3d9b0 msgr2=0x55d8b1e3fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:29.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.023+0000 7f80aad0a800 1 --2- 172.21.15.134:0/3335651599 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8b1e3d9b0 0x55d8b1e3fda0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f809800a520 tx=0x7f809801d010 comp rx=0 tx=0).stop 2024-04-24T02:13:29.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.023+0000 7f80aad0a800 1 -- 172.21.15.134:0/3335651599 shutdown_connections 2024-04-24T02:13:29.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.023+0000 7f80aad0a800 1 --2- 172.21.15.134:0/3335651599 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8b1e3d9b0 0x55d8b1e3fda0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:29.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.023+0000 7f80aad0a800 1 -- 172.21.15.134:0/3335651599 >> 172.21.15.134:0/3335651599 conn(0x55d8b1e37340 msgr2=0x55d8b1e39760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:29.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.023+0000 7f80aad0a800 1 -- 172.21.15.134:0/3335651599 shutdown_connections 2024-04-24T02:13:29.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.023+0000 7f80aad0a800 1 -- 172.21.15.134:0/3335651599 wait complete. 2024-04-24T02:13:29.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.034+0000 7f80aad0a800 1 Processor -- start 2024-04-24T02:13:29.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.034+0000 7f80aad0a800 1 -- start start 2024-04-24T02:13:29.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.035+0000 7f80aad0a800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8b1e3d9b0 0x55d8b1f2e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:29.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.035+0000 7f80aad0a800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d8b1d883b0 con 0x55d8b1e3d9b0 2024-04-24T02:13:29.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.035+0000 7f80a8809640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8b1e3d9b0 0x55d8b1f2e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:29.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.035+0000 7f80a8809640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8b1e3d9b0 0x55d8b1f2e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:48762/0 (socket says 172.21.15.134:48762) 2024-04-24T02:13:29.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.035+0000 7f80a8809640 1 -- 172.21.15.134:0/3238996487 learned_addr learned my addr 172.21.15.134:0/3238996487 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:29.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.035+0000 7f80a8809640 1 -- 172.21.15.134:0/3238996487 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8b1f2e710 con 0x55d8b1e3d9b0 2024-04-24T02:13:29.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.035+0000 7f80a8809640 1 --2- 172.21.15.134:0/3238996487 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8b1e3d9b0 0x55d8b1f2e140 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f8098055040 tx=0x7f809804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=568468c7c3e60128 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:29.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.036+0000 7f7f96e0d640 1 -- 172.21.15.134:0/3238996487 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8098057040 con 0x55d8b1e3d9b0 2024-04-24T02:13:29.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.036+0000 7f7f96e0d640 1 -- 172.21.15.134:0/3238996487 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8098052720 con 0x55d8b1e3d9b0 2024-04-24T02:13:29.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.036+0000 7f7f96e0d640 1 -- 172.21.15.134:0/3238996487 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8098052a40 con 0x55d8b1e3d9b0 2024-04-24T02:13:29.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.036+0000 7f80aad0a800 1 -- 172.21.15.134:0/3238996487 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8b1e3d9b0 msgr2=0x55d8b1f2e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:29.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.036+0000 7f80aad0a800 1 --2- 172.21.15.134:0/3238996487 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8b1e3d9b0 0x55d8b1f2e140 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f8098055040 tx=0x7f809804c000 comp rx=0 tx=0).stop 2024-04-24T02:13:29.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.036+0000 7f80aad0a800 1 -- 172.21.15.134:0/3238996487 shutdown_connections 2024-04-24T02:13:29.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.036+0000 7f80aad0a800 1 --2- 172.21.15.134:0/3238996487 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8b1e3d9b0 0x55d8b1f2e140 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:29.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.036+0000 7f80aad0a800 1 -- 172.21.15.134:0/3238996487 >> 172.21.15.134:0/3238996487 conn(0x55d8b1e37340 msgr2=0x55d8b1f29a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:29.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.036+0000 7f80aad0a800 1 -- 172.21.15.134:0/3238996487 shutdown_connections 2024-04-24T02:13:29.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.036+0000 7f80aad0a800 1 -- 172.21.15.134:0/3238996487 wait complete. 2024-04-24T02:13:29.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.037+0000 7f80aad0a800 1 Processor -- start 2024-04-24T02:13:29.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.037+0000 7f80aad0a800 1 -- start start 2024-04-24T02:13:29.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.037+0000 7f80aad0a800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8b1e3d9b0 0x55d8b1f35ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:29.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.037+0000 7f80aad0a800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d8b1e46100 con 0x55d8b1e3d9b0 2024-04-24T02:13:29.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.037+0000 7f80a8809640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8b1e3d9b0 0x55d8b1f35ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:29.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.037+0000 7f80a8809640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8b1e3d9b0 0x55d8b1f35ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:48776/0 (socket says 172.21.15.134:48776) 2024-04-24T02:13:29.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.037+0000 7f80a8809640 1 -- 172.21.15.134:0/3516161779 learned_addr learned my addr 172.21.15.134:0/3516161779 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:29.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.037+0000 7f80a8809640 1 -- 172.21.15.134:0/3516161779 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8b1f360e0 con 0x55d8b1e3d9b0 2024-04-24T02:13:29.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.037+0000 7f80a8809640 1 --2- 172.21.15.134:0/3516161779 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8b1e3d9b0 0x55d8b1f35ba0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f80980524f0 tx=0x7f8098003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:29.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.038+0000 7f7f9560a640 1 -- 172.21.15.134:0/3516161779 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8098073070 con 0x55d8b1e3d9b0 2024-04-24T02:13:29.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.038+0000 7f7f9560a640 1 -- 172.21.15.134:0/3516161779 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f809805d440 con 0x55d8b1e3d9b0 2024-04-24T02:13:29.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.038+0000 7f80aad0a800 1 -- 172.21.15.134:0/3516161779 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d8b1f36370 con 0x55d8b1e3d9b0 2024-04-24T02:13:29.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.038+0000 7f7f9560a640 1 -- 172.21.15.134:0/3516161779 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8098057070 con 0x55d8b1e3d9b0 2024-04-24T02:13:29.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.038+0000 7f80aad0a800 1 -- 172.21.15.134:0/3516161779 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8b1f38fd0 con 0x55d8b1e3d9b0 2024-04-24T02:13:29.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.038+0000 7f7f9560a640 1 -- 172.21.15.134:0/3516161779 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8098076070 con 0x55d8b1e3d9b0 2024-04-24T02:13:29.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.039+0000 7f7f9560a640 1 --2- 172.21.15.134:0/3516161779 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7f90036900 0x7f7f90038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:29.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.039+0000 7f7f9560a640 1 -- 172.21.15.134:0/3516161779 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f809808dbd0 con 0x55d8b1e3d9b0 2024-04-24T02:13:29.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.039+0000 7f80a8008640 1 --2- 172.21.15.134:0/3516161779 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7f90036900 0x7f7f90038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:29.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.039+0000 7f80aad0a800 1 --2- 172.21.15.134:0/3516161779 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d8b1e402e0 0x55d8b1f3cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:29.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.039+0000 7f80aad0a800 1 -- 172.21.15.134:0/3516161779 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f3d2d0 con 0x55d8b1e402e0 2024-04-24T02:13:29.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.039+0000 7f80a900a640 1 --2- 172.21.15.134:0/3516161779 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d8b1e402e0 0x55d8b1f3cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:29.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.039+0000 7f80a8008640 1 --2- 172.21.15.134:0/3516161779 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7f90036900 0x7f7f90038dc0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f809c001e10 tx=0x7f809c001390 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:29.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.039+0000 7f80a900a640 1 --2- 172.21.15.134:0/3516161779 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d8b1e402e0 0x55d8b1f3cd90 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:29.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.039+0000 7f80a900a640 1 -- 172.21.15.134:0/3516161779 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f80a000a4a0 con 0x55d8b1e402e0 2024-04-24T02:13:29.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.040+0000 7f80aad0a800 1 -- 172.21.15.134:0/3516161779 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f3dba0 con 0x55d8b1e402e0 2024-04-24T02:13:29.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.040+0000 7f80a900a640 1 -- 172.21.15.134:0/3516161779 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f80a000a4a0 con 0x55d8b1e402e0 2024-04-24T02:13:29.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.040+0000 7f80aad0a800 1 -- 172.21.15.134:0/3516161779 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f3ef50 con 0x55d8b1e402e0 2024-04-24T02:13:29.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.040+0000 7f80a900a640 1 -- 172.21.15.134:0/3516161779 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f80a000a4a0 con 0x55d8b1e402e0 2024-04-24T02:13:29.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.040+0000 7f80aad0a800 1 -- 172.21.15.134:0/3516161779 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f3e3f0 con 0x55d8b1e402e0 2024-04-24T02:13:29.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.040+0000 7f80a900a640 1 -- 172.21.15.134:0/3516161779 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f80a000a4a0 con 0x55d8b1e402e0 2024-04-24T02:13:29.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.040+0000 7f80aad0a800 1 -- 172.21.15.134:0/3516161779 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f3e810 con 0x55d8b1e402e0 2024-04-24T02:13:29.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.041+0000 7f80a900a640 1 -- 172.21.15.134:0/3516161779 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f80a000a4a0 con 0x55d8b1e402e0 2024-04-24T02:13:29.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.041+0000 7f80aad0a800 1 Processor -- start 2024-04-24T02:13:29.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.041+0000 7f80aad0a800 1 -- start start 2024-04-24T02:13:29.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.041+0000 7f80aad0a800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8b1f4df30 0x55d8b1f4e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:29.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.041+0000 7f80aad0a800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d8b1d2e6b0 con 0x55d8b1f4df30 2024-04-24T02:13:29.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.041+0000 7f80a8008640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8b1f4df30 0x55d8b1f4e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:29.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.041+0000 7f80a8008640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8b1f4df30 0x55d8b1f4e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:48788/0 (socket says 172.21.15.134:48788) 2024-04-24T02:13:29.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.041+0000 7f80a8008640 1 -- 172.21.15.134:0/2861912186 learned_addr learned my addr 172.21.15.134:0/2861912186 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:29.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.042+0000 7f80a8008640 1 -- 172.21.15.134:0/2861912186 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8b1f4e890 con 0x55d8b1f4df30 2024-04-24T02:13:29.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.042+0000 7f80a8008640 1 --2- 172.21.15.134:0/2861912186 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8b1f4df30 0x55d8b1f4e350 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f809c001770 tx=0x7f809c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:29.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.042+0000 7f7f8e7fc640 1 -- 172.21.15.134:0/2861912186 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f809c01c410 con 0x55d8b1f4df30 2024-04-24T02:13:29.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.042+0000 7f7f8e7fc640 1 -- 172.21.15.134:0/2861912186 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f809c017050 con 0x55d8b1f4df30 2024-04-24T02:13:29.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.042+0000 7f7f8e7fc640 1 -- 172.21.15.134:0/2861912186 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f809c01c6e0 con 0x55d8b1f4df30 2024-04-24T02:13:29.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.042+0000 7f80aad0a800 1 -- 172.21.15.134:0/2861912186 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d8b1f4f300 con 0x55d8b1f4df30 2024-04-24T02:13:29.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.042+0000 7f80aad0a800 1 -- 172.21.15.134:0/2861912186 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8b1f4f800 con 0x55d8b1f4df30 2024-04-24T02:13:29.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.043+0000 7f7f8e7fc640 1 -- 172.21.15.134:0/2861912186 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f809c00e070 con 0x55d8b1f4df30 2024-04-24T02:13:29.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.043+0000 7f7f8e7fc640 1 --2- 172.21.15.134:0/2861912186 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7f80036900 0x7f7f80038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:29.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.043+0000 7f7f8e7fc640 1 -- 172.21.15.134:0/2861912186 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f809c04dec0 con 0x55d8b1f4df30 2024-04-24T02:13:29.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.043+0000 7f80a900a640 1 --2- 172.21.15.134:0/2861912186 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7f80036900 0x7f7f80038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:29.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.043+0000 7f80aad0a800 1 Processor -- start 2024-04-24T02:13:29.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.043+0000 7f80a900a640 1 --2- 172.21.15.134:0/2861912186 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7f80036900 0x7f7f80038dc0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x55d8b1f3e790 tx=0x7f80a0005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:29.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.043+0000 7f80aad0a800 1 -- start start 2024-04-24T02:13:29.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.043+0000 7f80aad0a800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8b1e3cfa0 0x55d8b1e3d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:29.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.044+0000 7f80aad0a800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d8b1f2e9d0 con 0x55d8b1e3cfa0 2024-04-24T02:13:29.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.044+0000 7f80a8008640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8b1e3cfa0 0x55d8b1e3d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:29.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.044+0000 7f80a8008640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8b1e3cfa0 0x55d8b1e3d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:48794/0 (socket says 172.21.15.134:48794) 2024-04-24T02:13:29.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.044+0000 7f80a8008640 1 -- 172.21.15.134:0/133878500 learned_addr learned my addr 172.21.15.134:0/133878500 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:29.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.044+0000 7f80a8008640 1 -- 172.21.15.134:0/133878500 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8b1e3b7a0 con 0x55d8b1e3cfa0 2024-04-24T02:13:29.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.044+0000 7f80a8008640 1 --2- 172.21.15.134:0/133878500 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8b1e3cfa0 0x55d8b1e3d3c0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f809c01afd0 tx=0x7f809c01ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49853d946f081c70 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:29.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.044+0000 7f7f7ffff640 1 -- 172.21.15.134:0/133878500 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f809c040070 con 0x55d8b1e3cfa0 2024-04-24T02:13:29.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.044+0000 7f7f7ffff640 1 -- 172.21.15.134:0/133878500 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f809c002e50 con 0x55d8b1e3cfa0 2024-04-24T02:13:29.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.044+0000 7f7f7ffff640 1 -- 172.21.15.134:0/133878500 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f809c025920 con 0x55d8b1e3cfa0 2024-04-24T02:13:29.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.045+0000 7f80aad0a800 1 -- 172.21.15.134:0/133878500 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8b1e3cfa0 msgr2=0x55d8b1e3d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:29.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.045+0000 7f80aad0a800 1 --2- 172.21.15.134:0/133878500 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8b1e3cfa0 0x55d8b1e3d3c0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f809c01afd0 tx=0x7f809c01ac60 comp rx=0 tx=0).stop 2024-04-24T02:13:29.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.045+0000 7f80aad0a800 1 -- 172.21.15.134:0/133878500 shutdown_connections 2024-04-24T02:13:29.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.045+0000 7f80aad0a800 1 --2- 172.21.15.134:0/133878500 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8b1e3cfa0 0x55d8b1e3d3c0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:29.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.045+0000 7f80aad0a800 1 -- 172.21.15.134:0/133878500 >> 172.21.15.134:0/133878500 conn(0x55d8b1f57630 msgr2=0x55d8b1f55690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:29.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.045+0000 7f80aad0a800 1 -- 172.21.15.134:0/133878500 shutdown_connections 2024-04-24T02:13:29.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.045+0000 7f80aad0a800 1 -- 172.21.15.134:0/133878500 wait complete. 2024-04-24T02:13:29.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.045+0000 7f80aad0a800 1 Processor -- start 2024-04-24T02:13:29.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.045+0000 7f80aad0a800 1 -- start start 2024-04-24T02:13:29.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.045+0000 7f80aad0a800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8b1e3cfa0 0x55d8b1f64af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:29.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.045+0000 7f80aad0a800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d8b1e3bc70 con 0x55d8b1e3cfa0 2024-04-24T02:13:29.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.045+0000 7f80a8008640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8b1e3cfa0 0x55d8b1f64af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:29.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.045+0000 7f80a8008640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8b1e3cfa0 0x55d8b1f64af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:48810/0 (socket says 172.21.15.134:48810) 2024-04-24T02:13:29.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.045+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 learned_addr learned my addr 172.21.15.134:0/2801647049 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:13:29.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.046+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8b1f65030 con 0x55d8b1e3cfa0 2024-04-24T02:13:29.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.046+0000 7f80a8008640 1 --2- 172.21.15.134:0/2801647049 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8b1e3cfa0 0x55d8b1f64af0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f809c00fce0 tx=0x7f809c04c2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:29.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.046+0000 7f7f7e7fc640 1 -- 172.21.15.134:0/2801647049 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f809c046030 con 0x55d8b1e3cfa0 2024-04-24T02:13:29.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.046+0000 7f7f7e7fc640 1 -- 172.21.15.134:0/2801647049 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f809c025920 con 0x55d8b1e3cfa0 2024-04-24T02:13:29.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.046+0000 7f7f7e7fc640 1 -- 172.21.15.134:0/2801647049 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f809c00ec60 con 0x55d8b1e3cfa0 2024-04-24T02:13:29.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.046+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d8b1f652c0 con 0x55d8b1e3cfa0 2024-04-24T02:13:29.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.046+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8b1f67f70 con 0x55d8b1e3cfa0 2024-04-24T02:13:29.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.047+0000 7f7f7e7fc640 1 -- 172.21.15.134:0/2801647049 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f809c050070 con 0x55d8b1e3cfa0 2024-04-24T02:13:29.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.047+0000 7f7f7e7fc640 1 --2- 172.21.15.134:0/2801647049 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7f74036900 0x7f7f74038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:29.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.047+0000 7f7f7e7fc640 1 -- 172.21.15.134:0/2801647049 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f809c03abf0 con 0x55d8b1e3cfa0 2024-04-24T02:13:29.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.047+0000 7f80a900a640 1 --2- 172.21.15.134:0/2801647049 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7f74036900 0x7f7f74038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:29.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.047+0000 7f80aad0a800 20 rados->read ofs=0 len=0 2024-04-24T02:13:29.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.047+0000 7f80aad0a800 1 --2- 172.21.15.134:0/2801647049 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d8b1f70690 0x55d8b1f72b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:29.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.047+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f732a0 con 0x55d8b1f70690 2024-04-24T02:13:29.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.047+0000 7f80a900a640 1 --2- 172.21.15.134:0/2801647049 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7f74036900 0x7f7f74038dc0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x55d8b1f3db00 tx=0x7f80a001f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:29.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.048+0000 7f80a8809640 1 --2- 172.21.15.134:0/2801647049 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d8b1f70690 0x55d8b1f72b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:29.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.048+0000 7f80a8809640 1 --2- 172.21.15.134:0/2801647049 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d8b1f70690 0x55d8b1f72b50 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:29.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.048+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8098075030 con 0x55d8b1f70690 2024-04-24T02:13:29.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.048+0000 7f80aad0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:29.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.048+0000 7f80aad0a800 20 realm 2024-04-24T02:13:29.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.048+0000 7f80aad0a800 20 rados->read ofs=0 len=0 2024-04-24T02:13:29.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.048+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f736b0 con 0x55d8b1f70690 2024-04-24T02:13:29.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.048+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8098075030 con 0x55d8b1f70690 2024-04-24T02:13:29.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.048+0000 7f80aad0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:29.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.048+0000 7f80aad0a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:13:29.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.048+0000 7f80aad0a800 20 rados->read ofs=0 len=0 2024-04-24T02:13:29.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.048+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f73f80 con 0x55d8b1f70690 2024-04-24T02:13:29.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.048+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8098075030 con 0x55d8b1f70690 2024-04-24T02:13:29.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.048+0000 7f80aad0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:29.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.048+0000 7f80aad0a800 20 rados->read ofs=0 len=0 2024-04-24T02:13:29.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.048+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f74320 con 0x55d8b1f70690 2024-04-24T02:13:29.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.049+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8098075030 con 0x55d8b1f70690 2024-04-24T02:13:29.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.049+0000 7f80aad0a800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:13:29.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.049+0000 7f80aad0a800 20 rados->read ofs=0 len=0 2024-04-24T02:13:29.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.049+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f74b70 con 0x55d8b1f70690 2024-04-24T02:13:29.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.049+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8098075030 con 0x55d8b1f70690 2024-04-24T02:13:29.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.049+0000 7f80aad0a800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:13:29.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.049+0000 7f80aad0a800 20 searching for the correct realm 2024-04-24T02:13:29.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.049+0000 7f80aad0a800 1 --2- 172.21.15.134:0/2801647049 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55d8b1f768e0 0x55d8b1f78cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:29.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.049+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f79300 con 0x55d8b1f768e0 2024-04-24T02:13:29.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.049+0000 7f80a8008640 1 --2- 172.21.15.134:0/2801647049 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55d8b1f768e0 0x55d8b1f78cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:29.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.049+0000 7f80a8008640 1 --2- 172.21.15.134:0/2801647049 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55d8b1f768e0 0x55d8b1f78cd0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:29.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.050+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f809c04f030 con 0x55d8b1f768e0 2024-04-24T02:13:29.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.050+0000 7f80a8008640 1 --2- 172.21.15.134:0/2801647049 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f809c052060 0x7f809c011070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:29.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.050+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f79300 con 0x7f809c052060 2024-04-24T02:13:29.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.050+0000 7f80a900a640 1 --2- 172.21.15.134:0/2801647049 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f809c052060 0x7f809c011070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:29.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.050+0000 7f80a900a640 1 --2- 172.21.15.134:0/2801647049 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f809c052060 0x7f809c011070 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:29.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.050+0000 7f80a900a640 1 -- 172.21.15.134:0/2801647049 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80a001f070 con 0x7f809c052060 2024-04-24T02:13:29.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.050+0000 7f80a900a640 1 --2- 172.21.15.134:0/2801647049 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f80a0031040 0x7f80a0032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:13:29.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.050+0000 7f80a900a640 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f79300 con 0x7f80a0031040 2024-04-24T02:13:29.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.051+0000 7f80a8809640 1 --2- 172.21.15.134:0/2801647049 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f80a0031040 0x7f80a0032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:13:29.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.051+0000 7f80a8809640 1 --2- 172.21.15.134:0/2801647049 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f80a0031040 0x7f80a0032430 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:13:29.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.051+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8098075030 con 0x7f80a0031040 2024-04-24T02:13:29.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.051+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f79300 con 0x55d8b1f70690 2024-04-24T02:13:29.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.051+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8098075030 con 0x55d8b1f70690 2024-04-24T02:13:29.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.051+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f79300 con 0x55d8b1f70690 2024-04-24T02:13:29.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.052+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8098075030 con 0x55d8b1f70690 2024-04-24T02:13:29.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.052+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f79300 con 0x7f80a0031040 2024-04-24T02:13:29.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.052+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8098075030 con 0x7f80a0031040 2024-04-24T02:13:29.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.052+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f79300 con 0x7f809c052060 2024-04-24T02:13:29.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.052+0000 7f80a900a640 1 -- 172.21.15.134:0/2801647049 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80a001f070 con 0x7f809c052060 2024-04-24T02:13:29.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.052+0000 7f80a900a640 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f79300 con 0x7f809c052060 2024-04-24T02:13:29.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.052+0000 7f80a900a640 1 -- 172.21.15.134:0/2801647049 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80a001f070 con 0x7f809c052060 2024-04-24T02:13:29.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.052+0000 7f80a900a640 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f79300 con 0x55d8b1f768e0 2024-04-24T02:13:29.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.053+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f809c04f030 con 0x55d8b1f768e0 2024-04-24T02:13:29.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.053+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f79300 con 0x55d8b1f70690 2024-04-24T02:13:29.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.053+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8098075030 con 0x55d8b1f70690 2024-04-24T02:13:29.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.053+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f79300 con 0x7f80a0031040 2024-04-24T02:13:29.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.053+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8098075030 con 0x7f80a0031040 2024-04-24T02:13:29.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.053+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f79300 con 0x55d8b1f70690 2024-04-24T02:13:29.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.053+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8098075030 con 0x55d8b1f70690 2024-04-24T02:13:29.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.053+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f79300 con 0x7f809c052060 2024-04-24T02:13:29.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.054+0000 7f80a900a640 1 -- 172.21.15.134:0/2801647049 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f80a001f070 con 0x7f809c052060 2024-04-24T02:13:29.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.054+0000 7f80a900a640 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f79300 con 0x55d8b1f768e0 2024-04-24T02:13:29.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.054+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f809c04f030 con 0x55d8b1f768e0 2024-04-24T02:13:29.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.054+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f79300 con 0x55d8b1f768e0 2024-04-24T02:13:29.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.054+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f809c04f030 con 0x55d8b1f768e0 2024-04-24T02:13:29.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.054+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f79300 con 0x7f809c052060 2024-04-24T02:13:29.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.054+0000 7f80a900a640 1 -- 172.21.15.134:0/2801647049 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80a001f070 con 0x7f809c052060 2024-04-24T02:13:29.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.054+0000 7f80a900a640 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f79300 con 0x55d8b1f768e0 2024-04-24T02:13:29.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.055+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f809c04f030 con 0x55d8b1f768e0 2024-04-24T02:13:29.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.055+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f79300 con 0x55d8b1f768e0 2024-04-24T02:13:29.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.055+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f809c04f030 con 0x55d8b1f768e0 2024-04-24T02:13:29.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.055+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f79300 con 0x55d8b1f70690 2024-04-24T02:13:29.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.055+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8098075030 con 0x55d8b1f70690 2024-04-24T02:13:29.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.055+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f79300 con 0x55d8b1f70690 2024-04-24T02:13:29.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.055+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f8098075030 con 0x55d8b1f70690 2024-04-24T02:13:29.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.055+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f79300 con 0x7f80a0031040 2024-04-24T02:13:29.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.055+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8098075030 con 0x7f80a0031040 2024-04-24T02:13:29.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.055+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f79300 con 0x55d8b1f768e0 2024-04-24T02:13:29.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.056+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f809c04f030 con 0x55d8b1f768e0 2024-04-24T02:13:29.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.056+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f79300 con 0x7f809c052060 2024-04-24T02:13:29.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.056+0000 7f80a900a640 1 -- 172.21.15.134:0/2801647049 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80a001f070 con 0x7f809c052060 2024-04-24T02:13:29.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.056+0000 7f80a900a640 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f79300 con 0x55d8b1f70690 2024-04-24T02:13:29.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.056+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8098075030 con 0x55d8b1f70690 2024-04-24T02:13:29.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.056+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f79300 con 0x7f80a0031040 2024-04-24T02:13:29.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.056+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8098075030 con 0x7f80a0031040 2024-04-24T02:13:29.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.056+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f79300 con 0x55d8b1f768e0 2024-04-24T02:13:29.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.057+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f809c04f030 con 0x55d8b1f768e0 2024-04-24T02:13:29.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.057+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f79300 con 0x7f80a0031040 2024-04-24T02:13:29.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.057+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8098075030 con 0x7f80a0031040 2024-04-24T02:13:29.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.057+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f79300 con 0x7f809c052060 2024-04-24T02:13:29.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.057+0000 7f80a900a640 1 -- 172.21.15.134:0/2801647049 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80a0040040 con 0x7f809c052060 2024-04-24T02:13:29.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.057+0000 7f80a900a640 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f79300 con 0x55d8b1f768e0 2024-04-24T02:13:29.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.057+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f809c04f030 con 0x55d8b1f768e0 2024-04-24T02:13:29.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.057+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f79300 con 0x7f809c052060 2024-04-24T02:13:29.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.058+0000 7f80a900a640 1 -- 172.21.15.134:0/2801647049 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80a0040040 con 0x7f809c052060 2024-04-24T02:13:29.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.058+0000 7f80a900a640 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f79300 con 0x55d8b1f70690 2024-04-24T02:13:29.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.058+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8098075030 con 0x55d8b1f70690 2024-04-24T02:13:29.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.058+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f79300 con 0x7f809c052060 2024-04-24T02:13:29.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.058+0000 7f80a900a640 1 -- 172.21.15.134:0/2801647049 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80a0040040 con 0x7f809c052060 2024-04-24T02:13:29.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.058+0000 7f80aad0a800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:13:29.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.058+0000 7f80aad0a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:13:29.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.058+0000 7f80aad0a800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:13:29.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.058+0000 7f80aad0a800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:13:29.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.058+0000 7f80aad0a800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:13:29.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.058+0000 7f80aad0a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:13:29.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.058+0000 7f80aad0a800 20 rados->read ofs=0 len=0 2024-04-24T02:13:29.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.058+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f75520 con 0x55d8b1f70690 2024-04-24T02:13:29.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.058+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8098075030 con 0x55d8b1f70690 2024-04-24T02:13:29.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.058+0000 7f80aad0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:29.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.058+0000 7f80aad0a800 20 rados->read ofs=0 len=0 2024-04-24T02:13:29.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.058+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f75dc0 con 0x55d8b1f70690 2024-04-24T02:13:29.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.059+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8098075030 con 0x55d8b1f70690 2024-04-24T02:13:29.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.059+0000 7f80aad0a800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:13:29.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.059+0000 7f80aad0a800 20 rados->read ofs=0 len=0 2024-04-24T02:13:29.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.059+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f79780 con 0x55d8b1f70690 2024-04-24T02:13:29.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.059+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8098075030 con 0x55d8b1f70690 2024-04-24T02:13:29.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.059+0000 7f80aad0a800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:13:29.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.059+0000 7f80aad0a800 20 zone default found 2024-04-24T02:13:29.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.059+0000 7f80aad0a800 4 Realm: () 2024-04-24T02:13:29.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.059+0000 7f80aad0a800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:13:29.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.059+0000 7f80aad0a800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:13:29.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.059+0000 7f80aad0a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:13:29.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.059+0000 7f80aad0a800 20 zonegroup default 2024-04-24T02:13:29.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.059+0000 7f80aad0a800 20 rados->read ofs=0 len=0 2024-04-24T02:13:29.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.059+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f75a20 con 0x7f80a0031040 2024-04-24T02:13:29.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.059+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8098075030 con 0x7f80a0031040 2024-04-24T02:13:29.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.059+0000 7f80aad0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:29.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.059+0000 7f80aad0a800 20 rados->read ofs=0 len=0 2024-04-24T02:13:29.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.059+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f7b660 con 0x55d8b1f768e0 2024-04-24T02:13:29.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.060+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f809c04f030 con 0x55d8b1f768e0 2024-04-24T02:13:29.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.060+0000 7f80aad0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:29.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.060+0000 7f80aad0a800 20 rados->read ofs=0 len=0 2024-04-24T02:13:29.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.060+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f7ba30 con 0x55d8b1f768e0 2024-04-24T02:13:29.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.060+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f809c04f030 con 0x55d8b1f768e0 2024-04-24T02:13:29.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.060+0000 7f80aad0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:29.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.060+0000 7f80aad0a800 20 started sync module instance, tier type = 2024-04-24T02:13:29.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.060+0000 7f80aad0a800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:13:29.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.060+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f7ab00 con 0x7f809c052060 2024-04-24T02:13:29.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.061+0000 7f80a900a640 1 -- 172.21.15.134:0/2801647049 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(44 notify.0 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80a0040040 con 0x7f809c052060 2024-04-24T02:13:29.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.061+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94389187096304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f7a760 con 0x7f809c052060 2024-04-24T02:13:29.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.061+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f7c960 con 0x55d8b1f70690 2024-04-24T02:13:29.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.062+0000 7f80a900a640 1 -- 172.21.15.134:0/2801647049 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94389187096304] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80a0040040 con 0x7f809c052060 2024-04-24T02:13:29.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.062+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8098075030 con 0x55d8b1f70690 2024-04-24T02:13:29.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.062+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94389187100304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f7c960 con 0x55d8b1f70690 2024-04-24T02:13:29.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.062+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f7d320 con 0x55d8b1f768e0 2024-04-24T02:13:29.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.063+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94389187100304] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8098075030 con 0x55d8b1f70690 2024-04-24T02:13:29.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.064+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f809c04f030 con 0x55d8b1f768e0 2024-04-24T02:13:29.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.064+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94389187101872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f7c8d0 con 0x55d8b1f768e0 2024-04-24T02:13:29.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.064+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f7e1e0 con 0x7f809c052060 2024-04-24T02:13:29.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.065+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94389187101872] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f809c04f030 con 0x55d8b1f768e0 2024-04-24T02:13:29.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.065+0000 7f80a900a640 1 -- 172.21.15.134:0/2801647049 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(50 notify.3 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80a0040040 con 0x7f809c052060 2024-04-24T02:13:29.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.065+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94389187108144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f7e150 con 0x7f809c052060 2024-04-24T02:13:29.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.065+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f7f0a0 con 0x55d8b1f70690 2024-04-24T02:13:29.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.066+0000 7f80a900a640 1 -- 172.21.15.134:0/2801647049 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94389187108144] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80a0040040 con 0x7f809c052060 2024-04-24T02:13:29.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.066+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8098075030 con 0x55d8b1f70690 2024-04-24T02:13:29.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.066+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94389187110352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f7f0a0 con 0x55d8b1f70690 2024-04-24T02:13:29.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.066+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f7fa60 con 0x7f80a0031040 2024-04-24T02:13:29.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.067+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(54 notify.5 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8098075030 con 0x7f80a0031040 2024-04-24T02:13:29.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.067+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94389187114416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f7f9d0 con 0x7f80a0031040 2024-04-24T02:13:29.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.067+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f809d0 con 0x7f80a0031040 2024-04-24T02:13:29.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.067+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94389187110352] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8098075030 con 0x55d8b1f70690 2024-04-24T02:13:29.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.068+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94389187114416] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8098075030 con 0x7f80a0031040 2024-04-24T02:13:29.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.068+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(56 notify.6 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8098075030 con 0x7f80a0031040 2024-04-24T02:13:29.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.068+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94389187116624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f80520 con 0x7f80a0031040 2024-04-24T02:13:29.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.068+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f80ee0 con 0x7f80a0031040 2024-04-24T02:13:29.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.069+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(58 notify.7 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8098075030 con 0x7f80a0031040 2024-04-24T02:13:29.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.069+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94389187119664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f81300 con 0x7f80a0031040 2024-04-24T02:13:29.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.069+0000 7f80aad0a800 20 add_watcher() i=0 2024-04-24T02:13:29.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.069+0000 7f80aad0a800 20 add_watcher() i=1 2024-04-24T02:13:29.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.069+0000 7f80aad0a800 20 add_watcher() i=2 2024-04-24T02:13:29.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.069+0000 7f80aad0a800 20 add_watcher() i=3 2024-04-24T02:13:29.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.069+0000 7f80aad0a800 20 add_watcher() i=4 2024-04-24T02:13:29.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.069+0000 7f80aad0a800 20 add_watcher() i=5 2024-04-24T02:13:29.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.069+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94389187116624] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8098075030 con 0x7f80a0031040 2024-04-24T02:13:29.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.069+0000 7f80aad0a800 20 add_watcher() i=6 2024-04-24T02:13:29.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.070+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94389187119664] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8098075030 con 0x7f80a0031040 2024-04-24T02:13:29.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.070+0000 7f80aad0a800 20 add_watcher() i=7 2024-04-24T02:13:29.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.070+0000 7f80aad0a800 2 all 8 watchers are set, enabling cache 2024-04-24T02:13:29.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.070+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f81300 con 0x55d8b1f70690 2024-04-24T02:13:29.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.070+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8098075030 con 0x55d8b1f70690 2024-04-24T02:13:29.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.070+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94389187120720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f81270 con 0x55d8b1f70690 2024-04-24T02:13:29.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.071+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94389187120720] v32'230 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8098075030 con 0x55d8b1f70690 2024-04-24T02:13:29.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.071+0000 7f7f5efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:13:29.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.072+0000 7f80aad0a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:13:29.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.072+0000 7f80aad0a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:13:29.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.072+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f8cbf0 con 0x55d8b1f70690 2024-04-24T02:13:29.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.073+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'57 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8098075030 con 0x55d8b1f70690 2024-04-24T02:13:29.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.073+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f8d2c0 con 0x7f80a0031040 2024-04-24T02:13:29.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.074+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'34 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8098075030 con 0x7f80a0031040 2024-04-24T02:13:29.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.074+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f8d2c0 con 0x55d8b1f768e0 2024-04-24T02:13:29.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.075+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f809c04f030 con 0x55d8b1f768e0 2024-04-24T02:13:29.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.075+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f8d680 con 0x55d8b1f70690 2024-04-24T02:13:29.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.076+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'231 uv169 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8098075030 con 0x55d8b1f70690 2024-04-24T02:13:29.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.076+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f8c3d0 con 0x7f809c052060 2024-04-24T02:13:29.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.077+0000 7f80a900a640 1 -- 172.21.15.134:0/2801647049 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'79 uv58 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f80a0040040 con 0x7f809c052060 2024-04-24T02:13:29.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.077+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f8c3d0 con 0x55d8b1f768e0 2024-04-24T02:13:29.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.078+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'62 uv48 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f809c04f030 con 0x55d8b1f768e0 2024-04-24T02:13:29.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.078+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f8e0c0 con 0x55d8b1f70690 2024-04-24T02:13:29.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.079+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8098075030 con 0x55d8b1f70690 2024-04-24T02:13:29.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.079+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f8e0c0 con 0x7f80a0031040 2024-04-24T02:13:29.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.081+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'54 uv41 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8098075030 con 0x7f80a0031040 2024-04-24T02:13:29.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.081+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f8e0c0 con 0x7f809c052060 2024-04-24T02:13:29.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.082+0000 7f80a900a640 1 -- 172.21.15.134:0/2801647049 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f80a0040040 con 0x7f809c052060 2024-04-24T02:13:29.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.082+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f8e540 con 0x55d8b1f768e0 2024-04-24T02:13:29.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.083+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f809c04f030 con 0x55d8b1f768e0 2024-04-24T02:13:29.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.083+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f8e8e0 con 0x7f809c052060 2024-04-24T02:13:29.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.084+0000 7f80a900a640 1 -- 172.21.15.134:0/2801647049 <== osd.2 v2:172.21.15.134:6800/214480313 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'80 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f80a0040040 con 0x7f809c052060 2024-04-24T02:13:29.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.084+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f8ee90 con 0x7f80a0031040 2024-04-24T02:13:29.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.085+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'31 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8098075030 con 0x7f80a0031040 2024-04-24T02:13:29.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.085+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f8ee90 con 0x7f809c052060 2024-04-24T02:13:29.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.086+0000 7f80a900a640 1 -- 172.21.15.134:0/2801647049 <== osd.2 v2:172.21.15.134:6800/214480313 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f80a0040040 con 0x7f809c052060 2024-04-24T02:13:29.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.086+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f8f340 con 0x7f80a0031040 2024-04-24T02:13:29.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.087+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'65 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8098075030 con 0x7f80a0031040 2024-04-24T02:13:29.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.087+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f8f340 con 0x55d8b1f70690 2024-04-24T02:13:29.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.088+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'232 uv171 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8098075030 con 0x55d8b1f70690 2024-04-24T02:13:29.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.088+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f8f340 con 0x55d8b1f768e0 2024-04-24T02:13:29.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.089+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'71 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f809c04f030 con 0x55d8b1f768e0 2024-04-24T02:13:29.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.089+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f8f340 con 0x7f809c052060 2024-04-24T02:13:29.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.090+0000 7f80a900a640 1 -- 172.21.15.134:0/2801647049 <== osd.2 v2:172.21.15.134:6800/214480313 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'81 uv63 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f80a0040040 con 0x7f809c052060 2024-04-24T02:13:29.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.090+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f8f340 con 0x55d8b1f768e0 2024-04-24T02:13:29.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.091+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'40 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f809c04f030 con 0x55d8b1f768e0 2024-04-24T02:13:29.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.091+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f8f340 con 0x55d8b1f70690 2024-04-24T02:13:29.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.092+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8098075030 con 0x55d8b1f70690 2024-04-24T02:13:29.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.092+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f8f340 con 0x55d8b1f70690 2024-04-24T02:13:29.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.093+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'233 uv173 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8098075030 con 0x55d8b1f70690 2024-04-24T02:13:29.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.093+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f8f3d0 con 0x55d8b1f768e0 2024-04-24T02:13:29.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.094+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'72 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f809c04f030 con 0x55d8b1f768e0 2024-04-24T02:13:29.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.094+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f8f3d0 con 0x7f809c052060 2024-04-24T02:13:29.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.095+0000 7f80a900a640 1 -- 172.21.15.134:0/2801647049 <== osd.2 v2:172.21.15.134:6800/214480313 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'43 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f80a0040040 con 0x7f809c052060 2024-04-24T02:13:29.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.095+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f8f3d0 con 0x55d8b1f768e0 2024-04-24T02:13:29.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.096+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f809c04f030 con 0x55d8b1f768e0 2024-04-24T02:13:29.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.096+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f8f3d0 con 0x55d8b1f768e0 2024-04-24T02:13:29.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.097+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'45 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f809c04f030 con 0x55d8b1f768e0 2024-04-24T02:13:29.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.097+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f8f3d0 con 0x55d8b1f768e0 2024-04-24T02:13:29.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.098+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f809c04f030 con 0x55d8b1f768e0 2024-04-24T02:13:29.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.098+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f8f3d0 con 0x55d8b1f768e0 2024-04-24T02:13:29.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.099+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'63 uv50 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f809c04f030 con 0x55d8b1f768e0 2024-04-24T02:13:29.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.099+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f8f3d0 con 0x7f80a0031040 2024-04-24T02:13:29.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.100+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8098075030 con 0x7f80a0031040 2024-04-24T02:13:29.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.100+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f8f3d0 con 0x55d8b1f768e0 2024-04-24T02:13:29.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.101+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'39 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f809c04f030 con 0x55d8b1f768e0 2024-04-24T02:13:29.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.101+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f8f3d0 con 0x7f80a0031040 2024-04-24T02:13:29.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.102+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'55 uv43 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8098075030 con 0x7f80a0031040 2024-04-24T02:13:29.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.102+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f8f3d0 con 0x55d8b1f768e0 2024-04-24T02:13:29.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.104+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'73 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f809c04f030 con 0x55d8b1f768e0 2024-04-24T02:13:29.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.104+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f8f3d0 con 0x7f80a0031040 2024-04-24T02:13:29.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.105+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.0 v2:172.21.15.104:6800/2419146313 20 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'66 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8098075030 con 0x7f80a0031040 2024-04-24T02:13:29.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.105+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f8f3d0 con 0x7f809c052060 2024-04-24T02:13:29.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.106+0000 7f80a900a640 1 -- 172.21.15.134:0/2801647049 <== osd.2 v2:172.21.15.134:6800/214480313 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f80a0040040 con 0x7f809c052060 2024-04-24T02:13:29.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.106+0000 7f7f5dfe3640 20 reqs_thread_entry: start 2024-04-24T02:13:29.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.106+0000 7f80aad0a800 20 init_complete bucket index max shards: 11 2024-04-24T02:13:29.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.106+0000 7f80aad0a800 20 Filter name: none 2024-04-24T02:13:29.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.106+0000 7f7ecf7fe640 20 reqs_thread_entry: start 2024-04-24T02:13:29.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.106+0000 7f80aad0a800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-24T02:13:29.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.106+0000 7f80aad0a800 20 rados->read ofs=0 len=0 2024-04-24T02:13:29.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.106+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1fba370 con 0x7f80a0031040 2024-04-24T02:13:29.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.107+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.0 v2:172.21.15.104:6800/2419146313 21 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f8098075030 con 0x7f80a0031040 2024-04-24T02:13:29.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.107+0000 7f80aad0a800 20 rados_obj.operate() r=0 bl.length=380 2024-04-24T02:13:29.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.107+0000 7f80aad0a800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-04-24T02:13:29.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.107+0000 7f80aad0a800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-24T02:13:29.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.107+0000 7f80aad0a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:13:29.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.107+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1fbcd40 con 0x7f80a0031040 2024-04-24T02:13:29.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.107+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.0 v2:172.21.15.104:6800/2419146313 22 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv5 ondisk = 0) ==== 155+0+186 (crc 0 0 0) 0x7f8098075030 con 0x7f80a0031040 2024-04-24T02:13:29.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.107+0000 7f80aad0a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10 : miss 2024-04-24T02:13:29.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.107+0000 7f80aad0a800 20 rados->read ofs=0 len=0 2024-04-24T02:13:29.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.107+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:96 8.1a 8:58f5c86e:root::.bucket.meta.myfoo7%3a582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1fbcbe0 con 0x7f80a0031040 2024-04-24T02:13:29.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.108+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.0 v2:172.21.15.104:6800/2419146313 23 ==== osd_op_reply(96 .bucket.meta.myfoo7:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10 [call out=48b,stat out=16b,read 0~382 out=382b,getxattrs out=218b] v0'0 uv7 ondisk = 0) ==== 334+0+664 (crc 0 0 0) 0x7f8098075030 con 0x7f80a0031040 2024-04-24T02:13:29.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.108+0000 7f80aad0a800 20 rados_obj.operate() r=0 bl.length=382 2024-04-24T02:13:29.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.108+0000 7f80aad0a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10 info.flags=0x17 2024-04-24T02:13:29.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.108+0000 7f80aad0a800 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10 to cache LRU end 2024-04-24T02:13:29.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.108+0000 7f80aad0a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:13:29.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.108+0000 7f80aad0a800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T02:13:29.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.108+0000 7f80aad0a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10 2024-04-24T02:13:29.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.108+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:97 4.7 4:e1a97146:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b203a0c0 con 0x7f80a0031040 2024-04-24T02:13:29.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.108+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.0 v2:172.21.15.104:6800/2419146313 24 ==== osd_op_reply(97 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.0 [call out=85b] v0'0 uv12 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f8098075030 con 0x7f80a0031040 2024-04-24T02:13:29.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.108+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:98 4.6 4:6393d215:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b203a140 con 0x55d8b1f768e0 2024-04-24T02:13:29.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.109+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 26 ==== osd_op_reply(98 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f809c04f030 con 0x55d8b1f768e0 2024-04-24T02:13:29.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.109+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:99 4.b 4:d3f18a5e:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b203a140 con 0x7f809c052060 2024-04-24T02:13:29.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.109+0000 7f80a900a640 1 -- 172.21.15.134:0/2801647049 <== osd.2 v2:172.21.15.134:6800/214480313 21 ==== osd_op_reply(99 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.2 [call out=85b] v0'0 uv16 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f80a0040040 con 0x7f809c052060 2024-04-24T02:13:29.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.109+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:100 4.3f 4:fd7d5caa:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b203a140 con 0x7f809c052060 2024-04-24T02:13:29.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.109+0000 7f80a900a640 1 -- 172.21.15.134:0/2801647049 <== osd.2 v2:172.21.15.134:6800/214480313 22 ==== osd_op_reply(100 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.3 [call out=85b] v0'0 uv17 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f80a0040040 con 0x7f809c052060 2024-04-24T02:13:29.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.109+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:101 4.b 4:d2f0a7eb:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b203a140 con 0x7f809c052060 2024-04-24T02:13:29.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.109+0000 7f80a900a640 1 -- 172.21.15.134:0/2801647049 <== osd.2 v2:172.21.15.134:6800/214480313 23 ==== osd_op_reply(101 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.4 [call out=85b] v0'0 uv17 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f80a0040040 con 0x7f809c052060 2024-04-24T02:13:29.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.109+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:102 4.3a 4:5c8c6e53:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b203a100 con 0x55d8b1f768e0 2024-04-24T02:13:29.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.110+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 27 ==== osd_op_reply(102 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.5 [call out=378b] v0'0 uv3 ondisk = 0) ==== 195+0+378 (crc 0 0 0) 0x7f809c04f030 con 0x55d8b1f768e0 2024-04-24T02:13:29.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.110+0000 7f80aad0a800 10 cls_bucket_list_unordered: got fourteen 2024-04-24T02:13:29.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.110+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:103 4.3b 4:df7bf51c:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b203a710 con 0x55d8b1f768e0 2024-04-24T02:13:29.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.110+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 28 ==== osd_op_reply(103 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f809c04f030 con 0x55d8b1f768e0 2024-04-24T02:13:29.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.110+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:104 4.32 4:4f5f8fd4:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b203a710 con 0x55d8b1f70690 2024-04-24T02:13:29.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.110+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(104 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.7 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f8098075030 con 0x55d8b1f70690 2024-04-24T02:13:29.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.110+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:105 4.10 4:085394b3:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b203a710 con 0x55d8b1f768e0 2024-04-24T02:13:29.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.111+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 29 ==== osd_op_reply(105 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f809c04f030 con 0x55d8b1f768e0 2024-04-24T02:13:29.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.111+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:106 4.2e 4:77958b55:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b203a710 con 0x55d8b1f768e0 2024-04-24T02:13:29.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.111+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 30 ==== osd_op_reply(106 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.9 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f809c06e060 con 0x55d8b1f768e0 2024-04-24T02:13:29.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.111+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:107 4.16 4:68030fe6:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b203a710 con 0x55d8b1f768e0 2024-04-24T02:13:29.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.111+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 31 ==== osd_op_reply(107 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7f809c06e060 con 0x55d8b1f768e0 2024-04-24T02:13:29.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.111+0000 7f80aad0a800 20 get_obj_state: octx=0x7f80980777b0 obj=myfoo7:fourteen state=0x55d8b2038148 s->prefetch_data=0 2024-04-24T02:13:29.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.111+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:108 3.37 3:ec562829:::582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10_fourteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b2038f70 con 0x55d8b1f70690 2024-04-24T02:13:29.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.112+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.1 v2:172.21.15.134:6804/1487076214 30 ==== osd_op_reply(108 582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10_fourteen [getxattrs out=858b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 239+0+874 (crc 0 0 0) 0x7f8098075030 con 0x55d8b1f70690 2024-04-24T02:13:29.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.112+0000 7f80aad0a800 10 manifest: total_size = 8 2024-04-24T02:13:29.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.112+0000 7f80aad0a800 20 get_obj_state: setting s->obj_tag to 582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.13023203607200194692 2024-04-24T02:13:29.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.112+0000 7f80aad0a800 20 get_obj_state: octx=0x7f80980777b0 obj=myfoo7:fourteen state=0x55d8b2038148 s->prefetch_data=0 2024-04-24T02:13:29.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.112+0000 7f80aad0a800 20 prepare_atomic_modification: state is not atomic. state=0x55d8b2038148 2024-04-24T02:13:29.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.112+0000 7f80aad0a800 20 bucket index object: :.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.5 2024-04-24T02:13:29.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.112+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:109 4.3a 4:5c8c6e53:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b20399f0 con 0x55d8b1f768e0 2024-04-24T02:13:29.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.113+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 32 ==== osd_op_reply(109 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.5 [stat,call,call] v32'4 uv4 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f809c06e060 con 0x55d8b1f768e0 2024-04-24T02:13:29.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.113+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:110 3.37 3:ec562829:::582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b20399f0 con 0x55d8b1f70690 2024-04-24T02:13:29.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.114+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.1 v2:172.21.15.134:6804/1487076214 31 ==== osd_op_reply(110 582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10_fourteen [call] v32'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f8098075030 con 0x55d8b1f70690 2024-04-24T02:13:29.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.114+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:111 4.3a 4:5c8c6e53:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b20399f0 con 0x55d8b1f768e0 2024-04-24T02:13:29.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.114+0000 7f80aad0a800 20 list_objects_ordered: starting attempt 1 2024-04-24T02:13:29.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.114+0000 7f80aad0a800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-04-24T02:13:29.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.114+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:112 4.7 4:e1a97146:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b20399f0 con 0x7f80a0031040 2024-04-24T02:13:29.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.114+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:113 4.6 4:6393d215:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1fc6840 con 0x55d8b1f768e0 2024-04-24T02:13:29.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.114+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:114 4.b 4:d3f18a5e:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1fc91d0 con 0x7f809c052060 2024-04-24T02:13:29.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.114+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:115 4.3f 4:fd7d5caa:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1fcbd20 con 0x7f809c052060 2024-04-24T02:13:29.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.114+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:116 4.b 4:d2f0a7eb:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1fce6d0 con 0x7f809c052060 2024-04-24T02:13:29.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.114+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:117 4.3a 4:5c8c6e53:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1fd1390 con 0x55d8b1f768e0 2024-04-24T02:13:29.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.114+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:118 4.3b 4:df7bf51c:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1fcbd20 con 0x55d8b1f768e0 2024-04-24T02:13:29.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.114+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:119 4.32 4:4f5f8fd4:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1fd1390 con 0x55d8b1f70690 2024-04-24T02:13:29.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.114+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:120 4.10 4:085394b3:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1fd89a0 con 0x55d8b1f768e0 2024-04-24T02:13:29.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.114+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 33 ==== osd_op_reply(113 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f809c06e060 con 0x55d8b1f768e0 2024-04-24T02:13:29.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.115+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.0 v2:172.21.15.104:6800/2419146313 25 ==== osd_op_reply(112 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.0 [call out=85b] v0'0 uv12 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f8098075030 con 0x7f80a0031040 2024-04-24T02:13:29.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.115+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 34 ==== osd_op_reply(118 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f809c06e060 con 0x55d8b1f768e0 2024-04-24T02:13:29.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.115+0000 7f80a900a640 1 -- 172.21.15.134:0/2801647049 <== osd.2 v2:172.21.15.134:6800/214480313 24 ==== osd_op_reply(114 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.2 [call out=85b] v0'0 uv16 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f80a004c040 con 0x7f809c052060 2024-04-24T02:13:29.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.115+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:121 4.2e 4:77958b55:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1fd17d0 con 0x55d8b1f768e0 2024-04-24T02:13:29.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.115+0000 7f80a900a640 1 -- 172.21.15.134:0/2801647049 <== osd.2 v2:172.21.15.134:6800/214480313 25 ==== osd_op_reply(115 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.3 [call out=85b] v0'0 uv17 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f80a004c040 con 0x7f809c052060 2024-04-24T02:13:29.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.115+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:122 4.16 4:68030fe6:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1fd2040 con 0x55d8b1f768e0 2024-04-24T02:13:29.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.115+0000 7f80a900a640 1 -- 172.21.15.134:0/2801647049 <== osd.2 v2:172.21.15.134:6800/214480313 26 ==== osd_op_reply(116 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.4 [call out=85b] v0'0 uv17 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f80a004c040 con 0x7f809c052060 2024-04-24T02:13:29.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.115+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 35 ==== osd_op_reply(120 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f809c06e060 con 0x55d8b1f768e0 2024-04-24T02:13:29.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.115+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 36 ==== osd_op_reply(122 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7f809c06e060 con 0x55d8b1f768e0 2024-04-24T02:13:29.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.115+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.1 v2:172.21.15.134:6804/1487076214 32 ==== osd_op_reply(119 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.7 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f8098075030 con 0x55d8b1f70690 2024-04-24T02:13:29.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.115+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 37 ==== osd_op_reply(121 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.9 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f809c06e060 con 0x55d8b1f768e0 2024-04-24T02:13:29.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.115+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 38 ==== osd_op_reply(111 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.5 [stat,call,call] v32'5 uv5 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f809c06e060 con 0x55d8b1f768e0 2024-04-24T02:13:29.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.115+0000 7f7f7f7fe640 20 handle_completion(): completion ok for obj=fourteen 2024-04-24T02:13:29.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.116+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 39 ==== osd_op_reply(117 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.5 [call out=124b] v0'0 uv5 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f809c06e060 con 0x55d8b1f768e0 2024-04-24T02:13:29.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.116+0000 7f80aad0a800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-04-24T02:13:29.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.116+0000 7f80aad0a800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-04-24T02:13:29.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.116+0000 7f80aad0a800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-04-24T02:13:29.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.116+0000 7f80aad0a800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-04-24T02:13:29.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.116+0000 7f80aad0a800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10])"; uploads.size()=0; is_truncated=0 2024-04-24T02:13:29.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.116+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:123 4.7 4:e1a97146:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1fd1390 con 0x7f80a0031040 2024-04-24T02:13:29.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.116+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:124 4.6 4:6393d215:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1fd17d0 con 0x55d8b1f768e0 2024-04-24T02:13:29.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.116+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:125 4.b 4:d3f18a5e:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1fd1bf0 con 0x7f809c052060 2024-04-24T02:13:29.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.116+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:126 4.3f 4:fd7d5caa:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1fd2030 con 0x7f809c052060 2024-04-24T02:13:29.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.116+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:127 4.b 4:d2f0a7eb:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1fbe2b0 con 0x7f809c052060 2024-04-24T02:13:29.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.116+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:128 4.3a 4:5c8c6e53:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1fd1390 con 0x55d8b1f768e0 2024-04-24T02:13:29.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.116+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:129 4.3b 4:df7bf51c:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1fd1bf0 con 0x55d8b1f768e0 2024-04-24T02:13:29.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.116+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:130 4.32 4:4f5f8fd4:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1fd2030 con 0x55d8b1f70690 2024-04-24T02:13:29.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.116+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:131 4.10 4:085394b3:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1fd1390 con 0x55d8b1f768e0 2024-04-24T02:13:29.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.116+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.0 v2:172.21.15.104:6800/2419146313 26 ==== osd_op_reply(123 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.0 [call out=85b] v0'0 uv12 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f8098075030 con 0x7f80a0031040 2024-04-24T02:13:29.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.116+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.1 v2:172.21.15.134:6804/1487076214 33 ==== osd_op_reply(130 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.7 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f80980b1060 con 0x55d8b1f70690 2024-04-24T02:13:29.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.116+0000 7f80a900a640 1 -- 172.21.15.134:0/2801647049 <== osd.2 v2:172.21.15.134:6800/214480313 27 ==== osd_op_reply(125 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.2 [call out=85b] v0'0 uv16 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f80a004c040 con 0x7f809c052060 2024-04-24T02:13:29.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.116+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 40 ==== osd_op_reply(128 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.5 [call out=124b] v0'0 uv5 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f809c06e060 con 0x55d8b1f768e0 2024-04-24T02:13:29.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.116+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:132 4.2e 4:77958b55:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1fd1bf0 con 0x55d8b1f768e0 2024-04-24T02:13:29.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.116+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 41 ==== osd_op_reply(124 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f809c06e060 con 0x55d8b1f768e0 2024-04-24T02:13:29.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.116+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:133 4.16 4:68030fe6:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1fbe2b0 con 0x55d8b1f768e0 2024-04-24T02:13:29.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.116+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 42 ==== osd_op_reply(129 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f809c06e060 con 0x55d8b1f768e0 2024-04-24T02:13:29.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.116+0000 7f80a900a640 1 -- 172.21.15.134:0/2801647049 <== osd.2 v2:172.21.15.134:6800/214480313 28 ==== osd_op_reply(126 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.3 [call out=85b] v0'0 uv17 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f80a004c040 con 0x7f809c052060 2024-04-24T02:13:29.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.116+0000 7f80a900a640 1 -- 172.21.15.134:0/2801647049 <== osd.2 v2:172.21.15.134:6800/214480313 29 ==== osd_op_reply(127 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.4 [call out=85b] v0'0 uv17 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f80a004c040 con 0x7f809c052060 2024-04-24T02:13:29.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.116+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 43 ==== osd_op_reply(131 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f809c06e060 con 0x55d8b1f768e0 2024-04-24T02:13:29.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.116+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 44 ==== osd_op_reply(132 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.9 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f809c06e060 con 0x55d8b1f768e0 2024-04-24T02:13:29.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.116+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 45 ==== osd_op_reply(133 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7f809c06e060 con 0x55d8b1f768e0 2024-04-24T02:13:29.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.117+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1fd1370 con 0x7f80a0031040 2024-04-24T02:13:29.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.118+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.0 v2:172.21.15.104:6800/2419146313 27 ==== osd_op_reply(134 fud.buckets [call] v32'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f80980b1060 con 0x7f80a0031040 2024-04-24T02:13:29.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.118+0000 7f80aad0a800 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-04-24T02:13:29.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.118+0000 7f80aad0a800 20 rados->read ofs=0 len=0 2024-04-24T02:13:29.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.118+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1fd1370 con 0x7f809c052060 2024-04-24T02:13:29.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.118+0000 7f80a900a640 1 -- 172.21.15.134:0/2801647049 <== osd.2 v2:172.21.15.134:6800/214480313 30 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv44 ondisk = 0) ==== 192+0+216 (crc 0 0 0) 0x7f80a004c040 con 0x7f809c052060 2024-04-24T02:13:29.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.118+0000 7f80aad0a800 20 rados_obj.operate() r=0 bl.length=168 2024-04-24T02:13:29.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.118+0000 7f80aad0a800 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2024-04-24T02:13:29.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.118+0000 7f80aad0a800 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-04-24T02:13:29.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.118+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:136 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1fd1370 con 0x7f809c052060 2024-04-24T02:13:29.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.119+0000 7f80a900a640 1 -- 172.21.15.134:0/2801647049 <== osd.2 v2:172.21.15.134:6800/214480313 31 ==== osd_op_reply(136 myfoo7 [call,call,delete] v32'45 uv45 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f80a004c040 con 0x7f809c052060 2024-04-24T02:13:29.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.119+0000 7f80aad0a800 10 removing default.rgw.meta+root+myfoo7 from cache 2024-04-24T02:13:29.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.119+0000 7f80aad0a800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-04-24T02:13:29.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.119+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94389187452976 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1fd1370 con 0x7f809c052060 2024-04-24T02:13:29.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.120+0000 7f80a900a640 1 -- 172.21.15.134:0/2801647049 <== osd.2 v2:172.21.15.134:6800/214480313 32 ==== watch-notify(notify (1) cookie 94389187108144 notify 137438953490 ret 0) ==== 192+0+0 (crc 0 0 0) 0x55d8b1f8de30 con 0x7f809c052060 2024-04-24T02:13:29.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.120+0000 7f7f7ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953490 cookie 94389187108144 notifier 4753 bl.length()=150 2024-04-24T02:13:29.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.120+0000 7f7f7ffff640 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f7f6c003d60 con 0x7f809c052060 2024-04-24T02:13:29.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.120+0000 7f80a900a640 1 -- 172.21.15.134:0/2801647049 <== osd.2 v2:172.21.15.134:6800/214480313 33 ==== osd_op_reply(137 notify.3 [notify cookie 94389187452976 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f80a004c040 con 0x7f809c052060 2024-04-24T02:13:29.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.120+0000 7f80a900a640 1 -- 172.21.15.134:0/2801647049 <== osd.2 v2:172.21.15.134:6800/214480313 34 ==== watch-notify(notify_complete (2) cookie 94389187452976 notify 137438953490 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d8b1f8ec80 con 0x7f809c052060 2024-04-24T02:13:29.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.120+0000 7f80a900a640 1 -- 172.21.15.134:0/2801647049 <== osd.2 v2:172.21.15.134:6800/214480313 35 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80a004c040 con 0x7f809c052060 2024-04-24T02:13:29.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.120+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:139 8.1a 8:58f5c86e:root::.bucket.meta.myfoo7%3a582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1fd2030 con 0x7f80a0031040 2024-04-24T02:13:29.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.121+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.0 v2:172.21.15.104:6800/2419146313 28 ==== osd_op_reply(139 .bucket.meta.myfoo7:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10 [call,call,delete] v32'8 uv8 ondisk = 0) ==== 292+0+0 (crc 0 0 0) 0x7f80980b1060 con 0x7f80a0031040 2024-04-24T02:13:29.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.121+0000 7f80aad0a800 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10 from cache 2024-04-24T02:13:29.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.121+0000 7f80aad0a800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10, ofs0, ns] 2024-04-24T02:13:29.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.121+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:140 7.9 7:93e5b521:::notify.7:head [notify cookie 94389187365712 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1fd2010 con 0x7f80a0031040 2024-04-24T02:13:29.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.122+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.0 v2:172.21.15.104:6800/2419146313 29 ==== watch-notify(notify (1) cookie 94389187119664 notify 137438953514 ret 0) ==== 250+0+0 (crc 0 0 0) 0x55d8b1fbc0c0 con 0x7f80a0031040 2024-04-24T02:13:29.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.122+0000 7f7f7f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953514 cookie 94389187119664 notifier 4753 bl.length()=208 2024-04-24T02:13:29.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.122+0000 7f7f7f7fe640 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:141 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f7edc003380 con 0x7f80a0031040 2024-04-24T02:13:29.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.122+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.0 v2:172.21.15.104:6800/2419146313 30 ==== osd_op_reply(140 notify.7 [notify cookie 94389187365712 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f80980b1060 con 0x7f80a0031040 2024-04-24T02:13:29.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.122+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.0 v2:172.21.15.104:6800/2419146313 31 ==== osd_op_reply(141 notify.7 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80980b1060 con 0x7f80a0031040 2024-04-24T02:13:29.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.122+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.0 v2:172.21.15.104:6800/2419146313 32 ==== watch-notify(notify_complete (2) cookie 94389187365712 notify 137438953514 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f8098094080 con 0x7f80a0031040 2024-04-24T02:13:29.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.122+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:142 4.7 4:e1a97146:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1fd2010 con 0x7f80a0031040 2024-04-24T02:13:29.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.122+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:143 4.6 4:6393d215:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1fd8210 con 0x55d8b1f768e0 2024-04-24T02:13:29.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.122+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:144 4.b 4:d3f18a5e:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1fd71c0 con 0x7f809c052060 2024-04-24T02:13:29.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.122+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:145 4.3f 4:fd7d5caa:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1fd2010 con 0x7f809c052060 2024-04-24T02:13:29.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.122+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:146 4.b 4:d2f0a7eb:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1fd8210 con 0x7f809c052060 2024-04-24T02:13:29.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.122+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:147 4.3a 4:5c8c6e53:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1fd71c0 con 0x55d8b1f768e0 2024-04-24T02:13:29.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.122+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:148 4.3b 4:df7bf51c:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1fd2010 con 0x55d8b1f768e0 2024-04-24T02:13:29.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.122+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:149 4.32 4:4f5f8fd4:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1fd8210 con 0x55d8b1f70690 2024-04-24T02:13:29.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.122+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:150 4.10 4:085394b3:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1fd71c0 con 0x55d8b1f768e0 2024-04-24T02:13:29.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.122+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:151 4.2e 4:77958b55:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1fc75e0 con 0x55d8b1f768e0 2024-04-24T02:13:29.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.122+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:152 4.16 4:68030fe6:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1fc7fb0 con 0x55d8b1f768e0 2024-04-24T02:13:29.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.123+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.0 v2:172.21.15.104:6800/2419146313 33 ==== osd_op_reply(142 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.0 [delete] v32'16 uv16 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f80980b1060 con 0x7f80a0031040 2024-04-24T02:13:29.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.124+0000 7f80a900a640 1 -- 172.21.15.134:0/2801647049 <== osd.2 v2:172.21.15.134:6800/214480313 36 ==== osd_op_reply(144 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.2 [delete] v32'18 uv18 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f80a004c040 con 0x7f809c052060 2024-04-24T02:13:29.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.124+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 46 ==== osd_op_reply(143 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.1 [delete] v32'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f809c06e060 con 0x55d8b1f768e0 2024-04-24T02:13:29.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.124+0000 7f80a900a640 1 -- 172.21.15.134:0/2801647049 <== osd.2 v2:172.21.15.134:6800/214480313 37 ==== osd_op_reply(146 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.4 [delete] v32'19 uv19 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f80a004c040 con 0x7f809c052060 2024-04-24T02:13:29.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.124+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.1 v2:172.21.15.134:6804/1487076214 34 ==== osd_op_reply(149 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.7 [delete] v32'5 uv5 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f80980b1060 con 0x55d8b1f70690 2024-04-24T02:13:29.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.124+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 47 ==== osd_op_reply(147 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.5 [delete] v32'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f809c06e060 con 0x55d8b1f768e0 2024-04-24T02:13:29.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.124+0000 7f80a900a640 1 -- 172.21.15.134:0/2801647049 <== osd.2 v2:172.21.15.134:6800/214480313 38 ==== osd_op_reply(145 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.3 [delete] v32'18 uv18 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f80a004c040 con 0x7f809c052060 2024-04-24T02:13:29.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.124+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 48 ==== osd_op_reply(150 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.8 [delete] v32'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f809c06e060 con 0x55d8b1f768e0 2024-04-24T02:13:29.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.124+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 49 ==== osd_op_reply(151 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.9 [delete] v32'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f809c06e060 con 0x55d8b1f768e0 2024-04-24T02:13:29.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.126+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 50 ==== osd_op_reply(148 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.6 [delete] v32'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f809c06e060 con 0x55d8b1f768e0 2024-04-24T02:13:29.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.127+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 51 ==== osd_op_reply(152 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10.10 [delete] v32'6 uv6 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7f809c06e060 con 0x55d8b1f768e0 2024-04-24T02:13:29.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.127+0000 7f80aad0a800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10 : miss 2024-04-24T02:13:29.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.127+0000 7f80aad0a800 20 rados->read ofs=0 len=0 2024-04-24T02:13:29.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.127+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:153 6.f 6:f1856bac:::pubsub..bucket.myfoo7%2f582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1fbcb50 con 0x7f809c052060 2024-04-24T02:13:29.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.127+0000 7f80a900a640 1 -- 172.21.15.134:0/2801647049 <== osd.2 v2:172.21.15.134:6800/214480313 39 ==== osd_op_reply(153 pubsub..bucket.myfoo7/582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f80a004c040 con 0x7f809c052060 2024-04-24T02:13:29.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.127+0000 7f80aad0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:13:29.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.127+0000 7f80aad0a800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10 info.flags=0x0 2024-04-24T02:13:29.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.127+0000 7f80aad0a800 10 adding default.rgw.log++pubsub..bucket.myfoo7/582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10 to cache LRU end 2024-04-24T02:13:29.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.127+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:154 6.f 6:f1856bac:::pubsub..bucket.myfoo7%2f582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1fbcb50 con 0x7f809c052060 2024-04-24T02:13:29.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.128+0000 7f80a900a640 1 -- 172.21.15.134:0/2801647049 <== osd.2 v2:172.21.15.134:6800/214480313 40 ==== osd_op_reply(154 pubsub..bucket.myfoo7/582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.10 [delete] v32'34 uv27 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f80a004c040 con 0x7f809c052060 2024-04-24T02:13:29.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.128+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:155 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=147b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1fbcb50 con 0x7f80a0031040 2024-04-24T02:13:29.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.129+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.0 v2:172.21.15.104:6800/2419146313 34 ==== osd_op_reply(155 fud.buckets [call] v32'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f80980b1060 con 0x7f80a0031040 2024-04-24T02:13:29.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.129+0000 7f80aad0a800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-04-24T02:13:29.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.129+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:156 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1fbcb50 con 0x7f80a0031040 2024-04-24T02:13:29.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.130+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.0 v2:172.21.15.104:6800/2419146313 35 ==== osd_op_reply(156 p5YnriCv1nAtykxBrupQ [delete] v32'12 uv12 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f80980b1060 con 0x7f80a0031040 2024-04-24T02:13:29.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.130+0000 7f80aad0a800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-24T02:13:29.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.130+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:157 7.15 7:a93a5511:::notify.2:head [notify cookie 94389187384384 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1fbb880 con 0x55d8b1f768e0 2024-04-24T02:13:29.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.130+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 52 ==== watch-notify(notify (1) cookie 94389187101872 notify 137438953489 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55d8b1f8dc60 con 0x55d8b1f768e0 2024-04-24T02:13:29.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.130+0000 7f7f7ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953489 cookie 94389187101872 notifier 4753 bl.length()=170 2024-04-24T02:13:29.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.130+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 53 ==== osd_op_reply(157 notify.2 [notify cookie 94389187384384 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f809c06e060 con 0x55d8b1f768e0 2024-04-24T02:13:29.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.130+0000 7f7f7ffff640 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f7f6c003d60 con 0x55d8b1f768e0 2024-04-24T02:13:29.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.131+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 54 ==== osd_op_reply(158 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f809c06e060 con 0x55d8b1f768e0 2024-04-24T02:13:29.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.131+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 55 ==== watch-notify(notify_complete (2) cookie 94389187384384 notify 137438953489 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d8b1f65030 con 0x55d8b1f768e0 2024-04-24T02:13:29.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.131+0000 7f80aad0a800 10 removing email index: 2024-04-24T02:13:29.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.131+0000 7f80aad0a800 10 removing user buckets index 2024-04-24T02:13:29.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.131+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:159 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1fbcb50 con 0x7f80a0031040 2024-04-24T02:13:29.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.132+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.0 v2:172.21.15.104:6800/2419146313 36 ==== osd_op_reply(159 fud.buckets [delete] v32'8 uv8 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f80980b1060 con 0x7f80a0031040 2024-04-24T02:13:29.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.132+0000 7f80aad0a800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-04-24T02:13:29.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.132+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94389187384384 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1fbb880 con 0x7f80a0031040 2024-04-24T02:13:29.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.132+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.0 v2:172.21.15.104:6800/2419146313 37 ==== watch-notify(notify (1) cookie 94389187116624 notify 137438953515 ret 0) ==== 202+0+0 (crc 0 0 0) 0x7f8098094080 con 0x7f80a0031040 2024-04-24T02:13:29.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.132+0000 7f7f7f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953515 cookie 94389187116624 notifier 4753 bl.length()=160 2024-04-24T02:13:29.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.132+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.0 v2:172.21.15.104:6800/2419146313 38 ==== osd_op_reply(160 notify.6 [notify cookie 94389187384384 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f80980b1060 con 0x7f80a0031040 2024-04-24T02:13:29.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.132+0000 7f7f7f7fe640 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f7edc003320 con 0x7f80a0031040 2024-04-24T02:13:29.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.133+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.0 v2:172.21.15.104:6800/2419146313 39 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80980b1060 con 0x7f80a0031040 2024-04-24T02:13:29.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.133+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.0 v2:172.21.15.104:6800/2419146313 40 ==== watch-notify(notify_complete (2) cookie 94389187384384 notify 137438953515 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d8b1f38fd0 con 0x7f80a0031040 2024-04-24T02:13:29.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.133+0000 7f80aad0a800 10 removing user index: fud 2024-04-24T02:13:29.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.133+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:162 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1fbcb50 con 0x7f80a0031040 2024-04-24T02:13:29.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.134+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.0 v2:172.21.15.104:6800/2419146313 41 ==== osd_op_reply(162 fud [call,call,delete] v32'7 uv7 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f80980b1060 con 0x7f80a0031040 2024-04-24T02:13:29.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.134+0000 7f80aad0a800 10 removing default.rgw.meta+users.uid+fud from cache 2024-04-24T02:13:29.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.134+0000 7f80aad0a800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-04-24T02:13:29.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.134+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94389187384384 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1fbb880 con 0x7f80a0031040 2024-04-24T02:13:29.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.134+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.0 v2:172.21.15.104:6800/2419146313 42 ==== watch-notify(notify (1) cookie 94389187114416 notify 137438953516 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55d8b1f38fd0 con 0x7f80a0031040 2024-04-24T02:13:29.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.134+0000 7f7f7ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953516 cookie 94389187114416 notifier 4753 bl.length()=152 2024-04-24T02:13:29.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.134+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.0 v2:172.21.15.104:6800/2419146313 43 ==== osd_op_reply(163 notify.5 [notify cookie 94389187384384 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f80980b1060 con 0x7f80a0031040 2024-04-24T02:13:29.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.134+0000 7f7f7ffff640 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f7f6c003d60 con 0x7f80a0031040 2024-04-24T02:13:29.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.134+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.0 v2:172.21.15.104:6800/2419146313 44 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80980b1060 con 0x7f80a0031040 2024-04-24T02:13:29.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.134+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.0 v2:172.21.15.104:6800/2419146313 45 ==== watch-notify(notify_complete (2) cookie 94389187384384 notify 137438953516 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d8b1f36370 con 0x7f80a0031040 2024-04-24T02:13:29.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.135+0000 7f7f5efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:13:29.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.135+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94389187120720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f88510 con 0x55d8b1f70690 2024-04-24T02:13:29.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.136+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.1 v2:172.21.15.134:6804/1487076214 35 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94389187120720] v32'234 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f80980b1060 con 0x55d8b1f70690 2024-04-24T02:13:29.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.136+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94389187096304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f88510 con 0x7f809c052060 2024-04-24T02:13:29.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.137+0000 7f80a900a640 1 -- 172.21.15.134:0/2801647049 <== osd.2 v2:172.21.15.134:6800/214480313 41 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94389187096304] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80a004c040 con 0x7f809c052060 2024-04-24T02:13:29.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.137+0000 7f80aad0a800 20 remove_watcher() i=0 2024-04-24T02:13:29.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.137+0000 7f80aad0a800 2 removed watcher, disabling cache 2024-04-24T02:13:29.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.137+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94389187100304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f7aef0 con 0x55d8b1f70690 2024-04-24T02:13:29.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.138+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.1 v2:172.21.15.134:6804/1487076214 36 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94389187100304] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80980b1060 con 0x55d8b1f70690 2024-04-24T02:13:29.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.138+0000 7f80aad0a800 20 remove_watcher() i=1 2024-04-24T02:13:29.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.138+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94389187101872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f88510 con 0x55d8b1f768e0 2024-04-24T02:13:29.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.140+0000 7f80a8008640 1 -- 172.21.15.134:0/2801647049 <== osd.3 v2:172.21.15.134:6801/3585115521 56 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94389187101872] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f809c06e060 con 0x55d8b1f768e0 2024-04-24T02:13:29.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.140+0000 7f80aad0a800 20 remove_watcher() i=2 2024-04-24T02:13:29.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.140+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94389187108144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f7aef0 con 0x7f809c052060 2024-04-24T02:13:29.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.141+0000 7f80a900a640 1 -- 172.21.15.134:0/2801647049 <== osd.2 v2:172.21.15.134:6800/214480313 42 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94389187108144] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80a004c040 con 0x7f809c052060 2024-04-24T02:13:29.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.141+0000 7f80aad0a800 20 remove_watcher() i=3 2024-04-24T02:13:29.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.141+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94389187110352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f7c4b0 con 0x55d8b1f70690 2024-04-24T02:13:29.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.142+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.1 v2:172.21.15.134:6804/1487076214 37 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94389187110352] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80980b1060 con 0x55d8b1f70690 2024-04-24T02:13:29.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.142+0000 7f80aad0a800 20 remove_watcher() i=4 2024-04-24T02:13:29.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.142+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94389187114416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f88510 con 0x7f80a0031040 2024-04-24T02:13:29.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.143+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.0 v2:172.21.15.104:6800/2419146313 46 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94389187114416] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80980b1060 con 0x7f80a0031040 2024-04-24T02:13:29.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.143+0000 7f80aad0a800 20 remove_watcher() i=5 2024-04-24T02:13:29.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.143+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94389187116624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f7dd30 con 0x7f80a0031040 2024-04-24T02:13:29.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.144+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.0 v2:172.21.15.104:6800/2419146313 47 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94389187116624] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80980b1060 con 0x7f80a0031040 2024-04-24T02:13:29.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.144+0000 7f80aad0a800 20 remove_watcher() i=6 2024-04-24T02:13:29.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.144+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94389187119664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8b1f7aef0 con 0x7f80a0031040 2024-04-24T02:13:29.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.145+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 <== osd.0 v2:172.21.15.104:6800/2419146313 48 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94389187119664] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80980b1060 con 0x7f80a0031040 2024-04-24T02:13:29.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.145+0000 7f80aad0a800 20 remove_watcher() i=7 2024-04-24T02:13:29.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.145+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f80a0031040 msgr2=0x7f80a0032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:29.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.145+0000 7f80aad0a800 1 --2- 172.21.15.134:0/2801647049 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f80a0031040 0x7f80a0032430 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:29.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.145+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d8b1f70690 msgr2=0x55d8b1f72b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:29.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.145+0000 7f80aad0a800 1 --2- 172.21.15.134:0/2801647049 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d8b1f70690 0x55d8b1f72b50 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:29.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.145+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f809c052060 msgr2=0x7f809c011070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:29.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.145+0000 7f80aad0a800 1 --2- 172.21.15.134:0/2801647049 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f809c052060 0x7f809c011070 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:29.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.145+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55d8b1f768e0 msgr2=0x55d8b1f78cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:29.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.145+0000 7f80aad0a800 1 --2- 172.21.15.134:0/2801647049 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55d8b1f768e0 0x55d8b1f78cd0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:29.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.145+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7f74036900 msgr2=0x7f7f74038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:29.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.145+0000 7f80aad0a800 1 --2- 172.21.15.134:0/2801647049 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7f74036900 0x7f7f74038dc0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x55d8b1f3db00 tx=0x7f80a001f000 comp rx=0 tx=0).stop 2024-04-24T02:13:29.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.145+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8b1e3cfa0 msgr2=0x55d8b1f64af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:29.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.145+0000 7f80a8809640 1 -- 172.21.15.134:0/2801647049 reap_dead start 2024-04-24T02:13:29.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.145+0000 7f80aad0a800 1 --2- 172.21.15.134:0/2801647049 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8b1e3cfa0 0x55d8b1f64af0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f809c00fce0 tx=0x7f809c04c2f0 comp rx=0 tx=0).stop 2024-04-24T02:13:29.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.145+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 shutdown_connections 2024-04-24T02:13:29.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.145+0000 7f80aad0a800 1 --2- 172.21.15.134:0/2801647049 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8b1e3cfa0 0x55d8b1f64af0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:29.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.145+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 >> 172.21.15.134:0/2801647049 conn(0x55d8b1f57630 msgr2=0x55d8b1f54c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:29.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.145+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 shutdown_connections 2024-04-24T02:13:29.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.145+0000 7f80aad0a800 1 -- 172.21.15.134:0/2801647049 wait complete. 2024-04-24T02:13:29.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.145+0000 7f80aad0a800 1 -- 172.21.15.134:0/2861912186 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7f80036900 msgr2=0x7f7f80038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:29.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.145+0000 7f80aad0a800 1 --2- 172.21.15.134:0/2861912186 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7f80036900 0x7f7f80038dc0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x55d8b1f3e790 tx=0x7f80a0005840 comp rx=0 tx=0).stop 2024-04-24T02:13:29.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.145+0000 7f80aad0a800 1 -- 172.21.15.134:0/2861912186 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8b1f4df30 msgr2=0x55d8b1f4e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:29.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.145+0000 7f80aad0a800 1 --2- 172.21.15.134:0/2861912186 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8b1f4df30 0x55d8b1f4e350 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f809c001770 tx=0x7f809c00f790 comp rx=0 tx=0).stop 2024-04-24T02:13:29.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.146+0000 7f80aad0a800 1 -- 172.21.15.134:0/2861912186 shutdown_connections 2024-04-24T02:13:29.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.146+0000 7f80aad0a800 1 --2- 172.21.15.134:0/2861912186 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7f80036900 0x7f7f80038dc0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:29.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.146+0000 7f80aad0a800 1 --2- 172.21.15.134:0/2861912186 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8b1f4df30 0x55d8b1f4e350 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:29.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.146+0000 7f80aad0a800 1 -- 172.21.15.134:0/2861912186 >> 172.21.15.134:0/2861912186 conn(0x55d8b1f41fd0 msgr2=0x55d8b1f423d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:29.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.146+0000 7f80aad0a800 1 -- 172.21.15.134:0/2861912186 shutdown_connections 2024-04-24T02:13:29.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.146+0000 7f80aad0a800 1 -- 172.21.15.134:0/2861912186 wait complete. 2024-04-24T02:13:29.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.146+0000 7f80aad0a800 1 -- 172.21.15.134:0/3516161779 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d8b1e402e0 msgr2=0x55d8b1f3cd90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:29.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.146+0000 7f80aad0a800 1 --2- 172.21.15.134:0/3516161779 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d8b1e402e0 0x55d8b1f3cd90 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:29.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.146+0000 7f80aad0a800 1 -- 172.21.15.134:0/3516161779 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7f90036900 msgr2=0x7f7f90038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:29.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.146+0000 7f80aad0a800 1 --2- 172.21.15.134:0/3516161779 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7f90036900 0x7f7f90038dc0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f809c001e10 tx=0x7f809c001390 comp rx=0 tx=0).stop 2024-04-24T02:13:29.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.146+0000 7f80aad0a800 1 -- 172.21.15.134:0/3516161779 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8b1e3d9b0 msgr2=0x55d8b1f35ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:13:29.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.146+0000 7f80aad0a800 1 --2- 172.21.15.134:0/3516161779 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8b1e3d9b0 0x55d8b1f35ba0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f80980524f0 tx=0x7f8098003020 comp rx=0 tx=0).stop 2024-04-24T02:13:29.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.146+0000 7f80aad0a800 1 -- 172.21.15.134:0/3516161779 shutdown_connections 2024-04-24T02:13:29.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.146+0000 7f80aad0a800 1 --2- 172.21.15.134:0/3516161779 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55d8b1e402e0 0x55d8b1f3cd90 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:29.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.146+0000 7f80aad0a800 1 --2- 172.21.15.134:0/3516161779 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7f90036900 0x7f7f90038dc0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:29.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.146+0000 7f80aad0a800 1 --2- 172.21.15.134:0/3516161779 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8b1e3d9b0 0x55d8b1f35ba0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:13:29.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.146+0000 7f80aad0a800 1 -- 172.21.15.134:0/3516161779 >> 172.21.15.134:0/3516161779 conn(0x55d8b1e37340 msgr2=0x55d8b1f28260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:13:29.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.146+0000 7f80aad0a800 1 -- 172.21.15.134:0/3516161779 shutdown_connections 2024-04-24T02:13:29.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:13:29.146+0000 7f80aad0a800 1 -- 172.21.15.134:0/3516161779 wait complete. 2024-04-24T02:14:09.160 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-04-24T02:14:09.161 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-04-24T02:14:09.161 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-04-24T02:14:09.212 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:14:09.212 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:14:09.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.211+0000 7f560c616800 1 Processor -- start 2024-04-24T02:14:09.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.211+0000 7f560c616800 1 -- start start 2024-04-24T02:14:09.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.211+0000 7f560c616800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55b6703cc330 0x55b670460cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.211+0000 7f560c616800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b670316d40 con 0x55b6703cb800 2024-04-24T02:14:09.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.211+0000 7f560c616800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55b6702e94d0 con 0x55b6703cc330 2024-04-24T02:14:09.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.212+0000 7f560755b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55b6703cc330 0x55b670460cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.212+0000 7f5607d5c640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55b6703cb800 0x55b6703cbc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:46326/0 (socket says 172.21.15.134:46326) 2024-04-24T02:14:09.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.212+0000 7f560755b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55b6703cc330 0x55b670460cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43054/0 (socket says 172.21.15.134:43054) 2024-04-24T02:14:09.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.212+0000 7f5607d5c640 1 -- 172.21.15.134:0/3077119902 learned_addr learned my addr 172.21.15.134:0/3077119902 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:14:09.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.212+0000 7f560755b640 1 -- 172.21.15.134:0/3077119902 >> v1:172.21.15.104:6789/0 conn(0x55b6703cb800 legacy=0x55b6703cbc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.212+0000 7f560755b640 1 -- 172.21.15.134:0/3077119902 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b670315590 con 0x55b6703cc330 2024-04-24T02:14:09.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.214+0000 7f560755b640 1 --2- 172.21.15.134:0/3077119902 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b6703cc330 0x55b670460cd0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f55fc00a470 tx=0x7f55fc01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e3e29876d3ab51e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.214+0000 7f5606d5a640 1 -- 172.21.15.134:0/3077119902 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55fc057070 con 0x55b6703cc330 2024-04-24T02:14:09.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.214+0000 7f5606d5a640 1 -- 172.21.15.134:0/3077119902 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55fc04adc0 con 0x55b6703cc330 2024-04-24T02:14:09.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.214+0000 7f5606d5a640 1 -- 172.21.15.134:0/3077119902 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55fc052590 con 0x55b6703cc330 2024-04-24T02:14:09.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.215+0000 7f560c616800 1 -- 172.21.15.134:0/3077119902 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b6703cc330 msgr2=0x55b670460cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.215+0000 7f560c616800 1 --2- 172.21.15.134:0/3077119902 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b6703cc330 0x55b670460cd0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f55fc00a470 tx=0x7f55fc01ce90 comp rx=0 tx=0).stop 2024-04-24T02:14:09.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.215+0000 7f560c616800 1 -- 172.21.15.134:0/3077119902 shutdown_connections 2024-04-24T02:14:09.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.215+0000 7f560c616800 1 --2- 172.21.15.134:0/3077119902 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b6703cc330 0x55b670460cd0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.215+0000 7f560c616800 1 -- 172.21.15.134:0/3077119902 >> 172.21.15.134:0/3077119902 conn(0x55b670453450 msgr2=0x55b670455870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:09.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.215+0000 7f560c616800 1 -- 172.21.15.134:0/3077119902 shutdown_connections 2024-04-24T02:14:09.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.215+0000 7f560c616800 1 -- 172.21.15.134:0/3077119902 wait complete. 2024-04-24T02:14:09.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.228+0000 7f560c616800 1 Processor -- start 2024-04-24T02:14:09.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.228+0000 7f560c616800 1 -- start start 2024-04-24T02:14:09.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.228+0000 7f560c616800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b6703cb800 0x55b67054b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.229+0000 7f560c616800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b6703a33c0 con 0x55b6703cb800 2024-04-24T02:14:09.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.229+0000 7f5607d5c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b6703cb800 0x55b67054b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.229+0000 7f5607d5c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b6703cb800 0x55b67054b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43060/0 (socket says 172.21.15.134:43060) 2024-04-24T02:14:09.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.229+0000 7f5607d5c640 1 -- 172.21.15.134:0/1666969527 learned_addr learned my addr 172.21.15.134:0/1666969527 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:09.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.229+0000 7f5607d5c640 1 -- 172.21.15.134:0/1666969527 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b67054b990 con 0x55b6703cb800 2024-04-24T02:14:09.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.229+0000 7f5607d5c640 1 --2- 172.21.15.134:0/1666969527 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b6703cb800 0x55b67054b3c0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f55f8001d50 tx=0x7f55f800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb475e4707e358ff server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.230+0000 7f54f5e0b640 1 -- 172.21.15.134:0/1666969527 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55f8013030 con 0x55b6703cb800 2024-04-24T02:14:09.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.230+0000 7f54f5e0b640 1 -- 172.21.15.134:0/1666969527 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55f800e470 con 0x55b6703cb800 2024-04-24T02:14:09.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.230+0000 7f54f5e0b640 1 -- 172.21.15.134:0/1666969527 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55f800e810 con 0x55b6703cb800 2024-04-24T02:14:09.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.230+0000 7f560c616800 1 -- 172.21.15.134:0/1666969527 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b6703cb800 msgr2=0x55b67054b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.230+0000 7f560c616800 1 --2- 172.21.15.134:0/1666969527 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b6703cb800 0x55b67054b3c0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f55f8001d50 tx=0x7f55f800b6c0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.230+0000 7f560c616800 1 -- 172.21.15.134:0/1666969527 shutdown_connections 2024-04-24T02:14:09.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.230+0000 7f560c616800 1 --2- 172.21.15.134:0/1666969527 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b6703cb800 0x55b67054b3c0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.230+0000 7f560c616800 1 -- 172.21.15.134:0/1666969527 >> 172.21.15.134:0/1666969527 conn(0x55b670453450 msgr2=0x55b670546ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:09.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.230+0000 7f560c616800 1 -- 172.21.15.134:0/1666969527 shutdown_connections 2024-04-24T02:14:09.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.230+0000 7f560c616800 1 -- 172.21.15.134:0/1666969527 wait complete. 2024-04-24T02:14:09.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.231+0000 7f560c616800 1 Processor -- start 2024-04-24T02:14:09.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.231+0000 7f560c616800 1 -- start start 2024-04-24T02:14:09.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.231+0000 7f560c616800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b6703cb800 0x55b670552f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.231+0000 7f560c616800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b6704634f0 con 0x55b6703cb800 2024-04-24T02:14:09.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.231+0000 7f5607d5c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b6703cb800 0x55b670552f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.231+0000 7f5607d5c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b6703cb800 0x55b670552f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43068/0 (socket says 172.21.15.134:43068) 2024-04-24T02:14:09.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.231+0000 7f5607d5c640 1 -- 172.21.15.134:0/2157158517 learned_addr learned my addr 172.21.15.134:0/2157158517 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:09.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.232+0000 7f5607d5c640 1 -- 172.21.15.134:0/2157158517 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b670553470 con 0x55b6703cb800 2024-04-24T02:14:09.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.232+0000 7f5607d5c640 1 --2- 172.21.15.134:0/2157158517 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b6703cb800 0x55b670552f30 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f55f8004000 tx=0x7f55f8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.232+0000 7f54effff640 1 -- 172.21.15.134:0/2157158517 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55f8027070 con 0x55b6703cb800 2024-04-24T02:14:09.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.232+0000 7f54effff640 1 -- 172.21.15.134:0/2157158517 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55f80013d0 con 0x55b6703cb800 2024-04-24T02:14:09.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.232+0000 7f560c616800 1 -- 172.21.15.134:0/2157158517 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b670553700 con 0x55b6703cb800 2024-04-24T02:14:09.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.232+0000 7f54effff640 1 -- 172.21.15.134:0/2157158517 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55f8019ac0 con 0x55b6703cb800 2024-04-24T02:14:09.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.232+0000 7f560c616800 1 -- 172.21.15.134:0/2157158517 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6705563b0 con 0x55b6703cb800 2024-04-24T02:14:09.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.233+0000 7f54effff640 1 -- 172.21.15.134:0/2157158517 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f55f802a070 con 0x55b6703cb800 2024-04-24T02:14:09.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.233+0000 7f54effff640 1 --2- 172.21.15.134:0/2157158517 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f54f0036950 0x7f54f0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.233+0000 7f54effff640 1 -- 172.21.15.134:0/2157158517 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f55f801f070 con 0x55b6703cb800 2024-04-24T02:14:09.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.233+0000 7f560755b640 1 --2- 172.21.15.134:0/2157158517 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f54f0036950 0x7f54f0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.233+0000 7f560c616800 1 --2- 172.21.15.134:0/2157158517 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b6703cc330 0x55b67055a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.233+0000 7f560c616800 1 -- 172.21.15.134:0/2157158517 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b67055a6f0 con 0x55b6703cc330 2024-04-24T02:14:09.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.233+0000 7f560855d640 1 --2- 172.21.15.134:0/2157158517 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b6703cc330 0x55b67055a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.234+0000 7f560755b640 1 --2- 172.21.15.134:0/2157158517 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f54f0036950 0x7f54f0038e10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f55fc054000 tx=0x7f55fc04e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.234+0000 7f560855d640 1 --2- 172.21.15.134:0/2157158517 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b6703cc330 0x55b67055a170 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.234+0000 7f560855d640 1 -- 172.21.15.134:0/2157158517 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f560000a4a0 con 0x55b6703cc330 2024-04-24T02:14:09.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.234+0000 7f560c616800 1 -- 172.21.15.134:0/2157158517 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b670557720 con 0x55b6703cc330 2024-04-24T02:14:09.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.234+0000 7f560855d640 1 -- 172.21.15.134:0/2157158517 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f560000a4a0 con 0x55b6703cc330 2024-04-24T02:14:09.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.234+0000 7f560c616800 1 -- 172.21.15.134:0/2157158517 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b67055c4f0 con 0x55b6703cc330 2024-04-24T02:14:09.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.235+0000 7f560855d640 1 -- 172.21.15.134:0/2157158517 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f560000a4a0 con 0x55b6703cc330 2024-04-24T02:14:09.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.235+0000 7f560c616800 1 -- 172.21.15.134:0/2157158517 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b67055b830 con 0x55b6703cc330 2024-04-24T02:14:09.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.235+0000 7f560855d640 1 -- 172.21.15.134:0/2157158517 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f560000a4a0 con 0x55b6703cc330 2024-04-24T02:14:09.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.235+0000 7f560c616800 1 -- 172.21.15.134:0/2157158517 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b67055bc80 con 0x55b6703cc330 2024-04-24T02:14:09.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.235+0000 7f560855d640 1 -- 172.21.15.134:0/2157158517 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f560000a4a0 con 0x55b6703cc330 2024-04-24T02:14:09.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.236+0000 7f560c616800 1 Processor -- start 2024-04-24T02:14:09.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.236+0000 7f560c616800 1 -- start start 2024-04-24T02:14:09.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.236+0000 7f560c616800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b67056b2c0 0x55b67056b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.236+0000 7f560c616800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b6703496b0 con 0x55b67056b2c0 2024-04-24T02:14:09.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.236+0000 7f560755b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b67056b2c0 0x55b67056b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.236+0000 7f560755b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b67056b2c0 0x55b67056b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43082/0 (socket says 172.21.15.134:43082) 2024-04-24T02:14:09.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.236+0000 7f560755b640 1 -- 172.21.15.134:0/4191644380 learned_addr learned my addr 172.21.15.134:0/4191644380 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:09.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.237+0000 7f560755b640 1 -- 172.21.15.134:0/4191644380 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b67056bc20 con 0x55b67056b2c0 2024-04-24T02:14:09.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.237+0000 7f560755b640 1 --2- 172.21.15.134:0/4191644380 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b67056b2c0 0x55b67056b6e0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f55fc055040 tx=0x7f55fc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.237+0000 7f54ed7fa640 1 -- 172.21.15.134:0/4191644380 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55fc06d070 con 0x55b67056b2c0 2024-04-24T02:14:09.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.237+0000 7f54ed7fa640 1 -- 172.21.15.134:0/4191644380 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55fc052780 con 0x55b67056b2c0 2024-04-24T02:14:09.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.237+0000 7f560c616800 1 -- 172.21.15.134:0/4191644380 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b67056c690 con 0x55b67056b2c0 2024-04-24T02:14:09.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.237+0000 7f54ed7fa640 1 -- 172.21.15.134:0/4191644380 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55fc057040 con 0x55b67056b2c0 2024-04-24T02:14:09.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.237+0000 7f560c616800 1 -- 172.21.15.134:0/4191644380 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b67056cb30 con 0x55b67056b2c0 2024-04-24T02:14:09.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.238+0000 7f54ed7fa640 1 -- 172.21.15.134:0/4191644380 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f55fc070070 con 0x55b67056b2c0 2024-04-24T02:14:09.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.238+0000 7f54ed7fa640 1 --2- 172.21.15.134:0/4191644380 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f54e0036950 0x7f54e0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.238+0000 7f54ed7fa640 1 -- 172.21.15.134:0/4191644380 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f55fc08f510 con 0x55b67056b2c0 2024-04-24T02:14:09.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.238+0000 7f560855d640 1 --2- 172.21.15.134:0/4191644380 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f54e0036950 0x7f54e0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.239+0000 7f560c616800 1 Processor -- start 2024-04-24T02:14:09.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.239+0000 7f560c616800 1 -- start start 2024-04-24T02:14:09.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.239+0000 7f560855d640 1 --2- 172.21.15.134:0/4191644380 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f54e0036950 0x7f54e0038e10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x55b67055b350 tx=0x7f5600005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.239+0000 7f560c616800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b670578520 0x55b670578940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.239+0000 7f560c616800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b67054bd10 con 0x55b670578520 2024-04-24T02:14:09.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.239+0000 7f560755b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b670578520 0x55b670578940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.239+0000 7f560755b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b670578520 0x55b670578940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43098/0 (socket says 172.21.15.134:43098) 2024-04-24T02:14:09.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.239+0000 7f560755b640 1 -- 172.21.15.134:0/546489501 learned_addr learned my addr 172.21.15.134:0/546489501 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:09.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.239+0000 7f560755b640 1 -- 172.21.15.134:0/546489501 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b670578f10 con 0x55b670578520 2024-04-24T02:14:09.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.240+0000 7f560755b640 1 --2- 172.21.15.134:0/546489501 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b670578520 0x55b670578940 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f55fc08db70 tx=0x7f55fc08f420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1121ab112e48cea server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.240+0000 7f54e6ffd640 1 -- 172.21.15.134:0/546489501 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55fc05e530 con 0x55b670578520 2024-04-24T02:14:09.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.240+0000 7f54e6ffd640 1 -- 172.21.15.134:0/546489501 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55fc067350 con 0x55b670578520 2024-04-24T02:14:09.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.240+0000 7f54e6ffd640 1 -- 172.21.15.134:0/546489501 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55fc05ccd0 con 0x55b670578520 2024-04-24T02:14:09.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.240+0000 7f560c616800 1 -- 172.21.15.134:0/546489501 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b670578520 msgr2=0x55b670578940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.240+0000 7f560c616800 1 --2- 172.21.15.134:0/546489501 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b670578520 0x55b670578940 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f55fc08db70 tx=0x7f55fc08f420 comp rx=0 tx=0).stop 2024-04-24T02:14:09.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.240+0000 7f560c616800 1 -- 172.21.15.134:0/546489501 shutdown_connections 2024-04-24T02:14:09.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.240+0000 7f560c616800 1 --2- 172.21.15.134:0/546489501 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b670578520 0x55b670578940 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.240+0000 7f560c616800 1 -- 172.21.15.134:0/546489501 >> 172.21.15.134:0/546489501 conn(0x55b670574880 msgr2=0x55b6705728e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:09.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.240+0000 7f560c616800 1 -- 172.21.15.134:0/546489501 shutdown_connections 2024-04-24T02:14:09.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.240+0000 7f560c616800 1 -- 172.21.15.134:0/546489501 wait complete. 2024-04-24T02:14:09.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.241+0000 7f560c616800 1 Processor -- start 2024-04-24T02:14:09.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.241+0000 7f560c616800 1 -- start start 2024-04-24T02:14:09.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.241+0000 7f560c616800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b670578520 0x55b67057fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.241+0000 7f560c616800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b670579680 con 0x55b670578520 2024-04-24T02:14:09.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.241+0000 7f560755b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b670578520 0x55b67057fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.241+0000 7f560755b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b670578520 0x55b67057fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43108/0 (socket says 172.21.15.134:43108) 2024-04-24T02:14:09.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.241+0000 7f560755b640 1 -- 172.21.15.134:0/4178307400 learned_addr learned my addr 172.21.15.134:0/4178307400 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:09.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.241+0000 7f560755b640 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6705800c0 con 0x55b670578520 2024-04-24T02:14:09.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.241+0000 7f560755b640 1 --2- 172.21.15.134:0/4178307400 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b670578520 0x55b67057fb80 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f55fc08db70 tx=0x7f55fc08d880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.242+0000 7f54e57fa640 1 -- 172.21.15.134:0/4178307400 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55fc094070 con 0x55b670578520 2024-04-24T02:14:09.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.242+0000 7f54e57fa640 1 -- 172.21.15.134:0/4178307400 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55fc08c460 con 0x55b670578520 2024-04-24T02:14:09.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.242+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b670580350 con 0x55b670578520 2024-04-24T02:14:09.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.242+0000 7f54e57fa640 1 -- 172.21.15.134:0/4178307400 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55fc067820 con 0x55b670578520 2024-04-24T02:14:09.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.242+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b670583000 con 0x55b670578520 2024-04-24T02:14:09.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.243+0000 7f54e57fa640 1 -- 172.21.15.134:0/4178307400 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f55fc097070 con 0x55b670578520 2024-04-24T02:14:09.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.243+0000 7f54e57fa640 1 --2- 172.21.15.134:0/4178307400 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f54d0036900 0x7f54d0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.243+0000 7f54e57fa640 1 -- 172.21.15.134:0/4178307400 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f55fc073070 con 0x55b670578520 2024-04-24T02:14:09.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.243+0000 7f560855d640 1 --2- 172.21.15.134:0/4178307400 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f54d0036900 0x7f54d0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.243+0000 7f560c616800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.243+0000 7f560c616800 1 --2- 172.21.15.134:0/4178307400 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b67058b6d0 0x55b67058db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.243+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b67058e2e0 con 0x55b67058b6d0 2024-04-24T02:14:09.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.243+0000 7f5607d5c640 1 --2- 172.21.15.134:0/4178307400 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b67058b6d0 0x55b67058db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.243+0000 7f560855d640 1 --2- 172.21.15.134:0/4178307400 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f54d0036900 0x7f54d0038dc0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x55b670557690 tx=0x7f560001f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.244+0000 7f5607d5c640 1 --2- 172.21.15.134:0/4178307400 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b67058b6d0 0x55b67058db90 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.244+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55f8029030 con 0x55b67058b6d0 2024-04-24T02:14:09.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.244+0000 7f560c616800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:09.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.244+0000 7f560c616800 20 realm 2024-04-24T02:14:09.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.244+0000 7f560c616800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.244+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b67058e6f0 con 0x55b67058b6d0 2024-04-24T02:14:09.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.244+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55f8029030 con 0x55b67058b6d0 2024-04-24T02:14:09.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.244+0000 7f560c616800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:09.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.244+0000 7f560c616800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:14:09.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.244+0000 7f560c616800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.244+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b67058efc0 con 0x55b67058b6d0 2024-04-24T02:14:09.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.244+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55f8029030 con 0x55b67058b6d0 2024-04-24T02:14:09.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.244+0000 7f560c616800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:09.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.244+0000 7f560c616800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.244+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b67058f360 con 0x55b67058b6d0 2024-04-24T02:14:09.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.245+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f55f8029030 con 0x55b67058b6d0 2024-04-24T02:14:09.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.245+0000 7f560c616800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:14:09.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.245+0000 7f560c616800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.245+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b67058fbb0 con 0x55b67058b6d0 2024-04-24T02:14:09.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.245+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f55f8029030 con 0x55b67058b6d0 2024-04-24T02:14:09.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.245+0000 7f560c616800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:14:09.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.245+0000 7f560c616800 20 searching for the correct realm 2024-04-24T02:14:09.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.245+0000 7f560c616800 1 --2- 172.21.15.134:0/4178307400 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55b670591920 0x55b670593d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.245+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b6705942f0 con 0x55b670591920 2024-04-24T02:14:09.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.245+0000 7f560755b640 1 --2- 172.21.15.134:0/4178307400 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55b670591920 0x55b670593d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.246+0000 7f560755b640 1 --2- 172.21.15.134:0/4178307400 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55b670591920 0x55b670593d10 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.246+0000 7f560755b640 1 -- 172.21.15.134:0/4178307400 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55fc096030 con 0x55b670591920 2024-04-24T02:14:09.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.246+0000 7f560755b640 1 --2- 172.21.15.134:0/4178307400 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f55fc099060 0x7f55fc08f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.246+0000 7f560755b640 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b6705942f0 con 0x7f55fc099060 2024-04-24T02:14:09.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.246+0000 7f560855d640 1 --2- 172.21.15.134:0/4178307400 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f55fc099060 0x7f55fc08f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.246+0000 7f560855d640 1 --2- 172.21.15.134:0/4178307400 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f55fc099060 0x7f55fc08f7b0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.247+0000 7f560855d640 1 -- 172.21.15.134:0/4178307400 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f560001f070 con 0x7f55fc099060 2024-04-24T02:14:09.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.247+0000 7f560855d640 1 --2- 172.21.15.134:0/4178307400 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f5600031040 0x7f5600032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.247+0000 7f560855d640 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b6705942f0 con 0x7f5600031040 2024-04-24T02:14:09.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.247+0000 7f5607d5c640 1 --2- 172.21.15.134:0/4178307400 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f5600031040 0x7f5600032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.248+0000 7f5607d5c640 1 --2- 172.21.15.134:0/4178307400 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f5600031040 0x7f5600032940 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.248+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55f8029030 con 0x7f5600031040 2024-04-24T02:14:09.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.248+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b6705942f0 con 0x55b67058b6d0 2024-04-24T02:14:09.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.248+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55f8029030 con 0x55b67058b6d0 2024-04-24T02:14:09.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.248+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b6705942f0 con 0x55b67058b6d0 2024-04-24T02:14:09.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.248+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f55f8029030 con 0x55b67058b6d0 2024-04-24T02:14:09.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.248+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b6705942f0 con 0x7f5600031040 2024-04-24T02:14:09.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.249+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55f8029030 con 0x7f5600031040 2024-04-24T02:14:09.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.249+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b6705942f0 con 0x7f55fc099060 2024-04-24T02:14:09.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.249+0000 7f560855d640 1 -- 172.21.15.134:0/4178307400 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f560001f070 con 0x7f55fc099060 2024-04-24T02:14:09.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.249+0000 7f560855d640 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b6705942f0 con 0x7f55fc099060 2024-04-24T02:14:09.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.249+0000 7f560855d640 1 -- 172.21.15.134:0/4178307400 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f560001f070 con 0x7f55fc099060 2024-04-24T02:14:09.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.249+0000 7f560855d640 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b6705942f0 con 0x55b670591920 2024-04-24T02:14:09.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.249+0000 7f560755b640 1 -- 172.21.15.134:0/4178307400 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55fc096030 con 0x55b670591920 2024-04-24T02:14:09.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.249+0000 7f560755b640 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b6705942f0 con 0x55b67058b6d0 2024-04-24T02:14:09.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.250+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55f8029030 con 0x55b67058b6d0 2024-04-24T02:14:09.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.250+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b6705942f0 con 0x7f5600031040 2024-04-24T02:14:09.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.250+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55f8029030 con 0x7f5600031040 2024-04-24T02:14:09.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.250+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b6705942f0 con 0x55b67058b6d0 2024-04-24T02:14:09.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.250+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55f8029030 con 0x55b67058b6d0 2024-04-24T02:14:09.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.250+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b6705942f0 con 0x7f55fc099060 2024-04-24T02:14:09.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.251+0000 7f560855d640 1 -- 172.21.15.134:0/4178307400 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f560001f070 con 0x7f55fc099060 2024-04-24T02:14:09.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.251+0000 7f560855d640 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b6705942f0 con 0x55b670591920 2024-04-24T02:14:09.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.251+0000 7f560755b640 1 -- 172.21.15.134:0/4178307400 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55fc096030 con 0x55b670591920 2024-04-24T02:14:09.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.251+0000 7f560755b640 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b6705942f0 con 0x55b670591920 2024-04-24T02:14:09.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.251+0000 7f560755b640 1 -- 172.21.15.134:0/4178307400 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55fc096030 con 0x55b670591920 2024-04-24T02:14:09.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.251+0000 7f560755b640 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b6705942f0 con 0x7f55fc099060 2024-04-24T02:14:09.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.251+0000 7f560855d640 1 -- 172.21.15.134:0/4178307400 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f560001f070 con 0x7f55fc099060 2024-04-24T02:14:09.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.251+0000 7f560855d640 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b6705942f0 con 0x55b670591920 2024-04-24T02:14:09.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.251+0000 7f560755b640 1 -- 172.21.15.134:0/4178307400 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55fc096030 con 0x55b670591920 2024-04-24T02:14:09.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.252+0000 7f560755b640 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b6705942f0 con 0x55b670591920 2024-04-24T02:14:09.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.252+0000 7f560755b640 1 -- 172.21.15.134:0/4178307400 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55fc096030 con 0x55b670591920 2024-04-24T02:14:09.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.252+0000 7f560755b640 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b6705942f0 con 0x55b67058b6d0 2024-04-24T02:14:09.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.252+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55f8029030 con 0x55b67058b6d0 2024-04-24T02:14:09.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.252+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b6705942f0 con 0x55b67058b6d0 2024-04-24T02:14:09.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.252+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f55f8029030 con 0x55b67058b6d0 2024-04-24T02:14:09.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.252+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b6705942f0 con 0x7f5600031040 2024-04-24T02:14:09.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.253+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55f8029030 con 0x7f5600031040 2024-04-24T02:14:09.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.253+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b6705942f0 con 0x55b670591920 2024-04-24T02:14:09.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.253+0000 7f560755b640 1 -- 172.21.15.134:0/4178307400 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55fc096030 con 0x55b670591920 2024-04-24T02:14:09.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.253+0000 7f560755b640 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b6705942f0 con 0x7f55fc099060 2024-04-24T02:14:09.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.253+0000 7f560855d640 1 -- 172.21.15.134:0/4178307400 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f560001f070 con 0x7f55fc099060 2024-04-24T02:14:09.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.253+0000 7f560855d640 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b6705942f0 con 0x55b67058b6d0 2024-04-24T02:14:09.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.253+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55f8029030 con 0x55b67058b6d0 2024-04-24T02:14:09.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.253+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b6705942f0 con 0x7f5600031040 2024-04-24T02:14:09.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.254+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55f8029030 con 0x7f5600031040 2024-04-24T02:14:09.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.254+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b6705942f0 con 0x55b670591920 2024-04-24T02:14:09.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.254+0000 7f560755b640 1 -- 172.21.15.134:0/4178307400 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55fc096030 con 0x55b670591920 2024-04-24T02:14:09.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.254+0000 7f560755b640 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b6705942f0 con 0x7f5600031040 2024-04-24T02:14:09.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.254+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55f8029030 con 0x7f5600031040 2024-04-24T02:14:09.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.254+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b6705942f0 con 0x7f55fc099060 2024-04-24T02:14:09.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.255+0000 7f560855d640 1 -- 172.21.15.134:0/4178307400 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5600040040 con 0x7f55fc099060 2024-04-24T02:14:09.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.255+0000 7f560855d640 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b6705942f0 con 0x55b670591920 2024-04-24T02:14:09.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.255+0000 7f560755b640 1 -- 172.21.15.134:0/4178307400 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55fc096030 con 0x55b670591920 2024-04-24T02:14:09.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.255+0000 7f560755b640 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b6705942f0 con 0x7f55fc099060 2024-04-24T02:14:09.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.255+0000 7f560855d640 1 -- 172.21.15.134:0/4178307400 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5600040040 con 0x7f55fc099060 2024-04-24T02:14:09.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.255+0000 7f560855d640 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b6705942f0 con 0x55b67058b6d0 2024-04-24T02:14:09.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.255+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f55f8029030 con 0x55b67058b6d0 2024-04-24T02:14:09.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.255+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b6705942f0 con 0x7f55fc099060 2024-04-24T02:14:09.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.256+0000 7f560855d640 1 -- 172.21.15.134:0/4178307400 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5600040040 con 0x7f55fc099060 2024-04-24T02:14:09.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.256+0000 7f560c616800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:14:09.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.256+0000 7f560c616800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:14:09.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.256+0000 7f560c616800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:14:09.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.256+0000 7f560c616800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:14:09.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.256+0000 7f560c616800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:14:09.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.256+0000 7f560c616800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:14:09.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.256+0000 7f560c616800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.256+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b670590560 con 0x55b67058b6d0 2024-04-24T02:14:09.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.256+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55f8029030 con 0x55b67058b6d0 2024-04-24T02:14:09.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.256+0000 7f560c616800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:09.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.256+0000 7f560c616800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.256+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b670590e00 con 0x55b67058b6d0 2024-04-24T02:14:09.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.256+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f55f8029030 con 0x55b67058b6d0 2024-04-24T02:14:09.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.256+0000 7f560c616800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:14:09.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.256+0000 7f560c616800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.256+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b670590e00 con 0x55b67058b6d0 2024-04-24T02:14:09.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.257+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f55f8029030 con 0x55b67058b6d0 2024-04-24T02:14:09.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.257+0000 7f560c616800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:14:09.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.257+0000 7f560c616800 20 zone default found 2024-04-24T02:14:09.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.257+0000 7f560c616800 4 Realm: () 2024-04-24T02:14:09.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.257+0000 7f560c616800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:14:09.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.257+0000 7f560c616800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:14:09.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.257+0000 7f560c616800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:14:09.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.257+0000 7f560c616800 20 zonegroup default 2024-04-24T02:14:09.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.257+0000 7f560c616800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.257+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b670594770 con 0x7f5600031040 2024-04-24T02:14:09.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.257+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f55f8029030 con 0x7f5600031040 2024-04-24T02:14:09.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.257+0000 7f560c616800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:09.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.257+0000 7f560c616800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.257+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b670590bd0 con 0x55b670591920 2024-04-24T02:14:09.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.257+0000 7f560755b640 1 -- 172.21.15.134:0/4178307400 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f55fc096030 con 0x55b670591920 2024-04-24T02:14:09.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.257+0000 7f560c616800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:09.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.257+0000 7f560c616800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.257+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b670596750 con 0x55b670591920 2024-04-24T02:14:09.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.258+0000 7f560755b640 1 -- 172.21.15.134:0/4178307400 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f55fc096030 con 0x55b670591920 2024-04-24T02:14:09.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.258+0000 7f560c616800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:09.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.258+0000 7f560c616800 20 started sync module instance, tier type = 2024-04-24T02:14:09.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.258+0000 7f560c616800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:14:09.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.258+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b670595a90 con 0x7f55fc099060 2024-04-24T02:14:09.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.259+0000 7f560855d640 1 -- 172.21.15.134:0/4178307400 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(44 notify.0 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5600040040 con 0x7f55fc099060 2024-04-24T02:14:09.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.259+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94242057313920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b670597060 con 0x7f55fc099060 2024-04-24T02:14:09.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.259+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b6705978b0 con 0x55b67058b6d0 2024-04-24T02:14:09.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.260+0000 7f560855d640 1 -- 172.21.15.134:0/4178307400 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94242057313920] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5600040040 con 0x7f55fc099060 2024-04-24T02:14:09.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.260+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55f8029030 con 0x55b67058b6d0 2024-04-24T02:14:09.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.260+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94242057317296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b670597500 con 0x55b67058b6d0 2024-04-24T02:14:09.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.261+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b670598020 con 0x55b670591920 2024-04-24T02:14:09.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.262+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94242057317296] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55f8029030 con 0x55b67058b6d0 2024-04-24T02:14:09.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.262+0000 7f560755b640 1 -- 172.21.15.134:0/4178307400 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55fc096030 con 0x55b670591920 2024-04-24T02:14:09.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.262+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94242057321200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b670598410 con 0x55b670591920 2024-04-24T02:14:09.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.262+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b670598e10 con 0x7f55fc099060 2024-04-24T02:14:09.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.263+0000 7f560855d640 1 -- 172.21.15.134:0/4178307400 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(50 notify.3 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5600040040 con 0x7f55fc099060 2024-04-24T02:14:09.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.263+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94242057324832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b6705996b0 con 0x7f55fc099060 2024-04-24T02:14:09.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.263+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b67059a190 con 0x55b67058b6d0 2024-04-24T02:14:09.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.263+0000 7f560755b640 1 -- 172.21.15.134:0/4178307400 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94242057321200] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55fc096030 con 0x55b670591920 2024-04-24T02:14:09.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.264+0000 7f560855d640 1 -- 172.21.15.134:0/4178307400 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94242057324832] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5600040040 con 0x7f55fc099060 2024-04-24T02:14:09.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.264+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55f8029030 con 0x55b67058b6d0 2024-04-24T02:14:09.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.264+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94242057329824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b670599200 con 0x55b67058b6d0 2024-04-24T02:14:09.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.264+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b67059aa30 con 0x7f5600031040 2024-04-24T02:14:09.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.265+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94242057329824] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55f8029030 con 0x55b67058b6d0 2024-04-24T02:14:09.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.267+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(54 notify.5 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55f8029030 con 0x7f5600031040 2024-04-24T02:14:09.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.267+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94242057318352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b670599200 con 0x7f5600031040 2024-04-24T02:14:09.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.267+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b67059b050 con 0x7f5600031040 2024-04-24T02:14:09.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.268+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94242057318352] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55f8029030 con 0x7f5600031040 2024-04-24T02:14:09.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.268+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(56 notify.6 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55f8029030 con 0x7f5600031040 2024-04-24T02:14:09.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.268+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94242057333568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b67059b010 con 0x7f5600031040 2024-04-24T02:14:09.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.268+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b67059ba10 con 0x7f5600031040 2024-04-24T02:14:09.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.269+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94242057333568] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55f8029030 con 0x7f5600031040 2024-04-24T02:14:09.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.269+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(58 notify.7 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55f8029030 con 0x7f5600031040 2024-04-24T02:14:09.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.269+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94242057331696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b67059b9d0 con 0x7f5600031040 2024-04-24T02:14:09.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.269+0000 7f560c616800 20 add_watcher() i=0 2024-04-24T02:14:09.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.269+0000 7f560c616800 20 add_watcher() i=1 2024-04-24T02:14:09.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.269+0000 7f560c616800 20 add_watcher() i=2 2024-04-24T02:14:09.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.269+0000 7f560c616800 20 add_watcher() i=3 2024-04-24T02:14:09.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.269+0000 7f560c616800 20 add_watcher() i=4 2024-04-24T02:14:09.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.269+0000 7f560c616800 20 add_watcher() i=5 2024-04-24T02:14:09.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.269+0000 7f560c616800 20 add_watcher() i=6 2024-04-24T02:14:09.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.272+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94242057331696] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55f8029030 con 0x7f5600031040 2024-04-24T02:14:09.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.272+0000 7f560c616800 20 add_watcher() i=7 2024-04-24T02:14:09.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.272+0000 7f560c616800 2 all 8 watchers are set, enabling cache 2024-04-24T02:14:09.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.272+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b67059ee90 con 0x55b67058b6d0 2024-04-24T02:14:09.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.272+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f55f8029030 con 0x55b67058b6d0 2024-04-24T02:14:09.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.272+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94242057336560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b67059c420 con 0x55b67058b6d0 2024-04-24T02:14:09.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.273+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94242057336560] v32'235 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f55f8029030 con 0x55b67058b6d0 2024-04-24T02:14:09.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.273+0000 7f54bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:14:09.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.273+0000 7f560c616800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:14:09.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.273+0000 7f560c616800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:14:09.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.273+0000 7f560c616800 5 note: GC not initialized 2024-04-24T02:14:09.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.274+0000 7f54bcfe1640 20 reqs_thread_entry: start 2024-04-24T02:14:09.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.274+0000 7f560c616800 20 init_complete bucket index max shards: 11 2024-04-24T02:14:09.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.274+0000 7f560c616800 20 Filter name: none 2024-04-24T02:14:09.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.274+0000 7f54367fc640 20 reqs_thread_entry: start 2024-04-24T02:14:09.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.274+0000 7f560c616800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T02:14:09.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.274+0000 7f560c616800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.274+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b6705d21a0 con 0x55b67058b6d0 2024-04-24T02:14:09.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.274+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f55f8029030 con 0x55b67058b6d0 2024-04-24T02:14:09.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.274+0000 7f560c616800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T02:14:09.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.274+0000 7f560c616800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T02:14:09.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.274+0000 7f560c616800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:14:09.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.274+0000 7f560c616800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:14:09.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.274+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b6705d1c80 con 0x7f5600031040 2024-04-24T02:14:09.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.276+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(63 usage.10 [call] v32'32 uv32 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55f8029030 con 0x7f5600031040 2024-04-24T02:14:09.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.276+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b6705d1c80 con 0x7f5600031040 2024-04-24T02:14:09.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.277+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(64 usage.10 [call] v32'33 uv32 ondisk = -61 ((61) No data available)) ==== 152+0+0 (crc 0 0 0) 0x7f55f8029030 con 0x7f5600031040 2024-04-24T02:14:09.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.278+0000 7f54bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:14:09.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.278+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94242057336560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b6705d1c80 con 0x55b67058b6d0 2024-04-24T02:14:09.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.279+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94242057336560] v32'236 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f55f8029030 con 0x55b67058b6d0 2024-04-24T02:14:09.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.279+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94242057313920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b6705d1c80 con 0x7f55fc099060 2024-04-24T02:14:09.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.280+0000 7f560855d640 1 -- 172.21.15.134:0/4178307400 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94242057313920] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5600040040 con 0x7f55fc099060 2024-04-24T02:14:09.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.280+0000 7f560c616800 20 remove_watcher() i=0 2024-04-24T02:14:09.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.280+0000 7f560c616800 2 removed watcher, disabling cache 2024-04-24T02:14:09.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.280+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94242057317296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b6705d1c80 con 0x55b67058b6d0 2024-04-24T02:14:09.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.281+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94242057317296] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55f8029030 con 0x55b67058b6d0 2024-04-24T02:14:09.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.281+0000 7f560c616800 20 remove_watcher() i=1 2024-04-24T02:14:09.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.281+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94242057321200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b670596bb0 con 0x55b670591920 2024-04-24T02:14:09.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.282+0000 7f560755b640 1 -- 172.21.15.134:0/4178307400 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94242057321200] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55fc096030 con 0x55b670591920 2024-04-24T02:14:09.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.282+0000 7f560c616800 20 remove_watcher() i=2 2024-04-24T02:14:09.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.282+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94242057324832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b670597af0 con 0x7f55fc099060 2024-04-24T02:14:09.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.283+0000 7f560855d640 1 -- 172.21.15.134:0/4178307400 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94242057324832] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5600040040 con 0x7f55fc099060 2024-04-24T02:14:09.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.283+0000 7f560c616800 20 remove_watcher() i=3 2024-04-24T02:14:09.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.283+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94242057329824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b670595e80 con 0x55b67058b6d0 2024-04-24T02:14:09.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.285+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94242057329824] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55f8029030 con 0x55b67058b6d0 2024-04-24T02:14:09.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.285+0000 7f560c616800 20 remove_watcher() i=4 2024-04-24T02:14:09.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.285+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94242057318352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b670599ca0 con 0x7f5600031040 2024-04-24T02:14:09.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.286+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94242057318352] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55f8029030 con 0x7f5600031040 2024-04-24T02:14:09.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.286+0000 7f560c616800 20 remove_watcher() i=5 2024-04-24T02:14:09.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.286+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94242057333568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b670599ca0 con 0x7f5600031040 2024-04-24T02:14:09.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.287+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94242057333568] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55f8029030 con 0x7f5600031040 2024-04-24T02:14:09.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.287+0000 7f560c616800 20 remove_watcher() i=6 2024-04-24T02:14:09.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.287+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94242057331696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b67059ab40 con 0x7f5600031040 2024-04-24T02:14:09.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.288+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94242057331696] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55f8029030 con 0x7f5600031040 2024-04-24T02:14:09.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.288+0000 7f560c616800 20 remove_watcher() i=7 2024-04-24T02:14:09.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.288+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f5600031040 msgr2=0x7f5600032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.288+0000 7f560c616800 1 --2- 172.21.15.134:0/4178307400 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f5600031040 0x7f5600032940 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.288+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b67058b6d0 msgr2=0x55b67058db90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.288+0000 7f560c616800 1 --2- 172.21.15.134:0/4178307400 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b67058b6d0 0x55b67058db90 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.288+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f55fc099060 msgr2=0x7f55fc08f7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.288+0000 7f560c616800 1 --2- 172.21.15.134:0/4178307400 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f55fc099060 0x7f55fc08f7b0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.288+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55b670591920 msgr2=0x55b670593d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.288+0000 7f560c616800 1 --2- 172.21.15.134:0/4178307400 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55b670591920 0x55b670593d10 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.288+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f54d0036900 msgr2=0x7f54d0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.288+0000 7f560c616800 1 --2- 172.21.15.134:0/4178307400 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f54d0036900 0x7f54d0038dc0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x55b670557690 tx=0x7f560001f000 comp rx=0 tx=0).stop 2024-04-24T02:14:09.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.288+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b670578520 msgr2=0x55b67057fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.288+0000 7f5607d5c640 1 -- 172.21.15.134:0/4178307400 reap_dead start 2024-04-24T02:14:09.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.288+0000 7f560c616800 1 --2- 172.21.15.134:0/4178307400 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b670578520 0x55b67057fb80 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f55fc08db70 tx=0x7f55fc08d880 comp rx=0 tx=0).stop 2024-04-24T02:14:09.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.288+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 shutdown_connections 2024-04-24T02:14:09.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.288+0000 7f560c616800 1 --2- 172.21.15.134:0/4178307400 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b670578520 0x55b67057fb80 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.288+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 >> 172.21.15.134:0/4178307400 conn(0x55b670574880 msgr2=0x55b670571ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:09.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.289+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 shutdown_connections 2024-04-24T02:14:09.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.289+0000 7f560c616800 1 -- 172.21.15.134:0/4178307400 wait complete. 2024-04-24T02:14:09.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.289+0000 7f560c616800 1 -- 172.21.15.134:0/4191644380 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f54e0036950 msgr2=0x7f54e0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.289+0000 7f560c616800 1 --2- 172.21.15.134:0/4191644380 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f54e0036950 0x7f54e0038e10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x55b67055b350 tx=0x7f5600005840 comp rx=0 tx=0).stop 2024-04-24T02:14:09.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.289+0000 7f560c616800 1 -- 172.21.15.134:0/4191644380 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b67056b2c0 msgr2=0x55b67056b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.289+0000 7f560c616800 1 --2- 172.21.15.134:0/4191644380 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b67056b2c0 0x55b67056b6e0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f55fc055040 tx=0x7f55fc002fb0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.289+0000 7f560c616800 1 -- 172.21.15.134:0/4191644380 shutdown_connections 2024-04-24T02:14:09.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.289+0000 7f560c616800 1 --2- 172.21.15.134:0/4191644380 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f54e0036950 0x7f54e0038e10 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.289+0000 7f560c616800 1 --2- 172.21.15.134:0/4191644380 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b67056b2c0 0x55b67056b6e0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.289+0000 7f560c616800 1 -- 172.21.15.134:0/4191644380 >> 172.21.15.134:0/4191644380 conn(0x55b67055f360 msgr2=0x55b67055f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:09.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.289+0000 7f560c616800 1 -- 172.21.15.134:0/4191644380 shutdown_connections 2024-04-24T02:14:09.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.289+0000 7f560c616800 1 -- 172.21.15.134:0/4191644380 wait complete. 2024-04-24T02:14:09.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.289+0000 7f560c616800 1 -- 172.21.15.134:0/2157158517 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b6703cc330 msgr2=0x55b67055a170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.289+0000 7f560c616800 1 --2- 172.21.15.134:0/2157158517 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b6703cc330 0x55b67055a170 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.289+0000 7f560c616800 1 -- 172.21.15.134:0/2157158517 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f54f0036950 msgr2=0x7f54f0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.289+0000 7f560c616800 1 --2- 172.21.15.134:0/2157158517 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f54f0036950 0x7f54f0038e10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f55fc054000 tx=0x7f55fc04e000 comp rx=0 tx=0).stop 2024-04-24T02:14:09.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.289+0000 7f560c616800 1 -- 172.21.15.134:0/2157158517 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b6703cb800 msgr2=0x55b670552f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.289+0000 7f560c616800 1 --2- 172.21.15.134:0/2157158517 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b6703cb800 0x55b670552f30 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f55f8004000 tx=0x7f55f8000bc0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.289+0000 7f560c616800 1 -- 172.21.15.134:0/2157158517 shutdown_connections 2024-04-24T02:14:09.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.289+0000 7f560c616800 1 --2- 172.21.15.134:0/2157158517 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55b6703cc330 0x55b67055a170 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.289+0000 7f560c616800 1 --2- 172.21.15.134:0/2157158517 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f54f0036950 0x7f54f0038e10 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.289+0000 7f560c616800 1 --2- 172.21.15.134:0/2157158517 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b6703cb800 0x55b670552f30 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.289+0000 7f560c616800 1 -- 172.21.15.134:0/2157158517 >> 172.21.15.134:0/2157158517 conn(0x55b670453450 msgr2=0x55b6705454e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:09.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.289+0000 7f560c616800 1 -- 172.21.15.134:0/2157158517 shutdown_connections 2024-04-24T02:14:09.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.290+0000 7f560c616800 1 -- 172.21.15.134:0/2157158517 wait complete. 2024-04-24T02:14:09.314 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-04-24T02:14:09.314 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-04-24T02:14:09.315 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-04-24T02:14:09.358 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:14:09.358 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:14:09.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.358+0000 7fd82243f800 1 Processor -- start 2024-04-24T02:14:09.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.358+0000 7fd82243f800 1 -- start start 2024-04-24T02:14:09.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.358+0000 7fd82243f800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x564312a51330 0x564312a53720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.358+0000 7fd82243f800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56431290bd40 con 0x564312a4cf90 2024-04-24T02:14:09.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.358+0000 7fd82243f800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x5643128de4d0 con 0x564312a51330 2024-04-24T02:14:09.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.358+0000 7fd81773d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x564312a51330 0x564312a53720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.358+0000 7fd81773d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x564312a51330 0x564312a53720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43120/0 (socket says 172.21.15.134:43120) 2024-04-24T02:14:09.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.358+0000 7fd81ff3e640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x564312a4cf90 0x564312a4d3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:46342/0 (socket says 172.21.15.134:46342) 2024-04-24T02:14:09.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.358+0000 7fd81773d640 1 -- 172.21.15.134:0/4131676486 learned_addr learned my addr 172.21.15.134:0/4131676486 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:09.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.358+0000 7fd81773d640 1 -- 172.21.15.134:0/4131676486 >> v1:172.21.15.104:6789/0 conn(0x564312a4cf90 legacy=0x564312a4d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.358+0000 7fd81773d640 1 -- 172.21.15.134:0/4131676486 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56431290a590 con 0x564312a51330 2024-04-24T02:14:09.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.360+0000 7fd81773d640 1 --2- 172.21.15.134:0/4131676486 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564312a51330 0x564312a53720 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fd80800a520 tx=0x7fd80801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da4266b891c58b33 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.360+0000 7fd81f73d640 1 -- 172.21.15.134:0/4131676486 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd808057070 con 0x564312a51330 2024-04-24T02:14:09.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.360+0000 7fd81f73d640 1 -- 172.21.15.134:0/4131676486 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd808052570 con 0x564312a51330 2024-04-24T02:14:09.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.360+0000 7fd81f73d640 1 -- 172.21.15.134:0/4131676486 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd80804ae60 con 0x564312a51330 2024-04-24T02:14:09.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.361+0000 7fd82243f800 1 -- 172.21.15.134:0/4131676486 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564312a51330 msgr2=0x564312a53720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.361+0000 7fd82243f800 1 --2- 172.21.15.134:0/4131676486 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564312a51330 0x564312a53720 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fd80800a520 tx=0x7fd80801d010 comp rx=0 tx=0).stop 2024-04-24T02:14:09.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.361+0000 7fd82243f800 1 -- 172.21.15.134:0/4131676486 shutdown_connections 2024-04-24T02:14:09.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.361+0000 7fd82243f800 1 --2- 172.21.15.134:0/4131676486 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564312a51330 0x564312a53720 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.361+0000 7fd82243f800 1 -- 172.21.15.134:0/4131676486 >> 172.21.15.134:0/4131676486 conn(0x564312a48530 msgr2=0x564312a4a950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:09.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.361+0000 7fd82243f800 1 -- 172.21.15.134:0/4131676486 shutdown_connections 2024-04-24T02:14:09.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.361+0000 7fd82243f800 1 -- 172.21.15.134:0/4131676486 wait complete. 2024-04-24T02:14:09.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.373+0000 7fd82243f800 1 Processor -- start 2024-04-24T02:14:09.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.373+0000 7fd82243f800 1 -- start start 2024-04-24T02:14:09.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.373+0000 7fd82243f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564312a4cf90 0x5643129c29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.373+0000 7fd82243f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5643129983c0 con 0x564312a4cf90 2024-04-24T02:14:09.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.373+0000 7fd81ff3e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564312a4cf90 0x5643129c29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.373+0000 7fd81ff3e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564312a4cf90 0x5643129c29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43130/0 (socket says 172.21.15.134:43130) 2024-04-24T02:14:09.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.373+0000 7fd81ff3e640 1 -- 172.21.15.134:0/2882801009 learned_addr learned my addr 172.21.15.134:0/2882801009 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:09.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.373+0000 7fd81ff3e640 1 -- 172.21.15.134:0/2882801009 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643129c0f60 con 0x564312a4cf90 2024-04-24T02:14:09.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.374+0000 7fd81ff3e640 1 --2- 172.21.15.134:0/2882801009 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564312a4cf90 0x5643129c29a0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fd810001e40 tx=0x7fd810001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4594f2d75553851e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.374+0000 7fd70de0b640 1 -- 172.21.15.134:0/2882801009 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd81000e5c0 con 0x564312a4cf90 2024-04-24T02:14:09.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.374+0000 7fd70de0b640 1 -- 172.21.15.134:0/2882801009 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd810006070 con 0x564312a4cf90 2024-04-24T02:14:09.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.374+0000 7fd70de0b640 1 -- 172.21.15.134:0/2882801009 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd81000e910 con 0x564312a4cf90 2024-04-24T02:14:09.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.374+0000 7fd82243f800 1 -- 172.21.15.134:0/2882801009 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564312a4cf90 msgr2=0x5643129c29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.374+0000 7fd82243f800 1 --2- 172.21.15.134:0/2882801009 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564312a4cf90 0x5643129c29a0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fd810001e40 tx=0x7fd810001e70 comp rx=0 tx=0).stop 2024-04-24T02:14:09.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.375+0000 7fd82243f800 1 -- 172.21.15.134:0/2882801009 shutdown_connections 2024-04-24T02:14:09.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.375+0000 7fd82243f800 1 --2- 172.21.15.134:0/2882801009 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564312a4cf90 0x5643129c29a0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.375+0000 7fd82243f800 1 -- 172.21.15.134:0/2882801009 >> 172.21.15.134:0/2882801009 conn(0x564312a48530 msgr2=0x564312b39990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:09.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.375+0000 7fd82243f800 1 -- 172.21.15.134:0/2882801009 shutdown_connections 2024-04-24T02:14:09.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.375+0000 7fd82243f800 1 -- 172.21.15.134:0/2882801009 wait complete. 2024-04-24T02:14:09.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.375+0000 7fd82243f800 1 Processor -- start 2024-04-24T02:14:09.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.375+0000 7fd82243f800 1 -- start start 2024-04-24T02:14:09.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.375+0000 7fd82243f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564312a51330 0x564312b480c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.375+0000 7fd82243f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x564312a53ff0 con 0x564312a51330 2024-04-24T02:14:09.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.375+0000 7fd81ff3e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564312a51330 0x564312b480c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.375+0000 7fd81ff3e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564312a51330 0x564312b480c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43142/0 (socket says 172.21.15.134:43142) 2024-04-24T02:14:09.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.375+0000 7fd81ff3e640 1 -- 172.21.15.134:0/3679722621 learned_addr learned my addr 172.21.15.134:0/3679722621 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:09.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.375+0000 7fd81ff3e640 1 -- 172.21.15.134:0/3679722621 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564312b48600 con 0x564312a51330 2024-04-24T02:14:09.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.376+0000 7fd81ff3e640 1 --2- 172.21.15.134:0/3679722621 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564312a51330 0x564312b480c0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fd810000f60 tx=0x7fd810000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.376+0000 7fd707fff640 1 -- 172.21.15.134:0/3679722621 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd81001a7c0 con 0x564312a51330 2024-04-24T02:14:09.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.376+0000 7fd707fff640 1 -- 172.21.15.134:0/3679722621 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd81001a960 con 0x564312a51330 2024-04-24T02:14:09.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.376+0000 7fd82243f800 1 -- 172.21.15.134:0/3679722621 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564312b48890 con 0x564312a51330 2024-04-24T02:14:09.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.376+0000 7fd707fff640 1 -- 172.21.15.134:0/3679722621 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd81001acc0 con 0x564312a51330 2024-04-24T02:14:09.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.376+0000 7fd82243f800 1 -- 172.21.15.134:0/3679722621 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564312b4b4a0 con 0x564312a51330 2024-04-24T02:14:09.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.377+0000 7fd707fff640 1 -- 172.21.15.134:0/3679722621 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd810017070 con 0x564312a51330 2024-04-24T02:14:09.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.377+0000 7fd707fff640 1 --2- 172.21.15.134:0/3679722621 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd708036900 0x7fd708038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.377+0000 7fd707fff640 1 -- 172.21.15.134:0/3679722621 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fd810015020 con 0x564312a51330 2024-04-24T02:14:09.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.377+0000 7fd81773d640 1 --2- 172.21.15.134:0/3679722621 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd708036900 0x7fd708038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.377+0000 7fd82243f800 1 --2- 172.21.15.134:0/3679722621 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x564312b4d250 0x564312b4f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.377+0000 7fd82243f800 1 -- 172.21.15.134:0/3679722621 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564312b4fc10 con 0x564312b4d250 2024-04-24T02:14:09.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.377+0000 7fd82073f640 1 --2- 172.21.15.134:0/3679722621 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x564312b4d250 0x564312b4f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.377+0000 7fd81773d640 1 --2- 172.21.15.134:0/3679722621 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd708036900 0x7fd708038dc0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd808054000 tx=0x7fd80804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.377+0000 7fd82073f640 1 --2- 172.21.15.134:0/3679722621 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x564312b4d250 0x564312b4f640 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.378+0000 7fd82073f640 1 -- 172.21.15.134:0/3679722621 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd81800a4a0 con 0x564312b4d250 2024-04-24T02:14:09.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.378+0000 7fd82243f800 1 -- 172.21.15.134:0/3679722621 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564312b4c830 con 0x564312b4d250 2024-04-24T02:14:09.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.378+0000 7fd82073f640 1 -- 172.21.15.134:0/3679722621 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd81800a4a0 con 0x564312b4d250 2024-04-24T02:14:09.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.378+0000 7fd82243f800 1 -- 172.21.15.134:0/3679722621 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564312b51a60 con 0x564312b4d250 2024-04-24T02:14:09.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.378+0000 7fd82073f640 1 -- 172.21.15.134:0/3679722621 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd81800a4a0 con 0x564312b4d250 2024-04-24T02:14:09.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.378+0000 7fd82243f800 1 -- 172.21.15.134:0/3679722621 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564312b50da0 con 0x564312b4d250 2024-04-24T02:14:09.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.379+0000 7fd82073f640 1 -- 172.21.15.134:0/3679722621 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd81800a4a0 con 0x564312b4d250 2024-04-24T02:14:09.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.379+0000 7fd82243f800 1 -- 172.21.15.134:0/3679722621 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564312b511f0 con 0x564312b4d250 2024-04-24T02:14:09.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.379+0000 7fd82073f640 1 -- 172.21.15.134:0/3679722621 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd81800a4a0 con 0x564312b4d250 2024-04-24T02:14:09.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.379+0000 7fd82243f800 1 Processor -- start 2024-04-24T02:14:09.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.379+0000 7fd82243f800 1 -- start start 2024-04-24T02:14:09.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.379+0000 7fd82243f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564312b60850 0x564312b60c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.379+0000 7fd82243f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56431293e6b0 con 0x564312b60850 2024-04-24T02:14:09.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.380+0000 7fd81773d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564312b60850 0x564312b60c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.380+0000 7fd81773d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564312b60850 0x564312b60c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43150/0 (socket says 172.21.15.134:43150) 2024-04-24T02:14:09.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.380+0000 7fd81773d640 1 -- 172.21.15.134:0/2780942601 learned_addr learned my addr 172.21.15.134:0/2780942601 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:09.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.380+0000 7fd81773d640 1 -- 172.21.15.134:0/2780942601 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564312b611b0 con 0x564312b60850 2024-04-24T02:14:09.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.380+0000 7fd81773d640 1 --2- 172.21.15.134:0/2780942601 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564312b60850 0x564312b60c70 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fd808055040 tx=0x7fd808002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.381+0000 7fd7057fa640 1 -- 172.21.15.134:0/2780942601 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd808057040 con 0x564312b60850 2024-04-24T02:14:09.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.381+0000 7fd7057fa640 1 -- 172.21.15.134:0/2780942601 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd80805d650 con 0x564312b60850 2024-04-24T02:14:09.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.381+0000 7fd7057fa640 1 -- 172.21.15.134:0/2780942601 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd80805d970 con 0x564312b60850 2024-04-24T02:14:09.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.381+0000 7fd82243f800 1 -- 172.21.15.134:0/2780942601 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564312b61c20 con 0x564312b60850 2024-04-24T02:14:09.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.381+0000 7fd82243f800 1 -- 172.21.15.134:0/2780942601 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564312b620c0 con 0x564312b60850 2024-04-24T02:14:09.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.381+0000 7fd7057fa640 1 -- 172.21.15.134:0/2780942601 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd808067070 con 0x564312b60850 2024-04-24T02:14:09.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.382+0000 7fd7057fa640 1 --2- 172.21.15.134:0/2780942601 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd6f8036900 0x7fd6f8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.382+0000 7fd7057fa640 1 -- 172.21.15.134:0/2780942601 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fd80808f630 con 0x564312b60850 2024-04-24T02:14:09.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.382+0000 7fd82073f640 1 --2- 172.21.15.134:0/2780942601 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd6f8036900 0x7fd6f8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.382+0000 7fd82243f800 1 Processor -- start 2024-04-24T02:14:09.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.382+0000 7fd82243f800 1 -- start start 2024-04-24T02:14:09.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.382+0000 7fd82073f640 1 --2- 172.21.15.134:0/2780942601 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd6f8036900 0x7fd6f8038dc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x564312b508c0 tx=0x7fd818005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.382+0000 7fd82243f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564312b6dad0 0x564312b6def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.382+0000 7fd82243f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5643129c12e0 con 0x564312b6dad0 2024-04-24T02:14:09.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.382+0000 7fd81773d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564312b6dad0 0x564312b6def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.382+0000 7fd81773d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564312b6dad0 0x564312b6def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43158/0 (socket says 172.21.15.134:43158) 2024-04-24T02:14:09.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.382+0000 7fd81773d640 1 -- 172.21.15.134:0/1552287490 learned_addr learned my addr 172.21.15.134:0/1552287490 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:09.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.383+0000 7fd81773d640 1 -- 172.21.15.134:0/1552287490 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564312b6e4c0 con 0x564312b6dad0 2024-04-24T02:14:09.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.383+0000 7fd81773d640 1 --2- 172.21.15.134:0/1552287490 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564312b6dad0 0x564312b6def0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fd80808db00 tx=0x7fd80805cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=136175c5f970b2c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.383+0000 7fd6feffd640 1 -- 172.21.15.134:0/1552287490 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd808080070 con 0x564312b6dad0 2024-04-24T02:14:09.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.383+0000 7fd6feffd640 1 -- 172.21.15.134:0/1552287490 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd808067360 con 0x564312b6dad0 2024-04-24T02:14:09.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.383+0000 7fd6feffd640 1 -- 172.21.15.134:0/1552287490 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd808070c60 con 0x564312b6dad0 2024-04-24T02:14:09.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.383+0000 7fd82243f800 1 -- 172.21.15.134:0/1552287490 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564312b6dad0 msgr2=0x564312b6def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.383+0000 7fd82243f800 1 --2- 172.21.15.134:0/1552287490 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564312b6dad0 0x564312b6def0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fd80808db00 tx=0x7fd80805cde0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.383+0000 7fd82243f800 1 -- 172.21.15.134:0/1552287490 shutdown_connections 2024-04-24T02:14:09.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.383+0000 7fd82243f800 1 --2- 172.21.15.134:0/1552287490 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564312b6dad0 0x564312b6def0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.383+0000 7fd82243f800 1 -- 172.21.15.134:0/1552287490 >> 172.21.15.134:0/1552287490 conn(0x564312b69df0 msgr2=0x564312b67e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:09.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.383+0000 7fd82243f800 1 -- 172.21.15.134:0/1552287490 shutdown_connections 2024-04-24T02:14:09.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.383+0000 7fd82243f800 1 -- 172.21.15.134:0/1552287490 wait complete. 2024-04-24T02:14:09.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.384+0000 7fd82243f800 1 Processor -- start 2024-04-24T02:14:09.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.384+0000 7fd82243f800 1 -- start start 2024-04-24T02:14:09.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.384+0000 7fd82243f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564312b6dad0 0x564312b750e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.384+0000 7fd82243f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x564312b6ec40 con 0x564312b6dad0 2024-04-24T02:14:09.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.384+0000 7fd81773d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564312b6dad0 0x564312b750e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.384+0000 7fd81773d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564312b6dad0 0x564312b750e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43170/0 (socket says 172.21.15.134:43170) 2024-04-24T02:14:09.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.384+0000 7fd81773d640 1 -- 172.21.15.134:0/1570953365 learned_addr learned my addr 172.21.15.134:0/1570953365 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:09.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.384+0000 7fd81773d640 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564312b75620 con 0x564312b6dad0 2024-04-24T02:14:09.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.384+0000 7fd81773d640 1 --2- 172.21.15.134:0/1570953365 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564312b6dad0 0x564312b750e0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fd808006540 tx=0x7fd80808da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.385+0000 7fd6fd7fa640 1 -- 172.21.15.134:0/1570953365 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd808080040 con 0x564312b6dad0 2024-04-24T02:14:09.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.385+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564312b758b0 con 0x564312b6dad0 2024-04-24T02:14:09.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.385+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564312b78560 con 0x564312b6dad0 2024-04-24T02:14:09.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.385+0000 7fd6fd7fa640 1 -- 172.21.15.134:0/1570953365 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8080678f0 con 0x564312b6dad0 2024-04-24T02:14:09.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.385+0000 7fd6fd7fa640 1 -- 172.21.15.134:0/1570953365 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd80808b040 con 0x564312b6dad0 2024-04-24T02:14:09.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.386+0000 7fd82243f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.386+0000 7fd6fd7fa640 1 -- 172.21.15.134:0/1570953365 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd808083070 con 0x564312b6dad0 2024-04-24T02:14:09.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.386+0000 7fd6fd7fa640 1 --2- 172.21.15.134:0/1570953365 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd6e80368b0 0x7fd6e8038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.386+0000 7fd6fd7fa640 1 -- 172.21.15.134:0/1570953365 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fd80809a0b0 con 0x564312b6dad0 2024-04-24T02:14:09.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.386+0000 7fd82073f640 1 --2- 172.21.15.134:0/1570953365 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd6e80368b0 0x7fd6e8038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.386+0000 7fd82243f800 1 --2- 172.21.15.134:0/1570953365 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x564312b80c20 0x564312b830c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.386+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564312b83810 con 0x564312b80c20 2024-04-24T02:14:09.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.386+0000 7fd81ff3e640 1 --2- 172.21.15.134:0/1570953365 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x564312b80c20 0x564312b830c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.386+0000 7fd82073f640 1 --2- 172.21.15.134:0/1570953365 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd6e80368b0 0x7fd6e8038d70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x564312b4c780 tx=0x7fd81801f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.387+0000 7fd81ff3e640 1 --2- 172.21.15.134:0/1570953365 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x564312b80c20 0x564312b830c0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.387+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd81002e070 con 0x564312b80c20 2024-04-24T02:14:09.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.387+0000 7fd82243f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:09.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.387+0000 7fd82243f800 20 realm 2024-04-24T02:14:09.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.387+0000 7fd82243f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.387+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564312b83c20 con 0x564312b80c20 2024-04-24T02:14:09.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.387+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd81002e070 con 0x564312b80c20 2024-04-24T02:14:09.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.387+0000 7fd82243f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:09.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.387+0000 7fd82243f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:14:09.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.387+0000 7fd82243f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.387+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564312b844f0 con 0x564312b80c20 2024-04-24T02:14:09.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.387+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd81002e070 con 0x564312b80c20 2024-04-24T02:14:09.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.387+0000 7fd82243f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:09.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.387+0000 7fd82243f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.387+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564312b84890 con 0x564312b80c20 2024-04-24T02:14:09.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.387+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd81002e070 con 0x564312b80c20 2024-04-24T02:14:09.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.387+0000 7fd82243f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:14:09.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.387+0000 7fd82243f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.387+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564312b84cf0 con 0x564312b80c20 2024-04-24T02:14:09.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.388+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd81002e070 con 0x564312b80c20 2024-04-24T02:14:09.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.388+0000 7fd82243f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:14:09.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.388+0000 7fd82243f800 20 searching for the correct realm 2024-04-24T02:14:09.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.388+0000 7fd82243f800 1 --2- 172.21.15.134:0/1570953365 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x564312b86d40 0x564312b89130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.388+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564312b897e0 con 0x564312b86d40 2024-04-24T02:14:09.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.388+0000 7fd81773d640 1 --2- 172.21.15.134:0/1570953365 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x564312b86d40 0x564312b89130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.388+0000 7fd81773d640 1 --2- 172.21.15.134:0/1570953365 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x564312b86d40 0x564312b89130 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.388+0000 7fd81773d640 1 -- 172.21.15.134:0/1570953365 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd808066030 con 0x564312b86d40 2024-04-24T02:14:09.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.388+0000 7fd81773d640 1 --2- 172.21.15.134:0/1570953365 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fd808068c20 0x7fd80807b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.388+0000 7fd81773d640 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564312b897e0 con 0x7fd808068c20 2024-04-24T02:14:09.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.389+0000 7fd82073f640 1 --2- 172.21.15.134:0/1570953365 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fd808068c20 0x7fd80807b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.389+0000 7fd82073f640 1 --2- 172.21.15.134:0/1570953365 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fd808068c20 0x7fd80807b8e0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.389+0000 7fd82073f640 1 -- 172.21.15.134:0/1570953365 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd81801f070 con 0x7fd808068c20 2024-04-24T02:14:09.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.389+0000 7fd82073f640 1 --2- 172.21.15.134:0/1570953365 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fd818031040 0x7fd818032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.389+0000 7fd82073f640 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564312b897e0 con 0x7fd818031040 2024-04-24T02:14:09.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.389+0000 7fd81ff3e640 1 --2- 172.21.15.134:0/1570953365 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fd818031040 0x7fd818032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.390+0000 7fd81ff3e640 1 --2- 172.21.15.134:0/1570953365 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fd818031040 0x7fd818032430 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.390+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd81002e070 con 0x7fd818031040 2024-04-24T02:14:09.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.390+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564312b897e0 con 0x564312b80c20 2024-04-24T02:14:09.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.390+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd81002e070 con 0x564312b80c20 2024-04-24T02:14:09.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.390+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564312b897e0 con 0x564312b80c20 2024-04-24T02:14:09.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.390+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd81002e070 con 0x564312b80c20 2024-04-24T02:14:09.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.390+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564312b897e0 con 0x7fd818031040 2024-04-24T02:14:09.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.391+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd81002e070 con 0x7fd818031040 2024-04-24T02:14:09.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.391+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564312b897e0 con 0x7fd808068c20 2024-04-24T02:14:09.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.391+0000 7fd82073f640 1 -- 172.21.15.134:0/1570953365 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd81801f070 con 0x7fd808068c20 2024-04-24T02:14:09.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.391+0000 7fd82073f640 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564312b897e0 con 0x7fd808068c20 2024-04-24T02:14:09.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.391+0000 7fd82073f640 1 -- 172.21.15.134:0/1570953365 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd81801f070 con 0x7fd808068c20 2024-04-24T02:14:09.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.391+0000 7fd82073f640 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564312b897e0 con 0x564312b86d40 2024-04-24T02:14:09.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.391+0000 7fd81773d640 1 -- 172.21.15.134:0/1570953365 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd808066030 con 0x564312b86d40 2024-04-24T02:14:09.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.391+0000 7fd81773d640 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564312b897e0 con 0x564312b80c20 2024-04-24T02:14:09.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.392+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd81002e070 con 0x564312b80c20 2024-04-24T02:14:09.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.392+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564312b897e0 con 0x7fd818031040 2024-04-24T02:14:09.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.392+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd81002e070 con 0x7fd818031040 2024-04-24T02:14:09.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.392+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564312b897e0 con 0x564312b80c20 2024-04-24T02:14:09.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.392+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd81002e070 con 0x564312b80c20 2024-04-24T02:14:09.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.392+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564312b897e0 con 0x7fd808068c20 2024-04-24T02:14:09.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.392+0000 7fd82073f640 1 -- 172.21.15.134:0/1570953365 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd81801f070 con 0x7fd808068c20 2024-04-24T02:14:09.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.392+0000 7fd82073f640 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564312b897e0 con 0x564312b86d40 2024-04-24T02:14:09.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.393+0000 7fd81773d640 1 -- 172.21.15.134:0/1570953365 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd808066030 con 0x564312b86d40 2024-04-24T02:14:09.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.393+0000 7fd81773d640 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564312b897e0 con 0x564312b86d40 2024-04-24T02:14:09.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.393+0000 7fd81773d640 1 -- 172.21.15.134:0/1570953365 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd808066030 con 0x564312b86d40 2024-04-24T02:14:09.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.393+0000 7fd81773d640 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564312b897e0 con 0x7fd808068c20 2024-04-24T02:14:09.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.393+0000 7fd82073f640 1 -- 172.21.15.134:0/1570953365 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd81801f070 con 0x7fd808068c20 2024-04-24T02:14:09.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.393+0000 7fd82073f640 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564312b897e0 con 0x564312b86d40 2024-04-24T02:14:09.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.393+0000 7fd81773d640 1 -- 172.21.15.134:0/1570953365 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd808066030 con 0x564312b86d40 2024-04-24T02:14:09.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.393+0000 7fd81773d640 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564312b897e0 con 0x564312b86d40 2024-04-24T02:14:09.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.394+0000 7fd81773d640 1 -- 172.21.15.134:0/1570953365 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd808066030 con 0x564312b86d40 2024-04-24T02:14:09.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.394+0000 7fd81773d640 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564312b897e0 con 0x564312b80c20 2024-04-24T02:14:09.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.394+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd81002e070 con 0x564312b80c20 2024-04-24T02:14:09.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.394+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564312b897e0 con 0x564312b80c20 2024-04-24T02:14:09.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.394+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fd81002e070 con 0x564312b80c20 2024-04-24T02:14:09.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.394+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564312b897e0 con 0x7fd818031040 2024-04-24T02:14:09.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.394+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd81002e070 con 0x7fd818031040 2024-04-24T02:14:09.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.394+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564312b897e0 con 0x564312b86d40 2024-04-24T02:14:09.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.395+0000 7fd81773d640 1 -- 172.21.15.134:0/1570953365 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd808066030 con 0x564312b86d40 2024-04-24T02:14:09.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.395+0000 7fd81773d640 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564312b897e0 con 0x7fd808068c20 2024-04-24T02:14:09.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.395+0000 7fd82073f640 1 -- 172.21.15.134:0/1570953365 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd81801f070 con 0x7fd808068c20 2024-04-24T02:14:09.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.395+0000 7fd82073f640 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564312b897e0 con 0x564312b80c20 2024-04-24T02:14:09.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.395+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd81002e070 con 0x564312b80c20 2024-04-24T02:14:09.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.395+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564312b897e0 con 0x7fd818031040 2024-04-24T02:14:09.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.395+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd81002e070 con 0x7fd818031040 2024-04-24T02:14:09.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.395+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564312b897e0 con 0x564312b86d40 2024-04-24T02:14:09.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.396+0000 7fd81773d640 1 -- 172.21.15.134:0/1570953365 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd808066030 con 0x564312b86d40 2024-04-24T02:14:09.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.396+0000 7fd81773d640 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564312b897e0 con 0x7fd818031040 2024-04-24T02:14:09.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.396+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd81002e070 con 0x7fd818031040 2024-04-24T02:14:09.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.396+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564312b897e0 con 0x7fd808068c20 2024-04-24T02:14:09.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.396+0000 7fd82073f640 1 -- 172.21.15.134:0/1570953365 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd818040040 con 0x7fd808068c20 2024-04-24T02:14:09.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.396+0000 7fd82073f640 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564312b897e0 con 0x564312b86d40 2024-04-24T02:14:09.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.396+0000 7fd81773d640 1 -- 172.21.15.134:0/1570953365 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd808066030 con 0x564312b86d40 2024-04-24T02:14:09.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.396+0000 7fd81773d640 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564312b897e0 con 0x7fd808068c20 2024-04-24T02:14:09.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.397+0000 7fd82073f640 1 -- 172.21.15.134:0/1570953365 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd818040040 con 0x7fd808068c20 2024-04-24T02:14:09.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.397+0000 7fd82073f640 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564312b897e0 con 0x564312b80c20 2024-04-24T02:14:09.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.397+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd81002e070 con 0x564312b80c20 2024-04-24T02:14:09.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.397+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564312b897e0 con 0x7fd808068c20 2024-04-24T02:14:09.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.397+0000 7fd82073f640 1 -- 172.21.15.134:0/1570953365 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd818040040 con 0x7fd808068c20 2024-04-24T02:14:09.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.397+0000 7fd82243f800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:14:09.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.397+0000 7fd82243f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:14:09.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.397+0000 7fd82243f800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:14:09.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.397+0000 7fd82243f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:14:09.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.397+0000 7fd82243f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:14:09.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.397+0000 7fd82243f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:14:09.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.397+0000 7fd82243f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.397+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564312b85790 con 0x564312b80c20 2024-04-24T02:14:09.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.397+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd81002e070 con 0x564312b80c20 2024-04-24T02:14:09.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.397+0000 7fd82243f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:09.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.397+0000 7fd82243f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.397+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564312b853d0 con 0x564312b80c20 2024-04-24T02:14:09.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.398+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd81002e070 con 0x564312b80c20 2024-04-24T02:14:09.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.398+0000 7fd82243f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:14:09.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.398+0000 7fd82243f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.398+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564312b860f0 con 0x564312b80c20 2024-04-24T02:14:09.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.398+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd81002e070 con 0x564312b80c20 2024-04-24T02:14:09.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.398+0000 7fd82243f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:14:09.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.398+0000 7fd82243f800 20 zone default found 2024-04-24T02:14:09.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.398+0000 7fd82243f800 4 Realm: () 2024-04-24T02:14:09.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.398+0000 7fd82243f800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:14:09.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.398+0000 7fd82243f800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:14:09.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.398+0000 7fd82243f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:14:09.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.398+0000 7fd82243f800 20 zonegroup default 2024-04-24T02:14:09.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.398+0000 7fd82243f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.398+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564312b89c40 con 0x7fd818031040 2024-04-24T02:14:09.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.398+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd81002e070 con 0x7fd818031040 2024-04-24T02:14:09.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.398+0000 7fd82243f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:09.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.398+0000 7fd82243f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.398+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564312b8bad0 con 0x564312b86d40 2024-04-24T02:14:09.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.398+0000 7fd81773d640 1 -- 172.21.15.134:0/1570953365 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd808066030 con 0x564312b86d40 2024-04-24T02:14:09.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.399+0000 7fd82243f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:09.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.399+0000 7fd82243f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.399+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564312b8be70 con 0x564312b86d40 2024-04-24T02:14:09.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.399+0000 7fd81773d640 1 -- 172.21.15.134:0/1570953365 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd808066030 con 0x564312b86d40 2024-04-24T02:14:09.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.399+0000 7fd82243f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:09.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.399+0000 7fd82243f800 20 started sync module instance, tier type = 2024-04-24T02:14:09.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.399+0000 7fd82243f800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:14:09.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.399+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564312b8af10 con 0x7fd808068c20 2024-04-24T02:14:09.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.400+0000 7fd82073f640 1 -- 172.21.15.134:0/1570953365 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(44 notify.0 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd818040040 con 0x7fd808068c20 2024-04-24T02:14:09.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.400+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94846076891952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564312b8c6c0 con 0x7fd808068c20 2024-04-24T02:14:09.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.400+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564312b8cf10 con 0x564312b80c20 2024-04-24T02:14:09.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.401+0000 7fd82073f640 1 -- 172.21.15.134:0/1570953365 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94846076891952] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd818040040 con 0x7fd808068c20 2024-04-24T02:14:09.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.401+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd81002e070 con 0x564312b80c20 2024-04-24T02:14:09.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.401+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94846076895760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564312b8cb20 con 0x564312b80c20 2024-04-24T02:14:09.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.401+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564312b8d610 con 0x564312b86d40 2024-04-24T02:14:09.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.402+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94846076895760] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd81002e070 con 0x564312b80c20 2024-04-24T02:14:09.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.403+0000 7fd81773d640 1 -- 172.21.15.134:0/1570953365 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd808066030 con 0x564312b86d40 2024-04-24T02:14:09.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.403+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94846076899552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564312b8da30 con 0x564312b86d40 2024-04-24T02:14:09.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.403+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564312b8e430 con 0x7fd808068c20 2024-04-24T02:14:09.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.404+0000 7fd82073f640 1 -- 172.21.15.134:0/1570953365 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(50 notify.3 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd818040040 con 0x7fd808068c20 2024-04-24T02:14:09.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.404+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94846076903232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564312b8ecd0 con 0x7fd808068c20 2024-04-24T02:14:09.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.404+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564312b8f7d0 con 0x564312b80c20 2024-04-24T02:14:09.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.404+0000 7fd81773d640 1 -- 172.21.15.134:0/1570953365 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94846076899552] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd808066030 con 0x564312b86d40 2024-04-24T02:14:09.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.405+0000 7fd82073f640 1 -- 172.21.15.134:0/1570953365 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94846076903232] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd818040040 con 0x7fd808068c20 2024-04-24T02:14:09.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.405+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd81002e070 con 0x564312b80c20 2024-04-24T02:14:09.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.405+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94846076908224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564312b8e820 con 0x564312b80c20 2024-04-24T02:14:09.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.405+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564312b90070 con 0x7fd818031040 2024-04-24T02:14:09.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.406+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94846076908224] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd81002e070 con 0x564312b80c20 2024-04-24T02:14:09.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.406+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(54 notify.5 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd81002e070 con 0x7fd818031040 2024-04-24T02:14:09.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.406+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94846076896816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564312b8e820 con 0x7fd818031040 2024-04-24T02:14:09.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.406+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564312b90680 con 0x7fd818031040 2024-04-24T02:14:09.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.408+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(56 notify.6 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd81002e070 con 0x7fd818031040 2024-04-24T02:14:09.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.408+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94846076911968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564312b90b30 con 0x7fd818031040 2024-04-24T02:14:09.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.408+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564312b91590 con 0x7fd818031040 2024-04-24T02:14:09.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.408+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94846076896816] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd81002e070 con 0x7fd818031040 2024-04-24T02:14:09.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.409+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(58 notify.7 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd81002e070 con 0x7fd818031040 2024-04-24T02:14:09.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.409+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94846076910192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564312b91550 con 0x7fd818031040 2024-04-24T02:14:09.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.409+0000 7fd82243f800 20 add_watcher() i=0 2024-04-24T02:14:09.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.409+0000 7fd82243f800 20 add_watcher() i=1 2024-04-24T02:14:09.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.409+0000 7fd82243f800 20 add_watcher() i=2 2024-04-24T02:14:09.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.409+0000 7fd82243f800 20 add_watcher() i=3 2024-04-24T02:14:09.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.409+0000 7fd82243f800 20 add_watcher() i=4 2024-04-24T02:14:09.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.409+0000 7fd82243f800 20 add_watcher() i=5 2024-04-24T02:14:09.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.409+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94846076911968] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd81002e070 con 0x7fd818031040 2024-04-24T02:14:09.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.409+0000 7fd82243f800 20 add_watcher() i=6 2024-04-24T02:14:09.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.410+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94846076910192] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd81002e070 con 0x7fd818031040 2024-04-24T02:14:09.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.410+0000 7fd82243f800 20 add_watcher() i=7 2024-04-24T02:14:09.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.410+0000 7fd82243f800 2 all 8 watchers are set, enabling cache 2024-04-24T02:14:09.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.410+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564312b90680 con 0x564312b80c20 2024-04-24T02:14:09.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.410+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd81002e070 con 0x564312b80c20 2024-04-24T02:14:09.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.410+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94846076913280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564312b91980 con 0x564312b80c20 2024-04-24T02:14:09.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.411+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94846076913280] v32'237 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd81002e070 con 0x564312b80c20 2024-04-24T02:14:09.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.411+0000 7fd6d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:14:09.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.411+0000 7fd82243f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:14:09.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.411+0000 7fd82243f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:14:09.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.411+0000 7fd82243f800 5 note: GC not initialized 2024-04-24T02:14:09.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.411+0000 7fd6d4fe1640 20 reqs_thread_entry: start 2024-04-24T02:14:09.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.411+0000 7fd82243f800 20 init_complete bucket index max shards: 11 2024-04-24T02:14:09.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.411+0000 7fd82243f800 20 Filter name: none 2024-04-24T02:14:09.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.411+0000 7fd64e7fc640 20 reqs_thread_entry: start 2024-04-24T02:14:09.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.412+0000 7fd82243f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.412+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564312bc7320 con 0x564312b80c20 2024-04-24T02:14:09.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.412+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fd81002e070 con 0x564312b80c20 2024-04-24T02:14:09.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.412+0000 7fd82243f800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T02:14:09.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.412+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564312bc8870 con 0x7fd818031040 2024-04-24T02:14:09.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.412+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv32 ondisk = 0) ==== 152+0+15 (crc 0 0 0) 0x7fd81002e070 con 0x7fd818031040 2024-04-24T02:14:09.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.413+0000 7fd6d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:14:09.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.413+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94846076913280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564312b91d50 con 0x564312b80c20 2024-04-24T02:14:09.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.414+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94846076913280] v32'238 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd81002e070 con 0x564312b80c20 2024-04-24T02:14:09.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.414+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94846076891952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564312b90680 con 0x7fd808068c20 2024-04-24T02:14:09.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.415+0000 7fd82073f640 1 -- 172.21.15.134:0/1570953365 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94846076891952] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd818040040 con 0x7fd808068c20 2024-04-24T02:14:09.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.415+0000 7fd82243f800 20 remove_watcher() i=0 2024-04-24T02:14:09.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.415+0000 7fd82243f800 2 removed watcher, disabling cache 2024-04-24T02:14:09.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.415+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94846076895760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564312b8b330 con 0x564312b80c20 2024-04-24T02:14:09.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.416+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94846076895760] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd81002e070 con 0x564312b80c20 2024-04-24T02:14:09.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.416+0000 7fd82243f800 20 remove_watcher() i=1 2024-04-24T02:14:09.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.416+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94846076899552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564312b8b330 con 0x564312b86d40 2024-04-24T02:14:09.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.417+0000 7fd81773d640 1 -- 172.21.15.134:0/1570953365 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94846076899552] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd808066030 con 0x564312b86d40 2024-04-24T02:14:09.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.417+0000 7fd82243f800 20 remove_watcher() i=2 2024-04-24T02:14:09.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.417+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94846076903232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564312b8d0e0 con 0x7fd808068c20 2024-04-24T02:14:09.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.418+0000 7fd82073f640 1 -- 172.21.15.134:0/1570953365 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94846076903232] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd818040040 con 0x7fd808068c20 2024-04-24T02:14:09.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.418+0000 7fd82243f800 20 remove_watcher() i=3 2024-04-24T02:14:09.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.418+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94846076908224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564312b8c210 con 0x564312b80c20 2024-04-24T02:14:09.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.420+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94846076908224] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd81002e070 con 0x564312b80c20 2024-04-24T02:14:09.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.420+0000 7fd82243f800 20 remove_watcher() i=4 2024-04-24T02:14:09.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.420+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94846076896816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564312b8c210 con 0x7fd818031040 2024-04-24T02:14:09.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.421+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94846076896816] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd81002e070 con 0x7fd818031040 2024-04-24T02:14:09.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.421+0000 7fd82243f800 20 remove_watcher() i=5 2024-04-24T02:14:09.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.421+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94846076911968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564312b8c210 con 0x7fd818031040 2024-04-24T02:14:09.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.422+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94846076911968] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd81002e070 con 0x7fd818031040 2024-04-24T02:14:09.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.422+0000 7fd82243f800 20 remove_watcher() i=6 2024-04-24T02:14:09.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.422+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94846076910192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564312b8c210 con 0x7fd818031040 2024-04-24T02:14:09.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.423+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94846076910192] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd81002e070 con 0x7fd818031040 2024-04-24T02:14:09.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.423+0000 7fd82243f800 20 remove_watcher() i=7 2024-04-24T02:14:09.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.423+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fd818031040 msgr2=0x7fd818032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.423+0000 7fd82243f800 1 --2- 172.21.15.134:0/1570953365 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fd818031040 0x7fd818032430 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.423+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x564312b80c20 msgr2=0x564312b830c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.423+0000 7fd82243f800 1 --2- 172.21.15.134:0/1570953365 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x564312b80c20 0x564312b830c0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.423+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fd808068c20 msgr2=0x7fd80807b8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.423+0000 7fd82243f800 1 --2- 172.21.15.134:0/1570953365 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fd808068c20 0x7fd80807b8e0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.423+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x564312b86d40 msgr2=0x564312b89130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.423+0000 7fd82243f800 1 --2- 172.21.15.134:0/1570953365 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x564312b86d40 0x564312b89130 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.423+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd6e80368b0 msgr2=0x7fd6e8038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.423+0000 7fd82243f800 1 --2- 172.21.15.134:0/1570953365 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd6e80368b0 0x7fd6e8038d70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x564312b4c780 tx=0x7fd81801f000 comp rx=0 tx=0).stop 2024-04-24T02:14:09.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.423+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564312b6dad0 msgr2=0x564312b750e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.423+0000 7fd81ff3e640 1 -- 172.21.15.134:0/1570953365 reap_dead start 2024-04-24T02:14:09.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.423+0000 7fd82243f800 1 --2- 172.21.15.134:0/1570953365 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564312b6dad0 0x564312b750e0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fd808006540 tx=0x7fd80808da60 comp rx=0 tx=0).stop 2024-04-24T02:14:09.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.423+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 shutdown_connections 2024-04-24T02:14:09.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.423+0000 7fd82243f800 1 --2- 172.21.15.134:0/1570953365 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564312b6dad0 0x564312b750e0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.423+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 >> 172.21.15.134:0/1570953365 conn(0x564312b69df0 msgr2=0x564312b67450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:09.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.423+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 shutdown_connections 2024-04-24T02:14:09.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.423+0000 7fd82243f800 1 -- 172.21.15.134:0/1570953365 wait complete. 2024-04-24T02:14:09.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.423+0000 7fd82243f800 1 -- 172.21.15.134:0/2780942601 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd6f8036900 msgr2=0x7fd6f8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.423+0000 7fd82243f800 1 --2- 172.21.15.134:0/2780942601 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd6f8036900 0x7fd6f8038dc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x564312b508c0 tx=0x7fd818005840 comp rx=0 tx=0).stop 2024-04-24T02:14:09.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.423+0000 7fd82243f800 1 -- 172.21.15.134:0/2780942601 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564312b60850 msgr2=0x564312b60c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.423+0000 7fd82243f800 1 --2- 172.21.15.134:0/2780942601 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564312b60850 0x564312b60c70 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fd808055040 tx=0x7fd808002fb0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.423+0000 7fd82243f800 1 -- 172.21.15.134:0/2780942601 shutdown_connections 2024-04-24T02:14:09.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.423+0000 7fd82243f800 1 --2- 172.21.15.134:0/2780942601 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd6f8036900 0x7fd6f8038dc0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.423+0000 7fd82243f800 1 --2- 172.21.15.134:0/2780942601 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564312b60850 0x564312b60c70 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.423+0000 7fd82243f800 1 -- 172.21.15.134:0/2780942601 >> 172.21.15.134:0/2780942601 conn(0x564312b548f0 msgr2=0x564312b54cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:09.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.423+0000 7fd82243f800 1 -- 172.21.15.134:0/2780942601 shutdown_connections 2024-04-24T02:14:09.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.423+0000 7fd82243f800 1 -- 172.21.15.134:0/2780942601 wait complete. 2024-04-24T02:14:09.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.424+0000 7fd82243f800 1 -- 172.21.15.134:0/3679722621 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x564312b4d250 msgr2=0x564312b4f640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.424+0000 7fd82243f800 1 --2- 172.21.15.134:0/3679722621 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x564312b4d250 0x564312b4f640 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.424+0000 7fd82243f800 1 -- 172.21.15.134:0/3679722621 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd708036900 msgr2=0x7fd708038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.424+0000 7fd82243f800 1 --2- 172.21.15.134:0/3679722621 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd708036900 0x7fd708038dc0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd808054000 tx=0x7fd80804e000 comp rx=0 tx=0).stop 2024-04-24T02:14:09.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.424+0000 7fd82243f800 1 -- 172.21.15.134:0/3679722621 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564312a51330 msgr2=0x564312b480c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.424+0000 7fd82243f800 1 --2- 172.21.15.134:0/3679722621 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564312a51330 0x564312b480c0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fd810000f60 tx=0x7fd810000bc0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.424+0000 7fd82243f800 1 -- 172.21.15.134:0/3679722621 shutdown_connections 2024-04-24T02:14:09.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.424+0000 7fd82243f800 1 --2- 172.21.15.134:0/3679722621 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x564312b4d250 0x564312b4f640 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.424+0000 7fd82243f800 1 --2- 172.21.15.134:0/3679722621 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd708036900 0x7fd708038dc0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.424+0000 7fd82243f800 1 --2- 172.21.15.134:0/3679722621 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564312a51330 0x564312b480c0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.424+0000 7fd82243f800 1 -- 172.21.15.134:0/3679722621 >> 172.21.15.134:0/3679722621 conn(0x564312a48530 msgr2=0x5643129c1840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:09.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.424+0000 7fd82243f800 1 -- 172.21.15.134:0/3679722621 shutdown_connections 2024-04-24T02:14:09.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.424+0000 7fd82243f800 1 -- 172.21.15.134:0/3679722621 wait complete. 2024-04-24T02:14:09.448 INFO:teuthology.orchestra.run.smithi134.stdout:{"entries":[],"summary":[]} 2024-04-24T02:14:09.448 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-04-24T02:14:09.448 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-04-24T02:14:09.448 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-04-24T02:14:09.448 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-04-24T02:14:09.532 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:14:09.532 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:14:09.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.532+0000 7ff94012d800 1 Processor -- start 2024-04-24T02:14:09.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.532+0000 7ff94012d800 1 -- start start 2024-04-24T02:14:09.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.532+0000 7ff94012d800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x562e2570a990 0x562e2570cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.532+0000 7ff94012d800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562e255c8d40 con 0x562e2570d2c0 2024-04-24T02:14:09.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.532+0000 7ff94012d800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x562e2559b4d0 con 0x562e2570a990 2024-04-24T02:14:09.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.532+0000 7ff93bd78640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x562e2570a990 0x562e2570cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.532+0000 7ff93bd78640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x562e2570a990 0x562e2570cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43178/0 (socket says 172.21.15.134:43178) 2024-04-24T02:14:09.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.532+0000 7ff93bd78640 1 -- 172.21.15.134:0/452015235 learned_addr learned my addr 172.21.15.134:0/452015235 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:09.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.532+0000 7ff933577640 1 --1- 172.21.15.134:0/452015235 >> v1:172.21.15.104:6789/0 conn(0x562e2570d2c0 0x562e2570f6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:46356/0 (socket says 172.21.15.134:46356) 2024-04-24T02:14:09.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.533+0000 7ff93bd78640 1 -- 172.21.15.134:0/452015235 >> v1:172.21.15.104:6789/0 conn(0x562e2570d2c0 legacy=0x562e2570f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.533+0000 7ff93bd78640 1 -- 172.21.15.134:0/452015235 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e255c7590 con 0x562e2570a990 2024-04-24T02:14:09.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.533+0000 7ff93b577640 1 -- 172.21.15.134:0/452015235 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1742173122 0 0) 0x562e255c8d40 con 0x562e2570d2c0 2024-04-24T02:14:09.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.534+0000 7ff93bd78640 1 --2- 172.21.15.134:0/452015235 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e2570a990 0x562e2570cd80 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7ff92c00a520 tx=0x7ff92c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed9541040d6d9cfe server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.534+0000 7ff93b577640 1 -- 172.21.15.134:0/452015235 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff92c057070 con 0x562e2570a990 2024-04-24T02:14:09.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.535+0000 7ff93b577640 1 -- 172.21.15.134:0/452015235 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff92c052570 con 0x562e2570a990 2024-04-24T02:14:09.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.535+0000 7ff93b577640 1 -- 172.21.15.134:0/452015235 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff92c04ae60 con 0x562e2570a990 2024-04-24T02:14:09.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.535+0000 7ff94012d800 1 -- 172.21.15.134:0/452015235 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e2570a990 msgr2=0x562e2570cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.535+0000 7ff94012d800 1 --2- 172.21.15.134:0/452015235 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e2570a990 0x562e2570cd80 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7ff92c00a520 tx=0x7ff92c01d010 comp rx=0 tx=0).stop 2024-04-24T02:14:09.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.535+0000 7ff94012d800 1 -- 172.21.15.134:0/452015235 shutdown_connections 2024-04-24T02:14:09.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.535+0000 7ff94012d800 1 --2- 172.21.15.134:0/452015235 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e2570a990 0x562e2570cd80 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.535+0000 7ff94012d800 1 -- 172.21.15.134:0/452015235 >> 172.21.15.134:0/452015235 conn(0x562e25704340 msgr2=0x562e25706760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:09.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.535+0000 7ff94012d800 1 -- 172.21.15.134:0/452015235 shutdown_connections 2024-04-24T02:14:09.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.535+0000 7ff94012d800 1 -- 172.21.15.134:0/452015235 wait complete. 2024-04-24T02:14:09.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.547+0000 7ff94012d800 1 Processor -- start 2024-04-24T02:14:09.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.547+0000 7ff94012d800 1 -- start start 2024-04-24T02:14:09.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.547+0000 7ff94012d800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e2570a990 0x562e257fae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.547+0000 7ff94012d800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x562e256553b0 con 0x562e2570a990 2024-04-24T02:14:09.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.547+0000 7ff93bd78640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e2570a990 0x562e257fae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.547+0000 7ff93bd78640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e2570a990 0x562e257fae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43180/0 (socket says 172.21.15.134:43180) 2024-04-24T02:14:09.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.547+0000 7ff93bd78640 1 -- 172.21.15.134:0/3796811261 learned_addr learned my addr 172.21.15.134:0/3796811261 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:09.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.547+0000 7ff93bd78640 1 -- 172.21.15.134:0/3796811261 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e257fb460 con 0x562e2570a990 2024-04-24T02:14:09.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.548+0000 7ff93bd78640 1 --2- 172.21.15.134:0/3796811261 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e2570a990 0x562e257fae90 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7ff92c055040 tx=0x7ff92c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a3b45b729d0d32b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.548+0000 7ff829e0b640 1 -- 172.21.15.134:0/3796811261 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff92c062070 con 0x562e2570a990 2024-04-24T02:14:09.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.548+0000 7ff829e0b640 1 -- 172.21.15.134:0/3796811261 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff92c052720 con 0x562e2570a990 2024-04-24T02:14:09.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.548+0000 7ff829e0b640 1 -- 172.21.15.134:0/3796811261 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff92c057040 con 0x562e2570a990 2024-04-24T02:14:09.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.548+0000 7ff94012d800 1 -- 172.21.15.134:0/3796811261 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e2570a990 msgr2=0x562e257fae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.548+0000 7ff94012d800 1 --2- 172.21.15.134:0/3796811261 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e2570a990 0x562e257fae90 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7ff92c055040 tx=0x7ff92c04c000 comp rx=0 tx=0).stop 2024-04-24T02:14:09.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.548+0000 7ff94012d800 1 -- 172.21.15.134:0/3796811261 shutdown_connections 2024-04-24T02:14:09.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.548+0000 7ff94012d800 1 --2- 172.21.15.134:0/3796811261 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e2570a990 0x562e257fae90 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.548+0000 7ff94012d800 1 -- 172.21.15.134:0/3796811261 >> 172.21.15.134:0/3796811261 conn(0x562e25704340 msgr2=0x562e257f67b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:09.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.548+0000 7ff94012d800 1 -- 172.21.15.134:0/3796811261 shutdown_connections 2024-04-24T02:14:09.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.548+0000 7ff94012d800 1 -- 172.21.15.134:0/3796811261 wait complete. 2024-04-24T02:14:09.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.549+0000 7ff94012d800 1 Processor -- start 2024-04-24T02:14:09.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.549+0000 7ff94012d800 1 -- start start 2024-04-24T02:14:09.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.549+0000 7ff94012d800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e2570a990 0x562e258028d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.549+0000 7ff94012d800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x562e257130e0 con 0x562e2570a990 2024-04-24T02:14:09.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.549+0000 7ff93bd78640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e2570a990 0x562e258028d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.549+0000 7ff93bd78640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e2570a990 0x562e258028d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43182/0 (socket says 172.21.15.134:43182) 2024-04-24T02:14:09.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.549+0000 7ff93bd78640 1 -- 172.21.15.134:0/3490911137 learned_addr learned my addr 172.21.15.134:0/3490911137 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:09.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.549+0000 7ff93bd78640 1 -- 172.21.15.134:0/3490911137 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e25802e10 con 0x562e2570a990 2024-04-24T02:14:09.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.550+0000 7ff93bd78640 1 --2- 172.21.15.134:0/3490911137 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e2570a990 0x562e258028d0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7ff92c005400 tx=0x7ff92c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.550+0000 7ff823fff640 1 -- 172.21.15.134:0/3490911137 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff92c057050 con 0x562e2570a990 2024-04-24T02:14:09.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.550+0000 7ff823fff640 1 -- 172.21.15.134:0/3490911137 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff92c067580 con 0x562e2570a990 2024-04-24T02:14:09.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.550+0000 7ff94012d800 1 -- 172.21.15.134:0/3490911137 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e258030a0 con 0x562e2570a990 2024-04-24T02:14:09.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.550+0000 7ff823fff640 1 -- 172.21.15.134:0/3490911137 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff92c062040 con 0x562e2570a990 2024-04-24T02:14:09.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.550+0000 7ff94012d800 1 -- 172.21.15.134:0/3490911137 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e25805cb0 con 0x562e2570a990 2024-04-24T02:14:09.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.551+0000 7ff823fff640 1 -- 172.21.15.134:0/3490911137 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff92c067860 con 0x562e2570a990 2024-04-24T02:14:09.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.551+0000 7ff823fff640 1 --2- 172.21.15.134:0/3490911137 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7ff824036900 0x7ff824038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.551+0000 7ff823fff640 1 -- 172.21.15.134:0/3490911137 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7ff92c08df50 con 0x562e2570a990 2024-04-24T02:14:09.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.551+0000 7ff933577640 1 --2- 172.21.15.134:0/3490911137 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7ff824036900 0x7ff824038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.551+0000 7ff94012d800 1 --2- 172.21.15.134:0/3490911137 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x562e2570d2c0 0x562e25809a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.551+0000 7ff94012d800 1 -- 172.21.15.134:0/3490911137 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2580a040 con 0x562e2570d2c0 2024-04-24T02:14:09.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.551+0000 7ff93c579640 1 --2- 172.21.15.134:0/3490911137 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x562e2570d2c0 0x562e25809a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.551+0000 7ff933577640 1 --2- 172.21.15.134:0/3490911137 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7ff824036900 0x7ff824038dc0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff924000c00 tx=0x7ff9240013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.551+0000 7ff93c579640 1 --2- 172.21.15.134:0/3490911137 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x562e2570d2c0 0x562e25809a70 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.552+0000 7ff93c579640 1 -- 172.21.15.134:0/3490911137 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff93400a4a0 con 0x562e2570d2c0 2024-04-24T02:14:09.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.552+0000 7ff94012d800 1 -- 172.21.15.134:0/3490911137 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e25807000 con 0x562e2570d2c0 2024-04-24T02:14:09.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.552+0000 7ff93c579640 1 -- 172.21.15.134:0/3490911137 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff93400a4a0 con 0x562e2570d2c0 2024-04-24T02:14:09.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.552+0000 7ff94012d800 1 -- 172.21.15.134:0/3490911137 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2580beb0 con 0x562e2570d2c0 2024-04-24T02:14:09.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.552+0000 7ff93c579640 1 -- 172.21.15.134:0/3490911137 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff93400a4a0 con 0x562e2570d2c0 2024-04-24T02:14:09.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.552+0000 7ff94012d800 1 -- 172.21.15.134:0/3490911137 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2580b0e0 con 0x562e2570d2c0 2024-04-24T02:14:09.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.552+0000 7ff93c579640 1 -- 172.21.15.134:0/3490911137 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff93400a4a0 con 0x562e2570d2c0 2024-04-24T02:14:09.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.552+0000 7ff94012d800 1 -- 172.21.15.134:0/3490911137 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2580b500 con 0x562e2570d2c0 2024-04-24T02:14:09.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.553+0000 7ff93c579640 1 -- 172.21.15.134:0/3490911137 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff93400a4a0 con 0x562e2570d2c0 2024-04-24T02:14:09.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.553+0000 7ff94012d800 1 Processor -- start 2024-04-24T02:14:09.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.553+0000 7ff94012d800 1 -- start start 2024-04-24T02:14:09.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.553+0000 7ff94012d800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e2581ad10 0x562e2581b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.553+0000 7ff94012d800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x562e255fb6b0 con 0x562e2581ad10 2024-04-24T02:14:09.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.553+0000 7ff933577640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e2581ad10 0x562e2581b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.554+0000 7ff933577640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e2581ad10 0x562e2581b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43190/0 (socket says 172.21.15.134:43190) 2024-04-24T02:14:09.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.554+0000 7ff933577640 1 -- 172.21.15.134:0/2491722732 learned_addr learned my addr 172.21.15.134:0/2491722732 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:09.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.554+0000 7ff933577640 1 -- 172.21.15.134:0/2491722732 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e2581b670 con 0x562e2581ad10 2024-04-24T02:14:09.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.554+0000 7ff933577640 1 --2- 172.21.15.134:0/2491722732 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e2581ad10 0x562e2581b130 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ff92400e610 tx=0x7ff92400ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.554+0000 7ff8217fa640 1 -- 172.21.15.134:0/2491722732 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff924022070 con 0x562e2581ad10 2024-04-24T02:14:09.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.554+0000 7ff8217fa640 1 -- 172.21.15.134:0/2491722732 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff924009050 con 0x562e2581ad10 2024-04-24T02:14:09.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.554+0000 7ff94012d800 1 -- 172.21.15.134:0/2491722732 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e2581bfa0 con 0x562e2581ad10 2024-04-24T02:14:09.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.554+0000 7ff8217fa640 1 -- 172.21.15.134:0/2491722732 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff92400d500 con 0x562e2581ad10 2024-04-24T02:14:09.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.554+0000 7ff94012d800 1 -- 172.21.15.134:0/2491722732 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e2581c4a0 con 0x562e2581ad10 2024-04-24T02:14:09.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.555+0000 7ff8217fa640 1 -- 172.21.15.134:0/2491722732 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff924025070 con 0x562e2581ad10 2024-04-24T02:14:09.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.555+0000 7ff8217fa640 1 --2- 172.21.15.134:0/2491722732 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7ff814036900 0x7ff814038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.555+0000 7ff8217fa640 1 -- 172.21.15.134:0/2491722732 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7ff92404db30 con 0x562e2581ad10 2024-04-24T02:14:09.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.555+0000 7ff93c579640 1 --2- 172.21.15.134:0/2491722732 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7ff814036900 0x7ff814038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.555+0000 7ff94012d800 1 Processor -- start 2024-04-24T02:14:09.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.556+0000 7ff93c579640 1 --2- 172.21.15.134:0/2491722732 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7ff814036900 0x7ff814038dc0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x562e2580b480 tx=0x7ff934005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.556+0000 7ff94012d800 1 -- start start 2024-04-24T02:14:09.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.556+0000 7ff94012d800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e25828010 0x562e25828430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.556+0000 7ff94012d800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x562e257fb720 con 0x562e25828010 2024-04-24T02:14:09.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.556+0000 7ff933577640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e25828010 0x562e25828430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.556+0000 7ff933577640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e25828010 0x562e25828430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43192/0 (socket says 172.21.15.134:43192) 2024-04-24T02:14:09.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.556+0000 7ff933577640 1 -- 172.21.15.134:0/3101634639 learned_addr learned my addr 172.21.15.134:0/3101634639 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:09.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.556+0000 7ff933577640 1 -- 172.21.15.134:0/3101634639 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e25828a00 con 0x562e25828010 2024-04-24T02:14:09.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.556+0000 7ff933577640 1 --2- 172.21.15.134:0/3101634639 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e25828010 0x562e25828430 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ff92404bf40 tx=0x7ff9240243f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce85d74cafdfc5f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.556+0000 7ff81affd640 1 -- 172.21.15.134:0/3101634639 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff92404a030 con 0x562e25828010 2024-04-24T02:14:09.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.556+0000 7ff81affd640 1 -- 172.21.15.134:0/3101634639 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff924025e30 con 0x562e25828010 2024-04-24T02:14:09.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.556+0000 7ff81affd640 1 -- 172.21.15.134:0/3101634639 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff92401ad50 con 0x562e25828010 2024-04-24T02:14:09.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.557+0000 7ff94012d800 1 -- 172.21.15.134:0/3101634639 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e25828010 msgr2=0x562e25828430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.557+0000 7ff94012d800 1 --2- 172.21.15.134:0/3101634639 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e25828010 0x562e25828430 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ff92404bf40 tx=0x7ff9240243f0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.557+0000 7ff94012d800 1 -- 172.21.15.134:0/3101634639 shutdown_connections 2024-04-24T02:14:09.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.557+0000 7ff94012d800 1 --2- 172.21.15.134:0/3101634639 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e25828010 0x562e25828430 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.557+0000 7ff94012d800 1 -- 172.21.15.134:0/3101634639 >> 172.21.15.134:0/3101634639 conn(0x562e25824370 msgr2=0x562e258223d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:09.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.557+0000 7ff94012d800 1 -- 172.21.15.134:0/3101634639 shutdown_connections 2024-04-24T02:14:09.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.557+0000 7ff94012d800 1 -- 172.21.15.134:0/3101634639 wait complete. 2024-04-24T02:14:09.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.557+0000 7ff94012d800 1 Processor -- start 2024-04-24T02:14:09.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.557+0000 7ff94012d800 1 -- start start 2024-04-24T02:14:09.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.557+0000 7ff94012d800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e25828010 0x562e2582f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.557+0000 7ff94012d800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x562e25829170 con 0x562e25828010 2024-04-24T02:14:09.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.558+0000 7ff933577640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e25828010 0x562e2582f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.558+0000 7ff933577640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e25828010 0x562e2582f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43202/0 (socket says 172.21.15.134:43202) 2024-04-24T02:14:09.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.558+0000 7ff933577640 1 -- 172.21.15.134:0/3052029598 learned_addr learned my addr 172.21.15.134:0/3052029598 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:09.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.558+0000 7ff933577640 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e2582fc10 con 0x562e25828010 2024-04-24T02:14:09.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.558+0000 7ff933577640 1 --2- 172.21.15.134:0/3052029598 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e25828010 0x562e2582f6d0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7ff9240266c0 tx=0x7ff92404bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.558+0000 7ff8197fa640 1 -- 172.21.15.134:0/3052029598 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff924045040 con 0x562e25828010 2024-04-24T02:14:09.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.558+0000 7ff8197fa640 1 -- 172.21.15.134:0/3052029598 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff92400d6a0 con 0x562e25828010 2024-04-24T02:14:09.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.558+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e2582fea0 con 0x562e25828010 2024-04-24T02:14:09.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.558+0000 7ff8197fa640 1 -- 172.21.15.134:0/3052029598 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff92400d980 con 0x562e25828010 2024-04-24T02:14:09.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.558+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e25832b50 con 0x562e25828010 2024-04-24T02:14:09.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.559+0000 7ff8197fa640 1 -- 172.21.15.134:0/3052029598 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff92404d3c0 con 0x562e25828010 2024-04-24T02:14:09.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.559+0000 7ff8197fa640 1 --2- 172.21.15.134:0/3052029598 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7ff804036900 0x7ff804038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.559+0000 7ff8197fa640 1 -- 172.21.15.134:0/3052029598 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7ff92404de00 con 0x562e25828010 2024-04-24T02:14:09.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.559+0000 7ff93c579640 1 --2- 172.21.15.134:0/3052029598 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7ff804036900 0x7ff804038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.560+0000 7ff94012d800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.560+0000 7ff94012d800 1 --2- 172.21.15.134:0/3052029598 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x562e2583b1e0 0x562e2583d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.560+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2583ddf0 con 0x562e2583b1e0 2024-04-24T02:14:09.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.560+0000 7ff93c579640 1 --2- 172.21.15.134:0/3052029598 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7ff804036900 0x7ff804038dc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x562e2580ac00 tx=0x7ff93401f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.560+0000 7ff93bd78640 1 --2- 172.21.15.134:0/3052029598 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x562e2583b1e0 0x562e2583d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.560+0000 7ff93bd78640 1 --2- 172.21.15.134:0/3052029598 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x562e2583b1e0 0x562e2583d6a0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.560+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff92c076070 con 0x562e2583b1e0 2024-04-24T02:14:09.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.560+0000 7ff94012d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:09.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.560+0000 7ff94012d800 20 realm 2024-04-24T02:14:09.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.560+0000 7ff94012d800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.560+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2583e200 con 0x562e2583b1e0 2024-04-24T02:14:09.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.561+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff92c076070 con 0x562e2583b1e0 2024-04-24T02:14:09.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.561+0000 7ff94012d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:09.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.561+0000 7ff94012d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:14:09.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.561+0000 7ff94012d800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.561+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2583ead0 con 0x562e2583b1e0 2024-04-24T02:14:09.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.561+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff92c076070 con 0x562e2583b1e0 2024-04-24T02:14:09.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.561+0000 7ff94012d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:09.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.561+0000 7ff94012d800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.561+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2583ee70 con 0x562e2583b1e0 2024-04-24T02:14:09.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.561+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff92c076070 con 0x562e2583b1e0 2024-04-24T02:14:09.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.561+0000 7ff94012d800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:14:09.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.561+0000 7ff94012d800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.561+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2583f6c0 con 0x562e2583b1e0 2024-04-24T02:14:09.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.561+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff92c076070 con 0x562e2583b1e0 2024-04-24T02:14:09.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.561+0000 7ff94012d800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:14:09.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.561+0000 7ff94012d800 20 searching for the correct realm 2024-04-24T02:14:09.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.561+0000 7ff94012d800 1 --2- 172.21.15.134:0/3052029598 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x562e25841430 0x562e25843820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.561+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e25843e50 con 0x562e25841430 2024-04-24T02:14:09.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.561+0000 7ff933577640 1 --2- 172.21.15.134:0/3052029598 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x562e25841430 0x562e25843820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.562+0000 7ff933577640 1 --2- 172.21.15.134:0/3052029598 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x562e25841430 0x562e25843820 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.562+0000 7ff933577640 1 -- 172.21.15.134:0/3052029598 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff924024030 con 0x562e25841430 2024-04-24T02:14:09.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.562+0000 7ff933577640 1 --2- 172.21.15.134:0/3052029598 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7ff924036070 0x7ff92403a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.562+0000 7ff933577640 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e25843e50 con 0x7ff924036070 2024-04-24T02:14:09.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.562+0000 7ff93c579640 1 --2- 172.21.15.134:0/3052029598 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7ff924036070 0x7ff92403a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.562+0000 7ff93c579640 1 --2- 172.21.15.134:0/3052029598 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7ff924036070 0x7ff92403a1c0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.563+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff93401f070 con 0x7ff924036070 2024-04-24T02:14:09.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.563+0000 7ff93c579640 1 --2- 172.21.15.134:0/3052029598 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7ff934031040 0x7ff934032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.563+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e25843e50 con 0x7ff934031040 2024-04-24T02:14:09.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.563+0000 7ff93bd78640 1 --2- 172.21.15.134:0/3052029598 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7ff934031040 0x7ff934032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.563+0000 7ff93bd78640 1 --2- 172.21.15.134:0/3052029598 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7ff934031040 0x7ff934032430 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.564+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff92c076070 con 0x7ff934031040 2024-04-24T02:14:09.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.564+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e25843e50 con 0x562e2583b1e0 2024-04-24T02:14:09.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.564+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff92c076070 con 0x562e2583b1e0 2024-04-24T02:14:09.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.564+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e25843e50 con 0x562e2583b1e0 2024-04-24T02:14:09.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.564+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff92c076070 con 0x562e2583b1e0 2024-04-24T02:14:09.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.564+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e25843e50 con 0x7ff934031040 2024-04-24T02:14:09.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.564+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff92c076070 con 0x7ff934031040 2024-04-24T02:14:09.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.564+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e25843e50 con 0x7ff924036070 2024-04-24T02:14:09.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.565+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff93401f070 con 0x7ff924036070 2024-04-24T02:14:09.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.565+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e25843e50 con 0x7ff924036070 2024-04-24T02:14:09.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.565+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff93401f070 con 0x7ff924036070 2024-04-24T02:14:09.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.565+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e25843e50 con 0x562e25841430 2024-04-24T02:14:09.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.565+0000 7ff933577640 1 -- 172.21.15.134:0/3052029598 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff924024030 con 0x562e25841430 2024-04-24T02:14:09.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.565+0000 7ff933577640 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e25843e50 con 0x562e2583b1e0 2024-04-24T02:14:09.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.565+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff92c076070 con 0x562e2583b1e0 2024-04-24T02:14:09.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.565+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e25843e50 con 0x7ff934031040 2024-04-24T02:14:09.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.566+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff92c076070 con 0x7ff934031040 2024-04-24T02:14:09.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.566+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e25843e50 con 0x562e2583b1e0 2024-04-24T02:14:09.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.566+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff92c076070 con 0x562e2583b1e0 2024-04-24T02:14:09.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.566+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e25843e50 con 0x7ff924036070 2024-04-24T02:14:09.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.566+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff93401f070 con 0x7ff924036070 2024-04-24T02:14:09.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.566+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e25843e50 con 0x562e25841430 2024-04-24T02:14:09.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.566+0000 7ff933577640 1 -- 172.21.15.134:0/3052029598 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff924024030 con 0x562e25841430 2024-04-24T02:14:09.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.566+0000 7ff933577640 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e25843e50 con 0x562e25841430 2024-04-24T02:14:09.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.566+0000 7ff933577640 1 -- 172.21.15.134:0/3052029598 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff924024030 con 0x562e25841430 2024-04-24T02:14:09.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.566+0000 7ff933577640 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e25843e50 con 0x7ff924036070 2024-04-24T02:14:09.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.567+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff93401f070 con 0x7ff924036070 2024-04-24T02:14:09.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.567+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e25843e50 con 0x562e25841430 2024-04-24T02:14:09.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.567+0000 7ff933577640 1 -- 172.21.15.134:0/3052029598 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff924024030 con 0x562e25841430 2024-04-24T02:14:09.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.567+0000 7ff933577640 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e25843e50 con 0x562e25841430 2024-04-24T02:14:09.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.567+0000 7ff933577640 1 -- 172.21.15.134:0/3052029598 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff924024030 con 0x562e25841430 2024-04-24T02:14:09.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.567+0000 7ff933577640 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e25843e50 con 0x562e2583b1e0 2024-04-24T02:14:09.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.567+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff92c076070 con 0x562e2583b1e0 2024-04-24T02:14:09.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.567+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e25843e50 con 0x562e2583b1e0 2024-04-24T02:14:09.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.567+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7ff92c076070 con 0x562e2583b1e0 2024-04-24T02:14:09.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.568+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e25843e50 con 0x7ff934031040 2024-04-24T02:14:09.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.568+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff92c076070 con 0x7ff934031040 2024-04-24T02:14:09.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.568+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e25843e50 con 0x562e25841430 2024-04-24T02:14:09.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.568+0000 7ff933577640 1 -- 172.21.15.134:0/3052029598 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff924024030 con 0x562e25841430 2024-04-24T02:14:09.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.568+0000 7ff933577640 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e25843e50 con 0x7ff924036070 2024-04-24T02:14:09.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.569+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff93401f070 con 0x7ff924036070 2024-04-24T02:14:09.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.569+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e25843e50 con 0x562e2583b1e0 2024-04-24T02:14:09.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.569+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff92c076070 con 0x562e2583b1e0 2024-04-24T02:14:09.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.569+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e25843e50 con 0x7ff934031040 2024-04-24T02:14:09.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.569+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff92c076070 con 0x7ff934031040 2024-04-24T02:14:09.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.569+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e25843e50 con 0x562e25841430 2024-04-24T02:14:09.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.569+0000 7ff933577640 1 -- 172.21.15.134:0/3052029598 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff924067040 con 0x562e25841430 2024-04-24T02:14:09.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.569+0000 7ff933577640 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e25843e50 con 0x7ff934031040 2024-04-24T02:14:09.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.570+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff92c076070 con 0x7ff934031040 2024-04-24T02:14:09.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.570+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e25843e50 con 0x7ff924036070 2024-04-24T02:14:09.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.570+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff934040040 con 0x7ff924036070 2024-04-24T02:14:09.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.570+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e25843e50 con 0x562e25841430 2024-04-24T02:14:09.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.570+0000 7ff933577640 1 -- 172.21.15.134:0/3052029598 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff924067040 con 0x562e25841430 2024-04-24T02:14:09.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.570+0000 7ff933577640 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e25843e50 con 0x7ff924036070 2024-04-24T02:14:09.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.570+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff934040040 con 0x7ff924036070 2024-04-24T02:14:09.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.570+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e25843e50 con 0x562e2583b1e0 2024-04-24T02:14:09.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.570+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff92c076070 con 0x562e2583b1e0 2024-04-24T02:14:09.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.571+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e25843e50 con 0x7ff924036070 2024-04-24T02:14:09.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.571+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff934040040 con 0x7ff924036070 2024-04-24T02:14:09.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.571+0000 7ff94012d800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:14:09.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.571+0000 7ff94012d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:14:09.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.571+0000 7ff94012d800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:14:09.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.571+0000 7ff94012d800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:14:09.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.571+0000 7ff94012d800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:14:09.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.571+0000 7ff94012d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:14:09.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.571+0000 7ff94012d800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.571+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e25840010 con 0x562e2583b1e0 2024-04-24T02:14:09.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.571+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff92c076070 con 0x562e2583b1e0 2024-04-24T02:14:09.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.571+0000 7ff94012d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:09.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.571+0000 7ff94012d800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.571+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e258408b0 con 0x562e2583b1e0 2024-04-24T02:14:09.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.571+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff92c076070 con 0x562e2583b1e0 2024-04-24T02:14:09.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.571+0000 7ff94012d800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:14:09.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.571+0000 7ff94012d800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.571+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e258408b0 con 0x562e2583b1e0 2024-04-24T02:14:09.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.572+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff92c076070 con 0x562e2583b1e0 2024-04-24T02:14:09.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.572+0000 7ff94012d800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:14:09.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.572+0000 7ff94012d800 20 zone default found 2024-04-24T02:14:09.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.572+0000 7ff94012d800 4 Realm: () 2024-04-24T02:14:09.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.572+0000 7ff94012d800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:14:09.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.572+0000 7ff94012d800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:14:09.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.572+0000 7ff94012d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:14:09.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.572+0000 7ff94012d800 20 zonegroup default 2024-04-24T02:14:09.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.572+0000 7ff94012d800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.572+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e258442d0 con 0x7ff934031040 2024-04-24T02:14:09.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.572+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff92c076070 con 0x7ff934031040 2024-04-24T02:14:09.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.572+0000 7ff94012d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:09.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.572+0000 7ff94012d800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.572+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e25845ce0 con 0x562e25841430 2024-04-24T02:14:09.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.572+0000 7ff933577640 1 -- 172.21.15.134:0/3052029598 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff924067040 con 0x562e25841430 2024-04-24T02:14:09.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.572+0000 7ff94012d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:09.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.572+0000 7ff94012d800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.572+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e258461d0 con 0x562e25841430 2024-04-24T02:14:09.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.573+0000 7ff933577640 1 -- 172.21.15.134:0/3052029598 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff924067040 con 0x562e25841430 2024-04-24T02:14:09.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.573+0000 7ff94012d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:09.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.573+0000 7ff94012d800 20 started sync module instance, tier type = 2024-04-24T02:14:09.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.573+0000 7ff94012d800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:14:09.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.573+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e25845150 con 0x7ff924036070 2024-04-24T02:14:09.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.574+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(44 notify.0 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff934040040 con 0x7ff924036070 2024-04-24T02:14:09.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.574+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94756197913920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e25846ae0 con 0x7ff924036070 2024-04-24T02:14:09.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.574+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e25847330 con 0x562e2583b1e0 2024-04-24T02:14:09.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.575+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94756197913920] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff934040040 con 0x7ff924036070 2024-04-24T02:14:09.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.575+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff92c076070 con 0x562e2583b1e0 2024-04-24T02:14:09.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.575+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94756197918256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e25846f40 con 0x562e2583b1e0 2024-04-24T02:14:09.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.575+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e25847a50 con 0x562e25841430 2024-04-24T02:14:09.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.577+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94756197918256] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff92c076070 con 0x562e2583b1e0 2024-04-24T02:14:09.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.577+0000 7ff933577640 1 -- 172.21.15.134:0/3052029598 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff924067040 con 0x562e25841430 2024-04-24T02:14:09.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.577+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94756197922048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e25847e40 con 0x562e25841430 2024-04-24T02:14:09.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.577+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e25848840 con 0x7ff924036070 2024-04-24T02:14:09.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.578+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(50 notify.3 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff934040040 con 0x7ff924036070 2024-04-24T02:14:09.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.578+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94756197925712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e258490e0 con 0x7ff924036070 2024-04-24T02:14:09.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.578+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e25849be0 con 0x562e2583b1e0 2024-04-24T02:14:09.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.578+0000 7ff933577640 1 -- 172.21.15.134:0/3052029598 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94756197922048] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff924067040 con 0x562e25841430 2024-04-24T02:14:09.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.579+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94756197925712] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff934040040 con 0x7ff924036070 2024-04-24T02:14:09.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.579+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff92c076070 con 0x562e2583b1e0 2024-04-24T02:14:09.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.579+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94756197930704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e25848c30 con 0x562e2583b1e0 2024-04-24T02:14:09.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.579+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e2584a480 con 0x7ff934031040 2024-04-24T02:14:09.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.580+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94756197930704] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff92c076070 con 0x562e2583b1e0 2024-04-24T02:14:09.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.580+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(54 notify.5 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff92c076070 con 0x7ff934031040 2024-04-24T02:14:09.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.580+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94756197919312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e25848c30 con 0x7ff934031040 2024-04-24T02:14:09.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.580+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e2584aac0 con 0x7ff934031040 2024-04-24T02:14:09.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.582+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94756197919312] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff92c076070 con 0x7ff934031040 2024-04-24T02:14:09.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.582+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(56 notify.6 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff92c076070 con 0x7ff934031040 2024-04-24T02:14:09.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.582+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94756197934544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e2584aac0 con 0x7ff934031040 2024-04-24T02:14:09.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.582+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e2584b4c0 con 0x7ff934031040 2024-04-24T02:14:09.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.583+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(58 notify.7 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff92c076070 con 0x7ff934031040 2024-04-24T02:14:09.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.583+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94756197937104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e2584b3f0 con 0x7ff934031040 2024-04-24T02:14:09.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.583+0000 7ff94012d800 20 add_watcher() i=0 2024-04-24T02:14:09.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.583+0000 7ff94012d800 20 add_watcher() i=1 2024-04-24T02:14:09.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.583+0000 7ff94012d800 20 add_watcher() i=2 2024-04-24T02:14:09.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.583+0000 7ff94012d800 20 add_watcher() i=3 2024-04-24T02:14:09.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.583+0000 7ff94012d800 20 add_watcher() i=4 2024-04-24T02:14:09.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.583+0000 7ff94012d800 20 add_watcher() i=5 2024-04-24T02:14:09.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.583+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94756197934544] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff92c076070 con 0x7ff934031040 2024-04-24T02:14:09.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.583+0000 7ff94012d800 20 add_watcher() i=6 2024-04-24T02:14:09.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.584+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94756197937104] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff92c076070 con 0x7ff934031040 2024-04-24T02:14:09.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.584+0000 7ff94012d800 20 add_watcher() i=7 2024-04-24T02:14:09.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.584+0000 7ff94012d800 2 all 8 watchers are set, enabling cache 2024-04-24T02:14:09.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.584+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e25849ed0 con 0x562e2583b1e0 2024-04-24T02:14:09.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.584+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff92c076070 con 0x562e2583b1e0 2024-04-24T02:14:09.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.584+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94756197932752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e2584be50 con 0x562e2583b1e0 2024-04-24T02:14:09.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.585+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94756197932752] v32'239 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff92c076070 con 0x562e2583b1e0 2024-04-24T02:14:09.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.585+0000 7ff7f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:14:09.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.585+0000 7ff94012d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:14:09.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.585+0000 7ff94012d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:14:09.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.585+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e25857210 con 0x562e2583b1e0 2024-04-24T02:14:09.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.586+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'58 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff92c076070 con 0x562e2583b1e0 2024-04-24T02:14:09.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.586+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e25857860 con 0x7ff934031040 2024-04-24T02:14:09.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.588+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'35 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff92c076070 con 0x7ff934031040 2024-04-24T02:14:09.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.588+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e25857860 con 0x562e25841430 2024-04-24T02:14:09.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.589+0000 7ff933577640 1 -- 172.21.15.134:0/3052029598 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff924067040 con 0x562e25841430 2024-04-24T02:14:09.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.589+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e25857c00 con 0x562e2583b1e0 2024-04-24T02:14:09.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.590+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'240 uv169 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff92c076070 con 0x562e2583b1e0 2024-04-24T02:14:09.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.590+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e25857d30 con 0x7ff924036070 2024-04-24T02:14:09.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.591+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'82 uv58 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff934040040 con 0x7ff924036070 2024-04-24T02:14:09.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.591+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e258583c0 con 0x562e25841430 2024-04-24T02:14:09.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.592+0000 7ff933577640 1 -- 172.21.15.134:0/3052029598 <== osd.3 v2:172.21.15.134:6801/3585115521 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'64 uv48 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff924067040 con 0x562e25841430 2024-04-24T02:14:09.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.592+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e25858760 con 0x562e2583b1e0 2024-04-24T02:14:09.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.593+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff92c076070 con 0x562e2583b1e0 2024-04-24T02:14:09.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.593+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e25858760 con 0x7ff934031040 2024-04-24T02:14:09.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.594+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'56 uv41 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff92c076070 con 0x7ff934031040 2024-04-24T02:14:09.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.594+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e25858760 con 0x7ff924036070 2024-04-24T02:14:09.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.595+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff934040040 con 0x7ff924036070 2024-04-24T02:14:09.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.595+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e25858cd0 con 0x562e25841430 2024-04-24T02:14:09.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.596+0000 7ff933577640 1 -- 172.21.15.134:0/3052029598 <== osd.3 v2:172.21.15.134:6801/3585115521 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff924067040 con 0x562e25841430 2024-04-24T02:14:09.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.596+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e25858cd0 con 0x7ff924036070 2024-04-24T02:14:09.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.597+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 <== osd.2 v2:172.21.15.134:6800/214480313 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'83 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff934040040 con 0x7ff924036070 2024-04-24T02:14:09.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.597+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e25859240 con 0x7ff934031040 2024-04-24T02:14:09.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.598+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'34 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff92c076070 con 0x7ff934031040 2024-04-24T02:14:09.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.598+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e25859240 con 0x7ff924036070 2024-04-24T02:14:09.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.599+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 <== osd.2 v2:172.21.15.134:6800/214480313 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff934040040 con 0x7ff924036070 2024-04-24T02:14:09.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.599+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e258596f0 con 0x7ff934031040 2024-04-24T02:14:09.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.600+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'67 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff92c076070 con 0x7ff934031040 2024-04-24T02:14:09.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.600+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e258596f0 con 0x562e2583b1e0 2024-04-24T02:14:09.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.601+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'241 uv171 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff92c076070 con 0x562e2583b1e0 2024-04-24T02:14:09.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.601+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e258596f0 con 0x562e25841430 2024-04-24T02:14:09.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.602+0000 7ff933577640 1 -- 172.21.15.134:0/3052029598 <== osd.3 v2:172.21.15.134:6801/3585115521 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'74 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff924067040 con 0x562e25841430 2024-04-24T02:14:09.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.602+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e258596f0 con 0x7ff924036070 2024-04-24T02:14:09.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.603+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 <== osd.2 v2:172.21.15.134:6800/214480313 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'84 uv63 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff934040040 con 0x7ff924036070 2024-04-24T02:14:09.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.603+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e25859780 con 0x562e25841430 2024-04-24T02:14:09.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.604+0000 7ff933577640 1 -- 172.21.15.134:0/3052029598 <== osd.3 v2:172.21.15.134:6801/3585115521 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'41 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff924067040 con 0x562e25841430 2024-04-24T02:14:09.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.604+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e25859780 con 0x562e2583b1e0 2024-04-24T02:14:09.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.606+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff92c076070 con 0x562e2583b1e0 2024-04-24T02:14:09.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.606+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e25859780 con 0x562e2583b1e0 2024-04-24T02:14:09.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.607+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'242 uv173 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff92c076070 con 0x562e2583b1e0 2024-04-24T02:14:09.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.607+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e258596f0 con 0x562e25841430 2024-04-24T02:14:09.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.608+0000 7ff933577640 1 -- 172.21.15.134:0/3052029598 <== osd.3 v2:172.21.15.134:6801/3585115521 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'75 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff924067040 con 0x562e25841430 2024-04-24T02:14:09.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.608+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e258596f0 con 0x7ff924036070 2024-04-24T02:14:09.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.609+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 <== osd.2 v2:172.21.15.134:6800/214480313 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'44 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff934040040 con 0x7ff924036070 2024-04-24T02:14:09.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.609+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e258596f0 con 0x562e25841430 2024-04-24T02:14:09.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.610+0000 7ff933577640 1 -- 172.21.15.134:0/3052029598 <== osd.3 v2:172.21.15.134:6801/3585115521 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff924067040 con 0x562e25841430 2024-04-24T02:14:09.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.610+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e258596f0 con 0x562e25841430 2024-04-24T02:14:09.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.611+0000 7ff933577640 1 -- 172.21.15.134:0/3052029598 <== osd.3 v2:172.21.15.134:6801/3585115521 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'46 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff924067040 con 0x562e25841430 2024-04-24T02:14:09.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.611+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e258596f0 con 0x562e25841430 2024-04-24T02:14:09.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.612+0000 7ff933577640 1 -- 172.21.15.134:0/3052029598 <== osd.3 v2:172.21.15.134:6801/3585115521 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff924067040 con 0x562e25841430 2024-04-24T02:14:09.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.612+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e258596f0 con 0x562e25841430 2024-04-24T02:14:09.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.613+0000 7ff933577640 1 -- 172.21.15.134:0/3052029598 <== osd.3 v2:172.21.15.134:6801/3585115521 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'65 uv50 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff924067040 con 0x562e25841430 2024-04-24T02:14:09.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.613+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e258596f0 con 0x7ff934031040 2024-04-24T02:14:09.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.614+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff92c076070 con 0x7ff934031040 2024-04-24T02:14:09.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.614+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e258596f0 con 0x562e25841430 2024-04-24T02:14:09.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.615+0000 7ff933577640 1 -- 172.21.15.134:0/3052029598 <== osd.3 v2:172.21.15.134:6801/3585115521 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'41 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff924067040 con 0x562e25841430 2024-04-24T02:14:09.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.615+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e258596f0 con 0x7ff934031040 2024-04-24T02:14:09.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.616+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'57 uv43 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff92c076070 con 0x7ff934031040 2024-04-24T02:14:09.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.616+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e258596f0 con 0x562e25841430 2024-04-24T02:14:09.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.617+0000 7ff933577640 1 -- 172.21.15.134:0/3052029598 <== osd.3 v2:172.21.15.134:6801/3585115521 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'76 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff924067040 con 0x562e25841430 2024-04-24T02:14:09.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.617+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e258596f0 con 0x7ff934031040 2024-04-24T02:14:09.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.618+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.0 v2:172.21.15.104:6800/2419146313 20 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'68 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff92c076070 con 0x7ff934031040 2024-04-24T02:14:09.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.618+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e258596f0 con 0x7ff924036070 2024-04-24T02:14:09.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.619+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 <== osd.2 v2:172.21.15.134:6800/214480313 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff934040040 con 0x7ff924036070 2024-04-24T02:14:09.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.620+0000 7ff7f0fe1640 20 reqs_thread_entry: start 2024-04-24T02:14:09.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.620+0000 7ff94012d800 20 init_complete bucket index max shards: 11 2024-04-24T02:14:09.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.620+0000 7ff94012d800 20 Filter name: none 2024-04-24T02:14:09.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.620+0000 7ff76a7fc640 20 reqs_thread_entry: start 2024-04-24T02:14:09.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.620+0000 7ff94012d800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T02:14:09.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.620+0000 7ff94012d800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.620+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e25884500 con 0x562e2583b1e0 2024-04-24T02:14:09.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.620+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff92c076070 con 0x562e2583b1e0 2024-04-24T02:14:09.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.620+0000 7ff94012d800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T02:14:09.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.620+0000 7ff94012d800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T02:14:09.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.620+0000 7ff94012d800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T02:14:09.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.620+0000 7ff94012d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:14:09.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.620+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e258840b0 con 0x7ff924036070 2024-04-24T02:14:09.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.621+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 <== osd.2 v2:172.21.15.134:6800/214480313 21 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv43 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7ff934040040 con 0x7ff924036070 2024-04-24T02:14:09.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.621+0000 7ff94012d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7 : miss 2024-04-24T02:14:09.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.621+0000 7ff94012d800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.621+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:96 8.14 8:2dc20475:root::.bucket.meta.myfoo%3a582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e25886fe0 con 0x562e25841430 2024-04-24T02:14:09.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.621+0000 7ff933577640 1 -- 172.21.15.134:0/3052029598 <== osd.3 v2:172.21.15.134:6801/3585115521 26 ==== osd_op_reply(96 .bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7ff924067040 con 0x562e25841430 2024-04-24T02:14:09.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.621+0000 7ff94012d800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T02:14:09.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.621+0000 7ff94012d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7 info.flags=0x17 2024-04-24T02:14:09.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.621+0000 7ff94012d800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7 to cache LRU end 2024-04-24T02:14:09.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.621+0000 7ff94012d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:14:09.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.621+0000 7ff94012d800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T02:14:09.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.621+0000 7ff94012d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7 2024-04-24T02:14:09.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.621+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:97 4.3c 4:3c79e719:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e25904360 con 0x562e2583b1e0 2024-04-24T02:14:09.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.622+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 30 ==== osd_op_reply(97 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff92c076070 con 0x562e2583b1e0 2024-04-24T02:14:09.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.622+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:98 4.36 4:6fa4b710:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e25904360 con 0x562e2583b1e0 2024-04-24T02:14:09.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.622+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 31 ==== osd_op_reply(98 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff92c076070 con 0x562e2583b1e0 2024-04-24T02:14:09.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.622+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:99 4.2a 4:569e6da7:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e25904360 con 0x562e2583b1e0 2024-04-24T02:14:09.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.622+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 32 ==== osd_op_reply(99 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.2 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff92c076070 con 0x562e2583b1e0 2024-04-24T02:14:09.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.622+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:100 4.3e 4:7f58ec2b:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e259043a0 con 0x7ff924036070 2024-04-24T02:14:09.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.623+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 <== osd.2 v2:172.21.15.134:6800/214480313 22 ==== osd_op_reply(100 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff934040040 con 0x7ff924036070 2024-04-24T02:14:09.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.623+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:101 4.32 4:4c522360:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e259043a0 con 0x562e2583b1e0 2024-04-24T02:14:09.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.623+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 33 ==== osd_op_reply(101 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.4 [call out=425b] v0'0 uv3 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7ff92c076070 con 0x562e2583b1e0 2024-04-24T02:14:09.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.623+0000 7ff94012d800 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-04-24T02:14:09.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.623+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:102 4.b 4:d01413ef:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e259043a0 con 0x7ff924036070 2024-04-24T02:14:09.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.623+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 <== osd.2 v2:172.21.15.134:6800/214480313 23 ==== osd_op_reply(102 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.5 [call out=85b] v0'0 uv13 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff934040040 con 0x7ff924036070 2024-04-24T02:14:09.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.623+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:103 4.23 4:c41207a8:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e259043a0 con 0x7ff934031040 2024-04-24T02:14:09.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.624+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.0 v2:172.21.15.104:6800/2419146313 21 ==== osd_op_reply(103 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff92c076070 con 0x7ff934031040 2024-04-24T02:14:09.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.624+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:104 4.22 4:473094e7:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e259043a0 con 0x7ff924036070 2024-04-24T02:14:09.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.624+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 <== osd.2 v2:172.21.15.134:6800/214480313 24 ==== osd_op_reply(104 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff934040040 con 0x7ff924036070 2024-04-24T02:14:09.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.624+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:105 4.d 4:b0908e7d:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e25904320 con 0x562e25841430 2024-04-24T02:14:09.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.625+0000 7ff933577640 1 -- 172.21.15.134:0/3052029598 <== osd.3 v2:172.21.15.134:6801/3585115521 27 ==== osd_op_reply(105 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff924067040 con 0x562e25841430 2024-04-24T02:14:09.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.625+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:106 4.3d 4:bea3b103:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e25904360 con 0x562e25841430 2024-04-24T02:14:09.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.625+0000 7ff933577640 1 -- 172.21.15.134:0/3052029598 <== osd.3 v2:172.21.15.134:6801/3585115521 28 ==== osd_op_reply(106 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.9 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff924067040 con 0x562e25841430 2024-04-24T02:14:09.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.625+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:107 4.1e 4:7a047ef0:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e25904360 con 0x7ff934031040 2024-04-24T02:14:09.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.625+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.0 v2:172.21.15.104:6800/2419146313 22 ==== osd_op_reply(107 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.10 [call out=85b] v0'0 uv9 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff92c076070 con 0x7ff934031040 2024-04-24T02:14:09.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.625+0000 7ff94012d800 20 get_obj_state: octx=0x7ff92c066460 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x562e25902448 s->prefetch_data=0 2024-04-24T02:14:09.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.625+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:108 3.17 3:e93c5048:::582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7_15f6f8dc036519d7fe15b39338f6e5db:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e25903420 con 0x562e2583b1e0 2024-04-24T02:14:09.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.626+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 34 ==== osd_op_reply(108 582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7_15f6f8dc036519d7fe15b39338f6e5db [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7ff92c076070 con 0x562e2583b1e0 2024-04-24T02:14:09.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.626+0000 7ff94012d800 10 manifest: total_size = 6 2024-04-24T02:14:09.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.626+0000 7ff94012d800 20 get_obj_state: setting s->obj_tag to 582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7765533953960008939 2024-04-24T02:14:09.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.626+0000 7ff94012d800 20 get_obj_state: octx=0x7ff92c066460 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x562e25902448 s->prefetch_data=0 2024-04-24T02:14:09.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.626+0000 7ff94012d800 20 prepare_atomic_modification: state is not atomic. state=0x562e25902448 2024-04-24T02:14:09.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.626+0000 7ff94012d800 20 bucket index object: :.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.4 2024-04-24T02:14:09.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.626+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:109 4.32 4:4c522360:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e25903d00 con 0x562e2583b1e0 2024-04-24T02:14:09.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.627+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 35 ==== osd_op_reply(109 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.4 [stat,call,call] v32'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7ff92c076070 con 0x562e2583b1e0 2024-04-24T02:14:09.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.627+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:110 3.17 3:e93c5048:::582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e25903d00 con 0x562e2583b1e0 2024-04-24T02:14:09.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.628+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 36 ==== osd_op_reply(110 582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7_15f6f8dc036519d7fe15b39338f6e5db [call] v32'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7ff92c076070 con 0x562e2583b1e0 2024-04-24T02:14:09.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.628+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:111 4.32 4:4c522360:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e25903e50 con 0x562e2583b1e0 2024-04-24T02:14:09.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.628+0000 7ff94012d800 20 list_objects_ordered: starting attempt 1 2024-04-24T02:14:09.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.628+0000 7ff94012d800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-04-24T02:14:09.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.628+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:112 4.3c 4:3c79e719:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e25903e50 con 0x562e2583b1e0 2024-04-24T02:14:09.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.628+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:113 4.36 4:6fa4b710:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2588fab0 con 0x562e2583b1e0 2024-04-24T02:14:09.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.628+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:114 4.2a 4:569e6da7:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e25903e50 con 0x562e2583b1e0 2024-04-24T02:14:09.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.628+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:115 4.3e 4:7f58ec2b:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e258948c0 con 0x7ff924036070 2024-04-24T02:14:09.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.628+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:116 4.32 4:4c522360:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e25897220 con 0x562e2583b1e0 2024-04-24T02:14:09.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.628+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:117 4.b 4:d01413ef:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e25897220 con 0x7ff924036070 2024-04-24T02:14:09.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.629+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 37 ==== osd_op_reply(114 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.2 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff92c076070 con 0x562e2583b1e0 2024-04-24T02:14:09.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.629+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 38 ==== osd_op_reply(112 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff92c076070 con 0x562e2583b1e0 2024-04-24T02:14:09.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.629+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 39 ==== osd_op_reply(113 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff92c076070 con 0x562e2583b1e0 2024-04-24T02:14:09.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.629+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 <== osd.2 v2:172.21.15.134:6800/214480313 25 ==== osd_op_reply(115 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff934040040 con 0x7ff924036070 2024-04-24T02:14:09.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.629+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:118 4.23 4:c41207a8:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2588d5e0 con 0x7ff934031040 2024-04-24T02:14:09.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.629+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:119 4.22 4:473094e7:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2588f710 con 0x7ff924036070 2024-04-24T02:14:09.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.629+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:120 4.d 4:b0908e7d:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e25892ba0 con 0x562e25841430 2024-04-24T02:14:09.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.629+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:121 4.3d 4:bea3b103:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2589ace0 con 0x562e25841430 2024-04-24T02:14:09.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.629+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:122 4.1e 4:7a047ef0:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2589d830 con 0x7ff934031040 2024-04-24T02:14:09.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.629+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 <== osd.2 v2:172.21.15.134:6800/214480313 26 ==== osd_op_reply(117 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.5 [call out=85b] v0'0 uv13 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff934040040 con 0x7ff924036070 2024-04-24T02:14:09.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.629+0000 7ff933577640 1 -- 172.21.15.134:0/3052029598 <== osd.3 v2:172.21.15.134:6801/3585115521 29 ==== osd_op_reply(120 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff924067040 con 0x562e25841430 2024-04-24T02:14:09.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.629+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.0 v2:172.21.15.104:6800/2419146313 23 ==== osd_op_reply(118 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff92c076070 con 0x7ff934031040 2024-04-24T02:14:09.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.629+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.0 v2:172.21.15.104:6800/2419146313 24 ==== osd_op_reply(122 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.10 [call out=85b] v0'0 uv9 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff92c076070 con 0x7ff934031040 2024-04-24T02:14:09.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.629+0000 7ff933577640 1 -- 172.21.15.134:0/3052029598 <== osd.3 v2:172.21.15.134:6801/3585115521 30 ==== osd_op_reply(121 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.9 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff924067040 con 0x562e25841430 2024-04-24T02:14:09.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.629+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 <== osd.2 v2:172.21.15.134:6800/214480313 27 ==== osd_op_reply(119 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff934040040 con 0x7ff924036070 2024-04-24T02:14:09.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.629+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 40 ==== osd_op_reply(111 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.4 [stat,call,call] v32'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7ff92c076070 con 0x562e2583b1e0 2024-04-24T02:14:09.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.629+0000 7ff81a7fc640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-04-24T02:14:09.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.630+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 41 ==== osd_op_reply(116 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.4 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7ff92c0ad090 con 0x562e2583b1e0 2024-04-24T02:14:09.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.630+0000 7ff94012d800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-04-24T02:14:09.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.630+0000 7ff94012d800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-04-24T02:14:09.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.630+0000 7ff94012d800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-04-24T02:14:09.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.630+0000 7ff94012d800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-04-24T02:14:09.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.630+0000 7ff94012d800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7])"; uploads.size()=0; is_truncated=0 2024-04-24T02:14:09.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.630+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:123 4.3c 4:3c79e719:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2589d830 con 0x562e2583b1e0 2024-04-24T02:14:09.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.630+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:124 4.36 4:6fa4b710:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e25894210 con 0x562e2583b1e0 2024-04-24T02:14:09.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.630+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:125 4.2a 4:569e6da7:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e25894600 con 0x562e2583b1e0 2024-04-24T02:14:09.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.630+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:126 4.3e 4:7f58ec2b:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e25896ee0 con 0x7ff924036070 2024-04-24T02:14:09.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.630+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:127 4.32 4:4c522360:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2589d830 con 0x562e2583b1e0 2024-04-24T02:14:09.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.630+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:128 4.b 4:d01413ef:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e258928a0 con 0x7ff924036070 2024-04-24T02:14:09.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.630+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:129 4.23 4:c41207a8:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e25894210 con 0x7ff934031040 2024-04-24T02:14:09.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.630+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:130 4.22 4:473094e7:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e25894600 con 0x7ff924036070 2024-04-24T02:14:09.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.630+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:131 4.d 4:b0908e7d:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2589dcd0 con 0x562e25841430 2024-04-24T02:14:09.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.630+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:132 4.3d 4:bea3b103:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e258a0560 con 0x562e25841430 2024-04-24T02:14:09.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.630+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:133 4.1e 4:7a047ef0:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2589dcd0 con 0x7ff934031040 2024-04-24T02:14:09.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.630+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 42 ==== osd_op_reply(123 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff92c0ad090 con 0x562e2583b1e0 2024-04-24T02:14:09.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.630+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 43 ==== osd_op_reply(124 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff92c0ad090 con 0x562e2583b1e0 2024-04-24T02:14:09.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.630+0000 7ff933577640 1 -- 172.21.15.134:0/3052029598 <== osd.3 v2:172.21.15.134:6801/3585115521 31 ==== osd_op_reply(131 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff924074040 con 0x562e25841430 2024-04-24T02:14:09.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.630+0000 7ff933577640 1 -- 172.21.15.134:0/3052029598 <== osd.3 v2:172.21.15.134:6801/3585115521 32 ==== osd_op_reply(132 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.9 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff924074040 con 0x562e25841430 2024-04-24T02:14:09.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.630+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 <== osd.2 v2:172.21.15.134:6800/214480313 28 ==== osd_op_reply(126 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff934040040 con 0x7ff924036070 2024-04-24T02:14:09.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.630+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 44 ==== osd_op_reply(127 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.4 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7ff92c0ad090 con 0x562e2583b1e0 2024-04-24T02:14:09.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.630+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.0 v2:172.21.15.104:6800/2419146313 25 ==== osd_op_reply(133 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.10 [call out=85b] v0'0 uv9 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff92c0ad090 con 0x7ff934031040 2024-04-24T02:14:09.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.630+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.0 v2:172.21.15.104:6800/2419146313 26 ==== osd_op_reply(129 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff92c0ad090 con 0x7ff934031040 2024-04-24T02:14:09.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.630+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 45 ==== osd_op_reply(125 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.2 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff92c0ad090 con 0x562e2583b1e0 2024-04-24T02:14:09.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.630+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 <== osd.2 v2:172.21.15.134:6800/214480313 29 ==== osd_op_reply(128 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.5 [call out=85b] v0'0 uv13 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff934040040 con 0x7ff924036070 2024-04-24T02:14:09.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.630+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 <== osd.2 v2:172.21.15.134:6800/214480313 30 ==== osd_op_reply(130 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff934040040 con 0x7ff924036070 2024-04-24T02:14:09.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.630+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e258928a0 con 0x7ff924036070 2024-04-24T02:14:09.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.632+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 <== osd.2 v2:172.21.15.134:6800/214480313 31 ==== osd_op_reply(134 foo.buckets [call] v32'46 uv46 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7ff934040040 con 0x7ff924036070 2024-04-24T02:14:09.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.632+0000 7ff94012d800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-24T02:14:09.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.632+0000 7ff94012d800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.632+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e258945b0 con 0x7ff924036070 2024-04-24T02:14:09.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.632+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 <== osd.2 v2:172.21.15.134:6800/214480313 32 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv40 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7ff934040040 con 0x7ff924036070 2024-04-24T02:14:09.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.632+0000 7ff94012d800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T02:14:09.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.632+0000 7ff94012d800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-24T02:14:09.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.632+0000 7ff94012d800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T02:14:09.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.632+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:136 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e258945b0 con 0x7ff924036070 2024-04-24T02:14:09.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.633+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 <== osd.2 v2:172.21.15.134:6800/214480313 33 ==== osd_op_reply(136 myfoo [call,call,delete] v32'47 uv47 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7ff934040040 con 0x7ff924036070 2024-04-24T02:14:09.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.633+0000 7ff94012d800 10 removing default.rgw.meta+root+myfoo from cache 2024-04-24T02:14:09.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.633+0000 7ff94012d800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-24T02:14:09.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.633+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94756198217584 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e258945b0 con 0x7ff934031040 2024-04-24T02:14:09.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.634+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.0 v2:172.21.15.104:6800/2419146313 27 ==== watch-notify(notify (1) cookie 94756197934544 notify 137438953517 ret 0) ==== 191+0+0 (crc 0 0 0) 0x562e25858d20 con 0x7ff934031040 2024-04-24T02:14:09.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.634+0000 7ff81affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953517 cookie 94756197934544 notifier 4774 bl.length()=149 2024-04-24T02:14:09.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.634+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.0 v2:172.21.15.104:6800/2419146313 28 ==== osd_op_reply(137 notify.6 [notify cookie 94756198217584 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff92c0ad090 con 0x7ff934031040 2024-04-24T02:14:09.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.634+0000 7ff81affd640 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:138 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7ff800003d60 con 0x7ff934031040 2024-04-24T02:14:09.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.634+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.0 v2:172.21.15.104:6800/2419146313 29 ==== osd_op_reply(138 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff92c0ad090 con 0x7ff934031040 2024-04-24T02:14:09.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.634+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.0 v2:172.21.15.104:6800/2419146313 30 ==== watch-notify(notify_complete (2) cookie 94756198217584 notify 137438953517 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562e25855a60 con 0x7ff934031040 2024-04-24T02:14:09.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.634+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:139 8.14 8:2dc20475:root::.bucket.meta.myfoo%3a582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e258945b0 con 0x562e25841430 2024-04-24T02:14:09.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.636+0000 7ff933577640 1 -- 172.21.15.134:0/3052029598 <== osd.3 v2:172.21.15.134:6801/3585115521 33 ==== osd_op_reply(139 .bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7 [call,call,delete] v32'2 uv2 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7ff924074040 con 0x562e25841430 2024-04-24T02:14:09.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.636+0000 7ff94012d800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7 from cache 2024-04-24T02:14:09.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.636+0000 7ff94012d800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7, ofs0, ns] 2024-04-24T02:14:09.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.636+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:140 7.9 7:93e5b521:::notify.7:head [notify cookie 94756198217584 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e258945b0 con 0x7ff934031040 2024-04-24T02:14:09.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.636+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.0 v2:172.21.15.104:6800/2419146313 31 ==== watch-notify(notify (1) cookie 94756197937104 notify 137438953518 ret 0) ==== 248+0+0 (crc 0 0 0) 0x562e25855a60 con 0x7ff934031040 2024-04-24T02:14:09.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.636+0000 7ff81affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953518 cookie 94756197937104 notifier 4774 bl.length()=206 2024-04-24T02:14:09.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.636+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.0 v2:172.21.15.104:6800/2419146313 32 ==== osd_op_reply(140 notify.7 [notify cookie 94756198217584 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff92c0ad090 con 0x7ff934031040 2024-04-24T02:14:09.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.636+0000 7ff81affd640 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:141 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7ff800003d60 con 0x7ff934031040 2024-04-24T02:14:09.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.636+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.0 v2:172.21.15.104:6800/2419146313 33 ==== osd_op_reply(141 notify.7 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff92c0ad090 con 0x7ff934031040 2024-04-24T02:14:09.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.636+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.0 v2:172.21.15.104:6800/2419146313 34 ==== watch-notify(notify_complete (2) cookie 94756198217584 notify 137438953518 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562e25805cb0 con 0x7ff934031040 2024-04-24T02:14:09.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.636+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:142 4.3c 4:3c79e719:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e258945b0 con 0x562e2583b1e0 2024-04-24T02:14:09.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.636+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:143 4.36 4:6fa4b710:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e25893090 con 0x562e2583b1e0 2024-04-24T02:14:09.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.636+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:144 4.2a 4:569e6da7:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e258938e0 con 0x562e2583b1e0 2024-04-24T02:14:09.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.636+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:145 4.3e 4:7f58ec2b:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e258855d0 con 0x7ff924036070 2024-04-24T02:14:09.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.636+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:146 4.32 4:4c522360:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e258945b0 con 0x562e2583b1e0 2024-04-24T02:14:09.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.636+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:147 4.b 4:d01413ef:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e25893090 con 0x7ff924036070 2024-04-24T02:14:09.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.636+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:148 4.23 4:c41207a8:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e258938e0 con 0x7ff934031040 2024-04-24T02:14:09.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.636+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:149 4.22 4:473094e7:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e258945b0 con 0x7ff924036070 2024-04-24T02:14:09.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.637+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:150 4.d 4:b0908e7d:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e258855d0 con 0x562e25841430 2024-04-24T02:14:09.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.637+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:151 4.3d 4:bea3b103:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e25893090 con 0x562e25841430 2024-04-24T02:14:09.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.637+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:152 4.1e 4:7a047ef0:::.dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e258938e0 con 0x7ff934031040 2024-04-24T02:14:09.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.638+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 46 ==== osd_op_reply(142 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.0 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff92c0ad090 con 0x562e2583b1e0 2024-04-24T02:14:09.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.638+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 <== osd.2 v2:172.21.15.134:6800/214480313 34 ==== osd_op_reply(147 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.5 [delete] v32'20 uv20 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff934040040 con 0x7ff924036070 2024-04-24T02:14:09.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.639+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 <== osd.2 v2:172.21.15.134:6800/214480313 35 ==== osd_op_reply(145 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.3 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff934040040 con 0x7ff924036070 2024-04-24T02:14:09.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.639+0000 7ff933577640 1 -- 172.21.15.134:0/3052029598 <== osd.3 v2:172.21.15.134:6801/3585115521 34 ==== osd_op_reply(150 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.8 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff924074040 con 0x562e25841430 2024-04-24T02:14:09.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.639+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.0 v2:172.21.15.104:6800/2419146313 35 ==== osd_op_reply(152 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.10 [delete] v32'10 uv10 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7ff92c0ad090 con 0x7ff934031040 2024-04-24T02:14:09.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.639+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.0 v2:172.21.15.104:6800/2419146313 36 ==== osd_op_reply(148 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.6 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff92c0ad090 con 0x7ff934031040 2024-04-24T02:14:09.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.639+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 47 ==== osd_op_reply(144 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.2 [delete] v32'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff92c0ad090 con 0x562e2583b1e0 2024-04-24T02:14:09.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.639+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 48 ==== osd_op_reply(146 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.4 [delete] v32'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff92c0ad090 con 0x562e2583b1e0 2024-04-24T02:14:09.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.639+0000 7ff933577640 1 -- 172.21.15.134:0/3052029598 <== osd.3 v2:172.21.15.134:6801/3585115521 35 ==== osd_op_reply(151 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.9 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff924074040 con 0x562e25841430 2024-04-24T02:14:09.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.639+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 <== osd.2 v2:172.21.15.134:6800/214480313 36 ==== osd_op_reply(149 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.7 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff934040040 con 0x7ff924036070 2024-04-24T02:14:09.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.639+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 49 ==== osd_op_reply(143 .dir.582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7.1 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff92c0ad090 con 0x562e2583b1e0 2024-04-24T02:14:09.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.639+0000 7ff94012d800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7 : miss 2024-04-24T02:14:09.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.639+0000 7ff94012d800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.639+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:153 6.1b 6:dc03cc42:::pubsub..bucket.myfoo%2f582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e25893d00 con 0x562e25841430 2024-04-24T02:14:09.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.639+0000 7ff933577640 1 -- 172.21.15.134:0/3052029598 <== osd.3 v2:172.21.15.134:6801/3585115521 36 ==== osd_op_reply(153 pubsub..bucket.myfoo/582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7ff924074040 con 0x562e25841430 2024-04-24T02:14:09.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.639+0000 7ff94012d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:09.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.639+0000 7ff94012d800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7 info.flags=0x0 2024-04-24T02:14:09.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.639+0000 7ff94012d800 10 adding default.rgw.log++pubsub..bucket.myfoo/582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7 to cache LRU end 2024-04-24T02:14:09.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.639+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:154 6.1b 6:dc03cc42:::pubsub..bucket.myfoo%2f582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e25897130 con 0x562e25841430 2024-04-24T02:14:09.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.640+0000 7ff933577640 1 -- 172.21.15.134:0/3052029598 <== osd.3 v2:172.21.15.134:6801/3585115521 37 ==== osd_op_reply(154 pubsub..bucket.myfoo/582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.7 [delete] v32'31 uv23 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7ff924074040 con 0x562e25841430 2024-04-24T02:14:09.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.640+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:155 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e25897130 con 0x7ff924036070 2024-04-24T02:14:09.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.641+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 <== osd.2 v2:172.21.15.134:6800/214480313 37 ==== osd_op_reply(155 foo.buckets [call] v32'48 uv48 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7ff934040040 con 0x7ff924036070 2024-04-24T02:14:09.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.641+0000 7ff94012d800 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-04-24T02:14:09.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.641+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:156 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e25897130 con 0x7ff934031040 2024-04-24T02:14:09.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.642+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.0 v2:172.21.15.104:6800/2419146313 37 ==== osd_op_reply(156 9te6NH5mcdcq0Tc5i8i1 [delete] v32'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7ff92c0ad090 con 0x7ff934031040 2024-04-24T02:14:09.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.642+0000 7ff94012d800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-04-24T02:14:09.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.642+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:157 7.e 7:7759931f:::notify.3:head [notify cookie 94756198248752 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e25885ad0 con 0x7ff924036070 2024-04-24T02:14:09.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.643+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 <== osd.2 v2:172.21.15.134:6800/214480313 38 ==== watch-notify(notify (1) cookie 94756197925712 notify 137438953491 ret 0) ==== 212+0+0 (crc 0 0 0) 0x562e25856c40 con 0x7ff924036070 2024-04-24T02:14:09.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.643+0000 7ff81a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953491 cookie 94756197925712 notifier 4774 bl.length()=170 2024-04-24T02:14:09.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.643+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 <== osd.2 v2:172.21.15.134:6800/214480313 39 ==== osd_op_reply(157 notify.3 [notify cookie 94756198248752 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff934040040 con 0x7ff924036070 2024-04-24T02:14:09.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.643+0000 7ff81a7fc640 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7ff7700032c0 con 0x7ff924036070 2024-04-24T02:14:09.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.643+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 <== osd.2 v2:172.21.15.134:6800/214480313 40 ==== watch-notify(notify_complete (2) cookie 94756198248752 notify 137438953491 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562e25859070 con 0x7ff924036070 2024-04-24T02:14:09.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.643+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 <== osd.2 v2:172.21.15.134:6800/214480313 41 ==== osd_op_reply(158 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff934040040 con 0x7ff924036070 2024-04-24T02:14:09.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.643+0000 7ff94012d800 10 removing email index: foo@foo.com 2024-04-24T02:14:09.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.643+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:159 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e25897130 con 0x562e2583b1e0 2024-04-24T02:14:09.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.644+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 50 ==== osd_op_reply(159 foo@foo.com [delete] v32'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7ff92c0ad090 con 0x562e2583b1e0 2024-04-24T02:14:09.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.644+0000 7ff94012d800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-04-24T02:14:09.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.644+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:160 7.e 7:7759931f:::notify.3:head [notify cookie 94756198248752 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e25885ad0 con 0x7ff924036070 2024-04-24T02:14:09.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.644+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 <== osd.2 v2:172.21.15.134:6800/214480313 42 ==== watch-notify(notify (1) cookie 94756197925712 notify 137438953492 ret 0) ==== 204+0+0 (crc 0 0 0) 0x562e25859070 con 0x7ff924036070 2024-04-24T02:14:09.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.644+0000 7ff81affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953492 cookie 94756197925712 notifier 4774 bl.length()=162 2024-04-24T02:14:09.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.644+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 <== osd.2 v2:172.21.15.134:6800/214480313 43 ==== osd_op_reply(160 notify.3 [notify cookie 94756198248752 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff934040040 con 0x7ff924036070 2024-04-24T02:14:09.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.644+0000 7ff81affd640 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7ff800003d60 con 0x7ff924036070 2024-04-24T02:14:09.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.645+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 <== osd.2 v2:172.21.15.134:6800/214480313 44 ==== watch-notify(notify_complete (2) cookie 94756198248752 notify 137438953492 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562e25857d30 con 0x7ff924036070 2024-04-24T02:14:09.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.645+0000 7ff94012d800 10 removing user buckets index 2024-04-24T02:14:09.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.645+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 <== osd.2 v2:172.21.15.134:6800/214480313 45 ==== osd_op_reply(161 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff934040040 con 0x7ff924036070 2024-04-24T02:14:09.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.645+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:162 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e25897130 con 0x7ff924036070 2024-04-24T02:14:09.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.646+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 <== osd.2 v2:172.21.15.134:6800/214480313 46 ==== osd_op_reply(162 foo.buckets [delete] v32'49 uv49 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7ff934040040 con 0x7ff924036070 2024-04-24T02:14:09.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.646+0000 7ff94012d800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-04-24T02:14:09.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.646+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94756198248752 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e25885ad0 con 0x7ff934031040 2024-04-24T02:14:09.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.646+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.0 v2:172.21.15.104:6800/2419146313 38 ==== watch-notify(notify (1) cookie 94756197919312 notify 137438953519 ret 0) ==== 202+0+0 (crc 0 0 0) 0x562e25805cb0 con 0x7ff934031040 2024-04-24T02:14:09.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.646+0000 7ff81a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953519 cookie 94756197919312 notifier 4774 bl.length()=160 2024-04-24T02:14:09.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.646+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.0 v2:172.21.15.104:6800/2419146313 39 ==== osd_op_reply(163 notify.5 [notify cookie 94756198248752 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff92c0ad090 con 0x7ff934031040 2024-04-24T02:14:09.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.646+0000 7ff81a7fc640 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7ff7700032c0 con 0x7ff934031040 2024-04-24T02:14:09.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.646+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.0 v2:172.21.15.104:6800/2419146313 40 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff92c0ad090 con 0x7ff934031040 2024-04-24T02:14:09.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.646+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.0 v2:172.21.15.104:6800/2419146313 41 ==== watch-notify(notify_complete (2) cookie 94756198248752 notify 137438953519 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562e258030a0 con 0x7ff934031040 2024-04-24T02:14:09.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.646+0000 7ff94012d800 10 removing user index: foo 2024-04-24T02:14:09.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.646+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:165 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e25897130 con 0x562e2583b1e0 2024-04-24T02:14:09.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.647+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 51 ==== osd_op_reply(165 foo [call,call,delete] v32'19 uv19 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7ff92c0ad090 con 0x562e2583b1e0 2024-04-24T02:14:09.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.647+0000 7ff94012d800 10 removing default.rgw.meta+users.uid+foo from cache 2024-04-24T02:14:09.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.647+0000 7ff94012d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-24T02:14:09.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.647+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:166 7.d 7:b4812045:::notify.4:head [notify cookie 94756198248752 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e25884ac0 con 0x562e2583b1e0 2024-04-24T02:14:09.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.648+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 52 ==== watch-notify(notify (1) cookie 94756197930704 notify 137438953490 ret 0) ==== 194+0+0 (crc 0 0 0) 0x562e258030a0 con 0x562e2583b1e0 2024-04-24T02:14:09.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.648+0000 7ff81a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953490 cookie 94756197930704 notifier 4774 bl.length()=152 2024-04-24T02:14:09.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.648+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 53 ==== osd_op_reply(166 notify.4 [notify cookie 94756198248752 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff92c0ad090 con 0x562e2583b1e0 2024-04-24T02:14:09.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.648+0000 7ff81a7fc640 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7ff7700032c0 con 0x562e2583b1e0 2024-04-24T02:14:09.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.648+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 54 ==== osd_op_reply(167 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff92c0ad090 con 0x562e2583b1e0 2024-04-24T02:14:09.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.648+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 55 ==== watch-notify(notify_complete (2) cookie 94756198248752 notify 137438953490 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562e25802e10 con 0x562e2583b1e0 2024-04-24T02:14:09.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.649+0000 7ff7f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:14:09.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.649+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:168 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94756197932752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e25897130 con 0x562e2583b1e0 2024-04-24T02:14:09.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.650+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 56 ==== osd_op_reply(168 data_loggenerations_metadata [watch unwatch cookie 94756197932752] v32'243 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff92c0ad090 con 0x562e2583b1e0 2024-04-24T02:14:09.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.650+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:169 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94756197913920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e25897130 con 0x7ff924036070 2024-04-24T02:14:09.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.651+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 <== osd.2 v2:172.21.15.134:6800/214480313 47 ==== osd_op_reply(169 notify.0 [watch unwatch cookie 94756197913920] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff934040040 con 0x7ff924036070 2024-04-24T02:14:09.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.651+0000 7ff94012d800 20 remove_watcher() i=0 2024-04-24T02:14:09.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.651+0000 7ff94012d800 2 removed watcher, disabling cache 2024-04-24T02:14:09.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.651+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:170 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94756197918256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e25897130 con 0x562e2583b1e0 2024-04-24T02:14:09.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.652+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 57 ==== osd_op_reply(170 notify.1 [watch unwatch cookie 94756197918256] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff92c0ad090 con 0x562e2583b1e0 2024-04-24T02:14:09.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.652+0000 7ff94012d800 20 remove_watcher() i=1 2024-04-24T02:14:09.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.652+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:171 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94756197922048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e25846630 con 0x562e25841430 2024-04-24T02:14:09.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.653+0000 7ff933577640 1 -- 172.21.15.134:0/3052029598 <== osd.3 v2:172.21.15.134:6801/3585115521 38 ==== osd_op_reply(171 notify.2 [watch unwatch cookie 94756197922048] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff924074040 con 0x562e25841430 2024-04-24T02:14:09.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.653+0000 7ff94012d800 20 remove_watcher() i=2 2024-04-24T02:14:09.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.653+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:172 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94756197925712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e25846630 con 0x7ff924036070 2024-04-24T02:14:09.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.654+0000 7ff93c579640 1 -- 172.21.15.134:0/3052029598 <== osd.2 v2:172.21.15.134:6800/214480313 48 ==== osd_op_reply(172 notify.3 [watch unwatch cookie 94756197925712] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff934040040 con 0x7ff924036070 2024-04-24T02:14:09.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.654+0000 7ff94012d800 20 remove_watcher() i=3 2024-04-24T02:14:09.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.654+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:173 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94756197930704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e25846630 con 0x562e2583b1e0 2024-04-24T02:14:09.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.655+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.1 v2:172.21.15.134:6804/1487076214 58 ==== osd_op_reply(173 notify.4 [watch unwatch cookie 94756197930704] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff92c0ad090 con 0x562e2583b1e0 2024-04-24T02:14:09.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.655+0000 7ff94012d800 20 remove_watcher() i=4 2024-04-24T02:14:09.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.655+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:174 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94756197919312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e25846630 con 0x7ff934031040 2024-04-24T02:14:09.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.657+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.0 v2:172.21.15.104:6800/2419146313 42 ==== osd_op_reply(174 notify.5 [watch unwatch cookie 94756197919312] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff92c0ad090 con 0x7ff934031040 2024-04-24T02:14:09.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.657+0000 7ff94012d800 20 remove_watcher() i=5 2024-04-24T02:14:09.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.657+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:175 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94756197934544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e25845540 con 0x7ff934031040 2024-04-24T02:14:09.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.658+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.0 v2:172.21.15.104:6800/2419146313 43 ==== osd_op_reply(175 notify.6 [watch unwatch cookie 94756197934544] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff92c0ad090 con 0x7ff934031040 2024-04-24T02:14:09.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.658+0000 7ff94012d800 20 remove_watcher() i=6 2024-04-24T02:14:09.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.658+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:176 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94756197937104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e25845540 con 0x7ff934031040 2024-04-24T02:14:09.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.659+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 <== osd.0 v2:172.21.15.104:6800/2419146313 44 ==== osd_op_reply(176 notify.7 [watch unwatch cookie 94756197937104] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff92c0ad090 con 0x7ff934031040 2024-04-24T02:14:09.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.659+0000 7ff94012d800 20 remove_watcher() i=7 2024-04-24T02:14:09.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.659+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7ff934031040 msgr2=0x7ff934032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.659+0000 7ff94012d800 1 --2- 172.21.15.134:0/3052029598 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7ff934031040 0x7ff934032430 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.659+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x562e2583b1e0 msgr2=0x562e2583d6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.659+0000 7ff94012d800 1 --2- 172.21.15.134:0/3052029598 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x562e2583b1e0 0x562e2583d6a0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.659+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7ff924036070 msgr2=0x7ff92403a1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.659+0000 7ff94012d800 1 --2- 172.21.15.134:0/3052029598 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7ff924036070 0x7ff92403a1c0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.659+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x562e25841430 msgr2=0x562e25843820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.659+0000 7ff94012d800 1 --2- 172.21.15.134:0/3052029598 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x562e25841430 0x562e25843820 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.659+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7ff804036900 msgr2=0x7ff804038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.659+0000 7ff94012d800 1 --2- 172.21.15.134:0/3052029598 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7ff804036900 0x7ff804038dc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x562e2580ac00 tx=0x7ff93401f000 comp rx=0 tx=0).stop 2024-04-24T02:14:09.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.659+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e25828010 msgr2=0x562e2582f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.659+0000 7ff94012d800 1 --2- 172.21.15.134:0/3052029598 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e25828010 0x562e2582f6d0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7ff9240266c0 tx=0x7ff92404bea0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.659+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 reap_dead start 2024-04-24T02:14:09.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.659+0000 7ff93bd78640 1 -- 172.21.15.134:0/3052029598 reap_dead start 2024-04-24T02:14:09.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.659+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 shutdown_connections 2024-04-24T02:14:09.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.659+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 >> 172.21.15.134:0/3052029598 conn(0x562e25824370 msgr2=0x562e258219d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:09.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.659+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 shutdown_connections 2024-04-24T02:14:09.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.659+0000 7ff94012d800 1 -- 172.21.15.134:0/3052029598 wait complete. 2024-04-24T02:14:09.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.660+0000 7ff94012d800 1 -- 172.21.15.134:0/2491722732 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7ff814036900 msgr2=0x7ff814038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.660+0000 7ff94012d800 1 --2- 172.21.15.134:0/2491722732 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7ff814036900 0x7ff814038dc0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x562e2580b480 tx=0x7ff934005840 comp rx=0 tx=0).stop 2024-04-24T02:14:09.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.660+0000 7ff94012d800 1 -- 172.21.15.134:0/2491722732 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e2581ad10 msgr2=0x562e2581b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.660+0000 7ff94012d800 1 --2- 172.21.15.134:0/2491722732 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e2581ad10 0x562e2581b130 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ff92400e610 tx=0x7ff92400ff90 comp rx=0 tx=0).stop 2024-04-24T02:14:09.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.660+0000 7ff94012d800 1 -- 172.21.15.134:0/2491722732 shutdown_connections 2024-04-24T02:14:09.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.660+0000 7ff94012d800 1 --2- 172.21.15.134:0/2491722732 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7ff814036900 0x7ff814038dc0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.660+0000 7ff94012d800 1 --2- 172.21.15.134:0/2491722732 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e2581ad10 0x562e2581b130 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.660+0000 7ff94012d800 1 -- 172.21.15.134:0/2491722732 >> 172.21.15.134:0/2491722732 conn(0x562e2580ed10 msgr2=0x562e2580f110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:09.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.660+0000 7ff94012d800 1 -- 172.21.15.134:0/2491722732 shutdown_connections 2024-04-24T02:14:09.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.660+0000 7ff94012d800 1 -- 172.21.15.134:0/2491722732 wait complete. 2024-04-24T02:14:09.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.660+0000 7ff94012d800 1 -- 172.21.15.134:0/3490911137 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x562e2570d2c0 msgr2=0x562e25809a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.660+0000 7ff94012d800 1 --2- 172.21.15.134:0/3490911137 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x562e2570d2c0 0x562e25809a70 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.660+0000 7ff94012d800 1 -- 172.21.15.134:0/3490911137 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7ff824036900 msgr2=0x7ff824038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.660+0000 7ff94012d800 1 --2- 172.21.15.134:0/3490911137 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7ff824036900 0x7ff824038dc0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff924000c00 tx=0x7ff9240013b0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.660+0000 7ff94012d800 1 -- 172.21.15.134:0/3490911137 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e2570a990 msgr2=0x562e258028d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.660+0000 7ff94012d800 1 --2- 172.21.15.134:0/3490911137 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e2570a990 0x562e258028d0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7ff92c005400 tx=0x7ff92c002fb0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.660+0000 7ff94012d800 1 -- 172.21.15.134:0/3490911137 shutdown_connections 2024-04-24T02:14:09.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.660+0000 7ff94012d800 1 --2- 172.21.15.134:0/3490911137 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x562e2570d2c0 0x562e25809a70 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.660+0000 7ff94012d800 1 --2- 172.21.15.134:0/3490911137 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7ff824036900 0x7ff824038dc0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.660+0000 7ff94012d800 1 --2- 172.21.15.134:0/3490911137 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562e2570a990 0x562e258028d0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.660+0000 7ff94012d800 1 -- 172.21.15.134:0/3490911137 >> 172.21.15.134:0/3490911137 conn(0x562e25704340 msgr2=0x562e257f4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:09.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.660+0000 7ff94012d800 1 -- 172.21.15.134:0/3490911137 shutdown_connections 2024-04-24T02:14:09.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.660+0000 7ff94012d800 1 -- 172.21.15.134:0/3490911137 wait complete. 2024-04-24T02:14:09.672 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-24T02:14:09.673 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-24T02:14:09.673 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-24T02:14:09.716 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:14:09.716 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:14:09.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.715+0000 7fc9bef46800 1 Processor -- start 2024-04-24T02:14:09.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.715+0000 7fc9bef46800 1 -- start start 2024-04-24T02:14:09.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.715+0000 7fc9bef46800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x556fef864970 0x556fef866d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.715+0000 7fc9bef46800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556fef722d40 con 0x556fef8672a0 2024-04-24T02:14:09.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.715+0000 7fc9bef46800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x556fef6f54d0 con 0x556fef864970 2024-04-24T02:14:09.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.716+0000 7fc9bca45640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x556fef864970 0x556fef866d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.716+0000 7fc9b4244640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x556fef8672a0 0x556fef869690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:46366/0 (socket says 172.21.15.134:46366) 2024-04-24T02:14:09.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.716+0000 7fc9b4244640 1 -- 172.21.15.134:0/2443177492 learned_addr learned my addr 172.21.15.134:0/2443177492 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:14:09.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.716+0000 7fc9bca45640 1 -- 172.21.15.134:0/2443177492 >> v1:172.21.15.104:6789/0 conn(0x556fef8672a0 legacy=0x556fef869690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.716+0000 7fc9bca45640 1 -- 172.21.15.134:0/2443177492 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fef721590 con 0x556fef864970 2024-04-24T02:14:09.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.718+0000 7fc9bca45640 1 --2- 172.21.15.134:0/2443177492 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556fef864970 0x556fef866d60 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac00a470 tx=0x7fc9ac01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff6eb63c7d457b22 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.718+0000 7fc9b7fff640 1 -- 172.21.15.134:0/2443177492 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9ac057070 con 0x556fef864970 2024-04-24T02:14:09.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.718+0000 7fc9b7fff640 1 -- 172.21.15.134:0/2443177492 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9ac052570 con 0x556fef864970 2024-04-24T02:14:09.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.718+0000 7fc9b7fff640 1 -- 172.21.15.134:0/2443177492 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9ac052870 con 0x556fef864970 2024-04-24T02:14:09.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.718+0000 7fc9bef46800 1 -- 172.21.15.134:0/2443177492 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556fef864970 msgr2=0x556fef866d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.718+0000 7fc9bef46800 1 --2- 172.21.15.134:0/2443177492 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556fef864970 0x556fef866d60 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac00a470 tx=0x7fc9ac01ce90 comp rx=0 tx=0).stop 2024-04-24T02:14:09.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.718+0000 7fc9bef46800 1 -- 172.21.15.134:0/2443177492 shutdown_connections 2024-04-24T02:14:09.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.718+0000 7fc9bef46800 1 --2- 172.21.15.134:0/2443177492 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556fef864970 0x556fef866d60 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.718+0000 7fc9bef46800 1 -- 172.21.15.134:0/2443177492 >> 172.21.15.134:0/2443177492 conn(0x556fef85e300 msgr2=0x556fef860720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:09.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.718+0000 7fc9bef46800 1 -- 172.21.15.134:0/2443177492 shutdown_connections 2024-04-24T02:14:09.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.718+0000 7fc9bef46800 1 -- 172.21.15.134:0/2443177492 wait complete. 2024-04-24T02:14:09.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.730+0000 7fc9bef46800 1 Processor -- start 2024-04-24T02:14:09.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.730+0000 7fc9bef46800 1 -- start start 2024-04-24T02:14:09.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.730+0000 7fc9bef46800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556fef864970 0x556fef8642b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.730+0000 7fc9bef46800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556fef7af3c0 con 0x556fef864970 2024-04-24T02:14:09.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.730+0000 7fc9bca45640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556fef864970 0x556fef8642b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.730+0000 7fc9bca45640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556fef864970 0x556fef8642b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43220/0 (socket says 172.21.15.134:43220) 2024-04-24T02:14:09.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.730+0000 7fc9bca45640 1 -- 172.21.15.134:0/3721752298 learned_addr learned my addr 172.21.15.134:0/3721752298 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:09.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.731+0000 7fc9bca45640 1 -- 172.21.15.134:0/3721752298 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fef862870 con 0x556fef864970 2024-04-24T02:14:09.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.731+0000 7fc9bca45640 1 --2- 172.21.15.134:0/3721752298 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556fef864970 0x556fef8642b0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac055040 tx=0x7fc9ac04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b2c7d347eef6262 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.731+0000 7fc8aae0d640 1 -- 172.21.15.134:0/3721752298 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9ac057070 con 0x556fef864970 2024-04-24T02:14:09.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.731+0000 7fc8aae0d640 1 -- 172.21.15.134:0/3721752298 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9ac063070 con 0x556fef864970 2024-04-24T02:14:09.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.731+0000 7fc8aae0d640 1 -- 172.21.15.134:0/3721752298 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9ac052720 con 0x556fef864970 2024-04-24T02:14:09.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.732+0000 7fc9bef46800 1 -- 172.21.15.134:0/3721752298 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556fef864970 msgr2=0x556fef8642b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.732+0000 7fc9bef46800 1 --2- 172.21.15.134:0/3721752298 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556fef864970 0x556fef8642b0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac055040 tx=0x7fc9ac04c000 comp rx=0 tx=0).stop 2024-04-24T02:14:09.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.732+0000 7fc9bef46800 1 -- 172.21.15.134:0/3721752298 shutdown_connections 2024-04-24T02:14:09.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.732+0000 7fc9bef46800 1 --2- 172.21.15.134:0/3721752298 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556fef864970 0x556fef8642b0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.732+0000 7fc9bef46800 1 -- 172.21.15.134:0/3721752298 >> 172.21.15.134:0/3721752298 conn(0x556fef85e300 msgr2=0x556fef9509c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:09.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.732+0000 7fc9bef46800 1 -- 172.21.15.134:0/3721752298 shutdown_connections 2024-04-24T02:14:09.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.732+0000 7fc9bef46800 1 -- 172.21.15.134:0/3721752298 wait complete. 2024-04-24T02:14:09.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.732+0000 7fc9bef46800 1 Processor -- start 2024-04-24T02:14:09.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.732+0000 7fc9bef46800 1 -- start start 2024-04-24T02:14:09.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.732+0000 7fc9bef46800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556fef864970 0x556fef95ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.732+0000 7fc9bef46800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556fef86d0c0 con 0x556fef864970 2024-04-24T02:14:09.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.733+0000 7fc9bca45640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556fef864970 0x556fef95ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.733+0000 7fc9bca45640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556fef864970 0x556fef95ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43234/0 (socket says 172.21.15.134:43234) 2024-04-24T02:14:09.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.733+0000 7fc9bca45640 1 -- 172.21.15.134:0/366597283 learned_addr learned my addr 172.21.15.134:0/366597283 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:09.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.733+0000 7fc9bca45640 1 -- 172.21.15.134:0/366597283 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fef95f1c0 con 0x556fef864970 2024-04-24T02:14:09.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.733+0000 7fc9bca45640 1 --2- 172.21.15.134:0/366597283 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556fef864970 0x556fef95ec80 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac055040 tx=0x7fc9ac002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.733+0000 7fc8a960a640 1 -- 172.21.15.134:0/366597283 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9ac052df0 con 0x556fef864970 2024-04-24T02:14:09.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.733+0000 7fc8a960a640 1 -- 172.21.15.134:0/366597283 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9ac06c070 con 0x556fef864970 2024-04-24T02:14:09.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.733+0000 7fc9bef46800 1 -- 172.21.15.134:0/366597283 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556fef95f450 con 0x556fef864970 2024-04-24T02:14:09.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.733+0000 7fc8a960a640 1 -- 172.21.15.134:0/366597283 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9ac05e5d0 con 0x556fef864970 2024-04-24T02:14:09.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.733+0000 7fc9bef46800 1 -- 172.21.15.134:0/366597283 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556fef962100 con 0x556fef864970 2024-04-24T02:14:09.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.734+0000 7fc8a960a640 1 -- 172.21.15.134:0/366597283 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc9ac077060 con 0x556fef864970 2024-04-24T02:14:09.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.734+0000 7fc8a960a640 1 --2- 172.21.15.134:0/366597283 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc8a4036950 0x7fc8a4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.734+0000 7fc8a960a640 1 -- 172.21.15.134:0/366597283 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fc9ac08e470 con 0x556fef864970 2024-04-24T02:14:09.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.734+0000 7fc9b4244640 1 --2- 172.21.15.134:0/366597283 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc8a4036950 0x7fc8a4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.734+0000 7fc9bef46800 1 --2- 172.21.15.134:0/366597283 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556fef8672a0 0x556fef965ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.734+0000 7fc9bef46800 1 -- 172.21.15.134:0/366597283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556fef966450 con 0x556fef8672a0 2024-04-24T02:14:09.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.735+0000 7fc9bd246640 1 --2- 172.21.15.134:0/366597283 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556fef8672a0 0x556fef965ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.735+0000 7fc9b4244640 1 --2- 172.21.15.134:0/366597283 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc8a4036950 0x7fc8a4038e10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4000f60 tx=0x7fc9a40012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.735+0000 7fc9bd246640 1 --2- 172.21.15.134:0/366597283 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556fef8672a0 0x556fef965ec0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.735+0000 7fc9bd246640 1 -- 172.21.15.134:0/366597283 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9b800a4a0 con 0x556fef8672a0 2024-04-24T02:14:09.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.735+0000 7fc9bef46800 1 -- 172.21.15.134:0/366597283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556fef963490 con 0x556fef8672a0 2024-04-24T02:14:09.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.735+0000 7fc9bd246640 1 -- 172.21.15.134:0/366597283 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc9b800a4a0 con 0x556fef8672a0 2024-04-24T02:14:09.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.735+0000 7fc9bef46800 1 -- 172.21.15.134:0/366597283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556fef968290 con 0x556fef8672a0 2024-04-24T02:14:09.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.736+0000 7fc9bd246640 1 -- 172.21.15.134:0/366597283 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc9b800a4a0 con 0x556fef8672a0 2024-04-24T02:14:09.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.736+0000 7fc9bef46800 1 -- 172.21.15.134:0/366597283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556fef9675d0 con 0x556fef8672a0 2024-04-24T02:14:09.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.736+0000 7fc9bd246640 1 -- 172.21.15.134:0/366597283 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc9b800a4a0 con 0x556fef8672a0 2024-04-24T02:14:09.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.736+0000 7fc9bef46800 1 -- 172.21.15.134:0/366597283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556fef967a20 con 0x556fef8672a0 2024-04-24T02:14:09.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.736+0000 7fc9bd246640 1 -- 172.21.15.134:0/366597283 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc9b800a4a0 con 0x556fef8672a0 2024-04-24T02:14:09.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.737+0000 7fc9bef46800 1 Processor -- start 2024-04-24T02:14:09.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.737+0000 7fc9bef46800 1 -- start start 2024-04-24T02:14:09.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.737+0000 7fc9bef46800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556fef977080 0x556fef9774a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.737+0000 7fc9bef46800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556fef7556b0 con 0x556fef977080 2024-04-24T02:14:09.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.737+0000 7fc9b4244640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556fef977080 0x556fef9774a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.737+0000 7fc9b4244640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556fef977080 0x556fef9774a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43244/0 (socket says 172.21.15.134:43244) 2024-04-24T02:14:09.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.737+0000 7fc9b4244640 1 -- 172.21.15.134:0/819122117 learned_addr learned my addr 172.21.15.134:0/819122117 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:09.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.737+0000 7fc9b4244640 1 -- 172.21.15.134:0/819122117 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fef9779e0 con 0x556fef977080 2024-04-24T02:14:09.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.738+0000 7fc9b4244640 1 --2- 172.21.15.134:0/819122117 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556fef977080 0x556fef9774a0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4001ed0 tx=0x7fc9a400d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.738+0000 7fc8a27fc640 1 -- 172.21.15.134:0/819122117 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9a401b550 con 0x556fef977080 2024-04-24T02:14:09.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.738+0000 7fc8a27fc640 1 -- 172.21.15.134:0/819122117 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9a401b6f0 con 0x556fef977080 2024-04-24T02:14:09.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.738+0000 7fc9bef46800 1 -- 172.21.15.134:0/819122117 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556fef978450 con 0x556fef977080 2024-04-24T02:14:09.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.738+0000 7fc8a27fc640 1 -- 172.21.15.134:0/819122117 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9a401b9d0 con 0x556fef977080 2024-04-24T02:14:09.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.738+0000 7fc9bef46800 1 -- 172.21.15.134:0/819122117 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556fef978950 con 0x556fef977080 2024-04-24T02:14:09.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.738+0000 7fc8a27fc640 1 -- 172.21.15.134:0/819122117 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc9a4023020 con 0x556fef977080 2024-04-24T02:14:09.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.739+0000 7fc8a27fc640 1 --2- 172.21.15.134:0/819122117 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc894036950 0x7fc894038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.739+0000 7fc8a27fc640 1 -- 172.21.15.134:0/819122117 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fc9a4021020 con 0x556fef977080 2024-04-24T02:14:09.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.739+0000 7fc9bd246640 1 --2- 172.21.15.134:0/819122117 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc894036950 0x7fc894038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.739+0000 7fc9bef46800 1 Processor -- start 2024-04-24T02:14:09.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.739+0000 7fc9bd246640 1 --2- 172.21.15.134:0/819122117 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc894036950 0x7fc894038e10 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x556fef9670f0 tx=0x7fc9b8005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.739+0000 7fc9bef46800 1 -- start start 2024-04-24T02:14:09.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.739+0000 7fc9bef46800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556fef9843c0 0x556fef9847e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.739+0000 7fc9bef46800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556fef862b30 con 0x556fef9843c0 2024-04-24T02:14:09.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.739+0000 7fc9b4244640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556fef9843c0 0x556fef9847e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.739+0000 7fc9b4244640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556fef9843c0 0x556fef9847e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43252/0 (socket says 172.21.15.134:43252) 2024-04-24T02:14:09.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.739+0000 7fc9b4244640 1 -- 172.21.15.134:0/3386172580 learned_addr learned my addr 172.21.15.134:0/3386172580 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:09.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.740+0000 7fc9b4244640 1 -- 172.21.15.134:0/3386172580 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fef984db0 con 0x556fef9843c0 2024-04-24T02:14:09.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.740+0000 7fc9b4244640 1 --2- 172.21.15.134:0/3386172580 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556fef9843c0 0x556fef9847e0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fc9a404ce10 tx=0x7fc9a4019ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2d7cac57f2661d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.740+0000 7fc893fff640 1 -- 172.21.15.134:0/3386172580 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9a4041070 con 0x556fef9843c0 2024-04-24T02:14:09.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.740+0000 7fc893fff640 1 -- 172.21.15.134:0/3386172580 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9a401bd50 con 0x556fef9843c0 2024-04-24T02:14:09.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.740+0000 7fc893fff640 1 -- 172.21.15.134:0/3386172580 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9a4025a30 con 0x556fef9843c0 2024-04-24T02:14:09.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.740+0000 7fc9bef46800 1 -- 172.21.15.134:0/3386172580 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556fef9843c0 msgr2=0x556fef9847e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.740+0000 7fc9bef46800 1 --2- 172.21.15.134:0/3386172580 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556fef9843c0 0x556fef9847e0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fc9a404ce10 tx=0x7fc9a4019ce0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.740+0000 7fc9bef46800 1 -- 172.21.15.134:0/3386172580 shutdown_connections 2024-04-24T02:14:09.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.740+0000 7fc9bef46800 1 --2- 172.21.15.134:0/3386172580 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556fef9843c0 0x556fef9847e0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.740+0000 7fc9bef46800 1 -- 172.21.15.134:0/3386172580 >> 172.21.15.134:0/3386172580 conn(0x556fef980720 msgr2=0x556fef97e780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:09.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.740+0000 7fc9bef46800 1 -- 172.21.15.134:0/3386172580 shutdown_connections 2024-04-24T02:14:09.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.740+0000 7fc9bef46800 1 -- 172.21.15.134:0/3386172580 wait complete. 2024-04-24T02:14:09.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.741+0000 7fc9bef46800 1 Processor -- start 2024-04-24T02:14:09.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.741+0000 7fc9bef46800 1 -- start start 2024-04-24T02:14:09.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.741+0000 7fc9bef46800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556fef9843c0 0x556fef98ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.741+0000 7fc9bef46800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556fef985520 con 0x556fef9843c0 2024-04-24T02:14:09.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.741+0000 7fc9b4244640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556fef9843c0 0x556fef98ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.741+0000 7fc9b4244640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556fef9843c0 0x556fef98ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43264/0 (socket says 172.21.15.134:43264) 2024-04-24T02:14:09.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.741+0000 7fc9b4244640 1 -- 172.21.15.134:0/111821544 learned_addr learned my addr 172.21.15.134:0/111821544 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:09.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.741+0000 7fc9b4244640 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fef98bfc0 con 0x556fef9843c0 2024-04-24T02:14:09.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.741+0000 7fc9b4244640 1 --2- 172.21.15.134:0/111821544 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556fef9843c0 0x556fef98ba80 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4019f50 tx=0x7fc9a404cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.742+0000 7fc8927fc640 1 -- 172.21.15.134:0/111821544 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9a4041070 con 0x556fef9843c0 2024-04-24T02:14:09.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.742+0000 7fc8927fc640 1 -- 172.21.15.134:0/111821544 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9a400cc60 con 0x556fef9843c0 2024-04-24T02:14:09.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.742+0000 7fc8927fc640 1 -- 172.21.15.134:0/111821544 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9a404e7f0 con 0x556fef9843c0 2024-04-24T02:14:09.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.742+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556fef98c250 con 0x556fef9843c0 2024-04-24T02:14:09.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.742+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556fef98c250 con 0x556fef9843c0 2024-04-24T02:14:09.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.742+0000 7fc8927fc640 1 -- 172.21.15.134:0/111821544 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc9a404ea90 con 0x556fef9843c0 2024-04-24T02:14:09.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.742+0000 7fc8927fc640 1 --2- 172.21.15.134:0/111821544 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc888036900 0x7fc888038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.743+0000 7fc8927fc640 1 -- 172.21.15.134:0/111821544 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fc9a4039bb0 con 0x556fef9843c0 2024-04-24T02:14:09.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.743+0000 7fc9bd246640 1 --2- 172.21.15.134:0/111821544 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc888036900 0x7fc888038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.743+0000 7fc9bef46800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.743+0000 7fc9bef46800 1 --2- 172.21.15.134:0/111821544 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556fef997380 0x556fef999840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.743+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556fef999f90 con 0x556fef997380 2024-04-24T02:14:09.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.743+0000 7fc9bca45640 1 --2- 172.21.15.134:0/111821544 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556fef997380 0x556fef999840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.743+0000 7fc9bd246640 1 --2- 172.21.15.134:0/111821544 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc888036900 0x7fc888038dc0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x556fef9633e0 tx=0x7fc9b801f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.743+0000 7fc9bca45640 1 --2- 172.21.15.134:0/111821544 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556fef997380 0x556fef999840 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.743+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9ac05ebf0 con 0x556fef997380 2024-04-24T02:14:09.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.743+0000 7fc9bef46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:09.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.743+0000 7fc9bef46800 20 realm 2024-04-24T02:14:09.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.743+0000 7fc9bef46800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.743+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556fef99a3a0 con 0x556fef997380 2024-04-24T02:14:09.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.744+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9ac05ebf0 con 0x556fef997380 2024-04-24T02:14:09.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.744+0000 7fc9bef46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:09.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.744+0000 7fc9bef46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:14:09.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.744+0000 7fc9bef46800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.744+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556fef99ac70 con 0x556fef997380 2024-04-24T02:14:09.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.744+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9ac05ebf0 con 0x556fef997380 2024-04-24T02:14:09.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.744+0000 7fc9bef46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:09.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.744+0000 7fc9bef46800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.744+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556fef99b010 con 0x556fef997380 2024-04-24T02:14:09.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.744+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc9ac05ebf0 con 0x556fef997380 2024-04-24T02:14:09.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.744+0000 7fc9bef46800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:14:09.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.744+0000 7fc9bef46800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.744+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556fef99b470 con 0x556fef997380 2024-04-24T02:14:09.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.744+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc9ac05ebf0 con 0x556fef997380 2024-04-24T02:14:09.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.744+0000 7fc9bef46800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:14:09.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.744+0000 7fc9bef46800 20 searching for the correct realm 2024-04-24T02:14:09.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.744+0000 7fc9bef46800 1 --2- 172.21.15.134:0/111821544 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x556fef99d4c0 0x556fef99f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.744+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fef99ffa0 con 0x556fef99d4c0 2024-04-24T02:14:09.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.745+0000 7fc9b4244640 1 --2- 172.21.15.134:0/111821544 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x556fef99d4c0 0x556fef99f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.745+0000 7fc9b4244640 1 --2- 172.21.15.134:0/111821544 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x556fef99d4c0 0x556fef99f8d0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.745+0000 7fc9b4244640 1 -- 172.21.15.134:0/111821544 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9a4056040 con 0x556fef99d4c0 2024-04-24T02:14:09.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.745+0000 7fc9b4244640 1 --2- 172.21.15.134:0/111821544 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fc9a40462b0 0x7fc9a40306d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.745+0000 7fc9b4244640 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fef99ffa0 con 0x7fc9a40462b0 2024-04-24T02:14:09.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.745+0000 7fc9bd246640 1 --2- 172.21.15.134:0/111821544 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fc9a40462b0 0x7fc9a40306d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.746+0000 7fc9bd246640 1 --2- 172.21.15.134:0/111821544 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fc9a40462b0 0x7fc9a40306d0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.746+0000 7fc9bd246640 1 -- 172.21.15.134:0/111821544 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9b801f070 con 0x7fc9a40462b0 2024-04-24T02:14:09.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.746+0000 7fc9bd246640 1 --2- 172.21.15.134:0/111821544 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fc9b8031040 0x7fc9b8032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.746+0000 7fc9bd246640 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fef99ffa0 con 0x7fc9b8031040 2024-04-24T02:14:09.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.746+0000 7fc9bca45640 1 --2- 172.21.15.134:0/111821544 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fc9b8031040 0x7fc9b8032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.747+0000 7fc9bca45640 1 --2- 172.21.15.134:0/111821544 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fc9b8031040 0x7fc9b8032940 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.747+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9ac05ebf0 con 0x7fc9b8031040 2024-04-24T02:14:09.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.747+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fef99ffa0 con 0x556fef997380 2024-04-24T02:14:09.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.747+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9ac05ebf0 con 0x556fef997380 2024-04-24T02:14:09.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.747+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fef99ffa0 con 0x556fef997380 2024-04-24T02:14:09.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.747+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc9ac05ebf0 con 0x556fef997380 2024-04-24T02:14:09.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.747+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fef99ffa0 con 0x7fc9b8031040 2024-04-24T02:14:09.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.748+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9ac05ebf0 con 0x7fc9b8031040 2024-04-24T02:14:09.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.748+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fef99ffa0 con 0x7fc9a40462b0 2024-04-24T02:14:09.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.748+0000 7fc9bd246640 1 -- 172.21.15.134:0/111821544 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9b801f070 con 0x7fc9a40462b0 2024-04-24T02:14:09.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.748+0000 7fc9bd246640 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fef99ffa0 con 0x7fc9a40462b0 2024-04-24T02:14:09.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.748+0000 7fc9bd246640 1 -- 172.21.15.134:0/111821544 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9b801f070 con 0x7fc9a40462b0 2024-04-24T02:14:09.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.748+0000 7fc9bd246640 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fef99ffa0 con 0x556fef99d4c0 2024-04-24T02:14:09.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.748+0000 7fc9b4244640 1 -- 172.21.15.134:0/111821544 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9a4056040 con 0x556fef99d4c0 2024-04-24T02:14:09.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.748+0000 7fc9b4244640 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fef99ffa0 con 0x556fef997380 2024-04-24T02:14:09.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.748+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9ac05ebf0 con 0x556fef997380 2024-04-24T02:14:09.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.749+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fef99ffa0 con 0x7fc9b8031040 2024-04-24T02:14:09.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.749+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9ac05ebf0 con 0x7fc9b8031040 2024-04-24T02:14:09.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.749+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fef99ffa0 con 0x556fef997380 2024-04-24T02:14:09.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.749+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9ac05ebf0 con 0x556fef997380 2024-04-24T02:14:09.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.749+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fef99ffa0 con 0x7fc9a40462b0 2024-04-24T02:14:09.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.749+0000 7fc9bd246640 1 -- 172.21.15.134:0/111821544 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc9b801f070 con 0x7fc9a40462b0 2024-04-24T02:14:09.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.749+0000 7fc9bd246640 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fef99ffa0 con 0x556fef99d4c0 2024-04-24T02:14:09.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.749+0000 7fc9b4244640 1 -- 172.21.15.134:0/111821544 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9a4056040 con 0x556fef99d4c0 2024-04-24T02:14:09.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.750+0000 7fc9b4244640 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fef99ffa0 con 0x556fef99d4c0 2024-04-24T02:14:09.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.750+0000 7fc9b4244640 1 -- 172.21.15.134:0/111821544 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9a4056040 con 0x556fef99d4c0 2024-04-24T02:14:09.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.750+0000 7fc9b4244640 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fef99ffa0 con 0x7fc9a40462b0 2024-04-24T02:14:09.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.750+0000 7fc9bd246640 1 -- 172.21.15.134:0/111821544 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9b801f070 con 0x7fc9a40462b0 2024-04-24T02:14:09.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.750+0000 7fc9bd246640 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fef99ffa0 con 0x556fef99d4c0 2024-04-24T02:14:09.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.750+0000 7fc9b4244640 1 -- 172.21.15.134:0/111821544 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9a4056040 con 0x556fef99d4c0 2024-04-24T02:14:09.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.750+0000 7fc9b4244640 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fef99ffa0 con 0x556fef99d4c0 2024-04-24T02:14:09.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.750+0000 7fc9b4244640 1 -- 172.21.15.134:0/111821544 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9a4056040 con 0x556fef99d4c0 2024-04-24T02:14:09.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.750+0000 7fc9b4244640 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fef99ffa0 con 0x556fef997380 2024-04-24T02:14:09.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.751+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9ac05ebf0 con 0x556fef997380 2024-04-24T02:14:09.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.751+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fef99ffa0 con 0x556fef997380 2024-04-24T02:14:09.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.751+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fc9ac05ebf0 con 0x556fef997380 2024-04-24T02:14:09.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.751+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fef99ffa0 con 0x7fc9b8031040 2024-04-24T02:14:09.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.751+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9ac05ebf0 con 0x7fc9b8031040 2024-04-24T02:14:09.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.751+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fef99ffa0 con 0x556fef99d4c0 2024-04-24T02:14:09.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.751+0000 7fc9b4244640 1 -- 172.21.15.134:0/111821544 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9a4056040 con 0x556fef99d4c0 2024-04-24T02:14:09.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.751+0000 7fc9b4244640 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fef99ffa0 con 0x7fc9a40462b0 2024-04-24T02:14:09.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.752+0000 7fc9bd246640 1 -- 172.21.15.134:0/111821544 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9b801f070 con 0x7fc9a40462b0 2024-04-24T02:14:09.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.752+0000 7fc9bd246640 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fef99ffa0 con 0x556fef997380 2024-04-24T02:14:09.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.752+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9ac05ebf0 con 0x556fef997380 2024-04-24T02:14:09.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.752+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fef99ffa0 con 0x7fc9b8031040 2024-04-24T02:14:09.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.752+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9ac05ebf0 con 0x7fc9b8031040 2024-04-24T02:14:09.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.752+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fef99ffa0 con 0x556fef99d4c0 2024-04-24T02:14:09.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.752+0000 7fc9b4244640 1 -- 172.21.15.134:0/111821544 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9a4056040 con 0x556fef99d4c0 2024-04-24T02:14:09.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.752+0000 7fc9b4244640 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fef99ffa0 con 0x7fc9b8031040 2024-04-24T02:14:09.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.753+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9ac05ebf0 con 0x7fc9b8031040 2024-04-24T02:14:09.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.753+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fef99ffa0 con 0x7fc9a40462b0 2024-04-24T02:14:09.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.753+0000 7fc9bd246640 1 -- 172.21.15.134:0/111821544 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9b8040040 con 0x7fc9a40462b0 2024-04-24T02:14:09.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.753+0000 7fc9bd246640 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fef99ffa0 con 0x556fef99d4c0 2024-04-24T02:14:09.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.753+0000 7fc9b4244640 1 -- 172.21.15.134:0/111821544 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9a4056040 con 0x556fef99d4c0 2024-04-24T02:14:09.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.753+0000 7fc9b4244640 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fef99ffa0 con 0x7fc9a40462b0 2024-04-24T02:14:09.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.753+0000 7fc9bd246640 1 -- 172.21.15.134:0/111821544 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9b8040040 con 0x7fc9a40462b0 2024-04-24T02:14:09.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.753+0000 7fc9bd246640 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fef99ffa0 con 0x556fef997380 2024-04-24T02:14:09.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.754+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc9ac05ebf0 con 0x556fef997380 2024-04-24T02:14:09.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.754+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556fef99ffa0 con 0x7fc9a40462b0 2024-04-24T02:14:09.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.754+0000 7fc9bd246640 1 -- 172.21.15.134:0/111821544 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9b8040040 con 0x7fc9a40462b0 2024-04-24T02:14:09.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.754+0000 7fc9bef46800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:14:09.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.754+0000 7fc9bef46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:14:09.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.754+0000 7fc9bef46800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:14:09.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.754+0000 7fc9bef46800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:14:09.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.754+0000 7fc9bef46800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:14:09.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.754+0000 7fc9bef46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:14:09.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.754+0000 7fc9bef46800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.754+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556fef99bf10 con 0x556fef997380 2024-04-24T02:14:09.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.754+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9ac05ebf0 con 0x556fef997380 2024-04-24T02:14:09.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.754+0000 7fc9bef46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:09.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.754+0000 7fc9bef46800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.754+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556fef99c7b0 con 0x556fef997380 2024-04-24T02:14:09.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.754+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc9ac05ebf0 con 0x556fef997380 2024-04-24T02:14:09.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.755+0000 7fc9bef46800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:14:09.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.755+0000 7fc9bef46800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.755+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556fef99bb50 con 0x556fef997380 2024-04-24T02:14:09.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.755+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc9ac05ebf0 con 0x556fef997380 2024-04-24T02:14:09.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.755+0000 7fc9bef46800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:14:09.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.755+0000 7fc9bef46800 20 zone default found 2024-04-24T02:14:09.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.755+0000 7fc9bef46800 4 Realm: () 2024-04-24T02:14:09.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.755+0000 7fc9bef46800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:14:09.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.755+0000 7fc9bef46800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:14:09.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.755+0000 7fc9bef46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:14:09.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.755+0000 7fc9bef46800 20 zonegroup default 2024-04-24T02:14:09.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.755+0000 7fc9bef46800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.755+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556fef99c7b0 con 0x7fc9b8031040 2024-04-24T02:14:09.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.755+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc9ac05ebf0 con 0x7fc9b8031040 2024-04-24T02:14:09.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.755+0000 7fc9bef46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:09.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.755+0000 7fc9bef46800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.755+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556fef9a1e00 con 0x556fef99d4c0 2024-04-24T02:14:09.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.756+0000 7fc9b4244640 1 -- 172.21.15.134:0/111821544 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc9a4056040 con 0x556fef99d4c0 2024-04-24T02:14:09.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.756+0000 7fc9bef46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:09.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.756+0000 7fc9bef46800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.756+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556fef9a21a0 con 0x556fef99d4c0 2024-04-24T02:14:09.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.756+0000 7fc9b4244640 1 -- 172.21.15.134:0/111821544 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc9a4056040 con 0x556fef99d4c0 2024-04-24T02:14:09.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.756+0000 7fc9bef46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:09.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.756+0000 7fc9bef46800 20 started sync module instance, tier type = 2024-04-24T02:14:09.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.756+0000 7fc9bef46800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:14:09.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.756+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fef9a12a0 con 0x7fc9a40462b0 2024-04-24T02:14:09.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.757+0000 7fc9bd246640 1 -- 172.21.15.134:0/111821544 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(44 notify.0 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9b8040040 con 0x7fc9a40462b0 2024-04-24T02:14:09.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.757+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93939249583808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fef9a29f0 con 0x7fc9a40462b0 2024-04-24T02:14:09.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.757+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fef9a3240 con 0x556fef997380 2024-04-24T02:14:09.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.758+0000 7fc9bd246640 1 -- 172.21.15.134:0/111821544 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93939249583808] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9b8040040 con 0x7fc9a40462b0 2024-04-24T02:14:09.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.758+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9ac05ebf0 con 0x556fef997380 2024-04-24T02:14:09.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.758+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93939249587520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fef9a2f30 con 0x556fef997380 2024-04-24T02:14:09.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.758+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fef9a39f0 con 0x556fef99d4c0 2024-04-24T02:14:09.790 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-24T02:14:09.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.759+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93939249587520] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9ac05ebf0 con 0x556fef997380 2024-04-24T02:14:09.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.759+0000 7fc9b4244640 1 -- 172.21.15.134:0/111821544 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9a4056040 con 0x556fef99d4c0 2024-04-24T02:14:09.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.759+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93939249591488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fef9a3de0 con 0x556fef99d4c0 2024-04-24T02:14:09.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.759+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fef9a47e0 con 0x7fc9a40462b0 2024-04-24T02:14:09.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.760+0000 7fc9bd246640 1 -- 172.21.15.134:0/111821544 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(50 notify.3 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9b8040040 con 0x7fc9a40462b0 2024-04-24T02:14:09.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.760+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93939249595120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fef9a5080 con 0x7fc9a40462b0 2024-04-24T02:14:09.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.760+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fef9a5b40 con 0x556fef997380 2024-04-24T02:14:09.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.760+0000 7fc9b4244640 1 -- 172.21.15.134:0/111821544 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93939249591488] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9a4056040 con 0x556fef99d4c0 2024-04-24T02:14:09.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.761+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9ac05ebf0 con 0x556fef997380 2024-04-24T02:14:09.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.762+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93939249600112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fef9a5b40 con 0x556fef997380 2024-04-24T02:14:09.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.762+0000 7fc9bd246640 1 -- 172.21.15.134:0/111821544 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93939249595120] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9b8040040 con 0x7fc9a40462b0 2024-04-24T02:14:09.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.762+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fef9a6580 con 0x7fc9b8031040 2024-04-24T02:14:09.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.763+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(54 notify.5 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9ac05ebf0 con 0x7fc9b8031040 2024-04-24T02:14:09.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.763+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93939249600112] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9ac05ebf0 con 0x556fef997380 2024-04-24T02:14:09.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.763+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93939249597392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fef9a60d0 con 0x7fc9b8031040 2024-04-24T02:14:09.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.763+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fef9a60d0 con 0x7fc9b8031040 2024-04-24T02:14:09.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.764+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 93939249597392] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9ac05ebf0 con 0x7fc9b8031040 2024-04-24T02:14:09.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.764+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(56 notify.6 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9ac05ebf0 con 0x7fc9b8031040 2024-04-24T02:14:09.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.764+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93939249588640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fef9a69c0 con 0x7fc9b8031040 2024-04-24T02:14:09.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.764+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fef9a73c0 con 0x7fc9b8031040 2024-04-24T02:14:09.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.765+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 93939249588640] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9ac05ebf0 con 0x7fc9b8031040 2024-04-24T02:14:09.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.765+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(58 notify.7 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9ac05ebf0 con 0x7fc9b8031040 2024-04-24T02:14:09.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.765+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93939249606352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fef9a75a0 con 0x7fc9b8031040 2024-04-24T02:14:09.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.765+0000 7fc9bef46800 20 add_watcher() i=0 2024-04-24T02:14:09.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.765+0000 7fc9bef46800 20 add_watcher() i=1 2024-04-24T02:14:09.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.765+0000 7fc9bef46800 20 add_watcher() i=2 2024-04-24T02:14:09.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.765+0000 7fc9bef46800 20 add_watcher() i=3 2024-04-24T02:14:09.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.765+0000 7fc9bef46800 20 add_watcher() i=4 2024-04-24T02:14:09.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.765+0000 7fc9bef46800 20 add_watcher() i=5 2024-04-24T02:14:09.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.765+0000 7fc9bef46800 20 add_watcher() i=6 2024-04-24T02:14:09.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.766+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 93939249606352] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9ac05ebf0 con 0x7fc9b8031040 2024-04-24T02:14:09.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.766+0000 7fc9bef46800 20 add_watcher() i=7 2024-04-24T02:14:09.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.766+0000 7fc9bef46800 2 all 8 watchers are set, enabling cache 2024-04-24T02:14:09.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.767+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556fef9aa970 con 0x556fef997380 2024-04-24T02:14:09.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.767+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc9ac05ebf0 con 0x556fef997380 2024-04-24T02:14:09.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.767+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93939249607824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fef9a7d60 con 0x556fef997380 2024-04-24T02:14:09.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.768+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93939249607824] v32'244 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc9ac05ebf0 con 0x556fef997380 2024-04-24T02:14:09.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.768+0000 7fc872fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:14:09.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.768+0000 7fc9bef46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:14:09.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.768+0000 7fc9bef46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:14:09.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.768+0000 7fc9bef46800 5 note: GC not initialized 2024-04-24T02:14:09.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.768+0000 7fc871fe3640 20 reqs_thread_entry: start 2024-04-24T02:14:09.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.768+0000 7fc9bef46800 20 init_complete bucket index max shards: 11 2024-04-24T02:14:09.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.768+0000 7fc9bef46800 20 Filter name: none 2024-04-24T02:14:09.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.769+0000 7fc7e37fe640 20 reqs_thread_entry: start 2024-04-24T02:14:09.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.769+0000 7fc9bef46800 20 rados->read ofs=0 len=0 2024-04-24T02:14:09.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.769+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556fef9dd680 con 0x556fef997380 2024-04-24T02:14:09.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.769+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fc9ac05ebf0 con 0x556fef997380 2024-04-24T02:14:09.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.769+0000 7fc9bef46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:09.795 INFO:teuthology.orchestra.run.smithi134.stderr:could not fetch user info: no user info saved 2024-04-24T02:14:09.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.770+0000 7fc872fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:14:09.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.770+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93939249607824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fef9dd640 con 0x556fef997380 2024-04-24T02:14:09.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.770+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93939249607824] v32'245 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc9ac05ebf0 con 0x556fef997380 2024-04-24T02:14:09.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.771+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93939249583808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fef9dd640 con 0x7fc9a40462b0 2024-04-24T02:14:09.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.772+0000 7fc9bd246640 1 -- 172.21.15.134:0/111821544 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93939249583808] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9b8040040 con 0x7fc9a40462b0 2024-04-24T02:14:09.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.772+0000 7fc9bef46800 20 remove_watcher() i=0 2024-04-24T02:14:09.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.772+0000 7fc9bef46800 2 removed watcher, disabling cache 2024-04-24T02:14:09.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.772+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93939249587520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fef9dd640 con 0x556fef997380 2024-04-24T02:14:09.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.773+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93939249587520] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9ac05ebf0 con 0x556fef997380 2024-04-24T02:14:09.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.773+0000 7fc9bef46800 20 remove_watcher() i=1 2024-04-24T02:14:09.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.773+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93939249591488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fef9dd640 con 0x556fef99d4c0 2024-04-24T02:14:09.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.774+0000 7fc9b4244640 1 -- 172.21.15.134:0/111821544 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93939249591488] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9a4056040 con 0x556fef99d4c0 2024-04-24T02:14:09.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.774+0000 7fc9bef46800 20 remove_watcher() i=2 2024-04-24T02:14:09.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.774+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93939249595120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fef9a34c0 con 0x7fc9a40462b0 2024-04-24T02:14:09.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.775+0000 7fc9bd246640 1 -- 172.21.15.134:0/111821544 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93939249595120] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9b8040040 con 0x7fc9a40462b0 2024-04-24T02:14:09.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.775+0000 7fc9bef46800 20 remove_watcher() i=3 2024-04-24T02:14:09.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.776+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93939249600112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fef9a34c0 con 0x556fef997380 2024-04-24T02:14:09.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.777+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93939249600112] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9ac05ebf0 con 0x556fef997380 2024-04-24T02:14:09.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.777+0000 7fc9bef46800 20 remove_watcher() i=4 2024-04-24T02:14:09.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.777+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93939249597392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fef9a5670 con 0x7fc9b8031040 2024-04-24T02:14:09.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.778+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93939249597392] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9ac05ebf0 con 0x7fc9b8031040 2024-04-24T02:14:09.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.778+0000 7fc9bef46800 20 remove_watcher() i=5 2024-04-24T02:14:09.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.778+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93939249588640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fef9a34c0 con 0x7fc9b8031040 2024-04-24T02:14:09.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.779+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93939249588640] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9ac05ebf0 con 0x7fc9b8031040 2024-04-24T02:14:09.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.779+0000 7fc9bef46800 20 remove_watcher() i=6 2024-04-24T02:14:09.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.779+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93939249606352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556fef9a4bd0 con 0x7fc9b8031040 2024-04-24T02:14:09.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.780+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93939249606352] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9ac05ebf0 con 0x7fc9b8031040 2024-04-24T02:14:09.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.780+0000 7fc9bef46800 20 remove_watcher() i=7 2024-04-24T02:14:09.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.780+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fc9b8031040 msgr2=0x7fc9b8032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.780+0000 7fc9bef46800 1 --2- 172.21.15.134:0/111821544 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fc9b8031040 0x7fc9b8032940 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.780+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556fef997380 msgr2=0x556fef999840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.780+0000 7fc9bef46800 1 --2- 172.21.15.134:0/111821544 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556fef997380 0x556fef999840 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.780+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fc9a40462b0 msgr2=0x7fc9a40306d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.780+0000 7fc9bef46800 1 --2- 172.21.15.134:0/111821544 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fc9a40462b0 0x7fc9a40306d0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.780+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x556fef99d4c0 msgr2=0x556fef99f8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.780+0000 7fc9bef46800 1 --2- 172.21.15.134:0/111821544 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x556fef99d4c0 0x556fef99f8d0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.780+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc888036900 msgr2=0x7fc888038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.780+0000 7fc9bef46800 1 --2- 172.21.15.134:0/111821544 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc888036900 0x7fc888038dc0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x556fef9633e0 tx=0x7fc9b801f000 comp rx=0 tx=0).stop 2024-04-24T02:14:09.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.780+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556fef9843c0 msgr2=0x556fef98ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.780+0000 7fc9bca45640 1 -- 172.21.15.134:0/111821544 reap_dead start 2024-04-24T02:14:09.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.780+0000 7fc9bef46800 1 --2- 172.21.15.134:0/111821544 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556fef9843c0 0x556fef98ba80 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4019f50 tx=0x7fc9a404cda0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.780+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 shutdown_connections 2024-04-24T02:14:09.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.780+0000 7fc9bef46800 1 --2- 172.21.15.134:0/111821544 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556fef9843c0 0x556fef98ba80 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.780+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 >> 172.21.15.134:0/111821544 conn(0x556fef980720 msgr2=0x556fef97dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:09.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.780+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 shutdown_connections 2024-04-24T02:14:09.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.780+0000 7fc9bef46800 1 -- 172.21.15.134:0/111821544 wait complete. 2024-04-24T02:14:09.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.781+0000 7fc9bef46800 1 -- 172.21.15.134:0/819122117 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc894036950 msgr2=0x7fc894038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.781+0000 7fc9bef46800 1 --2- 172.21.15.134:0/819122117 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc894036950 0x7fc894038e10 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x556fef9670f0 tx=0x7fc9b8005840 comp rx=0 tx=0).stop 2024-04-24T02:14:09.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.781+0000 7fc9bef46800 1 -- 172.21.15.134:0/819122117 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556fef977080 msgr2=0x556fef9774a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.781+0000 7fc9bef46800 1 --2- 172.21.15.134:0/819122117 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556fef977080 0x556fef9774a0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4001ed0 tx=0x7fc9a400d7a0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.781+0000 7fc9bef46800 1 -- 172.21.15.134:0/819122117 shutdown_connections 2024-04-24T02:14:09.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.781+0000 7fc9bef46800 1 --2- 172.21.15.134:0/819122117 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc894036950 0x7fc894038e10 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.781+0000 7fc9bef46800 1 --2- 172.21.15.134:0/819122117 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556fef977080 0x556fef9774a0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.781+0000 7fc9bef46800 1 -- 172.21.15.134:0/819122117 >> 172.21.15.134:0/819122117 conn(0x556fef96b120 msgr2=0x556fef96b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:09.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.781+0000 7fc9bef46800 1 -- 172.21.15.134:0/819122117 shutdown_connections 2024-04-24T02:14:09.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.781+0000 7fc9bef46800 1 -- 172.21.15.134:0/819122117 wait complete. 2024-04-24T02:14:09.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.781+0000 7fc9bef46800 1 -- 172.21.15.134:0/366597283 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556fef8672a0 msgr2=0x556fef965ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.781+0000 7fc9bef46800 1 --2- 172.21.15.134:0/366597283 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556fef8672a0 0x556fef965ec0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.781+0000 7fc9bef46800 1 -- 172.21.15.134:0/366597283 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc8a4036950 msgr2=0x7fc8a4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.781+0000 7fc9bef46800 1 --2- 172.21.15.134:0/366597283 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc8a4036950 0x7fc8a4038e10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4000f60 tx=0x7fc9a40012b0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.781+0000 7fc9bef46800 1 -- 172.21.15.134:0/366597283 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556fef864970 msgr2=0x556fef95ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.781+0000 7fc9bef46800 1 --2- 172.21.15.134:0/366597283 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556fef864970 0x556fef95ec80 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac055040 tx=0x7fc9ac002fb0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.781+0000 7fc9bef46800 1 -- 172.21.15.134:0/366597283 shutdown_connections 2024-04-24T02:14:09.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.781+0000 7fc9bef46800 1 --2- 172.21.15.134:0/366597283 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556fef8672a0 0x556fef965ec0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.781+0000 7fc9bef46800 1 --2- 172.21.15.134:0/366597283 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc8a4036950 0x7fc8a4038e10 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.781+0000 7fc9bef46800 1 --2- 172.21.15.134:0/366597283 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556fef864970 0x556fef95ec80 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.781+0000 7fc9bef46800 1 -- 172.21.15.134:0/366597283 >> 172.21.15.134:0/366597283 conn(0x556fef85e300 msgr2=0x556fef950590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:09.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.781+0000 7fc9bef46800 1 -- 172.21.15.134:0/366597283 shutdown_connections 2024-04-24T02:14:09.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.781+0000 7fc9bef46800 1 -- 172.21.15.134:0/366597283 wait complete. 2024-04-24T02:14:09.801 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-04-24T02:14:09.801 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-04-24T02:14:09.802 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-04-24T02:14:09.872 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:14:09.872 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:14:09.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.872+0000 7f8963731800 1 Processor -- start 2024-04-24T02:14:09.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.872+0000 7f8963731800 1 -- start start 2024-04-24T02:14:09.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.872+0000 7f8963731800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55cf964ad850 0x55cf964adc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.872+0000 7f8963731800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cf9636dd40 con 0x55cf964ae1b0 2024-04-24T02:14:09.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.872+0000 7f8963731800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55cf963404d0 con 0x55cf964ad850 2024-04-24T02:14:09.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.872+0000 7f895f4f2640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55cf964ad850 0x55cf964adc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.872+0000 7f8957fff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55cf964ae1b0 0x55cf964ae660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:46378/0 (socket says 172.21.15.134:46378) 2024-04-24T02:14:09.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.872+0000 7f8957fff640 1 -- 172.21.15.134:0/3147845419 learned_addr learned my addr 172.21.15.134:0/3147845419 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:14:09.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.872+0000 7f895f4f2640 1 -- 172.21.15.134:0/3147845419 >> v1:172.21.15.104:6789/0 conn(0x55cf964ae1b0 legacy=0x55cf964ae660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.872+0000 7f895f4f2640 1 -- 172.21.15.134:0/3147845419 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf9636c590 con 0x55cf964ad850 2024-04-24T02:14:09.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.874+0000 7f895f4f2640 1 --2- 172.21.15.134:0/3147845419 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cf964ad850 0x55cf964adc70 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f895000a470 tx=0x7f895001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bef5c374f65e9c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.874+0000 7f895ecf1640 1 -- 172.21.15.134:0/3147845419 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8950057070 con 0x55cf964ad850 2024-04-24T02:14:09.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.874+0000 7f895ecf1640 1 -- 172.21.15.134:0/3147845419 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f895004adc0 con 0x55cf964ad850 2024-04-24T02:14:09.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.874+0000 7f895ecf1640 1 -- 172.21.15.134:0/3147845419 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8950052590 con 0x55cf964ad850 2024-04-24T02:14:09.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.875+0000 7f8963731800 1 -- 172.21.15.134:0/3147845419 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cf964ad850 msgr2=0x55cf964adc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.875+0000 7f8963731800 1 --2- 172.21.15.134:0/3147845419 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cf964ad850 0x55cf964adc70 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f895000a470 tx=0x7f895001ce90 comp rx=0 tx=0).stop 2024-04-24T02:14:09.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.875+0000 7f8963731800 1 -- 172.21.15.134:0/3147845419 shutdown_connections 2024-04-24T02:14:09.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.875+0000 7f8963731800 1 --2- 172.21.15.134:0/3147845419 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cf964ad850 0x55cf964adc70 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.875+0000 7f8963731800 1 -- 172.21.15.134:0/3147845419 >> 172.21.15.134:0/3147845419 conn(0x55cf964a93d0 msgr2=0x55cf964ab7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:09.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.875+0000 7f8963731800 1 -- 172.21.15.134:0/3147845419 shutdown_connections 2024-04-24T02:14:09.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.875+0000 7f8963731800 1 -- 172.21.15.134:0/3147845419 wait complete. 2024-04-24T02:14:09.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.886+0000 7f8963731800 1 Processor -- start 2024-04-24T02:14:09.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.887+0000 7f8963731800 1 -- start start 2024-04-24T02:14:09.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.887+0000 7f8963731800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cf964ad850 0x55cf965a2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.887+0000 7f8963731800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55cf963fa3c0 con 0x55cf964ad850 2024-04-24T02:14:09.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.887+0000 7f895f4f2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cf964ad850 0x55cf965a2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.887+0000 7f895f4f2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cf964ad850 0x55cf965a2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43278/0 (socket says 172.21.15.134:43278) 2024-04-24T02:14:09.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.887+0000 7f895f4f2640 1 -- 172.21.15.134:0/2048633300 learned_addr learned my addr 172.21.15.134:0/2048633300 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:09.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.887+0000 7f895f4f2640 1 -- 172.21.15.134:0/2048633300 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf965a2a30 con 0x55cf964ad850 2024-04-24T02:14:09.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.888+0000 7f895f4f2640 1 --2- 172.21.15.134:0/2048633300 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cf964ad850 0x55cf965a2460 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f8950055040 tx=0x7f895004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ec31910ba3a59b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.888+0000 7f884d60a640 1 -- 172.21.15.134:0/2048633300 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8950057040 con 0x55cf964ad850 2024-04-24T02:14:09.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.888+0000 7f884d60a640 1 -- 172.21.15.134:0/2048633300 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8950062070 con 0x55cf964ad850 2024-04-24T02:14:09.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.888+0000 7f884d60a640 1 -- 172.21.15.134:0/2048633300 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f895005d470 con 0x55cf964ad850 2024-04-24T02:14:09.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.888+0000 7f8963731800 1 -- 172.21.15.134:0/2048633300 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cf964ad850 msgr2=0x55cf965a2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.888+0000 7f8963731800 1 --2- 172.21.15.134:0/2048633300 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cf964ad850 0x55cf965a2460 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f8950055040 tx=0x7f895004c000 comp rx=0 tx=0).stop 2024-04-24T02:14:09.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.888+0000 7f8963731800 1 -- 172.21.15.134:0/2048633300 shutdown_connections 2024-04-24T02:14:09.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.888+0000 7f8963731800 1 --2- 172.21.15.134:0/2048633300 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cf964ad850 0x55cf965a2460 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.888+0000 7f8963731800 1 -- 172.21.15.134:0/2048633300 >> 172.21.15.134:0/2048633300 conn(0x55cf964a93d0 msgr2=0x55cf9659dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:09.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.888+0000 7f8963731800 1 -- 172.21.15.134:0/2048633300 shutdown_connections 2024-04-24T02:14:09.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.888+0000 7f8963731800 1 -- 172.21.15.134:0/2048633300 wait complete. 2024-04-24T02:14:09.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.889+0000 7f8963731800 1 Processor -- start 2024-04-24T02:14:09.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.889+0000 7f8963731800 1 -- start start 2024-04-24T02:14:09.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.889+0000 7f8963731800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cf964ad850 0x55cf965a9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.889+0000 7f8963731800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55cf964aefb0 con 0x55cf964ad850 2024-04-24T02:14:09.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.889+0000 7f895f4f2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cf964ad850 0x55cf965a9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.889+0000 7f895f4f2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cf964ad850 0x55cf965a9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43286/0 (socket says 172.21.15.134:43286) 2024-04-24T02:14:09.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.889+0000 7f895f4f2640 1 -- 172.21.15.134:0/273803421 learned_addr learned my addr 172.21.15.134:0/273803421 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:09.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.889+0000 7f895f4f2640 1 -- 172.21.15.134:0/273803421 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf965aa410 con 0x55cf964ad850 2024-04-24T02:14:09.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.890+0000 7f895f4f2640 1 --2- 172.21.15.134:0/273803421 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cf964ad850 0x55cf965a9ed0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f895005f040 tx=0x7f8950002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.890+0000 7f884be07640 1 -- 172.21.15.134:0/273803421 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f895006b070 con 0x55cf964ad850 2024-04-24T02:14:09.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.890+0000 7f884be07640 1 -- 172.21.15.134:0/273803421 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f895005d960 con 0x55cf964ad850 2024-04-24T02:14:09.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.890+0000 7f8963731800 1 -- 172.21.15.134:0/273803421 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cf965aa6a0 con 0x55cf964ad850 2024-04-24T02:14:09.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.890+0000 7f884be07640 1 -- 172.21.15.134:0/273803421 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8950057070 con 0x55cf964ad850 2024-04-24T02:14:09.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.890+0000 7f8963731800 1 -- 172.21.15.134:0/273803421 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf965ad350 con 0x55cf964ad850 2024-04-24T02:14:09.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.890+0000 7f8963731800 1 Processor -- start 2024-04-24T02:14:09.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.890+0000 7f8963731800 1 -- start start 2024-04-24T02:14:09.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.890+0000 7f8963731800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cf965b7710 0x55cf965b7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.890+0000 7f8963731800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55cf963a06b0 con 0x55cf965b7710 2024-04-24T02:14:09.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.891+0000 7f884be07640 1 -- 172.21.15.134:0/273803421 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f895005dc80 con 0x55cf964ad850 2024-04-24T02:14:09.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.891+0000 7f895fcf3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cf965b7710 0x55cf965b7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.891+0000 7f895fcf3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cf965b7710 0x55cf965b7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43288/0 (socket says 172.21.15.134:43288) 2024-04-24T02:14:09.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.891+0000 7f895fcf3640 1 -- 172.21.15.134:0/2978993635 learned_addr learned my addr 172.21.15.134:0/2978993635 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:09.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.891+0000 7f884be07640 1 --2- 172.21.15.134:0/273803421 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8844036900 0x7f8844038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.891+0000 7f884be07640 1 -- 172.21.15.134:0/273803421 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f895008e200 con 0x55cf964ad850 2024-04-24T02:14:09.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.891+0000 7f895f4f2640 1 --2- 172.21.15.134:0/273803421 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8844036900 0x7f8844038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.891+0000 7f895fcf3640 1 -- 172.21.15.134:0/2978993635 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf965b8070 con 0x55cf965b7710 2024-04-24T02:14:09.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.891+0000 7f895fcf3640 1 --2- 172.21.15.134:0/2978993635 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cf965b7710 0x55cf965b7b30 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f895800a430 tx=0x7f895800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69fedc5c0e707b90 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.891+0000 7f895f4f2640 1 --2- 172.21.15.134:0/273803421 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8844036900 0x7f8844038dc0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f895004ab80 tx=0x7f895004ab10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.891+0000 7f8849e03640 1 -- 172.21.15.134:0/2978993635 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8958015070 con 0x55cf965b7710 2024-04-24T02:14:09.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.891+0000 7f8849e03640 1 -- 172.21.15.134:0/2978993635 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8958001670 con 0x55cf965b7710 2024-04-24T02:14:09.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.891+0000 7f8849e03640 1 -- 172.21.15.134:0/2978993635 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8958001990 con 0x55cf965b7710 2024-04-24T02:14:09.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.892+0000 7f8963731800 1 -- 172.21.15.134:0/2978993635 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cf965b7710 msgr2=0x55cf965b7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.892+0000 7f8963731800 1 --2- 172.21.15.134:0/2978993635 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cf965b7710 0x55cf965b7b30 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f895800a430 tx=0x7f895800a8f0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.892+0000 7f8963731800 1 -- 172.21.15.134:0/2978993635 shutdown_connections 2024-04-24T02:14:09.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.892+0000 7f8963731800 1 --2- 172.21.15.134:0/2978993635 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cf965b7710 0x55cf965b7b30 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.892+0000 7f8963731800 1 -- 172.21.15.134:0/2978993635 >> 172.21.15.134:0/2978993635 conn(0x55cf964ae1b0 msgr2=0x55cf965b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:09.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.892+0000 7f8963731800 1 -- 172.21.15.134:0/2978993635 shutdown_connections 2024-04-24T02:14:09.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.892+0000 7f8963731800 1 -- 172.21.15.134:0/2978993635 wait complete. 2024-04-24T02:14:09.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.892+0000 7f8963731800 1 Processor -- start 2024-04-24T02:14:09.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.892+0000 7f8963731800 1 -- start start 2024-04-24T02:14:09.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.892+0000 7f8963731800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cf965b7710 0x55cf965bec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.892+0000 7f8963731800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55cf965b8a00 con 0x55cf965b7710 2024-04-24T02:14:09.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.892+0000 7f895fcf3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cf965b7710 0x55cf965bec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.892+0000 7f895fcf3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cf965b7710 0x55cf965bec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43300/0 (socket says 172.21.15.134:43300) 2024-04-24T02:14:09.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.892+0000 7f895fcf3640 1 -- 172.21.15.134:0/122510472 learned_addr learned my addr 172.21.15.134:0/122510472 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:09.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.893+0000 7f895fcf3640 1 -- 172.21.15.134:0/122510472 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf965bf1a0 con 0x55cf965b7710 2024-04-24T02:14:09.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.893+0000 7f895fcf3640 1 --2- 172.21.15.134:0/122510472 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cf965b7710 0x55cf965bec60 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f895800a930 tx=0x7f8958003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.893+0000 7f883bfff640 1 -- 172.21.15.134:0/122510472 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8958020020 con 0x55cf965b7710 2024-04-24T02:14:09.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.893+0000 7f883bfff640 1 -- 172.21.15.134:0/122510472 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89580108b0 con 0x55cf965b7710 2024-04-24T02:14:09.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.893+0000 7f8963731800 1 -- 172.21.15.134:0/122510472 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cf965bf430 con 0x55cf965b7710 2024-04-24T02:14:09.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.893+0000 7f883bfff640 1 -- 172.21.15.134:0/122510472 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8958015040 con 0x55cf965b7710 2024-04-24T02:14:09.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.893+0000 7f8963731800 1 -- 172.21.15.134:0/122510472 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf965c20e0 con 0x55cf965b7710 2024-04-24T02:14:09.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.894+0000 7f883bfff640 1 -- 172.21.15.134:0/122510472 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8958023020 con 0x55cf965b7710 2024-04-24T02:14:09.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.894+0000 7f883bfff640 1 --2- 172.21.15.134:0/122510472 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8840036950 0x7f8840038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.894+0000 7f8963731800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:14:09.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.894+0000 7f8963731800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:14:09.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.894+0000 7f883bfff640 1 -- 172.21.15.134:0/122510472 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f895804be90 con 0x55cf965b7710 2024-04-24T02:14:09.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.894+0000 7f8957fff640 1 --2- 172.21.15.134:0/122510472 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8840036950 0x7f8840038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.894+0000 7f8963731800 1 Processor -- start 2024-04-24T02:14:09.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.895+0000 7f8963731800 1 -- start start 2024-04-24T02:14:09.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.895+0000 7f8957fff640 1 --2- 172.21.15.134:0/122510472 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8840036950 0x7f8840038e10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8948000f60 tx=0x7f8948001230 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.895+0000 7f8963731800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cf965d9370 0x55cf965d9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.895+0000 7f8963731800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55cf965a2cf0 con 0x55cf965d9370 2024-04-24T02:14:09.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.895+0000 7f895f4f2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cf965d9370 0x55cf965d9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.895+0000 7f895f4f2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cf965d9370 0x55cf965d9790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43314/0 (socket says 172.21.15.134:43314) 2024-04-24T02:14:09.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.895+0000 7f895f4f2640 1 -- 172.21.15.134:0/2387513004 learned_addr learned my addr 172.21.15.134:0/2387513004 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:09.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.895+0000 7f895f4f2640 1 -- 172.21.15.134:0/2387513004 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf965d9cd0 con 0x55cf965d9370 2024-04-24T02:14:09.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.895+0000 7f895f4f2640 1 --2- 172.21.15.134:0/2387513004 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cf965d9370 0x55cf965d9790 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f8950052f30 tx=0x7f8950066880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.895+0000 7f8824fe1640 1 -- 172.21.15.134:0/2387513004 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8950093070 con 0x55cf965d9370 2024-04-24T02:14:09.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.895+0000 7f8824fe1640 1 -- 172.21.15.134:0/2387513004 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f895007f050 con 0x55cf965d9370 2024-04-24T02:14:09.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.895+0000 7f8824fe1640 1 -- 172.21.15.134:0/2387513004 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f895007d030 con 0x55cf965d9370 2024-04-24T02:14:09.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.896+0000 7f8963731800 1 -- 172.21.15.134:0/2387513004 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cf965da740 con 0x55cf965d9370 2024-04-24T02:14:09.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.896+0000 7f8963731800 1 -- 172.21.15.134:0/2387513004 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf965dac40 con 0x55cf965d9370 2024-04-24T02:14:09.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.896+0000 7f8824fe1640 1 -- 172.21.15.134:0/2387513004 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8950096070 con 0x55cf965d9370 2024-04-24T02:14:09.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.896+0000 7f8824fe1640 1 --2- 172.21.15.134:0/2387513004 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8798036900 0x7f8798038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.896+0000 7f8824fe1640 1 -- 172.21.15.134:0/2387513004 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f895007e070 con 0x55cf965d9370 2024-04-24T02:14:09.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.896+0000 7f8957fff640 1 --2- 172.21.15.134:0/2387513004 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8798036900 0x7f8798038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.897+0000 7f881e7fc640 20 reqs_thread_entry: start 2024-04-24T02:14:09.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.897+0000 7f8963731800 1 --2- 172.21.15.134:0/273803421 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55cf965e6d70 0x55cf965e91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.897+0000 7f8963731800 1 -- 172.21.15.134:0/273803421 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cf965e98b0 con 0x55cf965e6d70 2024-04-24T02:14:09.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.897+0000 7f8957fff640 1 --2- 172.21.15.134:0/2387513004 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8798036900 0x7f8798038dc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8948001ed0 tx=0x7f894800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.897+0000 7f895fcf3640 1 --2- 172.21.15.134:0/273803421 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55cf965e6d70 0x55cf965e91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.897+0000 7f895fcf3640 1 --2- 172.21.15.134:0/273803421 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55cf965e6d70 0x55cf965e91e0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:09.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.898+0000 7f895fcf3640 1 -- 172.21.15.134:0/273803421 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8958010d70 con 0x55cf965e6d70 2024-04-24T02:14:09.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.898+0000 7f8963731800 1 -- 172.21.15.134:0/273803421 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cf965eb210 con 0x55cf965e6d70 2024-04-24T02:14:09.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.898+0000 7f895fcf3640 1 -- 172.21.15.134:0/273803421 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8958010d70 con 0x55cf965e6d70 2024-04-24T02:14:09.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.898+0000 7f8963731800 1 -- 172.21.15.134:0/122510472 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8840036950 msgr2=0x7f8840038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.898+0000 7f8963731800 1 --2- 172.21.15.134:0/122510472 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8840036950 0x7f8840038e10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8948000f60 tx=0x7f8948001230 comp rx=0 tx=0).stop 2024-04-24T02:14:09.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.898+0000 7f8963731800 1 -- 172.21.15.134:0/122510472 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cf965b7710 msgr2=0x55cf965bec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.898+0000 7f8963731800 1 --2- 172.21.15.134:0/122510472 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cf965b7710 0x55cf965bec60 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f895800a930 tx=0x7f8958003370 comp rx=0 tx=0).stop 2024-04-24T02:14:09.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.899+0000 7f8963731800 1 -- 172.21.15.134:0/122510472 shutdown_connections 2024-04-24T02:14:09.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.899+0000 7f8963731800 1 --2- 172.21.15.134:0/122510472 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8840036950 0x7f8840038e10 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.899+0000 7f8963731800 1 --2- 172.21.15.134:0/122510472 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cf965b7710 0x55cf965bec60 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.899+0000 7f8963731800 1 -- 172.21.15.134:0/122510472 >> 172.21.15.134:0/122510472 conn(0x55cf964ae1b0 msgr2=0x55cf965b17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:09.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.899+0000 7f8963731800 1 -- 172.21.15.134:0/122510472 shutdown_connections 2024-04-24T02:14:09.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.899+0000 7f8963731800 1 -- 172.21.15.134:0/122510472 wait complete. 2024-04-24T02:14:09.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.899+0000 7f8963731800 1 -- 172.21.15.134:0/2387513004 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8798036900 msgr2=0x7f8798038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.899+0000 7f8963731800 1 --2- 172.21.15.134:0/2387513004 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8798036900 0x7f8798038dc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8948001ed0 tx=0x7f894800f000 comp rx=0 tx=0).stop 2024-04-24T02:14:09.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.899+0000 7f8963731800 1 -- 172.21.15.134:0/2387513004 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cf965d9370 msgr2=0x55cf965d9790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.899+0000 7f8963731800 1 --2- 172.21.15.134:0/2387513004 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cf965d9370 0x55cf965d9790 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f8950052f30 tx=0x7f8950066880 comp rx=0 tx=0).stop 2024-04-24T02:14:09.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.899+0000 7f8963731800 1 -- 172.21.15.134:0/2387513004 shutdown_connections 2024-04-24T02:14:09.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.899+0000 7f8963731800 1 --2- 172.21.15.134:0/2387513004 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8798036900 0x7f8798038dc0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.899+0000 7f8963731800 1 --2- 172.21.15.134:0/2387513004 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cf965d9370 0x55cf965d9790 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.899+0000 7f8963731800 1 -- 172.21.15.134:0/2387513004 >> 172.21.15.134:0/2387513004 conn(0x55cf965cde40 msgr2=0x55cf965ce860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:09.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.899+0000 7f8963731800 1 -- 172.21.15.134:0/2387513004 shutdown_connections 2024-04-24T02:14:09.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.899+0000 7f8963731800 1 -- 172.21.15.134:0/2387513004 wait complete. 2024-04-24T02:14:09.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.899+0000 7f8963731800 1 -- 172.21.15.134:0/273803421 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55cf965e6d70 msgr2=0x55cf965e91e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.899+0000 7f8963731800 1 --2- 172.21.15.134:0/273803421 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55cf965e6d70 0x55cf965e91e0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.899+0000 7f8963731800 1 -- 172.21.15.134:0/273803421 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8844036900 msgr2=0x7f8844038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.899+0000 7f8963731800 1 --2- 172.21.15.134:0/273803421 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8844036900 0x7f8844038dc0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f895004ab80 tx=0x7f895004ab10 comp rx=0 tx=0).stop 2024-04-24T02:14:09.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.899+0000 7f8963731800 1 -- 172.21.15.134:0/273803421 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cf964ad850 msgr2=0x55cf965a9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.899+0000 7f8963731800 1 --2- 172.21.15.134:0/273803421 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cf964ad850 0x55cf965a9ed0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f895005f040 tx=0x7f8950002fb0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.899+0000 7f8963731800 1 -- 172.21.15.134:0/273803421 shutdown_connections 2024-04-24T02:14:09.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.899+0000 7f8963731800 1 --2- 172.21.15.134:0/273803421 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55cf965e6d70 0x55cf965e91e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.899+0000 7f8963731800 1 --2- 172.21.15.134:0/273803421 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f8844036900 0x7f8844038dc0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.899+0000 7f8963731800 1 --2- 172.21.15.134:0/273803421 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cf964ad850 0x55cf965a9ed0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:09.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.899+0000 7f8963731800 1 -- 172.21.15.134:0/273803421 >> 172.21.15.134:0/273803421 conn(0x55cf964a93d0 msgr2=0x55cf9659c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:09.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.900+0000 7f8963731800 1 -- 172.21.15.134:0/273803421 shutdown_connections 2024-04-24T02:14:09.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.900+0000 7f8963731800 1 -- 172.21.15.134:0/273803421 wait complete. 2024-04-24T02:14:09.913 INFO:teuthology.orchestra.run.smithi134.stdout:{"id":"582e5324-1512-4fe8-bc69-2f28bbcfaf89","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-04-24T02:14:09.913 DEBUG:tasks.util.rgw: json result: {'id': '582e5324-1512-4fe8-bc69-2f28bbcfaf89', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-04-24T02:14:09.913 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-04-24T02:14:09.913 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-04-24T02:14:09.913 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-04-24T02:14:09.994 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:14:09.994 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:14:09.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.993+0000 7fb9d2d29800 1 Processor -- start 2024-04-24T02:14:09.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.993+0000 7fb9d2d29800 1 -- start start 2024-04-24T02:14:09.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.993+0000 7fb9d2d29800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55a5236efd10 0x55a5236f0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:09.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.993+0000 7fb9d2d29800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a5235afd40 con 0x55a5236f0f70 2024-04-24T02:14:09.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.993+0000 7fb9d2d29800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55a5235824d0 con 0x55a5236efd10 2024-04-24T02:14:09.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.994+0000 7fb9ceabe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55a5236efd10 0x55a5236f0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:09.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.994+0000 7fb9ce2bd640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55a5236f0f70 0x55a5236f13f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:46388/0 (socket says 172.21.15.134:46388) 2024-04-24T02:14:09.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.994+0000 7fb9ceabe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55a5236efd10 0x55a5236f0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43320/0 (socket says 172.21.15.134:43320) 2024-04-24T02:14:09.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.994+0000 7fb9ce2bd640 1 -- 172.21.15.134:0/1954300166 learned_addr learned my addr 172.21.15.134:0/1954300166 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:14:09.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.994+0000 7fb9ceabe640 1 -- 172.21.15.134:0/1954300166 >> v1:172.21.15.104:6789/0 conn(0x55a5236f0f70 legacy=0x55a5236f13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:09.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.994+0000 7fb9ceabe640 1 -- 172.21.15.134:0/1954300166 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5235ae590 con 0x55a5236efd10 2024-04-24T02:14:09.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.996+0000 7fb9ceabe640 1 --2- 172.21.15.134:0/1954300166 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5236efd10 0x55a5236f0130 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fb9c000a470 tx=0x7fb9c001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b9292203926a5e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.996+0000 7fb9cdabc640 1 -- 172.21.15.134:0/1954300166 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9c0057070 con 0x55a5236efd10 2024-04-24T02:14:10.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.996+0000 7fb9cdabc640 1 -- 172.21.15.134:0/1954300166 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9c0052570 con 0x55a5236efd10 2024-04-24T02:14:10.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.996+0000 7fb9cdabc640 1 -- 172.21.15.134:0/1954300166 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9c0052870 con 0x55a5236efd10 2024-04-24T02:14:10.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.996+0000 7fb9d2d29800 1 -- 172.21.15.134:0/1954300166 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5236efd10 msgr2=0x55a5236f0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.996+0000 7fb9d2d29800 1 --2- 172.21.15.134:0/1954300166 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5236efd10 0x55a5236f0130 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fb9c000a470 tx=0x7fb9c001ce90 comp rx=0 tx=0).stop 2024-04-24T02:14:10.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.996+0000 7fb9d2d29800 1 -- 172.21.15.134:0/1954300166 shutdown_connections 2024-04-24T02:14:10.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.996+0000 7fb9d2d29800 1 --2- 172.21.15.134:0/1954300166 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5236efd10 0x55a5236f0130 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.996+0000 7fb9d2d29800 1 -- 172.21.15.134:0/1954300166 >> 172.21.15.134:0/1954300166 conn(0x55a5236eb370 msgr2=0x55a5236ed790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:10.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.996+0000 7fb9d2d29800 1 -- 172.21.15.134:0/1954300166 shutdown_connections 2024-04-24T02:14:10.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:09.996+0000 7fb9d2d29800 1 -- 172.21.15.134:0/1954300166 wait complete. 2024-04-24T02:14:10.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.008+0000 7fb9d2d29800 1 Processor -- start 2024-04-24T02:14:10.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.008+0000 7fb9d2d29800 1 -- start start 2024-04-24T02:14:10.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.008+0000 7fb9d2d29800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5236efd10 0x55a523663fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.008+0000 7fb9d2d29800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a52363c3b0 con 0x55a5236efd10 2024-04-24T02:14:10.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.009+0000 7fb9ceabe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5236efd10 0x55a523663fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.009+0000 7fb9ceabe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5236efd10 0x55a523663fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43328/0 (socket says 172.21.15.134:43328) 2024-04-24T02:14:10.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.009+0000 7fb9ceabe640 1 -- 172.21.15.134:0/562978064 learned_addr learned my addr 172.21.15.134:0/562978064 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:10.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.009+0000 7fb9ceabe640 1 -- 172.21.15.134:0/562978064 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5237e3050 con 0x55a5236efd10 2024-04-24T02:14:10.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.009+0000 7fb9ceabe640 1 --2- 172.21.15.134:0/562978064 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5236efd10 0x55a523663fe0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0055040 tx=0x7fb9c004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11c2d1c853aa9154 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.009+0000 7fb8bce09640 1 -- 172.21.15.134:0/562978064 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9c0057070 con 0x55a5236efd10 2024-04-24T02:14:10.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.009+0000 7fb8bce09640 1 -- 172.21.15.134:0/562978064 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9c0063070 con 0x55a5236efd10 2024-04-24T02:14:10.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.009+0000 7fb8bce09640 1 -- 172.21.15.134:0/562978064 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9c0052720 con 0x55a5236efd10 2024-04-24T02:14:10.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.010+0000 7fb9d2d29800 1 -- 172.21.15.134:0/562978064 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5236efd10 msgr2=0x55a523663fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.010+0000 7fb9d2d29800 1 --2- 172.21.15.134:0/562978064 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5236efd10 0x55a523663fe0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0055040 tx=0x7fb9c004c000 comp rx=0 tx=0).stop 2024-04-24T02:14:10.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.010+0000 7fb9d2d29800 1 -- 172.21.15.134:0/562978064 shutdown_connections 2024-04-24T02:14:10.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.010+0000 7fb9d2d29800 1 --2- 172.21.15.134:0/562978064 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5236efd10 0x55a523663fe0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.010+0000 7fb9d2d29800 1 -- 172.21.15.134:0/562978064 >> 172.21.15.134:0/562978064 conn(0x55a5236eb370 msgr2=0x55a5237dcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:10.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.010+0000 7fb9d2d29800 1 -- 172.21.15.134:0/562978064 shutdown_connections 2024-04-24T02:14:10.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.010+0000 7fb9d2d29800 1 -- 172.21.15.134:0/562978064 wait complete. 2024-04-24T02:14:10.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.010+0000 7fb9d2d29800 1 Processor -- start 2024-04-24T02:14:10.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.010+0000 7fb9d2d29800 1 -- start start 2024-04-24T02:14:10.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.010+0000 7fb9d2d29800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5236efd10 0x55a5237ec0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.011+0000 7fb9d2d29800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a5236f93e0 con 0x55a5236efd10 2024-04-24T02:14:10.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.011+0000 7fb9ceabe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5236efd10 0x55a5237ec0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.011+0000 7fb9ceabe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5236efd10 0x55a5237ec0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43336/0 (socket says 172.21.15.134:43336) 2024-04-24T02:14:10.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.011+0000 7fb9ceabe640 1 -- 172.21.15.134:0/4088431137 learned_addr learned my addr 172.21.15.134:0/4088431137 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:10.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.011+0000 7fb9ceabe640 1 -- 172.21.15.134:0/4088431137 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5237ec610 con 0x55a5236efd10 2024-04-24T02:14:10.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.011+0000 7fb9ceabe640 1 --2- 172.21.15.134:0/4088431137 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5236efd10 0x55a5237ec0d0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0055040 tx=0x7fb9c0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.011+0000 7fb8bb606640 1 -- 172.21.15.134:0/4088431137 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9c0052cd0 con 0x55a5236efd10 2024-04-24T02:14:10.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.011+0000 7fb8bb606640 1 -- 172.21.15.134:0/4088431137 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9c006c070 con 0x55a5236efd10 2024-04-24T02:14:10.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.011+0000 7fb9d2d29800 1 -- 172.21.15.134:0/4088431137 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a5237ec8a0 con 0x55a5236efd10 2024-04-24T02:14:10.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.011+0000 7fb8bb606640 1 -- 172.21.15.134:0/4088431137 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9c005e480 con 0x55a5236efd10 2024-04-24T02:14:10.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.011+0000 7fb9d2d29800 1 -- 172.21.15.134:0/4088431137 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5237ef550 con 0x55a5236efd10 2024-04-24T02:14:10.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.012+0000 7fb9d2d29800 1 Processor -- start 2024-04-24T02:14:10.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.012+0000 7fb9d2d29800 1 -- start start 2024-04-24T02:14:10.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.012+0000 7fb9d2d29800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5237f99d0 0x55a5237f9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.012+0000 7fb9d2d29800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a5235e26b0 con 0x55a5237f99d0 2024-04-24T02:14:10.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.012+0000 7fb8bb606640 1 -- 172.21.15.134:0/4088431137 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb9c005e620 con 0x55a5236efd10 2024-04-24T02:14:10.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.013+0000 7fb8bb606640 1 --2- 172.21.15.134:0/4088431137 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fb8b4036900 0x7fb8b4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.013+0000 7fb9cf2bf640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5237f99d0 0x55a5237f9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.013+0000 7fb9cf2bf640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5237f99d0 0x55a5237f9df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43350/0 (socket says 172.21.15.134:43350) 2024-04-24T02:14:10.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.013+0000 7fb9cf2bf640 1 -- 172.21.15.134:0/3221759031 learned_addr learned my addr 172.21.15.134:0/3221759031 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:10.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.013+0000 7fb8bb606640 1 -- 172.21.15.134:0/4088431137 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fb9c008e710 con 0x55a5236efd10 2024-04-24T02:14:10.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.013+0000 7fb9ceabe640 1 --2- 172.21.15.134:0/4088431137 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fb8b4036900 0x7fb8b4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.013+0000 7fb9cf2bf640 1 -- 172.21.15.134:0/3221759031 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5237fa330 con 0x55a5237f99d0 2024-04-24T02:14:10.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.013+0000 7fb9ceabe640 1 --2- 172.21.15.134:0/4088431137 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fb8b4036900 0x7fb8b4038dc0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb9c00715e0 tx=0x7fb9c0071570 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.013+0000 7fb9cf2bf640 1 --2- 172.21.15.134:0/3221759031 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5237f99d0 0x55a5237f9df0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fb9c800a430 tx=0x7fb9c800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50378dbb9d974394 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.013+0000 7fb8b9602640 1 -- 172.21.15.134:0/3221759031 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9c8015070 con 0x55a5237f99d0 2024-04-24T02:14:10.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.013+0000 7fb8b9602640 1 -- 172.21.15.134:0/3221759031 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9c8001670 con 0x55a5237f99d0 2024-04-24T02:14:10.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.013+0000 7fb8b9602640 1 -- 172.21.15.134:0/3221759031 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9c8001990 con 0x55a5237f99d0 2024-04-24T02:14:10.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.014+0000 7fb9d2d29800 1 -- 172.21.15.134:0/3221759031 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5237f99d0 msgr2=0x55a5237f9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.014+0000 7fb9d2d29800 1 --2- 172.21.15.134:0/3221759031 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5237f99d0 0x55a5237f9df0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fb9c800a430 tx=0x7fb9c800a8f0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.014+0000 7fb9d2d29800 1 -- 172.21.15.134:0/3221759031 shutdown_connections 2024-04-24T02:14:10.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.014+0000 7fb9d2d29800 1 --2- 172.21.15.134:0/3221759031 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5237f99d0 0x55a5237f9df0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.014+0000 7fb9d2d29800 1 -- 172.21.15.134:0/3221759031 >> 172.21.15.134:0/3221759031 conn(0x55a5236f0f70 msgr2=0x55a5237f6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:10.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.014+0000 7fb9d2d29800 1 -- 172.21.15.134:0/3221759031 shutdown_connections 2024-04-24T02:14:10.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.014+0000 7fb9d2d29800 1 -- 172.21.15.134:0/3221759031 wait complete. 2024-04-24T02:14:10.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.014+0000 7fb9d2d29800 1 Processor -- start 2024-04-24T02:14:10.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.014+0000 7fb9d2d29800 1 -- start start 2024-04-24T02:14:10.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.014+0000 7fb9d2d29800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5237f99d0 0x55a523800ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.014+0000 7fb9d2d29800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a5237facc0 con 0x55a5237f99d0 2024-04-24T02:14:10.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.014+0000 7fb9cf2bf640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5237f99d0 0x55a523800ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.014+0000 7fb9cf2bf640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5237f99d0 0x55a523800ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43352/0 (socket says 172.21.15.134:43352) 2024-04-24T02:14:10.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.014+0000 7fb9cf2bf640 1 -- 172.21.15.134:0/1019778887 learned_addr learned my addr 172.21.15.134:0/1019778887 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:10.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.015+0000 7fb9cf2bf640 1 -- 172.21.15.134:0/1019778887 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a523801420 con 0x55a5237f99d0 2024-04-24T02:14:10.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.015+0000 7fb9cf2bf640 1 --2- 172.21.15.134:0/1019778887 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5237f99d0 0x55a523800ee0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fb9c800a930 tx=0x7fb9c8003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.015+0000 7fb8b37fe640 1 -- 172.21.15.134:0/1019778887 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9c8020020 con 0x55a5237f99d0 2024-04-24T02:14:10.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.015+0000 7fb8b37fe640 1 -- 172.21.15.134:0/1019778887 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9c80108b0 con 0x55a5237f99d0 2024-04-24T02:14:10.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.015+0000 7fb9d2d29800 1 -- 172.21.15.134:0/1019778887 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a5238016b0 con 0x55a5237f99d0 2024-04-24T02:14:10.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.015+0000 7fb8b37fe640 1 -- 172.21.15.134:0/1019778887 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9c8015040 con 0x55a5237f99d0 2024-04-24T02:14:10.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.015+0000 7fb9d2d29800 1 -- 172.21.15.134:0/1019778887 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a523804360 con 0x55a5237f99d0 2024-04-24T02:14:10.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.016+0000 7fb8b37fe640 1 -- 172.21.15.134:0/1019778887 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb9c8023020 con 0x55a5237f99d0 2024-04-24T02:14:10.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.016+0000 7fb8b37fe640 1 --2- 172.21.15.134:0/1019778887 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fb8a8036950 0x7fb8a8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.016+0000 7fb8b37fe640 1 -- 172.21.15.134:0/1019778887 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fb9c804be90 con 0x55a5237f99d0 2024-04-24T02:14:10.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.016+0000 7fb9ce2bd640 1 --2- 172.21.15.134:0/1019778887 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fb8a8036950 0x7fb8a8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.016+0000 7fb9d2d29800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:14:10.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.016+0000 7fb9d2d29800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:14:10.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.016+0000 7fb9d2d29800 1 Processor -- start 2024-04-24T02:14:10.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.016+0000 7fb9ce2bd640 1 --2- 172.21.15.134:0/1019778887 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fb8a8036950 0x7fb8a8038e10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb9c4000f60 tx=0x7fb9c4001230 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.017+0000 7fb9d2d29800 1 -- start start 2024-04-24T02:14:10.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.017+0000 7fb9d2d29800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a52381b5f0 0x55a52381ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.017+0000 7fb9d2d29800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a5237e7720 con 0x55a52381b5f0 2024-04-24T02:14:10.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.017+0000 7fb9ceabe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a52381b5f0 0x55a52381ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.017+0000 7fb9ceabe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a52381b5f0 0x55a52381ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43362/0 (socket says 172.21.15.134:43362) 2024-04-24T02:14:10.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.017+0000 7fb9ceabe640 1 -- 172.21.15.134:0/4130199809 learned_addr learned my addr 172.21.15.134:0/4130199809 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:10.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.017+0000 7fb9ceabe640 1 -- 172.21.15.134:0/4130199809 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a52381bf50 con 0x55a52381b5f0 2024-04-24T02:14:10.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.017+0000 7fb9ceabe640 1 --2- 172.21.15.134:0/4130199809 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a52381b5f0 0x55a52381ba10 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0066fd0 tx=0x7fb9c0002df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.017+0000 7fb893fe7640 1 -- 172.21.15.134:0/4130199809 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9c008ea60 con 0x55a52381b5f0 2024-04-24T02:14:10.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.017+0000 7fb893fe7640 1 -- 172.21.15.134:0/4130199809 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9c0058040 con 0x55a52381b5f0 2024-04-24T02:14:10.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.017+0000 7fb893fe7640 1 -- 172.21.15.134:0/4130199809 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9c008ed50 con 0x55a52381b5f0 2024-04-24T02:14:10.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.018+0000 7fb9d2d29800 1 -- 172.21.15.134:0/4130199809 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a52381c9c0 con 0x55a52381b5f0 2024-04-24T02:14:10.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.018+0000 7fb9d2d29800 1 -- 172.21.15.134:0/4130199809 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a52381cec0 con 0x55a52381b5f0 2024-04-24T02:14:10.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.018+0000 7fb893fe7640 1 -- 172.21.15.134:0/4130199809 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb9c0083070 con 0x55a52381b5f0 2024-04-24T02:14:10.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.018+0000 7fb893fe7640 1 --2- 172.21.15.134:0/4130199809 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fb80c036950 0x7fb80c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.018+0000 7fb893fe7640 1 -- 172.21.15.134:0/4130199809 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fb9c008b0c0 con 0x55a52381b5f0 2024-04-24T02:14:10.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.018+0000 7fb9ce2bd640 1 --2- 172.21.15.134:0/4130199809 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fb80c036950 0x7fb80c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.019+0000 7fb891fe3640 20 reqs_thread_entry: start 2024-04-24T02:14:10.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.019+0000 7fb9ce2bd640 1 --2- 172.21.15.134:0/4130199809 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fb80c036950 0x7fb80c038e10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb9c4001ed0 tx=0x7fb9c400f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.019+0000 7fb9d2d29800 1 --2- 172.21.15.134:0/4088431137 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55a523828ff0 0x55a52382b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.019+0000 7fb9d2d29800 1 -- 172.21.15.134:0/4088431137 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a52382ba90 con 0x55a523828ff0 2024-04-24T02:14:10.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.019+0000 7fb9cf2bf640 1 --2- 172.21.15.134:0/4088431137 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55a523828ff0 0x55a52382b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.019+0000 7fb9cf2bf640 1 --2- 172.21.15.134:0/4088431137 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55a523828ff0 0x55a52382b3e0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.019+0000 7fb9cf2bf640 1 -- 172.21.15.134:0/4088431137 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb9c8010d70 con 0x55a523828ff0 2024-04-24T02:14:10.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.019+0000 7fb9d2d29800 1 -- 172.21.15.134:0/4088431137 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a52382c370 con 0x55a523828ff0 2024-04-24T02:14:10.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.020+0000 7fb9cf2bf640 1 -- 172.21.15.134:0/4088431137 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb9c8010d70 con 0x55a523828ff0 2024-04-24T02:14:10.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.020+0000 7fb9d2d29800 1 -- 172.21.15.134:0/4088431137 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a52382d720 con 0x55a523828ff0 2024-04-24T02:14:10.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.020+0000 7fb9cf2bf640 1 -- 172.21.15.134:0/4088431137 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb9c8010d70 con 0x55a523828ff0 2024-04-24T02:14:10.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.020+0000 7fb9d2d29800 1 -- 172.21.15.134:0/4088431137 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a52383a680 con 0x55a523828ff0 2024-04-24T02:14:10.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.020+0000 7fb9cf2bf640 1 -- 172.21.15.134:0/4088431137 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb9c8010d70 con 0x55a523828ff0 2024-04-24T02:14:10.042 INFO:teuthology.orchestra.run.smithi134.stderr:NOTICE: set zone's realm_id= 2024-04-24T02:14:10.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.020+0000 7fb9d2d29800 1 --2- 172.21.15.134:0/4088431137 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55a523831ae0 0x55a523833e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.020+0000 7fb9d2d29800 1 -- 172.21.15.134:0/4088431137 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a52382e1d0 con 0x55a523831ae0 2024-04-24T02:14:10.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.021+0000 7fb9ceabe640 1 --2- 172.21.15.134:0/4088431137 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55a523831ae0 0x55a523833e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.021+0000 7fb9ceabe640 1 --2- 172.21.15.134:0/4088431137 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55a523831ae0 0x55a523833e20 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.021+0000 7fb9ceabe640 1 -- 172.21.15.134:0/4088431137 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(5 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9c0082030 con 0x55a523831ae0 2024-04-24T02:14:10.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.021+0000 7fb9ceabe640 1 --2- 172.21.15.134:0/4088431137 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fb9c0086040 0x7fb9c0002000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.021+0000 7fb9ceabe640 1 -- 172.21.15.134:0/4088431137 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a52382e1d0 con 0x7fb9c0086040 2024-04-24T02:14:10.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.021+0000 7fb9ce2bd640 1 --2- 172.21.15.134:0/4088431137 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fb9c0086040 0x7fb9c0002000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.021+0000 7fb9ce2bd640 1 --2- 172.21.15.134:0/4088431137 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fb9c0086040 0x7fb9c0002000 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.022+0000 7fb9ce2bd640 1 -- 172.21.15.134:0/4088431137 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9c4009050 con 0x7fb9c0086040 2024-04-24T02:14:10.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.022+0000 7fb9ce2bd640 1 --2- 172.21.15.134:0/4088431137 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fb9c401d040 0x7fb9c401c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.022+0000 7fb9ce2bd640 1 -- 172.21.15.134:0/4088431137 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a52382e1d0 con 0x7fb9c401d040 2024-04-24T02:14:10.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.022+0000 7fb9cf2bf640 1 --2- 172.21.15.134:0/4088431137 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fb9c401d040 0x7fb9c401c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.022+0000 7fb9cf2bf640 1 --2- 172.21.15.134:0/4088431137 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fb9c401d040 0x7fb9c401c980 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.023+0000 7fb9cf2bf640 1 -- 172.21.15.134:0/4088431137 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9c8010d70 con 0x7fb9c401d040 2024-04-24T02:14:10.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.023+0000 7fb9cf2bf640 1 -- 172.21.15.134:0/4088431137 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a52382e1d0 con 0x55a523828ff0 2024-04-24T02:14:10.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.023+0000 7fb9cf2bf640 1 -- 172.21.15.134:0/4088431137 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9c8010d70 con 0x55a523828ff0 2024-04-24T02:14:10.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.023+0000 7fb9cf2bf640 1 -- 172.21.15.134:0/4088431137 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a52382e1d0 con 0x55a523828ff0 2024-04-24T02:14:10.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.023+0000 7fb9cf2bf640 1 -- 172.21.15.134:0/4088431137 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb9c8010d70 con 0x55a523828ff0 2024-04-24T02:14:10.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.023+0000 7fb9cf2bf640 1 -- 172.21.15.134:0/4088431137 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a52382e1d0 con 0x7fb9c401d040 2024-04-24T02:14:10.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.023+0000 7fb9cf2bf640 1 -- 172.21.15.134:0/4088431137 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9c8010d70 con 0x7fb9c401d040 2024-04-24T02:14:10.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.023+0000 7fb9cf2bf640 1 -- 172.21.15.134:0/4088431137 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a52382e1d0 con 0x7fb9c0086040 2024-04-24T02:14:10.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.024+0000 7fb9ce2bd640 1 -- 172.21.15.134:0/4088431137 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9c4009050 con 0x7fb9c0086040 2024-04-24T02:14:10.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.024+0000 7fb9ce2bd640 1 -- 172.21.15.134:0/4088431137 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a52382e1d0 con 0x7fb9c0086040 2024-04-24T02:14:10.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.024+0000 7fb9ce2bd640 1 -- 172.21.15.134:0/4088431137 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9c4009050 con 0x7fb9c0086040 2024-04-24T02:14:10.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.024+0000 7fb9ce2bd640 1 -- 172.21.15.134:0/4088431137 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a52382e1d0 con 0x55a523831ae0 2024-04-24T02:14:10.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.024+0000 7fb9ceabe640 1 -- 172.21.15.134:0/4088431137 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9c0082030 con 0x55a523831ae0 2024-04-24T02:14:10.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.024+0000 7fb9ceabe640 1 -- 172.21.15.134:0/4088431137 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a52382e1d0 con 0x55a523828ff0 2024-04-24T02:14:10.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.024+0000 7fb9cf2bf640 1 -- 172.21.15.134:0/4088431137 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9c8010d70 con 0x55a523828ff0 2024-04-24T02:14:10.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.024+0000 7fb9cf2bf640 1 -- 172.21.15.134:0/4088431137 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a52382e1d0 con 0x7fb9c401d040 2024-04-24T02:14:10.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.025+0000 7fb9cf2bf640 1 -- 172.21.15.134:0/4088431137 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9c8010d70 con 0x7fb9c401d040 2024-04-24T02:14:10.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.025+0000 7fb9cf2bf640 1 -- 172.21.15.134:0/4088431137 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a52382e1d0 con 0x55a523828ff0 2024-04-24T02:14:10.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.025+0000 7fb9cf2bf640 1 -- 172.21.15.134:0/4088431137 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9c8010d70 con 0x55a523828ff0 2024-04-24T02:14:10.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.025+0000 7fb9cf2bf640 1 -- 172.21.15.134:0/4088431137 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a52382e1d0 con 0x7fb9c0086040 2024-04-24T02:14:10.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.025+0000 7fb9ce2bd640 1 -- 172.21.15.134:0/4088431137 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(17 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb9c4009050 con 0x7fb9c0086040 2024-04-24T02:14:10.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.025+0000 7fb9ce2bd640 1 -- 172.21.15.134:0/4088431137 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a52382e1d0 con 0x55a523831ae0 2024-04-24T02:14:10.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.025+0000 7fb9ceabe640 1 -- 172.21.15.134:0/4088431137 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9c0082030 con 0x55a523831ae0 2024-04-24T02:14:10.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.025+0000 7fb9ceabe640 1 -- 172.21.15.134:0/4088431137 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a52382e1d0 con 0x55a523831ae0 2024-04-24T02:14:10.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.025+0000 7fb9ceabe640 1 -- 172.21.15.134:0/4088431137 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9c0082030 con 0x55a523831ae0 2024-04-24T02:14:10.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.025+0000 7fb9ceabe640 1 -- 172.21.15.134:0/4088431137 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a52382e1d0 con 0x7fb9c0086040 2024-04-24T02:14:10.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.026+0000 7fb9ce2bd640 1 -- 172.21.15.134:0/4088431137 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9c4009050 con 0x7fb9c0086040 2024-04-24T02:14:10.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.026+0000 7fb9ce2bd640 1 -- 172.21.15.134:0/4088431137 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a52382e1d0 con 0x55a523831ae0 2024-04-24T02:14:10.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.026+0000 7fb9ceabe640 1 -- 172.21.15.134:0/4088431137 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9c0082030 con 0x55a523831ae0 2024-04-24T02:14:10.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.026+0000 7fb9ceabe640 1 -- 172.21.15.134:0/4088431137 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a52382e1d0 con 0x55a523831ae0 2024-04-24T02:14:10.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.026+0000 7fb9ceabe640 1 -- 172.21.15.134:0/4088431137 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9c0082030 con 0x55a523831ae0 2024-04-24T02:14:10.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.026+0000 7fb9ceabe640 1 -- 172.21.15.134:0/4088431137 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a52382e1d0 con 0x55a523828ff0 2024-04-24T02:14:10.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.026+0000 7fb9cf2bf640 1 -- 172.21.15.134:0/4088431137 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9c8010d70 con 0x55a523828ff0 2024-04-24T02:14:10.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.026+0000 7fb9cf2bf640 1 -- 172.21.15.134:0/4088431137 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a52382e1d0 con 0x55a523828ff0 2024-04-24T02:14:10.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.027+0000 7fb9cf2bf640 1 -- 172.21.15.134:0/4088431137 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=132b] v30'3 uv3 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fb9c8010d70 con 0x55a523828ff0 2024-04-24T02:14:10.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.027+0000 7fb9cf2bf640 1 -- 172.21.15.134:0/4088431137 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a52382e1d0 con 0x7fb9c401d040 2024-04-24T02:14:10.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.027+0000 7fb9cf2bf640 1 -- 172.21.15.134:0/4088431137 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9c804e040 con 0x7fb9c401d040 2024-04-24T02:14:10.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.027+0000 7fb9cf2bf640 1 -- 172.21.15.134:0/4088431137 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a52382e1d0 con 0x55a523831ae0 2024-04-24T02:14:10.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.027+0000 7fb9ceabe640 1 -- 172.21.15.134:0/4088431137 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9c0082030 con 0x55a523831ae0 2024-04-24T02:14:10.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.027+0000 7fb9ceabe640 1 -- 172.21.15.134:0/4088431137 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a52382e1d0 con 0x7fb9c0086040 2024-04-24T02:14:10.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.027+0000 7fb9ce2bd640 1 -- 172.21.15.134:0/4088431137 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9c4009050 con 0x7fb9c0086040 2024-04-24T02:14:10.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.027+0000 7fb9ce2bd640 1 -- 172.21.15.134:0/4088431137 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a52382e1d0 con 0x55a523828ff0 2024-04-24T02:14:10.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.028+0000 7fb9cf2bf640 1 -- 172.21.15.134:0/4088431137 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9c804e040 con 0x55a523828ff0 2024-04-24T02:14:10.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.028+0000 7fb9cf2bf640 1 -- 172.21.15.134:0/4088431137 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a52382e1d0 con 0x7fb9c401d040 2024-04-24T02:14:10.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.028+0000 7fb9cf2bf640 1 -- 172.21.15.134:0/4088431137 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9c804e040 con 0x7fb9c401d040 2024-04-24T02:14:10.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.028+0000 7fb9cf2bf640 1 -- 172.21.15.134:0/4088431137 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a52382e1d0 con 0x55a523831ae0 2024-04-24T02:14:10.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.028+0000 7fb9ceabe640 1 -- 172.21.15.134:0/4088431137 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9c0082030 con 0x55a523831ae0 2024-04-24T02:14:10.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.028+0000 7fb9ceabe640 1 -- 172.21.15.134:0/4088431137 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a52382e1d0 con 0x7fb9c401d040 2024-04-24T02:14:10.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.028+0000 7fb9cf2bf640 1 -- 172.21.15.134:0/4088431137 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9c804e040 con 0x7fb9c401d040 2024-04-24T02:14:10.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.028+0000 7fb9cf2bf640 1 -- 172.21.15.134:0/4088431137 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a52382e1d0 con 0x7fb9c0086040 2024-04-24T02:14:10.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.029+0000 7fb9ce2bd640 1 -- 172.21.15.134:0/4088431137 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9c4009050 con 0x7fb9c0086040 2024-04-24T02:14:10.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.029+0000 7fb9ce2bd640 1 -- 172.21.15.134:0/4088431137 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a52382e1d0 con 0x55a523831ae0 2024-04-24T02:14:10.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.029+0000 7fb9ceabe640 1 -- 172.21.15.134:0/4088431137 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9c0082030 con 0x55a523831ae0 2024-04-24T02:14:10.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.029+0000 7fb9ceabe640 1 -- 172.21.15.134:0/4088431137 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a52382e1d0 con 0x7fb9c0086040 2024-04-24T02:14:10.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.029+0000 7fb9ce2bd640 1 -- 172.21.15.134:0/4088431137 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9c4009050 con 0x7fb9c0086040 2024-04-24T02:14:10.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.029+0000 7fb9ce2bd640 1 -- 172.21.15.134:0/4088431137 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a52382e1d0 con 0x55a523828ff0 2024-04-24T02:14:10.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.029+0000 7fb9cf2bf640 1 -- 172.21.15.134:0/4088431137 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(35 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb9c804e040 con 0x55a523828ff0 2024-04-24T02:14:10.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.029+0000 7fb9cf2bf640 1 -- 172.21.15.134:0/4088431137 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a52382e1d0 con 0x7fb9c0086040 2024-04-24T02:14:10.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.030+0000 7fb9ce2bd640 1 -- 172.21.15.134:0/4088431137 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9c4009050 con 0x7fb9c0086040 2024-04-24T02:14:10.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.030+0000 7fb9d2d29800 1 -- 172.21.15.134:0/4088431137 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a523838590 con 0x55a523828ff0 2024-04-24T02:14:10.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.030+0000 7fb9cf2bf640 1 -- 172.21.15.134:0/4088431137 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb9c804e040 con 0x55a523828ff0 2024-04-24T02:14:10.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.030+0000 7fb9d2d29800 1 -- 172.21.15.134:0/4088431137 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a523835b60 con 0x55a523828ff0 2024-04-24T02:14:10.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.030+0000 7fb9cf2bf640 1 -- 172.21.15.134:0/4088431137 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv3 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb9c804e040 con 0x55a523828ff0 2024-04-24T02:14:10.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.030+0000 7fb9d2d29800 1 -- 172.21.15.134:0/4088431137 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [create,call version.set in=58b,writefull 0~1155 in=1155b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5238330e0 con 0x55a523828ff0 2024-04-24T02:14:10.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.031+0000 7fb9cf2bf640 1 -- 172.21.15.134:0/4088431137 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [create,call,writefull 0~1155] v32'4 uv4 ondisk = 0) ==== 274+0+0 (crc 0 0 0) 0x7fb9c804e040 con 0x55a523828ff0 2024-04-24T02:14:10.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.031+0000 7fb9d2d29800 1 -- 172.21.15.134:0/4088431137 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a523839f60 con 0x55a523828ff0 2024-04-24T02:14:10.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.033+0000 7fb9cf2bf640 1 -- 172.21.15.134:0/4088431137 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v32'3 uv3 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7fb9c804e040 con 0x55a523828ff0 2024-04-24T02:14:10.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.033+0000 7fb9d2d29800 1 -- 172.21.15.134:0/4088431137 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a523839f60 con 0x55a523828ff0 2024-04-24T02:14:10.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.033+0000 7fb9cf2bf640 1 -- 172.21.15.134:0/4088431137 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v32'5 uv2 ondisk = -17 ((17) File exists)) ==== 199+0+0 (crc 0 0 0) 0x7fb9c804e040 con 0x55a523828ff0 2024-04-24T02:14:10.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.034+0000 7fb9d2d29800 1 -- 172.21.15.134:0/1019778887 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fb8a8036950 msgr2=0x7fb8a8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.034+0000 7fb9d2d29800 1 --2- 172.21.15.134:0/1019778887 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fb8a8036950 0x7fb8a8038e10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb9c4000f60 tx=0x7fb9c4001230 comp rx=0 tx=0).stop 2024-04-24T02:14:10.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.034+0000 7fb9d2d29800 1 -- 172.21.15.134:0/1019778887 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5237f99d0 msgr2=0x55a523800ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.034+0000 7fb9d2d29800 1 --2- 172.21.15.134:0/1019778887 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5237f99d0 0x55a523800ee0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fb9c800a930 tx=0x7fb9c8003370 comp rx=0 tx=0).stop 2024-04-24T02:14:10.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.034+0000 7fb9d2d29800 1 -- 172.21.15.134:0/1019778887 shutdown_connections 2024-04-24T02:14:10.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.034+0000 7fb9d2d29800 1 --2- 172.21.15.134:0/1019778887 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fb8a8036950 0x7fb8a8038e10 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.034+0000 7fb9d2d29800 1 --2- 172.21.15.134:0/1019778887 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5237f99d0 0x55a523800ee0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.034+0000 7fb9d2d29800 1 -- 172.21.15.134:0/1019778887 >> 172.21.15.134:0/1019778887 conn(0x55a5236f0f70 msgr2=0x55a5237f3ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:10.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.034+0000 7fb9d2d29800 1 -- 172.21.15.134:0/1019778887 shutdown_connections 2024-04-24T02:14:10.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.034+0000 7fb9d2d29800 1 -- 172.21.15.134:0/1019778887 wait complete. 2024-04-24T02:14:10.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.035+0000 7fb9d2d29800 1 -- 172.21.15.134:0/4130199809 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fb80c036950 msgr2=0x7fb80c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.035+0000 7fb9d2d29800 1 --2- 172.21.15.134:0/4130199809 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fb80c036950 0x7fb80c038e10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb9c4001ed0 tx=0x7fb9c400f000 comp rx=0 tx=0).stop 2024-04-24T02:14:10.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.035+0000 7fb9d2d29800 1 -- 172.21.15.134:0/4130199809 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a52381b5f0 msgr2=0x55a52381ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.035+0000 7fb9d2d29800 1 --2- 172.21.15.134:0/4130199809 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a52381b5f0 0x55a52381ba10 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0066fd0 tx=0x7fb9c0002df0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.035+0000 7fb9d2d29800 1 -- 172.21.15.134:0/4130199809 shutdown_connections 2024-04-24T02:14:10.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.035+0000 7fb9d2d29800 1 --2- 172.21.15.134:0/4130199809 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fb80c036950 0x7fb80c038e10 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.035+0000 7fb9d2d29800 1 --2- 172.21.15.134:0/4130199809 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a52381b5f0 0x55a52381ba10 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.035+0000 7fb9d2d29800 1 -- 172.21.15.134:0/4130199809 >> 172.21.15.134:0/4130199809 conn(0x55a5238100a0 msgr2=0x55a523810ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:10.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.035+0000 7fb9d2d29800 1 -- 172.21.15.134:0/4130199809 shutdown_connections 2024-04-24T02:14:10.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.035+0000 7fb9d2d29800 1 -- 172.21.15.134:0/4130199809 wait complete. 2024-04-24T02:14:10.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.035+0000 7fb9d2d29800 1 -- 172.21.15.134:0/4088431137 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fb9c401d040 msgr2=0x7fb9c401c980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.035+0000 7fb9d2d29800 1 --2- 172.21.15.134:0/4088431137 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fb9c401d040 0x7fb9c401c980 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.035+0000 7fb9d2d29800 1 -- 172.21.15.134:0/4088431137 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55a523828ff0 msgr2=0x55a52382b3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.035+0000 7fb9d2d29800 1 --2- 172.21.15.134:0/4088431137 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55a523828ff0 0x55a52382b3e0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.035+0000 7fb9d2d29800 1 -- 172.21.15.134:0/4088431137 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fb9c0086040 msgr2=0x7fb9c0002000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.035+0000 7fb9d2d29800 1 --2- 172.21.15.134:0/4088431137 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fb9c0086040 0x7fb9c0002000 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.035+0000 7fb9d2d29800 1 -- 172.21.15.134:0/4088431137 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55a523831ae0 msgr2=0x55a523833e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.035+0000 7fb9d2d29800 1 --2- 172.21.15.134:0/4088431137 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55a523831ae0 0x55a523833e20 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.035+0000 7fb9d2d29800 1 -- 172.21.15.134:0/4088431137 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fb8b4036900 msgr2=0x7fb8b4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.035+0000 7fb9d2d29800 1 --2- 172.21.15.134:0/4088431137 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fb8b4036900 0x7fb8b4038dc0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb9c00715e0 tx=0x7fb9c0071570 comp rx=0 tx=0).stop 2024-04-24T02:14:10.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.035+0000 7fb9d2d29800 1 -- 172.21.15.134:0/4088431137 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5236efd10 msgr2=0x55a5237ec0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.035+0000 7fb9cf2bf640 1 -- 172.21.15.134:0/4088431137 reap_dead start 2024-04-24T02:14:10.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.035+0000 7fb9d2d29800 1 --2- 172.21.15.134:0/4088431137 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5236efd10 0x55a5237ec0d0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0055040 tx=0x7fb9c0002fb0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.035+0000 7fb9d2d29800 1 -- 172.21.15.134:0/4088431137 shutdown_connections 2024-04-24T02:14:10.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.035+0000 7fb9d2d29800 1 --2- 172.21.15.134:0/4088431137 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5236efd10 0x55a5237ec0d0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.035+0000 7fb9d2d29800 1 -- 172.21.15.134:0/4088431137 >> 172.21.15.134:0/4088431137 conn(0x55a5236eb370 msgr2=0x55a5237db5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:10.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.035+0000 7fb9d2d29800 1 -- 172.21.15.134:0/4088431137 shutdown_connections 2024-04-24T02:14:10.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.035+0000 7fb9d2d29800 1 -- 172.21.15.134:0/4088431137 wait complete. 2024-04-24T02:14:10.055 INFO:teuthology.orchestra.run.smithi134.stdout:{"id":"582e5324-1512-4fe8-bc69-2f28bbcfaf89","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-04-24T02:14:10.056 DEBUG:tasks.util.rgw: json result: {'id': '582e5324-1512-4fe8-bc69-2f28bbcfaf89', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-04-24T02:14:10.056 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-04-24T02:14:10.056 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-04-24T02:14:10.056 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-04-24T02:14:10.137 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:14:10.137 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:14:10.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.136+0000 7ff40d298800 1 Processor -- start 2024-04-24T02:14:10.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.137+0000 7ff40d298800 1 -- start start 2024-04-24T02:14:10.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.137+0000 7ff40d298800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x563a1523e790 0x563a1523ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.137+0000 7ff40d298800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563a150fed40 con 0x563a1523f0f0 2024-04-24T02:14:10.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.137+0000 7ff40d298800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x563a150d14d0 con 0x563a1523e790 2024-04-24T02:14:10.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.137+0000 7ff40ad9e640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x563a1523e790 0x563a1523ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.137+0000 7ff40a59d640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x563a1523f0f0 0x563a1523f5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:46398/0 (socket says 172.21.15.134:46398) 2024-04-24T02:14:10.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.137+0000 7ff40a59d640 1 -- 172.21.15.134:0/422498144 learned_addr learned my addr 172.21.15.134:0/422498144 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:14:10.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.137+0000 7ff40ad9e640 1 -- 172.21.15.134:0/422498144 >> v1:172.21.15.104:6789/0 conn(0x563a1523f0f0 legacy=0x563a1523f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.137+0000 7ff40ad9e640 1 -- 172.21.15.134:0/422498144 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a150fd590 con 0x563a1523e790 2024-04-24T02:14:10.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.139+0000 7ff40ad9e640 1 --2- 172.21.15.134:0/422498144 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a1523e790 0x563a1523ebb0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7ff404005fd0 tx=0x7ff40401ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b2d56f48e9caae4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.139+0000 7ff409d9c640 1 -- 172.21.15.134:0/422498144 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff404052560 con 0x563a1523e790 2024-04-24T02:14:10.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.139+0000 7ff409d9c640 1 -- 172.21.15.134:0/422498144 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff404052700 con 0x563a1523e790 2024-04-24T02:14:10.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.139+0000 7ff409d9c640 1 -- 172.21.15.134:0/422498144 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff404052a60 con 0x563a1523e790 2024-04-24T02:14:10.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.140+0000 7ff40d298800 1 -- 172.21.15.134:0/422498144 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a1523e790 msgr2=0x563a1523ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.140+0000 7ff40d298800 1 --2- 172.21.15.134:0/422498144 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a1523e790 0x563a1523ebb0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7ff404005fd0 tx=0x7ff40401ccc0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.140+0000 7ff40d298800 1 -- 172.21.15.134:0/422498144 shutdown_connections 2024-04-24T02:14:10.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.140+0000 7ff40d298800 1 --2- 172.21.15.134:0/422498144 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a1523e790 0x563a1523ebb0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.140+0000 7ff40d298800 1 -- 172.21.15.134:0/422498144 >> 172.21.15.134:0/422498144 conn(0x563a1523a310 msgr2=0x563a1523c730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:10.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.140+0000 7ff40d298800 1 -- 172.21.15.134:0/422498144 shutdown_connections 2024-04-24T02:14:10.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.140+0000 7ff40d298800 1 -- 172.21.15.134:0/422498144 wait complete. 2024-04-24T02:14:10.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.151+0000 7ff40d298800 1 Processor -- start 2024-04-24T02:14:10.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.152+0000 7ff40d298800 1 -- start start 2024-04-24T02:14:10.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.152+0000 7ff40d298800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a1523e790 0x563a15333380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.152+0000 7ff40d298800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x563a1518b3b0 con 0x563a1523e790 2024-04-24T02:14:10.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.152+0000 7ff40ad9e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a1523e790 0x563a15333380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.152+0000 7ff40ad9e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a1523e790 0x563a15333380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43370/0 (socket says 172.21.15.134:43370) 2024-04-24T02:14:10.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.152+0000 7ff40ad9e640 1 -- 172.21.15.134:0/1910924834 learned_addr learned my addr 172.21.15.134:0/1910924834 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:10.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.152+0000 7ff40ad9e640 1 -- 172.21.15.134:0/1910924834 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a15333950 con 0x563a1523e790 2024-04-24T02:14:10.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.153+0000 7ff40ad9e640 1 --2- 172.21.15.134:0/1910924834 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a1523e790 0x563a15333380 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7ff404054040 tx=0x7ff40404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63455c1f30322c08 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.153+0000 7ff2f8e09640 1 -- 172.21.15.134:0/1910924834 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4040529e0 con 0x563a1523e790 2024-04-24T02:14:10.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.153+0000 7ff2f8e09640 1 -- 172.21.15.134:0/1910924834 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff404052b80 con 0x563a1523e790 2024-04-24T02:14:10.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.153+0000 7ff2f8e09640 1 -- 172.21.15.134:0/1910924834 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff40405c430 con 0x563a1523e790 2024-04-24T02:14:10.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.153+0000 7ff40d298800 1 -- 172.21.15.134:0/1910924834 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a1523e790 msgr2=0x563a15333380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.153+0000 7ff40d298800 1 --2- 172.21.15.134:0/1910924834 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a1523e790 0x563a15333380 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7ff404054040 tx=0x7ff40404c000 comp rx=0 tx=0).stop 2024-04-24T02:14:10.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.153+0000 7ff40d298800 1 -- 172.21.15.134:0/1910924834 shutdown_connections 2024-04-24T02:14:10.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.153+0000 7ff40d298800 1 --2- 172.21.15.134:0/1910924834 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a1523e790 0x563a15333380 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.153+0000 7ff40d298800 1 -- 172.21.15.134:0/1910924834 >> 172.21.15.134:0/1910924834 conn(0x563a1523a310 msgr2=0x563a1532eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:10.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.154+0000 7ff40d298800 1 -- 172.21.15.134:0/1910924834 shutdown_connections 2024-04-24T02:14:10.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.154+0000 7ff40d298800 1 -- 172.21.15.134:0/1910924834 wait complete. 2024-04-24T02:14:10.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.154+0000 7ff40d298800 1 Processor -- start 2024-04-24T02:14:10.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.154+0000 7ff40d298800 1 -- start start 2024-04-24T02:14:10.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.154+0000 7ff40d298800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a1523e790 0x563a1533ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.154+0000 7ff40d298800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x563a1523ff50 con 0x563a1523e790 2024-04-24T02:14:10.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.154+0000 7ff40ad9e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a1523e790 0x563a1533ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.154+0000 7ff40ad9e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a1523e790 0x563a1533ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43386/0 (socket says 172.21.15.134:43386) 2024-04-24T02:14:10.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.154+0000 7ff40ad9e640 1 -- 172.21.15.134:0/1548291683 learned_addr learned my addr 172.21.15.134:0/1548291683 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:10.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.154+0000 7ff40ad9e640 1 -- 172.21.15.134:0/1548291683 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a1533b290 con 0x563a1523e790 2024-04-24T02:14:10.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.155+0000 7ff40ad9e640 1 --2- 172.21.15.134:0/1548291683 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a1523e790 0x563a1533ad50 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7ff404044810 tx=0x7ff404003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.155+0000 7ff2f7606640 1 -- 172.21.15.134:0/1548291683 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff404066540 con 0x563a1523e790 2024-04-24T02:14:10.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.155+0000 7ff2f7606640 1 -- 172.21.15.134:0/1548291683 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4040666e0 con 0x563a1523e790 2024-04-24T02:14:10.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.155+0000 7ff2f7606640 1 -- 172.21.15.134:0/1548291683 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff404066a00 con 0x563a1523e790 2024-04-24T02:14:10.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.155+0000 7ff40d298800 1 -- 172.21.15.134:0/1548291683 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563a1533b520 con 0x563a1523e790 2024-04-24T02:14:10.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.155+0000 7ff40d298800 1 -- 172.21.15.134:0/1548291683 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a1533e1d0 con 0x563a1523e790 2024-04-24T02:14:10.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.155+0000 7ff40d298800 1 Processor -- start 2024-04-24T02:14:10.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.156+0000 7ff40d298800 1 -- start start 2024-04-24T02:14:10.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.156+0000 7ff2f7606640 1 -- 172.21.15.134:0/1548291683 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff404078020 con 0x563a1523e790 2024-04-24T02:14:10.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.156+0000 7ff40d298800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a15348680 0x563a15348aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.156+0000 7ff40d298800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x563a151316b0 con 0x563a15348680 2024-04-24T02:14:10.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.156+0000 7ff2f7606640 1 --2- 172.21.15.134:0/1548291683 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7ff2f0036900 0x7ff2f0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.156+0000 7ff40b59f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a15348680 0x563a15348aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.156+0000 7ff40b59f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a15348680 0x563a15348aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43396/0 (socket says 172.21.15.134:43396) 2024-04-24T02:14:10.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.156+0000 7ff2f7606640 1 -- 172.21.15.134:0/1548291683 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7ff40408eb20 con 0x563a1523e790 2024-04-24T02:14:10.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.156+0000 7ff40b59f640 1 -- 172.21.15.134:0/444697992 learned_addr learned my addr 172.21.15.134:0/444697992 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:10.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.156+0000 7ff40ad9e640 1 --2- 172.21.15.134:0/1548291683 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7ff2f0036900 0x7ff2f0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.156+0000 7ff40b59f640 1 -- 172.21.15.134:0/444697992 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a15348fe0 con 0x563a15348680 2024-04-24T02:14:10.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.156+0000 7ff40ad9e640 1 --2- 172.21.15.134:0/1548291683 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7ff2f0036900 0x7ff2f0038dc0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff40401cce0 tx=0x7ff40405c4f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.156+0000 7ff40b59f640 1 --2- 172.21.15.134:0/444697992 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a15348680 0x563a15348aa0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc00a400 tx=0x7ff3fc00a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86763b935eabc6f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.156+0000 7ff2f5602640 1 -- 172.21.15.134:0/444697992 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3fc0087e0 con 0x563a15348680 2024-04-24T02:14:10.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.156+0000 7ff2f5602640 1 -- 172.21.15.134:0/444697992 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3fc0089a0 con 0x563a15348680 2024-04-24T02:14:10.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.156+0000 7ff2f5602640 1 -- 172.21.15.134:0/444697992 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3fc008d00 con 0x563a15348680 2024-04-24T02:14:10.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.157+0000 7ff40d298800 1 -- 172.21.15.134:0/444697992 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a15348680 msgr2=0x563a15348aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.157+0000 7ff40d298800 1 --2- 172.21.15.134:0/444697992 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a15348680 0x563a15348aa0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc00a400 tx=0x7ff3fc00a8c0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.157+0000 7ff40d298800 1 -- 172.21.15.134:0/444697992 shutdown_connections 2024-04-24T02:14:10.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.157+0000 7ff40d298800 1 --2- 172.21.15.134:0/444697992 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a15348680 0x563a15348aa0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.157+0000 7ff40d298800 1 -- 172.21.15.134:0/444697992 >> 172.21.15.134:0/444697992 conn(0x563a1523f0f0 msgr2=0x563a15345120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:10.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.157+0000 7ff40d298800 1 -- 172.21.15.134:0/444697992 shutdown_connections 2024-04-24T02:14:10.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.157+0000 7ff40d298800 1 -- 172.21.15.134:0/444697992 wait complete. 2024-04-24T02:14:10.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.157+0000 7ff40d298800 1 Processor -- start 2024-04-24T02:14:10.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.157+0000 7ff40d298800 1 -- start start 2024-04-24T02:14:10.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.157+0000 7ff40d298800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a15348680 0x563a1534fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.157+0000 7ff40d298800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x563a15349970 con 0x563a15348680 2024-04-24T02:14:10.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.158+0000 7ff40b59f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a15348680 0x563a1534fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.158+0000 7ff40b59f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a15348680 0x563a1534fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43412/0 (socket says 172.21.15.134:43412) 2024-04-24T02:14:10.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.158+0000 7ff40b59f640 1 -- 172.21.15.134:0/28848587 learned_addr learned my addr 172.21.15.134:0/28848587 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:10.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.158+0000 7ff40b59f640 1 -- 172.21.15.134:0/28848587 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a153500a0 con 0x563a15348680 2024-04-24T02:14:10.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.158+0000 7ff40b59f640 1 --2- 172.21.15.134:0/28848587 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a15348680 0x563a1534fb60 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x563a15349430 tx=0x7ff3fc002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.158+0000 7ff2ef7fe640 1 -- 172.21.15.134:0/28848587 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3fc022020 con 0x563a15348680 2024-04-24T02:14:10.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.158+0000 7ff2ef7fe640 1 -- 172.21.15.134:0/28848587 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3fc019040 con 0x563a15348680 2024-04-24T02:14:10.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.158+0000 7ff40d298800 1 -- 172.21.15.134:0/28848587 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563a15350330 con 0x563a15348680 2024-04-24T02:14:10.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.158+0000 7ff2ef7fe640 1 -- 172.21.15.134:0/28848587 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3fc013950 con 0x563a15348680 2024-04-24T02:14:10.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.158+0000 7ff40d298800 1 -- 172.21.15.134:0/28848587 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a15352fe0 con 0x563a15348680 2024-04-24T02:14:10.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.159+0000 7ff2ef7fe640 1 -- 172.21.15.134:0/28848587 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff3fc025020 con 0x563a15348680 2024-04-24T02:14:10.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.159+0000 7ff2ef7fe640 1 --2- 172.21.15.134:0/28848587 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7ff2e4036950 0x7ff2e4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.159+0000 7ff2ef7fe640 1 -- 172.21.15.134:0/28848587 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7ff3fc04c230 con 0x563a15348680 2024-04-24T02:14:10.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.159+0000 7ff40d298800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:14:10.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.159+0000 7ff40d298800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:14:10.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.159+0000 7ff40a59d640 1 --2- 172.21.15.134:0/28848587 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7ff2e4036950 0x7ff2e4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.160+0000 7ff40d298800 1 Processor -- start 2024-04-24T02:14:10.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.160+0000 7ff40d298800 1 -- start start 2024-04-24T02:14:10.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.160+0000 7ff40a59d640 1 --2- 172.21.15.134:0/28848587 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7ff2e4036950 0x7ff2e4038e10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff400000f60 tx=0x7ff400001230 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.160+0000 7ff40d298800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a1536a260 0x563a1536a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.160+0000 7ff40d298800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x563a15333c10 con 0x563a1536a260 2024-04-24T02:14:10.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.160+0000 7ff40ad9e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a1536a260 0x563a1536a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.160+0000 7ff40ad9e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a1536a260 0x563a1536a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43428/0 (socket says 172.21.15.134:43428) 2024-04-24T02:14:10.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.160+0000 7ff40ad9e640 1 -- 172.21.15.134:0/111963920 learned_addr learned my addr 172.21.15.134:0/111963920 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:10.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.160+0000 7ff40ad9e640 1 -- 172.21.15.134:0/111963920 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a1536abc0 con 0x563a1536a260 2024-04-24T02:14:10.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.161+0000 7ff40ad9e640 1 --2- 172.21.15.134:0/111963920 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a1536a260 0x563a1536a680 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7ff40408cfa0 tx=0x7ff4040705d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.161+0000 7ff2cffe7640 1 -- 172.21.15.134:0/111963920 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff40408a050 con 0x563a1536a260 2024-04-24T02:14:10.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.161+0000 7ff2cffe7640 1 -- 172.21.15.134:0/111963920 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff40408b040 con 0x563a1536a260 2024-04-24T02:14:10.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.161+0000 7ff40d298800 1 -- 172.21.15.134:0/111963920 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563a1536b630 con 0x563a1536a260 2024-04-24T02:14:10.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.161+0000 7ff2cffe7640 1 -- 172.21.15.134:0/111963920 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff404005040 con 0x563a1536a260 2024-04-24T02:14:10.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.161+0000 7ff40d298800 1 -- 172.21.15.134:0/111963920 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a1536bb30 con 0x563a1536a260 2024-04-24T02:14:10.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.162+0000 7ff2cffe7640 1 -- 172.21.15.134:0/111963920 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff4040051e0 con 0x563a1536a260 2024-04-24T02:14:10.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.162+0000 7ff2cffe7640 1 --2- 172.21.15.134:0/111963920 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7ff248036950 0x7ff248038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.162+0000 7ff2cffe7640 1 -- 172.21.15.134:0/111963920 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7ff404097bb0 con 0x563a1536a260 2024-04-24T02:14:10.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.162+0000 7ff40a59d640 1 --2- 172.21.15.134:0/111963920 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7ff248036950 0x7ff248038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.162+0000 7ff2cdfe3640 20 reqs_thread_entry: start 2024-04-24T02:14:10.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.162+0000 7ff40a59d640 1 --2- 172.21.15.134:0/111963920 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7ff248036950 0x7ff248038e10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff400001ed0 tx=0x7ff40000f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.162+0000 7ff40d298800 1 --2- 172.21.15.134:0/1548291683 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x563a15377c60 0x563a1537a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.162+0000 7ff40d298800 1 -- 172.21.15.134:0/1548291683 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a1537a760 con 0x563a15377c60 2024-04-24T02:14:10.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.162+0000 7ff40b59f640 1 --2- 172.21.15.134:0/1548291683 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x563a15377c60 0x563a1537a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.163+0000 7ff40b59f640 1 --2- 172.21.15.134:0/1548291683 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x563a15377c60 0x563a1537a0b0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.163+0000 7ff40b59f640 1 -- 172.21.15.134:0/1548291683 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff3fc0491a0 con 0x563a15377c60 2024-04-24T02:14:10.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.163+0000 7ff40d298800 1 -- 172.21.15.134:0/1548291683 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a1537b040 con 0x563a15377c60 2024-04-24T02:14:10.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.163+0000 7ff40b59f640 1 -- 172.21.15.134:0/1548291683 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff3fc0491a0 con 0x563a15377c60 2024-04-24T02:14:10.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.163+0000 7ff40d298800 1 -- 172.21.15.134:0/1548291683 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a1537c3f0 con 0x563a15377c60 2024-04-24T02:14:10.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.163+0000 7ff40b59f640 1 -- 172.21.15.134:0/1548291683 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~1155 out=1155b] v0'0 uv4 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7ff3fc0491a0 con 0x563a15377c60 2024-04-24T02:14:10.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.164+0000 7ff40d298800 1 -- 172.21.15.134:0/28848587 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7ff2e4036950 msgr2=0x7ff2e4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.164+0000 7ff40d298800 1 --2- 172.21.15.134:0/28848587 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7ff2e4036950 0x7ff2e4038e10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff400000f60 tx=0x7ff400001230 comp rx=0 tx=0).stop 2024-04-24T02:14:10.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.164+0000 7ff40d298800 1 -- 172.21.15.134:0/28848587 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a15348680 msgr2=0x563a1534fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.164+0000 7ff40d298800 1 --2- 172.21.15.134:0/28848587 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a15348680 0x563a1534fb60 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x563a15349430 tx=0x7ff3fc002ff0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.164+0000 7ff40d298800 1 -- 172.21.15.134:0/28848587 shutdown_connections 2024-04-24T02:14:10.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.164+0000 7ff40d298800 1 --2- 172.21.15.134:0/28848587 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7ff2e4036950 0x7ff2e4038e10 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.164+0000 7ff40d298800 1 --2- 172.21.15.134:0/28848587 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a15348680 0x563a1534fb60 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.164+0000 7ff40d298800 1 -- 172.21.15.134:0/28848587 >> 172.21.15.134:0/28848587 conn(0x563a1523f0f0 msgr2=0x563a15342760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:10.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.164+0000 7ff40d298800 1 -- 172.21.15.134:0/28848587 shutdown_connections 2024-04-24T02:14:10.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.164+0000 7ff40d298800 1 -- 172.21.15.134:0/28848587 wait complete. 2024-04-24T02:14:10.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.164+0000 7ff40d298800 1 -- 172.21.15.134:0/111963920 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7ff248036950 msgr2=0x7ff248038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.164+0000 7ff40d298800 1 --2- 172.21.15.134:0/111963920 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7ff248036950 0x7ff248038e10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff400001ed0 tx=0x7ff40000f000 comp rx=0 tx=0).stop 2024-04-24T02:14:10.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.165+0000 7ff40d298800 1 -- 172.21.15.134:0/111963920 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a1536a260 msgr2=0x563a1536a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.165+0000 7ff40d298800 1 --2- 172.21.15.134:0/111963920 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a1536a260 0x563a1536a680 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7ff40408cfa0 tx=0x7ff4040705d0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.165+0000 7ff40d298800 1 -- 172.21.15.134:0/111963920 shutdown_connections 2024-04-24T02:14:10.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.165+0000 7ff40d298800 1 --2- 172.21.15.134:0/111963920 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7ff248036950 0x7ff248038e10 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.165+0000 7ff40d298800 1 --2- 172.21.15.134:0/111963920 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a1536a260 0x563a1536a680 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.165+0000 7ff40d298800 1 -- 172.21.15.134:0/111963920 >> 172.21.15.134:0/111963920 conn(0x563a1535ed10 msgr2=0x563a1535f730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:10.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.165+0000 7ff40d298800 1 -- 172.21.15.134:0/111963920 shutdown_connections 2024-04-24T02:14:10.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.165+0000 7ff40d298800 1 -- 172.21.15.134:0/111963920 wait complete. 2024-04-24T02:14:10.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.165+0000 7ff40d298800 1 -- 172.21.15.134:0/1548291683 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x563a15377c60 msgr2=0x563a1537a0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.165+0000 7ff40d298800 1 --2- 172.21.15.134:0/1548291683 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x563a15377c60 0x563a1537a0b0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.165+0000 7ff40d298800 1 -- 172.21.15.134:0/1548291683 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7ff2f0036900 msgr2=0x7ff2f0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.165+0000 7ff40d298800 1 --2- 172.21.15.134:0/1548291683 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7ff2f0036900 0x7ff2f0038dc0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff40401cce0 tx=0x7ff40405c4f0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.165+0000 7ff40d298800 1 -- 172.21.15.134:0/1548291683 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a1523e790 msgr2=0x563a1533ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.165+0000 7ff40d298800 1 --2- 172.21.15.134:0/1548291683 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a1523e790 0x563a1533ad50 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7ff404044810 tx=0x7ff404003330 comp rx=0 tx=0).stop 2024-04-24T02:14:10.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.165+0000 7ff40d298800 1 -- 172.21.15.134:0/1548291683 shutdown_connections 2024-04-24T02:14:10.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.165+0000 7ff40d298800 1 --2- 172.21.15.134:0/1548291683 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x563a15377c60 0x563a1537a0b0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.165+0000 7ff40d298800 1 --2- 172.21.15.134:0/1548291683 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7ff2f0036900 0x7ff2f0038dc0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.165+0000 7ff40d298800 1 --2- 172.21.15.134:0/1548291683 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563a1523e790 0x563a1533ad50 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.165+0000 7ff40d298800 1 -- 172.21.15.134:0/1548291683 >> 172.21.15.134:0/1548291683 conn(0x563a1523a310 msgr2=0x563a1532d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:10.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.165+0000 7ff40d298800 1 -- 172.21.15.134:0/1548291683 shutdown_connections 2024-04-24T02:14:10.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.165+0000 7ff40d298800 1 -- 172.21.15.134:0/1548291683 wait complete. 2024-04-24T02:14:10.178 INFO:teuthology.orchestra.run.smithi134.stdout:{"id":"582e5324-1512-4fe8-bc69-2f28bbcfaf89","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-04-24T02:14:10.178 DEBUG:tasks.util.rgw: json result: {'id': '582e5324-1512-4fe8-bc69-2f28bbcfaf89', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-04-24T02:14:10.179 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-04-24T02:14:10.179 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-04-24T02:14:10.179 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-04-24T02:14:10.264 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:14:10.264 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:14:10.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.264+0000 7f43eab19800 1 Processor -- start 2024-04-24T02:14:10.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.264+0000 7f43eab19800 1 -- start start 2024-04-24T02:14:10.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.264+0000 7f43eab19800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x558903403a10 0x558903405e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.264+0000 7f43eab19800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5589032c1d40 con 0x558903406340 2024-04-24T02:14:10.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.264+0000 7f43eab19800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x5589032944d0 con 0x558903403a10 2024-04-24T02:14:10.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.264+0000 7f43e8618640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x558903403a10 0x558903405e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.264+0000 7f43e8618640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x558903403a10 0x558903405e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43434/0 (socket says 172.21.15.134:43434) 2024-04-24T02:14:10.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.264+0000 7f43e7e17640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x558903406340 0x558903408730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:46410/0 (socket says 172.21.15.134:46410) 2024-04-24T02:14:10.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.264+0000 7f43e8618640 1 -- 172.21.15.134:0/26517938 learned_addr learned my addr 172.21.15.134:0/26517938 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:10.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.265+0000 7f43e8618640 1 -- 172.21.15.134:0/26517938 >> v1:172.21.15.104:6789/0 conn(0x558903406340 legacy=0x558903408730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.265+0000 7f43e8618640 1 -- 172.21.15.134:0/26517938 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589032c0590 con 0x558903403a10 2024-04-24T02:14:10.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.266+0000 7f43e8618640 1 --2- 172.21.15.134:0/26517938 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558903403a10 0x558903405e00 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f43d800a520 tx=0x7f43d801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ef1c4dca9a166df server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.267+0000 7f43e7616640 1 -- 172.21.15.134:0/26517938 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43d8057070 con 0x558903403a10 2024-04-24T02:14:10.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.267+0000 7f43e7616640 1 -- 172.21.15.134:0/26517938 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43d8052570 con 0x558903403a10 2024-04-24T02:14:10.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.267+0000 7f43e7616640 1 -- 172.21.15.134:0/26517938 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43d804ae60 con 0x558903403a10 2024-04-24T02:14:10.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.267+0000 7f43eab19800 1 -- 172.21.15.134:0/26517938 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558903403a10 msgr2=0x558903405e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.267+0000 7f43eab19800 1 --2- 172.21.15.134:0/26517938 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558903403a10 0x558903405e00 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f43d800a520 tx=0x7f43d801d010 comp rx=0 tx=0).stop 2024-04-24T02:14:10.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.267+0000 7f43eab19800 1 -- 172.21.15.134:0/26517938 shutdown_connections 2024-04-24T02:14:10.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.267+0000 7f43eab19800 1 --2- 172.21.15.134:0/26517938 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558903403a10 0x558903405e00 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.267+0000 7f43eab19800 1 -- 172.21.15.134:0/26517938 >> 172.21.15.134:0/26517938 conn(0x5589033fd380 msgr2=0x5589033ff7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:10.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.267+0000 7f43eab19800 1 -- 172.21.15.134:0/26517938 shutdown_connections 2024-04-24T02:14:10.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.267+0000 7f43eab19800 1 -- 172.21.15.134:0/26517938 wait complete. 2024-04-24T02:14:10.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.279+0000 7f43eab19800 1 Processor -- start 2024-04-24T02:14:10.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.279+0000 7f43eab19800 1 -- start start 2024-04-24T02:14:10.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.279+0000 7f43eab19800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558903403a10 0x5589034f4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.279+0000 7f43eab19800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55890334e3e0 con 0x558903403a10 2024-04-24T02:14:10.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.279+0000 7f43e8618640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558903403a10 0x5589034f4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.279+0000 7f43e8618640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558903403a10 0x5589034f4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43450/0 (socket says 172.21.15.134:43450) 2024-04-24T02:14:10.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.279+0000 7f43e8618640 1 -- 172.21.15.134:0/2761642539 learned_addr learned my addr 172.21.15.134:0/2761642539 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:10.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.280+0000 7f43e8618640 1 -- 172.21.15.134:0/2761642539 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589034f4800 con 0x558903403a10 2024-04-24T02:14:10.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.280+0000 7f43e8618640 1 --2- 172.21.15.134:0/2761642539 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558903403a10 0x5589034f4230 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f43d8055040 tx=0x7f43d804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79bc8078263c9173 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.280+0000 7f42d660c640 1 -- 172.21.15.134:0/2761642539 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43d8057040 con 0x558903403a10 2024-04-24T02:14:10.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.280+0000 7f42d660c640 1 -- 172.21.15.134:0/2761642539 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43d8052720 con 0x558903403a10 2024-04-24T02:14:10.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.280+0000 7f42d660c640 1 -- 172.21.15.134:0/2761642539 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43d8052a40 con 0x558903403a10 2024-04-24T02:14:10.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.281+0000 7f43eab19800 1 -- 172.21.15.134:0/2761642539 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558903403a10 msgr2=0x5589034f4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.281+0000 7f43eab19800 1 --2- 172.21.15.134:0/2761642539 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558903403a10 0x5589034f4230 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f43d8055040 tx=0x7f43d804c000 comp rx=0 tx=0).stop 2024-04-24T02:14:10.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.281+0000 7f43eab19800 1 -- 172.21.15.134:0/2761642539 shutdown_connections 2024-04-24T02:14:10.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.281+0000 7f43eab19800 1 --2- 172.21.15.134:0/2761642539 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558903403a10 0x5589034f4230 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.281+0000 7f43eab19800 1 -- 172.21.15.134:0/2761642539 >> 172.21.15.134:0/2761642539 conn(0x5589033fd380 msgr2=0x5589034efb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:10.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.281+0000 7f43eab19800 1 -- 172.21.15.134:0/2761642539 shutdown_connections 2024-04-24T02:14:10.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.281+0000 7f43eab19800 1 -- 172.21.15.134:0/2761642539 wait complete. 2024-04-24T02:14:10.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.281+0000 7f43eab19800 1 Processor -- start 2024-04-24T02:14:10.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.281+0000 7f43eab19800 1 -- start start 2024-04-24T02:14:10.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.281+0000 7f43eab19800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558903403a10 0x5589034fbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.281+0000 7f43eab19800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55890340c160 con 0x558903403a10 2024-04-24T02:14:10.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.281+0000 7f43e8618640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558903403a10 0x5589034fbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.281+0000 7f43e8618640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558903403a10 0x5589034fbc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43462/0 (socket says 172.21.15.134:43462) 2024-04-24T02:14:10.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.281+0000 7f43e8618640 1 -- 172.21.15.134:0/337039126 learned_addr learned my addr 172.21.15.134:0/337039126 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:10.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.282+0000 7f43e8618640 1 -- 172.21.15.134:0/337039126 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589034fc1c0 con 0x558903403a10 2024-04-24T02:14:10.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.282+0000 7f43e8618640 1 --2- 172.21.15.134:0/337039126 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558903403a10 0x5589034fbc80 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f43d80524f0 tx=0x7f43d8003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.282+0000 7f42d4e09640 1 -- 172.21.15.134:0/337039126 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43d8073070 con 0x558903403a10 2024-04-24T02:14:10.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.282+0000 7f42d4e09640 1 -- 172.21.15.134:0/337039126 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43d805d440 con 0x558903403a10 2024-04-24T02:14:10.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.282+0000 7f43eab19800 1 -- 172.21.15.134:0/337039126 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5589034fc450 con 0x558903403a10 2024-04-24T02:14:10.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.282+0000 7f42d4e09640 1 -- 172.21.15.134:0/337039126 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43d8057070 con 0x558903403a10 2024-04-24T02:14:10.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.282+0000 7f43eab19800 1 -- 172.21.15.134:0/337039126 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589034ff100 con 0x558903403a10 2024-04-24T02:14:10.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.283+0000 7f43eab19800 1 Processor -- start 2024-04-24T02:14:10.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.283+0000 7f43eab19800 1 -- start start 2024-04-24T02:14:10.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.283+0000 7f43eab19800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558903509530 0x558903509950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.283+0000 7f43eab19800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5589032f46b0 con 0x558903509530 2024-04-24T02:14:10.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.283+0000 7f42d4e09640 1 -- 172.21.15.134:0/337039126 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f43d8076070 con 0x558903403a10 2024-04-24T02:14:10.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.283+0000 7f42d4e09640 1 --2- 172.21.15.134:0/337039126 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f42d0036900 0x7f42d0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.283+0000 7f43e8e19640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558903509530 0x558903509950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.283+0000 7f43e8e19640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558903509530 0x558903509950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43474/0 (socket says 172.21.15.134:43474) 2024-04-24T02:14:10.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.283+0000 7f43e8e19640 1 -- 172.21.15.134:0/3994170267 learned_addr learned my addr 172.21.15.134:0/3994170267 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:10.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.283+0000 7f42d4e09640 1 -- 172.21.15.134:0/337039126 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f43d808dbd0 con 0x558903403a10 2024-04-24T02:14:10.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.283+0000 7f43e8618640 1 --2- 172.21.15.134:0/337039126 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f42d0036900 0x7f42d0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.283+0000 7f43e8e19640 1 -- 172.21.15.134:0/3994170267 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558903509e90 con 0x558903509530 2024-04-24T02:14:10.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.284+0000 7f43e8618640 1 --2- 172.21.15.134:0/337039126 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f42d0036900 0x7f42d0038dc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f43d805cfd0 tx=0x7f43d8052ef0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.284+0000 7f43e8e19640 1 --2- 172.21.15.134:0/3994170267 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558903509530 0x558903509950 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f43e000a430 tx=0x7f43e000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceb8676f9e3f5943 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.284+0000 7f42ce7fc640 1 -- 172.21.15.134:0/3994170267 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43e0015070 con 0x558903509530 2024-04-24T02:14:10.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.284+0000 7f42ce7fc640 1 -- 172.21.15.134:0/3994170267 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43e0001670 con 0x558903509530 2024-04-24T02:14:10.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.284+0000 7f42ce7fc640 1 -- 172.21.15.134:0/3994170267 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43e0001990 con 0x558903509530 2024-04-24T02:14:10.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.284+0000 7f43eab19800 1 -- 172.21.15.134:0/3994170267 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558903509530 msgr2=0x558903509950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.284+0000 7f43eab19800 1 --2- 172.21.15.134:0/3994170267 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558903509530 0x558903509950 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f43e000a430 tx=0x7f43e000a8f0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.284+0000 7f43eab19800 1 -- 172.21.15.134:0/3994170267 shutdown_connections 2024-04-24T02:14:10.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.284+0000 7f43eab19800 1 --2- 172.21.15.134:0/3994170267 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558903509530 0x558903509950 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.284+0000 7f43eab19800 1 -- 172.21.15.134:0/3994170267 >> 172.21.15.134:0/3994170267 conn(0x558903406340 msgr2=0x558903505fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:10.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.284+0000 7f43eab19800 1 -- 172.21.15.134:0/3994170267 shutdown_connections 2024-04-24T02:14:10.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.284+0000 7f43eab19800 1 -- 172.21.15.134:0/3994170267 wait complete. 2024-04-24T02:14:10.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.284+0000 7f43eab19800 1 Processor -- start 2024-04-24T02:14:10.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.285+0000 7f43eab19800 1 -- start start 2024-04-24T02:14:10.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.285+0000 7f43eab19800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558903509530 0x558903510a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.285+0000 7f43eab19800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55890350a820 con 0x558903509530 2024-04-24T02:14:10.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.285+0000 7f43e8e19640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558903509530 0x558903510a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.285+0000 7f43e8e19640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558903509530 0x558903510a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43476/0 (socket says 172.21.15.134:43476) 2024-04-24T02:14:10.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.285+0000 7f43e8e19640 1 -- 172.21.15.134:0/3169547577 learned_addr learned my addr 172.21.15.134:0/3169547577 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:10.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.285+0000 7f43e8e19640 1 -- 172.21.15.134:0/3169547577 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558903510f80 con 0x558903509530 2024-04-24T02:14:10.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.285+0000 7f43e8e19640 1 --2- 172.21.15.134:0/3169547577 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558903509530 0x558903510a40 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f43e000a930 tx=0x7f43e0003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.285+0000 7f42ccff9640 1 -- 172.21.15.134:0/3169547577 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43e0020020 con 0x558903509530 2024-04-24T02:14:10.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.285+0000 7f42ccff9640 1 -- 172.21.15.134:0/3169547577 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43e00108b0 con 0x558903509530 2024-04-24T02:14:10.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.285+0000 7f43eab19800 1 -- 172.21.15.134:0/3169547577 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558903511210 con 0x558903509530 2024-04-24T02:14:10.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.286+0000 7f42ccff9640 1 -- 172.21.15.134:0/3169547577 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43e0015040 con 0x558903509530 2024-04-24T02:14:10.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.286+0000 7f43eab19800 1 -- 172.21.15.134:0/3169547577 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558903513ec0 con 0x558903509530 2024-04-24T02:14:10.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.286+0000 7f42ccff9640 1 -- 172.21.15.134:0/3169547577 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f43e0023020 con 0x558903509530 2024-04-24T02:14:10.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.286+0000 7f42ccff9640 1 --2- 172.21.15.134:0/3169547577 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f42c0036950 0x7f42c0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.287+0000 7f42ccff9640 1 -- 172.21.15.134:0/3169547577 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f43e004bf10 con 0x558903509530 2024-04-24T02:14:10.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.287+0000 7f43eab19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:14:10.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.287+0000 7f43eab19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:14:10.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.287+0000 7f43e7e17640 1 --2- 172.21.15.134:0/3169547577 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f42c0036950 0x7f42c0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.287+0000 7f43eab19800 1 Processor -- start 2024-04-24T02:14:10.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.287+0000 7f43e7e17640 1 --2- 172.21.15.134:0/3169547577 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f42c0036950 0x7f42c0038e10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f43dc000f60 tx=0x7f43dc0012f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.287+0000 7f43eab19800 1 -- start start 2024-04-24T02:14:10.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.287+0000 7f43eab19800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55890352b130 0x55890352b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.287+0000 7f43eab19800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5589034f4ac0 con 0x55890352b130 2024-04-24T02:14:10.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.287+0000 7f43e8618640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55890352b130 0x55890352b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.287+0000 7f43e8618640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55890352b130 0x55890352b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43486/0 (socket says 172.21.15.134:43486) 2024-04-24T02:14:10.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.287+0000 7f43e8618640 1 -- 172.21.15.134:0/1808899847 learned_addr learned my addr 172.21.15.134:0/1808899847 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:10.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.288+0000 7f43e8618640 1 -- 172.21.15.134:0/1808899847 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55890352ba90 con 0x55890352b130 2024-04-24T02:14:10.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.288+0000 7f43e8618640 1 --2- 172.21.15.134:0/1808899847 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55890352b130 0x55890352b550 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f43d808c0a0 tx=0x7f43d805deb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.288+0000 7f42acfe1640 1 -- 172.21.15.134:0/1808899847 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43d8091070 con 0x55890352b130 2024-04-24T02:14:10.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.288+0000 7f42acfe1640 1 -- 172.21.15.134:0/1808899847 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43d808a040 con 0x55890352b130 2024-04-24T02:14:10.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.288+0000 7f43eab19800 1 -- 172.21.15.134:0/1808899847 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55890352c500 con 0x55890352b130 2024-04-24T02:14:10.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.288+0000 7f42acfe1640 1 -- 172.21.15.134:0/1808899847 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43d80773b0 con 0x55890352b130 2024-04-24T02:14:10.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.288+0000 7f43eab19800 1 -- 172.21.15.134:0/1808899847 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55890352ca00 con 0x55890352b130 2024-04-24T02:14:10.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.289+0000 7f42acfe1640 1 -- 172.21.15.134:0/1808899847 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f43d8094070 con 0x55890352b130 2024-04-24T02:14:10.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.289+0000 7f42acfe1640 1 --2- 172.21.15.134:0/1808899847 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4224036900 0x7f4224038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.289+0000 7f42acfe1640 1 -- 172.21.15.134:0/1808899847 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f43d8097c00 con 0x55890352b130 2024-04-24T02:14:10.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.289+0000 7f43e7e17640 1 --2- 172.21.15.134:0/1808899847 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4224036900 0x7f4224038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.289+0000 7f422e7fc640 20 reqs_thread_entry: start 2024-04-24T02:14:10.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.289+0000 7f43eab19800 1 --2- 172.21.15.134:0/337039126 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x558903538c40 0x55890353b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.289+0000 7f43e7e17640 1 --2- 172.21.15.134:0/1808899847 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4224036900 0x7f4224038dc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f43dc001ed0 tx=0x7f43dc00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.289+0000 7f43eab19800 1 -- 172.21.15.134:0/337039126 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55890353b7a0 con 0x558903538c40 2024-04-24T02:14:10.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.289+0000 7f43e8e19640 1 --2- 172.21.15.134:0/337039126 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x558903538c40 0x55890353b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.290+0000 7f43e8e19640 1 --2- 172.21.15.134:0/337039126 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x558903538c40 0x55890353b0d0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.290+0000 7f43e8e19640 1 -- 172.21.15.134:0/337039126 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f43e0010d70 con 0x558903538c40 2024-04-24T02:14:10.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.290+0000 7f43eab19800 1 -- 172.21.15.134:0/337039126 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55890353d0b0 con 0x558903538c40 2024-04-24T02:14:10.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.290+0000 7f43e8e19640 1 -- 172.21.15.134:0/337039126 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~1155 out=1155b] v0'0 uv4 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f43e0010d70 con 0x558903538c40 2024-04-24T02:14:10.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.290+0000 7f43eab19800 1 -- 172.21.15.134:0/337039126 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55890353c9d0 con 0x558903538c40 2024-04-24T02:14:10.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.291+0000 7f43e8e19640 1 -- 172.21.15.134:0/337039126 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [stat,call,call,writefull 0~993] v32'6 uv6 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f43e0010d70 con 0x558903538c40 2024-04-24T02:14:10.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.292+0000 7f43eab19800 1 -- 172.21.15.134:0/3169547577 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f42c0036950 msgr2=0x7f42c0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.292+0000 7f43eab19800 1 --2- 172.21.15.134:0/3169547577 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f42c0036950 0x7f42c0038e10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f43dc000f60 tx=0x7f43dc0012f0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.292+0000 7f43eab19800 1 -- 172.21.15.134:0/3169547577 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558903509530 msgr2=0x558903510a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.292+0000 7f43eab19800 1 --2- 172.21.15.134:0/3169547577 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558903509530 0x558903510a40 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f43e000a930 tx=0x7f43e0003370 comp rx=0 tx=0).stop 2024-04-24T02:14:10.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.292+0000 7f43eab19800 1 -- 172.21.15.134:0/3169547577 shutdown_connections 2024-04-24T02:14:10.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.292+0000 7f43eab19800 1 --2- 172.21.15.134:0/3169547577 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f42c0036950 0x7f42c0038e10 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.292+0000 7f43eab19800 1 --2- 172.21.15.134:0/3169547577 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558903509530 0x558903510a40 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.292+0000 7f43eab19800 1 -- 172.21.15.134:0/3169547577 >> 172.21.15.134:0/3169547577 conn(0x558903406340 msgr2=0x558903503610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:10.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.292+0000 7f43eab19800 1 -- 172.21.15.134:0/3169547577 shutdown_connections 2024-04-24T02:14:10.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.292+0000 7f43eab19800 1 -- 172.21.15.134:0/3169547577 wait complete. 2024-04-24T02:14:10.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.293+0000 7f43eab19800 1 -- 172.21.15.134:0/1808899847 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4224036900 msgr2=0x7f4224038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.293+0000 7f43eab19800 1 --2- 172.21.15.134:0/1808899847 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4224036900 0x7f4224038dc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f43dc001ed0 tx=0x7f43dc00f000 comp rx=0 tx=0).stop 2024-04-24T02:14:10.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.293+0000 7f43eab19800 1 -- 172.21.15.134:0/1808899847 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55890352b130 msgr2=0x55890352b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.293+0000 7f43eab19800 1 --2- 172.21.15.134:0/1808899847 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55890352b130 0x55890352b550 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f43d808c0a0 tx=0x7f43d805deb0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.293+0000 7f43eab19800 1 -- 172.21.15.134:0/1808899847 shutdown_connections 2024-04-24T02:14:10.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.293+0000 7f43eab19800 1 --2- 172.21.15.134:0/1808899847 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f4224036900 0x7f4224038dc0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.293+0000 7f43eab19800 1 --2- 172.21.15.134:0/1808899847 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55890352b130 0x55890352b550 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.293+0000 7f43eab19800 1 -- 172.21.15.134:0/1808899847 >> 172.21.15.134:0/1808899847 conn(0x55890351fbd0 msgr2=0x558903520640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:10.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.293+0000 7f43eab19800 1 -- 172.21.15.134:0/1808899847 shutdown_connections 2024-04-24T02:14:10.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.293+0000 7f43eab19800 1 -- 172.21.15.134:0/1808899847 wait complete. 2024-04-24T02:14:10.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.293+0000 7f43eab19800 1 -- 172.21.15.134:0/337039126 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x558903538c40 msgr2=0x55890353b0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.293+0000 7f43eab19800 1 --2- 172.21.15.134:0/337039126 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x558903538c40 0x55890353b0d0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.293+0000 7f43eab19800 1 -- 172.21.15.134:0/337039126 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f42d0036900 msgr2=0x7f42d0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.293+0000 7f43eab19800 1 --2- 172.21.15.134:0/337039126 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f42d0036900 0x7f42d0038dc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f43d805cfd0 tx=0x7f43d8052ef0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.293+0000 7f43eab19800 1 -- 172.21.15.134:0/337039126 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558903403a10 msgr2=0x5589034fbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.293+0000 7f43eab19800 1 --2- 172.21.15.134:0/337039126 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558903403a10 0x5589034fbc80 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f43d80524f0 tx=0x7f43d8003020 comp rx=0 tx=0).stop 2024-04-24T02:14:10.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.293+0000 7f43eab19800 1 -- 172.21.15.134:0/337039126 shutdown_connections 2024-04-24T02:14:10.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.293+0000 7f43eab19800 1 --2- 172.21.15.134:0/337039126 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x558903538c40 0x55890353b0d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.293+0000 7f43eab19800 1 --2- 172.21.15.134:0/337039126 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f42d0036900 0x7f42d0038dc0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.293+0000 7f43eab19800 1 --2- 172.21.15.134:0/337039126 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558903403a10 0x5589034fbc80 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.293+0000 7f43eab19800 1 -- 172.21.15.134:0/337039126 >> 172.21.15.134:0/337039126 conn(0x5589033fd380 msgr2=0x5589034ee350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:10.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.293+0000 7f43eab19800 1 -- 172.21.15.134:0/337039126 shutdown_connections 2024-04-24T02:14:10.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.293+0000 7f43eab19800 1 -- 172.21.15.134:0/337039126 wait complete. 2024-04-24T02:14:10.306 INFO:teuthology.orchestra.run.smithi134.stdout:{"id":"582e5324-1512-4fe8-bc69-2f28bbcfaf89","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-04-24T02:14:10.306 DEBUG:tasks.util.rgw: json result: {'id': '582e5324-1512-4fe8-bc69-2f28bbcfaf89', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-04-24T02:14:10.306 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-04-24T02:14:10.306 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-04-24T02:14:10.307 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-04-24T02:14:10.347 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:14:10.347 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:14:10.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.347+0000 7f336060f800 1 Processor -- start 2024-04-24T02:14:10.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.347+0000 7f336060f800 1 -- start start 2024-04-24T02:14:10.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.347+0000 7f336060f800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55eb74fab3b0 0x55eb74fad7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.347+0000 7f336060f800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55eb74e65d40 con 0x55eb74fa78a0 2024-04-24T02:14:10.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.347+0000 7f336060f800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55eb74e384d0 con 0x55eb74fab3b0 2024-04-24T02:14:10.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.347+0000 7f335355b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55eb74fab3b0 0x55eb74fad7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.347+0000 7f335bd5c640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55eb74fa78a0 0x55eb74fa9c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:46412/0 (socket says 172.21.15.134:46412) 2024-04-24T02:14:10.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.347+0000 7f335bd5c640 1 -- 172.21.15.134:0/2083207583 learned_addr learned my addr 172.21.15.134:0/2083207583 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:14:10.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.347+0000 7f335355b640 1 -- 172.21.15.134:0/2083207583 >> v1:172.21.15.104:6789/0 conn(0x55eb74fa78a0 legacy=0x55eb74fa9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.347+0000 7f335355b640 1 -- 172.21.15.134:0/2083207583 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb74e64590 con 0x55eb74fab3b0 2024-04-24T02:14:10.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.349+0000 7f335355b640 1 --2- 172.21.15.134:0/2083207583 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eb74fab3b0 0x55eb74fad7a0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f334400a470 tx=0x7f334401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d04b9110e133c0b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.349+0000 7f335b55b640 1 -- 172.21.15.134:0/2083207583 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3344057070 con 0x55eb74fab3b0 2024-04-24T02:14:10.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.349+0000 7f335b55b640 1 -- 172.21.15.134:0/2083207583 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3344052570 con 0x55eb74fab3b0 2024-04-24T02:14:10.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.349+0000 7f335b55b640 1 -- 172.21.15.134:0/2083207583 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3344052870 con 0x55eb74fab3b0 2024-04-24T02:14:10.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.350+0000 7f336060f800 1 -- 172.21.15.134:0/2083207583 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eb74fab3b0 msgr2=0x55eb74fad7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.350+0000 7f336060f800 1 --2- 172.21.15.134:0/2083207583 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eb74fab3b0 0x55eb74fad7a0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f334400a470 tx=0x7f334401ce90 comp rx=0 tx=0).stop 2024-04-24T02:14:10.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.350+0000 7f336060f800 1 -- 172.21.15.134:0/2083207583 shutdown_connections 2024-04-24T02:14:10.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.350+0000 7f336060f800 1 --2- 172.21.15.134:0/2083207583 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eb74fab3b0 0x55eb74fad7a0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.350+0000 7f336060f800 1 -- 172.21.15.134:0/2083207583 >> 172.21.15.134:0/2083207583 conn(0x55eb74fa1370 msgr2=0x55eb74fa3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:10.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.350+0000 7f336060f800 1 -- 172.21.15.134:0/2083207583 shutdown_connections 2024-04-24T02:14:10.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.350+0000 7f336060f800 1 -- 172.21.15.134:0/2083207583 wait complete. 2024-04-24T02:14:10.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.361+0000 7f336060f800 1 Processor -- start 2024-04-24T02:14:10.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.362+0000 7f336060f800 1 -- start start 2024-04-24T02:14:10.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.362+0000 7f336060f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eb74fa78a0 0x55eb750980e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.362+0000 7f336060f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55eb74ef23b0 con 0x55eb74fa78a0 2024-04-24T02:14:10.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.362+0000 7f335bd5c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eb74fa78a0 0x55eb750980e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.362+0000 7f335bd5c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eb74fa78a0 0x55eb750980e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43510/0 (socket says 172.21.15.134:43510) 2024-04-24T02:14:10.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.362+0000 7f335bd5c640 1 -- 172.21.15.134:0/3522287402 learned_addr learned my addr 172.21.15.134:0/3522287402 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:10.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.362+0000 7f335bd5c640 1 -- 172.21.15.134:0/3522287402 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb750986b0 con 0x55eb74fa78a0 2024-04-24T02:14:10.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.362+0000 7f335bd5c640 1 --2- 172.21.15.134:0/3522287402 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eb74fa78a0 0x55eb750980e0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f334c001de0 tx=0x7f334c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfd689a83c77d62d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.363+0000 7f3249e0b640 1 -- 172.21.15.134:0/3522287402 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f334c012020 con 0x55eb74fa78a0 2024-04-24T02:14:10.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.363+0000 7f3249e0b640 1 -- 172.21.15.134:0/3522287402 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f334c00e5a0 con 0x55eb74fa78a0 2024-04-24T02:14:10.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.363+0000 7f3249e0b640 1 -- 172.21.15.134:0/3522287402 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f334c00e8c0 con 0x55eb74fa78a0 2024-04-24T02:14:10.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.363+0000 7f336060f800 1 -- 172.21.15.134:0/3522287402 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eb74fa78a0 msgr2=0x55eb750980e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.363+0000 7f336060f800 1 --2- 172.21.15.134:0/3522287402 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eb74fa78a0 0x55eb750980e0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f334c001de0 tx=0x7f334c00b6c0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.363+0000 7f336060f800 1 -- 172.21.15.134:0/3522287402 shutdown_connections 2024-04-24T02:14:10.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.363+0000 7f336060f800 1 --2- 172.21.15.134:0/3522287402 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eb74fa78a0 0x55eb750980e0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.363+0000 7f336060f800 1 -- 172.21.15.134:0/3522287402 >> 172.21.15.134:0/3522287402 conn(0x55eb74fa1370 msgr2=0x55eb75093a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:10.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.363+0000 7f336060f800 1 -- 172.21.15.134:0/3522287402 shutdown_connections 2024-04-24T02:14:10.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.363+0000 7f336060f800 1 -- 172.21.15.134:0/3522287402 wait complete. 2024-04-24T02:14:10.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.364+0000 7f336060f800 1 Processor -- start 2024-04-24T02:14:10.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.364+0000 7f336060f800 1 -- start start 2024-04-24T02:14:10.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.364+0000 7f336060f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eb74fab3b0 0x55eb74fa7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.364+0000 7f336060f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55eb74fadfe0 con 0x55eb74fab3b0 2024-04-24T02:14:10.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.364+0000 7f335bd5c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eb74fab3b0 0x55eb74fa7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.364+0000 7f335bd5c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eb74fab3b0 0x55eb74fa7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43526/0 (socket says 172.21.15.134:43526) 2024-04-24T02:14:10.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.364+0000 7f335bd5c640 1 -- 172.21.15.134:0/1970609793 learned_addr learned my addr 172.21.15.134:0/1970609793 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:10.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.364+0000 7f335bd5c640 1 -- 172.21.15.134:0/1970609793 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb74fa76d0 con 0x55eb74fab3b0 2024-04-24T02:14:10.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.365+0000 7f335bd5c640 1 --2- 172.21.15.134:0/1970609793 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eb74fab3b0 0x55eb74fa7190 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f334c001de0 tx=0x7f334c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.365+0000 7f3243fff640 1 -- 172.21.15.134:0/1970609793 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f334c012030 con 0x55eb74fab3b0 2024-04-24T02:14:10.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.365+0000 7f3243fff640 1 -- 172.21.15.134:0/1970609793 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f334c01a700 con 0x55eb74fab3b0 2024-04-24T02:14:10.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.365+0000 7f336060f800 1 -- 172.21.15.134:0/1970609793 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eb74fa58d0 con 0x55eb74fab3b0 2024-04-24T02:14:10.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.365+0000 7f3243fff640 1 -- 172.21.15.134:0/1970609793 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f334c01aa20 con 0x55eb74fab3b0 2024-04-24T02:14:10.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.365+0000 7f336060f800 1 -- 172.21.15.134:0/1970609793 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb74fa5df0 con 0x55eb74fab3b0 2024-04-24T02:14:10.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.365+0000 7f336060f800 1 Processor -- start 2024-04-24T02:14:10.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.365+0000 7f336060f800 1 -- start start 2024-04-24T02:14:10.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.366+0000 7f3243fff640 1 -- 172.21.15.134:0/1970609793 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f334c015020 con 0x55eb74fab3b0 2024-04-24T02:14:10.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.366+0000 7f336060f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eb750b0080 0x55eb750b04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.366+0000 7f336060f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55eb74e986b0 con 0x55eb750b0080 2024-04-24T02:14:10.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.366+0000 7f3243fff640 1 --2- 172.21.15.134:0/1970609793 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3244036900 0x7f3244038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.366+0000 7f3243fff640 1 -- 172.21.15.134:0/1970609793 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f334c020070 con 0x55eb74fab3b0 2024-04-24T02:14:10.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.366+0000 7f335c55d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eb750b0080 0x55eb750b04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.366+0000 7f335c55d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eb750b0080 0x55eb750b04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43534/0 (socket says 172.21.15.134:43534) 2024-04-24T02:14:10.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.366+0000 7f335c55d640 1 -- 172.21.15.134:0/582430806 learned_addr learned my addr 172.21.15.134:0/582430806 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:10.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.366+0000 7f335bd5c640 1 --2- 172.21.15.134:0/1970609793 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3244036900 0x7f3244038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.366+0000 7f335c55d640 1 -- 172.21.15.134:0/582430806 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb750b0a70 con 0x55eb750b0080 2024-04-24T02:14:10.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.366+0000 7f335bd5c640 1 --2- 172.21.15.134:0/1970609793 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3244036900 0x7f3244038dc0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f334c017f90 tx=0x7f334c016430 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.366+0000 7f335c55d640 1 --2- 172.21.15.134:0/582430806 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eb750b0080 0x55eb750b04a0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f335400a430 tx=0x7f335400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e282d503ecd617fd server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.366+0000 7f3241ffb640 1 -- 172.21.15.134:0/582430806 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3354015070 con 0x55eb750b0080 2024-04-24T02:14:10.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.366+0000 7f3241ffb640 1 -- 172.21.15.134:0/582430806 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3354001670 con 0x55eb750b0080 2024-04-24T02:14:10.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.367+0000 7f3241ffb640 1 -- 172.21.15.134:0/582430806 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3354001990 con 0x55eb750b0080 2024-04-24T02:14:10.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.367+0000 7f336060f800 1 -- 172.21.15.134:0/582430806 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eb750b0080 msgr2=0x55eb750b04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.367+0000 7f336060f800 1 --2- 172.21.15.134:0/582430806 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eb750b0080 0x55eb750b04a0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f335400a430 tx=0x7f335400a8f0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.367+0000 7f336060f800 1 -- 172.21.15.134:0/582430806 shutdown_connections 2024-04-24T02:14:10.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.367+0000 7f336060f800 1 --2- 172.21.15.134:0/582430806 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eb750b0080 0x55eb750b04a0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.367+0000 7f336060f800 1 -- 172.21.15.134:0/582430806 >> 172.21.15.134:0/582430806 conn(0x55eb750ac390 msgr2=0x55eb750aa3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:10.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.367+0000 7f336060f800 1 -- 172.21.15.134:0/582430806 shutdown_connections 2024-04-24T02:14:10.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.367+0000 7f336060f800 1 -- 172.21.15.134:0/582430806 wait complete. 2024-04-24T02:14:10.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.367+0000 7f336060f800 1 Processor -- start 2024-04-24T02:14:10.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.367+0000 7f336060f800 1 -- start start 2024-04-24T02:14:10.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.367+0000 7f336060f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eb750b0080 0x55eb750b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.367+0000 7f336060f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55eb750b0fa0 con 0x55eb750b0080 2024-04-24T02:14:10.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.368+0000 7f335c55d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eb750b0080 0x55eb750b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.368+0000 7f335c55d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eb750b0080 0x55eb750b71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43548/0 (socket says 172.21.15.134:43548) 2024-04-24T02:14:10.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.368+0000 7f335c55d640 1 -- 172.21.15.134:0/2819071040 learned_addr learned my addr 172.21.15.134:0/2819071040 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:10.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.368+0000 7f335c55d640 1 -- 172.21.15.134:0/2819071040 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb750b76e0 con 0x55eb750b0080 2024-04-24T02:14:10.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.368+0000 7f335c55d640 1 --2- 172.21.15.134:0/2819071040 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eb750b0080 0x55eb750b71a0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f3354013040 tx=0x7f3354003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.368+0000 7f323bfff640 1 -- 172.21.15.134:0/2819071040 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3354020020 con 0x55eb750b0080 2024-04-24T02:14:10.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.368+0000 7f323bfff640 1 -- 172.21.15.134:0/2819071040 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33540108e0 con 0x55eb750b0080 2024-04-24T02:14:10.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.368+0000 7f336060f800 1 -- 172.21.15.134:0/2819071040 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eb750b7970 con 0x55eb750b0080 2024-04-24T02:14:10.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.368+0000 7f323bfff640 1 -- 172.21.15.134:0/2819071040 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3354015040 con 0x55eb750b0080 2024-04-24T02:14:10.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.368+0000 7f336060f800 1 -- 172.21.15.134:0/2819071040 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb750ba620 con 0x55eb750b0080 2024-04-24T02:14:10.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.369+0000 7f323bfff640 1 -- 172.21.15.134:0/2819071040 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3354023020 con 0x55eb750b0080 2024-04-24T02:14:10.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.369+0000 7f323bfff640 1 --2- 172.21.15.134:0/2819071040 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3234036950 0x7f3234038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.369+0000 7f323bfff640 1 -- 172.21.15.134:0/2819071040 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f335404bf60 con 0x55eb750b0080 2024-04-24T02:14:10.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.369+0000 7f335355b640 1 --2- 172.21.15.134:0/2819071040 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3234036950 0x7f3234038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.369+0000 7f336060f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:14:10.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.369+0000 7f336060f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:14:10.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.370+0000 7f335355b640 1 --2- 172.21.15.134:0/2819071040 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3234036950 0x7f3234038e10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3344054000 tx=0x7f334404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.370+0000 7f336060f800 1 Processor -- start 2024-04-24T02:14:10.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.370+0000 7f336060f800 1 -- start start 2024-04-24T02:14:10.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.370+0000 7f336060f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eb750d17f0 0x55eb750d1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.370+0000 7f336060f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55eb75098a30 con 0x55eb750d17f0 2024-04-24T02:14:10.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.370+0000 7f335bd5c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eb750d17f0 0x55eb750d1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.370+0000 7f335bd5c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eb750d17f0 0x55eb750d1c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43560/0 (socket says 172.21.15.134:43560) 2024-04-24T02:14:10.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.370+0000 7f335bd5c640 1 -- 172.21.15.134:0/4158076964 learned_addr learned my addr 172.21.15.134:0/4158076964 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:10.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.370+0000 7f335bd5c640 1 -- 172.21.15.134:0/4158076964 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb750d2150 con 0x55eb750d17f0 2024-04-24T02:14:10.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.371+0000 7f335bd5c640 1 --2- 172.21.15.134:0/4158076964 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eb750d17f0 0x55eb750d1c10 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f334c04ae30 tx=0x7f334c017800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.371+0000 7f31c3fff640 1 -- 172.21.15.134:0/4158076964 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f334c035040 con 0x55eb750d17f0 2024-04-24T02:14:10.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.371+0000 7f31c3fff640 1 -- 172.21.15.134:0/4158076964 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f334c040050 con 0x55eb750d17f0 2024-04-24T02:14:10.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.371+0000 7f31c3fff640 1 -- 172.21.15.134:0/4158076964 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f334c017930 con 0x55eb750d17f0 2024-04-24T02:14:10.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.371+0000 7f336060f800 1 -- 172.21.15.134:0/4158076964 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eb750d2bc0 con 0x55eb750d17f0 2024-04-24T02:14:10.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.371+0000 7f336060f800 1 -- 172.21.15.134:0/4158076964 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb750d30c0 con 0x55eb750d17f0 2024-04-24T02:14:10.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.372+0000 7f31c3fff640 1 -- 172.21.15.134:0/4158076964 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f334c024980 con 0x55eb750d17f0 2024-04-24T02:14:10.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.372+0000 7f31c3fff640 1 --2- 172.21.15.134:0/4158076964 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3194036950 0x7f3194038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.372+0000 7f31c3fff640 1 -- 172.21.15.134:0/4158076964 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f334c046c00 con 0x55eb750d17f0 2024-04-24T02:14:10.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.372+0000 7f335355b640 1 --2- 172.21.15.134:0/4158076964 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3194036950 0x7f3194038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.372+0000 7f31c1ffb640 20 reqs_thread_entry: start 2024-04-24T02:14:10.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.372+0000 7f336060f800 1 --2- 172.21.15.134:0/1970609793 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55eb750df1f0 0x55eb750e15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.372+0000 7f336060f800 1 -- 172.21.15.134:0/1970609793 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55eb750e1bf0 con 0x55eb750df1f0 2024-04-24T02:14:10.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.372+0000 7f335355b640 1 --2- 172.21.15.134:0/4158076964 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3194036950 0x7f3194038e10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f334401ced0 tx=0x7f3344005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.372+0000 7f335c55d640 1 --2- 172.21.15.134:0/1970609793 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55eb750df1f0 0x55eb750e15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.372+0000 7f335c55d640 1 --2- 172.21.15.134:0/1970609793 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55eb750df1f0 0x55eb750e15e0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.373+0000 7f335c55d640 1 -- 172.21.15.134:0/1970609793 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f335400e070 con 0x55eb750df1f0 2024-04-24T02:14:10.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.373+0000 7f336060f800 1 -- 172.21.15.134:0/1970609793 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55eb750e24d0 con 0x55eb750df1f0 2024-04-24T02:14:10.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.373+0000 7f335c55d640 1 -- 172.21.15.134:0/1970609793 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f335400e070 con 0x55eb750df1f0 2024-04-24T02:14:10.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.373+0000 7f336060f800 1 -- 172.21.15.134:0/1970609793 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55eb750e3880 con 0x55eb750df1f0 2024-04-24T02:14:10.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.373+0000 7f335c55d640 1 -- 172.21.15.134:0/1970609793 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f335400e070 con 0x55eb750df1f0 2024-04-24T02:14:10.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.374+0000 7f336060f800 1 -- 172.21.15.134:0/2819071040 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3234036950 msgr2=0x7f3234038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.374+0000 7f336060f800 1 --2- 172.21.15.134:0/2819071040 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3234036950 0x7f3234038e10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3344054000 tx=0x7f334404e000 comp rx=0 tx=0).stop 2024-04-24T02:14:10.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.374+0000 7f336060f800 1 -- 172.21.15.134:0/2819071040 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eb750b0080 msgr2=0x55eb750b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.374+0000 7f336060f800 1 --2- 172.21.15.134:0/2819071040 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eb750b0080 0x55eb750b71a0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f3354013040 tx=0x7f3354003370 comp rx=0 tx=0).stop 2024-04-24T02:14:10.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.374+0000 7f336060f800 1 -- 172.21.15.134:0/2819071040 shutdown_connections 2024-04-24T02:14:10.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.374+0000 7f336060f800 1 --2- 172.21.15.134:0/2819071040 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3234036950 0x7f3234038e10 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.374+0000 7f336060f800 1 --2- 172.21.15.134:0/2819071040 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eb750b0080 0x55eb750b71a0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.374+0000 7f336060f800 1 -- 172.21.15.134:0/2819071040 >> 172.21.15.134:0/2819071040 conn(0x55eb750ac390 msgr2=0x55eb750a99f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:10.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.374+0000 7f336060f800 1 -- 172.21.15.134:0/2819071040 shutdown_connections 2024-04-24T02:14:10.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.374+0000 7f336060f800 1 -- 172.21.15.134:0/2819071040 wait complete. 2024-04-24T02:14:10.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.374+0000 7f336060f800 1 -- 172.21.15.134:0/4158076964 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3194036950 msgr2=0x7f3194038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.374+0000 7f336060f800 1 --2- 172.21.15.134:0/4158076964 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3194036950 0x7f3194038e10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f334401ced0 tx=0x7f3344005a00 comp rx=0 tx=0).stop 2024-04-24T02:14:10.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.374+0000 7f336060f800 1 -- 172.21.15.134:0/4158076964 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eb750d17f0 msgr2=0x55eb750d1c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.374+0000 7f336060f800 1 --2- 172.21.15.134:0/4158076964 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eb750d17f0 0x55eb750d1c10 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f334c04ae30 tx=0x7f334c017800 comp rx=0 tx=0).stop 2024-04-24T02:14:10.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.374+0000 7f336060f800 1 -- 172.21.15.134:0/4158076964 shutdown_connections 2024-04-24T02:14:10.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.374+0000 7f336060f800 1 --2- 172.21.15.134:0/4158076964 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3194036950 0x7f3194038e10 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.374+0000 7f336060f800 1 --2- 172.21.15.134:0/4158076964 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eb750d17f0 0x55eb750d1c10 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.374+0000 7f336060f800 1 -- 172.21.15.134:0/4158076964 >> 172.21.15.134:0/4158076964 conn(0x55eb750c62a0 msgr2=0x55eb750c6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:10.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.374+0000 7f336060f800 1 -- 172.21.15.134:0/4158076964 shutdown_connections 2024-04-24T02:14:10.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.375+0000 7f336060f800 1 -- 172.21.15.134:0/4158076964 wait complete. 2024-04-24T02:14:10.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.375+0000 7f336060f800 1 -- 172.21.15.134:0/1970609793 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55eb750df1f0 msgr2=0x55eb750e15e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.375+0000 7f336060f800 1 --2- 172.21.15.134:0/1970609793 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55eb750df1f0 0x55eb750e15e0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.375+0000 7f336060f800 1 -- 172.21.15.134:0/1970609793 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3244036900 msgr2=0x7f3244038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.375+0000 7f336060f800 1 --2- 172.21.15.134:0/1970609793 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3244036900 0x7f3244038dc0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f334c017f90 tx=0x7f334c016430 comp rx=0 tx=0).stop 2024-04-24T02:14:10.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.375+0000 7f336060f800 1 -- 172.21.15.134:0/1970609793 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eb74fab3b0 msgr2=0x55eb74fa7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.375+0000 7f336060f800 1 --2- 172.21.15.134:0/1970609793 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eb74fab3b0 0x55eb74fa7190 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f334c001de0 tx=0x7f334c000ed0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.375+0000 7f336060f800 1 -- 172.21.15.134:0/1970609793 shutdown_connections 2024-04-24T02:14:10.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.375+0000 7f336060f800 1 --2- 172.21.15.134:0/1970609793 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55eb750df1f0 0x55eb750e15e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.375+0000 7f336060f800 1 --2- 172.21.15.134:0/1970609793 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3244036900 0x7f3244038dc0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.375+0000 7f336060f800 1 --2- 172.21.15.134:0/1970609793 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55eb74fab3b0 0x55eb74fa7190 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.375+0000 7f336060f800 1 -- 172.21.15.134:0/1970609793 >> 172.21.15.134:0/1970609793 conn(0x55eb74fa1370 msgr2=0x55eb75092260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:10.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.375+0000 7f336060f800 1 -- 172.21.15.134:0/1970609793 shutdown_connections 2024-04-24T02:14:10.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.375+0000 7f336060f800 1 -- 172.21.15.134:0/1970609793 wait complete. 2024-04-24T02:14:10.385 INFO:teuthology.orchestra.run.smithi134.stdout:{"id":"b893fd8a-cafc-4918-98fa-f8aa8e20a508","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"582e5324-1512-4fe8-bc69-2f28bbcfaf89","zones":[{"id":"582e5324-1512-4fe8-bc69-2f28bbcfaf89","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]} 2024-04-24T02:14:10.386 DEBUG:tasks.util.rgw: json result: {'id': 'b893fd8a-cafc-4918-98fa-f8aa8e20a508', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': '582e5324-1512-4fe8-bc69-2f28bbcfaf89', 'zones': [{'id': '582e5324-1512-4fe8-bc69-2f28bbcfaf89', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['notification_v2', 'resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['notification_v2', 'resharding']} 2024-04-24T02:14:10.388 INFO:teuthology.run_tasks:Running task radosgw-admin-rest... 2024-04-24T02:14:10.405 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-04-24T02:14:10.405 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-04-24T02:14:10.405 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid ada --display-name 'Ms. Admin User' --access-key MH1WC2XQ1S8UISFDZC8W --secret dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG --max-buckets 0 --caps 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write' 2024-04-24T02:14:10.478 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:14:10.479 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:14:10.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.478+0000 7f775401f800 1 Processor -- start 2024-04-24T02:14:10.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.478+0000 7f775401f800 1 -- start start 2024-04-24T02:14:10.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.478+0000 7f775401f800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5580352d2740 0x5580352d2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.478+0000 7f775401f800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558035192d40 con 0x5580352d30a0 2024-04-24T02:14:10.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.478+0000 7f775401f800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x5580351654d0 con 0x5580352d2740 2024-04-24T02:14:10.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.478+0000 7f7751b1e640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5580352d2740 0x5580352d2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.478+0000 7f775131d640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x5580352d30a0 0x5580352d3550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:46422/0 (socket says 172.21.15.134:46422) 2024-04-24T02:14:10.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.478+0000 7f775131d640 1 -- 172.21.15.134:0/371585822 learned_addr learned my addr 172.21.15.134:0/371585822 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:14:10.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.478+0000 7f7751b1e640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5580352d2740 0x5580352d2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43562/0 (socket says 172.21.15.134:43562) 2024-04-24T02:14:10.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.478+0000 7f7751b1e640 1 -- 172.21.15.134:0/371585822 >> v1:172.21.15.104:6789/0 conn(0x5580352d30a0 legacy=0x5580352d3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.478+0000 7f7751b1e640 1 -- 172.21.15.134:0/371585822 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558035191590 con 0x5580352d2740 2024-04-24T02:14:10.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.480+0000 7f7751b1e640 1 --2- 172.21.15.134:0/371585822 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5580352d2740 0x5580352d2b60 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f774400a470 tx=0x7f774401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=611ad54fcceb0354 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.481+0000 7f7750b1c640 1 -- 172.21.15.134:0/371585822 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7744057070 con 0x5580352d2740 2024-04-24T02:14:10.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.481+0000 7f7750b1c640 1 -- 172.21.15.134:0/371585822 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f774404adc0 con 0x5580352d2740 2024-04-24T02:14:10.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.481+0000 7f7750b1c640 1 -- 172.21.15.134:0/371585822 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7744052590 con 0x5580352d2740 2024-04-24T02:14:10.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.481+0000 7f775401f800 1 -- 172.21.15.134:0/371585822 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5580352d2740 msgr2=0x5580352d2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.481+0000 7f775401f800 1 --2- 172.21.15.134:0/371585822 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5580352d2740 0x5580352d2b60 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f774400a470 tx=0x7f774401ce90 comp rx=0 tx=0).stop 2024-04-24T02:14:10.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.481+0000 7f775401f800 1 -- 172.21.15.134:0/371585822 shutdown_connections 2024-04-24T02:14:10.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.481+0000 7f775401f800 1 --2- 172.21.15.134:0/371585822 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5580352d2740 0x5580352d2b60 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.481+0000 7f775401f800 1 -- 172.21.15.134:0/371585822 >> 172.21.15.134:0/371585822 conn(0x5580352ce2c0 msgr2=0x5580352d06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:10.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.481+0000 7f775401f800 1 -- 172.21.15.134:0/371585822 shutdown_connections 2024-04-24T02:14:10.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.481+0000 7f775401f800 1 -- 172.21.15.134:0/371585822 wait complete. 2024-04-24T02:14:10.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.493+0000 7f775401f800 1 Processor -- start 2024-04-24T02:14:10.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.493+0000 7f775401f800 1 -- start start 2024-04-24T02:14:10.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.493+0000 7f775401f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5580352d2740 0x5580353c74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.493+0000 7f775401f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55803521f360 con 0x5580352d2740 2024-04-24T02:14:10.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.493+0000 7f7751b1e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5580352d2740 0x5580353c74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.493+0000 7f7751b1e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5580352d2740 0x5580353c74b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43574/0 (socket says 172.21.15.134:43574) 2024-04-24T02:14:10.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.493+0000 7f7751b1e640 1 -- 172.21.15.134:0/2527463183 learned_addr learned my addr 172.21.15.134:0/2527463183 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:10.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.494+0000 7f7751b1e640 1 -- 172.21.15.134:0/2527463183 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580353c7a80 con 0x5580352d2740 2024-04-24T02:14:10.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.494+0000 7f7751b1e640 1 --2- 172.21.15.134:0/2527463183 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5580352d2740 0x5580353c74b0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f7744055040 tx=0x7f774404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea65523e9a638422 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.494+0000 7f763fe07640 1 -- 172.21.15.134:0/2527463183 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7744057040 con 0x5580352d2740 2024-04-24T02:14:10.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.494+0000 7f763fe07640 1 -- 172.21.15.134:0/2527463183 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7744062070 con 0x5580352d2740 2024-04-24T02:14:10.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.494+0000 7f763fe07640 1 -- 172.21.15.134:0/2527463183 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f774405d470 con 0x5580352d2740 2024-04-24T02:14:10.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.495+0000 7f775401f800 1 -- 172.21.15.134:0/2527463183 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5580352d2740 msgr2=0x5580353c74b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.495+0000 7f775401f800 1 --2- 172.21.15.134:0/2527463183 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5580352d2740 0x5580353c74b0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f7744055040 tx=0x7f774404c000 comp rx=0 tx=0).stop 2024-04-24T02:14:10.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.495+0000 7f775401f800 1 -- 172.21.15.134:0/2527463183 shutdown_connections 2024-04-24T02:14:10.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.495+0000 7f775401f800 1 --2- 172.21.15.134:0/2527463183 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5580352d2740 0x5580353c74b0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.495+0000 7f775401f800 1 -- 172.21.15.134:0/2527463183 >> 172.21.15.134:0/2527463183 conn(0x5580352ce2c0 msgr2=0x5580353c2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:10.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.495+0000 7f775401f800 1 -- 172.21.15.134:0/2527463183 shutdown_connections 2024-04-24T02:14:10.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.495+0000 7f775401f800 1 -- 172.21.15.134:0/2527463183 wait complete. 2024-04-24T02:14:10.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.495+0000 7f775401f800 1 Processor -- start 2024-04-24T02:14:10.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.495+0000 7f775401f800 1 -- start start 2024-04-24T02:14:10.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.495+0000 7f775401f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5580352d2740 0x5580353cef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.495+0000 7f775401f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5580352d3f00 con 0x5580352d2740 2024-04-24T02:14:10.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.495+0000 7f7751b1e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5580352d2740 0x5580353cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.496+0000 7f7751b1e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5580352d2740 0x5580353cef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43584/0 (socket says 172.21.15.134:43584) 2024-04-24T02:14:10.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.496+0000 7f7751b1e640 1 -- 172.21.15.134:0/2514157916 learned_addr learned my addr 172.21.15.134:0/2514157916 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:10.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.496+0000 7f7751b1e640 1 -- 172.21.15.134:0/2514157916 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580353cf490 con 0x5580352d2740 2024-04-24T02:14:10.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.496+0000 7f7751b1e640 1 --2- 172.21.15.134:0/2514157916 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5580352d2740 0x5580353cef50 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f774405f040 tx=0x7f7744002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.496+0000 7f763e604640 1 -- 172.21.15.134:0/2514157916 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f774406b070 con 0x5580352d2740 2024-04-24T02:14:10.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.496+0000 7f763e604640 1 -- 172.21.15.134:0/2514157916 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f774405d960 con 0x5580352d2740 2024-04-24T02:14:10.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.496+0000 7f775401f800 1 -- 172.21.15.134:0/2514157916 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5580353cf720 con 0x5580352d2740 2024-04-24T02:14:10.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.496+0000 7f763e604640 1 -- 172.21.15.134:0/2514157916 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7744057070 con 0x5580352d2740 2024-04-24T02:14:10.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.496+0000 7f775401f800 1 -- 172.21.15.134:0/2514157916 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580353d2330 con 0x5580352d2740 2024-04-24T02:14:10.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.497+0000 7f763e604640 1 -- 172.21.15.134:0/2514157916 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f774405dc80 con 0x5580352d2740 2024-04-24T02:14:10.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.497+0000 7f763e604640 1 --2- 172.21.15.134:0/2514157916 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7638036900 0x7f7638038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.497+0000 7f763e604640 1 -- 172.21.15.134:0/2514157916 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f774408e280 con 0x5580352d2740 2024-04-24T02:14:10.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.497+0000 7f775131d640 1 --2- 172.21.15.134:0/2514157916 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7638036900 0x7f7638038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.497+0000 7f775401f800 1 --2- 172.21.15.134:0/2514157916 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5580352d30a0 0x5580353d60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.497+0000 7f775401f800 1 -- 172.21.15.134:0/2514157916 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5580353d6630 con 0x5580352d30a0 2024-04-24T02:14:10.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.498+0000 7f775231f640 1 --2- 172.21.15.134:0/2514157916 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5580352d30a0 0x5580353d60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.498+0000 7f775131d640 1 --2- 172.21.15.134:0/2514157916 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7638036900 0x7f7638038dc0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7748000f60 tx=0x7f77480012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.498+0000 7f775231f640 1 --2- 172.21.15.134:0/2514157916 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5580352d30a0 0x5580353d60f0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.498+0000 7f775231f640 1 -- 172.21.15.134:0/2514157916 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f774c00a4a0 con 0x5580352d30a0 2024-04-24T02:14:10.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.498+0000 7f775401f800 1 -- 172.21.15.134:0/2514157916 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5580353d36c0 con 0x5580352d30a0 2024-04-24T02:14:10.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.498+0000 7f775231f640 1 -- 172.21.15.134:0/2514157916 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f774c00a4a0 con 0x5580352d30a0 2024-04-24T02:14:10.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.498+0000 7f775401f800 1 -- 172.21.15.134:0/2514157916 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5580353d8450 con 0x5580352d30a0 2024-04-24T02:14:10.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.499+0000 7f775231f640 1 -- 172.21.15.134:0/2514157916 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f774c00a4a0 con 0x5580352d30a0 2024-04-24T02:14:10.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.499+0000 7f775401f800 1 -- 172.21.15.134:0/2514157916 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5580353d7790 con 0x5580352d30a0 2024-04-24T02:14:10.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.499+0000 7f775231f640 1 -- 172.21.15.134:0/2514157916 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f774c00a4a0 con 0x5580352d30a0 2024-04-24T02:14:10.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.499+0000 7f775401f800 1 -- 172.21.15.134:0/2514157916 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5580353d7be0 con 0x5580352d30a0 2024-04-24T02:14:10.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.499+0000 7f775231f640 1 -- 172.21.15.134:0/2514157916 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f774c00a4a0 con 0x5580352d30a0 2024-04-24T02:14:10.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.499+0000 7f775401f800 1 Processor -- start 2024-04-24T02:14:10.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.499+0000 7f775401f800 1 -- start start 2024-04-24T02:14:10.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.500+0000 7f775401f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5580353e7220 0x5580353e7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.500+0000 7f775401f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5580351c56b0 con 0x5580353e7220 2024-04-24T02:14:10.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.500+0000 7f775131d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5580353e7220 0x5580353e7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.500+0000 7f775131d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5580353e7220 0x5580353e7640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43586/0 (socket says 172.21.15.134:43586) 2024-04-24T02:14:10.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.500+0000 7f775131d640 1 -- 172.21.15.134:0/3939115198 learned_addr learned my addr 172.21.15.134:0/3939115198 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:10.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.500+0000 7f775131d640 1 -- 172.21.15.134:0/3939115198 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580353e7b80 con 0x5580353e7220 2024-04-24T02:14:10.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.500+0000 7f775131d640 1 --2- 172.21.15.134:0/3939115198 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5580353e7220 0x5580353e7640 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f7748001ed0 tx=0x7f774800d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.501+0000 7f76377fe640 1 -- 172.21.15.134:0/3939115198 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f774801b550 con 0x5580353e7220 2024-04-24T02:14:10.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.501+0000 7f76377fe640 1 -- 172.21.15.134:0/3939115198 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f774801b6f0 con 0x5580353e7220 2024-04-24T02:14:10.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.501+0000 7f76377fe640 1 -- 172.21.15.134:0/3939115198 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f774801b9d0 con 0x5580353e7220 2024-04-24T02:14:10.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.501+0000 7f775401f800 1 -- 172.21.15.134:0/3939115198 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5580353e85f0 con 0x5580353e7220 2024-04-24T02:14:10.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.501+0000 7f775401f800 1 -- 172.21.15.134:0/3939115198 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580353e8af0 con 0x5580353e7220 2024-04-24T02:14:10.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.501+0000 7f76377fe640 1 -- 172.21.15.134:0/3939115198 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7748023020 con 0x5580353e7220 2024-04-24T02:14:10.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.502+0000 7f76377fe640 1 --2- 172.21.15.134:0/3939115198 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f762c036950 0x7f762c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.502+0000 7f76377fe640 1 -- 172.21.15.134:0/3939115198 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f7748021020 con 0x5580353e7220 2024-04-24T02:14:10.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.502+0000 7f775231f640 1 --2- 172.21.15.134:0/3939115198 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f762c036950 0x7f762c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.502+0000 7f775401f800 1 Processor -- start 2024-04-24T02:14:10.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.502+0000 7f775401f800 1 -- start start 2024-04-24T02:14:10.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.502+0000 7f775231f640 1 --2- 172.21.15.134:0/3939115198 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f762c036950 0x7f762c038e10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x5580353d72b0 tx=0x7f774c005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.502+0000 7f775401f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5580353f4560 0x5580353f4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.502+0000 7f775401f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5580353c7d40 con 0x5580353f4560 2024-04-24T02:14:10.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.502+0000 7f775131d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5580353f4560 0x5580353f4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.502+0000 7f775131d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5580353f4560 0x5580353f4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43588/0 (socket says 172.21.15.134:43588) 2024-04-24T02:14:10.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.502+0000 7f775131d640 1 -- 172.21.15.134:0/651330790 learned_addr learned my addr 172.21.15.134:0/651330790 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:10.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.503+0000 7f775131d640 1 -- 172.21.15.134:0/651330790 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580353f4f50 con 0x5580353f4560 2024-04-24T02:14:10.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.503+0000 7f775131d640 1 --2- 172.21.15.134:0/651330790 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5580353f4560 0x5580353f4980 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f774804ce10 tx=0x7f7748019ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7cb5cfcd16173ea server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.503+0000 7f76357fa640 1 -- 172.21.15.134:0/651330790 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7748041070 con 0x5580353f4560 2024-04-24T02:14:10.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.503+0000 7f76357fa640 1 -- 172.21.15.134:0/651330790 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77480258e0 con 0x5580353f4560 2024-04-24T02:14:10.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.503+0000 7f76357fa640 1 -- 172.21.15.134:0/651330790 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7748025410 con 0x5580353f4560 2024-04-24T02:14:10.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.503+0000 7f775401f800 1 -- 172.21.15.134:0/651330790 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5580353f4560 msgr2=0x5580353f4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.503+0000 7f775401f800 1 --2- 172.21.15.134:0/651330790 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5580353f4560 0x5580353f4980 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f774804ce10 tx=0x7f7748019ce0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.503+0000 7f775401f800 1 -- 172.21.15.134:0/651330790 shutdown_connections 2024-04-24T02:14:10.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.503+0000 7f775401f800 1 --2- 172.21.15.134:0/651330790 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5580353f4560 0x5580353f4980 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.503+0000 7f775401f800 1 -- 172.21.15.134:0/651330790 >> 172.21.15.134:0/651330790 conn(0x5580353f08c0 msgr2=0x5580353ee920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:10.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.503+0000 7f775401f800 1 -- 172.21.15.134:0/651330790 shutdown_connections 2024-04-24T02:14:10.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.503+0000 7f775401f800 1 -- 172.21.15.134:0/651330790 wait complete. 2024-04-24T02:14:10.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.504+0000 7f775401f800 1 Processor -- start 2024-04-24T02:14:10.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.504+0000 7f775401f800 1 -- start start 2024-04-24T02:14:10.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.504+0000 7f775401f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5580353f4560 0x5580353fbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.504+0000 7f775401f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5580353f56c0 con 0x5580353f4560 2024-04-24T02:14:10.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.504+0000 7f775131d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5580353f4560 0x5580353fbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.504+0000 7f775131d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5580353f4560 0x5580353fbbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43594/0 (socket says 172.21.15.134:43594) 2024-04-24T02:14:10.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.504+0000 7f775131d640 1 -- 172.21.15.134:0/3983627310 learned_addr learned my addr 172.21.15.134:0/3983627310 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:10.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.504+0000 7f775131d640 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580353fc100 con 0x5580353f4560 2024-04-24T02:14:10.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.504+0000 7f775131d640 1 --2- 172.21.15.134:0/3983627310 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5580353f4560 0x5580353fbbc0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f7748048010 tx=0x7f774804cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.505+0000 7f76237fe640 1 -- 172.21.15.134:0/3983627310 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7748041070 con 0x5580353f4560 2024-04-24T02:14:10.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.505+0000 7f76237fe640 1 -- 172.21.15.134:0/3983627310 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f774804e810 con 0x5580353f4560 2024-04-24T02:14:10.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.505+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5580353fc390 con 0x5580353f4560 2024-04-24T02:14:10.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.505+0000 7f76237fe640 1 -- 172.21.15.134:0/3983627310 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7748024370 con 0x5580353f4560 2024-04-24T02:14:10.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.505+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580353fc390 con 0x5580353f4560 2024-04-24T02:14:10.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.505+0000 7f76237fe640 1 -- 172.21.15.134:0/3983627310 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f774804ead0 con 0x5580353f4560 2024-04-24T02:14:10.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.506+0000 7f76237fe640 1 --2- 172.21.15.134:0/3983627310 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f761c036950 0x7f761c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.506+0000 7f76237fe640 1 -- 172.21.15.134:0/3983627310 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f774804f060 con 0x5580353f4560 2024-04-24T02:14:10.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.506+0000 7f775231f640 1 --2- 172.21.15.134:0/3983627310 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f761c036950 0x7f761c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.506+0000 7f775231f640 1 --2- 172.21.15.134:0/3983627310 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f761c036950 0x7f761c038e10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x5580353d3610 tx=0x7f774c01f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.506+0000 7f775401f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:10.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.506+0000 7f775401f800 1 --2- 172.21.15.134:0/3983627310 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5580354074b0 0x558035409970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.506+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55803540a0c0 con 0x5580354074b0 2024-04-24T02:14:10.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.507+0000 7f7751b1e640 1 --2- 172.21.15.134:0/3983627310 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5580354074b0 0x558035409970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.507+0000 7f7751b1e640 1 --2- 172.21.15.134:0/3983627310 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5580354074b0 0x558035409970 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.507+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f774405a040 con 0x5580354074b0 2024-04-24T02:14:10.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.507+0000 7f775401f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:10.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.507+0000 7f775401f800 20 realm 2024-04-24T02:14:10.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.507+0000 7f775401f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:10.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.507+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55803540a4d0 con 0x5580354074b0 2024-04-24T02:14:10.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.507+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f774405a040 con 0x5580354074b0 2024-04-24T02:14:10.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.507+0000 7f775401f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:10.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.507+0000 7f775401f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:14:10.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.507+0000 7f775401f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:10.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.507+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55803540ada0 con 0x5580354074b0 2024-04-24T02:14:10.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.507+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f774405a040 con 0x5580354074b0 2024-04-24T02:14:10.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.507+0000 7f775401f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:10.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.507+0000 7f775401f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:10.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.507+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55803540b140 con 0x5580354074b0 2024-04-24T02:14:10.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.508+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f774405a040 con 0x5580354074b0 2024-04-24T02:14:10.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.508+0000 7f775401f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:14:10.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.508+0000 7f775401f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:10.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.508+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55803540b990 con 0x5580354074b0 2024-04-24T02:14:10.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.508+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f774405a040 con 0x5580354074b0 2024-04-24T02:14:10.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.508+0000 7f775401f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:14:10.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.508+0000 7f775401f800 20 searching for the correct realm 2024-04-24T02:14:10.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.508+0000 7f775401f800 1 --2- 172.21.15.134:0/3983627310 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55803540d700 0x55803540faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.508+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558035410120 con 0x55803540d700 2024-04-24T02:14:10.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.508+0000 7f775131d640 1 --2- 172.21.15.134:0/3983627310 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55803540d700 0x55803540faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.508+0000 7f775131d640 1 --2- 172.21.15.134:0/3983627310 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55803540d700 0x55803540faf0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.509+0000 7f775131d640 1 -- 172.21.15.134:0/3983627310 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7748009050 con 0x55803540d700 2024-04-24T02:14:10.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.509+0000 7f775131d640 1 --2- 172.21.15.134:0/3983627310 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f7748015660 0x7f77480234d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.509+0000 7f775131d640 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558035410120 con 0x7f7748015660 2024-04-24T02:14:10.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.509+0000 7f775231f640 1 --2- 172.21.15.134:0/3983627310 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f7748015660 0x7f77480234d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.509+0000 7f775231f640 1 --2- 172.21.15.134:0/3983627310 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f7748015660 0x7f77480234d0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.509+0000 7f775231f640 1 -- 172.21.15.134:0/3983627310 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f774c01f070 con 0x7f7748015660 2024-04-24T02:14:10.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.509+0000 7f775231f640 1 --2- 172.21.15.134:0/3983627310 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f774c031040 0x7f774c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.509+0000 7f775231f640 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558035410120 con 0x7f774c031040 2024-04-24T02:14:10.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.509+0000 7f7751b1e640 1 --2- 172.21.15.134:0/3983627310 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f774c031040 0x7f774c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.510+0000 7f7751b1e640 1 --2- 172.21.15.134:0/3983627310 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f774c031040 0x7f774c032940 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.510+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f774405a040 con 0x7f774c031040 2024-04-24T02:14:10.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.510+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558035410120 con 0x5580354074b0 2024-04-24T02:14:10.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.510+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f774405a040 con 0x5580354074b0 2024-04-24T02:14:10.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.510+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558035410120 con 0x5580354074b0 2024-04-24T02:14:10.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.510+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f774405a040 con 0x5580354074b0 2024-04-24T02:14:10.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.510+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558035410120 con 0x7f774c031040 2024-04-24T02:14:10.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.511+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f774405a040 con 0x7f774c031040 2024-04-24T02:14:10.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.511+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558035410120 con 0x7f7748015660 2024-04-24T02:14:10.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.511+0000 7f775231f640 1 -- 172.21.15.134:0/3983627310 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f774c01f070 con 0x7f7748015660 2024-04-24T02:14:10.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.511+0000 7f775231f640 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558035410120 con 0x7f7748015660 2024-04-24T02:14:10.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.511+0000 7f775231f640 1 -- 172.21.15.134:0/3983627310 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f774c01f070 con 0x7f7748015660 2024-04-24T02:14:10.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.511+0000 7f775231f640 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558035410120 con 0x55803540d700 2024-04-24T02:14:10.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.511+0000 7f775131d640 1 -- 172.21.15.134:0/3983627310 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7748009050 con 0x55803540d700 2024-04-24T02:14:10.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.511+0000 7f775131d640 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558035410120 con 0x5580354074b0 2024-04-24T02:14:10.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.512+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f774405a040 con 0x5580354074b0 2024-04-24T02:14:10.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.512+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558035410120 con 0x7f774c031040 2024-04-24T02:14:10.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.512+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f774405a040 con 0x7f774c031040 2024-04-24T02:14:10.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.512+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558035410120 con 0x5580354074b0 2024-04-24T02:14:10.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.512+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f774405a040 con 0x5580354074b0 2024-04-24T02:14:10.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.512+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558035410120 con 0x7f7748015660 2024-04-24T02:14:10.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.512+0000 7f775231f640 1 -- 172.21.15.134:0/3983627310 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f774c01f070 con 0x7f7748015660 2024-04-24T02:14:10.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.512+0000 7f775231f640 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558035410120 con 0x55803540d700 2024-04-24T02:14:10.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.513+0000 7f775131d640 1 -- 172.21.15.134:0/3983627310 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7748009050 con 0x55803540d700 2024-04-24T02:14:10.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.513+0000 7f775131d640 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558035410120 con 0x55803540d700 2024-04-24T02:14:10.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.513+0000 7f775131d640 1 -- 172.21.15.134:0/3983627310 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7748009050 con 0x55803540d700 2024-04-24T02:14:10.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.513+0000 7f775131d640 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558035410120 con 0x7f7748015660 2024-04-24T02:14:10.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.513+0000 7f775231f640 1 -- 172.21.15.134:0/3983627310 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f774c01f070 con 0x7f7748015660 2024-04-24T02:14:10.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.513+0000 7f775231f640 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558035410120 con 0x55803540d700 2024-04-24T02:14:10.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.513+0000 7f775131d640 1 -- 172.21.15.134:0/3983627310 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7748009050 con 0x55803540d700 2024-04-24T02:14:10.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.513+0000 7f775131d640 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558035410120 con 0x55803540d700 2024-04-24T02:14:10.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.514+0000 7f775131d640 1 -- 172.21.15.134:0/3983627310 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7748009050 con 0x55803540d700 2024-04-24T02:14:10.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.514+0000 7f775131d640 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558035410120 con 0x5580354074b0 2024-04-24T02:14:10.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.514+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f774405a040 con 0x5580354074b0 2024-04-24T02:14:10.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.514+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558035410120 con 0x5580354074b0 2024-04-24T02:14:10.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.514+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=132b] v32'6 uv6 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f774405a040 con 0x5580354074b0 2024-04-24T02:14:10.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.514+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558035410120 con 0x7f774c031040 2024-04-24T02:14:10.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.515+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f774405a040 con 0x7f774c031040 2024-04-24T02:14:10.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.515+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558035410120 con 0x55803540d700 2024-04-24T02:14:10.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.515+0000 7f775131d640 1 -- 172.21.15.134:0/3983627310 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7748009050 con 0x55803540d700 2024-04-24T02:14:10.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.515+0000 7f775131d640 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558035410120 con 0x7f7748015660 2024-04-24T02:14:10.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.515+0000 7f775231f640 1 -- 172.21.15.134:0/3983627310 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f774c01f070 con 0x7f7748015660 2024-04-24T02:14:10.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.515+0000 7f775231f640 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558035410120 con 0x5580354074b0 2024-04-24T02:14:10.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.515+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f774405a040 con 0x5580354074b0 2024-04-24T02:14:10.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.515+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558035410120 con 0x7f774c031040 2024-04-24T02:14:10.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.516+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f774405a040 con 0x7f774c031040 2024-04-24T02:14:10.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.516+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558035410120 con 0x55803540d700 2024-04-24T02:14:10.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.516+0000 7f775131d640 1 -- 172.21.15.134:0/3983627310 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7748009050 con 0x55803540d700 2024-04-24T02:14:10.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.516+0000 7f775131d640 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558035410120 con 0x7f774c031040 2024-04-24T02:14:10.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.516+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f774405a040 con 0x7f774c031040 2024-04-24T02:14:10.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.516+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558035410120 con 0x7f7748015660 2024-04-24T02:14:10.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.516+0000 7f775231f640 1 -- 172.21.15.134:0/3983627310 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f774c040040 con 0x7f7748015660 2024-04-24T02:14:10.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.516+0000 7f775231f640 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558035410120 con 0x55803540d700 2024-04-24T02:14:10.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.516+0000 7f775131d640 1 -- 172.21.15.134:0/3983627310 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7748009050 con 0x55803540d700 2024-04-24T02:14:10.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.516+0000 7f775131d640 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558035410120 con 0x7f7748015660 2024-04-24T02:14:10.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.517+0000 7f775231f640 1 -- 172.21.15.134:0/3983627310 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f774c040040 con 0x7f7748015660 2024-04-24T02:14:10.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.517+0000 7f775231f640 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558035410120 con 0x5580354074b0 2024-04-24T02:14:10.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.517+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f774405a040 con 0x5580354074b0 2024-04-24T02:14:10.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.517+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558035410120 con 0x7f7748015660 2024-04-24T02:14:10.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.517+0000 7f775231f640 1 -- 172.21.15.134:0/3983627310 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f774c040040 con 0x7f7748015660 2024-04-24T02:14:10.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.517+0000 7f775401f800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:14:10.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.517+0000 7f775401f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:14:10.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.517+0000 7f775401f800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:14:10.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.517+0000 7f775401f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:14:10.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.517+0000 7f775401f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:14:10.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.517+0000 7f775401f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:14:10.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.517+0000 7f775401f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:10.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.517+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55803540c310 con 0x5580354074b0 2024-04-24T02:14:10.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.517+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f774405a040 con 0x5580354074b0 2024-04-24T02:14:10.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.517+0000 7f775401f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:10.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.517+0000 7f775401f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:10.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.517+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55803540cbb0 con 0x5580354074b0 2024-04-24T02:14:10.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.518+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f774405a040 con 0x5580354074b0 2024-04-24T02:14:10.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.518+0000 7f775401f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:14:10.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.518+0000 7f775401f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:10.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.518+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55803540cbb0 con 0x5580354074b0 2024-04-24T02:14:10.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.518+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f774405a040 con 0x5580354074b0 2024-04-24T02:14:10.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.518+0000 7f775401f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:14:10.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.518+0000 7f775401f800 20 zone default found 2024-04-24T02:14:10.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.518+0000 7f775401f800 4 Realm: () 2024-04-24T02:14:10.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.518+0000 7f775401f800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:14:10.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.518+0000 7f775401f800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:14:10.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.518+0000 7f775401f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:14:10.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.518+0000 7f775401f800 20 zonegroup default 2024-04-24T02:14:10.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.518+0000 7f775401f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:10.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.518+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5580354105a0 con 0x7f774c031040 2024-04-24T02:14:10.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.518+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f774405a040 con 0x7f774c031040 2024-04-24T02:14:10.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.518+0000 7f775401f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:10.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.518+0000 7f775401f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:10.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.518+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558035412010 con 0x55803540d700 2024-04-24T02:14:10.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.519+0000 7f775131d640 1 -- 172.21.15.134:0/3983627310 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7748009050 con 0x55803540d700 2024-04-24T02:14:10.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.519+0000 7f775401f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:10.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.519+0000 7f775401f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:10.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.519+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5580354124c0 con 0x55803540d700 2024-04-24T02:14:10.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.519+0000 7f775131d640 1 -- 172.21.15.134:0/3983627310 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7748009050 con 0x55803540d700 2024-04-24T02:14:10.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.519+0000 7f775401f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:10.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.519+0000 7f775401f800 20 started sync module instance, tier type = 2024-04-24T02:14:10.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.519+0000 7f775401f800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:14:10.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.519+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558035411420 con 0x7f7748015660 2024-04-24T02:14:10.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.520+0000 7f775231f640 1 -- 172.21.15.134:0/3983627310 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(44 notify.0 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f774c040040 con 0x7f7748015660 2024-04-24T02:14:10.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.520+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94009137633296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558035411c30 con 0x7f7748015660 2024-04-24T02:14:10.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.520+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5580354133f0 con 0x5580354074b0 2024-04-24T02:14:10.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.521+0000 7f775231f640 1 -- 172.21.15.134:0/3983627310 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94009137633296] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f774c040040 con 0x7f7748015660 2024-04-24T02:14:10.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.521+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f774405a040 con 0x5580354074b0 2024-04-24T02:14:10.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.521+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94009137637664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5580354133f0 con 0x5580354074b0 2024-04-24T02:14:10.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.521+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558035413db0 con 0x55803540d700 2024-04-24T02:14:10.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.522+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94009137637664] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f774405a040 con 0x5580354074b0 2024-04-24T02:14:10.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.523+0000 7f775131d640 1 -- 172.21.15.134:0/3983627310 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7748009050 con 0x55803540d700 2024-04-24T02:14:10.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.523+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94009137639232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558035413360 con 0x55803540d700 2024-04-24T02:14:10.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.523+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558035414c70 con 0x7f7748015660 2024-04-24T02:14:10.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.524+0000 7f775231f640 1 -- 172.21.15.134:0/3983627310 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(50 notify.3 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f774c040040 con 0x7f7748015660 2024-04-24T02:14:10.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.524+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94009137645984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558035415450 con 0x7f7748015660 2024-04-24T02:14:10.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.524+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558035415f70 con 0x5580354074b0 2024-04-24T02:14:10.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.524+0000 7f775131d640 1 -- 172.21.15.134:0/3983627310 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94009137639232] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7748009050 con 0x55803540d700 2024-04-24T02:14:10.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.525+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f774405a040 con 0x5580354074b0 2024-04-24T02:14:10.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.525+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94009137650240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558035415f30 con 0x5580354074b0 2024-04-24T02:14:10.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.525+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5580354169c0 con 0x7f774c031040 2024-04-24T02:14:10.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.525+0000 7f775231f640 1 -- 172.21.15.134:0/3983627310 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94009137645984] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f774c040040 con 0x7f7748015660 2024-04-24T02:14:10.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.526+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94009137650240] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f774405a040 con 0x5580354074b0 2024-04-24T02:14:10.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.526+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(54 notify.5 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f774405a040 con 0x7f774c031040 2024-04-24T02:14:10.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.526+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94009137643936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5580354169c0 con 0x7f774c031040 2024-04-24T02:14:10.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.526+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558035417260 con 0x7f774c031040 2024-04-24T02:14:10.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.527+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94009137643936] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f774405a040 con 0x7f774c031040 2024-04-24T02:14:10.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.527+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(56 notify.6 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f774405a040 con 0x7f774c031040 2024-04-24T02:14:10.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.527+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94009137652944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5580354169c0 con 0x7f774c031040 2024-04-24T02:14:10.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.527+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558035417880 con 0x7f774c031040 2024-04-24T02:14:10.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.528+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(58 notify.7 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f774405a040 con 0x7f774c031040 2024-04-24T02:14:10.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.528+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94009137652944] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f774405a040 con 0x7f774c031040 2024-04-24T02:14:10.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.528+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94009137656784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558035417ca0 con 0x7f774c031040 2024-04-24T02:14:10.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.528+0000 7f775401f800 20 add_watcher() i=0 2024-04-24T02:14:10.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.528+0000 7f775401f800 20 add_watcher() i=1 2024-04-24T02:14:10.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.528+0000 7f775401f800 20 add_watcher() i=2 2024-04-24T02:14:10.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.528+0000 7f775401f800 20 add_watcher() i=3 2024-04-24T02:14:10.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.528+0000 7f775401f800 20 add_watcher() i=4 2024-04-24T02:14:10.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.528+0000 7f775401f800 20 add_watcher() i=5 2024-04-24T02:14:10.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.528+0000 7f775401f800 20 add_watcher() i=6 2024-04-24T02:14:10.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.529+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94009137656784] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f774405a040 con 0x7f774c031040 2024-04-24T02:14:10.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.529+0000 7f775401f800 20 add_watcher() i=7 2024-04-24T02:14:10.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.529+0000 7f775401f800 2 all 8 watchers are set, enabling cache 2024-04-24T02:14:10.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.529+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55803541acd0 con 0x5580354074b0 2024-04-24T02:14:10.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.530+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f774405a040 con 0x5580354074b0 2024-04-24T02:14:10.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.530+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94009137657840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558035418160 con 0x5580354074b0 2024-04-24T02:14:10.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.531+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94009137657840] v32'246 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f774405a040 con 0x5580354074b0 2024-04-24T02:14:10.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.531+0000 7f76037fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:14:10.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.531+0000 7f775401f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:14:10.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.531+0000 7f775401f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:14:10.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.531+0000 7f775401f800 5 note: GC not initialized 2024-04-24T02:14:10.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.531+0000 7f76027fc640 20 reqs_thread_entry: start 2024-04-24T02:14:10.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.531+0000 7f775401f800 20 init_complete bucket index max shards: 11 2024-04-24T02:14:10.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.531+0000 7f775401f800 20 Filter name: none 2024-04-24T02:14:10.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.531+0000 7f7573fff640 20 reqs_thread_entry: start 2024-04-24T02:14:10.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.531+0000 7f775401f800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-24T02:14:10.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.531+0000 7f775401f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:10.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.531+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55803544dfa0 con 0x7f774c031040 2024-04-24T02:14:10.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.532+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(62 ada [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f774405a040 con 0x7f774c031040 2024-04-24T02:14:10.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.532+0000 7f775401f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:10.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.532+0000 7f775401f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x0 2024-04-24T02:14:10.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.532+0000 7f775401f800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T02:14:10.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.532+0000 7f775401f800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : miss 2024-04-24T02:14:10.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.532+0000 7f775401f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:10.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.532+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:63 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55803544c740 con 0x5580354074b0 2024-04-24T02:14:10.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.532+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(63 MH1WC2XQ1S8UISFDZC8W [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f774405a040 con 0x5580354074b0 2024-04-24T02:14:10.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.532+0000 7f775401f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:10.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.532+0000 7f775401f800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x0 2024-04-24T02:14:10.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.532+0000 7f775401f800 10 adding default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-04-24T02:14:10.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.532+0000 7f775401f800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-04-24T02:14:10.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.532+0000 7f775401f800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-04-24T02:14:10.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.532+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:64 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55803544d140 con 0x7f774c031040 2024-04-24T02:14:10.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.534+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(64 ada [delete,create,call,writefull 0~473] v32'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f774405a040 con 0x7f774c031040 2024-04-24T02:14:10.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.534+0000 7f775401f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T02:14:10.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.534+0000 7f775401f800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T02:14:10.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.534+0000 7f775401f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-24T02:14:10.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.534+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94009137875808 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558035451b00 con 0x5580354074b0 2024-04-24T02:14:10.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.534+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== watch-notify(notify (1) cookie 94009137650240 notify 137438953491 ret 0) ==== 691+0+0 (crc 0 0 0) 0x55803544d4e0 con 0x5580354074b0 2024-04-24T02:14:10.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.534+0000 7f76357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953491 cookie 94009137650240 notifier 4823 bl.length()=649 2024-04-24T02:14:10.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.534+0000 7f76357fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T02:14:10.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.534+0000 7f76357fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T02:14:10.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.534+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(65 notify.4 [notify cookie 94009137875808 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f774405a040 con 0x5580354074b0 2024-04-24T02:14:10.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.534+0000 7f76357fa640 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f7614003ea0 con 0x5580354074b0 2024-04-24T02:14:10.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.534+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f774405a040 con 0x5580354074b0 2024-04-24T02:14:10.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.534+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== watch-notify(notify_complete (2) cookie 94009137875808 notify 137438953491 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55803544dbc0 con 0x5580354074b0 2024-04-24T02:14:10.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.534+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:67 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558035451a80 con 0x5580354074b0 2024-04-24T02:14:10.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.535+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(67 MH1WC2XQ1S8UISFDZC8W [delete,create,writefull 0~7] v32'20 uv20 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f774405a040 con 0x5580354074b0 2024-04-24T02:14:10.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.535+0000 7f775401f800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-04-24T02:14:10.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.535+0000 7f775401f800 10 moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-04-24T02:14:10.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.535+0000 7f775401f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W, ofs0, ns] 2024-04-24T02:14:10.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.535+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94009137890688 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558035451f30 con 0x55803540d700 2024-04-24T02:14:10.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.536+0000 7f775131d640 1 -- 172.21.15.134:0/3983627310 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== watch-notify(notify (1) cookie 94009137639232 notify 137438953490 ret 0) ==== 219+0+0 (crc 0 0 0) 0x5580353fc100 con 0x55803540d700 2024-04-24T02:14:10.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.536+0000 7f76357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953490 cookie 94009137639232 notifier 4823 bl.length()=177 2024-04-24T02:14:10.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.536+0000 7f76357fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-04-24T02:14:10.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.536+0000 7f76357fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-04-24T02:14:10.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.536+0000 7f76357fa640 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f7614003ea0 con 0x55803540d700 2024-04-24T02:14:10.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.536+0000 7f775131d640 1 -- 172.21.15.134:0/3983627310 <== osd.3 v2:172.21.15.134:6801/3585115521 15 ==== osd_op_reply(68 notify.2 [notify cookie 94009137890688 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7748009050 con 0x55803540d700 2024-04-24T02:14:10.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.536+0000 7f775131d640 1 -- 172.21.15.134:0/3983627310 <== osd.3 v2:172.21.15.134:6801/3585115521 16 ==== watch-notify(notify_complete (2) cookie 94009137890688 notify 137438953490 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5580353f4f50 con 0x55803540d700 2024-04-24T02:14:10.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.536+0000 7f775131d640 1 -- 172.21.15.134:0/3983627310 <== osd.3 v2:172.21.15.134:6801/3585115521 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7748009050 con 0x55803540d700 2024-04-24T02:14:10.550 INFO:teuthology.orchestra.run.smithi134.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-24T02:14:10.534163Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T02:14:10.534144Z","tags":[],"group_ids":[]} 2024-04-24T02:14:10.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.537+0000 7f76037fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:14:10.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.537+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94009137657840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558035400be0 con 0x5580354074b0 2024-04-24T02:14:10.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.538+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94009137657840] v32'247 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f774405a040 con 0x5580354074b0 2024-04-24T02:14:10.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.538+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94009137633296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5580354177f0 con 0x7f7748015660 2024-04-24T02:14:10.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.539+0000 7f775231f640 1 -- 172.21.15.134:0/3983627310 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94009137633296] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f774c040040 con 0x7f7748015660 2024-04-24T02:14:10.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.539+0000 7f775401f800 20 remove_watcher() i=0 2024-04-24T02:14:10.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.539+0000 7f775401f800 2 removed watcher, disabling cache 2024-04-24T02:14:10.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.539+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94009137637664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5580354177f0 con 0x5580354074b0 2024-04-24T02:14:10.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.540+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 <== osd.1 v2:172.21.15.134:6804/1487076214 30 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94009137637664] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f774405a040 con 0x5580354074b0 2024-04-24T02:14:10.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.540+0000 7f775401f800 20 remove_watcher() i=1 2024-04-24T02:14:10.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.540+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94009137639232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558035412920 con 0x55803540d700 2024-04-24T02:14:10.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.541+0000 7f775131d640 1 -- 172.21.15.134:0/3983627310 <== osd.3 v2:172.21.15.134:6801/3585115521 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94009137639232] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7748009050 con 0x55803540d700 2024-04-24T02:14:10.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.541+0000 7f775401f800 20 remove_watcher() i=2 2024-04-24T02:14:10.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.541+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94009137645984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5580354177f0 con 0x7f7748015660 2024-04-24T02:14:10.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.542+0000 7f775231f640 1 -- 172.21.15.134:0/3983627310 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94009137645984] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f774c040040 con 0x7f7748015660 2024-04-24T02:14:10.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.542+0000 7f775401f800 20 remove_watcher() i=3 2024-04-24T02:14:10.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.542+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94009137650240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558035412f40 con 0x5580354074b0 2024-04-24T02:14:10.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.544+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 <== osd.1 v2:172.21.15.134:6804/1487076214 31 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94009137650240] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f774405a040 con 0x5580354074b0 2024-04-24T02:14:10.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.544+0000 7f775401f800 20 remove_watcher() i=4 2024-04-24T02:14:10.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.544+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94009137643936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5580354177f0 con 0x7f774c031040 2024-04-24T02:14:10.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.545+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94009137643936] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f774405a040 con 0x7f774c031040 2024-04-24T02:14:10.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.545+0000 7f775401f800 20 remove_watcher() i=5 2024-04-24T02:14:10.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.545+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94009137652944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558035415a40 con 0x7f774c031040 2024-04-24T02:14:10.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.546+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94009137652944] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f774405a040 con 0x7f774c031040 2024-04-24T02:14:10.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.546+0000 7f775401f800 20 remove_watcher() i=6 2024-04-24T02:14:10.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.546+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94009137656784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558035412f40 con 0x7f774c031040 2024-04-24T02:14:10.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.547+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94009137656784] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f774405a040 con 0x7f774c031040 2024-04-24T02:14:10.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.547+0000 7f775401f800 20 remove_watcher() i=7 2024-04-24T02:14:10.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.547+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f774c031040 msgr2=0x7f774c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.547+0000 7f775401f800 1 --2- 172.21.15.134:0/3983627310 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f774c031040 0x7f774c032940 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.547+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5580354074b0 msgr2=0x558035409970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.547+0000 7f775401f800 1 --2- 172.21.15.134:0/3983627310 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5580354074b0 0x558035409970 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.547+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f7748015660 msgr2=0x7f77480234d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.547+0000 7f775401f800 1 --2- 172.21.15.134:0/3983627310 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f7748015660 0x7f77480234d0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.547+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55803540d700 msgr2=0x55803540faf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.547+0000 7f775401f800 1 --2- 172.21.15.134:0/3983627310 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55803540d700 0x55803540faf0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.547+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f761c036950 msgr2=0x7f761c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.547+0000 7f775401f800 1 --2- 172.21.15.134:0/3983627310 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f761c036950 0x7f761c038e10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x5580353d3610 tx=0x7f774c01f000 comp rx=0 tx=0).stop 2024-04-24T02:14:10.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.547+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5580353f4560 msgr2=0x5580353fbbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.547+0000 7f7751b1e640 1 -- 172.21.15.134:0/3983627310 reap_dead start 2024-04-24T02:14:10.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.547+0000 7f775401f800 1 --2- 172.21.15.134:0/3983627310 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5580353f4560 0x5580353fbbc0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f7748048010 tx=0x7f774804cda0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.547+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 shutdown_connections 2024-04-24T02:14:10.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.547+0000 7f775401f800 1 --2- 172.21.15.134:0/3983627310 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5580353f4560 0x5580353fbbc0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.547+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 >> 172.21.15.134:0/3983627310 conn(0x5580353f08c0 msgr2=0x5580353edf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:10.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.547+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 shutdown_connections 2024-04-24T02:14:10.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.547+0000 7f775401f800 1 -- 172.21.15.134:0/3983627310 wait complete. 2024-04-24T02:14:10.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.547+0000 7f775401f800 1 -- 172.21.15.134:0/3939115198 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f762c036950 msgr2=0x7f762c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.547+0000 7f775401f800 1 --2- 172.21.15.134:0/3939115198 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f762c036950 0x7f762c038e10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x5580353d72b0 tx=0x7f774c005840 comp rx=0 tx=0).stop 2024-04-24T02:14:10.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.547+0000 7f775401f800 1 -- 172.21.15.134:0/3939115198 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5580353e7220 msgr2=0x5580353e7640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.547+0000 7f775401f800 1 --2- 172.21.15.134:0/3939115198 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5580353e7220 0x5580353e7640 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f7748001ed0 tx=0x7f774800d7a0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.547+0000 7f775401f800 1 -- 172.21.15.134:0/3939115198 shutdown_connections 2024-04-24T02:14:10.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.547+0000 7f775401f800 1 --2- 172.21.15.134:0/3939115198 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f762c036950 0x7f762c038e10 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.547+0000 7f775401f800 1 --2- 172.21.15.134:0/3939115198 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5580353e7220 0x5580353e7640 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.547+0000 7f775401f800 1 -- 172.21.15.134:0/3939115198 >> 172.21.15.134:0/3939115198 conn(0x5580353db2c0 msgr2=0x5580353db6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:10.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.548+0000 7f775401f800 1 -- 172.21.15.134:0/3939115198 shutdown_connections 2024-04-24T02:14:10.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.548+0000 7f775401f800 1 -- 172.21.15.134:0/3939115198 wait complete. 2024-04-24T02:14:10.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.548+0000 7f775401f800 1 -- 172.21.15.134:0/2514157916 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5580352d30a0 msgr2=0x5580353d60f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.548+0000 7f775401f800 1 --2- 172.21.15.134:0/2514157916 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5580352d30a0 0x5580353d60f0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.548+0000 7f775401f800 1 -- 172.21.15.134:0/2514157916 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7638036900 msgr2=0x7f7638038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.548+0000 7f775401f800 1 --2- 172.21.15.134:0/2514157916 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7638036900 0x7f7638038dc0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7748000f60 tx=0x7f77480012b0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.548+0000 7f775401f800 1 -- 172.21.15.134:0/2514157916 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5580352d2740 msgr2=0x5580353cef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.548+0000 7f775401f800 1 --2- 172.21.15.134:0/2514157916 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5580352d2740 0x5580353cef50 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f774405f040 tx=0x7f7744002fb0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.548+0000 7f775401f800 1 -- 172.21.15.134:0/2514157916 shutdown_connections 2024-04-24T02:14:10.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.548+0000 7f775401f800 1 --2- 172.21.15.134:0/2514157916 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5580352d30a0 0x5580353d60f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.548+0000 7f775401f800 1 --2- 172.21.15.134:0/2514157916 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7638036900 0x7f7638038dc0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.548+0000 7f775401f800 1 --2- 172.21.15.134:0/2514157916 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5580352d2740 0x5580353cef50 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.548+0000 7f775401f800 1 -- 172.21.15.134:0/2514157916 >> 172.21.15.134:0/2514157916 conn(0x5580352ce2c0 msgr2=0x5580353c15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:10.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.548+0000 7f775401f800 1 -- 172.21.15.134:0/2514157916 shutdown_connections 2024-04-24T02:14:10.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.548+0000 7f775401f800 1 -- 172.21.15.134:0/2514157916 wait complete. 2024-04-24T02:14:10.561 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T02:14:10.534163Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:14:10.534144Z', 'tags': [], 'group_ids': []} 2024-04-24T02:14:10.561 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T02:14:10.534163Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:14:10.534144Z', 'tags': [], 'group_ids': []} 2024-04-24T02:14:10.561 ERROR:root:0 2024-04-24T02:14:10.562 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T02:14:10.568 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx000003569af510543da7f-0066286af2-4222-default', 'HostId': '4222-default-default'} 2024-04-24T02:14:10.569 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'foo', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '4'} 2024-04-24T02:14:10.579 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T02:14:10.580 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 0} 2024-04-24T02:14:10.592 INFO:tasks.radosgw_admin_rest: json result: {'keys': [], 'truncated': True, 'count': 0, 'marker': '8:1e6ca5ed:users.uid::foo:head'} 2024-04-24T02:14:10.592 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1} 2024-04-24T02:14:10.608 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['foo'], 'truncated': True, 'count': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-04-24T02:14:10.609 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-04-24T02:14:10.617 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['ada'], 'truncated': False, 'count': 1} 2024-04-24T02:14:10.617 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T02:14:10.621 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T02:14:10.621 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'access-key': '9te6NH5mcdcq0Tc5i8i1', 'uid': 'uid_not_exist'} 2024-04-24T02:14:10.625 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T02:14:10.625 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-24T02:14:10.625 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-24T02:14:10.626 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write' 2024-04-24T02:14:10.670 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:14:10.671 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:14:10.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.670+0000 7f841543f800 1 Processor -- start 2024-04-24T02:14:10.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.670+0000 7f841543f800 1 -- start start 2024-04-24T02:14:10.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.670+0000 7f841543f800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55adebf63a90 0x55adebff2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.670+0000 7f841543f800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55adebeaed40 con 0x55adebff2fc0 2024-04-24T02:14:10.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.670+0000 7f841543f800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55adebe814d0 con 0x55adebf63a90 2024-04-24T02:14:10.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.670+0000 7f8412f45640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55adebf63a90 0x55adebff2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.670+0000 7f8412744640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55adebff2fc0 0x55adebff5460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:46430/0 (socket says 172.21.15.134:46430) 2024-04-24T02:14:10.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.670+0000 7f8412744640 1 -- 172.21.15.134:0/2918352178 learned_addr learned my addr 172.21.15.134:0/2918352178 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:14:10.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.671+0000 7f8411f43640 1 -- 172.21.15.134:0/2918352178 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 990690384 0 0) 0x55adebeaed40 con 0x55adebff2fc0 2024-04-24T02:14:10.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.671+0000 7f8411f43640 1 -- 172.21.15.134:0/2918352178 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83fc001e10 con 0x55adebff2fc0 2024-04-24T02:14:10.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.671+0000 7f8412f45640 1 -- 172.21.15.134:0/2918352178 >> v1:172.21.15.104:6789/0 conn(0x55adebff2fc0 legacy=0x55adebff5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.671+0000 7f8412f45640 1 -- 172.21.15.134:0/2918352178 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adebead590 con 0x55adebf63a90 2024-04-24T02:14:10.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.672+0000 7f8412f45640 1 --2- 172.21.15.134:0/2918352178 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55adebf63a90 0x55adebff2a20 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f840400a470 tx=0x7f840401cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f528fd2fd76c8d7c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.673+0000 7f8411f43640 1 -- 172.21.15.134:0/2918352178 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8404057070 con 0x55adebf63a90 2024-04-24T02:14:10.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.673+0000 7f8411f43640 1 -- 172.21.15.134:0/2918352178 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8404052570 con 0x55adebf63a90 2024-04-24T02:14:10.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.673+0000 7f8411f43640 1 -- 172.21.15.134:0/2918352178 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8404052850 con 0x55adebf63a90 2024-04-24T02:14:10.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.673+0000 7f841543f800 1 -- 172.21.15.134:0/2918352178 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55adebf63a90 msgr2=0x55adebff2a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.673+0000 7f841543f800 1 --2- 172.21.15.134:0/2918352178 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55adebf63a90 0x55adebff2a20 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f840400a470 tx=0x7f840401cdb0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.673+0000 7f841543f800 1 -- 172.21.15.134:0/2918352178 shutdown_connections 2024-04-24T02:14:10.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.673+0000 7f841543f800 1 --2- 172.21.15.134:0/2918352178 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55adebf63a90 0x55adebff2a20 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.673+0000 7f841543f800 1 -- 172.21.15.134:0/2918352178 >> 172.21.15.134:0/2918352178 conn(0x55adebfea320 msgr2=0x55adebfec740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:10.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.673+0000 7f841543f800 1 -- 172.21.15.134:0/2918352178 shutdown_connections 2024-04-24T02:14:10.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.673+0000 7f841543f800 1 -- 172.21.15.134:0/2918352178 wait complete. 2024-04-24T02:14:10.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.685+0000 7f841543f800 1 Processor -- start 2024-04-24T02:14:10.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.685+0000 7f841543f800 1 -- start start 2024-04-24T02:14:10.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.685+0000 7f841543f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55adebf63a90 0x55adec0e0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.685+0000 7f841543f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55adebf3b3b0 con 0x55adebf63a90 2024-04-24T02:14:10.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.685+0000 7f8412f45640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55adebf63a90 0x55adec0e0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.685+0000 7f8412f45640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55adebf63a90 0x55adec0e0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43608/0 (socket says 172.21.15.134:43608) 2024-04-24T02:14:10.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.685+0000 7f8412f45640 1 -- 172.21.15.134:0/2534489708 learned_addr learned my addr 172.21.15.134:0/2534489708 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:10.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.686+0000 7f8412f45640 1 -- 172.21.15.134:0/2534489708 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adec0e14d0 con 0x55adebf63a90 2024-04-24T02:14:10.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.686+0000 7f8412f45640 1 --2- 172.21.15.134:0/2534489708 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55adebf63a90 0x55adec0e0f00 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f8404055040 tx=0x7f840404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db353f3b1cc32b0b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.686+0000 7f8300e09640 1 -- 172.21.15.134:0/2534489708 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8404057070 con 0x55adebf63a90 2024-04-24T02:14:10.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.686+0000 7f8300e09640 1 -- 172.21.15.134:0/2534489708 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8404063070 con 0x55adebf63a90 2024-04-24T02:14:10.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.686+0000 7f8300e09640 1 -- 172.21.15.134:0/2534489708 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8404052720 con 0x55adebf63a90 2024-04-24T02:14:10.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.687+0000 7f841543f800 1 -- 172.21.15.134:0/2534489708 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55adebf63a90 msgr2=0x55adec0e0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.687+0000 7f841543f800 1 --2- 172.21.15.134:0/2534489708 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55adebf63a90 0x55adec0e0f00 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f8404055040 tx=0x7f840404c000 comp rx=0 tx=0).stop 2024-04-24T02:14:10.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.687+0000 7f841543f800 1 -- 172.21.15.134:0/2534489708 shutdown_connections 2024-04-24T02:14:10.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.687+0000 7f841543f800 1 --2- 172.21.15.134:0/2534489708 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55adebf63a90 0x55adec0e0f00 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.687+0000 7f841543f800 1 -- 172.21.15.134:0/2534489708 >> 172.21.15.134:0/2534489708 conn(0x55adebfea320 msgr2=0x55adec0dc820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:10.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.687+0000 7f841543f800 1 -- 172.21.15.134:0/2534489708 shutdown_connections 2024-04-24T02:14:10.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.687+0000 7f841543f800 1 -- 172.21.15.134:0/2534489708 wait complete. 2024-04-24T02:14:10.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.687+0000 7f841543f800 1 Processor -- start 2024-04-24T02:14:10.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.687+0000 7f841543f800 1 -- start start 2024-04-24T02:14:10.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.687+0000 7f841543f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55adebf63a90 0x55adec0e89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.687+0000 7f841543f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55adebff6ed0 con 0x55adebf63a90 2024-04-24T02:14:10.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.687+0000 7f8412f45640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55adebf63a90 0x55adec0e89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.687+0000 7f8412f45640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55adebf63a90 0x55adec0e89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43622/0 (socket says 172.21.15.134:43622) 2024-04-24T02:14:10.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.687+0000 7f8412f45640 1 -- 172.21.15.134:0/2413983006 learned_addr learned my addr 172.21.15.134:0/2413983006 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:10.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.688+0000 7f8412f45640 1 -- 172.21.15.134:0/2413983006 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adec0e8ef0 con 0x55adebf63a90 2024-04-24T02:14:10.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.688+0000 7f8412f45640 1 --2- 172.21.15.134:0/2413983006 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55adebf63a90 0x55adec0e89b0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f8404005870 tx=0x7f8404002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.688+0000 7f82ff606640 1 -- 172.21.15.134:0/2413983006 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8404052e20 con 0x55adebf63a90 2024-04-24T02:14:10.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.688+0000 7f82ff606640 1 -- 172.21.15.134:0/2413983006 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f840406c070 con 0x55adebf63a90 2024-04-24T02:14:10.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.688+0000 7f841543f800 1 -- 172.21.15.134:0/2413983006 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55adec0e9180 con 0x55adebf63a90 2024-04-24T02:14:10.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.688+0000 7f82ff606640 1 -- 172.21.15.134:0/2413983006 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f840405e5b0 con 0x55adebf63a90 2024-04-24T02:14:10.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.688+0000 7f841543f800 1 -- 172.21.15.134:0/2413983006 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55adec0ebd90 con 0x55adebf63a90 2024-04-24T02:14:10.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.689+0000 7f82ff606640 1 -- 172.21.15.134:0/2413983006 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8404077060 con 0x55adebf63a90 2024-04-24T02:14:10.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.689+0000 7f82ff606640 1 --2- 172.21.15.134:0/2413983006 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f82f8036900 0x7f82f8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.689+0000 7f82ff606640 1 -- 172.21.15.134:0/2413983006 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f840408e400 con 0x55adebf63a90 2024-04-24T02:14:10.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.689+0000 7f8412744640 1 --2- 172.21.15.134:0/2413983006 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f82f8036900 0x7f82f8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.689+0000 7f841543f800 1 --2- 172.21.15.134:0/2413983006 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55adebff2fc0 0x55adec0efb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.689+0000 7f841543f800 1 -- 172.21.15.134:0/2413983006 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55adec0f0090 con 0x55adebff2fc0 2024-04-24T02:14:10.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.689+0000 7f8413746640 1 --2- 172.21.15.134:0/2413983006 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55adebff2fc0 0x55adec0efb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.690+0000 7f8412744640 1 --2- 172.21.15.134:0/2413983006 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f82f8036900 0x7f82f8038dc0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8408000f60 tx=0x7f84080010a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.690+0000 7f8413746640 1 --2- 172.21.15.134:0/2413983006 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55adebff2fc0 0x55adec0efb50 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.690+0000 7f8413746640 1 -- 172.21.15.134:0/2413983006 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f840c00a4a0 con 0x55adebff2fc0 2024-04-24T02:14:10.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.690+0000 7f841543f800 1 -- 172.21.15.134:0/2413983006 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55adec0ed100 con 0x55adebff2fc0 2024-04-24T02:14:10.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.690+0000 7f8413746640 1 -- 172.21.15.134:0/2413983006 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f840c00a4a0 con 0x55adebff2fc0 2024-04-24T02:14:10.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.690+0000 7f841543f800 1 -- 172.21.15.134:0/2413983006 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55adec0f1ee0 con 0x55adebff2fc0 2024-04-24T02:14:10.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.691+0000 7f8413746640 1 -- 172.21.15.134:0/2413983006 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f840c00a4a0 con 0x55adebff2fc0 2024-04-24T02:14:10.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.691+0000 7f841543f800 1 -- 172.21.15.134:0/2413983006 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55adec0f1220 con 0x55adebff2fc0 2024-04-24T02:14:10.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.691+0000 7f8413746640 1 -- 172.21.15.134:0/2413983006 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f840c00a4a0 con 0x55adebff2fc0 2024-04-24T02:14:10.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.691+0000 7f841543f800 1 -- 172.21.15.134:0/2413983006 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55adec0f1640 con 0x55adebff2fc0 2024-04-24T02:14:10.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.691+0000 7f8413746640 1 -- 172.21.15.134:0/2413983006 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f840c00a4a0 con 0x55adebff2fc0 2024-04-24T02:14:10.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.691+0000 7f841543f800 1 Processor -- start 2024-04-24T02:14:10.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.691+0000 7f841543f800 1 -- start start 2024-04-24T02:14:10.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.692+0000 7f841543f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55adec100d20 0x55adec101160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.692+0000 7f841543f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55adebee16b0 con 0x55adec100d20 2024-04-24T02:14:10.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.692+0000 7f8412744640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55adec100d20 0x55adec101160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.692+0000 7f8412744640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55adec100d20 0x55adec101160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43630/0 (socket says 172.21.15.134:43630) 2024-04-24T02:14:10.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.692+0000 7f8412744640 1 -- 172.21.15.134:0/1477221793 learned_addr learned my addr 172.21.15.134:0/1477221793 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:10.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.692+0000 7f8412744640 1 -- 172.21.15.134:0/1477221793 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adec1016a0 con 0x55adec100d20 2024-04-24T02:14:10.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.692+0000 7f8412744640 1 --2- 172.21.15.134:0/1477221793 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55adec100d20 0x55adec101160 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f840800bec0 tx=0x7f840800d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.693+0000 7f82fce01640 1 -- 172.21.15.134:0/1477221793 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f840801b550 con 0x55adec100d20 2024-04-24T02:14:10.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.693+0000 7f82fce01640 1 -- 172.21.15.134:0/1477221793 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f840801b6f0 con 0x55adec100d20 2024-04-24T02:14:10.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.693+0000 7f841543f800 1 -- 172.21.15.134:0/1477221793 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55adec102030 con 0x55adec100d20 2024-04-24T02:14:10.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.693+0000 7f82fce01640 1 -- 172.21.15.134:0/1477221793 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f840801ba10 con 0x55adec100d20 2024-04-24T02:14:10.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.693+0000 7f841543f800 1 -- 172.21.15.134:0/1477221793 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55adec1024d0 con 0x55adec100d20 2024-04-24T02:14:10.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.693+0000 7f82fce01640 1 -- 172.21.15.134:0/1477221793 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8408023020 con 0x55adec100d20 2024-04-24T02:14:10.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.694+0000 7f82fce01640 1 --2- 172.21.15.134:0/1477221793 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f82ec036950 0x7f82ec038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.694+0000 7f82fce01640 1 -- 172.21.15.134:0/1477221793 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f8408021020 con 0x55adec100d20 2024-04-24T02:14:10.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.694+0000 7f8413746640 1 --2- 172.21.15.134:0/1477221793 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f82ec036950 0x7f82ec038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.694+0000 7f841543f800 1 Processor -- start 2024-04-24T02:14:10.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.694+0000 7f8413746640 1 --2- 172.21.15.134:0/1477221793 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f82ec036950 0x7f82ec038e10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x55adec0f15c0 tx=0x7f840c005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.694+0000 7f841543f800 1 -- start start 2024-04-24T02:14:10.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.694+0000 7f841543f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55adec10e020 0x55adec10e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.694+0000 7f841543f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55adec0e1790 con 0x55adec10e020 2024-04-24T02:14:10.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.694+0000 7f8412744640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55adec10e020 0x55adec10e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.694+0000 7f8412744640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55adec10e020 0x55adec10e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43644/0 (socket says 172.21.15.134:43644) 2024-04-24T02:14:10.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.694+0000 7f8412744640 1 -- 172.21.15.134:0/1114994665 learned_addr learned my addr 172.21.15.134:0/1114994665 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:10.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.695+0000 7f8412744640 1 -- 172.21.15.134:0/1114994665 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adec10ea10 con 0x55adec10e020 2024-04-24T02:14:10.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.695+0000 7f8412744640 1 --2- 172.21.15.134:0/1114994665 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55adec10e020 0x55adec10e440 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f840804ce20 tx=0x7f8408024f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da36ebfeaea72509 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.695+0000 7f82f67fc640 1 -- 172.21.15.134:0/1114994665 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8408025930 con 0x55adec10e020 2024-04-24T02:14:10.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.695+0000 7f82f67fc640 1 -- 172.21.15.134:0/1114994665 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8408025410 con 0x55adec10e020 2024-04-24T02:14:10.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.695+0000 7f82f67fc640 1 -- 172.21.15.134:0/1114994665 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8408025ad0 con 0x55adec10e020 2024-04-24T02:14:10.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.695+0000 7f841543f800 1 -- 172.21.15.134:0/1114994665 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55adec10e020 msgr2=0x55adec10e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.695+0000 7f841543f800 1 --2- 172.21.15.134:0/1114994665 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55adec10e020 0x55adec10e440 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f840804ce20 tx=0x7f8408024f40 comp rx=0 tx=0).stop 2024-04-24T02:14:10.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.695+0000 7f841543f800 1 -- 172.21.15.134:0/1114994665 shutdown_connections 2024-04-24T02:14:10.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.695+0000 7f841543f800 1 --2- 172.21.15.134:0/1114994665 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55adec10e020 0x55adec10e440 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.695+0000 7f841543f800 1 -- 172.21.15.134:0/1114994665 >> 172.21.15.134:0/1114994665 conn(0x55adec10a380 msgr2=0x55adec1083e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:10.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.695+0000 7f841543f800 1 -- 172.21.15.134:0/1114994665 shutdown_connections 2024-04-24T02:14:10.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.695+0000 7f841543f800 1 -- 172.21.15.134:0/1114994665 wait complete. 2024-04-24T02:14:10.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.696+0000 7f841543f800 1 Processor -- start 2024-04-24T02:14:10.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.696+0000 7f841543f800 1 -- start start 2024-04-24T02:14:10.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.696+0000 7f841543f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55adec10e020 0x55adec1156c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.696+0000 7f841543f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55adec10f180 con 0x55adec10e020 2024-04-24T02:14:10.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.696+0000 7f8412744640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55adec10e020 0x55adec1156c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.696+0000 7f8412744640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55adec10e020 0x55adec1156c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43656/0 (socket says 172.21.15.134:43656) 2024-04-24T02:14:10.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.696+0000 7f8412744640 1 -- 172.21.15.134:0/1153230763 learned_addr learned my addr 172.21.15.134:0/1153230763 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:10.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.696+0000 7f8412744640 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adec115c00 con 0x55adec10e020 2024-04-24T02:14:10.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.696+0000 7f8412744640 1 --2- 172.21.15.134:0/1153230763 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55adec10e020 0x55adec1156c0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f8408046fd0 tx=0x7f840804cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.697+0000 7f82f4ff9640 1 -- 172.21.15.134:0/1153230763 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84080197e0 con 0x55adec10e020 2024-04-24T02:14:10.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.697+0000 7f82f4ff9640 1 -- 172.21.15.134:0/1153230763 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f840800c360 con 0x55adec10e020 2024-04-24T02:14:10.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.697+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55adec115e90 con 0x55adec10e020 2024-04-24T02:14:10.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.697+0000 7f82f4ff9640 1 -- 172.21.15.134:0/1153230763 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f840800c660 con 0x55adec10e020 2024-04-24T02:14:10.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.697+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55adec115e90 con 0x55adec10e020 2024-04-24T02:14:10.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.697+0000 7f82f4ff9640 1 -- 172.21.15.134:0/1153230763 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f840804ea60 con 0x55adec10e020 2024-04-24T02:14:10.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.697+0000 7f82f4ff9640 1 --2- 172.21.15.134:0/1153230763 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f82dc036aa0 0x7f82dc038f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.697+0000 7f82f4ff9640 1 -- 172.21.15.134:0/1153230763 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f840800f8f0 con 0x55adec10e020 2024-04-24T02:14:10.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.698+0000 7f8413746640 1 --2- 172.21.15.134:0/1153230763 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f82dc036aa0 0x7f82dc038f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.698+0000 7f841543f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:10.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.698+0000 7f8413746640 1 --2- 172.21.15.134:0/1153230763 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f82dc036aa0 0x7f82dc038f60 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x55adec0f0d40 tx=0x7f840c01f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.698+0000 7f841543f800 1 --2- 172.21.15.134:0/1153230763 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55adec121060 0x55adec123520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.698+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55adec123c70 con 0x55adec121060 2024-04-24T02:14:10.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.698+0000 7f8412f45640 1 --2- 172.21.15.134:0/1153230763 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55adec121060 0x55adec123520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.698+0000 7f8412f45640 1 --2- 172.21.15.134:0/1153230763 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55adec121060 0x55adec123520 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.699+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f840406fcc0 con 0x55adec121060 2024-04-24T02:14:10.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.699+0000 7f841543f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:10.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.699+0000 7f841543f800 20 realm 2024-04-24T02:14:10.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.699+0000 7f841543f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:10.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.699+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55adec124080 con 0x55adec121060 2024-04-24T02:14:10.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.699+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f840406fcc0 con 0x55adec121060 2024-04-24T02:14:10.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.699+0000 7f841543f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:10.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.699+0000 7f841543f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:14:10.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.699+0000 7f841543f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:10.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.699+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55adec124950 con 0x55adec121060 2024-04-24T02:14:10.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.699+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f840406fcc0 con 0x55adec121060 2024-04-24T02:14:10.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.699+0000 7f841543f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:10.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.699+0000 7f841543f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:10.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.699+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55adec124cf0 con 0x55adec121060 2024-04-24T02:14:10.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.699+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f840406fcc0 con 0x55adec121060 2024-04-24T02:14:10.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.699+0000 7f841543f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:14:10.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.699+0000 7f841543f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:10.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.699+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55adec125540 con 0x55adec121060 2024-04-24T02:14:10.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.700+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f840406fcc0 con 0x55adec121060 2024-04-24T02:14:10.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.700+0000 7f841543f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:14:10.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.700+0000 7f841543f800 20 searching for the correct realm 2024-04-24T02:14:10.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.700+0000 7f841543f800 1 --2- 172.21.15.134:0/1153230763 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55adec1272b0 0x55adec1296a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.700+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55adec129c80 con 0x55adec1272b0 2024-04-24T02:14:10.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.700+0000 7f8412744640 1 --2- 172.21.15.134:0/1153230763 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55adec1272b0 0x55adec1296a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.700+0000 7f8412744640 1 --2- 172.21.15.134:0/1153230763 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55adec1272b0 0x55adec1296a0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.700+0000 7f8412744640 1 -- 172.21.15.134:0/1153230763 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8408009050 con 0x55adec1272b0 2024-04-24T02:14:10.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.700+0000 7f8412744640 1 --2- 172.21.15.134:0/1153230763 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f8408046070 0x7f8408024850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.700+0000 7f8412744640 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55adec129c80 con 0x7f8408046070 2024-04-24T02:14:10.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.701+0000 7f8413746640 1 --2- 172.21.15.134:0/1153230763 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f8408046070 0x7f8408024850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.701+0000 7f8413746640 1 --2- 172.21.15.134:0/1153230763 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f8408046070 0x7f8408024850 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.701+0000 7f8413746640 1 -- 172.21.15.134:0/1153230763 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840c01f070 con 0x7f8408046070 2024-04-24T02:14:10.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.701+0000 7f8413746640 1 --2- 172.21.15.134:0/1153230763 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f840c031040 0x7f840c032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.701+0000 7f8413746640 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55adec129c80 con 0x7f840c031040 2024-04-24T02:14:10.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.701+0000 7f8412f45640 1 --2- 172.21.15.134:0/1153230763 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f840c031040 0x7f840c032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.702+0000 7f8412f45640 1 --2- 172.21.15.134:0/1153230763 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f840c031040 0x7f840c032430 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.702+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840406fcc0 con 0x7f840c031040 2024-04-24T02:14:10.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.702+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55adec129c80 con 0x55adec121060 2024-04-24T02:14:10.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.702+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840406fcc0 con 0x55adec121060 2024-04-24T02:14:10.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.702+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55adec129c80 con 0x55adec121060 2024-04-24T02:14:10.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.702+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f840406fcc0 con 0x55adec121060 2024-04-24T02:14:10.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.702+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55adec129c80 con 0x7f840c031040 2024-04-24T02:14:10.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.703+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840406fcc0 con 0x7f840c031040 2024-04-24T02:14:10.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.703+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55adec129c80 con 0x7f8408046070 2024-04-24T02:14:10.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.703+0000 7f8413746640 1 -- 172.21.15.134:0/1153230763 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840c01f070 con 0x7f8408046070 2024-04-24T02:14:10.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.703+0000 7f8413746640 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55adec129c80 con 0x7f8408046070 2024-04-24T02:14:10.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.703+0000 7f8413746640 1 -- 172.21.15.134:0/1153230763 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840c01f070 con 0x7f8408046070 2024-04-24T02:14:10.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.703+0000 7f8413746640 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55adec129c80 con 0x55adec1272b0 2024-04-24T02:14:10.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.703+0000 7f8412744640 1 -- 172.21.15.134:0/1153230763 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8408009050 con 0x55adec1272b0 2024-04-24T02:14:10.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.703+0000 7f8412744640 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55adec129c80 con 0x55adec121060 2024-04-24T02:14:10.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.704+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840406fcc0 con 0x55adec121060 2024-04-24T02:14:10.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.704+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55adec129c80 con 0x7f840c031040 2024-04-24T02:14:10.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.704+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840406fcc0 con 0x7f840c031040 2024-04-24T02:14:10.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.704+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55adec129c80 con 0x55adec121060 2024-04-24T02:14:10.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.704+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840406fcc0 con 0x55adec121060 2024-04-24T02:14:10.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.704+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55adec129c80 con 0x7f8408046070 2024-04-24T02:14:10.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.705+0000 7f8413746640 1 -- 172.21.15.134:0/1153230763 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f840c01f070 con 0x7f8408046070 2024-04-24T02:14:10.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.705+0000 7f8413746640 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55adec129c80 con 0x55adec1272b0 2024-04-24T02:14:10.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.705+0000 7f8412744640 1 -- 172.21.15.134:0/1153230763 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8408009050 con 0x55adec1272b0 2024-04-24T02:14:10.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.705+0000 7f8412744640 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55adec129c80 con 0x55adec1272b0 2024-04-24T02:14:10.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.705+0000 7f8412744640 1 -- 172.21.15.134:0/1153230763 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8408009050 con 0x55adec1272b0 2024-04-24T02:14:10.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.705+0000 7f8412744640 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55adec129c80 con 0x7f8408046070 2024-04-24T02:14:10.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.705+0000 7f8413746640 1 -- 172.21.15.134:0/1153230763 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840c01f070 con 0x7f8408046070 2024-04-24T02:14:10.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.705+0000 7f8413746640 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55adec129c80 con 0x55adec1272b0 2024-04-24T02:14:10.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.706+0000 7f8412744640 1 -- 172.21.15.134:0/1153230763 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8408009050 con 0x55adec1272b0 2024-04-24T02:14:10.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.706+0000 7f8412744640 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55adec129c80 con 0x55adec1272b0 2024-04-24T02:14:10.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.706+0000 7f8412744640 1 -- 172.21.15.134:0/1153230763 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8408009050 con 0x55adec1272b0 2024-04-24T02:14:10.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.706+0000 7f8412744640 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55adec129c80 con 0x55adec121060 2024-04-24T02:14:10.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.706+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840406fcc0 con 0x55adec121060 2024-04-24T02:14:10.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.706+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55adec129c80 con 0x55adec121060 2024-04-24T02:14:10.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.706+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=132b] v32'6 uv6 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f840406fcc0 con 0x55adec121060 2024-04-24T02:14:10.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.706+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55adec129c80 con 0x7f840c031040 2024-04-24T02:14:10.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.707+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840406fcc0 con 0x7f840c031040 2024-04-24T02:14:10.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.707+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55adec129c80 con 0x55adec1272b0 2024-04-24T02:14:10.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.707+0000 7f8412744640 1 -- 172.21.15.134:0/1153230763 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8408009050 con 0x55adec1272b0 2024-04-24T02:14:10.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.707+0000 7f8412744640 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55adec129c80 con 0x7f8408046070 2024-04-24T02:14:10.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.707+0000 7f8413746640 1 -- 172.21.15.134:0/1153230763 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840c01f070 con 0x7f8408046070 2024-04-24T02:14:10.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.707+0000 7f8413746640 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55adec129c80 con 0x55adec121060 2024-04-24T02:14:10.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.708+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840406fcc0 con 0x55adec121060 2024-04-24T02:14:10.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.708+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55adec129c80 con 0x7f840c031040 2024-04-24T02:14:10.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.708+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840406fcc0 con 0x7f840c031040 2024-04-24T02:14:10.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.708+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55adec129c80 con 0x55adec1272b0 2024-04-24T02:14:10.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.708+0000 7f8412744640 1 -- 172.21.15.134:0/1153230763 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8408009050 con 0x55adec1272b0 2024-04-24T02:14:10.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.708+0000 7f8412744640 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55adec129c80 con 0x7f840c031040 2024-04-24T02:14:10.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.709+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840406fcc0 con 0x7f840c031040 2024-04-24T02:14:10.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.709+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55adec129c80 con 0x7f8408046070 2024-04-24T02:14:10.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.709+0000 7f8413746640 1 -- 172.21.15.134:0/1153230763 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840c040040 con 0x7f8408046070 2024-04-24T02:14:10.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.709+0000 7f8413746640 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55adec129c80 con 0x55adec1272b0 2024-04-24T02:14:10.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.709+0000 7f8412744640 1 -- 172.21.15.134:0/1153230763 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8408009050 con 0x55adec1272b0 2024-04-24T02:14:10.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.709+0000 7f8412744640 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55adec129c80 con 0x7f8408046070 2024-04-24T02:14:10.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.709+0000 7f8413746640 1 -- 172.21.15.134:0/1153230763 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840c040040 con 0x7f8408046070 2024-04-24T02:14:10.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.709+0000 7f8413746640 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55adec129c80 con 0x55adec121060 2024-04-24T02:14:10.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.710+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f840406fcc0 con 0x55adec121060 2024-04-24T02:14:10.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.710+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55adec129c80 con 0x7f8408046070 2024-04-24T02:14:10.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.710+0000 7f8413746640 1 -- 172.21.15.134:0/1153230763 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840c040040 con 0x7f8408046070 2024-04-24T02:14:10.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.710+0000 7f841543f800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:14:10.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.710+0000 7f841543f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:14:10.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.710+0000 7f841543f800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:14:10.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.710+0000 7f841543f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:14:10.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.710+0000 7f841543f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:14:10.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.710+0000 7f841543f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:14:10.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.710+0000 7f841543f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:10.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.710+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55adec125e90 con 0x55adec121060 2024-04-24T02:14:10.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.710+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f840406fcc0 con 0x55adec121060 2024-04-24T02:14:10.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.710+0000 7f841543f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:10.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.710+0000 7f841543f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:10.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.710+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55adec126730 con 0x55adec121060 2024-04-24T02:14:10.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.710+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f840406fcc0 con 0x55adec121060 2024-04-24T02:14:10.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.710+0000 7f841543f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:14:10.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.710+0000 7f841543f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:10.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.710+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55adec12a100 con 0x55adec121060 2024-04-24T02:14:10.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.711+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f840406fcc0 con 0x55adec121060 2024-04-24T02:14:10.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.711+0000 7f841543f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:14:10.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.711+0000 7f841543f800 20 zone default found 2024-04-24T02:14:10.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.711+0000 7f841543f800 4 Realm: () 2024-04-24T02:14:10.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.711+0000 7f841543f800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:14:10.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.711+0000 7f841543f800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:14:10.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.711+0000 7f841543f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:14:10.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.711+0000 7f841543f800 20 zonegroup default 2024-04-24T02:14:10.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.711+0000 7f841543f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:10.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.711+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55adec126370 con 0x7f840c031040 2024-04-24T02:14:10.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.711+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f840406fcc0 con 0x7f840c031040 2024-04-24T02:14:10.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.711+0000 7f841543f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:10.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.711+0000 7f841543f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:10.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.711+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55adec12c010 con 0x55adec1272b0 2024-04-24T02:14:10.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.711+0000 7f8412744640 1 -- 172.21.15.134:0/1153230763 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8408009050 con 0x55adec1272b0 2024-04-24T02:14:10.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.712+0000 7f841543f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:10.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.712+0000 7f841543f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:10.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.712+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55adec12c3e0 con 0x55adec1272b0 2024-04-24T02:14:10.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.712+0000 7f8412744640 1 -- 172.21.15.134:0/1153230763 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8408009050 con 0x55adec1272b0 2024-04-24T02:14:10.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.712+0000 7f841543f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:10.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.712+0000 7f841543f800 20 started sync module instance, tier type = 2024-04-24T02:14:10.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.712+0000 7f841543f800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:14:10.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.712+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55adec12b4b0 con 0x7f8408046070 2024-04-24T02:14:10.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.713+0000 7f8413746640 1 -- 172.21.15.134:0/1153230763 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(44 notify.0 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840c040040 con 0x7f8408046070 2024-04-24T02:14:10.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.713+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94205478353056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55adec12b110 con 0x7f8408046070 2024-04-24T02:14:10.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.713+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55adec12d2f0 con 0x55adec121060 2024-04-24T02:14:10.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.714+0000 7f8413746640 1 -- 172.21.15.134:0/1153230763 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94205478353056] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840c040040 con 0x7f8408046070 2024-04-24T02:14:10.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.714+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840406fcc0 con 0x55adec121060 2024-04-24T02:14:10.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.714+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94205478357024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55adec12d2f0 con 0x55adec121060 2024-04-24T02:14:10.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.714+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55adec12dcb0 con 0x55adec1272b0 2024-04-24T02:14:10.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.715+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94205478357024] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840406fcc0 con 0x55adec121060 2024-04-24T02:14:10.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.715+0000 7f8412744640 1 -- 172.21.15.134:0/1153230763 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8408009050 con 0x55adec1272b0 2024-04-24T02:14:10.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.715+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94205478358592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55adec12d260 con 0x55adec1272b0 2024-04-24T02:14:10.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.715+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55adec12eba0 con 0x7f8408046070 2024-04-24T02:14:10.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.717+0000 7f8412744640 1 -- 172.21.15.134:0/1153230763 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94205478358592] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8408009050 con 0x55adec1272b0 2024-04-24T02:14:10.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.717+0000 7f8413746640 1 -- 172.21.15.134:0/1153230763 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(50 notify.3 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840c040040 con 0x7f8408046070 2024-04-24T02:14:10.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.717+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94205478364912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55adec12eb10 con 0x7f8408046070 2024-04-24T02:14:10.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.717+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55adec12fa60 con 0x55adec121060 2024-04-24T02:14:10.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.718+0000 7f8413746640 1 -- 172.21.15.134:0/1153230763 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94205478364912] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840c040040 con 0x7f8408046070 2024-04-24T02:14:10.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.718+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840406fcc0 con 0x55adec121060 2024-04-24T02:14:10.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.718+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94205478367120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55adec12fa60 con 0x55adec121060 2024-04-24T02:14:10.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.718+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55adec130470 con 0x7f840c031040 2024-04-24T02:14:10.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.719+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94205478367120] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840406fcc0 con 0x55adec121060 2024-04-24T02:14:10.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.719+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(54 notify.5 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840406fcc0 con 0x7f840c031040 2024-04-24T02:14:10.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.719+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94205478371744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55adec12fa60 con 0x7f840c031040 2024-04-24T02:14:10.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.719+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55adec130e80 con 0x7f840c031040 2024-04-24T02:14:10.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.720+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94205478371744] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840406fcc0 con 0x7f840c031040 2024-04-24T02:14:10.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.720+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(56 notify.6 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840406fcc0 con 0x7f840c031040 2024-04-24T02:14:10.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.720+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94205478369168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55adec130e80 con 0x7f840c031040 2024-04-24T02:14:10.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.720+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55adec131840 con 0x7f840c031040 2024-04-24T02:14:10.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.721+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94205478369168] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840406fcc0 con 0x7f840c031040 2024-04-24T02:14:10.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.721+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(58 notify.7 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840406fcc0 con 0x7f840c031040 2024-04-24T02:14:10.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.721+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94205478373840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55adec131a20 con 0x7f840c031040 2024-04-24T02:14:10.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.721+0000 7f841543f800 20 add_watcher() i=0 2024-04-24T02:14:10.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.721+0000 7f841543f800 20 add_watcher() i=1 2024-04-24T02:14:10.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.721+0000 7f841543f800 20 add_watcher() i=2 2024-04-24T02:14:10.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.721+0000 7f841543f800 20 add_watcher() i=3 2024-04-24T02:14:10.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.721+0000 7f841543f800 20 add_watcher() i=4 2024-04-24T02:14:10.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.721+0000 7f841543f800 20 add_watcher() i=5 2024-04-24T02:14:10.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.721+0000 7f841543f800 20 add_watcher() i=6 2024-04-24T02:14:10.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.722+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94205478373840] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840406fcc0 con 0x7f840c031040 2024-04-24T02:14:10.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.722+0000 7f841543f800 20 add_watcher() i=7 2024-04-24T02:14:10.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.722+0000 7f841543f800 2 all 8 watchers are set, enabling cache 2024-04-24T02:14:10.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.722+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55adec134b90 con 0x55adec121060 2024-04-24T02:14:10.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.723+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f840406fcc0 con 0x55adec121060 2024-04-24T02:14:10.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.723+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94205478388992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55adec131910 con 0x55adec121060 2024-04-24T02:14:10.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.724+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94205478388992] v32'248 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f840406fcc0 con 0x55adec121060 2024-04-24T02:14:10.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.724+0000 7f82c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:14:10.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.724+0000 7f841543f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:14:10.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.724+0000 7f841543f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:14:10.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.724+0000 7f841543f800 5 note: GC not initialized 2024-04-24T02:14:10.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.724+0000 7f8243fff640 20 reqs_thread_entry: start 2024-04-24T02:14:10.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.724+0000 7f841543f800 20 init_complete bucket index max shards: 11 2024-04-24T02:14:10.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.724+0000 7f841543f800 20 Filter name: none 2024-04-24T02:14:10.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.724+0000 7f8241ffb640 20 reqs_thread_entry: start 2024-04-24T02:14:10.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.724+0000 7f841543f800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-24T02:14:10.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.724+0000 7f841543f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:10.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.724+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55adec167ff0 con 0x7f840c031040 2024-04-24T02:14:10.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.725+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f840406fcc0 con 0x7f840c031040 2024-04-24T02:14:10.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.725+0000 7f841543f800 20 rados_obj.operate() r=0 bl.length=473 2024-04-24T02:14:10.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.725+0000 7f841543f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-24T02:14:10.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.725+0000 7f841543f800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T02:14:10.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.725+0000 7f841543f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:14:10.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.725+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55adec16e880 con 0x7f840c031040 2024-04-24T02:14:10.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.727+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v32'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f840406fcc0 con 0x7f840c031040 2024-04-24T02:14:10.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.727+0000 7f841543f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T02:14:10.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.727+0000 7f841543f800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T02:14:10.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.727+0000 7f841543f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-24T02:14:10.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.727+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94205478626032 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55adec169fb0 con 0x55adec121060 2024-04-24T02:14:10.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.727+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== watch-notify(notify (1) cookie 94205478367120 notify 137438953493 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7f840407f040 con 0x55adec121060 2024-04-24T02:14:10.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.727+0000 7f82f67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953493 cookie 94205478367120 notifier 4830 bl.length()=636 2024-04-24T02:14:10.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.727+0000 7f82f67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T02:14:10.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.727+0000 7f82f67fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T02:14:10.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.727+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(64 notify.4 [notify cookie 94205478626032 out=8b] v0'0 uv243 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f840406fcc0 con 0x55adec121060 2024-04-24T02:14:10.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.727+0000 7f82f67fc640 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f82d8003ea0 con 0x55adec121060 2024-04-24T02:14:10.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.727+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840406fcc0 con 0x55adec121060 2024-04-24T02:14:10.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.727+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== watch-notify(notify_complete (2) cookie 94205478626032 notify 137438953493 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55adec0ebd90 con 0x55adec121060 2024-04-24T02:14:10.742 INFO:teuthology.orchestra.run.smithi134.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-24T02:14:10.534163Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T02:14:10.534144Z","tags":[],"group_ids":[]} 2024-04-24T02:14:10.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.728+0000 7f82c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:14:10.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.728+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94205478388992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55adec16d7e0 con 0x55adec121060 2024-04-24T02:14:10.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.729+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94205478388992] v32'249 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f840406fcc0 con 0x55adec121060 2024-04-24T02:14:10.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.729+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94205478353056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55adec134500 con 0x7f8408046070 2024-04-24T02:14:10.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.730+0000 7f8413746640 1 -- 172.21.15.134:0/1153230763 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94205478353056] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840c040040 con 0x7f8408046070 2024-04-24T02:14:10.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.730+0000 7f841543f800 20 remove_watcher() i=0 2024-04-24T02:14:10.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.730+0000 7f841543f800 2 removed watcher, disabling cache 2024-04-24T02:14:10.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.730+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94205478357024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55adec12b8a0 con 0x55adec121060 2024-04-24T02:14:10.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.731+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94205478357024] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840406fcc0 con 0x55adec121060 2024-04-24T02:14:10.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.731+0000 7f841543f800 20 remove_watcher() i=1 2024-04-24T02:14:10.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.731+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94205478358592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55adec12b8a0 con 0x55adec1272b0 2024-04-24T02:14:10.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.732+0000 7f8412744640 1 -- 172.21.15.134:0/1153230763 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94205478358592] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8408009050 con 0x55adec1272b0 2024-04-24T02:14:10.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.732+0000 7f841543f800 20 remove_watcher() i=2 2024-04-24T02:14:10.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.732+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94205478364912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55adec12ce40 con 0x7f8408046070 2024-04-24T02:14:10.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.733+0000 7f8413746640 1 -- 172.21.15.134:0/1153230763 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94205478364912] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840c040040 con 0x7f8408046070 2024-04-24T02:14:10.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.733+0000 7f841543f800 20 remove_watcher() i=3 2024-04-24T02:14:10.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.733+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94205478367120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55adec12ce40 con 0x55adec121060 2024-04-24T02:14:10.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.735+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94205478367120] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840406fcc0 con 0x55adec121060 2024-04-24T02:14:10.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.735+0000 7f841543f800 20 remove_watcher() i=4 2024-04-24T02:14:10.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.735+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94205478371744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55adec12ef90 con 0x7f840c031040 2024-04-24T02:14:10.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.736+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94205478371744] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840406fcc0 con 0x7f840c031040 2024-04-24T02:14:10.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.736+0000 7f841543f800 20 remove_watcher() i=5 2024-04-24T02:14:10.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.736+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94205478369168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55adec12ce40 con 0x7f840c031040 2024-04-24T02:14:10.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.737+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94205478369168] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840406fcc0 con 0x7f840c031040 2024-04-24T02:14:10.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.737+0000 7f841543f800 20 remove_watcher() i=6 2024-04-24T02:14:10.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.737+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94205478373840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55adec12f790 con 0x7f840c031040 2024-04-24T02:14:10.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.738+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94205478373840] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840406fcc0 con 0x7f840c031040 2024-04-24T02:14:10.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.738+0000 7f841543f800 20 remove_watcher() i=7 2024-04-24T02:14:10.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.738+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f840c031040 msgr2=0x7f840c032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.738+0000 7f841543f800 1 --2- 172.21.15.134:0/1153230763 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f840c031040 0x7f840c032430 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.738+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55adec121060 msgr2=0x55adec123520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.738+0000 7f841543f800 1 --2- 172.21.15.134:0/1153230763 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55adec121060 0x55adec123520 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.738+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f8408046070 msgr2=0x7f8408024850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.738+0000 7f841543f800 1 --2- 172.21.15.134:0/1153230763 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f8408046070 0x7f8408024850 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.738+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55adec1272b0 msgr2=0x55adec1296a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.738+0000 7f841543f800 1 --2- 172.21.15.134:0/1153230763 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55adec1272b0 0x55adec1296a0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.738+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f82dc036aa0 msgr2=0x7f82dc038f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.738+0000 7f841543f800 1 --2- 172.21.15.134:0/1153230763 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f82dc036aa0 0x7f82dc038f60 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x55adec0f0d40 tx=0x7f840c01f000 comp rx=0 tx=0).stop 2024-04-24T02:14:10.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.738+0000 7f8412f45640 1 -- 172.21.15.134:0/1153230763 reap_dead start 2024-04-24T02:14:10.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.738+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55adec10e020 msgr2=0x55adec1156c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.738+0000 7f841543f800 1 --2- 172.21.15.134:0/1153230763 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55adec10e020 0x55adec1156c0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f8408046fd0 tx=0x7f840804cd80 comp rx=0 tx=0).stop 2024-04-24T02:14:10.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.738+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 shutdown_connections 2024-04-24T02:14:10.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.738+0000 7f841543f800 1 --2- 172.21.15.134:0/1153230763 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55adec10e020 0x55adec1156c0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.738+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 >> 172.21.15.134:0/1153230763 conn(0x55adec10a380 msgr2=0x55adec1079e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:10.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.738+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 shutdown_connections 2024-04-24T02:14:10.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.738+0000 7f841543f800 1 -- 172.21.15.134:0/1153230763 wait complete. 2024-04-24T02:14:10.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.739+0000 7f841543f800 1 -- 172.21.15.134:0/1477221793 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f82ec036950 msgr2=0x7f82ec038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.739+0000 7f841543f800 1 --2- 172.21.15.134:0/1477221793 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f82ec036950 0x7f82ec038e10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x55adec0f15c0 tx=0x7f840c005840 comp rx=0 tx=0).stop 2024-04-24T02:14:10.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.739+0000 7f841543f800 1 -- 172.21.15.134:0/1477221793 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55adec100d20 msgr2=0x55adec101160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.739+0000 7f841543f800 1 --2- 172.21.15.134:0/1477221793 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55adec100d20 0x55adec101160 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f840800bec0 tx=0x7f840800d7a0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.739+0000 7f841543f800 1 -- 172.21.15.134:0/1477221793 shutdown_connections 2024-04-24T02:14:10.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.739+0000 7f841543f800 1 --2- 172.21.15.134:0/1477221793 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f82ec036950 0x7f82ec038e10 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.739+0000 7f841543f800 1 --2- 172.21.15.134:0/1477221793 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55adec100d20 0x55adec101160 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.739+0000 7f841543f800 1 -- 172.21.15.134:0/1477221793 >> 172.21.15.134:0/1477221793 conn(0x55adec0f4d70 msgr2=0x55adec0f5170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:10.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.739+0000 7f841543f800 1 -- 172.21.15.134:0/1477221793 shutdown_connections 2024-04-24T02:14:10.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.739+0000 7f841543f800 1 -- 172.21.15.134:0/1477221793 wait complete. 2024-04-24T02:14:10.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.739+0000 7f841543f800 1 -- 172.21.15.134:0/2413983006 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55adebff2fc0 msgr2=0x55adec0efb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.739+0000 7f841543f800 1 --2- 172.21.15.134:0/2413983006 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55adebff2fc0 0x55adec0efb50 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.739+0000 7f841543f800 1 -- 172.21.15.134:0/2413983006 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f82f8036900 msgr2=0x7f82f8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.739+0000 7f841543f800 1 --2- 172.21.15.134:0/2413983006 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f82f8036900 0x7f82f8038dc0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8408000f60 tx=0x7f84080010a0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.739+0000 7f841543f800 1 -- 172.21.15.134:0/2413983006 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55adebf63a90 msgr2=0x55adec0e89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.739+0000 7f841543f800 1 --2- 172.21.15.134:0/2413983006 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55adebf63a90 0x55adec0e89b0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f8404005870 tx=0x7f8404002fb0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.739+0000 7f841543f800 1 -- 172.21.15.134:0/2413983006 shutdown_connections 2024-04-24T02:14:10.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.739+0000 7f841543f800 1 --2- 172.21.15.134:0/2413983006 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55adebff2fc0 0x55adec0efb50 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.739+0000 7f841543f800 1 --2- 172.21.15.134:0/2413983006 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f82f8036900 0x7f82f8038dc0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.739+0000 7f841543f800 1 --2- 172.21.15.134:0/2413983006 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55adebf63a90 0x55adec0e89b0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.739+0000 7f841543f800 1 -- 172.21.15.134:0/2413983006 >> 172.21.15.134:0/2413983006 conn(0x55adebfea320 msgr2=0x55adec0db020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:10.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.739+0000 7f841543f800 1 -- 172.21.15.134:0/2413983006 shutdown_connections 2024-04-24T02:14:10.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.739+0000 7f841543f800 1 -- 172.21.15.134:0/2413983006 wait complete. 2024-04-24T02:14:10.753 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T02:14:10.534163Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:14:10.534144Z', 'tags': [], 'group_ids': []} 2024-04-24T02:14:10.753 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T02:14:10.534163Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:14:10.534144Z', 'tags': [], 'group_ids': []} 2024-04-24T02:14:10.753 ERROR:root:0 2024-04-24T02:14:10.753 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-04-24T02:14:10.753 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-04-24T02:14:10.753 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid system_user --display-name 'System User' --access-key system_akey --secret system_skey --caps user-info-without-keys=read --system 2024-04-24T02:14:10.805 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:14:10.805 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:14:10.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.805+0000 7fc70d062800 1 Processor -- start 2024-04-24T02:14:10.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.805+0000 7fc70d062800 1 -- start start 2024-04-24T02:14:10.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.805+0000 7fc70d062800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55ba2d572360 0x55ba2d574750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.805+0000 7fc70d062800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ba2d42cd40 con 0x55ba2d56e850 2024-04-24T02:14:10.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.805+0000 7fc70d062800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55ba2d3ff4d0 con 0x55ba2d572360 2024-04-24T02:14:10.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.805+0000 7fc70a367640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55ba2d572360 0x55ba2d574750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.805+0000 7fc70a367640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55ba2d572360 0x55ba2d574750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43662/0 (socket says 172.21.15.134:43662) 2024-04-24T02:14:10.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.805+0000 7fc70a367640 1 -- 172.21.15.134:0/1581792436 learned_addr learned my addr 172.21.15.134:0/1581792436 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:10.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.805+0000 7fc70ab68640 1 --1- 172.21.15.134:0/1581792436 >> v1:172.21.15.104:6789/0 conn(0x55ba2d56e850 0x55ba2d570c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:46444/0 (socket says 172.21.15.134:46444) 2024-04-24T02:14:10.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.806+0000 7fc70a367640 1 -- 172.21.15.134:0/1581792436 >> v1:172.21.15.104:6789/0 conn(0x55ba2d56e850 legacy=0x55ba2d570c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.806+0000 7fc70a367640 1 -- 172.21.15.134:0/1581792436 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba2d42b590 con 0x55ba2d572360 2024-04-24T02:14:10.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.807+0000 7fc70a367640 1 --2- 172.21.15.134:0/1581792436 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba2d572360 0x55ba2d574750 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fc6f400a520 tx=0x7fc6f401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e833ab9d8fc784e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.808+0000 7fc709b66640 1 -- 172.21.15.134:0/1581792436 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6f4057070 con 0x55ba2d572360 2024-04-24T02:14:10.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.808+0000 7fc709b66640 1 -- 172.21.15.134:0/1581792436 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6f4052570 con 0x55ba2d572360 2024-04-24T02:14:10.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.808+0000 7fc709b66640 1 -- 172.21.15.134:0/1581792436 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6f404ae60 con 0x55ba2d572360 2024-04-24T02:14:10.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.808+0000 7fc70d062800 1 -- 172.21.15.134:0/1581792436 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba2d572360 msgr2=0x55ba2d574750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.808+0000 7fc70d062800 1 --2- 172.21.15.134:0/1581792436 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba2d572360 0x55ba2d574750 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fc6f400a520 tx=0x7fc6f401d010 comp rx=0 tx=0).stop 2024-04-24T02:14:10.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.808+0000 7fc70d062800 1 -- 172.21.15.134:0/1581792436 shutdown_connections 2024-04-24T02:14:10.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.808+0000 7fc70d062800 1 --2- 172.21.15.134:0/1581792436 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba2d572360 0x55ba2d574750 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.808+0000 7fc70d062800 1 -- 172.21.15.134:0/1581792436 >> 172.21.15.134:0/1581792436 conn(0x55ba2d568320 msgr2=0x55ba2d56a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:10.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.808+0000 7fc70d062800 1 -- 172.21.15.134:0/1581792436 shutdown_connections 2024-04-24T02:14:10.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.808+0000 7fc70d062800 1 -- 172.21.15.134:0/1581792436 wait complete. 2024-04-24T02:14:10.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.820+0000 7fc70d062800 1 Processor -- start 2024-04-24T02:14:10.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.820+0000 7fc70d062800 1 -- start start 2024-04-24T02:14:10.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.820+0000 7fc70d062800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba2d56e850 0x55ba2d56e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.820+0000 7fc70d062800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55ba2d4b9360 con 0x55ba2d56e850 2024-04-24T02:14:10.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.820+0000 7fc70ab68640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba2d56e850 0x55ba2d56e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.820+0000 7fc70ab68640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba2d56e850 0x55ba2d56e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43674/0 (socket says 172.21.15.134:43674) 2024-04-24T02:14:10.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.820+0000 7fc70ab68640 1 -- 172.21.15.134:0/1965734903 learned_addr learned my addr 172.21.15.134:0/1965734903 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:10.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.820+0000 7fc70ab68640 1 -- 172.21.15.134:0/1965734903 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba2d56c750 con 0x55ba2d56e850 2024-04-24T02:14:10.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.821+0000 7fc70ab68640 1 --2- 172.21.15.134:0/1965734903 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba2d56e850 0x55ba2d56e190 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fc704001e90 tx=0x7fc70400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71d98434b788d1b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.821+0000 7fc5f8e09640 1 -- 172.21.15.134:0/1965734903 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc70400e5c0 con 0x55ba2d56e850 2024-04-24T02:14:10.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.821+0000 7fc5f8e09640 1 -- 172.21.15.134:0/1965734903 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc704006070 con 0x55ba2d56e850 2024-04-24T02:14:10.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.821+0000 7fc5f8e09640 1 -- 172.21.15.134:0/1965734903 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc70400e890 con 0x55ba2d56e850 2024-04-24T02:14:10.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.821+0000 7fc70d062800 1 -- 172.21.15.134:0/1965734903 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba2d56e850 msgr2=0x55ba2d56e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.821+0000 7fc70d062800 1 --2- 172.21.15.134:0/1965734903 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba2d56e850 0x55ba2d56e190 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fc704001e90 tx=0x7fc70400b6c0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.822+0000 7fc70d062800 1 -- 172.21.15.134:0/1965734903 shutdown_connections 2024-04-24T02:14:10.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.822+0000 7fc70d062800 1 --2- 172.21.15.134:0/1965734903 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba2d56e850 0x55ba2d56e190 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.822+0000 7fc70d062800 1 -- 172.21.15.134:0/1965734903 >> 172.21.15.134:0/1965734903 conn(0x55ba2d568320 msgr2=0x55ba2d65aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:10.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.822+0000 7fc70d062800 1 -- 172.21.15.134:0/1965734903 shutdown_connections 2024-04-24T02:14:10.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.822+0000 7fc70d062800 1 -- 172.21.15.134:0/1965734903 wait complete. 2024-04-24T02:14:10.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.822+0000 7fc70d062800 1 Processor -- start 2024-04-24T02:14:10.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.822+0000 7fc70d062800 1 -- start start 2024-04-24T02:14:10.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.822+0000 7fc70d062800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba2d56e850 0x55ba2d668e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.822+0000 7fc70d062800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55ba2d574f90 con 0x55ba2d56e850 2024-04-24T02:14:10.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.822+0000 7fc70ab68640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba2d56e850 0x55ba2d668e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.822+0000 7fc70ab68640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba2d56e850 0x55ba2d668e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43686/0 (socket says 172.21.15.134:43686) 2024-04-24T02:14:10.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.822+0000 7fc70ab68640 1 -- 172.21.15.134:0/2204644883 learned_addr learned my addr 172.21.15.134:0/2204644883 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:10.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.823+0000 7fc70ab68640 1 -- 172.21.15.134:0/2204644883 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba2d669380 con 0x55ba2d56e850 2024-04-24T02:14:10.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.823+0000 7fc70ab68640 1 --2- 172.21.15.134:0/2204644883 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba2d56e850 0x55ba2d668e40 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fc70400c010 tx=0x7fc704000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.823+0000 7fc5f7606640 1 -- 172.21.15.134:0/2204644883 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc70400f8d0 con 0x55ba2d56e850 2024-04-24T02:14:10.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.823+0000 7fc5f7606640 1 -- 172.21.15.134:0/2204644883 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc70400fa90 con 0x55ba2d56e850 2024-04-24T02:14:10.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.823+0000 7fc5f7606640 1 -- 172.21.15.134:0/2204644883 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc70400fdb0 con 0x55ba2d56e850 2024-04-24T02:14:10.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.823+0000 7fc70d062800 1 -- 172.21.15.134:0/2204644883 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ba2d669610 con 0x55ba2d56e850 2024-04-24T02:14:10.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.823+0000 7fc70d062800 1 -- 172.21.15.134:0/2204644883 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba2d66c2c0 con 0x55ba2d56e850 2024-04-24T02:14:10.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.824+0000 7fc5f7606640 1 -- 172.21.15.134:0/2204644883 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc704017070 con 0x55ba2d56e850 2024-04-24T02:14:10.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.824+0000 7fc5f7606640 1 --2- 172.21.15.134:0/2204644883 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc5f0036900 0x7fc5f0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.824+0000 7fc5f7606640 1 -- 172.21.15.134:0/2204644883 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fc704015020 con 0x55ba2d56e850 2024-04-24T02:14:10.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.824+0000 7fc70a367640 1 --2- 172.21.15.134:0/2204644883 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc5f0036900 0x7fc5f0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.824+0000 7fc70d062800 1 --2- 172.21.15.134:0/2204644883 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55ba2d572360 0x55ba2d670080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.824+0000 7fc70d062800 1 -- 172.21.15.134:0/2204644883 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d670650 con 0x55ba2d572360 2024-04-24T02:14:10.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.824+0000 7fc70b369640 1 --2- 172.21.15.134:0/2204644883 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55ba2d572360 0x55ba2d670080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.824+0000 7fc70a367640 1 --2- 172.21.15.134:0/2204644883 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc5f0036900 0x7fc5f0038dc0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4054000 tx=0x7fc6f404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.825+0000 7fc70b369640 1 --2- 172.21.15.134:0/2204644883 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55ba2d572360 0x55ba2d670080 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.825+0000 7fc70b369640 1 -- 172.21.15.134:0/2204644883 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc6fc00a4a0 con 0x55ba2d572360 2024-04-24T02:14:10.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.825+0000 7fc70d062800 1 -- 172.21.15.134:0/2204644883 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d66d630 con 0x55ba2d572360 2024-04-24T02:14:10.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.825+0000 7fc70b369640 1 -- 172.21.15.134:0/2204644883 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc6fc00a4a0 con 0x55ba2d572360 2024-04-24T02:14:10.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.825+0000 7fc70d062800 1 -- 172.21.15.134:0/2204644883 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6724a0 con 0x55ba2d572360 2024-04-24T02:14:10.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.825+0000 7fc70b369640 1 -- 172.21.15.134:0/2204644883 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc6fc00a4a0 con 0x55ba2d572360 2024-04-24T02:14:10.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.826+0000 7fc70d062800 1 -- 172.21.15.134:0/2204644883 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6717e0 con 0x55ba2d572360 2024-04-24T02:14:10.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.826+0000 7fc70b369640 1 -- 172.21.15.134:0/2204644883 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc6fc00a4a0 con 0x55ba2d572360 2024-04-24T02:14:10.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.826+0000 7fc70d062800 1 -- 172.21.15.134:0/2204644883 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d671c30 con 0x55ba2d572360 2024-04-24T02:14:10.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.826+0000 7fc70b369640 1 -- 172.21.15.134:0/2204644883 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc6fc00a4a0 con 0x55ba2d572360 2024-04-24T02:14:10.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.826+0000 7fc70d062800 1 Processor -- start 2024-04-24T02:14:10.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.826+0000 7fc70d062800 1 -- start start 2024-04-24T02:14:10.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.827+0000 7fc70d062800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba2d681290 0x55ba2d6816b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.827+0000 7fc70d062800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55ba2d45f6b0 con 0x55ba2d681290 2024-04-24T02:14:10.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.827+0000 7fc70a367640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba2d681290 0x55ba2d6816b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.827+0000 7fc70a367640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba2d681290 0x55ba2d6816b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43700/0 (socket says 172.21.15.134:43700) 2024-04-24T02:14:10.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.827+0000 7fc70a367640 1 -- 172.21.15.134:0/1312572930 learned_addr learned my addr 172.21.15.134:0/1312572930 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:10.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.827+0000 7fc70a367640 1 -- 172.21.15.134:0/1312572930 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba2d681bf0 con 0x55ba2d681290 2024-04-24T02:14:10.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.827+0000 7fc70a367640 1 --2- 172.21.15.134:0/1312572930 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba2d681290 0x55ba2d6816b0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4005930 tx=0x7fc6f4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.827+0000 7fc5f4e01640 1 -- 172.21.15.134:0/1312572930 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6f4057040 con 0x55ba2d681290 2024-04-24T02:14:10.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.827+0000 7fc5f4e01640 1 -- 172.21.15.134:0/1312572930 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6f405d650 con 0x55ba2d681290 2024-04-24T02:14:10.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.827+0000 7fc70d062800 1 -- 172.21.15.134:0/1312572930 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ba2d682660 con 0x55ba2d681290 2024-04-24T02:14:10.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.827+0000 7fc5f4e01640 1 -- 172.21.15.134:0/1312572930 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6f405d950 con 0x55ba2d681290 2024-04-24T02:14:10.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.827+0000 7fc70d062800 1 -- 172.21.15.134:0/1312572930 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba2d682b00 con 0x55ba2d681290 2024-04-24T02:14:10.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.828+0000 7fc5f4e01640 1 -- 172.21.15.134:0/1312572930 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc6f4067070 con 0x55ba2d681290 2024-04-24T02:14:10.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.828+0000 7fc5f4e01640 1 --2- 172.21.15.134:0/1312572930 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc5e4036900 0x7fc5e4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.828+0000 7fc5f4e01640 1 -- 172.21.15.134:0/1312572930 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fc6f408f660 con 0x55ba2d681290 2024-04-24T02:14:10.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.828+0000 7fc70b369640 1 --2- 172.21.15.134:0/1312572930 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc5e4036900 0x7fc5e4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.829+0000 7fc70d062800 1 Processor -- start 2024-04-24T02:14:10.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.829+0000 7fc70d062800 1 -- start start 2024-04-24T02:14:10.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.829+0000 7fc70b369640 1 --2- 172.21.15.134:0/1312572930 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc5e4036900 0x7fc5e4038dc0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x55ba2d671300 tx=0x7fc6fc005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.829+0000 7fc70d062800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba2d68e4d0 0x55ba2d68e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.829+0000 7fc70d062800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55ba2d56cad0 con 0x55ba2d68e4d0 2024-04-24T02:14:10.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.829+0000 7fc70a367640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba2d68e4d0 0x55ba2d68e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.829+0000 7fc70a367640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba2d68e4d0 0x55ba2d68e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43714/0 (socket says 172.21.15.134:43714) 2024-04-24T02:14:10.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.829+0000 7fc70a367640 1 -- 172.21.15.134:0/881140093 learned_addr learned my addr 172.21.15.134:0/881140093 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:10.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.829+0000 7fc70a367640 1 -- 172.21.15.134:0/881140093 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba2d68eec0 con 0x55ba2d68e4d0 2024-04-24T02:14:10.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.829+0000 7fc70a367640 1 --2- 172.21.15.134:0/881140093 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba2d68e4d0 0x55ba2d68e8f0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fc6f408da40 tx=0x7fc6f405df50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce1671210e65011 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.830+0000 7fc5ee7fc640 1 -- 172.21.15.134:0/881140093 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6f4082070 con 0x55ba2d68e4d0 2024-04-24T02:14:10.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.830+0000 7fc5ee7fc640 1 -- 172.21.15.134:0/881140093 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6f408de50 con 0x55ba2d68e4d0 2024-04-24T02:14:10.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.830+0000 7fc5ee7fc640 1 -- 172.21.15.134:0/881140093 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6f408b070 con 0x55ba2d68e4d0 2024-04-24T02:14:10.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.830+0000 7fc70d062800 1 -- 172.21.15.134:0/881140093 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba2d68e4d0 msgr2=0x55ba2d68e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.830+0000 7fc70d062800 1 --2- 172.21.15.134:0/881140093 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba2d68e4d0 0x55ba2d68e8f0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fc6f408da40 tx=0x7fc6f405df50 comp rx=0 tx=0).stop 2024-04-24T02:14:10.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.830+0000 7fc70d062800 1 -- 172.21.15.134:0/881140093 shutdown_connections 2024-04-24T02:14:10.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.830+0000 7fc70d062800 1 --2- 172.21.15.134:0/881140093 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba2d68e4d0 0x55ba2d68e8f0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.830+0000 7fc70d062800 1 -- 172.21.15.134:0/881140093 >> 172.21.15.134:0/881140093 conn(0x55ba2d68a830 msgr2=0x55ba2d688890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:10.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.830+0000 7fc70d062800 1 -- 172.21.15.134:0/881140093 shutdown_connections 2024-04-24T02:14:10.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.830+0000 7fc70d062800 1 -- 172.21.15.134:0/881140093 wait complete. 2024-04-24T02:14:10.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.830+0000 7fc70d062800 1 Processor -- start 2024-04-24T02:14:10.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.830+0000 7fc70d062800 1 -- start start 2024-04-24T02:14:10.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.830+0000 7fc70d062800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba2d68e4d0 0x55ba2d695b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.831+0000 7fc70d062800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55ba2d68f630 con 0x55ba2d68e4d0 2024-04-24T02:14:10.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.831+0000 7fc70a367640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba2d68e4d0 0x55ba2d695b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.831+0000 7fc70a367640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba2d68e4d0 0x55ba2d695b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43716/0 (socket says 172.21.15.134:43716) 2024-04-24T02:14:10.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.831+0000 7fc70a367640 1 -- 172.21.15.134:0/2345481493 learned_addr learned my addr 172.21.15.134:0/2345481493 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:10.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.831+0000 7fc70a367640 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba2d6960c0 con 0x55ba2d68e4d0 2024-04-24T02:14:10.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.831+0000 7fc70a367640 1 --2- 172.21.15.134:0/2345481493 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba2d68e4d0 0x55ba2d695b80 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4080040 tx=0x7fc6f408d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.831+0000 7fc5ecff9640 1 -- 172.21.15.134:0/2345481493 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6f4093070 con 0x55ba2d68e4d0 2024-04-24T02:14:10.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.831+0000 7fc5ecff9640 1 -- 172.21.15.134:0/2345481493 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6f4083040 con 0x55ba2d68e4d0 2024-04-24T02:14:10.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.831+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ba2d696350 con 0x55ba2d68e4d0 2024-04-24T02:14:10.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.831+0000 7fc5ecff9640 1 -- 172.21.15.134:0/2345481493 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6f4082070 con 0x55ba2d68e4d0 2024-04-24T02:14:10.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.831+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba2d699000 con 0x55ba2d68e4d0 2024-04-24T02:14:10.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.832+0000 7fc5ecff9640 1 -- 172.21.15.134:0/2345481493 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc6f4096070 con 0x55ba2d68e4d0 2024-04-24T02:14:10.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.832+0000 7fc5ecff9640 1 --2- 172.21.15.134:0/2345481493 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc5d40368b0 0x7fc5d4038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.832+0000 7fc5ecff9640 1 -- 172.21.15.134:0/2345481493 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fc6f4099c00 con 0x55ba2d68e4d0 2024-04-24T02:14:10.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.832+0000 7fc70b369640 1 --2- 172.21.15.134:0/2345481493 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc5d40368b0 0x7fc5d4038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.833+0000 7fc70d062800 20 rados->read ofs=0 len=0 2024-04-24T02:14:10.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.833+0000 7fc70d062800 1 --2- 172.21.15.134:0/2345481493 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55ba2d6a1670 0x55ba2d6a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.833+0000 7fc70b369640 1 --2- 172.21.15.134:0/2345481493 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc5d40368b0 0x7fc5d4038d70 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x55ba2d66d5a0 tx=0x7fc6fc01f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.833+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6a4280 con 0x55ba2d6a1670 2024-04-24T02:14:10.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.833+0000 7fc70ab68640 1 --2- 172.21.15.134:0/2345481493 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55ba2d6a1670 0x55ba2d6a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.833+0000 7fc70ab68640 1 --2- 172.21.15.134:0/2345481493 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55ba2d6a1670 0x55ba2d6a3b30 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.833+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc70402e070 con 0x55ba2d6a1670 2024-04-24T02:14:10.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.833+0000 7fc70d062800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:10.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.833+0000 7fc70d062800 20 realm 2024-04-24T02:14:10.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.833+0000 7fc70d062800 20 rados->read ofs=0 len=0 2024-04-24T02:14:10.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.833+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6a4690 con 0x55ba2d6a1670 2024-04-24T02:14:10.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.834+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc70402e070 con 0x55ba2d6a1670 2024-04-24T02:14:10.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.834+0000 7fc70d062800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:10.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.834+0000 7fc70d062800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:14:10.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.834+0000 7fc70d062800 20 rados->read ofs=0 len=0 2024-04-24T02:14:10.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.834+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6a4f60 con 0x55ba2d6a1670 2024-04-24T02:14:10.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.834+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc70402e070 con 0x55ba2d6a1670 2024-04-24T02:14:10.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.834+0000 7fc70d062800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:10.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.834+0000 7fc70d062800 20 rados->read ofs=0 len=0 2024-04-24T02:14:10.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.834+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6a5300 con 0x55ba2d6a1670 2024-04-24T02:14:10.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.834+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc70402e070 con 0x55ba2d6a1670 2024-04-24T02:14:10.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.834+0000 7fc70d062800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:14:10.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.834+0000 7fc70d062800 20 rados->read ofs=0 len=0 2024-04-24T02:14:10.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.834+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6a5b50 con 0x55ba2d6a1670 2024-04-24T02:14:10.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.834+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc70402e070 con 0x55ba2d6a1670 2024-04-24T02:14:10.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.834+0000 7fc70d062800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:14:10.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.834+0000 7fc70d062800 20 searching for the correct realm 2024-04-24T02:14:10.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.834+0000 7fc70d062800 1 --2- 172.21.15.134:0/2345481493 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55ba2d6a78c0 0x55ba2d6a9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.834+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6aa2e0 con 0x55ba2d6a78c0 2024-04-24T02:14:10.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.835+0000 7fc70a367640 1 --2- 172.21.15.134:0/2345481493 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55ba2d6a78c0 0x55ba2d6a9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.835+0000 7fc70a367640 1 --2- 172.21.15.134:0/2345481493 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55ba2d6a78c0 0x55ba2d6a9cb0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.835+0000 7fc70a367640 1 -- 172.21.15.134:0/2345481493 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6f409f070 con 0x55ba2d6a78c0 2024-04-24T02:14:10.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.835+0000 7fc70a367640 1 --2- 172.21.15.134:0/2345481493 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fc6f4098070 0x7fc6f407c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.835+0000 7fc70a367640 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6aa2e0 con 0x7fc6f4098070 2024-04-24T02:14:10.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.835+0000 7fc70b369640 1 --2- 172.21.15.134:0/2345481493 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fc6f4098070 0x7fc6f407c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.836+0000 7fc70b369640 1 --2- 172.21.15.134:0/2345481493 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fc6f4098070 0x7fc6f407c860 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.836+0000 7fc70b369640 1 -- 172.21.15.134:0/2345481493 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6fc01f070 con 0x7fc6f4098070 2024-04-24T02:14:10.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.836+0000 7fc70b369640 1 --2- 172.21.15.134:0/2345481493 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fc6fc031040 0x7fc6fc032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.836+0000 7fc70b369640 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6aa2e0 con 0x7fc6fc031040 2024-04-24T02:14:10.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.836+0000 7fc70ab68640 1 --2- 172.21.15.134:0/2345481493 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fc6fc031040 0x7fc6fc032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.836+0000 7fc70ab68640 1 --2- 172.21.15.134:0/2345481493 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fc6fc031040 0x7fc6fc032430 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.837+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc70402e070 con 0x7fc6fc031040 2024-04-24T02:14:10.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.837+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6aa2e0 con 0x55ba2d6a1670 2024-04-24T02:14:10.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.837+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc70402e070 con 0x55ba2d6a1670 2024-04-24T02:14:10.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.837+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6aa2e0 con 0x55ba2d6a1670 2024-04-24T02:14:10.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.837+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc70402e070 con 0x55ba2d6a1670 2024-04-24T02:14:10.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.837+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6aa2e0 con 0x7fc6fc031040 2024-04-24T02:14:10.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.837+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc70402e070 con 0x7fc6fc031040 2024-04-24T02:14:10.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.837+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6aa2e0 con 0x7fc6f4098070 2024-04-24T02:14:10.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.838+0000 7fc70b369640 1 -- 172.21.15.134:0/2345481493 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6fc01f070 con 0x7fc6f4098070 2024-04-24T02:14:10.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.838+0000 7fc70b369640 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6aa2e0 con 0x7fc6f4098070 2024-04-24T02:14:10.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.838+0000 7fc70b369640 1 -- 172.21.15.134:0/2345481493 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6fc01f070 con 0x7fc6f4098070 2024-04-24T02:14:10.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.838+0000 7fc70b369640 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6aa2e0 con 0x55ba2d6a78c0 2024-04-24T02:14:10.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.838+0000 7fc70a367640 1 -- 172.21.15.134:0/2345481493 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6f409f070 con 0x55ba2d6a78c0 2024-04-24T02:14:10.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.838+0000 7fc70a367640 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6aa2e0 con 0x55ba2d6a1670 2024-04-24T02:14:10.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.838+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc70402e070 con 0x55ba2d6a1670 2024-04-24T02:14:10.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.838+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6aa2e0 con 0x7fc6fc031040 2024-04-24T02:14:10.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.839+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc70402e070 con 0x7fc6fc031040 2024-04-24T02:14:10.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.839+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6aa2e0 con 0x55ba2d6a1670 2024-04-24T02:14:10.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.839+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc70402e070 con 0x55ba2d6a1670 2024-04-24T02:14:10.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.839+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6aa2e0 con 0x7fc6f4098070 2024-04-24T02:14:10.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.839+0000 7fc70b369640 1 -- 172.21.15.134:0/2345481493 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc6fc01f070 con 0x7fc6f4098070 2024-04-24T02:14:10.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.839+0000 7fc70b369640 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6aa2e0 con 0x55ba2d6a78c0 2024-04-24T02:14:10.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.839+0000 7fc70a367640 1 -- 172.21.15.134:0/2345481493 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6f409f070 con 0x55ba2d6a78c0 2024-04-24T02:14:10.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.839+0000 7fc70a367640 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6aa2e0 con 0x55ba2d6a78c0 2024-04-24T02:14:10.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.839+0000 7fc70a367640 1 -- 172.21.15.134:0/2345481493 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6f409f070 con 0x55ba2d6a78c0 2024-04-24T02:14:10.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.839+0000 7fc70a367640 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc6f40af040 con 0x7fc6f4098070 2024-04-24T02:14:10.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.840+0000 7fc70b369640 1 -- 172.21.15.134:0/2345481493 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6fc01f070 con 0x7fc6f4098070 2024-04-24T02:14:10.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.840+0000 7fc70b369640 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc6f40af040 con 0x55ba2d6a78c0 2024-04-24T02:14:10.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.840+0000 7fc70a367640 1 -- 172.21.15.134:0/2345481493 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6f409f070 con 0x55ba2d6a78c0 2024-04-24T02:14:10.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.840+0000 7fc70a367640 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc6f40af040 con 0x55ba2d6a78c0 2024-04-24T02:14:10.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.840+0000 7fc70a367640 1 -- 172.21.15.134:0/2345481493 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6f409f070 con 0x55ba2d6a78c0 2024-04-24T02:14:10.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.840+0000 7fc70a367640 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc6f40af040 con 0x55ba2d6a1670 2024-04-24T02:14:10.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.840+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc70402e070 con 0x55ba2d6a1670 2024-04-24T02:14:10.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.840+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc6f40af040 con 0x55ba2d6a1670 2024-04-24T02:14:10.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.841+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=132b] v32'6 uv6 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fc70402e070 con 0x55ba2d6a1670 2024-04-24T02:14:10.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.841+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc6f40af040 con 0x7fc6fc031040 2024-04-24T02:14:10.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.841+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc70402e070 con 0x7fc6fc031040 2024-04-24T02:14:10.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.841+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc6f40af040 con 0x55ba2d6a78c0 2024-04-24T02:14:10.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.841+0000 7fc70a367640 1 -- 172.21.15.134:0/2345481493 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6f409f070 con 0x55ba2d6a78c0 2024-04-24T02:14:10.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.841+0000 7fc70a367640 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc6f40af040 con 0x7fc6f4098070 2024-04-24T02:14:10.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.842+0000 7fc70b369640 1 -- 172.21.15.134:0/2345481493 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6fc01f070 con 0x7fc6f4098070 2024-04-24T02:14:10.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.842+0000 7fc70b369640 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc6f40af040 con 0x55ba2d6a1670 2024-04-24T02:14:10.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.842+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc70402e070 con 0x55ba2d6a1670 2024-04-24T02:14:10.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.842+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc6f40af040 con 0x7fc6fc031040 2024-04-24T02:14:10.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.842+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc70402e070 con 0x7fc6fc031040 2024-04-24T02:14:10.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.842+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc6f40af040 con 0x55ba2d6a78c0 2024-04-24T02:14:10.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.842+0000 7fc70a367640 1 -- 172.21.15.134:0/2345481493 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6f409f070 con 0x55ba2d6a78c0 2024-04-24T02:14:10.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.842+0000 7fc70a367640 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc6f40af040 con 0x7fc6fc031040 2024-04-24T02:14:10.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.843+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc70402e070 con 0x7fc6fc031040 2024-04-24T02:14:10.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.843+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc6f40af040 con 0x7fc6f4098070 2024-04-24T02:14:10.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.843+0000 7fc70b369640 1 -- 172.21.15.134:0/2345481493 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6fc040040 con 0x7fc6f4098070 2024-04-24T02:14:10.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.843+0000 7fc70b369640 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc6f40af040 con 0x55ba2d6a78c0 2024-04-24T02:14:10.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.843+0000 7fc70a367640 1 -- 172.21.15.134:0/2345481493 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6f409f070 con 0x55ba2d6a78c0 2024-04-24T02:14:10.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.843+0000 7fc70a367640 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc6f40af040 con 0x7fc6f4098070 2024-04-24T02:14:10.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.843+0000 7fc70b369640 1 -- 172.21.15.134:0/2345481493 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6fc040040 con 0x7fc6f4098070 2024-04-24T02:14:10.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.843+0000 7fc70b369640 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc6f40af040 con 0x55ba2d6a1670 2024-04-24T02:14:10.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.844+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc70402e070 con 0x55ba2d6a1670 2024-04-24T02:14:10.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.844+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc6f40af040 con 0x7fc6f4098070 2024-04-24T02:14:10.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.844+0000 7fc70b369640 1 -- 172.21.15.134:0/2345481493 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6fc040040 con 0x7fc6f4098070 2024-04-24T02:14:10.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.844+0000 7fc70d062800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:14:10.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.844+0000 7fc70d062800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:14:10.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.844+0000 7fc70d062800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:14:10.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.844+0000 7fc70d062800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:14:10.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.844+0000 7fc70d062800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:14:10.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.844+0000 7fc70d062800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:14:10.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.844+0000 7fc70d062800 20 rados->read ofs=0 len=0 2024-04-24T02:14:10.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.844+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6a6500 con 0x55ba2d6a1670 2024-04-24T02:14:10.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.844+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc70402e070 con 0x55ba2d6a1670 2024-04-24T02:14:10.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.844+0000 7fc70d062800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:10.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.844+0000 7fc70d062800 20 rados->read ofs=0 len=0 2024-04-24T02:14:10.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.844+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6a6da0 con 0x55ba2d6a1670 2024-04-24T02:14:10.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.844+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc70402e070 con 0x55ba2d6a1670 2024-04-24T02:14:10.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.844+0000 7fc70d062800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:14:10.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.844+0000 7fc70d062800 20 rados->read ofs=0 len=0 2024-04-24T02:14:10.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.844+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6aa760 con 0x55ba2d6a1670 2024-04-24T02:14:10.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.845+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc70402e070 con 0x55ba2d6a1670 2024-04-24T02:14:10.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.845+0000 7fc70d062800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:14:10.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.845+0000 7fc70d062800 20 zone default found 2024-04-24T02:14:10.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.845+0000 7fc70d062800 4 Realm: () 2024-04-24T02:14:10.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.845+0000 7fc70d062800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:14:10.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.845+0000 7fc70d062800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:14:10.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.845+0000 7fc70d062800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:14:10.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.845+0000 7fc70d062800 20 zonegroup default 2024-04-24T02:14:10.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.845+0000 7fc70d062800 20 rados->read ofs=0 len=0 2024-04-24T02:14:10.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.845+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6aac10 con 0x7fc6fc031040 2024-04-24T02:14:10.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.845+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc70402e070 con 0x7fc6fc031040 2024-04-24T02:14:10.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.845+0000 7fc70d062800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:10.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.845+0000 7fc70d062800 20 rados->read ofs=0 len=0 2024-04-24T02:14:10.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.845+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6ac5f0 con 0x55ba2d6a78c0 2024-04-24T02:14:10.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.845+0000 7fc70a367640 1 -- 172.21.15.134:0/2345481493 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc6f409f070 con 0x55ba2d6a78c0 2024-04-24T02:14:10.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.845+0000 7fc70d062800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:10.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.845+0000 7fc70d062800 20 rados->read ofs=0 len=0 2024-04-24T02:14:10.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.845+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6aca70 con 0x55ba2d6a78c0 2024-04-24T02:14:10.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.845+0000 7fc70a367640 1 -- 172.21.15.134:0/2345481493 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc6f409f070 con 0x55ba2d6a78c0 2024-04-24T02:14:10.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.845+0000 7fc70d062800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:10.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.845+0000 7fc70d062800 20 started sync module instance, tier type = 2024-04-24T02:14:10.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.846+0000 7fc70d062800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:14:10.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.846+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6aba80 con 0x7fc6f4098070 2024-04-24T02:14:10.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.847+0000 7fc70b369640 1 -- 172.21.15.134:0/2345481493 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(44 notify.0 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6fc040040 con 0x7fc6f4098070 2024-04-24T02:14:10.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.847+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94258114248304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6ab6e0 con 0x7fc6f4098070 2024-04-24T02:14:10.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.847+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6ad890 con 0x55ba2d6a1670 2024-04-24T02:14:10.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.848+0000 7fc70b369640 1 -- 172.21.15.134:0/2345481493 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94258114248304] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6fc040040 con 0x7fc6f4098070 2024-04-24T02:14:10.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.848+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc70402e070 con 0x55ba2d6a1670 2024-04-24T02:14:10.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.848+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94258114252496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6ad850 con 0x55ba2d6a1670 2024-04-24T02:14:10.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.848+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6ae2e0 con 0x55ba2d6a78c0 2024-04-24T02:14:10.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.849+0000 7fc70a367640 1 -- 172.21.15.134:0/2345481493 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6f409f070 con 0x55ba2d6a78c0 2024-04-24T02:14:10.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.849+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94258114256368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6aeb80 con 0x55ba2d6a78c0 2024-04-24T02:14:10.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.849+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6af600 con 0x7fc6f4098070 2024-04-24T02:14:10.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.849+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94258114252496] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc70402e070 con 0x55ba2d6a1670 2024-04-24T02:14:10.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.850+0000 7fc70a367640 1 -- 172.21.15.134:0/2345481493 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94258114256368] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6f409f070 con 0x55ba2d6a78c0 2024-04-24T02:14:10.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.850+0000 7fc70b369640 1 -- 172.21.15.134:0/2345481493 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(50 notify.3 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6fc040040 con 0x7fc6f4098070 2024-04-24T02:14:10.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.850+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94258114258640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6ad2f0 con 0x7fc6f4098070 2024-04-24T02:14:10.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.850+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6afed0 con 0x55ba2d6a1670 2024-04-24T02:14:10.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.851+0000 7fc70b369640 1 -- 172.21.15.134:0/2345481493 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94258114258640] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6fc040040 con 0x7fc6f4098070 2024-04-24T02:14:10.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.851+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc70402e070 con 0x55ba2d6a1670 2024-04-24T02:14:10.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.851+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94258114261232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6afed0 con 0x55ba2d6a1670 2024-04-24T02:14:10.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.851+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6b0920 con 0x7fc6fc031040 2024-04-24T02:14:10.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.852+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(54 notify.5 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc70402e070 con 0x7fc6fc031040 2024-04-24T02:14:10.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.852+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94258114266160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6b0850 con 0x7fc6fc031040 2024-04-24T02:14:10.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.852+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6b1850 con 0x7fc6fc031040 2024-04-24T02:14:10.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.852+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94258114261232] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc70402e070 con 0x55ba2d6a1670 2024-04-24T02:14:10.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.853+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(56 notify.6 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc70402e070 con 0x7fc6fc031040 2024-04-24T02:14:10.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.853+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94258114266160] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc70402e070 con 0x7fc6fc031040 2024-04-24T02:14:10.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.853+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94258114263584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6b1810 con 0x7fc6fc031040 2024-04-24T02:14:10.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.853+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6b0d50 con 0x7fc6fc031040 2024-04-24T02:14:10.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.854+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94258114263584] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc70402e070 con 0x7fc6fc031040 2024-04-24T02:14:10.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.854+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(58 notify.7 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc70402e070 con 0x7fc6fc031040 2024-04-24T02:14:10.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.855+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94258114270048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6b1780 con 0x7fc6fc031040 2024-04-24T02:14:10.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.855+0000 7fc70d062800 20 add_watcher() i=0 2024-04-24T02:14:10.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.855+0000 7fc70d062800 20 add_watcher() i=1 2024-04-24T02:14:10.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.855+0000 7fc70d062800 20 add_watcher() i=2 2024-04-24T02:14:10.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.855+0000 7fc70d062800 20 add_watcher() i=3 2024-04-24T02:14:10.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.855+0000 7fc70d062800 20 add_watcher() i=4 2024-04-24T02:14:10.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.855+0000 7fc70d062800 20 add_watcher() i=5 2024-04-24T02:14:10.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.855+0000 7fc70d062800 20 add_watcher() i=6 2024-04-24T02:14:10.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.855+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94258114270048] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc70402e070 con 0x7fc6fc031040 2024-04-24T02:14:10.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.855+0000 7fc70d062800 20 add_watcher() i=7 2024-04-24T02:14:10.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.855+0000 7fc70d062800 2 all 8 watchers are set, enabling cache 2024-04-24T02:14:10.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.856+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6b5230 con 0x55ba2d6a1670 2024-04-24T02:14:10.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.856+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc70402e070 con 0x55ba2d6a1670 2024-04-24T02:14:10.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.856+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94258114272592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6b2620 con 0x55ba2d6a1670 2024-04-24T02:14:10.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.857+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94258114272592] v32'250 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc70402e070 con 0x55ba2d6a1670 2024-04-24T02:14:10.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.857+0000 7fc5c17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:14:10.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.857+0000 7fc70d062800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:14:10.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.857+0000 7fc70d062800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:14:10.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.857+0000 7fc70d062800 5 note: GC not initialized 2024-04-24T02:14:10.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.858+0000 7fc53bfff640 20 reqs_thread_entry: start 2024-04-24T02:14:10.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.858+0000 7fc70d062800 20 init_complete bucket index max shards: 11 2024-04-24T02:14:10.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.858+0000 7fc70d062800 20 Filter name: none 2024-04-24T02:14:10.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.858+0000 7fc539ffb640 20 reqs_thread_entry: start 2024-04-24T02:14:10.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.858+0000 7fc70d062800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-04-24T02:14:10.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.858+0000 7fc70d062800 20 rados->read ofs=0 len=0 2024-04-24T02:14:10.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.858+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:62 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6e8450 con 0x7fc6fc031040 2024-04-24T02:14:10.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.858+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(62 system_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 239+0+0 (crc 0 0 0) 0x7fc70402e070 con 0x7fc6fc031040 2024-04-24T02:14:10.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.858+0000 7fc70d062800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:10.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.858+0000 7fc70d062800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x0 2024-04-24T02:14:10.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.858+0000 7fc70d062800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-04-24T02:14:10.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.858+0000 7fc70d062800 10 cache get: name=default.rgw.meta+users.keys+system_akey : miss 2024-04-24T02:14:10.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.858+0000 7fc70d062800 20 rados->read ofs=0 len=0 2024-04-24T02:14:10.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.858+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:63 8.0 8:01223cbf:users.keys::system_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6e6bf0 con 0x55ba2d6a78c0 2024-04-24T02:14:10.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.859+0000 7fc70a367640 1 -- 172.21.15.134:0/2345481493 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(63 system_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7fc6f409f070 con 0x55ba2d6a78c0 2024-04-24T02:14:10.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.859+0000 7fc70d062800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:10.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.859+0000 7fc70d062800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x0 2024-04-24T02:14:10.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.859+0000 7fc70d062800 10 adding default.rgw.meta+users.keys+system_akey to cache LRU end 2024-04-24T02:14:10.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.859+0000 7fc70d062800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-04-24T02:14:10.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.859+0000 7fc70d062800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-04-24T02:14:10.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.859+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:64 8.1e 8:78ce4db0:users.uid::system_user:head [delete,create,call version.set in=58b,writefull 0~349 in=349b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6e7710 con 0x7fc6fc031040 2024-04-24T02:14:10.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.860+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(64 system_user [delete,create,call,writefull 0~349] v32'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7fc70402e070 con 0x7fc6fc031040 2024-04-24T02:14:10.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.860+0000 7fc70d062800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-04-24T02:14:10.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.860+0000 7fc70d062800 10 moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-04-24T02:14:10.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.860+0000 7fc70d062800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-04-24T02:14:10.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.860+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94258114490624 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6ebf30 con 0x7fc6f4098070 2024-04-24T02:14:10.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.860+0000 7fc70b369640 1 -- 172.21.15.134:0/2345481493 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== watch-notify(notify (1) cookie 94258114248304 notify 137438953495 ret 0) ==== 575+0+0 (crc 0 0 0) 0x7fc6fc024780 con 0x7fc6f4098070 2024-04-24T02:14:10.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.860+0000 7fc5ee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953495 cookie 94258114248304 notifier 4837 bl.length()=533 2024-04-24T02:14:10.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.860+0000 7fc70b369640 1 -- 172.21.15.134:0/2345481493 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(65 notify.0 [notify cookie 94258114490624 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc6fc040040 con 0x7fc6f4098070 2024-04-24T02:14:10.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.860+0000 7fc5ee7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-04-24T02:14:10.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.860+0000 7fc5ee7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-04-24T02:14:10.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.860+0000 7fc5ee7fc640 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc5d0003ea0 con 0x7fc6f4098070 2024-04-24T02:14:10.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.860+0000 7fc70b369640 1 -- 172.21.15.134:0/2345481493 <== osd.2 v2:172.21.15.134:6800/214480313 16 ==== osd_op_reply(66 notify.0 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6fc040040 con 0x7fc6f4098070 2024-04-24T02:14:10.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.861+0000 7fc70b369640 1 -- 172.21.15.134:0/2345481493 <== osd.2 v2:172.21.15.134:6800/214480313 17 ==== watch-notify(notify_complete (2) cookie 94258114490624 notify 137438953495 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc6fc032970 con 0x7fc6f4098070 2024-04-24T02:14:10.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.861+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:67 8.0 8:01223cbf:users.keys::system_akey:head [delete,create,writefull 0~15 in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6e7100 con 0x55ba2d6a78c0 2024-04-24T02:14:10.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.862+0000 7fc70a367640 1 -- 172.21.15.134:0/2345481493 <== osd.3 v2:172.21.15.134:6801/3585115521 15 ==== osd_op_reply(67 system_akey [delete,create,writefull 0~15] v32'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7fc6f409f070 con 0x55ba2d6a78c0 2024-04-24T02:14:10.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.862+0000 7fc70d062800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-04-24T02:14:10.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.862+0000 7fc70d062800 10 moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-04-24T02:14:10.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.862+0000 7fc70d062800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-04-24T02:14:10.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.862+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify cookie 94258114501152 in=188b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6ec810 con 0x55ba2d6a1670 2024-04-24T02:14:10.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.862+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== watch-notify(notify (1) cookie 94258114252496 notify 137438953494 ret 0) ==== 218+0+0 (crc 0 0 0) 0x55ba2d6e8160 con 0x55ba2d6a1670 2024-04-24T02:14:10.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.862+0000 7fc5ee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953494 cookie 94258114252496 notifier 4837 bl.length()=176 2024-04-24T02:14:10.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.862+0000 7fc5ee7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-04-24T02:14:10.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.862+0000 7fc5ee7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-04-24T02:14:10.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.862+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(68 notify.1 [notify cookie 94258114501152 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc70402e070 con 0x55ba2d6a1670 2024-04-24T02:14:10.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.862+0000 7fc5ee7fc640 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc5d0003ea0 con 0x55ba2d6a1670 2024-04-24T02:14:10.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.862+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== watch-notify(notify_complete (2) cookie 94258114501152 notify 137438953494 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc704037040 con 0x55ba2d6a1670 2024-04-24T02:14:10.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.862+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(69 notify.1 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc70402e070 con 0x55ba2d6a1670 2024-04-24T02:14:10.877 INFO:teuthology.orchestra.run.smithi134.stdout:{"user_id":"system_user","display_name":"System User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"system_user","access_key":"system_akey","secret_key":"system_skey","active":true,"create_date":"2024-04-24T02:14:10.860423Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","system":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T02:14:10.860400Z","tags":[],"group_ids":[]} 2024-04-24T02:14:10.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.863+0000 7fc5c17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:14:10.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.863+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94258114272592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6e9910 con 0x55ba2d6a1670 2024-04-24T02:14:10.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.864+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94258114272592] v32'251 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc70402e070 con 0x55ba2d6a1670 2024-04-24T02:14:10.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.864+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94258114248304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6b1d50 con 0x7fc6f4098070 2024-04-24T02:14:10.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.865+0000 7fc70b369640 1 -- 172.21.15.134:0/2345481493 <== osd.2 v2:172.21.15.134:6800/214480313 18 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94258114248304] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6fc040040 con 0x7fc6f4098070 2024-04-24T02:14:10.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.865+0000 7fc70d062800 20 remove_watcher() i=0 2024-04-24T02:14:10.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.865+0000 7fc70d062800 2 removed watcher, disabling cache 2024-04-24T02:14:10.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.865+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94258114252496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6b1d50 con 0x55ba2d6a1670 2024-04-24T02:14:10.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.866+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94258114252496] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc70402e070 con 0x55ba2d6a1670 2024-04-24T02:14:10.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.866+0000 7fc70d062800 20 remove_watcher() i=1 2024-04-24T02:14:10.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.866+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94258114256368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6aced0 con 0x55ba2d6a78c0 2024-04-24T02:14:10.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.867+0000 7fc70a367640 1 -- 172.21.15.134:0/2345481493 <== osd.3 v2:172.21.15.134:6801/3585115521 16 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94258114256368] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6f409f070 con 0x55ba2d6a78c0 2024-04-24T02:14:10.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.867+0000 7fc70d062800 20 remove_watcher() i=2 2024-04-24T02:14:10.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.867+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94258114258640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6b1d50 con 0x7fc6f4098070 2024-04-24T02:14:10.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.868+0000 7fc70b369640 1 -- 172.21.15.134:0/2345481493 <== osd.2 v2:172.21.15.134:6800/214480313 19 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94258114258640] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6fc040040 con 0x7fc6f4098070 2024-04-24T02:14:10.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.868+0000 7fc70d062800 20 remove_watcher() i=3 2024-04-24T02:14:10.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.868+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94258114261232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6aced0 con 0x55ba2d6a1670 2024-04-24T02:14:10.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.869+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94258114261232] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc70402e070 con 0x55ba2d6a1670 2024-04-24T02:14:10.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.869+0000 7fc70d062800 20 remove_watcher() i=4 2024-04-24T02:14:10.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.869+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94258114266160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6ae6d0 con 0x7fc6fc031040 2024-04-24T02:14:10.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.871+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94258114266160] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc70402e070 con 0x7fc6fc031040 2024-04-24T02:14:10.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.871+0000 7fc70d062800 20 remove_watcher() i=5 2024-04-24T02:14:10.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.871+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94258114263584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6b1d50 con 0x7fc6fc031040 2024-04-24T02:14:10.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.872+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94258114263584] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc70402e070 con 0x7fc6fc031040 2024-04-24T02:14:10.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.872+0000 7fc70d062800 20 remove_watcher() i=6 2024-04-24T02:14:10.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.872+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94258114270048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba2d6aced0 con 0x7fc6fc031040 2024-04-24T02:14:10.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.873+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94258114270048] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc70402e070 con 0x7fc6fc031040 2024-04-24T02:14:10.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.873+0000 7fc70d062800 20 remove_watcher() i=7 2024-04-24T02:14:10.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.873+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fc6fc031040 msgr2=0x7fc6fc032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.873+0000 7fc70d062800 1 --2- 172.21.15.134:0/2345481493 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fc6fc031040 0x7fc6fc032430 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.873+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55ba2d6a1670 msgr2=0x55ba2d6a3b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.873+0000 7fc70d062800 1 --2- 172.21.15.134:0/2345481493 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55ba2d6a1670 0x55ba2d6a3b30 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.873+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fc6f4098070 msgr2=0x7fc6f407c860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.873+0000 7fc70d062800 1 --2- 172.21.15.134:0/2345481493 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fc6f4098070 0x7fc6f407c860 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.873+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55ba2d6a78c0 msgr2=0x55ba2d6a9cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.873+0000 7fc70d062800 1 --2- 172.21.15.134:0/2345481493 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55ba2d6a78c0 0x55ba2d6a9cb0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.873+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc5d40368b0 msgr2=0x7fc5d4038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.873+0000 7fc70d062800 1 --2- 172.21.15.134:0/2345481493 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc5d40368b0 0x7fc5d4038d70 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x55ba2d66d5a0 tx=0x7fc6fc01f000 comp rx=0 tx=0).stop 2024-04-24T02:14:10.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.873+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba2d68e4d0 msgr2=0x55ba2d695b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.873+0000 7fc70d062800 1 --2- 172.21.15.134:0/2345481493 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba2d68e4d0 0x55ba2d695b80 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4080040 tx=0x7fc6f408d9d0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.873+0000 7fc70ab68640 1 -- 172.21.15.134:0/2345481493 reap_dead start 2024-04-24T02:14:10.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.873+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 shutdown_connections 2024-04-24T02:14:10.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.873+0000 7fc70d062800 1 --2- 172.21.15.134:0/2345481493 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba2d68e4d0 0x55ba2d695b80 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.873+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 >> 172.21.15.134:0/2345481493 conn(0x55ba2d68a830 msgr2=0x55ba2d687e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:10.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.873+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 shutdown_connections 2024-04-24T02:14:10.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.873+0000 7fc70d062800 1 -- 172.21.15.134:0/2345481493 wait complete. 2024-04-24T02:14:10.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.873+0000 7fc70d062800 1 -- 172.21.15.134:0/1312572930 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc5e4036900 msgr2=0x7fc5e4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.873+0000 7fc70d062800 1 --2- 172.21.15.134:0/1312572930 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc5e4036900 0x7fc5e4038dc0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x55ba2d671300 tx=0x7fc6fc005840 comp rx=0 tx=0).stop 2024-04-24T02:14:10.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.873+0000 7fc70d062800 1 -- 172.21.15.134:0/1312572930 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba2d681290 msgr2=0x55ba2d6816b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.873+0000 7fc70d062800 1 --2- 172.21.15.134:0/1312572930 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba2d681290 0x55ba2d6816b0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4005930 tx=0x7fc6f4002fb0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.873+0000 7fc70d062800 1 -- 172.21.15.134:0/1312572930 shutdown_connections 2024-04-24T02:14:10.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.873+0000 7fc70d062800 1 --2- 172.21.15.134:0/1312572930 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc5e4036900 0x7fc5e4038dc0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.873+0000 7fc70d062800 1 --2- 172.21.15.134:0/1312572930 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba2d681290 0x55ba2d6816b0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.873+0000 7fc70d062800 1 -- 172.21.15.134:0/1312572930 >> 172.21.15.134:0/1312572930 conn(0x55ba2d675330 msgr2=0x55ba2d675730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:10.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.873+0000 7fc70d062800 1 -- 172.21.15.134:0/1312572930 shutdown_connections 2024-04-24T02:14:10.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.873+0000 7fc70d062800 1 -- 172.21.15.134:0/1312572930 wait complete. 2024-04-24T02:14:10.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.874+0000 7fc70d062800 1 -- 172.21.15.134:0/2204644883 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55ba2d572360 msgr2=0x55ba2d670080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.874+0000 7fc70d062800 1 --2- 172.21.15.134:0/2204644883 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55ba2d572360 0x55ba2d670080 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.874+0000 7fc70d062800 1 -- 172.21.15.134:0/2204644883 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc5f0036900 msgr2=0x7fc5f0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.874+0000 7fc70d062800 1 --2- 172.21.15.134:0/2204644883 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc5f0036900 0x7fc5f0038dc0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4054000 tx=0x7fc6f404e000 comp rx=0 tx=0).stop 2024-04-24T02:14:10.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.874+0000 7fc70d062800 1 -- 172.21.15.134:0/2204644883 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba2d56e850 msgr2=0x55ba2d668e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.874+0000 7fc70d062800 1 --2- 172.21.15.134:0/2204644883 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba2d56e850 0x55ba2d668e40 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fc70400c010 tx=0x7fc704000ed0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.874+0000 7fc70d062800 1 -- 172.21.15.134:0/2204644883 shutdown_connections 2024-04-24T02:14:10.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.874+0000 7fc70d062800 1 --2- 172.21.15.134:0/2204644883 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55ba2d572360 0x55ba2d670080 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.874+0000 7fc70d062800 1 --2- 172.21.15.134:0/2204644883 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc5f0036900 0x7fc5f0038dc0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.874+0000 7fc70d062800 1 --2- 172.21.15.134:0/2204644883 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba2d56e850 0x55ba2d668e40 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.874+0000 7fc70d062800 1 -- 172.21.15.134:0/2204644883 >> 172.21.15.134:0/2204644883 conn(0x55ba2d568320 msgr2=0x55ba2d56d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:10.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.874+0000 7fc70d062800 1 -- 172.21.15.134:0/2204644883 shutdown_connections 2024-04-24T02:14:10.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.874+0000 7fc70d062800 1 -- 172.21.15.134:0/2204644883 wait complete. 2024-04-24T02:14:10.888 DEBUG:tasks.util.rgw: json result: {'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-04-24T02:14:10.860423Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:14:10.860400Z', 'tags': [], 'group_ids': []} 2024-04-24T02:14:10.889 ERROR:root:{'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-04-24T02:14:10.860423Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:14:10.860400Z', 'tags': [], 'group_ids': []} 2024-04-24T02:14:10.889 ERROR:root:0 2024-04-24T02:14:10.889 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T02:14:10.894 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T02:14:10.894 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'system_user'] 2024-04-24T02:14:10.894 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'system_user'] 2024-04-24T02:14:10.894 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid system_user 2024-04-24T02:14:10.936 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:14:10.937 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:14:10.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.936+0000 7f71c2333800 1 Processor -- start 2024-04-24T02:14:10.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.936+0000 7f71c2333800 1 -- start start 2024-04-24T02:14:10.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.936+0000 7f71c2333800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5595e4ecbd20 0x5595e4ecc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.936+0000 7f71c2333800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5595e4d8bd40 con 0x5595e4eccf80 2024-04-24T02:14:10.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.936+0000 7f71c2333800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x5595e4d5e4d0 con 0x5595e4ecbd20 2024-04-24T02:14:10.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.936+0000 7f71bdff5640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5595e4ecbd20 0x5595e4ecc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.936+0000 7f71bd7f4640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x5595e4eccf80 0x5595e4ecd400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:46456/0 (socket says 172.21.15.134:46456) 2024-04-24T02:14:10.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.936+0000 7f71bd7f4640 1 -- 172.21.15.134:0/3331186985 learned_addr learned my addr 172.21.15.134:0/3331186985 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:14:10.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.936+0000 7f71bdff5640 1 -- 172.21.15.134:0/3331186985 >> v1:172.21.15.104:6789/0 conn(0x5595e4eccf80 legacy=0x5595e4ecd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.937+0000 7f71bdff5640 1 -- 172.21.15.134:0/3331186985 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595e4d8a590 con 0x5595e4ecbd20 2024-04-24T02:14:10.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.938+0000 7f71bdff5640 1 --2- 172.21.15.134:0/3331186985 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595e4ecbd20 0x5595e4ecc140 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f71b8005fd0 tx=0x7f71b801ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=814b0a95461d9e3c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.938+0000 7f71bcff3640 1 -- 172.21.15.134:0/3331186985 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71b8052560 con 0x5595e4ecbd20 2024-04-24T02:14:10.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.938+0000 7f71bcff3640 1 -- 172.21.15.134:0/3331186985 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71b8052700 con 0x5595e4ecbd20 2024-04-24T02:14:10.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.938+0000 7f71bcff3640 1 -- 172.21.15.134:0/3331186985 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71b8052a60 con 0x5595e4ecbd20 2024-04-24T02:14:10.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.939+0000 7f71c2333800 1 -- 172.21.15.134:0/3331186985 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595e4ecbd20 msgr2=0x5595e4ecc140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.939+0000 7f71c2333800 1 --2- 172.21.15.134:0/3331186985 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595e4ecbd20 0x5595e4ecc140 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f71b8005fd0 tx=0x7f71b801ccc0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.939+0000 7f71c2333800 1 -- 172.21.15.134:0/3331186985 shutdown_connections 2024-04-24T02:14:10.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.939+0000 7f71c2333800 1 --2- 172.21.15.134:0/3331186985 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595e4ecbd20 0x5595e4ecc140 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.939+0000 7f71c2333800 1 -- 172.21.15.134:0/3331186985 >> 172.21.15.134:0/3331186985 conn(0x5595e4ec7380 msgr2=0x5595e4ec97a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:10.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.939+0000 7f71c2333800 1 -- 172.21.15.134:0/3331186985 shutdown_connections 2024-04-24T02:14:10.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.939+0000 7f71c2333800 1 -- 172.21.15.134:0/3331186985 wait complete. 2024-04-24T02:14:10.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.950+0000 7f71c2333800 1 Processor -- start 2024-04-24T02:14:10.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.951+0000 7f71c2333800 1 -- start start 2024-04-24T02:14:10.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.951+0000 7f71c2333800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595e4eccf80 0x5595e4fbd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.951+0000 7f71c2333800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5595e4e183c0 con 0x5595e4eccf80 2024-04-24T02:14:10.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.951+0000 7f71bdff5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595e4eccf80 0x5595e4fbd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.951+0000 7f71bdff5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595e4eccf80 0x5595e4fbd520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43732/0 (socket says 172.21.15.134:43732) 2024-04-24T02:14:10.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.951+0000 7f71bdff5640 1 -- 172.21.15.134:0/3817253955 learned_addr learned my addr 172.21.15.134:0/3817253955 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:10.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.951+0000 7f71bdff5640 1 -- 172.21.15.134:0/3817253955 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595e4fbdaf0 con 0x5595e4eccf80 2024-04-24T02:14:10.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.952+0000 7f71bdff5640 1 --2- 172.21.15.134:0/3817253955 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595e4eccf80 0x5595e4fbd520 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f71b8007000 tx=0x7f71b804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3887af23c6066f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.952+0000 7f70abe07640 1 -- 172.21.15.134:0/3817253955 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71b8069070 con 0x5595e4eccf80 2024-04-24T02:14:10.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.952+0000 7f70abe07640 1 -- 172.21.15.134:0/3817253955 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71b80528b0 con 0x5595e4eccf80 2024-04-24T02:14:10.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.952+0000 7f70abe07640 1 -- 172.21.15.134:0/3817253955 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71b8052bb0 con 0x5595e4eccf80 2024-04-24T02:14:10.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.952+0000 7f71c2333800 1 -- 172.21.15.134:0/3817253955 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595e4eccf80 msgr2=0x5595e4fbd520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.952+0000 7f71c2333800 1 --2- 172.21.15.134:0/3817253955 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595e4eccf80 0x5595e4fbd520 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f71b8007000 tx=0x7f71b804c000 comp rx=0 tx=0).stop 2024-04-24T02:14:10.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.952+0000 7f71c2333800 1 -- 172.21.15.134:0/3817253955 shutdown_connections 2024-04-24T02:14:10.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.952+0000 7f71c2333800 1 --2- 172.21.15.134:0/3817253955 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595e4eccf80 0x5595e4fbd520 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.952+0000 7f71c2333800 1 -- 172.21.15.134:0/3817253955 >> 172.21.15.134:0/3817253955 conn(0x5595e4ec7380 msgr2=0x5595e4fb8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:10.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.953+0000 7f71c2333800 1 -- 172.21.15.134:0/3817253955 shutdown_connections 2024-04-24T02:14:10.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.953+0000 7f71c2333800 1 -- 172.21.15.134:0/3817253955 wait complete. 2024-04-24T02:14:10.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.953+0000 7f71c2333800 1 Processor -- start 2024-04-24T02:14:10.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.953+0000 7f71c2333800 1 -- start start 2024-04-24T02:14:10.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.953+0000 7f71c2333800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595e4eccf80 0x5595e4fc83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.953+0000 7f71c2333800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5595e4ed53f0 con 0x5595e4eccf80 2024-04-24T02:14:10.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.953+0000 7f71bdff5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595e4eccf80 0x5595e4fc83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.953+0000 7f71bdff5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595e4eccf80 0x5595e4fc83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43744/0 (socket says 172.21.15.134:43744) 2024-04-24T02:14:10.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.953+0000 7f71bdff5640 1 -- 172.21.15.134:0/1171706978 learned_addr learned my addr 172.21.15.134:0/1171706978 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:10.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.953+0000 7f71bdff5640 1 -- 172.21.15.134:0/1171706978 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595e4fc88f0 con 0x5595e4eccf80 2024-04-24T02:14:10.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.954+0000 7f71bdff5640 1 --2- 172.21.15.134:0/1171706978 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595e4eccf80 0x5595e4fc83b0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f71b80448a0 tx=0x7f71b8003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.954+0000 7f70aa604640 1 -- 172.21.15.134:0/1171706978 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71b8072070 con 0x5595e4eccf80 2024-04-24T02:14:10.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.954+0000 7f70aa604640 1 -- 172.21.15.134:0/1171706978 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71b806d450 con 0x5595e4eccf80 2024-04-24T02:14:10.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.954+0000 7f71c2333800 1 -- 172.21.15.134:0/1171706978 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5595e4fc8b80 con 0x5595e4eccf80 2024-04-24T02:14:10.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.954+0000 7f70aa604640 1 -- 172.21.15.134:0/1171706978 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71b8069070 con 0x5595e4eccf80 2024-04-24T02:14:10.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.954+0000 7f71c2333800 1 -- 172.21.15.134:0/1171706978 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595e4fcb830 con 0x5595e4eccf80 2024-04-24T02:14:10.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.955+0000 7f70aa604640 1 -- 172.21.15.134:0/1171706978 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f71b8075070 con 0x5595e4eccf80 2024-04-24T02:14:10.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.955+0000 7f70aa604640 1 --2- 172.21.15.134:0/1171706978 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f70a4036950 0x7f70a4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.955+0000 7f70aa604640 1 -- 172.21.15.134:0/1171706978 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f71b805f030 con 0x5595e4eccf80 2024-04-24T02:14:10.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.955+0000 7f71bd7f4640 1 --2- 172.21.15.134:0/1171706978 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f70a4036950 0x7f70a4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.955+0000 7f71c2333800 1 --2- 172.21.15.134:0/1171706978 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5595e4fcd5e0 0x5595e4fcf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.955+0000 7f71c2333800 1 -- 172.21.15.134:0/1171706978 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595e4fcff10 con 0x5595e4fcd5e0 2024-04-24T02:14:10.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.955+0000 7f71be7f6640 1 --2- 172.21.15.134:0/1171706978 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5595e4fcd5e0 0x5595e4fcf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.955+0000 7f71bd7f4640 1 --2- 172.21.15.134:0/1171706978 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f70a4036950 0x7f70a4038e10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f71a8000f60 tx=0x7f71a80012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.955+0000 7f71be7f6640 1 --2- 172.21.15.134:0/1171706978 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5595e4fcd5e0 0x5595e4fcf9d0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.956+0000 7f71be7f6640 1 -- 172.21.15.134:0/1171706978 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f71b00083e0 con 0x5595e4fcd5e0 2024-04-24T02:14:10.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.956+0000 7f71c2333800 1 -- 172.21.15.134:0/1171706978 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595e4fccb80 con 0x5595e4fcd5e0 2024-04-24T02:14:10.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.956+0000 7f71be7f6640 1 -- 172.21.15.134:0/1171706978 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f71b00083e0 con 0x5595e4fcd5e0 2024-04-24T02:14:10.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.956+0000 7f71c2333800 1 -- 172.21.15.134:0/1171706978 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595e4fd1d20 con 0x5595e4fcd5e0 2024-04-24T02:14:10.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.956+0000 7f71be7f6640 1 -- 172.21.15.134:0/1171706978 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f71b00083e0 con 0x5595e4fcd5e0 2024-04-24T02:14:10.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.956+0000 7f71c2333800 1 -- 172.21.15.134:0/1171706978 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595e4fd1060 con 0x5595e4fcd5e0 2024-04-24T02:14:10.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.957+0000 7f71be7f6640 1 -- 172.21.15.134:0/1171706978 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f71b00083e0 con 0x5595e4fcd5e0 2024-04-24T02:14:10.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.957+0000 7f71c2333800 1 -- 172.21.15.134:0/1171706978 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595e4fd1450 con 0x5595e4fcd5e0 2024-04-24T02:14:10.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.957+0000 7f71be7f6640 1 -- 172.21.15.134:0/1171706978 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f71b00083e0 con 0x5595e4fcd5e0 2024-04-24T02:14:10.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.957+0000 7f71c2333800 1 Processor -- start 2024-04-24T02:14:10.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.957+0000 7f71c2333800 1 -- start start 2024-04-24T02:14:10.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.957+0000 7f71c2333800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595e4fe0b10 0x5595e4fe0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.957+0000 7f71c2333800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5595e4dbe6b0 con 0x5595e4fe0b10 2024-04-24T02:14:10.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.958+0000 7f71bd7f4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595e4fe0b10 0x5595e4fe0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.958+0000 7f71bd7f4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595e4fe0b10 0x5595e4fe0f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43750/0 (socket says 172.21.15.134:43750) 2024-04-24T02:14:10.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.958+0000 7f71bd7f4640 1 -- 172.21.15.134:0/2402278428 learned_addr learned my addr 172.21.15.134:0/2402278428 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:10.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.958+0000 7f71bd7f4640 1 -- 172.21.15.134:0/2402278428 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595e4fe1470 con 0x5595e4fe0b10 2024-04-24T02:14:10.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.958+0000 7f71bd7f4640 1 --2- 172.21.15.134:0/2402278428 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595e4fe0b10 0x5595e4fe0f30 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f71a8001ed0 tx=0x7f71a800d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.958+0000 7f70a37fe640 1 -- 172.21.15.134:0/2402278428 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71a801b550 con 0x5595e4fe0b10 2024-04-24T02:14:10.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.958+0000 7f70a37fe640 1 -- 172.21.15.134:0/2402278428 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71a801b6f0 con 0x5595e4fe0b10 2024-04-24T02:14:10.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.958+0000 7f71c2333800 1 -- 172.21.15.134:0/2402278428 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5595e4fe1ee0 con 0x5595e4fe0b10 2024-04-24T02:14:10.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.958+0000 7f70a37fe640 1 -- 172.21.15.134:0/2402278428 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71a801b9d0 con 0x5595e4fe0b10 2024-04-24T02:14:10.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.958+0000 7f71c2333800 1 -- 172.21.15.134:0/2402278428 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595e4fe23e0 con 0x5595e4fe0b10 2024-04-24T02:14:10.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.959+0000 7f70a37fe640 1 -- 172.21.15.134:0/2402278428 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f71a8023020 con 0x5595e4fe0b10 2024-04-24T02:14:10.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.959+0000 7f70a37fe640 1 --2- 172.21.15.134:0/2402278428 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7098036950 0x7f7098038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.959+0000 7f70a37fe640 1 -- 172.21.15.134:0/2402278428 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f71a8021020 con 0x5595e4fe0b10 2024-04-24T02:14:10.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.959+0000 7f71be7f6640 1 --2- 172.21.15.134:0/2402278428 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7098036950 0x7f7098038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.959+0000 7f71c2333800 1 Processor -- start 2024-04-24T02:14:10.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.959+0000 7f71c2333800 1 -- start start 2024-04-24T02:14:10.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.959+0000 7f71be7f6640 1 --2- 172.21.15.134:0/2402278428 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7098036950 0x7f7098038e10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x5595e4fd0b80 tx=0x7f71b0000f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.960+0000 7f71c2333800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595e4fede50 0x5595e4fee270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.960+0000 7f71c2333800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5595e4fbde10 con 0x5595e4fede50 2024-04-24T02:14:10.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.960+0000 7f71bd7f4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595e4fede50 0x5595e4fee270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.960+0000 7f71bd7f4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595e4fede50 0x5595e4fee270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43760/0 (socket says 172.21.15.134:43760) 2024-04-24T02:14:10.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.960+0000 7f71bd7f4640 1 -- 172.21.15.134:0/2319083251 learned_addr learned my addr 172.21.15.134:0/2319083251 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:10.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.960+0000 7f71bd7f4640 1 -- 172.21.15.134:0/2319083251 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595e4fee840 con 0x5595e4fede50 2024-04-24T02:14:10.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.960+0000 7f71bd7f4640 1 --2- 172.21.15.134:0/2319083251 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595e4fede50 0x5595e4fee270 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f71a804ce10 tx=0x7f71a8019ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3e33d3428040254 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.960+0000 7f70a17fa640 1 -- 172.21.15.134:0/2319083251 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71a8041070 con 0x5595e4fede50 2024-04-24T02:14:10.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.960+0000 7f70a17fa640 1 -- 172.21.15.134:0/2319083251 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71a80258e0 con 0x5595e4fede50 2024-04-24T02:14:10.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.960+0000 7f70a17fa640 1 -- 172.21.15.134:0/2319083251 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71a8025410 con 0x5595e4fede50 2024-04-24T02:14:10.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.961+0000 7f71c2333800 1 -- 172.21.15.134:0/2319083251 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595e4fede50 msgr2=0x5595e4fee270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:10.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.961+0000 7f71c2333800 1 --2- 172.21.15.134:0/2319083251 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595e4fede50 0x5595e4fee270 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f71a804ce10 tx=0x7f71a8019ce0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.961+0000 7f71c2333800 1 -- 172.21.15.134:0/2319083251 shutdown_connections 2024-04-24T02:14:10.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.961+0000 7f71c2333800 1 --2- 172.21.15.134:0/2319083251 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595e4fede50 0x5595e4fee270 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:10.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.961+0000 7f71c2333800 1 -- 172.21.15.134:0/2319083251 >> 172.21.15.134:0/2319083251 conn(0x5595e4fea1b0 msgr2=0x5595e4fe8210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:10.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.961+0000 7f71c2333800 1 -- 172.21.15.134:0/2319083251 shutdown_connections 2024-04-24T02:14:10.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.961+0000 7f71c2333800 1 -- 172.21.15.134:0/2319083251 wait complete. 2024-04-24T02:14:10.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.961+0000 7f71c2333800 1 Processor -- start 2024-04-24T02:14:10.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.961+0000 7f71c2333800 1 -- start start 2024-04-24T02:14:10.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.961+0000 7f71c2333800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595e4fede50 0x5595e4ff54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.961+0000 7f71c2333800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5595e4feefb0 con 0x5595e4fede50 2024-04-24T02:14:10.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.961+0000 7f71bd7f4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595e4fede50 0x5595e4ff54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.961+0000 7f71bd7f4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595e4fede50 0x5595e4ff54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43770/0 (socket says 172.21.15.134:43770) 2024-04-24T02:14:10.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.961+0000 7f71bd7f4640 1 -- 172.21.15.134:0/3232737921 learned_addr learned my addr 172.21.15.134:0/3232737921 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:10.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.962+0000 7f71bd7f4640 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595e4ff5a20 con 0x5595e4fede50 2024-04-24T02:14:10.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.962+0000 7f71bd7f4640 1 --2- 172.21.15.134:0/3232737921 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595e4fede50 0x5595e4ff54e0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f71a8019d20 tx=0x7f71a804cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.962+0000 7f708f7fe640 1 -- 172.21.15.134:0/3232737921 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71a8041070 con 0x5595e4fede50 2024-04-24T02:14:10.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.962+0000 7f708f7fe640 1 -- 172.21.15.134:0/3232737921 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71a804e810 con 0x5595e4fede50 2024-04-24T02:14:10.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.962+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5595e4ff5cb0 con 0x5595e4fede50 2024-04-24T02:14:10.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.962+0000 7f708f7fe640 1 -- 172.21.15.134:0/3232737921 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71a8024370 con 0x5595e4fede50 2024-04-24T02:14:10.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.962+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595e4ff5cb0 con 0x5595e4fede50 2024-04-24T02:14:10.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.963+0000 7f708f7fe640 1 -- 172.21.15.134:0/3232737921 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f71a804ea80 con 0x5595e4fede50 2024-04-24T02:14:10.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.963+0000 7f708f7fe640 1 --2- 172.21.15.134:0/3232737921 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7088036950 0x7f7088038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.963+0000 7f708f7fe640 1 -- 172.21.15.134:0/3232737921 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f71a804f060 con 0x5595e4fede50 2024-04-24T02:14:10.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.963+0000 7f71be7f6640 1 --2- 172.21.15.134:0/3232737921 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7088036950 0x7f7088038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.963+0000 7f71be7f6640 1 --2- 172.21.15.134:0/3232737921 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7088036950 0x7f7088038e10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f71b000f010 tx=0x7f71b000c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.963+0000 7f71c2333800 20 rados->read ofs=0 len=0 2024-04-24T02:14:10.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.963+0000 7f71c2333800 1 --2- 172.21.15.134:0/3232737921 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5595e5000de0 0x5595e50032a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.963+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595e50039f0 con 0x5595e5000de0 2024-04-24T02:14:10.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.964+0000 7f71bdff5640 1 --2- 172.21.15.134:0/3232737921 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5595e5000de0 0x5595e50032a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.964+0000 7f71bdff5640 1 --2- 172.21.15.134:0/3232737921 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5595e5000de0 0x5595e50032a0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.964+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f71b8074030 con 0x5595e5000de0 2024-04-24T02:14:10.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.964+0000 7f71c2333800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:10.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.964+0000 7f71c2333800 20 realm 2024-04-24T02:14:10.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.964+0000 7f71c2333800 20 rados->read ofs=0 len=0 2024-04-24T02:14:10.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.964+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595e5003e00 con 0x5595e5000de0 2024-04-24T02:14:10.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.964+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f71b8074030 con 0x5595e5000de0 2024-04-24T02:14:10.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.964+0000 7f71c2333800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:10.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.964+0000 7f71c2333800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:14:10.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.964+0000 7f71c2333800 20 rados->read ofs=0 len=0 2024-04-24T02:14:10.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.964+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595e50046d0 con 0x5595e5000de0 2024-04-24T02:14:10.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.964+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f71b8074030 con 0x5595e5000de0 2024-04-24T02:14:10.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.964+0000 7f71c2333800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:10.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.964+0000 7f71c2333800 20 rados->read ofs=0 len=0 2024-04-24T02:14:10.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.964+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595e5004a70 con 0x5595e5000de0 2024-04-24T02:14:10.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.965+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f71b8074030 con 0x5595e5000de0 2024-04-24T02:14:10.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.965+0000 7f71c2333800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:14:10.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.965+0000 7f71c2333800 20 rados->read ofs=0 len=0 2024-04-24T02:14:10.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.965+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595e50052c0 con 0x5595e5000de0 2024-04-24T02:14:10.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.965+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f71b8074030 con 0x5595e5000de0 2024-04-24T02:14:10.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.965+0000 7f71c2333800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:14:10.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.965+0000 7f71c2333800 20 searching for the correct realm 2024-04-24T02:14:10.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.965+0000 7f71c2333800 1 --2- 172.21.15.134:0/3232737921 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5595e5007030 0x5595e5009420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.965+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595e5009a00 con 0x5595e5007030 2024-04-24T02:14:10.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.965+0000 7f71bd7f4640 1 --2- 172.21.15.134:0/3232737921 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5595e5007030 0x5595e5009420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.965+0000 7f71bd7f4640 1 --2- 172.21.15.134:0/3232737921 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5595e5007030 0x5595e5009420 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.966+0000 7f71bd7f4640 1 -- 172.21.15.134:0/3232737921 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71a8009050 con 0x5595e5007030 2024-04-24T02:14:10.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.966+0000 7f71bd7f4640 1 --2- 172.21.15.134:0/3232737921 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f71a80447e0 0x7f71a80234d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.966+0000 7f71bd7f4640 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595e5009a00 con 0x7f71a80447e0 2024-04-24T02:14:10.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.966+0000 7f71be7f6640 1 --2- 172.21.15.134:0/3232737921 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f71a80447e0 0x7f71a80234d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.966+0000 7f71be7f6640 1 --2- 172.21.15.134:0/3232737921 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f71a80447e0 0x7f71a80234d0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.966+0000 7f71be7f6640 1 -- 172.21.15.134:0/3232737921 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71b002f040 con 0x7f71a80447e0 2024-04-24T02:14:10.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.966+0000 7f71be7f6640 1 --2- 172.21.15.134:0/3232737921 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f71b0019040 0x7f71b0019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:10.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.966+0000 7f71be7f6640 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595e5009a00 con 0x7f71b0019040 2024-04-24T02:14:10.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.967+0000 7f71bdff5640 1 --2- 172.21.15.134:0/3232737921 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f71b0019040 0x7f71b0019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:10.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.967+0000 7f71bdff5640 1 --2- 172.21.15.134:0/3232737921 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f71b0019040 0x7f71b0019930 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:10.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.967+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71b8074030 con 0x7f71b0019040 2024-04-24T02:14:10.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.967+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595e5009a00 con 0x5595e5000de0 2024-04-24T02:14:10.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.968+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71b8074030 con 0x5595e5000de0 2024-04-24T02:14:10.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.968+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595e5009a00 con 0x5595e5000de0 2024-04-24T02:14:10.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.968+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f71b8074030 con 0x5595e5000de0 2024-04-24T02:14:10.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.968+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595e5009a00 con 0x7f71b0019040 2024-04-24T02:14:10.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.968+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71b8074030 con 0x7f71b0019040 2024-04-24T02:14:10.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.968+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595e5009a00 con 0x7f71a80447e0 2024-04-24T02:14:10.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.968+0000 7f71be7f6640 1 -- 172.21.15.134:0/3232737921 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71b002f040 con 0x7f71a80447e0 2024-04-24T02:14:10.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.968+0000 7f71be7f6640 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595e5009a00 con 0x7f71a80447e0 2024-04-24T02:14:10.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.969+0000 7f71be7f6640 1 -- 172.21.15.134:0/3232737921 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71b002f040 con 0x7f71a80447e0 2024-04-24T02:14:10.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.969+0000 7f71be7f6640 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595e5009a00 con 0x5595e5007030 2024-04-24T02:14:10.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.969+0000 7f71bd7f4640 1 -- 172.21.15.134:0/3232737921 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71a8009050 con 0x5595e5007030 2024-04-24T02:14:10.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.969+0000 7f71bd7f4640 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595e5009a00 con 0x5595e5000de0 2024-04-24T02:14:10.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.969+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71b8074030 con 0x5595e5000de0 2024-04-24T02:14:10.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.969+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595e5009a00 con 0x7f71b0019040 2024-04-24T02:14:10.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.969+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71b8074030 con 0x7f71b0019040 2024-04-24T02:14:10.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.969+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595e5009a00 con 0x5595e5000de0 2024-04-24T02:14:10.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.970+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71b8074030 con 0x5595e5000de0 2024-04-24T02:14:10.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.970+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595e5009a00 con 0x7f71a80447e0 2024-04-24T02:14:10.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.970+0000 7f71be7f6640 1 -- 172.21.15.134:0/3232737921 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f71b002f040 con 0x7f71a80447e0 2024-04-24T02:14:10.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.970+0000 7f71be7f6640 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595e5009a00 con 0x5595e5007030 2024-04-24T02:14:10.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.970+0000 7f71bd7f4640 1 -- 172.21.15.134:0/3232737921 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71a8009050 con 0x5595e5007030 2024-04-24T02:14:10.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.970+0000 7f71bd7f4640 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595e5009a00 con 0x5595e5007030 2024-04-24T02:14:10.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.970+0000 7f71bd7f4640 1 -- 172.21.15.134:0/3232737921 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71a8009050 con 0x5595e5007030 2024-04-24T02:14:10.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.970+0000 7f71bd7f4640 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595e5009a00 con 0x7f71a80447e0 2024-04-24T02:14:10.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.971+0000 7f71be7f6640 1 -- 172.21.15.134:0/3232737921 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71b002f040 con 0x7f71a80447e0 2024-04-24T02:14:10.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.971+0000 7f71be7f6640 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595e5009a00 con 0x5595e5007030 2024-04-24T02:14:10.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.971+0000 7f71bd7f4640 1 -- 172.21.15.134:0/3232737921 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71a8009050 con 0x5595e5007030 2024-04-24T02:14:10.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.971+0000 7f71bd7f4640 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595e5009a00 con 0x5595e5007030 2024-04-24T02:14:10.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.971+0000 7f71bd7f4640 1 -- 172.21.15.134:0/3232737921 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71a8009050 con 0x5595e5007030 2024-04-24T02:14:10.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.971+0000 7f71bd7f4640 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595e5009a00 con 0x5595e5000de0 2024-04-24T02:14:10.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.971+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71b8074030 con 0x5595e5000de0 2024-04-24T02:14:10.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.971+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595e5009a00 con 0x5595e5000de0 2024-04-24T02:14:10.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.972+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=132b] v32'6 uv6 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f71b8074030 con 0x5595e5000de0 2024-04-24T02:14:10.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.972+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595e5009a00 con 0x7f71b0019040 2024-04-24T02:14:10.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.972+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71b8074030 con 0x7f71b0019040 2024-04-24T02:14:10.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.972+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595e5009a00 con 0x5595e5007030 2024-04-24T02:14:10.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.972+0000 7f71bd7f4640 1 -- 172.21.15.134:0/3232737921 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71a8009050 con 0x5595e5007030 2024-04-24T02:14:10.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.972+0000 7f71bd7f4640 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595e5009a00 con 0x7f71a80447e0 2024-04-24T02:14:10.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.973+0000 7f71be7f6640 1 -- 172.21.15.134:0/3232737921 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71b002f040 con 0x7f71a80447e0 2024-04-24T02:14:10.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.973+0000 7f71be7f6640 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595e5009a00 con 0x5595e5000de0 2024-04-24T02:14:10.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.973+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71b8074030 con 0x5595e5000de0 2024-04-24T02:14:10.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.973+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595e5009a00 con 0x7f71b0019040 2024-04-24T02:14:10.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.973+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71b8074030 con 0x7f71b0019040 2024-04-24T02:14:10.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.973+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595e5009a00 con 0x5595e5007030 2024-04-24T02:14:10.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.973+0000 7f71bd7f4640 1 -- 172.21.15.134:0/3232737921 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71a8009050 con 0x5595e5007030 2024-04-24T02:14:10.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.973+0000 7f71bd7f4640 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595e5009a00 con 0x7f71b0019040 2024-04-24T02:14:10.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.974+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71b8074030 con 0x7f71b0019040 2024-04-24T02:14:10.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.974+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595e5009a00 con 0x7f71a80447e0 2024-04-24T02:14:10.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.974+0000 7f71be7f6640 1 -- 172.21.15.134:0/3232737921 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71b002f040 con 0x7f71a80447e0 2024-04-24T02:14:10.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.974+0000 7f71be7f6640 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595e5009a00 con 0x5595e5007030 2024-04-24T02:14:10.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.974+0000 7f71bd7f4640 1 -- 172.21.15.134:0/3232737921 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71a8009050 con 0x5595e5007030 2024-04-24T02:14:10.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.974+0000 7f71bd7f4640 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595e5009a00 con 0x7f71a80447e0 2024-04-24T02:14:10.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.974+0000 7f71be7f6640 1 -- 172.21.15.134:0/3232737921 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71b002f040 con 0x7f71a80447e0 2024-04-24T02:14:10.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.974+0000 7f71be7f6640 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595e5009a00 con 0x5595e5000de0 2024-04-24T02:14:10.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.975+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f71b8074030 con 0x5595e5000de0 2024-04-24T02:14:10.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.975+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595e5009a00 con 0x7f71a80447e0 2024-04-24T02:14:10.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.975+0000 7f71be7f6640 1 -- 172.21.15.134:0/3232737921 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71b002f040 con 0x7f71a80447e0 2024-04-24T02:14:10.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.975+0000 7f71c2333800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:14:10.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.975+0000 7f71c2333800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:14:10.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.975+0000 7f71c2333800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:14:10.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.975+0000 7f71c2333800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:14:10.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.975+0000 7f71c2333800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:14:10.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.975+0000 7f71c2333800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:14:10.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.975+0000 7f71c2333800 20 rados->read ofs=0 len=0 2024-04-24T02:14:10.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.975+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595e5005c10 con 0x5595e5000de0 2024-04-24T02:14:10.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.975+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f71b8074030 con 0x5595e5000de0 2024-04-24T02:14:10.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.975+0000 7f71c2333800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:10.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.975+0000 7f71c2333800 20 rados->read ofs=0 len=0 2024-04-24T02:14:10.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.975+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595e50064b0 con 0x5595e5000de0 2024-04-24T02:14:10.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.975+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f71b8074030 con 0x5595e5000de0 2024-04-24T02:14:10.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.975+0000 7f71c2333800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:14:10.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.975+0000 7f71c2333800 20 rados->read ofs=0 len=0 2024-04-24T02:14:10.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.975+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595e50064b0 con 0x5595e5000de0 2024-04-24T02:14:10.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.976+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f71b8074030 con 0x5595e5000de0 2024-04-24T02:14:10.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.976+0000 7f71c2333800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:14:10.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.976+0000 7f71c2333800 20 zone default found 2024-04-24T02:14:10.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.976+0000 7f71c2333800 4 Realm: () 2024-04-24T02:14:10.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.976+0000 7f71c2333800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:14:10.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.976+0000 7f71c2333800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:14:10.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.976+0000 7f71c2333800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:14:10.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.976+0000 7f71c2333800 20 zonegroup default 2024-04-24T02:14:10.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.976+0000 7f71c2333800 20 rados->read ofs=0 len=0 2024-04-24T02:14:10.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.976+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595e5009e80 con 0x7f71b0019040 2024-04-24T02:14:10.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.976+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f71b8074030 con 0x7f71b0019040 2024-04-24T02:14:10.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.976+0000 7f71c2333800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:10.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.976+0000 7f71c2333800 20 rados->read ofs=0 len=0 2024-04-24T02:14:10.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.976+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595e500b8c0 con 0x5595e5007030 2024-04-24T02:14:10.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.977+0000 7f71bd7f4640 1 -- 172.21.15.134:0/3232737921 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f71a8009050 con 0x5595e5007030 2024-04-24T02:14:10.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.977+0000 7f71c2333800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:10.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.977+0000 7f71c2333800 20 rados->read ofs=0 len=0 2024-04-24T02:14:10.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.977+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595e500bd90 con 0x5595e5007030 2024-04-24T02:14:10.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.977+0000 7f71bd7f4640 1 -- 172.21.15.134:0/3232737921 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f71a8009050 con 0x5595e5007030 2024-04-24T02:14:10.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.977+0000 7f71c2333800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:10.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.977+0000 7f71c2333800 20 started sync module instance, tier type = 2024-04-24T02:14:10.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.977+0000 7f71c2333800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:14:10.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.977+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e500ad00 con 0x7f71a80447e0 2024-04-24T02:14:10.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.978+0000 7f71be7f6640 1 -- 172.21.15.134:0/3232737921 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(44 notify.0 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71b002f040 con 0x7f71a80447e0 2024-04-24T02:14:10.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.978+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94102280516128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e500ad00 con 0x7f71a80447e0 2024-04-24T02:14:10.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.978+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e500c870 con 0x5595e5000de0 2024-04-24T02:14:10.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.979+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71b8074030 con 0x5595e5000de0 2024-04-24T02:14:10.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.979+0000 7f71be7f6640 1 -- 172.21.15.134:0/3232737921 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94102280516128] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71b002f040 con 0x7f71a80447e0 2024-04-24T02:14:10.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.979+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94102280520544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e500ad00 con 0x5595e5000de0 2024-04-24T02:14:10.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.979+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e500d2f0 con 0x5595e5007030 2024-04-24T02:14:10.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.981+0000 7f71bd7f4640 1 -- 172.21.15.134:0/3232737921 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71a8009050 con 0x5595e5007030 2024-04-24T02:14:10.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.981+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94102280520544] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71b8074030 con 0x5595e5000de0 2024-04-24T02:14:10.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.981+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94102280513616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e500ac70 con 0x5595e5007030 2024-04-24T02:14:10.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.981+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e500e1b0 con 0x7f71a80447e0 2024-04-24T02:14:10.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.982+0000 7f71be7f6640 1 -- 172.21.15.134:0/3232737921 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(50 notify.3 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71b002f040 con 0x7f71a80447e0 2024-04-24T02:14:10.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.982+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94102280527616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e500ea50 con 0x7f71a80447e0 2024-04-24T02:14:10.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.982+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e500f520 con 0x5595e5000de0 2024-04-24T02:14:10.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.982+0000 7f71bd7f4640 1 -- 172.21.15.134:0/3232737921 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94102280513616] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71a8009050 con 0x5595e5007030 2024-04-24T02:14:10.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.983+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71b8074030 con 0x5595e5000de0 2024-04-24T02:14:10.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.983+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94102280531984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e500f4e0 con 0x5595e5000de0 2024-04-24T02:14:10.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.983+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e500ffa0 con 0x7f71b0019040 2024-04-24T02:14:10.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.983+0000 7f71be7f6640 1 -- 172.21.15.134:0/3232737921 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94102280527616] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71b002f040 con 0x7f71a80447e0 2024-04-24T02:14:10.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.984+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94102280531984] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71b8074030 con 0x5595e5000de0 2024-04-24T02:14:10.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.984+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(54 notify.5 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71b8074030 con 0x7f71b0019040 2024-04-24T02:14:10.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.984+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94102280525536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e500fab0 con 0x7f71b0019040 2024-04-24T02:14:10.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.984+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e5010840 con 0x7f71b0019040 2024-04-24T02:14:10.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.985+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94102280525536] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71b8074030 con 0x7f71b0019040 2024-04-24T02:14:10.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.985+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(56 notify.6 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71b8074030 con 0x7f71b0019040 2024-04-24T02:14:10.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.985+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94102280529312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e5010650 con 0x7f71b0019040 2024-04-24T02:14:10.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.985+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e5010ea0 con 0x7f71b0019040 2024-04-24T02:14:11.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.988+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94102280529312] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71b8074030 con 0x7f71b0019040 2024-04-24T02:14:11.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.988+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(58 notify.7 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71b8074030 con 0x7f71b0019040 2024-04-24T02:14:11.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.988+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94102280536960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e5010cb0 con 0x7f71b0019040 2024-04-24T02:14:11.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.988+0000 7f71c2333800 20 add_watcher() i=0 2024-04-24T02:14:11.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.988+0000 7f71c2333800 20 add_watcher() i=1 2024-04-24T02:14:11.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.988+0000 7f71c2333800 20 add_watcher() i=2 2024-04-24T02:14:11.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.988+0000 7f71c2333800 20 add_watcher() i=3 2024-04-24T02:14:11.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.988+0000 7f71c2333800 20 add_watcher() i=4 2024-04-24T02:14:11.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.988+0000 7f71c2333800 20 add_watcher() i=5 2024-04-24T02:14:11.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.988+0000 7f71c2333800 20 add_watcher() i=6 2024-04-24T02:14:11.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.989+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94102280536960] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71b8074030 con 0x7f71b0019040 2024-04-24T02:14:11.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.989+0000 7f71c2333800 20 add_watcher() i=7 2024-04-24T02:14:11.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.989+0000 7f71c2333800 2 all 8 watchers are set, enabling cache 2024-04-24T02:14:11.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.989+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595e5014220 con 0x5595e5000de0 2024-04-24T02:14:11.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.989+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f71b8074030 con 0x5595e5000de0 2024-04-24T02:14:11.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.989+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94102280538016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e5011710 con 0x5595e5000de0 2024-04-24T02:14:11.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.990+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94102280538016] v32'252 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f71b8074030 con 0x5595e5000de0 2024-04-24T02:14:11.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.990+0000 7f706f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:14:11.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.990+0000 7f71c2333800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:14:11.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.990+0000 7f71c2333800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:14:11.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.990+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e5013f30 con 0x5595e5000de0 2024-04-24T02:14:11.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.992+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'59 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f71b8074030 con 0x5595e5000de0 2024-04-24T02:14:11.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.992+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e501d2b0 con 0x7f71b0019040 2024-04-24T02:14:11.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.993+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'36 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f71b8074030 con 0x7f71b0019040 2024-04-24T02:14:11.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.993+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e501d2b0 con 0x5595e5007030 2024-04-24T02:14:11.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.994+0000 7f71bd7f4640 1 -- 172.21.15.134:0/3232737921 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f71a8009050 con 0x5595e5007030 2024-04-24T02:14:11.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.994+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e501d650 con 0x5595e5000de0 2024-04-24T02:14:11.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.995+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'253 uv169 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f71b8074030 con 0x5595e5000de0 2024-04-24T02:14:11.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.995+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e501d650 con 0x7f71a80447e0 2024-04-24T02:14:11.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.996+0000 7f71be7f6640 1 -- 172.21.15.134:0/3232737921 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'85 uv58 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f71b002f040 con 0x7f71a80447e0 2024-04-24T02:14:11.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.996+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e501da90 con 0x5595e5007030 2024-04-24T02:14:11.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.997+0000 7f71bd7f4640 1 -- 172.21.15.134:0/3232737921 <== osd.3 v2:172.21.15.134:6801/3585115521 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'66 uv48 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f71a8009050 con 0x5595e5007030 2024-04-24T02:14:11.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.997+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e501dec0 con 0x5595e5000de0 2024-04-24T02:14:11.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.998+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f71b8074030 con 0x5595e5000de0 2024-04-24T02:14:11.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.998+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e501dec0 con 0x7f71b0019040 2024-04-24T02:14:11.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.999+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'58 uv41 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f71b8074030 con 0x7f71b0019040 2024-04-24T02:14:11.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:10.999+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e501dec0 con 0x7f71a80447e0 2024-04-24T02:14:11.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.000+0000 7f71be7f6640 1 -- 172.21.15.134:0/3232737921 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f71b002f040 con 0x7f71a80447e0 2024-04-24T02:14:11.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.000+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e501e4d0 con 0x5595e5007030 2024-04-24T02:14:11.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.001+0000 7f71bd7f4640 1 -- 172.21.15.134:0/3232737921 <== osd.3 v2:172.21.15.134:6801/3585115521 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f71a8009050 con 0x5595e5007030 2024-04-24T02:14:11.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.001+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e501e4d0 con 0x7f71a80447e0 2024-04-24T02:14:11.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.002+0000 7f71be7f6640 1 -- 172.21.15.134:0/3232737921 <== osd.2 v2:172.21.15.134:6800/214480313 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'86 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f71b002f040 con 0x7f71a80447e0 2024-04-24T02:14:11.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.002+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e501ea40 con 0x7f71b0019040 2024-04-24T02:14:11.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.003+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'35 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f71b8074030 con 0x7f71b0019040 2024-04-24T02:14:11.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.003+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e501ea40 con 0x7f71a80447e0 2024-04-24T02:14:11.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.004+0000 7f71be7f6640 1 -- 172.21.15.134:0/3232737921 <== osd.2 v2:172.21.15.134:6800/214480313 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f71b002f040 con 0x7f71a80447e0 2024-04-24T02:14:11.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.004+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e501eef0 con 0x7f71b0019040 2024-04-24T02:14:11.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.005+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'69 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f71b8074030 con 0x7f71b0019040 2024-04-24T02:14:11.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.005+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e501eef0 con 0x5595e5000de0 2024-04-24T02:14:11.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.006+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'254 uv171 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f71b8074030 con 0x5595e5000de0 2024-04-24T02:14:11.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.006+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e501eef0 con 0x5595e5007030 2024-04-24T02:14:11.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.007+0000 7f71bd7f4640 1 -- 172.21.15.134:0/3232737921 <== osd.3 v2:172.21.15.134:6801/3585115521 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'77 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f71a8009050 con 0x5595e5007030 2024-04-24T02:14:11.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.007+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e501eef0 con 0x7f71a80447e0 2024-04-24T02:14:11.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.008+0000 7f71be7f6640 1 -- 172.21.15.134:0/3232737921 <== osd.2 v2:172.21.15.134:6800/214480313 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'87 uv63 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f71b002f040 con 0x7f71a80447e0 2024-04-24T02:14:11.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.008+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e501eef0 con 0x5595e5007030 2024-04-24T02:14:11.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.009+0000 7f71bd7f4640 1 -- 172.21.15.134:0/3232737921 <== osd.3 v2:172.21.15.134:6801/3585115521 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'42 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f71a8009050 con 0x5595e5007030 2024-04-24T02:14:11.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.009+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e501eef0 con 0x5595e5000de0 2024-04-24T02:14:11.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.010+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f71b8074030 con 0x5595e5000de0 2024-04-24T02:14:11.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.010+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e501eef0 con 0x5595e5000de0 2024-04-24T02:14:11.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.012+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'255 uv173 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f71b8074030 con 0x5595e5000de0 2024-04-24T02:14:11.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.012+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e501eef0 con 0x5595e5007030 2024-04-24T02:14:11.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.013+0000 7f71bd7f4640 1 -- 172.21.15.134:0/3232737921 <== osd.3 v2:172.21.15.134:6801/3585115521 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'78 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f71a8009050 con 0x5595e5007030 2024-04-24T02:14:11.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.013+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e501eef0 con 0x7f71a80447e0 2024-04-24T02:14:11.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.014+0000 7f71be7f6640 1 -- 172.21.15.134:0/3232737921 <== osd.2 v2:172.21.15.134:6800/214480313 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'45 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f71b002f040 con 0x7f71a80447e0 2024-04-24T02:14:11.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.014+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e501eef0 con 0x5595e5007030 2024-04-24T02:14:11.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.015+0000 7f71bd7f4640 1 -- 172.21.15.134:0/3232737921 <== osd.3 v2:172.21.15.134:6801/3585115521 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f71a8009050 con 0x5595e5007030 2024-04-24T02:14:11.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.015+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e501eef0 con 0x5595e5007030 2024-04-24T02:14:11.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.016+0000 7f71bd7f4640 1 -- 172.21.15.134:0/3232737921 <== osd.3 v2:172.21.15.134:6801/3585115521 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'47 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f71a8009050 con 0x5595e5007030 2024-04-24T02:14:11.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.016+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e501eef0 con 0x5595e5007030 2024-04-24T02:14:11.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.016+0000 7f71bd7f4640 1 -- 172.21.15.134:0/3232737921 <== osd.3 v2:172.21.15.134:6801/3585115521 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f71a8009050 con 0x5595e5007030 2024-04-24T02:14:11.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.016+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e501eef0 con 0x5595e5007030 2024-04-24T02:14:11.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.017+0000 7f71bd7f4640 1 -- 172.21.15.134:0/3232737921 <== osd.3 v2:172.21.15.134:6801/3585115521 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'67 uv50 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f71a8009050 con 0x5595e5007030 2024-04-24T02:14:11.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.017+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e501eef0 con 0x7f71b0019040 2024-04-24T02:14:11.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.019+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f71b8074030 con 0x7f71b0019040 2024-04-24T02:14:11.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.019+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e501eef0 con 0x5595e5007030 2024-04-24T02:14:11.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.020+0000 7f71bd7f4640 1 -- 172.21.15.134:0/3232737921 <== osd.3 v2:172.21.15.134:6801/3585115521 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'42 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f71a8009050 con 0x5595e5007030 2024-04-24T02:14:11.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.020+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e501eef0 con 0x7f71b0019040 2024-04-24T02:14:11.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.021+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'59 uv43 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f71b8074030 con 0x7f71b0019040 2024-04-24T02:14:11.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.021+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e501eef0 con 0x5595e5007030 2024-04-24T02:14:11.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.022+0000 7f71bd7f4640 1 -- 172.21.15.134:0/3232737921 <== osd.3 v2:172.21.15.134:6801/3585115521 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'79 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f71a8009050 con 0x5595e5007030 2024-04-24T02:14:11.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.022+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e501eef0 con 0x7f71b0019040 2024-04-24T02:14:11.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.023+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.0 v2:172.21.15.104:6800/2419146313 20 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'70 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f71b8074030 con 0x7f71b0019040 2024-04-24T02:14:11.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.023+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e501eef0 con 0x7f71a80447e0 2024-04-24T02:14:11.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.024+0000 7f71be7f6640 1 -- 172.21.15.134:0/3232737921 <== osd.2 v2:172.21.15.134:6800/214480313 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f71b002f040 con 0x7f71a80447e0 2024-04-24T02:14:11.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.024+0000 7f706e7fc640 20 reqs_thread_entry: start 2024-04-24T02:14:11.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.025+0000 7f71c2333800 20 init_complete bucket index max shards: 11 2024-04-24T02:14:11.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.025+0000 7f71c2333800 20 Filter name: none 2024-04-24T02:14:11.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.025+0000 7f6fdffff640 20 reqs_thread_entry: start 2024-04-24T02:14:11.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.025+0000 7f71c2333800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-04-24T02:14:11.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.025+0000 7f71c2333800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.025+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:94 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595e5049db0 con 0x7f71b0019040 2024-04-24T02:14:11.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.025+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.0 v2:172.21.15.104:6800/2419146313 21 ==== osd_op_reply(94 system_user [call out=48b,read 0~349 out=349b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 239+0+472 (crc 0 0 0) 0x7f71b8074030 con 0x7f71b0019040 2024-04-24T02:14:11.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.025+0000 7f71c2333800 20 rados_obj.operate() r=0 bl.length=349 2024-04-24T02:14:11.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.025+0000 7f71c2333800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x13 2024-04-24T02:14:11.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.025+0000 7f71c2333800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-04-24T02:14:11.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.025+0000 7f71c2333800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:14:11.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.026+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:95 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595e5049db0 con 0x7f71b0019040 2024-04-24T02:14:11.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.026+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.0 v2:172.21.15.104:6800/2419146313 22 ==== osd_op_reply(95 system_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7f71b8074030 con 0x7f71b0019040 2024-04-24T02:14:11.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.026+0000 7f71c2333800 10 removing key index: system_akey 2024-04-24T02:14:11.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.026+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:96 8.0 8:01223cbf:users.keys::system_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e5049db0 con 0x5595e5007030 2024-04-24T02:14:11.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.027+0000 7f71bd7f4640 1 -- 172.21.15.134:0/3232737921 <== osd.3 v2:172.21.15.134:6801/3585115521 26 ==== osd_op_reply(96 system_akey [delete] v32'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f71a8009050 con 0x5595e5007030 2024-04-24T02:14:11.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.027+0000 7f71c2333800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-04-24T02:14:11.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.027+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [notify cookie 94102280778592 in=173b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595e504cd60 con 0x5595e5000de0 2024-04-24T02:14:11.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.027+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== watch-notify(notify (1) cookie 94102280520544 notify 137438953495 ret 0) ==== 203+0+0 (crc 0 0 0) 0x5595e501e520 con 0x5595e5000de0 2024-04-24T02:14:11.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.027+0000 7f70a17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953495 cookie 94102280520544 notifier 4844 bl.length()=161 2024-04-24T02:14:11.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.027+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.1 v2:172.21.15.134:6804/1487076214 30 ==== osd_op_reply(97 notify.1 [notify cookie 94102280778592 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f71b8074030 con 0x5595e5000de0 2024-04-24T02:14:11.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.027+0000 7f70a17fa640 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f7080003d60 con 0x5595e5000de0 2024-04-24T02:14:11.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.027+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.1 v2:172.21.15.134:6804/1487076214 31 ==== osd_op_reply(98 notify.1 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71b8074030 con 0x5595e5000de0 2024-04-24T02:14:11.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.027+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.1 v2:172.21.15.134:6804/1487076214 32 ==== watch-notify(notify_complete (2) cookie 94102280778592 notify 137438953495 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f71b808be30 con 0x5595e5000de0 2024-04-24T02:14:11.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.027+0000 7f71c2333800 10 removing email index: 2024-04-24T02:14:11.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.027+0000 7f71c2333800 10 removing user buckets index 2024-04-24T02:14:11.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.027+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:99 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e504a7b0 con 0x7f71b0019040 2024-04-24T02:14:11.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.028+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.0 v2:172.21.15.104:6800/2419146313 23 ==== osd_op_reply(99 system_user.buckets [delete] v32'2 uv1 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7f71b8074030 con 0x7f71b0019040 2024-04-24T02:14:11.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.028+0000 7f71c2333800 10 removing user index: system_user 2024-04-24T02:14:11.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.028+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:100 8.1e 8:78ce4db0:users.uid::system_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e504c320 con 0x7f71b0019040 2024-04-24T02:14:11.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.029+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.0 v2:172.21.15.104:6800/2419146313 24 ==== osd_op_reply(100 system_user [call,call,delete] v32'3 uv3 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f71b8074030 con 0x7f71b0019040 2024-04-24T02:14:11.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.029+0000 7f71c2333800 10 removing default.rgw.meta+users.uid+system_user from cache 2024-04-24T02:14:11.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.029+0000 7f71c2333800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-04-24T02:14:11.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.029+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94102280774400 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595e504bbe0 con 0x7f71a80447e0 2024-04-24T02:14:11.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.030+0000 7f71be7f6640 1 -- 172.21.15.134:0/3232737921 <== osd.2 v2:172.21.15.134:6800/214480313 21 ==== watch-notify(notify (1) cookie 94102280516128 notify 137438953496 ret 0) ==== 202+0+0 (crc 0 0 0) 0x5595e5013ef0 con 0x7f71a80447e0 2024-04-24T02:14:11.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.030+0000 7f70a0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953496 cookie 94102280516128 notifier 4844 bl.length()=160 2024-04-24T02:14:11.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.030+0000 7f71be7f6640 1 -- 172.21.15.134:0/3232737921 <== osd.2 v2:172.21.15.134:6800/214480313 22 ==== osd_op_reply(101 notify.0 [notify cookie 94102280774400 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f71b002f040 con 0x7f71a80447e0 2024-04-24T02:14:11.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.030+0000 7f70a0ff9640 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6fe80032c0 con 0x7f71a80447e0 2024-04-24T02:14:11.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.030+0000 7f71be7f6640 1 -- 172.21.15.134:0/3232737921 <== osd.2 v2:172.21.15.134:6800/214480313 23 ==== osd_op_reply(102 notify.0 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71b002f040 con 0x7f71a80447e0 2024-04-24T02:14:11.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.030+0000 7f71be7f6640 1 -- 172.21.15.134:0/3232737921 <== osd.2 v2:172.21.15.134:6800/214480313 24 ==== watch-notify(notify_complete (2) cookie 94102280774400 notify 137438953496 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5595e501e870 con 0x7f71a80447e0 2024-04-24T02:14:11.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.031+0000 7f706f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:14:11.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.031+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94102280538016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e501c6a0 con 0x5595e5000de0 2024-04-24T02:14:11.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.032+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.1 v2:172.21.15.134:6804/1487076214 33 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94102280538016] v32'256 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f71b8074030 con 0x5595e5000de0 2024-04-24T02:14:11.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.032+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94102280516128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e50107a0 con 0x7f71a80447e0 2024-04-24T02:14:11.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.033+0000 7f71be7f6640 1 -- 172.21.15.134:0/3232737921 <== osd.2 v2:172.21.15.134:6800/214480313 25 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94102280516128] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71b002f040 con 0x7f71a80447e0 2024-04-24T02:14:11.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.033+0000 7f71c2333800 20 remove_watcher() i=0 2024-04-24T02:14:11.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.033+0000 7f71c2333800 2 removed watcher, disabling cache 2024-04-24T02:14:11.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.033+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94102280520544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e50107a0 con 0x5595e5000de0 2024-04-24T02:14:11.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.034+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.1 v2:172.21.15.134:6804/1487076214 34 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94102280520544] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71b8074030 con 0x5595e5000de0 2024-04-24T02:14:11.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.034+0000 7f71c2333800 20 remove_watcher() i=1 2024-04-24T02:14:11.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.034+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94102280513616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e500c360 con 0x5595e5007030 2024-04-24T02:14:11.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.035+0000 7f71bd7f4640 1 -- 172.21.15.134:0/3232737921 <== osd.3 v2:172.21.15.134:6801/3585115521 27 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94102280513616] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71a8009050 con 0x5595e5007030 2024-04-24T02:14:11.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.035+0000 7f71c2333800 20 remove_watcher() i=2 2024-04-24T02:14:11.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.035+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94102280527616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e50107a0 con 0x7f71a80447e0 2024-04-24T02:14:11.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.036+0000 7f71be7f6640 1 -- 172.21.15.134:0/3232737921 <== osd.2 v2:172.21.15.134:6800/214480313 26 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94102280527616] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71b002f040 con 0x7f71a80447e0 2024-04-24T02:14:11.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.036+0000 7f71c2333800 20 remove_watcher() i=3 2024-04-24T02:14:11.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.036+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94102280531984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e500a850 con 0x5595e5000de0 2024-04-24T02:14:11.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.037+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.1 v2:172.21.15.134:6804/1487076214 35 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94102280531984] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71b8074030 con 0x5595e5000de0 2024-04-24T02:14:11.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.037+0000 7f71c2333800 20 remove_watcher() i=4 2024-04-24T02:14:11.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.037+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94102280525536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e500c360 con 0x7f71b0019040 2024-04-24T02:14:11.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.038+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.0 v2:172.21.15.104:6800/2419146313 25 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94102280525536] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71b8074030 con 0x7f71b0019040 2024-04-24T02:14:11.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.038+0000 7f71c2333800 20 remove_watcher() i=5 2024-04-24T02:14:11.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.038+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94102280529312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e50107a0 con 0x7f71b0019040 2024-04-24T02:14:11.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.039+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.0 v2:172.21.15.104:6800/2419146313 26 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94102280529312] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71b8074030 con 0x7f71b0019040 2024-04-24T02:14:11.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.039+0000 7f71c2333800 20 remove_watcher() i=6 2024-04-24T02:14:11.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.039+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94102280536960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595e500a850 con 0x7f71b0019040 2024-04-24T02:14:11.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.040+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 <== osd.0 v2:172.21.15.104:6800/2419146313 27 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94102280536960] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71b8074030 con 0x7f71b0019040 2024-04-24T02:14:11.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.040+0000 7f71c2333800 20 remove_watcher() i=7 2024-04-24T02:14:11.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.040+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f71b0019040 msgr2=0x7f71b0019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.040+0000 7f71c2333800 1 --2- 172.21.15.134:0/3232737921 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f71b0019040 0x7f71b0019930 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.040+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5595e5000de0 msgr2=0x5595e50032a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.040+0000 7f71c2333800 1 --2- 172.21.15.134:0/3232737921 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5595e5000de0 0x5595e50032a0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.040+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f71a80447e0 msgr2=0x7f71a80234d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.040+0000 7f71c2333800 1 --2- 172.21.15.134:0/3232737921 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f71a80447e0 0x7f71a80234d0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.040+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5595e5007030 msgr2=0x5595e5009420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.040+0000 7f71c2333800 1 --2- 172.21.15.134:0/3232737921 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5595e5007030 0x5595e5009420 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.040+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7088036950 msgr2=0x7f7088038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.040+0000 7f71c2333800 1 --2- 172.21.15.134:0/3232737921 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7088036950 0x7f7088038e10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f71b000f010 tx=0x7f71b000c040 comp rx=0 tx=0).stop 2024-04-24T02:14:11.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.040+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595e4fede50 msgr2=0x5595e4ff54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.040+0000 7f71bdff5640 1 -- 172.21.15.134:0/3232737921 reap_dead start 2024-04-24T02:14:11.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.040+0000 7f71c2333800 1 --2- 172.21.15.134:0/3232737921 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595e4fede50 0x5595e4ff54e0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f71a8019d20 tx=0x7f71a804cda0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.040+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 shutdown_connections 2024-04-24T02:14:11.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.040+0000 7f71c2333800 1 --2- 172.21.15.134:0/3232737921 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595e4fede50 0x5595e4ff54e0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.040+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 >> 172.21.15.134:0/3232737921 conn(0x5595e4fea1b0 msgr2=0x5595e4fe7810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:11.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.040+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 shutdown_connections 2024-04-24T02:14:11.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.040+0000 7f71c2333800 1 -- 172.21.15.134:0/3232737921 wait complete. 2024-04-24T02:14:11.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.041+0000 7f71c2333800 1 -- 172.21.15.134:0/2402278428 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7098036950 msgr2=0x7f7098038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.041+0000 7f71c2333800 1 --2- 172.21.15.134:0/2402278428 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7098036950 0x7f7098038e10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x5595e4fd0b80 tx=0x7f71b0000f90 comp rx=0 tx=0).stop 2024-04-24T02:14:11.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.041+0000 7f71c2333800 1 -- 172.21.15.134:0/2402278428 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595e4fe0b10 msgr2=0x5595e4fe0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.041+0000 7f71c2333800 1 --2- 172.21.15.134:0/2402278428 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595e4fe0b10 0x5595e4fe0f30 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f71a8001ed0 tx=0x7f71a800d7a0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.041+0000 7f71c2333800 1 -- 172.21.15.134:0/2402278428 shutdown_connections 2024-04-24T02:14:11.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.041+0000 7f71c2333800 1 --2- 172.21.15.134:0/2402278428 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7098036950 0x7f7098038e10 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.041+0000 7f71c2333800 1 --2- 172.21.15.134:0/2402278428 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595e4fe0b10 0x5595e4fe0f30 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.041+0000 7f71c2333800 1 -- 172.21.15.134:0/2402278428 >> 172.21.15.134:0/2402278428 conn(0x5595e4fd4bb0 msgr2=0x5595e4fd4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:11.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.041+0000 7f71c2333800 1 -- 172.21.15.134:0/2402278428 shutdown_connections 2024-04-24T02:14:11.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.041+0000 7f71c2333800 1 -- 172.21.15.134:0/2402278428 wait complete. 2024-04-24T02:14:11.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.041+0000 7f71c2333800 1 -- 172.21.15.134:0/1171706978 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5595e4fcd5e0 msgr2=0x5595e4fcf9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.041+0000 7f71c2333800 1 --2- 172.21.15.134:0/1171706978 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5595e4fcd5e0 0x5595e4fcf9d0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.041+0000 7f71c2333800 1 -- 172.21.15.134:0/1171706978 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f70a4036950 msgr2=0x7f70a4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.041+0000 7f71c2333800 1 --2- 172.21.15.134:0/1171706978 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f70a4036950 0x7f70a4038e10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f71a8000f60 tx=0x7f71a80012b0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.041+0000 7f71c2333800 1 -- 172.21.15.134:0/1171706978 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595e4eccf80 msgr2=0x5595e4fc83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.041+0000 7f71c2333800 1 --2- 172.21.15.134:0/1171706978 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595e4eccf80 0x5595e4fc83b0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f71b80448a0 tx=0x7f71b8003330 comp rx=0 tx=0).stop 2024-04-24T02:14:11.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.041+0000 7f71c2333800 1 -- 172.21.15.134:0/1171706978 shutdown_connections 2024-04-24T02:14:11.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.041+0000 7f71c2333800 1 --2- 172.21.15.134:0/1171706978 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5595e4fcd5e0 0x5595e4fcf9d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.041+0000 7f71c2333800 1 --2- 172.21.15.134:0/1171706978 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f70a4036950 0x7f70a4038e10 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.041+0000 7f71c2333800 1 --2- 172.21.15.134:0/1171706978 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595e4eccf80 0x5595e4fc83b0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.041+0000 7f71c2333800 1 -- 172.21.15.134:0/1171706978 >> 172.21.15.134:0/1171706978 conn(0x5595e4ec7380 msgr2=0x5595e4fb7620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:11.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.041+0000 7f71c2333800 1 -- 172.21.15.134:0/1171706978 shutdown_connections 2024-04-24T02:14:11.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.041+0000 7f71c2333800 1 -- 172.21.15.134:0/1171706978 wait complete. 2024-04-24T02:14:11.051 ERROR:root:None 2024-04-24T02:14:11.051 ERROR:root:0 2024-04-24T02:14:11.051 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-04-24T02:14:11.051 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-04-24T02:14:11.051 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid a_user --display-name 'True Admin User' --access-key true_admin_akey --secret true_admin_skey --caps user-info-without-keys=read --admin 2024-04-24T02:14:11.143 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:14:11.143 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:14:11.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.142+0000 7fa5acf2e800 1 Processor -- start 2024-04-24T02:14:11.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.142+0000 7fa5acf2e800 1 -- start start 2024-04-24T02:14:11.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.142+0000 7fa5acf2e800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x560baa901850 0x560baa903c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.142+0000 7fa5acf2e800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560baa7bfd40 con 0x560baa904180 2024-04-24T02:14:11.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.142+0000 7fa5acf2e800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x560baa7924d0 con 0x560baa901850 2024-04-24T02:14:11.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.143+0000 7fa5a8c67640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x560baa901850 0x560baa903c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.143+0000 7fa5a8c67640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x560baa901850 0x560baa903c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43784/0 (socket says 172.21.15.134:43784) 2024-04-24T02:14:11.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.143+0000 7fa5a3fff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x560baa904180 0x560baa906570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:46468/0 (socket says 172.21.15.134:46468) 2024-04-24T02:14:11.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.143+0000 7fa5a8c67640 1 -- 172.21.15.134:0/323573496 learned_addr learned my addr 172.21.15.134:0/323573496 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:11.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.143+0000 7fa5a8c67640 1 -- 172.21.15.134:0/323573496 >> v1:172.21.15.104:6789/0 conn(0x560baa904180 legacy=0x560baa906570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.143+0000 7fa5a37fe640 1 -- 172.21.15.134:0/323573496 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3713137340 0 0) 0x560baa7bfd40 con 0x560baa904180 2024-04-24T02:14:11.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.143+0000 7fa5a8c67640 1 -- 172.21.15.134:0/323573496 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560baa7be590 con 0x560baa901850 2024-04-24T02:14:11.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.145+0000 7fa5a8c67640 1 --2- 172.21.15.134:0/323573496 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560baa901850 0x560baa903c40 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fa59c00a520 tx=0x7fa59c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37c9e66a7145d6cf server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.145+0000 7fa5a37fe640 1 -- 172.21.15.134:0/323573496 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa59c057070 con 0x560baa901850 2024-04-24T02:14:11.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.145+0000 7fa5a37fe640 1 -- 172.21.15.134:0/323573496 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa59c052570 con 0x560baa901850 2024-04-24T02:14:11.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.145+0000 7fa5a37fe640 1 -- 172.21.15.134:0/323573496 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa59c04ae60 con 0x560baa901850 2024-04-24T02:14:11.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.145+0000 7fa5acf2e800 1 -- 172.21.15.134:0/323573496 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560baa901850 msgr2=0x560baa903c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.145+0000 7fa5acf2e800 1 --2- 172.21.15.134:0/323573496 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560baa901850 0x560baa903c40 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fa59c00a520 tx=0x7fa59c01d010 comp rx=0 tx=0).stop 2024-04-24T02:14:11.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.145+0000 7fa5acf2e800 1 -- 172.21.15.134:0/323573496 shutdown_connections 2024-04-24T02:14:11.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.145+0000 7fa5acf2e800 1 --2- 172.21.15.134:0/323573496 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560baa901850 0x560baa903c40 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.145+0000 7fa5acf2e800 1 -- 172.21.15.134:0/323573496 >> 172.21.15.134:0/323573496 conn(0x560baa8fb320 msgr2=0x560baa8fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:11.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.145+0000 7fa5acf2e800 1 -- 172.21.15.134:0/323573496 shutdown_connections 2024-04-24T02:14:11.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.145+0000 7fa5acf2e800 1 -- 172.21.15.134:0/323573496 wait complete. 2024-04-24T02:14:11.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.157+0000 7fa5acf2e800 1 Processor -- start 2024-04-24T02:14:11.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.157+0000 7fa5acf2e800 1 -- start start 2024-04-24T02:14:11.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.157+0000 7fa5acf2e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560baa901850 0x560baa9f1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.157+0000 7fa5acf2e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560baa84c360 con 0x560baa901850 2024-04-24T02:14:11.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.158+0000 7fa5a8c67640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560baa901850 0x560baa9f1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.158+0000 7fa5a8c67640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560baa901850 0x560baa9f1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43796/0 (socket says 172.21.15.134:43796) 2024-04-24T02:14:11.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.158+0000 7fa5a8c67640 1 -- 172.21.15.134:0/2502293823 learned_addr learned my addr 172.21.15.134:0/2502293823 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:11.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.158+0000 7fa5a8c67640 1 -- 172.21.15.134:0/2502293823 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560baa9f2400 con 0x560baa901850 2024-04-24T02:14:11.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.158+0000 7fa5a8c67640 1 --2- 172.21.15.134:0/2502293823 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560baa901850 0x560baa9f1e30 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fa59c055040 tx=0x7fa59c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8afb62dcd080486 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.158+0000 7fa496e05640 1 -- 172.21.15.134:0/2502293823 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa59c062070 con 0x560baa901850 2024-04-24T02:14:11.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.158+0000 7fa496e05640 1 -- 172.21.15.134:0/2502293823 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa59c052720 con 0x560baa901850 2024-04-24T02:14:11.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.158+0000 7fa496e05640 1 -- 172.21.15.134:0/2502293823 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa59c057040 con 0x560baa901850 2024-04-24T02:14:11.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.159+0000 7fa5acf2e800 1 -- 172.21.15.134:0/2502293823 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560baa901850 msgr2=0x560baa9f1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.159+0000 7fa5acf2e800 1 --2- 172.21.15.134:0/2502293823 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560baa901850 0x560baa9f1e30 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fa59c055040 tx=0x7fa59c04c000 comp rx=0 tx=0).stop 2024-04-24T02:14:11.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.159+0000 7fa5acf2e800 1 -- 172.21.15.134:0/2502293823 shutdown_connections 2024-04-24T02:14:11.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.159+0000 7fa5acf2e800 1 --2- 172.21.15.134:0/2502293823 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560baa901850 0x560baa9f1e30 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.159+0000 7fa5acf2e800 1 -- 172.21.15.134:0/2502293823 >> 172.21.15.134:0/2502293823 conn(0x560baa8fb320 msgr2=0x560baa9ed750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:11.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.159+0000 7fa5acf2e800 1 -- 172.21.15.134:0/2502293823 shutdown_connections 2024-04-24T02:14:11.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.159+0000 7fa5acf2e800 1 -- 172.21.15.134:0/2502293823 wait complete. 2024-04-24T02:14:11.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.159+0000 7fa5acf2e800 1 Processor -- start 2024-04-24T02:14:11.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.159+0000 7fa5acf2e800 1 -- start start 2024-04-24T02:14:11.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.160+0000 7fa5acf2e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560baa901850 0x560baa901190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.160+0000 7fa5acf2e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560baa907f90 con 0x560baa901850 2024-04-24T02:14:11.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.160+0000 7fa5a8c67640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560baa901850 0x560baa901190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.160+0000 7fa5a8c67640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560baa901850 0x560baa901190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43810/0 (socket says 172.21.15.134:43810) 2024-04-24T02:14:11.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.160+0000 7fa5a8c67640 1 -- 172.21.15.134:0/188421246 learned_addr learned my addr 172.21.15.134:0/188421246 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:11.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.160+0000 7fa5a8c67640 1 -- 172.21.15.134:0/188421246 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560baa8ff880 con 0x560baa901850 2024-04-24T02:14:11.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.160+0000 7fa5a8c67640 1 --2- 172.21.15.134:0/188421246 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560baa901850 0x560baa901190 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fa59c0057e0 tx=0x7fa59c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.160+0000 7fa495602640 1 -- 172.21.15.134:0/188421246 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa59c057050 con 0x560baa901850 2024-04-24T02:14:11.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.160+0000 7fa495602640 1 -- 172.21.15.134:0/188421246 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa59c067450 con 0x560baa901850 2024-04-24T02:14:11.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.160+0000 7fa5acf2e800 1 -- 172.21.15.134:0/188421246 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560baa8ffb10 con 0x560baa901850 2024-04-24T02:14:11.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.160+0000 7fa495602640 1 -- 172.21.15.134:0/188421246 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa59c062040 con 0x560baa901850 2024-04-24T02:14:11.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.160+0000 7fa5acf2e800 1 -- 172.21.15.134:0/188421246 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560baa900090 con 0x560baa901850 2024-04-24T02:14:11.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.161+0000 7fa495602640 1 -- 172.21.15.134:0/188421246 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa59c067750 con 0x560baa901850 2024-04-24T02:14:11.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.161+0000 7fa495602640 1 --2- 172.21.15.134:0/188421246 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa490036950 0x7fa490038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.161+0000 7fa495602640 1 -- 172.21.15.134:0/188421246 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fa59c08e0b0 con 0x560baa901850 2024-04-24T02:14:11.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.161+0000 7fa5a3fff640 1 --2- 172.21.15.134:0/188421246 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa490036950 0x7fa490038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.161+0000 7fa5acf2e800 1 --2- 172.21.15.134:0/188421246 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560baa904180 0x560baaa02e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.161+0000 7fa5acf2e800 1 -- 172.21.15.134:0/188421246 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560baaa03380 con 0x560baa904180 2024-04-24T02:14:11.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.162+0000 7fa5a9468640 1 --2- 172.21.15.134:0/188421246 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560baa904180 0x560baaa02e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.162+0000 7fa5a3fff640 1 --2- 172.21.15.134:0/188421246 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa490036950 0x7fa490038e10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa594000c00 tx=0x7fa5940013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.162+0000 7fa5a9468640 1 --2- 172.21.15.134:0/188421246 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560baa904180 0x560baaa02e40 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.162+0000 7fa5a9468640 1 -- 172.21.15.134:0/188421246 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa5a400a4a0 con 0x560baa904180 2024-04-24T02:14:11.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.162+0000 7fa5acf2e800 1 -- 172.21.15.134:0/188421246 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560baaa03bd0 con 0x560baa904180 2024-04-24T02:14:11.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.162+0000 7fa5a9468640 1 -- 172.21.15.134:0/188421246 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa5a400a4a0 con 0x560baa904180 2024-04-24T02:14:11.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.162+0000 7fa5acf2e800 1 -- 172.21.15.134:0/188421246 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560baaa04f80 con 0x560baa904180 2024-04-24T02:14:11.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.163+0000 7fa5a9468640 1 -- 172.21.15.134:0/188421246 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa5a400a4a0 con 0x560baa904180 2024-04-24T02:14:11.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.163+0000 7fa5acf2e800 1 -- 172.21.15.134:0/188421246 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560baaa04420 con 0x560baa904180 2024-04-24T02:14:11.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.163+0000 7fa5a9468640 1 -- 172.21.15.134:0/188421246 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa5a400a4a0 con 0x560baa904180 2024-04-24T02:14:11.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.163+0000 7fa5acf2e800 1 -- 172.21.15.134:0/188421246 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560baaa04870 con 0x560baa904180 2024-04-24T02:14:11.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.163+0000 7fa5a9468640 1 -- 172.21.15.134:0/188421246 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa5a400a4a0 con 0x560baa904180 2024-04-24T02:14:11.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.163+0000 7fa5acf2e800 1 Processor -- start 2024-04-24T02:14:11.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.164+0000 7fa5acf2e800 1 -- start start 2024-04-24T02:14:11.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.164+0000 7fa5acf2e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560baaa13fd0 0x560baaa143f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.164+0000 7fa5acf2e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560baa9016d0 con 0x560baaa13fd0 2024-04-24T02:14:11.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.164+0000 7fa5a3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560baaa13fd0 0x560baaa143f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.164+0000 7fa5a3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560baaa13fd0 0x560baaa143f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43818/0 (socket says 172.21.15.134:43818) 2024-04-24T02:14:11.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.164+0000 7fa5a3fff640 1 -- 172.21.15.134:0/1365035670 learned_addr learned my addr 172.21.15.134:0/1365035670 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:11.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.164+0000 7fa5a3fff640 1 -- 172.21.15.134:0/1365035670 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560baaa14930 con 0x560baaa13fd0 2024-04-24T02:14:11.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.164+0000 7fa5a3fff640 1 --2- 172.21.15.134:0/1365035670 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560baaa13fd0 0x560baaa143f0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fa59400e610 tx=0x7fa59400ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.165+0000 7fa48e7fc640 1 -- 172.21.15.134:0/1365035670 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa594022070 con 0x560baaa13fd0 2024-04-24T02:14:11.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.165+0000 7fa48e7fc640 1 -- 172.21.15.134:0/1365035670 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa594009050 con 0x560baaa13fd0 2024-04-24T02:14:11.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.165+0000 7fa5acf2e800 1 -- 172.21.15.134:0/1365035670 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560baaa153a0 con 0x560baaa13fd0 2024-04-24T02:14:11.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.165+0000 7fa48e7fc640 1 -- 172.21.15.134:0/1365035670 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa59400d500 con 0x560baaa13fd0 2024-04-24T02:14:11.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.165+0000 7fa5acf2e800 1 -- 172.21.15.134:0/1365035670 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560baaa158a0 con 0x560baaa13fd0 2024-04-24T02:14:11.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.165+0000 7fa48e7fc640 1 -- 172.21.15.134:0/1365035670 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa594025070 con 0x560baaa13fd0 2024-04-24T02:14:11.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.165+0000 7fa48e7fc640 1 --2- 172.21.15.134:0/1365035670 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa480036950 0x7fa480038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.165+0000 7fa48e7fc640 1 -- 172.21.15.134:0/1365035670 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fa59404dae0 con 0x560baaa13fd0 2024-04-24T02:14:11.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.166+0000 7fa5a9468640 1 --2- 172.21.15.134:0/1365035670 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa480036950 0x7fa480038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.166+0000 7fa5acf2e800 1 Processor -- start 2024-04-24T02:14:11.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.166+0000 7fa5acf2e800 1 -- start start 2024-04-24T02:14:11.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.166+0000 7fa5a9468640 1 --2- 172.21.15.134:0/1365035670 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa480036950 0x7fa480038e10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x560baaa03b60 tx=0x7fa5a4005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.166+0000 7fa5acf2e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560baaa213a0 0x560baaa217a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.166+0000 7fa5acf2e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560baa7f26b0 con 0x560baaa213a0 2024-04-24T02:14:11.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.166+0000 7fa5a3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560baaa213a0 0x560baaa217a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.166+0000 7fa5a3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560baaa213a0 0x560baaa217a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43820/0 (socket says 172.21.15.134:43820) 2024-04-24T02:14:11.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.166+0000 7fa5a3fff640 1 -- 172.21.15.134:0/3135404384 learned_addr learned my addr 172.21.15.134:0/3135404384 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:11.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.166+0000 7fa5a3fff640 1 -- 172.21.15.134:0/3135404384 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560baaa21d70 con 0x560baaa213a0 2024-04-24T02:14:11.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.166+0000 7fa5a3fff640 1 --2- 172.21.15.134:0/3135404384 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560baaa213a0 0x560baaa217a0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fa594026fd0 tx=0x7fa594024eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfa19f87b95dd922 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.167+0000 7fa47ffff640 1 -- 172.21.15.134:0/3135404384 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa59404a030 con 0x560baaa213a0 2024-04-24T02:14:11.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.167+0000 7fa47ffff640 1 -- 172.21.15.134:0/3135404384 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa594025e30 con 0x560baaa213a0 2024-04-24T02:14:11.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.167+0000 7fa47ffff640 1 -- 172.21.15.134:0/3135404384 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa59401ad50 con 0x560baaa213a0 2024-04-24T02:14:11.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.167+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3135404384 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560baaa213a0 msgr2=0x560baaa217a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.167+0000 7fa5acf2e800 1 --2- 172.21.15.134:0/3135404384 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560baaa213a0 0x560baaa217a0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fa594026fd0 tx=0x7fa594024eb0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.167+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3135404384 shutdown_connections 2024-04-24T02:14:11.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.167+0000 7fa5acf2e800 1 --2- 172.21.15.134:0/3135404384 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560baaa213a0 0x560baaa217a0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.167+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3135404384 >> 172.21.15.134:0/3135404384 conn(0x560baaa1d670 msgr2=0x560baaa1b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:11.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.167+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3135404384 shutdown_connections 2024-04-24T02:14:11.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.167+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3135404384 wait complete. 2024-04-24T02:14:11.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.167+0000 7fa5acf2e800 1 Processor -- start 2024-04-24T02:14:11.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.167+0000 7fa5acf2e800 1 -- start start 2024-04-24T02:14:11.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.167+0000 7fa5acf2e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560baaa213a0 0x560baaa28800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.168+0000 7fa5acf2e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560baaa223a0 con 0x560baaa213a0 2024-04-24T02:14:11.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.168+0000 7fa5a3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560baaa213a0 0x560baaa28800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.168+0000 7fa5a3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560baaa213a0 0x560baaa28800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43822/0 (socket says 172.21.15.134:43822) 2024-04-24T02:14:11.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.168+0000 7fa5a3fff640 1 -- 172.21.15.134:0/3258213132 learned_addr learned my addr 172.21.15.134:0/3258213132 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:11.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.168+0000 7fa5a3fff640 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560baaa28d40 con 0x560baaa213a0 2024-04-24T02:14:11.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.168+0000 7fa5a3fff640 1 --2- 172.21.15.134:0/3258213132 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560baaa213a0 0x560baaa28800 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fa594026fd0 tx=0x7fa59404be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.168+0000 7fa47e7fc640 1 -- 172.21.15.134:0/3258213132 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa59404a050 con 0x560baaa213a0 2024-04-24T02:14:11.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.168+0000 7fa47e7fc640 1 -- 172.21.15.134:0/3258213132 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa59400d6a0 con 0x560baaa213a0 2024-04-24T02:14:11.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.168+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560baaa28fd0 con 0x560baaa213a0 2024-04-24T02:14:11.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.168+0000 7fa47e7fc640 1 -- 172.21.15.134:0/3258213132 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa59400d9e0 con 0x560baaa213a0 2024-04-24T02:14:11.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.168+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560baaa2bc80 con 0x560baaa213a0 2024-04-24T02:14:11.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.169+0000 7fa47e7fc640 1 -- 172.21.15.134:0/3258213132 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa59404d370 con 0x560baaa213a0 2024-04-24T02:14:11.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.169+0000 7fa47e7fc640 1 --2- 172.21.15.134:0/3258213132 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa4740368b0 0x7fa474038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.169+0000 7fa47e7fc640 1 -- 172.21.15.134:0/3258213132 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fa5940457f0 con 0x560baaa213a0 2024-04-24T02:14:11.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.169+0000 7fa5a9468640 1 --2- 172.21.15.134:0/3258213132 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa4740368b0 0x7fa474038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.170+0000 7fa5a9468640 1 --2- 172.21.15.134:0/3258213132 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa4740368b0 0x7fa474038d70 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x560baa900b60 tx=0x7fa5a401f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.170+0000 7fa5acf2e800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.170+0000 7fa5acf2e800 1 --2- 172.21.15.134:0/3258213132 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560baaa34350 0x560baaa36810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.170+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560baaa36f60 con 0x560baaa34350 2024-04-24T02:14:11.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.170+0000 7fa5a8c67640 1 --2- 172.21.15.134:0/3258213132 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560baaa34350 0x560baaa36810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.170+0000 7fa5a8c67640 1 --2- 172.21.15.134:0/3258213132 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560baaa34350 0x560baaa36810 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.170+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa59c064070 con 0x560baaa34350 2024-04-24T02:14:11.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.170+0000 7fa5acf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:11.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.170+0000 7fa5acf2e800 20 realm 2024-04-24T02:14:11.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.170+0000 7fa5acf2e800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.170+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560baaa37370 con 0x560baaa34350 2024-04-24T02:14:11.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.170+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa59c064070 con 0x560baaa34350 2024-04-24T02:14:11.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.171+0000 7fa5acf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:11.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.171+0000 7fa5acf2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:14:11.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.171+0000 7fa5acf2e800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.171+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560baaa37c40 con 0x560baaa34350 2024-04-24T02:14:11.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.171+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa59c064070 con 0x560baaa34350 2024-04-24T02:14:11.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.171+0000 7fa5acf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:11.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.171+0000 7fa5acf2e800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.171+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560baaa37fe0 con 0x560baaa34350 2024-04-24T02:14:11.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.171+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa59c064070 con 0x560baaa34350 2024-04-24T02:14:11.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.171+0000 7fa5acf2e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:14:11.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.171+0000 7fa5acf2e800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.171+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560baaa38830 con 0x560baaa34350 2024-04-24T02:14:11.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.171+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa59c064070 con 0x560baaa34350 2024-04-24T02:14:11.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.171+0000 7fa5acf2e800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:14:11.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.171+0000 7fa5acf2e800 20 searching for the correct realm 2024-04-24T02:14:11.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.171+0000 7fa5acf2e800 1 --2- 172.21.15.134:0/3258213132 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x560baaa3a5a0 0x560baaa3c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.171+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560baaa3cfc0 con 0x560baaa3a5a0 2024-04-24T02:14:11.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.171+0000 7fa5a3fff640 1 --2- 172.21.15.134:0/3258213132 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x560baaa3a5a0 0x560baaa3c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.172+0000 7fa5a3fff640 1 --2- 172.21.15.134:0/3258213132 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x560baaa3a5a0 0x560baaa3c990 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.172+0000 7fa5a3fff640 1 -- 172.21.15.134:0/3258213132 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa594024030 con 0x560baaa3a5a0 2024-04-24T02:14:11.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.172+0000 7fa5a3fff640 1 --2- 172.21.15.134:0/3258213132 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fa594027060 0x7fa5940467d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.172+0000 7fa5a3fff640 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560baaa3cfc0 con 0x7fa594027060 2024-04-24T02:14:11.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.172+0000 7fa5a9468640 1 --2- 172.21.15.134:0/3258213132 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fa594027060 0x7fa5940467d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.172+0000 7fa5a9468640 1 --2- 172.21.15.134:0/3258213132 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fa594027060 0x7fa5940467d0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.173+0000 7fa5a9468640 1 -- 172.21.15.134:0/3258213132 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5a401f070 con 0x7fa594027060 2024-04-24T02:14:11.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.173+0000 7fa5a9468640 1 --2- 172.21.15.134:0/3258213132 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fa5a4031040 0x7fa5a4032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.173+0000 7fa5a9468640 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560baaa3cfc0 con 0x7fa5a4031040 2024-04-24T02:14:11.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.173+0000 7fa5a8c67640 1 --2- 172.21.15.134:0/3258213132 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fa5a4031040 0x7fa5a4032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.173+0000 7fa5a8c67640 1 --2- 172.21.15.134:0/3258213132 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fa5a4031040 0x7fa5a4032430 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.174+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa59c064070 con 0x7fa5a4031040 2024-04-24T02:14:11.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.174+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560baaa3cfc0 con 0x560baaa34350 2024-04-24T02:14:11.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.174+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa59c064070 con 0x560baaa34350 2024-04-24T02:14:11.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.174+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560baaa3cfc0 con 0x560baaa34350 2024-04-24T02:14:11.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.174+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa59c064070 con 0x560baaa34350 2024-04-24T02:14:11.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.174+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560baaa3cfc0 con 0x7fa5a4031040 2024-04-24T02:14:11.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.174+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa59c064070 con 0x7fa5a4031040 2024-04-24T02:14:11.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.174+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560baaa3cfc0 con 0x7fa594027060 2024-04-24T02:14:11.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.174+0000 7fa5a9468640 1 -- 172.21.15.134:0/3258213132 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5a401f070 con 0x7fa594027060 2024-04-24T02:14:11.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.174+0000 7fa5a9468640 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560baaa3cfc0 con 0x7fa594027060 2024-04-24T02:14:11.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.175+0000 7fa5a9468640 1 -- 172.21.15.134:0/3258213132 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5a401f070 con 0x7fa594027060 2024-04-24T02:14:11.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.175+0000 7fa5a9468640 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560baaa3cfc0 con 0x560baaa3a5a0 2024-04-24T02:14:11.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.175+0000 7fa5a3fff640 1 -- 172.21.15.134:0/3258213132 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa594024030 con 0x560baaa3a5a0 2024-04-24T02:14:11.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.175+0000 7fa5a3fff640 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560baaa3cfc0 con 0x560baaa34350 2024-04-24T02:14:11.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.175+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa59c064070 con 0x560baaa34350 2024-04-24T02:14:11.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.175+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560baaa3cfc0 con 0x7fa5a4031040 2024-04-24T02:14:11.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.175+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa59c064070 con 0x7fa5a4031040 2024-04-24T02:14:11.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.176+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560baaa3cfc0 con 0x560baaa34350 2024-04-24T02:14:11.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.176+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa59c064070 con 0x560baaa34350 2024-04-24T02:14:11.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.176+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560baaa3cfc0 con 0x7fa594027060 2024-04-24T02:14:11.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.176+0000 7fa5a9468640 1 -- 172.21.15.134:0/3258213132 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa5a401f070 con 0x7fa594027060 2024-04-24T02:14:11.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.176+0000 7fa5a9468640 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560baaa3cfc0 con 0x560baaa3a5a0 2024-04-24T02:14:11.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.176+0000 7fa5a3fff640 1 -- 172.21.15.134:0/3258213132 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa594024030 con 0x560baaa3a5a0 2024-04-24T02:14:11.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.176+0000 7fa5a3fff640 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560baaa3cfc0 con 0x560baaa3a5a0 2024-04-24T02:14:11.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.177+0000 7fa5a3fff640 1 -- 172.21.15.134:0/3258213132 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa594024030 con 0x560baaa3a5a0 2024-04-24T02:14:11.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.177+0000 7fa5a3fff640 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560baaa3cfc0 con 0x7fa594027060 2024-04-24T02:14:11.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.177+0000 7fa5a9468640 1 -- 172.21.15.134:0/3258213132 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5a401f070 con 0x7fa594027060 2024-04-24T02:14:11.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.177+0000 7fa5a9468640 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560baaa3cfc0 con 0x560baaa3a5a0 2024-04-24T02:14:11.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.177+0000 7fa5a3fff640 1 -- 172.21.15.134:0/3258213132 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa594024030 con 0x560baaa3a5a0 2024-04-24T02:14:11.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.177+0000 7fa5a3fff640 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560baaa3cfc0 con 0x560baaa3a5a0 2024-04-24T02:14:11.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.177+0000 7fa5a3fff640 1 -- 172.21.15.134:0/3258213132 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa594024030 con 0x560baaa3a5a0 2024-04-24T02:14:11.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.177+0000 7fa5a3fff640 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560baaa3cfc0 con 0x560baaa34350 2024-04-24T02:14:11.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.177+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa59c064070 con 0x560baaa34350 2024-04-24T02:14:11.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.177+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560baaa3cfc0 con 0x560baaa34350 2024-04-24T02:14:11.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.178+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=132b] v32'6 uv6 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fa59c064070 con 0x560baaa34350 2024-04-24T02:14:11.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.178+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560baaa3cfc0 con 0x7fa5a4031040 2024-04-24T02:14:11.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.178+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa59c064070 con 0x7fa5a4031040 2024-04-24T02:14:11.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.178+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560baaa3cfc0 con 0x560baaa3a5a0 2024-04-24T02:14:11.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.178+0000 7fa5a3fff640 1 -- 172.21.15.134:0/3258213132 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa594024030 con 0x560baaa3a5a0 2024-04-24T02:14:11.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.178+0000 7fa5a3fff640 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560baaa3cfc0 con 0x7fa594027060 2024-04-24T02:14:11.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.178+0000 7fa5a9468640 1 -- 172.21.15.134:0/3258213132 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5a401f070 con 0x7fa594027060 2024-04-24T02:14:11.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.178+0000 7fa5a9468640 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560baaa3cfc0 con 0x560baaa34350 2024-04-24T02:14:11.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.179+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa59c064070 con 0x560baaa34350 2024-04-24T02:14:11.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.179+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560baaa3cfc0 con 0x7fa5a4031040 2024-04-24T02:14:11.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.179+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa59c064070 con 0x7fa5a4031040 2024-04-24T02:14:11.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.179+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560baaa3cfc0 con 0x560baaa3a5a0 2024-04-24T02:14:11.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.179+0000 7fa5a3fff640 1 -- 172.21.15.134:0/3258213132 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa594024030 con 0x560baaa3a5a0 2024-04-24T02:14:11.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.179+0000 7fa5a3fff640 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560baaa3cfc0 con 0x7fa5a4031040 2024-04-24T02:14:11.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.180+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa59c064070 con 0x7fa5a4031040 2024-04-24T02:14:11.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.180+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560baaa3cfc0 con 0x7fa594027060 2024-04-24T02:14:11.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.180+0000 7fa5a9468640 1 -- 172.21.15.134:0/3258213132 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5a4040040 con 0x7fa594027060 2024-04-24T02:14:11.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.180+0000 7fa5a9468640 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560baaa3cfc0 con 0x560baaa3a5a0 2024-04-24T02:14:11.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.180+0000 7fa5a3fff640 1 -- 172.21.15.134:0/3258213132 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa594024030 con 0x560baaa3a5a0 2024-04-24T02:14:11.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.180+0000 7fa5a3fff640 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560baaa3cfc0 con 0x7fa594027060 2024-04-24T02:14:11.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.180+0000 7fa5a9468640 1 -- 172.21.15.134:0/3258213132 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5a4040040 con 0x7fa594027060 2024-04-24T02:14:11.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.180+0000 7fa5a9468640 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560baaa3cfc0 con 0x560baaa34350 2024-04-24T02:14:11.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.180+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa59c064070 con 0x560baaa34350 2024-04-24T02:14:11.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.180+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560baaa3cfc0 con 0x7fa594027060 2024-04-24T02:14:11.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.181+0000 7fa5a9468640 1 -- 172.21.15.134:0/3258213132 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5a4040040 con 0x7fa594027060 2024-04-24T02:14:11.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.181+0000 7fa5acf2e800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:14:11.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.181+0000 7fa5acf2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:14:11.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.181+0000 7fa5acf2e800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:14:11.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.181+0000 7fa5acf2e800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:14:11.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.181+0000 7fa5acf2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:14:11.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.181+0000 7fa5acf2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:14:11.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.181+0000 7fa5acf2e800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.181+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560baaa391e0 con 0x560baaa34350 2024-04-24T02:14:11.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.181+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa59c064070 con 0x560baaa34350 2024-04-24T02:14:11.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.181+0000 7fa5acf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:11.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.181+0000 7fa5acf2e800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.181+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560baaa39a80 con 0x560baaa34350 2024-04-24T02:14:11.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.181+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa59c064070 con 0x560baaa34350 2024-04-24T02:14:11.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.181+0000 7fa5acf2e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:14:11.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.181+0000 7fa5acf2e800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.181+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560baaa39a80 con 0x560baaa34350 2024-04-24T02:14:11.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.181+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa59c064070 con 0x560baaa34350 2024-04-24T02:14:11.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.182+0000 7fa5acf2e800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:14:11.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.182+0000 7fa5acf2e800 20 zone default found 2024-04-24T02:14:11.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.182+0000 7fa5acf2e800 4 Realm: () 2024-04-24T02:14:11.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.182+0000 7fa5acf2e800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:14:11.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.182+0000 7fa5acf2e800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:14:11.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.182+0000 7fa5acf2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:14:11.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.182+0000 7fa5acf2e800 20 zonegroup default 2024-04-24T02:14:11.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.182+0000 7fa5acf2e800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.182+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560baaa3d440 con 0x7fa5a4031040 2024-04-24T02:14:11.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.182+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa59c064070 con 0x7fa5a4031040 2024-04-24T02:14:11.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.182+0000 7fa5acf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:11.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.182+0000 7fa5acf2e800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.182+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560baaa39850 con 0x560baaa3a5a0 2024-04-24T02:14:11.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.182+0000 7fa5a3fff640 1 -- 172.21.15.134:0/3258213132 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa594024030 con 0x560baaa3a5a0 2024-04-24T02:14:11.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.182+0000 7fa5acf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:11.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.182+0000 7fa5acf2e800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.182+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560baaa3f380 con 0x560baaa3a5a0 2024-04-24T02:14:11.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.182+0000 7fa5a3fff640 1 -- 172.21.15.134:0/3258213132 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa594024030 con 0x560baaa3a5a0 2024-04-24T02:14:11.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.182+0000 7fa5acf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:11.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.183+0000 7fa5acf2e800 20 started sync module instance, tier type = 2024-04-24T02:14:11.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.183+0000 7fa5acf2e800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:14:11.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.183+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560baaa3e760 con 0x7fa594027060 2024-04-24T02:14:11.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.184+0000 7fa5a9468640 1 -- 172.21.15.134:0/3258213132 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(44 notify.0 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5a4040040 con 0x7fa594027060 2024-04-24T02:14:11.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.184+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94608107498320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560baaa3e3c0 con 0x7fa594027060 2024-04-24T02:14:11.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.184+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560baaa402b0 con 0x560baaa34350 2024-04-24T02:14:11.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.185+0000 7fa5a9468640 1 -- 172.21.15.134:0/3258213132 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94608107498320] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5a4040040 con 0x7fa594027060 2024-04-24T02:14:11.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.185+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa59c064070 con 0x560baaa34350 2024-04-24T02:14:11.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.185+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94608107501536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560baaa402b0 con 0x560baaa34350 2024-04-24T02:14:11.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.185+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560baaa40c70 con 0x560baaa3a5a0 2024-04-24T02:14:11.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.186+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94608107501536] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa59c064070 con 0x560baaa34350 2024-04-24T02:14:11.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.186+0000 7fa5a3fff640 1 -- 172.21.15.134:0/3258213132 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa594024030 con 0x560baaa3a5a0 2024-04-24T02:14:11.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.186+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94608107503104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560baaa40220 con 0x560baaa3a5a0 2024-04-24T02:14:11.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.186+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560baaa419b0 con 0x7fa594027060 2024-04-24T02:14:11.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.187+0000 7fa5a3fff640 1 -- 172.21.15.134:0/3258213132 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94608107503104] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa594024030 con 0x560baaa3a5a0 2024-04-24T02:14:11.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.187+0000 7fa5a9468640 1 -- 172.21.15.134:0/3258213132 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(50 notify.3 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5a4040040 con 0x7fa594027060 2024-04-24T02:14:11.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.187+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94608107507728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560baaa41da0 con 0x7fa594027060 2024-04-24T02:14:11.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.187+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560baaa42810 con 0x560baaa34350 2024-04-24T02:14:11.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.189+0000 7fa5a9468640 1 -- 172.21.15.134:0/3258213132 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94608107507728] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5a4040040 con 0x7fa594027060 2024-04-24T02:14:11.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.189+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa59c064070 con 0x560baaa34350 2024-04-24T02:14:11.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.189+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94608107512544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560baaa427d0 con 0x560baaa34350 2024-04-24T02:14:11.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.189+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560baaa432c0 con 0x7fa5a4031040 2024-04-24T02:14:11.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.190+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94608107512544] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa59c064070 con 0x560baaa34350 2024-04-24T02:14:11.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.190+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(54 notify.5 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa59c064070 con 0x7fa5a4031040 2024-04-24T02:14:11.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.190+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94608107508784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560baaa432c0 con 0x7fa5a4031040 2024-04-24T02:14:11.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.190+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560baaa43cd0 con 0x7fa5a4031040 2024-04-24T02:14:11.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.191+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94608107508784] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa59c064070 con 0x7fa5a4031040 2024-04-24T02:14:11.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.191+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(56 notify.6 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa59c064070 con 0x7fa5a4031040 2024-04-24T02:14:11.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.191+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94608107515296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560baaa43cd0 con 0x7fa5a4031040 2024-04-24T02:14:11.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.191+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560baaa44690 con 0x7fa5a4031040 2024-04-24T02:14:11.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.192+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94608107515296] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa59c064070 con 0x7fa5a4031040 2024-04-24T02:14:11.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.193+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(58 notify.7 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa59c064070 con 0x7fa5a4031040 2024-04-24T02:14:11.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.193+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94608107518464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560baaa44690 con 0x7fa5a4031040 2024-04-24T02:14:11.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.193+0000 7fa5acf2e800 20 add_watcher() i=0 2024-04-24T02:14:11.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.193+0000 7fa5acf2e800 20 add_watcher() i=1 2024-04-24T02:14:11.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.193+0000 7fa5acf2e800 20 add_watcher() i=2 2024-04-24T02:14:11.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.193+0000 7fa5acf2e800 20 add_watcher() i=3 2024-04-24T02:14:11.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.193+0000 7fa5acf2e800 20 add_watcher() i=4 2024-04-24T02:14:11.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.193+0000 7fa5acf2e800 20 add_watcher() i=5 2024-04-24T02:14:11.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.193+0000 7fa5acf2e800 20 add_watcher() i=6 2024-04-24T02:14:11.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.193+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94608107518464] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa59c064070 con 0x7fa5a4031040 2024-04-24T02:14:11.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.194+0000 7fa5acf2e800 20 add_watcher() i=7 2024-04-24T02:14:11.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.194+0000 7fa5acf2e800 2 all 8 watchers are set, enabling cache 2024-04-24T02:14:11.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.194+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560baaa47a90 con 0x560baaa34350 2024-04-24T02:14:11.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.194+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa59c064070 con 0x560baaa34350 2024-04-24T02:14:11.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.194+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94608107520944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560baaa44fb0 con 0x560baaa34350 2024-04-24T02:14:11.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.195+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94608107520944] v32'257 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa59c064070 con 0x560baaa34350 2024-04-24T02:14:11.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.195+0000 7fa45efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:14:11.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.195+0000 7fa5acf2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:14:11.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.195+0000 7fa5acf2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:14:11.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.195+0000 7fa5acf2e800 5 note: GC not initialized 2024-04-24T02:14:11.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.195+0000 7fa45dfe3640 20 reqs_thread_entry: start 2024-04-24T02:14:11.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.195+0000 7fa5acf2e800 20 init_complete bucket index max shards: 11 2024-04-24T02:14:11.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.195+0000 7fa5acf2e800 20 Filter name: none 2024-04-24T02:14:11.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.196+0000 7fa3cf7fe640 20 reqs_thread_entry: start 2024-04-24T02:14:11.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.196+0000 7fa5acf2e800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-04-24T02:14:11.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.196+0000 7fa5acf2e800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.196+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:62 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560baaa7ae00 con 0x560baaa3a5a0 2024-04-24T02:14:11.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.196+0000 7fa5a3fff640 1 -- 172.21.15.134:0/3258213132 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(62 a_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 234+0+0 (crc 0 0 0) 0x7fa594024030 con 0x560baaa3a5a0 2024-04-24T02:14:11.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.196+0000 7fa5acf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:11.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.196+0000 7fa5acf2e800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x0 2024-04-24T02:14:11.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.196+0000 7fa5acf2e800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-04-24T02:14:11.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.196+0000 7fa5acf2e800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : miss 2024-04-24T02:14:11.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.196+0000 7fa5acf2e800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.196+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:63 8.15 8:afe09604:users.keys::true_admin_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560baaa79a70 con 0x560baaa3a5a0 2024-04-24T02:14:11.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.196+0000 7fa5a3fff640 1 -- 172.21.15.134:0/3258213132 <== osd.3 v2:172.21.15.134:6801/3585115521 15 ==== osd_op_reply(63 true_admin_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 201+0+0 (crc 0 0 0) 0x7fa594024030 con 0x560baaa3a5a0 2024-04-24T02:14:11.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.196+0000 7fa5acf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:11.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.196+0000 7fa5acf2e800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x0 2024-04-24T02:14:11.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.196+0000 7fa5acf2e800 10 adding default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-04-24T02:14:11.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.196+0000 7fa5acf2e800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-04-24T02:14:11.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.196+0000 7fa5acf2e800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-04-24T02:14:11.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.196+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:64 8.14 8:2efb937b:users.uid::a_user:head [delete,create,call version.set in=58b,writefull 0~363 in=363b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560baaa7e3f0 con 0x560baaa3a5a0 2024-04-24T02:14:11.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.197+0000 7fa5a3fff640 1 -- 172.21.15.134:0/3258213132 <== osd.3 v2:172.21.15.134:6801/3585115521 16 ==== osd_op_reply(64 a_user [delete,create,call,writefull 0~363] v32'3 uv3 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7fa594024030 con 0x560baaa3a5a0 2024-04-24T02:14:11.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.197+0000 7fa5acf2e800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-04-24T02:14:11.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.197+0000 7fa5acf2e800 10 moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-04-24T02:14:11.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.197+0000 7fa5acf2e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-04-24T02:14:11.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.197+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [notify cookie 94608107740912 in=554b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560baaa7eec0 con 0x560baaa3a5a0 2024-04-24T02:14:11.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.198+0000 7fa5a3fff640 1 -- 172.21.15.134:0/3258213132 <== osd.3 v2:172.21.15.134:6801/3585115521 17 ==== watch-notify(notify (1) cookie 94608107503104 notify 137438953491 ret 0) ==== 584+0+0 (crc 0 0 0) 0x560baaa797f0 con 0x560baaa3a5a0 2024-04-24T02:14:11.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.198+0000 7fa5a3fff640 1 -- 172.21.15.134:0/3258213132 <== osd.3 v2:172.21.15.134:6801/3585115521 18 ==== osd_op_reply(65 notify.2 [notify cookie 94608107740912 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa594024030 con 0x560baaa3a5a0 2024-04-24T02:14:11.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.198+0000 7fa47ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953491 cookie 94608107503104 notifier 4851 bl.length()=542 2024-04-24T02:14:11.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.198+0000 7fa47ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-04-24T02:14:11.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.198+0000 7fa47ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-04-24T02:14:11.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.198+0000 7fa47ffff640 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fa46c003ea0 con 0x560baaa3a5a0 2024-04-24T02:14:11.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.198+0000 7fa5a3fff640 1 -- 172.21.15.134:0/3258213132 <== osd.3 v2:172.21.15.134:6801/3585115521 19 ==== watch-notify(notify_complete (2) cookie 94608107740912 notify 137438953491 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560baaa28d40 con 0x560baaa3a5a0 2024-04-24T02:14:11.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.198+0000 7fa5a3fff640 1 -- 172.21.15.134:0/3258213132 <== osd.3 v2:172.21.15.134:6801/3585115521 20 ==== osd_op_reply(66 notify.2 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa594024030 con 0x560baaa3a5a0 2024-04-24T02:14:11.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.198+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:67 8.15 8:afe09604:users.keys::true_admin_akey:head [delete,create,writefull 0~10 in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560baaa79ef0 con 0x560baaa3a5a0 2024-04-24T02:14:11.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.199+0000 7fa5a3fff640 1 -- 172.21.15.134:0/3258213132 <== osd.3 v2:172.21.15.134:6801/3585115521 21 ==== osd_op_reply(67 true_admin_akey [delete,create,writefull 0~10] v32'3 uv3 ondisk = 0) ==== 243+0+0 (crc 0 0 0) 0x7fa594024030 con 0x560baaa3a5a0 2024-04-24T02:14:11.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.199+0000 7fa5acf2e800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-04-24T02:14:11.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.199+0000 7fa5acf2e800 10 moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-04-24T02:14:11.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.199+0000 7fa5acf2e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-04-24T02:14:11.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.199+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94608107740912 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560baaa7f2f0 con 0x7fa5a4031040 2024-04-24T02:14:11.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.200+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== watch-notify(notify (1) cookie 94608107508784 notify 137438953520 ret 0) ==== 217+0+0 (crc 0 0 0) 0x7fa59c086040 con 0x7fa5a4031040 2024-04-24T02:14:11.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.200+0000 7fa47ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953520 cookie 94608107508784 notifier 4851 bl.length()=175 2024-04-24T02:14:11.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.200+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(68 notify.5 [notify cookie 94608107740912 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa59c064070 con 0x7fa5a4031040 2024-04-24T02:14:11.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.200+0000 7fa47ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-04-24T02:14:11.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.200+0000 7fa47ffff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-04-24T02:14:11.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.200+0000 7fa47ffff640 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fa46c003ea0 con 0x7fa5a4031040 2024-04-24T02:14:11.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.200+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa59c064070 con 0x7fa5a4031040 2024-04-24T02:14:11.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.200+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== watch-notify(notify_complete (2) cookie 94608107740912 notify 137438953520 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560baa900090 con 0x7fa5a4031040 2024-04-24T02:14:11.214 INFO:teuthology.orchestra.run.smithi134.stdout:{"user_id":"a_user","display_name":"True Admin User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"a_user","access_key":"true_admin_akey","secret_key":"true_admin_skey","active":true,"create_date":"2024-04-24T02:14:11.198010Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","admin":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T02:14:11.197991Z","tags":[],"group_ids":[]} 2024-04-24T02:14:11.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.201+0000 7fa45efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:14:11.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.201+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94608107520944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560baaa7cba0 con 0x560baaa34350 2024-04-24T02:14:11.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.202+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94608107520944] v32'258 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa59c064070 con 0x560baaa34350 2024-04-24T02:14:11.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.202+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94608107498320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560baaa44380 con 0x7fa594027060 2024-04-24T02:14:11.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.203+0000 7fa5a9468640 1 -- 172.21.15.134:0/3258213132 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94608107498320] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5a4040040 con 0x7fa594027060 2024-04-24T02:14:11.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.203+0000 7fa5acf2e800 20 remove_watcher() i=0 2024-04-24T02:14:11.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.203+0000 7fa5acf2e800 2 removed watcher, disabling cache 2024-04-24T02:14:11.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.203+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94608107501536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560baaa3eb50 con 0x560baaa34350 2024-04-24T02:14:11.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.204+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94608107501536] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa59c064070 con 0x560baaa34350 2024-04-24T02:14:11.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.204+0000 7fa5acf2e800 20 remove_watcher() i=1 2024-04-24T02:14:11.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.204+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94608107503104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560baaa3eb50 con 0x560baaa3a5a0 2024-04-24T02:14:11.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.205+0000 7fa5a3fff640 1 -- 172.21.15.134:0/3258213132 <== osd.3 v2:172.21.15.134:6801/3585115521 22 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94608107503104] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa594024030 con 0x560baaa3a5a0 2024-04-24T02:14:11.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.205+0000 7fa5acf2e800 20 remove_watcher() i=2 2024-04-24T02:14:11.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.205+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94608107507728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560baaa3fe00 con 0x7fa594027060 2024-04-24T02:14:11.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.206+0000 7fa5a9468640 1 -- 172.21.15.134:0/3258213132 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94608107507728] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5a4040040 con 0x7fa594027060 2024-04-24T02:14:11.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.206+0000 7fa5acf2e800 20 remove_watcher() i=3 2024-04-24T02:14:11.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.206+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94608107512544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560baaa3eb50 con 0x560baaa34350 2024-04-24T02:14:11.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.207+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94608107512544] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa59c064070 con 0x560baaa34350 2024-04-24T02:14:11.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.207+0000 7fa5acf2e800 20 remove_watcher() i=4 2024-04-24T02:14:11.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.207+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94608107508784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560baaa41010 con 0x7fa5a4031040 2024-04-24T02:14:11.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.208+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94608107508784] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa59c064070 con 0x7fa5a4031040 2024-04-24T02:14:11.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.208+0000 7fa5acf2e800 20 remove_watcher() i=5 2024-04-24T02:14:11.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.208+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94608107515296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560baaa3fe00 con 0x7fa5a4031040 2024-04-24T02:14:11.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.209+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94608107515296] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa59c064070 con 0x7fa5a4031040 2024-04-24T02:14:11.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.209+0000 7fa5acf2e800 20 remove_watcher() i=6 2024-04-24T02:14:11.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.209+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94608107518464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560baaa42da0 con 0x7fa5a4031040 2024-04-24T02:14:11.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.210+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 <== osd.0 v2:172.21.15.104:6800/2419146313 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94608107518464] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa59c064070 con 0x7fa5a4031040 2024-04-24T02:14:11.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.210+0000 7fa5acf2e800 20 remove_watcher() i=7 2024-04-24T02:14:11.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.210+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fa5a4031040 msgr2=0x7fa5a4032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.210+0000 7fa5acf2e800 1 --2- 172.21.15.134:0/3258213132 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fa5a4031040 0x7fa5a4032430 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.210+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560baaa34350 msgr2=0x560baaa36810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.210+0000 7fa5acf2e800 1 --2- 172.21.15.134:0/3258213132 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560baaa34350 0x560baaa36810 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.210+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fa594027060 msgr2=0x7fa5940467d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.210+0000 7fa5acf2e800 1 --2- 172.21.15.134:0/3258213132 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fa594027060 0x7fa5940467d0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.210+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x560baaa3a5a0 msgr2=0x560baaa3c990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.210+0000 7fa5acf2e800 1 --2- 172.21.15.134:0/3258213132 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x560baaa3a5a0 0x560baaa3c990 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.210+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa4740368b0 msgr2=0x7fa474038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.210+0000 7fa5acf2e800 1 --2- 172.21.15.134:0/3258213132 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa4740368b0 0x7fa474038d70 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x560baa900b60 tx=0x7fa5a401f000 comp rx=0 tx=0).stop 2024-04-24T02:14:11.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.210+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560baaa213a0 msgr2=0x560baaa28800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.210+0000 7fa5a8c67640 1 -- 172.21.15.134:0/3258213132 reap_dead start 2024-04-24T02:14:11.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.210+0000 7fa5acf2e800 1 --2- 172.21.15.134:0/3258213132 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560baaa213a0 0x560baaa28800 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fa594026fd0 tx=0x7fa59404be50 comp rx=0 tx=0).stop 2024-04-24T02:14:11.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.210+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 shutdown_connections 2024-04-24T02:14:11.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.210+0000 7fa5acf2e800 1 --2- 172.21.15.134:0/3258213132 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560baaa213a0 0x560baaa28800 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.210+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 >> 172.21.15.134:0/3258213132 conn(0x560baaa1d670 msgr2=0x560baaa1acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:11.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.210+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 shutdown_connections 2024-04-24T02:14:11.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.210+0000 7fa5acf2e800 1 -- 172.21.15.134:0/3258213132 wait complete. 2024-04-24T02:14:11.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.211+0000 7fa5acf2e800 1 -- 172.21.15.134:0/1365035670 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa480036950 msgr2=0x7fa480038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.211+0000 7fa5acf2e800 1 --2- 172.21.15.134:0/1365035670 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa480036950 0x7fa480038e10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x560baaa03b60 tx=0x7fa5a4005840 comp rx=0 tx=0).stop 2024-04-24T02:14:11.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.211+0000 7fa5acf2e800 1 -- 172.21.15.134:0/1365035670 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560baaa13fd0 msgr2=0x560baaa143f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.211+0000 7fa5acf2e800 1 --2- 172.21.15.134:0/1365035670 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560baaa13fd0 0x560baaa143f0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fa59400e610 tx=0x7fa59400ff90 comp rx=0 tx=0).stop 2024-04-24T02:14:11.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.211+0000 7fa5acf2e800 1 -- 172.21.15.134:0/1365035670 shutdown_connections 2024-04-24T02:14:11.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.211+0000 7fa5acf2e800 1 --2- 172.21.15.134:0/1365035670 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa480036950 0x7fa480038e10 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.211+0000 7fa5acf2e800 1 --2- 172.21.15.134:0/1365035670 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560baaa13fd0 0x560baaa143f0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.211+0000 7fa5acf2e800 1 -- 172.21.15.134:0/1365035670 >> 172.21.15.134:0/1365035670 conn(0x560baaa08070 msgr2=0x560baaa08470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:11.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.211+0000 7fa5acf2e800 1 -- 172.21.15.134:0/1365035670 shutdown_connections 2024-04-24T02:14:11.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.211+0000 7fa5acf2e800 1 -- 172.21.15.134:0/1365035670 wait complete. 2024-04-24T02:14:11.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.211+0000 7fa5acf2e800 1 -- 172.21.15.134:0/188421246 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560baa904180 msgr2=0x560baaa02e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.211+0000 7fa5acf2e800 1 --2- 172.21.15.134:0/188421246 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560baa904180 0x560baaa02e40 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.211+0000 7fa5acf2e800 1 -- 172.21.15.134:0/188421246 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa490036950 msgr2=0x7fa490038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.211+0000 7fa5acf2e800 1 --2- 172.21.15.134:0/188421246 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa490036950 0x7fa490038e10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa594000c00 tx=0x7fa5940013b0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.211+0000 7fa5acf2e800 1 -- 172.21.15.134:0/188421246 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560baa901850 msgr2=0x560baa901190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.211+0000 7fa5acf2e800 1 --2- 172.21.15.134:0/188421246 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560baa901850 0x560baa901190 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fa59c0057e0 tx=0x7fa59c002fb0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.211+0000 7fa5acf2e800 1 -- 172.21.15.134:0/188421246 shutdown_connections 2024-04-24T02:14:11.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.211+0000 7fa5acf2e800 1 --2- 172.21.15.134:0/188421246 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560baa904180 0x560baaa02e40 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.211+0000 7fa5acf2e800 1 --2- 172.21.15.134:0/188421246 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fa490036950 0x7fa490038e10 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.211+0000 7fa5acf2e800 1 --2- 172.21.15.134:0/188421246 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560baa901850 0x560baa901190 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.211+0000 7fa5acf2e800 1 -- 172.21.15.134:0/188421246 >> 172.21.15.134:0/188421246 conn(0x560baa8fb320 msgr2=0x560baa9ebf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:11.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.211+0000 7fa5acf2e800 1 -- 172.21.15.134:0/188421246 shutdown_connections 2024-04-24T02:14:11.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.211+0000 7fa5acf2e800 1 -- 172.21.15.134:0/188421246 wait complete. 2024-04-24T02:14:11.225 DEBUG:tasks.util.rgw: json result: {'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-04-24T02:14:11.198010Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:14:11.197991Z', 'tags': [], 'group_ids': []} 2024-04-24T02:14:11.226 ERROR:root:{'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-04-24T02:14:11.198010Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:14:11.197991Z', 'tags': [], 'group_ids': []} 2024-04-24T02:14:11.226 ERROR:root:0 2024-04-24T02:14:11.226 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T02:14:11.231 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T02:14:11.231 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'a_user'] 2024-04-24T02:14:11.231 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'a_user'] 2024-04-24T02:14:11.231 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid a_user 2024-04-24T02:14:11.274 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:14:11.274 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:14:11.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.273+0000 7f6eba413800 1 Processor -- start 2024-04-24T02:14:11.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.273+0000 7f6eba413800 1 -- start start 2024-04-24T02:14:11.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.273+0000 7f6eba413800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x560897f05400 0x560897f077f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.273+0000 7f6eba413800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560897dbfd40 con 0x560897f018f0 2024-04-24T02:14:11.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.273+0000 7f6eba413800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x560897d924d0 con 0x560897f05400 2024-04-24T02:14:11.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.274+0000 7f6eb5346640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x560897f05400 0x560897f077f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.274+0000 7f6eb5b47640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x560897f018f0 0x560897f03ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:46472/0 (socket says 172.21.15.134:46472) 2024-04-24T02:14:11.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.274+0000 7f6eb5b47640 1 -- 172.21.15.134:0/2517109046 learned_addr learned my addr 172.21.15.134:0/2517109046 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:14:11.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.274+0000 7f6eb5346640 1 -- 172.21.15.134:0/2517109046 >> v1:172.21.15.104:6789/0 conn(0x560897f018f0 legacy=0x560897f03ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.274+0000 7f6eb4b45640 1 -- 172.21.15.134:0/2517109046 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2736508574 0 0) 0x560897dbfd40 con 0x560897f018f0 2024-04-24T02:14:11.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.274+0000 7f6eb5346640 1 -- 172.21.15.134:0/2517109046 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560897dbe590 con 0x560897f05400 2024-04-24T02:14:11.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.276+0000 7f6eb5346640 1 --2- 172.21.15.134:0/2517109046 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560897f05400 0x560897f077f0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f6eac00a470 tx=0x7f6eac01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef1d30a18e567a97 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.276+0000 7f6eb4b45640 1 -- 172.21.15.134:0/2517109046 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6eac057070 con 0x560897f05400 2024-04-24T02:14:11.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.276+0000 7f6eb4b45640 1 -- 172.21.15.134:0/2517109046 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eac052570 con 0x560897f05400 2024-04-24T02:14:11.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.276+0000 7f6eb4b45640 1 -- 172.21.15.134:0/2517109046 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6eac052870 con 0x560897f05400 2024-04-24T02:14:11.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.277+0000 7f6eba413800 1 -- 172.21.15.134:0/2517109046 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560897f05400 msgr2=0x560897f077f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.277+0000 7f6eba413800 1 --2- 172.21.15.134:0/2517109046 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560897f05400 0x560897f077f0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f6eac00a470 tx=0x7f6eac01ce90 comp rx=0 tx=0).stop 2024-04-24T02:14:11.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.277+0000 7f6eba413800 1 -- 172.21.15.134:0/2517109046 shutdown_connections 2024-04-24T02:14:11.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.277+0000 7f6eba413800 1 --2- 172.21.15.134:0/2517109046 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560897f05400 0x560897f077f0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.277+0000 7f6eba413800 1 -- 172.21.15.134:0/2517109046 >> 172.21.15.134:0/2517109046 conn(0x560897efb320 msgr2=0x560897efd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:11.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.277+0000 7f6eba413800 1 -- 172.21.15.134:0/2517109046 shutdown_connections 2024-04-24T02:14:11.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.277+0000 7f6eba413800 1 -- 172.21.15.134:0/2517109046 wait complete. 2024-04-24T02:14:11.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.288+0000 7f6eba413800 1 Processor -- start 2024-04-24T02:14:11.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.288+0000 7f6eba413800 1 -- start start 2024-04-24T02:14:11.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.288+0000 7f6eba413800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560897f018f0 0x560897f01230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.288+0000 7f6eba413800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560897e4c3c0 con 0x560897f018f0 2024-04-24T02:14:11.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.289+0000 7f6eb5b47640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560897f018f0 0x560897f01230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.289+0000 7f6eb5b47640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560897f018f0 0x560897f01230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43830/0 (socket says 172.21.15.134:43830) 2024-04-24T02:14:11.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.289+0000 7f6eb5b47640 1 -- 172.21.15.134:0/2987588203 learned_addr learned my addr 172.21.15.134:0/2987588203 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:11.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.289+0000 7f6eb5b47640 1 -- 172.21.15.134:0/2987588203 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560897eff7f0 con 0x560897f018f0 2024-04-24T02:14:11.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.289+0000 7f6eb5b47640 1 --2- 172.21.15.134:0/2987588203 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560897f018f0 0x560897f01230 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f6ea800b210 tx=0x7f6ea800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ac5d60df9bb7459 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.289+0000 7f6da3e07640 1 -- 172.21.15.134:0/2987588203 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ea8008070 con 0x560897f018f0 2024-04-24T02:14:11.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.289+0000 7f6da3e07640 1 -- 172.21.15.134:0/2987588203 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ea800d500 con 0x560897f018f0 2024-04-24T02:14:11.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.289+0000 7f6da3e07640 1 -- 172.21.15.134:0/2987588203 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ea800d840 con 0x560897f018f0 2024-04-24T02:14:11.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.290+0000 7f6eba413800 1 -- 172.21.15.134:0/2987588203 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560897f018f0 msgr2=0x560897f01230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.290+0000 7f6eba413800 1 --2- 172.21.15.134:0/2987588203 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560897f018f0 0x560897f01230 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f6ea800b210 tx=0x7f6ea800b6d0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.290+0000 7f6eba413800 1 -- 172.21.15.134:0/2987588203 shutdown_connections 2024-04-24T02:14:11.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.290+0000 7f6eba413800 1 --2- 172.21.15.134:0/2987588203 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560897f018f0 0x560897f01230 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.290+0000 7f6eba413800 1 -- 172.21.15.134:0/2987588203 >> 172.21.15.134:0/2987588203 conn(0x560897efb320 msgr2=0x560897fed850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:11.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.290+0000 7f6eba413800 1 -- 172.21.15.134:0/2987588203 shutdown_connections 2024-04-24T02:14:11.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.290+0000 7f6eba413800 1 -- 172.21.15.134:0/2987588203 wait complete. 2024-04-24T02:14:11.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.290+0000 7f6eba413800 1 Processor -- start 2024-04-24T02:14:11.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.290+0000 7f6eba413800 1 -- start start 2024-04-24T02:14:11.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.291+0000 7f6eba413800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560897f018f0 0x560897ffbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.291+0000 7f6eba413800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560897f08030 con 0x560897f018f0 2024-04-24T02:14:11.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.291+0000 7f6eb5b47640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560897f018f0 0x560897ffbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.291+0000 7f6eb5b47640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560897f018f0 0x560897ffbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43834/0 (socket says 172.21.15.134:43834) 2024-04-24T02:14:11.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.291+0000 7f6eb5b47640 1 -- 172.21.15.134:0/798783471 learned_addr learned my addr 172.21.15.134:0/798783471 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:11.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.291+0000 7f6eb5b47640 1 -- 172.21.15.134:0/798783471 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560897ffc1f0 con 0x560897f018f0 2024-04-24T02:14:11.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.291+0000 7f6eb5b47640 1 --2- 172.21.15.134:0/798783471 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560897f018f0 0x560897ffbcb0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f6ea800b210 tx=0x7f6ea8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.291+0000 7f6da2604640 1 -- 172.21.15.134:0/798783471 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ea800f950 con 0x560897f018f0 2024-04-24T02:14:11.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.291+0000 7f6da2604640 1 -- 172.21.15.134:0/798783471 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ea800faf0 con 0x560897f018f0 2024-04-24T02:14:11.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.291+0000 7f6eba413800 1 -- 172.21.15.134:0/798783471 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560897ffc480 con 0x560897f018f0 2024-04-24T02:14:11.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.291+0000 7f6da2604640 1 -- 172.21.15.134:0/798783471 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ea800fdd0 con 0x560897f018f0 2024-04-24T02:14:11.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.292+0000 7f6eba413800 1 -- 172.21.15.134:0/798783471 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560897fff130 con 0x560897f018f0 2024-04-24T02:14:11.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.292+0000 7f6da2604640 1 -- 172.21.15.134:0/798783471 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6ea8017040 con 0x560897f018f0 2024-04-24T02:14:11.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.292+0000 7f6da2604640 1 --2- 172.21.15.134:0/798783471 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6d9c036900 0x7f6d9c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.292+0000 7f6da2604640 1 -- 172.21.15.134:0/798783471 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f6ea8015020 con 0x560897f018f0 2024-04-24T02:14:11.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.293+0000 7f6eb5346640 1 --2- 172.21.15.134:0/798783471 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6d9c036900 0x7f6d9c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.293+0000 7f6eba413800 1 --2- 172.21.15.134:0/798783471 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560897f05400 0x560898002ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.293+0000 7f6eba413800 1 -- 172.21.15.134:0/798783471 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560898003430 con 0x560897f05400 2024-04-24T02:14:11.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.293+0000 7f6eb6348640 1 --2- 172.21.15.134:0/798783471 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560897f05400 0x560898002ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.293+0000 7f6eb5346640 1 --2- 172.21.15.134:0/798783471 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6d9c036900 0x7f6d9c038dc0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6eac054000 tx=0x7f6eac04e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.293+0000 7f6eb6348640 1 --2- 172.21.15.134:0/798783471 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560897f05400 0x560898002ef0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.293+0000 7f6eb6348640 1 -- 172.21.15.134:0/798783471 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6eb000a4a0 con 0x560897f05400 2024-04-24T02:14:11.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.293+0000 7f6eba413800 1 -- 172.21.15.134:0/798783471 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608980004a0 con 0x560897f05400 2024-04-24T02:14:11.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.294+0000 7f6eb6348640 1 -- 172.21.15.134:0/798783471 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6eb000a4a0 con 0x560897f05400 2024-04-24T02:14:11.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.294+0000 7f6eba413800 1 -- 172.21.15.134:0/798783471 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560898005240 con 0x560897f05400 2024-04-24T02:14:11.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.294+0000 7f6eb6348640 1 -- 172.21.15.134:0/798783471 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6eb000a4a0 con 0x560897f05400 2024-04-24T02:14:11.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.294+0000 7f6eba413800 1 -- 172.21.15.134:0/798783471 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560898004580 con 0x560897f05400 2024-04-24T02:14:11.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.294+0000 7f6eb6348640 1 -- 172.21.15.134:0/798783471 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6eb000a4a0 con 0x560897f05400 2024-04-24T02:14:11.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.294+0000 7f6eba413800 1 -- 172.21.15.134:0/798783471 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608980049a0 con 0x560897f05400 2024-04-24T02:14:11.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.294+0000 7f6eb6348640 1 -- 172.21.15.134:0/798783471 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6eb000a4a0 con 0x560897f05400 2024-04-24T02:14:11.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.295+0000 7f6eba413800 1 Processor -- start 2024-04-24T02:14:11.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.295+0000 7f6eba413800 1 -- start start 2024-04-24T02:14:11.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.295+0000 7f6eba413800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560898014050 0x560898014470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.295+0000 7f6eba413800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560897df26b0 con 0x560898014050 2024-04-24T02:14:11.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.295+0000 7f6eb5346640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560898014050 0x560898014470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.295+0000 7f6eb5346640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560898014050 0x560898014470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43840/0 (socket says 172.21.15.134:43840) 2024-04-24T02:14:11.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.295+0000 7f6eb5346640 1 -- 172.21.15.134:0/410159441 learned_addr learned my addr 172.21.15.134:0/410159441 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:11.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.295+0000 7f6eb5346640 1 -- 172.21.15.134:0/410159441 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608980149b0 con 0x560898014050 2024-04-24T02:14:11.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.295+0000 7f6eb5346640 1 --2- 172.21.15.134:0/410159441 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560898014050 0x560898014470 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f6eac044840 tx=0x7f6eac002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.296+0000 7f6d9b7fe640 1 -- 172.21.15.134:0/410159441 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6eac06f070 con 0x560898014050 2024-04-24T02:14:11.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.296+0000 7f6d9b7fe640 1 -- 172.21.15.134:0/410159441 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eac058040 con 0x560898014050 2024-04-24T02:14:11.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.296+0000 7f6eba413800 1 -- 172.21.15.134:0/410159441 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560898015420 con 0x560898014050 2024-04-24T02:14:11.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.296+0000 7f6d9b7fe640 1 -- 172.21.15.134:0/410159441 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6eac057050 con 0x560898014050 2024-04-24T02:14:11.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.296+0000 7f6eba413800 1 -- 172.21.15.134:0/410159441 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608980158c0 con 0x560898014050 2024-04-24T02:14:11.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.296+0000 7f6d9b7fe640 1 -- 172.21.15.134:0/410159441 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6eac072070 con 0x560898014050 2024-04-24T02:14:11.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.296+0000 7f6d9b7fe640 1 --2- 172.21.15.134:0/410159441 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6d90036900 0x7f6d90038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.297+0000 7f6d9b7fe640 1 -- 172.21.15.134:0/410159441 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f6eac08f9f0 con 0x560898014050 2024-04-24T02:14:11.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.297+0000 7f6eb6348640 1 --2- 172.21.15.134:0/410159441 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6d90036900 0x7f6d90038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.297+0000 7f6eba413800 1 Processor -- start 2024-04-24T02:14:11.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.297+0000 7f6eb6348640 1 --2- 172.21.15.134:0/410159441 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6d90036900 0x7f6d90038dc0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x560898004920 tx=0x7f6eb0005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.297+0000 7f6eba413800 1 -- start start 2024-04-24T02:14:11.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.297+0000 7f6eba413800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5608980212d0 0x5608980216f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.297+0000 7f6eba413800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560897effb70 con 0x5608980212d0 2024-04-24T02:14:11.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.297+0000 7f6eb5346640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5608980212d0 0x5608980216f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.297+0000 7f6eb5346640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5608980212d0 0x5608980216f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43848/0 (socket says 172.21.15.134:43848) 2024-04-24T02:14:11.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.297+0000 7f6eb5346640 1 -- 172.21.15.134:0/1041925741 learned_addr learned my addr 172.21.15.134:0/1041925741 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:11.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.297+0000 7f6eb5346640 1 -- 172.21.15.134:0/1041925741 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560898021cc0 con 0x5608980212d0 2024-04-24T02:14:11.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.298+0000 7f6eb5346640 1 --2- 172.21.15.134:0/1041925741 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5608980212d0 0x5608980216f0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f6eac08ddd0 tx=0x7f6eac08df10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f456ddaf149239f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.298+0000 7f6d997fa640 1 -- 172.21.15.134:0/1041925741 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6eac05ead0 con 0x5608980212d0 2024-04-24T02:14:11.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.298+0000 7f6d997fa640 1 -- 172.21.15.134:0/1041925741 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eac05e480 con 0x5608980212d0 2024-04-24T02:14:11.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.298+0000 7f6d997fa640 1 -- 172.21.15.134:0/1041925741 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6eac073c00 con 0x5608980212d0 2024-04-24T02:14:11.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.298+0000 7f6eba413800 1 -- 172.21.15.134:0/1041925741 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5608980212d0 msgr2=0x5608980216f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.298+0000 7f6eba413800 1 --2- 172.21.15.134:0/1041925741 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5608980212d0 0x5608980216f0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f6eac08ddd0 tx=0x7f6eac08df10 comp rx=0 tx=0).stop 2024-04-24T02:14:11.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.298+0000 7f6eba413800 1 -- 172.21.15.134:0/1041925741 shutdown_connections 2024-04-24T02:14:11.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.298+0000 7f6eba413800 1 --2- 172.21.15.134:0/1041925741 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5608980212d0 0x5608980216f0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.298+0000 7f6eba413800 1 -- 172.21.15.134:0/1041925741 >> 172.21.15.134:0/1041925741 conn(0x56089801d630 msgr2=0x56089801b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:11.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.298+0000 7f6eba413800 1 -- 172.21.15.134:0/1041925741 shutdown_connections 2024-04-24T02:14:11.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.298+0000 7f6eba413800 1 -- 172.21.15.134:0/1041925741 wait complete. 2024-04-24T02:14:11.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.298+0000 7f6eba413800 1 Processor -- start 2024-04-24T02:14:11.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.299+0000 7f6eba413800 1 -- start start 2024-04-24T02:14:11.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.299+0000 7f6eba413800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5608980212d0 0x560898028970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.299+0000 7f6eba413800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560898022430 con 0x5608980212d0 2024-04-24T02:14:11.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.299+0000 7f6eb5346640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5608980212d0 0x560898028970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.299+0000 7f6eb5346640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5608980212d0 0x560898028970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43852/0 (socket says 172.21.15.134:43852) 2024-04-24T02:14:11.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.299+0000 7f6eb5346640 1 -- 172.21.15.134:0/1450733704 learned_addr learned my addr 172.21.15.134:0/1450733704 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:11.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.299+0000 7f6eb5346640 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560898028eb0 con 0x5608980212d0 2024-04-24T02:14:11.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.299+0000 7f6eb5346640 1 --2- 172.21.15.134:0/1450733704 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5608980212d0 0x560898028970 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f6eac08cd40 tx=0x7f6eac08dd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.299+0000 7f6d877fe640 1 -- 172.21.15.134:0/1450733704 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6eac072570 con 0x5608980212d0 2024-04-24T02:14:11.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.299+0000 7f6d877fe640 1 -- 172.21.15.134:0/1450733704 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eac093030 con 0x5608980212d0 2024-04-24T02:14:11.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.299+0000 7f6d877fe640 1 -- 172.21.15.134:0/1450733704 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6eac05fc50 con 0x5608980212d0 2024-04-24T02:14:11.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.299+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560898029140 con 0x5608980212d0 2024-04-24T02:14:11.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.300+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56089802bdf0 con 0x5608980212d0 2024-04-24T02:14:11.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.300+0000 7f6d877fe640 1 -- 172.21.15.134:0/1450733704 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6eac086070 con 0x5608980212d0 2024-04-24T02:14:11.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.300+0000 7f6d877fe640 1 --2- 172.21.15.134:0/1450733704 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6d80036900 0x7f6d80038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.300+0000 7f6d877fe640 1 -- 172.21.15.134:0/1450733704 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f6eac099bd0 con 0x5608980212d0 2024-04-24T02:14:11.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.300+0000 7f6eb6348640 1 --2- 172.21.15.134:0/1450733704 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6d80036900 0x7f6d80038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.301+0000 7f6eb6348640 1 --2- 172.21.15.134:0/1450733704 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6d80036900 0x7f6d80038dc0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x5608980040a0 tx=0x7f6eb001f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.301+0000 7f6eba413800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.301+0000 7f6eba413800 1 --2- 172.21.15.134:0/1450733704 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560898034460 0x560898036920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.301+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560898037070 con 0x560898034460 2024-04-24T02:14:11.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.301+0000 7f6eb5b47640 1 --2- 172.21.15.134:0/1450733704 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560898034460 0x560898036920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.301+0000 7f6eb5b47640 1 --2- 172.21.15.134:0/1450733704 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560898034460 0x560898036920 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.301+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ea802d070 con 0x560898034460 2024-04-24T02:14:11.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.301+0000 7f6eba413800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:11.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.301+0000 7f6eba413800 20 realm 2024-04-24T02:14:11.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.301+0000 7f6eba413800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.301+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560898037480 con 0x560898034460 2024-04-24T02:14:11.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.302+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ea802d070 con 0x560898034460 2024-04-24T02:14:11.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.302+0000 7f6eba413800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:11.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.302+0000 7f6eba413800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:14:11.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.302+0000 7f6eba413800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.302+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560898037d50 con 0x560898034460 2024-04-24T02:14:11.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.302+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ea802d070 con 0x560898034460 2024-04-24T02:14:11.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.302+0000 7f6eba413800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:11.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.302+0000 7f6eba413800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.302+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608980380f0 con 0x560898034460 2024-04-24T02:14:11.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.302+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6ea802d070 con 0x560898034460 2024-04-24T02:14:11.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.302+0000 7f6eba413800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:14:11.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.302+0000 7f6eba413800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.302+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560898038940 con 0x560898034460 2024-04-24T02:14:11.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.302+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6ea802d070 con 0x560898034460 2024-04-24T02:14:11.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.302+0000 7f6eba413800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:14:11.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.302+0000 7f6eba413800 20 searching for the correct realm 2024-04-24T02:14:11.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.302+0000 7f6eba413800 1 --2- 172.21.15.134:0/1450733704 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x56089803a6b0 0x56089803caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.302+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56089803d080 con 0x56089803a6b0 2024-04-24T02:14:11.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.303+0000 7f6eb5346640 1 --2- 172.21.15.134:0/1450733704 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x56089803a6b0 0x56089803caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.303+0000 7f6eb5346640 1 --2- 172.21.15.134:0/1450733704 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x56089803a6b0 0x56089803caa0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.303+0000 7f6eb5346640 1 -- 172.21.15.134:0/1450733704 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6eac071030 con 0x56089803a6b0 2024-04-24T02:14:11.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.303+0000 7f6eb5346640 1 --2- 172.21.15.134:0/1450733704 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f6eac074060 0x7f6eac002290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.303+0000 7f6eb5346640 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56089803d080 con 0x7f6eac074060 2024-04-24T02:14:11.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.303+0000 7f6eb6348640 1 --2- 172.21.15.134:0/1450733704 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f6eac074060 0x7f6eac002290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.303+0000 7f6eb6348640 1 --2- 172.21.15.134:0/1450733704 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f6eac074060 0x7f6eac002290 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.304+0000 7f6eb6348640 1 -- 172.21.15.134:0/1450733704 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6eb001f070 con 0x7f6eac074060 2024-04-24T02:14:11.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.304+0000 7f6eb6348640 1 --2- 172.21.15.134:0/1450733704 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f6eb0031040 0x7f6eb0032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.304+0000 7f6eb6348640 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56089803d080 con 0x7f6eb0031040 2024-04-24T02:14:11.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.304+0000 7f6eb5b47640 1 --2- 172.21.15.134:0/1450733704 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f6eb0031040 0x7f6eb0032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.304+0000 7f6eb5b47640 1 --2- 172.21.15.134:0/1450733704 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f6eb0031040 0x7f6eb0032430 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.305+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ea8048040 con 0x7f6eb0031040 2024-04-24T02:14:11.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.305+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56089803d080 con 0x560898034460 2024-04-24T02:14:11.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.305+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ea8048040 con 0x560898034460 2024-04-24T02:14:11.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.305+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56089803d080 con 0x560898034460 2024-04-24T02:14:11.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.305+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6ea8048040 con 0x560898034460 2024-04-24T02:14:11.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.305+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56089803d080 con 0x7f6eb0031040 2024-04-24T02:14:11.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.305+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ea8048040 con 0x7f6eb0031040 2024-04-24T02:14:11.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.305+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56089803d080 con 0x7f6eac074060 2024-04-24T02:14:11.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.305+0000 7f6eb6348640 1 -- 172.21.15.134:0/1450733704 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6eb001f070 con 0x7f6eac074060 2024-04-24T02:14:11.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.305+0000 7f6eb6348640 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56089803d080 con 0x7f6eac074060 2024-04-24T02:14:11.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.306+0000 7f6eb6348640 1 -- 172.21.15.134:0/1450733704 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6eb001f070 con 0x7f6eac074060 2024-04-24T02:14:11.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.306+0000 7f6eb6348640 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56089803d080 con 0x56089803a6b0 2024-04-24T02:14:11.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.306+0000 7f6eb5346640 1 -- 172.21.15.134:0/1450733704 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6eac071030 con 0x56089803a6b0 2024-04-24T02:14:11.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.306+0000 7f6eb5346640 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56089803d080 con 0x560898034460 2024-04-24T02:14:11.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.306+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ea8048040 con 0x560898034460 2024-04-24T02:14:11.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.306+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56089803d080 con 0x7f6eb0031040 2024-04-24T02:14:11.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.306+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ea8048040 con 0x7f6eb0031040 2024-04-24T02:14:11.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.306+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56089803d080 con 0x560898034460 2024-04-24T02:14:11.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.306+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ea8048040 con 0x560898034460 2024-04-24T02:14:11.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.306+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56089803d080 con 0x7f6eac074060 2024-04-24T02:14:11.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.307+0000 7f6eb6348640 1 -- 172.21.15.134:0/1450733704 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6eb001f070 con 0x7f6eac074060 2024-04-24T02:14:11.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.307+0000 7f6eb6348640 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56089803d080 con 0x56089803a6b0 2024-04-24T02:14:11.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.307+0000 7f6eb5346640 1 -- 172.21.15.134:0/1450733704 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6eac071030 con 0x56089803a6b0 2024-04-24T02:14:11.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.307+0000 7f6eb5346640 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56089803d080 con 0x56089803a6b0 2024-04-24T02:14:11.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.307+0000 7f6eb5346640 1 -- 172.21.15.134:0/1450733704 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6eac071030 con 0x56089803a6b0 2024-04-24T02:14:11.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.307+0000 7f6eb5346640 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56089803d080 con 0x7f6eac074060 2024-04-24T02:14:11.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.307+0000 7f6eb6348640 1 -- 172.21.15.134:0/1450733704 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6eb001f070 con 0x7f6eac074060 2024-04-24T02:14:11.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.307+0000 7f6eb6348640 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56089803d080 con 0x56089803a6b0 2024-04-24T02:14:11.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.308+0000 7f6eb5346640 1 -- 172.21.15.134:0/1450733704 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6eac071030 con 0x56089803a6b0 2024-04-24T02:14:11.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.308+0000 7f6eb5346640 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56089803d080 con 0x56089803a6b0 2024-04-24T02:14:11.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.308+0000 7f6eb5346640 1 -- 172.21.15.134:0/1450733704 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6eac071030 con 0x56089803a6b0 2024-04-24T02:14:11.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.308+0000 7f6eb5346640 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56089803d080 con 0x560898034460 2024-04-24T02:14:11.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.308+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ea8048040 con 0x560898034460 2024-04-24T02:14:11.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.308+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56089803d080 con 0x560898034460 2024-04-24T02:14:11.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.308+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=132b] v32'6 uv6 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f6ea8048040 con 0x560898034460 2024-04-24T02:14:11.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.308+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56089803d080 con 0x7f6eb0031040 2024-04-24T02:14:11.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.309+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ea8048040 con 0x7f6eb0031040 2024-04-24T02:14:11.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.309+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56089803d080 con 0x56089803a6b0 2024-04-24T02:14:11.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.309+0000 7f6eb5346640 1 -- 172.21.15.134:0/1450733704 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6eac071030 con 0x56089803a6b0 2024-04-24T02:14:11.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.309+0000 7f6eb5346640 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56089803d080 con 0x7f6eac074060 2024-04-24T02:14:11.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.309+0000 7f6eb6348640 1 -- 172.21.15.134:0/1450733704 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6eb001f070 con 0x7f6eac074060 2024-04-24T02:14:11.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.309+0000 7f6eb6348640 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56089803d080 con 0x560898034460 2024-04-24T02:14:11.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.309+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ea8048040 con 0x560898034460 2024-04-24T02:14:11.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.309+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56089803d080 con 0x7f6eb0031040 2024-04-24T02:14:11.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.309+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ea8054040 con 0x7f6eb0031040 2024-04-24T02:14:11.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.309+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56089803d080 con 0x56089803a6b0 2024-04-24T02:14:11.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.310+0000 7f6eb5346640 1 -- 172.21.15.134:0/1450733704 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6eac071030 con 0x56089803a6b0 2024-04-24T02:14:11.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.310+0000 7f6eb5346640 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56089803d080 con 0x7f6eb0031040 2024-04-24T02:14:11.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.310+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ea8054040 con 0x7f6eb0031040 2024-04-24T02:14:11.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.310+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56089803d080 con 0x7f6eac074060 2024-04-24T02:14:11.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.310+0000 7f6eb6348640 1 -- 172.21.15.134:0/1450733704 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6eb0040040 con 0x7f6eac074060 2024-04-24T02:14:11.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.310+0000 7f6eb6348640 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56089803d080 con 0x56089803a6b0 2024-04-24T02:14:11.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.310+0000 7f6eb5346640 1 -- 172.21.15.134:0/1450733704 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6eac071030 con 0x56089803a6b0 2024-04-24T02:14:11.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.310+0000 7f6eb5346640 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56089803d080 con 0x7f6eac074060 2024-04-24T02:14:11.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.311+0000 7f6eb6348640 1 -- 172.21.15.134:0/1450733704 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6eb0040040 con 0x7f6eac074060 2024-04-24T02:14:11.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.311+0000 7f6eb6348640 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56089803d080 con 0x560898034460 2024-04-24T02:14:11.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.311+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6ea8054040 con 0x560898034460 2024-04-24T02:14:11.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.311+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56089803d080 con 0x7f6eac074060 2024-04-24T02:14:11.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.311+0000 7f6eb6348640 1 -- 172.21.15.134:0/1450733704 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6eb0040040 con 0x7f6eac074060 2024-04-24T02:14:11.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.311+0000 7f6eba413800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:14:11.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.311+0000 7f6eba413800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:14:11.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.311+0000 7f6eba413800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:14:11.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.311+0000 7f6eba413800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:14:11.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.311+0000 7f6eba413800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:14:11.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.311+0000 7f6eba413800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:14:11.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.311+0000 7f6eba413800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.311+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560898039290 con 0x560898034460 2024-04-24T02:14:11.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.311+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ea8054040 con 0x560898034460 2024-04-24T02:14:11.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.311+0000 7f6eba413800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:11.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.311+0000 7f6eba413800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.311+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560898039b30 con 0x560898034460 2024-04-24T02:14:11.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.312+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6ea8054040 con 0x560898034460 2024-04-24T02:14:11.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.312+0000 7f6eba413800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:14:11.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.312+0000 7f6eba413800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.312+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56089803d500 con 0x560898034460 2024-04-24T02:14:11.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.312+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6ea8054040 con 0x560898034460 2024-04-24T02:14:11.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.312+0000 7f6eba413800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:14:11.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.312+0000 7f6eba413800 20 zone default found 2024-04-24T02:14:11.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.312+0000 7f6eba413800 4 Realm: () 2024-04-24T02:14:11.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.312+0000 7f6eba413800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:14:11.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.312+0000 7f6eba413800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:14:11.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.312+0000 7f6eba413800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:14:11.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.312+0000 7f6eba413800 20 zonegroup default 2024-04-24T02:14:11.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.312+0000 7f6eba413800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.312+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560898039780 con 0x7f6eb0031040 2024-04-24T02:14:11.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.312+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6ea8054040 con 0x7f6eb0031040 2024-04-24T02:14:11.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.312+0000 7f6eba413800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:11.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.312+0000 7f6eba413800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.312+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56089803f8e0 con 0x56089803a6b0 2024-04-24T02:14:11.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.313+0000 7f6eb5346640 1 -- 172.21.15.134:0/1450733704 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6eac071030 con 0x56089803a6b0 2024-04-24T02:14:11.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.313+0000 7f6eba413800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:11.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.313+0000 7f6eba413800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.313+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56089803fc80 con 0x56089803a6b0 2024-04-24T02:14:11.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.313+0000 7f6eb5346640 1 -- 172.21.15.134:0/1450733704 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6eac071030 con 0x56089803a6b0 2024-04-24T02:14:11.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.313+0000 7f6eba413800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:11.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.313+0000 7f6eba413800 20 started sync module instance, tier type = 2024-04-24T02:14:11.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.313+0000 7f6eba413800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:14:11.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.313+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56089803ed70 con 0x7f6eac074060 2024-04-24T02:14:11.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.314+0000 7f6eb6348640 1 -- 172.21.15.134:0/1450733704 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(44 notify.0 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6eb0040040 con 0x7f6eac074060 2024-04-24T02:14:11.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.314+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94594910122384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560898040540 con 0x7f6eac074060 2024-04-24T02:14:11.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.314+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560898040d90 con 0x560898034460 2024-04-24T02:14:11.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.315+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ea8054040 con 0x560898034460 2024-04-24T02:14:11.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.315+0000 7f6eb6348640 1 -- 172.21.15.134:0/1450733704 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94594910122384] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6eb0040040 con 0x7f6eac074060 2024-04-24T02:14:11.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.315+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94594910127424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560898040f90 con 0x560898034460 2024-04-24T02:14:11.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.315+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560898040090 con 0x56089803a6b0 2024-04-24T02:14:11.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.316+0000 7f6eb5346640 1 -- 172.21.15.134:0/1450733704 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6eac071030 con 0x56089803a6b0 2024-04-24T02:14:11.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.316+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94594910131584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560898041e50 con 0x56089803a6b0 2024-04-24T02:14:11.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.316+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608980428a0 con 0x7f6eac074060 2024-04-24T02:14:11.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.317+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94594910127424] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ea8054040 con 0x560898034460 2024-04-24T02:14:11.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.317+0000 7f6eb5346640 1 -- 172.21.15.134:0/1450733704 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94594910131584] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6eac071030 con 0x56089803a6b0 2024-04-24T02:14:11.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.317+0000 7f6eb6348640 1 -- 172.21.15.134:0/1450733704 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(50 notify.3 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6eb0040040 con 0x7f6eac074060 2024-04-24T02:14:11.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.317+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94594910132640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608980409e0 con 0x7f6eac074060 2024-04-24T02:14:11.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.317+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608980432b0 con 0x560898034460 2024-04-24T02:14:11.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.318+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ea8054040 con 0x560898034460 2024-04-24T02:14:11.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.318+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94594910137856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608980436d0 con 0x560898034460 2024-04-24T02:14:11.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.319+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560898044120 con 0x7f6eb0031040 2024-04-24T02:14:11.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.319+0000 7f6eb6348640 1 -- 172.21.15.134:0/1450733704 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94594910132640] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6eb0040040 con 0x7f6eac074060 2024-04-24T02:14:11.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.320+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(54 notify.5 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ea8054040 con 0x7f6eb0031040 2024-04-24T02:14:11.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.320+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94594910141456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608980440e0 con 0x7f6eb0031040 2024-04-24T02:14:11.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.320+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94594910137856] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ea8054040 con 0x560898034460 2024-04-24T02:14:11.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.320+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560898044b30 con 0x7f6eb0031040 2024-04-24T02:14:11.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.321+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94594910141456] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ea8054040 con 0x7f6eb0031040 2024-04-24T02:14:11.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.321+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(56 notify.6 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ea8054040 con 0x7f6eb0031040 2024-04-24T02:14:11.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.321+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94594910138992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560898044680 con 0x7f6eb0031040 2024-04-24T02:14:11.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.321+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560898045040 con 0x7f6eb0031040 2024-04-24T02:14:11.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.322+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94594910138992] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ea8054040 con 0x7f6eb0031040 2024-04-24T02:14:11.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.322+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(58 notify.7 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ea8054040 con 0x7f6eb0031040 2024-04-24T02:14:11.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.322+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94594910135184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560898045040 con 0x7f6eb0031040 2024-04-24T02:14:11.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.322+0000 7f6eba413800 20 add_watcher() i=0 2024-04-24T02:14:11.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.322+0000 7f6eba413800 20 add_watcher() i=1 2024-04-24T02:14:11.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.322+0000 7f6eba413800 20 add_watcher() i=2 2024-04-24T02:14:11.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.322+0000 7f6eba413800 20 add_watcher() i=3 2024-04-24T02:14:11.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.322+0000 7f6eba413800 20 add_watcher() i=4 2024-04-24T02:14:11.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.322+0000 7f6eba413800 20 add_watcher() i=5 2024-04-24T02:14:11.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.322+0000 7f6eba413800 20 add_watcher() i=6 2024-04-24T02:14:11.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.323+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94594910135184] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ea8054040 con 0x7f6eb0031040 2024-04-24T02:14:11.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.323+0000 7f6eba413800 20 add_watcher() i=7 2024-04-24T02:14:11.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.323+0000 7f6eba413800 2 all 8 watchers are set, enabling cache 2024-04-24T02:14:11.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.323+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560898048320 con 0x560898034460 2024-04-24T02:14:11.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.323+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6ea8054040 con 0x560898034460 2024-04-24T02:14:11.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.323+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94594910145792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608980455d0 con 0x560898034460 2024-04-24T02:14:11.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.324+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94594910145792] v32'259 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6ea8054040 con 0x560898034460 2024-04-24T02:14:11.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.324+0000 7f6d677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:14:11.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.324+0000 7f6eba413800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:14:11.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.324+0000 7f6eba413800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:14:11.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.324+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560898047b10 con 0x560898034460 2024-04-24T02:14:11.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.326+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'60 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6ea8054040 con 0x560898034460 2024-04-24T02:14:11.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.326+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608980513e0 con 0x7f6eb0031040 2024-04-24T02:14:11.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.327+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'37 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6ea8054040 con 0x7f6eb0031040 2024-04-24T02:14:11.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.327+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608980513e0 con 0x56089803a6b0 2024-04-24T02:14:11.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.328+0000 7f6eb5346640 1 -- 172.21.15.134:0/1450733704 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6eac071030 con 0x56089803a6b0 2024-04-24T02:14:11.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.328+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560898051c80 con 0x560898034460 2024-04-24T02:14:11.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.329+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'260 uv169 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6ea8054040 con 0x560898034460 2024-04-24T02:14:11.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.329+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560898051c80 con 0x7f6eac074060 2024-04-24T02:14:11.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.330+0000 7f6eb6348640 1 -- 172.21.15.134:0/1450733704 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'88 uv58 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6eb0040040 con 0x7f6eac074060 2024-04-24T02:14:11.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.330+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560898050a50 con 0x56089803a6b0 2024-04-24T02:14:11.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.330+0000 7f6eb5346640 1 -- 172.21.15.134:0/1450733704 <== osd.3 v2:172.21.15.134:6801/3585115521 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'68 uv48 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6eac071030 con 0x56089803a6b0 2024-04-24T02:14:11.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.330+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608980527e0 con 0x560898034460 2024-04-24T02:14:11.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.332+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6ea8054040 con 0x560898034460 2024-04-24T02:14:11.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.332+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608980527e0 con 0x7f6eb0031040 2024-04-24T02:14:11.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.333+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'60 uv41 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6ea8054040 con 0x7f6eb0031040 2024-04-24T02:14:11.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.333+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608980527e0 con 0x7f6eac074060 2024-04-24T02:14:11.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.334+0000 7f6eb6348640 1 -- 172.21.15.134:0/1450733704 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6eb0040040 con 0x7f6eac074060 2024-04-24T02:14:11.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.334+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560898052c90 con 0x56089803a6b0 2024-04-24T02:14:11.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.335+0000 7f6eb5346640 1 -- 172.21.15.134:0/1450733704 <== osd.3 v2:172.21.15.134:6801/3585115521 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6eac071030 con 0x56089803a6b0 2024-04-24T02:14:11.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.335+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560898052c90 con 0x7f6eac074060 2024-04-24T02:14:11.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.336+0000 7f6eb6348640 1 -- 172.21.15.134:0/1450733704 <== osd.2 v2:172.21.15.134:6800/214480313 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'89 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6eb0040040 con 0x7f6eac074060 2024-04-24T02:14:11.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.336+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560898052e60 con 0x7f6eb0031040 2024-04-24T02:14:11.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.337+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'36 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6ea8054040 con 0x7f6eb0031040 2024-04-24T02:14:11.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.337+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560898052e60 con 0x7f6eac074060 2024-04-24T02:14:11.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.338+0000 7f6eb6348640 1 -- 172.21.15.134:0/1450733704 <== osd.2 v2:172.21.15.134:6800/214480313 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6eb0040040 con 0x7f6eac074060 2024-04-24T02:14:11.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.338+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560898053410 con 0x7f6eb0031040 2024-04-24T02:14:11.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.339+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'71 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6ea8054040 con 0x7f6eb0031040 2024-04-24T02:14:11.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.339+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560898053410 con 0x560898034460 2024-04-24T02:14:11.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.340+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'261 uv171 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6ea8054040 con 0x560898034460 2024-04-24T02:14:11.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.340+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560898053410 con 0x56089803a6b0 2024-04-24T02:14:11.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.341+0000 7f6eb5346640 1 -- 172.21.15.134:0/1450733704 <== osd.3 v2:172.21.15.134:6801/3585115521 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'80 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6eac071030 con 0x56089803a6b0 2024-04-24T02:14:11.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.341+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560898053410 con 0x7f6eac074060 2024-04-24T02:14:11.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.342+0000 7f6eb6348640 1 -- 172.21.15.134:0/1450733704 <== osd.2 v2:172.21.15.134:6800/214480313 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'90 uv63 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6eb0040040 con 0x7f6eac074060 2024-04-24T02:14:11.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.342+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560898053410 con 0x56089803a6b0 2024-04-24T02:14:11.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.343+0000 7f6eb5346640 1 -- 172.21.15.134:0/1450733704 <== osd.3 v2:172.21.15.134:6801/3585115521 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'43 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6eac071030 con 0x56089803a6b0 2024-04-24T02:14:11.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.343+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560898053410 con 0x560898034460 2024-04-24T02:14:11.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.344+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6ea8054040 con 0x560898034460 2024-04-24T02:14:11.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.344+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560898052c90 con 0x560898034460 2024-04-24T02:14:11.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.345+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'262 uv173 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6ea8054040 con 0x560898034460 2024-04-24T02:14:11.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.345+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560898052e60 con 0x56089803a6b0 2024-04-24T02:14:11.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.347+0000 7f6eb5346640 1 -- 172.21.15.134:0/1450733704 <== osd.3 v2:172.21.15.134:6801/3585115521 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'81 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6eac071030 con 0x56089803a6b0 2024-04-24T02:14:11.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.347+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560898052e60 con 0x7f6eac074060 2024-04-24T02:14:11.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.348+0000 7f6eb6348640 1 -- 172.21.15.134:0/1450733704 <== osd.2 v2:172.21.15.134:6800/214480313 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'46 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6eb0040040 con 0x7f6eac074060 2024-04-24T02:14:11.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.348+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560898052e60 con 0x56089803a6b0 2024-04-24T02:14:11.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.349+0000 7f6eb5346640 1 -- 172.21.15.134:0/1450733704 <== osd.3 v2:172.21.15.134:6801/3585115521 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6eac071030 con 0x56089803a6b0 2024-04-24T02:14:11.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.349+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560898052e60 con 0x56089803a6b0 2024-04-24T02:14:11.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.350+0000 7f6eb5346640 1 -- 172.21.15.134:0/1450733704 <== osd.3 v2:172.21.15.134:6801/3585115521 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'48 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6eac071030 con 0x56089803a6b0 2024-04-24T02:14:11.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.350+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560898052e60 con 0x56089803a6b0 2024-04-24T02:14:11.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.351+0000 7f6eb5346640 1 -- 172.21.15.134:0/1450733704 <== osd.3 v2:172.21.15.134:6801/3585115521 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6eac071030 con 0x56089803a6b0 2024-04-24T02:14:11.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.351+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560898052c90 con 0x56089803a6b0 2024-04-24T02:14:11.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.352+0000 7f6eb5346640 1 -- 172.21.15.134:0/1450733704 <== osd.3 v2:172.21.15.134:6801/3585115521 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'69 uv50 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6eac071030 con 0x56089803a6b0 2024-04-24T02:14:11.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.352+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560898052c90 con 0x7f6eb0031040 2024-04-24T02:14:11.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.353+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6ea8054040 con 0x7f6eb0031040 2024-04-24T02:14:11.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.353+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560898052c90 con 0x56089803a6b0 2024-04-24T02:14:11.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.354+0000 7f6eb5346640 1 -- 172.21.15.134:0/1450733704 <== osd.3 v2:172.21.15.134:6801/3585115521 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'43 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6eac071030 con 0x56089803a6b0 2024-04-24T02:14:11.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.354+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560898052c90 con 0x7f6eb0031040 2024-04-24T02:14:11.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.355+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'61 uv43 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6ea8054040 con 0x7f6eb0031040 2024-04-24T02:14:11.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.355+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560898052c90 con 0x56089803a6b0 2024-04-24T02:14:11.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.356+0000 7f6eb5346640 1 -- 172.21.15.134:0/1450733704 <== osd.3 v2:172.21.15.134:6801/3585115521 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'82 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6eac071030 con 0x56089803a6b0 2024-04-24T02:14:11.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.356+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560898052c90 con 0x7f6eb0031040 2024-04-24T02:14:11.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.357+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.0 v2:172.21.15.104:6800/2419146313 20 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'72 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6ea8054040 con 0x7f6eb0031040 2024-04-24T02:14:11.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.357+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560898052c90 con 0x7f6eac074060 2024-04-24T02:14:11.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.359+0000 7f6eb6348640 1 -- 172.21.15.134:0/1450733704 <== osd.2 v2:172.21.15.134:6800/214480313 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6eb0040040 con 0x7f6eac074060 2024-04-24T02:14:11.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.359+0000 7f6d667fc640 20 reqs_thread_entry: start 2024-04-24T02:14:11.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.359+0000 7f6eba413800 20 init_complete bucket index max shards: 11 2024-04-24T02:14:11.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.359+0000 7f6eba413800 20 Filter name: none 2024-04-24T02:14:11.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.359+0000 7f6cd7fff640 20 reqs_thread_entry: start 2024-04-24T02:14:11.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.359+0000 7f6eba413800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-04-24T02:14:11.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.359+0000 7f6eba413800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.359+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:94 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56089807e3d0 con 0x56089803a6b0 2024-04-24T02:14:11.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.360+0000 7f6eb5346640 1 -- 172.21.15.134:0/1450733704 <== osd.3 v2:172.21.15.134:6801/3585115521 26 ==== osd_op_reply(94 a_user [call out=48b,read 0~363 out=363b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 234+0+486 (crc 0 0 0) 0x7f6eac071030 con 0x56089803a6b0 2024-04-24T02:14:11.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.360+0000 7f6eba413800 20 rados_obj.operate() r=0 bl.length=363 2024-04-24T02:14:11.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.360+0000 7f6eba413800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x13 2024-04-24T02:14:11.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.360+0000 7f6eba413800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-04-24T02:14:11.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.360+0000 7f6eba413800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:14:11.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.360+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:95 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560898080df0 con 0x56089803a6b0 2024-04-24T02:14:11.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.360+0000 7f6eb5346640 1 -- 172.21.15.134:0/1450733704 <== osd.3 v2:172.21.15.134:6801/3585115521 27 ==== osd_op_reply(95 a_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f6eac071030 con 0x56089803a6b0 2024-04-24T02:14:11.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.360+0000 7f6eba413800 10 removing key index: true_admin_akey 2024-04-24T02:14:11.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.360+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:96 8.15 8:afe09604:users.keys::true_admin_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56089807edd0 con 0x56089803a6b0 2024-04-24T02:14:11.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.361+0000 7f6eb5346640 1 -- 172.21.15.134:0/1450733704 <== osd.3 v2:172.21.15.134:6801/3585115521 28 ==== osd_op_reply(96 true_admin_akey [delete] v32'4 uv4 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f6eac071030 con 0x56089803a6b0 2024-04-24T02:14:11.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.361+0000 7f6eba413800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-04-24T02:14:11.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.361+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify cookie 94594910386400 in=177b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560898081300 con 0x7f6eb0031040 2024-04-24T02:14:11.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.361+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.0 v2:172.21.15.104:6800/2419146313 21 ==== watch-notify(notify (1) cookie 94594910141456 notify 137438953521 ret 0) ==== 207+0+0 (crc 0 0 0) 0x560898053410 con 0x7f6eb0031040 2024-04-24T02:14:11.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.361+0000 7f6d997fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953521 cookie 94594910141456 notifier 4858 bl.length()=165 2024-04-24T02:14:11.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.361+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.0 v2:172.21.15.104:6800/2419146313 22 ==== osd_op_reply(97 notify.5 [notify cookie 94594910386400 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6ea8054040 con 0x7f6eb0031040 2024-04-24T02:14:11.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.361+0000 7f6d997fa640 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6d78003d60 con 0x7f6eb0031040 2024-04-24T02:14:11.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.362+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.0 v2:172.21.15.104:6800/2419146313 23 ==== osd_op_reply(98 notify.5 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ea8054040 con 0x7f6eb0031040 2024-04-24T02:14:11.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.362+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.0 v2:172.21.15.104:6800/2419146313 24 ==== watch-notify(notify_complete (2) cookie 94594910386400 notify 137438953521 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5608980472d0 con 0x7f6eb0031040 2024-04-24T02:14:11.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.362+0000 7f6eba413800 10 removing email index: 2024-04-24T02:14:11.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.362+0000 7f6eba413800 10 removing user buckets index 2024-04-24T02:14:11.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.362+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:99 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560898081260 con 0x56089803a6b0 2024-04-24T02:14:11.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.362+0000 7f6eb5346640 1 -- 172.21.15.134:0/1450733704 <== osd.3 v2:172.21.15.134:6801/3585115521 29 ==== osd_op_reply(99 a_user.buckets [delete] v32'1 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f6eac071030 con 0x56089803a6b0 2024-04-24T02:14:11.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.362+0000 7f6eba413800 10 removing user index: a_user 2024-04-24T02:14:11.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.362+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:100 8.14 8:2efb937b:users.uid::a_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560898081260 con 0x56089803a6b0 2024-04-24T02:14:11.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.363+0000 7f6eb5346640 1 -- 172.21.15.134:0/1450733704 <== osd.3 v2:172.21.15.134:6801/3585115521 30 ==== osd_op_reply(100 a_user [call,call,delete] v32'4 uv4 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f6eac071030 con 0x56089803a6b0 2024-04-24T02:14:11.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.363+0000 7f6eba413800 10 removing default.rgw.meta+users.uid+a_user from cache 2024-04-24T02:14:11.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.363+0000 7f6eba413800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-04-24T02:14:11.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.363+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [notify cookie 94594910392928 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56089807f8e0 con 0x56089803a6b0 2024-04-24T02:14:11.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.364+0000 7f6eb5346640 1 -- 172.21.15.134:0/1450733704 <== osd.3 v2:172.21.15.134:6801/3585115521 31 ==== watch-notify(notify (1) cookie 94594910131584 notify 137438953492 ret 0) ==== 197+0+0 (crc 0 0 0) 0x5608980505a0 con 0x56089803a6b0 2024-04-24T02:14:11.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.364+0000 7f6d997fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953492 cookie 94594910131584 notifier 4858 bl.length()=155 2024-04-24T02:14:11.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.364+0000 7f6eb5346640 1 -- 172.21.15.134:0/1450733704 <== osd.3 v2:172.21.15.134:6801/3585115521 32 ==== osd_op_reply(101 notify.2 [notify cookie 94594910392928 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6eac071030 con 0x56089803a6b0 2024-04-24T02:14:11.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.364+0000 7f6d997fa640 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:102 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6d78003d60 con 0x56089803a6b0 2024-04-24T02:14:11.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.364+0000 7f6eb5346640 1 -- 172.21.15.134:0/1450733704 <== osd.3 v2:172.21.15.134:6801/3585115521 33 ==== watch-notify(notify_complete (2) cookie 94594910392928 notify 137438953492 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560898028eb0 con 0x56089803a6b0 2024-04-24T02:14:11.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.364+0000 7f6eb5346640 1 -- 172.21.15.134:0/1450733704 <== osd.3 v2:172.21.15.134:6801/3585115521 34 ==== osd_op_reply(102 notify.2 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6eac071030 con 0x56089803a6b0 2024-04-24T02:14:11.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.365+0000 7f6d677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:14:11.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.365+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94594910145792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56089804c730 con 0x560898034460 2024-04-24T02:14:11.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.366+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94594910145792] v32'263 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6ea8054040 con 0x560898034460 2024-04-24T02:14:11.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.366+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94594910122384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56089804c730 con 0x7f6eac074060 2024-04-24T02:14:11.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.367+0000 7f6eb6348640 1 -- 172.21.15.134:0/1450733704 <== osd.2 v2:172.21.15.134:6800/214480313 21 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94594910122384] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6eb0040040 con 0x7f6eac074060 2024-04-24T02:14:11.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.367+0000 7f6eba413800 20 remove_watcher() i=0 2024-04-24T02:14:11.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.367+0000 7f6eba413800 2 removed watcher, disabling cache 2024-04-24T02:14:11.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.367+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94594910127424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56089804c730 con 0x560898034460 2024-04-24T02:14:11.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.368+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.1 v2:172.21.15.134:6804/1487076214 30 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94594910127424] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ea8054040 con 0x560898034460 2024-04-24T02:14:11.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.368+0000 7f6eba413800 20 remove_watcher() i=1 2024-04-24T02:14:11.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.368+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94594910131584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56089804c730 con 0x56089803a6b0 2024-04-24T02:14:11.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.369+0000 7f6eb5346640 1 -- 172.21.15.134:0/1450733704 <== osd.3 v2:172.21.15.134:6801/3585115521 35 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94594910131584] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6eac071030 con 0x56089803a6b0 2024-04-24T02:14:11.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.369+0000 7f6eba413800 20 remove_watcher() i=2 2024-04-24T02:14:11.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.369+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94594910132640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56089804c730 con 0x7f6eac074060 2024-04-24T02:14:11.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.370+0000 7f6eb6348640 1 -- 172.21.15.134:0/1450733704 <== osd.2 v2:172.21.15.134:6800/214480313 22 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94594910132640] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6eb0040040 con 0x7f6eac074060 2024-04-24T02:14:11.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.370+0000 7f6eba413800 20 remove_watcher() i=3 2024-04-24T02:14:11.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.370+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94594910137856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56089804c730 con 0x560898034460 2024-04-24T02:14:11.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.371+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.1 v2:172.21.15.134:6804/1487076214 31 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94594910137856] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ea8054040 con 0x560898034460 2024-04-24T02:14:11.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.371+0000 7f6eba413800 20 remove_watcher() i=4 2024-04-24T02:14:11.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.371+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94594910141456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56089804c730 con 0x7f6eb0031040 2024-04-24T02:14:11.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.373+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.0 v2:172.21.15.104:6800/2419146313 25 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94594910141456] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ea8054040 con 0x7f6eb0031040 2024-04-24T02:14:11.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.373+0000 7f6eba413800 20 remove_watcher() i=5 2024-04-24T02:14:11.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.373+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94594910138992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56089804c730 con 0x7f6eb0031040 2024-04-24T02:14:11.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.374+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.0 v2:172.21.15.104:6800/2419146313 26 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94594910138992] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ea8054040 con 0x7f6eb0031040 2024-04-24T02:14:11.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.374+0000 7f6eba413800 20 remove_watcher() i=6 2024-04-24T02:14:11.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.374+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94594910135184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56089804c730 con 0x7f6eb0031040 2024-04-24T02:14:11.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.375+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 <== osd.0 v2:172.21.15.104:6800/2419146313 27 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94594910135184] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ea8054040 con 0x7f6eb0031040 2024-04-24T02:14:11.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.375+0000 7f6eba413800 20 remove_watcher() i=7 2024-04-24T02:14:11.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.375+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f6eb0031040 msgr2=0x7f6eb0032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.375+0000 7f6eba413800 1 --2- 172.21.15.134:0/1450733704 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f6eb0031040 0x7f6eb0032430 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.375+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560898034460 msgr2=0x560898036920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.375+0000 7f6eba413800 1 --2- 172.21.15.134:0/1450733704 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560898034460 0x560898036920 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.375+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f6eac074060 msgr2=0x7f6eac002290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.375+0000 7f6eba413800 1 --2- 172.21.15.134:0/1450733704 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f6eac074060 0x7f6eac002290 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.375+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x56089803a6b0 msgr2=0x56089803caa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.375+0000 7f6eba413800 1 --2- 172.21.15.134:0/1450733704 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x56089803a6b0 0x56089803caa0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.375+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6d80036900 msgr2=0x7f6d80038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.375+0000 7f6eba413800 1 --2- 172.21.15.134:0/1450733704 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6d80036900 0x7f6d80038dc0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x5608980040a0 tx=0x7f6eb001f000 comp rx=0 tx=0).stop 2024-04-24T02:14:11.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.375+0000 7f6eb5b47640 1 -- 172.21.15.134:0/1450733704 reap_dead start 2024-04-24T02:14:11.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.375+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5608980212d0 msgr2=0x560898028970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.375+0000 7f6eba413800 1 --2- 172.21.15.134:0/1450733704 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5608980212d0 0x560898028970 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f6eac08cd40 tx=0x7f6eac08dd60 comp rx=0 tx=0).stop 2024-04-24T02:14:11.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.375+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 shutdown_connections 2024-04-24T02:14:11.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.375+0000 7f6eba413800 1 --2- 172.21.15.134:0/1450733704 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5608980212d0 0x560898028970 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.375+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 >> 172.21.15.134:0/1450733704 conn(0x56089801d630 msgr2=0x56089801ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:11.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.375+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 shutdown_connections 2024-04-24T02:14:11.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.375+0000 7f6eba413800 1 -- 172.21.15.134:0/1450733704 wait complete. 2024-04-24T02:14:11.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.375+0000 7f6eba413800 1 -- 172.21.15.134:0/410159441 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6d90036900 msgr2=0x7f6d90038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.375+0000 7f6eba413800 1 --2- 172.21.15.134:0/410159441 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6d90036900 0x7f6d90038dc0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x560898004920 tx=0x7f6eb0005840 comp rx=0 tx=0).stop 2024-04-24T02:14:11.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.376+0000 7f6eba413800 1 -- 172.21.15.134:0/410159441 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560898014050 msgr2=0x560898014470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.376+0000 7f6eba413800 1 --2- 172.21.15.134:0/410159441 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560898014050 0x560898014470 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f6eac044840 tx=0x7f6eac002fb0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.376+0000 7f6eba413800 1 -- 172.21.15.134:0/410159441 shutdown_connections 2024-04-24T02:14:11.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.376+0000 7f6eba413800 1 --2- 172.21.15.134:0/410159441 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6d90036900 0x7f6d90038dc0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.376+0000 7f6eba413800 1 --2- 172.21.15.134:0/410159441 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560898014050 0x560898014470 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.376+0000 7f6eba413800 1 -- 172.21.15.134:0/410159441 >> 172.21.15.134:0/410159441 conn(0x5608980080f0 msgr2=0x5608980084f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:11.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.376+0000 7f6eba413800 1 -- 172.21.15.134:0/410159441 shutdown_connections 2024-04-24T02:14:11.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.376+0000 7f6eba413800 1 -- 172.21.15.134:0/410159441 wait complete. 2024-04-24T02:14:11.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.376+0000 7f6eba413800 1 -- 172.21.15.134:0/798783471 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560897f05400 msgr2=0x560898002ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.376+0000 7f6eba413800 1 --2- 172.21.15.134:0/798783471 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560897f05400 0x560898002ef0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.376+0000 7f6eba413800 1 -- 172.21.15.134:0/798783471 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6d9c036900 msgr2=0x7f6d9c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.376+0000 7f6eba413800 1 --2- 172.21.15.134:0/798783471 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6d9c036900 0x7f6d9c038dc0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6eac054000 tx=0x7f6eac04e000 comp rx=0 tx=0).stop 2024-04-24T02:14:11.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.376+0000 7f6eba413800 1 -- 172.21.15.134:0/798783471 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560897f018f0 msgr2=0x560897ffbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.376+0000 7f6eba413800 1 --2- 172.21.15.134:0/798783471 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560897f018f0 0x560897ffbcb0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f6ea800b210 tx=0x7f6ea8000ed0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.376+0000 7f6eba413800 1 -- 172.21.15.134:0/798783471 shutdown_connections 2024-04-24T02:14:11.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.376+0000 7f6eba413800 1 --2- 172.21.15.134:0/798783471 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x560897f05400 0x560898002ef0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.376+0000 7f6eba413800 1 --2- 172.21.15.134:0/798783471 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6d9c036900 0x7f6d9c038dc0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.376+0000 7f6eba413800 1 --2- 172.21.15.134:0/798783471 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560897f018f0 0x560897ffbcb0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.376+0000 7f6eba413800 1 -- 172.21.15.134:0/798783471 >> 172.21.15.134:0/798783471 conn(0x560897efb320 msgr2=0x560897f000d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:11.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.376+0000 7f6eba413800 1 -- 172.21.15.134:0/798783471 shutdown_connections 2024-04-24T02:14:11.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.376+0000 7f6eba413800 1 -- 172.21.15.134:0/798783471 wait complete. 2024-04-24T02:14:11.385 ERROR:root:None 2024-04-24T02:14:11.385 ERROR:root:0 2024-04-24T02:14:11.386 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-04-24T02:14:11.386 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-04-24T02:14:11.386 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=read 2024-04-24T02:14:11.471 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:14:11.471 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:14:11.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.470+0000 7fd99b610800 1 Processor -- start 2024-04-24T02:14:11.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.470+0000 7fd99b610800 1 -- start start 2024-04-24T02:14:11.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.471+0000 7fd99b610800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55a403f738d0 0x55a403f75cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.471+0000 7fd99b610800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a403e31d40 con 0x55a403f76200 2024-04-24T02:14:11.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.471+0000 7fd99b610800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55a403e044d0 con 0x55a403f738d0 2024-04-24T02:14:11.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.471+0000 7fd996bee640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55a403f738d0 0x55a403f75cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.471+0000 7fd98e3ed640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55a403f76200 0x55a403f785f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:46476/0 (socket says 172.21.15.134:46476) 2024-04-24T02:14:11.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.471+0000 7fd98e3ed640 1 -- 172.21.15.134:0/3199805480 learned_addr learned my addr 172.21.15.134:0/3199805480 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:14:11.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.471+0000 7fd996bee640 1 -- 172.21.15.134:0/3199805480 >> v1:172.21.15.104:6789/0 conn(0x55a403f76200 legacy=0x55a403f785f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.471+0000 7fd9963ed640 1 -- 172.21.15.134:0/3199805480 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3956419773 0 0) 0x55a403e31d40 con 0x55a403f76200 2024-04-24T02:14:11.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.471+0000 7fd996bee640 1 -- 172.21.15.134:0/3199805480 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a403e30590 con 0x55a403f738d0 2024-04-24T02:14:11.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.473+0000 7fd996bee640 1 --2- 172.21.15.134:0/3199805480 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a403f738d0 0x55a403f75cc0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fd98800a470 tx=0x7fd98801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ff1ff9191bcff38 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.473+0000 7fd9963ed640 1 -- 172.21.15.134:0/3199805480 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd988057070 con 0x55a403f738d0 2024-04-24T02:14:11.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.473+0000 7fd9963ed640 1 -- 172.21.15.134:0/3199805480 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd988052570 con 0x55a403f738d0 2024-04-24T02:14:11.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.473+0000 7fd9963ed640 1 -- 172.21.15.134:0/3199805480 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd988052870 con 0x55a403f738d0 2024-04-24T02:14:11.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.474+0000 7fd99b610800 1 -- 172.21.15.134:0/3199805480 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a403f738d0 msgr2=0x55a403f75cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.474+0000 7fd99b610800 1 --2- 172.21.15.134:0/3199805480 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a403f738d0 0x55a403f75cc0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fd98800a470 tx=0x7fd98801ce90 comp rx=0 tx=0).stop 2024-04-24T02:14:11.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.474+0000 7fd99b610800 1 -- 172.21.15.134:0/3199805480 shutdown_connections 2024-04-24T02:14:11.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.474+0000 7fd99b610800 1 --2- 172.21.15.134:0/3199805480 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a403f738d0 0x55a403f75cc0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.474+0000 7fd99b610800 1 -- 172.21.15.134:0/3199805480 >> 172.21.15.134:0/3199805480 conn(0x55a403f6d3a0 msgr2=0x55a403f6f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:11.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.474+0000 7fd99b610800 1 -- 172.21.15.134:0/3199805480 shutdown_connections 2024-04-24T02:14:11.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.474+0000 7fd99b610800 1 -- 172.21.15.134:0/3199805480 wait complete. 2024-04-24T02:14:11.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.485+0000 7fd99b610800 1 Processor -- start 2024-04-24T02:14:11.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.485+0000 7fd99b610800 1 -- start start 2024-04-24T02:14:11.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.486+0000 7fd99b610800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a403f738d0 0x55a403f73210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.486+0000 7fd99b610800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a403ebe3b0 con 0x55a403f738d0 2024-04-24T02:14:11.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.486+0000 7fd996bee640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a403f738d0 0x55a403f73210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.486+0000 7fd996bee640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a403f738d0 0x55a403f73210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43868/0 (socket says 172.21.15.134:43868) 2024-04-24T02:14:11.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.486+0000 7fd996bee640 1 -- 172.21.15.134:0/307521845 learned_addr learned my addr 172.21.15.134:0/307521845 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:11.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.486+0000 7fd996bee640 1 -- 172.21.15.134:0/307521845 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a403f717d0 con 0x55a403f738d0 2024-04-24T02:14:11.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.487+0000 7fd996bee640 1 --2- 172.21.15.134:0/307521845 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a403f738d0 0x55a403f73210 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fd988055040 tx=0x7fd98804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b2dc6da27ff6352 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.487+0000 7fd884e09640 1 -- 172.21.15.134:0/307521845 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd988063070 con 0x55a403f738d0 2024-04-24T02:14:11.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.487+0000 7fd884e09640 1 -- 172.21.15.134:0/307521845 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd988058040 con 0x55a403f738d0 2024-04-24T02:14:11.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.487+0000 7fd884e09640 1 -- 172.21.15.134:0/307521845 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd988057070 con 0x55a403f738d0 2024-04-24T02:14:11.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.487+0000 7fd99b610800 1 -- 172.21.15.134:0/307521845 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a403f738d0 msgr2=0x55a403f73210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.487+0000 7fd99b610800 1 --2- 172.21.15.134:0/307521845 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a403f738d0 0x55a403f73210 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fd988055040 tx=0x7fd98804c000 comp rx=0 tx=0).stop 2024-04-24T02:14:11.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.487+0000 7fd99b610800 1 -- 172.21.15.134:0/307521845 shutdown_connections 2024-04-24T02:14:11.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.487+0000 7fd99b610800 1 --2- 172.21.15.134:0/307521845 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a403f738d0 0x55a403f73210 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.487+0000 7fd99b610800 1 -- 172.21.15.134:0/307521845 >> 172.21.15.134:0/307521845 conn(0x55a403f6d3a0 msgr2=0x55a40405f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:11.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.487+0000 7fd99b610800 1 -- 172.21.15.134:0/307521845 shutdown_connections 2024-04-24T02:14:11.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.487+0000 7fd99b610800 1 -- 172.21.15.134:0/307521845 wait complete. 2024-04-24T02:14:11.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.488+0000 7fd99b610800 1 Processor -- start 2024-04-24T02:14:11.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.488+0000 7fd99b610800 1 -- start start 2024-04-24T02:14:11.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.488+0000 7fd99b610800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a403f738d0 0x55a40406dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.488+0000 7fd99b610800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a403f7a010 con 0x55a403f738d0 2024-04-24T02:14:11.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.488+0000 7fd996bee640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a403f738d0 0x55a40406dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.488+0000 7fd996bee640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a403f738d0 0x55a40406dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43884/0 (socket says 172.21.15.134:43884) 2024-04-24T02:14:11.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.488+0000 7fd996bee640 1 -- 172.21.15.134:0/4284679692 learned_addr learned my addr 172.21.15.134:0/4284679692 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:11.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.488+0000 7fd996bee640 1 -- 172.21.15.134:0/4284679692 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a40406e0e0 con 0x55a403f738d0 2024-04-24T02:14:11.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.488+0000 7fd996bee640 1 --2- 172.21.15.134:0/4284679692 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a403f738d0 0x55a40406dba0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fd988061040 tx=0x7fd988002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.489+0000 7fd883606640 1 -- 172.21.15.134:0/4284679692 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd988063030 con 0x55a403f738d0 2024-04-24T02:14:11.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.489+0000 7fd883606640 1 -- 172.21.15.134:0/4284679692 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd988052d90 con 0x55a403f738d0 2024-04-24T02:14:11.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.489+0000 7fd99b610800 1 -- 172.21.15.134:0/4284679692 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a40406e370 con 0x55a403f738d0 2024-04-24T02:14:11.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.489+0000 7fd883606640 1 -- 172.21.15.134:0/4284679692 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd98805e5b0 con 0x55a403f738d0 2024-04-24T02:14:11.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.489+0000 7fd99b610800 1 -- 172.21.15.134:0/4284679692 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a404071020 con 0x55a403f738d0 2024-04-24T02:14:11.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.489+0000 7fd883606640 1 -- 172.21.15.134:0/4284679692 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd98805e750 con 0x55a403f738d0 2024-04-24T02:14:11.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.490+0000 7fd883606640 1 --2- 172.21.15.134:0/4284679692 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd87c036950 0x7fd87c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.490+0000 7fd883606640 1 -- 172.21.15.134:0/4284679692 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fd988064070 con 0x55a403f738d0 2024-04-24T02:14:11.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.490+0000 7fd98e3ed640 1 --2- 172.21.15.134:0/4284679692 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd87c036950 0x7fd87c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.490+0000 7fd99b610800 1 --2- 172.21.15.134:0/4284679692 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55a403f76200 0x55a404074de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.490+0000 7fd99b610800 1 -- 172.21.15.134:0/4284679692 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a404075360 con 0x55a403f76200 2024-04-24T02:14:11.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.490+0000 7fd9973ef640 1 --2- 172.21.15.134:0/4284679692 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55a403f76200 0x55a404074de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.490+0000 7fd98e3ed640 1 --2- 172.21.15.134:0/4284679692 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd87c036950 0x7fd87c038e10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd980000c00 tx=0x7fd9800013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.490+0000 7fd9973ef640 1 --2- 172.21.15.134:0/4284679692 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55a403f76200 0x55a404074de0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.490+0000 7fd9973ef640 1 -- 172.21.15.134:0/4284679692 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd99000a4a0 con 0x55a403f76200 2024-04-24T02:14:11.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.490+0000 7fd99b610800 1 -- 172.21.15.134:0/4284679692 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a404072390 con 0x55a403f76200 2024-04-24T02:14:11.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.491+0000 7fd9973ef640 1 -- 172.21.15.134:0/4284679692 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd99000a4a0 con 0x55a403f76200 2024-04-24T02:14:11.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.491+0000 7fd99b610800 1 -- 172.21.15.134:0/4284679692 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a404077170 con 0x55a403f76200 2024-04-24T02:14:11.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.491+0000 7fd9973ef640 1 -- 172.21.15.134:0/4284679692 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd99000a4a0 con 0x55a403f76200 2024-04-24T02:14:11.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.491+0000 7fd99b610800 1 -- 172.21.15.134:0/4284679692 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4040764b0 con 0x55a403f76200 2024-04-24T02:14:11.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.491+0000 7fd9973ef640 1 -- 172.21.15.134:0/4284679692 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd99000a4a0 con 0x55a403f76200 2024-04-24T02:14:11.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.491+0000 7fd99b610800 1 -- 172.21.15.134:0/4284679692 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4040768d0 con 0x55a403f76200 2024-04-24T02:14:11.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.492+0000 7fd9973ef640 1 -- 172.21.15.134:0/4284679692 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd99000a4a0 con 0x55a403f76200 2024-04-24T02:14:11.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.492+0000 7fd99b610800 1 Processor -- start 2024-04-24T02:14:11.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.492+0000 7fd99b610800 1 -- start start 2024-04-24T02:14:11.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.492+0000 7fd99b610800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a404085f80 0x55a4040863a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.492+0000 7fd99b610800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a403e646b0 con 0x55a404085f80 2024-04-24T02:14:11.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.492+0000 7fd98e3ed640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a404085f80 0x55a4040863a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.492+0000 7fd98e3ed640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a404085f80 0x55a4040863a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43896/0 (socket says 172.21.15.134:43896) 2024-04-24T02:14:11.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.492+0000 7fd98e3ed640 1 -- 172.21.15.134:0/1856536530 learned_addr learned my addr 172.21.15.134:0/1856536530 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:11.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.493+0000 7fd98e3ed640 1 -- 172.21.15.134:0/1856536530 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4040868e0 con 0x55a404085f80 2024-04-24T02:14:11.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.493+0000 7fd98e3ed640 1 --2- 172.21.15.134:0/1856536530 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a404085f80 0x55a4040863a0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fd98000e610 tx=0x7fd98000ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.493+0000 7fd880e01640 1 -- 172.21.15.134:0/1856536530 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd980022070 con 0x55a404085f80 2024-04-24T02:14:11.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.493+0000 7fd880e01640 1 -- 172.21.15.134:0/1856536530 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd980009050 con 0x55a404085f80 2024-04-24T02:14:11.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.493+0000 7fd880e01640 1 -- 172.21.15.134:0/1856536530 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd98000d500 con 0x55a404085f80 2024-04-24T02:14:11.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.493+0000 7fd99b610800 1 -- 172.21.15.134:0/1856536530 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a404087350 con 0x55a404085f80 2024-04-24T02:14:11.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.493+0000 7fd99b610800 1 -- 172.21.15.134:0/1856536530 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a404087850 con 0x55a404085f80 2024-04-24T02:14:11.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.494+0000 7fd880e01640 1 -- 172.21.15.134:0/1856536530 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd980025070 con 0x55a404085f80 2024-04-24T02:14:11.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.494+0000 7fd880e01640 1 --2- 172.21.15.134:0/1856536530 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd870036950 0x7fd870038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.494+0000 7fd880e01640 1 -- 172.21.15.134:0/1856536530 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fd98004da20 con 0x55a404085f80 2024-04-24T02:14:11.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.494+0000 7fd9973ef640 1 --2- 172.21.15.134:0/1856536530 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd870036950 0x7fd870038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.494+0000 7fd99b610800 1 Processor -- start 2024-04-24T02:14:11.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.494+0000 7fd9973ef640 1 --2- 172.21.15.134:0/1856536530 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd870036950 0x7fd870038e10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x55a404076850 tx=0x7fd990005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.494+0000 7fd99b610800 1 -- start start 2024-04-24T02:14:11.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.494+0000 7fd99b610800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4040932c0 0x55a4040936e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.494+0000 7fd99b610800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a403f71a90 con 0x55a4040932c0 2024-04-24T02:14:11.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.494+0000 7fd98e3ed640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4040932c0 0x55a4040936e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.494+0000 7fd98e3ed640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4040932c0 0x55a4040936e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43904/0 (socket says 172.21.15.134:43904) 2024-04-24T02:14:11.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.495+0000 7fd98e3ed640 1 -- 172.21.15.134:0/3496665410 learned_addr learned my addr 172.21.15.134:0/3496665410 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:11.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.495+0000 7fd98e3ed640 1 -- 172.21.15.134:0/3496665410 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a404093cb0 con 0x55a4040932c0 2024-04-24T02:14:11.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.495+0000 7fd98e3ed640 1 --2- 172.21.15.134:0/3496665410 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4040932c0 0x55a4040936e0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fd980026fd0 tx=0x7fd980026680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6abb02268c2a085a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.495+0000 7fd87a7fc640 1 -- 172.21.15.134:0/3496665410 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd98001ac20 con 0x55a4040932c0 2024-04-24T02:14:11.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.495+0000 7fd87a7fc640 1 -- 172.21.15.134:0/3496665410 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd98001adc0 con 0x55a4040932c0 2024-04-24T02:14:11.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.495+0000 7fd87a7fc640 1 -- 172.21.15.134:0/3496665410 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9800254d0 con 0x55a4040932c0 2024-04-24T02:14:11.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.495+0000 7fd99b610800 1 -- 172.21.15.134:0/3496665410 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4040932c0 msgr2=0x55a4040936e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.495+0000 7fd99b610800 1 --2- 172.21.15.134:0/3496665410 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4040932c0 0x55a4040936e0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fd980026fd0 tx=0x7fd980026680 comp rx=0 tx=0).stop 2024-04-24T02:14:11.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.495+0000 7fd99b610800 1 -- 172.21.15.134:0/3496665410 shutdown_connections 2024-04-24T02:14:11.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.495+0000 7fd99b610800 1 --2- 172.21.15.134:0/3496665410 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4040932c0 0x55a4040936e0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.495+0000 7fd99b610800 1 -- 172.21.15.134:0/3496665410 >> 172.21.15.134:0/3496665410 conn(0x55a40408f620 msgr2=0x55a40408d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:11.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.495+0000 7fd99b610800 1 -- 172.21.15.134:0/3496665410 shutdown_connections 2024-04-24T02:14:11.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.495+0000 7fd99b610800 1 -- 172.21.15.134:0/3496665410 wait complete. 2024-04-24T02:14:11.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.496+0000 7fd99b610800 1 Processor -- start 2024-04-24T02:14:11.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.496+0000 7fd99b610800 1 -- start start 2024-04-24T02:14:11.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.496+0000 7fd99b610800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4040932c0 0x55a40409a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.496+0000 7fd99b610800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a404094420 con 0x55a4040932c0 2024-04-24T02:14:11.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.496+0000 7fd98e3ed640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4040932c0 0x55a40409a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.496+0000 7fd98e3ed640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4040932c0 0x55a40409a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43918/0 (socket says 172.21.15.134:43918) 2024-04-24T02:14:11.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.496+0000 7fd98e3ed640 1 -- 172.21.15.134:0/997424539 learned_addr learned my addr 172.21.15.134:0/997424539 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:11.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.496+0000 7fd98e3ed640 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a40409ae60 con 0x55a4040932c0 2024-04-24T02:14:11.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.496+0000 7fd98e3ed640 1 --2- 172.21.15.134:0/997424539 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4040932c0 0x55a40409a920 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fd9800266c0 tx=0x7fd98004be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.497+0000 7fd878ff9640 1 -- 172.21.15.134:0/997424539 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd98000d8b0 con 0x55a4040932c0 2024-04-24T02:14:11.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.497+0000 7fd878ff9640 1 -- 172.21.15.134:0/997424539 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd98000da50 con 0x55a4040932c0 2024-04-24T02:14:11.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.497+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a40409b0f0 con 0x55a4040932c0 2024-04-24T02:14:11.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.497+0000 7fd878ff9640 1 -- 172.21.15.134:0/997424539 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd98001a450 con 0x55a4040932c0 2024-04-24T02:14:11.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.497+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a40409dda0 con 0x55a4040932c0 2024-04-24T02:14:11.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.497+0000 7fd878ff9640 1 -- 172.21.15.134:0/997424539 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd98001a5f0 con 0x55a4040932c0 2024-04-24T02:14:11.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.498+0000 7fd878ff9640 1 --2- 172.21.15.134:0/997424539 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd860036950 0x7fd860038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.498+0000 7fd878ff9640 1 -- 172.21.15.134:0/997424539 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fd980036bf0 con 0x55a4040932c0 2024-04-24T02:14:11.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.498+0000 7fd9973ef640 1 --2- 172.21.15.134:0/997424539 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd860036950 0x7fd860038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.498+0000 7fd9973ef640 1 --2- 172.21.15.134:0/997424539 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd860036950 0x7fd860038e10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x55a404075fd0 tx=0x7fd99001f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.498+0000 7fd99b610800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.498+0000 7fd99b610800 1 --2- 172.21.15.134:0/997424539 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55a4040a6410 0x55a4040a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.498+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4040a9020 con 0x55a4040a6410 2024-04-24T02:14:11.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.498+0000 7fd996bee640 1 --2- 172.21.15.134:0/997424539 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55a4040a6410 0x55a4040a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.499+0000 7fd996bee640 1 --2- 172.21.15.134:0/997424539 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55a4040a6410 0x55a4040a88d0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.499+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd988070020 con 0x55a4040a6410 2024-04-24T02:14:11.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.499+0000 7fd99b610800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:11.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.499+0000 7fd99b610800 20 realm 2024-04-24T02:14:11.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.499+0000 7fd99b610800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.499+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4040a9430 con 0x55a4040a6410 2024-04-24T02:14:11.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.499+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd988070020 con 0x55a4040a6410 2024-04-24T02:14:11.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.499+0000 7fd99b610800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:11.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.499+0000 7fd99b610800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:14:11.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.499+0000 7fd99b610800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.499+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4040a9d00 con 0x55a4040a6410 2024-04-24T02:14:11.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.499+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd988070020 con 0x55a4040a6410 2024-04-24T02:14:11.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.499+0000 7fd99b610800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:11.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.499+0000 7fd99b610800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.499+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4040aa0a0 con 0x55a4040a6410 2024-04-24T02:14:11.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.499+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd988070020 con 0x55a4040a6410 2024-04-24T02:14:11.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.499+0000 7fd99b610800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:14:11.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.499+0000 7fd99b610800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.499+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4040aa8f0 con 0x55a4040a6410 2024-04-24T02:14:11.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.500+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd988070020 con 0x55a4040a6410 2024-04-24T02:14:11.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.500+0000 7fd99b610800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:14:11.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.500+0000 7fd99b610800 20 searching for the correct realm 2024-04-24T02:14:11.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.500+0000 7fd99b610800 1 --2- 172.21.15.134:0/997424539 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55a4040ac660 0x55a4040aea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.500+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4040af060 con 0x55a4040ac660 2024-04-24T02:14:11.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.500+0000 7fd98e3ed640 1 --2- 172.21.15.134:0/997424539 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55a4040ac660 0x55a4040aea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.500+0000 7fd98e3ed640 1 --2- 172.21.15.134:0/997424539 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55a4040ac660 0x55a4040aea50 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.500+0000 7fd98e3ed640 1 -- 172.21.15.134:0/997424539 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd980024030 con 0x55a4040ac660 2024-04-24T02:14:11.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.500+0000 7fd98e3ed640 1 --2- 172.21.15.134:0/997424539 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fd980027060 0x7fd98004d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.500+0000 7fd98e3ed640 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4040af060 con 0x7fd980027060 2024-04-24T02:14:11.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.501+0000 7fd9973ef640 1 --2- 172.21.15.134:0/997424539 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fd980027060 0x7fd98004d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.501+0000 7fd9973ef640 1 --2- 172.21.15.134:0/997424539 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fd980027060 0x7fd98004d0f0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.501+0000 7fd9973ef640 1 -- 172.21.15.134:0/997424539 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd99001f070 con 0x7fd980027060 2024-04-24T02:14:11.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.501+0000 7fd9973ef640 1 --2- 172.21.15.134:0/997424539 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fd990031040 0x7fd990032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.501+0000 7fd9973ef640 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4040af060 con 0x7fd990031040 2024-04-24T02:14:11.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.501+0000 7fd996bee640 1 --2- 172.21.15.134:0/997424539 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fd990031040 0x7fd990032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.502+0000 7fd996bee640 1 --2- 172.21.15.134:0/997424539 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fd990031040 0x7fd990032430 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.502+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd988070020 con 0x7fd990031040 2024-04-24T02:14:11.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.502+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4040af060 con 0x55a4040a6410 2024-04-24T02:14:11.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.502+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd988070020 con 0x55a4040a6410 2024-04-24T02:14:11.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.502+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4040af060 con 0x55a4040a6410 2024-04-24T02:14:11.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.502+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd988070020 con 0x55a4040a6410 2024-04-24T02:14:11.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.502+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4040af060 con 0x7fd990031040 2024-04-24T02:14:11.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.503+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd988070020 con 0x7fd990031040 2024-04-24T02:14:11.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.503+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4040af060 con 0x7fd980027060 2024-04-24T02:14:11.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.503+0000 7fd9973ef640 1 -- 172.21.15.134:0/997424539 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd99001f070 con 0x7fd980027060 2024-04-24T02:14:11.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.503+0000 7fd9973ef640 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4040af060 con 0x7fd980027060 2024-04-24T02:14:11.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.503+0000 7fd9973ef640 1 -- 172.21.15.134:0/997424539 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd99001f070 con 0x7fd980027060 2024-04-24T02:14:11.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.503+0000 7fd9973ef640 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4040af060 con 0x55a4040ac660 2024-04-24T02:14:11.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.503+0000 7fd98e3ed640 1 -- 172.21.15.134:0/997424539 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd980024030 con 0x55a4040ac660 2024-04-24T02:14:11.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.503+0000 7fd98e3ed640 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4040af060 con 0x55a4040a6410 2024-04-24T02:14:11.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.504+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd988070020 con 0x55a4040a6410 2024-04-24T02:14:11.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.504+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4040af060 con 0x7fd990031040 2024-04-24T02:14:11.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.504+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd988070020 con 0x7fd990031040 2024-04-24T02:14:11.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.504+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4040af060 con 0x55a4040a6410 2024-04-24T02:14:11.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.504+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd988070020 con 0x55a4040a6410 2024-04-24T02:14:11.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.504+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4040af060 con 0x7fd980027060 2024-04-24T02:14:11.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.504+0000 7fd9973ef640 1 -- 172.21.15.134:0/997424539 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd99001f070 con 0x7fd980027060 2024-04-24T02:14:11.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.504+0000 7fd9973ef640 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4040af060 con 0x55a4040ac660 2024-04-24T02:14:11.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.505+0000 7fd98e3ed640 1 -- 172.21.15.134:0/997424539 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd980024030 con 0x55a4040ac660 2024-04-24T02:14:11.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.505+0000 7fd98e3ed640 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4040af060 con 0x55a4040ac660 2024-04-24T02:14:11.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.505+0000 7fd98e3ed640 1 -- 172.21.15.134:0/997424539 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd980024030 con 0x55a4040ac660 2024-04-24T02:14:11.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.505+0000 7fd98e3ed640 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4040af060 con 0x7fd980027060 2024-04-24T02:14:11.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.505+0000 7fd9973ef640 1 -- 172.21.15.134:0/997424539 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd99001f070 con 0x7fd980027060 2024-04-24T02:14:11.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.505+0000 7fd9973ef640 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4040af060 con 0x55a4040ac660 2024-04-24T02:14:11.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.505+0000 7fd98e3ed640 1 -- 172.21.15.134:0/997424539 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd980024030 con 0x55a4040ac660 2024-04-24T02:14:11.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.505+0000 7fd98e3ed640 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4040af060 con 0x55a4040ac660 2024-04-24T02:14:11.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.506+0000 7fd98e3ed640 1 -- 172.21.15.134:0/997424539 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd980024030 con 0x55a4040ac660 2024-04-24T02:14:11.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.506+0000 7fd98e3ed640 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4040af060 con 0x55a4040a6410 2024-04-24T02:14:11.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.506+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd988070020 con 0x55a4040a6410 2024-04-24T02:14:11.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.506+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4040af060 con 0x55a4040a6410 2024-04-24T02:14:11.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.506+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=132b] v32'6 uv6 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fd988070020 con 0x55a4040a6410 2024-04-24T02:14:11.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.506+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4040af060 con 0x7fd990031040 2024-04-24T02:14:11.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.506+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd988070020 con 0x7fd990031040 2024-04-24T02:14:11.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.506+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4040af060 con 0x55a4040ac660 2024-04-24T02:14:11.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.507+0000 7fd98e3ed640 1 -- 172.21.15.134:0/997424539 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd980024030 con 0x55a4040ac660 2024-04-24T02:14:11.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.507+0000 7fd98e3ed640 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4040af060 con 0x7fd980027060 2024-04-24T02:14:11.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.507+0000 7fd9973ef640 1 -- 172.21.15.134:0/997424539 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd99001f070 con 0x7fd980027060 2024-04-24T02:14:11.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.507+0000 7fd9973ef640 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4040af060 con 0x55a4040a6410 2024-04-24T02:14:11.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.507+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd988070020 con 0x55a4040a6410 2024-04-24T02:14:11.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.507+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4040af060 con 0x7fd990031040 2024-04-24T02:14:11.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.507+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd988070020 con 0x7fd990031040 2024-04-24T02:14:11.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.507+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4040af060 con 0x55a4040ac660 2024-04-24T02:14:11.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.508+0000 7fd98e3ed640 1 -- 172.21.15.134:0/997424539 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd980024030 con 0x55a4040ac660 2024-04-24T02:14:11.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.508+0000 7fd98e3ed640 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4040af060 con 0x7fd990031040 2024-04-24T02:14:11.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.508+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd988070020 con 0x7fd990031040 2024-04-24T02:14:11.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.508+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4040af060 con 0x7fd980027060 2024-04-24T02:14:11.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.508+0000 7fd9973ef640 1 -- 172.21.15.134:0/997424539 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd990040040 con 0x7fd980027060 2024-04-24T02:14:11.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.508+0000 7fd9973ef640 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4040af060 con 0x55a4040ac660 2024-04-24T02:14:11.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.508+0000 7fd98e3ed640 1 -- 172.21.15.134:0/997424539 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd980024030 con 0x55a4040ac660 2024-04-24T02:14:11.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.508+0000 7fd98e3ed640 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4040af060 con 0x7fd980027060 2024-04-24T02:14:11.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.509+0000 7fd9973ef640 1 -- 172.21.15.134:0/997424539 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd990040040 con 0x7fd980027060 2024-04-24T02:14:11.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.509+0000 7fd9973ef640 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4040af060 con 0x55a4040a6410 2024-04-24T02:14:11.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.509+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd988070020 con 0x55a4040a6410 2024-04-24T02:14:11.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.509+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4040af060 con 0x7fd980027060 2024-04-24T02:14:11.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.509+0000 7fd9973ef640 1 -- 172.21.15.134:0/997424539 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd990040040 con 0x7fd980027060 2024-04-24T02:14:11.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.509+0000 7fd99b610800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:14:11.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.509+0000 7fd99b610800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:14:11.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.509+0000 7fd99b610800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:14:11.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.509+0000 7fd99b610800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:14:11.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.509+0000 7fd99b610800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:14:11.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.509+0000 7fd99b610800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:14:11.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.509+0000 7fd99b610800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.509+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4040ab240 con 0x55a4040a6410 2024-04-24T02:14:11.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.509+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd988070020 con 0x55a4040a6410 2024-04-24T02:14:11.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.509+0000 7fd99b610800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:11.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.509+0000 7fd99b610800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.509+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4040abae0 con 0x55a4040a6410 2024-04-24T02:14:11.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.510+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd988070020 con 0x55a4040a6410 2024-04-24T02:14:11.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.510+0000 7fd99b610800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:14:11.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.510+0000 7fd99b610800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.510+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4040af4e0 con 0x55a4040a6410 2024-04-24T02:14:11.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.510+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd988070020 con 0x55a4040a6410 2024-04-24T02:14:11.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.510+0000 7fd99b610800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:14:11.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.510+0000 7fd99b610800 20 zone default found 2024-04-24T02:14:11.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.510+0000 7fd99b610800 4 Realm: () 2024-04-24T02:14:11.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.510+0000 7fd99b610800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:14:11.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.510+0000 7fd99b610800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:14:11.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.510+0000 7fd99b610800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:14:11.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.510+0000 7fd99b610800 20 zonegroup default 2024-04-24T02:14:11.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.510+0000 7fd99b610800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.510+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4040ab6f0 con 0x7fd990031040 2024-04-24T02:14:11.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.510+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd988070020 con 0x7fd990031040 2024-04-24T02:14:11.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.510+0000 7fd99b610800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:11.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.510+0000 7fd99b610800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.510+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4040b13c0 con 0x55a4040ac660 2024-04-24T02:14:11.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.510+0000 7fd98e3ed640 1 -- 172.21.15.134:0/997424539 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd980024030 con 0x55a4040ac660 2024-04-24T02:14:11.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.510+0000 7fd99b610800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:11.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.510+0000 7fd99b610800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.510+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4040b17d0 con 0x55a4040ac660 2024-04-24T02:14:11.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.511+0000 7fd98e3ed640 1 -- 172.21.15.134:0/997424539 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd980024030 con 0x55a4040ac660 2024-04-24T02:14:11.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.511+0000 7fd99b610800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:11.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.511+0000 7fd99b610800 20 started sync module instance, tier type = 2024-04-24T02:14:11.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.511+0000 7fd99b610800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:14:11.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.511+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4040b0860 con 0x7fd980027060 2024-04-24T02:14:11.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.512+0000 7fd9973ef640 1 -- 172.21.15.134:0/997424539 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(44 notify.0 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd990040040 con 0x7fd980027060 2024-04-24T02:14:11.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.512+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94162930830416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4040b04c0 con 0x7fd980027060 2024-04-24T02:14:11.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.512+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4040b2700 con 0x55a4040a6410 2024-04-24T02:14:11.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.513+0000 7fd9973ef640 1 -- 172.21.15.134:0/997424539 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94162930830416] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd990040040 con 0x7fd980027060 2024-04-24T02:14:11.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.513+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd988070020 con 0x55a4040a6410 2024-04-24T02:14:11.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.513+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94162930834480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4040b2700 con 0x55a4040a6410 2024-04-24T02:14:11.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.513+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4040b30c0 con 0x55a4040ac660 2024-04-24T02:14:11.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.514+0000 7fd98e3ed640 1 -- 172.21.15.134:0/997424539 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd980024030 con 0x55a4040ac660 2024-04-24T02:14:11.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.514+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94162930838544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4040b3960 con 0x55a4040ac660 2024-04-24T02:14:11.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.514+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94162930834480] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd988070020 con 0x55a4040a6410 2024-04-24T02:14:11.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.514+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4040b3ef0 con 0x7fd980027060 2024-04-24T02:14:11.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.515+0000 7fd9973ef640 1 -- 172.21.15.134:0/997424539 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(50 notify.3 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd990040040 con 0x7fd980027060 2024-04-24T02:14:11.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.515+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94162930843376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4040b47c0 con 0x7fd980027060 2024-04-24T02:14:11.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.515+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4040b5220 con 0x55a4040a6410 2024-04-24T02:14:11.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.515+0000 7fd98e3ed640 1 -- 172.21.15.134:0/997424539 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94162930838544] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd980024030 con 0x55a4040ac660 2024-04-24T02:14:11.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.516+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd988070020 con 0x55a4040a6410 2024-04-24T02:14:11.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.516+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94162930840752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4040b5220 con 0x55a4040a6410 2024-04-24T02:14:11.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.516+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4040b5c70 con 0x7fd990031040 2024-04-24T02:14:11.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.516+0000 7fd9973ef640 1 -- 172.21.15.134:0/997424539 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94162930843376] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd990040040 con 0x7fd980027060 2024-04-24T02:14:11.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.517+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94162930840752] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd988070020 con 0x55a4040a6410 2024-04-24T02:14:11.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.517+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(54 notify.5 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd988070020 con 0x7fd990031040 2024-04-24T02:14:11.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.517+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94162930844432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4040b5780 con 0x7fd990031040 2024-04-24T02:14:11.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.517+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4040b6510 con 0x7fd990031040 2024-04-24T02:14:11.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.518+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94162930844432] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd988070020 con 0x7fd990031040 2024-04-24T02:14:11.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.518+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(56 notify.6 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd988070020 con 0x7fd990031040 2024-04-24T02:14:11.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.518+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94162930846976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4040b5780 con 0x7fd990031040 2024-04-24T02:14:11.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.519+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4040b6b30 con 0x7fd990031040 2024-04-24T02:14:11.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.520+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94162930846976] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd988070020 con 0x7fd990031040 2024-04-24T02:14:11.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.520+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(58 notify.7 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd988070020 con 0x7fd990031040 2024-04-24T02:14:11.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.520+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94162930851728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4040b6b30 con 0x7fd990031040 2024-04-24T02:14:11.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.520+0000 7fd99b610800 20 add_watcher() i=0 2024-04-24T02:14:11.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.520+0000 7fd99b610800 20 add_watcher() i=1 2024-04-24T02:14:11.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.520+0000 7fd99b610800 20 add_watcher() i=2 2024-04-24T02:14:11.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.520+0000 7fd99b610800 20 add_watcher() i=3 2024-04-24T02:14:11.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.520+0000 7fd99b610800 20 add_watcher() i=4 2024-04-24T02:14:11.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.520+0000 7fd99b610800 20 add_watcher() i=5 2024-04-24T02:14:11.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.520+0000 7fd99b610800 20 add_watcher() i=6 2024-04-24T02:14:11.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.520+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94162930851728] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd988070020 con 0x7fd990031040 2024-04-24T02:14:11.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.521+0000 7fd99b610800 20 add_watcher() i=7 2024-04-24T02:14:11.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.521+0000 7fd99b610800 2 all 8 watchers are set, enabling cache 2024-04-24T02:14:11.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.521+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4040b9f30 con 0x55a4040a6410 2024-04-24T02:14:11.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.521+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd988070020 con 0x55a4040a6410 2024-04-24T02:14:11.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.521+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94162930853968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4040b73f0 con 0x55a4040a6410 2024-04-24T02:14:11.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.522+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94162930853968] v32'264 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd988070020 con 0x55a4040a6410 2024-04-24T02:14:11.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.522+0000 7fd84d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:14:11.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.522+0000 7fd99b610800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:14:11.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.522+0000 7fd99b610800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:14:11.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.522+0000 7fd99b610800 5 note: GC not initialized 2024-04-24T02:14:11.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.522+0000 7fd7c7fff640 20 reqs_thread_entry: start 2024-04-24T02:14:11.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.522+0000 7fd99b610800 20 init_complete bucket index max shards: 11 2024-04-24T02:14:11.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.522+0000 7fd99b610800 20 Filter name: none 2024-04-24T02:14:11.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.523+0000 7fd7c5ffb640 20 reqs_thread_entry: start 2024-04-24T02:14:11.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.523+0000 7fd99b610800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-24T02:14:11.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.523+0000 7fd99b610800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.523+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4040ed250 con 0x7fd990031040 2024-04-24T02:14:11.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.523+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7fd988070020 con 0x7fd990031040 2024-04-24T02:14:11.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.523+0000 7fd99b610800 20 rados_obj.operate() r=0 bl.length=460 2024-04-24T02:14:11.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.523+0000 7fd99b610800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-24T02:14:11.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.523+0000 7fd99b610800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T02:14:11.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.523+0000 7fd99b610800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:14:11.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.523+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4040f3890 con 0x7fd990031040 2024-04-24T02:14:11.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.524+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v32'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fd988070020 con 0x7fd990031040 2024-04-24T02:14:11.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.524+0000 7fd99b610800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T02:14:11.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.524+0000 7fd99b610800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T02:14:11.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.524+0000 7fd99b610800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-24T02:14:11.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.524+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94162931102464 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4040eef20 con 0x55a4040a6410 2024-04-24T02:14:11.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.525+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== watch-notify(notify (1) cookie 94162930840752 notify 137438953496 ret 0) ==== 708+0+0 (crc 0 0 0) 0x55a404071020 con 0x55a4040a6410 2024-04-24T02:14:11.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.525+0000 7fd87a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953496 cookie 94162930840752 notifier 4865 bl.length()=666 2024-04-24T02:14:11.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.525+0000 7fd87a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T02:14:11.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.525+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(64 notify.4 [notify cookie 94162931102464 out=8b] v0'0 uv258 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd988070020 con 0x55a4040a6410 2024-04-24T02:14:11.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.525+0000 7fd87a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T02:14:11.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.525+0000 7fd87a7fc640 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fd85c003ea0 con 0x55a4040a6410 2024-04-24T02:14:11.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.525+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd988070020 con 0x55a4040a6410 2024-04-24T02:14:11.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.525+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== watch-notify(notify_complete (2) cookie 94162931102464 notify 137438953496 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fd988078030 con 0x55a4040a6410 2024-04-24T02:14:11.542 INFO:teuthology.orchestra.run.smithi134.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-24T02:14:10.534163Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"read"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T02:14:10.534144Z","tags":[],"group_ids":[]} 2024-04-24T02:14:11.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.526+0000 7fd84d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:14:11.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.526+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94162930853968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4040eb950 con 0x55a4040a6410 2024-04-24T02:14:11.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.527+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94162930853968] v32'265 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd988070020 con 0x55a4040a6410 2024-04-24T02:14:11.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.527+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94162930830416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4040b6820 con 0x7fd980027060 2024-04-24T02:14:11.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.528+0000 7fd9973ef640 1 -- 172.21.15.134:0/997424539 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94162930830416] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd990040040 con 0x7fd980027060 2024-04-24T02:14:11.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.528+0000 7fd99b610800 20 remove_watcher() i=0 2024-04-24T02:14:11.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.528+0000 7fd99b610800 2 removed watcher, disabling cache 2024-04-24T02:14:11.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.528+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94162930834480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4040b0c50 con 0x55a4040a6410 2024-04-24T02:14:11.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.529+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94162930834480] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd988070020 con 0x55a4040a6410 2024-04-24T02:14:11.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.529+0000 7fd99b610800 20 remove_watcher() i=1 2024-04-24T02:14:11.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.529+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94162930838544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4040b0c50 con 0x55a4040ac660 2024-04-24T02:14:11.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.531+0000 7fd98e3ed640 1 -- 172.21.15.134:0/997424539 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94162930838544] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd980024030 con 0x55a4040ac660 2024-04-24T02:14:11.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.531+0000 7fd99b610800 20 remove_watcher() i=2 2024-04-24T02:14:11.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.531+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94162930843376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4040b2c10 con 0x7fd980027060 2024-04-24T02:14:11.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.532+0000 7fd9973ef640 1 -- 172.21.15.134:0/997424539 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94162930843376] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd990040040 con 0x7fd980027060 2024-04-24T02:14:11.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.532+0000 7fd99b610800 20 remove_watcher() i=3 2024-04-24T02:14:11.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.532+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94162930840752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4040b2c10 con 0x55a4040a6410 2024-04-24T02:14:11.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.533+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94162930840752] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd988070020 con 0x55a4040a6410 2024-04-24T02:14:11.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.533+0000 7fd99b610800 20 remove_watcher() i=4 2024-04-24T02:14:11.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.533+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94162930844432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4040b34b0 con 0x7fd990031040 2024-04-24T02:14:11.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.534+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94162930844432] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd988070020 con 0x7fd990031040 2024-04-24T02:14:11.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.534+0000 7fd99b610800 20 remove_watcher() i=5 2024-04-24T02:14:11.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.534+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94162930846976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4040b2c10 con 0x7fd990031040 2024-04-24T02:14:11.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.535+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94162930846976] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd988070020 con 0x7fd990031040 2024-04-24T02:14:11.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.535+0000 7fd99b610800 20 remove_watcher() i=6 2024-04-24T02:14:11.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.535+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94162930851728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4040b2c10 con 0x7fd990031040 2024-04-24T02:14:11.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.536+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94162930851728] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd988070020 con 0x7fd990031040 2024-04-24T02:14:11.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.536+0000 7fd99b610800 20 remove_watcher() i=7 2024-04-24T02:14:11.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.536+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fd990031040 msgr2=0x7fd990032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.536+0000 7fd99b610800 1 --2- 172.21.15.134:0/997424539 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fd990031040 0x7fd990032430 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.536+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55a4040a6410 msgr2=0x55a4040a88d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.536+0000 7fd99b610800 1 --2- 172.21.15.134:0/997424539 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55a4040a6410 0x55a4040a88d0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.536+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fd980027060 msgr2=0x7fd98004d0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.536+0000 7fd99b610800 1 --2- 172.21.15.134:0/997424539 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fd980027060 0x7fd98004d0f0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.536+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55a4040ac660 msgr2=0x55a4040aea50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.536+0000 7fd99b610800 1 --2- 172.21.15.134:0/997424539 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55a4040ac660 0x55a4040aea50 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.536+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd860036950 msgr2=0x7fd860038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.536+0000 7fd99b610800 1 --2- 172.21.15.134:0/997424539 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd860036950 0x7fd860038e10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x55a404075fd0 tx=0x7fd99001f000 comp rx=0 tx=0).stop 2024-04-24T02:14:11.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.536+0000 7fd996bee640 1 -- 172.21.15.134:0/997424539 reap_dead start 2024-04-24T02:14:11.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.536+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4040932c0 msgr2=0x55a40409a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.536+0000 7fd99b610800 1 --2- 172.21.15.134:0/997424539 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4040932c0 0x55a40409a920 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fd9800266c0 tx=0x7fd98004be50 comp rx=0 tx=0).stop 2024-04-24T02:14:11.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.536+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 shutdown_connections 2024-04-24T02:14:11.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.536+0000 7fd99b610800 1 --2- 172.21.15.134:0/997424539 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4040932c0 0x55a40409a920 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.536+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 >> 172.21.15.134:0/997424539 conn(0x55a40408f620 msgr2=0x55a40408cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:11.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.536+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 shutdown_connections 2024-04-24T02:14:11.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.536+0000 7fd99b610800 1 -- 172.21.15.134:0/997424539 wait complete. 2024-04-24T02:14:11.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.536+0000 7fd99b610800 1 -- 172.21.15.134:0/1856536530 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd870036950 msgr2=0x7fd870038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.536+0000 7fd99b610800 1 --2- 172.21.15.134:0/1856536530 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd870036950 0x7fd870038e10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x55a404076850 tx=0x7fd990005840 comp rx=0 tx=0).stop 2024-04-24T02:14:11.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.536+0000 7fd99b610800 1 -- 172.21.15.134:0/1856536530 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a404085f80 msgr2=0x55a4040863a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.536+0000 7fd99b610800 1 --2- 172.21.15.134:0/1856536530 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a404085f80 0x55a4040863a0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fd98000e610 tx=0x7fd98000ff90 comp rx=0 tx=0).stop 2024-04-24T02:14:11.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.536+0000 7fd99b610800 1 -- 172.21.15.134:0/1856536530 shutdown_connections 2024-04-24T02:14:11.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.536+0000 7fd99b610800 1 --2- 172.21.15.134:0/1856536530 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd870036950 0x7fd870038e10 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.536+0000 7fd99b610800 1 --2- 172.21.15.134:0/1856536530 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a404085f80 0x55a4040863a0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.536+0000 7fd99b610800 1 -- 172.21.15.134:0/1856536530 >> 172.21.15.134:0/1856536530 conn(0x55a40407a020 msgr2=0x55a40407a420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:11.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.537+0000 7fd99b610800 1 -- 172.21.15.134:0/1856536530 shutdown_connections 2024-04-24T02:14:11.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.537+0000 7fd99b610800 1 -- 172.21.15.134:0/1856536530 wait complete. 2024-04-24T02:14:11.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.537+0000 7fd99b610800 1 -- 172.21.15.134:0/4284679692 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55a403f76200 msgr2=0x55a404074de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.537+0000 7fd99b610800 1 --2- 172.21.15.134:0/4284679692 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55a403f76200 0x55a404074de0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.537+0000 7fd99b610800 1 -- 172.21.15.134:0/4284679692 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd87c036950 msgr2=0x7fd87c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.537+0000 7fd99b610800 1 --2- 172.21.15.134:0/4284679692 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd87c036950 0x7fd87c038e10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd980000c00 tx=0x7fd9800013b0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.537+0000 7fd99b610800 1 -- 172.21.15.134:0/4284679692 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a403f738d0 msgr2=0x55a40406dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.537+0000 7fd99b610800 1 --2- 172.21.15.134:0/4284679692 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a403f738d0 0x55a40406dba0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fd988061040 tx=0x7fd988002fb0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.537+0000 7fd99b610800 1 -- 172.21.15.134:0/4284679692 shutdown_connections 2024-04-24T02:14:11.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.537+0000 7fd99b610800 1 --2- 172.21.15.134:0/4284679692 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55a403f76200 0x55a404074de0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.537+0000 7fd99b610800 1 --2- 172.21.15.134:0/4284679692 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd87c036950 0x7fd87c038e10 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.537+0000 7fd99b610800 1 --2- 172.21.15.134:0/4284679692 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a403f738d0 0x55a40406dba0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.537+0000 7fd99b610800 1 -- 172.21.15.134:0/4284679692 >> 172.21.15.134:0/4284679692 conn(0x55a403f6d3a0 msgr2=0x55a403f71ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:11.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.537+0000 7fd99b610800 1 -- 172.21.15.134:0/4284679692 shutdown_connections 2024-04-24T02:14:11.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.537+0000 7fd99b610800 1 -- 172.21.15.134:0/4284679692 wait complete. 2024-04-24T02:14:11.552 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T02:14:10.534163Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:14:10.534144Z', 'tags': [], 'group_ids': []} 2024-04-24T02:14:11.552 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T02:14:10.534163Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:14:10.534144Z', 'tags': [], 'group_ids': []} 2024-04-24T02:14:11.553 ERROR:root:0 2024-04-24T02:14:11.553 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T02:14:11.557 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T02:14:11.557 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-04-24T02:14:11.558 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-04-24T02:14:11.558 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'user-info-without-keys=*' 2024-04-24T02:14:11.602 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:14:11.602 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:14:11.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.602+0000 7f61e2546800 1 Processor -- start 2024-04-24T02:14:11.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.602+0000 7f61e2546800 1 -- start start 2024-04-24T02:14:11.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.602+0000 7f61e2546800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5640c50d6700 0x5640c50d6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.602+0000 7f61e2546800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5640c4f96d40 con 0x5640c50d7060 2024-04-24T02:14:11.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.602+0000 7f61e2546800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x5640c4f694d0 con 0x5640c50d6700 2024-04-24T02:14:11.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.602+0000 7f61e0045640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5640c50d6700 0x5640c50d6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.602+0000 7f61df844640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x5640c50d7060 0x5640c50d7510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:46478/0 (socket says 172.21.15.134:46478) 2024-04-24T02:14:11.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.603+0000 7f61df844640 1 -- 172.21.15.134:0/3323241245 learned_addr learned my addr 172.21.15.134:0/3323241245 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:14:11.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.603+0000 7f61e0045640 1 -- 172.21.15.134:0/3323241245 >> v1:172.21.15.104:6789/0 conn(0x5640c50d7060 legacy=0x5640c50d7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.603+0000 7f61e0045640 1 -- 172.21.15.134:0/3323241245 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640c4f95590 con 0x5640c50d6700 2024-04-24T02:14:11.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.603+0000 7f61df043640 1 -- 172.21.15.134:0/3323241245 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3597480219 0 0) 0x5640c4f96d40 con 0x5640c50d7060 2024-04-24T02:14:11.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.605+0000 7f61e0045640 1 --2- 172.21.15.134:0/3323241245 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5640c50d6700 0x5640c50d6b20 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f61d800a470 tx=0x7f61d801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4cb99c1728c43ab server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.605+0000 7f61df043640 1 -- 172.21.15.134:0/3323241245 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61d8057070 con 0x5640c50d6700 2024-04-24T02:14:11.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.605+0000 7f61df043640 1 -- 172.21.15.134:0/3323241245 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61d8052570 con 0x5640c50d6700 2024-04-24T02:14:11.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.605+0000 7f61df043640 1 -- 172.21.15.134:0/3323241245 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61d8052870 con 0x5640c50d6700 2024-04-24T02:14:11.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.605+0000 7f61e2546800 1 -- 172.21.15.134:0/3323241245 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5640c50d6700 msgr2=0x5640c50d6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.605+0000 7f61e2546800 1 --2- 172.21.15.134:0/3323241245 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5640c50d6700 0x5640c50d6b20 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f61d800a470 tx=0x7f61d801ce90 comp rx=0 tx=0).stop 2024-04-24T02:14:11.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.605+0000 7f61e2546800 1 -- 172.21.15.134:0/3323241245 shutdown_connections 2024-04-24T02:14:11.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.605+0000 7f61e2546800 1 --2- 172.21.15.134:0/3323241245 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5640c50d6700 0x5640c50d6b20 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.605+0000 7f61e2546800 1 -- 172.21.15.134:0/3323241245 >> 172.21.15.134:0/3323241245 conn(0x5640c50d2340 msgr2=0x5640c50d4760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:11.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.605+0000 7f61e2546800 1 -- 172.21.15.134:0/3323241245 shutdown_connections 2024-04-24T02:14:11.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.605+0000 7f61e2546800 1 -- 172.21.15.134:0/3323241245 wait complete. 2024-04-24T02:14:11.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.617+0000 7f61e2546800 1 Processor -- start 2024-04-24T02:14:11.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.617+0000 7f61e2546800 1 -- start start 2024-04-24T02:14:11.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.617+0000 7f61e2546800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5640c50d6700 0x5640c51cb190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.617+0000 7f61e2546800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5640c50233b0 con 0x5640c50d6700 2024-04-24T02:14:11.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.617+0000 7f61e0045640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5640c50d6700 0x5640c51cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.617+0000 7f61e0045640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5640c50d6700 0x5640c51cb190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43938/0 (socket says 172.21.15.134:43938) 2024-04-24T02:14:11.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.617+0000 7f61e0045640 1 -- 172.21.15.134:0/1224845650 learned_addr learned my addr 172.21.15.134:0/1224845650 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:11.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.618+0000 7f61e0045640 1 -- 172.21.15.134:0/1224845650 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640c51cb760 con 0x5640c50d6700 2024-04-24T02:14:11.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.618+0000 7f61e0045640 1 --2- 172.21.15.134:0/1224845650 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5640c50d6700 0x5640c51cb190 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f61d8055040 tx=0x7f61d804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4473f0911dda04e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.618+0000 7f60ce60c640 1 -- 172.21.15.134:0/1224845650 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61d8057070 con 0x5640c50d6700 2024-04-24T02:14:11.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.618+0000 7f60ce60c640 1 -- 172.21.15.134:0/1224845650 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61d8063070 con 0x5640c50d6700 2024-04-24T02:14:11.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.618+0000 7f60ce60c640 1 -- 172.21.15.134:0/1224845650 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61d8052720 con 0x5640c50d6700 2024-04-24T02:14:11.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.619+0000 7f61e2546800 1 -- 172.21.15.134:0/1224845650 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5640c50d6700 msgr2=0x5640c51cb190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.619+0000 7f61e2546800 1 --2- 172.21.15.134:0/1224845650 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5640c50d6700 0x5640c51cb190 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f61d8055040 tx=0x7f61d804c000 comp rx=0 tx=0).stop 2024-04-24T02:14:11.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.619+0000 7f61e2546800 1 -- 172.21.15.134:0/1224845650 shutdown_connections 2024-04-24T02:14:11.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.619+0000 7f61e2546800 1 --2- 172.21.15.134:0/1224845650 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5640c50d6700 0x5640c51cb190 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.619+0000 7f61e2546800 1 -- 172.21.15.134:0/1224845650 >> 172.21.15.134:0/1224845650 conn(0x5640c50d2340 msgr2=0x5640c51c6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:11.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.619+0000 7f61e2546800 1 -- 172.21.15.134:0/1224845650 shutdown_connections 2024-04-24T02:14:11.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.619+0000 7f61e2546800 1 -- 172.21.15.134:0/1224845650 wait complete. 2024-04-24T02:14:11.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.619+0000 7f61e2546800 1 Processor -- start 2024-04-24T02:14:11.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.619+0000 7f61e2546800 1 -- start start 2024-04-24T02:14:11.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.619+0000 7f61e2546800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5640c50d6700 0x5640c51d2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.619+0000 7f61e2546800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5640c50d7e90 con 0x5640c50d6700 2024-04-24T02:14:11.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.619+0000 7f61e0045640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5640c50d6700 0x5640c51d2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.619+0000 7f61e0045640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5640c50d6700 0x5640c51d2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43944/0 (socket says 172.21.15.134:43944) 2024-04-24T02:14:11.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.619+0000 7f61e0045640 1 -- 172.21.15.134:0/1017484137 learned_addr learned my addr 172.21.15.134:0/1017484137 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:11.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.620+0000 7f61e0045640 1 -- 172.21.15.134:0/1017484137 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640c51d3100 con 0x5640c50d6700 2024-04-24T02:14:11.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.620+0000 7f61e0045640 1 --2- 172.21.15.134:0/1017484137 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5640c50d6700 0x5640c51d2bc0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f61d8060040 tx=0x7f61d8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.620+0000 7f60cce09640 1 -- 172.21.15.134:0/1017484137 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61d8052e30 con 0x5640c50d6700 2024-04-24T02:14:11.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.620+0000 7f60cce09640 1 -- 172.21.15.134:0/1017484137 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61d806c070 con 0x5640c50d6700 2024-04-24T02:14:11.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.620+0000 7f61e2546800 1 -- 172.21.15.134:0/1017484137 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5640c51d3390 con 0x5640c50d6700 2024-04-24T02:14:11.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.620+0000 7f60cce09640 1 -- 172.21.15.134:0/1017484137 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61d805e5f0 con 0x5640c50d6700 2024-04-24T02:14:11.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.620+0000 7f61e2546800 1 -- 172.21.15.134:0/1017484137 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640c51d6040 con 0x5640c50d6700 2024-04-24T02:14:11.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.621+0000 7f60cce09640 1 -- 172.21.15.134:0/1017484137 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f61d805e790 con 0x5640c50d6700 2024-04-24T02:14:11.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.621+0000 7f60cce09640 1 --2- 172.21.15.134:0/1017484137 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f60c8036950 0x7f60c8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.621+0000 7f60cce09640 1 -- 172.21.15.134:0/1017484137 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f61d808e7f0 con 0x5640c50d6700 2024-04-24T02:14:11.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.621+0000 7f61df844640 1 --2- 172.21.15.134:0/1017484137 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f60c8036950 0x7f60c8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.621+0000 7f61e2546800 1 --2- 172.21.15.134:0/1017484137 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5640c50d7060 0x5640c51d9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.621+0000 7f61e2546800 1 -- 172.21.15.134:0/1017484137 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5640c51da340 con 0x5640c50d7060 2024-04-24T02:14:11.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.621+0000 7f61e0846640 1 --2- 172.21.15.134:0/1017484137 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5640c50d7060 0x5640c51d9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.622+0000 7f61df844640 1 --2- 172.21.15.134:0/1017484137 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f60c8036950 0x7f60c8038e10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f61c8000c00 tx=0x7f61c80013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.622+0000 7f61e0846640 1 --2- 172.21.15.134:0/1017484137 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5640c50d7060 0x5640c51d9e00 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.622+0000 7f61e0846640 1 -- 172.21.15.134:0/1017484137 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f61d000a4a0 con 0x5640c50d7060 2024-04-24T02:14:11.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.622+0000 7f61e2546800 1 -- 172.21.15.134:0/1017484137 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5640c51d73b0 con 0x5640c50d7060 2024-04-24T02:14:11.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.622+0000 7f61e0846640 1 -- 172.21.15.134:0/1017484137 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f61d000a4a0 con 0x5640c50d7060 2024-04-24T02:14:11.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.622+0000 7f61e2546800 1 -- 172.21.15.134:0/1017484137 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5640c51dc120 con 0x5640c50d7060 2024-04-24T02:14:11.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.623+0000 7f61e0846640 1 -- 172.21.15.134:0/1017484137 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f61d000a4a0 con 0x5640c50d7060 2024-04-24T02:14:11.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.623+0000 7f61e2546800 1 -- 172.21.15.134:0/1017484137 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5640c51db460 con 0x5640c50d7060 2024-04-24T02:14:11.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.623+0000 7f61e0846640 1 -- 172.21.15.134:0/1017484137 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f61d000a4a0 con 0x5640c50d7060 2024-04-24T02:14:11.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.623+0000 7f61e2546800 1 -- 172.21.15.134:0/1017484137 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5640c51db880 con 0x5640c50d7060 2024-04-24T02:14:11.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.623+0000 7f61e0846640 1 -- 172.21.15.134:0/1017484137 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f61d000a4a0 con 0x5640c50d7060 2024-04-24T02:14:11.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.624+0000 7f61e2546800 1 Processor -- start 2024-04-24T02:14:11.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.624+0000 7f61e2546800 1 -- start start 2024-04-24T02:14:11.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.624+0000 7f61e2546800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5640c51eaf30 0x5640c51eb350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.624+0000 7f61e2546800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5640c4fc96b0 con 0x5640c51eaf30 2024-04-24T02:14:11.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.624+0000 7f61df844640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5640c51eaf30 0x5640c51eb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.624+0000 7f61df844640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5640c51eaf30 0x5640c51eb350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43956/0 (socket says 172.21.15.134:43956) 2024-04-24T02:14:11.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.624+0000 7f61df844640 1 -- 172.21.15.134:0/3409658195 learned_addr learned my addr 172.21.15.134:0/3409658195 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:11.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.624+0000 7f61df844640 1 -- 172.21.15.134:0/3409658195 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640c51eb890 con 0x5640c51eaf30 2024-04-24T02:14:11.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.625+0000 7f61df844640 1 --2- 172.21.15.134:0/3409658195 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5640c51eaf30 0x5640c51eb350 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f61c800e610 tx=0x7f61c800ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.625+0000 7f60c5ffb640 1 -- 172.21.15.134:0/3409658195 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61c8022070 con 0x5640c51eaf30 2024-04-24T02:14:11.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.625+0000 7f60c5ffb640 1 -- 172.21.15.134:0/3409658195 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61c8009050 con 0x5640c51eaf30 2024-04-24T02:14:11.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.625+0000 7f61e2546800 1 -- 172.21.15.134:0/3409658195 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5640c51ec300 con 0x5640c51eaf30 2024-04-24T02:14:11.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.625+0000 7f60c5ffb640 1 -- 172.21.15.134:0/3409658195 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61c800d500 con 0x5640c51eaf30 2024-04-24T02:14:11.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.625+0000 7f61e2546800 1 -- 172.21.15.134:0/3409658195 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640c51ec800 con 0x5640c51eaf30 2024-04-24T02:14:11.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.625+0000 7f60c5ffb640 1 -- 172.21.15.134:0/3409658195 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f61c8025070 con 0x5640c51eaf30 2024-04-24T02:14:11.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.626+0000 7f60c5ffb640 1 --2- 172.21.15.134:0/3409658195 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f60b8036950 0x7f60b8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.626+0000 7f60c5ffb640 1 -- 172.21.15.134:0/3409658195 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f61c804dae0 con 0x5640c51eaf30 2024-04-24T02:14:11.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.626+0000 7f61e0846640 1 --2- 172.21.15.134:0/3409658195 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f60b8036950 0x7f60b8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.626+0000 7f61e2546800 1 Processor -- start 2024-04-24T02:14:11.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.626+0000 7f61e0846640 1 --2- 172.21.15.134:0/3409658195 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f60b8036950 0x7f60b8038e10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x5640c51db800 tx=0x7f61d0005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.626+0000 7f61e2546800 1 -- start start 2024-04-24T02:14:11.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.626+0000 7f61e2546800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5640c51f8270 0x5640c51f8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.626+0000 7f61e2546800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5640c51cba20 con 0x5640c51f8270 2024-04-24T02:14:11.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.626+0000 7f61df844640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5640c51f8270 0x5640c51f8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.626+0000 7f61df844640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5640c51f8270 0x5640c51f8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43964/0 (socket says 172.21.15.134:43964) 2024-04-24T02:14:11.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.626+0000 7f61df844640 1 -- 172.21.15.134:0/1447040198 learned_addr learned my addr 172.21.15.134:0/1447040198 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:11.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.627+0000 7f61df844640 1 -- 172.21.15.134:0/1447040198 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640c51f8c60 con 0x5640c51f8270 2024-04-24T02:14:11.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.627+0000 7f61df844640 1 --2- 172.21.15.134:0/1447040198 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5640c51f8270 0x5640c51f8690 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f61c8026fd0 tx=0x7f61c8024eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7363fad00440aebb server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.627+0000 7f60bf7fe640 1 -- 172.21.15.134:0/1447040198 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61c804a030 con 0x5640c51f8270 2024-04-24T02:14:11.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.627+0000 7f60bf7fe640 1 -- 172.21.15.134:0/1447040198 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61c8025e30 con 0x5640c51f8270 2024-04-24T02:14:11.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.627+0000 7f60bf7fe640 1 -- 172.21.15.134:0/1447040198 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61c801ad50 con 0x5640c51f8270 2024-04-24T02:14:11.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.627+0000 7f61e2546800 1 -- 172.21.15.134:0/1447040198 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5640c51f8270 msgr2=0x5640c51f8690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.627+0000 7f61e2546800 1 --2- 172.21.15.134:0/1447040198 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5640c51f8270 0x5640c51f8690 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f61c8026fd0 tx=0x7f61c8024eb0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.627+0000 7f61e2546800 1 -- 172.21.15.134:0/1447040198 shutdown_connections 2024-04-24T02:14:11.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.627+0000 7f61e2546800 1 --2- 172.21.15.134:0/1447040198 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5640c51f8270 0x5640c51f8690 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.627+0000 7f61e2546800 1 -- 172.21.15.134:0/1447040198 >> 172.21.15.134:0/1447040198 conn(0x5640c51f45d0 msgr2=0x5640c51f2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:11.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.627+0000 7f61e2546800 1 -- 172.21.15.134:0/1447040198 shutdown_connections 2024-04-24T02:14:11.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.627+0000 7f61e2546800 1 -- 172.21.15.134:0/1447040198 wait complete. 2024-04-24T02:14:11.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.628+0000 7f61e2546800 1 Processor -- start 2024-04-24T02:14:11.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.628+0000 7f61e2546800 1 -- start start 2024-04-24T02:14:11.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.628+0000 7f61e2546800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5640c51f8270 0x5640c51ff8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.628+0000 7f61e2546800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5640c51f93d0 con 0x5640c51f8270 2024-04-24T02:14:11.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.628+0000 7f61df844640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5640c51f8270 0x5640c51ff8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.628+0000 7f61df844640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5640c51f8270 0x5640c51ff8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43968/0 (socket says 172.21.15.134:43968) 2024-04-24T02:14:11.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.628+0000 7f61df844640 1 -- 172.21.15.134:0/1610005907 learned_addr learned my addr 172.21.15.134:0/1610005907 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:11.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.628+0000 7f61df844640 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640c51ffdf0 con 0x5640c51f8270 2024-04-24T02:14:11.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.628+0000 7f61df844640 1 --2- 172.21.15.134:0/1610005907 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5640c51f8270 0x5640c51ff8b0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f61c8026fd0 tx=0x7f61c804be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.628+0000 7f60bdffb640 1 -- 172.21.15.134:0/1610005907 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61c804a050 con 0x5640c51f8270 2024-04-24T02:14:11.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.628+0000 7f60bdffb640 1 -- 172.21.15.134:0/1610005907 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61c800d6a0 con 0x5640c51f8270 2024-04-24T02:14:11.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.628+0000 7f60bdffb640 1 -- 172.21.15.134:0/1610005907 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61c800da00 con 0x5640c51f8270 2024-04-24T02:14:11.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.628+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5640c5200080 con 0x5640c51f8270 2024-04-24T02:14:11.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.629+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640c5202d30 con 0x5640c51f8270 2024-04-24T02:14:11.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.629+0000 7f60bdffb640 1 -- 172.21.15.134:0/1610005907 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f61c804d370 con 0x5640c51f8270 2024-04-24T02:14:11.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.629+0000 7f60bdffb640 1 --2- 172.21.15.134:0/1610005907 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f60b0036950 0x7f60b0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.629+0000 7f60bdffb640 1 -- 172.21.15.134:0/1610005907 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f61c8036be0 con 0x5640c51f8270 2024-04-24T02:14:11.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.629+0000 7f61e0846640 1 --2- 172.21.15.134:0/1610005907 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f60b0036950 0x7f60b0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.630+0000 7f61e0846640 1 --2- 172.21.15.134:0/1610005907 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f60b0036950 0x7f60b0038e10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x5640c51daf80 tx=0x7f61d001f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.630+0000 7f61e2546800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.630+0000 7f61e2546800 1 --2- 172.21.15.134:0/1610005907 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5640c520b400 0x5640c520d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.630+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5640c520e010 con 0x5640c520b400 2024-04-24T02:14:11.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.630+0000 7f61e0045640 1 --2- 172.21.15.134:0/1610005907 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5640c520b400 0x5640c520d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.630+0000 7f61e0045640 1 --2- 172.21.15.134:0/1610005907 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5640c520b400 0x5640c520d8c0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.631+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f61d8071990 con 0x5640c520b400 2024-04-24T02:14:11.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.631+0000 7f61e2546800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:11.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.631+0000 7f61e2546800 20 realm 2024-04-24T02:14:11.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.631+0000 7f61e2546800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.631+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5640c520e420 con 0x5640c520b400 2024-04-24T02:14:11.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.631+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f61d8071990 con 0x5640c520b400 2024-04-24T02:14:11.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.631+0000 7f61e2546800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:11.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.631+0000 7f61e2546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:14:11.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.631+0000 7f61e2546800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.631+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5640c520ecf0 con 0x5640c520b400 2024-04-24T02:14:11.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.631+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f61d8071990 con 0x5640c520b400 2024-04-24T02:14:11.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.631+0000 7f61e2546800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:11.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.631+0000 7f61e2546800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.631+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5640c520f090 con 0x5640c520b400 2024-04-24T02:14:11.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.631+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f61d8071990 con 0x5640c520b400 2024-04-24T02:14:11.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.631+0000 7f61e2546800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:14:11.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.631+0000 7f61e2546800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.631+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5640c520f8e0 con 0x5640c520b400 2024-04-24T02:14:11.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.632+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f61d8071990 con 0x5640c520b400 2024-04-24T02:14:11.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.632+0000 7f61e2546800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:14:11.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.632+0000 7f61e2546800 20 searching for the correct realm 2024-04-24T02:14:11.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.632+0000 7f61e2546800 1 --2- 172.21.15.134:0/1610005907 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5640c5211650 0x5640c5213a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.632+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5640c5214020 con 0x5640c5211650 2024-04-24T02:14:11.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.632+0000 7f61df844640 1 --2- 172.21.15.134:0/1610005907 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5640c5211650 0x5640c5213a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.632+0000 7f61df844640 1 --2- 172.21.15.134:0/1610005907 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5640c5211650 0x5640c5213a40 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.632+0000 7f61df844640 1 -- 172.21.15.134:0/1610005907 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61c8024030 con 0x5640c5211650 2024-04-24T02:14:11.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.632+0000 7f61df844640 1 --2- 172.21.15.134:0/1610005907 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f61c8027060 0x7f61c8027440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.632+0000 7f61df844640 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5640c5214020 con 0x7f61c8027060 2024-04-24T02:14:11.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.633+0000 7f61e0846640 1 --2- 172.21.15.134:0/1610005907 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f61c8027060 0x7f61c8027440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.633+0000 7f61e0846640 1 --2- 172.21.15.134:0/1610005907 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f61c8027060 0x7f61c8027440 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.633+0000 7f61e0846640 1 -- 172.21.15.134:0/1610005907 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61d001f070 con 0x7f61c8027060 2024-04-24T02:14:11.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.633+0000 7f61e0846640 1 --2- 172.21.15.134:0/1610005907 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f61d0031040 0x7f61d0032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.633+0000 7f61e0846640 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5640c5214020 con 0x7f61d0031040 2024-04-24T02:14:11.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.633+0000 7f61e0045640 1 --2- 172.21.15.134:0/1610005907 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f61d0031040 0x7f61d0032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.634+0000 7f61e0045640 1 --2- 172.21.15.134:0/1610005907 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f61d0031040 0x7f61d0032940 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.634+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61d8071990 con 0x7f61d0031040 2024-04-24T02:14:11.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.634+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5640c520f8e0 con 0x5640c520b400 2024-04-24T02:14:11.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.634+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61d8071990 con 0x5640c520b400 2024-04-24T02:14:11.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.635+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5640c520f8e0 con 0x5640c520b400 2024-04-24T02:14:11.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.635+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f61d8071990 con 0x5640c520b400 2024-04-24T02:14:11.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.635+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5640c520f8e0 con 0x7f61d0031040 2024-04-24T02:14:11.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.635+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61d8071990 con 0x7f61d0031040 2024-04-24T02:14:11.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.635+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5640c520f8e0 con 0x7f61c8027060 2024-04-24T02:14:11.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.635+0000 7f61e0846640 1 -- 172.21.15.134:0/1610005907 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61d001f070 con 0x7f61c8027060 2024-04-24T02:14:11.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.635+0000 7f61e0846640 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5640c520f8e0 con 0x7f61c8027060 2024-04-24T02:14:11.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.635+0000 7f61e0846640 1 -- 172.21.15.134:0/1610005907 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61d001f070 con 0x7f61c8027060 2024-04-24T02:14:11.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.635+0000 7f61e0846640 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5640c520f8e0 con 0x5640c5211650 2024-04-24T02:14:11.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.636+0000 7f61df844640 1 -- 172.21.15.134:0/1610005907 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61c8024030 con 0x5640c5211650 2024-04-24T02:14:11.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.636+0000 7f61df844640 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5640c520f8e0 con 0x5640c520b400 2024-04-24T02:14:11.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.636+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61d8071990 con 0x5640c520b400 2024-04-24T02:14:11.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.636+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5640c520f8e0 con 0x7f61d0031040 2024-04-24T02:14:11.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.636+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61d8071990 con 0x7f61d0031040 2024-04-24T02:14:11.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.636+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5640c520f8e0 con 0x5640c520b400 2024-04-24T02:14:11.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.637+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61d8071990 con 0x5640c520b400 2024-04-24T02:14:11.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.637+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5640c520f8e0 con 0x7f61c8027060 2024-04-24T02:14:11.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.637+0000 7f61e0846640 1 -- 172.21.15.134:0/1610005907 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f61d001f070 con 0x7f61c8027060 2024-04-24T02:14:11.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.637+0000 7f61e0846640 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5640c520f8e0 con 0x5640c5211650 2024-04-24T02:14:11.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.637+0000 7f61df844640 1 -- 172.21.15.134:0/1610005907 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61c8024030 con 0x5640c5211650 2024-04-24T02:14:11.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.637+0000 7f61df844640 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5640c520f8e0 con 0x5640c5211650 2024-04-24T02:14:11.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.637+0000 7f61df844640 1 -- 172.21.15.134:0/1610005907 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61c8024030 con 0x5640c5211650 2024-04-24T02:14:11.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.637+0000 7f61df844640 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5640c520f8e0 con 0x7f61c8027060 2024-04-24T02:14:11.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.637+0000 7f61e0846640 1 -- 172.21.15.134:0/1610005907 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61d001f070 con 0x7f61c8027060 2024-04-24T02:14:11.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.637+0000 7f61e0846640 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5640c520f8e0 con 0x5640c5211650 2024-04-24T02:14:11.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.638+0000 7f61df844640 1 -- 172.21.15.134:0/1610005907 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61c8024030 con 0x5640c5211650 2024-04-24T02:14:11.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.638+0000 7f61df844640 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5640c520f8e0 con 0x5640c5211650 2024-04-24T02:14:11.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.638+0000 7f61df844640 1 -- 172.21.15.134:0/1610005907 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61c8024030 con 0x5640c5211650 2024-04-24T02:14:11.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.638+0000 7f61df844640 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5640c520f8e0 con 0x5640c520b400 2024-04-24T02:14:11.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.638+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61d8071990 con 0x5640c520b400 2024-04-24T02:14:11.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.638+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5640c520f8e0 con 0x5640c520b400 2024-04-24T02:14:11.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.638+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=132b] v32'6 uv6 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f61d8071990 con 0x5640c520b400 2024-04-24T02:14:11.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.638+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5640c520f8e0 con 0x7f61d0031040 2024-04-24T02:14:11.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.639+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61d8071990 con 0x7f61d0031040 2024-04-24T02:14:11.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.639+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5640c520f8e0 con 0x5640c5211650 2024-04-24T02:14:11.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.639+0000 7f61df844640 1 -- 172.21.15.134:0/1610005907 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61c8024030 con 0x5640c5211650 2024-04-24T02:14:11.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.639+0000 7f61df844640 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5640c520f8e0 con 0x7f61c8027060 2024-04-24T02:14:11.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.639+0000 7f61e0846640 1 -- 172.21.15.134:0/1610005907 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61d001f070 con 0x7f61c8027060 2024-04-24T02:14:11.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.639+0000 7f61e0846640 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5640c520f8e0 con 0x5640c520b400 2024-04-24T02:14:11.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.639+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61d8071990 con 0x5640c520b400 2024-04-24T02:14:11.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.639+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5640c520f8e0 con 0x7f61d0031040 2024-04-24T02:14:11.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.640+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61d8071990 con 0x7f61d0031040 2024-04-24T02:14:11.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.640+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5640c520f8e0 con 0x5640c5211650 2024-04-24T02:14:11.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.640+0000 7f61df844640 1 -- 172.21.15.134:0/1610005907 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61c8024030 con 0x5640c5211650 2024-04-24T02:14:11.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.640+0000 7f61df844640 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5640c520f8e0 con 0x7f61d0031040 2024-04-24T02:14:11.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.640+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61d8071990 con 0x7f61d0031040 2024-04-24T02:14:11.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.640+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5640c520f8e0 con 0x7f61c8027060 2024-04-24T02:14:11.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.641+0000 7f61e0846640 1 -- 172.21.15.134:0/1610005907 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61d0040040 con 0x7f61c8027060 2024-04-24T02:14:11.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.641+0000 7f61e0846640 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5640c520f8e0 con 0x5640c5211650 2024-04-24T02:14:11.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.641+0000 7f61df844640 1 -- 172.21.15.134:0/1610005907 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61c8024030 con 0x5640c5211650 2024-04-24T02:14:11.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.641+0000 7f61df844640 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5640c520f8e0 con 0x7f61c8027060 2024-04-24T02:14:11.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.641+0000 7f61e0846640 1 -- 172.21.15.134:0/1610005907 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61d0040040 con 0x7f61c8027060 2024-04-24T02:14:11.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.641+0000 7f61e0846640 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5640c520f8e0 con 0x5640c520b400 2024-04-24T02:14:11.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.641+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f61d8071990 con 0x5640c520b400 2024-04-24T02:14:11.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.641+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5640c520f8e0 con 0x7f61c8027060 2024-04-24T02:14:11.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.641+0000 7f61e0846640 1 -- 172.21.15.134:0/1610005907 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61d0040040 con 0x7f61c8027060 2024-04-24T02:14:11.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.642+0000 7f61e2546800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:14:11.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.642+0000 7f61e2546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:14:11.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.642+0000 7f61e2546800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:14:11.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.642+0000 7f61e2546800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:14:11.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.642+0000 7f61e2546800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:14:11.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.642+0000 7f61e2546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:14:11.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.642+0000 7f61e2546800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.642+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5640c5210130 con 0x5640c520b400 2024-04-24T02:14:11.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.642+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f61d8071990 con 0x5640c520b400 2024-04-24T02:14:11.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.642+0000 7f61e2546800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:11.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.642+0000 7f61e2546800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.642+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5640c5210520 con 0x5640c520b400 2024-04-24T02:14:11.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.642+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f61d8071990 con 0x5640c520b400 2024-04-24T02:14:11.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.642+0000 7f61e2546800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:14:11.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.642+0000 7f61e2546800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.642+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5640c5210520 con 0x5640c520b400 2024-04-24T02:14:11.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.642+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f61d8071990 con 0x5640c520b400 2024-04-24T02:14:11.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.642+0000 7f61e2546800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:14:11.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.642+0000 7f61e2546800 20 zone default found 2024-04-24T02:14:11.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.642+0000 7f61e2546800 4 Realm: () 2024-04-24T02:14:11.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.642+0000 7f61e2546800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:14:11.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.642+0000 7f61e2546800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:14:11.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.642+0000 7f61e2546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:14:11.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.642+0000 7f61e2546800 20 zonegroup default 2024-04-24T02:14:11.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.642+0000 7f61e2546800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.642+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5640c52144a0 con 0x7f61d0031040 2024-04-24T02:14:11.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.643+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f61d8071990 con 0x7f61d0031040 2024-04-24T02:14:11.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.643+0000 7f61e2546800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:11.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.643+0000 7f61e2546800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.643+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5640c5215e80 con 0x5640c5211650 2024-04-24T02:14:11.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.643+0000 7f61df844640 1 -- 172.21.15.134:0/1610005907 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f61c8024030 con 0x5640c5211650 2024-04-24T02:14:11.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.643+0000 7f61e2546800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:11.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.643+0000 7f61e2546800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.643+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5640c5216220 con 0x5640c5211650 2024-04-24T02:14:11.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.643+0000 7f61df844640 1 -- 172.21.15.134:0/1610005907 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f61c8024030 con 0x5640c5211650 2024-04-24T02:14:11.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.644+0000 7f61e2546800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:11.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.644+0000 7f61e2546800 20 started sync module instance, tier type = 2024-04-24T02:14:11.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.644+0000 7f61e2546800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:14:11.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.644+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5640c5215320 con 0x7f61c8027060 2024-04-24T02:14:11.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.645+0000 7f61e0846640 1 -- 172.21.15.134:0/1610005907 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(44 notify.0 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61d0040040 con 0x7f61c8027060 2024-04-24T02:14:11.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.645+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94836185192208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5640c5216a70 con 0x7f61c8027060 2024-04-24T02:14:11.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.645+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5640c52172c0 con 0x5640c520b400 2024-04-24T02:14:11.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.646+0000 7f61e0846640 1 -- 172.21.15.134:0/1610005907 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94836185192208] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61d0040040 con 0x7f61c8027060 2024-04-24T02:14:11.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.646+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61d8071990 con 0x5640c520b400 2024-04-24T02:14:11.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.646+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94836185195968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5640c5216e90 con 0x5640c520b400 2024-04-24T02:14:11.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.646+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5640c5217960 con 0x5640c5211650 2024-04-24T02:14:11.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.647+0000 7f61df844640 1 -- 172.21.15.134:0/1610005907 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61c8024030 con 0x5640c5211650 2024-04-24T02:14:11.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.647+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94836185199696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5640c5218200 con 0x5640c5211650 2024-04-24T02:14:11.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.647+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5640c5218cc0 con 0x7f61c8027060 2024-04-24T02:14:11.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.647+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94836185195968] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61d8071990 con 0x5640c520b400 2024-04-24T02:14:11.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.648+0000 7f61df844640 1 -- 172.21.15.134:0/1610005907 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94836185199696] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61c8024030 con 0x5640c5211650 2024-04-24T02:14:11.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.648+0000 7f61e0846640 1 -- 172.21.15.134:0/1610005907 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(50 notify.3 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61d0040040 con 0x7f61c8027060 2024-04-24T02:14:11.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.648+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94836185202000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5640c52169e0 con 0x7f61c8027060 2024-04-24T02:14:11.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.648+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5640c52195a0 con 0x5640c520b400 2024-04-24T02:14:11.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.649+0000 7f61e0846640 1 -- 172.21.15.134:0/1610005907 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94836185202000] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61d0040040 con 0x7f61c8027060 2024-04-24T02:14:11.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.649+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61d8071990 con 0x5640c520b400 2024-04-24T02:14:11.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.649+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94836185204624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5640c5219560 con 0x5640c520b400 2024-04-24T02:14:11.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.649+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5640c5219fd0 con 0x7f61d0031040 2024-04-24T02:14:11.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.650+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(54 notify.5 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61d8071990 con 0x7f61d0031040 2024-04-24T02:14:11.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.650+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94836185204624] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61d8071990 con 0x5640c520b400 2024-04-24T02:14:11.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.650+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94836185209600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5640c5219fd0 con 0x7f61d0031040 2024-04-24T02:14:11.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.650+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5640c52190f0 con 0x7f61d0031040 2024-04-24T02:14:11.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.651+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(56 notify.6 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61d8071990 con 0x7f61d0031040 2024-04-24T02:14:11.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.651+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94836185207024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5640c521ae90 con 0x7f61d0031040 2024-04-24T02:14:11.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.651+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5640c521b930 con 0x7f61d0031040 2024-04-24T02:14:11.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.651+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94836185209600] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61d8071990 con 0x7f61d0031040 2024-04-24T02:14:11.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.652+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(58 notify.7 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61d8071990 con 0x7f61d0031040 2024-04-24T02:14:11.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.652+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94836185207024] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61d8071990 con 0x7f61d0031040 2024-04-24T02:14:11.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.652+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94836185216000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5640c521b8f0 con 0x7f61d0031040 2024-04-24T02:14:11.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.652+0000 7f61e2546800 20 add_watcher() i=0 2024-04-24T02:14:11.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.652+0000 7f61e2546800 20 add_watcher() i=1 2024-04-24T02:14:11.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.652+0000 7f61e2546800 20 add_watcher() i=2 2024-04-24T02:14:11.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.652+0000 7f61e2546800 20 add_watcher() i=3 2024-04-24T02:14:11.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.652+0000 7f61e2546800 20 add_watcher() i=4 2024-04-24T02:14:11.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.652+0000 7f61e2546800 20 add_watcher() i=5 2024-04-24T02:14:11.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.652+0000 7f61e2546800 20 add_watcher() i=6 2024-04-24T02:14:11.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.653+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94836185216000] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61d8071990 con 0x7f61d0031040 2024-04-24T02:14:11.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.653+0000 7f61e2546800 20 add_watcher() i=7 2024-04-24T02:14:11.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.653+0000 7f61e2546800 2 all 8 watchers are set, enabling cache 2024-04-24T02:14:11.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.653+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5640c521e920 con 0x5640c520b400 2024-04-24T02:14:11.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.653+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f61d8071990 con 0x5640c520b400 2024-04-24T02:14:11.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.654+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94836185211680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5640c521bda0 con 0x5640c520b400 2024-04-24T02:14:11.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.655+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94836185211680] v32'266 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f61d8071990 con 0x5640c520b400 2024-04-24T02:14:11.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.655+0000 7f60967e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:14:11.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.655+0000 7f61e2546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:14:11.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.655+0000 7f61e2546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:14:11.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.655+0000 7f61e2546800 5 note: GC not initialized 2024-04-24T02:14:11.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.655+0000 7f60957e2640 20 reqs_thread_entry: start 2024-04-24T02:14:11.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.655+0000 7f61e2546800 20 init_complete bucket index max shards: 11 2024-04-24T02:14:11.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.655+0000 7f61e2546800 20 Filter name: none 2024-04-24T02:14:11.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.655+0000 7f600effd640 20 reqs_thread_entry: start 2024-04-24T02:14:11.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.655+0000 7f61e2546800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-24T02:14:11.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.655+0000 7f61e2546800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.655+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5640c5251bc0 con 0x7f61d0031040 2024-04-24T02:14:11.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.656+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f61d8071990 con 0x7f61d0031040 2024-04-24T02:14:11.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.656+0000 7f61e2546800 20 rados_obj.operate() r=0 bl.length=490 2024-04-24T02:14:11.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.656+0000 7f61e2546800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-24T02:14:11.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.656+0000 7f61e2546800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T02:14:11.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.656+0000 7f61e2546800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:14:11.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.656+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5640c52584a0 con 0x7f61d0031040 2024-04-24T02:14:11.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.657+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v32'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f61d8071990 con 0x7f61d0031040 2024-04-24T02:14:11.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.657+0000 7f61e2546800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T02:14:11.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.657+0000 7f61e2546800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T02:14:11.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.657+0000 7f61e2546800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-24T02:14:11.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.657+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94836185464592 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5640c5253bb0 con 0x5640c520b400 2024-04-24T02:14:11.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.657+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== watch-notify(notify (1) cookie 94836185204624 notify 137438953497 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7f61d808ce30 con 0x5640c520b400 2024-04-24T02:14:11.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.657+0000 7f60bf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953497 cookie 94836185204624 notifier 4872 bl.length()=666 2024-04-24T02:14:11.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.657+0000 7f60bf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T02:14:11.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.657+0000 7f60bf7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T02:14:11.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.657+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(64 notify.4 [notify cookie 94836185464592 out=8b] v0'0 uv261 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f61d8071990 con 0x5640c520b400 2024-04-24T02:14:11.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.657+0000 7f60bf7fe640 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f60a4003ea0 con 0x5640c520b400 2024-04-24T02:14:11.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.658+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61d8071990 con 0x5640c520b400 2024-04-24T02:14:11.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.658+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== watch-notify(notify_complete (2) cookie 94836185464592 notify 137438953497 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5640c51d6040 con 0x5640c520b400 2024-04-24T02:14:11.675 INFO:teuthology.orchestra.run.smithi134.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-24T02:14:10.534163Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T02:14:10.534144Z","tags":[],"group_ids":[]} 2024-04-24T02:14:11.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.659+0000 7f60967e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:14:11.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.659+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94836185211680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5640c5256b40 con 0x5640c520b400 2024-04-24T02:14:11.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.660+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94836185211680] v32'267 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f61d8071990 con 0x5640c520b400 2024-04-24T02:14:11.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.660+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94836185192208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5640c521a2f0 con 0x7f61c8027060 2024-04-24T02:14:11.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.661+0000 7f61e0846640 1 -- 172.21.15.134:0/1610005907 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94836185192208] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61d0040040 con 0x7f61c8027060 2024-04-24T02:14:11.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.661+0000 7f61e2546800 20 remove_watcher() i=0 2024-04-24T02:14:11.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.661+0000 7f61e2546800 2 removed watcher, disabling cache 2024-04-24T02:14:11.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.661+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94836185195968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5640c5215710 con 0x5640c520b400 2024-04-24T02:14:11.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.662+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94836185195968] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61d8071990 con 0x5640c520b400 2024-04-24T02:14:11.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.662+0000 7f61e2546800 20 remove_watcher() i=1 2024-04-24T02:14:11.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.662+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94836185199696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5640c52165c0 con 0x5640c5211650 2024-04-24T02:14:11.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.663+0000 7f61df844640 1 -- 172.21.15.134:0/1610005907 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94836185199696] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61c8024030 con 0x5640c5211650 2024-04-24T02:14:11.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.663+0000 7f61e2546800 20 remove_watcher() i=2 2024-04-24T02:14:11.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.663+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94836185202000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5640c5217450 con 0x7f61c8027060 2024-04-24T02:14:11.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.664+0000 7f61e0846640 1 -- 172.21.15.134:0/1610005907 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94836185202000] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61d0040040 con 0x7f61c8027060 2024-04-24T02:14:11.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.664+0000 7f61e2546800 20 remove_watcher() i=3 2024-04-24T02:14:11.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.664+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94836185204624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5640c5217450 con 0x5640c520b400 2024-04-24T02:14:11.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.665+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94836185204624] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61d8071990 con 0x5640c520b400 2024-04-24T02:14:11.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.665+0000 7f61e2546800 20 remove_watcher() i=4 2024-04-24T02:14:11.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.665+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94836185209600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5640c5218790 con 0x7f61d0031040 2024-04-24T02:14:11.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.666+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94836185209600] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61d8071990 con 0x7f61d0031040 2024-04-24T02:14:11.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.666+0000 7f61e2546800 20 remove_watcher() i=5 2024-04-24T02:14:11.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.666+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94836185207024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5640c5217450 con 0x7f61d0031040 2024-04-24T02:14:11.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.667+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94836185207024] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61d8071990 con 0x7f61d0031040 2024-04-24T02:14:11.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.667+0000 7f61e2546800 20 remove_watcher() i=6 2024-04-24T02:14:11.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.667+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94836185216000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5640c5218790 con 0x7f61d0031040 2024-04-24T02:14:11.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.668+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94836185216000] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61d8071990 con 0x7f61d0031040 2024-04-24T02:14:11.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.668+0000 7f61e2546800 20 remove_watcher() i=7 2024-04-24T02:14:11.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.668+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f61d0031040 msgr2=0x7f61d0032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.668+0000 7f61e2546800 1 --2- 172.21.15.134:0/1610005907 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f61d0031040 0x7f61d0032940 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.668+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5640c520b400 msgr2=0x5640c520d8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.668+0000 7f61e2546800 1 --2- 172.21.15.134:0/1610005907 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5640c520b400 0x5640c520d8c0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.668+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f61c8027060 msgr2=0x7f61c8027440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.668+0000 7f61e2546800 1 --2- 172.21.15.134:0/1610005907 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f61c8027060 0x7f61c8027440 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.668+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5640c5211650 msgr2=0x5640c5213a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.668+0000 7f61e2546800 1 --2- 172.21.15.134:0/1610005907 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5640c5211650 0x5640c5213a40 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.668+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f60b0036950 msgr2=0x7f60b0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.668+0000 7f61e2546800 1 --2- 172.21.15.134:0/1610005907 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f60b0036950 0x7f60b0038e10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x5640c51daf80 tx=0x7f61d001f000 comp rx=0 tx=0).stop 2024-04-24T02:14:11.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.668+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5640c51f8270 msgr2=0x5640c51ff8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.668+0000 7f61e0045640 1 -- 172.21.15.134:0/1610005907 reap_dead start 2024-04-24T02:14:11.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.668+0000 7f61e2546800 1 --2- 172.21.15.134:0/1610005907 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5640c51f8270 0x5640c51ff8b0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f61c8026fd0 tx=0x7f61c804be50 comp rx=0 tx=0).stop 2024-04-24T02:14:11.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.668+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 shutdown_connections 2024-04-24T02:14:11.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.668+0000 7f61e2546800 1 --2- 172.21.15.134:0/1610005907 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5640c51f8270 0x5640c51ff8b0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.668+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 >> 172.21.15.134:0/1610005907 conn(0x5640c51f45d0 msgr2=0x5640c51f1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:11.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.668+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 shutdown_connections 2024-04-24T02:14:11.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.668+0000 7f61e2546800 1 -- 172.21.15.134:0/1610005907 wait complete. 2024-04-24T02:14:11.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.669+0000 7f61e2546800 1 -- 172.21.15.134:0/3409658195 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f60b8036950 msgr2=0x7f60b8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.669+0000 7f61e2546800 1 --2- 172.21.15.134:0/3409658195 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f60b8036950 0x7f60b8038e10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x5640c51db800 tx=0x7f61d0005840 comp rx=0 tx=0).stop 2024-04-24T02:14:11.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.669+0000 7f61e2546800 1 -- 172.21.15.134:0/3409658195 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5640c51eaf30 msgr2=0x5640c51eb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.669+0000 7f61e2546800 1 --2- 172.21.15.134:0/3409658195 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5640c51eaf30 0x5640c51eb350 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f61c800e610 tx=0x7f61c800ff90 comp rx=0 tx=0).stop 2024-04-24T02:14:11.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.669+0000 7f61e2546800 1 -- 172.21.15.134:0/3409658195 shutdown_connections 2024-04-24T02:14:11.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.669+0000 7f61e2546800 1 --2- 172.21.15.134:0/3409658195 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f60b8036950 0x7f60b8038e10 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.669+0000 7f61e2546800 1 --2- 172.21.15.134:0/3409658195 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5640c51eaf30 0x5640c51eb350 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.669+0000 7f61e2546800 1 -- 172.21.15.134:0/3409658195 >> 172.21.15.134:0/3409658195 conn(0x5640c51defd0 msgr2=0x5640c51df3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:11.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.669+0000 7f61e2546800 1 -- 172.21.15.134:0/3409658195 shutdown_connections 2024-04-24T02:14:11.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.669+0000 7f61e2546800 1 -- 172.21.15.134:0/3409658195 wait complete. 2024-04-24T02:14:11.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.669+0000 7f61e2546800 1 -- 172.21.15.134:0/1017484137 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5640c50d7060 msgr2=0x5640c51d9e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.669+0000 7f61e2546800 1 --2- 172.21.15.134:0/1017484137 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5640c50d7060 0x5640c51d9e00 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.669+0000 7f61e2546800 1 -- 172.21.15.134:0/1017484137 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f60c8036950 msgr2=0x7f60c8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.669+0000 7f61e2546800 1 --2- 172.21.15.134:0/1017484137 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f60c8036950 0x7f60c8038e10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f61c8000c00 tx=0x7f61c80013b0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.669+0000 7f61e2546800 1 -- 172.21.15.134:0/1017484137 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5640c50d6700 msgr2=0x5640c51d2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.669+0000 7f61e2546800 1 --2- 172.21.15.134:0/1017484137 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5640c50d6700 0x5640c51d2bc0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f61d8060040 tx=0x7f61d8002fb0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.669+0000 7f61e2546800 1 -- 172.21.15.134:0/1017484137 shutdown_connections 2024-04-24T02:14:11.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.669+0000 7f61e2546800 1 --2- 172.21.15.134:0/1017484137 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5640c50d7060 0x5640c51d9e00 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.669+0000 7f61e2546800 1 --2- 172.21.15.134:0/1017484137 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f60c8036950 0x7f60c8038e10 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.669+0000 7f61e2546800 1 --2- 172.21.15.134:0/1017484137 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5640c50d6700 0x5640c51d2bc0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.669+0000 7f61e2546800 1 -- 172.21.15.134:0/1017484137 >> 172.21.15.134:0/1017484137 conn(0x5640c50d2340 msgr2=0x5640c51c52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:11.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.669+0000 7f61e2546800 1 -- 172.21.15.134:0/1017484137 shutdown_connections 2024-04-24T02:14:11.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.669+0000 7f61e2546800 1 -- 172.21.15.134:0/1017484137 wait complete. 2024-04-24T02:14:11.685 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T02:14:10.534163Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:14:10.534144Z', 'tags': [], 'group_ids': []} 2024-04-24T02:14:11.686 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T02:14:10.534163Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:14:10.534144Z', 'tags': [], 'group_ids': []} 2024-04-24T02:14:11.686 ERROR:root:0 2024-04-24T02:14:11.686 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T02:14:11.690 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T02:14:11.691 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-24T02:14:11.691 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-24T02:14:11.691 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-04-24T02:14:11.735 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:14:11.736 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:14:11.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.735+0000 7f1503c10800 1 Processor -- start 2024-04-24T02:14:11.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.735+0000 7f1503c10800 1 -- start start 2024-04-24T02:14:11.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.735+0000 7f1503c10800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x556f3b022d40 0x556f3b023160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.735+0000 7f1503c10800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556f3aee2d40 con 0x556f3b023fa0 2024-04-24T02:14:11.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.735+0000 7f1503c10800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x556f3aeb54d0 con 0x556f3b022d40 2024-04-24T02:14:11.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.736+0000 7f14ff1ee640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x556f3b022d40 0x556f3b023160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.736+0000 7f14f7fff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x556f3b023fa0 0x556f3b024420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:46488/0 (socket says 172.21.15.134:46488) 2024-04-24T02:14:11.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.736+0000 7f14f7fff640 1 -- 172.21.15.134:0/1886339626 learned_addr learned my addr 172.21.15.134:0/1886339626 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:14:11.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.736+0000 7f14ff1ee640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x556f3b022d40 0x556f3b023160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43976/0 (socket says 172.21.15.134:43976) 2024-04-24T02:14:11.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.736+0000 7f14ff1ee640 1 -- 172.21.15.134:0/1886339626 >> v1:172.21.15.104:6789/0 conn(0x556f3b023fa0 legacy=0x556f3b024420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.736+0000 7f14fe9ed640 1 -- 172.21.15.134:0/1886339626 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4036132621 0 0) 0x556f3aee2d40 con 0x556f3b023fa0 2024-04-24T02:14:11.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.736+0000 7f14ff1ee640 1 -- 172.21.15.134:0/1886339626 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f3aee1590 con 0x556f3b022d40 2024-04-24T02:14:11.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.738+0000 7f14ff1ee640 1 --2- 172.21.15.134:0/1886339626 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f3b022d40 0x556f3b023160 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f14f000a470 tx=0x7f14f001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12d9710737b1d7a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.738+0000 7f14fe9ed640 1 -- 172.21.15.134:0/1886339626 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14f0057070 con 0x556f3b022d40 2024-04-24T02:14:11.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.738+0000 7f14fe9ed640 1 -- 172.21.15.134:0/1886339626 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14f0052570 con 0x556f3b022d40 2024-04-24T02:14:11.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.738+0000 7f14fe9ed640 1 -- 172.21.15.134:0/1886339626 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14f0052870 con 0x556f3b022d40 2024-04-24T02:14:11.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.738+0000 7f1503c10800 1 -- 172.21.15.134:0/1886339626 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f3b022d40 msgr2=0x556f3b023160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.738+0000 7f1503c10800 1 --2- 172.21.15.134:0/1886339626 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f3b022d40 0x556f3b023160 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f14f000a470 tx=0x7f14f001ce90 comp rx=0 tx=0).stop 2024-04-24T02:14:11.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.738+0000 7f1503c10800 1 -- 172.21.15.134:0/1886339626 shutdown_connections 2024-04-24T02:14:11.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.738+0000 7f1503c10800 1 --2- 172.21.15.134:0/1886339626 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f3b022d40 0x556f3b023160 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.738+0000 7f1503c10800 1 -- 172.21.15.134:0/1886339626 >> 172.21.15.134:0/1886339626 conn(0x556f3b01e3a0 msgr2=0x556f3b0207c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:11.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.738+0000 7f1503c10800 1 -- 172.21.15.134:0/1886339626 shutdown_connections 2024-04-24T02:14:11.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.739+0000 7f1503c10800 1 -- 172.21.15.134:0/1886339626 wait complete. 2024-04-24T02:14:11.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.750+0000 7f1503c10800 1 Processor -- start 2024-04-24T02:14:11.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.750+0000 7f1503c10800 1 -- start start 2024-04-24T02:14:11.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.750+0000 7f1503c10800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f3b022d40 0x556f3af97010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.750+0000 7f1503c10800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556f3af6f3b0 con 0x556f3b022d40 2024-04-24T02:14:11.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.751+0000 7f14ff1ee640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f3b022d40 0x556f3af97010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.751+0000 7f14ff1ee640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f3b022d40 0x556f3af97010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43992/0 (socket says 172.21.15.134:43992) 2024-04-24T02:14:11.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.751+0000 7f14ff1ee640 1 -- 172.21.15.134:0/2828096931 learned_addr learned my addr 172.21.15.134:0/2828096931 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:11.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.751+0000 7f14ff1ee640 1 -- 172.21.15.134:0/2828096931 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f3b118130 con 0x556f3b022d40 2024-04-24T02:14:11.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.751+0000 7f14ff1ee640 1 --2- 172.21.15.134:0/2828096931 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f3b022d40 0x556f3af97010 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f14f0055040 tx=0x7f14f004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e71b15f9aa2dda3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.751+0000 7f13ed60a640 1 -- 172.21.15.134:0/2828096931 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14f0057070 con 0x556f3b022d40 2024-04-24T02:14:11.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.751+0000 7f13ed60a640 1 -- 172.21.15.134:0/2828096931 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14f0063070 con 0x556f3b022d40 2024-04-24T02:14:11.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.751+0000 7f13ed60a640 1 -- 172.21.15.134:0/2828096931 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14f0052720 con 0x556f3b022d40 2024-04-24T02:14:11.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.752+0000 7f1503c10800 1 -- 172.21.15.134:0/2828096931 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f3b022d40 msgr2=0x556f3af97010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.752+0000 7f1503c10800 1 --2- 172.21.15.134:0/2828096931 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f3b022d40 0x556f3af97010 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f14f0055040 tx=0x7f14f004c000 comp rx=0 tx=0).stop 2024-04-24T02:14:11.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.752+0000 7f1503c10800 1 -- 172.21.15.134:0/2828096931 shutdown_connections 2024-04-24T02:14:11.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.752+0000 7f1503c10800 1 --2- 172.21.15.134:0/2828096931 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f3b022d40 0x556f3af97010 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.752+0000 7f1503c10800 1 -- 172.21.15.134:0/2828096931 >> 172.21.15.134:0/2828096931 conn(0x556f3b01e3a0 msgr2=0x556f3b10fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:11.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.752+0000 7f1503c10800 1 -- 172.21.15.134:0/2828096931 shutdown_connections 2024-04-24T02:14:11.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.752+0000 7f1503c10800 1 -- 172.21.15.134:0/2828096931 wait complete. 2024-04-24T02:14:11.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.752+0000 7f1503c10800 1 Processor -- start 2024-04-24T02:14:11.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.752+0000 7f1503c10800 1 -- start start 2024-04-24T02:14:11.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.752+0000 7f1503c10800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f3b023fa0 0x556f3b11d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.752+0000 7f1503c10800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556f3b02c440 con 0x556f3b023fa0 2024-04-24T02:14:11.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.753+0000 7f14ff1ee640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f3b023fa0 0x556f3b11d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.753+0000 7f14ff1ee640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f3b023fa0 0x556f3b11d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:43996/0 (socket says 172.21.15.134:43996) 2024-04-24T02:14:11.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.753+0000 7f14ff1ee640 1 -- 172.21.15.134:0/3130606822 learned_addr learned my addr 172.21.15.134:0/3130606822 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:11.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.753+0000 7f14ff1ee640 1 -- 172.21.15.134:0/3130606822 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f3b11d560 con 0x556f3b023fa0 2024-04-24T02:14:11.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.753+0000 7f14ff1ee640 1 --2- 172.21.15.134:0/3130606822 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f3b023fa0 0x556f3b11d020 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f14f0060040 tx=0x7f14f0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.753+0000 7f13ebe07640 1 -- 172.21.15.134:0/3130606822 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14f0052b60 con 0x556f3b023fa0 2024-04-24T02:14:11.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.753+0000 7f13ebe07640 1 -- 172.21.15.134:0/3130606822 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14f006c070 con 0x556f3b023fa0 2024-04-24T02:14:11.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.753+0000 7f1503c10800 1 -- 172.21.15.134:0/3130606822 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556f3b11d7f0 con 0x556f3b023fa0 2024-04-24T02:14:11.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.753+0000 7f13ebe07640 1 -- 172.21.15.134:0/3130606822 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14f0052e50 con 0x556f3b023fa0 2024-04-24T02:14:11.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.753+0000 7f1503c10800 1 -- 172.21.15.134:0/3130606822 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f3b1204a0 con 0x556f3b023fa0 2024-04-24T02:14:11.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.754+0000 7f13ebe07640 1 -- 172.21.15.134:0/3130606822 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f14f005e480 con 0x556f3b023fa0 2024-04-24T02:14:11.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.754+0000 7f13ebe07640 1 --2- 172.21.15.134:0/3130606822 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f13e4036af0 0x7f13e4038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.754+0000 7f13ebe07640 1 -- 172.21.15.134:0/3130606822 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f14f008e540 con 0x556f3b023fa0 2024-04-24T02:14:11.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.754+0000 7f14f7fff640 1 --2- 172.21.15.134:0/3130606822 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f13e4036af0 0x7f13e4038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.754+0000 7f1503c10800 1 --2- 172.21.15.134:0/3130606822 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556f3b122250 0x556f3b124640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.754+0000 7f1503c10800 1 -- 172.21.15.134:0/3130606822 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f3b124b80 con 0x556f3b122250 2024-04-24T02:14:11.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.755+0000 7f14ff9ef640 1 --2- 172.21.15.134:0/3130606822 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556f3b122250 0x556f3b124640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.755+0000 7f14f7fff640 1 --2- 172.21.15.134:0/3130606822 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f13e4036af0 0x7f13e4038fb0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f14e8000c00 tx=0x7f14e80013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.755+0000 7f14ff9ef640 1 --2- 172.21.15.134:0/3130606822 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556f3b122250 0x556f3b124640 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.755+0000 7f14ff9ef640 1 -- 172.21.15.134:0/3130606822 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f14f800a4a0 con 0x556f3b122250 2024-04-24T02:14:11.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.755+0000 7f1503c10800 1 -- 172.21.15.134:0/3130606822 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f3b121810 con 0x556f3b122250 2024-04-24T02:14:11.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.755+0000 7f14ff9ef640 1 -- 172.21.15.134:0/3130606822 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f14f800a4a0 con 0x556f3b122250 2024-04-24T02:14:11.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.755+0000 7f1503c10800 1 -- 172.21.15.134:0/3130606822 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f3b126960 con 0x556f3b122250 2024-04-24T02:14:11.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.756+0000 7f14ff9ef640 1 -- 172.21.15.134:0/3130606822 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f14f800a4a0 con 0x556f3b122250 2024-04-24T02:14:11.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.756+0000 7f1503c10800 1 -- 172.21.15.134:0/3130606822 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f3b125ca0 con 0x556f3b122250 2024-04-24T02:14:11.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.756+0000 7f14ff9ef640 1 -- 172.21.15.134:0/3130606822 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f14f800a4a0 con 0x556f3b122250 2024-04-24T02:14:11.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.756+0000 7f1503c10800 1 -- 172.21.15.134:0/3130606822 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f3b1260c0 con 0x556f3b122250 2024-04-24T02:14:11.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.756+0000 7f14ff9ef640 1 -- 172.21.15.134:0/3130606822 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f14f800a4a0 con 0x556f3b122250 2024-04-24T02:14:11.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.757+0000 7f1503c10800 1 Processor -- start 2024-04-24T02:14:11.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.757+0000 7f1503c10800 1 -- start start 2024-04-24T02:14:11.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.757+0000 7f1503c10800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f3b115cc0 0x556f3b114130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.757+0000 7f1503c10800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556f3af156b0 con 0x556f3b115cc0 2024-04-24T02:14:11.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.757+0000 7f14f7fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f3b115cc0 0x556f3b114130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.757+0000 7f14f7fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f3b115cc0 0x556f3b114130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:44012/0 (socket says 172.21.15.134:44012) 2024-04-24T02:14:11.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.757+0000 7f14f7fff640 1 -- 172.21.15.134:0/721587091 learned_addr learned my addr 172.21.15.134:0/721587091 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:11.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.757+0000 7f14f7fff640 1 -- 172.21.15.134:0/721587091 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f3b114670 con 0x556f3b115cc0 2024-04-24T02:14:11.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.757+0000 7f14f7fff640 1 --2- 172.21.15.134:0/721587091 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f3b115cc0 0x556f3b114130 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f14e800e610 tx=0x7f14e800ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.758+0000 7f13e9602640 1 -- 172.21.15.134:0/721587091 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14e8022070 con 0x556f3b115cc0 2024-04-24T02:14:11.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.758+0000 7f13e9602640 1 -- 172.21.15.134:0/721587091 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14e8009050 con 0x556f3b115cc0 2024-04-24T02:14:11.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.758+0000 7f13e9602640 1 -- 172.21.15.134:0/721587091 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14e800d500 con 0x556f3b115cc0 2024-04-24T02:14:11.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.758+0000 7f1503c10800 1 -- 172.21.15.134:0/721587091 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556f3b114900 con 0x556f3b115cc0 2024-04-24T02:14:11.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.758+0000 7f1503c10800 1 -- 172.21.15.134:0/721587091 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f3b114e00 con 0x556f3b115cc0 2024-04-24T02:14:11.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.758+0000 7f13e9602640 1 -- 172.21.15.134:0/721587091 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f14e8025070 con 0x556f3b115cc0 2024-04-24T02:14:11.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.759+0000 7f13e9602640 1 --2- 172.21.15.134:0/721587091 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f13d8036950 0x7f13d8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.759+0000 7f13e9602640 1 -- 172.21.15.134:0/721587091 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f14e804dae0 con 0x556f3b115cc0 2024-04-24T02:14:11.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.759+0000 7f14ff9ef640 1 --2- 172.21.15.134:0/721587091 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f13d8036950 0x7f13d8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.759+0000 7f1503c10800 1 Processor -- start 2024-04-24T02:14:11.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.759+0000 7f1503c10800 1 -- start start 2024-04-24T02:14:11.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.759+0000 7f14ff9ef640 1 --2- 172.21.15.134:0/721587091 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f13d8036950 0x7f13d8038e10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x556f3b126040 tx=0x7f14f8005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.759+0000 7f1503c10800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f3b144d10 0x556f3b145130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.759+0000 7f1503c10800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556f3b1183c0 con 0x556f3b144d10 2024-04-24T02:14:11.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.759+0000 7f14f7fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f3b144d10 0x556f3b145130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.759+0000 7f14f7fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f3b144d10 0x556f3b145130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:44018/0 (socket says 172.21.15.134:44018) 2024-04-24T02:14:11.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.759+0000 7f14f7fff640 1 -- 172.21.15.134:0/3643595104 learned_addr learned my addr 172.21.15.134:0/3643595104 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:11.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.759+0000 7f14f7fff640 1 -- 172.21.15.134:0/3643595104 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f3b145700 con 0x556f3b144d10 2024-04-24T02:14:11.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.760+0000 7f14f7fff640 1 --2- 172.21.15.134:0/3643595104 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f3b144d10 0x556f3b145130 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f14e8026fd0 tx=0x7f14e8024eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab8d92d3891168cc server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.760+0000 7f13e2ffd640 1 -- 172.21.15.134:0/3643595104 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14e804a030 con 0x556f3b144d10 2024-04-24T02:14:11.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.760+0000 7f13e2ffd640 1 -- 172.21.15.134:0/3643595104 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14e8025e30 con 0x556f3b144d10 2024-04-24T02:14:11.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.760+0000 7f13e2ffd640 1 -- 172.21.15.134:0/3643595104 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14e801ad50 con 0x556f3b144d10 2024-04-24T02:14:11.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.760+0000 7f1503c10800 1 -- 172.21.15.134:0/3643595104 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f3b144d10 msgr2=0x556f3b145130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.760+0000 7f1503c10800 1 --2- 172.21.15.134:0/3643595104 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f3b144d10 0x556f3b145130 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f14e8026fd0 tx=0x7f14e8024eb0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.760+0000 7f1503c10800 1 -- 172.21.15.134:0/3643595104 shutdown_connections 2024-04-24T02:14:11.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.760+0000 7f1503c10800 1 --2- 172.21.15.134:0/3643595104 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f3b144d10 0x556f3b145130 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.760+0000 7f1503c10800 1 -- 172.21.15.134:0/3643595104 >> 172.21.15.134:0/3643595104 conn(0x556f3b141030 msgr2=0x556f3b13f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:11.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.760+0000 7f1503c10800 1 -- 172.21.15.134:0/3643595104 shutdown_connections 2024-04-24T02:14:11.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.760+0000 7f1503c10800 1 -- 172.21.15.134:0/3643595104 wait complete. 2024-04-24T02:14:11.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.760+0000 7f1503c10800 1 Processor -- start 2024-04-24T02:14:11.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.761+0000 7f1503c10800 1 -- start start 2024-04-24T02:14:11.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.761+0000 7f1503c10800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f3b144d10 0x556f3b14c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.761+0000 7f1503c10800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556f3b145e80 con 0x556f3b144d10 2024-04-24T02:14:11.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.761+0000 7f14f7fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f3b144d10 0x556f3b14c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.761+0000 7f14f7fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f3b144d10 0x556f3b14c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:44032/0 (socket says 172.21.15.134:44032) 2024-04-24T02:14:11.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.761+0000 7f14f7fff640 1 -- 172.21.15.134:0/887723696 learned_addr learned my addr 172.21.15.134:0/887723696 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:11.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.761+0000 7f14f7fff640 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f3b14c880 con 0x556f3b144d10 2024-04-24T02:14:11.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.761+0000 7f14f7fff640 1 --2- 172.21.15.134:0/887723696 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f3b144d10 0x556f3b14c340 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f14e8026fd0 tx=0x7f14e804be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.761+0000 7f13e17fa640 1 -- 172.21.15.134:0/887723696 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14e804a050 con 0x556f3b144d10 2024-04-24T02:14:11.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.761+0000 7f13e17fa640 1 -- 172.21.15.134:0/887723696 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14e800d6a0 con 0x556f3b144d10 2024-04-24T02:14:11.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.761+0000 7f13e17fa640 1 -- 172.21.15.134:0/887723696 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14e800d9e0 con 0x556f3b144d10 2024-04-24T02:14:11.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.761+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556f3b14cb10 con 0x556f3b144d10 2024-04-24T02:14:11.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.761+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f3b14f7c0 con 0x556f3b144d10 2024-04-24T02:14:11.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.762+0000 7f13e17fa640 1 -- 172.21.15.134:0/887723696 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f14e804d370 con 0x556f3b144d10 2024-04-24T02:14:11.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.762+0000 7f13e17fa640 1 --2- 172.21.15.134:0/887723696 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f13c8036950 0x7f13c8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.762+0000 7f13e17fa640 1 -- 172.21.15.134:0/887723696 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f14e80457f0 con 0x556f3b144d10 2024-04-24T02:14:11.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.762+0000 7f14ff9ef640 1 --2- 172.21.15.134:0/887723696 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f13c8036950 0x7f13c8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.763+0000 7f14ff9ef640 1 --2- 172.21.15.134:0/887723696 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f13c8036950 0x7f13c8038e10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x556f3b1257c0 tx=0x7f14f801f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.763+0000 7f1503c10800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.763+0000 7f1503c10800 1 --2- 172.21.15.134:0/887723696 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556f3b157e90 0x556f3b15a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.763+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f3b15aaa0 con 0x556f3b157e90 2024-04-24T02:14:11.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.763+0000 7f14ff1ee640 1 --2- 172.21.15.134:0/887723696 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556f3b157e90 0x556f3b15a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.763+0000 7f14ff1ee640 1 --2- 172.21.15.134:0/887723696 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556f3b157e90 0x556f3b15a350 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.763+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f14f0009d30 con 0x556f3b157e90 2024-04-24T02:14:11.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.763+0000 7f1503c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:11.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.763+0000 7f1503c10800 20 realm 2024-04-24T02:14:11.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.763+0000 7f1503c10800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.763+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f3b15aeb0 con 0x556f3b157e90 2024-04-24T02:14:11.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.764+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f14f0009d30 con 0x556f3b157e90 2024-04-24T02:14:11.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.764+0000 7f1503c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:11.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.764+0000 7f1503c10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:14:11.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.764+0000 7f1503c10800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.764+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f3b15b780 con 0x556f3b157e90 2024-04-24T02:14:11.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.764+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f14f0009d30 con 0x556f3b157e90 2024-04-24T02:14:11.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.764+0000 7f1503c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:11.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.764+0000 7f1503c10800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.764+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f3b15bb20 con 0x556f3b157e90 2024-04-24T02:14:11.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.764+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f14f0009d30 con 0x556f3b157e90 2024-04-24T02:14:11.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.764+0000 7f1503c10800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:14:11.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.764+0000 7f1503c10800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.764+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f3b15c370 con 0x556f3b157e90 2024-04-24T02:14:11.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.764+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f14f0009d30 con 0x556f3b157e90 2024-04-24T02:14:11.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.764+0000 7f1503c10800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:14:11.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.764+0000 7f1503c10800 20 searching for the correct realm 2024-04-24T02:14:11.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.764+0000 7f1503c10800 1 --2- 172.21.15.134:0/887723696 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x556f3b15e0e0 0x556f3b1604d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.764+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f3b160ae0 con 0x556f3b15e0e0 2024-04-24T02:14:11.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.764+0000 7f14f7fff640 1 --2- 172.21.15.134:0/887723696 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x556f3b15e0e0 0x556f3b1604d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.765+0000 7f14f7fff640 1 --2- 172.21.15.134:0/887723696 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x556f3b15e0e0 0x556f3b1604d0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.765+0000 7f14f7fff640 1 -- 172.21.15.134:0/887723696 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14e8024030 con 0x556f3b15e0e0 2024-04-24T02:14:11.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.765+0000 7f14f7fff640 1 --2- 172.21.15.134:0/887723696 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f14e8027060 0x7f14e80467d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.765+0000 7f14f7fff640 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f3b160ae0 con 0x7f14e8027060 2024-04-24T02:14:11.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.765+0000 7f14ff9ef640 1 --2- 172.21.15.134:0/887723696 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f14e8027060 0x7f14e80467d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.765+0000 7f14ff9ef640 1 --2- 172.21.15.134:0/887723696 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f14e8027060 0x7f14e80467d0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.766+0000 7f14ff9ef640 1 -- 172.21.15.134:0/887723696 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14f801f070 con 0x7f14e8027060 2024-04-24T02:14:11.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.766+0000 7f14ff9ef640 1 --2- 172.21.15.134:0/887723696 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f14f8031040 0x7f14f8032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.766+0000 7f14ff9ef640 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f3b160ae0 con 0x7f14f8031040 2024-04-24T02:14:11.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.766+0000 7f14ff1ee640 1 --2- 172.21.15.134:0/887723696 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f14f8031040 0x7f14f8032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.766+0000 7f14ff1ee640 1 --2- 172.21.15.134:0/887723696 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f14f8031040 0x7f14f8032940 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.766+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14f0009d30 con 0x7f14f8031040 2024-04-24T02:14:11.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.767+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f3b160ae0 con 0x556f3b157e90 2024-04-24T02:14:11.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.767+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14f0009d30 con 0x556f3b157e90 2024-04-24T02:14:11.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.767+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f3b160ae0 con 0x556f3b157e90 2024-04-24T02:14:11.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.767+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f14f0009d30 con 0x556f3b157e90 2024-04-24T02:14:11.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.767+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f3b160ae0 con 0x7f14f8031040 2024-04-24T02:14:11.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.767+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14f0009d30 con 0x7f14f8031040 2024-04-24T02:14:11.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.767+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f3b160ae0 con 0x7f14e8027060 2024-04-24T02:14:11.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.767+0000 7f14ff9ef640 1 -- 172.21.15.134:0/887723696 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14f801f070 con 0x7f14e8027060 2024-04-24T02:14:11.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.767+0000 7f14ff9ef640 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f3b160ae0 con 0x7f14e8027060 2024-04-24T02:14:11.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.768+0000 7f14ff9ef640 1 -- 172.21.15.134:0/887723696 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14f801f070 con 0x7f14e8027060 2024-04-24T02:14:11.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.768+0000 7f14ff9ef640 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f3b160ae0 con 0x556f3b15e0e0 2024-04-24T02:14:11.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.768+0000 7f14f7fff640 1 -- 172.21.15.134:0/887723696 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14e8024030 con 0x556f3b15e0e0 2024-04-24T02:14:11.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.768+0000 7f14f7fff640 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f3b160ae0 con 0x556f3b157e90 2024-04-24T02:14:11.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.768+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14f0009d30 con 0x556f3b157e90 2024-04-24T02:14:11.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.768+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f3b160ae0 con 0x7f14f8031040 2024-04-24T02:14:11.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.768+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14f0009d30 con 0x7f14f8031040 2024-04-24T02:14:11.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.768+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f3b160ae0 con 0x556f3b157e90 2024-04-24T02:14:11.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.769+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14f0009d30 con 0x556f3b157e90 2024-04-24T02:14:11.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.769+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f3b160ae0 con 0x7f14e8027060 2024-04-24T02:14:11.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.769+0000 7f14ff9ef640 1 -- 172.21.15.134:0/887723696 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f14f801f070 con 0x7f14e8027060 2024-04-24T02:14:11.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.769+0000 7f14ff9ef640 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f3b160ae0 con 0x556f3b15e0e0 2024-04-24T02:14:11.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.769+0000 7f14f7fff640 1 -- 172.21.15.134:0/887723696 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14e8024030 con 0x556f3b15e0e0 2024-04-24T02:14:11.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.769+0000 7f14f7fff640 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f3b160ae0 con 0x556f3b15e0e0 2024-04-24T02:14:11.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.769+0000 7f14f7fff640 1 -- 172.21.15.134:0/887723696 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14e8024030 con 0x556f3b15e0e0 2024-04-24T02:14:11.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.769+0000 7f14f7fff640 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f3b160ae0 con 0x7f14e8027060 2024-04-24T02:14:11.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.770+0000 7f14ff9ef640 1 -- 172.21.15.134:0/887723696 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14f801f070 con 0x7f14e8027060 2024-04-24T02:14:11.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.770+0000 7f14ff9ef640 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f3b160ae0 con 0x556f3b15e0e0 2024-04-24T02:14:11.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.770+0000 7f14f7fff640 1 -- 172.21.15.134:0/887723696 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14e8024030 con 0x556f3b15e0e0 2024-04-24T02:14:11.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.770+0000 7f14f7fff640 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f3b160ae0 con 0x556f3b15e0e0 2024-04-24T02:14:11.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.770+0000 7f14f7fff640 1 -- 172.21.15.134:0/887723696 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14e8024030 con 0x556f3b15e0e0 2024-04-24T02:14:11.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.770+0000 7f14f7fff640 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f3b160ae0 con 0x556f3b157e90 2024-04-24T02:14:11.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.770+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14f0009d30 con 0x556f3b157e90 2024-04-24T02:14:11.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.770+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f3b160ae0 con 0x556f3b157e90 2024-04-24T02:14:11.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.770+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=132b] v32'6 uv6 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f14f0009d30 con 0x556f3b157e90 2024-04-24T02:14:11.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.770+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f3b160ae0 con 0x7f14f8031040 2024-04-24T02:14:11.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.771+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14f0009d30 con 0x7f14f8031040 2024-04-24T02:14:11.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.771+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f3b160ae0 con 0x556f3b15e0e0 2024-04-24T02:14:11.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.771+0000 7f14f7fff640 1 -- 172.21.15.134:0/887723696 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14e8024030 con 0x556f3b15e0e0 2024-04-24T02:14:11.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.771+0000 7f14f7fff640 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f3b160ae0 con 0x7f14e8027060 2024-04-24T02:14:11.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.771+0000 7f14ff9ef640 1 -- 172.21.15.134:0/887723696 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14f801f070 con 0x7f14e8027060 2024-04-24T02:14:11.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.771+0000 7f14ff9ef640 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f3b160ae0 con 0x556f3b157e90 2024-04-24T02:14:11.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.771+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14f0009d30 con 0x556f3b157e90 2024-04-24T02:14:11.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.771+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f3b160ae0 con 0x7f14f8031040 2024-04-24T02:14:11.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.772+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14f0009d30 con 0x7f14f8031040 2024-04-24T02:14:11.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.772+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f3b160ae0 con 0x556f3b15e0e0 2024-04-24T02:14:11.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.772+0000 7f14f7fff640 1 -- 172.21.15.134:0/887723696 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14e8024030 con 0x556f3b15e0e0 2024-04-24T02:14:11.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.772+0000 7f14f7fff640 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f3b160ae0 con 0x7f14f8031040 2024-04-24T02:14:11.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.772+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14f0009d30 con 0x7f14f8031040 2024-04-24T02:14:11.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.772+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f3b160ae0 con 0x7f14e8027060 2024-04-24T02:14:11.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.772+0000 7f14ff9ef640 1 -- 172.21.15.134:0/887723696 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14f8040040 con 0x7f14e8027060 2024-04-24T02:14:11.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.772+0000 7f14ff9ef640 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f3b160ae0 con 0x556f3b15e0e0 2024-04-24T02:14:11.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.773+0000 7f14f7fff640 1 -- 172.21.15.134:0/887723696 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14e8024030 con 0x556f3b15e0e0 2024-04-24T02:14:11.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.773+0000 7f14f7fff640 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f3b160ae0 con 0x7f14e8027060 2024-04-24T02:14:11.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.773+0000 7f14ff9ef640 1 -- 172.21.15.134:0/887723696 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14f8040040 con 0x7f14e8027060 2024-04-24T02:14:11.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.773+0000 7f14ff9ef640 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f3b160ae0 con 0x556f3b157e90 2024-04-24T02:14:11.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.773+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f14f0009d30 con 0x556f3b157e90 2024-04-24T02:14:11.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.773+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f3b160ae0 con 0x7f14e8027060 2024-04-24T02:14:11.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.773+0000 7f14ff9ef640 1 -- 172.21.15.134:0/887723696 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14f8040040 con 0x7f14e8027060 2024-04-24T02:14:11.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.773+0000 7f1503c10800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:14:11.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.773+0000 7f1503c10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:14:11.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.773+0000 7f1503c10800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:14:11.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.773+0000 7f1503c10800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:14:11.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.773+0000 7f1503c10800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:14:11.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.773+0000 7f1503c10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:14:11.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.774+0000 7f1503c10800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.774+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f3b15ccf0 con 0x556f3b157e90 2024-04-24T02:14:11.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.774+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f14f0009d30 con 0x556f3b157e90 2024-04-24T02:14:11.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.774+0000 7f1503c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:11.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.774+0000 7f1503c10800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.774+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f3b15d590 con 0x556f3b157e90 2024-04-24T02:14:11.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.774+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f14f0009d30 con 0x556f3b157e90 2024-04-24T02:14:11.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.774+0000 7f1503c10800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:14:11.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.774+0000 7f1503c10800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.774+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f3b15d590 con 0x556f3b157e90 2024-04-24T02:14:11.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.774+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f14f0009d30 con 0x556f3b157e90 2024-04-24T02:14:11.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.774+0000 7f1503c10800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:14:11.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.774+0000 7f1503c10800 20 zone default found 2024-04-24T02:14:11.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.774+0000 7f1503c10800 4 Realm: () 2024-04-24T02:14:11.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.774+0000 7f1503c10800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:14:11.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.774+0000 7f1503c10800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:14:11.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.774+0000 7f1503c10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:14:11.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.774+0000 7f1503c10800 20 zonegroup default 2024-04-24T02:14:11.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.774+0000 7f1503c10800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.774+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f3b160f60 con 0x7f14f8031040 2024-04-24T02:14:11.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.775+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f14f0009d30 con 0x7f14f8031040 2024-04-24T02:14:11.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.775+0000 7f1503c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:11.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.775+0000 7f1503c10800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.775+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f3b1629d0 con 0x556f3b15e0e0 2024-04-24T02:14:11.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.775+0000 7f14f7fff640 1 -- 172.21.15.134:0/887723696 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f14e8024030 con 0x556f3b15e0e0 2024-04-24T02:14:11.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.775+0000 7f1503c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:11.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.775+0000 7f1503c10800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.775+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f3b162ea0 con 0x556f3b15e0e0 2024-04-24T02:14:11.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.776+0000 7f14f7fff640 1 -- 172.21.15.134:0/887723696 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f14e8024030 con 0x556f3b15e0e0 2024-04-24T02:14:11.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.776+0000 7f1503c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:11.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.776+0000 7f1503c10800 20 started sync module instance, tier type = 2024-04-24T02:14:11.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.776+0000 7f1503c10800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:14:11.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.776+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f3b161de0 con 0x7f14e8027060 2024-04-24T02:14:11.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.777+0000 7f14ff9ef640 1 -- 172.21.15.134:0/887723696 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(44 notify.0 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14f8040040 con 0x7f14e8027060 2024-04-24T02:14:11.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.777+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93936221037008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f3b1625f0 con 0x7f14e8027060 2024-04-24T02:14:11.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.777+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f3b163dd0 con 0x556f3b157e90 2024-04-24T02:14:11.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.778+0000 7f14ff9ef640 1 -- 172.21.15.134:0/887723696 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93936221037008] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14f8040040 con 0x7f14e8027060 2024-04-24T02:14:11.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.778+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14f0009d30 con 0x556f3b157e90 2024-04-24T02:14:11.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.778+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93936221042976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f3b1641f0 con 0x556f3b157e90 2024-04-24T02:14:11.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.778+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f3b164bb0 con 0x556f3b15e0e0 2024-04-24T02:14:11.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.779+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93936221042976] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14f0009d30 con 0x556f3b157e90 2024-04-24T02:14:11.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.779+0000 7f14f7fff640 1 -- 172.21.15.134:0/887723696 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14e8024030 con 0x556f3b15e0e0 2024-04-24T02:14:11.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.779+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93936221044032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f3b164160 con 0x556f3b15e0e0 2024-04-24T02:14:11.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.779+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f3b165910 con 0x7f14e8027060 2024-04-24T02:14:11.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.780+0000 7f14ff9ef640 1 -- 172.21.15.134:0/887723696 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(50 notify.3 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14f8040040 con 0x7f14e8027060 2024-04-24T02:14:11.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.780+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93936221049856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f3b1661e0 con 0x7f14e8027060 2024-04-24T02:14:11.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.780+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f3b166cb0 con 0x556f3b157e90 2024-04-24T02:14:11.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.780+0000 7f14f7fff640 1 -- 172.21.15.134:0/887723696 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93936221044032] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14e8024030 con 0x556f3b15e0e0 2024-04-24T02:14:11.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.781+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14f0009d30 con 0x556f3b157e90 2024-04-24T02:14:11.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.781+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93936221054880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f3b166c70 con 0x556f3b157e90 2024-04-24T02:14:11.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.781+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f3b167760 con 0x7f14f8031040 2024-04-24T02:14:11.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.781+0000 7f14ff9ef640 1 -- 172.21.15.134:0/887723696 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93936221049856] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14f8040040 con 0x7f14e8027060 2024-04-24T02:14:11.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.782+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(54 notify.5 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14f0009d30 con 0x7f14f8031040 2024-04-24T02:14:11.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.782+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93936221052208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f3b167760 con 0x7f14f8031040 2024-04-24T02:14:11.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.782+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93936221054880] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14f0009d30 con 0x556f3b157e90 2024-04-24T02:14:11.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.782+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f3b168170 con 0x7f14f8031040 2024-04-24T02:14:11.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.783+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 93936221052208] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14f0009d30 con 0x7f14f8031040 2024-04-24T02:14:11.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.784+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(56 notify.6 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14f0009d30 con 0x7f14f8031040 2024-04-24T02:14:11.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.784+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93936221048656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f3b167cc0 con 0x7f14f8031040 2024-04-24T02:14:11.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.784+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f3b168a10 con 0x7f14f8031040 2024-04-24T02:14:11.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.785+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 93936221048656] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14f0009d30 con 0x7f14f8031040 2024-04-24T02:14:11.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.785+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(58 notify.7 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14f0009d30 con 0x7f14f8031040 2024-04-24T02:14:11.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.785+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93936221057600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f3b167cc0 con 0x7f14f8031040 2024-04-24T02:14:11.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.785+0000 7f1503c10800 20 add_watcher() i=0 2024-04-24T02:14:11.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.785+0000 7f1503c10800 20 add_watcher() i=1 2024-04-24T02:14:11.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.785+0000 7f1503c10800 20 add_watcher() i=2 2024-04-24T02:14:11.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.785+0000 7f1503c10800 20 add_watcher() i=3 2024-04-24T02:14:11.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.785+0000 7f1503c10800 20 add_watcher() i=4 2024-04-24T02:14:11.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.785+0000 7f1503c10800 20 add_watcher() i=5 2024-04-24T02:14:11.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.785+0000 7f1503c10800 20 add_watcher() i=6 2024-04-24T02:14:11.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.787+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 93936221057600] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14f0009d30 con 0x7f14f8031040 2024-04-24T02:14:11.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.787+0000 7f1503c10800 20 add_watcher() i=7 2024-04-24T02:14:11.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.787+0000 7f1503c10800 2 all 8 watchers are set, enabling cache 2024-04-24T02:14:11.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.787+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f3b16ba40 con 0x556f3b157e90 2024-04-24T02:14:11.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.787+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f14f0009d30 con 0x556f3b157e90 2024-04-24T02:14:11.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.787+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93936221062416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f3b168f60 con 0x556f3b157e90 2024-04-24T02:14:11.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.788+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93936221062416] v32'268 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f14f0009d30 con 0x556f3b157e90 2024-04-24T02:14:11.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.788+0000 7f13b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:14:11.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.789+0000 7f1503c10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:14:11.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.789+0000 7f1503c10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:14:11.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.789+0000 7f1503c10800 5 note: GC not initialized 2024-04-24T02:14:11.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.789+0000 7f13b4fe1640 20 reqs_thread_entry: start 2024-04-24T02:14:11.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.789+0000 7f1503c10800 20 init_complete bucket index max shards: 11 2024-04-24T02:14:11.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.789+0000 7f1503c10800 20 Filter name: none 2024-04-24T02:14:11.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.789+0000 7f132e7fc640 20 reqs_thread_entry: start 2024-04-24T02:14:11.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.789+0000 7f1503c10800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-24T02:14:11.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.789+0000 7f1503c10800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.789+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f3b19eca0 con 0x7f14f8031040 2024-04-24T02:14:11.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.793+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f14f0009d30 con 0x7f14f8031040 2024-04-24T02:14:11.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.793+0000 7f1503c10800 20 rados_obj.operate() r=0 bl.length=490 2024-04-24T02:14:11.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.793+0000 7f1503c10800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-24T02:14:11.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.793+0000 7f1503c10800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T02:14:11.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.793+0000 7f1503c10800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:14:11.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.793+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~503 in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f3b1a5620 con 0x7f14f8031040 2024-04-24T02:14:11.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.794+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~503] v32'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f14f0009d30 con 0x7f14f8031040 2024-04-24T02:14:11.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.794+0000 7f1503c10800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T02:14:11.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.794+0000 7f1503c10800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T02:14:11.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.794+0000 7f1503c10800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-24T02:14:11.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.794+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93936221311120 in=691b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f3b1a0cb0 con 0x556f3b157e90 2024-04-24T02:14:11.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.794+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== watch-notify(notify (1) cookie 93936221054880 notify 137438953498 ret 0) ==== 721+0+0 (crc 0 0 0) 0x556f3b1204a0 con 0x556f3b157e90 2024-04-24T02:14:11.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.795+0000 7f13e2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953498 cookie 93936221054880 notifier 4879 bl.length()=679 2024-04-24T02:14:11.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.795+0000 7f13e2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T02:14:11.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.795+0000 7f13e2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T02:14:11.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.795+0000 7f13e2ffd640 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f13c4003ea0 con 0x556f3b157e90 2024-04-24T02:14:11.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.795+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(64 notify.4 [notify cookie 93936221311120 out=8b] v0'0 uv264 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f14f0009d30 con 0x556f3b157e90 2024-04-24T02:14:11.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.795+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14f0009d30 con 0x556f3b157e90 2024-04-24T02:14:11.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.795+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== watch-notify(notify_complete (2) cookie 93936221311120 notify 137438953498 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556f3b11d7f0 con 0x556f3b157e90 2024-04-24T02:14:11.805 INFO:teuthology.orchestra.run.smithi134.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-24T02:14:10.534163Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T02:14:10.534144Z","tags":[],"group_ids":[]} 2024-04-24T02:14:11.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.796+0000 7f13b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:14:11.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.796+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93936221062416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f3b16afe0 con 0x556f3b157e90 2024-04-24T02:14:11.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.797+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93936221062416] v32'269 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f14f0009d30 con 0x556f3b157e90 2024-04-24T02:14:11.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.797+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93936221037008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f3b168510 con 0x7f14e8027060 2024-04-24T02:14:11.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.798+0000 7f14ff9ef640 1 -- 172.21.15.134:0/887723696 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93936221037008] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14f8040040 con 0x7f14e8027060 2024-04-24T02:14:11.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.798+0000 7f1503c10800 20 remove_watcher() i=0 2024-04-24T02:14:11.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.798+0000 7f1503c10800 2 removed watcher, disabling cache 2024-04-24T02:14:11.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.798+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93936221042976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f3b168510 con 0x556f3b157e90 2024-04-24T02:14:11.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.799+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93936221042976] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14f0009d30 con 0x556f3b157e90 2024-04-24T02:14:11.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.799+0000 7f1503c10800 20 remove_watcher() i=1 2024-04-24T02:14:11.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.799+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93936221044032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f3b163920 con 0x556f3b15e0e0 2024-04-24T02:14:11.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.800+0000 7f14f7fff640 1 -- 172.21.15.134:0/887723696 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93936221044032] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14e8024030 con 0x556f3b15e0e0 2024-04-24T02:14:11.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.800+0000 7f1503c10800 20 remove_watcher() i=2 2024-04-24T02:14:11.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.800+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93936221049856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f3b168510 con 0x7f14e8027060 2024-04-24T02:14:11.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.801+0000 7f14ff9ef640 1 -- 172.21.15.134:0/887723696 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93936221049856] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14f8040040 con 0x7f14e8027060 2024-04-24T02:14:11.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.801+0000 7f1503c10800 20 remove_watcher() i=3 2024-04-24T02:14:11.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.801+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93936221054880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f3b168510 con 0x556f3b157e90 2024-04-24T02:14:11.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.802+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93936221054880] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14f0009d30 con 0x556f3b157e90 2024-04-24T02:14:11.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.802+0000 7f1503c10800 20 remove_watcher() i=4 2024-04-24T02:14:11.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.802+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93936221052208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f3b1667a0 con 0x7f14f8031040 2024-04-24T02:14:11.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.803+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93936221052208] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14f0009d30 con 0x7f14f8031040 2024-04-24T02:14:11.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.803+0000 7f1503c10800 20 remove_watcher() i=5 2024-04-24T02:14:11.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.803+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93936221048656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f3b168510 con 0x7f14f8031040 2024-04-24T02:14:11.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.804+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93936221048656] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14f0009d30 con 0x7f14f8031040 2024-04-24T02:14:11.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.804+0000 7f1503c10800 20 remove_watcher() i=6 2024-04-24T02:14:11.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.804+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93936221057600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f3b165d30 con 0x7f14f8031040 2024-04-24T02:14:11.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.805+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93936221057600] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14f0009d30 con 0x7f14f8031040 2024-04-24T02:14:11.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.805+0000 7f1503c10800 20 remove_watcher() i=7 2024-04-24T02:14:11.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.805+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f14f8031040 msgr2=0x7f14f8032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.805+0000 7f1503c10800 1 --2- 172.21.15.134:0/887723696 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f14f8031040 0x7f14f8032940 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.805+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556f3b157e90 msgr2=0x556f3b15a350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.805+0000 7f1503c10800 1 --2- 172.21.15.134:0/887723696 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556f3b157e90 0x556f3b15a350 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.805+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f14e8027060 msgr2=0x7f14e80467d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.805+0000 7f1503c10800 1 --2- 172.21.15.134:0/887723696 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f14e8027060 0x7f14e80467d0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.805+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x556f3b15e0e0 msgr2=0x556f3b1604d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.805+0000 7f1503c10800 1 --2- 172.21.15.134:0/887723696 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x556f3b15e0e0 0x556f3b1604d0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.805+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f13c8036950 msgr2=0x7f13c8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.805+0000 7f1503c10800 1 --2- 172.21.15.134:0/887723696 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f13c8036950 0x7f13c8038e10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x556f3b1257c0 tx=0x7f14f801f000 comp rx=0 tx=0).stop 2024-04-24T02:14:11.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.805+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f3b144d10 msgr2=0x556f3b14c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.805+0000 7f14ff1ee640 1 -- 172.21.15.134:0/887723696 reap_dead start 2024-04-24T02:14:11.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.805+0000 7f1503c10800 1 --2- 172.21.15.134:0/887723696 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f3b144d10 0x556f3b14c340 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f14e8026fd0 tx=0x7f14e804be50 comp rx=0 tx=0).stop 2024-04-24T02:14:11.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.805+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 shutdown_connections 2024-04-24T02:14:11.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.805+0000 7f1503c10800 1 --2- 172.21.15.134:0/887723696 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f3b144d10 0x556f3b14c340 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.805+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 >> 172.21.15.134:0/887723696 conn(0x556f3b141030 msgr2=0x556f3b13e690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:11.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.806+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 shutdown_connections 2024-04-24T02:14:11.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.806+0000 7f1503c10800 1 -- 172.21.15.134:0/887723696 wait complete. 2024-04-24T02:14:11.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.806+0000 7f1503c10800 1 -- 172.21.15.134:0/721587091 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f13d8036950 msgr2=0x7f13d8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.806+0000 7f1503c10800 1 --2- 172.21.15.134:0/721587091 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f13d8036950 0x7f13d8038e10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x556f3b126040 tx=0x7f14f8005840 comp rx=0 tx=0).stop 2024-04-24T02:14:11.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.806+0000 7f1503c10800 1 -- 172.21.15.134:0/721587091 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f3b115cc0 msgr2=0x556f3b114130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.806+0000 7f1503c10800 1 --2- 172.21.15.134:0/721587091 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f3b115cc0 0x556f3b114130 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f14e800e610 tx=0x7f14e800ff90 comp rx=0 tx=0).stop 2024-04-24T02:14:11.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.806+0000 7f1503c10800 1 -- 172.21.15.134:0/721587091 shutdown_connections 2024-04-24T02:14:11.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.806+0000 7f1503c10800 1 --2- 172.21.15.134:0/721587091 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f13d8036950 0x7f13d8038e10 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.806+0000 7f1503c10800 1 --2- 172.21.15.134:0/721587091 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f3b115cc0 0x556f3b114130 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.806+0000 7f1503c10800 1 -- 172.21.15.134:0/721587091 >> 172.21.15.134:0/721587091 conn(0x556f3b129810 msgr2=0x556f3b129c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:11.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.806+0000 7f1503c10800 1 -- 172.21.15.134:0/721587091 shutdown_connections 2024-04-24T02:14:11.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.806+0000 7f1503c10800 1 -- 172.21.15.134:0/721587091 wait complete. 2024-04-24T02:14:11.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.806+0000 7f1503c10800 1 -- 172.21.15.134:0/3130606822 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556f3b122250 msgr2=0x556f3b124640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.806+0000 7f1503c10800 1 --2- 172.21.15.134:0/3130606822 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556f3b122250 0x556f3b124640 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.806+0000 7f1503c10800 1 -- 172.21.15.134:0/3130606822 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f13e4036af0 msgr2=0x7f13e4038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.806+0000 7f1503c10800 1 --2- 172.21.15.134:0/3130606822 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f13e4036af0 0x7f13e4038fb0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f14e8000c00 tx=0x7f14e80013b0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.806+0000 7f1503c10800 1 -- 172.21.15.134:0/3130606822 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f3b023fa0 msgr2=0x556f3b11d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.806+0000 7f1503c10800 1 --2- 172.21.15.134:0/3130606822 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f3b023fa0 0x556f3b11d020 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f14f0060040 tx=0x7f14f0002fb0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.806+0000 7f1503c10800 1 -- 172.21.15.134:0/3130606822 shutdown_connections 2024-04-24T02:14:11.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.806+0000 7f1503c10800 1 --2- 172.21.15.134:0/3130606822 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556f3b122250 0x556f3b124640 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.806+0000 7f1503c10800 1 --2- 172.21.15.134:0/3130606822 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f13e4036af0 0x7f13e4038fb0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.806+0000 7f1503c10800 1 --2- 172.21.15.134:0/3130606822 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f3b023fa0 0x556f3b11d020 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.806+0000 7f1503c10800 1 -- 172.21.15.134:0/3130606822 >> 172.21.15.134:0/3130606822 conn(0x556f3b01e3a0 msgr2=0x556f3b10e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:11.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.806+0000 7f1503c10800 1 -- 172.21.15.134:0/3130606822 shutdown_connections 2024-04-24T02:14:11.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.806+0000 7f1503c10800 1 -- 172.21.15.134:0/3130606822 wait complete. 2024-04-24T02:14:11.817 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T02:14:10.534163Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:14:10.534144Z', 'tags': [], 'group_ids': []} 2024-04-24T02:14:11.817 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T02:14:10.534163Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:14:10.534144Z', 'tags': [], 'group_ids': []} 2024-04-24T02:14:11.817 ERROR:root:0 2024-04-24T02:14:11.817 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T02:14:11.822 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T02:14:11.822 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-04-24T02:14:11.822 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-04-24T02:14:11.822 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write; user-info-without-keys=*' 2024-04-24T02:14:11.867 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:14:11.867 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:14:11.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.867+0000 7f789d12f800 1 Processor -- start 2024-04-24T02:14:11.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.867+0000 7f789d12f800 1 -- start start 2024-04-24T02:14:11.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.867+0000 7f789d12f800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55aad0ce9210 0x55aad0ceb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.867+0000 7f789d12f800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55aad0ba4d40 con 0x55aad0ce4d80 2024-04-24T02:14:11.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.867+0000 7f789d12f800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55aad0b774d0 con 0x55aad0ce9210 2024-04-24T02:14:11.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.867+0000 7f7893fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55aad0ce9210 0x55aad0ceb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.867+0000 7f7898dae640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55aad0ce4d80 0x55aad0ce51a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:46492/0 (socket says 172.21.15.134:46492) 2024-04-24T02:14:11.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.867+0000 7f7898dae640 1 -- 172.21.15.134:0/2805485962 learned_addr learned my addr 172.21.15.134:0/2805485962 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:14:11.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.868+0000 7f7893fff640 1 -- 172.21.15.134:0/2805485962 >> v1:172.21.15.104:6789/0 conn(0x55aad0ce4d80 legacy=0x55aad0ce51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.868+0000 7f7893fff640 1 -- 172.21.15.134:0/2805485962 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aad0ba3590 con 0x55aad0ce9210 2024-04-24T02:14:11.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.868+0000 7f78937fe640 1 -- 172.21.15.134:0/2805485962 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3319395886 0 0) 0x55aad0ba4d40 con 0x55aad0ce4d80 2024-04-24T02:14:11.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.869+0000 7f7893fff640 1 --2- 172.21.15.134:0/2805485962 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aad0ce9210 0x55aad0ceb600 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f788400a470 tx=0x7f788401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=479cc5d96c90cd6d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.870+0000 7f78937fe640 1 -- 172.21.15.134:0/2805485962 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7884057070 con 0x55aad0ce9210 2024-04-24T02:14:11.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.870+0000 7f78937fe640 1 -- 172.21.15.134:0/2805485962 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7884052570 con 0x55aad0ce9210 2024-04-24T02:14:11.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.870+0000 7f78937fe640 1 -- 172.21.15.134:0/2805485962 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7884052870 con 0x55aad0ce9210 2024-04-24T02:14:11.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.870+0000 7f789d12f800 1 -- 172.21.15.134:0/2805485962 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aad0ce9210 msgr2=0x55aad0ceb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.870+0000 7f789d12f800 1 --2- 172.21.15.134:0/2805485962 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aad0ce9210 0x55aad0ceb600 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f788400a470 tx=0x7f788401ce90 comp rx=0 tx=0).stop 2024-04-24T02:14:11.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.870+0000 7f789d12f800 1 -- 172.21.15.134:0/2805485962 shutdown_connections 2024-04-24T02:14:11.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.870+0000 7f789d12f800 1 --2- 172.21.15.134:0/2805485962 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aad0ce9210 0x55aad0ceb600 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.870+0000 7f789d12f800 1 -- 172.21.15.134:0/2805485962 >> 172.21.15.134:0/2805485962 conn(0x55aad0ce0320 msgr2=0x55aad0ce2740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:11.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.870+0000 7f789d12f800 1 -- 172.21.15.134:0/2805485962 shutdown_connections 2024-04-24T02:14:11.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.870+0000 7f789d12f800 1 -- 172.21.15.134:0/2805485962 wait complete. 2024-04-24T02:14:11.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.882+0000 7f789d12f800 1 Processor -- start 2024-04-24T02:14:11.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.882+0000 7f789d12f800 1 -- start start 2024-04-24T02:14:11.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.882+0000 7f789d12f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aad0ce4d80 0x55aad0c598a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.882+0000 7f789d12f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55aad0c313b0 con 0x55aad0ce4d80 2024-04-24T02:14:11.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.882+0000 7f7898dae640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aad0ce4d80 0x55aad0c598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.882+0000 7f7898dae640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aad0ce4d80 0x55aad0c598a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:44048/0 (socket says 172.21.15.134:44048) 2024-04-24T02:14:11.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.882+0000 7f7898dae640 1 -- 172.21.15.134:0/3596175098 learned_addr learned my addr 172.21.15.134:0/3596175098 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:11.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.882+0000 7f7898dae640 1 -- 172.21.15.134:0/3596175098 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aad0dd9d00 con 0x55aad0ce4d80 2024-04-24T02:14:11.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.883+0000 7f7898dae640 1 --2- 172.21.15.134:0/3596175098 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aad0ce4d80 0x55aad0c598a0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f788c00b240 tx=0x7f788c00b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2edd48cec876314 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.883+0000 7f7786e05640 1 -- 172.21.15.134:0/3596175098 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f788c008070 con 0x55aad0ce4d80 2024-04-24T02:14:11.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.883+0000 7f7786e05640 1 -- 172.21.15.134:0/3596175098 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f788c00d500 con 0x55aad0ce4d80 2024-04-24T02:14:11.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.883+0000 7f7786e05640 1 -- 172.21.15.134:0/3596175098 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f788c00d860 con 0x55aad0ce4d80 2024-04-24T02:14:11.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.883+0000 7f789d12f800 1 -- 172.21.15.134:0/3596175098 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aad0ce4d80 msgr2=0x55aad0c598a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.883+0000 7f789d12f800 1 --2- 172.21.15.134:0/3596175098 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aad0ce4d80 0x55aad0c598a0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f788c00b240 tx=0x7f788c00b700 comp rx=0 tx=0).stop 2024-04-24T02:14:11.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.883+0000 7f789d12f800 1 -- 172.21.15.134:0/3596175098 shutdown_connections 2024-04-24T02:14:11.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.883+0000 7f789d12f800 1 --2- 172.21.15.134:0/3596175098 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aad0ce4d80 0x55aad0c598a0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.883+0000 7f789d12f800 1 -- 172.21.15.134:0/3596175098 >> 172.21.15.134:0/3596175098 conn(0x55aad0ce0320 msgr2=0x55aad0dd17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:11.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.883+0000 7f789d12f800 1 -- 172.21.15.134:0/3596175098 shutdown_connections 2024-04-24T02:14:11.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.884+0000 7f789d12f800 1 -- 172.21.15.134:0/3596175098 wait complete. 2024-04-24T02:14:11.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.884+0000 7f789d12f800 1 Processor -- start 2024-04-24T02:14:11.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.884+0000 7f789d12f800 1 -- start start 2024-04-24T02:14:11.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.884+0000 7f789d12f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aad0ce4d80 0x55aad0dd7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.884+0000 7f789d12f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55aad0cebed0 con 0x55aad0ce4d80 2024-04-24T02:14:11.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.884+0000 7f7898dae640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aad0ce4d80 0x55aad0dd7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.884+0000 7f7898dae640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aad0ce4d80 0x55aad0dd7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:44056/0 (socket says 172.21.15.134:44056) 2024-04-24T02:14:11.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.884+0000 7f7898dae640 1 -- 172.21.15.134:0/654570063 learned_addr learned my addr 172.21.15.134:0/654570063 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:11.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.885+0000 7f7898dae640 1 -- 172.21.15.134:0/654570063 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aad0dd5d40 con 0x55aad0ce4d80 2024-04-24T02:14:11.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.885+0000 7f7898dae640 1 --2- 172.21.15.134:0/654570063 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aad0ce4d80 0x55aad0dd7650 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f788c00b240 tx=0x7f788c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.885+0000 7f7785602640 1 -- 172.21.15.134:0/654570063 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f788c00f9d0 con 0x55aad0ce4d80 2024-04-24T02:14:11.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.885+0000 7f7785602640 1 -- 172.21.15.134:0/654570063 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f788c00fb70 con 0x55aad0ce4d80 2024-04-24T02:14:11.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.885+0000 7f7785602640 1 -- 172.21.15.134:0/654570063 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f788c019470 con 0x55aad0ce4d80 2024-04-24T02:14:11.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.885+0000 7f789d12f800 1 -- 172.21.15.134:0/654570063 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55aad0dd5fd0 con 0x55aad0ce4d80 2024-04-24T02:14:11.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.885+0000 7f789d12f800 1 -- 172.21.15.134:0/654570063 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aad0dd64f0 con 0x55aad0ce4d80 2024-04-24T02:14:11.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.886+0000 7f7785602640 1 -- 172.21.15.134:0/654570063 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f788c017040 con 0x55aad0ce4d80 2024-04-24T02:14:11.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.886+0000 7f7785602640 1 --2- 172.21.15.134:0/654570063 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7780036950 0x7f7780038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.886+0000 7f7785602640 1 -- 172.21.15.134:0/654570063 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f788c015020 con 0x55aad0ce4d80 2024-04-24T02:14:11.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.886+0000 7f7893fff640 1 --2- 172.21.15.134:0/654570063 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7780036950 0x7f7780038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.886+0000 7f789d12f800 1 --2- 172.21.15.134:0/654570063 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55aad0ce9210 0x55aad0de8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.886+0000 7f789d12f800 1 -- 172.21.15.134:0/654570063 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55aad0de85c0 con 0x55aad0ce9210 2024-04-24T02:14:11.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.886+0000 7f78995af640 1 --2- 172.21.15.134:0/654570063 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55aad0ce9210 0x55aad0de8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.886+0000 7f7893fff640 1 --2- 172.21.15.134:0/654570063 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7780036950 0x7f7780038e10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7884054000 tx=0x7f788404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.887+0000 7f78995af640 1 --2- 172.21.15.134:0/654570063 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55aad0ce9210 0x55aad0de8080 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.887+0000 7f78995af640 1 -- 172.21.15.134:0/654570063 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f789400a4a0 con 0x55aad0ce9210 2024-04-24T02:14:11.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.887+0000 7f789d12f800 1 -- 172.21.15.134:0/654570063 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55aad0de8960 con 0x55aad0ce9210 2024-04-24T02:14:11.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.887+0000 7f78995af640 1 -- 172.21.15.134:0/654570063 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f789400a4a0 con 0x55aad0ce9210 2024-04-24T02:14:11.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.887+0000 7f789d12f800 1 -- 172.21.15.134:0/654570063 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55aad0dea240 con 0x55aad0ce9210 2024-04-24T02:14:11.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.887+0000 7f78995af640 1 -- 172.21.15.134:0/654570063 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f789400a4a0 con 0x55aad0ce9210 2024-04-24T02:14:11.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.887+0000 7f789d12f800 1 -- 172.21.15.134:0/654570063 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55aad0de9580 con 0x55aad0ce9210 2024-04-24T02:14:11.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.888+0000 7f78995af640 1 -- 172.21.15.134:0/654570063 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f789400a4a0 con 0x55aad0ce9210 2024-04-24T02:14:11.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.888+0000 7f789d12f800 1 -- 172.21.15.134:0/654570063 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55aad0de99d0 con 0x55aad0ce9210 2024-04-24T02:14:11.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.888+0000 7f78995af640 1 -- 172.21.15.134:0/654570063 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f789400a4a0 con 0x55aad0ce9210 2024-04-24T02:14:11.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.888+0000 7f789d12f800 1 Processor -- start 2024-04-24T02:14:11.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.888+0000 7f789d12f800 1 -- start start 2024-04-24T02:14:11.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.888+0000 7f789d12f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aad0df9030 0x55aad0df9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.888+0000 7f789d12f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55aad0bd76b0 con 0x55aad0df9030 2024-04-24T02:14:11.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.889+0000 7f7893fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aad0df9030 0x55aad0df9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.889+0000 7f7893fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aad0df9030 0x55aad0df9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:44058/0 (socket says 172.21.15.134:44058) 2024-04-24T02:14:11.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.889+0000 7f7893fff640 1 -- 172.21.15.134:0/3905641970 learned_addr learned my addr 172.21.15.134:0/3905641970 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:11.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.889+0000 7f7893fff640 1 -- 172.21.15.134:0/3905641970 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aad0df9990 con 0x55aad0df9030 2024-04-24T02:14:11.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.889+0000 7f7893fff640 1 --2- 172.21.15.134:0/3905641970 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aad0df9030 0x55aad0df9450 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f7884044840 tx=0x7f7884002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.889+0000 7f777e7fc640 1 -- 172.21.15.134:0/3905641970 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f788406f070 con 0x55aad0df9030 2024-04-24T02:14:11.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.889+0000 7f777e7fc640 1 -- 172.21.15.134:0/3905641970 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7884058040 con 0x55aad0df9030 2024-04-24T02:14:11.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.889+0000 7f789d12f800 1 -- 172.21.15.134:0/3905641970 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55aad0dfa400 con 0x55aad0df9030 2024-04-24T02:14:11.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.889+0000 7f777e7fc640 1 -- 172.21.15.134:0/3905641970 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7884057050 con 0x55aad0df9030 2024-04-24T02:14:11.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.889+0000 7f789d12f800 1 -- 172.21.15.134:0/3905641970 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aad0dfa8a0 con 0x55aad0df9030 2024-04-24T02:14:11.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.890+0000 7f777e7fc640 1 -- 172.21.15.134:0/3905641970 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7884072070 con 0x55aad0df9030 2024-04-24T02:14:11.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.890+0000 7f777e7fc640 1 --2- 172.21.15.134:0/3905641970 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7770036950 0x7f7770038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.890+0000 7f777e7fc640 1 -- 172.21.15.134:0/3905641970 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f788408f8b0 con 0x55aad0df9030 2024-04-24T02:14:11.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.890+0000 7f78995af640 1 --2- 172.21.15.134:0/3905641970 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7770036950 0x7f7770038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.890+0000 7f789d12f800 1 Processor -- start 2024-04-24T02:14:11.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.891+0000 7f78995af640 1 --2- 172.21.15.134:0/3905641970 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7770036950 0x7f7770038e10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x55aad0de90a0 tx=0x7f7894005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.891+0000 7f789d12f800 1 -- start start 2024-04-24T02:14:11.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.891+0000 7f789d12f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aad0e06270 0x55aad0e06690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.891+0000 7f789d12f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55aad0dda050 con 0x55aad0e06270 2024-04-24T02:14:11.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.891+0000 7f7893fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aad0e06270 0x55aad0e06690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.891+0000 7f7893fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aad0e06270 0x55aad0e06690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:44060/0 (socket says 172.21.15.134:44060) 2024-04-24T02:14:11.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.891+0000 7f7893fff640 1 -- 172.21.15.134:0/2309514989 learned_addr learned my addr 172.21.15.134:0/2309514989 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:11.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.891+0000 7f7893fff640 1 -- 172.21.15.134:0/2309514989 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aad0e06c60 con 0x55aad0e06270 2024-04-24T02:14:11.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.891+0000 7f7893fff640 1 --2- 172.21.15.134:0/2309514989 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aad0e06270 0x55aad0e06690 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f788408dd50 tx=0x7f7884069c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a637661c6551d85 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.891+0000 7f776ffff640 1 -- 172.21.15.134:0/2309514989 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f788408b070 con 0x55aad0e06270 2024-04-24T02:14:11.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.891+0000 7f776ffff640 1 -- 172.21.15.134:0/2309514989 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7884087b40 con 0x55aad0e06270 2024-04-24T02:14:11.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.891+0000 7f776ffff640 1 -- 172.21.15.134:0/2309514989 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7884087e20 con 0x55aad0e06270 2024-04-24T02:14:11.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.892+0000 7f789d12f800 1 -- 172.21.15.134:0/2309514989 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aad0e06270 msgr2=0x55aad0e06690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.892+0000 7f789d12f800 1 --2- 172.21.15.134:0/2309514989 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aad0e06270 0x55aad0e06690 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f788408dd50 tx=0x7f7884069c60 comp rx=0 tx=0).stop 2024-04-24T02:14:11.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.892+0000 7f789d12f800 1 -- 172.21.15.134:0/2309514989 shutdown_connections 2024-04-24T02:14:11.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.892+0000 7f789d12f800 1 --2- 172.21.15.134:0/2309514989 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aad0e06270 0x55aad0e06690 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.892+0000 7f789d12f800 1 -- 172.21.15.134:0/2309514989 >> 172.21.15.134:0/2309514989 conn(0x55aad0e025d0 msgr2=0x55aad0e00630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:11.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.892+0000 7f789d12f800 1 -- 172.21.15.134:0/2309514989 shutdown_connections 2024-04-24T02:14:11.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.892+0000 7f789d12f800 1 -- 172.21.15.134:0/2309514989 wait complete. 2024-04-24T02:14:11.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.892+0000 7f789d12f800 1 Processor -- start 2024-04-24T02:14:11.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.892+0000 7f789d12f800 1 -- start start 2024-04-24T02:14:11.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.892+0000 7f789d12f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aad0e06270 0x55aad0e0d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.892+0000 7f789d12f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55aad0e073d0 con 0x55aad0e06270 2024-04-24T02:14:11.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.892+0000 7f7893fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aad0e06270 0x55aad0e0d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.893+0000 7f7893fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aad0e06270 0x55aad0e0d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:44076/0 (socket says 172.21.15.134:44076) 2024-04-24T02:14:11.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.893+0000 7f7893fff640 1 -- 172.21.15.134:0/2337248984 learned_addr learned my addr 172.21.15.134:0/2337248984 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:11.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.893+0000 7f7893fff640 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aad0e0de10 con 0x55aad0e06270 2024-04-24T02:14:11.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.893+0000 7f7893fff640 1 --2- 172.21.15.134:0/2337248984 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aad0e06270 0x55aad0e0d8d0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f788408ccc0 tx=0x7f788408dce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.893+0000 7f776e7fc640 1 -- 172.21.15.134:0/2337248984 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7884094070 con 0x55aad0e06270 2024-04-24T02:14:11.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.893+0000 7f776e7fc640 1 -- 172.21.15.134:0/2337248984 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f788405fe20 con 0x55aad0e06270 2024-04-24T02:14:11.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.893+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55aad0e0e0a0 con 0x55aad0e06270 2024-04-24T02:14:11.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.893+0000 7f776e7fc640 1 -- 172.21.15.134:0/2337248984 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f788408fc90 con 0x55aad0e06270 2024-04-24T02:14:11.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.893+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aad0e10d50 con 0x55aad0e06270 2024-04-24T02:14:11.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.894+0000 7f776e7fc640 1 -- 172.21.15.134:0/2337248984 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7884097070 con 0x55aad0e06270 2024-04-24T02:14:11.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.894+0000 7f776e7fc640 1 --2- 172.21.15.134:0/2337248984 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7764036950 0x7f7764038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.894+0000 7f776e7fc640 1 -- 172.21.15.134:0/2337248984 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f788409abf0 con 0x55aad0e06270 2024-04-24T02:14:11.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.894+0000 7f78995af640 1 --2- 172.21.15.134:0/2337248984 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7764036950 0x7f7764038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.895+0000 7f78995af640 1 --2- 172.21.15.134:0/2337248984 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7764036950 0x7f7764038e10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x55aad0dd7c20 tx=0x7f789401f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.895+0000 7f789d12f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.895+0000 7f789d12f800 1 --2- 172.21.15.134:0/2337248984 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55aad0e193a0 0x55aad0e1b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.895+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e1bfb0 con 0x55aad0e193a0 2024-04-24T02:14:11.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.895+0000 7f7898dae640 1 --2- 172.21.15.134:0/2337248984 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55aad0e193a0 0x55aad0e1b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.895+0000 7f7898dae640 1 --2- 172.21.15.134:0/2337248984 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55aad0e193a0 0x55aad0e1b860 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.895+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f788c049040 con 0x55aad0e193a0 2024-04-24T02:14:11.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.895+0000 7f789d12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:11.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.895+0000 7f789d12f800 20 realm 2024-04-24T02:14:11.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.895+0000 7f789d12f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.895+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e1c3c0 con 0x55aad0e193a0 2024-04-24T02:14:11.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.896+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f788c049040 con 0x55aad0e193a0 2024-04-24T02:14:11.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.896+0000 7f789d12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:11.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.896+0000 7f789d12f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:14:11.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.896+0000 7f789d12f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.896+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e1cc90 con 0x55aad0e193a0 2024-04-24T02:14:11.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.896+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f788c049040 con 0x55aad0e193a0 2024-04-24T02:14:11.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.896+0000 7f789d12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:11.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.896+0000 7f789d12f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.896+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e1d030 con 0x55aad0e193a0 2024-04-24T02:14:11.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.896+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f788c049040 con 0x55aad0e193a0 2024-04-24T02:14:11.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.896+0000 7f789d12f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:14:11.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.896+0000 7f789d12f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.896+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e1d880 con 0x55aad0e193a0 2024-04-24T02:14:11.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.896+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f788c049040 con 0x55aad0e193a0 2024-04-24T02:14:11.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.896+0000 7f789d12f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:14:11.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.896+0000 7f789d12f800 20 searching for the correct realm 2024-04-24T02:14:11.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.896+0000 7f789d12f800 1 --2- 172.21.15.134:0/2337248984 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55aad0e1f5f0 0x55aad0e219e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.896+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e21fc0 con 0x55aad0e1f5f0 2024-04-24T02:14:11.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.897+0000 7f7893fff640 1 --2- 172.21.15.134:0/2337248984 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55aad0e1f5f0 0x55aad0e219e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.897+0000 7f7893fff640 1 --2- 172.21.15.134:0/2337248984 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55aad0e1f5f0 0x55aad0e219e0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.897+0000 7f7893fff640 1 -- 172.21.15.134:0/2337248984 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7884096030 con 0x55aad0e1f5f0 2024-04-24T02:14:11.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.897+0000 7f7893fff640 1 --2- 172.21.15.134:0/2337248984 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f7884099060 0x7f78840693a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.897+0000 7f7893fff640 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e21fc0 con 0x7f7884099060 2024-04-24T02:14:11.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.897+0000 7f78995af640 1 --2- 172.21.15.134:0/2337248984 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f7884099060 0x7f78840693a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.897+0000 7f78995af640 1 --2- 172.21.15.134:0/2337248984 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f7884099060 0x7f78840693a0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.898+0000 7f78995af640 1 -- 172.21.15.134:0/2337248984 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f789401f070 con 0x7f7884099060 2024-04-24T02:14:11.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.898+0000 7f78995af640 1 --2- 172.21.15.134:0/2337248984 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f7894031040 0x7f7894032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.898+0000 7f78995af640 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e21fc0 con 0x7f7894031040 2024-04-24T02:14:11.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.898+0000 7f7898dae640 1 --2- 172.21.15.134:0/2337248984 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f7894031040 0x7f7894032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.898+0000 7f7898dae640 1 --2- 172.21.15.134:0/2337248984 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f7894031040 0x7f7894032940 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.899+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f788c049040 con 0x7f7894031040 2024-04-24T02:14:11.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.899+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e21fc0 con 0x55aad0e193a0 2024-04-24T02:14:11.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.899+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f788c049040 con 0x55aad0e193a0 2024-04-24T02:14:11.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.899+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e21fc0 con 0x55aad0e193a0 2024-04-24T02:14:11.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.899+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f788c049040 con 0x55aad0e193a0 2024-04-24T02:14:11.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.899+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e21fc0 con 0x7f7894031040 2024-04-24T02:14:11.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.899+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f788c049040 con 0x7f7894031040 2024-04-24T02:14:11.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.899+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e21fc0 con 0x7f7884099060 2024-04-24T02:14:11.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.900+0000 7f78995af640 1 -- 172.21.15.134:0/2337248984 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f789401f070 con 0x7f7884099060 2024-04-24T02:14:11.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.900+0000 7f78995af640 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e21fc0 con 0x7f7884099060 2024-04-24T02:14:11.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.900+0000 7f78995af640 1 -- 172.21.15.134:0/2337248984 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f789401f070 con 0x7f7884099060 2024-04-24T02:14:11.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.900+0000 7f78995af640 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e21fc0 con 0x55aad0e1f5f0 2024-04-24T02:14:11.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.900+0000 7f7893fff640 1 -- 172.21.15.134:0/2337248984 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7884096030 con 0x55aad0e1f5f0 2024-04-24T02:14:11.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.900+0000 7f7893fff640 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e21fc0 con 0x55aad0e193a0 2024-04-24T02:14:11.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.900+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f788c049040 con 0x55aad0e193a0 2024-04-24T02:14:11.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.900+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e21fc0 con 0x7f7894031040 2024-04-24T02:14:11.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.901+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f788c049040 con 0x7f7894031040 2024-04-24T02:14:11.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.901+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e21fc0 con 0x55aad0e193a0 2024-04-24T02:14:11.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.901+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f788c049040 con 0x55aad0e193a0 2024-04-24T02:14:11.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.901+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e21fc0 con 0x7f7884099060 2024-04-24T02:14:11.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.901+0000 7f78995af640 1 -- 172.21.15.134:0/2337248984 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f789401f070 con 0x7f7884099060 2024-04-24T02:14:11.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.901+0000 7f78995af640 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e21fc0 con 0x55aad0e1f5f0 2024-04-24T02:14:11.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.901+0000 7f7893fff640 1 -- 172.21.15.134:0/2337248984 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7884096030 con 0x55aad0e1f5f0 2024-04-24T02:14:11.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.901+0000 7f7893fff640 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e21fc0 con 0x55aad0e1f5f0 2024-04-24T02:14:11.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.901+0000 7f7893fff640 1 -- 172.21.15.134:0/2337248984 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7884096030 con 0x55aad0e1f5f0 2024-04-24T02:14:11.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.901+0000 7f7893fff640 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e21fc0 con 0x7f7884099060 2024-04-24T02:14:11.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.902+0000 7f78995af640 1 -- 172.21.15.134:0/2337248984 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f789401f070 con 0x7f7884099060 2024-04-24T02:14:11.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.902+0000 7f78995af640 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e21fc0 con 0x55aad0e1f5f0 2024-04-24T02:14:11.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.902+0000 7f7893fff640 1 -- 172.21.15.134:0/2337248984 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7884096030 con 0x55aad0e1f5f0 2024-04-24T02:14:11.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.902+0000 7f7893fff640 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e21fc0 con 0x55aad0e1f5f0 2024-04-24T02:14:11.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.902+0000 7f7893fff640 1 -- 172.21.15.134:0/2337248984 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7884096030 con 0x55aad0e1f5f0 2024-04-24T02:14:11.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.902+0000 7f7893fff640 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e21fc0 con 0x55aad0e193a0 2024-04-24T02:14:11.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.902+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f788c049040 con 0x55aad0e193a0 2024-04-24T02:14:11.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.902+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e21fc0 con 0x55aad0e193a0 2024-04-24T02:14:11.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.903+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=132b] v32'6 uv6 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f788c049040 con 0x55aad0e193a0 2024-04-24T02:14:11.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.903+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e21fc0 con 0x7f7894031040 2024-04-24T02:14:11.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.903+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f788c049040 con 0x7f7894031040 2024-04-24T02:14:11.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.903+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e21fc0 con 0x55aad0e1f5f0 2024-04-24T02:14:11.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.903+0000 7f7893fff640 1 -- 172.21.15.134:0/2337248984 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7884096030 con 0x55aad0e1f5f0 2024-04-24T02:14:11.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.903+0000 7f7893fff640 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e21fc0 con 0x7f7884099060 2024-04-24T02:14:11.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.903+0000 7f78995af640 1 -- 172.21.15.134:0/2337248984 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f789401f070 con 0x7f7884099060 2024-04-24T02:14:11.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.903+0000 7f78995af640 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e21fc0 con 0x55aad0e193a0 2024-04-24T02:14:11.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.904+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f788c049040 con 0x55aad0e193a0 2024-04-24T02:14:11.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.904+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e21fc0 con 0x7f7894031040 2024-04-24T02:14:11.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.904+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f788c049040 con 0x7f7894031040 2024-04-24T02:14:11.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.904+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e21fc0 con 0x55aad0e1f5f0 2024-04-24T02:14:11.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.904+0000 7f7893fff640 1 -- 172.21.15.134:0/2337248984 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7884096030 con 0x55aad0e1f5f0 2024-04-24T02:14:11.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.904+0000 7f7893fff640 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e21fc0 con 0x7f7894031040 2024-04-24T02:14:11.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.904+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f788c049040 con 0x7f7894031040 2024-04-24T02:14:11.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.904+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e21fc0 con 0x7f7884099060 2024-04-24T02:14:11.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.905+0000 7f78995af640 1 -- 172.21.15.134:0/2337248984 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f789401f070 con 0x7f7884099060 2024-04-24T02:14:11.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.905+0000 7f78995af640 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e21fc0 con 0x55aad0e1f5f0 2024-04-24T02:14:11.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.905+0000 7f7893fff640 1 -- 172.21.15.134:0/2337248984 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7884096030 con 0x55aad0e1f5f0 2024-04-24T02:14:11.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.905+0000 7f7893fff640 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e21fc0 con 0x7f7884099060 2024-04-24T02:14:11.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.905+0000 7f78995af640 1 -- 172.21.15.134:0/2337248984 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7894040040 con 0x7f7884099060 2024-04-24T02:14:11.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.905+0000 7f78995af640 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e21fc0 con 0x55aad0e193a0 2024-04-24T02:14:11.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.905+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f788c049040 con 0x55aad0e193a0 2024-04-24T02:14:11.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.905+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e21fc0 con 0x7f7884099060 2024-04-24T02:14:11.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.906+0000 7f78995af640 1 -- 172.21.15.134:0/2337248984 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7894040040 con 0x7f7884099060 2024-04-24T02:14:11.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.906+0000 7f789d12f800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:14:11.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.906+0000 7f789d12f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:14:11.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.906+0000 7f789d12f800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:14:11.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.906+0000 7f789d12f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:14:11.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.906+0000 7f789d12f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:14:11.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.906+0000 7f789d12f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:14:11.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.906+0000 7f789d12f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.906+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e1e200 con 0x55aad0e193a0 2024-04-24T02:14:11.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.906+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f788c049040 con 0x55aad0e193a0 2024-04-24T02:14:11.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.906+0000 7f789d12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:11.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.906+0000 7f789d12f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.906+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e1eaa0 con 0x55aad0e193a0 2024-04-24T02:14:11.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.906+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f788c049040 con 0x55aad0e193a0 2024-04-24T02:14:11.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.906+0000 7f789d12f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:14:11.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.906+0000 7f789d12f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.906+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e22440 con 0x55aad0e193a0 2024-04-24T02:14:11.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.906+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f788c049040 con 0x55aad0e193a0 2024-04-24T02:14:11.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.906+0000 7f789d12f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:14:11.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.906+0000 7f789d12f800 20 zone default found 2024-04-24T02:14:11.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.906+0000 7f789d12f800 4 Realm: () 2024-04-24T02:14:11.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.906+0000 7f789d12f800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:14:11.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.906+0000 7f789d12f800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:14:11.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.906+0000 7f789d12f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:14:11.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.906+0000 7f789d12f800 20 zonegroup default 2024-04-24T02:14:11.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.906+0000 7f789d12f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.906+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e1e700 con 0x7f7894031040 2024-04-24T02:14:11.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.907+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f788c049040 con 0x7f7894031040 2024-04-24T02:14:11.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.907+0000 7f789d12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:11.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.907+0000 7f789d12f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.907+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e24350 con 0x55aad0e1f5f0 2024-04-24T02:14:11.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.907+0000 7f7893fff640 1 -- 172.21.15.134:0/2337248984 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7884096030 con 0x55aad0e1f5f0 2024-04-24T02:14:11.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.907+0000 7f789d12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:11.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.907+0000 7f789d12f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.907+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e24710 con 0x55aad0e1f5f0 2024-04-24T02:14:11.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.907+0000 7f7893fff640 1 -- 172.21.15.134:0/2337248984 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7884096030 con 0x55aad0e1f5f0 2024-04-24T02:14:11.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.907+0000 7f789d12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:11.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.907+0000 7f789d12f800 20 started sync module instance, tier type = 2024-04-24T02:14:11.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.907+0000 7f789d12f800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:14:11.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.907+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e237f0 con 0x7f7884099060 2024-04-24T02:14:11.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.908+0000 7f78995af640 1 -- 172.21.15.134:0/2337248984 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(44 notify.0 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7894040040 con 0x7f7884099060 2024-04-24T02:14:11.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.908+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94192137288944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e237f0 con 0x7f7884099060 2024-04-24T02:14:11.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.908+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e251f0 con 0x55aad0e193a0 2024-04-24T02:14:11.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.909+0000 7f78995af640 1 -- 172.21.15.134:0/2337248984 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94192137288944] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7894040040 con 0x7f7884099060 2024-04-24T02:14:11.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.910+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f788c049040 con 0x55aad0e193a0 2024-04-24T02:14:11.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.910+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94192137293024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e237f0 con 0x55aad0e193a0 2024-04-24T02:14:11.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.910+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e25c40 con 0x55aad0e1f5f0 2024-04-24T02:14:11.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.911+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94192137293024] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f788c049040 con 0x55aad0e193a0 2024-04-24T02:14:11.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.911+0000 7f7893fff640 1 -- 172.21.15.134:0/2337248984 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7884096030 con 0x55aad0e1f5f0 2024-04-24T02:14:11.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.911+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94192137286464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e23760 con 0x55aad0e1f5f0 2024-04-24T02:14:11.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.911+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e26b00 con 0x7f7884099060 2024-04-24T02:14:11.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.912+0000 7f7893fff640 1 -- 172.21.15.134:0/2337248984 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94192137286464] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7884096030 con 0x55aad0e1f5f0 2024-04-24T02:14:11.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.912+0000 7f78995af640 1 -- 172.21.15.134:0/2337248984 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(50 notify.3 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7894040040 con 0x7f7884099060 2024-04-24T02:14:11.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.912+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94192137299536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e26a70 con 0x7f7884099060 2024-04-24T02:14:11.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.912+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e279c0 con 0x55aad0e193a0 2024-04-24T02:14:11.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.913+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f788c049040 con 0x55aad0e193a0 2024-04-24T02:14:11.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.913+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94192137303312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e27de0 con 0x55aad0e193a0 2024-04-24T02:14:11.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.913+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e288c0 con 0x7f7894031040 2024-04-24T02:14:11.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.913+0000 7f78995af640 1 -- 172.21.15.134:0/2337248984 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94192137299536] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7894040040 con 0x7f7884099060 2024-04-24T02:14:11.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.914+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(54 notify.5 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f788c049040 con 0x7f7894031040 2024-04-24T02:14:11.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.914+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94192137301744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e28880 con 0x7f7894031040 2024-04-24T02:14:11.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.914+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e29300 con 0x7f7894031040 2024-04-24T02:14:11.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.914+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94192137303312] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f788c049040 con 0x55aad0e193a0 2024-04-24T02:14:11.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.915+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94192137301744] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f788c049040 con 0x7f7894031040 2024-04-24T02:14:11.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.915+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(56 notify.6 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f788c049040 con 0x7f7894031040 2024-04-24T02:14:11.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.915+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94192137307088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e287f0 con 0x7f7894031040 2024-04-24T02:14:11.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.915+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e297b0 con 0x7f7894031040 2024-04-24T02:14:11.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.916+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94192137307088] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f788c049040 con 0x7f7894031040 2024-04-24T02:14:11.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.916+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(58 notify.7 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f788c049040 con 0x7f7894031040 2024-04-24T02:14:11.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.916+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94192137309776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e29720 con 0x7f7894031040 2024-04-24T02:14:11.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.916+0000 7f789d12f800 20 add_watcher() i=0 2024-04-24T02:14:11.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.916+0000 7f789d12f800 20 add_watcher() i=1 2024-04-24T02:14:11.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.916+0000 7f789d12f800 20 add_watcher() i=2 2024-04-24T02:14:11.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.916+0000 7f789d12f800 20 add_watcher() i=3 2024-04-24T02:14:11.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.916+0000 7f789d12f800 20 add_watcher() i=4 2024-04-24T02:14:11.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.916+0000 7f789d12f800 20 add_watcher() i=5 2024-04-24T02:14:11.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.916+0000 7f789d12f800 20 add_watcher() i=6 2024-04-24T02:14:11.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.917+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94192137309776] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f788c049040 con 0x7f7894031040 2024-04-24T02:14:11.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.917+0000 7f789d12f800 20 add_watcher() i=7 2024-04-24T02:14:11.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.917+0000 7f789d12f800 2 all 8 watchers are set, enabling cache 2024-04-24T02:14:11.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.917+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e2cbb0 con 0x55aad0e193a0 2024-04-24T02:14:11.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.918+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f788c049040 con 0x55aad0e193a0 2024-04-24T02:14:11.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.918+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94192137311296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e2a070 con 0x55aad0e193a0 2024-04-24T02:14:11.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.919+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94192137311296] v32'270 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f788c049040 con 0x55aad0e193a0 2024-04-24T02:14:11.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.919+0000 7f774efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:14:11.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.919+0000 7f789d12f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:14:11.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.919+0000 7f789d12f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:14:11.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.919+0000 7f789d12f800 5 note: GC not initialized 2024-04-24T02:14:11.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.919+0000 7f774dfe3640 20 reqs_thread_entry: start 2024-04-24T02:14:11.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.919+0000 7f789d12f800 20 init_complete bucket index max shards: 11 2024-04-24T02:14:11.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.919+0000 7f789d12f800 20 Filter name: none 2024-04-24T02:14:11.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.919+0000 7f76bf7fe640 20 reqs_thread_entry: start 2024-04-24T02:14:11.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.919+0000 7f789d12f800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-24T02:14:11.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.919+0000 7f789d12f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:11.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.919+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e5fef0 con 0x7f7894031040 2024-04-24T02:14:11.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.920+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(62 ada [call out=48b,read 0~503 out=503b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+626 (crc 0 0 0) 0x7f788c049040 con 0x7f7894031040 2024-04-24T02:14:11.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.920+0000 7f789d12f800 20 rados_obj.operate() r=0 bl.length=503 2024-04-24T02:14:11.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.920+0000 7f789d12f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-24T02:14:11.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.920+0000 7f789d12f800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T02:14:11.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.920+0000 7f789d12f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:14:11.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.920+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e66870 con 0x7f7894031040 2024-04-24T02:14:11.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.921+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v32'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f788c049040 con 0x7f7894031040 2024-04-24T02:14:11.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.921+0000 7f789d12f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T02:14:11.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.921+0000 7f789d12f800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T02:14:11.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.921+0000 7f789d12f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-24T02:14:11.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.921+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94192137560800 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e61f80 con 0x55aad0e193a0 2024-04-24T02:14:11.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.922+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== watch-notify(notify (1) cookie 94192137303312 notify 137438953499 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7f788c036040 con 0x55aad0e193a0 2024-04-24T02:14:11.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.922+0000 7f776ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953499 cookie 94192137303312 notifier 4886 bl.length()=636 2024-04-24T02:14:11.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.922+0000 7f776ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T02:14:11.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.922+0000 7f776ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T02:14:11.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.922+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(64 notify.4 [notify cookie 94192137560800 out=8b] v0'0 uv267 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f788c049040 con 0x55aad0e193a0 2024-04-24T02:14:11.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.922+0000 7f776ffff640 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f775c003ea0 con 0x55aad0e193a0 2024-04-24T02:14:11.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.922+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f788c049040 con 0x55aad0e193a0 2024-04-24T02:14:11.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.922+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== watch-notify(notify_complete (2) cookie 94192137560800 notify 137438953499 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55aad0dd64f0 con 0x55aad0e193a0 2024-04-24T02:14:11.935 INFO:teuthology.orchestra.run.smithi134.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-24T02:14:10.534163Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T02:14:10.534144Z","tags":[],"group_ids":[]} 2024-04-24T02:14:11.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.923+0000 7f774efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:14:11.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.923+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94192137311296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e2c700 con 0x55aad0e193a0 2024-04-24T02:14:11.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.924+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94192137311296] v32'271 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f788c049040 con 0x55aad0e193a0 2024-04-24T02:14:11.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.924+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94192137288944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e29410 con 0x7f7884099060 2024-04-24T02:14:11.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.925+0000 7f78995af640 1 -- 172.21.15.134:0/2337248984 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94192137288944] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7894040040 con 0x7f7884099060 2024-04-24T02:14:11.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.925+0000 7f789d12f800 20 remove_watcher() i=0 2024-04-24T02:14:11.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.925+0000 7f789d12f800 2 removed watcher, disabling cache 2024-04-24T02:14:11.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.925+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94192137293024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e23cf0 con 0x55aad0e193a0 2024-04-24T02:14:11.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.926+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94192137293024] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f788c049040 con 0x55aad0e193a0 2024-04-24T02:14:11.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.926+0000 7f789d12f800 20 remove_watcher() i=1 2024-04-24T02:14:11.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.926+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94192137286464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e23cf0 con 0x55aad0e1f5f0 2024-04-24T02:14:11.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.927+0000 7f7893fff640 1 -- 172.21.15.134:0/2337248984 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94192137286464] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7884096030 con 0x55aad0e1f5f0 2024-04-24T02:14:11.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.927+0000 7f789d12f800 20 remove_watcher() i=2 2024-04-24T02:14:11.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.927+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94192137299536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e23340 con 0x7f7884099060 2024-04-24T02:14:11.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.928+0000 7f78995af640 1 -- 172.21.15.134:0/2337248984 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94192137299536] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7894040040 con 0x7f7884099060 2024-04-24T02:14:11.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.928+0000 7f789d12f800 20 remove_watcher() i=3 2024-04-24T02:14:11.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.928+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94192137303312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e23340 con 0x55aad0e193a0 2024-04-24T02:14:11.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.929+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94192137303312] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f788c049040 con 0x55aad0e193a0 2024-04-24T02:14:11.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.929+0000 7f789d12f800 20 remove_watcher() i=4 2024-04-24T02:14:11.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.929+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94192137301744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e27510 con 0x7f7894031040 2024-04-24T02:14:11.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.930+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94192137301744] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f788c049040 con 0x7f7894031040 2024-04-24T02:14:11.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.930+0000 7f789d12f800 20 remove_watcher() i=5 2024-04-24T02:14:11.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.930+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94192137307088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e23340 con 0x7f7894031040 2024-04-24T02:14:11.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.931+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94192137307088] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f788c049040 con 0x7f7894031040 2024-04-24T02:14:11.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.931+0000 7f789d12f800 20 remove_watcher() i=6 2024-04-24T02:14:11.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.931+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94192137309776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55aad0e27510 con 0x7f7894031040 2024-04-24T02:14:11.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.932+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94192137309776] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f788c049040 con 0x7f7894031040 2024-04-24T02:14:11.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.932+0000 7f789d12f800 20 remove_watcher() i=7 2024-04-24T02:14:11.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.932+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f7894031040 msgr2=0x7f7894032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.932+0000 7f789d12f800 1 --2- 172.21.15.134:0/2337248984 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f7894031040 0x7f7894032940 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.932+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55aad0e193a0 msgr2=0x55aad0e1b860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.932+0000 7f789d12f800 1 --2- 172.21.15.134:0/2337248984 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55aad0e193a0 0x55aad0e1b860 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.932+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f7884099060 msgr2=0x7f78840693a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.932+0000 7f789d12f800 1 --2- 172.21.15.134:0/2337248984 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f7884099060 0x7f78840693a0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.932+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55aad0e1f5f0 msgr2=0x55aad0e219e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.932+0000 7f789d12f800 1 --2- 172.21.15.134:0/2337248984 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x55aad0e1f5f0 0x55aad0e219e0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.932+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7764036950 msgr2=0x7f7764038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.932+0000 7f789d12f800 1 --2- 172.21.15.134:0/2337248984 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7764036950 0x7f7764038e10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x55aad0dd7c20 tx=0x7f789401f000 comp rx=0 tx=0).stop 2024-04-24T02:14:11.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.932+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aad0e06270 msgr2=0x55aad0e0d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.932+0000 7f789d12f800 1 --2- 172.21.15.134:0/2337248984 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aad0e06270 0x55aad0e0d8d0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f788408ccc0 tx=0x7f788408dce0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.932+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 reap_dead start 2024-04-24T02:14:11.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.932+0000 7f7898dae640 1 -- 172.21.15.134:0/2337248984 reap_dead start 2024-04-24T02:14:11.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.932+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 shutdown_connections 2024-04-24T02:14:11.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.932+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 >> 172.21.15.134:0/2337248984 conn(0x55aad0e025d0 msgr2=0x55aad0dffc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:11.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.932+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 shutdown_connections 2024-04-24T02:14:11.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.932+0000 7f789d12f800 1 -- 172.21.15.134:0/2337248984 wait complete. 2024-04-24T02:14:11.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.932+0000 7f789d12f800 1 -- 172.21.15.134:0/3905641970 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7770036950 msgr2=0x7f7770038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.932+0000 7f789d12f800 1 --2- 172.21.15.134:0/3905641970 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7770036950 0x7f7770038e10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x55aad0de90a0 tx=0x7f7894005840 comp rx=0 tx=0).stop 2024-04-24T02:14:11.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.933+0000 7f789d12f800 1 -- 172.21.15.134:0/3905641970 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aad0df9030 msgr2=0x55aad0df9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.933+0000 7f789d12f800 1 --2- 172.21.15.134:0/3905641970 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aad0df9030 0x55aad0df9450 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f7884044840 tx=0x7f7884002fb0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.933+0000 7f789d12f800 1 -- 172.21.15.134:0/3905641970 shutdown_connections 2024-04-24T02:14:11.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.933+0000 7f789d12f800 1 --2- 172.21.15.134:0/3905641970 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7770036950 0x7f7770038e10 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.933+0000 7f789d12f800 1 --2- 172.21.15.134:0/3905641970 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aad0df9030 0x55aad0df9450 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.933+0000 7f789d12f800 1 -- 172.21.15.134:0/3905641970 >> 172.21.15.134:0/3905641970 conn(0x55aad0ded0d0 msgr2=0x55aad0ded4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:11.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.933+0000 7f789d12f800 1 -- 172.21.15.134:0/3905641970 shutdown_connections 2024-04-24T02:14:11.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.933+0000 7f789d12f800 1 -- 172.21.15.134:0/3905641970 wait complete. 2024-04-24T02:14:11.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.933+0000 7f789d12f800 1 -- 172.21.15.134:0/654570063 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55aad0ce9210 msgr2=0x55aad0de8080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.933+0000 7f789d12f800 1 --2- 172.21.15.134:0/654570063 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55aad0ce9210 0x55aad0de8080 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.933+0000 7f789d12f800 1 -- 172.21.15.134:0/654570063 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7780036950 msgr2=0x7f7780038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.933+0000 7f789d12f800 1 --2- 172.21.15.134:0/654570063 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7780036950 0x7f7780038e10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7884054000 tx=0x7f788404e000 comp rx=0 tx=0).stop 2024-04-24T02:14:11.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.933+0000 7f789d12f800 1 -- 172.21.15.134:0/654570063 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aad0ce4d80 msgr2=0x55aad0dd7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.933+0000 7f789d12f800 1 --2- 172.21.15.134:0/654570063 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aad0ce4d80 0x55aad0dd7650 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f788c00b240 tx=0x7f788c000ed0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.933+0000 7f789d12f800 1 -- 172.21.15.134:0/654570063 shutdown_connections 2024-04-24T02:14:11.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.933+0000 7f789d12f800 1 --2- 172.21.15.134:0/654570063 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55aad0ce9210 0x55aad0de8080 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.933+0000 7f789d12f800 1 --2- 172.21.15.134:0/654570063 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7780036950 0x7f7780038e10 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.933+0000 7f789d12f800 1 --2- 172.21.15.134:0/654570063 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55aad0ce4d80 0x55aad0dd7650 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.933+0000 7f789d12f800 1 -- 172.21.15.134:0/654570063 >> 172.21.15.134:0/654570063 conn(0x55aad0ce0320 msgr2=0x55aad0dcfff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:11.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.933+0000 7f789d12f800 1 -- 172.21.15.134:0/654570063 shutdown_connections 2024-04-24T02:14:11.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.933+0000 7f789d12f800 1 -- 172.21.15.134:0/654570063 wait complete. 2024-04-24T02:14:11.947 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T02:14:10.534163Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:14:10.534144Z', 'tags': [], 'group_ids': []} 2024-04-24T02:14:11.947 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T02:14:10.534163Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:14:10.534144Z', 'tags': [], 'group_ids': []} 2024-04-24T02:14:11.947 ERROR:root:0 2024-04-24T02:14:11.947 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-04-24T02:14:11.947 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-04-24T02:14:11.947 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=write 2024-04-24T02:14:11.994 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:14:11.994 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:14:11.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.993+0000 7fc163c98800 1 Processor -- start 2024-04-24T02:14:11.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.993+0000 7fc163c98800 1 -- start start 2024-04-24T02:14:11.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.993+0000 7fc163c98800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5622453607c0 0x562245360be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:11.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.993+0000 7fc163c98800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562245220d40 con 0x562245361120 2024-04-24T02:14:11.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.993+0000 7fc163c98800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x5622451f34d0 con 0x5622453607c0 2024-04-24T02:14:11.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.994+0000 7fc16179e640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5622453607c0 0x562245360be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:11.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.994+0000 7fc158f9d640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x562245361120 0x5622453615d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:46494/0 (socket says 172.21.15.134:46494) 2024-04-24T02:14:11.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.994+0000 7fc158f9d640 1 -- 172.21.15.134:0/3020150272 learned_addr learned my addr 172.21.15.134:0/3020150272 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:14:11.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.994+0000 7fc16179e640 1 -- 172.21.15.134:0/3020150272 >> v1:172.21.15.104:6789/0 conn(0x562245361120 legacy=0x5622453615d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.994+0000 7fc16179e640 1 -- 172.21.15.134:0/3020150272 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56224521f590 con 0x5622453607c0 2024-04-24T02:14:11.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.994+0000 7fc160f9d640 1 -- 172.21.15.134:0/3020150272 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1358454632 0 0) 0x562245220d40 con 0x562245361120 2024-04-24T02:14:11.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.996+0000 7fc16179e640 1 --2- 172.21.15.134:0/3020150272 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5622453607c0 0x562245360be0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fc15400a470 tx=0x7fc15401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41ce2ad805863489 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:11.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.996+0000 7fc160f9d640 1 -- 172.21.15.134:0/3020150272 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc154057070 con 0x5622453607c0 2024-04-24T02:14:11.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.996+0000 7fc160f9d640 1 -- 172.21.15.134:0/3020150272 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc15404adc0 con 0x5622453607c0 2024-04-24T02:14:11.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.996+0000 7fc160f9d640 1 -- 172.21.15.134:0/3020150272 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc154052590 con 0x5622453607c0 2024-04-24T02:14:11.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.997+0000 7fc163c98800 1 -- 172.21.15.134:0/3020150272 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5622453607c0 msgr2=0x562245360be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:11.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.997+0000 7fc163c98800 1 --2- 172.21.15.134:0/3020150272 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5622453607c0 0x562245360be0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fc15400a470 tx=0x7fc15401ce90 comp rx=0 tx=0).stop 2024-04-24T02:14:11.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.997+0000 7fc163c98800 1 -- 172.21.15.134:0/3020150272 shutdown_connections 2024-04-24T02:14:11.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.997+0000 7fc163c98800 1 --2- 172.21.15.134:0/3020150272 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5622453607c0 0x562245360be0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:11.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.997+0000 7fc163c98800 1 -- 172.21.15.134:0/3020150272 >> 172.21.15.134:0/3020150272 conn(0x56224535c340 msgr2=0x56224535e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:11.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.997+0000 7fc163c98800 1 -- 172.21.15.134:0/3020150272 shutdown_connections 2024-04-24T02:14:11.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:11.997+0000 7fc163c98800 1 -- 172.21.15.134:0/3020150272 wait complete. 2024-04-24T02:14:12.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.008+0000 7fc163c98800 1 Processor -- start 2024-04-24T02:14:12.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.008+0000 7fc163c98800 1 -- start start 2024-04-24T02:14:12.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.008+0000 7fc163c98800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5622453607c0 0x562245455210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.008+0000 7fc163c98800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5622452ad3b0 con 0x5622453607c0 2024-04-24T02:14:12.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.009+0000 7fc16179e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5622453607c0 0x562245455210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.009+0000 7fc16179e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5622453607c0 0x562245455210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:44106/0 (socket says 172.21.15.134:44106) 2024-04-24T02:14:12.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.009+0000 7fc16179e640 1 -- 172.21.15.134:0/611417311 learned_addr learned my addr 172.21.15.134:0/611417311 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:12.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.009+0000 7fc16179e640 1 -- 172.21.15.134:0/611417311 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622454557e0 con 0x5622453607c0 2024-04-24T02:14:12.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.009+0000 7fc16179e640 1 --2- 172.21.15.134:0/611417311 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5622453607c0 0x562245455210 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fc154055040 tx=0x7fc15404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2113bdd2a9d83b93 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.010+0000 7fc04f606640 1 -- 172.21.15.134:0/611417311 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc154063070 con 0x5622453607c0 2024-04-24T02:14:12.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.010+0000 7fc04f606640 1 -- 172.21.15.134:0/611417311 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc15400a230 con 0x5622453607c0 2024-04-24T02:14:12.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.010+0000 7fc04f606640 1 -- 172.21.15.134:0/611417311 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc154057040 con 0x5622453607c0 2024-04-24T02:14:12.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.010+0000 7fc163c98800 1 -- 172.21.15.134:0/611417311 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5622453607c0 msgr2=0x562245455210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.010+0000 7fc163c98800 1 --2- 172.21.15.134:0/611417311 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5622453607c0 0x562245455210 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fc154055040 tx=0x7fc15404c000 comp rx=0 tx=0).stop 2024-04-24T02:14:12.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.010+0000 7fc163c98800 1 -- 172.21.15.134:0/611417311 shutdown_connections 2024-04-24T02:14:12.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.010+0000 7fc163c98800 1 --2- 172.21.15.134:0/611417311 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5622453607c0 0x562245455210 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.010+0000 7fc163c98800 1 -- 172.21.15.134:0/611417311 >> 172.21.15.134:0/611417311 conn(0x56224535c340 msgr2=0x562245450b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:12.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.010+0000 7fc163c98800 1 -- 172.21.15.134:0/611417311 shutdown_connections 2024-04-24T02:14:12.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.010+0000 7fc163c98800 1 -- 172.21.15.134:0/611417311 wait complete. 2024-04-24T02:14:12.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.011+0000 7fc163c98800 1 Processor -- start 2024-04-24T02:14:12.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.011+0000 7fc163c98800 1 -- start start 2024-04-24T02:14:12.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.011+0000 7fc163c98800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5622453607c0 0x56224545ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.011+0000 7fc163c98800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x562245361fe0 con 0x5622453607c0 2024-04-24T02:14:12.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.011+0000 7fc16179e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5622453607c0 0x56224545ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.011+0000 7fc16179e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5622453607c0 0x56224545ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:44114/0 (socket says 172.21.15.134:44114) 2024-04-24T02:14:12.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.011+0000 7fc16179e640 1 -- 172.21.15.134:0/3260246353 learned_addr learned my addr 172.21.15.134:0/3260246353 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:12.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.011+0000 7fc16179e640 1 -- 172.21.15.134:0/3260246353 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56224545d1f0 con 0x5622453607c0 2024-04-24T02:14:12.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.011+0000 7fc16179e640 1 --2- 172.21.15.134:0/3260246353 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5622453607c0 0x56224545ccb0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fc154061040 tx=0x7fc154002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.012+0000 7fc04de03640 1 -- 172.21.15.134:0/3260246353 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc15406c070 con 0x5622453607c0 2024-04-24T02:14:12.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.012+0000 7fc04de03640 1 -- 172.21.15.134:0/3260246353 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc15405d7e0 con 0x5622453607c0 2024-04-24T02:14:12.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.012+0000 7fc163c98800 1 -- 172.21.15.134:0/3260246353 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56224545d480 con 0x5622453607c0 2024-04-24T02:14:12.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.012+0000 7fc04de03640 1 -- 172.21.15.134:0/3260246353 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc154063040 con 0x5622453607c0 2024-04-24T02:14:12.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.012+0000 7fc163c98800 1 -- 172.21.15.134:0/3260246353 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562245460090 con 0x5622453607c0 2024-04-24T02:14:12.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.012+0000 7fc04de03640 1 -- 172.21.15.134:0/3260246353 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc154066070 con 0x5622453607c0 2024-04-24T02:14:12.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.012+0000 7fc04de03640 1 --2- 172.21.15.134:0/3260246353 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc048036950 0x7fc048038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.012+0000 7fc04de03640 1 -- 172.21.15.134:0/3260246353 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fc15408d700 con 0x5622453607c0 2024-04-24T02:14:12.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.013+0000 7fc158f9d640 1 --2- 172.21.15.134:0/3260246353 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc048036950 0x7fc048038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.013+0000 7fc163c98800 1 --2- 172.21.15.134:0/3260246353 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x562245361120 0x562245463e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.013+0000 7fc163c98800 1 -- 172.21.15.134:0/3260246353 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622454643d0 con 0x562245361120 2024-04-24T02:14:12.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.013+0000 7fc161f9f640 1 --2- 172.21.15.134:0/3260246353 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x562245361120 0x562245463e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.013+0000 7fc158f9d640 1 --2- 172.21.15.134:0/3260246353 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc048036950 0x7fc048038e10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc14c000c00 tx=0x7fc14c0013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.013+0000 7fc161f9f640 1 --2- 172.21.15.134:0/3260246353 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x562245361120 0x562245463e50 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.013+0000 7fc161f9f640 1 -- 172.21.15.134:0/3260246353 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc15c00a4a0 con 0x562245361120 2024-04-24T02:14:12.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.013+0000 7fc163c98800 1 -- 172.21.15.134:0/3260246353 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562245461400 con 0x562245361120 2024-04-24T02:14:12.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.014+0000 7fc161f9f640 1 -- 172.21.15.134:0/3260246353 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc15c00a4a0 con 0x562245361120 2024-04-24T02:14:12.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.014+0000 7fc163c98800 1 -- 172.21.15.134:0/3260246353 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622454661e0 con 0x562245361120 2024-04-24T02:14:12.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.014+0000 7fc161f9f640 1 -- 172.21.15.134:0/3260246353 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc15c00a4a0 con 0x562245361120 2024-04-24T02:14:12.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.014+0000 7fc163c98800 1 -- 172.21.15.134:0/3260246353 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562245465520 con 0x562245361120 2024-04-24T02:14:12.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.014+0000 7fc161f9f640 1 -- 172.21.15.134:0/3260246353 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc15c00a4a0 con 0x562245361120 2024-04-24T02:14:12.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.014+0000 7fc163c98800 1 -- 172.21.15.134:0/3260246353 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562245465940 con 0x562245361120 2024-04-24T02:14:12.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.014+0000 7fc161f9f640 1 -- 172.21.15.134:0/3260246353 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc15c00a4a0 con 0x562245361120 2024-04-24T02:14:12.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.015+0000 7fc163c98800 1 Processor -- start 2024-04-24T02:14:12.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.015+0000 7fc163c98800 1 -- start start 2024-04-24T02:14:12.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.015+0000 7fc163c98800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562245474fd0 0x5622454753f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.015+0000 7fc163c98800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5622452536b0 con 0x562245474fd0 2024-04-24T02:14:12.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.015+0000 7fc158f9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562245474fd0 0x5622454753f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.015+0000 7fc158f9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562245474fd0 0x5622454753f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:44122/0 (socket says 172.21.15.134:44122) 2024-04-24T02:14:12.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.015+0000 7fc158f9d640 1 -- 172.21.15.134:0/1512923235 learned_addr learned my addr 172.21.15.134:0/1512923235 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:12.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.015+0000 7fc158f9d640 1 -- 172.21.15.134:0/1512923235 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562245475930 con 0x562245474fd0 2024-04-24T02:14:12.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.016+0000 7fc158f9d640 1 --2- 172.21.15.134:0/1512923235 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562245474fd0 0x5622454753f0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fc14c00e610 tx=0x7fc14c00ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.016+0000 7fc046ffd640 1 -- 172.21.15.134:0/1512923235 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc14c022070 con 0x562245474fd0 2024-04-24T02:14:12.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.016+0000 7fc046ffd640 1 -- 172.21.15.134:0/1512923235 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc14c009050 con 0x562245474fd0 2024-04-24T02:14:12.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.016+0000 7fc163c98800 1 -- 172.21.15.134:0/1512923235 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5622454763a0 con 0x562245474fd0 2024-04-24T02:14:12.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.016+0000 7fc046ffd640 1 -- 172.21.15.134:0/1512923235 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc14c00d500 con 0x562245474fd0 2024-04-24T02:14:12.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.016+0000 7fc163c98800 1 -- 172.21.15.134:0/1512923235 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622454768a0 con 0x562245474fd0 2024-04-24T02:14:12.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.016+0000 7fc046ffd640 1 -- 172.21.15.134:0/1512923235 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc14c025070 con 0x562245474fd0 2024-04-24T02:14:12.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.017+0000 7fc046ffd640 1 --2- 172.21.15.134:0/1512923235 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc038036950 0x7fc038038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.017+0000 7fc046ffd640 1 -- 172.21.15.134:0/1512923235 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fc14c04dae0 con 0x562245474fd0 2024-04-24T02:14:12.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.017+0000 7fc161f9f640 1 --2- 172.21.15.134:0/1512923235 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc038036950 0x7fc038038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.017+0000 7fc163c98800 1 Processor -- start 2024-04-24T02:14:12.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.017+0000 7fc163c98800 1 -- start start 2024-04-24T02:14:12.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.017+0000 7fc161f9f640 1 --2- 172.21.15.134:0/1512923235 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc038036950 0x7fc038038e10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x5622454658c0 tx=0x7fc15c005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.017+0000 7fc163c98800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562245482310 0x562245482730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.017+0000 7fc163c98800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x562245455aa0 con 0x562245482310 2024-04-24T02:14:12.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.017+0000 7fc158f9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562245482310 0x562245482730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.017+0000 7fc158f9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562245482310 0x562245482730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:44138/0 (socket says 172.21.15.134:44138) 2024-04-24T02:14:12.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.017+0000 7fc158f9d640 1 -- 172.21.15.134:0/2468080880 learned_addr learned my addr 172.21.15.134:0/2468080880 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:12.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.018+0000 7fc158f9d640 1 -- 172.21.15.134:0/2468080880 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562245482d00 con 0x562245482310 2024-04-24T02:14:12.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.018+0000 7fc158f9d640 1 --2- 172.21.15.134:0/2468080880 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562245482310 0x562245482730 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fc14c026fd0 tx=0x7fc14c024eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43100fae9aac1f54 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.018+0000 7fc044ff9640 1 -- 172.21.15.134:0/2468080880 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc14c04a030 con 0x562245482310 2024-04-24T02:14:12.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.018+0000 7fc044ff9640 1 -- 172.21.15.134:0/2468080880 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc14c025e30 con 0x562245482310 2024-04-24T02:14:12.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.018+0000 7fc044ff9640 1 -- 172.21.15.134:0/2468080880 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc14c01ad50 con 0x562245482310 2024-04-24T02:14:12.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.018+0000 7fc163c98800 1 -- 172.21.15.134:0/2468080880 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562245482310 msgr2=0x562245482730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.018+0000 7fc163c98800 1 --2- 172.21.15.134:0/2468080880 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562245482310 0x562245482730 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fc14c026fd0 tx=0x7fc14c024eb0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.018+0000 7fc163c98800 1 -- 172.21.15.134:0/2468080880 shutdown_connections 2024-04-24T02:14:12.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.018+0000 7fc163c98800 1 --2- 172.21.15.134:0/2468080880 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562245482310 0x562245482730 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.018+0000 7fc163c98800 1 -- 172.21.15.134:0/2468080880 >> 172.21.15.134:0/2468080880 conn(0x56224547e670 msgr2=0x56224547c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:12.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.018+0000 7fc163c98800 1 -- 172.21.15.134:0/2468080880 shutdown_connections 2024-04-24T02:14:12.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.018+0000 7fc163c98800 1 -- 172.21.15.134:0/2468080880 wait complete. 2024-04-24T02:14:12.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.019+0000 7fc163c98800 1 Processor -- start 2024-04-24T02:14:12.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.019+0000 7fc163c98800 1 -- start start 2024-04-24T02:14:12.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.019+0000 7fc163c98800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562245482310 0x5622454899d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.019+0000 7fc163c98800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x562245483470 con 0x562245482310 2024-04-24T02:14:12.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.019+0000 7fc158f9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562245482310 0x5622454899d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.019+0000 7fc158f9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562245482310 0x5622454899d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:44146/0 (socket says 172.21.15.134:44146) 2024-04-24T02:14:12.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.019+0000 7fc158f9d640 1 -- 172.21.15.134:0/4251476284 learned_addr learned my addr 172.21.15.134:0/4251476284 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:12.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.019+0000 7fc158f9d640 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562245489f10 con 0x562245482310 2024-04-24T02:14:12.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.019+0000 7fc158f9d640 1 --2- 172.21.15.134:0/4251476284 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562245482310 0x5622454899d0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fc14c026fd0 tx=0x7fc14c04be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.019+0000 7fc036ffd640 1 -- 172.21.15.134:0/4251476284 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc14c04a050 con 0x562245482310 2024-04-24T02:14:12.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.019+0000 7fc036ffd640 1 -- 172.21.15.134:0/4251476284 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc14c00d6a0 con 0x562245482310 2024-04-24T02:14:12.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.019+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56224548a1a0 con 0x562245482310 2024-04-24T02:14:12.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.019+0000 7fc036ffd640 1 -- 172.21.15.134:0/4251476284 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc14c00d9e0 con 0x562245482310 2024-04-24T02:14:12.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.019+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56224548ce50 con 0x562245482310 2024-04-24T02:14:12.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.020+0000 7fc036ffd640 1 -- 172.21.15.134:0/4251476284 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc14c04d370 con 0x562245482310 2024-04-24T02:14:12.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.020+0000 7fc036ffd640 1 --2- 172.21.15.134:0/4251476284 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc02c0368b0 0x7fc02c038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.020+0000 7fc036ffd640 1 -- 172.21.15.134:0/4251476284 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fc14c0457f0 con 0x562245482310 2024-04-24T02:14:12.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.020+0000 7fc161f9f640 1 --2- 172.21.15.134:0/4251476284 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc02c0368b0 0x7fc02c038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.021+0000 7fc161f9f640 1 --2- 172.21.15.134:0/4251476284 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc02c0368b0 0x7fc02c038d70 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x562245465040 tx=0x7fc15c01f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.021+0000 7fc163c98800 20 rados->read ofs=0 len=0 2024-04-24T02:14:12.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.021+0000 7fc163c98800 1 --2- 172.21.15.134:0/4251476284 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x562245495520 0x5622454979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.021+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562245498130 con 0x562245495520 2024-04-24T02:14:12.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.021+0000 7fc16179e640 1 --2- 172.21.15.134:0/4251476284 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x562245495520 0x5622454979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.021+0000 7fc16179e640 1 --2- 172.21.15.134:0/4251476284 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x562245495520 0x5622454979e0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.022+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc15406e070 con 0x562245495520 2024-04-24T02:14:12.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.022+0000 7fc163c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:12.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.022+0000 7fc163c98800 20 realm 2024-04-24T02:14:12.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.022+0000 7fc163c98800 20 rados->read ofs=0 len=0 2024-04-24T02:14:12.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.022+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562245498540 con 0x562245495520 2024-04-24T02:14:12.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.022+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc15406e070 con 0x562245495520 2024-04-24T02:14:12.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.022+0000 7fc163c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:12.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.022+0000 7fc163c98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:14:12.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.022+0000 7fc163c98800 20 rados->read ofs=0 len=0 2024-04-24T02:14:12.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.022+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562245498e10 con 0x562245495520 2024-04-24T02:14:12.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.022+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc15406e070 con 0x562245495520 2024-04-24T02:14:12.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.022+0000 7fc163c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:12.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.022+0000 7fc163c98800 20 rados->read ofs=0 len=0 2024-04-24T02:14:12.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.022+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622454991b0 con 0x562245495520 2024-04-24T02:14:12.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.022+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc15406e070 con 0x562245495520 2024-04-24T02:14:12.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.022+0000 7fc163c98800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:14:12.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.022+0000 7fc163c98800 20 rados->read ofs=0 len=0 2024-04-24T02:14:12.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.022+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562245499a00 con 0x562245495520 2024-04-24T02:14:12.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.022+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc15406e070 con 0x562245495520 2024-04-24T02:14:12.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.023+0000 7fc163c98800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:14:12.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.023+0000 7fc163c98800 20 searching for the correct realm 2024-04-24T02:14:12.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.023+0000 7fc163c98800 1 --2- 172.21.15.134:0/4251476284 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x56224549b770 0x56224549db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.023+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56224549e140 con 0x56224549b770 2024-04-24T02:14:12.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.023+0000 7fc158f9d640 1 --2- 172.21.15.134:0/4251476284 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x56224549b770 0x56224549db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.023+0000 7fc158f9d640 1 --2- 172.21.15.134:0/4251476284 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x56224549b770 0x56224549db60 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.023+0000 7fc158f9d640 1 -- 172.21.15.134:0/4251476284 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc14c024030 con 0x56224549b770 2024-04-24T02:14:12.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.023+0000 7fc158f9d640 1 --2- 172.21.15.134:0/4251476284 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fc14c027060 0x7fc14c0467d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.023+0000 7fc158f9d640 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56224549e140 con 0x7fc14c027060 2024-04-24T02:14:12.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.023+0000 7fc161f9f640 1 --2- 172.21.15.134:0/4251476284 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fc14c027060 0x7fc14c0467d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.024+0000 7fc161f9f640 1 --2- 172.21.15.134:0/4251476284 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fc14c027060 0x7fc14c0467d0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.024+0000 7fc161f9f640 1 -- 172.21.15.134:0/4251476284 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc15c01f070 con 0x7fc14c027060 2024-04-24T02:14:12.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.024+0000 7fc161f9f640 1 --2- 172.21.15.134:0/4251476284 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fc15c031040 0x7fc15c032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.024+0000 7fc161f9f640 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56224549e140 con 0x7fc15c031040 2024-04-24T02:14:12.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.024+0000 7fc16179e640 1 --2- 172.21.15.134:0/4251476284 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fc15c031040 0x7fc15c032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.024+0000 7fc16179e640 1 --2- 172.21.15.134:0/4251476284 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fc15c031040 0x7fc15c032430 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.025+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc15406e070 con 0x7fc15c031040 2024-04-24T02:14:12.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.025+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56224549e140 con 0x562245495520 2024-04-24T02:14:12.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.025+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc15406e070 con 0x562245495520 2024-04-24T02:14:12.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.025+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56224549e140 con 0x562245495520 2024-04-24T02:14:12.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.025+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc15406e070 con 0x562245495520 2024-04-24T02:14:12.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.025+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56224549e140 con 0x7fc15c031040 2024-04-24T02:14:12.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.025+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc15406e070 con 0x7fc15c031040 2024-04-24T02:14:12.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.025+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56224549e140 con 0x7fc14c027060 2024-04-24T02:14:12.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.025+0000 7fc161f9f640 1 -- 172.21.15.134:0/4251476284 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc15c01f070 con 0x7fc14c027060 2024-04-24T02:14:12.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.025+0000 7fc161f9f640 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56224549e140 con 0x7fc14c027060 2024-04-24T02:14:12.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.026+0000 7fc161f9f640 1 -- 172.21.15.134:0/4251476284 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc15c01f070 con 0x7fc14c027060 2024-04-24T02:14:12.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.026+0000 7fc161f9f640 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56224549e140 con 0x56224549b770 2024-04-24T02:14:12.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.026+0000 7fc158f9d640 1 -- 172.21.15.134:0/4251476284 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc14c024030 con 0x56224549b770 2024-04-24T02:14:12.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.026+0000 7fc158f9d640 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56224549e140 con 0x562245495520 2024-04-24T02:14:12.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.026+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc15406e070 con 0x562245495520 2024-04-24T02:14:12.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.026+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56224549e140 con 0x7fc15c031040 2024-04-24T02:14:12.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.026+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc15406e070 con 0x7fc15c031040 2024-04-24T02:14:12.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.026+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56224549e140 con 0x562245495520 2024-04-24T02:14:12.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.027+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc15406e070 con 0x562245495520 2024-04-24T02:14:12.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.027+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56224549e140 con 0x7fc14c027060 2024-04-24T02:14:12.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.027+0000 7fc161f9f640 1 -- 172.21.15.134:0/4251476284 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc15c01f070 con 0x7fc14c027060 2024-04-24T02:14:12.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.027+0000 7fc161f9f640 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56224549e140 con 0x56224549b770 2024-04-24T02:14:12.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.027+0000 7fc158f9d640 1 -- 172.21.15.134:0/4251476284 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc14c024030 con 0x56224549b770 2024-04-24T02:14:12.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.027+0000 7fc158f9d640 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56224549e140 con 0x56224549b770 2024-04-24T02:14:12.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.027+0000 7fc158f9d640 1 -- 172.21.15.134:0/4251476284 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc14c024030 con 0x56224549b770 2024-04-24T02:14:12.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.027+0000 7fc158f9d640 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56224549e140 con 0x7fc14c027060 2024-04-24T02:14:12.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.028+0000 7fc161f9f640 1 -- 172.21.15.134:0/4251476284 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc15c01f070 con 0x7fc14c027060 2024-04-24T02:14:12.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.028+0000 7fc161f9f640 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56224549e140 con 0x56224549b770 2024-04-24T02:14:12.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.028+0000 7fc158f9d640 1 -- 172.21.15.134:0/4251476284 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc14c024030 con 0x56224549b770 2024-04-24T02:14:12.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.028+0000 7fc158f9d640 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56224549e140 con 0x56224549b770 2024-04-24T02:14:12.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.028+0000 7fc158f9d640 1 -- 172.21.15.134:0/4251476284 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc14c024030 con 0x56224549b770 2024-04-24T02:14:12.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.028+0000 7fc158f9d640 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56224549e140 con 0x562245495520 2024-04-24T02:14:12.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.028+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc15406e070 con 0x562245495520 2024-04-24T02:14:12.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.028+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56224549e140 con 0x562245495520 2024-04-24T02:14:12.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.028+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=132b] v32'6 uv6 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7fc15406e070 con 0x562245495520 2024-04-24T02:14:12.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.028+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56224549e140 con 0x7fc15c031040 2024-04-24T02:14:12.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.029+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc15406e070 con 0x7fc15c031040 2024-04-24T02:14:12.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.029+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56224549e140 con 0x56224549b770 2024-04-24T02:14:12.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.029+0000 7fc158f9d640 1 -- 172.21.15.134:0/4251476284 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc14c024030 con 0x56224549b770 2024-04-24T02:14:12.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.029+0000 7fc158f9d640 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56224549e140 con 0x7fc14c027060 2024-04-24T02:14:12.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.029+0000 7fc161f9f640 1 -- 172.21.15.134:0/4251476284 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc15c01f070 con 0x7fc14c027060 2024-04-24T02:14:12.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.029+0000 7fc161f9f640 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56224549e140 con 0x562245495520 2024-04-24T02:14:12.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.029+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc15406e070 con 0x562245495520 2024-04-24T02:14:12.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.029+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56224549e140 con 0x7fc15c031040 2024-04-24T02:14:12.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.030+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc15406e070 con 0x7fc15c031040 2024-04-24T02:14:12.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.030+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56224549e140 con 0x56224549b770 2024-04-24T02:14:12.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.030+0000 7fc158f9d640 1 -- 172.21.15.134:0/4251476284 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc14c024030 con 0x56224549b770 2024-04-24T02:14:12.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.030+0000 7fc158f9d640 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56224549e140 con 0x7fc15c031040 2024-04-24T02:14:12.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.030+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc15406e070 con 0x7fc15c031040 2024-04-24T02:14:12.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.030+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56224549e140 con 0x7fc14c027060 2024-04-24T02:14:12.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.030+0000 7fc161f9f640 1 -- 172.21.15.134:0/4251476284 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc15c040040 con 0x7fc14c027060 2024-04-24T02:14:12.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.030+0000 7fc161f9f640 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56224549e140 con 0x56224549b770 2024-04-24T02:14:12.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.031+0000 7fc158f9d640 1 -- 172.21.15.134:0/4251476284 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc14c024030 con 0x56224549b770 2024-04-24T02:14:12.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.031+0000 7fc158f9d640 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56224549e140 con 0x7fc14c027060 2024-04-24T02:14:12.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.031+0000 7fc161f9f640 1 -- 172.21.15.134:0/4251476284 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc15c040040 con 0x7fc14c027060 2024-04-24T02:14:12.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.031+0000 7fc161f9f640 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56224549e140 con 0x562245495520 2024-04-24T02:14:12.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.031+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc15406e070 con 0x562245495520 2024-04-24T02:14:12.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.031+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56224549e140 con 0x7fc14c027060 2024-04-24T02:14:12.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.031+0000 7fc161f9f640 1 -- 172.21.15.134:0/4251476284 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc15c040040 con 0x7fc14c027060 2024-04-24T02:14:12.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.031+0000 7fc163c98800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:14:12.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.031+0000 7fc163c98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:14:12.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.031+0000 7fc163c98800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:14:12.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.031+0000 7fc163c98800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:14:12.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.031+0000 7fc163c98800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:14:12.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.031+0000 7fc163c98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:14:12.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.031+0000 7fc163c98800 20 rados->read ofs=0 len=0 2024-04-24T02:14:12.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.031+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56224549a350 con 0x562245495520 2024-04-24T02:14:12.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.032+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc15406e070 con 0x562245495520 2024-04-24T02:14:12.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.032+0000 7fc163c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:12.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.032+0000 7fc163c98800 20 rados->read ofs=0 len=0 2024-04-24T02:14:12.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.032+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56224549abf0 con 0x562245495520 2024-04-24T02:14:12.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.032+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc15406e070 con 0x562245495520 2024-04-24T02:14:12.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.032+0000 7fc163c98800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:14:12.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.032+0000 7fc163c98800 20 rados->read ofs=0 len=0 2024-04-24T02:14:12.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.032+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56224549abf0 con 0x562245495520 2024-04-24T02:14:12.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.032+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc15406e070 con 0x562245495520 2024-04-24T02:14:12.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.032+0000 7fc163c98800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:14:12.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.032+0000 7fc163c98800 20 zone default found 2024-04-24T02:14:12.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.032+0000 7fc163c98800 4 Realm: () 2024-04-24T02:14:12.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.032+0000 7fc163c98800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:14:12.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.032+0000 7fc163c98800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:14:12.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.032+0000 7fc163c98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:14:12.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.032+0000 7fc163c98800 20 zonegroup default 2024-04-24T02:14:12.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.032+0000 7fc163c98800 20 rados->read ofs=0 len=0 2024-04-24T02:14:12.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.032+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56224549e5c0 con 0x7fc15c031040 2024-04-24T02:14:12.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.033+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc15406e070 con 0x7fc15c031040 2024-04-24T02:14:12.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.033+0000 7fc163c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:12.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.033+0000 7fc163c98800 20 rados->read ofs=0 len=0 2024-04-24T02:14:12.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.033+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56224549ffd0 con 0x56224549b770 2024-04-24T02:14:12.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.033+0000 7fc158f9d640 1 -- 172.21.15.134:0/4251476284 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc14c024030 con 0x56224549b770 2024-04-24T02:14:12.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.033+0000 7fc163c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:12.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.033+0000 7fc163c98800 20 rados->read ofs=0 len=0 2024-04-24T02:14:12.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.033+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622454a04e0 con 0x56224549b770 2024-04-24T02:14:12.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.033+0000 7fc158f9d640 1 -- 172.21.15.134:0/4251476284 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc14c024030 con 0x56224549b770 2024-04-24T02:14:12.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.033+0000 7fc163c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:12.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.033+0000 7fc163c98800 20 started sync module instance, tier type = 2024-04-24T02:14:12.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.033+0000 7fc163c98800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:14:12.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.033+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56224549f440 con 0x7fc14c027060 2024-04-24T02:14:12.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.034+0000 7fc161f9f640 1 -- 172.21.15.134:0/4251476284 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(44 notify.0 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc15c040040 con 0x7fc14c027060 2024-04-24T02:14:12.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.034+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94705191352368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56224549f0a0 con 0x7fc14c027060 2024-04-24T02:14:12.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.034+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622454a1410 con 0x562245495520 2024-04-24T02:14:12.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.035+0000 7fc161f9f640 1 -- 172.21.15.134:0/4251476284 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94705191352368] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc15c040040 con 0x7fc14c027060 2024-04-24T02:14:12.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.035+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc15406e070 con 0x562245495520 2024-04-24T02:14:12.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.035+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94705191356736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622454a1410 con 0x562245495520 2024-04-24T02:14:12.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.035+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622454a1e10 con 0x56224549b770 2024-04-24T02:14:12.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.036+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94705191356736] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc15406e070 con 0x562245495520 2024-04-24T02:14:12.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.037+0000 7fc158f9d640 1 -- 172.21.15.134:0/4251476284 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc14c024030 con 0x56224549b770 2024-04-24T02:14:12.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.037+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94705191358304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622454a1380 con 0x56224549b770 2024-04-24T02:14:12.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.037+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622454a2bd0 con 0x7fc14c027060 2024-04-24T02:14:12.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.037+0000 7fc158f9d640 1 -- 172.21.15.134:0/4251476284 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94705191358304] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc14c024030 con 0x56224549b770 2024-04-24T02:14:12.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.038+0000 7fc161f9f640 1 -- 172.21.15.134:0/4251476284 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(50 notify.3 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc15c040040 con 0x7fc14c027060 2024-04-24T02:14:12.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.038+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94705191363072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622454a2fc0 con 0x7fc14c027060 2024-04-24T02:14:12.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.038+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622454a39e0 con 0x562245495520 2024-04-24T02:14:12.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.039+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc15406e070 con 0x562245495520 2024-04-24T02:14:12.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.039+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94705191367888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622454a39a0 con 0x562245495520 2024-04-24T02:14:12.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.039+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622454a47b0 con 0x7fc15c031040 2024-04-24T02:14:12.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.039+0000 7fc161f9f640 1 -- 172.21.15.134:0/4251476284 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94705191363072] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc15c040040 con 0x7fc14c027060 2024-04-24T02:14:12.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.040+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(54 notify.5 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc15406e070 con 0x7fc15c031040 2024-04-24T02:14:12.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.040+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94705191364128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622454a4860 con 0x7fc15c031040 2024-04-24T02:14:12.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.040+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622454a5380 con 0x7fc15c031040 2024-04-24T02:14:12.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.040+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94705191367888] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc15406e070 con 0x562245495520 2024-04-24T02:14:12.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.041+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94705191364128] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc15406e070 con 0x7fc15c031040 2024-04-24T02:14:12.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.041+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(56 notify.6 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc15406e070 con 0x7fc15c031040 2024-04-24T02:14:12.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.041+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94705191374416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622454a4280 con 0x7fc15c031040 2024-04-24T02:14:12.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.041+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622454a5960 con 0x7fc15c031040 2024-04-24T02:14:12.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.042+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94705191374416] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc15406e070 con 0x7fc15c031040 2024-04-24T02:14:12.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.042+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(58 notify.7 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc15406e070 con 0x7fc15c031040 2024-04-24T02:14:12.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.042+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94705191370464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622454a5960 con 0x7fc15c031040 2024-04-24T02:14:12.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.042+0000 7fc163c98800 20 add_watcher() i=0 2024-04-24T02:14:12.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.042+0000 7fc163c98800 20 add_watcher() i=1 2024-04-24T02:14:12.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.042+0000 7fc163c98800 20 add_watcher() i=2 2024-04-24T02:14:12.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.042+0000 7fc163c98800 20 add_watcher() i=3 2024-04-24T02:14:12.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.042+0000 7fc163c98800 20 add_watcher() i=4 2024-04-24T02:14:12.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.042+0000 7fc163c98800 20 add_watcher() i=5 2024-04-24T02:14:12.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.042+0000 7fc163c98800 20 add_watcher() i=6 2024-04-24T02:14:12.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.043+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94705191370464] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc15406e070 con 0x7fc15c031040 2024-04-24T02:14:12.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.043+0000 7fc163c98800 20 add_watcher() i=7 2024-04-24T02:14:12.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.043+0000 7fc163c98800 2 all 8 watchers are set, enabling cache 2024-04-24T02:14:12.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.043+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622454a8c20 con 0x562245495520 2024-04-24T02:14:12.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.043+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc15406e070 con 0x562245495520 2024-04-24T02:14:12.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.043+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94705191376416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622454a5ef0 con 0x562245495520 2024-04-24T02:14:12.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.044+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94705191376416] v32'272 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc15406e070 con 0x562245495520 2024-04-24T02:14:12.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.044+0000 7fc0177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:14:12.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.044+0000 7fc163c98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:14:12.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.044+0000 7fc163c98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:14:12.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.045+0000 7fc163c98800 5 note: GC not initialized 2024-04-24T02:14:12.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.045+0000 7fc0167e4640 20 reqs_thread_entry: start 2024-04-24T02:14:12.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.045+0000 7fc163c98800 20 init_complete bucket index max shards: 11 2024-04-24T02:14:12.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.045+0000 7fc163c98800 20 Filter name: none 2024-04-24T02:14:12.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.045+0000 7fbf87fff640 20 reqs_thread_entry: start 2024-04-24T02:14:12.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.045+0000 7fc163c98800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-24T02:14:12.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.045+0000 7fc163c98800 20 rados->read ofs=0 len=0 2024-04-24T02:14:12.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.045+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622454dbff0 con 0x7fc15c031040 2024-04-24T02:14:12.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.046+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7fc15406e070 con 0x7fc15c031040 2024-04-24T02:14:12.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.046+0000 7fc163c98800 20 rados_obj.operate() r=0 bl.length=460 2024-04-24T02:14:12.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.046+0000 7fc163c98800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-24T02:14:12.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.046+0000 7fc163c98800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T02:14:12.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.046+0000 7fc163c98800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:14:12.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.046+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622454e2600 con 0x7fc15c031040 2024-04-24T02:14:12.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.047+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v32'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fc15406e070 con 0x7fc15c031040 2024-04-24T02:14:12.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.047+0000 7fc163c98800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T02:14:12.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.047+0000 7fc163c98800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T02:14:12.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.047+0000 7fc163c98800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-24T02:14:12.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.047+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94705191624816 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622454ddd10 con 0x562245495520 2024-04-24T02:14:12.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.047+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== watch-notify(notify (1) cookie 94705191367888 notify 137438953500 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7fc154084040 con 0x562245495520 2024-04-24T02:14:12.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.047+0000 7fc044ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953500 cookie 94705191367888 notifier 4893 bl.length()=666 2024-04-24T02:14:12.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.047+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(64 notify.4 [notify cookie 94705191624816 out=8b] v0'0 uv270 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc15406e070 con 0x562245495520 2024-04-24T02:14:12.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.047+0000 7fc044ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T02:14:12.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.047+0000 7fc044ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T02:14:12.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.047+0000 7fc044ff9640 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc024003ea0 con 0x562245495520 2024-04-24T02:14:12.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.047+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc15406e070 con 0x562245495520 2024-04-24T02:14:12.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.048+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== watch-notify(notify_complete (2) cookie 94705191624816 notify 137438953500 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562245460090 con 0x562245495520 2024-04-24T02:14:12.061 INFO:teuthology.orchestra.run.smithi134.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-24T02:14:10.534163Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"write"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T02:14:10.534144Z","tags":[],"group_ids":[]} 2024-04-24T02:14:12.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.048+0000 7fc0177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:14:12.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.048+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94705191376416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622454a7e70 con 0x562245495520 2024-04-24T02:14:12.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.049+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94705191376416] v32'273 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc15406e070 con 0x562245495520 2024-04-24T02:14:12.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.049+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94705191352368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622454a5620 con 0x7fc14c027060 2024-04-24T02:14:12.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.050+0000 7fc161f9f640 1 -- 172.21.15.134:0/4251476284 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94705191352368] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc15c040040 con 0x7fc14c027060 2024-04-24T02:14:12.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.050+0000 7fc163c98800 20 remove_watcher() i=0 2024-04-24T02:14:12.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.050+0000 7fc163c98800 2 removed watcher, disabling cache 2024-04-24T02:14:12.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.050+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94705191356736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622454a5620 con 0x562245495520 2024-04-24T02:14:12.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.052+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94705191356736] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc15406e070 con 0x562245495520 2024-04-24T02:14:12.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.052+0000 7fc163c98800 20 remove_watcher() i=1 2024-04-24T02:14:12.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.052+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94705191358304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622454a0940 con 0x56224549b770 2024-04-24T02:14:12.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.053+0000 7fc158f9d640 1 -- 172.21.15.134:0/4251476284 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94705191358304] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc14c024030 con 0x56224549b770 2024-04-24T02:14:12.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.053+0000 7fc163c98800 20 remove_watcher() i=2 2024-04-24T02:14:12.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.053+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94705191363072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622454a5620 con 0x7fc14c027060 2024-04-24T02:14:12.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.054+0000 7fc161f9f640 1 -- 172.21.15.134:0/4251476284 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94705191363072] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc15c040040 con 0x7fc14c027060 2024-04-24T02:14:12.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.054+0000 7fc163c98800 20 remove_watcher() i=3 2024-04-24T02:14:12.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.054+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94705191367888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622454a0f60 con 0x562245495520 2024-04-24T02:14:12.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.055+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94705191367888] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc15406e070 con 0x562245495520 2024-04-24T02:14:12.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.055+0000 7fc163c98800 20 remove_watcher() i=4 2024-04-24T02:14:12.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.055+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94705191364128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622454a2200 con 0x7fc15c031040 2024-04-24T02:14:12.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.056+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94705191364128] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc15406e070 con 0x7fc15c031040 2024-04-24T02:14:12.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.056+0000 7fc163c98800 20 remove_watcher() i=5 2024-04-24T02:14:12.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.056+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94705191374416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622454a5620 con 0x7fc15c031040 2024-04-24T02:14:12.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.058+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94705191374416] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc15406e070 con 0x7fc15c031040 2024-04-24T02:14:12.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.058+0000 7fc163c98800 20 remove_watcher() i=6 2024-04-24T02:14:12.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.058+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94705191370464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622454a0f60 con 0x7fc15c031040 2024-04-24T02:14:12.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.059+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94705191370464] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc15406e070 con 0x7fc15c031040 2024-04-24T02:14:12.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.059+0000 7fc163c98800 20 remove_watcher() i=7 2024-04-24T02:14:12.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.059+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fc15c031040 msgr2=0x7fc15c032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.059+0000 7fc163c98800 1 --2- 172.21.15.134:0/4251476284 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fc15c031040 0x7fc15c032430 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.059+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x562245495520 msgr2=0x5622454979e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.059+0000 7fc163c98800 1 --2- 172.21.15.134:0/4251476284 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x562245495520 0x5622454979e0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.059+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fc14c027060 msgr2=0x7fc14c0467d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.059+0000 7fc163c98800 1 --2- 172.21.15.134:0/4251476284 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7fc14c027060 0x7fc14c0467d0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.059+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x56224549b770 msgr2=0x56224549db60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.059+0000 7fc163c98800 1 --2- 172.21.15.134:0/4251476284 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x56224549b770 0x56224549db60 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.059+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc02c0368b0 msgr2=0x7fc02c038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.059+0000 7fc163c98800 1 --2- 172.21.15.134:0/4251476284 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc02c0368b0 0x7fc02c038d70 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x562245465040 tx=0x7fc15c01f000 comp rx=0 tx=0).stop 2024-04-24T02:14:12.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.059+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562245482310 msgr2=0x5622454899d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.059+0000 7fc163c98800 1 --2- 172.21.15.134:0/4251476284 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562245482310 0x5622454899d0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fc14c026fd0 tx=0x7fc14c04be50 comp rx=0 tx=0).stop 2024-04-24T02:14:12.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.059+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 reap_dead start 2024-04-24T02:14:12.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.059+0000 7fc16179e640 1 -- 172.21.15.134:0/4251476284 reap_dead start 2024-04-24T02:14:12.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.059+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 shutdown_connections 2024-04-24T02:14:12.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.059+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 >> 172.21.15.134:0/4251476284 conn(0x56224547e670 msgr2=0x56224547bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:12.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.059+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 shutdown_connections 2024-04-24T02:14:12.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.059+0000 7fc163c98800 1 -- 172.21.15.134:0/4251476284 wait complete. 2024-04-24T02:14:12.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.059+0000 7fc163c98800 1 -- 172.21.15.134:0/1512923235 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc038036950 msgr2=0x7fc038038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.059+0000 7fc163c98800 1 --2- 172.21.15.134:0/1512923235 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc038036950 0x7fc038038e10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x5622454658c0 tx=0x7fc15c005840 comp rx=0 tx=0).stop 2024-04-24T02:14:12.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.059+0000 7fc163c98800 1 -- 172.21.15.134:0/1512923235 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562245474fd0 msgr2=0x5622454753f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.059+0000 7fc163c98800 1 --2- 172.21.15.134:0/1512923235 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562245474fd0 0x5622454753f0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fc14c00e610 tx=0x7fc14c00ff90 comp rx=0 tx=0).stop 2024-04-24T02:14:12.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.059+0000 7fc163c98800 1 -- 172.21.15.134:0/1512923235 shutdown_connections 2024-04-24T02:14:12.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.059+0000 7fc163c98800 1 --2- 172.21.15.134:0/1512923235 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc038036950 0x7fc038038e10 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.059+0000 7fc163c98800 1 --2- 172.21.15.134:0/1512923235 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562245474fd0 0x5622454753f0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.059+0000 7fc163c98800 1 -- 172.21.15.134:0/1512923235 >> 172.21.15.134:0/1512923235 conn(0x562245469070 msgr2=0x562245469470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:12.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.059+0000 7fc163c98800 1 -- 172.21.15.134:0/1512923235 shutdown_connections 2024-04-24T02:14:12.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.060+0000 7fc163c98800 1 -- 172.21.15.134:0/1512923235 wait complete. 2024-04-24T02:14:12.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.060+0000 7fc163c98800 1 -- 172.21.15.134:0/3260246353 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x562245361120 msgr2=0x562245463e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.060+0000 7fc163c98800 1 --2- 172.21.15.134:0/3260246353 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x562245361120 0x562245463e50 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.060+0000 7fc163c98800 1 -- 172.21.15.134:0/3260246353 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc048036950 msgr2=0x7fc048038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.060+0000 7fc163c98800 1 --2- 172.21.15.134:0/3260246353 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc048036950 0x7fc048038e10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc14c000c00 tx=0x7fc14c0013b0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.060+0000 7fc163c98800 1 -- 172.21.15.134:0/3260246353 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5622453607c0 msgr2=0x56224545ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.060+0000 7fc163c98800 1 --2- 172.21.15.134:0/3260246353 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5622453607c0 0x56224545ccb0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fc154061040 tx=0x7fc154002fb0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.060+0000 7fc163c98800 1 -- 172.21.15.134:0/3260246353 shutdown_connections 2024-04-24T02:14:12.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.060+0000 7fc163c98800 1 --2- 172.21.15.134:0/3260246353 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x562245361120 0x562245463e50 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.060+0000 7fc163c98800 1 --2- 172.21.15.134:0/3260246353 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fc048036950 0x7fc048038e10 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.060+0000 7fc163c98800 1 --2- 172.21.15.134:0/3260246353 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5622453607c0 0x56224545ccb0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.060+0000 7fc163c98800 1 -- 172.21.15.134:0/3260246353 >> 172.21.15.134:0/3260246353 conn(0x56224535c340 msgr2=0x56224544f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:12.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.060+0000 7fc163c98800 1 -- 172.21.15.134:0/3260246353 shutdown_connections 2024-04-24T02:14:12.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.060+0000 7fc163c98800 1 -- 172.21.15.134:0/3260246353 wait complete. 2024-04-24T02:14:12.072 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T02:14:10.534163Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:14:10.534144Z', 'tags': [], 'group_ids': []} 2024-04-24T02:14:12.072 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T02:14:10.534163Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:14:10.534144Z', 'tags': [], 'group_ids': []} 2024-04-24T02:14:12.072 ERROR:root:0 2024-04-24T02:14:12.073 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T02:14:12.077 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'AccessDenied', 'Message': '', 'RequestId': 'tx00000cc775a6aadc80480-0066286af4-4222-default', 'HostId': '4222-default-default'} 2024-04-24T02:14:12.077 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-04-24T02:14:12.078 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-04-24T02:14:12.078 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps user-info-without-keys=write 2024-04-24T02:14:12.122 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:14:12.122 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:14:12.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.122+0000 7f56ce72a800 1 Processor -- start 2024-04-24T02:14:12.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.122+0000 7f56ce72a800 1 -- start start 2024-04-24T02:14:12.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.122+0000 7f56ce72a800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x563cc832c9b0 0x563cc832eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.122+0000 7f56ce72a800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563cc81ead40 con 0x563cc832f2e0 2024-04-24T02:14:12.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.122+0000 7f56ce72a800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x563cc81bd4d0 con 0x563cc832c9b0 2024-04-24T02:14:12.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.122+0000 7f56ca464640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x563cc832c9b0 0x563cc832eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.122+0000 7f56c9c63640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x563cc832f2e0 0x563cc83316d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:46498/0 (socket says 172.21.15.134:46498) 2024-04-24T02:14:12.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.122+0000 7f56c9c63640 1 -- 172.21.15.134:0/3913254252 learned_addr learned my addr 172.21.15.134:0/3913254252 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:14:12.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.123+0000 7f56ca464640 1 -- 172.21.15.134:0/3913254252 >> v1:172.21.15.104:6789/0 conn(0x563cc832f2e0 legacy=0x563cc83316d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.123+0000 7f56c9462640 1 -- 172.21.15.134:0/3913254252 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2910911831 0 0) 0x563cc81ead40 con 0x563cc832f2e0 2024-04-24T02:14:12.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.123+0000 7f56ca464640 1 -- 172.21.15.134:0/3913254252 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cc81e9590 con 0x563cc832c9b0 2024-04-24T02:14:12.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.125+0000 7f56ca464640 1 --2- 172.21.15.134:0/3913254252 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563cc832c9b0 0x563cc832eda0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f56bc00a470 tx=0x7f56bc01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6dec894bd0db760 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.125+0000 7f56c9462640 1 -- 172.21.15.134:0/3913254252 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56bc057070 con 0x563cc832c9b0 2024-04-24T02:14:12.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.125+0000 7f56c9462640 1 -- 172.21.15.134:0/3913254252 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56bc052570 con 0x563cc832c9b0 2024-04-24T02:14:12.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.125+0000 7f56c9462640 1 -- 172.21.15.134:0/3913254252 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56bc052870 con 0x563cc832c9b0 2024-04-24T02:14:12.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.125+0000 7f56ce72a800 1 -- 172.21.15.134:0/3913254252 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563cc832c9b0 msgr2=0x563cc832eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.125+0000 7f56ce72a800 1 --2- 172.21.15.134:0/3913254252 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563cc832c9b0 0x563cc832eda0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f56bc00a470 tx=0x7f56bc01ce90 comp rx=0 tx=0).stop 2024-04-24T02:14:12.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.125+0000 7f56ce72a800 1 -- 172.21.15.134:0/3913254252 shutdown_connections 2024-04-24T02:14:12.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.125+0000 7f56ce72a800 1 --2- 172.21.15.134:0/3913254252 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563cc832c9b0 0x563cc832eda0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.125+0000 7f56ce72a800 1 -- 172.21.15.134:0/3913254252 >> 172.21.15.134:0/3913254252 conn(0x563cc8326340 msgr2=0x563cc8328760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:12.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.125+0000 7f56ce72a800 1 -- 172.21.15.134:0/3913254252 shutdown_connections 2024-04-24T02:14:12.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.125+0000 7f56ce72a800 1 -- 172.21.15.134:0/3913254252 wait complete. 2024-04-24T02:14:12.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.137+0000 7f56ce72a800 1 Processor -- start 2024-04-24T02:14:12.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.137+0000 7f56ce72a800 1 -- start start 2024-04-24T02:14:12.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.137+0000 7f56ce72a800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563cc832c9b0 0x563cc841cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.137+0000 7f56ce72a800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x563cc82773b0 con 0x563cc832c9b0 2024-04-24T02:14:12.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.138+0000 7f56ca464640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563cc832c9b0 0x563cc841cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.138+0000 7f56ca464640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563cc832c9b0 0x563cc841cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:44170/0 (socket says 172.21.15.134:44170) 2024-04-24T02:14:12.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.138+0000 7f56ca464640 1 -- 172.21.15.134:0/1292538651 learned_addr learned my addr 172.21.15.134:0/1292538651 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:12.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.138+0000 7f56ca464640 1 -- 172.21.15.134:0/1292538651 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cc841d520 con 0x563cc832c9b0 2024-04-24T02:14:12.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.138+0000 7f56ca464640 1 --2- 172.21.15.134:0/1292538651 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563cc832c9b0 0x563cc841cf50 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f56bc055040 tx=0x7f56bc04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1308f53f16167663 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.138+0000 7f55b8608640 1 -- 172.21.15.134:0/1292538651 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56bc057070 con 0x563cc832c9b0 2024-04-24T02:14:12.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.138+0000 7f55b8608640 1 -- 172.21.15.134:0/1292538651 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56bc063070 con 0x563cc832c9b0 2024-04-24T02:14:12.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.138+0000 7f55b8608640 1 -- 172.21.15.134:0/1292538651 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56bc052720 con 0x563cc832c9b0 2024-04-24T02:14:12.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.139+0000 7f56ce72a800 1 -- 172.21.15.134:0/1292538651 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563cc832c9b0 msgr2=0x563cc841cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.139+0000 7f56ce72a800 1 --2- 172.21.15.134:0/1292538651 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563cc832c9b0 0x563cc841cf50 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f56bc055040 tx=0x7f56bc04c000 comp rx=0 tx=0).stop 2024-04-24T02:14:12.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.139+0000 7f56ce72a800 1 -- 172.21.15.134:0/1292538651 shutdown_connections 2024-04-24T02:14:12.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.139+0000 7f56ce72a800 1 --2- 172.21.15.134:0/1292538651 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563cc832c9b0 0x563cc841cf50 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.139+0000 7f56ce72a800 1 -- 172.21.15.134:0/1292538651 >> 172.21.15.134:0/1292538651 conn(0x563cc8326340 msgr2=0x563cc8418870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:12.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.139+0000 7f56ce72a800 1 -- 172.21.15.134:0/1292538651 shutdown_connections 2024-04-24T02:14:12.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.139+0000 7f56ce72a800 1 -- 172.21.15.134:0/1292538651 wait complete. 2024-04-24T02:14:12.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.139+0000 7f56ce72a800 1 Processor -- start 2024-04-24T02:14:12.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.139+0000 7f56ce72a800 1 -- start start 2024-04-24T02:14:12.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.139+0000 7f56ce72a800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563cc832c9b0 0x563cc84249d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.139+0000 7f56ce72a800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x563cc8335100 con 0x563cc832c9b0 2024-04-24T02:14:12.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.140+0000 7f56ca464640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563cc832c9b0 0x563cc84249d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.140+0000 7f56ca464640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563cc832c9b0 0x563cc84249d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:44180/0 (socket says 172.21.15.134:44180) 2024-04-24T02:14:12.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.140+0000 7f56ca464640 1 -- 172.21.15.134:0/1082994854 learned_addr learned my addr 172.21.15.134:0/1082994854 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:12.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.140+0000 7f56ca464640 1 -- 172.21.15.134:0/1082994854 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cc8424f10 con 0x563cc832c9b0 2024-04-24T02:14:12.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.140+0000 7f56ca464640 1 --2- 172.21.15.134:0/1082994854 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563cc832c9b0 0x563cc84249d0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f56bc060040 tx=0x7f56bc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.140+0000 7f55b6e05640 1 -- 172.21.15.134:0/1082994854 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56bc052e30 con 0x563cc832c9b0 2024-04-24T02:14:12.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.140+0000 7f55b6e05640 1 -- 172.21.15.134:0/1082994854 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56bc06c070 con 0x563cc832c9b0 2024-04-24T02:14:12.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.140+0000 7f56ce72a800 1 -- 172.21.15.134:0/1082994854 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563cc84251a0 con 0x563cc832c9b0 2024-04-24T02:14:12.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.140+0000 7f55b6e05640 1 -- 172.21.15.134:0/1082994854 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56bc05e5f0 con 0x563cc832c9b0 2024-04-24T02:14:12.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.140+0000 7f56ce72a800 1 -- 172.21.15.134:0/1082994854 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563cc8427e50 con 0x563cc832c9b0 2024-04-24T02:14:12.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.141+0000 7f55b6e05640 1 -- 172.21.15.134:0/1082994854 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f56bc05e790 con 0x563cc832c9b0 2024-04-24T02:14:12.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.141+0000 7f55b6e05640 1 --2- 172.21.15.134:0/1082994854 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f55b0036950 0x7f55b0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.141+0000 7f55b6e05640 1 -- 172.21.15.134:0/1082994854 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f56bc08e7f0 con 0x563cc832c9b0 2024-04-24T02:14:12.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.141+0000 7f56c9c63640 1 --2- 172.21.15.134:0/1082994854 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f55b0036950 0x7f55b0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.141+0000 7f56ce72a800 1 --2- 172.21.15.134:0/1082994854 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x563cc832f2e0 0x563cc842bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.142+0000 7f56ce72a800 1 -- 172.21.15.134:0/1082994854 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563cc842c150 con 0x563cc832f2e0 2024-04-24T02:14:12.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.142+0000 7f56cac65640 1 --2- 172.21.15.134:0/1082994854 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x563cc832f2e0 0x563cc842bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.142+0000 7f56c9c63640 1 --2- 172.21.15.134:0/1082994854 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f55b0036950 0x7f55b0038e10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f56c0000c00 tx=0x7f56c00013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.142+0000 7f56cac65640 1 --2- 172.21.15.134:0/1082994854 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x563cc832f2e0 0x563cc842bc10 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.142+0000 7f56cac65640 1 -- 172.21.15.134:0/1082994854 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f56c400a4a0 con 0x563cc832f2e0 2024-04-24T02:14:12.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.142+0000 7f56ce72a800 1 -- 172.21.15.134:0/1082994854 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563cc84291c0 con 0x563cc832f2e0 2024-04-24T02:14:12.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.143+0000 7f56cac65640 1 -- 172.21.15.134:0/1082994854 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f56c400a4a0 con 0x563cc832f2e0 2024-04-24T02:14:12.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.143+0000 7f56ce72a800 1 -- 172.21.15.134:0/1082994854 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563cc842df30 con 0x563cc832f2e0 2024-04-24T02:14:12.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.143+0000 7f56cac65640 1 -- 172.21.15.134:0/1082994854 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f56c400a4a0 con 0x563cc832f2e0 2024-04-24T02:14:12.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.143+0000 7f56ce72a800 1 -- 172.21.15.134:0/1082994854 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563cc842d270 con 0x563cc832f2e0 2024-04-24T02:14:12.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.143+0000 7f56cac65640 1 -- 172.21.15.134:0/1082994854 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f56c400a4a0 con 0x563cc832f2e0 2024-04-24T02:14:12.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.143+0000 7f56ce72a800 1 -- 172.21.15.134:0/1082994854 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563cc842d6c0 con 0x563cc832f2e0 2024-04-24T02:14:12.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.143+0000 7f56cac65640 1 -- 172.21.15.134:0/1082994854 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f56c400a4a0 con 0x563cc832f2e0 2024-04-24T02:14:12.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.144+0000 7f56ce72a800 1 Processor -- start 2024-04-24T02:14:12.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.144+0000 7f56ce72a800 1 -- start start 2024-04-24T02:14:12.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.144+0000 7f56ce72a800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563cc843cd50 0x563cc843d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.144+0000 7f56ce72a800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x563cc821d6b0 con 0x563cc843cd50 2024-04-24T02:14:12.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.144+0000 7f56c9c63640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563cc843cd50 0x563cc843d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.144+0000 7f56c9c63640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563cc843cd50 0x563cc843d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:44196/0 (socket says 172.21.15.134:44196) 2024-04-24T02:14:12.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.144+0000 7f56c9c63640 1 -- 172.21.15.134:0/77695425 learned_addr learned my addr 172.21.15.134:0/77695425 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:12.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.144+0000 7f56c9c63640 1 -- 172.21.15.134:0/77695425 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cc843d6d0 con 0x563cc843cd50 2024-04-24T02:14:12.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.145+0000 7f56c9c63640 1 --2- 172.21.15.134:0/77695425 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563cc843cd50 0x563cc843d190 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f56c000e610 tx=0x7f56c000ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.145+0000 7f55affff640 1 -- 172.21.15.134:0/77695425 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56c0022070 con 0x563cc843cd50 2024-04-24T02:14:12.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.145+0000 7f55affff640 1 -- 172.21.15.134:0/77695425 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56c0009050 con 0x563cc843cd50 2024-04-24T02:14:12.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.145+0000 7f55affff640 1 -- 172.21.15.134:0/77695425 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56c000d500 con 0x563cc843cd50 2024-04-24T02:14:12.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.145+0000 7f56ce72a800 1 -- 172.21.15.134:0/77695425 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563cc843e060 con 0x563cc843cd50 2024-04-24T02:14:12.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.145+0000 7f56ce72a800 1 -- 172.21.15.134:0/77695425 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563cc843e500 con 0x563cc843cd50 2024-04-24T02:14:12.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.145+0000 7f55affff640 1 -- 172.21.15.134:0/77695425 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f56c0025070 con 0x563cc843cd50 2024-04-24T02:14:12.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.146+0000 7f55affff640 1 --2- 172.21.15.134:0/77695425 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f55a4036950 0x7f55a4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.146+0000 7f55affff640 1 -- 172.21.15.134:0/77695425 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f56c004daa0 con 0x563cc843cd50 2024-04-24T02:14:12.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.146+0000 7f56cac65640 1 --2- 172.21.15.134:0/77695425 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f55a4036950 0x7f55a4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.146+0000 7f56ce72a800 1 Processor -- start 2024-04-24T02:14:12.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.146+0000 7f56cac65640 1 --2- 172.21.15.134:0/77695425 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f55a4036950 0x7f55a4038e10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x563cc842cd90 tx=0x7f56c4005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.146+0000 7f56ce72a800 1 -- start start 2024-04-24T02:14:12.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.146+0000 7f56ce72a800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563cc844a050 0x563cc844a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.146+0000 7f56ce72a800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x563cc841d7e0 con 0x563cc844a050 2024-04-24T02:14:12.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.146+0000 7f56c9c63640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563cc844a050 0x563cc844a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.146+0000 7f56c9c63640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563cc844a050 0x563cc844a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:44206/0 (socket says 172.21.15.134:44206) 2024-04-24T02:14:12.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.146+0000 7f56c9c63640 1 -- 172.21.15.134:0/3950848375 learned_addr learned my addr 172.21.15.134:0/3950848375 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:12.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.147+0000 7f56c9c63640 1 -- 172.21.15.134:0/3950848375 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cc844aa40 con 0x563cc844a050 2024-04-24T02:14:12.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.147+0000 7f56c9c63640 1 --2- 172.21.15.134:0/3950848375 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563cc844a050 0x563cc844a470 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f56c0026fd0 tx=0x7f56c0024eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fecc6d744331960 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.147+0000 7f55adffb640 1 -- 172.21.15.134:0/3950848375 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56c004a030 con 0x563cc844a050 2024-04-24T02:14:12.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.147+0000 7f55adffb640 1 -- 172.21.15.134:0/3950848375 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56c0025e30 con 0x563cc844a050 2024-04-24T02:14:12.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.147+0000 7f55adffb640 1 -- 172.21.15.134:0/3950848375 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56c001ad50 con 0x563cc844a050 2024-04-24T02:14:12.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.147+0000 7f56ce72a800 1 -- 172.21.15.134:0/3950848375 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563cc844a050 msgr2=0x563cc844a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.147+0000 7f56ce72a800 1 --2- 172.21.15.134:0/3950848375 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563cc844a050 0x563cc844a470 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f56c0026fd0 tx=0x7f56c0024eb0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.147+0000 7f56ce72a800 1 -- 172.21.15.134:0/3950848375 shutdown_connections 2024-04-24T02:14:12.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.147+0000 7f56ce72a800 1 --2- 172.21.15.134:0/3950848375 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563cc844a050 0x563cc844a470 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.147+0000 7f56ce72a800 1 -- 172.21.15.134:0/3950848375 >> 172.21.15.134:0/3950848375 conn(0x563cc84463b0 msgr2=0x563cc8444410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:12.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.147+0000 7f56ce72a800 1 -- 172.21.15.134:0/3950848375 shutdown_connections 2024-04-24T02:14:12.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.147+0000 7f56ce72a800 1 -- 172.21.15.134:0/3950848375 wait complete. 2024-04-24T02:14:12.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.148+0000 7f56ce72a800 1 Processor -- start 2024-04-24T02:14:12.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.148+0000 7f56ce72a800 1 -- start start 2024-04-24T02:14:12.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.148+0000 7f56ce72a800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563cc844a050 0x563cc84516b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.148+0000 7f56ce72a800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x563cc844b1b0 con 0x563cc844a050 2024-04-24T02:14:12.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.148+0000 7f56c9c63640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563cc844a050 0x563cc84516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.148+0000 7f56c9c63640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563cc844a050 0x563cc84516b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:44216/0 (socket says 172.21.15.134:44216) 2024-04-24T02:14:12.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.148+0000 7f56c9c63640 1 -- 172.21.15.134:0/147709283 learned_addr learned my addr 172.21.15.134:0/147709283 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:12.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.148+0000 7f56c9c63640 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cc8451bf0 con 0x563cc844a050 2024-04-24T02:14:12.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.148+0000 7f56c9c63640 1 --2- 172.21.15.134:0/147709283 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563cc844a050 0x563cc84516b0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f56c0026fd0 tx=0x7f56c004be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.148+0000 7f559bfff640 1 -- 172.21.15.134:0/147709283 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56c004a050 con 0x563cc844a050 2024-04-24T02:14:12.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.149+0000 7f559bfff640 1 -- 172.21.15.134:0/147709283 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56c000d6a0 con 0x563cc844a050 2024-04-24T02:14:12.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.149+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563cc8451e80 con 0x563cc844a050 2024-04-24T02:14:12.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.149+0000 7f559bfff640 1 -- 172.21.15.134:0/147709283 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56c000d9e0 con 0x563cc844a050 2024-04-24T02:14:12.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.149+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563cc8454b30 con 0x563cc844a050 2024-04-24T02:14:12.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.149+0000 7f559bfff640 1 -- 172.21.15.134:0/147709283 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f56c004d330 con 0x563cc844a050 2024-04-24T02:14:12.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.149+0000 7f559bfff640 1 --2- 172.21.15.134:0/147709283 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5594036950 0x7f5594038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.149+0000 7f559bfff640 1 -- 172.21.15.134:0/147709283 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f56c00457f0 con 0x563cc844a050 2024-04-24T02:14:12.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.149+0000 7f56cac65640 1 --2- 172.21.15.134:0/147709283 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5594036950 0x7f5594038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.150+0000 7f56cac65640 1 --2- 172.21.15.134:0/147709283 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5594036950 0x7f5594038e10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x563cc8429130 tx=0x7f56c401f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.150+0000 7f56ce72a800 20 rados->read ofs=0 len=0 2024-04-24T02:14:12.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.150+0000 7f56ce72a800 1 --2- 172.21.15.134:0/147709283 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x563cc845d200 0x563cc845f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.150+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563cc845fe10 con 0x563cc845d200 2024-04-24T02:14:12.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.150+0000 7f56ca464640 1 --2- 172.21.15.134:0/147709283 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x563cc845d200 0x563cc845f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.150+0000 7f56ca464640 1 --2- 172.21.15.134:0/147709283 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x563cc845d200 0x563cc845f6c0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.151+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f56bc071990 con 0x563cc845d200 2024-04-24T02:14:12.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.151+0000 7f56ce72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:12.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.151+0000 7f56ce72a800 20 realm 2024-04-24T02:14:12.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.151+0000 7f56ce72a800 20 rados->read ofs=0 len=0 2024-04-24T02:14:12.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.151+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563cc8460220 con 0x563cc845d200 2024-04-24T02:14:12.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.151+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f56bc071990 con 0x563cc845d200 2024-04-24T02:14:12.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.151+0000 7f56ce72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:12.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.151+0000 7f56ce72a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:14:12.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.151+0000 7f56ce72a800 20 rados->read ofs=0 len=0 2024-04-24T02:14:12.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.151+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563cc8460af0 con 0x563cc845d200 2024-04-24T02:14:12.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.151+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f56bc071990 con 0x563cc845d200 2024-04-24T02:14:12.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.151+0000 7f56ce72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:12.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.151+0000 7f56ce72a800 20 rados->read ofs=0 len=0 2024-04-24T02:14:12.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.151+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563cc8460e90 con 0x563cc845d200 2024-04-24T02:14:12.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.151+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f56bc071990 con 0x563cc845d200 2024-04-24T02:14:12.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.151+0000 7f56ce72a800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:14:12.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.151+0000 7f56ce72a800 20 rados->read ofs=0 len=0 2024-04-24T02:14:12.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.151+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563cc84616e0 con 0x563cc845d200 2024-04-24T02:14:12.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.152+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f56bc071990 con 0x563cc845d200 2024-04-24T02:14:12.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.152+0000 7f56ce72a800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:14:12.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.152+0000 7f56ce72a800 20 searching for the correct realm 2024-04-24T02:14:12.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.152+0000 7f56ce72a800 1 --2- 172.21.15.134:0/147709283 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x563cc8463450 0x563cc8465840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.152+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563cc8465e20 con 0x563cc8463450 2024-04-24T02:14:12.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.152+0000 7f56c9c63640 1 --2- 172.21.15.134:0/147709283 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x563cc8463450 0x563cc8465840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.152+0000 7f56c9c63640 1 --2- 172.21.15.134:0/147709283 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x563cc8463450 0x563cc8465840 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.152+0000 7f56c9c63640 1 -- 172.21.15.134:0/147709283 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56c0024030 con 0x563cc8463450 2024-04-24T02:14:12.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.152+0000 7f56c9c63640 1 --2- 172.21.15.134:0/147709283 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f56c0035c20 0x7f56c00467d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.152+0000 7f56c9c63640 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563cc8465e20 con 0x7f56c0035c20 2024-04-24T02:14:12.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.152+0000 7f56cac65640 1 --2- 172.21.15.134:0/147709283 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f56c0035c20 0x7f56c00467d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.153+0000 7f56cac65640 1 --2- 172.21.15.134:0/147709283 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f56c0035c20 0x7f56c00467d0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.153+0000 7f56cac65640 1 -- 172.21.15.134:0/147709283 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56c401f070 con 0x7f56c0035c20 2024-04-24T02:14:12.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.153+0000 7f56cac65640 1 --2- 172.21.15.134:0/147709283 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f56c4031040 0x7f56c4032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.153+0000 7f56cac65640 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563cc8465e20 con 0x7f56c4031040 2024-04-24T02:14:12.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.153+0000 7f56ca464640 1 --2- 172.21.15.134:0/147709283 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f56c4031040 0x7f56c4032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.153+0000 7f56ca464640 1 --2- 172.21.15.134:0/147709283 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f56c4031040 0x7f56c4032940 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.154+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56bc071990 con 0x7f56c4031040 2024-04-24T02:14:12.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.154+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563cc84616e0 con 0x563cc845d200 2024-04-24T02:14:12.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.154+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56bc071990 con 0x563cc845d200 2024-04-24T02:14:12.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.154+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563cc84616e0 con 0x563cc845d200 2024-04-24T02:14:12.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.154+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f56bc071990 con 0x563cc845d200 2024-04-24T02:14:12.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.154+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563cc84616e0 con 0x7f56c4031040 2024-04-24T02:14:12.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.154+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56bc071990 con 0x7f56c4031040 2024-04-24T02:14:12.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.154+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563cc84616e0 con 0x7f56c0035c20 2024-04-24T02:14:12.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.155+0000 7f56cac65640 1 -- 172.21.15.134:0/147709283 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56c401f070 con 0x7f56c0035c20 2024-04-24T02:14:12.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.155+0000 7f56cac65640 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563cc84616e0 con 0x7f56c0035c20 2024-04-24T02:14:12.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.155+0000 7f56cac65640 1 -- 172.21.15.134:0/147709283 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56c401f070 con 0x7f56c0035c20 2024-04-24T02:14:12.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.155+0000 7f56cac65640 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563cc84616e0 con 0x563cc8463450 2024-04-24T02:14:12.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.155+0000 7f56c9c63640 1 -- 172.21.15.134:0/147709283 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56c0024030 con 0x563cc8463450 2024-04-24T02:14:12.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.155+0000 7f56c9c63640 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563cc84616e0 con 0x563cc845d200 2024-04-24T02:14:12.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.155+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56bc071990 con 0x563cc845d200 2024-04-24T02:14:12.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.155+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563cc84616e0 con 0x7f56c4031040 2024-04-24T02:14:12.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.156+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56bc071990 con 0x7f56c4031040 2024-04-24T02:14:12.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.156+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563cc84616e0 con 0x563cc845d200 2024-04-24T02:14:12.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.156+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56bc071990 con 0x563cc845d200 2024-04-24T02:14:12.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.156+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563cc84616e0 con 0x7f56c0035c20 2024-04-24T02:14:12.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.156+0000 7f56cac65640 1 -- 172.21.15.134:0/147709283 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f56c401f070 con 0x7f56c0035c20 2024-04-24T02:14:12.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.156+0000 7f56cac65640 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563cc84616e0 con 0x563cc8463450 2024-04-24T02:14:12.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.156+0000 7f56c9c63640 1 -- 172.21.15.134:0/147709283 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56c0024030 con 0x563cc8463450 2024-04-24T02:14:12.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.156+0000 7f56c9c63640 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563cc84616e0 con 0x563cc8463450 2024-04-24T02:14:12.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.156+0000 7f56c9c63640 1 -- 172.21.15.134:0/147709283 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56c0024030 con 0x563cc8463450 2024-04-24T02:14:12.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.156+0000 7f56c9c63640 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563cc84616e0 con 0x7f56c0035c20 2024-04-24T02:14:12.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.157+0000 7f56cac65640 1 -- 172.21.15.134:0/147709283 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56c401f070 con 0x7f56c0035c20 2024-04-24T02:14:12.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.157+0000 7f56cac65640 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563cc84616e0 con 0x563cc8463450 2024-04-24T02:14:12.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.157+0000 7f56c9c63640 1 -- 172.21.15.134:0/147709283 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56c0024030 con 0x563cc8463450 2024-04-24T02:14:12.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.157+0000 7f56c9c63640 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563cc84616e0 con 0x563cc8463450 2024-04-24T02:14:12.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.157+0000 7f56c9c63640 1 -- 172.21.15.134:0/147709283 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56c0024030 con 0x563cc8463450 2024-04-24T02:14:12.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.157+0000 7f56c9c63640 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563cc84616e0 con 0x563cc845d200 2024-04-24T02:14:12.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.157+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56bc071990 con 0x563cc845d200 2024-04-24T02:14:12.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.157+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563cc84616e0 con 0x563cc845d200 2024-04-24T02:14:12.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.158+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=132b] v32'6 uv6 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f56bc071990 con 0x563cc845d200 2024-04-24T02:14:12.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.158+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563cc84616e0 con 0x7f56c4031040 2024-04-24T02:14:12.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.158+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56bc071990 con 0x7f56c4031040 2024-04-24T02:14:12.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.158+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563cc84616e0 con 0x563cc8463450 2024-04-24T02:14:12.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.158+0000 7f56c9c63640 1 -- 172.21.15.134:0/147709283 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56c0024030 con 0x563cc8463450 2024-04-24T02:14:12.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.158+0000 7f56c9c63640 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563cc84616e0 con 0x7f56c0035c20 2024-04-24T02:14:12.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.159+0000 7f56cac65640 1 -- 172.21.15.134:0/147709283 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56c401f070 con 0x7f56c0035c20 2024-04-24T02:14:12.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.159+0000 7f56cac65640 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563cc84616e0 con 0x563cc845d200 2024-04-24T02:14:12.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.159+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56bc071990 con 0x563cc845d200 2024-04-24T02:14:12.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.159+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563cc84616e0 con 0x7f56c4031040 2024-04-24T02:14:12.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.159+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56bc071990 con 0x7f56c4031040 2024-04-24T02:14:12.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.159+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563cc84616e0 con 0x563cc8463450 2024-04-24T02:14:12.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.159+0000 7f56c9c63640 1 -- 172.21.15.134:0/147709283 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56c0024030 con 0x563cc8463450 2024-04-24T02:14:12.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.159+0000 7f56c9c63640 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563cc84616e0 con 0x7f56c4031040 2024-04-24T02:14:12.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.160+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56bc071990 con 0x7f56c4031040 2024-04-24T02:14:12.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.160+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563cc84616e0 con 0x7f56c0035c20 2024-04-24T02:14:12.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.160+0000 7f56cac65640 1 -- 172.21.15.134:0/147709283 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56c4040040 con 0x7f56c0035c20 2024-04-24T02:14:12.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.160+0000 7f56cac65640 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563cc84616e0 con 0x563cc8463450 2024-04-24T02:14:12.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.160+0000 7f56c9c63640 1 -- 172.21.15.134:0/147709283 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56c0024030 con 0x563cc8463450 2024-04-24T02:14:12.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.160+0000 7f56c9c63640 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563cc84616e0 con 0x7f56c0035c20 2024-04-24T02:14:12.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.160+0000 7f56cac65640 1 -- 172.21.15.134:0/147709283 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56c4040040 con 0x7f56c0035c20 2024-04-24T02:14:12.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.160+0000 7f56cac65640 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563cc84616e0 con 0x563cc845d200 2024-04-24T02:14:12.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.161+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f56bc071990 con 0x563cc845d200 2024-04-24T02:14:12.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.161+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563cc84616e0 con 0x7f56c0035c20 2024-04-24T02:14:12.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.161+0000 7f56cac65640 1 -- 172.21.15.134:0/147709283 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56c4040040 con 0x7f56c0035c20 2024-04-24T02:14:12.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.161+0000 7f56ce72a800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:14:12.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.161+0000 7f56ce72a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:14:12.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.161+0000 7f56ce72a800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:14:12.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.161+0000 7f56ce72a800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:14:12.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.161+0000 7f56ce72a800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:14:12.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.161+0000 7f56ce72a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:14:12.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.161+0000 7f56ce72a800 20 rados->read ofs=0 len=0 2024-04-24T02:14:12.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.161+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563cc8461f30 con 0x563cc845d200 2024-04-24T02:14:12.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.161+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f56bc071990 con 0x563cc845d200 2024-04-24T02:14:12.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.161+0000 7f56ce72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:12.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.161+0000 7f56ce72a800 20 rados->read ofs=0 len=0 2024-04-24T02:14:12.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.161+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563cc8462320 con 0x563cc845d200 2024-04-24T02:14:12.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.161+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f56bc071990 con 0x563cc845d200 2024-04-24T02:14:12.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.161+0000 7f56ce72a800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:14:12.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.161+0000 7f56ce72a800 20 rados->read ofs=0 len=0 2024-04-24T02:14:12.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.161+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563cc8462320 con 0x563cc845d200 2024-04-24T02:14:12.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.162+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f56bc071990 con 0x563cc845d200 2024-04-24T02:14:12.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.162+0000 7f56ce72a800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:14:12.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.162+0000 7f56ce72a800 20 zone default found 2024-04-24T02:14:12.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.162+0000 7f56ce72a800 4 Realm: () 2024-04-24T02:14:12.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.162+0000 7f56ce72a800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:14:12.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.162+0000 7f56ce72a800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:14:12.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.162+0000 7f56ce72a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:14:12.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.162+0000 7f56ce72a800 20 zonegroup default 2024-04-24T02:14:12.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.162+0000 7f56ce72a800 20 rados->read ofs=0 len=0 2024-04-24T02:14:12.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.162+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563cc84662a0 con 0x7f56c4031040 2024-04-24T02:14:12.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.162+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f56bc071990 con 0x7f56c4031040 2024-04-24T02:14:12.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.162+0000 7f56ce72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:12.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.162+0000 7f56ce72a800 20 rados->read ofs=0 len=0 2024-04-24T02:14:12.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.162+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563cc8467c80 con 0x563cc8463450 2024-04-24T02:14:12.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.162+0000 7f56c9c63640 1 -- 172.21.15.134:0/147709283 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f56c0024030 con 0x563cc8463450 2024-04-24T02:14:12.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.163+0000 7f56ce72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:12.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.163+0000 7f56ce72a800 20 rados->read ofs=0 len=0 2024-04-24T02:14:12.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.163+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563cc8468020 con 0x563cc8463450 2024-04-24T02:14:12.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.163+0000 7f56c9c63640 1 -- 172.21.15.134:0/147709283 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f56c0024030 con 0x563cc8463450 2024-04-24T02:14:12.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.163+0000 7f56ce72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:12.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.163+0000 7f56ce72a800 20 started sync module instance, tier type = 2024-04-24T02:14:12.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.163+0000 7f56ce72a800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:14:12.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.163+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563cc8467120 con 0x7f56c0035c20 2024-04-24T02:14:12.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.164+0000 7f56cac65640 1 -- 172.21.15.134:0/147709283 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(44 notify.0 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56c4040040 con 0x7f56c0035c20 2024-04-24T02:14:12.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.164+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94819058087184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563cc8466d80 con 0x7f56c0035c20 2024-04-24T02:14:12.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.164+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563cc8468d20 con 0x563cc845d200 2024-04-24T02:14:12.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.165+0000 7f56cac65640 1 -- 172.21.15.134:0/147709283 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94819058087184] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56c4040040 con 0x7f56c0035c20 2024-04-24T02:14:12.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.165+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56bc071990 con 0x563cc845d200 2024-04-24T02:14:12.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.165+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94819058090944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563cc8468c90 con 0x563cc845d200 2024-04-24T02:14:12.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.165+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563cc8469760 con 0x563cc8463450 2024-04-24T02:14:12.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.166+0000 7f56c9c63640 1 -- 172.21.15.134:0/147709283 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56c0024030 con 0x563cc8463450 2024-04-24T02:14:12.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.166+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94819058094672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563cc846a030 con 0x563cc8463450 2024-04-24T02:14:12.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.166+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563cc846aad0 con 0x7f56c0035c20 2024-04-24T02:14:12.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.166+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94819058090944] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56bc071990 con 0x563cc845d200 2024-04-24T02:14:12.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.167+0000 7f56c9c63640 1 -- 172.21.15.134:0/147709283 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94819058094672] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56c0024030 con 0x563cc8463450 2024-04-24T02:14:12.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.167+0000 7f56cac65640 1 -- 172.21.15.134:0/147709283 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(50 notify.3 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56c4040040 con 0x7f56c0035c20 2024-04-24T02:14:12.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.167+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94819058097024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563cc84687e0 con 0x7f56c0035c20 2024-04-24T02:14:12.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.167+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563cc846b3b0 con 0x563cc845d200 2024-04-24T02:14:12.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.168+0000 7f56cac65640 1 -- 172.21.15.134:0/147709283 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94819058097024] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56c4040040 con 0x7f56c0035c20 2024-04-24T02:14:12.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.168+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56bc071990 con 0x563cc845d200 2024-04-24T02:14:12.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.168+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94819058099616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563cc846b370 con 0x563cc845d200 2024-04-24T02:14:12.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.168+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563cc846be20 con 0x7f56c4031040 2024-04-24T02:14:12.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.169+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94819058099616] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56bc071990 con 0x563cc845d200 2024-04-24T02:14:12.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.169+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(54 notify.5 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56bc071990 con 0x7f56c4031040 2024-04-24T02:14:12.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.169+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94819058102432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563cc846be20 con 0x7f56c4031040 2024-04-24T02:14:12.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.169+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563cc846c820 con 0x7f56c4031040 2024-04-24T02:14:12.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.170+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94819058102432] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56bc071990 con 0x7f56c4031040 2024-04-24T02:14:12.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.171+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(56 notify.6 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56bc071990 con 0x7f56c4031040 2024-04-24T02:14:12.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.171+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94819058107184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563cc846ca00 con 0x7f56c4031040 2024-04-24T02:14:12.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.171+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563cc846d250 con 0x7f56c4031040 2024-04-24T02:14:12.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.172+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94819058107184] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56bc071990 con 0x7f56c4031040 2024-04-24T02:14:12.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.172+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(58 notify.7 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56bc071990 con 0x7f56c4031040 2024-04-24T02:14:12.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.172+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94819058108928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563cc846d640 con 0x7f56c4031040 2024-04-24T02:14:12.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.172+0000 7f56ce72a800 20 add_watcher() i=0 2024-04-24T02:14:12.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.172+0000 7f56ce72a800 20 add_watcher() i=1 2024-04-24T02:14:12.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.172+0000 7f56ce72a800 20 add_watcher() i=2 2024-04-24T02:14:12.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.172+0000 7f56ce72a800 20 add_watcher() i=3 2024-04-24T02:14:12.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.172+0000 7f56ce72a800 20 add_watcher() i=4 2024-04-24T02:14:12.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.172+0000 7f56ce72a800 20 add_watcher() i=5 2024-04-24T02:14:12.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.172+0000 7f56ce72a800 20 add_watcher() i=6 2024-04-24T02:14:12.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.172+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94819058108928] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56bc071990 con 0x7f56c4031040 2024-04-24T02:14:12.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.172+0000 7f56ce72a800 20 add_watcher() i=7 2024-04-24T02:14:12.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.172+0000 7f56ce72a800 2 all 8 watchers are set, enabling cache 2024-04-24T02:14:12.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.173+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563cc8470670 con 0x563cc845d200 2024-04-24T02:14:12.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.173+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f56bc071990 con 0x563cc845d200 2024-04-24T02:14:12.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.173+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94819058110448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563cc846db50 con 0x563cc845d200 2024-04-24T02:14:12.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.174+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94819058110448] v32'274 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f56bc071990 con 0x563cc845d200 2024-04-24T02:14:12.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.174+0000 7f5580fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:14:12.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.174+0000 7f56ce72a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:14:12.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.174+0000 7f56ce72a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:14:12.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.174+0000 7f56ce72a800 5 note: GC not initialized 2024-04-24T02:14:12.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.174+0000 7f54fb7fe640 20 reqs_thread_entry: start 2024-04-24T02:14:12.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.174+0000 7f56ce72a800 20 init_complete bucket index max shards: 11 2024-04-24T02:14:12.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.175+0000 7f56ce72a800 20 Filter name: none 2024-04-24T02:14:12.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.175+0000 7f54f97fa640 20 reqs_thread_entry: start 2024-04-24T02:14:12.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.175+0000 7f56ce72a800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-24T02:14:12.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.175+0000 7f56ce72a800 20 rados->read ofs=0 len=0 2024-04-24T02:14:12.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.175+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563cc84a39b0 con 0x7f56c4031040 2024-04-24T02:14:12.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.175+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f56bc071990 con 0x7f56c4031040 2024-04-24T02:14:12.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.176+0000 7f56ce72a800 20 rados_obj.operate() r=0 bl.length=490 2024-04-24T02:14:12.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.176+0000 7f56ce72a800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-24T02:14:12.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.176+0000 7f56ce72a800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T02:14:12.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.176+0000 7f56ce72a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:14:12.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.176+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563cc84aa320 con 0x7f56c4031040 2024-04-24T02:14:12.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.177+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v32'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f56bc071990 con 0x7f56c4031040 2024-04-24T02:14:12.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.177+0000 7f56ce72a800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T02:14:12.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.177+0000 7f56ce72a800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T02:14:12.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.177+0000 7f56ce72a800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-24T02:14:12.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.177+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94819058359696 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563cc84a59f0 con 0x563cc845d200 2024-04-24T02:14:12.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.177+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== watch-notify(notify (1) cookie 94819058099616 notify 137438953501 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7f56bc08ce30 con 0x563cc845d200 2024-04-24T02:14:12.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.177+0000 7f55adffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953501 cookie 94819058099616 notifier 4900 bl.length()=636 2024-04-24T02:14:12.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.177+0000 7f55adffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T02:14:12.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.177+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(64 notify.4 [notify cookie 94819058359696 out=8b] v0'0 uv273 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f56bc071990 con 0x563cc845d200 2024-04-24T02:14:12.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.177+0000 7f55adffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T02:14:12.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.177+0000 7f55adffb640 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f5590003ea0 con 0x563cc845d200 2024-04-24T02:14:12.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.177+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56bc071990 con 0x563cc845d200 2024-04-24T02:14:12.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.177+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== watch-notify(notify_complete (2) cookie 94819058359696 notify 137438953501 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563cc8427e50 con 0x563cc845d200 2024-04-24T02:14:12.190 INFO:teuthology.orchestra.run.smithi134.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-24T02:14:10.534163Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T02:14:10.534144Z","tags":[],"group_ids":[]} 2024-04-24T02:14:12.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.178+0000 7f5580fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:14:12.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.178+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94819058110448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563cc8470230 con 0x563cc845d200 2024-04-24T02:14:12.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.179+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94819058110448] v32'275 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f56bc071990 con 0x563cc845d200 2024-04-24T02:14:12.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.179+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94819058087184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563cc846cfc0 con 0x7f56c0035c20 2024-04-24T02:14:12.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.180+0000 7f56cac65640 1 -- 172.21.15.134:0/147709283 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94819058087184] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56c4040040 con 0x7f56c0035c20 2024-04-24T02:14:12.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.180+0000 7f56ce72a800 20 remove_watcher() i=0 2024-04-24T02:14:12.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.180+0000 7f56ce72a800 2 removed watcher, disabling cache 2024-04-24T02:14:12.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.180+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94819058090944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563cc8467510 con 0x563cc845d200 2024-04-24T02:14:12.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.182+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94819058090944] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56bc071990 con 0x563cc845d200 2024-04-24T02:14:12.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.182+0000 7f56ce72a800 20 remove_watcher() i=1 2024-04-24T02:14:12.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.182+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94819058094672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563cc8467510 con 0x563cc8463450 2024-04-24T02:14:12.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.183+0000 7f56c9c63640 1 -- 172.21.15.134:0/147709283 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94819058094672] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56c0024030 con 0x563cc8463450 2024-04-24T02:14:12.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.183+0000 7f56ce72a800 20 remove_watcher() i=2 2024-04-24T02:14:12.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.183+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94819058097024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563cc8469250 con 0x7f56c0035c20 2024-04-24T02:14:12.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.184+0000 7f56cac65640 1 -- 172.21.15.134:0/147709283 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94819058097024] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56c4040040 con 0x7f56c0035c20 2024-04-24T02:14:12.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.184+0000 7f56ce72a800 20 remove_watcher() i=3 2024-04-24T02:14:12.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.184+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94819058099616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563cc8469250 con 0x563cc845d200 2024-04-24T02:14:12.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.185+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94819058099616] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56bc071990 con 0x563cc845d200 2024-04-24T02:14:12.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.185+0000 7f56ce72a800 20 remove_watcher() i=4 2024-04-24T02:14:12.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.185+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94819058102432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563cc846a5a0 con 0x7f56c4031040 2024-04-24T02:14:12.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.186+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94819058102432] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56bc071990 con 0x7f56c4031040 2024-04-24T02:14:12.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.186+0000 7f56ce72a800 20 remove_watcher() i=5 2024-04-24T02:14:12.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.186+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94819058107184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563cc8469250 con 0x7f56c4031040 2024-04-24T02:14:12.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.187+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94819058107184] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56bc071990 con 0x7f56c4031040 2024-04-24T02:14:12.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.187+0000 7f56ce72a800 20 remove_watcher() i=6 2024-04-24T02:14:12.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.187+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94819058108928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563cc846b0a0 con 0x7f56c4031040 2024-04-24T02:14:12.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.188+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94819058108928] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56bc071990 con 0x7f56c4031040 2024-04-24T02:14:12.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.188+0000 7f56ce72a800 20 remove_watcher() i=7 2024-04-24T02:14:12.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.188+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f56c4031040 msgr2=0x7f56c4032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.188+0000 7f56ce72a800 1 --2- 172.21.15.134:0/147709283 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f56c4031040 0x7f56c4032940 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.188+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x563cc845d200 msgr2=0x563cc845f6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.188+0000 7f56ce72a800 1 --2- 172.21.15.134:0/147709283 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x563cc845d200 0x563cc845f6c0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.188+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f56c0035c20 msgr2=0x7f56c00467d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.188+0000 7f56ce72a800 1 --2- 172.21.15.134:0/147709283 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f56c0035c20 0x7f56c00467d0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.188+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x563cc8463450 msgr2=0x563cc8465840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.188+0000 7f56ce72a800 1 --2- 172.21.15.134:0/147709283 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x563cc8463450 0x563cc8465840 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.189+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5594036950 msgr2=0x7f5594038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.189+0000 7f56ce72a800 1 --2- 172.21.15.134:0/147709283 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f5594036950 0x7f5594038e10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x563cc8429130 tx=0x7f56c401f000 comp rx=0 tx=0).stop 2024-04-24T02:14:12.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.189+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563cc844a050 msgr2=0x563cc84516b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.189+0000 7f56ce72a800 1 --2- 172.21.15.134:0/147709283 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563cc844a050 0x563cc84516b0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f56c0026fd0 tx=0x7f56c004be50 comp rx=0 tx=0).stop 2024-04-24T02:14:12.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.189+0000 7f56ca464640 1 -- 172.21.15.134:0/147709283 reap_dead start 2024-04-24T02:14:12.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.189+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 shutdown_connections 2024-04-24T02:14:12.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.189+0000 7f56ce72a800 1 --2- 172.21.15.134:0/147709283 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563cc844a050 0x563cc84516b0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.189+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 >> 172.21.15.134:0/147709283 conn(0x563cc84463b0 msgr2=0x563cc8443a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:12.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.189+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 shutdown_connections 2024-04-24T02:14:12.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.189+0000 7f56ce72a800 1 -- 172.21.15.134:0/147709283 wait complete. 2024-04-24T02:14:12.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.189+0000 7f56ce72a800 1 -- 172.21.15.134:0/77695425 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f55a4036950 msgr2=0x7f55a4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.189+0000 7f56ce72a800 1 --2- 172.21.15.134:0/77695425 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f55a4036950 0x7f55a4038e10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x563cc842cd90 tx=0x7f56c4005840 comp rx=0 tx=0).stop 2024-04-24T02:14:12.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.189+0000 7f56ce72a800 1 -- 172.21.15.134:0/77695425 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563cc843cd50 msgr2=0x563cc843d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.189+0000 7f56ce72a800 1 --2- 172.21.15.134:0/77695425 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563cc843cd50 0x563cc843d190 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f56c000e610 tx=0x7f56c000ff90 comp rx=0 tx=0).stop 2024-04-24T02:14:12.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.189+0000 7f56ce72a800 1 -- 172.21.15.134:0/77695425 shutdown_connections 2024-04-24T02:14:12.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.189+0000 7f56ce72a800 1 --2- 172.21.15.134:0/77695425 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f55a4036950 0x7f55a4038e10 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.189+0000 7f56ce72a800 1 --2- 172.21.15.134:0/77695425 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563cc843cd50 0x563cc843d190 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.189+0000 7f56ce72a800 1 -- 172.21.15.134:0/77695425 >> 172.21.15.134:0/77695425 conn(0x563cc8430da0 msgr2=0x563cc84311a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:12.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.189+0000 7f56ce72a800 1 -- 172.21.15.134:0/77695425 shutdown_connections 2024-04-24T02:14:12.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.189+0000 7f56ce72a800 1 -- 172.21.15.134:0/77695425 wait complete. 2024-04-24T02:14:12.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.189+0000 7f56ce72a800 1 -- 172.21.15.134:0/1082994854 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x563cc832f2e0 msgr2=0x563cc842bc10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.189+0000 7f56ce72a800 1 --2- 172.21.15.134:0/1082994854 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x563cc832f2e0 0x563cc842bc10 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.189+0000 7f56ce72a800 1 -- 172.21.15.134:0/1082994854 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f55b0036950 msgr2=0x7f55b0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.189+0000 7f56ce72a800 1 --2- 172.21.15.134:0/1082994854 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f55b0036950 0x7f55b0038e10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f56c0000c00 tx=0x7f56c00013b0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.189+0000 7f56ce72a800 1 -- 172.21.15.134:0/1082994854 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563cc832c9b0 msgr2=0x563cc84249d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.189+0000 7f56ce72a800 1 --2- 172.21.15.134:0/1082994854 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563cc832c9b0 0x563cc84249d0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f56bc060040 tx=0x7f56bc002fb0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.189+0000 7f56ce72a800 1 -- 172.21.15.134:0/1082994854 shutdown_connections 2024-04-24T02:14:12.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.189+0000 7f56ce72a800 1 --2- 172.21.15.134:0/1082994854 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x563cc832f2e0 0x563cc842bc10 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.189+0000 7f56ce72a800 1 --2- 172.21.15.134:0/1082994854 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f55b0036950 0x7f55b0038e10 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.189+0000 7f56ce72a800 1 --2- 172.21.15.134:0/1082994854 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563cc832c9b0 0x563cc84249d0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.189+0000 7f56ce72a800 1 -- 172.21.15.134:0/1082994854 >> 172.21.15.134:0/1082994854 conn(0x563cc8326340 msgr2=0x563cc8417070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:12.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.190+0000 7f56ce72a800 1 -- 172.21.15.134:0/1082994854 shutdown_connections 2024-04-24T02:14:12.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.190+0000 7f56ce72a800 1 -- 172.21.15.134:0/1082994854 wait complete. 2024-04-24T02:14:12.201 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T02:14:10.534163Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:14:10.534144Z', 'tags': [], 'group_ids': []} 2024-04-24T02:14:12.202 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T02:14:10.534163Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:14:10.534144Z', 'tags': [], 'group_ids': []} 2024-04-24T02:14:12.202 ERROR:root:0 2024-04-24T02:14:12.202 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-24T02:14:12.202 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-24T02:14:12.202 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-04-24T02:14:12.246 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:14:12.247 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:14:12.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.246+0000 7f1b50da2800 1 Processor -- start 2024-04-24T02:14:12.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.246+0000 7f1b50da2800 1 -- start start 2024-04-24T02:14:12.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.246+0000 7f1b50da2800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55597981b7e0 0x5559798a99f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.246+0000 7f1b50da2800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555979765d40 con 0x55597981cb20 2024-04-24T02:14:12.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.246+0000 7f1b50da2800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x5559797384d0 con 0x55597981b7e0 2024-04-24T02:14:12.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.246+0000 7f1b4e0a7640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55597981b7e0 0x5559798a99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.246+0000 7f1b4e8a8640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55597981cb20 0x55597981b0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:46502/0 (socket says 172.21.15.134:46502) 2024-04-24T02:14:12.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.246+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/2597984463 learned_addr learned my addr 172.21.15.134:0/2597984463 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:14:12.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.247+0000 7f1b4e0a7640 1 -- 172.21.15.134:0/2597984463 >> v1:172.21.15.104:6789/0 conn(0x55597981cb20 legacy=0x55597981b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.247+0000 7f1b4e0a7640 1 -- 172.21.15.134:0/2597984463 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555979764590 con 0x55597981b7e0 2024-04-24T02:14:12.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.248+0000 7f1b4e0a7640 1 --2- 172.21.15.134:0/2597984463 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55597981b7e0 0x5559798a99f0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f1b4400a470 tx=0x7f1b4401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c8e4e4853327bdf server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.249+0000 7f1b4d8a6640 1 -- 172.21.15.134:0/2597984463 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b44057070 con 0x55597981b7e0 2024-04-24T02:14:12.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.249+0000 7f1b4d8a6640 1 -- 172.21.15.134:0/2597984463 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b44052440 con 0x55597981b7e0 2024-04-24T02:14:12.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.249+0000 7f1b4d8a6640 1 -- 172.21.15.134:0/2597984463 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b44052740 con 0x55597981b7e0 2024-04-24T02:14:12.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.249+0000 7f1b50da2800 1 -- 172.21.15.134:0/2597984463 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55597981b7e0 msgr2=0x5559798a99f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.249+0000 7f1b50da2800 1 --2- 172.21.15.134:0/2597984463 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55597981b7e0 0x5559798a99f0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f1b4400a470 tx=0x7f1b4401ce90 comp rx=0 tx=0).stop 2024-04-24T02:14:12.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.249+0000 7f1b50da2800 1 -- 172.21.15.134:0/2597984463 shutdown_connections 2024-04-24T02:14:12.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.249+0000 7f1b50da2800 1 --2- 172.21.15.134:0/2597984463 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55597981b7e0 0x5559798a99f0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.249+0000 7f1b50da2800 1 -- 172.21.15.134:0/2597984463 >> 172.21.15.134:0/2597984463 conn(0x5559798a2550 msgr2=0x5559798a4970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:12.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.249+0000 7f1b50da2800 1 -- 172.21.15.134:0/2597984463 shutdown_connections 2024-04-24T02:14:12.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.249+0000 7f1b50da2800 1 -- 172.21.15.134:0/2597984463 wait complete. 2024-04-24T02:14:12.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.261+0000 7f1b50da2800 1 Processor -- start 2024-04-24T02:14:12.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.261+0000 7f1b50da2800 1 -- start start 2024-04-24T02:14:12.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.261+0000 7f1b50da2800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55597981b7e0 0x55597999e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.261+0000 7f1b50da2800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5559797f23b0 con 0x55597981b7e0 2024-04-24T02:14:12.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.261+0000 7f1b4e8a8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55597981b7e0 0x55597999e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.261+0000 7f1b4e8a8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55597981b7e0 0x55597999e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:44238/0 (socket says 172.21.15.134:44238) 2024-04-24T02:14:12.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.261+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/1528138069 learned_addr learned my addr 172.21.15.134:0/1528138069 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:12.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.261+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/1528138069 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55597999ef60 con 0x55597981b7e0 2024-04-24T02:14:12.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.262+0000 7f1b4e8a8640 1 --2- 172.21.15.134:0/1528138069 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55597981b7e0 0x55597999e990 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f1b40001dd0 tx=0x7f1b4000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5984398e89adf11c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.262+0000 7f1a3ce09640 1 -- 172.21.15.134:0/1528138069 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b40012020 con 0x55597981b7e0 2024-04-24T02:14:12.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.262+0000 7f1a3ce09640 1 -- 172.21.15.134:0/1528138069 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b4000e5a0 con 0x55597981b7e0 2024-04-24T02:14:12.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.262+0000 7f1a3ce09640 1 -- 172.21.15.134:0/1528138069 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b4000e900 con 0x55597981b7e0 2024-04-24T02:14:12.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.262+0000 7f1b50da2800 1 -- 172.21.15.134:0/1528138069 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55597981b7e0 msgr2=0x55597999e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.262+0000 7f1b50da2800 1 --2- 172.21.15.134:0/1528138069 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55597981b7e0 0x55597999e990 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f1b40001dd0 tx=0x7f1b4000b6c0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.262+0000 7f1b50da2800 1 -- 172.21.15.134:0/1528138069 shutdown_connections 2024-04-24T02:14:12.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.262+0000 7f1b50da2800 1 --2- 172.21.15.134:0/1528138069 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55597981b7e0 0x55597999e990 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.262+0000 7f1b50da2800 1 -- 172.21.15.134:0/1528138069 >> 172.21.15.134:0/1528138069 conn(0x5559798a2550 msgr2=0x55597999a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:12.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.263+0000 7f1b50da2800 1 -- 172.21.15.134:0/1528138069 shutdown_connections 2024-04-24T02:14:12.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.263+0000 7f1b50da2800 1 -- 172.21.15.134:0/1528138069 wait complete. 2024-04-24T02:14:12.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.263+0000 7f1b50da2800 1 Processor -- start 2024-04-24T02:14:12.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.263+0000 7f1b50da2800 1 -- start start 2024-04-24T02:14:12.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.263+0000 7f1b50da2800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55597981b7e0 0x5559799a6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.263+0000 7f1b50da2800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5559798aa230 con 0x55597981b7e0 2024-04-24T02:14:12.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.263+0000 7f1b4e8a8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55597981b7e0 0x5559799a6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.263+0000 7f1b4e8a8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55597981b7e0 0x5559799a6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:44244/0 (socket says 172.21.15.134:44244) 2024-04-24T02:14:12.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.263+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/1446507133 learned_addr learned my addr 172.21.15.134:0/1446507133 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:12.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.264+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/1446507133 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559799a6a40 con 0x55597981b7e0 2024-04-24T02:14:12.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.264+0000 7f1b4e8a8640 1 --2- 172.21.15.134:0/1446507133 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55597981b7e0 0x5559799a6500 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f1b40001dd0 tx=0x7f1b40000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.264+0000 7f1a3b606640 1 -- 172.21.15.134:0/1446507133 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b40012030 con 0x55597981b7e0 2024-04-24T02:14:12.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.264+0000 7f1a3b606640 1 -- 172.21.15.134:0/1446507133 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b4001a720 con 0x55597981b7e0 2024-04-24T02:14:12.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.264+0000 7f1b50da2800 1 -- 172.21.15.134:0/1446507133 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5559799a6cd0 con 0x55597981b7e0 2024-04-24T02:14:12.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.264+0000 7f1a3b606640 1 -- 172.21.15.134:0/1446507133 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b4001aa40 con 0x55597981b7e0 2024-04-24T02:14:12.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.264+0000 7f1b50da2800 1 -- 172.21.15.134:0/1446507133 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559799a9980 con 0x55597981b7e0 2024-04-24T02:14:12.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.265+0000 7f1a3b606640 1 -- 172.21.15.134:0/1446507133 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1b40015020 con 0x55597981b7e0 2024-04-24T02:14:12.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.265+0000 7f1a3b606640 1 --2- 172.21.15.134:0/1446507133 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1a34036950 0x7f1a34038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.265+0000 7f1a3b606640 1 -- 172.21.15.134:0/1446507133 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f1b40020030 con 0x55597981b7e0 2024-04-24T02:14:12.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.265+0000 7f1b4e0a7640 1 --2- 172.21.15.134:0/1446507133 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1a34036950 0x7f1a34038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.265+0000 7f1b50da2800 1 --2- 172.21.15.134:0/1446507133 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55597981cb20 0x5559799ad740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.265+0000 7f1b50da2800 1 -- 172.21.15.134:0/1446507133 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559799adc80 con 0x55597981cb20 2024-04-24T02:14:12.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.265+0000 7f1b4f0a9640 1 --2- 172.21.15.134:0/1446507133 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55597981cb20 0x5559799ad740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.265+0000 7f1b4e0a7640 1 --2- 172.21.15.134:0/1446507133 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1a34036950 0x7f1a34038e10 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f1b44054000 tx=0x7f1b4404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.266+0000 7f1b4f0a9640 1 --2- 172.21.15.134:0/1446507133 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55597981cb20 0x5559799ad740 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.266+0000 7f1b4f0a9640 1 -- 172.21.15.134:0/1446507133 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1b4800a4a0 con 0x55597981cb20 2024-04-24T02:14:12.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.266+0000 7f1b50da2800 1 -- 172.21.15.134:0/1446507133 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559799aacf0 con 0x55597981cb20 2024-04-24T02:14:12.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.266+0000 7f1b4f0a9640 1 -- 172.21.15.134:0/1446507133 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1b4800a4a0 con 0x55597981cb20 2024-04-24T02:14:12.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.266+0000 7f1b50da2800 1 -- 172.21.15.134:0/1446507133 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559799afa90 con 0x55597981cb20 2024-04-24T02:14:12.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.266+0000 7f1b4f0a9640 1 -- 172.21.15.134:0/1446507133 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1b4800a4a0 con 0x55597981cb20 2024-04-24T02:14:12.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.266+0000 7f1b50da2800 1 -- 172.21.15.134:0/1446507133 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559799aedd0 con 0x55597981cb20 2024-04-24T02:14:12.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.267+0000 7f1b4f0a9640 1 -- 172.21.15.134:0/1446507133 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1b4800a4a0 con 0x55597981cb20 2024-04-24T02:14:12.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.267+0000 7f1b50da2800 1 -- 172.21.15.134:0/1446507133 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559799af220 con 0x55597981cb20 2024-04-24T02:14:12.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.267+0000 7f1b4f0a9640 1 -- 172.21.15.134:0/1446507133 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1b4800a4a0 con 0x55597981cb20 2024-04-24T02:14:12.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.267+0000 7f1b50da2800 1 Processor -- start 2024-04-24T02:14:12.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.267+0000 7f1b50da2800 1 -- start start 2024-04-24T02:14:12.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.267+0000 7f1b50da2800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5559799be880 0x5559799beca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.267+0000 7f1b50da2800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5559797986b0 con 0x5559799be880 2024-04-24T02:14:12.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.268+0000 7f1b4e0a7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5559799be880 0x5559799beca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.268+0000 7f1b4e0a7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5559799be880 0x5559799beca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:44246/0 (socket says 172.21.15.134:44246) 2024-04-24T02:14:12.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.268+0000 7f1b4e0a7640 1 -- 172.21.15.134:0/1667882127 learned_addr learned my addr 172.21.15.134:0/1667882127 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:12.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.268+0000 7f1b4e0a7640 1 -- 172.21.15.134:0/1667882127 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559799bf1e0 con 0x5559799be880 2024-04-24T02:14:12.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.268+0000 7f1b4e0a7640 1 --2- 172.21.15.134:0/1667882127 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5559799be880 0x5559799beca0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f1b44044840 tx=0x7f1b44002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.268+0000 7f1a38e01640 1 -- 172.21.15.134:0/1667882127 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b4406f070 con 0x5559799be880 2024-04-24T02:14:12.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.268+0000 7f1a38e01640 1 -- 172.21.15.134:0/1667882127 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b44058040 con 0x5559799be880 2024-04-24T02:14:12.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.268+0000 7f1b50da2800 1 -- 172.21.15.134:0/1667882127 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5559799bfc50 con 0x5559799be880 2024-04-24T02:14:12.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.268+0000 7f1a38e01640 1 -- 172.21.15.134:0/1667882127 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b44057050 con 0x5559799be880 2024-04-24T02:14:12.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.268+0000 7f1b50da2800 1 -- 172.21.15.134:0/1667882127 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559799c00f0 con 0x5559799be880 2024-04-24T02:14:12.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.269+0000 7f1a38e01640 1 -- 172.21.15.134:0/1667882127 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1b44072070 con 0x5559799be880 2024-04-24T02:14:12.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.269+0000 7f1a38e01640 1 --2- 172.21.15.134:0/1667882127 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1a28036950 0x7f1a28038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.269+0000 7f1a38e01640 1 -- 172.21.15.134:0/1667882127 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f1b4408f750 con 0x5559799be880 2024-04-24T02:14:12.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.269+0000 7f1b4f0a9640 1 --2- 172.21.15.134:0/1667882127 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1a28036950 0x7f1a28038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.269+0000 7f1b50da2800 1 Processor -- start 2024-04-24T02:14:12.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.269+0000 7f1b50da2800 1 -- start start 2024-04-24T02:14:12.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.269+0000 7f1b4f0a9640 1 --2- 172.21.15.134:0/1667882127 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1a28036950 0x7f1a28038e10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x5559799ae8f0 tx=0x7f1b48005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.270+0000 7f1b50da2800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5559799cbac0 0x5559799cbee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.270+0000 7f1b50da2800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55597999f2e0 con 0x5559799cbac0 2024-04-24T02:14:12.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.270+0000 7f1b4e0a7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5559799cbac0 0x5559799cbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.270+0000 7f1b4e0a7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5559799cbac0 0x5559799cbee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:44252/0 (socket says 172.21.15.134:44252) 2024-04-24T02:14:12.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.270+0000 7f1b4e0a7640 1 -- 172.21.15.134:0/905251113 learned_addr learned my addr 172.21.15.134:0/905251113 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:12.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.270+0000 7f1b4e0a7640 1 -- 172.21.15.134:0/905251113 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559799cc4b0 con 0x5559799cbac0 2024-04-24T02:14:12.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.270+0000 7f1b4e0a7640 1 --2- 172.21.15.134:0/905251113 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5559799cbac0 0x5559799cbee0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f1b4408dbf0 tx=0x7f1b44069c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac4ce2b2a63d9d06 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.270+0000 7f1a327fc640 1 -- 172.21.15.134:0/905251113 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b44084070 con 0x5559799cbac0 2024-04-24T02:14:12.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.270+0000 7f1a327fc640 1 -- 172.21.15.134:0/905251113 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b4405eb20 con 0x5559799cbac0 2024-04-24T02:14:12.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.270+0000 7f1a327fc640 1 -- 172.21.15.134:0/905251113 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b4405d510 con 0x5559799cbac0 2024-04-24T02:14:12.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.271+0000 7f1b50da2800 1 -- 172.21.15.134:0/905251113 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5559799cbac0 msgr2=0x5559799cbee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.271+0000 7f1b50da2800 1 --2- 172.21.15.134:0/905251113 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5559799cbac0 0x5559799cbee0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f1b4408dbf0 tx=0x7f1b44069c00 comp rx=0 tx=0).stop 2024-04-24T02:14:12.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.271+0000 7f1b50da2800 1 -- 172.21.15.134:0/905251113 shutdown_connections 2024-04-24T02:14:12.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.271+0000 7f1b50da2800 1 --2- 172.21.15.134:0/905251113 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5559799cbac0 0x5559799cbee0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.271+0000 7f1b50da2800 1 -- 172.21.15.134:0/905251113 >> 172.21.15.134:0/905251113 conn(0x5559799c7e20 msgr2=0x5559799c5e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:12.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.271+0000 7f1b50da2800 1 -- 172.21.15.134:0/905251113 shutdown_connections 2024-04-24T02:14:12.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.271+0000 7f1b50da2800 1 -- 172.21.15.134:0/905251113 wait complete. 2024-04-24T02:14:12.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.271+0000 7f1b50da2800 1 Processor -- start 2024-04-24T02:14:12.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.271+0000 7f1b50da2800 1 -- start start 2024-04-24T02:14:12.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.271+0000 7f1b50da2800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5559799cbac0 0x5559799d3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.271+0000 7f1b50da2800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5559799ccc20 con 0x5559799cbac0 2024-04-24T02:14:12.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.271+0000 7f1b4e0a7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5559799cbac0 0x5559799d3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.271+0000 7f1b4e0a7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5559799cbac0 0x5559799d3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:44260/0 (socket says 172.21.15.134:44260) 2024-04-24T02:14:12.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.271+0000 7f1b4e0a7640 1 -- 172.21.15.134:0/226193457 learned_addr learned my addr 172.21.15.134:0/226193457 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:12.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.272+0000 7f1b4e0a7640 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559799d3660 con 0x5559799cbac0 2024-04-24T02:14:12.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.272+0000 7f1b4e0a7640 1 --2- 172.21.15.134:0/226193457 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5559799cbac0 0x5559799d3120 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f1b4401ced0 tx=0x7f1b4408db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.272+0000 7f1a30ff9640 1 -- 172.21.15.134:0/226193457 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b44093020 con 0x5559799cbac0 2024-04-24T02:14:12.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.272+0000 7f1a30ff9640 1 -- 172.21.15.134:0/226193457 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b44085040 con 0x5559799cbac0 2024-04-24T02:14:12.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.272+0000 7f1a30ff9640 1 -- 172.21.15.134:0/226193457 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b44084070 con 0x5559799cbac0 2024-04-24T02:14:12.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.272+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5559799d38f0 con 0x5559799cbac0 2024-04-24T02:14:12.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.272+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559799d65a0 con 0x5559799cbac0 2024-04-24T02:14:12.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.273+0000 7f1a30ff9640 1 -- 172.21.15.134:0/226193457 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1b44096020 con 0x5559799cbac0 2024-04-24T02:14:12.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.273+0000 7f1a30ff9640 1 --2- 172.21.15.134:0/226193457 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1a18036950 0x7f1a18038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.273+0000 7f1a30ff9640 1 -- 172.21.15.134:0/226193457 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f1b44099bb0 con 0x5559799cbac0 2024-04-24T02:14:12.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.273+0000 7f1b4f0a9640 1 --2- 172.21.15.134:0/226193457 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1a18036950 0x7f1a18038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.273+0000 7f1b4f0a9640 1 --2- 172.21.15.134:0/226193457 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1a18036950 0x7f1a18038e10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x5559799aac60 tx=0x7f1b4801f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.273+0000 7f1b50da2800 20 rados->read ofs=0 len=0 2024-04-24T02:14:12.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.273+0000 7f1b50da2800 1 --2- 172.21.15.134:0/226193457 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5559799dec30 0x5559799e10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.273+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559799e1840 con 0x5559799dec30 2024-04-24T02:14:12.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.273+0000 7f1b4e8a8640 1 --2- 172.21.15.134:0/226193457 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5559799dec30 0x5559799e10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.274+0000 7f1b4e8a8640 1 --2- 172.21.15.134:0/226193457 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5559799dec30 0x5559799e10f0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.274+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1b40018950 con 0x5559799dec30 2024-04-24T02:14:12.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.274+0000 7f1b50da2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:12.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.274+0000 7f1b50da2800 20 realm 2024-04-24T02:14:12.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.274+0000 7f1b50da2800 20 rados->read ofs=0 len=0 2024-04-24T02:14:12.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.274+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559799e1c50 con 0x5559799dec30 2024-04-24T02:14:12.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.274+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1b40018950 con 0x5559799dec30 2024-04-24T02:14:12.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.274+0000 7f1b50da2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:12.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.274+0000 7f1b50da2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:14:12.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.274+0000 7f1b50da2800 20 rados->read ofs=0 len=0 2024-04-24T02:14:12.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.274+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559799e2520 con 0x5559799dec30 2024-04-24T02:14:12.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.274+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1b40018950 con 0x5559799dec30 2024-04-24T02:14:12.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.274+0000 7f1b50da2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:12.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.274+0000 7f1b50da2800 20 rados->read ofs=0 len=0 2024-04-24T02:14:12.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.274+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559799e28c0 con 0x5559799dec30 2024-04-24T02:14:12.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.275+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1b40018950 con 0x5559799dec30 2024-04-24T02:14:12.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.275+0000 7f1b50da2800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:14:12.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.275+0000 7f1b50da2800 20 rados->read ofs=0 len=0 2024-04-24T02:14:12.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.275+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559799e3110 con 0x5559799dec30 2024-04-24T02:14:12.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.275+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1b40018950 con 0x5559799dec30 2024-04-24T02:14:12.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.275+0000 7f1b50da2800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:14:12.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.275+0000 7f1b50da2800 20 searching for the correct realm 2024-04-24T02:14:12.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.275+0000 7f1b50da2800 1 --2- 172.21.15.134:0/226193457 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5559799e4e80 0x5559799e7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.275+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559799e7850 con 0x5559799e4e80 2024-04-24T02:14:12.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.275+0000 7f1b4e0a7640 1 --2- 172.21.15.134:0/226193457 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5559799e4e80 0x5559799e7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.275+0000 7f1b4e0a7640 1 --2- 172.21.15.134:0/226193457 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5559799e4e80 0x5559799e7270 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.275+0000 7f1b4e0a7640 1 -- 172.21.15.134:0/226193457 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b44071030 con 0x5559799e4e80 2024-04-24T02:14:12.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.275+0000 7f1b4e0a7640 1 --2- 172.21.15.134:0/226193457 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f1b44098020 0x7f1b4406a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.276+0000 7f1b4e0a7640 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559799e7850 con 0x7f1b44098020 2024-04-24T02:14:12.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.276+0000 7f1b4f0a9640 1 --2- 172.21.15.134:0/226193457 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f1b44098020 0x7f1b4406a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.276+0000 7f1b4f0a9640 1 --2- 172.21.15.134:0/226193457 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f1b44098020 0x7f1b4406a820 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.276+0000 7f1b4f0a9640 1 -- 172.21.15.134:0/226193457 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b4801f070 con 0x7f1b44098020 2024-04-24T02:14:12.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.276+0000 7f1b4f0a9640 1 --2- 172.21.15.134:0/226193457 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f1b48031040 0x7f1b48032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.276+0000 7f1b4f0a9640 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559799e7850 con 0x7f1b48031040 2024-04-24T02:14:12.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.276+0000 7f1b4e8a8640 1 --2- 172.21.15.134:0/226193457 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f1b48031040 0x7f1b48032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.277+0000 7f1b4e8a8640 1 --2- 172.21.15.134:0/226193457 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f1b48031040 0x7f1b48032430 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.277+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b40018950 con 0x7f1b48031040 2024-04-24T02:14:12.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.277+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559799e7850 con 0x5559799dec30 2024-04-24T02:14:12.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.277+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b40018950 con 0x5559799dec30 2024-04-24T02:14:12.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.277+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559799e7850 con 0x5559799dec30 2024-04-24T02:14:12.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.277+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1b40018950 con 0x5559799dec30 2024-04-24T02:14:12.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.277+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559799e7850 con 0x7f1b48031040 2024-04-24T02:14:12.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.278+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b40018950 con 0x7f1b48031040 2024-04-24T02:14:12.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.278+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559799e7850 con 0x7f1b44098020 2024-04-24T02:14:12.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.278+0000 7f1b4f0a9640 1 -- 172.21.15.134:0/226193457 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b4801f070 con 0x7f1b44098020 2024-04-24T02:14:12.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.278+0000 7f1b4f0a9640 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559799e7850 con 0x7f1b44098020 2024-04-24T02:14:12.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.278+0000 7f1b4f0a9640 1 -- 172.21.15.134:0/226193457 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b4801f070 con 0x7f1b44098020 2024-04-24T02:14:12.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.278+0000 7f1b4f0a9640 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559799e7850 con 0x5559799e4e80 2024-04-24T02:14:12.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.278+0000 7f1b4e0a7640 1 -- 172.21.15.134:0/226193457 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b44071030 con 0x5559799e4e80 2024-04-24T02:14:12.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.278+0000 7f1b4e0a7640 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559799e7850 con 0x5559799dec30 2024-04-24T02:14:12.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.278+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b40018950 con 0x5559799dec30 2024-04-24T02:14:12.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.278+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559799e7850 con 0x7f1b48031040 2024-04-24T02:14:12.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.279+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b40018950 con 0x7f1b48031040 2024-04-24T02:14:12.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.279+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559799e7850 con 0x5559799dec30 2024-04-24T02:14:12.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.279+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b40018950 con 0x5559799dec30 2024-04-24T02:14:12.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.279+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559799e7850 con 0x7f1b44098020 2024-04-24T02:14:12.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.279+0000 7f1b4f0a9640 1 -- 172.21.15.134:0/226193457 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1b4801f070 con 0x7f1b44098020 2024-04-24T02:14:12.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.279+0000 7f1b4f0a9640 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559799e7850 con 0x5559799e4e80 2024-04-24T02:14:12.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.279+0000 7f1b4e0a7640 1 -- 172.21.15.134:0/226193457 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b44071030 con 0x5559799e4e80 2024-04-24T02:14:12.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.279+0000 7f1b4e0a7640 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559799e7850 con 0x5559799e4e80 2024-04-24T02:14:12.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.280+0000 7f1b4e0a7640 1 -- 172.21.15.134:0/226193457 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b44071030 con 0x5559799e4e80 2024-04-24T02:14:12.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.280+0000 7f1b4e0a7640 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559799e7850 con 0x7f1b44098020 2024-04-24T02:14:12.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.280+0000 7f1b4f0a9640 1 -- 172.21.15.134:0/226193457 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b4801f070 con 0x7f1b44098020 2024-04-24T02:14:12.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.280+0000 7f1b4f0a9640 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559799e7850 con 0x5559799e4e80 2024-04-24T02:14:12.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.280+0000 7f1b4e0a7640 1 -- 172.21.15.134:0/226193457 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b44071030 con 0x5559799e4e80 2024-04-24T02:14:12.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.280+0000 7f1b4e0a7640 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559799e7850 con 0x5559799e4e80 2024-04-24T02:14:12.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.280+0000 7f1b4e0a7640 1 -- 172.21.15.134:0/226193457 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b44071030 con 0x5559799e4e80 2024-04-24T02:14:12.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.280+0000 7f1b4e0a7640 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559799e7850 con 0x5559799dec30 2024-04-24T02:14:12.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.280+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b40018950 con 0x5559799dec30 2024-04-24T02:14:12.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.280+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559799e7850 con 0x5559799dec30 2024-04-24T02:14:12.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.281+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=132b] v32'6 uv6 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f1b40018950 con 0x5559799dec30 2024-04-24T02:14:12.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.281+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559799e7850 con 0x7f1b48031040 2024-04-24T02:14:12.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.281+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b40018950 con 0x7f1b48031040 2024-04-24T02:14:12.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.281+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559799e7850 con 0x5559799e4e80 2024-04-24T02:14:12.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.281+0000 7f1b4e0a7640 1 -- 172.21.15.134:0/226193457 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b44071030 con 0x5559799e4e80 2024-04-24T02:14:12.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.281+0000 7f1b4e0a7640 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559799e7850 con 0x7f1b44098020 2024-04-24T02:14:12.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.281+0000 7f1b4f0a9640 1 -- 172.21.15.134:0/226193457 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b4801f070 con 0x7f1b44098020 2024-04-24T02:14:12.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.281+0000 7f1b4f0a9640 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559799e7850 con 0x5559799dec30 2024-04-24T02:14:12.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.282+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b40018950 con 0x5559799dec30 2024-04-24T02:14:12.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.282+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559799e7850 con 0x7f1b48031040 2024-04-24T02:14:12.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.282+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b40018950 con 0x7f1b48031040 2024-04-24T02:14:12.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.282+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559799e7850 con 0x5559799e4e80 2024-04-24T02:14:12.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.282+0000 7f1b4e0a7640 1 -- 172.21.15.134:0/226193457 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b44071030 con 0x5559799e4e80 2024-04-24T02:14:12.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.282+0000 7f1b4e0a7640 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559799e7850 con 0x7f1b48031040 2024-04-24T02:14:12.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.283+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b40018950 con 0x7f1b48031040 2024-04-24T02:14:12.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.283+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559799e7850 con 0x7f1b44098020 2024-04-24T02:14:12.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.283+0000 7f1b4f0a9640 1 -- 172.21.15.134:0/226193457 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b48040040 con 0x7f1b44098020 2024-04-24T02:14:12.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.283+0000 7f1b4f0a9640 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559799e7850 con 0x5559799e4e80 2024-04-24T02:14:12.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.283+0000 7f1b4e0a7640 1 -- 172.21.15.134:0/226193457 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b44071030 con 0x5559799e4e80 2024-04-24T02:14:12.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.283+0000 7f1b4e0a7640 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559799e7850 con 0x7f1b44098020 2024-04-24T02:14:12.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.283+0000 7f1b4f0a9640 1 -- 172.21.15.134:0/226193457 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b48040040 con 0x7f1b44098020 2024-04-24T02:14:12.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.283+0000 7f1b4f0a9640 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559799e7850 con 0x5559799dec30 2024-04-24T02:14:12.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.284+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1b40018950 con 0x5559799dec30 2024-04-24T02:14:12.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.284+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559799e7850 con 0x7f1b44098020 2024-04-24T02:14:12.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.284+0000 7f1b4f0a9640 1 -- 172.21.15.134:0/226193457 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b48040040 con 0x7f1b44098020 2024-04-24T02:14:12.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.284+0000 7f1b50da2800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:14:12.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.284+0000 7f1b50da2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:14:12.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.284+0000 7f1b50da2800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:14:12.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.284+0000 7f1b50da2800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:14:12.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.284+0000 7f1b50da2800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:14:12.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.284+0000 7f1b50da2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:14:12.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.284+0000 7f1b50da2800 20 rados->read ofs=0 len=0 2024-04-24T02:14:12.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.284+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559799e3a90 con 0x5559799dec30 2024-04-24T02:14:12.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.284+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1b40018950 con 0x5559799dec30 2024-04-24T02:14:12.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.284+0000 7f1b50da2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:12.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.284+0000 7f1b50da2800 20 rados->read ofs=0 len=0 2024-04-24T02:14:12.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.284+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559799e4330 con 0x5559799dec30 2024-04-24T02:14:12.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.284+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1b40018950 con 0x5559799dec30 2024-04-24T02:14:12.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.284+0000 7f1b50da2800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:14:12.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.284+0000 7f1b50da2800 20 rados->read ofs=0 len=0 2024-04-24T02:14:12.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.284+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559799e7cd0 con 0x5559799dec30 2024-04-24T02:14:12.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.284+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1b40018950 con 0x5559799dec30 2024-04-24T02:14:12.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.285+0000 7f1b50da2800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:14:12.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.285+0000 7f1b50da2800 20 zone default found 2024-04-24T02:14:12.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.285+0000 7f1b50da2800 4 Realm: () 2024-04-24T02:14:12.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.285+0000 7f1b50da2800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:14:12.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.285+0000 7f1b50da2800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:14:12.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.285+0000 7f1b50da2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:14:12.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.285+0000 7f1b50da2800 20 zonegroup default 2024-04-24T02:14:12.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.285+0000 7f1b50da2800 20 rados->read ofs=0 len=0 2024-04-24T02:14:12.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.285+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559799e3f90 con 0x7f1b48031040 2024-04-24T02:14:12.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.285+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1b40018950 con 0x7f1b48031040 2024-04-24T02:14:12.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.285+0000 7f1b50da2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:12.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.285+0000 7f1b50da2800 20 rados->read ofs=0 len=0 2024-04-24T02:14:12.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.285+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559799e9be0 con 0x5559799e4e80 2024-04-24T02:14:12.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.285+0000 7f1b4e0a7640 1 -- 172.21.15.134:0/226193457 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1b44071030 con 0x5559799e4e80 2024-04-24T02:14:12.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.285+0000 7f1b50da2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:12.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.285+0000 7f1b50da2800 20 rados->read ofs=0 len=0 2024-04-24T02:14:12.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.285+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559799ea040 con 0x5559799e4e80 2024-04-24T02:14:12.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.286+0000 7f1b4e0a7640 1 -- 172.21.15.134:0/226193457 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1b44071030 con 0x5559799e4e80 2024-04-24T02:14:12.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.286+0000 7f1b50da2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:12.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.286+0000 7f1b50da2800 20 started sync module instance, tier type = 2024-04-24T02:14:12.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.286+0000 7f1b50da2800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:14:12.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.286+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559799e9080 con 0x7f1b44098020 2024-04-24T02:14:12.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.287+0000 7f1b4f0a9640 1 -- 172.21.15.134:0/226193457 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(44 notify.0 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b48040040 con 0x7f1b44098020 2024-04-24T02:14:12.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.287+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93842780886128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559799ea950 con 0x7f1b44098020 2024-04-24T02:14:12.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.287+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559799eb1a0 con 0x5559799dec30 2024-04-24T02:14:12.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.288+0000 7f1b4f0a9640 1 -- 172.21.15.134:0/226193457 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93842780886128] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b48040040 con 0x7f1b44098020 2024-04-24T02:14:12.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.288+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b40018950 con 0x5559799dec30 2024-04-24T02:14:12.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.288+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93842780890272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559799eadd0 con 0x5559799dec30 2024-04-24T02:14:12.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.288+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559799eb8e0 con 0x5559799e4e80 2024-04-24T02:14:12.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.289+0000 7f1b4e0a7640 1 -- 172.21.15.134:0/226193457 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b44071030 con 0x5559799e4e80 2024-04-24T02:14:12.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.289+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93842780894096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559799ec180 con 0x5559799e4e80 2024-04-24T02:14:12.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.289+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559799ecc40 con 0x7f1b44098020 2024-04-24T02:14:12.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.290+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93842780890272] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b40018950 con 0x5559799dec30 2024-04-24T02:14:12.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.290+0000 7f1b4e0a7640 1 -- 172.21.15.134:0/226193457 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93842780894096] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b44071030 con 0x5559799e4e80 2024-04-24T02:14:12.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.291+0000 7f1b4f0a9640 1 -- 172.21.15.134:0/226193457 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(50 notify.3 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b48040040 con 0x7f1b44098020 2024-04-24T02:14:12.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.291+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93842780896464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559799ea8c0 con 0x7f1b44098020 2024-04-24T02:14:12.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.291+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559799ed520 con 0x5559799dec30 2024-04-24T02:14:12.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.292+0000 7f1b4f0a9640 1 -- 172.21.15.134:0/226193457 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93842780896464] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b48040040 con 0x7f1b44098020 2024-04-24T02:14:12.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.292+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b40018950 con 0x5559799dec30 2024-04-24T02:14:12.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.292+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93842780899088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559799ed4e0 con 0x5559799dec30 2024-04-24T02:14:12.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.292+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559799edf30 con 0x7f1b48031040 2024-04-24T02:14:12.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.293+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93842780899088] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b40018950 con 0x5559799dec30 2024-04-24T02:14:12.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.293+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(54 notify.5 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b40018950 con 0x7f1b48031040 2024-04-24T02:14:12.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.293+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93842780901904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559799edf30 con 0x7f1b48031040 2024-04-24T02:14:12.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.293+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559799ee8f0 con 0x7f1b48031040 2024-04-24T02:14:12.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.294+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 93842780901904] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b40018950 con 0x7f1b48031040 2024-04-24T02:14:12.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.294+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(56 notify.6 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b40018950 con 0x7f1b48031040 2024-04-24T02:14:12.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.294+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93842780904064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559799eead0 con 0x7f1b48031040 2024-04-24T02:14:12.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.294+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559799eead0 con 0x7f1b48031040 2024-04-24T02:14:12.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.295+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 93842780904064] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b40018950 con 0x7f1b48031040 2024-04-24T02:14:12.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.295+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(58 notify.7 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b40018950 con 0x7f1b48031040 2024-04-24T02:14:12.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.295+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93842780907520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559799ef170 con 0x7f1b48031040 2024-04-24T02:14:12.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.295+0000 7f1b50da2800 20 add_watcher() i=0 2024-04-24T02:14:12.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.295+0000 7f1b50da2800 20 add_watcher() i=1 2024-04-24T02:14:12.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.295+0000 7f1b50da2800 20 add_watcher() i=2 2024-04-24T02:14:12.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.295+0000 7f1b50da2800 20 add_watcher() i=3 2024-04-24T02:14:12.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.295+0000 7f1b50da2800 20 add_watcher() i=4 2024-04-24T02:14:12.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.295+0000 7f1b50da2800 20 add_watcher() i=5 2024-04-24T02:14:12.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.295+0000 7f1b50da2800 20 add_watcher() i=6 2024-04-24T02:14:12.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.296+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 93842780907520] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b40018950 con 0x7f1b48031040 2024-04-24T02:14:12.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.296+0000 7f1b50da2800 20 add_watcher() i=7 2024-04-24T02:14:12.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.296+0000 7f1b50da2800 2 all 8 watchers are set, enabling cache 2024-04-24T02:14:12.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.296+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559799f26e0 con 0x5559799dec30 2024-04-24T02:14:12.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.296+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1b40018950 con 0x5559799dec30 2024-04-24T02:14:12.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.296+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93842780908576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559799efbd0 con 0x5559799dec30 2024-04-24T02:14:12.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.297+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93842780908576] v32'276 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1b40018950 con 0x5559799dec30 2024-04-24T02:14:12.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.298+0000 7f1a057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:14:12.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.298+0000 7f1b50da2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:14:12.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.298+0000 7f1b50da2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:14:12.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.298+0000 7f1b50da2800 5 note: GC not initialized 2024-04-24T02:14:12.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.298+0000 7f197ffff640 20 reqs_thread_entry: start 2024-04-24T02:14:12.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.298+0000 7f1b50da2800 20 init_complete bucket index max shards: 11 2024-04-24T02:14:12.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.298+0000 7f1b50da2800 20 Filter name: none 2024-04-24T02:14:12.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.298+0000 7f197dffb640 20 reqs_thread_entry: start 2024-04-24T02:14:12.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.298+0000 7f1b50da2800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-24T02:14:12.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.298+0000 7f1b50da2800 20 rados->read ofs=0 len=0 2024-04-24T02:14:12.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.298+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555979a25a90 con 0x7f1b48031040 2024-04-24T02:14:12.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.302+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f1b40018950 con 0x7f1b48031040 2024-04-24T02:14:12.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.302+0000 7f1b50da2800 20 rados_obj.operate() r=0 bl.length=460 2024-04-24T02:14:12.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.302+0000 7f1b50da2800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-24T02:14:12.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.302+0000 7f1b50da2800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T02:14:12.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.302+0000 7f1b50da2800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:14:12.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.302+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555979a2c050 con 0x7f1b48031040 2024-04-24T02:14:12.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.304+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v32'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f1b40018950 con 0x7f1b48031040 2024-04-24T02:14:12.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.304+0000 7f1b50da2800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T02:14:12.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.304+0000 7f1b50da2800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T02:14:12.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.304+0000 7f1b50da2800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-24T02:14:12.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.304+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93842781158080 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555979a27780 con 0x5559799dec30 2024-04-24T02:14:12.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.304+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== watch-notify(notify (1) cookie 93842780899088 notify 137438953502 ret 0) ==== 691+0+0 (crc 0 0 0) 0x5559799a9980 con 0x5559799dec30 2024-04-24T02:14:12.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.304+0000 7f1a327fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953502 cookie 93842780899088 notifier 4907 bl.length()=649 2024-04-24T02:14:12.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.304+0000 7f1a327fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T02:14:12.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.304+0000 7f1a327fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T02:14:12.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.304+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(64 notify.4 [notify cookie 93842781158080 out=8b] v0'0 uv276 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1b40018950 con 0x5559799dec30 2024-04-24T02:14:12.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.304+0000 7f1a327fc640 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f1a14003ea0 con 0x5559799dec30 2024-04-24T02:14:12.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.304+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b40018950 con 0x5559799dec30 2024-04-24T02:14:12.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.304+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== watch-notify(notify_complete (2) cookie 93842781158080 notify 137438953502 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5559799a6cd0 con 0x5559799dec30 2024-04-24T02:14:12.317 INFO:teuthology.orchestra.run.smithi134.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-24T02:14:10.534163Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T02:14:10.534144Z","tags":[],"group_ids":[]} 2024-04-24T02:14:12.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.305+0000 7f1a057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:14:12.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.305+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93842780908576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555979a27f40 con 0x5559799dec30 2024-04-24T02:14:12.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.306+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93842780908576] v32'277 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1b40018950 con 0x5559799dec30 2024-04-24T02:14:12.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.306+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93842780886128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555979a27f40 con 0x7f1b44098020 2024-04-24T02:14:12.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.307+0000 7f1b4f0a9640 1 -- 172.21.15.134:0/226193457 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93842780886128] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b48040040 con 0x7f1b44098020 2024-04-24T02:14:12.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.307+0000 7f1b50da2800 20 remove_watcher() i=0 2024-04-24T02:14:12.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.307+0000 7f1b50da2800 2 removed watcher, disabling cache 2024-04-24T02:14:12.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.307+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93842780890272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555979a27f40 con 0x5559799dec30 2024-04-24T02:14:12.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.309+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93842780890272] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b40018950 con 0x5559799dec30 2024-04-24T02:14:12.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.309+0000 7f1b50da2800 20 remove_watcher() i=1 2024-04-24T02:14:12.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.309+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93842780894096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555979a27f40 con 0x5559799e4e80 2024-04-24T02:14:12.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.310+0000 7f1b4e0a7640 1 -- 172.21.15.134:0/226193457 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93842780894096] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b44071030 con 0x5559799e4e80 2024-04-24T02:14:12.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.310+0000 7f1b50da2800 20 remove_watcher() i=2 2024-04-24T02:14:12.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.310+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93842780896464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559799e9470 con 0x7f1b44098020 2024-04-24T02:14:12.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.311+0000 7f1b4f0a9640 1 -- 172.21.15.134:0/226193457 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93842780896464] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b48040040 con 0x7f1b44098020 2024-04-24T02:14:12.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.311+0000 7f1b50da2800 20 remove_watcher() i=3 2024-04-24T02:14:12.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.311+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93842780899088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559799ea4a0 con 0x5559799dec30 2024-04-24T02:14:12.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.312+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93842780899088] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b40018950 con 0x5559799dec30 2024-04-24T02:14:12.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.312+0000 7f1b50da2800 20 remove_watcher() i=4 2024-04-24T02:14:12.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.312+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93842780901904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559799eb390 con 0x7f1b48031040 2024-04-24T02:14:12.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.313+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93842780901904] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b40018950 con 0x7f1b48031040 2024-04-24T02:14:12.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.313+0000 7f1b50da2800 20 remove_watcher() i=5 2024-04-24T02:14:12.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.313+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93842780904064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559799ea4a0 con 0x7f1b48031040 2024-04-24T02:14:12.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.314+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93842780904064] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b40018950 con 0x7f1b48031040 2024-04-24T02:14:12.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.314+0000 7f1b50da2800 20 remove_watcher() i=6 2024-04-24T02:14:12.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.314+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93842780907520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559799ed210 con 0x7f1b48031040 2024-04-24T02:14:12.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.315+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93842780907520] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b40018950 con 0x7f1b48031040 2024-04-24T02:14:12.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.315+0000 7f1b50da2800 20 remove_watcher() i=7 2024-04-24T02:14:12.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.315+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f1b48031040 msgr2=0x7f1b48032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.315+0000 7f1b50da2800 1 --2- 172.21.15.134:0/226193457 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f1b48031040 0x7f1b48032430 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.315+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5559799dec30 msgr2=0x5559799e10f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.315+0000 7f1b50da2800 1 --2- 172.21.15.134:0/226193457 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x5559799dec30 0x5559799e10f0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.315+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f1b44098020 msgr2=0x7f1b4406a820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.315+0000 7f1b50da2800 1 --2- 172.21.15.134:0/226193457 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f1b44098020 0x7f1b4406a820 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.315+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5559799e4e80 msgr2=0x5559799e7270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.315+0000 7f1b50da2800 1 --2- 172.21.15.134:0/226193457 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x5559799e4e80 0x5559799e7270 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.315+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1a18036950 msgr2=0x7f1a18038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.315+0000 7f1b50da2800 1 --2- 172.21.15.134:0/226193457 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1a18036950 0x7f1a18038e10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x5559799aac60 tx=0x7f1b4801f000 comp rx=0 tx=0).stop 2024-04-24T02:14:12.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.315+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5559799cbac0 msgr2=0x5559799d3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.315+0000 7f1b50da2800 1 --2- 172.21.15.134:0/226193457 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5559799cbac0 0x5559799d3120 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f1b4401ced0 tx=0x7f1b4408db80 comp rx=0 tx=0).stop 2024-04-24T02:14:12.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.315+0000 7f1b4e8a8640 1 -- 172.21.15.134:0/226193457 reap_dead start 2024-04-24T02:14:12.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.315+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 shutdown_connections 2024-04-24T02:14:12.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.315+0000 7f1b50da2800 1 --2- 172.21.15.134:0/226193457 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5559799cbac0 0x5559799d3120 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.315+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 >> 172.21.15.134:0/226193457 conn(0x5559799c7e20 msgr2=0x5559799c5480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:12.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.315+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 shutdown_connections 2024-04-24T02:14:12.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.315+0000 7f1b50da2800 1 -- 172.21.15.134:0/226193457 wait complete. 2024-04-24T02:14:12.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.315+0000 7f1b50da2800 1 -- 172.21.15.134:0/1667882127 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1a28036950 msgr2=0x7f1a28038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.315+0000 7f1b50da2800 1 --2- 172.21.15.134:0/1667882127 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1a28036950 0x7f1a28038e10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x5559799ae8f0 tx=0x7f1b48005840 comp rx=0 tx=0).stop 2024-04-24T02:14:12.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.315+0000 7f1b50da2800 1 -- 172.21.15.134:0/1667882127 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5559799be880 msgr2=0x5559799beca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.315+0000 7f1b50da2800 1 --2- 172.21.15.134:0/1667882127 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5559799be880 0x5559799beca0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f1b44044840 tx=0x7f1b44002fb0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.315+0000 7f1b50da2800 1 -- 172.21.15.134:0/1667882127 shutdown_connections 2024-04-24T02:14:12.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.315+0000 7f1b50da2800 1 --2- 172.21.15.134:0/1667882127 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1a28036950 0x7f1a28038e10 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.315+0000 7f1b50da2800 1 --2- 172.21.15.134:0/1667882127 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5559799be880 0x5559799beca0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.315+0000 7f1b50da2800 1 -- 172.21.15.134:0/1667882127 >> 172.21.15.134:0/1667882127 conn(0x5559799b2920 msgr2=0x5559799b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:12.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.316+0000 7f1b50da2800 1 -- 172.21.15.134:0/1667882127 shutdown_connections 2024-04-24T02:14:12.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.316+0000 7f1b50da2800 1 -- 172.21.15.134:0/1667882127 wait complete. 2024-04-24T02:14:12.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.316+0000 7f1b50da2800 1 -- 172.21.15.134:0/1446507133 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55597981cb20 msgr2=0x5559799ad740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.316+0000 7f1b50da2800 1 --2- 172.21.15.134:0/1446507133 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55597981cb20 0x5559799ad740 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.316+0000 7f1b50da2800 1 -- 172.21.15.134:0/1446507133 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1a34036950 msgr2=0x7f1a34038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.316+0000 7f1b50da2800 1 --2- 172.21.15.134:0/1446507133 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1a34036950 0x7f1a34038e10 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f1b44054000 tx=0x7f1b4404e000 comp rx=0 tx=0).stop 2024-04-24T02:14:12.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.316+0000 7f1b50da2800 1 -- 172.21.15.134:0/1446507133 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55597981b7e0 msgr2=0x5559799a6500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.316+0000 7f1b50da2800 1 --2- 172.21.15.134:0/1446507133 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55597981b7e0 0x5559799a6500 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f1b40001dd0 tx=0x7f1b40000ed0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.316+0000 7f1b50da2800 1 -- 172.21.15.134:0/1446507133 shutdown_connections 2024-04-24T02:14:12.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.316+0000 7f1b50da2800 1 --2- 172.21.15.134:0/1446507133 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x55597981cb20 0x5559799ad740 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.316+0000 7f1b50da2800 1 --2- 172.21.15.134:0/1446507133 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1a34036950 0x7f1a34038e10 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.316+0000 7f1b50da2800 1 --2- 172.21.15.134:0/1446507133 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55597981b7e0 0x5559799a6500 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.316+0000 7f1b50da2800 1 -- 172.21.15.134:0/1446507133 >> 172.21.15.134:0/1446507133 conn(0x5559798a2550 msgr2=0x555979998ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:12.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.316+0000 7f1b50da2800 1 -- 172.21.15.134:0/1446507133 shutdown_connections 2024-04-24T02:14:12.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.316+0000 7f1b50da2800 1 -- 172.21.15.134:0/1446507133 wait complete. 2024-04-24T02:14:12.328 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T02:14:10.534163Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:14:10.534144Z', 'tags': [], 'group_ids': []} 2024-04-24T02:14:12.328 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T02:14:10.534163Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:14:10.534144Z', 'tags': [], 'group_ids': []} 2024-04-24T02:14:12.328 ERROR:root:0 2024-04-24T02:14:12.328 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-24T02:14:12.328 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-24T02:14:12.329 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-04-24T02:14:12.373 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:14:12.373 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:14:12.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.372+0000 7f0b2772f800 1 Processor -- start 2024-04-24T02:14:12.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.372+0000 7f0b2772f800 1 -- start start 2024-04-24T02:14:12.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.372+0000 7f0b2772f800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x559fa4a273e0 0x559fa4a297d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.372+0000 7f0b2772f800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559fa48e1d40 con 0x559fa4a238d0 2024-04-24T02:14:12.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.372+0000 7f0b2772f800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x559fa48b44d0 con 0x559fa4a273e0 2024-04-24T02:14:12.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.373+0000 7f0b1bfff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x559fa4a273e0 0x559fa4a297d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.373+0000 7f0b233ae640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x559fa4a238d0 0x559fa4a25cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:46508/0 (socket says 172.21.15.134:46508) 2024-04-24T02:14:12.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.373+0000 7f0b233ae640 1 -- 172.21.15.134:0/4108887894 learned_addr learned my addr 172.21.15.134:0/4108887894 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:14:12.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.373+0000 7f0b1bfff640 1 -- 172.21.15.134:0/4108887894 >> v1:172.21.15.104:6789/0 conn(0x559fa4a238d0 legacy=0x559fa4a25cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.373+0000 7f0b1bfff640 1 -- 172.21.15.134:0/4108887894 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fa48e0590 con 0x559fa4a273e0 2024-04-24T02:14:12.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.373+0000 7f0b22bad640 1 -- 172.21.15.134:0/4108887894 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1127846886 0 0) 0x559fa48e1d40 con 0x559fa4a238d0 2024-04-24T02:14:12.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.375+0000 7f0b1bfff640 1 --2- 172.21.15.134:0/4108887894 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559fa4a273e0 0x559fa4a297d0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c00a470 tx=0x7f0b0c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=544916eec3de4b24 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.375+0000 7f0b22bad640 1 -- 172.21.15.134:0/4108887894 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b0c057070 con 0x559fa4a273e0 2024-04-24T02:14:12.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.375+0000 7f0b22bad640 1 -- 172.21.15.134:0/4108887894 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b0c052570 con 0x559fa4a273e0 2024-04-24T02:14:12.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.375+0000 7f0b22bad640 1 -- 172.21.15.134:0/4108887894 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b0c052870 con 0x559fa4a273e0 2024-04-24T02:14:12.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.375+0000 7f0b2772f800 1 -- 172.21.15.134:0/4108887894 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559fa4a273e0 msgr2=0x559fa4a297d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.375+0000 7f0b2772f800 1 --2- 172.21.15.134:0/4108887894 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559fa4a273e0 0x559fa4a297d0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c00a470 tx=0x7f0b0c01ce90 comp rx=0 tx=0).stop 2024-04-24T02:14:12.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.375+0000 7f0b2772f800 1 -- 172.21.15.134:0/4108887894 shutdown_connections 2024-04-24T02:14:12.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.375+0000 7f0b2772f800 1 --2- 172.21.15.134:0/4108887894 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559fa4a273e0 0x559fa4a297d0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.375+0000 7f0b2772f800 1 -- 172.21.15.134:0/4108887894 >> 172.21.15.134:0/4108887894 conn(0x559fa4a1d3a0 msgr2=0x559fa4a1f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:12.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.375+0000 7f0b2772f800 1 -- 172.21.15.134:0/4108887894 shutdown_connections 2024-04-24T02:14:12.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.375+0000 7f0b2772f800 1 -- 172.21.15.134:0/4108887894 wait complete. 2024-04-24T02:14:12.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.387+0000 7f0b2772f800 1 Processor -- start 2024-04-24T02:14:12.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.387+0000 7f0b2772f800 1 -- start start 2024-04-24T02:14:12.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.387+0000 7f0b2772f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559fa4a238d0 0x559fa4b13fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.387+0000 7f0b2772f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x559fa496e3b0 con 0x559fa4a238d0 2024-04-24T02:14:12.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.387+0000 7f0b233ae640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559fa4a238d0 0x559fa4b13fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.387+0000 7f0b233ae640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559fa4a238d0 0x559fa4b13fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:44266/0 (socket says 172.21.15.134:44266) 2024-04-24T02:14:12.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.387+0000 7f0b233ae640 1 -- 172.21.15.134:0/1974517545 learned_addr learned my addr 172.21.15.134:0/1974517545 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:12.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.388+0000 7f0b233ae640 1 -- 172.21.15.134:0/1974517545 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fa4b14570 con 0x559fa4a238d0 2024-04-24T02:14:12.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.388+0000 7f0b233ae640 1 --2- 172.21.15.134:0/1974517545 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559fa4a238d0 0x559fa4b13fa0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f0b1400b210 tx=0x7f0b1400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ed3231873fe0fda server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.388+0000 7f0a1160a640 1 -- 172.21.15.134:0/1974517545 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b14008070 con 0x559fa4a238d0 2024-04-24T02:14:12.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.388+0000 7f0a1160a640 1 -- 172.21.15.134:0/1974517545 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b1400d500 con 0x559fa4a238d0 2024-04-24T02:14:12.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.388+0000 7f0a1160a640 1 -- 172.21.15.134:0/1974517545 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b1400d840 con 0x559fa4a238d0 2024-04-24T02:14:12.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.389+0000 7f0b2772f800 1 -- 172.21.15.134:0/1974517545 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559fa4a238d0 msgr2=0x559fa4b13fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.389+0000 7f0b2772f800 1 --2- 172.21.15.134:0/1974517545 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559fa4a238d0 0x559fa4b13fa0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f0b1400b210 tx=0x7f0b1400b6d0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.389+0000 7f0b2772f800 1 -- 172.21.15.134:0/1974517545 shutdown_connections 2024-04-24T02:14:12.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.389+0000 7f0b2772f800 1 --2- 172.21.15.134:0/1974517545 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559fa4a238d0 0x559fa4b13fa0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.389+0000 7f0b2772f800 1 -- 172.21.15.134:0/1974517545 >> 172.21.15.134:0/1974517545 conn(0x559fa4a1d3a0 msgr2=0x559fa4b0f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:12.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.389+0000 7f0b2772f800 1 -- 172.21.15.134:0/1974517545 shutdown_connections 2024-04-24T02:14:12.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.389+0000 7f0b2772f800 1 -- 172.21.15.134:0/1974517545 wait complete. 2024-04-24T02:14:12.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.389+0000 7f0b2772f800 1 Processor -- start 2024-04-24T02:14:12.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.389+0000 7f0b2772f800 1 -- start start 2024-04-24T02:14:12.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.389+0000 7f0b2772f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559fa4a238d0 0x559fa4b1bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.389+0000 7f0b2772f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x559fa4a2a010 con 0x559fa4a238d0 2024-04-24T02:14:12.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.389+0000 7f0b233ae640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559fa4a238d0 0x559fa4b1bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.390+0000 7f0b233ae640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559fa4a238d0 0x559fa4b1bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:44274/0 (socket says 172.21.15.134:44274) 2024-04-24T02:14:12.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.390+0000 7f0b233ae640 1 -- 172.21.15.134:0/1031294164 learned_addr learned my addr 172.21.15.134:0/1031294164 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:12.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.390+0000 7f0b233ae640 1 -- 172.21.15.134:0/1031294164 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fa4b1c060 con 0x559fa4a238d0 2024-04-24T02:14:12.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.390+0000 7f0b233ae640 1 --2- 172.21.15.134:0/1031294164 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559fa4a238d0 0x559fa4b1bb20 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f0b1400b210 tx=0x7f0b14000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.390+0000 7f0a0fe07640 1 -- 172.21.15.134:0/1031294164 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b1400f950 con 0x559fa4a238d0 2024-04-24T02:14:12.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.390+0000 7f0a0fe07640 1 -- 172.21.15.134:0/1031294164 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b1400faf0 con 0x559fa4a238d0 2024-04-24T02:14:12.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.390+0000 7f0a0fe07640 1 -- 172.21.15.134:0/1031294164 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b1400fdd0 con 0x559fa4a238d0 2024-04-24T02:14:12.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.390+0000 7f0b2772f800 1 -- 172.21.15.134:0/1031294164 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559fa4b1c2f0 con 0x559fa4a238d0 2024-04-24T02:14:12.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.390+0000 7f0b2772f800 1 -- 172.21.15.134:0/1031294164 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fa4b1efa0 con 0x559fa4a238d0 2024-04-24T02:14:12.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.391+0000 7f0a0fe07640 1 -- 172.21.15.134:0/1031294164 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0b14017040 con 0x559fa4a238d0 2024-04-24T02:14:12.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.391+0000 7f0a0fe07640 1 --2- 172.21.15.134:0/1031294164 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0a080368b0 0x7f0a08038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.391+0000 7f0a0fe07640 1 -- 172.21.15.134:0/1031294164 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f0b14015020 con 0x559fa4a238d0 2024-04-24T02:14:12.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.391+0000 7f0b1bfff640 1 --2- 172.21.15.134:0/1031294164 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0a080368b0 0x7f0a08038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.391+0000 7f0b2772f800 1 --2- 172.21.15.134:0/1031294164 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x559fa4a273e0 0x559fa4b22d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.391+0000 7f0b2772f800 1 -- 172.21.15.134:0/1031294164 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b232e0 con 0x559fa4a273e0 2024-04-24T02:14:12.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.391+0000 7f0b23baf640 1 --2- 172.21.15.134:0/1031294164 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x559fa4a273e0 0x559fa4b22d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.392+0000 7f0b1bfff640 1 --2- 172.21.15.134:0/1031294164 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0a080368b0 0x7f0a08038d70 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c054000 tx=0x7f0b0c04e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.392+0000 7f0b23baf640 1 --2- 172.21.15.134:0/1031294164 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x559fa4a273e0 0x559fa4b22d60 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.392+0000 7f0b23baf640 1 -- 172.21.15.134:0/1031294164 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b1c00a4a0 con 0x559fa4a273e0 2024-04-24T02:14:12.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.392+0000 7f0b2772f800 1 -- 172.21.15.134:0/1031294164 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b20330 con 0x559fa4a273e0 2024-04-24T02:14:12.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.392+0000 7f0b23baf640 1 -- 172.21.15.134:0/1031294164 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0b1c00a4a0 con 0x559fa4a273e0 2024-04-24T02:14:12.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.392+0000 7f0b2772f800 1 -- 172.21.15.134:0/1031294164 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b25100 con 0x559fa4a273e0 2024-04-24T02:14:12.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.393+0000 7f0b23baf640 1 -- 172.21.15.134:0/1031294164 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0b1c00a4a0 con 0x559fa4a273e0 2024-04-24T02:14:12.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.393+0000 7f0b2772f800 1 -- 172.21.15.134:0/1031294164 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b24440 con 0x559fa4a273e0 2024-04-24T02:14:12.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.393+0000 7f0b23baf640 1 -- 172.21.15.134:0/1031294164 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0b1c00a4a0 con 0x559fa4a273e0 2024-04-24T02:14:12.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.393+0000 7f0b2772f800 1 -- 172.21.15.134:0/1031294164 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b24890 con 0x559fa4a273e0 2024-04-24T02:14:12.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.393+0000 7f0b23baf640 1 -- 172.21.15.134:0/1031294164 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0b1c00a4a0 con 0x559fa4a273e0 2024-04-24T02:14:12.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.393+0000 7f0b2772f800 1 Processor -- start 2024-04-24T02:14:12.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.394+0000 7f0b2772f800 1 -- start start 2024-04-24T02:14:12.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.394+0000 7f0b2772f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559fa4b33ed0 0x559fa4b342f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.394+0000 7f0b2772f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x559fa49146b0 con 0x559fa4b33ed0 2024-04-24T02:14:12.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.394+0000 7f0b1bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559fa4b33ed0 0x559fa4b342f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.394+0000 7f0b1bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559fa4b33ed0 0x559fa4b342f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:44276/0 (socket says 172.21.15.134:44276) 2024-04-24T02:14:12.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.394+0000 7f0b1bfff640 1 -- 172.21.15.134:0/1097416154 learned_addr learned my addr 172.21.15.134:0/1097416154 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:12.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.394+0000 7f0b1bfff640 1 -- 172.21.15.134:0/1097416154 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fa4b34830 con 0x559fa4b33ed0 2024-04-24T02:14:12.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.394+0000 7f0b1bfff640 1 --2- 172.21.15.134:0/1097416154 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559fa4b33ed0 0x559fa4b342f0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c044840 tx=0x7f0b0c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.395+0000 7f0a0d602640 1 -- 172.21.15.134:0/1097416154 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b0c06f070 con 0x559fa4b33ed0 2024-04-24T02:14:12.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.395+0000 7f0a0d602640 1 -- 172.21.15.134:0/1097416154 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b0c058040 con 0x559fa4b33ed0 2024-04-24T02:14:12.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.395+0000 7f0a0d602640 1 -- 172.21.15.134:0/1097416154 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b0c057050 con 0x559fa4b33ed0 2024-04-24T02:14:12.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.395+0000 7f0b2772f800 1 -- 172.21.15.134:0/1097416154 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559fa4b352a0 con 0x559fa4b33ed0 2024-04-24T02:14:12.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.395+0000 7f0b2772f800 1 -- 172.21.15.134:0/1097416154 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fa4b35740 con 0x559fa4b33ed0 2024-04-24T02:14:12.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.395+0000 7f0a0d602640 1 -- 172.21.15.134:0/1097416154 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0b0c072070 con 0x559fa4b33ed0 2024-04-24T02:14:12.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.396+0000 7f0a0d602640 1 --2- 172.21.15.134:0/1097416154 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f09fc036950 0x7f09fc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.396+0000 7f0a0d602640 1 -- 172.21.15.134:0/1097416154 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f0b0c08f970 con 0x559fa4b33ed0 2024-04-24T02:14:12.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.396+0000 7f0b23baf640 1 --2- 172.21.15.134:0/1097416154 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f09fc036950 0x7f09fc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.396+0000 7f0b2772f800 1 Processor -- start 2024-04-24T02:14:12.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.396+0000 7f0b2772f800 1 -- start start 2024-04-24T02:14:12.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.396+0000 7f0b23baf640 1 --2- 172.21.15.134:0/1097416154 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f09fc036950 0x7f09fc038e10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x559fa4b23f60 tx=0x7f0b1c005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.396+0000 7f0b2772f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559fa4a22ec0 0x559fa4a232e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.396+0000 7f0b2772f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x559fa4b148f0 con 0x559fa4a22ec0 2024-04-24T02:14:12.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.396+0000 7f0b1bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559fa4a22ec0 0x559fa4a232e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.396+0000 7f0b1bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559fa4a22ec0 0x559fa4a232e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:44284/0 (socket says 172.21.15.134:44284) 2024-04-24T02:14:12.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.396+0000 7f0b1bfff640 1 -- 172.21.15.134:0/3918634322 learned_addr learned my addr 172.21.15.134:0/3918634322 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:12.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.396+0000 7f0b1bfff640 1 -- 172.21.15.134:0/3918634322 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fa4a216c0 con 0x559fa4a22ec0 2024-04-24T02:14:12.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.397+0000 7f0b1bfff640 1 --2- 172.21.15.134:0/3918634322 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559fa4a22ec0 0x559fa4a232e0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c08dd50 tx=0x7f0b0c08df50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f05b7d564b994730 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.397+0000 7f0a06ffd640 1 -- 172.21.15.134:0/3918634322 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b0c08b030 con 0x559fa4a22ec0 2024-04-24T02:14:12.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.397+0000 7f0a06ffd640 1 -- 172.21.15.134:0/3918634322 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b0c05e480 con 0x559fa4a22ec0 2024-04-24T02:14:12.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.397+0000 7f0a06ffd640 1 -- 172.21.15.134:0/3918634322 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b0c087b40 con 0x559fa4a22ec0 2024-04-24T02:14:12.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.397+0000 7f0b2772f800 1 -- 172.21.15.134:0/3918634322 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559fa4a22ec0 msgr2=0x559fa4a232e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.397+0000 7f0b2772f800 1 --2- 172.21.15.134:0/3918634322 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559fa4a22ec0 0x559fa4a232e0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c08dd50 tx=0x7f0b0c08df50 comp rx=0 tx=0).stop 2024-04-24T02:14:12.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.397+0000 7f0b2772f800 1 -- 172.21.15.134:0/3918634322 shutdown_connections 2024-04-24T02:14:12.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.397+0000 7f0b2772f800 1 --2- 172.21.15.134:0/3918634322 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559fa4a22ec0 0x559fa4a232e0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.397+0000 7f0b2772f800 1 -- 172.21.15.134:0/3918634322 >> 172.21.15.134:0/3918634322 conn(0x559fa4b3d470 msgr2=0x559fa4b3b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:12.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.397+0000 7f0b2772f800 1 -- 172.21.15.134:0/3918634322 shutdown_connections 2024-04-24T02:14:12.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.397+0000 7f0b2772f800 1 -- 172.21.15.134:0/3918634322 wait complete. 2024-04-24T02:14:12.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.397+0000 7f0b2772f800 1 Processor -- start 2024-04-24T02:14:12.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.398+0000 7f0b2772f800 1 -- start start 2024-04-24T02:14:12.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.398+0000 7f0b2772f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559fa4a22ec0 0x559fa4b4a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.398+0000 7f0b2772f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x559fa4a21b90 con 0x559fa4a22ec0 2024-04-24T02:14:12.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.398+0000 7f0b1bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559fa4a22ec0 0x559fa4b4a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.398+0000 7f0b1bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559fa4a22ec0 0x559fa4b4a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:44300/0 (socket says 172.21.15.134:44300) 2024-04-24T02:14:12.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.398+0000 7f0b1bfff640 1 -- 172.21.15.134:0/2517945227 learned_addr learned my addr 172.21.15.134:0/2517945227 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:14:12.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.398+0000 7f0b1bfff640 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fa4b4aeb0 con 0x559fa4a22ec0 2024-04-24T02:14:12.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.398+0000 7f0b1bfff640 1 --2- 172.21.15.134:0/2517945227 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559fa4a22ec0 0x559fa4b4a970 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c08dd50 tx=0x7f0b0c08dce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.398+0000 7f0a057fa640 1 -- 172.21.15.134:0/2517945227 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b0c072660 con 0x559fa4a22ec0 2024-04-24T02:14:12.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.398+0000 7f0a057fa640 1 -- 172.21.15.134:0/2517945227 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b0c08fbc0 con 0x559fa4a22ec0 2024-04-24T02:14:12.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.398+0000 7f0a057fa640 1 -- 172.21.15.134:0/2517945227 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b0c05daf0 con 0x559fa4a22ec0 2024-04-24T02:14:12.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.398+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559fa4b4b140 con 0x559fa4a22ec0 2024-04-24T02:14:12.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.398+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fa4b4b140 con 0x559fa4a22ec0 2024-04-24T02:14:12.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.399+0000 7f0a057fa640 1 -- 172.21.15.134:0/2517945227 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0b0c07b020 con 0x559fa4a22ec0 2024-04-24T02:14:12.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.399+0000 7f0a057fa640 1 --2- 172.21.15.134:0/2517945227 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f09ec036950 0x7f09ec038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.399+0000 7f0a057fa640 1 -- 172.21.15.134:0/2517945227 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f0b0c08c070 con 0x559fa4a22ec0 2024-04-24T02:14:12.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.399+0000 7f0b23baf640 1 --2- 172.21.15.134:0/2517945227 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f09ec036950 0x7f09ec038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.400+0000 7f0b23baf640 1 --2- 172.21.15.134:0/2517945227 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f09ec036950 0x7f09ec038e10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x559fa4b20280 tx=0x7f0b1c01f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.400+0000 7f0b2772f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:12.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.400+0000 7f0b2772f800 1 --2- 172.21.15.134:0/2517945227 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x559fa4b56280 0x559fa4b58740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.400+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b58e90 con 0x559fa4b56280 2024-04-24T02:14:12.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.400+0000 7f0b233ae640 1 --2- 172.21.15.134:0/2517945227 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x559fa4b56280 0x559fa4b58740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.400+0000 7f0b233ae640 1 --2- 172.21.15.134:0/2517945227 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x559fa4b56280 0x559fa4b58740 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.401+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b1402d070 con 0x559fa4b56280 2024-04-24T02:14:12.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.401+0000 7f0b2772f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:12.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.401+0000 7f0b2772f800 20 realm 2024-04-24T02:14:12.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.401+0000 7f0b2772f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:12.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.401+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b592a0 con 0x559fa4b56280 2024-04-24T02:14:12.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.401+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b1402d070 con 0x559fa4b56280 2024-04-24T02:14:12.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.401+0000 7f0b2772f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:12.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.401+0000 7f0b2772f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:14:12.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.401+0000 7f0b2772f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:12.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.401+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b59b70 con 0x559fa4b56280 2024-04-24T02:14:12.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.401+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b1402d070 con 0x559fa4b56280 2024-04-24T02:14:12.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.401+0000 7f0b2772f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:12.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.401+0000 7f0b2772f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:12.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.401+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b59f10 con 0x559fa4b56280 2024-04-24T02:14:12.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.401+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0b1402d070 con 0x559fa4b56280 2024-04-24T02:14:12.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.401+0000 7f0b2772f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:14:12.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.401+0000 7f0b2772f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:12.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.401+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b5a760 con 0x559fa4b56280 2024-04-24T02:14:12.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.401+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0b1402d070 con 0x559fa4b56280 2024-04-24T02:14:12.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.401+0000 7f0b2772f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:14:12.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.401+0000 7f0b2772f800 20 searching for the correct realm 2024-04-24T02:14:12.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.401+0000 7f0b2772f800 1 --2- 172.21.15.134:0/2517945227 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x559fa4b5c4d0 0x559fa4b5e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.401+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b5ee80 con 0x559fa4b5c4d0 2024-04-24T02:14:12.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.402+0000 7f0b1bfff640 1 --2- 172.21.15.134:0/2517945227 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x559fa4b5c4d0 0x559fa4b5e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.402+0000 7f0b1bfff640 1 --2- 172.21.15.134:0/2517945227 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x559fa4b5c4d0 0x559fa4b5e8c0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.402+0000 7f0b1bfff640 1 -- 172.21.15.134:0/2517945227 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b0c071030 con 0x559fa4b5c4d0 2024-04-24T02:14:12.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.402+0000 7f0b1bfff640 1 --2- 172.21.15.134:0/2517945227 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f0b0c074060 0x7f0b0c08c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.402+0000 7f0b1bfff640 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b5ee80 con 0x7f0b0c074060 2024-04-24T02:14:12.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.402+0000 7f0b23baf640 1 --2- 172.21.15.134:0/2517945227 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f0b0c074060 0x7f0b0c08c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.402+0000 7f0b23baf640 1 --2- 172.21.15.134:0/2517945227 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f0b0c074060 0x7f0b0c08c270 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.403+0000 7f0b23baf640 1 -- 172.21.15.134:0/2517945227 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1c01f070 con 0x7f0b0c074060 2024-04-24T02:14:12.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.403+0000 7f0b23baf640 1 --2- 172.21.15.134:0/2517945227 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f0b1c031040 0x7f0b1c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:14:12.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.403+0000 7f0b23baf640 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b5ee80 con 0x7f0b1c031040 2024-04-24T02:14:12.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.403+0000 7f0b233ae640 1 --2- 172.21.15.134:0/2517945227 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f0b1c031040 0x7f0b1c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:14:12.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.403+0000 7f0b233ae640 1 --2- 172.21.15.134:0/2517945227 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f0b1c031040 0x7f0b1c032940 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:14:12.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.403+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1402d070 con 0x7f0b1c031040 2024-04-24T02:14:12.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.404+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b5ee80 con 0x559fa4b56280 2024-04-24T02:14:12.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.404+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1402d070 con 0x559fa4b56280 2024-04-24T02:14:12.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.404+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b5ee80 con 0x559fa4b56280 2024-04-24T02:14:12.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.404+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0b1402d070 con 0x559fa4b56280 2024-04-24T02:14:12.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.404+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b5ee80 con 0x7f0b1c031040 2024-04-24T02:14:12.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.404+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1402d070 con 0x7f0b1c031040 2024-04-24T02:14:12.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.404+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b5ee80 con 0x7f0b0c074060 2024-04-24T02:14:12.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.404+0000 7f0b23baf640 1 -- 172.21.15.134:0/2517945227 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1c01f070 con 0x7f0b0c074060 2024-04-24T02:14:12.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.404+0000 7f0b23baf640 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b5ee80 con 0x7f0b0c074060 2024-04-24T02:14:12.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.405+0000 7f0b23baf640 1 -- 172.21.15.134:0/2517945227 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1c01f070 con 0x7f0b0c074060 2024-04-24T02:14:12.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.405+0000 7f0b23baf640 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b5ee80 con 0x559fa4b5c4d0 2024-04-24T02:14:12.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.405+0000 7f0b1bfff640 1 -- 172.21.15.134:0/2517945227 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b0c071030 con 0x559fa4b5c4d0 2024-04-24T02:14:12.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.405+0000 7f0b1bfff640 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b5ee80 con 0x559fa4b56280 2024-04-24T02:14:12.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.405+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1402d070 con 0x559fa4b56280 2024-04-24T02:14:12.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.405+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b5ee80 con 0x7f0b1c031040 2024-04-24T02:14:12.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.405+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1402d070 con 0x7f0b1c031040 2024-04-24T02:14:12.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.405+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b5ee80 con 0x559fa4b56280 2024-04-24T02:14:12.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.405+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1402d070 con 0x559fa4b56280 2024-04-24T02:14:12.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.406+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b5ee80 con 0x7f0b0c074060 2024-04-24T02:14:12.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.406+0000 7f0b23baf640 1 -- 172.21.15.134:0/2517945227 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0b1c01f070 con 0x7f0b0c074060 2024-04-24T02:14:12.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.406+0000 7f0b23baf640 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b5ee80 con 0x559fa4b5c4d0 2024-04-24T02:14:12.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.406+0000 7f0b1bfff640 1 -- 172.21.15.134:0/2517945227 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b0c071030 con 0x559fa4b5c4d0 2024-04-24T02:14:12.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.406+0000 7f0b1bfff640 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b5ee80 con 0x559fa4b5c4d0 2024-04-24T02:14:12.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.406+0000 7f0b1bfff640 1 -- 172.21.15.134:0/2517945227 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b0c071030 con 0x559fa4b5c4d0 2024-04-24T02:14:12.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.406+0000 7f0b1bfff640 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b5ee80 con 0x7f0b0c074060 2024-04-24T02:14:12.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.406+0000 7f0b23baf640 1 -- 172.21.15.134:0/2517945227 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1c01f070 con 0x7f0b0c074060 2024-04-24T02:14:12.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.406+0000 7f0b23baf640 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b5ee80 con 0x559fa4b5c4d0 2024-04-24T02:14:12.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.407+0000 7f0b1bfff640 1 -- 172.21.15.134:0/2517945227 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b0c071030 con 0x559fa4b5c4d0 2024-04-24T02:14:12.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.407+0000 7f0b1bfff640 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b5ee80 con 0x559fa4b5c4d0 2024-04-24T02:14:12.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.407+0000 7f0b1bfff640 1 -- 172.21.15.134:0/2517945227 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b0c071030 con 0x559fa4b5c4d0 2024-04-24T02:14:12.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.407+0000 7f0b1bfff640 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b5ee80 con 0x559fa4b56280 2024-04-24T02:14:12.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.407+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1402d070 con 0x559fa4b56280 2024-04-24T02:14:12.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.407+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b5ee80 con 0x559fa4b56280 2024-04-24T02:14:12.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.407+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=132b] v32'6 uv6 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f0b1402d070 con 0x559fa4b56280 2024-04-24T02:14:12.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.407+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b5ee80 con 0x7f0b1c031040 2024-04-24T02:14:12.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.407+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1402d070 con 0x7f0b1c031040 2024-04-24T02:14:12.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.407+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b5ee80 con 0x559fa4b5c4d0 2024-04-24T02:14:12.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.408+0000 7f0b1bfff640 1 -- 172.21.15.134:0/2517945227 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b0c071030 con 0x559fa4b5c4d0 2024-04-24T02:14:12.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.408+0000 7f0b1bfff640 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b5ee80 con 0x7f0b0c074060 2024-04-24T02:14:12.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.408+0000 7f0b23baf640 1 -- 172.21.15.134:0/2517945227 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1c01f070 con 0x7f0b0c074060 2024-04-24T02:14:12.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.408+0000 7f0b23baf640 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b5ee80 con 0x559fa4b56280 2024-04-24T02:14:12.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.408+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1402d070 con 0x559fa4b56280 2024-04-24T02:14:12.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.408+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b5ee80 con 0x7f0b1c031040 2024-04-24T02:14:12.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.408+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1402d070 con 0x7f0b1c031040 2024-04-24T02:14:12.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.408+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b5ee80 con 0x559fa4b5c4d0 2024-04-24T02:14:12.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.409+0000 7f0b1bfff640 1 -- 172.21.15.134:0/2517945227 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b0c071030 con 0x559fa4b5c4d0 2024-04-24T02:14:12.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.409+0000 7f0b1bfff640 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b5ee80 con 0x7f0b1c031040 2024-04-24T02:14:12.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.409+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1402d070 con 0x7f0b1c031040 2024-04-24T02:14:12.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.409+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b5ee80 con 0x7f0b0c074060 2024-04-24T02:14:12.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.409+0000 7f0b23baf640 1 -- 172.21.15.134:0/2517945227 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1c040040 con 0x7f0b0c074060 2024-04-24T02:14:12.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.409+0000 7f0b23baf640 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b5ee80 con 0x559fa4b5c4d0 2024-04-24T02:14:12.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.410+0000 7f0b1bfff640 1 -- 172.21.15.134:0/2517945227 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b0c071030 con 0x559fa4b5c4d0 2024-04-24T02:14:12.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.410+0000 7f0b1bfff640 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b5ee80 con 0x7f0b0c074060 2024-04-24T02:14:12.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.410+0000 7f0b23baf640 1 -- 172.21.15.134:0/2517945227 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1c040040 con 0x7f0b0c074060 2024-04-24T02:14:12.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.410+0000 7f0b23baf640 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b5ee80 con 0x559fa4b56280 2024-04-24T02:14:12.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.410+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0b1402d070 con 0x559fa4b56280 2024-04-24T02:14:12.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.410+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b5ee80 con 0x7f0b0c074060 2024-04-24T02:14:12.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.410+0000 7f0b23baf640 1 -- 172.21.15.134:0/2517945227 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1c040040 con 0x7f0b0c074060 2024-04-24T02:14:12.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.410+0000 7f0b2772f800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:14:12.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.410+0000 7f0b2772f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:14:12.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.410+0000 7f0b2772f800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:14:12.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.410+0000 7f0b2772f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:14:12.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.410+0000 7f0b2772f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:14:12.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.410+0000 7f0b2772f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:14:12.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.410+0000 7f0b2772f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:12.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.410+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b5b110 con 0x559fa4b56280 2024-04-24T02:14:12.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.411+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b1402d070 con 0x559fa4b56280 2024-04-24T02:14:12.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.411+0000 7f0b2772f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:12.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.411+0000 7f0b2772f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:12.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.411+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b5b9b0 con 0x559fa4b56280 2024-04-24T02:14:12.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.411+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0b1402d070 con 0x559fa4b56280 2024-04-24T02:14:12.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.411+0000 7f0b2772f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:14:12.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.411+0000 7f0b2772f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:12.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.411+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b5f300 con 0x559fa4b56280 2024-04-24T02:14:12.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.411+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0b1402d070 con 0x559fa4b56280 2024-04-24T02:14:12.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.411+0000 7f0b2772f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:14:12.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.411+0000 7f0b2772f800 20 zone default found 2024-04-24T02:14:12.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.411+0000 7f0b2772f800 4 Realm: () 2024-04-24T02:14:12.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.411+0000 7f0b2772f800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:14:12.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.411+0000 7f0b2772f800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:14:12.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.411+0000 7f0b2772f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:14:12.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.411+0000 7f0b2772f800 20 zonegroup default 2024-04-24T02:14:12.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.411+0000 7f0b2772f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:12.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.411+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b5f7b0 con 0x7f0b1c031040 2024-04-24T02:14:12.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.411+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0b1402d070 con 0x7f0b1c031040 2024-04-24T02:14:12.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.412+0000 7f0b2772f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:12.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.412+0000 7f0b2772f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:12.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.412+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b61190 con 0x559fa4b5c4d0 2024-04-24T02:14:12.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.412+0000 7f0b1bfff640 1 -- 172.21.15.134:0/2517945227 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0b0c071030 con 0x559fa4b5c4d0 2024-04-24T02:14:12.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.412+0000 7f0b2772f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:12.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.412+0000 7f0b2772f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:12.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.412+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b61680 con 0x559fa4b5c4d0 2024-04-24T02:14:12.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.412+0000 7f0b1bfff640 1 -- 172.21.15.134:0/2517945227 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0b0c071030 con 0x559fa4b5c4d0 2024-04-24T02:14:12.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.412+0000 7f0b2772f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:14:12.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.412+0000 7f0b2772f800 20 started sync module instance, tier type = 2024-04-24T02:14:12.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.412+0000 7f0b2772f800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:14:12.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.412+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b60620 con 0x7f0b0c074060 2024-04-24T02:14:12.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.413+0000 7f0b23baf640 1 -- 172.21.15.134:0/2517945227 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(44 notify.0 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1c040040 con 0x7f0b0c074060 2024-04-24T02:14:12.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.413+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94144151554576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b60280 con 0x7f0b0c074060 2024-04-24T02:14:12.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.413+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b62480 con 0x559fa4b56280 2024-04-24T02:14:12.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.414+0000 7f0b23baf640 1 -- 172.21.15.134:0/2517945227 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94144151554576] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1c040040 con 0x7f0b0c074060 2024-04-24T02:14:12.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.415+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1402d070 con 0x559fa4b56280 2024-04-24T02:14:12.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.415+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94144151558880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b623b0 con 0x559fa4b56280 2024-04-24T02:14:12.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.415+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b62ed0 con 0x559fa4b5c4d0 2024-04-24T02:14:12.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.416+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94144151558880] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1402d070 con 0x559fa4b56280 2024-04-24T02:14:12.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.416+0000 7f0b1bfff640 1 -- 172.21.15.134:0/2517945227 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b0c071030 con 0x559fa4b5c4d0 2024-04-24T02:14:12.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.416+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94144151559936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b62320 con 0x559fa4b5c4d0 2024-04-24T02:14:12.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.416+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b63d90 con 0x7f0b0c074060 2024-04-24T02:14:12.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.417+0000 7f0b1bfff640 1 -- 172.21.15.134:0/2517945227 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94144151559936] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b0c071030 con 0x559fa4b5c4d0 2024-04-24T02:14:12.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.417+0000 7f0b23baf640 1 -- 172.21.15.134:0/2517945227 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(50 notify.3 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1c040040 con 0x7f0b0c074060 2024-04-24T02:14:12.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.417+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94144151566560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b641b0 con 0x7f0b0c074060 2024-04-24T02:14:12.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.417+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b64b70 con 0x559fa4b56280 2024-04-24T02:14:12.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.418+0000 7f0b23baf640 1 -- 172.21.15.134:0/2517945227 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94144151566560] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1c040040 con 0x7f0b0c074060 2024-04-24T02:14:12.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.418+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1402d070 con 0x559fa4b56280 2024-04-24T02:14:12.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.418+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94144151568096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b64b70 con 0x559fa4b56280 2024-04-24T02:14:12.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.418+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b65530 con 0x7f0b1c031040 2024-04-24T02:14:12.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.419+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(54 notify.5 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1402d070 con 0x7f0b1c031040 2024-04-24T02:14:12.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.419+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94144151568096] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1402d070 con 0x559fa4b56280 2024-04-24T02:14:12.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.419+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94144151572608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b65950 con 0x7f0b1c031040 2024-04-24T02:14:12.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.419+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b64700 con 0x7f0b1c031040 2024-04-24T02:14:12.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.420+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94144151572608] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1402d070 con 0x7f0b1c031040 2024-04-24T02:14:12.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.420+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(56 notify.6 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1402d070 con 0x7f0b1c031040 2024-04-24T02:14:12.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.420+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94144151573664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b658c0 con 0x7f0b1c031040 2024-04-24T02:14:12.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.420+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b668e0 con 0x7f0b1c031040 2024-04-24T02:14:12.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.421+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94144151573664] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1402d070 con 0x7f0b1c031040 2024-04-24T02:14:12.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.421+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(58 notify.7 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1402d070 con 0x7f0b1c031040 2024-04-24T02:14:12.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.421+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94144151576384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b66810 con 0x7f0b1c031040 2024-04-24T02:14:12.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.421+0000 7f0b2772f800 20 add_watcher() i=0 2024-04-24T02:14:12.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.421+0000 7f0b2772f800 20 add_watcher() i=1 2024-04-24T02:14:12.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.421+0000 7f0b2772f800 20 add_watcher() i=2 2024-04-24T02:14:12.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.421+0000 7f0b2772f800 20 add_watcher() i=3 2024-04-24T02:14:12.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.421+0000 7f0b2772f800 20 add_watcher() i=4 2024-04-24T02:14:12.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.421+0000 7f0b2772f800 20 add_watcher() i=5 2024-04-24T02:14:12.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.421+0000 7f0b2772f800 20 add_watcher() i=6 2024-04-24T02:14:12.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.423+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94144151576384] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1402d070 con 0x7f0b1c031040 2024-04-24T02:14:12.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.423+0000 7f0b2772f800 20 add_watcher() i=7 2024-04-24T02:14:12.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.423+0000 7f0b2772f800 2 all 8 watchers are set, enabling cache 2024-04-24T02:14:12.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.423+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b69cd0 con 0x559fa4b56280 2024-04-24T02:14:12.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.423+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0b1402d070 con 0x559fa4b56280 2024-04-24T02:14:12.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.423+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94144151577904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b67190 con 0x559fa4b56280 2024-04-24T02:14:12.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.424+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94144151577904] v32'278 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0b1402d070 con 0x559fa4b56280 2024-04-24T02:14:12.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.424+0000 7f09d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:14:12.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.424+0000 7f0b2772f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:14:12.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.424+0000 7f0b2772f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:14:12.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.424+0000 7f0b2772f800 5 note: GC not initialized 2024-04-24T02:14:12.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.424+0000 7f09d8fe1640 20 reqs_thread_entry: start 2024-04-24T02:14:12.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.424+0000 7f0b2772f800 20 init_complete bucket index max shards: 11 2024-04-24T02:14:12.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.424+0000 7f0b2772f800 20 Filter name: none 2024-04-24T02:14:12.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.424+0000 7f09527fc640 20 reqs_thread_entry: start 2024-04-24T02:14:12.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.425+0000 7f0b2772f800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-24T02:14:12.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.425+0000 7f0b2772f800 20 rados->read ofs=0 len=0 2024-04-24T02:14:12.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.425+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b9d050 con 0x7f0b1c031040 2024-04-24T02:14:12.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.425+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f0b1402d070 con 0x7f0b1c031040 2024-04-24T02:14:12.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.425+0000 7f0b2772f800 20 rados_obj.operate() r=0 bl.length=473 2024-04-24T02:14:12.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.425+0000 7f0b2772f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-24T02:14:12.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.425+0000 7f0b2772f800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T02:14:12.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.425+0000 7f0b2772f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T02:14:12.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.425+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559fa4ba3950 con 0x7f0b1c031040 2024-04-24T02:14:12.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.427+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v32'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f0b1402d070 con 0x7f0b1c031040 2024-04-24T02:14:12.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.427+0000 7f0b2772f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T02:14:12.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.427+0000 7f0b2772f800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T02:14:12.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.427+0000 7f0b2772f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-24T02:14:12.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.427+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94144151827392 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b9f060 con 0x559fa4b56280 2024-04-24T02:14:12.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.427+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== watch-notify(notify (1) cookie 94144151568096 notify 137438953503 ret 0) ==== 691+0+0 (crc 0 0 0) 0x7f0b1405f040 con 0x559fa4b56280 2024-04-24T02:14:12.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.427+0000 7f0a06ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953503 cookie 94144151568096 notifier 4914 bl.length()=649 2024-04-24T02:14:12.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.427+0000 7f0a06ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T02:14:12.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.427+0000 7f0a06ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T02:14:12.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.427+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(64 notify.4 [notify cookie 94144151827392 out=8b] v0'0 uv279 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0b1402d070 con 0x559fa4b56280 2024-04-24T02:14:12.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.427+0000 7f0a06ffd640 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f09e8003ea0 con 0x559fa4b56280 2024-04-24T02:14:12.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.427+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1402d070 con 0x559fa4b56280 2024-04-24T02:14:12.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.427+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== watch-notify(notify_complete (2) cookie 94144151827392 notify 137438953503 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f0b1404e040 con 0x559fa4b56280 2024-04-24T02:14:12.441 INFO:teuthology.orchestra.run.smithi134.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-24T02:14:10.534163Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T02:14:10.534144Z","tags":[],"group_ids":[]} 2024-04-24T02:14:12.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.428+0000 7f09d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:14:12.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.428+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94144151577904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b9f820 con 0x559fa4b56280 2024-04-24T02:14:12.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.429+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94144151577904] v32'279 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0b1402d070 con 0x559fa4b56280 2024-04-24T02:14:12.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.429+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94144151554576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b9f820 con 0x7f0b0c074060 2024-04-24T02:14:12.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.430+0000 7f0b23baf640 1 -- 172.21.15.134:0/2517945227 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94144151554576] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1c040040 con 0x7f0b0c074060 2024-04-24T02:14:12.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.430+0000 7f0b2772f800 20 remove_watcher() i=0 2024-04-24T02:14:12.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.430+0000 7f0b2772f800 2 removed watcher, disabling cache 2024-04-24T02:14:12.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.430+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94144151558880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b9f820 con 0x559fa4b56280 2024-04-24T02:14:12.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.431+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94144151558880] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1402d070 con 0x559fa4b56280 2024-04-24T02:14:12.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.432+0000 7f0b2772f800 20 remove_watcher() i=1 2024-04-24T02:14:12.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.432+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94144151559936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b9f820 con 0x559fa4b5c4d0 2024-04-24T02:14:12.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.433+0000 7f0b1bfff640 1 -- 172.21.15.134:0/2517945227 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94144151559936] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b0c071030 con 0x559fa4b5c4d0 2024-04-24T02:14:12.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.433+0000 7f0b2772f800 20 remove_watcher() i=2 2024-04-24T02:14:12.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.433+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94144151566560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b60a10 con 0x7f0b0c074060 2024-04-24T02:14:12.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.434+0000 7f0b23baf640 1 -- 172.21.15.134:0/2517945227 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94144151566560] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1c040040 con 0x7f0b0c074060 2024-04-24T02:14:12.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.434+0000 7f0b2772f800 20 remove_watcher() i=3 2024-04-24T02:14:12.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.434+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94144151568096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b60a10 con 0x559fa4b56280 2024-04-24T02:14:12.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.435+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94144151568096] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1402d070 con 0x559fa4b56280 2024-04-24T02:14:12.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.435+0000 7f0b2772f800 20 remove_watcher() i=4 2024-04-24T02:14:12.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.435+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94144151572608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b63ee0 con 0x7f0b1c031040 2024-04-24T02:14:12.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.436+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94144151572608] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1402d070 con 0x7f0b1c031040 2024-04-24T02:14:12.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.436+0000 7f0b2772f800 20 remove_watcher() i=5 2024-04-24T02:14:12.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.436+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94144151573664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b60a10 con 0x7f0b1c031040 2024-04-24T02:14:12.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.437+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94144151573664] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1402d070 con 0x7f0b1c031040 2024-04-24T02:14:12.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.437+0000 7f0b2772f800 20 remove_watcher() i=6 2024-04-24T02:14:12.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.437+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94144151576384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559fa4b60a10 con 0x7f0b1c031040 2024-04-24T02:14:12.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.438+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94144151576384] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1402d070 con 0x7f0b1c031040 2024-04-24T02:14:12.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.438+0000 7f0b2772f800 20 remove_watcher() i=7 2024-04-24T02:14:12.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.438+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f0b1c031040 msgr2=0x7f0b1c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.438+0000 7f0b2772f800 1 --2- 172.21.15.134:0/2517945227 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f0b1c031040 0x7f0b1c032940 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.438+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x559fa4b56280 msgr2=0x559fa4b58740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.438+0000 7f0b2772f800 1 --2- 172.21.15.134:0/2517945227 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x559fa4b56280 0x559fa4b58740 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.438+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f0b0c074060 msgr2=0x7f0b0c08c270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.438+0000 7f0b2772f800 1 --2- 172.21.15.134:0/2517945227 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f0b0c074060 0x7f0b0c08c270 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.438+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x559fa4b5c4d0 msgr2=0x559fa4b5e8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.438+0000 7f0b2772f800 1 --2- 172.21.15.134:0/2517945227 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x559fa4b5c4d0 0x559fa4b5e8c0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.438+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f09ec036950 msgr2=0x7f09ec038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.438+0000 7f0b2772f800 1 --2- 172.21.15.134:0/2517945227 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f09ec036950 0x7f09ec038e10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x559fa4b20280 tx=0x7f0b1c01f000 comp rx=0 tx=0).stop 2024-04-24T02:14:12.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.438+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559fa4a22ec0 msgr2=0x559fa4b4a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.438+0000 7f0b233ae640 1 -- 172.21.15.134:0/2517945227 reap_dead start 2024-04-24T02:14:12.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.438+0000 7f0b2772f800 1 --2- 172.21.15.134:0/2517945227 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559fa4a22ec0 0x559fa4b4a970 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c08dd50 tx=0x7f0b0c08dce0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.438+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 shutdown_connections 2024-04-24T02:14:12.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.438+0000 7f0b2772f800 1 --2- 172.21.15.134:0/2517945227 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559fa4a22ec0 0x559fa4b4a970 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.438+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 >> 172.21.15.134:0/2517945227 conn(0x559fa4b3d470 msgr2=0x559fa4b3aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:12.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.438+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 shutdown_connections 2024-04-24T02:14:12.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.438+0000 7f0b2772f800 1 -- 172.21.15.134:0/2517945227 wait complete. 2024-04-24T02:14:12.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.439+0000 7f0b2772f800 1 -- 172.21.15.134:0/1097416154 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f09fc036950 msgr2=0x7f09fc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.439+0000 7f0b2772f800 1 --2- 172.21.15.134:0/1097416154 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f09fc036950 0x7f09fc038e10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x559fa4b23f60 tx=0x7f0b1c005840 comp rx=0 tx=0).stop 2024-04-24T02:14:12.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.439+0000 7f0b2772f800 1 -- 172.21.15.134:0/1097416154 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559fa4b33ed0 msgr2=0x559fa4b342f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.439+0000 7f0b2772f800 1 --2- 172.21.15.134:0/1097416154 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559fa4b33ed0 0x559fa4b342f0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c044840 tx=0x7f0b0c002fb0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.439+0000 7f0b2772f800 1 -- 172.21.15.134:0/1097416154 shutdown_connections 2024-04-24T02:14:12.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.439+0000 7f0b2772f800 1 --2- 172.21.15.134:0/1097416154 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f09fc036950 0x7f09fc038e10 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.439+0000 7f0b2772f800 1 --2- 172.21.15.134:0/1097416154 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559fa4b33ed0 0x559fa4b342f0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.439+0000 7f0b2772f800 1 -- 172.21.15.134:0/1097416154 >> 172.21.15.134:0/1097416154 conn(0x559fa4b27f70 msgr2=0x559fa4b28370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:12.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.439+0000 7f0b2772f800 1 -- 172.21.15.134:0/1097416154 shutdown_connections 2024-04-24T02:14:12.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.439+0000 7f0b2772f800 1 -- 172.21.15.134:0/1097416154 wait complete. 2024-04-24T02:14:12.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.439+0000 7f0b2772f800 1 -- 172.21.15.134:0/1031294164 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x559fa4a273e0 msgr2=0x559fa4b22d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.439+0000 7f0b2772f800 1 --2- 172.21.15.134:0/1031294164 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x559fa4a273e0 0x559fa4b22d60 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.439+0000 7f0b2772f800 1 -- 172.21.15.134:0/1031294164 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0a080368b0 msgr2=0x7f0a08038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.439+0000 7f0b2772f800 1 --2- 172.21.15.134:0/1031294164 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0a080368b0 0x7f0a08038d70 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c054000 tx=0x7f0b0c04e000 comp rx=0 tx=0).stop 2024-04-24T02:14:12.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.439+0000 7f0b2772f800 1 -- 172.21.15.134:0/1031294164 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559fa4a238d0 msgr2=0x559fa4b1bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:14:12.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.439+0000 7f0b2772f800 1 --2- 172.21.15.134:0/1031294164 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559fa4a238d0 0x559fa4b1bb20 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f0b1400b210 tx=0x7f0b14000ed0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.439+0000 7f0b2772f800 1 -- 172.21.15.134:0/1031294164 shutdown_connections 2024-04-24T02:14:12.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.439+0000 7f0b2772f800 1 --2- 172.21.15.134:0/1031294164 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x559fa4a273e0 0x559fa4b22d60 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.439+0000 7f0b2772f800 1 --2- 172.21.15.134:0/1031294164 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0a080368b0 0x7f0a08038d70 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.439+0000 7f0b2772f800 1 --2- 172.21.15.134:0/1031294164 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559fa4a238d0 0x559fa4b1bb20 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:14:12.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.439+0000 7f0b2772f800 1 -- 172.21.15.134:0/1031294164 >> 172.21.15.134:0/1031294164 conn(0x559fa4a1d3a0 msgr2=0x559fa4b0e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:14:12.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.439+0000 7f0b2772f800 1 -- 172.21.15.134:0/1031294164 shutdown_connections 2024-04-24T02:14:12.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:14:12.439+0000 7f0b2772f800 1 -- 172.21.15.134:0/1031294164 wait complete. 2024-04-24T02:14:12.452 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T02:14:10.534163Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:14:10.534144Z', 'tags': [], 'group_ids': []} 2024-04-24T02:14:12.452 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T02:14:10.534163Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T02:14:10.534144Z', 'tags': [], 'group_ids': []} 2024-04-24T02:14:12.452 ERROR:root:0 2024-04-24T02:14:12.452 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-04-24T02:14:12.459 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T02:14:12.460 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T02:14:12.463 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T02:14:12.464 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-04-24T02:14:12.469 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T02:14:12.470 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T02:14:12.473 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T02:14:12.474 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'create'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'} 2024-04-24T02:14:12.481 INFO:tasks.radosgw_admin_rest: json result: [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}] 2024-04-24T02:14:12.481 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T02:14:12.485 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T02:14:12.485 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ'} 2024-04-24T02:14:12.492 INFO:tasks.radosgw_admin_rest: empty result 2024-04-24T02:14:12.492 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T02:14:12.496 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T02:14:12.496 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo1', 'secret-key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'key-type': 'swift'} 2024-04-24T02:14:12.502 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}] 2024-04-24T02:14:12.503 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T02:14:12.506 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T02:14:12.507 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo2', 'secret-key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'key-type': 'swift'} 2024-04-24T02:14:12.514 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}] 2024-04-24T02:14:12.514 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T02:14:12.518 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T02:14:12.518 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'subuser': 'foo:foo1', 'key-type': 'swift'} 2024-04-24T02:14:12.525 INFO:tasks.radosgw_admin_rest: empty result 2024-04-24T02:14:12.526 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T02:14:12.529 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T02:14:12.530 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo1'} 2024-04-24T02:14:12.535 INFO:tasks.radosgw_admin_rest: empty result 2024-04-24T02:14:12.535 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T02:14:12.539 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T02:14:12.539 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo2', 'key-type': 'swift', '{purge-keys': True} 2024-04-24T02:14:12.546 INFO:tasks.radosgw_admin_rest: empty result 2024-04-24T02:14:12.546 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T02:14:12.550 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T02:14:12.550 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-04-24T02:14:12.554 INFO:tasks.radosgw_admin_rest: json result: [] 2024-04-24T02:14:12.556 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-04-24T02:14:12.561 INFO:tasks.radosgw_admin_rest: json result: [] 2024-04-24T02:14:12.573 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-04-24T02:14:12.577 INFO:tasks.radosgw_admin_rest: json result: ['myfoo'] 2024-04-24T02:14:12.578 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-04-24T02:14:12.583 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'b893fd8a-cafc-4918-98fa-f8aa8e20a508', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.11', 'marker': '582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-24T02:14:12.568934Z', 'creation_time': '2024-04-24T02:14:12.565958Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-04-24T02:14:12.583 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-04-24T02:14:12.589 INFO:tasks.radosgw_admin_rest: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'b893fd8a-cafc-4918-98fa-f8aa8e20a508', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.11', 'marker': '582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-24T02:14:12.568934Z', 'creation_time': '2024-04-24T02:14:12.565958Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-04-24T02:14:12.594 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-04-24T02:14:12.598 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'b893fd8a-cafc-4918-98fa-f8aa8e20a508', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.11', 'marker': '582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-24T02:14:12.568934Z', 'creation_time': '2024-04-24T02:14:12.565958Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-04-24T02:14:12.599 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'doesnotexist'} 2024-04-24T02:14:12.603 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchBucket', 'Message': '', 'RequestId': 'tx000003d91d43cebc35315-0066286af4-4222-default', 'HostId': '4222-default-default'} 2024-04-24T02:14:12.607 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'unlink'] {'uid': 'foo', 'bucket': 'myfoo'} 2024-04-24T02:14:12.614 INFO:tasks.radosgw_admin_rest: empty result 2024-04-24T02:14:12.615 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'fud', 'display-name': 'Fud', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'max-buckets': '1'} 2024-04-24T02:14:12.622 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T02:14:12.675 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'fud', 'bucket': 'myfoo', 'bucket-id': '582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.11'} 2024-04-24T02:14:12.685 INFO:tasks.radosgw_admin_rest: empty result 2024-04-24T02:14:12.688 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'foo', 'bucket': 'myfoo', 'bucket-id': '582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.11'} 2024-04-24T02:14:12.698 INFO:tasks.radosgw_admin_rest: empty result 2024-04-24T02:14:12.699 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'fud'} 2024-04-24T02:14:12.708 INFO:tasks.radosgw_admin_rest: empty result 2024-04-24T02:14:12.716 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['object', 'rm'] {'bucket': 'myfoo', 'object': 'four'} 2024-04-24T02:14:12.722 INFO:tasks.radosgw_admin_rest: empty result 2024-04-24T02:14:12.723 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-04-24T02:14:12.727 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'b893fd8a-cafc-4918-98fa-f8aa8e20a508', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.11', 'marker': '582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-24T02:14:12.693984Z', 'creation_time': '2024-04-24T02:14:12.565958Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-04-24T02:15:12.784 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'categories': 'delete_obj'} 2024-04-24T02:15:12.802 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'anonymous', 'categories': []}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'bar', 'categories': []}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'bud', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'fud', 'categories': []}, {'bucket': 'myfoo7', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'fud', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bar', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}, {'user': 'fud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}]} 2024-04-24T02:15:12.803 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] None 2024-04-24T02:15:12.817 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'fud', 'categories': [{'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 0, 'ops': 1, 'successful_ops': 0}]}, {'bucket': 'myfoo7', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 8, 'ops': 2, 'successful_ops': 2}}, {'user': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 16, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}, {'user': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 8, 'ops': 2, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 242, 'bytes_received': 8, 'ops': 5, 'successful_ops': 4}}]} 2024-04-24T02:15:12.818 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-04-24T02:15:12.824 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}]} 2024-04-24T02:15:12.824 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'create_bucket'} 2024-04-24T02:15:12.828 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'useless-bucket', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}}]} 2024-04-24T02:15:12.829 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'put_obj'} 2024-04-24T02:15:12.833 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}}]} 2024-04-24T02:15:12.833 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_obj'} 2024-04-24T02:15:12.837 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}]} 2024-04-24T02:15:12.838 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_bucket'} 2024-04-24T02:15:12.842 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'foo', 'categories': []}, {'bucket': 'useless-bucket', 'time': '2024-04-24T02:00:00.000000Z', 'epoch': 1713924000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}]} 2024-04-24T02:15:12.842 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'trim'] {'uid': 'foo'} 2024-04-24T02:15:12.849 INFO:tasks.radosgw_admin_rest: empty result 2024-04-24T02:15:12.849 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-04-24T02:15:12.853 INFO:tasks.radosgw_admin_rest: json result: {'entries': [], 'summary': []} 2024-04-24T02:15:12.854 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-04-24T02:15:12.863 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T02:15:12.866 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-04-24T02:15:12.875 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T02:15:13.134 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-04-24T02:15:13.139 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx000002d12e9c2b516cb40-0066286b31-4222-default', 'HostId': '4222-default-default'} 2024-04-24T02:15:13.239 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-04-24T02:15:13.243 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [], 'grant_map': [{'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-04-24T02:15:13.248 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-04-24T02:15:13.253 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [{'group': 1, 'acl': 1}], 'grant_map': [{'id': '', 'grant': {'type': {'type': 2}, 'group': 1, 'permission': {'flags': 1}}}, {'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-04-24T02:15:13.326 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'rm'] {'bucket': 'myfoo', 'purge-objects': True} 2024-04-24T02:15:13.359 INFO:tasks.radosgw_admin_rest: empty result 2024-04-24T02:15:13.359 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'add'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-04-24T02:15:13.365 INFO:tasks.radosgw_admin_rest: json result: [{'type': 'usage', 'perm': 'read'}] 2024-04-24T02:15:13.365 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'rm'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-04-24T02:15:13.371 INFO:tasks.radosgw_admin_rest: json result: [] 2024-04-24T02:15:13.381 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-04-24T02:15:13.385 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000987e5522ba17ed14-0066286b31-4222-default', 'HostId': '4222-default-default'} 2024-04-24T02:15:13.451 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo', 'purge-data': True} 2024-04-24T02:15:13.485 INFO:tasks.radosgw_admin_rest: empty result 2024-04-24T02:15:13.485 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T02:15:13.490 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx000005612f98d9730ea49-0066286b31-4222-default', 'HostId': '4222-default-default'} 2024-04-24T02:15:13.490 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['info', ''] None 2024-04-24T02:15:13.494 INFO:tasks.radosgw_admin_rest: json result: {'info': {'storage_backends': [{'name': 'rados', 'cluster_id': 'b09461c3-8f3e-4967-89da-98f6945a4445'}]}} 2024-04-24T02:15:13.494 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'ratelimit_user', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '1000'} 2024-04-24T02:15:13.505 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'ratelimit_user', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'ratelimit_user', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T02:15:13.505 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-04-24T02:15:13.509 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-04-24T02:15:13.510 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring'} 2024-04-24T02:15:13.514 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000338fc742fa879a8d-0066286b31-4222-default', 'HostId': '4222-default-default'} 2024-04-24T02:15:13.515 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user'} 2024-04-24T02:15:13.518 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000003c22e869bf062d9f-0066286b31-4222-default', 'HostId': '4222-default-default'} 2024-04-24T02:15:13.529 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-04-24T02:15:13.533 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-04-24T02:15:13.533 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring'} 2024-04-24T02:15:13.537 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000b6e6dded024f364e-0066286b31-4222-default', 'HostId': '4222-default-default'} 2024-04-24T02:15:13.537 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket'} 2024-04-24T02:15:13.540 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000b684b3b2aa535326-0066286b31-4222-default', 'HostId': '4222-default-default'} 2024-04-24T02:15:13.541 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'global': 'true'} 2024-04-24T02:15:13.545 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'anonymous_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-04-24T02:15:13.545 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring', 'enabled': 'true'} 2024-04-24T02:15:13.549 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000280b93b97ff14c7e-0066286b31-4222-default', 'HostId': '4222-default-default'} 2024-04-24T02:15:13.549 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user'} 2024-04-24T02:15:13.552 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000072ac984777d56cd-0066286b31-4222-default', 'HostId': '4222-default-default'} 2024-04-24T02:15:13.553 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring', 'enabled': 'true'} 2024-04-24T02:15:13.556 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000219a8a0e4b51b7cf-0066286b31-4222-default', 'HostId': '4222-default-default'} 2024-04-24T02:15:13.557 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'enabled': 'true'} 2024-04-24T02:15:13.560 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000003c2d6c0a236b5b8f-0066286b31-4222-default', 'HostId': '4222-default-default'} 2024-04-24T02:15:13.561 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user', 'enabled': 'true', 'max-read-bytes': '2'} 2024-04-24T02:15:13.571 INFO:tasks.radosgw_admin_rest: empty result 2024-04-24T02:15:13.571 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-04-24T02:15:13.574 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 2, 'max_write_bytes': 0, 'enabled': True}} 2024-04-24T02:15:13.575 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket', 'enabled': 'true', 'max-write-bytes': '2'} 2024-04-24T02:15:13.581 INFO:tasks.radosgw_admin_rest: empty result 2024-04-24T02:15:13.581 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-04-24T02:15:13.585 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 2, 'enabled': True}} 2024-04-24T02:15:13.585 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'global': 'true', 'enabled': 'true'} 2024-04-24T02:15:13.591 INFO:tasks.radosgw_admin_rest: empty result 2024-04-24T02:15:13.595 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-04-24T02:15:13.610 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-04-24T02:15:13.610 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T02:15:13.611 INFO:tasks.rgw.client.0.smithi134.stdout:2024-04-24T02:15:13.610+0000 7f751279f640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 34578) UID: 0 2024-04-24T02:15:13.611 INFO:tasks.rgw.client.0.smithi134.stdout:2024-04-24T02:15:13.610+0000 7f7518122880 -1 shutting down 2024-04-24T02:15:16.953 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-04-24T02:15:19.712 INFO:tasks.rgw.client.0:Stopped 2024-04-24T02:15:19.712 DEBUG:teuthology.orchestra.run.smithi134:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-04-24T02:15:19.731 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f /etc/ceph/vault-root-token 2024-04-24T02:15:19.801 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-04-24T02:15:19.869 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-04-24T02:15:19.869 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-04-24T02:15:19.869 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-04-24T02:15:19.955 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setuser ceph since I am not root 2024-04-24T02:15:19.955 INFO:teuthology.orchestra.run.smithi134.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T02:15:19.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.954+0000 7f13d3146800 1 Processor -- start 2024-04-24T02:15:19.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.954+0000 7f13d3146800 1 -- start start 2024-04-24T02:15:19.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.954+0000 7f13d3146800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x556265f23130 0x556265f255f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:19.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.954+0000 7f13d3146800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556265dddd40 con 0x556265e921c0 2024-04-24T02:15:19.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.954+0000 7f13d3146800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x556265db04d0 con 0x556265f23130 2024-04-24T02:15:19.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.955+0000 7f13cbfff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x556265f23130 0x556265f255f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:19.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.955+0000 7f13d0c45640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x556265e921c0 0x556265f219e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.134:44002/0 (socket says 172.21.15.134:44002) 2024-04-24T02:15:19.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.955+0000 7f13d0c45640 1 -- 172.21.15.134:0/533530277 learned_addr learned my addr 172.21.15.134:0/533530277 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-04-24T02:15:19.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.955+0000 7f13cbfff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x556265f23130 0x556265f255f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:41486/0 (socket says 172.21.15.134:41486) 2024-04-24T02:15:19.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.955+0000 7f13cbfff640 1 -- 172.21.15.134:0/533530277 >> v1:172.21.15.104:6789/0 conn(0x556265e921c0 legacy=0x556265f219e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:19.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.955+0000 7f13cbfff640 1 -- 172.21.15.134:0/533530277 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556265ddc590 con 0x556265f23130 2024-04-24T02:15:19.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.957+0000 7f13cbfff640 1 --2- 172.21.15.134:0/533530277 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556265f23130 0x556265f255f0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f13bc00a470 tx=0x7f13bc01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3f5d1028f061c21 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:19.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.957+0000 7f13cb7fe640 1 -- 172.21.15.134:0/533530277 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13bc057070 con 0x556265f23130 2024-04-24T02:15:19.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.957+0000 7f13cb7fe640 1 -- 172.21.15.134:0/533530277 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13bc052570 con 0x556265f23130 2024-04-24T02:15:19.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.957+0000 7f13cb7fe640 1 -- 172.21.15.134:0/533530277 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13bc052870 con 0x556265f23130 2024-04-24T02:15:19.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.958+0000 7f13d3146800 1 -- 172.21.15.134:0/533530277 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556265f23130 msgr2=0x556265f255f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:19.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.958+0000 7f13d3146800 1 --2- 172.21.15.134:0/533530277 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556265f23130 0x556265f255f0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f13bc00a470 tx=0x7f13bc01ce90 comp rx=0 tx=0).stop 2024-04-24T02:15:19.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.958+0000 7f13d3146800 1 -- 172.21.15.134:0/533530277 shutdown_connections 2024-04-24T02:15:19.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.958+0000 7f13d3146800 1 --2- 172.21.15.134:0/533530277 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556265f23130 0x556265f255f0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:19.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.958+0000 7f13d3146800 1 -- 172.21.15.134:0/533530277 >> 172.21.15.134:0/533530277 conn(0x556265f19380 msgr2=0x556265f1b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:15:19.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.958+0000 7f13d3146800 1 -- 172.21.15.134:0/533530277 shutdown_connections 2024-04-24T02:15:19.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.958+0000 7f13d3146800 1 -- 172.21.15.134:0/533530277 wait complete. 2024-04-24T02:15:19.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.971+0000 7f13d3146800 1 Processor -- start 2024-04-24T02:15:19.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.971+0000 7f13d3146800 1 -- start start 2024-04-24T02:15:19.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.971+0000 7f13d3146800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556265e921c0 0x556265f1f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:19.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.971+0000 7f13d3146800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556265e6a3c0 con 0x556265e921c0 2024-04-24T02:15:19.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.972+0000 7f13d0c45640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556265e921c0 0x556265f1f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:19.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.972+0000 7f13d0c45640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556265e921c0 0x556265f1f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:41496/0 (socket says 172.21.15.134:41496) 2024-04-24T02:15:19.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.972+0000 7f13d0c45640 1 -- 172.21.15.134:0/734825277 learned_addr learned my addr 172.21.15.134:0/734825277 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:15:19.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.972+0000 7f13d0c45640 1 -- 172.21.15.134:0/734825277 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556265f1d8d0 con 0x556265e921c0 2024-04-24T02:15:19.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.972+0000 7f13d0c45640 1 --2- 172.21.15.134:0/734825277 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556265e921c0 0x556265f1f310 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f13c4001de0 tx=0x7f13c400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=260fb370895d1a5c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:19.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.972+0000 7f12bee05640 1 -- 172.21.15.134:0/734825277 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13c4012020 con 0x556265e921c0 2024-04-24T02:15:19.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.972+0000 7f12bee05640 1 -- 172.21.15.134:0/734825277 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13c400e5a0 con 0x556265e921c0 2024-04-24T02:15:19.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.972+0000 7f12bee05640 1 -- 172.21.15.134:0/734825277 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13c400e8c0 con 0x556265e921c0 2024-04-24T02:15:19.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.973+0000 7f13d3146800 1 -- 172.21.15.134:0/734825277 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556265e921c0 msgr2=0x556265f1f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:19.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.973+0000 7f13d3146800 1 --2- 172.21.15.134:0/734825277 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556265e921c0 0x556265f1f310 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f13c4001de0 tx=0x7f13c400b6c0 comp rx=0 tx=0).stop 2024-04-24T02:15:19.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.973+0000 7f13d3146800 1 -- 172.21.15.134:0/734825277 shutdown_connections 2024-04-24T02:15:19.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.973+0000 7f13d3146800 1 --2- 172.21.15.134:0/734825277 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556265e921c0 0x556265f1f310 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:19.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.973+0000 7f13d3146800 1 -- 172.21.15.134:0/734825277 >> 172.21.15.134:0/734825277 conn(0x556265f19380 msgr2=0x55626600ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:15:19.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.973+0000 7f13d3146800 1 -- 172.21.15.134:0/734825277 shutdown_connections 2024-04-24T02:15:19.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.973+0000 7f13d3146800 1 -- 172.21.15.134:0/734825277 wait complete. 2024-04-24T02:15:19.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.973+0000 7f13d3146800 1 Processor -- start 2024-04-24T02:15:19.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.973+0000 7f13d3146800 1 -- start start 2024-04-24T02:15:19.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.974+0000 7f13d3146800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556265e921c0 0x556266019e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:19.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.974+0000 7f13d3146800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556265f25fa0 con 0x556265e921c0 2024-04-24T02:15:19.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.974+0000 7f13d0c45640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556265e921c0 0x556266019e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:19.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.974+0000 7f13d0c45640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556265e921c0 0x556266019e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:41502/0 (socket says 172.21.15.134:41502) 2024-04-24T02:15:19.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.974+0000 7f13d0c45640 1 -- 172.21.15.134:0/4070345416 learned_addr learned my addr 172.21.15.134:0/4070345416 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:15:19.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.974+0000 7f13d0c45640 1 -- 172.21.15.134:0/4070345416 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55626601a340 con 0x556265e921c0 2024-04-24T02:15:19.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.974+0000 7f13d0c45640 1 --2- 172.21.15.134:0/4070345416 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556265e921c0 0x556266019e00 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f13c400c010 tx=0x7f13c4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:19.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.975+0000 7f12bd602640 1 -- 172.21.15.134:0/4070345416 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13c4012070 con 0x556265e921c0 2024-04-24T02:15:19.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.975+0000 7f12bd602640 1 -- 172.21.15.134:0/4070345416 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13c401a7a0 con 0x556265e921c0 2024-04-24T02:15:19.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.975+0000 7f13d3146800 1 -- 172.21.15.134:0/4070345416 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55626601a5d0 con 0x556265e921c0 2024-04-24T02:15:19.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.975+0000 7f12bd602640 1 -- 172.21.15.134:0/4070345416 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13c401aa80 con 0x556265e921c0 2024-04-24T02:15:19.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.975+0000 7f13d3146800 1 -- 172.21.15.134:0/4070345416 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55626601d280 con 0x556265e921c0 2024-04-24T02:15:19.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.976+0000 7f12bd602640 1 -- 172.21.15.134:0/4070345416 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f13c4015020 con 0x556265e921c0 2024-04-24T02:15:19.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.976+0000 7f12bd602640 1 --2- 172.21.15.134:0/4070345416 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f12b8036950 0x7f12b8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:19.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.976+0000 7f12bd602640 1 -- 172.21.15.134:0/4070345416 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f13c4020070 con 0x556265e921c0 2024-04-24T02:15:19.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.976+0000 7f13cbfff640 1 --2- 172.21.15.134:0/4070345416 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f12b8036950 0x7f12b8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:19.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.976+0000 7f13d3146800 1 --2- 172.21.15.134:0/4070345416 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556265f23130 0x556266021040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:19.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.976+0000 7f13d3146800 1 -- 172.21.15.134:0/4070345416 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556266021580 con 0x556265f23130 2024-04-24T02:15:19.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.976+0000 7f13d1446640 1 --2- 172.21.15.134:0/4070345416 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556265f23130 0x556266021040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:19.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.976+0000 7f13cbfff640 1 --2- 172.21.15.134:0/4070345416 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f12b8036950 0x7f12b8038e10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f13bc054000 tx=0x7f13bc04e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:19.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.976+0000 7f13d1446640 1 --2- 172.21.15.134:0/4070345416 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556265f23130 0x556266021040 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:19.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.977+0000 7f13d1446640 1 -- 172.21.15.134:0/4070345416 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f13cc00a4a0 con 0x556265f23130 2024-04-24T02:15:19.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.977+0000 7f13d3146800 1 -- 172.21.15.134:0/4070345416 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626601e610 con 0x556265f23130 2024-04-24T02:15:19.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.977+0000 7f13d1446640 1 -- 172.21.15.134:0/4070345416 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f13cc00a4a0 con 0x556265f23130 2024-04-24T02:15:19.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.977+0000 7f13d3146800 1 -- 172.21.15.134:0/4070345416 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562660233c0 con 0x556265f23130 2024-04-24T02:15:19.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.977+0000 7f13d1446640 1 -- 172.21.15.134:0/4070345416 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [call out=48b,read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f13cc00a4a0 con 0x556265f23130 2024-04-24T02:15:19.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.977+0000 7f13d3146800 1 -- 172.21.15.134:0/4070345416 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556266022700 con 0x556265f23130 2024-04-24T02:15:19.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.978+0000 7f13d1446640 1 -- 172.21.15.134:0/4070345416 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f13cc00a4a0 con 0x556265f23130 2024-04-24T02:15:19.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.978+0000 7f13d3146800 1 -- 172.21.15.134:0/4070345416 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556266022aa0 con 0x556265f23130 2024-04-24T02:15:19.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.978+0000 7f13d1446640 1 -- 172.21.15.134:0/4070345416 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f13cc00a4a0 con 0x556265f23130 2024-04-24T02:15:19.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.978+0000 7f13d3146800 1 Processor -- start 2024-04-24T02:15:19.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.978+0000 7f13d3146800 1 -- start start 2024-04-24T02:15:19.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.978+0000 7f13d3146800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556266032210 0x556266032630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:19.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.978+0000 7f13d3146800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556265e106b0 con 0x556266032210 2024-04-24T02:15:19.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.979+0000 7f13cbfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556266032210 0x556266032630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:19.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.979+0000 7f13cbfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556266032210 0x556266032630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:41512/0 (socket says 172.21.15.134:41512) 2024-04-24T02:15:19.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.979+0000 7f13cbfff640 1 -- 172.21.15.134:0/2603865376 learned_addr learned my addr 172.21.15.134:0/2603865376 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:15:19.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.979+0000 7f13cbfff640 1 -- 172.21.15.134:0/2603865376 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556266032b70 con 0x556266032210 2024-04-24T02:15:19.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.979+0000 7f13cbfff640 1 --2- 172.21.15.134:0/2603865376 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556266032210 0x556266032630 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f13bc044840 tx=0x7f13bc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:19.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.979+0000 7f12b67fc640 1 -- 172.21.15.134:0/2603865376 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13bc06f070 con 0x556266032210 2024-04-24T02:15:19.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.979+0000 7f12b67fc640 1 -- 172.21.15.134:0/2603865376 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13bc058040 con 0x556266032210 2024-04-24T02:15:19.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.979+0000 7f13d3146800 1 -- 172.21.15.134:0/2603865376 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5562660335e0 con 0x556266032210 2024-04-24T02:15:19.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.979+0000 7f12b67fc640 1 -- 172.21.15.134:0/2603865376 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13bc057050 con 0x556266032210 2024-04-24T02:15:19.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.979+0000 7f13d3146800 1 -- 172.21.15.134:0/2603865376 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556266033a80 con 0x556266032210 2024-04-24T02:15:19.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.980+0000 7f12b67fc640 1 -- 172.21.15.134:0/2603865376 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f13bc072070 con 0x556266032210 2024-04-24T02:15:19.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.980+0000 7f12b67fc640 1 --2- 172.21.15.134:0/2603865376 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f12a8036950 0x7f12a8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:19.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.980+0000 7f12b67fc640 1 -- 172.21.15.134:0/2603865376 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f13bc08f970 con 0x556266032210 2024-04-24T02:15:19.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.980+0000 7f13d1446640 1 --2- 172.21.15.134:0/2603865376 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f12a8036950 0x7f12a8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:19.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.981+0000 7f13d3146800 1 Processor -- start 2024-04-24T02:15:19.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.981+0000 7f13d3146800 1 -- start start 2024-04-24T02:15:19.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.981+0000 7f13d1446640 1 --2- 172.21.15.134:0/2603865376 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f12a8036950 0x7f12a8038e10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x556266022220 tx=0x7f13cc005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:19.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.981+0000 7f13d3146800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55626603f470 0x55626603f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:19.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.981+0000 7f13d3146800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556265f1dc50 con 0x55626603f470 2024-04-24T02:15:19.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.981+0000 7f13cbfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55626603f470 0x55626603f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:19.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.981+0000 7f13cbfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55626603f470 0x55626603f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:41522/0 (socket says 172.21.15.134:41522) 2024-04-24T02:15:19.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.981+0000 7f13cbfff640 1 -- 172.21.15.134:0/1780088113 learned_addr learned my addr 172.21.15.134:0/1780088113 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:15:19.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.981+0000 7f13cbfff640 1 -- 172.21.15.134:0/1780088113 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55626603fe60 con 0x55626603f470 2024-04-24T02:15:19.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.982+0000 7f13cbfff640 1 --2- 172.21.15.134:0/1780088113 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55626603f470 0x55626603f890 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f13bc05f4a0 tx=0x7f13bc08e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19d070d59ffe7bfe server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:19.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.982+0000 7f12a7fff640 1 -- 172.21.15.134:0/1780088113 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13bc087070 con 0x55626603f470 2024-04-24T02:15:19.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.982+0000 7f12a7fff640 1 -- 172.21.15.134:0/1780088113 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13bc05e480 con 0x55626603f470 2024-04-24T02:15:19.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.982+0000 7f12a7fff640 1 -- 172.21.15.134:0/1780088113 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13bc072360 con 0x55626603f470 2024-04-24T02:15:19.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.982+0000 7f13d3146800 1 -- 172.21.15.134:0/1780088113 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55626603f470 msgr2=0x55626603f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:19.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.982+0000 7f13d3146800 1 --2- 172.21.15.134:0/1780088113 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55626603f470 0x55626603f890 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f13bc05f4a0 tx=0x7f13bc08e000 comp rx=0 tx=0).stop 2024-04-24T02:15:19.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.982+0000 7f13d3146800 1 -- 172.21.15.134:0/1780088113 shutdown_connections 2024-04-24T02:15:19.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.982+0000 7f13d3146800 1 --2- 172.21.15.134:0/1780088113 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55626603f470 0x55626603f890 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:19.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.982+0000 7f13d3146800 1 -- 172.21.15.134:0/1780088113 >> 172.21.15.134:0/1780088113 conn(0x55626603b7d0 msgr2=0x556266039830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:15:19.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.982+0000 7f13d3146800 1 -- 172.21.15.134:0/1780088113 shutdown_connections 2024-04-24T02:15:19.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.982+0000 7f13d3146800 1 -- 172.21.15.134:0/1780088113 wait complete. 2024-04-24T02:15:19.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.983+0000 7f13d3146800 1 Processor -- start 2024-04-24T02:15:19.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.983+0000 7f13d3146800 1 -- start start 2024-04-24T02:15:19.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.983+0000 7f13d3146800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55626603f470 0x556266046aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:19.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.983+0000 7f13d3146800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5562660405d0 con 0x55626603f470 2024-04-24T02:15:19.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.983+0000 7f13cbfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55626603f470 0x556266046aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:19.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.983+0000 7f13cbfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55626603f470 0x556266046aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.134:41536/0 (socket says 172.21.15.134:41536) 2024-04-24T02:15:19.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.983+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 learned_addr learned my addr 172.21.15.134:0/1819466628 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-24T02:15:19.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.983+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556266046fe0 con 0x55626603f470 2024-04-24T02:15:19.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.984+0000 7f13cbfff640 1 --2- 172.21.15.134:0/1819466628 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55626603f470 0x556266046aa0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f13bc073fd0 tx=0x7f13bc08dce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:19.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.984+0000 7f12a67fc640 1 -- 172.21.15.134:0/1819466628 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13bc087030 con 0x55626603f470 2024-04-24T02:15:19.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.984+0000 7f12a67fc640 1 -- 172.21.15.134:0/1819466628 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13bc05fd50 con 0x55626603f470 2024-04-24T02:15:19.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.984+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556266047270 con 0x55626603f470 2024-04-24T02:15:19.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.984+0000 7f12a67fc640 1 -- 172.21.15.134:0/1819466628 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13bc0726e0 con 0x55626603f470 2024-04-24T02:15:19.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.984+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556266049f20 con 0x55626603f470 2024-04-24T02:15:19.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.985+0000 7f12a67fc640 1 -- 172.21.15.134:0/1819466628 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f13bc0728a0 con 0x55626603f470 2024-04-24T02:15:19.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.985+0000 7f12a67fc640 1 --2- 172.21.15.134:0/1819466628 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f129c036900 0x7f129c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:19.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.985+0000 7f12a67fc640 1 -- 172.21.15.134:0/1819466628 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f13bc088070 con 0x55626603f470 2024-04-24T02:15:19.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.985+0000 7f13d1446640 1 --2- 172.21.15.134:0/1819466628 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f129c036900 0x7f129c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:19.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.985+0000 7f13d3146800 20 rados->read ofs=0 len=0 2024-04-24T02:15:20.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.985+0000 7f13d3146800 1 --2- 172.21.15.134:0/1819466628 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556266052640 0x556266054b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:20.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.985+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556266055250 con 0x556266052640 2024-04-24T02:15:20.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.985+0000 7f13d1446640 1 --2- 172.21.15.134:0/1819466628 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f129c036900 0x7f129c038dc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x55626601e560 tx=0x7f13cc01f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:20.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.985+0000 7f13d0c45640 1 --2- 172.21.15.134:0/1819466628 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556266052640 0x556266054b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:20.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.986+0000 7f13d0c45640 1 --2- 172.21.15.134:0/1819466628 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556266052640 0x556266054b00 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:20.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.986+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f13c402b070 con 0x556266052640 2024-04-24T02:15:20.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.986+0000 7f13d3146800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:15:20.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.986+0000 7f13d3146800 20 realm 2024-04-24T02:15:20.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.986+0000 7f13d3146800 20 rados->read ofs=0 len=0 2024-04-24T02:15:20.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.986+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556266055660 con 0x556266052640 2024-04-24T02:15:20.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.986+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f13c402b070 con 0x556266052640 2024-04-24T02:15:20.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.986+0000 7f13d3146800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:15:20.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.986+0000 7f13d3146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T02:15:20.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.986+0000 7f13d3146800 20 rados->read ofs=0 len=0 2024-04-24T02:15:20.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.986+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556266055f30 con 0x556266052640 2024-04-24T02:15:20.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.986+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f13c402b070 con 0x556266052640 2024-04-24T02:15:20.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.986+0000 7f13d3146800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:15:20.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.986+0000 7f13d3146800 20 rados->read ofs=0 len=0 2024-04-24T02:15:20.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.986+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562660562d0 con 0x556266052640 2024-04-24T02:15:20.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.987+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f13c402b070 con 0x556266052640 2024-04-24T02:15:20.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.987+0000 7f13d3146800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:15:20.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.987+0000 7f13d3146800 20 rados->read ofs=0 len=0 2024-04-24T02:15:20.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.987+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:5 5.19 5:9abc57be:::zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556266056b20 con 0x556266052640 2024-04-24T02:15:20.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.987+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 5 ==== osd_op_reply(5 zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 [read 0~993 out=993b] v0'0 uv6 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f13c402b070 con 0x556266052640 2024-04-24T02:15:20.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.987+0000 7f13d3146800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T02:15:20.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.987+0000 7f13d3146800 20 searching for the correct realm 2024-04-24T02:15:20.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.987+0000 7f13d3146800 1 --2- 172.21.15.134:0/1819466628 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x556266058890 0x55626605ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:20.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.987+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55626605b260 con 0x556266058890 2024-04-24T02:15:20.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.987+0000 7f13cbfff640 1 --2- 172.21.15.134:0/1819466628 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x556266058890 0x55626605ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:20.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.987+0000 7f13cbfff640 1 --2- 172.21.15.134:0/1819466628 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x556266058890 0x55626605ac80 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:20.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.988+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.988+0000 7f13cbfff640 1 --2- 172.21.15.134:0/1819466628 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f13bc082070 0x7f13bc05c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:20.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.988+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55626605b260 con 0x7f13bc082070 2024-04-24T02:15:20.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.988+0000 7f13d1446640 1 --2- 172.21.15.134:0/1819466628 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f13bc082070 0x7f13bc05c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:20.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.988+0000 7f13d1446640 1 --2- 172.21.15.134:0/1819466628 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f13bc082070 0x7f13bc05c5b0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:20.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.988+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13cc01f070 con 0x7f13bc082070 2024-04-24T02:15:20.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.988+0000 7f13d1446640 1 --2- 172.21.15.134:0/1819466628 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f13cc031040 0x7f13cc032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:20.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.988+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55626605b260 con 0x7f13cc031040 2024-04-24T02:15:20.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.989+0000 7f13d0c45640 1 --2- 172.21.15.134:0/1819466628 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f13cc031040 0x7f13cc032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:20.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.989+0000 7f13d0c45640 1 --2- 172.21.15.134:0/1819466628 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f13cc031040 0x7f13cc032940 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:20.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.989+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13c402b070 con 0x7f13cc031040 2024-04-24T02:15:20.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.989+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55626605b260 con 0x556266052640 2024-04-24T02:15:20.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.990+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13c402b070 con 0x556266052640 2024-04-24T02:15:20.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.990+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55626605b260 con 0x556266052640 2024-04-24T02:15:20.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.990+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f13c402b070 con 0x556266052640 2024-04-24T02:15:20.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.990+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55626605b260 con 0x7f13cc031040 2024-04-24T02:15:20.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.990+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13c402b070 con 0x7f13cc031040 2024-04-24T02:15:20.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.990+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55626605b260 con 0x7f13bc082070 2024-04-24T02:15:20.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.990+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13cc01f070 con 0x7f13bc082070 2024-04-24T02:15:20.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.990+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55626605b260 con 0x7f13bc082070 2024-04-24T02:15:20.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.991+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13cc01f070 con 0x7f13bc082070 2024-04-24T02:15:20.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.991+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55626605b260 con 0x556266058890 2024-04-24T02:15:20.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.991+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.991+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55626605b260 con 0x556266052640 2024-04-24T02:15:20.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.991+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13c402b070 con 0x556266052640 2024-04-24T02:15:20.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.991+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55626605b260 con 0x7f13cc031040 2024-04-24T02:15:20.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.991+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13c402b070 con 0x7f13cc031040 2024-04-24T02:15:20.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.991+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55626605b260 con 0x556266052640 2024-04-24T02:15:20.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.992+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13c402b070 con 0x556266052640 2024-04-24T02:15:20.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.992+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55626605b260 con 0x7f13bc082070 2024-04-24T02:15:20.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.992+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f13cc01f070 con 0x7f13bc082070 2024-04-24T02:15:20.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.992+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55626605b260 con 0x556266058890 2024-04-24T02:15:20.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.992+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.992+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55626605b260 con 0x556266058890 2024-04-24T02:15:20.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.992+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.992+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55626605b260 con 0x7f13bc082070 2024-04-24T02:15:20.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.993+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13cc01f070 con 0x7f13bc082070 2024-04-24T02:15:20.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.993+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55626605b260 con 0x556266058890 2024-04-24T02:15:20.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.993+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.993+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55626605b260 con 0x556266058890 2024-04-24T02:15:20.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.993+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.993+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55626605b260 con 0x556266052640 2024-04-24T02:15:20.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.993+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13c402b070 con 0x556266052640 2024-04-24T02:15:20.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.993+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55626605b260 con 0x556266052640 2024-04-24T02:15:20.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.993+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=132b] v32'6 uv6 ondisk = 1) ==== 144+0+132 (crc 0 0 0) 0x7f13c402b070 con 0x556266052640 2024-04-24T02:15:20.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.993+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55626605b260 con 0x7f13cc031040 2024-04-24T02:15:20.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.994+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13c402b070 con 0x7f13cc031040 2024-04-24T02:15:20.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.994+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55626605b260 con 0x556266058890 2024-04-24T02:15:20.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.994+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.994+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55626605b260 con 0x7f13bc082070 2024-04-24T02:15:20.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.994+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13cc01f070 con 0x7f13bc082070 2024-04-24T02:15:20.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.994+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55626605b260 con 0x556266052640 2024-04-24T02:15:20.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.995+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13c402b070 con 0x556266052640 2024-04-24T02:15:20.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.995+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55626605b260 con 0x7f13cc031040 2024-04-24T02:15:20.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.995+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=82b] v32'1 uv1 ondisk = 1) ==== 144+0+82 (crc 0 0 0) 0x7f13c402b070 con 0x7f13cc031040 2024-04-24T02:15:20.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.995+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55626605b260 con 0x556266058890 2024-04-24T02:15:20.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.995+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.995+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55626605b260 con 0x7f13cc031040 2024-04-24T02:15:20.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.996+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13c402b070 con 0x7f13cc031040 2024-04-24T02:15:20.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.996+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55626605b260 con 0x7f13bc082070 2024-04-24T02:15:20.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.996+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.996+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55626605b260 con 0x556266058890 2024-04-24T02:15:20.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.996+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.996+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55626605b260 con 0x7f13bc082070 2024-04-24T02:15:20.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.996+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.996+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55626605b260 con 0x556266052640 2024-04-24T02:15:20.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.997+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f13c402b070 con 0x556266052640 2024-04-24T02:15:20.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.997+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55626605b260 con 0x7f13bc082070 2024-04-24T02:15:20.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.997+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 9 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.997+0000 7f13d3146800 20 RGWRados::pool_iterate: got zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 2024-04-24T02:15:20.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.997+0000 7f13d3146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T02:15:20.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.997+0000 7f13d3146800 20 RGWRados::pool_iterate: got zone_info.582e5324-1512-4fe8-bc69-2f28bbcfaf89 2024-04-24T02:15:20.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.997+0000 7f13d3146800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T02:15:20.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.997+0000 7f13d3146800 20 RGWRados::pool_iterate: got period_config.default 2024-04-24T02:15:20.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.997+0000 7f13d3146800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T02:15:20.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.997+0000 7f13d3146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T02:15:20.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.997+0000 7f13d3146800 20 rados->read ofs=0 len=0 2024-04-24T02:15:20.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.997+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562660574a0 con 0x556266052640 2024-04-24T02:15:20.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.997+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f13c402b070 con 0x556266052640 2024-04-24T02:15:20.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.997+0000 7f13d3146800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:15:20.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.997+0000 7f13d3146800 20 rados->read ofs=0 len=0 2024-04-24T02:15:20.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.997+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556266057d40 con 0x556266052640 2024-04-24T02:15:20.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.997+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f13c402b070 con 0x556266052640 2024-04-24T02:15:20.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.997+0000 7f13d3146800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T02:15:20.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.997+0000 7f13d3146800 20 rados->read ofs=0 len=0 2024-04-24T02:15:20.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.997+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:40 5.4 5:2630e453:::zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556266057d40 con 0x556266052640 2024-04-24T02:15:20.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.998+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 16 ==== osd_op_reply(40 zonegroup_info.b893fd8a-cafc-4918-98fa-f8aa8e20a508 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.998+0000 7f13d3146800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T02:15:20.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.998+0000 7f13d3146800 20 zone default found 2024-04-24T02:15:20.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.998+0000 7f13d3146800 4 Realm: () 2024-04-24T02:15:20.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.998+0000 7f13d3146800 4 ZoneGroup: default (b893fd8a-cafc-4918-98fa-f8aa8e20a508) 2024-04-24T02:15:20.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.998+0000 7f13d3146800 4 Zone: default (582e5324-1512-4fe8-bc69-2f28bbcfaf89) 2024-04-24T02:15:20.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.998+0000 7f13d3146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T02:15:20.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.998+0000 7f13d3146800 20 zonegroup default 2024-04-24T02:15:20.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.998+0000 7f13d3146800 20 rados->read ofs=0 len=0 2024-04-24T02:15:20.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.998+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626605b6e0 con 0x7f13cc031040 2024-04-24T02:15:20.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.998+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 7 ==== osd_op_reply(41 period_config.default [read 0~187 out=187b] v0'0 uv1 ondisk = 0) ==== 165+0+187 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.998+0000 7f13d3146800 20 rados_obj.operate() r=0 bl.length=187 2024-04-24T02:15:20.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.998+0000 7f13d3146800 20 rados->read ofs=0 len=0 2024-04-24T02:15:20.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.998+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626605d570 con 0x556266058890 2024-04-24T02:15:20.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.999+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.999+0000 7f13d3146800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:15:20.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.999+0000 7f13d3146800 20 rados->read ofs=0 len=0 2024-04-24T02:15:20.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.999+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626605d910 con 0x556266058890 2024-04-24T02:15:20.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.999+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.999+0000 7f13d3146800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T02:15:20.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.999+0000 7f13d3146800 20 started sync module instance, tier type = 2024-04-24T02:15:20.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.999+0000 7f13d3146800 20 started zone id=582e5324-1512-4fe8-bc69-2f28bbcfaf89 (name=default) with tier type = 2024-04-24T02:15:20.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:19.999+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626605c9b0 con 0x7f13bc082070 2024-04-24T02:15:20.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.000+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 10 ==== osd_op_reply(44 notify.0 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.000+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93881106812240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626605d170 con 0x7f13bc082070 2024-04-24T02:15:20.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.000+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626605e610 con 0x556266052640 2024-04-24T02:15:20.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.001+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93881106812240] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.001+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 17 ==== osd_op_reply(46 notify.1 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.002+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93881106816176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626605e580 con 0x556266052640 2024-04-24T02:15:20.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.002+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626605f020 con 0x556266058890 2024-04-24T02:15:20.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.003+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93881106816176] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.003+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 12 ==== osd_op_reply(48 notify.2 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.003+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93881106817232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626605e4f0 con 0x556266058890 2024-04-24T02:15:20.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.003+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626605fdb0 con 0x7f13bc082070 2024-04-24T02:15:20.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.004+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 12 ==== osd_op_reply(50 notify.3 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.004+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93881106823360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556266060680 con 0x7f13bc082070 2024-04-24T02:15:20.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.004+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556266061170 con 0x556266052640 2024-04-24T02:15:20.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.004+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93881106817232] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.005+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93881106823360] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.007+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 19 ==== osd_op_reply(52 notify.4 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.007+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93881106828352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562660601d0 con 0x556266052640 2024-04-24T02:15:20.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.007+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556266061a10 con 0x7f13cc031040 2024-04-24T02:15:20.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.008+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 8 ==== osd_op_reply(54 notify.5 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.008+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93881106830368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556266061cf0 con 0x7f13cc031040 2024-04-24T02:15:20.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.008+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562660625a0 con 0x7f13cc031040 2024-04-24T02:15:20.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.008+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93881106828352] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.009+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 93881106830368] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.009+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 10 ==== osd_op_reply(56 notify.6 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.009+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93881106822160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556266061cf0 con 0x7f13cc031040 2024-04-24T02:15:20.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.009+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556266062e40 con 0x7f13cc031040 2024-04-24T02:15:20.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.010+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 93881106822160] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.010+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 12 ==== osd_op_reply(58 notify.7 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.010+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93881106831424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556266062c30 con 0x7f13cc031040 2024-04-24T02:15:20.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.010+0000 7f13d3146800 20 add_watcher() i=0 2024-04-24T02:15:20.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.010+0000 7f13d3146800 20 add_watcher() i=1 2024-04-24T02:15:20.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.010+0000 7f13d3146800 20 add_watcher() i=2 2024-04-24T02:15:20.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.010+0000 7f13d3146800 20 add_watcher() i=3 2024-04-24T02:15:20.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.010+0000 7f13d3146800 20 add_watcher() i=4 2024-04-24T02:15:20.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.010+0000 7f13d3146800 20 add_watcher() i=5 2024-04-24T02:15:20.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.010+0000 7f13d3146800 20 add_watcher() i=6 2024-04-24T02:15:20.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.011+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 93881106831424] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.011+0000 7f13d3146800 20 add_watcher() i=7 2024-04-24T02:15:20.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.011+0000 7f13d3146800 2 all 8 watchers are set, enabling cache 2024-04-24T02:15:20.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.011+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556266065da0 con 0x556266052640 2024-04-24T02:15:20.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.012+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.012+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93881106835328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556266063050 con 0x556266052640 2024-04-24T02:15:20.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.013+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93881106835328] v32'281 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.013+0000 7f1286fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:15:20.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.013+0000 7f13d3146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T02:15:20.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.013+0000 7f13d3146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T02:15:20.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.013+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562660654c0 con 0x556266052640 2024-04-24T02:15:20.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.014+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'61 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.014+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626606ee60 con 0x7f13cc031040 2024-04-24T02:15:20.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.015+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'38 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.015+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626606ee60 con 0x556266058890 2024-04-24T02:15:20.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.016+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'39 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.016+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626606f200 con 0x556266052640 2024-04-24T02:15:20.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.017+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'282 uv169 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.017+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626606f200 con 0x7f13bc082070 2024-04-24T02:15:20.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.018+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'91 uv58 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.018+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626606f770 con 0x556266058890 2024-04-24T02:15:20.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.019+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'70 uv48 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.019+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626606fb10 con 0x556266052640 2024-04-24T02:15:20.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.020+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.021+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626606fb10 con 0x7f13cc031040 2024-04-24T02:15:20.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.022+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 15 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'63 uv41 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.022+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626606fb10 con 0x7f13bc082070 2024-04-24T02:15:20.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.023+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.023+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562660700a0 con 0x556266058890 2024-04-24T02:15:20.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.024+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.024+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556266070440 con 0x7f13bc082070 2024-04-24T02:15:20.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.025+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'92 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.025+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556266070a10 con 0x7f13cc031040 2024-04-24T02:15:20.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.026+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'41 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.026+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556266070a10 con 0x7f13bc082070 2024-04-24T02:15:20.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.027+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'38 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.027+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556266070ec0 con 0x7f13cc031040 2024-04-24T02:15:20.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.028+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 17 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'74 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.028+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556266070ec0 con 0x556266052640 2024-04-24T02:15:20.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.029+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'283 uv171 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.029+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556266070ec0 con 0x556266058890 2024-04-24T02:15:20.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.031+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'83 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.031+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556266070ec0 con 0x7f13bc082070 2024-04-24T02:15:20.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.032+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'93 uv63 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.032+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556266070ec0 con 0x556266058890 2024-04-24T02:15:20.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.032+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'44 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.033+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556266070ec0 con 0x556266052640 2024-04-24T02:15:20.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.034+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'40 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.034+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556266070ec0 con 0x556266052640 2024-04-24T02:15:20.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.035+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'284 uv173 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.035+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556266070ec0 con 0x556266058890 2024-04-24T02:15:20.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.036+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'84 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.036+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556266070ec0 con 0x7f13bc082070 2024-04-24T02:15:20.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.037+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'47 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.037+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556266070ec0 con 0x556266058890 2024-04-24T02:15:20.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.038+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.038+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556266070ec0 con 0x556266058890 2024-04-24T02:15:20.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.039+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'49 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.039+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556266070ec0 con 0x556266058890 2024-04-24T02:15:20.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.040+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'34 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.040+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556266070ec0 con 0x556266058890 2024-04-24T02:15:20.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.041+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'71 uv50 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.041+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556266070ec0 con 0x7f13cc031040 2024-04-24T02:15:20.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.042+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 18 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.042+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556266070ec0 con 0x556266058890 2024-04-24T02:15:20.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.043+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'45 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.043+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556266070ec0 con 0x7f13cc031040 2024-04-24T02:15:20.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.044+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 19 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'64 uv43 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.044+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556266070ec0 con 0x556266058890 2024-04-24T02:15:20.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.045+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'85 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.045+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556266070ec0 con 0x7f13cc031040 2024-04-24T02:15:20.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.046+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 20 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'75 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.046+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556266070ec0 con 0x7f13bc082070 2024-04-24T02:15:20.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.047+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'38 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.047+0000 7f1285fe3640 20 reqs_thread_entry: start 2024-04-24T02:15:20.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.047+0000 7f13d3146800 20 init_complete bucket index max shards: 11 2024-04-24T02:15:20.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.048+0000 7f13d3146800 20 Filter name: none 2024-04-24T02:15:20.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.048+0000 7f11f77fe640 20 reqs_thread_entry: start 2024-04-24T02:15:20.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.048+0000 7f13d3146800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-04-24T02:15:20.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.048+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:94 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x556266058890 2024-04-24T02:15:20.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.049+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 26 ==== osd_op_reply(94 gc.5 [call] v32'72 uv72 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.049+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:95 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x556266058890 2024-04-24T02:15:20.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.049+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 27 ==== osd_op_reply(95 gc.5 [call out=15b] v0'0 uv72 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.049+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.049+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:96 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x556266058890 2024-04-24T02:15:20.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.049+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 28 ==== osd_op_reply(96 gc.5 [call out=24b] v0'0 uv72 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.049+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:97 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x556266058890 2024-04-24T02:15:20.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.050+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 29 ==== osd_op_reply(97 gc.5 [call out=15b] v0'0 uv72 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.050+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:15:20.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.050+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:98 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x556266058890 2024-04-24T02:15:20.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.050+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 30 ==== osd_op_reply(98 gc.5 [call out=15b] v0'0 uv72 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.050+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.050+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:99 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x556266058890 2024-04-24T02:15:20.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.051+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 31 ==== osd_op_reply(99 gc.5 [call] v32'73 uv73 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.051+0000 7f13d3146800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-04-24T02:15:20.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.051+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:100 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x556266052640 2024-04-24T02:15:20.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.052+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 29 ==== osd_op_reply(100 gc.6 [call] v32'40 uv40 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.052+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:101 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x556266052640 2024-04-24T02:15:20.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.053+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 30 ==== osd_op_reply(101 gc.6 [call out=15b] v0'0 uv40 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.053+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.053+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:102 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x556266052640 2024-04-24T02:15:20.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.053+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 31 ==== osd_op_reply(102 gc.6 [call out=24b] v0'0 uv40 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.053+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:103 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x556266052640 2024-04-24T02:15:20.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.053+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 32 ==== osd_op_reply(103 gc.6 [call out=15b] v0'0 uv40 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.053+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:15:20.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.053+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:104 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x556266052640 2024-04-24T02:15:20.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.053+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 33 ==== osd_op_reply(104 gc.6 [call out=15b] v0'0 uv40 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.053+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.053+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:105 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x556266052640 2024-04-24T02:15:20.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.055+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 34 ==== osd_op_reply(105 gc.6 [call] v32'41 uv41 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.055+0000 7f13d3146800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-04-24T02:15:20.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.055+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:106 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x7f13cc031040 2024-04-24T02:15:20.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.056+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 21 ==== osd_op_reply(106 gc.7 [call] v32'65 uv65 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.056+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:107 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x7f13cc031040 2024-04-24T02:15:20.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.056+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 22 ==== osd_op_reply(107 gc.7 [call out=15b] v0'0 uv65 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.056+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.056+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:108 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x7f13cc031040 2024-04-24T02:15:20.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.056+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 23 ==== osd_op_reply(108 gc.7 [call out=24b] v0'0 uv65 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.056+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:109 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x7f13cc031040 2024-04-24T02:15:20.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.056+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 24 ==== osd_op_reply(109 gc.7 [call out=15b] v0'0 uv65 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.057+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:15:20.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.057+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:110 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x7f13cc031040 2024-04-24T02:15:20.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.057+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 25 ==== osd_op_reply(110 gc.7 [call out=15b] v0'0 uv65 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.057+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.057+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:111 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x7f13cc031040 2024-04-24T02:15:20.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.058+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 26 ==== osd_op_reply(111 gc.7 [call] v32'66 uv66 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.058+0000 7f13d3146800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-04-24T02:15:20.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.058+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:112 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x7f13bc082070 2024-04-24T02:15:20.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.059+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 21 ==== osd_op_reply(112 gc.8 [call] v32'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.059+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:113 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x7f13bc082070 2024-04-24T02:15:20.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.059+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 22 ==== osd_op_reply(113 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.059+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.059+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:114 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x7f13bc082070 2024-04-24T02:15:20.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.059+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 23 ==== osd_op_reply(114 gc.8 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.060+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:115 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x7f13bc082070 2024-04-24T02:15:20.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.060+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 24 ==== osd_op_reply(115 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.060+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:15:20.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.060+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:116 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x7f13bc082070 2024-04-24T02:15:20.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.060+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 25 ==== osd_op_reply(116 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.060+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.060+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:117 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x7f13bc082070 2024-04-24T02:15:20.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.061+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 26 ==== osd_op_reply(117 gc.8 [call] v32'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.061+0000 7f13d3146800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-04-24T02:15:20.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.061+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:118 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x556266058890 2024-04-24T02:15:20.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.062+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 32 ==== osd_op_reply(118 gc.9 [call] v32'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.062+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:119 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x556266058890 2024-04-24T02:15:20.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.062+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 33 ==== osd_op_reply(119 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.062+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.062+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:120 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x556266058890 2024-04-24T02:15:20.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.062+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 34 ==== osd_op_reply(120 gc.9 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.062+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x556266058890 2024-04-24T02:15:20.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.063+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 35 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.063+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:15:20.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.063+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x556266058890 2024-04-24T02:15:20.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.063+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 36 ==== osd_op_reply(122 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.063+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.063+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x556266058890 2024-04-24T02:15:20.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.064+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 37 ==== osd_op_reply(123 gc.9 [call] v32'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.064+0000 7f13d3146800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-04-24T02:15:20.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.064+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x7f13bc082070 2024-04-24T02:15:20.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.065+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 27 ==== osd_op_reply(124 gc.10 [call] v32'94 uv94 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.065+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x7f13bc082070 2024-04-24T02:15:20.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.065+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 28 ==== osd_op_reply(125 gc.10 [call out=15b] v0'0 uv94 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.065+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.065+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x7f13bc082070 2024-04-24T02:15:20.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.065+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 29 ==== osd_op_reply(126 gc.10 [call out=24b] v0'0 uv94 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.065+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:127 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x7f13bc082070 2024-04-24T02:15:20.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.065+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 30 ==== osd_op_reply(127 gc.10 [call out=15b] v0'0 uv94 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.065+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:15:20.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.065+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:128 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x7f13bc082070 2024-04-24T02:15:20.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.066+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 31 ==== osd_op_reply(128 gc.10 [call out=15b] v0'0 uv94 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.066+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.066+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:129 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x7f13bc082070 2024-04-24T02:15:20.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.067+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 32 ==== osd_op_reply(129 gc.10 [call] v32'95 uv95 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.067+0000 7f13d3146800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-04-24T02:15:20.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.067+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:130 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x7f13cc031040 2024-04-24T02:15:20.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.068+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 27 ==== osd_op_reply(130 gc.11 [call] v32'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.068+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:131 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x7f13cc031040 2024-04-24T02:15:20.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.068+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 28 ==== osd_op_reply(131 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.068+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.068+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:132 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x7f13cc031040 2024-04-24T02:15:20.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.068+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 29 ==== osd_op_reply(132 gc.11 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.069+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:133 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x7f13cc031040 2024-04-24T02:15:20.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.069+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 30 ==== osd_op_reply(133 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.069+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:15:20.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.069+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:134 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x7f13cc031040 2024-04-24T02:15:20.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.069+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 31 ==== osd_op_reply(134 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.069+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.069+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:135 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x7f13cc031040 2024-04-24T02:15:20.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.070+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 32 ==== osd_op_reply(135 gc.11 [call] v32'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.070+0000 7f13d3146800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-04-24T02:15:20.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.070+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:136 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x7f13bc082070 2024-04-24T02:15:20.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.071+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 33 ==== osd_op_reply(136 gc.12 [call] v32'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.071+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:137 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x7f13bc082070 2024-04-24T02:15:20.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.071+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 34 ==== osd_op_reply(137 gc.12 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.071+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.071+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:138 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x7f13bc082070 2024-04-24T02:15:20.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.072+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 35 ==== osd_op_reply(138 gc.12 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.072+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:139 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x7f13bc082070 2024-04-24T02:15:20.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.072+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 36 ==== osd_op_reply(139 gc.12 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.072+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:15:20.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.072+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:140 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x7f13bc082070 2024-04-24T02:15:20.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.072+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 37 ==== osd_op_reply(140 gc.12 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.072+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.072+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:141 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x7f13bc082070 2024-04-24T02:15:20.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.073+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 38 ==== osd_op_reply(141 gc.12 [call] v32'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.073+0000 7f13d3146800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-04-24T02:15:20.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.073+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:142 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x7f13cc031040 2024-04-24T02:15:20.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.074+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 33 ==== osd_op_reply(142 gc.13 [call] v32'76 uv76 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.074+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:143 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x7f13cc031040 2024-04-24T02:15:20.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.074+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 34 ==== osd_op_reply(143 gc.13 [call out=15b] v0'0 uv76 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.074+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.074+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:144 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x7f13cc031040 2024-04-24T02:15:20.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.075+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 35 ==== osd_op_reply(144 gc.13 [call out=24b] v0'0 uv76 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.075+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:145 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x7f13cc031040 2024-04-24T02:15:20.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.075+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 36 ==== osd_op_reply(145 gc.13 [call out=15b] v0'0 uv76 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.075+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:15:20.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.075+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:146 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x7f13cc031040 2024-04-24T02:15:20.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.075+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 37 ==== osd_op_reply(146 gc.13 [call out=15b] v0'0 uv76 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.075+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.075+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:147 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x7f13cc031040 2024-04-24T02:15:20.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.076+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 38 ==== osd_op_reply(147 gc.13 [call] v32'77 uv77 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.076+0000 7f13d3146800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-04-24T02:15:20.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.076+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:148 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x556266052640 2024-04-24T02:15:20.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.077+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 35 ==== osd_op_reply(148 gc.14 [call] v32'285 uv285 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.077+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:149 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x556266052640 2024-04-24T02:15:20.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.078+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 36 ==== osd_op_reply(149 gc.14 [call out=15b] v0'0 uv285 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.078+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.078+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:150 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x556266052640 2024-04-24T02:15:20.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.078+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 37 ==== osd_op_reply(150 gc.14 [call out=24b] v0'0 uv285 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.078+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:151 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x556266052640 2024-04-24T02:15:20.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.078+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 38 ==== osd_op_reply(151 gc.14 [call out=15b] v0'0 uv285 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.078+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:15:20.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.078+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:152 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x556266052640 2024-04-24T02:15:20.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.078+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 39 ==== osd_op_reply(152 gc.14 [call out=15b] v0'0 uv285 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.078+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.078+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:153 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x556266052640 2024-04-24T02:15:20.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.079+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 40 ==== osd_op_reply(153 gc.14 [call] v32'286 uv286 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.079+0000 7f13d3146800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-04-24T02:15:20.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.079+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:154 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x556266058890 2024-04-24T02:15:20.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.081+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 38 ==== osd_op_reply(154 gc.15 [call] v32'86 uv86 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.081+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:155 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x556266058890 2024-04-24T02:15:20.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.081+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 39 ==== osd_op_reply(155 gc.15 [call out=15b] v0'0 uv86 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.081+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.081+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:156 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x556266058890 2024-04-24T02:15:20.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.081+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 40 ==== osd_op_reply(156 gc.15 [call out=24b] v0'0 uv86 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.081+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:157 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x556266058890 2024-04-24T02:15:20.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.082+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 41 ==== osd_op_reply(157 gc.15 [call out=15b] v0'0 uv86 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.082+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:15:20.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.082+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:158 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x556266058890 2024-04-24T02:15:20.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.082+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 42 ==== osd_op_reply(158 gc.15 [call out=15b] v0'0 uv86 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.082+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.082+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:159 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x556266058890 2024-04-24T02:15:20.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.083+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 43 ==== osd_op_reply(159 gc.15 [call] v32'87 uv87 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.083+0000 7f13d3146800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-04-24T02:15:20.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.083+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:160 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x7f13bc082070 2024-04-24T02:15:20.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.084+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 39 ==== osd_op_reply(160 gc.16 [call] v32'96 uv96 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.084+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:161 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x7f13bc082070 2024-04-24T02:15:20.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.084+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 40 ==== osd_op_reply(161 gc.16 [call out=15b] v0'0 uv96 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.084+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.084+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:162 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x7f13bc082070 2024-04-24T02:15:20.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.084+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 41 ==== osd_op_reply(162 gc.16 [call out=24b] v0'0 uv96 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.084+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:163 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x7f13bc082070 2024-04-24T02:15:20.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.085+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 42 ==== osd_op_reply(163 gc.16 [call out=15b] v0'0 uv96 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.085+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:15:20.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.085+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:164 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x7f13bc082070 2024-04-24T02:15:20.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.085+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 43 ==== osd_op_reply(164 gc.16 [call out=15b] v0'0 uv96 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.085+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.085+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:165 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x7f13bc082070 2024-04-24T02:15:20.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.086+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 44 ==== osd_op_reply(165 gc.16 [call] v32'97 uv97 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.086+0000 7f13d3146800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-04-24T02:15:20.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.086+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:166 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x556266058890 2024-04-24T02:15:20.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.087+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 44 ==== osd_op_reply(166 gc.17 [call] v32'45 uv45 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.087+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:167 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x556266058890 2024-04-24T02:15:20.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.087+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 45 ==== osd_op_reply(167 gc.17 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.087+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.087+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:168 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x556266058890 2024-04-24T02:15:20.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.087+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 46 ==== osd_op_reply(168 gc.17 [call out=24b] v0'0 uv45 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.087+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:169 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x556266058890 2024-04-24T02:15:20.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.088+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 47 ==== osd_op_reply(169 gc.17 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.088+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:15:20.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.088+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:170 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x556266058890 2024-04-24T02:15:20.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.088+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 48 ==== osd_op_reply(170 gc.17 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.088+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.088+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:171 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x556266058890 2024-04-24T02:15:20.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.089+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 49 ==== osd_op_reply(171 gc.17 [call] v32'46 uv46 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.089+0000 7f13d3146800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-04-24T02:15:20.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.089+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:172 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x556266052640 2024-04-24T02:15:20.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.090+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 41 ==== osd_op_reply(172 gc.18 [call] v32'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.090+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:173 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x556266052640 2024-04-24T02:15:20.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.090+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 42 ==== osd_op_reply(173 gc.18 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.090+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.090+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:174 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x556266052640 2024-04-24T02:15:20.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.090+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 43 ==== osd_op_reply(174 gc.18 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.090+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:175 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x556266052640 2024-04-24T02:15:20.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.091+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 44 ==== osd_op_reply(175 gc.18 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.091+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:15:20.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.091+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:176 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626606ea20 con 0x556266052640 2024-04-24T02:15:20.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.091+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 45 ==== osd_op_reply(176 gc.18 [call out=1716b] v0'0 uv41 ondisk = 0) ==== 149+0+1716 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.091+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-04-24T02:15:20.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.091+0000 7f13d3146800 20 garbage collection: RGWGC::process iterating over entry tag='582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.13630309748514607159', time=2024-04-24T02:15:28.133653+0000, chain.objs.size()=7 2024-04-24T02:15:20.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.091+0000 7f13d3146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.11__shadow_.G7BRYdTBZtHMqtlKIN9YpcAtZv8gWup_1 2024-04-24T02:15:20.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.091+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:177 3.9 3:91a0098a:::582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.11__shadow_.G7BRYdTBZtHMqtlKIN9YpcAtZv8gWup_1:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626609b490 con 0x556266058890 2024-04-24T02:15:20.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.091+0000 7f13d3146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.11__shadow_.G7BRYdTBZtHMqtlKIN9YpcAtZv8gWup_2 2024-04-24T02:15:20.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.091+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:178 3.35 3:ac48524d:::582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.11__shadow_.G7BRYdTBZtHMqtlKIN9YpcAtZv8gWup_2:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626609ba50 con 0x556266052640 2024-04-24T02:15:20.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.091+0000 7f13d3146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.11__shadow_.G7BRYdTBZtHMqtlKIN9YpcAtZv8gWup_3 2024-04-24T02:15:20.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.091+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:179 3.6 3:631bfa37:::582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.11__shadow_.G7BRYdTBZtHMqtlKIN9YpcAtZv8gWup_3:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562660a2d30 con 0x556266052640 2024-04-24T02:15:20.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.091+0000 7f13d3146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.11__shadow_.G7BRYdTBZtHMqtlKIN9YpcAtZv8gWup_4 2024-04-24T02:15:20.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.091+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:180 3.28 3:1557e9e7:::582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.11__shadow_.G7BRYdTBZtHMqtlKIN9YpcAtZv8gWup_4:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562660a55a0 con 0x556266058890 2024-04-24T02:15:20.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.091+0000 7f13d3146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.11__shadow_.G7BRYdTBZtHMqtlKIN9YpcAtZv8gWup_5 2024-04-24T02:15:20.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.091+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:181 3.25 3:a741bc4c:::582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.11__shadow_.G7BRYdTBZtHMqtlKIN9YpcAtZv8gWup_5:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562660a7e70 con 0x556266052640 2024-04-24T02:15:20.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.091+0000 7f13d3146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.11__shadow_.G7BRYdTBZtHMqtlKIN9YpcAtZv8gWup_6 2024-04-24T02:15:20.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.091+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:182 3.0 3:02992855:::582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.11__shadow_.G7BRYdTBZtHMqtlKIN9YpcAtZv8gWup_6:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562660aa340 con 0x7f13cc031040 2024-04-24T02:15:20.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.091+0000 7f13d3146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.11__shadow_.G7BRYdTBZtHMqtlKIN9YpcAtZv8gWup_7 2024-04-24T02:15:20.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.091+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:183 3.14 3:2b6961cf:::582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.11__shadow_.G7BRYdTBZtHMqtlKIN9YpcAtZv8gWup_7:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562660acf20 con 0x556266058890 2024-04-24T02:15:20.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.094+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 46 ==== osd_op_reply(179 582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.11__shadow_.G7BRYdTBZtHMqtlKIN9YpcAtZv8gWup_3 [call] v32'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.094+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 50 ==== osd_op_reply(180 582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.11__shadow_.G7BRYdTBZtHMqtlKIN9YpcAtZv8gWup_4 [call] v32'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.094+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 51 ==== osd_op_reply(183 582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.11__shadow_.G7BRYdTBZtHMqtlKIN9YpcAtZv8gWup_7 [call] v32'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.094+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 47 ==== osd_op_reply(181 582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.11__shadow_.G7BRYdTBZtHMqtlKIN9YpcAtZv8gWup_5 [call] v32'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.096+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 48 ==== osd_op_reply(178 582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.11__shadow_.G7BRYdTBZtHMqtlKIN9YpcAtZv8gWup_2 [call] v32'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.096+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 39 ==== osd_op_reply(182 582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.11__shadow_.G7BRYdTBZtHMqtlKIN9YpcAtZv8gWup_6 [call] v32'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.097+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 52 ==== osd_op_reply(177 582e5324-1512-4fe8-bc69-2f28bbcfaf89.4222.11__shadow_.G7BRYdTBZtHMqtlKIN9YpcAtZv8gWup_1 [call] v32'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.097+0000 7f13d3146800 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-24T02:15:20.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.097+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:184 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562660a1870 con 0x556266052640 2024-04-24T02:15:20.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.098+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 49 ==== osd_op_reply(184 gc.18 [call] v32'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.098+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:185 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562660a1870 con 0x556266052640 2024-04-24T02:15:20.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.099+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 50 ==== osd_op_reply(185 gc.18 [call] v32'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.099+0000 7f13d3146800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-04-24T02:15:20.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.099+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:186 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562660a1870 con 0x556266052640 2024-04-24T02:15:20.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.100+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 51 ==== osd_op_reply(186 gc.19 [call] v32'287 uv287 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.100+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:187 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562660a1870 con 0x556266052640 2024-04-24T02:15:20.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.101+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 52 ==== osd_op_reply(187 gc.19 [call out=15b] v0'0 uv287 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.101+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.101+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:188 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562660a1c50 con 0x556266052640 2024-04-24T02:15:20.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.101+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 53 ==== osd_op_reply(188 gc.19 [call out=24b] v0'0 uv287 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.101+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:189 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562660a1870 con 0x556266052640 2024-04-24T02:15:20.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.101+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 54 ==== osd_op_reply(189 gc.19 [call out=15b] v0'0 uv287 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.101+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:15:20.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.101+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:190 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562660a1870 con 0x556266052640 2024-04-24T02:15:20.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.101+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 55 ==== osd_op_reply(190 gc.19 [call out=15b] v0'0 uv287 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.101+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.101+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:191 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562660a1870 con 0x556266052640 2024-04-24T02:15:20.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.102+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 56 ==== osd_op_reply(191 gc.19 [call] v32'288 uv288 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.102+0000 7f13d3146800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-04-24T02:15:20.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.102+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:192 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562660a1870 con 0x556266058890 2024-04-24T02:15:20.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.104+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 53 ==== osd_op_reply(192 gc.20 [call] v32'88 uv88 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.104+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:193 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562660a1870 con 0x556266058890 2024-04-24T02:15:20.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.104+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 54 ==== osd_op_reply(193 gc.20 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.104+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.104+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:194 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562660a0860 con 0x556266058890 2024-04-24T02:15:20.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.104+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 55 ==== osd_op_reply(194 gc.20 [call out=24b] v0'0 uv88 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.104+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:195 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562660a1870 con 0x556266058890 2024-04-24T02:15:20.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.104+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 56 ==== osd_op_reply(195 gc.20 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.104+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:15:20.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.104+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:196 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562660a1870 con 0x556266058890 2024-04-24T02:15:20.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.105+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 57 ==== osd_op_reply(196 gc.20 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.105+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.105+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:197 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562660a1870 con 0x556266058890 2024-04-24T02:15:20.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.106+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 58 ==== osd_op_reply(197 gc.20 [call] v32'89 uv89 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.106+0000 7f13d3146800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-04-24T02:15:20.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.106+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:198 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562660a1870 con 0x7f13bc082070 2024-04-24T02:15:20.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.107+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 45 ==== osd_op_reply(198 gc.21 [call] v32'48 uv48 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.107+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:199 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562660a1870 con 0x7f13bc082070 2024-04-24T02:15:20.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.107+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 46 ==== osd_op_reply(199 gc.21 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.107+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.107+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:200 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562660a0860 con 0x7f13bc082070 2024-04-24T02:15:20.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.107+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 47 ==== osd_op_reply(200 gc.21 [call out=24b] v0'0 uv48 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.107+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:201 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562660a1870 con 0x7f13bc082070 2024-04-24T02:15:20.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.108+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 48 ==== osd_op_reply(201 gc.21 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.108+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:15:20.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.108+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:202 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562660a1870 con 0x7f13bc082070 2024-04-24T02:15:20.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.108+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 49 ==== osd_op_reply(202 gc.21 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.108+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.108+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:203 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562660a1870 con 0x7f13bc082070 2024-04-24T02:15:20.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.109+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 50 ==== osd_op_reply(203 gc.21 [call] v32'49 uv49 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.109+0000 7f13d3146800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-04-24T02:15:20.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.109+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:204 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562660a1870 con 0x556266058890 2024-04-24T02:15:20.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.110+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 59 ==== osd_op_reply(204 gc.22 [call] v32'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.110+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:205 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562660a1870 con 0x556266058890 2024-04-24T02:15:20.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.110+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 60 ==== osd_op_reply(205 gc.22 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.110+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.110+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:206 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562660a1c50 con 0x556266058890 2024-04-24T02:15:20.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.110+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 61 ==== osd_op_reply(206 gc.22 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.110+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:207 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562660a0860 con 0x556266058890 2024-04-24T02:15:20.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.110+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 62 ==== osd_op_reply(207 gc.22 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.110+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:15:20.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.110+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:208 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562660a1870 con 0x556266058890 2024-04-24T02:15:20.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.111+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 63 ==== osd_op_reply(208 gc.22 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.111+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.111+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:209 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562660a1870 con 0x556266058890 2024-04-24T02:15:20.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.112+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 64 ==== osd_op_reply(209 gc.22 [call] v32'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.112+0000 7f13d3146800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-04-24T02:15:20.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.112+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:210 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562660a1870 con 0x556266058890 2024-04-24T02:15:20.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.112+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 65 ==== osd_op_reply(210 gc.23 [call] v32'50 uv50 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.112+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:211 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562660a1870 con 0x556266058890 2024-04-24T02:15:20.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.113+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 66 ==== osd_op_reply(211 gc.23 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.113+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.113+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:212 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562660a1c70 con 0x556266058890 2024-04-24T02:15:20.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.113+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 67 ==== osd_op_reply(212 gc.23 [call out=24b] v0'0 uv50 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.113+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:213 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562660a0860 con 0x556266058890 2024-04-24T02:15:20.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.113+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 68 ==== osd_op_reply(213 gc.23 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.113+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:15:20.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.113+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:214 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562660a0860 con 0x556266058890 2024-04-24T02:15:20.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.114+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 69 ==== osd_op_reply(214 gc.23 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.114+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.114+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:215 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562660a1870 con 0x556266058890 2024-04-24T02:15:20.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.114+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 70 ==== osd_op_reply(215 gc.23 [call] v32'51 uv51 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.114+0000 7f13d3146800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-04-24T02:15:20.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.114+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:216 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562660a1870 con 0x556266058890 2024-04-24T02:15:20.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.115+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 71 ==== osd_op_reply(216 gc.24 [call] v32'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.115+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:217 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562660a1870 con 0x556266058890 2024-04-24T02:15:20.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.116+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 72 ==== osd_op_reply(217 gc.24 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.116+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.116+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:218 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562660a1c70 con 0x556266058890 2024-04-24T02:15:20.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.116+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 73 ==== osd_op_reply(218 gc.24 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.116+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:219 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562660a0860 con 0x556266058890 2024-04-24T02:15:20.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.116+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 74 ==== osd_op_reply(219 gc.24 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.116+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:15:20.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.116+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:220 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562660a0860 con 0x556266058890 2024-04-24T02:15:20.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.116+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 75 ==== osd_op_reply(220 gc.24 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.116+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.116+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:221 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562660a0860 con 0x556266058890 2024-04-24T02:15:20.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.117+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 76 ==== osd_op_reply(221 gc.24 [call] v32'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.117+0000 7f13d3146800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-04-24T02:15:20.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.117+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:222 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562660a1870 con 0x556266058890 2024-04-24T02:15:20.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.118+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 77 ==== osd_op_reply(222 gc.25 [call] v32'74 uv74 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.118+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:223 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562660a1870 con 0x556266058890 2024-04-24T02:15:20.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.118+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 78 ==== osd_op_reply(223 gc.25 [call out=15b] v0'0 uv74 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.118+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.118+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:224 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562660a1c70 con 0x556266058890 2024-04-24T02:15:20.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.118+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 79 ==== osd_op_reply(224 gc.25 [call out=24b] v0'0 uv74 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.119+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:225 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562660a0860 con 0x556266058890 2024-04-24T02:15:20.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.119+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 80 ==== osd_op_reply(225 gc.25 [call out=15b] v0'0 uv74 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.119+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:15:20.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.119+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:226 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562660a0860 con 0x556266058890 2024-04-24T02:15:20.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.119+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 81 ==== osd_op_reply(226 gc.25 [call out=15b] v0'0 uv74 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.119+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.119+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:227 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562660a1870 con 0x556266058890 2024-04-24T02:15:20.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.120+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 82 ==== osd_op_reply(227 gc.25 [call] v32'75 uv75 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.120+0000 7f13d3146800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-04-24T02:15:20.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.120+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:228 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562660a1870 con 0x7f13cc031040 2024-04-24T02:15:20.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.121+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 40 ==== osd_op_reply(228 gc.26 [call] v32'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.121+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:229 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562660a1870 con 0x7f13cc031040 2024-04-24T02:15:20.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.122+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 41 ==== osd_op_reply(229 gc.26 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.122+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.122+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:230 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562660a1c50 con 0x7f13cc031040 2024-04-24T02:15:20.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.122+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 42 ==== osd_op_reply(230 gc.26 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.122+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:231 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626609d260 con 0x7f13cc031040 2024-04-24T02:15:20.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.122+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 43 ==== osd_op_reply(231 gc.26 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.122+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:15:20.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.122+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:232 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x7f13cc031040 2024-04-24T02:15:20.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.123+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 44 ==== osd_op_reply(232 gc.26 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.123+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.123+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:233 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x7f13cc031040 2024-04-24T02:15:20.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.123+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 45 ==== osd_op_reply(233 gc.26 [call] v32'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.123+0000 7f13d3146800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-04-24T02:15:20.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.123+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:234 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x556266058890 2024-04-24T02:15:20.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.124+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 83 ==== osd_op_reply(234 gc.27 [call] v32'46 uv46 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.124+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:235 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x556266058890 2024-04-24T02:15:20.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.125+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 84 ==== osd_op_reply(235 gc.27 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.125+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.125+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:236 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626609d260 con 0x556266058890 2024-04-24T02:15:20.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.125+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 85 ==== osd_op_reply(236 gc.27 [call out=24b] v0'0 uv46 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.125+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:237 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x556266058890 2024-04-24T02:15:20.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.125+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 86 ==== osd_op_reply(237 gc.27 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.125+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:15:20.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.125+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:238 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x556266058890 2024-04-24T02:15:20.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.125+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 87 ==== osd_op_reply(238 gc.27 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.125+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.125+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:239 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x556266058890 2024-04-24T02:15:20.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.126+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 88 ==== osd_op_reply(239 gc.27 [call] v32'47 uv47 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.126+0000 7f13d3146800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-04-24T02:15:20.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.126+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:240 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x7f13cc031040 2024-04-24T02:15:20.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.127+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 46 ==== osd_op_reply(240 gc.28 [call] v32'67 uv67 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.127+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:241 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x7f13cc031040 2024-04-24T02:15:20.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.128+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 47 ==== osd_op_reply(241 gc.28 [call out=15b] v0'0 uv67 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.128+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.128+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:242 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626609d260 con 0x7f13cc031040 2024-04-24T02:15:20.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.128+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 48 ==== osd_op_reply(242 gc.28 [call out=24b] v0'0 uv67 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.128+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:243 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x7f13cc031040 2024-04-24T02:15:20.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.128+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 49 ==== osd_op_reply(243 gc.28 [call out=15b] v0'0 uv67 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.128+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:15:20.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.128+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:244 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x7f13cc031040 2024-04-24T02:15:20.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.128+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 50 ==== osd_op_reply(244 gc.28 [call out=15b] v0'0 uv67 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.128+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.128+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:245 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x7f13cc031040 2024-04-24T02:15:20.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.129+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 51 ==== osd_op_reply(245 gc.28 [call] v32'68 uv68 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.129+0000 7f13d3146800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-04-24T02:15:20.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.129+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:246 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x556266058890 2024-04-24T02:15:20.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.130+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 89 ==== osd_op_reply(246 gc.29 [call] v32'90 uv90 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.130+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:247 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x556266058890 2024-04-24T02:15:20.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.131+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 90 ==== osd_op_reply(247 gc.29 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.131+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.131+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:248 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626609d260 con 0x556266058890 2024-04-24T02:15:20.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.131+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 91 ==== osd_op_reply(248 gc.29 [call out=24b] v0'0 uv90 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.131+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:249 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x556266058890 2024-04-24T02:15:20.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.131+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 92 ==== osd_op_reply(249 gc.29 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.131+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:15:20.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.131+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:250 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x556266058890 2024-04-24T02:15:20.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.131+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 93 ==== osd_op_reply(250 gc.29 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.131+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.131+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:251 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x556266058890 2024-04-24T02:15:20.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.132+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 94 ==== osd_op_reply(251 gc.29 [call] v32'91 uv91 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.132+0000 7f13d3146800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-04-24T02:15:20.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.132+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:252 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x7f13cc031040 2024-04-24T02:15:20.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.133+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 52 ==== osd_op_reply(252 gc.30 [call] v32'78 uv78 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.133+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:253 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x7f13cc031040 2024-04-24T02:15:20.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.134+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 53 ==== osd_op_reply(253 gc.30 [call out=15b] v0'0 uv78 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.134+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.134+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:254 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626609d260 con 0x7f13cc031040 2024-04-24T02:15:20.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.134+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 54 ==== osd_op_reply(254 gc.30 [call out=24b] v0'0 uv78 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.134+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:255 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x7f13cc031040 2024-04-24T02:15:20.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.134+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 55 ==== osd_op_reply(255 gc.30 [call out=15b] v0'0 uv78 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.134+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:15:20.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.134+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:256 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x7f13cc031040 2024-04-24T02:15:20.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.134+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 56 ==== osd_op_reply(256 gc.30 [call out=15b] v0'0 uv78 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.134+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.134+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:257 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x7f13cc031040 2024-04-24T02:15:20.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.135+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 57 ==== osd_op_reply(257 gc.30 [call] v32'79 uv79 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.135+0000 7f13d3146800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-04-24T02:15:20.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.135+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:258 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x7f13bc082070 2024-04-24T02:15:20.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.137+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 51 ==== osd_op_reply(258 gc.31 [call] v32'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.137+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:259 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x7f13bc082070 2024-04-24T02:15:20.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.137+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 52 ==== osd_op_reply(259 gc.31 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.137+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.137+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:260 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626609d260 con 0x7f13bc082070 2024-04-24T02:15:20.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.137+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 53 ==== osd_op_reply(260 gc.31 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.137+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:261 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x7f13bc082070 2024-04-24T02:15:20.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.137+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 54 ==== osd_op_reply(261 gc.31 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.137+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:15:20.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.137+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:262 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x7f13bc082070 2024-04-24T02:15:20.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.137+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 55 ==== osd_op_reply(262 gc.31 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.137+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.137+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:263 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x7f13bc082070 2024-04-24T02:15:20.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.138+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 56 ==== osd_op_reply(263 gc.31 [call] v32'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.138+0000 7f13d3146800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-04-24T02:15:20.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.138+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:264 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x556266052640 2024-04-24T02:15:20.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.139+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 57 ==== osd_op_reply(264 gc.0 [call] v32'62 uv62 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.139+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:265 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x556266052640 2024-04-24T02:15:20.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.140+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 58 ==== osd_op_reply(265 gc.0 [call out=15b] v0'0 uv62 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.140+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.140+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:266 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626609d260 con 0x556266052640 2024-04-24T02:15:20.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.140+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 59 ==== osd_op_reply(266 gc.0 [call out=24b] v0'0 uv62 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.140+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:267 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x556266052640 2024-04-24T02:15:20.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.140+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 60 ==== osd_op_reply(267 gc.0 [call out=15b] v0'0 uv62 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.140+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:15:20.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.140+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:268 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x556266052640 2024-04-24T02:15:20.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.140+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 61 ==== osd_op_reply(268 gc.0 [call out=15b] v0'0 uv62 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.140+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.140+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:269 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x556266052640 2024-04-24T02:15:20.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.141+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 62 ==== osd_op_reply(269 gc.0 [call] v32'63 uv63 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.141+0000 7f13d3146800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-04-24T02:15:20.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.141+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:270 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x7f13cc031040 2024-04-24T02:15:20.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.142+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 58 ==== osd_op_reply(270 gc.1 [call] v32'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.142+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:271 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x7f13cc031040 2024-04-24T02:15:20.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.143+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 59 ==== osd_op_reply(271 gc.1 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.143+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.143+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:272 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626609d260 con 0x7f13cc031040 2024-04-24T02:15:20.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.143+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 60 ==== osd_op_reply(272 gc.1 [call out=24b] v0'0 uv39 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.143+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:273 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x7f13cc031040 2024-04-24T02:15:20.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.143+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 61 ==== osd_op_reply(273 gc.1 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.143+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:15:20.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.143+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:274 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x7f13cc031040 2024-04-24T02:15:20.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.143+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 62 ==== osd_op_reply(274 gc.1 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.143+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.143+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:275 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x7f13cc031040 2024-04-24T02:15:20.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.144+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 63 ==== osd_op_reply(275 gc.1 [call] v32'40 uv40 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.144+0000 7f13d3146800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-04-24T02:15:20.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.144+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:276 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x556266058890 2024-04-24T02:15:20.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.145+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 95 ==== osd_op_reply(276 gc.2 [call] v32'40 uv40 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.145+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:277 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x556266058890 2024-04-24T02:15:20.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.146+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 96 ==== osd_op_reply(277 gc.2 [call out=15b] v0'0 uv40 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.146+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.146+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:278 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626609d260 con 0x556266058890 2024-04-24T02:15:20.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.146+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 97 ==== osd_op_reply(278 gc.2 [call out=24b] v0'0 uv40 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.146+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:279 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x556266058890 2024-04-24T02:15:20.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.146+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 98 ==== osd_op_reply(279 gc.2 [call out=15b] v0'0 uv40 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.146+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:15:20.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.146+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:280 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x556266058890 2024-04-24T02:15:20.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.146+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 99 ==== osd_op_reply(280 gc.2 [call out=15b] v0'0 uv40 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.146+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.146+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:281 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x556266058890 2024-04-24T02:15:20.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.147+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 100 ==== osd_op_reply(281 gc.2 [call] v32'41 uv41 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.147+0000 7f13d3146800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-04-24T02:15:20.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.147+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:282 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x556266052640 2024-04-24T02:15:20.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.148+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 63 ==== osd_op_reply(282 gc.3 [call] v32'289 uv289 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.148+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:283 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x556266052640 2024-04-24T02:15:20.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.148+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 64 ==== osd_op_reply(283 gc.3 [call out=15b] v0'0 uv289 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.148+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.148+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:284 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626609d260 con 0x556266052640 2024-04-24T02:15:20.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.148+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 65 ==== osd_op_reply(284 gc.3 [call out=24b] v0'0 uv289 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.149+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:285 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x556266052640 2024-04-24T02:15:20.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.149+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 66 ==== osd_op_reply(285 gc.3 [call out=15b] v0'0 uv289 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.149+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:15:20.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.149+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:286 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x556266052640 2024-04-24T02:15:20.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.149+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 67 ==== osd_op_reply(286 gc.3 [call out=15b] v0'0 uv289 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.149+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.149+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:287 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x556266052640 2024-04-24T02:15:20.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.150+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 68 ==== osd_op_reply(287 gc.3 [call] v32'290 uv290 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.150+0000 7f13d3146800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-04-24T02:15:20.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.150+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:288 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x7f13bc082070 2024-04-24T02:15:20.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.151+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 57 ==== osd_op_reply(288 gc.4 [call] v32'98 uv98 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.151+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:289 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x7f13bc082070 2024-04-24T02:15:20.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.151+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 58 ==== osd_op_reply(289 gc.4 [call out=15b] v0'0 uv98 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.151+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.151+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:290 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626609d260 con 0x7f13bc082070 2024-04-24T02:15:20.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.151+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 59 ==== osd_op_reply(290 gc.4 [call out=24b] v0'0 uv98 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.151+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:291 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x7f13bc082070 2024-04-24T02:15:20.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.152+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 60 ==== osd_op_reply(291 gc.4 [call out=15b] v0'0 uv98 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.152+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T02:15:20.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.152+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:292 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x7f13bc082070 2024-04-24T02:15:20.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.152+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 61 ==== osd_op_reply(292 gc.4 [call out=15b] v0'0 uv98 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.152+0000 7f13d3146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T02:15:20.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.152+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:293 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626609e270 con 0x7f13bc082070 2024-04-24T02:15:20.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.153+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 62 ==== osd_op_reply(293 gc.4 [call] v32'99 uv99 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.153+0000 7f1286fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T02:15:20.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.153+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93881106835328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626609af90 con 0x556266052640 2024-04-24T02:15:20.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.154+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 69 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 93881106835328] v32'291 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.154+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93881106812240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556266062780 con 0x7f13bc082070 2024-04-24T02:15:20.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.155+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 63 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 93881106812240] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.155+0000 7f13d3146800 20 remove_watcher() i=0 2024-04-24T02:15:20.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.155+0000 7f13d3146800 2 removed watcher, disabling cache 2024-04-24T02:15:20.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.155+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93881106816176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556266062780 con 0x556266052640 2024-04-24T02:15:20.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.157+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 70 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 93881106816176] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.157+0000 7f13d3146800 20 remove_watcher() i=1 2024-04-24T02:15:20.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.157+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93881106817232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626605dcb0 con 0x556266058890 2024-04-24T02:15:20.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.158+0000 7f13cbfff640 1 -- 172.21.15.134:0/1819466628 <== osd.3 v2:172.21.15.134:6801/3585115521 101 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 93881106817232] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13bc071030 con 0x556266058890 2024-04-24T02:15:20.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.158+0000 7f13d3146800 20 remove_watcher() i=2 2024-04-24T02:15:20.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.158+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93881106823360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556266062780 con 0x7f13bc082070 2024-04-24T02:15:20.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.159+0000 7f13d1446640 1 -- 172.21.15.134:0/1819466628 <== osd.2 v2:172.21.15.134:6800/214480313 64 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 93881106823360] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13cc040040 con 0x7f13bc082070 2024-04-24T02:15:20.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.159+0000 7f13d3146800 20 remove_watcher() i=3 2024-04-24T02:15:20.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.159+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93881106828352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626605f8c0 con 0x556266052640 2024-04-24T02:15:20.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.160+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.1 v2:172.21.15.134:6804/1487076214 71 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 93881106828352] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x556266052640 2024-04-24T02:15:20.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.160+0000 7f13d3146800 20 remove_watcher() i=4 2024-04-24T02:15:20.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.160+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93881106830368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556266062780 con 0x7f13cc031040 2024-04-24T02:15:20.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.161+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 64 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 93881106830368] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.161+0000 7f13d3146800 20 remove_watcher() i=5 2024-04-24T02:15:20.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.161+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93881106822160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556266060c40 con 0x7f13cc031040 2024-04-24T02:15:20.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.162+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 65 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 93881106822160] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.162+0000 7f13d3146800 20 remove_watcher() i=6 2024-04-24T02:15:20.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.162+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93881106831424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55626605f8c0 con 0x7f13cc031040 2024-04-24T02:15:20.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.163+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 <== osd.0 v2:172.21.15.104:6800/2419146313 66 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 93881106831424] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13c4053040 con 0x7f13cc031040 2024-04-24T02:15:20.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.163+0000 7f13d3146800 20 remove_watcher() i=7 2024-04-24T02:15:20.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.163+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f13cc031040 msgr2=0x7f13cc032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:20.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.163+0000 7f13d3146800 1 --2- 172.21.15.134:0/1819466628 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7f13cc031040 0x7f13cc032940 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:20.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.163+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556266052640 msgr2=0x556266054b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:20.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.163+0000 7f13d3146800 1 --2- 172.21.15.134:0/1819466628 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556266052640 0x556266054b00 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:20.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.163+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f13bc082070 msgr2=0x7f13bc05c5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:20.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.163+0000 7f13d3146800 1 --2- 172.21.15.134:0/1819466628 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f13bc082070 0x7f13bc05c5b0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:20.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.163+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x556266058890 msgr2=0x55626605ac80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:20.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.163+0000 7f13d3146800 1 --2- 172.21.15.134:0/1819466628 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x556266058890 0x55626605ac80 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:20.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.164+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f129c036900 msgr2=0x7f129c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:20.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.164+0000 7f13d3146800 1 --2- 172.21.15.134:0/1819466628 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f129c036900 0x7f129c038dc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x55626601e560 tx=0x7f13cc01f000 comp rx=0 tx=0).stop 2024-04-24T02:15:20.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.164+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55626603f470 msgr2=0x556266046aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:20.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.164+0000 7f13d0c45640 1 -- 172.21.15.134:0/1819466628 reap_dead start 2024-04-24T02:15:20.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.164+0000 7f13d3146800 1 --2- 172.21.15.134:0/1819466628 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55626603f470 0x556266046aa0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f13bc073fd0 tx=0x7f13bc08dce0 comp rx=0 tx=0).stop 2024-04-24T02:15:20.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.164+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 shutdown_connections 2024-04-24T02:15:20.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.164+0000 7f13d3146800 1 --2- 172.21.15.134:0/1819466628 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55626603f470 0x556266046aa0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:20.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.164+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 >> 172.21.15.134:0/1819466628 conn(0x55626603b7d0 msgr2=0x556266038e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:15:20.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.164+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 shutdown_connections 2024-04-24T02:15:20.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.164+0000 7f13d3146800 1 -- 172.21.15.134:0/1819466628 wait complete. 2024-04-24T02:15:20.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.164+0000 7f13d3146800 1 -- 172.21.15.134:0/2603865376 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f12a8036950 msgr2=0x7f12a8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:20.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.164+0000 7f13d3146800 1 --2- 172.21.15.134:0/2603865376 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f12a8036950 0x7f12a8038e10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x556266022220 tx=0x7f13cc005840 comp rx=0 tx=0).stop 2024-04-24T02:15:20.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.164+0000 7f13d3146800 1 -- 172.21.15.134:0/2603865376 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556266032210 msgr2=0x556266032630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:20.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.164+0000 7f13d3146800 1 --2- 172.21.15.134:0/2603865376 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556266032210 0x556266032630 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f13bc044840 tx=0x7f13bc002fb0 comp rx=0 tx=0).stop 2024-04-24T02:15:20.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.164+0000 7f13d3146800 1 -- 172.21.15.134:0/2603865376 shutdown_connections 2024-04-24T02:15:20.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.164+0000 7f13d3146800 1 --2- 172.21.15.134:0/2603865376 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f12a8036950 0x7f12a8038e10 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:20.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.164+0000 7f13d3146800 1 --2- 172.21.15.134:0/2603865376 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556266032210 0x556266032630 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:20.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.164+0000 7f13d3146800 1 -- 172.21.15.134:0/2603865376 >> 172.21.15.134:0/2603865376 conn(0x5562660262b0 msgr2=0x5562660266b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:15:20.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.164+0000 7f13d3146800 1 -- 172.21.15.134:0/2603865376 shutdown_connections 2024-04-24T02:15:20.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.164+0000 7f13d3146800 1 -- 172.21.15.134:0/2603865376 wait complete. 2024-04-24T02:15:20.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.164+0000 7f13d3146800 1 -- 172.21.15.134:0/4070345416 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556265f23130 msgr2=0x556266021040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:20.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.164+0000 7f13d3146800 1 --2- 172.21.15.134:0/4070345416 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556265f23130 0x556266021040 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:20.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.164+0000 7f13d3146800 1 -- 172.21.15.134:0/4070345416 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f12b8036950 msgr2=0x7f12b8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:20.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.164+0000 7f13d3146800 1 --2- 172.21.15.134:0/4070345416 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f12b8036950 0x7f12b8038e10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f13bc054000 tx=0x7f13bc04e000 comp rx=0 tx=0).stop 2024-04-24T02:15:20.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.164+0000 7f13d3146800 1 -- 172.21.15.134:0/4070345416 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556265e921c0 msgr2=0x556266019e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:20.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.164+0000 7f13d3146800 1 --2- 172.21.15.134:0/4070345416 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556265e921c0 0x556266019e00 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f13c400c010 tx=0x7f13c4000ed0 comp rx=0 tx=0).stop 2024-04-24T02:15:20.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.165+0000 7f13d3146800 1 -- 172.21.15.134:0/4070345416 shutdown_connections 2024-04-24T02:15:20.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.165+0000 7f13d3146800 1 --2- 172.21.15.134:0/4070345416 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x556265f23130 0x556266021040 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:20.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.165+0000 7f13d3146800 1 --2- 172.21.15.134:0/4070345416 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f12b8036950 0x7f12b8038e10 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:20.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.165+0000 7f13d3146800 1 --2- 172.21.15.134:0/4070345416 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556265e921c0 0x556266019e00 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:20.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.165+0000 7f13d3146800 1 -- 172.21.15.134:0/4070345416 >> 172.21.15.134:0/4070345416 conn(0x556265f19380 msgr2=0x556265f1e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:15:20.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.165+0000 7f13d3146800 1 -- 172.21.15.134:0/4070345416 shutdown_connections 2024-04-24T02:15:20.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-24T02:15:20.165+0000 7f13d3146800 1 -- 172.21.15.134:0/4070345416 wait complete. 2024-04-24T02:15:20.175 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-24T02:15:20.183 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-24T02:15:20.184 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T02:15:20.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.281+0000 7f11e8a4a640 1 Processor -- start 2024-04-24T02:15:20.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.282+0000 7f11e8a4a640 1 -- start start 2024-04-24T02:15:20.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.282+0000 7f11e8a4a640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f11e41287d0 0x7f11e4130360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:20.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.282+0000 7f11e8a4a640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11e4127b00 con 0x7f11e4127ce0 2024-04-24T02:15:20.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.282+0000 7f11e8a4a640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f11e40708e0 con 0x7f11e41287d0 2024-04-24T02:15:20.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.282+0000 7f11e1d9b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f11e41287d0 0x7f11e4130360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:20.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.282+0000 7f11e259c640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f11e4127ce0 0x7f11e41280c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:46556/0 (socket says 172.21.15.104:46556) 2024-04-24T02:15:20.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.282+0000 7f11e259c640 1 -- 172.21.15.104:0/3428920112 learned_addr learned my addr 172.21.15.104:0/3428920112 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-04-24T02:15:20.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.283+0000 7f11e1d9b640 1 -- 172.21.15.104:0/3428920112 >> v1:172.21.15.104:6789/0 conn(0x7f11e4127ce0 legacy=0x7f11e41280c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:20.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.283+0000 7f11e1d9b640 1 -- 172.21.15.104:0/3428920112 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11e4098800 con 0x7f11e41287d0 2024-04-24T02:15:20.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.283+0000 7f11e159a640 1 -- 172.21.15.104:0/3428920112 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 67537606 0 0) 0x7f11d8001110 con 0x7f11e4127ce0 2024-04-24T02:15:20.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.283+0000 7f11e1d9b640 1 --2- 172.21.15.104:0/3428920112 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f11e41287d0 0x7f11e4130360 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f11d4009750 tx=0x7f11d402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84952541252f5b54 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:20.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.283+0000 7f11e159a640 1 -- 172.21.15.104:0/3428920112 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11d40316d0 con 0x7f11e41287d0 2024-04-24T02:15:20.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.283+0000 7f11e159a640 1 -- 172.21.15.104:0/3428920112 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11d4037070 con 0x7f11e41287d0 2024-04-24T02:15:20.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.283+0000 7f11e159a640 1 -- 172.21.15.104:0/3428920112 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11d40319c0 con 0x7f11e41287d0 2024-04-24T02:15:20.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.284+0000 7f11e8a4a640 1 -- 172.21.15.104:0/3428920112 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f11e41287d0 msgr2=0x7f11e4130360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:20.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.284+0000 7f11e8a4a640 1 --2- 172.21.15.104:0/3428920112 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f11e41287d0 0x7f11e4130360 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f11d4009750 tx=0x7f11d402b840 comp rx=0 tx=0).stop 2024-04-24T02:15:20.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.284+0000 7f11e8a4a640 1 -- 172.21.15.104:0/3428920112 shutdown_connections 2024-04-24T02:15:20.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.284+0000 7f11e8a4a640 1 --2- 172.21.15.104:0/3428920112 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f11e41287d0 0x7f11e4130360 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:20.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.284+0000 7f11e8a4a640 1 -- 172.21.15.104:0/3428920112 >> 172.21.15.104:0/3428920112 conn(0x7f11e4099680 msgr2=0x7f11e4099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:15:20.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.284+0000 7f11e8a4a640 1 -- 172.21.15.104:0/3428920112 shutdown_connections 2024-04-24T02:15:20.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.284+0000 7f11e8a4a640 1 -- 172.21.15.104:0/3428920112 wait complete. 2024-04-24T02:15:20.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.285+0000 7f11e8a4a640 1 Processor -- start 2024-04-24T02:15:20.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.285+0000 7f11e8a4a640 1 -- start start 2024-04-24T02:15:20.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.285+0000 7f11e8a4a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f11e4127ce0 0x7f11e4124550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:20.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.285+0000 7f11e8a4a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f11e406faa0 con 0x7f11e4127ce0 2024-04-24T02:15:20.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.285+0000 7f11e259c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f11e4127ce0 0x7f11e4124550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:20.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.285+0000 7f11e259c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f11e4127ce0 0x7f11e4124550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54264/0 (socket says 172.21.15.104:54264) 2024-04-24T02:15:20.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.286+0000 7f11e259c640 1 -- 172.21.15.104:0/3644560805 learned_addr learned my addr 172.21.15.104:0/3644560805 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:15:20.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.286+0000 7f11e259c640 1 -- 172.21.15.104:0/3644560805 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11e4130250 con 0x7f11e4127ce0 2024-04-24T02:15:20.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.286+0000 7f11e259c640 1 --2- 172.21.15.104:0/3644560805 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f11e4127ce0 0x7f11e4124550 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f11d800c700 tx=0x7f11d800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:20.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.286+0000 7f11d2ffd640 1 -- 172.21.15.104:0/3644560805 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11d8018070 con 0x7f11e4127ce0 2024-04-24T02:15:20.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.286+0000 7f11d2ffd640 1 -- 172.21.15.104:0/3644560805 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11d80070d0 con 0x7f11e4127ce0 2024-04-24T02:15:20.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.286+0000 7f11e8a4a640 1 -- 172.21.15.104:0/3644560805 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11e4096bc0 con 0x7f11e4127ce0 2024-04-24T02:15:20.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.286+0000 7f11d2ffd640 1 -- 172.21.15.104:0/3644560805 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11d80073f0 con 0x7f11e4127ce0 2024-04-24T02:15:20.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.286+0000 7f11e8a4a640 1 -- 172.21.15.104:0/3644560805 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11e4129e40 con 0x7f11e4127ce0 2024-04-24T02:15:20.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.287+0000 7f11d2ffd640 1 -- 172.21.15.104:0/3644560805 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f11d801b070 con 0x7f11e4127ce0 2024-04-24T02:15:20.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.287+0000 7f11e8a4a640 1 -- 172.21.15.104:0/3644560805 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11e4130820 con 0x7f11e4127ce0 2024-04-24T02:15:20.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.287+0000 7f11d2ffd640 1 --2- 172.21.15.104:0/3644560805 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f11c4038090 0x7f11c403a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:20.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.287+0000 7f11d2ffd640 1 -- 172.21.15.104:0/3644560805 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f11d804ac80 con 0x7f11e4127ce0 2024-04-24T02:15:20.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.287+0000 7f11e1d9b640 1 --2- 172.21.15.104:0/3644560805 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f11c4038090 0x7f11c403a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:20.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.288+0000 7f11e1d9b640 1 --2- 172.21.15.104:0/3644560805 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f11c4038090 0x7f11c403a550 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f11d4036000 tx=0x7f11d4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:20.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.292+0000 7f11d2ffd640 1 -- 172.21.15.104:0/3644560805 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f11d8050020 con 0x7f11e4127ce0 2024-04-24T02:15:20.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.460+0000 7f11e8a4a640 1 -- 172.21.15.104:0/3644560805 --> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f11e4062da0 con 0x7f11c4038090 2024-04-24T02:15:20.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.475+0000 7f11d2ffd640 1 -- 172.21.15.104:0/3644560805 <== mgr.4101 v2:172.21.15.134:6824/3655027977 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665463 (secure 0 0 0) 0x7f11e4062da0 con 0x7f11c4038090 2024-04-24T02:15:20.485 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:15:20.491 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-04-24T02:15:20.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.480+0000 7f11e8a4a640 1 -- 172.21.15.104:0/3644560805 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f11c4038090 msgr2=0x7f11c403a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:20.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.480+0000 7f11e8a4a640 1 --2- 172.21.15.104:0/3644560805 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f11c4038090 0x7f11c403a550 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f11d4036000 tx=0x7f11d4008030 comp rx=0 tx=0).stop 2024-04-24T02:15:20.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.480+0000 7f11e8a4a640 1 -- 172.21.15.104:0/3644560805 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f11e4127ce0 msgr2=0x7f11e4124550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:20.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.480+0000 7f11e8a4a640 1 --2- 172.21.15.104:0/3644560805 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f11e4127ce0 0x7f11e4124550 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f11d800c700 tx=0x7f11d800cbc0 comp rx=0 tx=0).stop 2024-04-24T02:15:20.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.480+0000 7f11e8a4a640 1 -- 172.21.15.104:0/3644560805 shutdown_connections 2024-04-24T02:15:20.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.480+0000 7f11e8a4a640 1 --2- 172.21.15.104:0/3644560805 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f11c4038090 0x7f11c403a550 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:20.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.480+0000 7f11e8a4a640 1 --2- 172.21.15.104:0/3644560805 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f11e4127ce0 0x7f11e4124550 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:20.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.480+0000 7f11e8a4a640 1 -- 172.21.15.104:0/3644560805 >> 172.21.15.104:0/3644560805 conn(0x7f11e4099680 msgr2=0x7f11e409a660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:15:20.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.480+0000 7f11e8a4a640 1 -- 172.21.15.104:0/3644560805 shutdown_connections 2024-04-24T02:15:20.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.480+0000 7f11e8a4a640 1 -- 172.21.15.104:0/3644560805 wait complete. 2024-04-24T02:15:20.495 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":135,"stamp":"2024-04-24T02:15:20.022016+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412790,"num_objects":259,"num_object_clones":0,"num_object_copies":518,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":259,"num_whiteouts":0,"num_read":5169,"num_read_kb":4718,"num_write":2296,"num_write_kb":61372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4672,"ondisk_log_size":4672,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":198728,"kb_used_data":53224,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377288632,"statfs":{"total":386547056640,"available":386343559168,"internally_reserved":0,"allocated":54501376,"data_stored":53330744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25811688,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":452,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004182"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.810958+0000","last_change":"2024-04-24T02:12:02.755215+0000","last_active":"2024-04-24T02:12:45.810958+0000","last_peered":"2024-04-24T02:12:45.810958+0000","last_clean":"2024-04-24T02:12:45.810958+0000","last_became_active":"2024-04-24T02:12:02.754954+0000","last_became_peered":"2024-04-24T02:12:02.754954+0000","last_unstale":"2024-04-24T02:12:45.810958+0000","last_undegraded":"2024-04-24T02:12:45.810958+0000","last_fullsized":"2024-04-24T02:12:45.810958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:57:48.477966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'8","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.464744+0000","last_change":"2024-04-24T02:12:04.754671+0000","last_active":"2024-04-24T02:15:13.464744+0000","last_peered":"2024-04-24T02:15:13.464744+0000","last_clean":"2024-04-24T02:15:13.464744+0000","last_became_active":"2024-04-24T02:12:04.754049+0000","last_became_peered":"2024-04-24T02:12:04.754049+0000","last_unstale":"2024-04-24T02:15:13.464744+0000","last_undegraded":"2024-04-24T02:15:13.464744+0000","last_fullsized":"2024-04-24T02:15:13.464744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:01:31.183580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.806164+0000","last_change":"2024-04-24T02:12:02.746058+0000","last_active":"2024-04-24T02:12:45.806164+0000","last_peered":"2024-04-24T02:12:45.806164+0000","last_clean":"2024-04-24T02:12:45.806164+0000","last_became_active":"2024-04-24T02:12:02.745526+0000","last_became_peered":"2024-04-24T02:12:02.745526+0000","last_unstale":"2024-04-24T02:12:45.806164+0000","last_undegraded":"2024-04-24T02:12:45.806164+0000","last_fullsized":"2024-04-24T02:12:45.806164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:29:06.156277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'12","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.465045+0000","last_change":"2024-04-24T02:12:04.763554+0000","last_active":"2024-04-24T02:15:13.465045+0000","last_peered":"2024-04-24T02:15:13.465045+0000","last_clean":"2024-04-24T02:15:13.465045+0000","last_became_active":"2024-04-24T02:12:04.762967+0000","last_became_peered":"2024-04-24T02:12:04.762967+0000","last_unstale":"2024-04-24T02:15:13.465045+0000","last_undegraded":"2024-04-24T02:15:13.465045+0000","last_fullsized":"2024-04-24T02:15:13.465045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:22:18.407526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":62,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.812393+0000","last_change":"2024-04-24T02:12:02.761596+0000","last_active":"2024-04-24T02:12:45.812393+0000","last_peered":"2024-04-24T02:12:45.812393+0000","last_clean":"2024-04-24T02:12:45.812393+0000","last_became_active":"2024-04-24T02:12:02.758985+0000","last_became_peered":"2024-04-24T02:12:02.758985+0000","last_unstale":"2024-04-24T02:12:45.812393+0000","last_undegraded":"2024-04-24T02:12:45.812393+0000","last_fullsized":"2024-04-24T02:12:45.812393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:31:31.121870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'6","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:29.125840+0000","last_change":"2024-04-24T02:12:04.765577+0000","last_active":"2024-04-24T02:13:29.125840+0000","last_peered":"2024-04-24T02:13:29.125840+0000","last_clean":"2024-04-24T02:13:29.125840+0000","last_became_active":"2024-04-24T02:12:04.765327+0000","last_became_peered":"2024-04-24T02:12:04.765327+0000","last_unstale":"2024-04-24T02:13:29.125840+0000","last_undegraded":"2024-04-24T02:13:29.125840+0000","last_fullsized":"2024-04-24T02:13:29.125840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:25:46.401212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.806962+0000","last_change":"2024-04-24T02:12:02.745643+0000","last_active":"2024-04-24T02:12:45.806962+0000","last_peered":"2024-04-24T02:12:45.806962+0000","last_clean":"2024-04-24T02:12:45.806962+0000","last_became_active":"2024-04-24T02:12:02.744804+0000","last_became_peered":"2024-04-24T02:12:02.744804+0000","last_unstale":"2024-04-24T02:12:45.806962+0000","last_undegraded":"2024-04-24T02:12:45.806962+0000","last_fullsized":"2024-04-24T02:12:45.806962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:05:35.109941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.167795+0000","last_change":"2024-04-24T02:12:04.763357+0000","last_active":"2024-04-24T02:15:13.167795+0000","last_peered":"2024-04-24T02:15:13.167795+0000","last_clean":"2024-04-24T02:15:13.167795+0000","last_became_active":"2024-04-24T02:12:04.763076+0000","last_became_peered":"2024-04-24T02:12:04.763076+0000","last_unstale":"2024-04-24T02:15:13.167795+0000","last_undegraded":"2024-04-24T02:15:13.167795+0000","last_fullsized":"2024-04-24T02:15:13.167795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:48:52.834838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.675276+0000","last_change":"2024-04-24T02:12:02.755265+0000","last_active":"2024-04-24T02:14:12.675276+0000","last_peered":"2024-04-24T02:14:12.675276+0000","last_clean":"2024-04-24T02:14:12.675276+0000","last_became_active":"2024-04-24T02:12:02.754208+0000","last_became_peered":"2024-04-24T02:12:02.754208+0000","last_unstale":"2024-04-24T02:14:12.675276+0000","last_undegraded":"2024-04-24T02:14:12.675276+0000","last_fullsized":"2024-04-24T02:14:12.675276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:34:23.368475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:09.631727+0000","last_change":"2024-04-24T02:12:04.755521+0000","last_active":"2024-04-24T02:14:09.631727+0000","last_peered":"2024-04-24T02:14:09.631727+0000","last_clean":"2024-04-24T02:14:09.631727+0000","last_became_active":"2024-04-24T02:12:04.755248+0000","last_became_peered":"2024-04-24T02:12:04.755248+0000","last_unstale":"2024-04-24T02:14:09.631727+0000","last_undegraded":"2024-04-24T02:14:09.631727+0000","last_fullsized":"2024-04-24T02:14:09.631727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:24:15.406623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:46.543231+0000","last_change":"2024-04-24T02:12:02.741732+0000","last_active":"2024-04-24T02:12:46.543231+0000","last_peered":"2024-04-24T02:12:46.543231+0000","last_clean":"2024-04-24T02:12:46.543231+0000","last_became_active":"2024-04-24T02:12:02.741326+0000","last_became_peered":"2024-04-24T02:12:02.741326+0000","last_unstale":"2024-04-24T02:12:46.543231+0000","last_undegraded":"2024-04-24T02:12:46.543231+0000","last_fullsized":"2024-04-24T02:12:46.543231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:56:56.371880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'4","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:09.640640+0000","last_change":"2024-04-24T02:12:04.763252+0000","last_active":"2024-04-24T02:14:09.640640+0000","last_peered":"2024-04-24T02:14:09.640640+0000","last_clean":"2024-04-24T02:14:09.640640+0000","last_became_active":"2024-04-24T02:12:04.762921+0000","last_became_peered":"2024-04-24T02:12:04.762921+0000","last_unstale":"2024-04-24T02:14:09.640640+0000","last_undegraded":"2024-04-24T02:14:09.640640+0000","last_fullsized":"2024-04-24T02:14:09.640640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:25:06.019153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.811719+0000","last_change":"2024-04-24T02:12:02.755513+0000","last_active":"2024-04-24T02:12:45.811719+0000","last_peered":"2024-04-24T02:12:45.811719+0000","last_clean":"2024-04-24T02:12:45.811719+0000","last_became_active":"2024-04-24T02:12:02.752921+0000","last_became_peered":"2024-04-24T02:12:02.752921+0000","last_unstale":"2024-04-24T02:12:45.811719+0000","last_undegraded":"2024-04-24T02:12:45.811719+0000","last_fullsized":"2024-04-24T02:12:45.811719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:31:26.988642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'12","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.393931+0000","last_change":"2024-04-24T02:12:04.752549+0000","last_active":"2024-04-24T02:15:13.393931+0000","last_peered":"2024-04-24T02:15:13.393931+0000","last_clean":"2024-04-24T02:15:13.393931+0000","last_became_active":"2024-04-24T02:12:04.751655+0000","last_became_peered":"2024-04-24T02:12:04.751655+0000","last_unstale":"2024-04-24T02:15:13.393931+0000","last_undegraded":"2024-04-24T02:15:13.393931+0000","last_fullsized":"2024-04-24T02:15:13.393931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:31:33.128498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804677+0000","last_change":"2024-04-24T02:12:02.752760+0000","last_active":"2024-04-24T02:12:45.804677+0000","last_peered":"2024-04-24T02:12:45.804677+0000","last_clean":"2024-04-24T02:12:45.804677+0000","last_became_active":"2024-04-24T02:12:02.752476+0000","last_became_peered":"2024-04-24T02:12:02.752476+0000","last_unstale":"2024-04-24T02:12:45.804677+0000","last_undegraded":"2024-04-24T02:12:45.804677+0000","last_fullsized":"2024-04-24T02:12:45.804677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:27:51.241688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'18","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:29.126000+0000","last_change":"2024-04-24T02:12:04.766969+0000","last_active":"2024-04-24T02:13:29.126000+0000","last_peered":"2024-04-24T02:13:29.126000+0000","last_clean":"2024-04-24T02:13:29.126000+0000","last_became_active":"2024-04-24T02:12:04.766693+0000","last_became_peered":"2024-04-24T02:12:04.766693+0000","last_unstale":"2024-04-24T02:13:29.126000+0000","last_undegraded":"2024-04-24T02:13:29.126000+0000","last_fullsized":"2024-04-24T02:13:29.126000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:01:31.183580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.811209+0000","last_change":"2024-04-24T02:12:04.764729+0000","last_active":"2024-04-24T02:12:45.811209+0000","last_peered":"2024-04-24T02:12:45.811209+0000","last_clean":"2024-04-24T02:12:45.811209+0000","last_became_active":"2024-04-24T02:12:04.764470+0000","last_became_peered":"2024-04-24T02:12:04.764470+0000","last_unstale":"2024-04-24T02:12:45.811209+0000","last_undegraded":"2024-04-24T02:12:45.811209+0000","last_fullsized":"2024-04-24T02:12:45.811209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:27:54.808025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:29.115642+0000","last_change":"2024-04-24T02:12:02.754017+0000","last_active":"2024-04-24T02:13:29.115642+0000","last_peered":"2024-04-24T02:13:29.115642+0000","last_clean":"2024-04-24T02:13:29.115642+0000","last_became_active":"2024-04-24T02:12:02.753791+0000","last_became_peered":"2024-04-24T02:12:02.753791+0000","last_unstale":"2024-04-24T02:13:29.115642+0000","last_undegraded":"2024-04-24T02:13:29.115642+0000","last_fullsized":"2024-04-24T02:13:29.115642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:05:35.109941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'10","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.356710+0000","last_change":"2024-04-24T02:12:04.751048+0000","last_active":"2024-04-24T02:15:13.356710+0000","last_peered":"2024-04-24T02:15:13.356710+0000","last_clean":"2024-04-24T02:15:13.356710+0000","last_became_active":"2024-04-24T02:12:04.750774+0000","last_became_peered":"2024-04-24T02:12:04.750774+0000","last_unstale":"2024-04-24T02:15:13.356710+0000","last_undegraded":"2024-04-24T02:15:13.356710+0000","last_fullsized":"2024-04-24T02:15:13.356710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:31:33.128498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.813506+0000","last_change":"2024-04-24T02:12:02.755711+0000","last_active":"2024-04-24T02:12:45.813506+0000","last_peered":"2024-04-24T02:12:45.813506+0000","last_clean":"2024-04-24T02:12:45.813506+0000","last_became_active":"2024-04-24T02:12:02.754860+0000","last_became_peered":"2024-04-24T02:12:02.754860+0000","last_unstale":"2024-04-24T02:12:45.813506+0000","last_undegraded":"2024-04-24T02:12:45.813506+0000","last_fullsized":"2024-04-24T02:12:45.813506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:15:49.257695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'8","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:09.640474+0000","last_change":"2024-04-24T02:12:04.751178+0000","last_active":"2024-04-24T02:14:09.640474+0000","last_peered":"2024-04-24T02:14:09.640474+0000","last_clean":"2024-04-24T02:14:09.640474+0000","last_became_active":"2024-04-24T02:12:04.750919+0000","last_became_peered":"2024-04-24T02:12:04.750919+0000","last_unstale":"2024-04-24T02:14:09.640474+0000","last_undegraded":"2024-04-24T02:14:09.640474+0000","last_fullsized":"2024-04-24T02:14:09.640474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:43:59.642115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:30.040831+0000","last_change":"2024-04-24T02:12:02.756671+0000","last_active":"2024-04-24T02:14:30.040831+0000","last_peered":"2024-04-24T02:14:30.040831+0000","last_clean":"2024-04-24T02:14:30.040831+0000","last_became_active":"2024-04-24T02:12:02.756389+0000","last_became_peered":"2024-04-24T02:12:02.756389+0000","last_unstale":"2024-04-24T02:14:30.040831+0000","last_undegraded":"2024-04-24T02:14:30.040831+0000","last_fullsized":"2024-04-24T02:14:30.040831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:51:48.494870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'1","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:33.036816+0000","last_change":"2024-04-24T02:12:04.767195+0000","last_active":"2024-04-24T02:14:33.036816+0000","last_peered":"2024-04-24T02:14:33.036816+0000","last_clean":"2024-04-24T02:14:33.036816+0000","last_became_active":"2024-04-24T02:12:04.766739+0000","last_became_peered":"2024-04-24T02:12:04.766739+0000","last_unstale":"2024-04-24T02:14:33.036816+0000","last_undegraded":"2024-04-24T02:14:33.036816+0000","last_fullsized":"2024-04-24T02:14:33.036816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:21:04.111831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805201+0000","last_change":"2024-04-24T02:12:02.745281+0000","last_active":"2024-04-24T02:12:45.805201+0000","last_peered":"2024-04-24T02:12:45.805201+0000","last_clean":"2024-04-24T02:12:45.805201+0000","last_became_active":"2024-04-24T02:12:02.744763+0000","last_became_peered":"2024-04-24T02:12:02.744763+0000","last_unstale":"2024-04-24T02:12:45.805201+0000","last_undegraded":"2024-04-24T02:12:45.805201+0000","last_fullsized":"2024-04-24T02:12:45.805201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:15:49.257695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'10","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.394017+0000","last_change":"2024-04-24T02:12:04.764907+0000","last_active":"2024-04-24T02:15:13.394017+0000","last_peered":"2024-04-24T02:15:13.394017+0000","last_clean":"2024-04-24T02:15:13.394017+0000","last_became_active":"2024-04-24T02:12:04.764659+0000","last_became_peered":"2024-04-24T02:12:04.764659+0000","last_unstale":"2024-04-24T02:15:13.394017+0000","last_undegraded":"2024-04-24T02:15:13.394017+0000","last_fullsized":"2024-04-24T02:15:13.394017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:02.847691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.806249+0000","last_change":"2024-04-24T02:12:02.742249+0000","last_active":"2024-04-24T02:12:45.806249+0000","last_peered":"2024-04-24T02:12:45.806249+0000","last_clean":"2024-04-24T02:12:45.806249+0000","last_became_active":"2024-04-24T02:12:02.741976+0000","last_became_peered":"2024-04-24T02:12:02.741976+0000","last_unstale":"2024-04-24T02:12:45.806249+0000","last_undegraded":"2024-04-24T02:12:45.806249+0000","last_fullsized":"2024-04-24T02:12:45.806249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:56:59.627386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'10","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:28.945151+0000","last_change":"2024-04-24T02:12:04.755425+0000","last_active":"2024-04-24T02:13:28.945151+0000","last_peered":"2024-04-24T02:13:28.945151+0000","last_clean":"2024-04-24T02:13:28.945151+0000","last_became_active":"2024-04-24T02:12:04.755133+0000","last_became_peered":"2024-04-24T02:12:04.755133+0000","last_unstale":"2024-04-24T02:13:28.945151+0000","last_undegraded":"2024-04-24T02:13:28.945151+0000","last_fullsized":"2024-04-24T02:13:28.945151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:57:46.692802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.810492+0000","last_change":"2024-04-24T02:12:02.758478+0000","last_active":"2024-04-24T02:12:45.810492+0000","last_peered":"2024-04-24T02:12:45.810492+0000","last_clean":"2024-04-24T02:12:45.810492+0000","last_became_active":"2024-04-24T02:12:02.753196+0000","last_became_peered":"2024-04-24T02:12:02.753196+0000","last_unstale":"2024-04-24T02:12:45.810492+0000","last_undegraded":"2024-04-24T02:12:45.810492+0000","last_fullsized":"2024-04-24T02:12:45.810492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:51:50.235295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'35","reported_seq":99,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.370315+0000","last_change":"2024-04-24T02:12:12.798478+0000","last_active":"2024-04-24T02:15:13.370315+0000","last_peered":"2024-04-24T02:15:13.370315+0000","last_clean":"2024-04-24T02:15:13.370315+0000","last_became_active":"2024-04-24T02:12:12.798179+0000","last_became_peered":"2024-04-24T02:12:12.798179+0000","last_unstale":"2024-04-24T02:15:13.370315+0000","last_undegraded":"2024-04-24T02:15:13.370315+0000","last_fullsized":"2024-04-24T02:15:13.370315+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:44:55.926593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'5","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:25.040642+0000","last_change":"2024-04-24T02:12:04.764143+0000","last_active":"2024-04-24T02:14:25.040642+0000","last_peered":"2024-04-24T02:14:25.040642+0000","last_clean":"2024-04-24T02:14:25.040642+0000","last_became_active":"2024-04-24T02:12:04.763725+0000","last_became_peered":"2024-04-24T02:12:04.763725+0000","last_unstale":"2024-04-24T02:14:25.040642+0000","last_undegraded":"2024-04-24T02:14:25.040642+0000","last_fullsized":"2024-04-24T02:14:25.040642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:47:39.917204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:46.554283+0000","last_change":"2024-04-24T02:12:02.756910+0000","last_active":"2024-04-24T02:12:46.554283+0000","last_peered":"2024-04-24T02:12:46.554283+0000","last_clean":"2024-04-24T02:12:46.554283+0000","last_became_active":"2024-04-24T02:12:02.755520+0000","last_became_peered":"2024-04-24T02:12:02.755520+0000","last_unstale":"2024-04-24T02:12:46.554283+0000","last_undegraded":"2024-04-24T02:12:46.554283+0000","last_fullsized":"2024-04-24T02:12:46.554283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:11:28.150533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.811511+0000","last_change":"2024-04-24T02:12:06.759172+0000","last_active":"2024-04-24T02:12:45.811511+0000","last_peered":"2024-04-24T02:12:45.811511+0000","last_clean":"2024-04-24T02:12:45.811511+0000","last_became_active":"2024-04-24T02:12:06.758033+0000","last_became_peered":"2024-04-24T02:12:06.758033+0000","last_unstale":"2024-04-24T02:12:45.811511+0000","last_undegraded":"2024-04-24T02:12:45.811511+0000","last_fullsized":"2024-04-24T02:12:45.811511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:24.367968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'43","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.344978+0000","last_change":"2024-04-24T02:12:08.783964+0000","last_active":"2024-04-24T02:14:11.344978+0000","last_peered":"2024-04-24T02:14:11.344978+0000","last_clean":"2024-04-24T02:14:11.344978+0000","last_became_active":"2024-04-24T02:12:08.783666+0000","last_became_peered":"2024-04-24T02:12:08.783666+0000","last_unstale":"2024-04-24T02:14:11.344978+0000","last_undegraded":"2024-04-24T02:14:11.344978+0000","last_fullsized":"2024-04-24T02:14:11.344978+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:00:42.425055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804631+0000","last_change":"2024-04-24T02:12:10.787426+0000","last_active":"2024-04-24T02:12:45.804631+0000","last_peered":"2024-04-24T02:12:45.804631+0000","last_clean":"2024-04-24T02:12:45.804631+0000","last_became_active":"2024-04-24T02:12:10.786981+0000","last_became_peered":"2024-04-24T02:12:10.786981+0000","last_unstale":"2024-04-24T02:12:45.804631+0000","last_undegraded":"2024-04-24T02:12:45.804631+0000","last_fullsized":"2024-04-24T02:12:45.804631+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:03:55.174622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:28.953239+0000","last_change":"2024-04-24T02:12:12.797648+0000","last_active":"2024-04-24T02:13:28.953239+0000","last_peered":"2024-04-24T02:13:28.953239+0000","last_clean":"2024-04-24T02:13:28.953239+0000","last_became_active":"2024-04-24T02:12:12.796319+0000","last_became_peered":"2024-04-24T02:12:12.796319+0000","last_unstale":"2024-04-24T02:13:28.953239+0000","last_undegraded":"2024-04-24T02:13:28.953239+0000","last_fullsized":"2024-04-24T02:13:28.953239+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:12:52.743479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.812193+0000","last_change":"2024-04-24T02:12:04.764679+0000","last_active":"2024-04-24T02:12:45.812193+0000","last_peered":"2024-04-24T02:12:45.812193+0000","last_clean":"2024-04-24T02:12:45.812193+0000","last_became_active":"2024-04-24T02:12:04.764351+0000","last_became_peered":"2024-04-24T02:12:04.764351+0000","last_unstale":"2024-04-24T02:12:45.812193+0000","last_undegraded":"2024-04-24T02:12:45.812193+0000","last_fullsized":"2024-04-24T02:12:45.812193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:24:09.733301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.806373+0000","last_change":"2024-04-24T02:12:02.748273+0000","last_active":"2024-04-24T02:12:45.806373+0000","last_peered":"2024-04-24T02:12:45.806373+0000","last_clean":"2024-04-24T02:12:45.806373+0000","last_became_active":"2024-04-24T02:12:02.744030+0000","last_became_peered":"2024-04-24T02:12:02.744030+0000","last_unstale":"2024-04-24T02:12:45.806373+0000","last_undegraded":"2024-04-24T02:12:45.806373+0000","last_fullsized":"2024-04-24T02:12:45.806373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:39:43.304402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805313+0000","last_change":"2024-04-24T02:12:06.758854+0000","last_active":"2024-04-24T02:12:45.805313+0000","last_peered":"2024-04-24T02:12:45.805313+0000","last_clean":"2024-04-24T02:12:45.805313+0000","last_became_active":"2024-04-24T02:12:06.758561+0000","last_became_peered":"2024-04-24T02:12:06.758561+0000","last_unstale":"2024-04-24T02:12:45.805313+0000","last_undegraded":"2024-04-24T02:12:45.805313+0000","last_fullsized":"2024-04-24T02:12:45.805313+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:30:27.876817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"30'12","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804944+0000","last_change":"2024-04-24T02:12:08.767804+0000","last_active":"2024-04-24T02:12:45.804944+0000","last_peered":"2024-04-24T02:12:45.804944+0000","last_clean":"2024-04-24T02:12:45.804944+0000","last_became_active":"2024-04-24T02:12:08.767493+0000","last_became_peered":"2024-04-24T02:12:08.767493+0000","last_unstale":"2024-04-24T02:12:45.804944+0000","last_undegraded":"2024-04-24T02:12:45.804944+0000","last_fullsized":"2024-04-24T02:12:45.804944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:21:18.301632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804318+0000","last_change":"2024-04-24T02:12:10.779679+0000","last_active":"2024-04-24T02:12:45.804318+0000","last_peered":"2024-04-24T02:12:45.804318+0000","last_clean":"2024-04-24T02:12:45.804318+0000","last_became_active":"2024-04-24T02:12:10.779231+0000","last_became_peered":"2024-04-24T02:12:10.779231+0000","last_unstale":"2024-04-24T02:12:45.804318+0000","last_undegraded":"2024-04-24T02:12:45.804318+0000","last_fullsized":"2024-04-24T02:12:45.804318+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:38:27.193760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'8","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:29.122978+0000","last_change":"2024-04-24T02:12:12.791754+0000","last_active":"2024-04-24T02:13:29.122978+0000","last_peered":"2024-04-24T02:13:29.122978+0000","last_clean":"2024-04-24T02:13:29.122978+0000","last_became_active":"2024-04-24T02:12:12.791542+0000","last_became_peered":"2024-04-24T02:12:12.791542+0000","last_unstale":"2024-04-24T02:13:29.122978+0000","last_undegraded":"2024-04-24T02:13:29.122978+0000","last_fullsized":"2024-04-24T02:13:29.122978+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:16:45.741077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.349051+0000","last_change":"2024-04-24T02:12:04.764138+0000","last_active":"2024-04-24T02:15:13.349051+0000","last_peered":"2024-04-24T02:15:13.349051+0000","last_clean":"2024-04-24T02:15:13.349051+0000","last_became_active":"2024-04-24T02:12:04.763491+0000","last_became_peered":"2024-04-24T02:12:04.763491+0000","last_unstale":"2024-04-24T02:15:13.349051+0000","last_undegraded":"2024-04-24T02:15:13.349051+0000","last_fullsized":"2024-04-24T02:15:13.349051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:37:41.541077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"30'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.811251+0000","last_change":"2024-04-24T02:12:02.757002+0000","last_active":"2024-04-24T02:12:45.811251+0000","last_peered":"2024-04-24T02:12:45.811251+0000","last_clean":"2024-04-24T02:12:45.811251+0000","last_became_active":"2024-04-24T02:12:02.755636+0000","last_became_peered":"2024-04-24T02:12:02.755636+0000","last_unstale":"2024-04-24T02:12:45.811251+0000","last_undegraded":"2024-04-24T02:12:45.811251+0000","last_fullsized":"2024-04-24T02:12:45.811251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:55:45.693152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.814863+0000","last_change":"2024-04-24T02:12:45.813418+0000","last_active":"2024-04-24T02:12:45.814863+0000","last_peered":"2024-04-24T02:12:45.814863+0000","last_clean":"2024-04-24T02:12:45.814863+0000","last_became_active":"2024-04-24T02:12:45.813038+0000","last_became_peered":"2024-04-24T02:12:45.813038+0000","last_unstale":"2024-04-24T02:12:45.814863+0000","last_undegraded":"2024-04-24T02:12:45.814863+0000","last_fullsized":"2024-04-24T02:12:45.814863+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:24.367968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"30'22","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.808733+0000","last_change":"2024-04-24T02:12:08.783389+0000","last_active":"2024-04-24T02:12:45.808733+0000","last_peered":"2024-04-24T02:12:45.808733+0000","last_clean":"2024-04-24T02:12:45.808733+0000","last_became_active":"2024-04-24T02:12:08.783077+0000","last_became_peered":"2024-04-24T02:12:08.783077+0000","last_unstale":"2024-04-24T02:12:45.808733+0000","last_undegraded":"2024-04-24T02:12:45.808733+0000","last_fullsized":"2024-04-24T02:12:45.808733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:56:15.426387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'282","reported_seq":404,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:11.839479+0000","last_change":"2024-04-24T02:12:10.784037+0000","last_active":"2024-04-24T02:15:11.839479+0000","last_peered":"2024-04-24T02:15:11.839479+0000","last_clean":"2024-04-24T02:15:11.839479+0000","last_became_active":"2024-04-24T02:12:10.783726+0000","last_became_peered":"2024-04-24T02:12:10.783726+0000","last_unstale":"2024-04-24T02:15:11.839479+0000","last_undegraded":"2024-04-24T02:15:11.839479+0000","last_fullsized":"2024-04-24T02:15:11.839479+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:49:38.926049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.808957+0000","last_change":"2024-04-24T02:12:12.801707+0000","last_active":"2024-04-24T02:12:45.808957+0000","last_peered":"2024-04-24T02:12:45.808957+0000","last_clean":"2024-04-24T02:12:45.808957+0000","last_became_active":"2024-04-24T02:12:12.801331+0000","last_became_peered":"2024-04-24T02:12:12.801331+0000","last_unstale":"2024-04-24T02:12:45.808957+0000","last_undegraded":"2024-04-24T02:12:45.808957+0000","last_fullsized":"2024-04-24T02:12:45.808957+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:10:27.748343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'17","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.400977+0000","last_change":"2024-04-24T02:12:04.756301+0000","last_active":"2024-04-24T02:15:13.400977+0000","last_peered":"2024-04-24T02:15:13.400977+0000","last_clean":"2024-04-24T02:15:13.400977+0000","last_became_active":"2024-04-24T02:12:04.756039+0000","last_became_peered":"2024-04-24T02:12:04.756039+0000","last_unstale":"2024-04-24T02:15:13.400977+0000","last_undegraded":"2024-04-24T02:15:13.400977+0000","last_fullsized":"2024-04-24T02:15:13.400977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:44:45.745380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":60,"num_read_kb":52,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.803334+0000","last_change":"2024-04-24T02:12:02.755651+0000","last_active":"2024-04-24T02:12:45.803334+0000","last_peered":"2024-04-24T02:12:45.803334+0000","last_clean":"2024-04-24T02:12:45.803334+0000","last_became_active":"2024-04-24T02:12:02.754852+0000","last_became_peered":"2024-04-24T02:12:02.754852+0000","last_unstale":"2024-04-24T02:12:45.803334+0000","last_undegraded":"2024-04-24T02:12:45.803334+0000","last_fullsized":"2024-04-24T02:12:45.803334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:02:45.311843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.812440+0000","last_change":"2024-04-24T02:12:06.758372+0000","last_active":"2024-04-24T02:12:45.812440+0000","last_peered":"2024-04-24T02:12:45.812440+0000","last_clean":"2024-04-24T02:12:45.812440+0000","last_became_active":"2024-04-24T02:12:06.757883+0000","last_became_peered":"2024-04-24T02:12:06.757883+0000","last_unstale":"2024-04-24T02:12:45.812440+0000","last_undegraded":"2024-04-24T02:12:45.812440+0000","last_fullsized":"2024-04-24T02:12:45.812440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:30:33.127083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'37","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:35.041555+0000","last_change":"2024-04-24T02:12:08.781239+0000","last_active":"2024-04-24T02:14:35.041555+0000","last_peered":"2024-04-24T02:14:35.041555+0000","last_clean":"2024-04-24T02:14:35.041555+0000","last_became_active":"2024-04-24T02:12:08.780950+0000","last_became_peered":"2024-04-24T02:12:08.780950+0000","last_unstale":"2024-04-24T02:14:35.041555+0000","last_undegraded":"2024-04-24T02:14:35.041555+0000","last_fullsized":"2024-04-24T02:14:35.041555+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:22:22.427553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'282","reported_seq":435,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.470327+0000","last_change":"2024-04-24T02:12:10.778536+0000","last_active":"2024-04-24T02:15:13.470327+0000","last_peered":"2024-04-24T02:15:13.470327+0000","last_clean":"2024-04-24T02:15:13.470327+0000","last_became_active":"2024-04-24T02:12:10.778254+0000","last_became_peered":"2024-04-24T02:12:10.778254+0000","last_unstale":"2024-04-24T02:15:13.470327+0000","last_undegraded":"2024-04-24T02:15:13.470327+0000","last_fullsized":"2024-04-24T02:15:13.470327+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:23:53.259197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.349016+0000","last_change":"2024-04-24T02:12:04.768436+0000","last_active":"2024-04-24T02:15:13.349016+0000","last_peered":"2024-04-24T02:15:13.349016+0000","last_clean":"2024-04-24T02:15:13.349016+0000","last_became_active":"2024-04-24T02:12:04.767906+0000","last_became_peered":"2024-04-24T02:12:04.767906+0000","last_unstale":"2024-04-24T02:15:13.349016+0000","last_undegraded":"2024-04-24T02:15:13.349016+0000","last_fullsized":"2024-04-24T02:15:13.349016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:21:44.832014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"32'3","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:28.904559+0000","last_change":"2024-04-24T02:12:02.749142+0000","last_active":"2024-04-24T02:13:28.904559+0000","last_peered":"2024-04-24T02:13:28.904559+0000","last_clean":"2024-04-24T02:13:28.904559+0000","last_became_active":"2024-04-24T02:12:02.748372+0000","last_became_peered":"2024-04-24T02:12:02.748372+0000","last_unstale":"2024-04-24T02:13:28.904559+0000","last_undegraded":"2024-04-24T02:13:28.904559+0000","last_fullsized":"2024-04-24T02:13:28.904559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:59:32.006851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.803560+0000","last_change":"2024-04-24T02:12:06.764649+0000","last_active":"2024-04-24T02:12:45.803560+0000","last_peered":"2024-04-24T02:12:45.803560+0000","last_clean":"2024-04-24T02:12:45.803560+0000","last_became_active":"2024-04-24T02:12:06.764324+0000","last_became_peered":"2024-04-24T02:12:06.764324+0000","last_unstale":"2024-04-24T02:12:45.803560+0000","last_undegraded":"2024-04-24T02:12:45.803560+0000","last_fullsized":"2024-04-24T02:12:45.803560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:24.266336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'46","reported_seq":99,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.349299+0000","last_change":"2024-04-24T02:12:08.771425+0000","last_active":"2024-04-24T02:14:11.349299+0000","last_peered":"2024-04-24T02:14:11.349299+0000","last_clean":"2024-04-24T02:14:11.349299+0000","last_became_active":"2024-04-24T02:12:08.771060+0000","last_became_peered":"2024-04-24T02:12:08.771060+0000","last_unstale":"2024-04-24T02:14:11.349299+0000","last_undegraded":"2024-04-24T02:14:11.349299+0000","last_fullsized":"2024-04-24T02:14:11.349299+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:04:03.080193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804862+0000","last_change":"2024-04-24T02:12:10.777029+0000","last_active":"2024-04-24T02:12:45.804862+0000","last_peered":"2024-04-24T02:12:45.804862+0000","last_clean":"2024-04-24T02:12:45.804862+0000","last_became_active":"2024-04-24T02:12:10.776715+0000","last_became_peered":"2024-04-24T02:12:10.776715+0000","last_unstale":"2024-04-24T02:12:45.804862+0000","last_undegraded":"2024-04-24T02:12:45.804862+0000","last_fullsized":"2024-04-24T02:12:45.804862+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:05:12.120497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'5","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:28.954965+0000","last_change":"2024-04-24T02:12:12.797751+0000","last_active":"2024-04-24T02:13:28.954965+0000","last_peered":"2024-04-24T02:13:28.954965+0000","last_clean":"2024-04-24T02:13:28.954965+0000","last_became_active":"2024-04-24T02:12:12.797405+0000","last_became_peered":"2024-04-24T02:12:12.797405+0000","last_unstale":"2024-04-24T02:13:28.954965+0000","last_undegraded":"2024-04-24T02:13:28.954965+0000","last_fullsized":"2024-04-24T02:13:28.954965+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:54:48.506969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'10","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.464804+0000","last_change":"2024-04-24T02:12:04.754076+0000","last_active":"2024-04-24T02:15:13.464804+0000","last_peered":"2024-04-24T02:15:13.464804+0000","last_clean":"2024-04-24T02:15:13.464804+0000","last_became_active":"2024-04-24T02:12:04.753819+0000","last_became_peered":"2024-04-24T02:12:04.753819+0000","last_unstale":"2024-04-24T02:15:13.464804+0000","last_undegraded":"2024-04-24T02:15:13.464804+0000","last_fullsized":"2024-04-24T02:15:13.464804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:39:00.502785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.813994+0000","last_change":"2024-04-24T02:12:02.743507+0000","last_active":"2024-04-24T02:12:45.813994+0000","last_peered":"2024-04-24T02:12:45.813994+0000","last_clean":"2024-04-24T02:12:45.813994+0000","last_became_active":"2024-04-24T02:12:02.743202+0000","last_became_peered":"2024-04-24T02:12:02.743202+0000","last_unstale":"2024-04-24T02:12:45.813994+0000","last_undegraded":"2024-04-24T02:12:45.813994+0000","last_fullsized":"2024-04-24T02:12:45.813994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:02:45.311843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805195+0000","last_change":"2024-04-24T02:12:06.765949+0000","last_active":"2024-04-24T02:12:45.805195+0000","last_peered":"2024-04-24T02:12:45.805195+0000","last_clean":"2024-04-24T02:12:45.805195+0000","last_became_active":"2024-04-24T02:12:06.765690+0000","last_became_peered":"2024-04-24T02:12:06.765690+0000","last_unstale":"2024-04-24T02:12:45.805195+0000","last_undegraded":"2024-04-24T02:12:45.805195+0000","last_fullsized":"2024-04-24T02:12:45.805195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:20:26.752873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'38","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.358070+0000","last_change":"2024-04-24T02:12:08.780282+0000","last_active":"2024-04-24T02:15:13.358070+0000","last_peered":"2024-04-24T02:15:13.358070+0000","last_clean":"2024-04-24T02:15:13.358070+0000","last_became_active":"2024-04-24T02:12:08.779594+0000","last_became_peered":"2024-04-24T02:12:08.779594+0000","last_unstale":"2024-04-24T02:15:13.358070+0000","last_undegraded":"2024-04-24T02:15:13.358070+0000","last_fullsized":"2024-04-24T02:15:13.358070+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:31:17.615935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804354+0000","last_change":"2024-04-24T02:12:10.785197+0000","last_active":"2024-04-24T02:12:45.804354+0000","last_peered":"2024-04-24T02:12:45.804354+0000","last_clean":"2024-04-24T02:12:45.804354+0000","last_became_active":"2024-04-24T02:12:10.784901+0000","last_became_peered":"2024-04-24T02:12:10.784901+0000","last_unstale":"2024-04-24T02:12:45.804354+0000","last_undegraded":"2024-04-24T02:12:45.804354+0000","last_fullsized":"2024-04-24T02:12:45.804354+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:08:57.130072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'5","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.396389+0000","last_change":"2024-04-24T02:12:12.795959+0000","last_active":"2024-04-24T02:15:13.396389+0000","last_peered":"2024-04-24T02:15:13.396389+0000","last_clean":"2024-04-24T02:15:13.396389+0000","last_became_active":"2024-04-24T02:12:12.795364+0000","last_became_peered":"2024-04-24T02:12:12.795364+0000","last_unstale":"2024-04-24T02:15:13.396389+0000","last_undegraded":"2024-04-24T02:15:13.396389+0000","last_fullsized":"2024-04-24T02:15:13.396389+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:56:16.695108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'8","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.464931+0000","last_change":"2024-04-24T02:12:04.763127+0000","last_active":"2024-04-24T02:15:13.464931+0000","last_peered":"2024-04-24T02:15:13.464931+0000","last_clean":"2024-04-24T02:15:13.464931+0000","last_became_active":"2024-04-24T02:12:04.762869+0000","last_became_peered":"2024-04-24T02:12:04.762869+0000","last_unstale":"2024-04-24T02:15:13.464931+0000","last_undegraded":"2024-04-24T02:15:13.464931+0000","last_fullsized":"2024-04-24T02:15:13.464931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:55:54.502965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.812086+0000","last_change":"2024-04-24T02:12:02.758980+0000","last_active":"2024-04-24T02:12:45.812086+0000","last_peered":"2024-04-24T02:12:45.812086+0000","last_clean":"2024-04-24T02:12:45.812086+0000","last_became_active":"2024-04-24T02:12:02.757488+0000","last_became_peered":"2024-04-24T02:12:02.757488+0000","last_unstale":"2024-04-24T02:12:45.812086+0000","last_undegraded":"2024-04-24T02:12:45.812086+0000","last_fullsized":"2024-04-24T02:12:45.812086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:39:09.728890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.807289+0000","last_change":"2024-04-24T02:12:06.764973+0000","last_active":"2024-04-24T02:12:45.807289+0000","last_peered":"2024-04-24T02:12:45.807289+0000","last_clean":"2024-04-24T02:12:45.807289+0000","last_became_active":"2024-04-24T02:12:06.764339+0000","last_became_peered":"2024-04-24T02:12:06.764339+0000","last_unstale":"2024-04-24T02:12:45.807289+0000","last_undegraded":"2024-04-24T02:12:45.807289+0000","last_fullsized":"2024-04-24T02:12:45.807289+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:48:03.012278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'48","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.351402+0000","last_change":"2024-04-24T02:12:08.781158+0000","last_active":"2024-04-24T02:14:11.351402+0000","last_peered":"2024-04-24T02:14:11.351402+0000","last_clean":"2024-04-24T02:14:11.351402+0000","last_became_active":"2024-04-24T02:12:08.780230+0000","last_became_peered":"2024-04-24T02:12:08.780230+0000","last_unstale":"2024-04-24T02:14:11.351402+0000","last_undegraded":"2024-04-24T02:14:11.351402+0000","last_fullsized":"2024-04-24T02:14:11.351402+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:53:03.292344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'282","reported_seq":397,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.591168+0000","last_change":"2024-04-24T02:12:10.784581+0000","last_active":"2024-04-24T02:15:13.591168+0000","last_peered":"2024-04-24T02:15:13.591168+0000","last_clean":"2024-04-24T02:15:13.591168+0000","last_became_active":"2024-04-24T02:12:10.784278+0000","last_became_peered":"2024-04-24T02:12:10.784278+0000","last_unstale":"2024-04-24T02:15:13.591168+0000","last_undegraded":"2024-04-24T02:15:13.591168+0000","last_fullsized":"2024-04-24T02:15:13.591168+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:21:58.208138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.190002+0000","last_change":"2024-04-24T02:12:12.792876+0000","last_active":"2024-04-24T02:15:13.190002+0000","last_peered":"2024-04-24T02:15:13.190002+0000","last_clean":"2024-04-24T02:15:13.190002+0000","last_became_active":"2024-04-24T02:12:12.792569+0000","last_became_peered":"2024-04-24T02:12:12.792569+0000","last_unstale":"2024-04-24T02:15:13.190002+0000","last_undegraded":"2024-04-24T02:15:13.190002+0000","last_fullsized":"2024-04-24T02:15:13.190002+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:00:24.269543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'26","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.464740+0000","last_change":"2024-04-24T02:12:04.752393+0000","last_active":"2024-04-24T02:15:13.464740+0000","last_peered":"2024-04-24T02:15:13.464740+0000","last_clean":"2024-04-24T02:15:13.464740+0000","last_became_active":"2024-04-24T02:12:04.752075+0000","last_became_peered":"2024-04-24T02:12:04.752075+0000","last_unstale":"2024-04-24T02:15:13.464740+0000","last_undegraded":"2024-04-24T02:15:13.464740+0000","last_fullsized":"2024-04-24T02:15:13.464740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:15:44.431680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":67,"num_write":30,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.811311+0000","last_change":"2024-04-24T02:12:02.755772+0000","last_active":"2024-04-24T02:12:45.811311+0000","last_peered":"2024-04-24T02:12:45.811311+0000","last_clean":"2024-04-24T02:12:45.811311+0000","last_became_active":"2024-04-24T02:12:02.755468+0000","last_became_peered":"2024-04-24T02:12:02.755468+0000","last_unstale":"2024-04-24T02:12:45.811311+0000","last_undegraded":"2024-04-24T02:12:45.811311+0000","last_fullsized":"2024-04-24T02:12:45.811311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:01:29.176953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804833+0000","last_change":"2024-04-24T02:12:06.764717+0000","last_active":"2024-04-24T02:12:45.804833+0000","last_peered":"2024-04-24T02:12:45.804833+0000","last_clean":"2024-04-24T02:12:45.804833+0000","last_became_active":"2024-04-24T02:12:06.764365+0000","last_became_peered":"2024-04-24T02:12:06.764365+0000","last_unstale":"2024-04-24T02:12:45.804833+0000","last_undegraded":"2024-04-24T02:12:45.804833+0000","last_fullsized":"2024-04-24T02:12:45.804833+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:24:11.723447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'69","reported_seq":137,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.353253+0000","last_change":"2024-04-24T02:12:08.780274+0000","last_active":"2024-04-24T02:14:11.353253+0000","last_peered":"2024-04-24T02:14:11.353253+0000","last_clean":"2024-04-24T02:14:11.353253+0000","last_became_active":"2024-04-24T02:12:08.779602+0000","last_became_peered":"2024-04-24T02:12:08.779602+0000","last_unstale":"2024-04-24T02:14:11.353253+0000","last_undegraded":"2024-04-24T02:14:11.353253+0000","last_fullsized":"2024-04-24T02:14:11.353253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:33:01.634520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804983+0000","last_change":"2024-04-24T02:12:10.782388+0000","last_active":"2024-04-24T02:12:45.804983+0000","last_peered":"2024-04-24T02:12:45.804983+0000","last_clean":"2024-04-24T02:12:45.804983+0000","last_became_active":"2024-04-24T02:12:10.782121+0000","last_became_peered":"2024-04-24T02:12:10.782121+0000","last_unstale":"2024-04-24T02:12:45.804983+0000","last_undegraded":"2024-04-24T02:12:45.804983+0000","last_fullsized":"2024-04-24T02:12:45.804983+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:07:26.897678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'20","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.566391+0000","last_change":"2024-04-24T02:12:12.790210+0000","last_active":"2024-04-24T02:15:13.566391+0000","last_peered":"2024-04-24T02:15:13.566391+0000","last_clean":"2024-04-24T02:15:13.566391+0000","last_became_active":"2024-04-24T02:12:12.789799+0000","last_became_peered":"2024-04-24T02:12:12.789799+0000","last_unstale":"2024-04-24T02:15:13.566391+0000","last_undegraded":"2024-04-24T02:15:13.566391+0000","last_fullsized":"2024-04-24T02:15:13.566391+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:13:23.819613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:28.944905+0000","last_change":"2024-04-24T02:12:04.766750+0000","last_active":"2024-04-24T02:13:28.944905+0000","last_peered":"2024-04-24T02:13:28.944905+0000","last_clean":"2024-04-24T02:13:28.944905+0000","last_became_active":"2024-04-24T02:12:04.766495+0000","last_became_peered":"2024-04-24T02:12:04.766495+0000","last_unstale":"2024-04-24T02:13:28.944905+0000","last_undegraded":"2024-04-24T02:13:28.944905+0000","last_fullsized":"2024-04-24T02:13:28.944905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:26:32.311949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805177+0000","last_change":"2024-04-24T02:12:02.743527+0000","last_active":"2024-04-24T02:12:45.805177+0000","last_peered":"2024-04-24T02:12:45.805177+0000","last_clean":"2024-04-24T02:12:45.805177+0000","last_became_active":"2024-04-24T02:12:02.743204+0000","last_became_peered":"2024-04-24T02:12:02.743204+0000","last_unstale":"2024-04-24T02:12:45.805177+0000","last_undegraded":"2024-04-24T02:12:45.805177+0000","last_fullsized":"2024-04-24T02:12:45.805177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:42:26.915246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.807995+0000","last_change":"2024-04-24T02:12:06.765176+0000","last_active":"2024-04-24T02:12:45.807995+0000","last_peered":"2024-04-24T02:12:45.807995+0000","last_clean":"2024-04-24T02:12:45.807995+0000","last_became_active":"2024-04-24T02:12:06.764676+0000","last_became_peered":"2024-04-24T02:12:06.764676+0000","last_unstale":"2024-04-24T02:12:45.807995+0000","last_undegraded":"2024-04-24T02:12:45.807995+0000","last_fullsized":"2024-04-24T02:12:45.807995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:44:01.649539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'38","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.333417+0000","last_change":"2024-04-24T02:12:08.773725+0000","last_active":"2024-04-24T02:14:11.333417+0000","last_peered":"2024-04-24T02:14:11.333417+0000","last_clean":"2024-04-24T02:14:11.333417+0000","last_became_active":"2024-04-24T02:12:08.773355+0000","last_became_peered":"2024-04-24T02:12:08.773355+0000","last_unstale":"2024-04-24T02:14:11.333417+0000","last_undegraded":"2024-04-24T02:14:11.333417+0000","last_fullsized":"2024-04-24T02:14:11.333417+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:38:42.332605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.813546+0000","last_change":"2024-04-24T02:12:10.784747+0000","last_active":"2024-04-24T02:12:45.813546+0000","last_peered":"2024-04-24T02:12:45.813546+0000","last_clean":"2024-04-24T02:12:45.813546+0000","last_became_active":"2024-04-24T02:12:10.783334+0000","last_became_peered":"2024-04-24T02:12:10.783334+0000","last_unstale":"2024-04-24T02:12:45.813546+0000","last_undegraded":"2024-04-24T02:12:45.813546+0000","last_fullsized":"2024-04-24T02:12:45.813546+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:37:24.863362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:15.038882+0000","last_change":"2024-04-24T02:12:12.794851+0000","last_active":"2024-04-24T02:14:15.038882+0000","last_peered":"2024-04-24T02:14:15.038882+0000","last_clean":"2024-04-24T02:14:15.038882+0000","last_became_active":"2024-04-24T02:12:12.794106+0000","last_became_peered":"2024-04-24T02:12:12.794106+0000","last_unstale":"2024-04-24T02:14:15.038882+0000","last_undegraded":"2024-04-24T02:14:15.038882+0000","last_fullsized":"2024-04-24T02:14:15.038882+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:30:12.595419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'4","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:09.640308+0000","last_change":"2024-04-24T02:12:04.768515+0000","last_active":"2024-04-24T02:14:09.640308+0000","last_peered":"2024-04-24T02:14:09.640308+0000","last_clean":"2024-04-24T02:14:09.640308+0000","last_became_active":"2024-04-24T02:12:04.767376+0000","last_became_peered":"2024-04-24T02:12:04.767376+0000","last_unstale":"2024-04-24T02:14:09.640308+0000","last_undegraded":"2024-04-24T02:14:09.640308+0000","last_fullsized":"2024-04-24T02:14:09.640308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:15:19.870705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.752057+0000","last_change":"2024-04-24T02:12:02.761147+0000","last_active":"2024-04-24T02:14:12.752057+0000","last_peered":"2024-04-24T02:14:12.752057+0000","last_clean":"2024-04-24T02:14:12.752057+0000","last_became_active":"2024-04-24T02:12:02.760317+0000","last_became_peered":"2024-04-24T02:12:02.760317+0000","last_unstale":"2024-04-24T02:14:12.752057+0000","last_undegraded":"2024-04-24T02:14:12.752057+0000","last_fullsized":"2024-04-24T02:14:12.752057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:00:21.940276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.815447+0000","last_change":"2024-04-24T02:12:45.814348+0000","last_active":"2024-04-24T02:12:45.815447+0000","last_peered":"2024-04-24T02:12:45.815447+0000","last_clean":"2024-04-24T02:12:45.815447+0000","last_became_active":"2024-04-24T02:12:45.811272+0000","last_became_peered":"2024-04-24T02:12:45.811272+0000","last_unstale":"2024-04-24T02:12:45.815447+0000","last_undegraded":"2024-04-24T02:12:45.815447+0000","last_fullsized":"2024-04-24T02:12:45.815447+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:50:21.355536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"32'37","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.360247+0000","last_change":"2024-04-24T02:12:08.769681+0000","last_active":"2024-04-24T02:14:11.360247+0000","last_peered":"2024-04-24T02:14:11.360247+0000","last_clean":"2024-04-24T02:14:11.360247+0000","last_became_active":"2024-04-24T02:12:08.769307+0000","last_became_peered":"2024-04-24T02:12:08.769307+0000","last_unstale":"2024-04-24T02:14:11.360247+0000","last_undegraded":"2024-04-24T02:14:11.360247+0000","last_fullsized":"2024-04-24T02:14:11.360247+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:28:14.541427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'282","reported_seq":403,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.571049+0000","last_change":"2024-04-24T02:12:10.779255+0000","last_active":"2024-04-24T02:15:13.571049+0000","last_peered":"2024-04-24T02:15:13.571049+0000","last_clean":"2024-04-24T02:15:13.571049+0000","last_became_active":"2024-04-24T02:12:10.778972+0000","last_became_peered":"2024-04-24T02:12:10.778972+0000","last_unstale":"2024-04-24T02:15:13.571049+0000","last_undegraded":"2024-04-24T02:15:13.571049+0000","last_fullsized":"2024-04-24T02:15:13.571049+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:37:47.569074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'12","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:18.034560+0000","last_change":"2024-04-24T02:12:12.790568+0000","last_active":"2024-04-24T02:14:18.034560+0000","last_peered":"2024-04-24T02:14:18.034560+0000","last_clean":"2024-04-24T02:14:18.034560+0000","last_became_active":"2024-04-24T02:12:12.790353+0000","last_became_peered":"2024-04-24T02:12:12.790353+0000","last_unstale":"2024-04-24T02:14:18.034560+0000","last_undegraded":"2024-04-24T02:14:18.034560+0000","last_fullsized":"2024-04-24T02:14:18.034560+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:03:40.609057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'10","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.465025+0000","last_change":"2024-04-24T02:12:04.760283+0000","last_active":"2024-04-24T02:15:13.465025+0000","last_peered":"2024-04-24T02:15:13.465025+0000","last_clean":"2024-04-24T02:15:13.465025+0000","last_became_active":"2024-04-24T02:12:04.760020+0000","last_became_peered":"2024-04-24T02:12:04.760020+0000","last_unstale":"2024-04-24T02:15:13.465025+0000","last_undegraded":"2024-04-24T02:15:13.465025+0000","last_fullsized":"2024-04-24T02:15:13.465025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:20:27.874953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"32'1","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:15.038970+0000","last_change":"2024-04-24T02:12:02.756829+0000","last_active":"2024-04-24T02:14:15.038970+0000","last_peered":"2024-04-24T02:14:15.038970+0000","last_clean":"2024-04-24T02:14:15.038970+0000","last_became_active":"2024-04-24T02:12:02.753593+0000","last_became_peered":"2024-04-24T02:12:02.753593+0000","last_unstale":"2024-04-24T02:14:15.038970+0000","last_undegraded":"2024-04-24T02:14:15.038970+0000","last_fullsized":"2024-04-24T02:14:15.038970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:22:26.189922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'3","reported_seq":413,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.412629+0000","last_change":"2024-04-24T02:12:06.759063+0000","last_active":"2024-04-24T02:14:12.412629+0000","last_peered":"2024-04-24T02:14:12.412629+0000","last_clean":"2024-04-24T02:14:12.412629+0000","last_became_active":"2024-04-24T02:12:06.758759+0000","last_became_peered":"2024-04-24T02:12:06.758759+0000","last_unstale":"2024-04-24T02:14:12.412629+0000","last_undegraded":"2024-04-24T02:14:12.412629+0000","last_fullsized":"2024-04-24T02:14:12.412629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:00:44.704350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"30'11","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.811579+0000","last_change":"2024-04-24T02:12:08.783278+0000","last_active":"2024-04-24T02:12:45.811579+0000","last_peered":"2024-04-24T02:12:45.811579+0000","last_clean":"2024-04-24T02:12:45.811579+0000","last_became_active":"2024-04-24T02:12:08.783011+0000","last_became_peered":"2024-04-24T02:12:08.783011+0000","last_unstale":"2024-04-24T02:12:45.811579+0000","last_undegraded":"2024-04-24T02:12:45.811579+0000","last_fullsized":"2024-04-24T02:12:45.811579+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:34:35.511797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'282","reported_seq":459,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.528202+0000","last_change":"2024-04-24T02:12:10.777668+0000","last_active":"2024-04-24T02:15:13.528202+0000","last_peered":"2024-04-24T02:15:13.528202+0000","last_clean":"2024-04-24T02:15:13.528202+0000","last_became_active":"2024-04-24T02:12:10.777222+0000","last_became_peered":"2024-04-24T02:12:10.777222+0000","last_unstale":"2024-04-24T02:15:13.528202+0000","last_undegraded":"2024-04-24T02:15:13.528202+0000","last_fullsized":"2024-04-24T02:15:13.528202+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:38:54.174398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.545828+0000","last_change":"2024-04-24T02:12:12.795499+0000","last_active":"2024-04-24T02:14:12.545828+0000","last_peered":"2024-04-24T02:14:12.545828+0000","last_clean":"2024-04-24T02:14:12.545828+0000","last_became_active":"2024-04-24T02:12:12.795204+0000","last_became_peered":"2024-04-24T02:12:12.795204+0000","last_unstale":"2024-04-24T02:14:12.545828+0000","last_undegraded":"2024-04-24T02:14:12.545828+0000","last_fullsized":"2024-04-24T02:14:12.545828+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:02:53.179496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.777605+0000","last_change":"2024-04-24T02:12:04.766853+0000","last_active":"2024-04-24T02:14:12.777605+0000","last_peered":"2024-04-24T02:14:12.777605+0000","last_clean":"2024-04-24T02:14:12.777605+0000","last_became_active":"2024-04-24T02:12:04.766540+0000","last_became_peered":"2024-04-24T02:12:04.766540+0000","last_unstale":"2024-04-24T02:14:12.777605+0000","last_undegraded":"2024-04-24T02:14:12.777605+0000","last_fullsized":"2024-04-24T02:14:12.777605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:43:13.413941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"32'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:46.556834+0000","last_change":"2024-04-24T02:12:02.760628+0000","last_active":"2024-04-24T02:12:46.556834+0000","last_peered":"2024-04-24T02:12:46.556834+0000","last_clean":"2024-04-24T02:12:46.556834+0000","last_became_active":"2024-04-24T02:12:02.757717+0000","last_became_peered":"2024-04-24T02:12:02.757717+0000","last_unstale":"2024-04-24T02:12:46.556834+0000","last_undegraded":"2024-04-24T02:12:46.556834+0000","last_fullsized":"2024-04-24T02:12:46.556834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:55:52.496337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.811769+0000","last_change":"2024-04-24T02:12:06.758742+0000","last_active":"2024-04-24T02:12:45.811769+0000","last_peered":"2024-04-24T02:12:45.811769+0000","last_clean":"2024-04-24T02:12:45.811769+0000","last_became_active":"2024-04-24T02:12:06.758452+0000","last_became_peered":"2024-04-24T02:12:06.758452+0000","last_unstale":"2024-04-24T02:12:45.811769+0000","last_undegraded":"2024-04-24T02:12:45.811769+0000","last_fullsized":"2024-04-24T02:12:45.811769+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:54:56.942552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'39","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:25.040028+0000","last_change":"2024-04-24T02:12:08.773650+0000","last_active":"2024-04-24T02:14:25.040028+0000","last_peered":"2024-04-24T02:14:25.040028+0000","last_clean":"2024-04-24T02:14:25.040028+0000","last_became_active":"2024-04-24T02:12:08.773319+0000","last_became_peered":"2024-04-24T02:12:08.773319+0000","last_unstale":"2024-04-24T02:14:25.040028+0000","last_undegraded":"2024-04-24T02:14:25.040028+0000","last_fullsized":"2024-04-24T02:14:25.040028+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:39:13.898594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5807,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":43,"num_read_kb":33,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.807176+0000","last_change":"2024-04-24T02:12:10.787285+0000","last_active":"2024-04-24T02:12:45.807176+0000","last_peered":"2024-04-24T02:12:45.807176+0000","last_clean":"2024-04-24T02:12:45.807176+0000","last_became_active":"2024-04-24T02:12:10.786998+0000","last_became_peered":"2024-04-24T02:12:10.786998+0000","last_unstale":"2024-04-24T02:12:45.807176+0000","last_undegraded":"2024-04-24T02:12:45.807176+0000","last_fullsized":"2024-04-24T02:12:45.807176+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:23:30.529184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'6","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.502555+0000","last_change":"2024-04-24T02:12:12.795209+0000","last_active":"2024-04-24T02:15:13.502555+0000","last_peered":"2024-04-24T02:15:13.502555+0000","last_clean":"2024-04-24T02:15:13.502555+0000","last_became_active":"2024-04-24T02:12:12.793724+0000","last_became_peered":"2024-04-24T02:12:12.793724+0000","last_unstale":"2024-04-24T02:15:13.502555+0000","last_undegraded":"2024-04-24T02:15:13.502555+0000","last_fullsized":"2024-04-24T02:15:13.502555+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:43:28.725420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.766426+0000","last_change":"2024-04-24T02:12:04.764441+0000","last_active":"2024-04-24T02:14:12.766426+0000","last_peered":"2024-04-24T02:14:12.766426+0000","last_clean":"2024-04-24T02:14:12.766426+0000","last_became_active":"2024-04-24T02:12:04.763246+0000","last_became_peered":"2024-04-24T02:12:04.763246+0000","last_unstale":"2024-04-24T02:14:12.766426+0000","last_undegraded":"2024-04-24T02:14:12.766426+0000","last_fullsized":"2024-04-24T02:14:12.766426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:01:31.738903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":199,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.802977+0000","last_change":"2024-04-24T02:11:51.990441+0000","last_active":"2024-04-24T02:12:45.802977+0000","last_peered":"2024-04-24T02:12:45.802977+0000","last_clean":"2024-04-24T02:12:45.802977+0000","last_became_active":"2024-04-24T02:11:51.989479+0000","last_became_peered":"2024-04-24T02:11:51.989479+0000","last_unstale":"2024-04-24T02:12:45.802977+0000","last_undegraded":"2024-04-24T02:12:45.802977+0000","last_fullsized":"2024-04-24T02:12:45.802977+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:50.697037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:50.697037+0000","last_clean_scrub_stamp":"2024-04-24T02:11:50.697037+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:59:33.037844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.810884+0000","last_change":"2024-04-24T02:11:56.724372+0000","last_active":"2024-04-24T02:12:45.810884+0000","last_peered":"2024-04-24T02:12:45.810884+0000","last_clean":"2024-04-24T02:12:45.810884+0000","last_became_active":"2024-04-24T02:11:56.723925+0000","last_became_peered":"2024-04-24T02:11:56.723925+0000","last_unstale":"2024-04-24T02:12:45.810884+0000","last_undegraded":"2024-04-24T02:12:45.810884+0000","last_fullsized":"2024-04-24T02:12:45.810884+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:03:43.918155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.809983+0000","last_change":"2024-04-24T02:12:02.758997+0000","last_active":"2024-04-24T02:12:45.809983+0000","last_peered":"2024-04-24T02:12:45.809983+0000","last_clean":"2024-04-24T02:12:45.809983+0000","last_became_active":"2024-04-24T02:12:02.758653+0000","last_became_peered":"2024-04-24T02:12:02.758653+0000","last_unstale":"2024-04-24T02:12:45.809983+0000","last_undegraded":"2024-04-24T02:12:45.809983+0000","last_fullsized":"2024-04-24T02:12:45.809983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:04:14.072260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"23'1","reported_seq":218,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.412883+0000","last_change":"2024-04-24T02:12:06.757529+0000","last_active":"2024-04-24T02:14:12.412883+0000","last_peered":"2024-04-24T02:14:12.412883+0000","last_clean":"2024-04-24T02:14:12.412883+0000","last_became_active":"2024-04-24T02:12:06.757173+0000","last_became_peered":"2024-04-24T02:12:06.757173+0000","last_unstale":"2024-04-24T02:14:12.412883+0000","last_undegraded":"2024-04-24T02:14:12.412883+0000","last_fullsized":"2024-04-24T02:14:12.412883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:25:48.408637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'82","reported_seq":157,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.357685+0000","last_change":"2024-04-24T02:12:08.781224+0000","last_active":"2024-04-24T02:14:11.357685+0000","last_peered":"2024-04-24T02:14:11.357685+0000","last_clean":"2024-04-24T02:14:11.357685+0000","last_became_active":"2024-04-24T02:12:08.780923+0000","last_became_peered":"2024-04-24T02:12:08.780923+0000","last_unstale":"2024-04-24T02:14:11.357685+0000","last_undegraded":"2024-04-24T02:14:11.357685+0000","last_fullsized":"2024-04-24T02:14:11.357685+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:26:20.925750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.806595+0000","last_change":"2024-04-24T02:12:10.784443+0000","last_active":"2024-04-24T02:12:45.806595+0000","last_peered":"2024-04-24T02:12:45.806595+0000","last_clean":"2024-04-24T02:12:45.806595+0000","last_became_active":"2024-04-24T02:12:10.784101+0000","last_became_peered":"2024-04-24T02:12:10.784101+0000","last_unstale":"2024-04-24T02:12:45.806595+0000","last_undegraded":"2024-04-24T02:12:45.806595+0000","last_fullsized":"2024-04-24T02:12:45.806595+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:41:35.662091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'81","reported_seq":162,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.478759+0000","last_change":"2024-04-24T02:12:12.795520+0000","last_active":"2024-04-24T02:15:13.478759+0000","last_peered":"2024-04-24T02:15:13.478759+0000","last_clean":"2024-04-24T02:15:13.478759+0000","last_became_active":"2024-04-24T02:12:12.795281+0000","last_became_peered":"2024-04-24T02:12:12.795281+0000","last_unstale":"2024-04-24T02:15:13.478759+0000","last_undegraded":"2024-04-24T02:15:13.478759+0000","last_fullsized":"2024-04-24T02:15:13.478759+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:12:13.247301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.349374+0000","last_change":"2024-04-24T02:12:04.764296+0000","last_active":"2024-04-24T02:15:13.349374+0000","last_peered":"2024-04-24T02:15:13.349374+0000","last_clean":"2024-04-24T02:15:13.349374+0000","last_became_active":"2024-04-24T02:12:04.763782+0000","last_became_peered":"2024-04-24T02:12:04.763782+0000","last_unstale":"2024-04-24T02:15:13.349374+0000","last_undegraded":"2024-04-24T02:15:13.349374+0000","last_fullsized":"2024-04-24T02:15:13.349374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:23:24.501187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.808625+0000","last_change":"2024-04-24T02:11:56.724008+0000","last_active":"2024-04-24T02:12:45.808625+0000","last_peered":"2024-04-24T02:12:45.808625+0000","last_clean":"2024-04-24T02:12:45.808625+0000","last_became_active":"2024-04-24T02:11:56.723682+0000","last_became_peered":"2024-04-24T02:11:56.723682+0000","last_unstale":"2024-04-24T02:12:45.808625+0000","last_undegraded":"2024-04-24T02:12:45.808625+0000","last_fullsized":"2024-04-24T02:12:45.808625+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:32:18.958074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"30'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804843+0000","last_change":"2024-04-24T02:12:02.742006+0000","last_active":"2024-04-24T02:12:45.804843+0000","last_peered":"2024-04-24T02:12:45.804843+0000","last_clean":"2024-04-24T02:12:45.804843+0000","last_became_active":"2024-04-24T02:12:02.741610+0000","last_became_peered":"2024-04-24T02:12:02.741610+0000","last_unstale":"2024-04-24T02:12:45.804843+0000","last_undegraded":"2024-04-24T02:12:45.804843+0000","last_fullsized":"2024-04-24T02:12:45.804843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:51:28.003991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.814410+0000","last_change":"2024-04-24T02:12:06.757365+0000","last_active":"2024-04-24T02:12:45.814410+0000","last_peered":"2024-04-24T02:12:45.814410+0000","last_clean":"2024-04-24T02:12:45.814410+0000","last_became_active":"2024-04-24T02:12:06.757052+0000","last_became_peered":"2024-04-24T02:12:06.757052+0000","last_unstale":"2024-04-24T02:12:45.814410+0000","last_undegraded":"2024-04-24T02:12:45.814410+0000","last_fullsized":"2024-04-24T02:12:45.814410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:03:51.154050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'280","reported_seq":489,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:11.839565+0000","last_change":"2024-04-24T02:12:08.780195+0000","last_active":"2024-04-24T02:15:11.839565+0000","last_peered":"2024-04-24T02:15:11.839565+0000","last_clean":"2024-04-24T02:15:11.839565+0000","last_became_active":"2024-04-24T02:12:08.779884+0000","last_became_peered":"2024-04-24T02:12:08.779884+0000","last_unstale":"2024-04-24T02:15:11.839565+0000","last_undegraded":"2024-04-24T02:15:11.839565+0000","last_fullsized":"2024-04-24T02:15:11.839565+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:39:29.226371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":366,"num_read_kb":350,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.811202+0000","last_change":"2024-04-24T02:12:10.784601+0000","last_active":"2024-04-24T02:12:45.811202+0000","last_peered":"2024-04-24T02:12:45.811202+0000","last_clean":"2024-04-24T02:12:45.811202+0000","last_became_active":"2024-04-24T02:12:10.783788+0000","last_became_peered":"2024-04-24T02:12:10.783788+0000","last_unstale":"2024-04-24T02:12:45.811202+0000","last_undegraded":"2024-04-24T02:12:45.811202+0000","last_fullsized":"2024-04-24T02:12:45.811202+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:11:51.847310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:28.951418+0000","last_change":"2024-04-24T02:12:12.796284+0000","last_active":"2024-04-24T02:13:28.951418+0000","last_peered":"2024-04-24T02:13:28.951418+0000","last_clean":"2024-04-24T02:13:28.951418+0000","last_became_active":"2024-04-24T02:12:12.795983+0000","last_became_peered":"2024-04-24T02:12:12.795983+0000","last_unstale":"2024-04-24T02:13:28.951418+0000","last_undegraded":"2024-04-24T02:13:28.951418+0000","last_fullsized":"2024-04-24T02:13:28.951418+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:51:33.324014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'22","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.169911+0000","last_change":"2024-04-24T02:12:04.756013+0000","last_active":"2024-04-24T02:15:13.169911+0000","last_peered":"2024-04-24T02:15:13.169911+0000","last_clean":"2024-04-24T02:15:13.169911+0000","last_became_active":"2024-04-24T02:12:04.755649+0000","last_became_peered":"2024-04-24T02:12:04.755649+0000","last_unstale":"2024-04-24T02:15:13.169911+0000","last_undegraded":"2024-04-24T02:15:13.169911+0000","last_fullsized":"2024-04-24T02:15:13.169911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:57:24.304456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":72,"num_write":29,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805377+0000","last_change":"2024-04-24T02:11:56.724010+0000","last_active":"2024-04-24T02:12:45.805377+0000","last_peered":"2024-04-24T02:12:45.805377+0000","last_clean":"2024-04-24T02:12:45.805377+0000","last_became_active":"2024-04-24T02:11:56.723497+0000","last_became_peered":"2024-04-24T02:11:56.723497+0000","last_unstale":"2024-04-24T02:12:45.805377+0000","last_undegraded":"2024-04-24T02:12:45.805377+0000","last_fullsized":"2024-04-24T02:12:45.805377+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:26:11.265014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'1","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:03.032259+0000","last_change":"2024-04-24T02:12:02.745574+0000","last_active":"2024-04-24T02:14:03.032259+0000","last_peered":"2024-04-24T02:14:03.032259+0000","last_clean":"2024-04-24T02:14:03.032259+0000","last_became_active":"2024-04-24T02:12:02.745238+0000","last_became_peered":"2024-04-24T02:12:02.745238+0000","last_unstale":"2024-04-24T02:14:03.032259+0000","last_undegraded":"2024-04-24T02:14:03.032259+0000","last_fullsized":"2024-04-24T02:14:03.032259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:18:53.552200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.813613+0000","last_change":"2024-04-24T02:12:06.757374+0000","last_active":"2024-04-24T02:12:45.813613+0000","last_peered":"2024-04-24T02:12:45.813613+0000","last_clean":"2024-04-24T02:12:45.813613+0000","last_became_active":"2024-04-24T02:12:06.757009+0000","last_became_peered":"2024-04-24T02:12:06.757009+0000","last_unstale":"2024-04-24T02:12:45.813613+0000","last_undegraded":"2024-04-24T02:12:45.813613+0000","last_fullsized":"2024-04-24T02:12:45.813613+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:26:34.319373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'16","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:11.839804+0000","last_change":"2024-04-24T02:12:08.774513+0000","last_active":"2024-04-24T02:15:11.839804+0000","last_peered":"2024-04-24T02:15:11.839804+0000","last_clean":"2024-04-24T02:15:11.839804+0000","last_became_active":"2024-04-24T02:12:08.774177+0000","last_became_peered":"2024-04-24T02:12:08.774177+0000","last_unstale":"2024-04-24T02:15:11.839804+0000","last_undegraded":"2024-04-24T02:15:11.839804+0000","last_fullsized":"2024-04-24T02:15:11.839804+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:27:58.828052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805416+0000","last_change":"2024-04-24T02:12:10.784579+0000","last_active":"2024-04-24T02:12:45.805416+0000","last_peered":"2024-04-24T02:12:45.805416+0000","last_clean":"2024-04-24T02:12:45.805416+0000","last_became_active":"2024-04-24T02:12:10.784247+0000","last_became_peered":"2024-04-24T02:12:10.784247+0000","last_unstale":"2024-04-24T02:12:45.805416+0000","last_undegraded":"2024-04-24T02:12:45.805416+0000","last_fullsized":"2024-04-24T02:12:45.805416+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:05:36.775186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.772420+0000","last_change":"2024-04-24T02:12:12.794755+0000","last_active":"2024-04-24T02:14:12.772420+0000","last_peered":"2024-04-24T02:14:12.772420+0000","last_clean":"2024-04-24T02:14:12.772420+0000","last_became_active":"2024-04-24T02:12:12.794453+0000","last_became_peered":"2024-04-24T02:12:12.794453+0000","last_unstale":"2024-04-24T02:14:12.772420+0000","last_undegraded":"2024-04-24T02:14:12.772420+0000","last_fullsized":"2024-04-24T02:14:12.772420+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:14:32.909095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'3","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:13.033851+0000","last_change":"2024-04-24T02:12:04.749524+0000","last_active":"2024-04-24T02:14:13.033851+0000","last_peered":"2024-04-24T02:14:13.033851+0000","last_clean":"2024-04-24T02:14:13.033851+0000","last_became_active":"2024-04-24T02:12:04.749173+0000","last_became_peered":"2024-04-24T02:12:04.749173+0000","last_unstale":"2024-04-24T02:14:13.033851+0000","last_undegraded":"2024-04-24T02:14:13.033851+0000","last_fullsized":"2024-04-24T02:14:13.033851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:58:09.943964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.809808+0000","last_change":"2024-04-24T02:11:56.723425+0000","last_active":"2024-04-24T02:12:45.809808+0000","last_peered":"2024-04-24T02:12:45.809808+0000","last_clean":"2024-04-24T02:12:45.809808+0000","last_became_active":"2024-04-24T02:11:56.723125+0000","last_became_peered":"2024-04-24T02:11:56.723125+0000","last_unstale":"2024-04-24T02:12:45.809808+0000","last_undegraded":"2024-04-24T02:12:45.809808+0000","last_fullsized":"2024-04-24T02:12:45.809808+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:48:12.516334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.808101+0000","last_change":"2024-04-24T02:12:02.746939+0000","last_active":"2024-04-24T02:12:45.808101+0000","last_peered":"2024-04-24T02:12:45.808101+0000","last_clean":"2024-04-24T02:12:45.808101+0000","last_became_active":"2024-04-24T02:12:02.746682+0000","last_became_peered":"2024-04-24T02:12:02.746682+0000","last_unstale":"2024-04-24T02:12:45.808101+0000","last_undegraded":"2024-04-24T02:12:45.808101+0000","last_fullsized":"2024-04-24T02:12:45.808101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:51:48.494870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.806518+0000","last_change":"2024-04-24T02:12:06.759484+0000","last_active":"2024-04-24T02:12:45.806518+0000","last_peered":"2024-04-24T02:12:45.806518+0000","last_clean":"2024-04-24T02:12:45.806518+0000","last_became_active":"2024-04-24T02:12:06.759169+0000","last_became_peered":"2024-04-24T02:12:06.759169+0000","last_unstale":"2024-04-24T02:12:45.806518+0000","last_undegraded":"2024-04-24T02:12:45.806518+0000","last_fullsized":"2024-04-24T02:12:45.806518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:44:21.656525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'13","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:12.792900+0000","last_change":"2024-04-24T02:12:08.783178+0000","last_active":"2024-04-24T02:15:12.792900+0000","last_peered":"2024-04-24T02:15:12.792900+0000","last_clean":"2024-04-24T02:15:12.792900+0000","last_became_active":"2024-04-24T02:12:08.782765+0000","last_became_peered":"2024-04-24T02:12:08.782765+0000","last_unstale":"2024-04-24T02:15:12.792900+0000","last_undegraded":"2024-04-24T02:15:12.792900+0000","last_fullsized":"2024-04-24T02:15:12.792900+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:43:33.627490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.813589+0000","last_change":"2024-04-24T02:12:10.785313+0000","last_active":"2024-04-24T02:12:45.813589+0000","last_peered":"2024-04-24T02:12:45.813589+0000","last_clean":"2024-04-24T02:12:45.813589+0000","last_became_active":"2024-04-24T02:12:10.783813+0000","last_became_peered":"2024-04-24T02:12:10.783813+0000","last_unstale":"2024-04-24T02:12:45.813589+0000","last_undegraded":"2024-04-24T02:12:45.813589+0000","last_fullsized":"2024-04-24T02:12:45.813589+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:29:00.483135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.525281+0000","last_change":"2024-04-24T02:12:12.797895+0000","last_active":"2024-04-24T02:14:12.525281+0000","last_peered":"2024-04-24T02:14:12.525281+0000","last_clean":"2024-04-24T02:14:12.525281+0000","last_became_active":"2024-04-24T02:12:12.796507+0000","last_became_peered":"2024-04-24T02:12:12.796507+0000","last_unstale":"2024-04-24T02:14:12.525281+0000","last_undegraded":"2024-04-24T02:14:12.525281+0000","last_fullsized":"2024-04-24T02:14:12.525281+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:24:58.744108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:28.945114+0000","last_change":"2024-04-24T02:12:04.767815+0000","last_active":"2024-04-24T02:13:28.945114+0000","last_peered":"2024-04-24T02:13:28.945114+0000","last_clean":"2024-04-24T02:13:28.945114+0000","last_became_active":"2024-04-24T02:12:04.767221+0000","last_became_peered":"2024-04-24T02:12:04.767221+0000","last_unstale":"2024-04-24T02:13:28.945114+0000","last_undegraded":"2024-04-24T02:13:28.945114+0000","last_fullsized":"2024-04-24T02:13:28.945114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:20:27.874953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.808341+0000","last_change":"2024-04-24T02:12:02.747860+0000","last_active":"2024-04-24T02:12:45.808341+0000","last_peered":"2024-04-24T02:12:45.808341+0000","last_clean":"2024-04-24T02:12:45.808341+0000","last_became_active":"2024-04-24T02:12:02.744161+0000","last_became_peered":"2024-04-24T02:12:02.744161+0000","last_unstale":"2024-04-24T02:12:45.808341+0000","last_undegraded":"2024-04-24T02:12:45.808341+0000","last_fullsized":"2024-04-24T02:12:45.808341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:30:58.417438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805335+0000","last_change":"2024-04-24T02:11:56.723976+0000","last_active":"2024-04-24T02:12:45.805335+0000","last_peered":"2024-04-24T02:12:45.805335+0000","last_clean":"2024-04-24T02:12:45.805335+0000","last_became_active":"2024-04-24T02:11:56.723697+0000","last_became_peered":"2024-04-24T02:11:56.723697+0000","last_unstale":"2024-04-24T02:12:45.805335+0000","last_undegraded":"2024-04-24T02:12:45.805335+0000","last_fullsized":"2024-04-24T02:12:45.805335+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:00:04.661481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'1","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:13.033798+0000","last_change":"2024-04-24T02:12:06.759464+0000","last_active":"2024-04-24T02:14:13.033798+0000","last_peered":"2024-04-24T02:14:13.033798+0000","last_clean":"2024-04-24T02:14:13.033798+0000","last_became_active":"2024-04-24T02:12:06.759160+0000","last_became_peered":"2024-04-24T02:12:06.759160+0000","last_unstale":"2024-04-24T02:14:13.033798+0000","last_undegraded":"2024-04-24T02:14:13.033798+0000","last_fullsized":"2024-04-24T02:14:13.033798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:02:59.130069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'73","reported_seq":144,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.359157+0000","last_change":"2024-04-24T02:12:08.780903+0000","last_active":"2024-04-24T02:14:11.359157+0000","last_peered":"2024-04-24T02:14:11.359157+0000","last_clean":"2024-04-24T02:14:11.359157+0000","last_became_active":"2024-04-24T02:12:08.780688+0000","last_became_peered":"2024-04-24T02:12:08.780688+0000","last_unstale":"2024-04-24T02:14:11.359157+0000","last_undegraded":"2024-04-24T02:14:11.359157+0000","last_fullsized":"2024-04-24T02:14:11.359157+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:25:49.361496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":77,"num_read_kb":63,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.806759+0000","last_change":"2024-04-24T02:12:10.781922+0000","last_active":"2024-04-24T02:12:45.806759+0000","last_peered":"2024-04-24T02:12:45.806759+0000","last_clean":"2024-04-24T02:12:45.806759+0000","last_became_active":"2024-04-24T02:12:10.781586+0000","last_became_peered":"2024-04-24T02:12:10.781586+0000","last_unstale":"2024-04-24T02:12:45.806759+0000","last_undegraded":"2024-04-24T02:12:45.806759+0000","last_fullsized":"2024-04-24T02:12:45.806759+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:24:04.726684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'9","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.708334+0000","last_change":"2024-04-24T02:12:12.798530+0000","last_active":"2024-04-24T02:14:12.708334+0000","last_peered":"2024-04-24T02:14:12.708334+0000","last_clean":"2024-04-24T02:14:12.708334+0000","last_became_active":"2024-04-24T02:12:12.798272+0000","last_became_peered":"2024-04-24T02:12:12.798272+0000","last_unstale":"2024-04-24T02:14:12.708334+0000","last_undegraded":"2024-04-24T02:14:12.708334+0000","last_fullsized":"2024-04-24T02:14:12.708334+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:58:10.660903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'6","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.766875+0000","last_change":"2024-04-24T02:12:04.765396+0000","last_active":"2024-04-24T02:14:12.766875+0000","last_peered":"2024-04-24T02:14:12.766875+0000","last_clean":"2024-04-24T02:14:12.766875+0000","last_became_active":"2024-04-24T02:12:04.765093+0000","last_became_peered":"2024-04-24T02:12:04.765093+0000","last_unstale":"2024-04-24T02:14:12.766875+0000","last_undegraded":"2024-04-24T02:14:12.766875+0000","last_fullsized":"2024-04-24T02:14:12.766875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:25:06.512394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805538+0000","last_change":"2024-04-24T02:12:02.741909+0000","last_active":"2024-04-24T02:12:45.805538+0000","last_peered":"2024-04-24T02:12:45.805538+0000","last_clean":"2024-04-24T02:12:45.805538+0000","last_became_active":"2024-04-24T02:12:02.741565+0000","last_became_peered":"2024-04-24T02:12:02.741565+0000","last_unstale":"2024-04-24T02:12:45.805538+0000","last_undegraded":"2024-04-24T02:12:45.805538+0000","last_fullsized":"2024-04-24T02:12:45.805538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:11:16.086557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.811832+0000","last_change":"2024-04-24T02:11:56.724046+0000","last_active":"2024-04-24T02:12:45.811832+0000","last_peered":"2024-04-24T02:12:45.811832+0000","last_clean":"2024-04-24T02:12:45.811832+0000","last_became_active":"2024-04-24T02:11:56.723673+0000","last_became_peered":"2024-04-24T02:11:56.723673+0000","last_unstale":"2024-04-24T02:12:45.811832+0000","last_undegraded":"2024-04-24T02:12:45.811832+0000","last_fullsized":"2024-04-24T02:12:45.811832+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:24:47.683078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.810339+0000","last_change":"2024-04-24T02:12:06.756068+0000","last_active":"2024-04-24T02:12:45.810339+0000","last_peered":"2024-04-24T02:12:45.810339+0000","last_clean":"2024-04-24T02:12:45.810339+0000","last_became_active":"2024-04-24T02:12:06.755760+0000","last_became_peered":"2024-04-24T02:12:06.755760+0000","last_unstale":"2024-04-24T02:12:45.810339+0000","last_undegraded":"2024-04-24T02:12:45.810339+0000","last_fullsized":"2024-04-24T02:12:45.810339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:53:36.479217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"30'20","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804087+0000","last_change":"2024-04-24T02:12:08.780018+0000","last_active":"2024-04-24T02:12:45.804087+0000","last_peered":"2024-04-24T02:12:45.804087+0000","last_clean":"2024-04-24T02:12:45.804087+0000","last_became_active":"2024-04-24T02:12:08.779698+0000","last_became_peered":"2024-04-24T02:12:08.779698+0000","last_unstale":"2024-04-24T02:12:45.804087+0000","last_undegraded":"2024-04-24T02:12:45.804087+0000","last_fullsized":"2024-04-24T02:12:45.804087+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:24:02.718714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'282","reported_seq":346,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:11.839480+0000","last_change":"2024-04-24T02:12:10.782077+0000","last_active":"2024-04-24T02:15:11.839480+0000","last_peered":"2024-04-24T02:15:11.839480+0000","last_clean":"2024-04-24T02:15:11.839480+0000","last_became_active":"2024-04-24T02:12:10.781799+0000","last_became_peered":"2024-04-24T02:12:10.781799+0000","last_unstale":"2024-04-24T02:15:11.839480+0000","last_undegraded":"2024-04-24T02:15:11.839480+0000","last_fullsized":"2024-04-24T02:15:11.839480+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:22:36.118429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'2","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:46.562672+0000","last_change":"2024-04-24T02:12:12.794164+0000","last_active":"2024-04-24T02:12:46.562672+0000","last_peered":"2024-04-24T02:12:46.562672+0000","last_clean":"2024-04-24T02:12:46.562672+0000","last_became_active":"2024-04-24T02:12:12.792628+0000","last_became_peered":"2024-04-24T02:12:12.792628+0000","last_unstale":"2024-04-24T02:12:46.562672+0000","last_undegraded":"2024-04-24T02:12:46.562672+0000","last_fullsized":"2024-04-24T02:12:46.562672+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:28:32.181565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'19","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.400430+0000","last_change":"2024-04-24T02:12:04.768557+0000","last_active":"2024-04-24T02:15:13.400430+0000","last_peered":"2024-04-24T02:15:13.400430+0000","last_clean":"2024-04-24T02:15:13.400430+0000","last_became_active":"2024-04-24T02:12:04.768066+0000","last_became_peered":"2024-04-24T02:12:04.768066+0000","last_unstale":"2024-04-24T02:15:13.400430+0000","last_undegraded":"2024-04-24T02:15:13.400430+0000","last_fullsized":"2024-04-24T02:15:13.400430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:37:58.075143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":70,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.813780+0000","last_change":"2024-04-24T02:12:02.761644+0000","last_active":"2024-04-24T02:12:45.813780+0000","last_peered":"2024-04-24T02:12:45.813780+0000","last_clean":"2024-04-24T02:12:45.813780+0000","last_became_active":"2024-04-24T02:12:02.760824+0000","last_became_peered":"2024-04-24T02:12:02.760824+0000","last_unstale":"2024-04-24T02:12:45.813780+0000","last_undegraded":"2024-04-24T02:12:45.813780+0000","last_fullsized":"2024-04-24T02:12:45.813780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:24:13.399996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.806050+0000","last_change":"2024-04-24T02:11:56.723499+0000","last_active":"2024-04-24T02:12:45.806050+0000","last_peered":"2024-04-24T02:12:45.806050+0000","last_clean":"2024-04-24T02:12:45.806050+0000","last_became_active":"2024-04-24T02:11:56.723277+0000","last_became_peered":"2024-04-24T02:11:56.723277+0000","last_unstale":"2024-04-24T02:12:45.806050+0000","last_undegraded":"2024-04-24T02:12:45.806050+0000","last_fullsized":"2024-04-24T02:12:45.806050+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:04:46.209999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.812139+0000","last_change":"2024-04-24T02:12:06.754713+0000","last_active":"2024-04-24T02:12:45.812139+0000","last_peered":"2024-04-24T02:12:45.812139+0000","last_clean":"2024-04-24T02:12:45.812139+0000","last_became_active":"2024-04-24T02:12:06.754414+0000","last_became_peered":"2024-04-24T02:12:06.754414+0000","last_unstale":"2024-04-24T02:12:45.812139+0000","last_undegraded":"2024-04-24T02:12:45.812139+0000","last_fullsized":"2024-04-24T02:12:45.812139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:38:23.173188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"30'17","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.810952+0000","last_change":"2024-04-24T02:12:08.780239+0000","last_active":"2024-04-24T02:12:45.810952+0000","last_peered":"2024-04-24T02:12:45.810952+0000","last_clean":"2024-04-24T02:12:45.810952+0000","last_became_active":"2024-04-24T02:12:08.779937+0000","last_became_peered":"2024-04-24T02:12:08.779937+0000","last_unstale":"2024-04-24T02:12:45.810952+0000","last_undegraded":"2024-04-24T02:12:45.810952+0000","last_fullsized":"2024-04-24T02:12:45.810952+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:33:58.011327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'282","reported_seq":389,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.567071+0000","last_change":"2024-04-24T02:12:10.776879+0000","last_active":"2024-04-24T02:15:13.567071+0000","last_peered":"2024-04-24T02:15:13.567071+0000","last_clean":"2024-04-24T02:15:13.567071+0000","last_became_active":"2024-04-24T02:12:10.776594+0000","last_became_peered":"2024-04-24T02:12:10.776594+0000","last_unstale":"2024-04-24T02:15:13.567071+0000","last_undegraded":"2024-04-24T02:15:13.567071+0000","last_fullsized":"2024-04-24T02:15:13.567071+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:11:56.635776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.803952+0000","last_change":"2024-04-24T02:12:12.795629+0000","last_active":"2024-04-24T02:12:45.803952+0000","last_peered":"2024-04-24T02:12:45.803952+0000","last_clean":"2024-04-24T02:12:45.803952+0000","last_became_active":"2024-04-24T02:12:12.795328+0000","last_became_peered":"2024-04-24T02:12:12.795328+0000","last_unstale":"2024-04-24T02:12:45.803952+0000","last_undegraded":"2024-04-24T02:12:45.803952+0000","last_fullsized":"2024-04-24T02:12:45.803952+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:55:23.691414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'3","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.264812+0000","last_change":"2024-04-24T02:12:04.760388+0000","last_active":"2024-04-24T02:15:13.264812+0000","last_peered":"2024-04-24T02:15:13.264812+0000","last_clean":"2024-04-24T02:15:13.264812+0000","last_became_active":"2024-04-24T02:12:04.760099+0000","last_became_peered":"2024-04-24T02:12:04.760099+0000","last_unstale":"2024-04-24T02:15:13.264812+0000","last_undegraded":"2024-04-24T02:15:13.264812+0000","last_fullsized":"2024-04-24T02:15:13.264812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:00:23.946903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'3","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:15.038544+0000","last_change":"2024-04-24T02:12:02.744971+0000","last_active":"2024-04-24T02:14:15.038544+0000","last_peered":"2024-04-24T02:14:15.038544+0000","last_clean":"2024-04-24T02:14:15.038544+0000","last_became_active":"2024-04-24T02:12:02.744454+0000","last_became_peered":"2024-04-24T02:12:02.744454+0000","last_unstale":"2024-04-24T02:14:15.038544+0000","last_undegraded":"2024-04-24T02:14:15.038544+0000","last_fullsized":"2024-04-24T02:14:15.038544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:59:32.006851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.813632+0000","last_change":"2024-04-24T02:11:57.000530+0000","last_active":"2024-04-24T02:12:45.813632+0000","last_peered":"2024-04-24T02:12:45.813632+0000","last_clean":"2024-04-24T02:12:45.813632+0000","last_became_active":"2024-04-24T02:11:57.000197+0000","last_became_peered":"2024-04-24T02:11:57.000197+0000","last_unstale":"2024-04-24T02:12:45.813632+0000","last_undegraded":"2024-04-24T02:12:45.813632+0000","last_fullsized":"2024-04-24T02:12:45.813632+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:42:43.216261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.810434+0000","last_change":"2024-04-24T02:12:06.754527+0000","last_active":"2024-04-24T02:12:45.810434+0000","last_peered":"2024-04-24T02:12:45.810434+0000","last_clean":"2024-04-24T02:12:45.810434+0000","last_became_active":"2024-04-24T02:12:06.754107+0000","last_became_peered":"2024-04-24T02:12:06.754107+0000","last_unstale":"2024-04-24T02:12:45.810434+0000","last_undegraded":"2024-04-24T02:12:45.810434+0000","last_fullsized":"2024-04-24T02:12:45.810434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:43:41.699448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'90","reported_seq":168,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.344060+0000","last_change":"2024-04-24T02:12:08.781379+0000","last_active":"2024-04-24T02:14:11.344060+0000","last_peered":"2024-04-24T02:14:11.344060+0000","last_clean":"2024-04-24T02:14:11.344060+0000","last_became_active":"2024-04-24T02:12:08.780925+0000","last_became_peered":"2024-04-24T02:12:08.780925+0000","last_unstale":"2024-04-24T02:14:11.344060+0000","last_undegraded":"2024-04-24T02:14:11.344060+0000","last_fullsized":"2024-04-24T02:14:11.344060+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:24:18.129044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":90,"num_read_kb":90,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804630+0000","last_change":"2024-04-24T02:12:10.775385+0000","last_active":"2024-04-24T02:12:45.804630+0000","last_peered":"2024-04-24T02:12:45.804630+0000","last_clean":"2024-04-24T02:12:45.804630+0000","last_became_active":"2024-04-24T02:12:10.775165+0000","last_became_peered":"2024-04-24T02:12:10.775165+0000","last_unstale":"2024-04-24T02:12:45.804630+0000","last_undegraded":"2024-04-24T02:12:45.804630+0000","last_fullsized":"2024-04-24T02:12:45.804630+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:26:58.984436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.806618+0000","last_change":"2024-04-24T02:12:12.796696+0000","last_active":"2024-04-24T02:12:45.806618+0000","last_peered":"2024-04-24T02:12:45.806618+0000","last_clean":"2024-04-24T02:12:45.806618+0000","last_became_active":"2024-04-24T02:12:12.796411+0000","last_became_peered":"2024-04-24T02:12:12.796411+0000","last_unstale":"2024-04-24T02:12:45.806618+0000","last_undegraded":"2024-04-24T02:12:45.806618+0000","last_fullsized":"2024-04-24T02:12:45.806618+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:22:38.124687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.808519+0000","last_change":"2024-04-24T02:12:12.801700+0000","last_active":"2024-04-24T02:12:45.808519+0000","last_peered":"2024-04-24T02:12:45.808519+0000","last_clean":"2024-04-24T02:12:45.808519+0000","last_became_active":"2024-04-24T02:12:12.801346+0000","last_became_peered":"2024-04-24T02:12:12.801346+0000","last_unstale":"2024-04-24T02:12:45.808519+0000","last_undegraded":"2024-04-24T02:12:45.808519+0000","last_fullsized":"2024-04-24T02:12:45.808519+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:53:42.506048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:47.053226+0000","last_change":"2024-04-24T02:12:04.764138+0000","last_active":"2024-04-24T02:12:47.053226+0000","last_peered":"2024-04-24T02:12:47.053226+0000","last_clean":"2024-04-24T02:12:47.053226+0000","last_became_active":"2024-04-24T02:12:04.763860+0000","last_became_peered":"2024-04-24T02:12:04.763860+0000","last_unstale":"2024-04-24T02:12:47.053226+0000","last_undegraded":"2024-04-24T02:12:47.053226+0000","last_fullsized":"2024-04-24T02:12:47.053226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:40:49.148779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"32'1","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:25.040623+0000","last_change":"2024-04-24T02:12:02.757073+0000","last_active":"2024-04-24T02:14:25.040623+0000","last_peered":"2024-04-24T02:14:25.040623+0000","last_clean":"2024-04-24T02:14:25.040623+0000","last_became_active":"2024-04-24T02:12:02.753166+0000","last_became_peered":"2024-04-24T02:12:02.753166+0000","last_unstale":"2024-04-24T02:14:25.040623+0000","last_undegraded":"2024-04-24T02:14:25.040623+0000","last_fullsized":"2024-04-24T02:14:25.040623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:00.841064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.803876+0000","last_change":"2024-04-24T02:12:06.758976+0000","last_active":"2024-04-24T02:12:45.803876+0000","last_peered":"2024-04-24T02:12:45.803876+0000","last_clean":"2024-04-24T02:12:45.803876+0000","last_became_active":"2024-04-24T02:12:06.758468+0000","last_became_peered":"2024-04-24T02:12:06.758468+0000","last_unstale":"2024-04-24T02:12:45.803876+0000","last_undegraded":"2024-04-24T02:12:45.803876+0000","last_fullsized":"2024-04-24T02:12:45.803876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:47:41.924628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'38","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.350258+0000","last_change":"2024-04-24T02:12:08.782070+0000","last_active":"2024-04-24T02:14:11.350258+0000","last_peered":"2024-04-24T02:14:11.350258+0000","last_clean":"2024-04-24T02:14:11.350258+0000","last_became_active":"2024-04-24T02:12:08.780353+0000","last_became_peered":"2024-04-24T02:12:08.780353+0000","last_unstale":"2024-04-24T02:14:11.350258+0000","last_undegraded":"2024-04-24T02:14:11.350258+0000","last_fullsized":"2024-04-24T02:14:11.350258+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:00:39.858738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.810326+0000","last_change":"2024-04-24T02:12:10.787091+0000","last_active":"2024-04-24T02:12:45.810326+0000","last_peered":"2024-04-24T02:12:45.810326+0000","last_clean":"2024-04-24T02:12:45.810326+0000","last_became_active":"2024-04-24T02:12:10.786813+0000","last_became_peered":"2024-04-24T02:12:10.786813+0000","last_unstale":"2024-04-24T02:12:45.810326+0000","last_undegraded":"2024-04-24T02:12:45.810326+0000","last_fullsized":"2024-04-24T02:12:45.810326+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:25:58.461531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'9","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:12.872914+0000","last_change":"2024-04-24T02:12:12.796438+0000","last_active":"2024-04-24T02:15:12.872914+0000","last_peered":"2024-04-24T02:15:12.872914+0000","last_clean":"2024-04-24T02:15:12.872914+0000","last_became_active":"2024-04-24T02:12:12.796149+0000","last_became_peered":"2024-04-24T02:12:12.796149+0000","last_unstale":"2024-04-24T02:15:12.872914+0000","last_undegraded":"2024-04-24T02:15:12.872914+0000","last_fullsized":"2024-04-24T02:15:12.872914+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:33:07.219054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.170970+0000","last_change":"2024-04-24T02:12:45.816393+0000","last_active":"2024-04-24T02:15:13.170970+0000","last_peered":"2024-04-24T02:15:13.170970+0000","last_clean":"2024-04-24T02:15:13.170970+0000","last_became_active":"2024-04-24T02:12:45.816009+0000","last_became_peered":"2024-04-24T02:12:45.816009+0000","last_unstale":"2024-04-24T02:15:13.170970+0000","last_undegraded":"2024-04-24T02:15:13.170970+0000","last_fullsized":"2024-04-24T02:15:13.170970+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:00:38.405027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"32'6","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.342215+0000","last_change":"2024-04-24T02:12:02.755246+0000","last_active":"2024-04-24T02:15:13.342215+0000","last_peered":"2024-04-24T02:15:13.342215+0000","last_clean":"2024-04-24T02:15:13.342215+0000","last_became_active":"2024-04-24T02:12:02.754623+0000","last_became_peered":"2024-04-24T02:12:02.754623+0000","last_unstale":"2024-04-24T02:15:13.342215+0000","last_undegraded":"2024-04-24T02:15:13.342215+0000","last_fullsized":"2024-04-24T02:15:13.342215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:42.734407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.811478+0000","last_change":"2024-04-24T02:12:06.757753+0000","last_active":"2024-04-24T02:12:45.811478+0000","last_peered":"2024-04-24T02:12:45.811478+0000","last_clean":"2024-04-24T02:12:45.811478+0000","last_became_active":"2024-04-24T02:12:06.756998+0000","last_became_peered":"2024-04-24T02:12:06.756998+0000","last_unstale":"2024-04-24T02:12:45.811478+0000","last_undegraded":"2024-04-24T02:12:45.811478+0000","last_fullsized":"2024-04-24T02:12:45.811478+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:13:32.253391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'6","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:12.797382+0000","last_change":"2024-04-24T02:12:08.769916+0000","last_active":"2024-04-24T02:15:12.797382+0000","last_peered":"2024-04-24T02:15:12.797382+0000","last_clean":"2024-04-24T02:15:12.797382+0000","last_became_active":"2024-04-24T02:12:08.769610+0000","last_became_peered":"2024-04-24T02:12:08.769610+0000","last_unstale":"2024-04-24T02:15:12.797382+0000","last_undegraded":"2024-04-24T02:15:12.797382+0000","last_fullsized":"2024-04-24T02:15:12.797382+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:53:07.348788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805538+0000","last_change":"2024-04-24T02:12:10.785261+0000","last_active":"2024-04-24T02:12:45.805538+0000","last_peered":"2024-04-24T02:12:45.805538+0000","last_clean":"2024-04-24T02:12:45.805538+0000","last_became_active":"2024-04-24T02:12:10.784955+0000","last_became_peered":"2024-04-24T02:12:10.784955+0000","last_unstale":"2024-04-24T02:12:45.805538+0000","last_undegraded":"2024-04-24T02:12:45.805538+0000","last_fullsized":"2024-04-24T02:12:45.805538+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:52:08.817241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'10","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:47.056982+0000","last_change":"2024-04-24T02:12:12.792872+0000","last_active":"2024-04-24T02:12:47.056982+0000","last_peered":"2024-04-24T02:12:47.056982+0000","last_clean":"2024-04-24T02:12:47.056982+0000","last_became_active":"2024-04-24T02:12:12.792565+0000","last_became_peered":"2024-04-24T02:12:12.792565+0000","last_unstale":"2024-04-24T02:12:47.056982+0000","last_undegraded":"2024-04-24T02:12:47.056982+0000","last_fullsized":"2024-04-24T02:12:47.056982+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:01:51.258319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":60,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'3","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:28.035923+0000","last_change":"2024-04-24T02:12:04.767155+0000","last_active":"2024-04-24T02:14:28.035923+0000","last_peered":"2024-04-24T02:14:28.035923+0000","last_clean":"2024-04-24T02:14:28.035923+0000","last_became_active":"2024-04-24T02:12:04.766700+0000","last_became_peered":"2024-04-24T02:12:04.766700+0000","last_unstale":"2024-04-24T02:14:28.035923+0000","last_undegraded":"2024-04-24T02:14:28.035923+0000","last_fullsized":"2024-04-24T02:14:28.035923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:56:30.404631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.818398+0000","last_change":"2024-04-24T02:12:45.817612+0000","last_active":"2024-04-24T02:12:45.818398+0000","last_peered":"2024-04-24T02:12:45.818398+0000","last_clean":"2024-04-24T02:12:45.818398+0000","last_became_active":"2024-04-24T02:12:45.817240+0000","last_became_peered":"2024-04-24T02:12:45.817240+0000","last_unstale":"2024-04-24T02:12:45.818398+0000","last_undegraded":"2024-04-24T02:12:45.818398+0000","last_fullsized":"2024-04-24T02:12:45.818398+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:23:14.696386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804920+0000","last_change":"2024-04-24T02:12:06.766890+0000","last_active":"2024-04-24T02:12:45.804920+0000","last_peered":"2024-04-24T02:12:45.804920+0000","last_clean":"2024-04-24T02:12:45.804920+0000","last_became_active":"2024-04-24T02:12:06.764776+0000","last_became_peered":"2024-04-24T02:12:06.764776+0000","last_unstale":"2024-04-24T02:12:45.804920+0000","last_undegraded":"2024-04-24T02:12:45.804920+0000","last_fullsized":"2024-04-24T02:12:45.804920+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:57:48.700227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'40","reported_seq":99,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:12.853711+0000","last_change":"2024-04-24T02:12:08.768761+0000","last_active":"2024-04-24T02:15:12.853711+0000","last_peered":"2024-04-24T02:15:12.853711+0000","last_clean":"2024-04-24T02:15:12.853711+0000","last_became_active":"2024-04-24T02:12:08.768499+0000","last_became_peered":"2024-04-24T02:12:08.768499+0000","last_unstale":"2024-04-24T02:15:12.853711+0000","last_undegraded":"2024-04-24T02:15:12.853711+0000","last_fullsized":"2024-04-24T02:15:12.853711+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:50:29.784473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.803282+0000","last_change":"2024-04-24T02:12:10.777246+0000","last_active":"2024-04-24T02:12:45.803282+0000","last_peered":"2024-04-24T02:12:45.803282+0000","last_clean":"2024-04-24T02:12:45.803282+0000","last_became_active":"2024-04-24T02:12:10.776882+0000","last_became_peered":"2024-04-24T02:12:10.776882+0000","last_unstale":"2024-04-24T02:12:45.803282+0000","last_undegraded":"2024-04-24T02:12:45.803282+0000","last_fullsized":"2024-04-24T02:12:45.803282+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:53:40.499789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.377763+0000","last_change":"2024-04-24T02:12:12.794192+0000","last_active":"2024-04-24T02:15:13.377763+0000","last_peered":"2024-04-24T02:15:13.377763+0000","last_clean":"2024-04-24T02:15:13.377763+0000","last_became_active":"2024-04-24T02:12:12.793884+0000","last_became_peered":"2024-04-24T02:12:12.793884+0000","last_unstale":"2024-04-24T02:15:13.377763+0000","last_undegraded":"2024-04-24T02:15:13.377763+0000","last_fullsized":"2024-04-24T02:15:13.377763+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:38:38.919788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.256832+0000","last_change":"2024-04-24T02:12:04.768207+0000","last_active":"2024-04-24T02:15:13.256832+0000","last_peered":"2024-04-24T02:15:13.256832+0000","last_clean":"2024-04-24T02:15:13.256832+0000","last_became_active":"2024-04-24T02:12:04.767431+0000","last_became_peered":"2024-04-24T02:12:04.767431+0000","last_unstale":"2024-04-24T02:15:13.256832+0000","last_undegraded":"2024-04-24T02:15:13.256832+0000","last_fullsized":"2024-04-24T02:15:13.256832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:28:10.521399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:09.629738+0000","last_change":"2024-04-24T02:12:02.754566+0000","last_active":"2024-04-24T02:14:09.629738+0000","last_peered":"2024-04-24T02:14:09.629738+0000","last_clean":"2024-04-24T02:14:09.629738+0000","last_became_active":"2024-04-24T02:12:02.754295+0000","last_became_peered":"2024-04-24T02:12:02.754295+0000","last_unstale":"2024-04-24T02:14:09.629738+0000","last_undegraded":"2024-04-24T02:14:09.629738+0000","last_fullsized":"2024-04-24T02:14:09.629738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:23:23.715876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.812262+0000","last_change":"2024-04-24T02:12:06.758891+0000","last_active":"2024-04-24T02:12:45.812262+0000","last_peered":"2024-04-24T02:12:45.812262+0000","last_clean":"2024-04-24T02:12:45.812262+0000","last_became_active":"2024-04-24T02:12:06.758462+0000","last_became_peered":"2024-04-24T02:12:06.758462+0000","last_unstale":"2024-04-24T02:12:45.812262+0000","last_undegraded":"2024-04-24T02:12:45.812262+0000","last_fullsized":"2024-04-24T02:12:45.812262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:38:50.153825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.335567+0000","last_change":"2024-04-24T02:12:08.769125+0000","last_active":"2024-04-24T02:14:11.335567+0000","last_peered":"2024-04-24T02:14:11.335567+0000","last_clean":"2024-04-24T02:14:11.335567+0000","last_became_active":"2024-04-24T02:12:08.768814+0000","last_became_peered":"2024-04-24T02:12:08.768814+0000","last_unstale":"2024-04-24T02:14:11.335567+0000","last_undegraded":"2024-04-24T02:14:11.335567+0000","last_fullsized":"2024-04-24T02:14:11.335567+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:53:37.011426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.808892+0000","last_change":"2024-04-24T02:12:10.780084+0000","last_active":"2024-04-24T02:12:45.808892+0000","last_peered":"2024-04-24T02:12:45.808892+0000","last_clean":"2024-04-24T02:12:45.808892+0000","last_became_active":"2024-04-24T02:12:10.779734+0000","last_became_peered":"2024-04-24T02:12:10.779734+0000","last_unstale":"2024-04-24T02:12:45.808892+0000","last_undegraded":"2024-04-24T02:12:45.808892+0000","last_fullsized":"2024-04-24T02:12:45.808892+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:39:31.234341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'1","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:10.038390+0000","last_change":"2024-04-24T02:12:04.764834+0000","last_active":"2024-04-24T02:14:10.038390+0000","last_peered":"2024-04-24T02:14:10.038390+0000","last_clean":"2024-04-24T02:14:10.038390+0000","last_became_active":"2024-04-24T02:12:04.764564+0000","last_became_peered":"2024-04-24T02:12:04.764564+0000","last_unstale":"2024-04-24T02:14:10.038390+0000","last_undegraded":"2024-04-24T02:14:10.038390+0000","last_fullsized":"2024-04-24T02:14:10.038390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:39:25.206344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.608026+0000","last_change":"2024-04-24T02:12:45.809612+0000","last_active":"2024-04-24T02:14:12.608026+0000","last_peered":"2024-04-24T02:14:12.608026+0000","last_clean":"2024-04-24T02:14:12.608026+0000","last_became_active":"2024-04-24T02:12:45.809365+0000","last_became_peered":"2024-04-24T02:12:45.809365+0000","last_unstale":"2024-04-24T02:14:12.608026+0000","last_undegraded":"2024-04-24T02:14:12.608026+0000","last_fullsized":"2024-04-24T02:14:12.608026+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:58:04.705635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.816471+0000","last_change":"2024-04-24T02:12:45.815335+0000","last_active":"2024-04-24T02:12:45.816471+0000","last_peered":"2024-04-24T02:12:45.816471+0000","last_clean":"2024-04-24T02:12:45.816471+0000","last_became_active":"2024-04-24T02:12:45.814918+0000","last_became_peered":"2024-04-24T02:12:45.814918+0000","last_unstale":"2024-04-24T02:12:45.816471+0000","last_undegraded":"2024-04-24T02:12:45.816471+0000","last_fullsized":"2024-04-24T02:12:45.816471+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:19:12.091357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"32'62","reported_seq":124,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.781967+0000","last_change":"2024-04-24T02:12:08.769850+0000","last_active":"2024-04-24T02:14:12.781967+0000","last_peered":"2024-04-24T02:14:12.781967+0000","last_clean":"2024-04-24T02:14:12.781967+0000","last_became_active":"2024-04-24T02:12:08.769578+0000","last_became_peered":"2024-04-24T02:12:08.769578+0000","last_unstale":"2024-04-24T02:14:12.781967+0000","last_undegraded":"2024-04-24T02:14:12.781967+0000","last_fullsized":"2024-04-24T02:14:12.781967+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:33:19.698246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":58,"num_read_kb":48,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.808829+0000","last_change":"2024-04-24T02:12:10.780015+0000","last_active":"2024-04-24T02:12:45.808829+0000","last_peered":"2024-04-24T02:12:45.808829+0000","last_clean":"2024-04-24T02:12:45.808829+0000","last_became_active":"2024-04-24T02:12:10.779703+0000","last_became_peered":"2024-04-24T02:12:10.779703+0000","last_unstale":"2024-04-24T02:12:45.808829+0000","last_undegraded":"2024-04-24T02:12:45.808829+0000","last_fullsized":"2024-04-24T02:12:45.808829+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:24:15.761298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'16","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.705023+0000","last_change":"2024-04-24T02:12:12.791870+0000","last_active":"2024-04-24T02:14:12.705023+0000","last_peered":"2024-04-24T02:14:12.705023+0000","last_clean":"2024-04-24T02:14:12.705023+0000","last_became_active":"2024-04-24T02:12:12.791623+0000","last_became_peered":"2024-04-24T02:12:12.791623+0000","last_unstale":"2024-04-24T02:14:12.705023+0000","last_undegraded":"2024-04-24T02:14:12.705023+0000","last_fullsized":"2024-04-24T02:14:12.705023+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:33:17.393684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'10","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:09.632050+0000","last_change":"2024-04-24T02:12:04.755894+0000","last_active":"2024-04-24T02:14:09.632050+0000","last_peered":"2024-04-24T02:14:09.632050+0000","last_clean":"2024-04-24T02:14:09.632050+0000","last_became_active":"2024-04-24T02:12:04.755554+0000","last_became_peered":"2024-04-24T02:12:04.755554+0000","last_unstale":"2024-04-24T02:14:09.632050+0000","last_undegraded":"2024-04-24T02:14:09.632050+0000","last_fullsized":"2024-04-24T02:14:09.632050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:59:47.844020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.803119+0000","last_change":"2024-04-24T02:12:02.752017+0000","last_active":"2024-04-24T02:12:45.803119+0000","last_peered":"2024-04-24T02:12:45.803119+0000","last_clean":"2024-04-24T02:12:45.803119+0000","last_became_active":"2024-04-24T02:12:02.751703+0000","last_became_peered":"2024-04-24T02:12:02.751703+0000","last_unstale":"2024-04-24T02:12:45.803119+0000","last_undegraded":"2024-04-24T02:12:45.803119+0000","last_fullsized":"2024-04-24T02:12:45.803119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:56:56.371880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.808857+0000","last_change":"2024-04-24T02:12:06.756434+0000","last_active":"2024-04-24T02:12:45.808857+0000","last_peered":"2024-04-24T02:12:45.808857+0000","last_clean":"2024-04-24T02:12:45.808857+0000","last_became_active":"2024-04-24T02:12:06.756154+0000","last_became_peered":"2024-04-24T02:12:06.756154+0000","last_unstale":"2024-04-24T02:12:45.808857+0000","last_undegraded":"2024-04-24T02:12:45.808857+0000","last_fullsized":"2024-04-24T02:12:45.808857+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:28:06.445253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'36","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.336595+0000","last_change":"2024-04-24T02:12:08.780969+0000","last_active":"2024-04-24T02:14:11.336595+0000","last_peered":"2024-04-24T02:14:11.336595+0000","last_clean":"2024-04-24T02:14:11.336595+0000","last_became_active":"2024-04-24T02:12:08.780215+0000","last_became_peered":"2024-04-24T02:12:08.780215+0000","last_unstale":"2024-04-24T02:14:11.336595+0000","last_undegraded":"2024-04-24T02:14:11.336595+0000","last_fullsized":"2024-04-24T02:14:11.336595+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:41:43.973694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.806596+0000","last_change":"2024-04-24T02:12:10.786015+0000","last_active":"2024-04-24T02:12:45.806596+0000","last_peered":"2024-04-24T02:12:45.806596+0000","last_clean":"2024-04-24T02:12:45.806596+0000","last_became_active":"2024-04-24T02:12:10.785707+0000","last_became_peered":"2024-04-24T02:12:10.785707+0000","last_unstale":"2024-04-24T02:12:45.806596+0000","last_undegraded":"2024-04-24T02:12:45.806596+0000","last_fullsized":"2024-04-24T02:12:45.806596+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:55:00.963124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.809558+0000","last_change":"2024-04-24T02:12:12.798843+0000","last_active":"2024-04-24T02:12:45.809558+0000","last_peered":"2024-04-24T02:12:45.809558+0000","last_clean":"2024-04-24T02:12:45.809558+0000","last_became_active":"2024-04-24T02:12:12.798498+0000","last_became_peered":"2024-04-24T02:12:12.798498+0000","last_unstale":"2024-04-24T02:12:45.809558+0000","last_undegraded":"2024-04-24T02:12:45.809558+0000","last_fullsized":"2024-04-24T02:12:45.809558+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:03:55.536222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.465088+0000","last_change":"2024-04-24T02:12:04.768687+0000","last_active":"2024-04-24T02:15:13.465088+0000","last_peered":"2024-04-24T02:15:13.465088+0000","last_clean":"2024-04-24T02:15:13.465088+0000","last_became_active":"2024-04-24T02:12:04.768285+0000","last_became_peered":"2024-04-24T02:12:04.768285+0000","last_unstale":"2024-04-24T02:15:13.465088+0000","last_undegraded":"2024-04-24T02:15:13.465088+0000","last_fullsized":"2024-04-24T02:15:13.465088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:38:38.312578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.803505+0000","last_change":"2024-04-24T02:12:02.749703+0000","last_active":"2024-04-24T02:12:45.803505+0000","last_peered":"2024-04-24T02:12:45.803505+0000","last_clean":"2024-04-24T02:12:45.803505+0000","last_became_active":"2024-04-24T02:12:02.749461+0000","last_became_peered":"2024-04-24T02:12:02.749461+0000","last_unstale":"2024-04-24T02:12:45.803505+0000","last_undegraded":"2024-04-24T02:12:45.803505+0000","last_fullsized":"2024-04-24T02:12:45.803505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:39:43.304402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.808573+0000","last_change":"2024-04-24T02:12:06.758054+0000","last_active":"2024-04-24T02:12:45.808573+0000","last_peered":"2024-04-24T02:12:45.808573+0000","last_clean":"2024-04-24T02:12:45.808573+0000","last_became_active":"2024-04-24T02:12:06.757760+0000","last_became_peered":"2024-04-24T02:12:06.757760+0000","last_unstale":"2024-04-24T02:12:45.808573+0000","last_undegraded":"2024-04-24T02:12:45.808573+0000","last_fullsized":"2024-04-24T02:12:45.808573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:03:26.912136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'38","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.354545+0000","last_change":"2024-04-24T02:12:08.779753+0000","last_active":"2024-04-24T02:14:11.354545+0000","last_peered":"2024-04-24T02:14:11.354545+0000","last_clean":"2024-04-24T02:14:11.354545+0000","last_became_active":"2024-04-24T02:12:08.779471+0000","last_became_peered":"2024-04-24T02:12:08.779471+0000","last_unstale":"2024-04-24T02:14:11.354545+0000","last_undegraded":"2024-04-24T02:14:11.354545+0000","last_fullsized":"2024-04-24T02:14:11.354545+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:12:36.613701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.806043+0000","last_change":"2024-04-24T02:12:10.780537+0000","last_active":"2024-04-24T02:12:45.806043+0000","last_peered":"2024-04-24T02:12:45.806043+0000","last_clean":"2024-04-24T02:12:45.806043+0000","last_became_active":"2024-04-24T02:12:10.780272+0000","last_became_peered":"2024-04-24T02:12:10.780272+0000","last_unstale":"2024-04-24T02:12:45.806043+0000","last_undegraded":"2024-04-24T02:12:45.806043+0000","last_fullsized":"2024-04-24T02:12:45.806043+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:13:38.421688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.770870+0000","last_change":"2024-04-24T02:12:12.795264+0000","last_active":"2024-04-24T02:14:12.770870+0000","last_peered":"2024-04-24T02:14:12.770870+0000","last_clean":"2024-04-24T02:14:12.770870+0000","last_became_active":"2024-04-24T02:12:12.794815+0000","last_became_peered":"2024-04-24T02:12:12.794815+0000","last_unstale":"2024-04-24T02:14:12.770870+0000","last_undegraded":"2024-04-24T02:14:12.770870+0000","last_fullsized":"2024-04-24T02:14:12.770870+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:07:13.044978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.464842+0000","last_change":"2024-04-24T02:12:04.750861+0000","last_active":"2024-04-24T02:15:13.464842+0000","last_peered":"2024-04-24T02:15:13.464842+0000","last_clean":"2024-04-24T02:15:13.464842+0000","last_became_active":"2024-04-24T02:12:04.750546+0000","last_became_peered":"2024-04-24T02:12:04.750546+0000","last_unstale":"2024-04-24T02:15:13.464842+0000","last_undegraded":"2024-04-24T02:15:13.464842+0000","last_fullsized":"2024-04-24T02:15:13.464842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:18:49.587013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.810175+0000","last_change":"2024-04-24T02:12:02.758862+0000","last_active":"2024-04-24T02:12:45.810175+0000","last_peered":"2024-04-24T02:12:45.810175+0000","last_clean":"2024-04-24T02:12:45.810175+0000","last_became_active":"2024-04-24T02:12:02.757728+0000","last_became_peered":"2024-04-24T02:12:02.757728+0000","last_unstale":"2024-04-24T02:12:45.810175+0000","last_undegraded":"2024-04-24T02:12:45.810175+0000","last_fullsized":"2024-04-24T02:12:45.810175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:15:42.425053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805610+0000","last_change":"2024-04-24T02:12:06.757498+0000","last_active":"2024-04-24T02:12:45.805610+0000","last_peered":"2024-04-24T02:12:45.805610+0000","last_clean":"2024-04-24T02:12:45.805610+0000","last_became_active":"2024-04-24T02:12:06.757145+0000","last_became_peered":"2024-04-24T02:12:06.757145+0000","last_unstale":"2024-04-24T02:12:45.805610+0000","last_undegraded":"2024-04-24T02:12:45.805610+0000","last_fullsized":"2024-04-24T02:12:45.805610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:48:54.842263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'16","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.812551+0000","last_change":"2024-04-24T02:12:08.782279+0000","last_active":"2024-04-24T02:12:45.812551+0000","last_peered":"2024-04-24T02:12:45.812551+0000","last_clean":"2024-04-24T02:12:45.812551+0000","last_became_active":"2024-04-24T02:12:08.781974+0000","last_became_peered":"2024-04-24T02:12:08.781974+0000","last_unstale":"2024-04-24T02:12:45.812551+0000","last_undegraded":"2024-04-24T02:12:45.812551+0000","last_fullsized":"2024-04-24T02:12:45.812551+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:08:01.406805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'282","reported_seq":370,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.581521+0000","last_change":"2024-04-24T02:12:10.787530+0000","last_active":"2024-04-24T02:15:13.581521+0000","last_peered":"2024-04-24T02:15:13.581521+0000","last_clean":"2024-04-24T02:15:13.581521+0000","last_became_active":"2024-04-24T02:12:10.786972+0000","last_became_peered":"2024-04-24T02:12:10.786972+0000","last_unstale":"2024-04-24T02:15:13.581521+0000","last_undegraded":"2024-04-24T02:15:13.581521+0000","last_fullsized":"2024-04-24T02:15:13.581521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:01:37.766900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'4","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:28.942341+0000","last_change":"2024-04-24T02:12:12.795734+0000","last_active":"2024-04-24T02:13:28.942341+0000","last_peered":"2024-04-24T02:13:28.942341+0000","last_clean":"2024-04-24T02:13:28.942341+0000","last_became_active":"2024-04-24T02:12:12.795013+0000","last_became_peered":"2024-04-24T02:12:12.795013+0000","last_unstale":"2024-04-24T02:13:28.942341+0000","last_undegraded":"2024-04-24T02:13:28.942341+0000","last_fullsized":"2024-04-24T02:13:28.942341+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:00:19.736045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'12","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.265255+0000","last_change":"2024-04-24T02:12:04.752294+0000","last_active":"2024-04-24T02:15:13.265255+0000","last_peered":"2024-04-24T02:15:13.265255+0000","last_clean":"2024-04-24T02:15:13.265255+0000","last_became_active":"2024-04-24T02:12:04.751676+0000","last_became_peered":"2024-04-24T02:12:04.751676+0000","last_unstale":"2024-04-24T02:15:13.265255+0000","last_undegraded":"2024-04-24T02:15:13.265255+0000","last_fullsized":"2024-04-24T02:15:13.265255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:04:16.078887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805289+0000","last_change":"2024-04-24T02:12:02.756088+0000","last_active":"2024-04-24T02:12:45.805289+0000","last_peered":"2024-04-24T02:12:45.805289+0000","last_clean":"2024-04-24T02:12:45.805289+0000","last_became_active":"2024-04-24T02:12:02.755512+0000","last_became_peered":"2024-04-24T02:12:02.755512+0000","last_unstale":"2024-04-24T02:12:45.805289+0000","last_undegraded":"2024-04-24T02:12:45.805289+0000","last_fullsized":"2024-04-24T02:12:45.805289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:35:57.790455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805191+0000","last_change":"2024-04-24T02:12:06.757421+0000","last_active":"2024-04-24T02:12:45.805191+0000","last_peered":"2024-04-24T02:12:45.805191+0000","last_clean":"2024-04-24T02:12:45.805191+0000","last_became_active":"2024-04-24T02:12:06.756909+0000","last_became_peered":"2024-04-24T02:12:06.756909+0000","last_unstale":"2024-04-24T02:12:45.805191+0000","last_undegraded":"2024-04-24T02:12:45.805191+0000","last_fullsized":"2024-04-24T02:12:45.805191+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:21:46.839438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'60","reported_seq":129,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.327447+0000","last_change":"2024-04-24T02:12:08.770654+0000","last_active":"2024-04-24T02:14:11.327447+0000","last_peered":"2024-04-24T02:14:11.327447+0000","last_clean":"2024-04-24T02:14:11.327447+0000","last_became_active":"2024-04-24T02:12:08.770255+0000","last_became_peered":"2024-04-24T02:12:08.770255+0000","last_unstale":"2024-04-24T02:14:11.327447+0000","last_undegraded":"2024-04-24T02:14:11.327447+0000","last_fullsized":"2024-04-24T02:14:11.327447+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:15:23.890733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":74,"num_read_kb":61,"num_write":42,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804341+0000","last_change":"2024-04-24T02:12:10.786024+0000","last_active":"2024-04-24T02:12:45.804341+0000","last_peered":"2024-04-24T02:12:45.804341+0000","last_clean":"2024-04-24T02:12:45.804341+0000","last_became_active":"2024-04-24T02:12:10.785811+0000","last_became_peered":"2024-04-24T02:12:10.785811+0000","last_unstale":"2024-04-24T02:12:45.804341+0000","last_undegraded":"2024-04-24T02:12:45.804341+0000","last_fullsized":"2024-04-24T02:12:45.804341+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:51:01.712254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804594+0000","last_change":"2024-04-24T02:12:12.799813+0000","last_active":"2024-04-24T02:12:45.804594+0000","last_peered":"2024-04-24T02:12:45.804594+0000","last_clean":"2024-04-24T02:12:45.804594+0000","last_became_active":"2024-04-24T02:12:12.799557+0000","last_became_peered":"2024-04-24T02:12:12.799557+0000","last_unstale":"2024-04-24T02:12:45.804594+0000","last_undegraded":"2024-04-24T02:12:45.804594+0000","last_fullsized":"2024-04-24T02:12:45.804594+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:23:38.168759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'18","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.349395+0000","last_change":"2024-04-24T02:12:04.748652+0000","last_active":"2024-04-24T02:15:13.349395+0000","last_peered":"2024-04-24T02:15:13.349395+0000","last_clean":"2024-04-24T02:15:13.349395+0000","last_became_active":"2024-04-24T02:12:04.748399+0000","last_became_peered":"2024-04-24T02:12:04.748399+0000","last_unstale":"2024-04-24T02:15:13.349395+0000","last_undegraded":"2024-04-24T02:15:13.349395+0000","last_fullsized":"2024-04-24T02:15:13.349395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:11:30.157161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":55,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.812037+0000","last_change":"2024-04-24T02:12:02.761810+0000","last_active":"2024-04-24T02:12:45.812037+0000","last_peered":"2024-04-24T02:12:45.812037+0000","last_clean":"2024-04-24T02:12:45.812037+0000","last_became_active":"2024-04-24T02:12:02.760772+0000","last_became_peered":"2024-04-24T02:12:02.760772+0000","last_unstale":"2024-04-24T02:12:45.812037+0000","last_undegraded":"2024-04-24T02:12:45.812037+0000","last_fullsized":"2024-04-24T02:12:45.812037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:20:25.868325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.808789+0000","last_change":"2024-04-24T02:12:06.765015+0000","last_active":"2024-04-24T02:12:45.808789+0000","last_peered":"2024-04-24T02:12:45.808789+0000","last_clean":"2024-04-24T02:12:45.808789+0000","last_became_active":"2024-04-24T02:12:06.764475+0000","last_became_peered":"2024-04-24T02:12:06.764475+0000","last_unstale":"2024-04-24T02:12:45.808789+0000","last_undegraded":"2024-04-24T02:12:45.808789+0000","last_fullsized":"2024-04-24T02:12:45.808789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:34:43.734495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'37","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.328386+0000","last_change":"2024-04-24T02:12:08.779659+0000","last_active":"2024-04-24T02:14:11.328386+0000","last_peered":"2024-04-24T02:14:11.328386+0000","last_clean":"2024-04-24T02:14:11.328386+0000","last_became_active":"2024-04-24T02:12:08.779447+0000","last_became_peered":"2024-04-24T02:12:08.779447+0000","last_unstale":"2024-04-24T02:14:11.328386+0000","last_undegraded":"2024-04-24T02:14:11.328386+0000","last_fullsized":"2024-04-24T02:14:11.328386+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:47:59.126462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.809971+0000","last_change":"2024-04-24T02:12:10.783395+0000","last_active":"2024-04-24T02:12:45.809971+0000","last_peered":"2024-04-24T02:12:45.809971+0000","last_clean":"2024-04-24T02:12:45.809971+0000","last_became_active":"2024-04-24T02:12:10.782019+0000","last_became_peered":"2024-04-24T02:12:10.782019+0000","last_unstale":"2024-04-24T02:12:45.809971+0000","last_undegraded":"2024-04-24T02:12:45.809971+0000","last_fullsized":"2024-04-24T02:12:45.809971+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:36:51.948849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.811428+0000","last_change":"2024-04-24T02:12:12.797073+0000","last_active":"2024-04-24T02:12:45.811428+0000","last_peered":"2024-04-24T02:12:45.811428+0000","last_clean":"2024-04-24T02:12:45.811428+0000","last_became_active":"2024-04-24T02:12:12.796494+0000","last_became_peered":"2024-04-24T02:12:12.796494+0000","last_unstale":"2024-04-24T02:12:45.811428+0000","last_undegraded":"2024-04-24T02:12:45.811428+0000","last_fullsized":"2024-04-24T02:12:45.811428+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:13.390946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'10","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.349088+0000","last_change":"2024-04-24T02:12:04.763788+0000","last_active":"2024-04-24T02:15:13.349088+0000","last_peered":"2024-04-24T02:15:13.349088+0000","last_clean":"2024-04-24T02:15:13.349088+0000","last_became_active":"2024-04-24T02:12:04.763263+0000","last_became_peered":"2024-04-24T02:12:04.763263+0000","last_unstale":"2024-04-24T02:15:13.349088+0000","last_undegraded":"2024-04-24T02:15:13.349088+0000","last_fullsized":"2024-04-24T02:15:13.349088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:22.258912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:46.550151+0000","last_change":"2024-04-24T02:12:02.745999+0000","last_active":"2024-04-24T02:12:46.550151+0000","last_peered":"2024-04-24T02:12:46.550151+0000","last_clean":"2024-04-24T02:12:46.550151+0000","last_became_active":"2024-04-24T02:12:02.745617+0000","last_became_peered":"2024-04-24T02:12:02.745617+0000","last_unstale":"2024-04-24T02:12:46.550151+0000","last_undegraded":"2024-04-24T02:12:46.550151+0000","last_fullsized":"2024-04-24T02:12:46.550151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:45:43.215829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805756+0000","last_change":"2024-04-24T02:12:06.766022+0000","last_active":"2024-04-24T02:12:45.805756+0000","last_peered":"2024-04-24T02:12:45.805756+0000","last_clean":"2024-04-24T02:12:45.805756+0000","last_became_active":"2024-04-24T02:12:06.765644+0000","last_became_peered":"2024-04-24T02:12:06.765644+0000","last_unstale":"2024-04-24T02:12:45.805756+0000","last_undegraded":"2024-04-24T02:12:45.805756+0000","last_fullsized":"2024-04-24T02:12:45.805756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:22:20.414950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'33","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.352320+0000","last_change":"2024-04-24T02:12:08.780672+0000","last_active":"2024-04-24T02:14:11.352320+0000","last_peered":"2024-04-24T02:14:11.352320+0000","last_clean":"2024-04-24T02:14:11.352320+0000","last_became_active":"2024-04-24T02:12:08.780056+0000","last_became_peered":"2024-04-24T02:12:08.780056+0000","last_unstale":"2024-04-24T02:14:11.352320+0000","last_undegraded":"2024-04-24T02:14:11.352320+0000","last_fullsized":"2024-04-24T02:14:11.352320+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:51:21.271286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":27,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.809863+0000","last_change":"2024-04-24T02:12:10.785977+0000","last_active":"2024-04-24T02:12:45.809863+0000","last_peered":"2024-04-24T02:12:45.809863+0000","last_clean":"2024-04-24T02:12:45.809863+0000","last_became_active":"2024-04-24T02:12:10.785396+0000","last_became_peered":"2024-04-24T02:12:10.785396+0000","last_unstale":"2024-04-24T02:12:45.809863+0000","last_undegraded":"2024-04-24T02:12:45.809863+0000","last_fullsized":"2024-04-24T02:12:45.809863+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:28:39.922824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.362615+0000","last_change":"2024-04-24T02:12:12.794051+0000","last_active":"2024-04-24T02:14:11.362615+0000","last_peered":"2024-04-24T02:14:11.362615+0000","last_clean":"2024-04-24T02:14:11.362615+0000","last_became_active":"2024-04-24T02:12:12.793796+0000","last_became_peered":"2024-04-24T02:12:12.793796+0000","last_unstale":"2024-04-24T02:14:11.362615+0000","last_undegraded":"2024-04-24T02:14:11.362615+0000","last_fullsized":"2024-04-24T02:14:11.362615+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:24:07.897162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'18","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.523119+0000","last_change":"2024-04-24T02:12:04.749487+0000","last_active":"2024-04-24T02:15:13.523119+0000","last_peered":"2024-04-24T02:15:13.523119+0000","last_clean":"2024-04-24T02:15:13.523119+0000","last_became_active":"2024-04-24T02:12:04.749055+0000","last_became_peered":"2024-04-24T02:12:04.749055+0000","last_unstale":"2024-04-24T02:15:13.523119+0000","last_undegraded":"2024-04-24T02:15:13.523119+0000","last_fullsized":"2024-04-24T02:15:13.523119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:22:28.196549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805080+0000","last_change":"2024-04-24T02:12:02.747590+0000","last_active":"2024-04-24T02:12:45.805080+0000","last_peered":"2024-04-24T02:12:45.805080+0000","last_clean":"2024-04-24T02:12:45.805080+0000","last_became_active":"2024-04-24T02:12:02.745895+0000","last_became_peered":"2024-04-24T02:12:02.745895+0000","last_unstale":"2024-04-24T02:12:45.805080+0000","last_undegraded":"2024-04-24T02:12:45.805080+0000","last_fullsized":"2024-04-24T02:12:45.805080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:21:06.907535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'6","reported_seq":228,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.403135+0000","last_change":"2024-04-24T02:12:06.765389+0000","last_active":"2024-04-24T02:14:12.403135+0000","last_peered":"2024-04-24T02:14:12.403135+0000","last_clean":"2024-04-24T02:14:12.403135+0000","last_became_active":"2024-04-24T02:12:06.765096+0000","last_became_peered":"2024-04-24T02:12:06.765096+0000","last_unstale":"2024-04-24T02:14:12.403135+0000","last_undegraded":"2024-04-24T02:14:12.403135+0000","last_fullsized":"2024-04-24T02:14:12.403135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:28:12.528823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'44","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:12.798259+0000","last_change":"2024-04-24T02:12:08.780244+0000","last_active":"2024-04-24T02:15:12.798259+0000","last_peered":"2024-04-24T02:15:12.798259+0000","last_clean":"2024-04-24T02:15:12.798259+0000","last_became_active":"2024-04-24T02:12:08.779892+0000","last_became_peered":"2024-04-24T02:12:08.779892+0000","last_unstale":"2024-04-24T02:15:12.798259+0000","last_undegraded":"2024-04-24T02:15:12.798259+0000","last_fullsized":"2024-04-24T02:15:12.798259+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:53:04.772697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":52,"num_read_kb":46,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804982+0000","last_change":"2024-04-24T02:12:10.781966+0000","last_active":"2024-04-24T02:12:45.804982+0000","last_peered":"2024-04-24T02:12:45.804982+0000","last_clean":"2024-04-24T02:12:45.804982+0000","last_became_active":"2024-04-24T02:12:10.781588+0000","last_became_peered":"2024-04-24T02:12:10.781588+0000","last_unstale":"2024-04-24T02:12:45.804982+0000","last_undegraded":"2024-04-24T02:12:45.804982+0000","last_fullsized":"2024-04-24T02:12:45.804982+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:36:23.742641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'6","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.526045+0000","last_change":"2024-04-24T02:12:12.793599+0000","last_active":"2024-04-24T02:15:13.526045+0000","last_peered":"2024-04-24T02:15:13.526045+0000","last_clean":"2024-04-24T02:15:13.526045+0000","last_became_active":"2024-04-24T02:12:12.793310+0000","last_became_peered":"2024-04-24T02:12:12.793310+0000","last_unstale":"2024-04-24T02:15:13.526045+0000","last_undegraded":"2024-04-24T02:15:13.526045+0000","last_fullsized":"2024-04-24T02:15:13.526045+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:31:25.149659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'4","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.464843+0000","last_change":"2024-04-24T02:12:04.767702+0000","last_active":"2024-04-24T02:15:13.464843+0000","last_peered":"2024-04-24T02:15:13.464843+0000","last_clean":"2024-04-24T02:15:13.464843+0000","last_became_active":"2024-04-24T02:12:04.766869+0000","last_became_peered":"2024-04-24T02:12:04.766869+0000","last_unstale":"2024-04-24T02:15:13.464843+0000","last_undegraded":"2024-04-24T02:15:13.464843+0000","last_fullsized":"2024-04-24T02:15:13.464843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:11:48.404916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805389+0000","last_change":"2024-04-24T02:12:02.750537+0000","last_active":"2024-04-24T02:12:45.805389+0000","last_peered":"2024-04-24T02:12:45.805389+0000","last_clean":"2024-04-24T02:12:45.805389+0000","last_became_active":"2024-04-24T02:12:02.746992+0000","last_became_peered":"2024-04-24T02:12:02.746992+0000","last_unstale":"2024-04-24T02:12:45.805389+0000","last_undegraded":"2024-04-24T02:12:45.805389+0000","last_fullsized":"2024-04-24T02:12:45.805389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:20:45.842023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.774843+0000","last_change":"2024-04-24T02:12:04.749519+0000","last_active":"2024-04-24T02:14:12.774843+0000","last_peered":"2024-04-24T02:14:12.774843+0000","last_clean":"2024-04-24T02:14:12.774843+0000","last_became_active":"2024-04-24T02:12:04.749165+0000","last_became_peered":"2024-04-24T02:12:04.749165+0000","last_unstale":"2024-04-24T02:14:12.774843+0000","last_undegraded":"2024-04-24T02:14:12.774843+0000","last_fullsized":"2024-04-24T02:14:12.774843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:46:52.766018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'6","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.344845+0000","last_change":"2024-04-24T02:12:02.751924+0000","last_active":"2024-04-24T02:15:13.344845+0000","last_peered":"2024-04-24T02:15:13.344845+0000","last_clean":"2024-04-24T02:15:13.344845+0000","last_became_active":"2024-04-24T02:12:02.751613+0000","last_became_peered":"2024-04-24T02:12:02.751613+0000","last_unstale":"2024-04-24T02:15:13.344845+0000","last_undegraded":"2024-04-24T02:15:13.344845+0000","last_fullsized":"2024-04-24T02:15:13.344845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:18:31.392785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.464756+0000","last_change":"2024-04-24T02:12:04.764660+0000","last_active":"2024-04-24T02:15:13.464756+0000","last_peered":"2024-04-24T02:15:13.464756+0000","last_clean":"2024-04-24T02:15:13.464756+0000","last_became_active":"2024-04-24T02:12:04.763819+0000","last_became_peered":"2024-04-24T02:12:04.763819+0000","last_unstale":"2024-04-24T02:15:13.464756+0000","last_undegraded":"2024-04-24T02:15:13.464756+0000","last_fullsized":"2024-04-24T02:15:13.464756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:23:58.698687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.810651+0000","last_change":"2024-04-24T02:12:02.758745+0000","last_active":"2024-04-24T02:12:45.810651+0000","last_peered":"2024-04-24T02:12:45.810651+0000","last_clean":"2024-04-24T02:12:45.810651+0000","last_became_active":"2024-04-24T02:12:02.757017+0000","last_became_peered":"2024-04-24T02:12:02.757017+0000","last_unstale":"2024-04-24T02:12:45.810651+0000","last_undegraded":"2024-04-24T02:12:45.810651+0000","last_fullsized":"2024-04-24T02:12:45.810651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:47:33.899846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'4","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.389055+0000","last_change":"2024-04-24T02:12:04.749624+0000","last_active":"2024-04-24T02:15:13.389055+0000","last_peered":"2024-04-24T02:15:13.389055+0000","last_clean":"2024-04-24T02:15:13.389055+0000","last_became_active":"2024-04-24T02:12:04.749305+0000","last_became_peered":"2024-04-24T02:12:04.749305+0000","last_unstale":"2024-04-24T02:15:13.389055+0000","last_undegraded":"2024-04-24T02:15:13.389055+0000","last_fullsized":"2024-04-24T02:15:13.389055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:12:19.920273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"30'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.806026+0000","last_change":"2024-04-24T02:12:02.741858+0000","last_active":"2024-04-24T02:12:45.806026+0000","last_peered":"2024-04-24T02:12:45.806026+0000","last_clean":"2024-04-24T02:12:45.806026+0000","last_became_active":"2024-04-24T02:12:02.741503+0000","last_became_peered":"2024-04-24T02:12:02.741503+0000","last_unstale":"2024-04-24T02:12:45.806026+0000","last_undegraded":"2024-04-24T02:12:45.806026+0000","last_fullsized":"2024-04-24T02:12:45.806026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:07:39.016614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'6","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.258691+0000","last_change":"2024-04-24T02:12:45.818489+0000","last_active":"2024-04-24T02:15:13.258691+0000","last_peered":"2024-04-24T02:15:13.258691+0000","last_clean":"2024-04-24T02:15:13.258691+0000","last_became_active":"2024-04-24T02:12:45.814356+0000","last_became_peered":"2024-04-24T02:12:45.814356+0000","last_unstale":"2024-04-24T02:15:13.258691+0000","last_undegraded":"2024-04-24T02:15:13.258691+0000","last_fullsized":"2024-04-24T02:15:13.258691+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:04:14.737856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.129792+0000","last_change":"2024-04-24T02:12:02.751995+0000","last_active":"2024-04-24T02:15:13.129792+0000","last_peered":"2024-04-24T02:15:13.129792+0000","last_clean":"2024-04-24T02:15:13.129792+0000","last_became_active":"2024-04-24T02:12:02.751680+0000","last_became_peered":"2024-04-24T02:12:02.751680+0000","last_unstale":"2024-04-24T02:15:13.129792+0000","last_undegraded":"2024-04-24T02:15:13.129792+0000","last_fullsized":"2024-04-24T02:15:13.129792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:31:45.410385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'8","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.391123+0000","last_change":"2024-04-24T02:12:45.817674+0000","last_active":"2024-04-24T02:15:13.391123+0000","last_peered":"2024-04-24T02:15:13.391123+0000","last_clean":"2024-04-24T02:15:13.391123+0000","last_became_active":"2024-04-24T02:12:45.813097+0000","last_became_peered":"2024-04-24T02:12:45.813097+0000","last_unstale":"2024-04-24T02:15:13.391123+0000","last_undegraded":"2024-04-24T02:15:13.391123+0000","last_fullsized":"2024-04-24T02:15:13.391123+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:03:21.634592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"32'1","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:15.038523+0000","last_change":"2024-04-24T02:12:02.754946+0000","last_active":"2024-04-24T02:14:15.038523+0000","last_peered":"2024-04-24T02:14:15.038523+0000","last_clean":"2024-04-24T02:14:15.038523+0000","last_became_active":"2024-04-24T02:12:02.754356+0000","last_became_peered":"2024-04-24T02:12:02.754356+0000","last_unstale":"2024-04-24T02:14:15.038523+0000","last_undegraded":"2024-04-24T02:14:15.038523+0000","last_fullsized":"2024-04-24T02:14:15.038523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:57:48.477966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'5","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.176709+0000","last_change":"2024-04-24T02:12:04.756117+0000","last_active":"2024-04-24T02:15:13.176709+0000","last_peered":"2024-04-24T02:15:13.176709+0000","last_clean":"2024-04-24T02:15:13.176709+0000","last_became_active":"2024-04-24T02:12:04.755738+0000","last_became_peered":"2024-04-24T02:12:04.755738+0000","last_unstale":"2024-04-24T02:15:13.176709+0000","last_undegraded":"2024-04-24T02:15:13.176709+0000","last_fullsized":"2024-04-24T02:15:13.176709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:34:53.394367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"30'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.813069+0000","last_change":"2024-04-24T02:12:02.756723+0000","last_active":"2024-04-24T02:12:45.813069+0000","last_peered":"2024-04-24T02:12:45.813069+0000","last_clean":"2024-04-24T02:12:45.813069+0000","last_became_active":"2024-04-24T02:12:02.755202+0000","last_became_peered":"2024-04-24T02:12:02.755202+0000","last_unstale":"2024-04-24T02:12:45.813069+0000","last_undegraded":"2024-04-24T02:12:45.813069+0000","last_fullsized":"2024-04-24T02:12:45.813069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:35:57.790455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"30'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.803548+0000","last_change":"2024-04-24T02:12:04.756072+0000","last_active":"2024-04-24T02:12:45.803548+0000","last_peered":"2024-04-24T02:12:45.803548+0000","last_clean":"2024-04-24T02:12:45.803548+0000","last_became_active":"2024-04-24T02:12:04.755194+0000","last_became_peered":"2024-04-24T02:12:04.755194+0000","last_unstale":"2024-04-24T02:12:45.803548+0000","last_undegraded":"2024-04-24T02:12:45.803548+0000","last_fullsized":"2024-04-24T02:12:45.803548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:48:16.917007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.459938+0000","last_change":"2024-04-24T02:12:02.752025+0000","last_active":"2024-04-24T02:15:13.459938+0000","last_peered":"2024-04-24T02:15:13.459938+0000","last_clean":"2024-04-24T02:15:13.459938+0000","last_became_active":"2024-04-24T02:12:02.751726+0000","last_became_peered":"2024-04-24T02:12:02.751726+0000","last_unstale":"2024-04-24T02:15:13.459938+0000","last_undegraded":"2024-04-24T02:15:13.459938+0000","last_fullsized":"2024-04-24T02:15:13.459938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:17:15.106316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'6","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.940195+0000","last_change":"2024-04-24T02:12:04.753374+0000","last_active":"2024-04-24T02:12:45.940195+0000","last_peered":"2024-04-24T02:12:45.940195+0000","last_clean":"2024-04-24T02:12:45.940195+0000","last_became_active":"2024-04-24T02:12:04.753074+0000","last_became_peered":"2024-04-24T02:12:04.753074+0000","last_unstale":"2024-04-24T02:12:45.940195+0000","last_undegraded":"2024-04-24T02:12:45.940195+0000","last_fullsized":"2024-04-24T02:12:45.940195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:54:39.701699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:15.038929+0000","last_change":"2024-04-24T02:12:02.755029+0000","last_active":"2024-04-24T02:14:15.038929+0000","last_peered":"2024-04-24T02:14:15.038929+0000","last_clean":"2024-04-24T02:14:15.038929+0000","last_became_active":"2024-04-24T02:12:02.754158+0000","last_became_peered":"2024-04-24T02:12:02.754158+0000","last_unstale":"2024-04-24T02:14:15.038929+0000","last_undegraded":"2024-04-24T02:14:15.038929+0000","last_fullsized":"2024-04-24T02:14:15.038929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:10:56.620635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:29.126199+0000","last_change":"2024-04-24T02:12:04.764100+0000","last_active":"2024-04-24T02:13:29.126199+0000","last_peered":"2024-04-24T02:13:29.126199+0000","last_clean":"2024-04-24T02:13:29.126199+0000","last_became_active":"2024-04-24T02:12:04.763136+0000","last_became_peered":"2024-04-24T02:12:04.763136+0000","last_unstale":"2024-04-24T02:13:29.126199+0000","last_undegraded":"2024-04-24T02:13:29.126199+0000","last_fullsized":"2024-04-24T02:13:29.126199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:52:02.789245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804576+0000","last_change":"2024-04-24T02:12:02.741912+0000","last_active":"2024-04-24T02:12:45.804576+0000","last_peered":"2024-04-24T02:12:45.804576+0000","last_clean":"2024-04-24T02:12:45.804576+0000","last_became_active":"2024-04-24T02:12:02.741543+0000","last_became_peered":"2024-04-24T02:12:02.741543+0000","last_unstale":"2024-04-24T02:12:45.804576+0000","last_undegraded":"2024-04-24T02:12:45.804576+0000","last_fullsized":"2024-04-24T02:12:45.804576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:23:18.903991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:46.564925+0000","last_change":"2024-04-24T02:12:04.760381+0000","last_active":"2024-04-24T02:12:46.564925+0000","last_peered":"2024-04-24T02:12:46.564925+0000","last_clean":"2024-04-24T02:12:46.564925+0000","last_became_active":"2024-04-24T02:12:04.760028+0000","last_became_peered":"2024-04-24T02:12:04.760028+0000","last_unstale":"2024-04-24T02:12:46.564925+0000","last_undegraded":"2024-04-24T02:12:46.564925+0000","last_fullsized":"2024-04-24T02:12:46.564925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:20:21.566094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.336619+0000","last_change":"2024-04-24T02:12:02.750391+0000","last_active":"2024-04-24T02:15:13.336619+0000","last_peered":"2024-04-24T02:15:13.336619+0000","last_clean":"2024-04-24T02:15:13.336619+0000","last_became_active":"2024-04-24T02:12:02.750143+0000","last_became_peered":"2024-04-24T02:12:02.750143+0000","last_unstale":"2024-04-24T02:15:13.336619+0000","last_undegraded":"2024-04-24T02:15:13.336619+0000","last_fullsized":"2024-04-24T02:15:13.336619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:30:58.417438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'8","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.465106+0000","last_change":"2024-04-24T02:12:04.754976+0000","last_active":"2024-04-24T02:15:13.465106+0000","last_peered":"2024-04-24T02:15:13.465106+0000","last_clean":"2024-04-24T02:15:13.465106+0000","last_became_active":"2024-04-24T02:12:04.754738+0000","last_became_peered":"2024-04-24T02:12:04.754738+0000","last_unstale":"2024-04-24T02:15:13.465106+0000","last_undegraded":"2024-04-24T02:15:13.465106+0000","last_fullsized":"2024-04-24T02:15:13.465106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:34:41.727071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804338+0000","last_change":"2024-04-24T02:12:02.746027+0000","last_active":"2024-04-24T02:12:45.804338+0000","last_peered":"2024-04-24T02:12:45.804338+0000","last_clean":"2024-04-24T02:12:45.804338+0000","last_became_active":"2024-04-24T02:12:02.744352+0000","last_became_peered":"2024-04-24T02:12:02.744352+0000","last_unstale":"2024-04-24T02:12:45.804338+0000","last_undegraded":"2024-04-24T02:12:45.804338+0000","last_fullsized":"2024-04-24T02:12:45.804338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:42.734407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'12","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.179236+0000","last_change":"2024-04-24T02:12:45.815138+0000","last_active":"2024-04-24T02:15:13.179236+0000","last_peered":"2024-04-24T02:15:13.179236+0000","last_clean":"2024-04-24T02:15:13.179236+0000","last_became_active":"2024-04-24T02:12:45.808774+0000","last_became_peered":"2024-04-24T02:12:45.808774+0000","last_unstale":"2024-04-24T02:15:13.179236+0000","last_undegraded":"2024-04-24T02:15:13.179236+0000","last_fullsized":"2024-04-24T02:15:13.179236+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:34:31.491770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.811686+0000","last_change":"2024-04-24T02:12:02.758624+0000","last_active":"2024-04-24T02:12:45.811686+0000","last_peered":"2024-04-24T02:12:45.811686+0000","last_clean":"2024-04-24T02:12:45.811686+0000","last_became_active":"2024-04-24T02:12:02.757458+0000","last_became_peered":"2024-04-24T02:12:02.757458+0000","last_unstale":"2024-04-24T02:12:45.811686+0000","last_undegraded":"2024-04-24T02:12:45.811686+0000","last_fullsized":"2024-04-24T02:12:45.811686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:40:47.142152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'14","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.391096+0000","last_change":"2024-04-24T02:12:04.751238+0000","last_active":"2024-04-24T02:15:13.391096+0000","last_peered":"2024-04-24T02:15:13.391096+0000","last_clean":"2024-04-24T02:15:13.391096+0000","last_became_active":"2024-04-24T02:12:04.750973+0000","last_became_peered":"2024-04-24T02:12:04.750973+0000","last_unstale":"2024-04-24T02:15:13.391096+0000","last_undegraded":"2024-04-24T02:15:13.391096+0000","last_fullsized":"2024-04-24T02:15:13.391096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:39:11.735517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.812141+0000","last_change":"2024-04-24T02:12:02.761835+0000","last_active":"2024-04-24T02:12:45.812141+0000","last_peered":"2024-04-24T02:12:45.812141+0000","last_clean":"2024-04-24T02:12:45.812141+0000","last_became_active":"2024-04-24T02:12:02.761235+0000","last_became_peered":"2024-04-24T02:12:02.761235+0000","last_unstale":"2024-04-24T02:12:45.812141+0000","last_undegraded":"2024-04-24T02:12:45.812141+0000","last_fullsized":"2024-04-24T02:12:45.812141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:25:04.505767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.389012+0000","last_change":"2024-04-24T02:12:04.764009+0000","last_active":"2024-04-24T02:15:13.389012+0000","last_peered":"2024-04-24T02:15:13.389012+0000","last_clean":"2024-04-24T02:15:13.389012+0000","last_became_active":"2024-04-24T02:12:04.763517+0000","last_became_peered":"2024-04-24T02:12:04.763517+0000","last_unstale":"2024-04-24T02:15:13.389012+0000","last_undegraded":"2024-04-24T02:15:13.389012+0000","last_fullsized":"2024-04-24T02:15:13.389012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:00:42.696926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.339848+0000","last_change":"2024-04-24T02:12:02.754501+0000","last_active":"2024-04-24T02:15:13.339848+0000","last_peered":"2024-04-24T02:15:13.339848+0000","last_clean":"2024-04-24T02:15:13.339848+0000","last_became_active":"2024-04-24T02:12:02.754227+0000","last_became_peered":"2024-04-24T02:12:02.754227+0000","last_unstale":"2024-04-24T02:15:13.339848+0000","last_undegraded":"2024-04-24T02:15:13.339848+0000","last_fullsized":"2024-04-24T02:15:13.339848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:21:06.907535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.349589+0000","last_change":"2024-04-24T02:12:04.755937+0000","last_active":"2024-04-24T02:15:13.349589+0000","last_peered":"2024-04-24T02:15:13.349589+0000","last_clean":"2024-04-24T02:15:13.349589+0000","last_became_active":"2024-04-24T02:12:04.755661+0000","last_became_peered":"2024-04-24T02:12:04.755661+0000","last_unstale":"2024-04-24T02:15:13.349589+0000","last_undegraded":"2024-04-24T02:15:13.349589+0000","last_fullsized":"2024-04-24T02:15:13.349589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:11:30.157161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.813752+0000","last_change":"2024-04-24T02:12:02.761162+0000","last_active":"2024-04-24T02:12:45.813752+0000","last_peered":"2024-04-24T02:12:45.813752+0000","last_clean":"2024-04-24T02:12:45.813752+0000","last_became_active":"2024-04-24T02:12:02.758855+0000","last_became_peered":"2024-04-24T02:12:02.758855+0000","last_unstale":"2024-04-24T02:12:45.813752+0000","last_undegraded":"2024-04-24T02:12:45.813752+0000","last_fullsized":"2024-04-24T02:12:45.813752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:48:14.910380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.809520+0000","last_change":"2024-04-24T02:12:02.757416+0000","last_active":"2024-04-24T02:12:45.809520+0000","last_peered":"2024-04-24T02:12:45.809520+0000","last_clean":"2024-04-24T02:12:45.809520+0000","last_became_active":"2024-04-24T02:12:02.753545+0000","last_became_peered":"2024-04-24T02:12:02.753545+0000","last_unstale":"2024-04-24T02:12:45.809520+0000","last_undegraded":"2024-04-24T02:12:45.809520+0000","last_fullsized":"2024-04-24T02:12:45.809520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:09.115795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'10","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.171289+0000","last_change":"2024-04-24T02:12:04.758909+0000","last_active":"2024-04-24T02:15:13.171289+0000","last_peered":"2024-04-24T02:15:13.171289+0000","last_clean":"2024-04-24T02:15:13.171289+0000","last_became_active":"2024-04-24T02:12:04.758661+0000","last_became_peered":"2024-04-24T02:12:04.758661+0000","last_unstale":"2024-04-24T02:15:13.171289+0000","last_undegraded":"2024-04-24T02:15:13.171289+0000","last_fullsized":"2024-04-24T02:15:13.171289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:14:26.877561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804307+0000","last_change":"2024-04-24T02:12:02.745737+0000","last_active":"2024-04-24T02:12:45.804307+0000","last_peered":"2024-04-24T02:12:45.804307+0000","last_clean":"2024-04-24T02:12:45.804307+0000","last_became_active":"2024-04-24T02:12:02.745396+0000","last_became_peered":"2024-04-24T02:12:02.745396+0000","last_unstale":"2024-04-24T02:12:45.804307+0000","last_undegraded":"2024-04-24T02:12:45.804307+0000","last_fullsized":"2024-04-24T02:12:45.804307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:11:19.180288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:09.640725+0000","last_change":"2024-04-24T02:12:04.766645+0000","last_active":"2024-04-24T02:14:09.640725+0000","last_peered":"2024-04-24T02:14:09.640725+0000","last_clean":"2024-04-24T02:14:09.640725+0000","last_became_active":"2024-04-24T02:12:04.766344+0000","last_became_peered":"2024-04-24T02:12:04.766344+0000","last_unstale":"2024-04-24T02:14:09.640725+0000","last_undegraded":"2024-04-24T02:14:09.640725+0000","last_fullsized":"2024-04-24T02:14:09.640725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:28:04.437829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1690,"num_read_kb":1444,"num_write":723,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1471,"ondisk_log_size":1471,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1617,"num_read_kb":1507,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":130,"num_read_kb":83,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51617792,"data_stored":51611392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640302,"num_pgs":152,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52796,"kb_used_data":17460,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94319044,"statfs":{"total":96636764160,"available":96582701056,"internally_reserved":0,"allocated":17879040,"data_stored":17552672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640300,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49212,"kb_used_data":13876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94322628,"statfs":{"total":96636764160,"available":96586371072,"internally_reserved":0,"allocated":14209024,"data_stored":13945472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640302,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48616,"kb_used_data":13280,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323224,"statfs":{"total":96636764160,"available":96586981376,"internally_reserved":0,"allocated":13598720,"data_stored":13308671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705710,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48104,"kb_used_data":8608,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323736,"statfs":{"total":96636764160,"available":96587505664,"internally_reserved":0,"allocated":8814592,"data_stored":8523929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13225984,"data_stored":13222784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":17420288,"data_stored":17417088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T02:15:20.506 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T02:15:20.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.625+0000 7fafbba5c640 1 Processor -- start 2024-04-24T02:15:20.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.625+0000 7fafbba5c640 1 -- start start 2024-04-24T02:15:20.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.626+0000 7fafbba5c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fafb406d7d0 0x7fafb406dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:20.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.626+0000 7fafbba5c640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafb40a08a0 con 0x7fafb406e0f0 2024-04-24T02:15:20.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.626+0000 7fafbba5c640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fafb406e560 con 0x7fafb406d7d0 2024-04-24T02:15:20.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.626+0000 7fafb97f8640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fafb406d7d0 0x7fafb406dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:20.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.626+0000 7fafb8ff7640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fafb406e0f0 0x7fafb412e320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:46566/0 (socket says 172.21.15.104:46566) 2024-04-24T02:15:20.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.626+0000 7fafb8ff7640 1 -- 172.21.15.104:0/3153112644 learned_addr learned my addr 172.21.15.104:0/3153112644 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-04-24T02:15:20.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.626+0000 7fafb97f8640 1 -- 172.21.15.104:0/3153112644 >> v1:172.21.15.104:6789/0 conn(0x7fafb406e0f0 legacy=0x7fafb412e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:20.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.626+0000 7fafb97f8640 1 -- 172.21.15.104:0/3153112644 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb406f6d0 con 0x7fafb406d7d0 2024-04-24T02:15:20.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.627+0000 7fafb97f8640 1 --2- 172.21.15.104:0/3153112644 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fafb406d7d0 0x7fafb406dbb0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fafb0009750 tx=0x7fafb002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25fcfb8f6fdbd03f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:20.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.627+0000 7fafabfff640 1 -- 172.21.15.104:0/3153112644 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafb0035020 con 0x7fafb406d7d0 2024-04-24T02:15:20.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.627+0000 7fafabfff640 1 -- 172.21.15.104:0/3153112644 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafb0031760 con 0x7fafb406d7d0 2024-04-24T02:15:20.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.627+0000 7fafabfff640 1 -- 172.21.15.104:0/3153112644 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafb0031a60 con 0x7fafb406d7d0 2024-04-24T02:15:20.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.628+0000 7fafbba5c640 1 -- 172.21.15.104:0/3153112644 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fafb406d7d0 msgr2=0x7fafb406dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:20.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.628+0000 7fafbba5c640 1 --2- 172.21.15.104:0/3153112644 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fafb406d7d0 0x7fafb406dbb0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fafb0009750 tx=0x7fafb002b8d0 comp rx=0 tx=0).stop 2024-04-24T02:15:20.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.628+0000 7fafbba5c640 1 -- 172.21.15.104:0/3153112644 shutdown_connections 2024-04-24T02:15:20.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.628+0000 7fafbba5c640 1 --2- 172.21.15.104:0/3153112644 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fafb406d7d0 0x7fafb406dbb0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:20.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.628+0000 7fafbba5c640 1 -- 172.21.15.104:0/3153112644 >> 172.21.15.104:0/3153112644 conn(0x7fafb409ea70 msgr2=0x7fafb409ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:15:20.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.628+0000 7fafbba5c640 1 -- 172.21.15.104:0/3153112644 shutdown_connections 2024-04-24T02:15:20.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.628+0000 7fafbba5c640 1 -- 172.21.15.104:0/3153112644 wait complete. 2024-04-24T02:15:20.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.628+0000 7fafbba5c640 1 Processor -- start 2024-04-24T02:15:20.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.628+0000 7fafbba5c640 1 -- start start 2024-04-24T02:15:20.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.629+0000 7fafbba5c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fafb406d7d0 0x7fafb41c3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:20.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.629+0000 7fafbba5c640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fafb412ebb0 con 0x7fafb406d7d0 2024-04-24T02:15:20.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.629+0000 7fafb97f8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fafb406d7d0 0x7fafb41c3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:20.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.629+0000 7fafb97f8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fafb406d7d0 0x7fafb41c3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54284/0 (socket says 172.21.15.104:54284) 2024-04-24T02:15:20.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.629+0000 7fafb97f8640 1 -- 172.21.15.104:0/851814824 learned_addr learned my addr 172.21.15.104:0/851814824 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:15:20.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.629+0000 7fafb97f8640 1 -- 172.21.15.104:0/851814824 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb4090c90 con 0x7fafb406d7d0 2024-04-24T02:15:20.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.629+0000 7fafb97f8640 1 --2- 172.21.15.104:0/851814824 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fafb406d7d0 0x7fafb41c3310 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fafb0009750 tx=0x7fafb00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:20.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.629+0000 7fafa9ffb640 1 -- 172.21.15.104:0/851814824 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafb003b980 con 0x7fafb406d7d0 2024-04-24T02:15:20.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.629+0000 7fafa9ffb640 1 -- 172.21.15.104:0/851814824 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafb003bb40 con 0x7fafb406d7d0 2024-04-24T02:15:20.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.629+0000 7fafbba5c640 1 -- 172.21.15.104:0/851814824 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafb4091460 con 0x7fafb406d7d0 2024-04-24T02:15:20.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.629+0000 7fafa9ffb640 1 -- 172.21.15.104:0/851814824 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafb003be60 con 0x7fafb406d7d0 2024-04-24T02:15:20.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.630+0000 7fafbba5c640 1 -- 172.21.15.104:0/851814824 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafb41c3850 con 0x7fafb406d7d0 2024-04-24T02:15:20.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.631+0000 7fafa9ffb640 1 -- 172.21.15.104:0/851814824 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fafb004c060 con 0x7fafb406d7d0 2024-04-24T02:15:20.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.631+0000 7fafbba5c640 1 -- 172.21.15.104:0/851814824 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafb40923e0 con 0x7fafb406d7d0 2024-04-24T02:15:20.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.631+0000 7fafa9ffb640 1 --2- 172.21.15.104:0/851814824 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7faf98038060 0x7faf9803a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:20.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.631+0000 7fafa9ffb640 1 -- 172.21.15.104:0/851814824 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fafb006d620 con 0x7fafb406d7d0 2024-04-24T02:15:20.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.631+0000 7fafb8ff7640 1 --2- 172.21.15.104:0/851814824 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7faf98038060 0x7faf9803a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:20.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.631+0000 7fafb8ff7640 1 --2- 172.21.15.104:0/851814824 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7faf98038060 0x7faf9803a520 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fafa4005880 tx=0x7fafa4007a80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:20.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.635+0000 7fafa9ffb640 1 -- 172.21.15.104:0/851814824 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7fafb0040070 con 0x7fafb406d7d0 2024-04-24T02:15:20.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.804+0000 7fafbba5c640 1 -- 172.21.15.104:0/851814824 --> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fafb4062da0 con 0x7faf98038060 2024-04-24T02:15:20.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.819+0000 7fafa9ffb640 1 -- 172.21.15.104:0/851814824 <== mgr.4101 v2:172.21.15.134:6824/3655027977 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665463 (secure 0 0 0) 0x7fafb4062da0 con 0x7faf98038060 2024-04-24T02:15:20.828 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:15:20.836 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-04-24T02:15:20.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.824+0000 7fafbba5c640 1 -- 172.21.15.104:0/851814824 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7faf98038060 msgr2=0x7faf9803a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:20.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.824+0000 7fafbba5c640 1 --2- 172.21.15.104:0/851814824 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7faf98038060 0x7faf9803a520 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fafa4005880 tx=0x7fafa4007a80 comp rx=0 tx=0).stop 2024-04-24T02:15:20.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.824+0000 7fafbba5c640 1 -- 172.21.15.104:0/851814824 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fafb406d7d0 msgr2=0x7fafb41c3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:20.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.824+0000 7fafbba5c640 1 --2- 172.21.15.104:0/851814824 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fafb406d7d0 0x7fafb41c3310 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fafb0009750 tx=0x7fafb00046c0 comp rx=0 tx=0).stop 2024-04-24T02:15:20.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.824+0000 7fafbba5c640 1 -- 172.21.15.104:0/851814824 shutdown_connections 2024-04-24T02:15:20.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.824+0000 7fafbba5c640 1 --2- 172.21.15.104:0/851814824 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7faf98038060 0x7faf9803a520 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:20.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.824+0000 7fafbba5c640 1 --2- 172.21.15.104:0/851814824 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fafb406d7d0 0x7fafb41c3310 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:20.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.824+0000 7fafbba5c640 1 -- 172.21.15.104:0/851814824 >> 172.21.15.104:0/851814824 conn(0x7fafb409ea70 msgr2=0x7fafb4125c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:15:20.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.824+0000 7fafbba5c640 1 -- 172.21.15.104:0/851814824 shutdown_connections 2024-04-24T02:15:20.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.824+0000 7fafbba5c640 1 -- 172.21.15.104:0/851814824 wait complete. 2024-04-24T02:15:20.840 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":135,"stamp":"2024-04-24T02:15:20.022016+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412790,"num_objects":259,"num_object_clones":0,"num_object_copies":518,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":259,"num_whiteouts":0,"num_read":5169,"num_read_kb":4718,"num_write":2296,"num_write_kb":61372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4672,"ondisk_log_size":4672,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":198728,"kb_used_data":53224,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377288632,"statfs":{"total":386547056640,"available":386343559168,"internally_reserved":0,"allocated":54501376,"data_stored":53330744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25811688,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":452,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004182"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.810958+0000","last_change":"2024-04-24T02:12:02.755215+0000","last_active":"2024-04-24T02:12:45.810958+0000","last_peered":"2024-04-24T02:12:45.810958+0000","last_clean":"2024-04-24T02:12:45.810958+0000","last_became_active":"2024-04-24T02:12:02.754954+0000","last_became_peered":"2024-04-24T02:12:02.754954+0000","last_unstale":"2024-04-24T02:12:45.810958+0000","last_undegraded":"2024-04-24T02:12:45.810958+0000","last_fullsized":"2024-04-24T02:12:45.810958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:57:48.477966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'8","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.464744+0000","last_change":"2024-04-24T02:12:04.754671+0000","last_active":"2024-04-24T02:15:13.464744+0000","last_peered":"2024-04-24T02:15:13.464744+0000","last_clean":"2024-04-24T02:15:13.464744+0000","last_became_active":"2024-04-24T02:12:04.754049+0000","last_became_peered":"2024-04-24T02:12:04.754049+0000","last_unstale":"2024-04-24T02:15:13.464744+0000","last_undegraded":"2024-04-24T02:15:13.464744+0000","last_fullsized":"2024-04-24T02:15:13.464744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:01:31.183580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.806164+0000","last_change":"2024-04-24T02:12:02.746058+0000","last_active":"2024-04-24T02:12:45.806164+0000","last_peered":"2024-04-24T02:12:45.806164+0000","last_clean":"2024-04-24T02:12:45.806164+0000","last_became_active":"2024-04-24T02:12:02.745526+0000","last_became_peered":"2024-04-24T02:12:02.745526+0000","last_unstale":"2024-04-24T02:12:45.806164+0000","last_undegraded":"2024-04-24T02:12:45.806164+0000","last_fullsized":"2024-04-24T02:12:45.806164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:29:06.156277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'12","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.465045+0000","last_change":"2024-04-24T02:12:04.763554+0000","last_active":"2024-04-24T02:15:13.465045+0000","last_peered":"2024-04-24T02:15:13.465045+0000","last_clean":"2024-04-24T02:15:13.465045+0000","last_became_active":"2024-04-24T02:12:04.762967+0000","last_became_peered":"2024-04-24T02:12:04.762967+0000","last_unstale":"2024-04-24T02:15:13.465045+0000","last_undegraded":"2024-04-24T02:15:13.465045+0000","last_fullsized":"2024-04-24T02:15:13.465045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:22:18.407526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":62,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.812393+0000","last_change":"2024-04-24T02:12:02.761596+0000","last_active":"2024-04-24T02:12:45.812393+0000","last_peered":"2024-04-24T02:12:45.812393+0000","last_clean":"2024-04-24T02:12:45.812393+0000","last_became_active":"2024-04-24T02:12:02.758985+0000","last_became_peered":"2024-04-24T02:12:02.758985+0000","last_unstale":"2024-04-24T02:12:45.812393+0000","last_undegraded":"2024-04-24T02:12:45.812393+0000","last_fullsized":"2024-04-24T02:12:45.812393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:31:31.121870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'6","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:29.125840+0000","last_change":"2024-04-24T02:12:04.765577+0000","last_active":"2024-04-24T02:13:29.125840+0000","last_peered":"2024-04-24T02:13:29.125840+0000","last_clean":"2024-04-24T02:13:29.125840+0000","last_became_active":"2024-04-24T02:12:04.765327+0000","last_became_peered":"2024-04-24T02:12:04.765327+0000","last_unstale":"2024-04-24T02:13:29.125840+0000","last_undegraded":"2024-04-24T02:13:29.125840+0000","last_fullsized":"2024-04-24T02:13:29.125840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:25:46.401212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.806962+0000","last_change":"2024-04-24T02:12:02.745643+0000","last_active":"2024-04-24T02:12:45.806962+0000","last_peered":"2024-04-24T02:12:45.806962+0000","last_clean":"2024-04-24T02:12:45.806962+0000","last_became_active":"2024-04-24T02:12:02.744804+0000","last_became_peered":"2024-04-24T02:12:02.744804+0000","last_unstale":"2024-04-24T02:12:45.806962+0000","last_undegraded":"2024-04-24T02:12:45.806962+0000","last_fullsized":"2024-04-24T02:12:45.806962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:05:35.109941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.167795+0000","last_change":"2024-04-24T02:12:04.763357+0000","last_active":"2024-04-24T02:15:13.167795+0000","last_peered":"2024-04-24T02:15:13.167795+0000","last_clean":"2024-04-24T02:15:13.167795+0000","last_became_active":"2024-04-24T02:12:04.763076+0000","last_became_peered":"2024-04-24T02:12:04.763076+0000","last_unstale":"2024-04-24T02:15:13.167795+0000","last_undegraded":"2024-04-24T02:15:13.167795+0000","last_fullsized":"2024-04-24T02:15:13.167795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:48:52.834838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.675276+0000","last_change":"2024-04-24T02:12:02.755265+0000","last_active":"2024-04-24T02:14:12.675276+0000","last_peered":"2024-04-24T02:14:12.675276+0000","last_clean":"2024-04-24T02:14:12.675276+0000","last_became_active":"2024-04-24T02:12:02.754208+0000","last_became_peered":"2024-04-24T02:12:02.754208+0000","last_unstale":"2024-04-24T02:14:12.675276+0000","last_undegraded":"2024-04-24T02:14:12.675276+0000","last_fullsized":"2024-04-24T02:14:12.675276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:34:23.368475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:09.631727+0000","last_change":"2024-04-24T02:12:04.755521+0000","last_active":"2024-04-24T02:14:09.631727+0000","last_peered":"2024-04-24T02:14:09.631727+0000","last_clean":"2024-04-24T02:14:09.631727+0000","last_became_active":"2024-04-24T02:12:04.755248+0000","last_became_peered":"2024-04-24T02:12:04.755248+0000","last_unstale":"2024-04-24T02:14:09.631727+0000","last_undegraded":"2024-04-24T02:14:09.631727+0000","last_fullsized":"2024-04-24T02:14:09.631727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:24:15.406623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:46.543231+0000","last_change":"2024-04-24T02:12:02.741732+0000","last_active":"2024-04-24T02:12:46.543231+0000","last_peered":"2024-04-24T02:12:46.543231+0000","last_clean":"2024-04-24T02:12:46.543231+0000","last_became_active":"2024-04-24T02:12:02.741326+0000","last_became_peered":"2024-04-24T02:12:02.741326+0000","last_unstale":"2024-04-24T02:12:46.543231+0000","last_undegraded":"2024-04-24T02:12:46.543231+0000","last_fullsized":"2024-04-24T02:12:46.543231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:56:56.371880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'4","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:09.640640+0000","last_change":"2024-04-24T02:12:04.763252+0000","last_active":"2024-04-24T02:14:09.640640+0000","last_peered":"2024-04-24T02:14:09.640640+0000","last_clean":"2024-04-24T02:14:09.640640+0000","last_became_active":"2024-04-24T02:12:04.762921+0000","last_became_peered":"2024-04-24T02:12:04.762921+0000","last_unstale":"2024-04-24T02:14:09.640640+0000","last_undegraded":"2024-04-24T02:14:09.640640+0000","last_fullsized":"2024-04-24T02:14:09.640640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:25:06.019153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.811719+0000","last_change":"2024-04-24T02:12:02.755513+0000","last_active":"2024-04-24T02:12:45.811719+0000","last_peered":"2024-04-24T02:12:45.811719+0000","last_clean":"2024-04-24T02:12:45.811719+0000","last_became_active":"2024-04-24T02:12:02.752921+0000","last_became_peered":"2024-04-24T02:12:02.752921+0000","last_unstale":"2024-04-24T02:12:45.811719+0000","last_undegraded":"2024-04-24T02:12:45.811719+0000","last_fullsized":"2024-04-24T02:12:45.811719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:31:26.988642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'12","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.393931+0000","last_change":"2024-04-24T02:12:04.752549+0000","last_active":"2024-04-24T02:15:13.393931+0000","last_peered":"2024-04-24T02:15:13.393931+0000","last_clean":"2024-04-24T02:15:13.393931+0000","last_became_active":"2024-04-24T02:12:04.751655+0000","last_became_peered":"2024-04-24T02:12:04.751655+0000","last_unstale":"2024-04-24T02:15:13.393931+0000","last_undegraded":"2024-04-24T02:15:13.393931+0000","last_fullsized":"2024-04-24T02:15:13.393931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:31:33.128498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804677+0000","last_change":"2024-04-24T02:12:02.752760+0000","last_active":"2024-04-24T02:12:45.804677+0000","last_peered":"2024-04-24T02:12:45.804677+0000","last_clean":"2024-04-24T02:12:45.804677+0000","last_became_active":"2024-04-24T02:12:02.752476+0000","last_became_peered":"2024-04-24T02:12:02.752476+0000","last_unstale":"2024-04-24T02:12:45.804677+0000","last_undegraded":"2024-04-24T02:12:45.804677+0000","last_fullsized":"2024-04-24T02:12:45.804677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:27:51.241688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'18","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:29.126000+0000","last_change":"2024-04-24T02:12:04.766969+0000","last_active":"2024-04-24T02:13:29.126000+0000","last_peered":"2024-04-24T02:13:29.126000+0000","last_clean":"2024-04-24T02:13:29.126000+0000","last_became_active":"2024-04-24T02:12:04.766693+0000","last_became_peered":"2024-04-24T02:12:04.766693+0000","last_unstale":"2024-04-24T02:13:29.126000+0000","last_undegraded":"2024-04-24T02:13:29.126000+0000","last_fullsized":"2024-04-24T02:13:29.126000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:01:31.183580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.811209+0000","last_change":"2024-04-24T02:12:04.764729+0000","last_active":"2024-04-24T02:12:45.811209+0000","last_peered":"2024-04-24T02:12:45.811209+0000","last_clean":"2024-04-24T02:12:45.811209+0000","last_became_active":"2024-04-24T02:12:04.764470+0000","last_became_peered":"2024-04-24T02:12:04.764470+0000","last_unstale":"2024-04-24T02:12:45.811209+0000","last_undegraded":"2024-04-24T02:12:45.811209+0000","last_fullsized":"2024-04-24T02:12:45.811209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:27:54.808025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:29.115642+0000","last_change":"2024-04-24T02:12:02.754017+0000","last_active":"2024-04-24T02:13:29.115642+0000","last_peered":"2024-04-24T02:13:29.115642+0000","last_clean":"2024-04-24T02:13:29.115642+0000","last_became_active":"2024-04-24T02:12:02.753791+0000","last_became_peered":"2024-04-24T02:12:02.753791+0000","last_unstale":"2024-04-24T02:13:29.115642+0000","last_undegraded":"2024-04-24T02:13:29.115642+0000","last_fullsized":"2024-04-24T02:13:29.115642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:05:35.109941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'10","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.356710+0000","last_change":"2024-04-24T02:12:04.751048+0000","last_active":"2024-04-24T02:15:13.356710+0000","last_peered":"2024-04-24T02:15:13.356710+0000","last_clean":"2024-04-24T02:15:13.356710+0000","last_became_active":"2024-04-24T02:12:04.750774+0000","last_became_peered":"2024-04-24T02:12:04.750774+0000","last_unstale":"2024-04-24T02:15:13.356710+0000","last_undegraded":"2024-04-24T02:15:13.356710+0000","last_fullsized":"2024-04-24T02:15:13.356710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:31:33.128498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.813506+0000","last_change":"2024-04-24T02:12:02.755711+0000","last_active":"2024-04-24T02:12:45.813506+0000","last_peered":"2024-04-24T02:12:45.813506+0000","last_clean":"2024-04-24T02:12:45.813506+0000","last_became_active":"2024-04-24T02:12:02.754860+0000","last_became_peered":"2024-04-24T02:12:02.754860+0000","last_unstale":"2024-04-24T02:12:45.813506+0000","last_undegraded":"2024-04-24T02:12:45.813506+0000","last_fullsized":"2024-04-24T02:12:45.813506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:15:49.257695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'8","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:09.640474+0000","last_change":"2024-04-24T02:12:04.751178+0000","last_active":"2024-04-24T02:14:09.640474+0000","last_peered":"2024-04-24T02:14:09.640474+0000","last_clean":"2024-04-24T02:14:09.640474+0000","last_became_active":"2024-04-24T02:12:04.750919+0000","last_became_peered":"2024-04-24T02:12:04.750919+0000","last_unstale":"2024-04-24T02:14:09.640474+0000","last_undegraded":"2024-04-24T02:14:09.640474+0000","last_fullsized":"2024-04-24T02:14:09.640474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:43:59.642115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:30.040831+0000","last_change":"2024-04-24T02:12:02.756671+0000","last_active":"2024-04-24T02:14:30.040831+0000","last_peered":"2024-04-24T02:14:30.040831+0000","last_clean":"2024-04-24T02:14:30.040831+0000","last_became_active":"2024-04-24T02:12:02.756389+0000","last_became_peered":"2024-04-24T02:12:02.756389+0000","last_unstale":"2024-04-24T02:14:30.040831+0000","last_undegraded":"2024-04-24T02:14:30.040831+0000","last_fullsized":"2024-04-24T02:14:30.040831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:51:48.494870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'1","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:33.036816+0000","last_change":"2024-04-24T02:12:04.767195+0000","last_active":"2024-04-24T02:14:33.036816+0000","last_peered":"2024-04-24T02:14:33.036816+0000","last_clean":"2024-04-24T02:14:33.036816+0000","last_became_active":"2024-04-24T02:12:04.766739+0000","last_became_peered":"2024-04-24T02:12:04.766739+0000","last_unstale":"2024-04-24T02:14:33.036816+0000","last_undegraded":"2024-04-24T02:14:33.036816+0000","last_fullsized":"2024-04-24T02:14:33.036816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:21:04.111831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805201+0000","last_change":"2024-04-24T02:12:02.745281+0000","last_active":"2024-04-24T02:12:45.805201+0000","last_peered":"2024-04-24T02:12:45.805201+0000","last_clean":"2024-04-24T02:12:45.805201+0000","last_became_active":"2024-04-24T02:12:02.744763+0000","last_became_peered":"2024-04-24T02:12:02.744763+0000","last_unstale":"2024-04-24T02:12:45.805201+0000","last_undegraded":"2024-04-24T02:12:45.805201+0000","last_fullsized":"2024-04-24T02:12:45.805201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:15:49.257695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'10","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.394017+0000","last_change":"2024-04-24T02:12:04.764907+0000","last_active":"2024-04-24T02:15:13.394017+0000","last_peered":"2024-04-24T02:15:13.394017+0000","last_clean":"2024-04-24T02:15:13.394017+0000","last_became_active":"2024-04-24T02:12:04.764659+0000","last_became_peered":"2024-04-24T02:12:04.764659+0000","last_unstale":"2024-04-24T02:15:13.394017+0000","last_undegraded":"2024-04-24T02:15:13.394017+0000","last_fullsized":"2024-04-24T02:15:13.394017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:02.847691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.806249+0000","last_change":"2024-04-24T02:12:02.742249+0000","last_active":"2024-04-24T02:12:45.806249+0000","last_peered":"2024-04-24T02:12:45.806249+0000","last_clean":"2024-04-24T02:12:45.806249+0000","last_became_active":"2024-04-24T02:12:02.741976+0000","last_became_peered":"2024-04-24T02:12:02.741976+0000","last_unstale":"2024-04-24T02:12:45.806249+0000","last_undegraded":"2024-04-24T02:12:45.806249+0000","last_fullsized":"2024-04-24T02:12:45.806249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:56:59.627386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'10","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:28.945151+0000","last_change":"2024-04-24T02:12:04.755425+0000","last_active":"2024-04-24T02:13:28.945151+0000","last_peered":"2024-04-24T02:13:28.945151+0000","last_clean":"2024-04-24T02:13:28.945151+0000","last_became_active":"2024-04-24T02:12:04.755133+0000","last_became_peered":"2024-04-24T02:12:04.755133+0000","last_unstale":"2024-04-24T02:13:28.945151+0000","last_undegraded":"2024-04-24T02:13:28.945151+0000","last_fullsized":"2024-04-24T02:13:28.945151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:57:46.692802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.810492+0000","last_change":"2024-04-24T02:12:02.758478+0000","last_active":"2024-04-24T02:12:45.810492+0000","last_peered":"2024-04-24T02:12:45.810492+0000","last_clean":"2024-04-24T02:12:45.810492+0000","last_became_active":"2024-04-24T02:12:02.753196+0000","last_became_peered":"2024-04-24T02:12:02.753196+0000","last_unstale":"2024-04-24T02:12:45.810492+0000","last_undegraded":"2024-04-24T02:12:45.810492+0000","last_fullsized":"2024-04-24T02:12:45.810492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:51:50.235295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'35","reported_seq":99,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.370315+0000","last_change":"2024-04-24T02:12:12.798478+0000","last_active":"2024-04-24T02:15:13.370315+0000","last_peered":"2024-04-24T02:15:13.370315+0000","last_clean":"2024-04-24T02:15:13.370315+0000","last_became_active":"2024-04-24T02:12:12.798179+0000","last_became_peered":"2024-04-24T02:12:12.798179+0000","last_unstale":"2024-04-24T02:15:13.370315+0000","last_undegraded":"2024-04-24T02:15:13.370315+0000","last_fullsized":"2024-04-24T02:15:13.370315+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:44:55.926593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'5","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:25.040642+0000","last_change":"2024-04-24T02:12:04.764143+0000","last_active":"2024-04-24T02:14:25.040642+0000","last_peered":"2024-04-24T02:14:25.040642+0000","last_clean":"2024-04-24T02:14:25.040642+0000","last_became_active":"2024-04-24T02:12:04.763725+0000","last_became_peered":"2024-04-24T02:12:04.763725+0000","last_unstale":"2024-04-24T02:14:25.040642+0000","last_undegraded":"2024-04-24T02:14:25.040642+0000","last_fullsized":"2024-04-24T02:14:25.040642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:47:39.917204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:46.554283+0000","last_change":"2024-04-24T02:12:02.756910+0000","last_active":"2024-04-24T02:12:46.554283+0000","last_peered":"2024-04-24T02:12:46.554283+0000","last_clean":"2024-04-24T02:12:46.554283+0000","last_became_active":"2024-04-24T02:12:02.755520+0000","last_became_peered":"2024-04-24T02:12:02.755520+0000","last_unstale":"2024-04-24T02:12:46.554283+0000","last_undegraded":"2024-04-24T02:12:46.554283+0000","last_fullsized":"2024-04-24T02:12:46.554283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:11:28.150533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.811511+0000","last_change":"2024-04-24T02:12:06.759172+0000","last_active":"2024-04-24T02:12:45.811511+0000","last_peered":"2024-04-24T02:12:45.811511+0000","last_clean":"2024-04-24T02:12:45.811511+0000","last_became_active":"2024-04-24T02:12:06.758033+0000","last_became_peered":"2024-04-24T02:12:06.758033+0000","last_unstale":"2024-04-24T02:12:45.811511+0000","last_undegraded":"2024-04-24T02:12:45.811511+0000","last_fullsized":"2024-04-24T02:12:45.811511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:24.367968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'43","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.344978+0000","last_change":"2024-04-24T02:12:08.783964+0000","last_active":"2024-04-24T02:14:11.344978+0000","last_peered":"2024-04-24T02:14:11.344978+0000","last_clean":"2024-04-24T02:14:11.344978+0000","last_became_active":"2024-04-24T02:12:08.783666+0000","last_became_peered":"2024-04-24T02:12:08.783666+0000","last_unstale":"2024-04-24T02:14:11.344978+0000","last_undegraded":"2024-04-24T02:14:11.344978+0000","last_fullsized":"2024-04-24T02:14:11.344978+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:00:42.425055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804631+0000","last_change":"2024-04-24T02:12:10.787426+0000","last_active":"2024-04-24T02:12:45.804631+0000","last_peered":"2024-04-24T02:12:45.804631+0000","last_clean":"2024-04-24T02:12:45.804631+0000","last_became_active":"2024-04-24T02:12:10.786981+0000","last_became_peered":"2024-04-24T02:12:10.786981+0000","last_unstale":"2024-04-24T02:12:45.804631+0000","last_undegraded":"2024-04-24T02:12:45.804631+0000","last_fullsized":"2024-04-24T02:12:45.804631+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:03:55.174622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:28.953239+0000","last_change":"2024-04-24T02:12:12.797648+0000","last_active":"2024-04-24T02:13:28.953239+0000","last_peered":"2024-04-24T02:13:28.953239+0000","last_clean":"2024-04-24T02:13:28.953239+0000","last_became_active":"2024-04-24T02:12:12.796319+0000","last_became_peered":"2024-04-24T02:12:12.796319+0000","last_unstale":"2024-04-24T02:13:28.953239+0000","last_undegraded":"2024-04-24T02:13:28.953239+0000","last_fullsized":"2024-04-24T02:13:28.953239+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:12:52.743479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.812193+0000","last_change":"2024-04-24T02:12:04.764679+0000","last_active":"2024-04-24T02:12:45.812193+0000","last_peered":"2024-04-24T02:12:45.812193+0000","last_clean":"2024-04-24T02:12:45.812193+0000","last_became_active":"2024-04-24T02:12:04.764351+0000","last_became_peered":"2024-04-24T02:12:04.764351+0000","last_unstale":"2024-04-24T02:12:45.812193+0000","last_undegraded":"2024-04-24T02:12:45.812193+0000","last_fullsized":"2024-04-24T02:12:45.812193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:24:09.733301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.806373+0000","last_change":"2024-04-24T02:12:02.748273+0000","last_active":"2024-04-24T02:12:45.806373+0000","last_peered":"2024-04-24T02:12:45.806373+0000","last_clean":"2024-04-24T02:12:45.806373+0000","last_became_active":"2024-04-24T02:12:02.744030+0000","last_became_peered":"2024-04-24T02:12:02.744030+0000","last_unstale":"2024-04-24T02:12:45.806373+0000","last_undegraded":"2024-04-24T02:12:45.806373+0000","last_fullsized":"2024-04-24T02:12:45.806373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:39:43.304402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805313+0000","last_change":"2024-04-24T02:12:06.758854+0000","last_active":"2024-04-24T02:12:45.805313+0000","last_peered":"2024-04-24T02:12:45.805313+0000","last_clean":"2024-04-24T02:12:45.805313+0000","last_became_active":"2024-04-24T02:12:06.758561+0000","last_became_peered":"2024-04-24T02:12:06.758561+0000","last_unstale":"2024-04-24T02:12:45.805313+0000","last_undegraded":"2024-04-24T02:12:45.805313+0000","last_fullsized":"2024-04-24T02:12:45.805313+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:30:27.876817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"30'12","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804944+0000","last_change":"2024-04-24T02:12:08.767804+0000","last_active":"2024-04-24T02:12:45.804944+0000","last_peered":"2024-04-24T02:12:45.804944+0000","last_clean":"2024-04-24T02:12:45.804944+0000","last_became_active":"2024-04-24T02:12:08.767493+0000","last_became_peered":"2024-04-24T02:12:08.767493+0000","last_unstale":"2024-04-24T02:12:45.804944+0000","last_undegraded":"2024-04-24T02:12:45.804944+0000","last_fullsized":"2024-04-24T02:12:45.804944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:21:18.301632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804318+0000","last_change":"2024-04-24T02:12:10.779679+0000","last_active":"2024-04-24T02:12:45.804318+0000","last_peered":"2024-04-24T02:12:45.804318+0000","last_clean":"2024-04-24T02:12:45.804318+0000","last_became_active":"2024-04-24T02:12:10.779231+0000","last_became_peered":"2024-04-24T02:12:10.779231+0000","last_unstale":"2024-04-24T02:12:45.804318+0000","last_undegraded":"2024-04-24T02:12:45.804318+0000","last_fullsized":"2024-04-24T02:12:45.804318+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:38:27.193760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'8","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:29.122978+0000","last_change":"2024-04-24T02:12:12.791754+0000","last_active":"2024-04-24T02:13:29.122978+0000","last_peered":"2024-04-24T02:13:29.122978+0000","last_clean":"2024-04-24T02:13:29.122978+0000","last_became_active":"2024-04-24T02:12:12.791542+0000","last_became_peered":"2024-04-24T02:12:12.791542+0000","last_unstale":"2024-04-24T02:13:29.122978+0000","last_undegraded":"2024-04-24T02:13:29.122978+0000","last_fullsized":"2024-04-24T02:13:29.122978+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:16:45.741077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.349051+0000","last_change":"2024-04-24T02:12:04.764138+0000","last_active":"2024-04-24T02:15:13.349051+0000","last_peered":"2024-04-24T02:15:13.349051+0000","last_clean":"2024-04-24T02:15:13.349051+0000","last_became_active":"2024-04-24T02:12:04.763491+0000","last_became_peered":"2024-04-24T02:12:04.763491+0000","last_unstale":"2024-04-24T02:15:13.349051+0000","last_undegraded":"2024-04-24T02:15:13.349051+0000","last_fullsized":"2024-04-24T02:15:13.349051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:37:41.541077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"30'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.811251+0000","last_change":"2024-04-24T02:12:02.757002+0000","last_active":"2024-04-24T02:12:45.811251+0000","last_peered":"2024-04-24T02:12:45.811251+0000","last_clean":"2024-04-24T02:12:45.811251+0000","last_became_active":"2024-04-24T02:12:02.755636+0000","last_became_peered":"2024-04-24T02:12:02.755636+0000","last_unstale":"2024-04-24T02:12:45.811251+0000","last_undegraded":"2024-04-24T02:12:45.811251+0000","last_fullsized":"2024-04-24T02:12:45.811251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:55:45.693152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.814863+0000","last_change":"2024-04-24T02:12:45.813418+0000","last_active":"2024-04-24T02:12:45.814863+0000","last_peered":"2024-04-24T02:12:45.814863+0000","last_clean":"2024-04-24T02:12:45.814863+0000","last_became_active":"2024-04-24T02:12:45.813038+0000","last_became_peered":"2024-04-24T02:12:45.813038+0000","last_unstale":"2024-04-24T02:12:45.814863+0000","last_undegraded":"2024-04-24T02:12:45.814863+0000","last_fullsized":"2024-04-24T02:12:45.814863+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:24.367968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"30'22","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.808733+0000","last_change":"2024-04-24T02:12:08.783389+0000","last_active":"2024-04-24T02:12:45.808733+0000","last_peered":"2024-04-24T02:12:45.808733+0000","last_clean":"2024-04-24T02:12:45.808733+0000","last_became_active":"2024-04-24T02:12:08.783077+0000","last_became_peered":"2024-04-24T02:12:08.783077+0000","last_unstale":"2024-04-24T02:12:45.808733+0000","last_undegraded":"2024-04-24T02:12:45.808733+0000","last_fullsized":"2024-04-24T02:12:45.808733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:56:15.426387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'282","reported_seq":404,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:11.839479+0000","last_change":"2024-04-24T02:12:10.784037+0000","last_active":"2024-04-24T02:15:11.839479+0000","last_peered":"2024-04-24T02:15:11.839479+0000","last_clean":"2024-04-24T02:15:11.839479+0000","last_became_active":"2024-04-24T02:12:10.783726+0000","last_became_peered":"2024-04-24T02:12:10.783726+0000","last_unstale":"2024-04-24T02:15:11.839479+0000","last_undegraded":"2024-04-24T02:15:11.839479+0000","last_fullsized":"2024-04-24T02:15:11.839479+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:49:38.926049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.808957+0000","last_change":"2024-04-24T02:12:12.801707+0000","last_active":"2024-04-24T02:12:45.808957+0000","last_peered":"2024-04-24T02:12:45.808957+0000","last_clean":"2024-04-24T02:12:45.808957+0000","last_became_active":"2024-04-24T02:12:12.801331+0000","last_became_peered":"2024-04-24T02:12:12.801331+0000","last_unstale":"2024-04-24T02:12:45.808957+0000","last_undegraded":"2024-04-24T02:12:45.808957+0000","last_fullsized":"2024-04-24T02:12:45.808957+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:10:27.748343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'17","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.400977+0000","last_change":"2024-04-24T02:12:04.756301+0000","last_active":"2024-04-24T02:15:13.400977+0000","last_peered":"2024-04-24T02:15:13.400977+0000","last_clean":"2024-04-24T02:15:13.400977+0000","last_became_active":"2024-04-24T02:12:04.756039+0000","last_became_peered":"2024-04-24T02:12:04.756039+0000","last_unstale":"2024-04-24T02:15:13.400977+0000","last_undegraded":"2024-04-24T02:15:13.400977+0000","last_fullsized":"2024-04-24T02:15:13.400977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:44:45.745380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":60,"num_read_kb":52,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.803334+0000","last_change":"2024-04-24T02:12:02.755651+0000","last_active":"2024-04-24T02:12:45.803334+0000","last_peered":"2024-04-24T02:12:45.803334+0000","last_clean":"2024-04-24T02:12:45.803334+0000","last_became_active":"2024-04-24T02:12:02.754852+0000","last_became_peered":"2024-04-24T02:12:02.754852+0000","last_unstale":"2024-04-24T02:12:45.803334+0000","last_undegraded":"2024-04-24T02:12:45.803334+0000","last_fullsized":"2024-04-24T02:12:45.803334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:02:45.311843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.812440+0000","last_change":"2024-04-24T02:12:06.758372+0000","last_active":"2024-04-24T02:12:45.812440+0000","last_peered":"2024-04-24T02:12:45.812440+0000","last_clean":"2024-04-24T02:12:45.812440+0000","last_became_active":"2024-04-24T02:12:06.757883+0000","last_became_peered":"2024-04-24T02:12:06.757883+0000","last_unstale":"2024-04-24T02:12:45.812440+0000","last_undegraded":"2024-04-24T02:12:45.812440+0000","last_fullsized":"2024-04-24T02:12:45.812440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:30:33.127083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'37","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:35.041555+0000","last_change":"2024-04-24T02:12:08.781239+0000","last_active":"2024-04-24T02:14:35.041555+0000","last_peered":"2024-04-24T02:14:35.041555+0000","last_clean":"2024-04-24T02:14:35.041555+0000","last_became_active":"2024-04-24T02:12:08.780950+0000","last_became_peered":"2024-04-24T02:12:08.780950+0000","last_unstale":"2024-04-24T02:14:35.041555+0000","last_undegraded":"2024-04-24T02:14:35.041555+0000","last_fullsized":"2024-04-24T02:14:35.041555+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:22:22.427553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'282","reported_seq":435,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.470327+0000","last_change":"2024-04-24T02:12:10.778536+0000","last_active":"2024-04-24T02:15:13.470327+0000","last_peered":"2024-04-24T02:15:13.470327+0000","last_clean":"2024-04-24T02:15:13.470327+0000","last_became_active":"2024-04-24T02:12:10.778254+0000","last_became_peered":"2024-04-24T02:12:10.778254+0000","last_unstale":"2024-04-24T02:15:13.470327+0000","last_undegraded":"2024-04-24T02:15:13.470327+0000","last_fullsized":"2024-04-24T02:15:13.470327+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:23:53.259197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.349016+0000","last_change":"2024-04-24T02:12:04.768436+0000","last_active":"2024-04-24T02:15:13.349016+0000","last_peered":"2024-04-24T02:15:13.349016+0000","last_clean":"2024-04-24T02:15:13.349016+0000","last_became_active":"2024-04-24T02:12:04.767906+0000","last_became_peered":"2024-04-24T02:12:04.767906+0000","last_unstale":"2024-04-24T02:15:13.349016+0000","last_undegraded":"2024-04-24T02:15:13.349016+0000","last_fullsized":"2024-04-24T02:15:13.349016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:21:44.832014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"32'3","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:28.904559+0000","last_change":"2024-04-24T02:12:02.749142+0000","last_active":"2024-04-24T02:13:28.904559+0000","last_peered":"2024-04-24T02:13:28.904559+0000","last_clean":"2024-04-24T02:13:28.904559+0000","last_became_active":"2024-04-24T02:12:02.748372+0000","last_became_peered":"2024-04-24T02:12:02.748372+0000","last_unstale":"2024-04-24T02:13:28.904559+0000","last_undegraded":"2024-04-24T02:13:28.904559+0000","last_fullsized":"2024-04-24T02:13:28.904559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:59:32.006851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.803560+0000","last_change":"2024-04-24T02:12:06.764649+0000","last_active":"2024-04-24T02:12:45.803560+0000","last_peered":"2024-04-24T02:12:45.803560+0000","last_clean":"2024-04-24T02:12:45.803560+0000","last_became_active":"2024-04-24T02:12:06.764324+0000","last_became_peered":"2024-04-24T02:12:06.764324+0000","last_unstale":"2024-04-24T02:12:45.803560+0000","last_undegraded":"2024-04-24T02:12:45.803560+0000","last_fullsized":"2024-04-24T02:12:45.803560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:24.266336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'46","reported_seq":99,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.349299+0000","last_change":"2024-04-24T02:12:08.771425+0000","last_active":"2024-04-24T02:14:11.349299+0000","last_peered":"2024-04-24T02:14:11.349299+0000","last_clean":"2024-04-24T02:14:11.349299+0000","last_became_active":"2024-04-24T02:12:08.771060+0000","last_became_peered":"2024-04-24T02:12:08.771060+0000","last_unstale":"2024-04-24T02:14:11.349299+0000","last_undegraded":"2024-04-24T02:14:11.349299+0000","last_fullsized":"2024-04-24T02:14:11.349299+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:04:03.080193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804862+0000","last_change":"2024-04-24T02:12:10.777029+0000","last_active":"2024-04-24T02:12:45.804862+0000","last_peered":"2024-04-24T02:12:45.804862+0000","last_clean":"2024-04-24T02:12:45.804862+0000","last_became_active":"2024-04-24T02:12:10.776715+0000","last_became_peered":"2024-04-24T02:12:10.776715+0000","last_unstale":"2024-04-24T02:12:45.804862+0000","last_undegraded":"2024-04-24T02:12:45.804862+0000","last_fullsized":"2024-04-24T02:12:45.804862+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:05:12.120497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'5","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:28.954965+0000","last_change":"2024-04-24T02:12:12.797751+0000","last_active":"2024-04-24T02:13:28.954965+0000","last_peered":"2024-04-24T02:13:28.954965+0000","last_clean":"2024-04-24T02:13:28.954965+0000","last_became_active":"2024-04-24T02:12:12.797405+0000","last_became_peered":"2024-04-24T02:12:12.797405+0000","last_unstale":"2024-04-24T02:13:28.954965+0000","last_undegraded":"2024-04-24T02:13:28.954965+0000","last_fullsized":"2024-04-24T02:13:28.954965+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:54:48.506969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'10","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.464804+0000","last_change":"2024-04-24T02:12:04.754076+0000","last_active":"2024-04-24T02:15:13.464804+0000","last_peered":"2024-04-24T02:15:13.464804+0000","last_clean":"2024-04-24T02:15:13.464804+0000","last_became_active":"2024-04-24T02:12:04.753819+0000","last_became_peered":"2024-04-24T02:12:04.753819+0000","last_unstale":"2024-04-24T02:15:13.464804+0000","last_undegraded":"2024-04-24T02:15:13.464804+0000","last_fullsized":"2024-04-24T02:15:13.464804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:39:00.502785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.813994+0000","last_change":"2024-04-24T02:12:02.743507+0000","last_active":"2024-04-24T02:12:45.813994+0000","last_peered":"2024-04-24T02:12:45.813994+0000","last_clean":"2024-04-24T02:12:45.813994+0000","last_became_active":"2024-04-24T02:12:02.743202+0000","last_became_peered":"2024-04-24T02:12:02.743202+0000","last_unstale":"2024-04-24T02:12:45.813994+0000","last_undegraded":"2024-04-24T02:12:45.813994+0000","last_fullsized":"2024-04-24T02:12:45.813994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:02:45.311843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805195+0000","last_change":"2024-04-24T02:12:06.765949+0000","last_active":"2024-04-24T02:12:45.805195+0000","last_peered":"2024-04-24T02:12:45.805195+0000","last_clean":"2024-04-24T02:12:45.805195+0000","last_became_active":"2024-04-24T02:12:06.765690+0000","last_became_peered":"2024-04-24T02:12:06.765690+0000","last_unstale":"2024-04-24T02:12:45.805195+0000","last_undegraded":"2024-04-24T02:12:45.805195+0000","last_fullsized":"2024-04-24T02:12:45.805195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:20:26.752873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'38","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.358070+0000","last_change":"2024-04-24T02:12:08.780282+0000","last_active":"2024-04-24T02:15:13.358070+0000","last_peered":"2024-04-24T02:15:13.358070+0000","last_clean":"2024-04-24T02:15:13.358070+0000","last_became_active":"2024-04-24T02:12:08.779594+0000","last_became_peered":"2024-04-24T02:12:08.779594+0000","last_unstale":"2024-04-24T02:15:13.358070+0000","last_undegraded":"2024-04-24T02:15:13.358070+0000","last_fullsized":"2024-04-24T02:15:13.358070+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:31:17.615935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804354+0000","last_change":"2024-04-24T02:12:10.785197+0000","last_active":"2024-04-24T02:12:45.804354+0000","last_peered":"2024-04-24T02:12:45.804354+0000","last_clean":"2024-04-24T02:12:45.804354+0000","last_became_active":"2024-04-24T02:12:10.784901+0000","last_became_peered":"2024-04-24T02:12:10.784901+0000","last_unstale":"2024-04-24T02:12:45.804354+0000","last_undegraded":"2024-04-24T02:12:45.804354+0000","last_fullsized":"2024-04-24T02:12:45.804354+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:08:57.130072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'5","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.396389+0000","last_change":"2024-04-24T02:12:12.795959+0000","last_active":"2024-04-24T02:15:13.396389+0000","last_peered":"2024-04-24T02:15:13.396389+0000","last_clean":"2024-04-24T02:15:13.396389+0000","last_became_active":"2024-04-24T02:12:12.795364+0000","last_became_peered":"2024-04-24T02:12:12.795364+0000","last_unstale":"2024-04-24T02:15:13.396389+0000","last_undegraded":"2024-04-24T02:15:13.396389+0000","last_fullsized":"2024-04-24T02:15:13.396389+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:56:16.695108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'8","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.464931+0000","last_change":"2024-04-24T02:12:04.763127+0000","last_active":"2024-04-24T02:15:13.464931+0000","last_peered":"2024-04-24T02:15:13.464931+0000","last_clean":"2024-04-24T02:15:13.464931+0000","last_became_active":"2024-04-24T02:12:04.762869+0000","last_became_peered":"2024-04-24T02:12:04.762869+0000","last_unstale":"2024-04-24T02:15:13.464931+0000","last_undegraded":"2024-04-24T02:15:13.464931+0000","last_fullsized":"2024-04-24T02:15:13.464931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:55:54.502965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.812086+0000","last_change":"2024-04-24T02:12:02.758980+0000","last_active":"2024-04-24T02:12:45.812086+0000","last_peered":"2024-04-24T02:12:45.812086+0000","last_clean":"2024-04-24T02:12:45.812086+0000","last_became_active":"2024-04-24T02:12:02.757488+0000","last_became_peered":"2024-04-24T02:12:02.757488+0000","last_unstale":"2024-04-24T02:12:45.812086+0000","last_undegraded":"2024-04-24T02:12:45.812086+0000","last_fullsized":"2024-04-24T02:12:45.812086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:39:09.728890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.807289+0000","last_change":"2024-04-24T02:12:06.764973+0000","last_active":"2024-04-24T02:12:45.807289+0000","last_peered":"2024-04-24T02:12:45.807289+0000","last_clean":"2024-04-24T02:12:45.807289+0000","last_became_active":"2024-04-24T02:12:06.764339+0000","last_became_peered":"2024-04-24T02:12:06.764339+0000","last_unstale":"2024-04-24T02:12:45.807289+0000","last_undegraded":"2024-04-24T02:12:45.807289+0000","last_fullsized":"2024-04-24T02:12:45.807289+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:48:03.012278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'48","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.351402+0000","last_change":"2024-04-24T02:12:08.781158+0000","last_active":"2024-04-24T02:14:11.351402+0000","last_peered":"2024-04-24T02:14:11.351402+0000","last_clean":"2024-04-24T02:14:11.351402+0000","last_became_active":"2024-04-24T02:12:08.780230+0000","last_became_peered":"2024-04-24T02:12:08.780230+0000","last_unstale":"2024-04-24T02:14:11.351402+0000","last_undegraded":"2024-04-24T02:14:11.351402+0000","last_fullsized":"2024-04-24T02:14:11.351402+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:53:03.292344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'282","reported_seq":397,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.591168+0000","last_change":"2024-04-24T02:12:10.784581+0000","last_active":"2024-04-24T02:15:13.591168+0000","last_peered":"2024-04-24T02:15:13.591168+0000","last_clean":"2024-04-24T02:15:13.591168+0000","last_became_active":"2024-04-24T02:12:10.784278+0000","last_became_peered":"2024-04-24T02:12:10.784278+0000","last_unstale":"2024-04-24T02:15:13.591168+0000","last_undegraded":"2024-04-24T02:15:13.591168+0000","last_fullsized":"2024-04-24T02:15:13.591168+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:21:58.208138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.190002+0000","last_change":"2024-04-24T02:12:12.792876+0000","last_active":"2024-04-24T02:15:13.190002+0000","last_peered":"2024-04-24T02:15:13.190002+0000","last_clean":"2024-04-24T02:15:13.190002+0000","last_became_active":"2024-04-24T02:12:12.792569+0000","last_became_peered":"2024-04-24T02:12:12.792569+0000","last_unstale":"2024-04-24T02:15:13.190002+0000","last_undegraded":"2024-04-24T02:15:13.190002+0000","last_fullsized":"2024-04-24T02:15:13.190002+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:00:24.269543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'26","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.464740+0000","last_change":"2024-04-24T02:12:04.752393+0000","last_active":"2024-04-24T02:15:13.464740+0000","last_peered":"2024-04-24T02:15:13.464740+0000","last_clean":"2024-04-24T02:15:13.464740+0000","last_became_active":"2024-04-24T02:12:04.752075+0000","last_became_peered":"2024-04-24T02:12:04.752075+0000","last_unstale":"2024-04-24T02:15:13.464740+0000","last_undegraded":"2024-04-24T02:15:13.464740+0000","last_fullsized":"2024-04-24T02:15:13.464740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:15:44.431680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":67,"num_write":30,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.811311+0000","last_change":"2024-04-24T02:12:02.755772+0000","last_active":"2024-04-24T02:12:45.811311+0000","last_peered":"2024-04-24T02:12:45.811311+0000","last_clean":"2024-04-24T02:12:45.811311+0000","last_became_active":"2024-04-24T02:12:02.755468+0000","last_became_peered":"2024-04-24T02:12:02.755468+0000","last_unstale":"2024-04-24T02:12:45.811311+0000","last_undegraded":"2024-04-24T02:12:45.811311+0000","last_fullsized":"2024-04-24T02:12:45.811311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:01:29.176953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804833+0000","last_change":"2024-04-24T02:12:06.764717+0000","last_active":"2024-04-24T02:12:45.804833+0000","last_peered":"2024-04-24T02:12:45.804833+0000","last_clean":"2024-04-24T02:12:45.804833+0000","last_became_active":"2024-04-24T02:12:06.764365+0000","last_became_peered":"2024-04-24T02:12:06.764365+0000","last_unstale":"2024-04-24T02:12:45.804833+0000","last_undegraded":"2024-04-24T02:12:45.804833+0000","last_fullsized":"2024-04-24T02:12:45.804833+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:24:11.723447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'69","reported_seq":137,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.353253+0000","last_change":"2024-04-24T02:12:08.780274+0000","last_active":"2024-04-24T02:14:11.353253+0000","last_peered":"2024-04-24T02:14:11.353253+0000","last_clean":"2024-04-24T02:14:11.353253+0000","last_became_active":"2024-04-24T02:12:08.779602+0000","last_became_peered":"2024-04-24T02:12:08.779602+0000","last_unstale":"2024-04-24T02:14:11.353253+0000","last_undegraded":"2024-04-24T02:14:11.353253+0000","last_fullsized":"2024-04-24T02:14:11.353253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:33:01.634520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804983+0000","last_change":"2024-04-24T02:12:10.782388+0000","last_active":"2024-04-24T02:12:45.804983+0000","last_peered":"2024-04-24T02:12:45.804983+0000","last_clean":"2024-04-24T02:12:45.804983+0000","last_became_active":"2024-04-24T02:12:10.782121+0000","last_became_peered":"2024-04-24T02:12:10.782121+0000","last_unstale":"2024-04-24T02:12:45.804983+0000","last_undegraded":"2024-04-24T02:12:45.804983+0000","last_fullsized":"2024-04-24T02:12:45.804983+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:07:26.897678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'20","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.566391+0000","last_change":"2024-04-24T02:12:12.790210+0000","last_active":"2024-04-24T02:15:13.566391+0000","last_peered":"2024-04-24T02:15:13.566391+0000","last_clean":"2024-04-24T02:15:13.566391+0000","last_became_active":"2024-04-24T02:12:12.789799+0000","last_became_peered":"2024-04-24T02:12:12.789799+0000","last_unstale":"2024-04-24T02:15:13.566391+0000","last_undegraded":"2024-04-24T02:15:13.566391+0000","last_fullsized":"2024-04-24T02:15:13.566391+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:13:23.819613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:28.944905+0000","last_change":"2024-04-24T02:12:04.766750+0000","last_active":"2024-04-24T02:13:28.944905+0000","last_peered":"2024-04-24T02:13:28.944905+0000","last_clean":"2024-04-24T02:13:28.944905+0000","last_became_active":"2024-04-24T02:12:04.766495+0000","last_became_peered":"2024-04-24T02:12:04.766495+0000","last_unstale":"2024-04-24T02:13:28.944905+0000","last_undegraded":"2024-04-24T02:13:28.944905+0000","last_fullsized":"2024-04-24T02:13:28.944905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:26:32.311949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805177+0000","last_change":"2024-04-24T02:12:02.743527+0000","last_active":"2024-04-24T02:12:45.805177+0000","last_peered":"2024-04-24T02:12:45.805177+0000","last_clean":"2024-04-24T02:12:45.805177+0000","last_became_active":"2024-04-24T02:12:02.743204+0000","last_became_peered":"2024-04-24T02:12:02.743204+0000","last_unstale":"2024-04-24T02:12:45.805177+0000","last_undegraded":"2024-04-24T02:12:45.805177+0000","last_fullsized":"2024-04-24T02:12:45.805177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:42:26.915246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.807995+0000","last_change":"2024-04-24T02:12:06.765176+0000","last_active":"2024-04-24T02:12:45.807995+0000","last_peered":"2024-04-24T02:12:45.807995+0000","last_clean":"2024-04-24T02:12:45.807995+0000","last_became_active":"2024-04-24T02:12:06.764676+0000","last_became_peered":"2024-04-24T02:12:06.764676+0000","last_unstale":"2024-04-24T02:12:45.807995+0000","last_undegraded":"2024-04-24T02:12:45.807995+0000","last_fullsized":"2024-04-24T02:12:45.807995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:44:01.649539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'38","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.333417+0000","last_change":"2024-04-24T02:12:08.773725+0000","last_active":"2024-04-24T02:14:11.333417+0000","last_peered":"2024-04-24T02:14:11.333417+0000","last_clean":"2024-04-24T02:14:11.333417+0000","last_became_active":"2024-04-24T02:12:08.773355+0000","last_became_peered":"2024-04-24T02:12:08.773355+0000","last_unstale":"2024-04-24T02:14:11.333417+0000","last_undegraded":"2024-04-24T02:14:11.333417+0000","last_fullsized":"2024-04-24T02:14:11.333417+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:38:42.332605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.813546+0000","last_change":"2024-04-24T02:12:10.784747+0000","last_active":"2024-04-24T02:12:45.813546+0000","last_peered":"2024-04-24T02:12:45.813546+0000","last_clean":"2024-04-24T02:12:45.813546+0000","last_became_active":"2024-04-24T02:12:10.783334+0000","last_became_peered":"2024-04-24T02:12:10.783334+0000","last_unstale":"2024-04-24T02:12:45.813546+0000","last_undegraded":"2024-04-24T02:12:45.813546+0000","last_fullsized":"2024-04-24T02:12:45.813546+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:37:24.863362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:15.038882+0000","last_change":"2024-04-24T02:12:12.794851+0000","last_active":"2024-04-24T02:14:15.038882+0000","last_peered":"2024-04-24T02:14:15.038882+0000","last_clean":"2024-04-24T02:14:15.038882+0000","last_became_active":"2024-04-24T02:12:12.794106+0000","last_became_peered":"2024-04-24T02:12:12.794106+0000","last_unstale":"2024-04-24T02:14:15.038882+0000","last_undegraded":"2024-04-24T02:14:15.038882+0000","last_fullsized":"2024-04-24T02:14:15.038882+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:30:12.595419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'4","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:09.640308+0000","last_change":"2024-04-24T02:12:04.768515+0000","last_active":"2024-04-24T02:14:09.640308+0000","last_peered":"2024-04-24T02:14:09.640308+0000","last_clean":"2024-04-24T02:14:09.640308+0000","last_became_active":"2024-04-24T02:12:04.767376+0000","last_became_peered":"2024-04-24T02:12:04.767376+0000","last_unstale":"2024-04-24T02:14:09.640308+0000","last_undegraded":"2024-04-24T02:14:09.640308+0000","last_fullsized":"2024-04-24T02:14:09.640308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:15:19.870705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.752057+0000","last_change":"2024-04-24T02:12:02.761147+0000","last_active":"2024-04-24T02:14:12.752057+0000","last_peered":"2024-04-24T02:14:12.752057+0000","last_clean":"2024-04-24T02:14:12.752057+0000","last_became_active":"2024-04-24T02:12:02.760317+0000","last_became_peered":"2024-04-24T02:12:02.760317+0000","last_unstale":"2024-04-24T02:14:12.752057+0000","last_undegraded":"2024-04-24T02:14:12.752057+0000","last_fullsized":"2024-04-24T02:14:12.752057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:00:21.940276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.815447+0000","last_change":"2024-04-24T02:12:45.814348+0000","last_active":"2024-04-24T02:12:45.815447+0000","last_peered":"2024-04-24T02:12:45.815447+0000","last_clean":"2024-04-24T02:12:45.815447+0000","last_became_active":"2024-04-24T02:12:45.811272+0000","last_became_peered":"2024-04-24T02:12:45.811272+0000","last_unstale":"2024-04-24T02:12:45.815447+0000","last_undegraded":"2024-04-24T02:12:45.815447+0000","last_fullsized":"2024-04-24T02:12:45.815447+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:50:21.355536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"32'37","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.360247+0000","last_change":"2024-04-24T02:12:08.769681+0000","last_active":"2024-04-24T02:14:11.360247+0000","last_peered":"2024-04-24T02:14:11.360247+0000","last_clean":"2024-04-24T02:14:11.360247+0000","last_became_active":"2024-04-24T02:12:08.769307+0000","last_became_peered":"2024-04-24T02:12:08.769307+0000","last_unstale":"2024-04-24T02:14:11.360247+0000","last_undegraded":"2024-04-24T02:14:11.360247+0000","last_fullsized":"2024-04-24T02:14:11.360247+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:28:14.541427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'282","reported_seq":403,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.571049+0000","last_change":"2024-04-24T02:12:10.779255+0000","last_active":"2024-04-24T02:15:13.571049+0000","last_peered":"2024-04-24T02:15:13.571049+0000","last_clean":"2024-04-24T02:15:13.571049+0000","last_became_active":"2024-04-24T02:12:10.778972+0000","last_became_peered":"2024-04-24T02:12:10.778972+0000","last_unstale":"2024-04-24T02:15:13.571049+0000","last_undegraded":"2024-04-24T02:15:13.571049+0000","last_fullsized":"2024-04-24T02:15:13.571049+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:37:47.569074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'12","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:18.034560+0000","last_change":"2024-04-24T02:12:12.790568+0000","last_active":"2024-04-24T02:14:18.034560+0000","last_peered":"2024-04-24T02:14:18.034560+0000","last_clean":"2024-04-24T02:14:18.034560+0000","last_became_active":"2024-04-24T02:12:12.790353+0000","last_became_peered":"2024-04-24T02:12:12.790353+0000","last_unstale":"2024-04-24T02:14:18.034560+0000","last_undegraded":"2024-04-24T02:14:18.034560+0000","last_fullsized":"2024-04-24T02:14:18.034560+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:03:40.609057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'10","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.465025+0000","last_change":"2024-04-24T02:12:04.760283+0000","last_active":"2024-04-24T02:15:13.465025+0000","last_peered":"2024-04-24T02:15:13.465025+0000","last_clean":"2024-04-24T02:15:13.465025+0000","last_became_active":"2024-04-24T02:12:04.760020+0000","last_became_peered":"2024-04-24T02:12:04.760020+0000","last_unstale":"2024-04-24T02:15:13.465025+0000","last_undegraded":"2024-04-24T02:15:13.465025+0000","last_fullsized":"2024-04-24T02:15:13.465025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:20:27.874953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"32'1","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:15.038970+0000","last_change":"2024-04-24T02:12:02.756829+0000","last_active":"2024-04-24T02:14:15.038970+0000","last_peered":"2024-04-24T02:14:15.038970+0000","last_clean":"2024-04-24T02:14:15.038970+0000","last_became_active":"2024-04-24T02:12:02.753593+0000","last_became_peered":"2024-04-24T02:12:02.753593+0000","last_unstale":"2024-04-24T02:14:15.038970+0000","last_undegraded":"2024-04-24T02:14:15.038970+0000","last_fullsized":"2024-04-24T02:14:15.038970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:22:26.189922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'3","reported_seq":413,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.412629+0000","last_change":"2024-04-24T02:12:06.759063+0000","last_active":"2024-04-24T02:14:12.412629+0000","last_peered":"2024-04-24T02:14:12.412629+0000","last_clean":"2024-04-24T02:14:12.412629+0000","last_became_active":"2024-04-24T02:12:06.758759+0000","last_became_peered":"2024-04-24T02:12:06.758759+0000","last_unstale":"2024-04-24T02:14:12.412629+0000","last_undegraded":"2024-04-24T02:14:12.412629+0000","last_fullsized":"2024-04-24T02:14:12.412629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:00:44.704350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"30'11","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.811579+0000","last_change":"2024-04-24T02:12:08.783278+0000","last_active":"2024-04-24T02:12:45.811579+0000","last_peered":"2024-04-24T02:12:45.811579+0000","last_clean":"2024-04-24T02:12:45.811579+0000","last_became_active":"2024-04-24T02:12:08.783011+0000","last_became_peered":"2024-04-24T02:12:08.783011+0000","last_unstale":"2024-04-24T02:12:45.811579+0000","last_undegraded":"2024-04-24T02:12:45.811579+0000","last_fullsized":"2024-04-24T02:12:45.811579+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:34:35.511797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'282","reported_seq":459,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.528202+0000","last_change":"2024-04-24T02:12:10.777668+0000","last_active":"2024-04-24T02:15:13.528202+0000","last_peered":"2024-04-24T02:15:13.528202+0000","last_clean":"2024-04-24T02:15:13.528202+0000","last_became_active":"2024-04-24T02:12:10.777222+0000","last_became_peered":"2024-04-24T02:12:10.777222+0000","last_unstale":"2024-04-24T02:15:13.528202+0000","last_undegraded":"2024-04-24T02:15:13.528202+0000","last_fullsized":"2024-04-24T02:15:13.528202+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:38:54.174398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.545828+0000","last_change":"2024-04-24T02:12:12.795499+0000","last_active":"2024-04-24T02:14:12.545828+0000","last_peered":"2024-04-24T02:14:12.545828+0000","last_clean":"2024-04-24T02:14:12.545828+0000","last_became_active":"2024-04-24T02:12:12.795204+0000","last_became_peered":"2024-04-24T02:12:12.795204+0000","last_unstale":"2024-04-24T02:14:12.545828+0000","last_undegraded":"2024-04-24T02:14:12.545828+0000","last_fullsized":"2024-04-24T02:14:12.545828+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:02:53.179496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.777605+0000","last_change":"2024-04-24T02:12:04.766853+0000","last_active":"2024-04-24T02:14:12.777605+0000","last_peered":"2024-04-24T02:14:12.777605+0000","last_clean":"2024-04-24T02:14:12.777605+0000","last_became_active":"2024-04-24T02:12:04.766540+0000","last_became_peered":"2024-04-24T02:12:04.766540+0000","last_unstale":"2024-04-24T02:14:12.777605+0000","last_undegraded":"2024-04-24T02:14:12.777605+0000","last_fullsized":"2024-04-24T02:14:12.777605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:43:13.413941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"32'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:46.556834+0000","last_change":"2024-04-24T02:12:02.760628+0000","last_active":"2024-04-24T02:12:46.556834+0000","last_peered":"2024-04-24T02:12:46.556834+0000","last_clean":"2024-04-24T02:12:46.556834+0000","last_became_active":"2024-04-24T02:12:02.757717+0000","last_became_peered":"2024-04-24T02:12:02.757717+0000","last_unstale":"2024-04-24T02:12:46.556834+0000","last_undegraded":"2024-04-24T02:12:46.556834+0000","last_fullsized":"2024-04-24T02:12:46.556834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:55:52.496337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.811769+0000","last_change":"2024-04-24T02:12:06.758742+0000","last_active":"2024-04-24T02:12:45.811769+0000","last_peered":"2024-04-24T02:12:45.811769+0000","last_clean":"2024-04-24T02:12:45.811769+0000","last_became_active":"2024-04-24T02:12:06.758452+0000","last_became_peered":"2024-04-24T02:12:06.758452+0000","last_unstale":"2024-04-24T02:12:45.811769+0000","last_undegraded":"2024-04-24T02:12:45.811769+0000","last_fullsized":"2024-04-24T02:12:45.811769+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:54:56.942552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'39","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:25.040028+0000","last_change":"2024-04-24T02:12:08.773650+0000","last_active":"2024-04-24T02:14:25.040028+0000","last_peered":"2024-04-24T02:14:25.040028+0000","last_clean":"2024-04-24T02:14:25.040028+0000","last_became_active":"2024-04-24T02:12:08.773319+0000","last_became_peered":"2024-04-24T02:12:08.773319+0000","last_unstale":"2024-04-24T02:14:25.040028+0000","last_undegraded":"2024-04-24T02:14:25.040028+0000","last_fullsized":"2024-04-24T02:14:25.040028+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:39:13.898594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5807,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":43,"num_read_kb":33,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.807176+0000","last_change":"2024-04-24T02:12:10.787285+0000","last_active":"2024-04-24T02:12:45.807176+0000","last_peered":"2024-04-24T02:12:45.807176+0000","last_clean":"2024-04-24T02:12:45.807176+0000","last_became_active":"2024-04-24T02:12:10.786998+0000","last_became_peered":"2024-04-24T02:12:10.786998+0000","last_unstale":"2024-04-24T02:12:45.807176+0000","last_undegraded":"2024-04-24T02:12:45.807176+0000","last_fullsized":"2024-04-24T02:12:45.807176+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:23:30.529184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'6","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.502555+0000","last_change":"2024-04-24T02:12:12.795209+0000","last_active":"2024-04-24T02:15:13.502555+0000","last_peered":"2024-04-24T02:15:13.502555+0000","last_clean":"2024-04-24T02:15:13.502555+0000","last_became_active":"2024-04-24T02:12:12.793724+0000","last_became_peered":"2024-04-24T02:12:12.793724+0000","last_unstale":"2024-04-24T02:15:13.502555+0000","last_undegraded":"2024-04-24T02:15:13.502555+0000","last_fullsized":"2024-04-24T02:15:13.502555+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:43:28.725420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.766426+0000","last_change":"2024-04-24T02:12:04.764441+0000","last_active":"2024-04-24T02:14:12.766426+0000","last_peered":"2024-04-24T02:14:12.766426+0000","last_clean":"2024-04-24T02:14:12.766426+0000","last_became_active":"2024-04-24T02:12:04.763246+0000","last_became_peered":"2024-04-24T02:12:04.763246+0000","last_unstale":"2024-04-24T02:14:12.766426+0000","last_undegraded":"2024-04-24T02:14:12.766426+0000","last_fullsized":"2024-04-24T02:14:12.766426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:01:31.738903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":199,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.802977+0000","last_change":"2024-04-24T02:11:51.990441+0000","last_active":"2024-04-24T02:12:45.802977+0000","last_peered":"2024-04-24T02:12:45.802977+0000","last_clean":"2024-04-24T02:12:45.802977+0000","last_became_active":"2024-04-24T02:11:51.989479+0000","last_became_peered":"2024-04-24T02:11:51.989479+0000","last_unstale":"2024-04-24T02:12:45.802977+0000","last_undegraded":"2024-04-24T02:12:45.802977+0000","last_fullsized":"2024-04-24T02:12:45.802977+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:50.697037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:50.697037+0000","last_clean_scrub_stamp":"2024-04-24T02:11:50.697037+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:59:33.037844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.810884+0000","last_change":"2024-04-24T02:11:56.724372+0000","last_active":"2024-04-24T02:12:45.810884+0000","last_peered":"2024-04-24T02:12:45.810884+0000","last_clean":"2024-04-24T02:12:45.810884+0000","last_became_active":"2024-04-24T02:11:56.723925+0000","last_became_peered":"2024-04-24T02:11:56.723925+0000","last_unstale":"2024-04-24T02:12:45.810884+0000","last_undegraded":"2024-04-24T02:12:45.810884+0000","last_fullsized":"2024-04-24T02:12:45.810884+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:03:43.918155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.809983+0000","last_change":"2024-04-24T02:12:02.758997+0000","last_active":"2024-04-24T02:12:45.809983+0000","last_peered":"2024-04-24T02:12:45.809983+0000","last_clean":"2024-04-24T02:12:45.809983+0000","last_became_active":"2024-04-24T02:12:02.758653+0000","last_became_peered":"2024-04-24T02:12:02.758653+0000","last_unstale":"2024-04-24T02:12:45.809983+0000","last_undegraded":"2024-04-24T02:12:45.809983+0000","last_fullsized":"2024-04-24T02:12:45.809983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:04:14.072260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"23'1","reported_seq":218,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.412883+0000","last_change":"2024-04-24T02:12:06.757529+0000","last_active":"2024-04-24T02:14:12.412883+0000","last_peered":"2024-04-24T02:14:12.412883+0000","last_clean":"2024-04-24T02:14:12.412883+0000","last_became_active":"2024-04-24T02:12:06.757173+0000","last_became_peered":"2024-04-24T02:12:06.757173+0000","last_unstale":"2024-04-24T02:14:12.412883+0000","last_undegraded":"2024-04-24T02:14:12.412883+0000","last_fullsized":"2024-04-24T02:14:12.412883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:25:48.408637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'82","reported_seq":157,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.357685+0000","last_change":"2024-04-24T02:12:08.781224+0000","last_active":"2024-04-24T02:14:11.357685+0000","last_peered":"2024-04-24T02:14:11.357685+0000","last_clean":"2024-04-24T02:14:11.357685+0000","last_became_active":"2024-04-24T02:12:08.780923+0000","last_became_peered":"2024-04-24T02:12:08.780923+0000","last_unstale":"2024-04-24T02:14:11.357685+0000","last_undegraded":"2024-04-24T02:14:11.357685+0000","last_fullsized":"2024-04-24T02:14:11.357685+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:26:20.925750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.806595+0000","last_change":"2024-04-24T02:12:10.784443+0000","last_active":"2024-04-24T02:12:45.806595+0000","last_peered":"2024-04-24T02:12:45.806595+0000","last_clean":"2024-04-24T02:12:45.806595+0000","last_became_active":"2024-04-24T02:12:10.784101+0000","last_became_peered":"2024-04-24T02:12:10.784101+0000","last_unstale":"2024-04-24T02:12:45.806595+0000","last_undegraded":"2024-04-24T02:12:45.806595+0000","last_fullsized":"2024-04-24T02:12:45.806595+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:41:35.662091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'81","reported_seq":162,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.478759+0000","last_change":"2024-04-24T02:12:12.795520+0000","last_active":"2024-04-24T02:15:13.478759+0000","last_peered":"2024-04-24T02:15:13.478759+0000","last_clean":"2024-04-24T02:15:13.478759+0000","last_became_active":"2024-04-24T02:12:12.795281+0000","last_became_peered":"2024-04-24T02:12:12.795281+0000","last_unstale":"2024-04-24T02:15:13.478759+0000","last_undegraded":"2024-04-24T02:15:13.478759+0000","last_fullsized":"2024-04-24T02:15:13.478759+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:12:13.247301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.349374+0000","last_change":"2024-04-24T02:12:04.764296+0000","last_active":"2024-04-24T02:15:13.349374+0000","last_peered":"2024-04-24T02:15:13.349374+0000","last_clean":"2024-04-24T02:15:13.349374+0000","last_became_active":"2024-04-24T02:12:04.763782+0000","last_became_peered":"2024-04-24T02:12:04.763782+0000","last_unstale":"2024-04-24T02:15:13.349374+0000","last_undegraded":"2024-04-24T02:15:13.349374+0000","last_fullsized":"2024-04-24T02:15:13.349374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:23:24.501187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.808625+0000","last_change":"2024-04-24T02:11:56.724008+0000","last_active":"2024-04-24T02:12:45.808625+0000","last_peered":"2024-04-24T02:12:45.808625+0000","last_clean":"2024-04-24T02:12:45.808625+0000","last_became_active":"2024-04-24T02:11:56.723682+0000","last_became_peered":"2024-04-24T02:11:56.723682+0000","last_unstale":"2024-04-24T02:12:45.808625+0000","last_undegraded":"2024-04-24T02:12:45.808625+0000","last_fullsized":"2024-04-24T02:12:45.808625+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:32:18.958074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"30'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804843+0000","last_change":"2024-04-24T02:12:02.742006+0000","last_active":"2024-04-24T02:12:45.804843+0000","last_peered":"2024-04-24T02:12:45.804843+0000","last_clean":"2024-04-24T02:12:45.804843+0000","last_became_active":"2024-04-24T02:12:02.741610+0000","last_became_peered":"2024-04-24T02:12:02.741610+0000","last_unstale":"2024-04-24T02:12:45.804843+0000","last_undegraded":"2024-04-24T02:12:45.804843+0000","last_fullsized":"2024-04-24T02:12:45.804843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:51:28.003991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.814410+0000","last_change":"2024-04-24T02:12:06.757365+0000","last_active":"2024-04-24T02:12:45.814410+0000","last_peered":"2024-04-24T02:12:45.814410+0000","last_clean":"2024-04-24T02:12:45.814410+0000","last_became_active":"2024-04-24T02:12:06.757052+0000","last_became_peered":"2024-04-24T02:12:06.757052+0000","last_unstale":"2024-04-24T02:12:45.814410+0000","last_undegraded":"2024-04-24T02:12:45.814410+0000","last_fullsized":"2024-04-24T02:12:45.814410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:03:51.154050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'280","reported_seq":489,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:11.839565+0000","last_change":"2024-04-24T02:12:08.780195+0000","last_active":"2024-04-24T02:15:11.839565+0000","last_peered":"2024-04-24T02:15:11.839565+0000","last_clean":"2024-04-24T02:15:11.839565+0000","last_became_active":"2024-04-24T02:12:08.779884+0000","last_became_peered":"2024-04-24T02:12:08.779884+0000","last_unstale":"2024-04-24T02:15:11.839565+0000","last_undegraded":"2024-04-24T02:15:11.839565+0000","last_fullsized":"2024-04-24T02:15:11.839565+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:39:29.226371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":366,"num_read_kb":350,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.811202+0000","last_change":"2024-04-24T02:12:10.784601+0000","last_active":"2024-04-24T02:12:45.811202+0000","last_peered":"2024-04-24T02:12:45.811202+0000","last_clean":"2024-04-24T02:12:45.811202+0000","last_became_active":"2024-04-24T02:12:10.783788+0000","last_became_peered":"2024-04-24T02:12:10.783788+0000","last_unstale":"2024-04-24T02:12:45.811202+0000","last_undegraded":"2024-04-24T02:12:45.811202+0000","last_fullsized":"2024-04-24T02:12:45.811202+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:11:51.847310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:28.951418+0000","last_change":"2024-04-24T02:12:12.796284+0000","last_active":"2024-04-24T02:13:28.951418+0000","last_peered":"2024-04-24T02:13:28.951418+0000","last_clean":"2024-04-24T02:13:28.951418+0000","last_became_active":"2024-04-24T02:12:12.795983+0000","last_became_peered":"2024-04-24T02:12:12.795983+0000","last_unstale":"2024-04-24T02:13:28.951418+0000","last_undegraded":"2024-04-24T02:13:28.951418+0000","last_fullsized":"2024-04-24T02:13:28.951418+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:51:33.324014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'22","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.169911+0000","last_change":"2024-04-24T02:12:04.756013+0000","last_active":"2024-04-24T02:15:13.169911+0000","last_peered":"2024-04-24T02:15:13.169911+0000","last_clean":"2024-04-24T02:15:13.169911+0000","last_became_active":"2024-04-24T02:12:04.755649+0000","last_became_peered":"2024-04-24T02:12:04.755649+0000","last_unstale":"2024-04-24T02:15:13.169911+0000","last_undegraded":"2024-04-24T02:15:13.169911+0000","last_fullsized":"2024-04-24T02:15:13.169911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:57:24.304456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":72,"num_write":29,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805377+0000","last_change":"2024-04-24T02:11:56.724010+0000","last_active":"2024-04-24T02:12:45.805377+0000","last_peered":"2024-04-24T02:12:45.805377+0000","last_clean":"2024-04-24T02:12:45.805377+0000","last_became_active":"2024-04-24T02:11:56.723497+0000","last_became_peered":"2024-04-24T02:11:56.723497+0000","last_unstale":"2024-04-24T02:12:45.805377+0000","last_undegraded":"2024-04-24T02:12:45.805377+0000","last_fullsized":"2024-04-24T02:12:45.805377+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:26:11.265014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'1","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:03.032259+0000","last_change":"2024-04-24T02:12:02.745574+0000","last_active":"2024-04-24T02:14:03.032259+0000","last_peered":"2024-04-24T02:14:03.032259+0000","last_clean":"2024-04-24T02:14:03.032259+0000","last_became_active":"2024-04-24T02:12:02.745238+0000","last_became_peered":"2024-04-24T02:12:02.745238+0000","last_unstale":"2024-04-24T02:14:03.032259+0000","last_undegraded":"2024-04-24T02:14:03.032259+0000","last_fullsized":"2024-04-24T02:14:03.032259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:18:53.552200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.813613+0000","last_change":"2024-04-24T02:12:06.757374+0000","last_active":"2024-04-24T02:12:45.813613+0000","last_peered":"2024-04-24T02:12:45.813613+0000","last_clean":"2024-04-24T02:12:45.813613+0000","last_became_active":"2024-04-24T02:12:06.757009+0000","last_became_peered":"2024-04-24T02:12:06.757009+0000","last_unstale":"2024-04-24T02:12:45.813613+0000","last_undegraded":"2024-04-24T02:12:45.813613+0000","last_fullsized":"2024-04-24T02:12:45.813613+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:26:34.319373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'16","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:11.839804+0000","last_change":"2024-04-24T02:12:08.774513+0000","last_active":"2024-04-24T02:15:11.839804+0000","last_peered":"2024-04-24T02:15:11.839804+0000","last_clean":"2024-04-24T02:15:11.839804+0000","last_became_active":"2024-04-24T02:12:08.774177+0000","last_became_peered":"2024-04-24T02:12:08.774177+0000","last_unstale":"2024-04-24T02:15:11.839804+0000","last_undegraded":"2024-04-24T02:15:11.839804+0000","last_fullsized":"2024-04-24T02:15:11.839804+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:27:58.828052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805416+0000","last_change":"2024-04-24T02:12:10.784579+0000","last_active":"2024-04-24T02:12:45.805416+0000","last_peered":"2024-04-24T02:12:45.805416+0000","last_clean":"2024-04-24T02:12:45.805416+0000","last_became_active":"2024-04-24T02:12:10.784247+0000","last_became_peered":"2024-04-24T02:12:10.784247+0000","last_unstale":"2024-04-24T02:12:45.805416+0000","last_undegraded":"2024-04-24T02:12:45.805416+0000","last_fullsized":"2024-04-24T02:12:45.805416+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:05:36.775186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.772420+0000","last_change":"2024-04-24T02:12:12.794755+0000","last_active":"2024-04-24T02:14:12.772420+0000","last_peered":"2024-04-24T02:14:12.772420+0000","last_clean":"2024-04-24T02:14:12.772420+0000","last_became_active":"2024-04-24T02:12:12.794453+0000","last_became_peered":"2024-04-24T02:12:12.794453+0000","last_unstale":"2024-04-24T02:14:12.772420+0000","last_undegraded":"2024-04-24T02:14:12.772420+0000","last_fullsized":"2024-04-24T02:14:12.772420+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:14:32.909095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'3","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:13.033851+0000","last_change":"2024-04-24T02:12:04.749524+0000","last_active":"2024-04-24T02:14:13.033851+0000","last_peered":"2024-04-24T02:14:13.033851+0000","last_clean":"2024-04-24T02:14:13.033851+0000","last_became_active":"2024-04-24T02:12:04.749173+0000","last_became_peered":"2024-04-24T02:12:04.749173+0000","last_unstale":"2024-04-24T02:14:13.033851+0000","last_undegraded":"2024-04-24T02:14:13.033851+0000","last_fullsized":"2024-04-24T02:14:13.033851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:58:09.943964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.809808+0000","last_change":"2024-04-24T02:11:56.723425+0000","last_active":"2024-04-24T02:12:45.809808+0000","last_peered":"2024-04-24T02:12:45.809808+0000","last_clean":"2024-04-24T02:12:45.809808+0000","last_became_active":"2024-04-24T02:11:56.723125+0000","last_became_peered":"2024-04-24T02:11:56.723125+0000","last_unstale":"2024-04-24T02:12:45.809808+0000","last_undegraded":"2024-04-24T02:12:45.809808+0000","last_fullsized":"2024-04-24T02:12:45.809808+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:48:12.516334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.808101+0000","last_change":"2024-04-24T02:12:02.746939+0000","last_active":"2024-04-24T02:12:45.808101+0000","last_peered":"2024-04-24T02:12:45.808101+0000","last_clean":"2024-04-24T02:12:45.808101+0000","last_became_active":"2024-04-24T02:12:02.746682+0000","last_became_peered":"2024-04-24T02:12:02.746682+0000","last_unstale":"2024-04-24T02:12:45.808101+0000","last_undegraded":"2024-04-24T02:12:45.808101+0000","last_fullsized":"2024-04-24T02:12:45.808101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:51:48.494870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.806518+0000","last_change":"2024-04-24T02:12:06.759484+0000","last_active":"2024-04-24T02:12:45.806518+0000","last_peered":"2024-04-24T02:12:45.806518+0000","last_clean":"2024-04-24T02:12:45.806518+0000","last_became_active":"2024-04-24T02:12:06.759169+0000","last_became_peered":"2024-04-24T02:12:06.759169+0000","last_unstale":"2024-04-24T02:12:45.806518+0000","last_undegraded":"2024-04-24T02:12:45.806518+0000","last_fullsized":"2024-04-24T02:12:45.806518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:44:21.656525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'13","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:12.792900+0000","last_change":"2024-04-24T02:12:08.783178+0000","last_active":"2024-04-24T02:15:12.792900+0000","last_peered":"2024-04-24T02:15:12.792900+0000","last_clean":"2024-04-24T02:15:12.792900+0000","last_became_active":"2024-04-24T02:12:08.782765+0000","last_became_peered":"2024-04-24T02:12:08.782765+0000","last_unstale":"2024-04-24T02:15:12.792900+0000","last_undegraded":"2024-04-24T02:15:12.792900+0000","last_fullsized":"2024-04-24T02:15:12.792900+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:43:33.627490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.813589+0000","last_change":"2024-04-24T02:12:10.785313+0000","last_active":"2024-04-24T02:12:45.813589+0000","last_peered":"2024-04-24T02:12:45.813589+0000","last_clean":"2024-04-24T02:12:45.813589+0000","last_became_active":"2024-04-24T02:12:10.783813+0000","last_became_peered":"2024-04-24T02:12:10.783813+0000","last_unstale":"2024-04-24T02:12:45.813589+0000","last_undegraded":"2024-04-24T02:12:45.813589+0000","last_fullsized":"2024-04-24T02:12:45.813589+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:29:00.483135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.525281+0000","last_change":"2024-04-24T02:12:12.797895+0000","last_active":"2024-04-24T02:14:12.525281+0000","last_peered":"2024-04-24T02:14:12.525281+0000","last_clean":"2024-04-24T02:14:12.525281+0000","last_became_active":"2024-04-24T02:12:12.796507+0000","last_became_peered":"2024-04-24T02:12:12.796507+0000","last_unstale":"2024-04-24T02:14:12.525281+0000","last_undegraded":"2024-04-24T02:14:12.525281+0000","last_fullsized":"2024-04-24T02:14:12.525281+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:24:58.744108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:28.945114+0000","last_change":"2024-04-24T02:12:04.767815+0000","last_active":"2024-04-24T02:13:28.945114+0000","last_peered":"2024-04-24T02:13:28.945114+0000","last_clean":"2024-04-24T02:13:28.945114+0000","last_became_active":"2024-04-24T02:12:04.767221+0000","last_became_peered":"2024-04-24T02:12:04.767221+0000","last_unstale":"2024-04-24T02:13:28.945114+0000","last_undegraded":"2024-04-24T02:13:28.945114+0000","last_fullsized":"2024-04-24T02:13:28.945114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:20:27.874953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.808341+0000","last_change":"2024-04-24T02:12:02.747860+0000","last_active":"2024-04-24T02:12:45.808341+0000","last_peered":"2024-04-24T02:12:45.808341+0000","last_clean":"2024-04-24T02:12:45.808341+0000","last_became_active":"2024-04-24T02:12:02.744161+0000","last_became_peered":"2024-04-24T02:12:02.744161+0000","last_unstale":"2024-04-24T02:12:45.808341+0000","last_undegraded":"2024-04-24T02:12:45.808341+0000","last_fullsized":"2024-04-24T02:12:45.808341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:30:58.417438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805335+0000","last_change":"2024-04-24T02:11:56.723976+0000","last_active":"2024-04-24T02:12:45.805335+0000","last_peered":"2024-04-24T02:12:45.805335+0000","last_clean":"2024-04-24T02:12:45.805335+0000","last_became_active":"2024-04-24T02:11:56.723697+0000","last_became_peered":"2024-04-24T02:11:56.723697+0000","last_unstale":"2024-04-24T02:12:45.805335+0000","last_undegraded":"2024-04-24T02:12:45.805335+0000","last_fullsized":"2024-04-24T02:12:45.805335+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:00:04.661481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'1","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:13.033798+0000","last_change":"2024-04-24T02:12:06.759464+0000","last_active":"2024-04-24T02:14:13.033798+0000","last_peered":"2024-04-24T02:14:13.033798+0000","last_clean":"2024-04-24T02:14:13.033798+0000","last_became_active":"2024-04-24T02:12:06.759160+0000","last_became_peered":"2024-04-24T02:12:06.759160+0000","last_unstale":"2024-04-24T02:14:13.033798+0000","last_undegraded":"2024-04-24T02:14:13.033798+0000","last_fullsized":"2024-04-24T02:14:13.033798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:02:59.130069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'73","reported_seq":144,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.359157+0000","last_change":"2024-04-24T02:12:08.780903+0000","last_active":"2024-04-24T02:14:11.359157+0000","last_peered":"2024-04-24T02:14:11.359157+0000","last_clean":"2024-04-24T02:14:11.359157+0000","last_became_active":"2024-04-24T02:12:08.780688+0000","last_became_peered":"2024-04-24T02:12:08.780688+0000","last_unstale":"2024-04-24T02:14:11.359157+0000","last_undegraded":"2024-04-24T02:14:11.359157+0000","last_fullsized":"2024-04-24T02:14:11.359157+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:25:49.361496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":77,"num_read_kb":63,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.806759+0000","last_change":"2024-04-24T02:12:10.781922+0000","last_active":"2024-04-24T02:12:45.806759+0000","last_peered":"2024-04-24T02:12:45.806759+0000","last_clean":"2024-04-24T02:12:45.806759+0000","last_became_active":"2024-04-24T02:12:10.781586+0000","last_became_peered":"2024-04-24T02:12:10.781586+0000","last_unstale":"2024-04-24T02:12:45.806759+0000","last_undegraded":"2024-04-24T02:12:45.806759+0000","last_fullsized":"2024-04-24T02:12:45.806759+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:24:04.726684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'9","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.708334+0000","last_change":"2024-04-24T02:12:12.798530+0000","last_active":"2024-04-24T02:14:12.708334+0000","last_peered":"2024-04-24T02:14:12.708334+0000","last_clean":"2024-04-24T02:14:12.708334+0000","last_became_active":"2024-04-24T02:12:12.798272+0000","last_became_peered":"2024-04-24T02:12:12.798272+0000","last_unstale":"2024-04-24T02:14:12.708334+0000","last_undegraded":"2024-04-24T02:14:12.708334+0000","last_fullsized":"2024-04-24T02:14:12.708334+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:58:10.660903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'6","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.766875+0000","last_change":"2024-04-24T02:12:04.765396+0000","last_active":"2024-04-24T02:14:12.766875+0000","last_peered":"2024-04-24T02:14:12.766875+0000","last_clean":"2024-04-24T02:14:12.766875+0000","last_became_active":"2024-04-24T02:12:04.765093+0000","last_became_peered":"2024-04-24T02:12:04.765093+0000","last_unstale":"2024-04-24T02:14:12.766875+0000","last_undegraded":"2024-04-24T02:14:12.766875+0000","last_fullsized":"2024-04-24T02:14:12.766875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:25:06.512394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805538+0000","last_change":"2024-04-24T02:12:02.741909+0000","last_active":"2024-04-24T02:12:45.805538+0000","last_peered":"2024-04-24T02:12:45.805538+0000","last_clean":"2024-04-24T02:12:45.805538+0000","last_became_active":"2024-04-24T02:12:02.741565+0000","last_became_peered":"2024-04-24T02:12:02.741565+0000","last_unstale":"2024-04-24T02:12:45.805538+0000","last_undegraded":"2024-04-24T02:12:45.805538+0000","last_fullsized":"2024-04-24T02:12:45.805538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:11:16.086557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.811832+0000","last_change":"2024-04-24T02:11:56.724046+0000","last_active":"2024-04-24T02:12:45.811832+0000","last_peered":"2024-04-24T02:12:45.811832+0000","last_clean":"2024-04-24T02:12:45.811832+0000","last_became_active":"2024-04-24T02:11:56.723673+0000","last_became_peered":"2024-04-24T02:11:56.723673+0000","last_unstale":"2024-04-24T02:12:45.811832+0000","last_undegraded":"2024-04-24T02:12:45.811832+0000","last_fullsized":"2024-04-24T02:12:45.811832+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:24:47.683078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.810339+0000","last_change":"2024-04-24T02:12:06.756068+0000","last_active":"2024-04-24T02:12:45.810339+0000","last_peered":"2024-04-24T02:12:45.810339+0000","last_clean":"2024-04-24T02:12:45.810339+0000","last_became_active":"2024-04-24T02:12:06.755760+0000","last_became_peered":"2024-04-24T02:12:06.755760+0000","last_unstale":"2024-04-24T02:12:45.810339+0000","last_undegraded":"2024-04-24T02:12:45.810339+0000","last_fullsized":"2024-04-24T02:12:45.810339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:53:36.479217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"30'20","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804087+0000","last_change":"2024-04-24T02:12:08.780018+0000","last_active":"2024-04-24T02:12:45.804087+0000","last_peered":"2024-04-24T02:12:45.804087+0000","last_clean":"2024-04-24T02:12:45.804087+0000","last_became_active":"2024-04-24T02:12:08.779698+0000","last_became_peered":"2024-04-24T02:12:08.779698+0000","last_unstale":"2024-04-24T02:12:45.804087+0000","last_undegraded":"2024-04-24T02:12:45.804087+0000","last_fullsized":"2024-04-24T02:12:45.804087+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:24:02.718714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'282","reported_seq":346,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:11.839480+0000","last_change":"2024-04-24T02:12:10.782077+0000","last_active":"2024-04-24T02:15:11.839480+0000","last_peered":"2024-04-24T02:15:11.839480+0000","last_clean":"2024-04-24T02:15:11.839480+0000","last_became_active":"2024-04-24T02:12:10.781799+0000","last_became_peered":"2024-04-24T02:12:10.781799+0000","last_unstale":"2024-04-24T02:15:11.839480+0000","last_undegraded":"2024-04-24T02:15:11.839480+0000","last_fullsized":"2024-04-24T02:15:11.839480+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:22:36.118429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'2","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:46.562672+0000","last_change":"2024-04-24T02:12:12.794164+0000","last_active":"2024-04-24T02:12:46.562672+0000","last_peered":"2024-04-24T02:12:46.562672+0000","last_clean":"2024-04-24T02:12:46.562672+0000","last_became_active":"2024-04-24T02:12:12.792628+0000","last_became_peered":"2024-04-24T02:12:12.792628+0000","last_unstale":"2024-04-24T02:12:46.562672+0000","last_undegraded":"2024-04-24T02:12:46.562672+0000","last_fullsized":"2024-04-24T02:12:46.562672+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:28:32.181565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'19","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.400430+0000","last_change":"2024-04-24T02:12:04.768557+0000","last_active":"2024-04-24T02:15:13.400430+0000","last_peered":"2024-04-24T02:15:13.400430+0000","last_clean":"2024-04-24T02:15:13.400430+0000","last_became_active":"2024-04-24T02:12:04.768066+0000","last_became_peered":"2024-04-24T02:12:04.768066+0000","last_unstale":"2024-04-24T02:15:13.400430+0000","last_undegraded":"2024-04-24T02:15:13.400430+0000","last_fullsized":"2024-04-24T02:15:13.400430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:37:58.075143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":70,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.813780+0000","last_change":"2024-04-24T02:12:02.761644+0000","last_active":"2024-04-24T02:12:45.813780+0000","last_peered":"2024-04-24T02:12:45.813780+0000","last_clean":"2024-04-24T02:12:45.813780+0000","last_became_active":"2024-04-24T02:12:02.760824+0000","last_became_peered":"2024-04-24T02:12:02.760824+0000","last_unstale":"2024-04-24T02:12:45.813780+0000","last_undegraded":"2024-04-24T02:12:45.813780+0000","last_fullsized":"2024-04-24T02:12:45.813780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:24:13.399996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.806050+0000","last_change":"2024-04-24T02:11:56.723499+0000","last_active":"2024-04-24T02:12:45.806050+0000","last_peered":"2024-04-24T02:12:45.806050+0000","last_clean":"2024-04-24T02:12:45.806050+0000","last_became_active":"2024-04-24T02:11:56.723277+0000","last_became_peered":"2024-04-24T02:11:56.723277+0000","last_unstale":"2024-04-24T02:12:45.806050+0000","last_undegraded":"2024-04-24T02:12:45.806050+0000","last_fullsized":"2024-04-24T02:12:45.806050+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:04:46.209999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.812139+0000","last_change":"2024-04-24T02:12:06.754713+0000","last_active":"2024-04-24T02:12:45.812139+0000","last_peered":"2024-04-24T02:12:45.812139+0000","last_clean":"2024-04-24T02:12:45.812139+0000","last_became_active":"2024-04-24T02:12:06.754414+0000","last_became_peered":"2024-04-24T02:12:06.754414+0000","last_unstale":"2024-04-24T02:12:45.812139+0000","last_undegraded":"2024-04-24T02:12:45.812139+0000","last_fullsized":"2024-04-24T02:12:45.812139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:38:23.173188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"30'17","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.810952+0000","last_change":"2024-04-24T02:12:08.780239+0000","last_active":"2024-04-24T02:12:45.810952+0000","last_peered":"2024-04-24T02:12:45.810952+0000","last_clean":"2024-04-24T02:12:45.810952+0000","last_became_active":"2024-04-24T02:12:08.779937+0000","last_became_peered":"2024-04-24T02:12:08.779937+0000","last_unstale":"2024-04-24T02:12:45.810952+0000","last_undegraded":"2024-04-24T02:12:45.810952+0000","last_fullsized":"2024-04-24T02:12:45.810952+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:33:58.011327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'282","reported_seq":389,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.567071+0000","last_change":"2024-04-24T02:12:10.776879+0000","last_active":"2024-04-24T02:15:13.567071+0000","last_peered":"2024-04-24T02:15:13.567071+0000","last_clean":"2024-04-24T02:15:13.567071+0000","last_became_active":"2024-04-24T02:12:10.776594+0000","last_became_peered":"2024-04-24T02:12:10.776594+0000","last_unstale":"2024-04-24T02:15:13.567071+0000","last_undegraded":"2024-04-24T02:15:13.567071+0000","last_fullsized":"2024-04-24T02:15:13.567071+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:11:56.635776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.803952+0000","last_change":"2024-04-24T02:12:12.795629+0000","last_active":"2024-04-24T02:12:45.803952+0000","last_peered":"2024-04-24T02:12:45.803952+0000","last_clean":"2024-04-24T02:12:45.803952+0000","last_became_active":"2024-04-24T02:12:12.795328+0000","last_became_peered":"2024-04-24T02:12:12.795328+0000","last_unstale":"2024-04-24T02:12:45.803952+0000","last_undegraded":"2024-04-24T02:12:45.803952+0000","last_fullsized":"2024-04-24T02:12:45.803952+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:55:23.691414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'3","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.264812+0000","last_change":"2024-04-24T02:12:04.760388+0000","last_active":"2024-04-24T02:15:13.264812+0000","last_peered":"2024-04-24T02:15:13.264812+0000","last_clean":"2024-04-24T02:15:13.264812+0000","last_became_active":"2024-04-24T02:12:04.760099+0000","last_became_peered":"2024-04-24T02:12:04.760099+0000","last_unstale":"2024-04-24T02:15:13.264812+0000","last_undegraded":"2024-04-24T02:15:13.264812+0000","last_fullsized":"2024-04-24T02:15:13.264812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:00:23.946903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'3","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:15.038544+0000","last_change":"2024-04-24T02:12:02.744971+0000","last_active":"2024-04-24T02:14:15.038544+0000","last_peered":"2024-04-24T02:14:15.038544+0000","last_clean":"2024-04-24T02:14:15.038544+0000","last_became_active":"2024-04-24T02:12:02.744454+0000","last_became_peered":"2024-04-24T02:12:02.744454+0000","last_unstale":"2024-04-24T02:14:15.038544+0000","last_undegraded":"2024-04-24T02:14:15.038544+0000","last_fullsized":"2024-04-24T02:14:15.038544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:59:32.006851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.813632+0000","last_change":"2024-04-24T02:11:57.000530+0000","last_active":"2024-04-24T02:12:45.813632+0000","last_peered":"2024-04-24T02:12:45.813632+0000","last_clean":"2024-04-24T02:12:45.813632+0000","last_became_active":"2024-04-24T02:11:57.000197+0000","last_became_peered":"2024-04-24T02:11:57.000197+0000","last_unstale":"2024-04-24T02:12:45.813632+0000","last_undegraded":"2024-04-24T02:12:45.813632+0000","last_fullsized":"2024-04-24T02:12:45.813632+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:42:43.216261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.810434+0000","last_change":"2024-04-24T02:12:06.754527+0000","last_active":"2024-04-24T02:12:45.810434+0000","last_peered":"2024-04-24T02:12:45.810434+0000","last_clean":"2024-04-24T02:12:45.810434+0000","last_became_active":"2024-04-24T02:12:06.754107+0000","last_became_peered":"2024-04-24T02:12:06.754107+0000","last_unstale":"2024-04-24T02:12:45.810434+0000","last_undegraded":"2024-04-24T02:12:45.810434+0000","last_fullsized":"2024-04-24T02:12:45.810434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:43:41.699448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'90","reported_seq":168,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.344060+0000","last_change":"2024-04-24T02:12:08.781379+0000","last_active":"2024-04-24T02:14:11.344060+0000","last_peered":"2024-04-24T02:14:11.344060+0000","last_clean":"2024-04-24T02:14:11.344060+0000","last_became_active":"2024-04-24T02:12:08.780925+0000","last_became_peered":"2024-04-24T02:12:08.780925+0000","last_unstale":"2024-04-24T02:14:11.344060+0000","last_undegraded":"2024-04-24T02:14:11.344060+0000","last_fullsized":"2024-04-24T02:14:11.344060+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:24:18.129044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":90,"num_read_kb":90,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804630+0000","last_change":"2024-04-24T02:12:10.775385+0000","last_active":"2024-04-24T02:12:45.804630+0000","last_peered":"2024-04-24T02:12:45.804630+0000","last_clean":"2024-04-24T02:12:45.804630+0000","last_became_active":"2024-04-24T02:12:10.775165+0000","last_became_peered":"2024-04-24T02:12:10.775165+0000","last_unstale":"2024-04-24T02:12:45.804630+0000","last_undegraded":"2024-04-24T02:12:45.804630+0000","last_fullsized":"2024-04-24T02:12:45.804630+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:26:58.984436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.806618+0000","last_change":"2024-04-24T02:12:12.796696+0000","last_active":"2024-04-24T02:12:45.806618+0000","last_peered":"2024-04-24T02:12:45.806618+0000","last_clean":"2024-04-24T02:12:45.806618+0000","last_became_active":"2024-04-24T02:12:12.796411+0000","last_became_peered":"2024-04-24T02:12:12.796411+0000","last_unstale":"2024-04-24T02:12:45.806618+0000","last_undegraded":"2024-04-24T02:12:45.806618+0000","last_fullsized":"2024-04-24T02:12:45.806618+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:22:38.124687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.808519+0000","last_change":"2024-04-24T02:12:12.801700+0000","last_active":"2024-04-24T02:12:45.808519+0000","last_peered":"2024-04-24T02:12:45.808519+0000","last_clean":"2024-04-24T02:12:45.808519+0000","last_became_active":"2024-04-24T02:12:12.801346+0000","last_became_peered":"2024-04-24T02:12:12.801346+0000","last_unstale":"2024-04-24T02:12:45.808519+0000","last_undegraded":"2024-04-24T02:12:45.808519+0000","last_fullsized":"2024-04-24T02:12:45.808519+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:53:42.506048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:47.053226+0000","last_change":"2024-04-24T02:12:04.764138+0000","last_active":"2024-04-24T02:12:47.053226+0000","last_peered":"2024-04-24T02:12:47.053226+0000","last_clean":"2024-04-24T02:12:47.053226+0000","last_became_active":"2024-04-24T02:12:04.763860+0000","last_became_peered":"2024-04-24T02:12:04.763860+0000","last_unstale":"2024-04-24T02:12:47.053226+0000","last_undegraded":"2024-04-24T02:12:47.053226+0000","last_fullsized":"2024-04-24T02:12:47.053226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:40:49.148779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"32'1","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:25.040623+0000","last_change":"2024-04-24T02:12:02.757073+0000","last_active":"2024-04-24T02:14:25.040623+0000","last_peered":"2024-04-24T02:14:25.040623+0000","last_clean":"2024-04-24T02:14:25.040623+0000","last_became_active":"2024-04-24T02:12:02.753166+0000","last_became_peered":"2024-04-24T02:12:02.753166+0000","last_unstale":"2024-04-24T02:14:25.040623+0000","last_undegraded":"2024-04-24T02:14:25.040623+0000","last_fullsized":"2024-04-24T02:14:25.040623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:00.841064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.803876+0000","last_change":"2024-04-24T02:12:06.758976+0000","last_active":"2024-04-24T02:12:45.803876+0000","last_peered":"2024-04-24T02:12:45.803876+0000","last_clean":"2024-04-24T02:12:45.803876+0000","last_became_active":"2024-04-24T02:12:06.758468+0000","last_became_peered":"2024-04-24T02:12:06.758468+0000","last_unstale":"2024-04-24T02:12:45.803876+0000","last_undegraded":"2024-04-24T02:12:45.803876+0000","last_fullsized":"2024-04-24T02:12:45.803876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:47:41.924628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'38","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.350258+0000","last_change":"2024-04-24T02:12:08.782070+0000","last_active":"2024-04-24T02:14:11.350258+0000","last_peered":"2024-04-24T02:14:11.350258+0000","last_clean":"2024-04-24T02:14:11.350258+0000","last_became_active":"2024-04-24T02:12:08.780353+0000","last_became_peered":"2024-04-24T02:12:08.780353+0000","last_unstale":"2024-04-24T02:14:11.350258+0000","last_undegraded":"2024-04-24T02:14:11.350258+0000","last_fullsized":"2024-04-24T02:14:11.350258+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:00:39.858738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.810326+0000","last_change":"2024-04-24T02:12:10.787091+0000","last_active":"2024-04-24T02:12:45.810326+0000","last_peered":"2024-04-24T02:12:45.810326+0000","last_clean":"2024-04-24T02:12:45.810326+0000","last_became_active":"2024-04-24T02:12:10.786813+0000","last_became_peered":"2024-04-24T02:12:10.786813+0000","last_unstale":"2024-04-24T02:12:45.810326+0000","last_undegraded":"2024-04-24T02:12:45.810326+0000","last_fullsized":"2024-04-24T02:12:45.810326+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:25:58.461531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'9","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:12.872914+0000","last_change":"2024-04-24T02:12:12.796438+0000","last_active":"2024-04-24T02:15:12.872914+0000","last_peered":"2024-04-24T02:15:12.872914+0000","last_clean":"2024-04-24T02:15:12.872914+0000","last_became_active":"2024-04-24T02:12:12.796149+0000","last_became_peered":"2024-04-24T02:12:12.796149+0000","last_unstale":"2024-04-24T02:15:12.872914+0000","last_undegraded":"2024-04-24T02:15:12.872914+0000","last_fullsized":"2024-04-24T02:15:12.872914+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:33:07.219054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.170970+0000","last_change":"2024-04-24T02:12:45.816393+0000","last_active":"2024-04-24T02:15:13.170970+0000","last_peered":"2024-04-24T02:15:13.170970+0000","last_clean":"2024-04-24T02:15:13.170970+0000","last_became_active":"2024-04-24T02:12:45.816009+0000","last_became_peered":"2024-04-24T02:12:45.816009+0000","last_unstale":"2024-04-24T02:15:13.170970+0000","last_undegraded":"2024-04-24T02:15:13.170970+0000","last_fullsized":"2024-04-24T02:15:13.170970+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:00:38.405027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"32'6","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.342215+0000","last_change":"2024-04-24T02:12:02.755246+0000","last_active":"2024-04-24T02:15:13.342215+0000","last_peered":"2024-04-24T02:15:13.342215+0000","last_clean":"2024-04-24T02:15:13.342215+0000","last_became_active":"2024-04-24T02:12:02.754623+0000","last_became_peered":"2024-04-24T02:12:02.754623+0000","last_unstale":"2024-04-24T02:15:13.342215+0000","last_undegraded":"2024-04-24T02:15:13.342215+0000","last_fullsized":"2024-04-24T02:15:13.342215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:42.734407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.811478+0000","last_change":"2024-04-24T02:12:06.757753+0000","last_active":"2024-04-24T02:12:45.811478+0000","last_peered":"2024-04-24T02:12:45.811478+0000","last_clean":"2024-04-24T02:12:45.811478+0000","last_became_active":"2024-04-24T02:12:06.756998+0000","last_became_peered":"2024-04-24T02:12:06.756998+0000","last_unstale":"2024-04-24T02:12:45.811478+0000","last_undegraded":"2024-04-24T02:12:45.811478+0000","last_fullsized":"2024-04-24T02:12:45.811478+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:13:32.253391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'6","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:12.797382+0000","last_change":"2024-04-24T02:12:08.769916+0000","last_active":"2024-04-24T02:15:12.797382+0000","last_peered":"2024-04-24T02:15:12.797382+0000","last_clean":"2024-04-24T02:15:12.797382+0000","last_became_active":"2024-04-24T02:12:08.769610+0000","last_became_peered":"2024-04-24T02:12:08.769610+0000","last_unstale":"2024-04-24T02:15:12.797382+0000","last_undegraded":"2024-04-24T02:15:12.797382+0000","last_fullsized":"2024-04-24T02:15:12.797382+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:53:07.348788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805538+0000","last_change":"2024-04-24T02:12:10.785261+0000","last_active":"2024-04-24T02:12:45.805538+0000","last_peered":"2024-04-24T02:12:45.805538+0000","last_clean":"2024-04-24T02:12:45.805538+0000","last_became_active":"2024-04-24T02:12:10.784955+0000","last_became_peered":"2024-04-24T02:12:10.784955+0000","last_unstale":"2024-04-24T02:12:45.805538+0000","last_undegraded":"2024-04-24T02:12:45.805538+0000","last_fullsized":"2024-04-24T02:12:45.805538+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:52:08.817241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'10","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:47.056982+0000","last_change":"2024-04-24T02:12:12.792872+0000","last_active":"2024-04-24T02:12:47.056982+0000","last_peered":"2024-04-24T02:12:47.056982+0000","last_clean":"2024-04-24T02:12:47.056982+0000","last_became_active":"2024-04-24T02:12:12.792565+0000","last_became_peered":"2024-04-24T02:12:12.792565+0000","last_unstale":"2024-04-24T02:12:47.056982+0000","last_undegraded":"2024-04-24T02:12:47.056982+0000","last_fullsized":"2024-04-24T02:12:47.056982+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:01:51.258319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":60,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'3","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:28.035923+0000","last_change":"2024-04-24T02:12:04.767155+0000","last_active":"2024-04-24T02:14:28.035923+0000","last_peered":"2024-04-24T02:14:28.035923+0000","last_clean":"2024-04-24T02:14:28.035923+0000","last_became_active":"2024-04-24T02:12:04.766700+0000","last_became_peered":"2024-04-24T02:12:04.766700+0000","last_unstale":"2024-04-24T02:14:28.035923+0000","last_undegraded":"2024-04-24T02:14:28.035923+0000","last_fullsized":"2024-04-24T02:14:28.035923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:56:30.404631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.818398+0000","last_change":"2024-04-24T02:12:45.817612+0000","last_active":"2024-04-24T02:12:45.818398+0000","last_peered":"2024-04-24T02:12:45.818398+0000","last_clean":"2024-04-24T02:12:45.818398+0000","last_became_active":"2024-04-24T02:12:45.817240+0000","last_became_peered":"2024-04-24T02:12:45.817240+0000","last_unstale":"2024-04-24T02:12:45.818398+0000","last_undegraded":"2024-04-24T02:12:45.818398+0000","last_fullsized":"2024-04-24T02:12:45.818398+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:23:14.696386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804920+0000","last_change":"2024-04-24T02:12:06.766890+0000","last_active":"2024-04-24T02:12:45.804920+0000","last_peered":"2024-04-24T02:12:45.804920+0000","last_clean":"2024-04-24T02:12:45.804920+0000","last_became_active":"2024-04-24T02:12:06.764776+0000","last_became_peered":"2024-04-24T02:12:06.764776+0000","last_unstale":"2024-04-24T02:12:45.804920+0000","last_undegraded":"2024-04-24T02:12:45.804920+0000","last_fullsized":"2024-04-24T02:12:45.804920+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:57:48.700227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'40","reported_seq":99,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:12.853711+0000","last_change":"2024-04-24T02:12:08.768761+0000","last_active":"2024-04-24T02:15:12.853711+0000","last_peered":"2024-04-24T02:15:12.853711+0000","last_clean":"2024-04-24T02:15:12.853711+0000","last_became_active":"2024-04-24T02:12:08.768499+0000","last_became_peered":"2024-04-24T02:12:08.768499+0000","last_unstale":"2024-04-24T02:15:12.853711+0000","last_undegraded":"2024-04-24T02:15:12.853711+0000","last_fullsized":"2024-04-24T02:15:12.853711+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:50:29.784473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.803282+0000","last_change":"2024-04-24T02:12:10.777246+0000","last_active":"2024-04-24T02:12:45.803282+0000","last_peered":"2024-04-24T02:12:45.803282+0000","last_clean":"2024-04-24T02:12:45.803282+0000","last_became_active":"2024-04-24T02:12:10.776882+0000","last_became_peered":"2024-04-24T02:12:10.776882+0000","last_unstale":"2024-04-24T02:12:45.803282+0000","last_undegraded":"2024-04-24T02:12:45.803282+0000","last_fullsized":"2024-04-24T02:12:45.803282+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:53:40.499789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.377763+0000","last_change":"2024-04-24T02:12:12.794192+0000","last_active":"2024-04-24T02:15:13.377763+0000","last_peered":"2024-04-24T02:15:13.377763+0000","last_clean":"2024-04-24T02:15:13.377763+0000","last_became_active":"2024-04-24T02:12:12.793884+0000","last_became_peered":"2024-04-24T02:12:12.793884+0000","last_unstale":"2024-04-24T02:15:13.377763+0000","last_undegraded":"2024-04-24T02:15:13.377763+0000","last_fullsized":"2024-04-24T02:15:13.377763+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:38:38.919788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.256832+0000","last_change":"2024-04-24T02:12:04.768207+0000","last_active":"2024-04-24T02:15:13.256832+0000","last_peered":"2024-04-24T02:15:13.256832+0000","last_clean":"2024-04-24T02:15:13.256832+0000","last_became_active":"2024-04-24T02:12:04.767431+0000","last_became_peered":"2024-04-24T02:12:04.767431+0000","last_unstale":"2024-04-24T02:15:13.256832+0000","last_undegraded":"2024-04-24T02:15:13.256832+0000","last_fullsized":"2024-04-24T02:15:13.256832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:28:10.521399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:09.629738+0000","last_change":"2024-04-24T02:12:02.754566+0000","last_active":"2024-04-24T02:14:09.629738+0000","last_peered":"2024-04-24T02:14:09.629738+0000","last_clean":"2024-04-24T02:14:09.629738+0000","last_became_active":"2024-04-24T02:12:02.754295+0000","last_became_peered":"2024-04-24T02:12:02.754295+0000","last_unstale":"2024-04-24T02:14:09.629738+0000","last_undegraded":"2024-04-24T02:14:09.629738+0000","last_fullsized":"2024-04-24T02:14:09.629738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:23:23.715876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.812262+0000","last_change":"2024-04-24T02:12:06.758891+0000","last_active":"2024-04-24T02:12:45.812262+0000","last_peered":"2024-04-24T02:12:45.812262+0000","last_clean":"2024-04-24T02:12:45.812262+0000","last_became_active":"2024-04-24T02:12:06.758462+0000","last_became_peered":"2024-04-24T02:12:06.758462+0000","last_unstale":"2024-04-24T02:12:45.812262+0000","last_undegraded":"2024-04-24T02:12:45.812262+0000","last_fullsized":"2024-04-24T02:12:45.812262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:38:50.153825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.335567+0000","last_change":"2024-04-24T02:12:08.769125+0000","last_active":"2024-04-24T02:14:11.335567+0000","last_peered":"2024-04-24T02:14:11.335567+0000","last_clean":"2024-04-24T02:14:11.335567+0000","last_became_active":"2024-04-24T02:12:08.768814+0000","last_became_peered":"2024-04-24T02:12:08.768814+0000","last_unstale":"2024-04-24T02:14:11.335567+0000","last_undegraded":"2024-04-24T02:14:11.335567+0000","last_fullsized":"2024-04-24T02:14:11.335567+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:53:37.011426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.808892+0000","last_change":"2024-04-24T02:12:10.780084+0000","last_active":"2024-04-24T02:12:45.808892+0000","last_peered":"2024-04-24T02:12:45.808892+0000","last_clean":"2024-04-24T02:12:45.808892+0000","last_became_active":"2024-04-24T02:12:10.779734+0000","last_became_peered":"2024-04-24T02:12:10.779734+0000","last_unstale":"2024-04-24T02:12:45.808892+0000","last_undegraded":"2024-04-24T02:12:45.808892+0000","last_fullsized":"2024-04-24T02:12:45.808892+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:39:31.234341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'1","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:10.038390+0000","last_change":"2024-04-24T02:12:04.764834+0000","last_active":"2024-04-24T02:14:10.038390+0000","last_peered":"2024-04-24T02:14:10.038390+0000","last_clean":"2024-04-24T02:14:10.038390+0000","last_became_active":"2024-04-24T02:12:04.764564+0000","last_became_peered":"2024-04-24T02:12:04.764564+0000","last_unstale":"2024-04-24T02:14:10.038390+0000","last_undegraded":"2024-04-24T02:14:10.038390+0000","last_fullsized":"2024-04-24T02:14:10.038390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:39:25.206344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.608026+0000","last_change":"2024-04-24T02:12:45.809612+0000","last_active":"2024-04-24T02:14:12.608026+0000","last_peered":"2024-04-24T02:14:12.608026+0000","last_clean":"2024-04-24T02:14:12.608026+0000","last_became_active":"2024-04-24T02:12:45.809365+0000","last_became_peered":"2024-04-24T02:12:45.809365+0000","last_unstale":"2024-04-24T02:14:12.608026+0000","last_undegraded":"2024-04-24T02:14:12.608026+0000","last_fullsized":"2024-04-24T02:14:12.608026+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:58:04.705635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.816471+0000","last_change":"2024-04-24T02:12:45.815335+0000","last_active":"2024-04-24T02:12:45.816471+0000","last_peered":"2024-04-24T02:12:45.816471+0000","last_clean":"2024-04-24T02:12:45.816471+0000","last_became_active":"2024-04-24T02:12:45.814918+0000","last_became_peered":"2024-04-24T02:12:45.814918+0000","last_unstale":"2024-04-24T02:12:45.816471+0000","last_undegraded":"2024-04-24T02:12:45.816471+0000","last_fullsized":"2024-04-24T02:12:45.816471+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:19:12.091357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"32'62","reported_seq":124,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.781967+0000","last_change":"2024-04-24T02:12:08.769850+0000","last_active":"2024-04-24T02:14:12.781967+0000","last_peered":"2024-04-24T02:14:12.781967+0000","last_clean":"2024-04-24T02:14:12.781967+0000","last_became_active":"2024-04-24T02:12:08.769578+0000","last_became_peered":"2024-04-24T02:12:08.769578+0000","last_unstale":"2024-04-24T02:14:12.781967+0000","last_undegraded":"2024-04-24T02:14:12.781967+0000","last_fullsized":"2024-04-24T02:14:12.781967+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:33:19.698246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":58,"num_read_kb":48,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.808829+0000","last_change":"2024-04-24T02:12:10.780015+0000","last_active":"2024-04-24T02:12:45.808829+0000","last_peered":"2024-04-24T02:12:45.808829+0000","last_clean":"2024-04-24T02:12:45.808829+0000","last_became_active":"2024-04-24T02:12:10.779703+0000","last_became_peered":"2024-04-24T02:12:10.779703+0000","last_unstale":"2024-04-24T02:12:45.808829+0000","last_undegraded":"2024-04-24T02:12:45.808829+0000","last_fullsized":"2024-04-24T02:12:45.808829+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:24:15.761298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'16","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.705023+0000","last_change":"2024-04-24T02:12:12.791870+0000","last_active":"2024-04-24T02:14:12.705023+0000","last_peered":"2024-04-24T02:14:12.705023+0000","last_clean":"2024-04-24T02:14:12.705023+0000","last_became_active":"2024-04-24T02:12:12.791623+0000","last_became_peered":"2024-04-24T02:12:12.791623+0000","last_unstale":"2024-04-24T02:14:12.705023+0000","last_undegraded":"2024-04-24T02:14:12.705023+0000","last_fullsized":"2024-04-24T02:14:12.705023+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:33:17.393684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'10","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:09.632050+0000","last_change":"2024-04-24T02:12:04.755894+0000","last_active":"2024-04-24T02:14:09.632050+0000","last_peered":"2024-04-24T02:14:09.632050+0000","last_clean":"2024-04-24T02:14:09.632050+0000","last_became_active":"2024-04-24T02:12:04.755554+0000","last_became_peered":"2024-04-24T02:12:04.755554+0000","last_unstale":"2024-04-24T02:14:09.632050+0000","last_undegraded":"2024-04-24T02:14:09.632050+0000","last_fullsized":"2024-04-24T02:14:09.632050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:59:47.844020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.803119+0000","last_change":"2024-04-24T02:12:02.752017+0000","last_active":"2024-04-24T02:12:45.803119+0000","last_peered":"2024-04-24T02:12:45.803119+0000","last_clean":"2024-04-24T02:12:45.803119+0000","last_became_active":"2024-04-24T02:12:02.751703+0000","last_became_peered":"2024-04-24T02:12:02.751703+0000","last_unstale":"2024-04-24T02:12:45.803119+0000","last_undegraded":"2024-04-24T02:12:45.803119+0000","last_fullsized":"2024-04-24T02:12:45.803119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:56:56.371880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.808857+0000","last_change":"2024-04-24T02:12:06.756434+0000","last_active":"2024-04-24T02:12:45.808857+0000","last_peered":"2024-04-24T02:12:45.808857+0000","last_clean":"2024-04-24T02:12:45.808857+0000","last_became_active":"2024-04-24T02:12:06.756154+0000","last_became_peered":"2024-04-24T02:12:06.756154+0000","last_unstale":"2024-04-24T02:12:45.808857+0000","last_undegraded":"2024-04-24T02:12:45.808857+0000","last_fullsized":"2024-04-24T02:12:45.808857+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:28:06.445253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'36","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.336595+0000","last_change":"2024-04-24T02:12:08.780969+0000","last_active":"2024-04-24T02:14:11.336595+0000","last_peered":"2024-04-24T02:14:11.336595+0000","last_clean":"2024-04-24T02:14:11.336595+0000","last_became_active":"2024-04-24T02:12:08.780215+0000","last_became_peered":"2024-04-24T02:12:08.780215+0000","last_unstale":"2024-04-24T02:14:11.336595+0000","last_undegraded":"2024-04-24T02:14:11.336595+0000","last_fullsized":"2024-04-24T02:14:11.336595+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:41:43.973694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.806596+0000","last_change":"2024-04-24T02:12:10.786015+0000","last_active":"2024-04-24T02:12:45.806596+0000","last_peered":"2024-04-24T02:12:45.806596+0000","last_clean":"2024-04-24T02:12:45.806596+0000","last_became_active":"2024-04-24T02:12:10.785707+0000","last_became_peered":"2024-04-24T02:12:10.785707+0000","last_unstale":"2024-04-24T02:12:45.806596+0000","last_undegraded":"2024-04-24T02:12:45.806596+0000","last_fullsized":"2024-04-24T02:12:45.806596+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:55:00.963124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.809558+0000","last_change":"2024-04-24T02:12:12.798843+0000","last_active":"2024-04-24T02:12:45.809558+0000","last_peered":"2024-04-24T02:12:45.809558+0000","last_clean":"2024-04-24T02:12:45.809558+0000","last_became_active":"2024-04-24T02:12:12.798498+0000","last_became_peered":"2024-04-24T02:12:12.798498+0000","last_unstale":"2024-04-24T02:12:45.809558+0000","last_undegraded":"2024-04-24T02:12:45.809558+0000","last_fullsized":"2024-04-24T02:12:45.809558+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:03:55.536222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.465088+0000","last_change":"2024-04-24T02:12:04.768687+0000","last_active":"2024-04-24T02:15:13.465088+0000","last_peered":"2024-04-24T02:15:13.465088+0000","last_clean":"2024-04-24T02:15:13.465088+0000","last_became_active":"2024-04-24T02:12:04.768285+0000","last_became_peered":"2024-04-24T02:12:04.768285+0000","last_unstale":"2024-04-24T02:15:13.465088+0000","last_undegraded":"2024-04-24T02:15:13.465088+0000","last_fullsized":"2024-04-24T02:15:13.465088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:38:38.312578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.803505+0000","last_change":"2024-04-24T02:12:02.749703+0000","last_active":"2024-04-24T02:12:45.803505+0000","last_peered":"2024-04-24T02:12:45.803505+0000","last_clean":"2024-04-24T02:12:45.803505+0000","last_became_active":"2024-04-24T02:12:02.749461+0000","last_became_peered":"2024-04-24T02:12:02.749461+0000","last_unstale":"2024-04-24T02:12:45.803505+0000","last_undegraded":"2024-04-24T02:12:45.803505+0000","last_fullsized":"2024-04-24T02:12:45.803505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:39:43.304402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.808573+0000","last_change":"2024-04-24T02:12:06.758054+0000","last_active":"2024-04-24T02:12:45.808573+0000","last_peered":"2024-04-24T02:12:45.808573+0000","last_clean":"2024-04-24T02:12:45.808573+0000","last_became_active":"2024-04-24T02:12:06.757760+0000","last_became_peered":"2024-04-24T02:12:06.757760+0000","last_unstale":"2024-04-24T02:12:45.808573+0000","last_undegraded":"2024-04-24T02:12:45.808573+0000","last_fullsized":"2024-04-24T02:12:45.808573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:03:26.912136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'38","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.354545+0000","last_change":"2024-04-24T02:12:08.779753+0000","last_active":"2024-04-24T02:14:11.354545+0000","last_peered":"2024-04-24T02:14:11.354545+0000","last_clean":"2024-04-24T02:14:11.354545+0000","last_became_active":"2024-04-24T02:12:08.779471+0000","last_became_peered":"2024-04-24T02:12:08.779471+0000","last_unstale":"2024-04-24T02:14:11.354545+0000","last_undegraded":"2024-04-24T02:14:11.354545+0000","last_fullsized":"2024-04-24T02:14:11.354545+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:12:36.613701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.806043+0000","last_change":"2024-04-24T02:12:10.780537+0000","last_active":"2024-04-24T02:12:45.806043+0000","last_peered":"2024-04-24T02:12:45.806043+0000","last_clean":"2024-04-24T02:12:45.806043+0000","last_became_active":"2024-04-24T02:12:10.780272+0000","last_became_peered":"2024-04-24T02:12:10.780272+0000","last_unstale":"2024-04-24T02:12:45.806043+0000","last_undegraded":"2024-04-24T02:12:45.806043+0000","last_fullsized":"2024-04-24T02:12:45.806043+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:13:38.421688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.770870+0000","last_change":"2024-04-24T02:12:12.795264+0000","last_active":"2024-04-24T02:14:12.770870+0000","last_peered":"2024-04-24T02:14:12.770870+0000","last_clean":"2024-04-24T02:14:12.770870+0000","last_became_active":"2024-04-24T02:12:12.794815+0000","last_became_peered":"2024-04-24T02:12:12.794815+0000","last_unstale":"2024-04-24T02:14:12.770870+0000","last_undegraded":"2024-04-24T02:14:12.770870+0000","last_fullsized":"2024-04-24T02:14:12.770870+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:07:13.044978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.464842+0000","last_change":"2024-04-24T02:12:04.750861+0000","last_active":"2024-04-24T02:15:13.464842+0000","last_peered":"2024-04-24T02:15:13.464842+0000","last_clean":"2024-04-24T02:15:13.464842+0000","last_became_active":"2024-04-24T02:12:04.750546+0000","last_became_peered":"2024-04-24T02:12:04.750546+0000","last_unstale":"2024-04-24T02:15:13.464842+0000","last_undegraded":"2024-04-24T02:15:13.464842+0000","last_fullsized":"2024-04-24T02:15:13.464842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:18:49.587013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.810175+0000","last_change":"2024-04-24T02:12:02.758862+0000","last_active":"2024-04-24T02:12:45.810175+0000","last_peered":"2024-04-24T02:12:45.810175+0000","last_clean":"2024-04-24T02:12:45.810175+0000","last_became_active":"2024-04-24T02:12:02.757728+0000","last_became_peered":"2024-04-24T02:12:02.757728+0000","last_unstale":"2024-04-24T02:12:45.810175+0000","last_undegraded":"2024-04-24T02:12:45.810175+0000","last_fullsized":"2024-04-24T02:12:45.810175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:15:42.425053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805610+0000","last_change":"2024-04-24T02:12:06.757498+0000","last_active":"2024-04-24T02:12:45.805610+0000","last_peered":"2024-04-24T02:12:45.805610+0000","last_clean":"2024-04-24T02:12:45.805610+0000","last_became_active":"2024-04-24T02:12:06.757145+0000","last_became_peered":"2024-04-24T02:12:06.757145+0000","last_unstale":"2024-04-24T02:12:45.805610+0000","last_undegraded":"2024-04-24T02:12:45.805610+0000","last_fullsized":"2024-04-24T02:12:45.805610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:48:54.842263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'16","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.812551+0000","last_change":"2024-04-24T02:12:08.782279+0000","last_active":"2024-04-24T02:12:45.812551+0000","last_peered":"2024-04-24T02:12:45.812551+0000","last_clean":"2024-04-24T02:12:45.812551+0000","last_became_active":"2024-04-24T02:12:08.781974+0000","last_became_peered":"2024-04-24T02:12:08.781974+0000","last_unstale":"2024-04-24T02:12:45.812551+0000","last_undegraded":"2024-04-24T02:12:45.812551+0000","last_fullsized":"2024-04-24T02:12:45.812551+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:08:01.406805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'282","reported_seq":370,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.581521+0000","last_change":"2024-04-24T02:12:10.787530+0000","last_active":"2024-04-24T02:15:13.581521+0000","last_peered":"2024-04-24T02:15:13.581521+0000","last_clean":"2024-04-24T02:15:13.581521+0000","last_became_active":"2024-04-24T02:12:10.786972+0000","last_became_peered":"2024-04-24T02:12:10.786972+0000","last_unstale":"2024-04-24T02:15:13.581521+0000","last_undegraded":"2024-04-24T02:15:13.581521+0000","last_fullsized":"2024-04-24T02:15:13.581521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:01:37.766900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'4","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:28.942341+0000","last_change":"2024-04-24T02:12:12.795734+0000","last_active":"2024-04-24T02:13:28.942341+0000","last_peered":"2024-04-24T02:13:28.942341+0000","last_clean":"2024-04-24T02:13:28.942341+0000","last_became_active":"2024-04-24T02:12:12.795013+0000","last_became_peered":"2024-04-24T02:12:12.795013+0000","last_unstale":"2024-04-24T02:13:28.942341+0000","last_undegraded":"2024-04-24T02:13:28.942341+0000","last_fullsized":"2024-04-24T02:13:28.942341+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:00:19.736045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'12","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.265255+0000","last_change":"2024-04-24T02:12:04.752294+0000","last_active":"2024-04-24T02:15:13.265255+0000","last_peered":"2024-04-24T02:15:13.265255+0000","last_clean":"2024-04-24T02:15:13.265255+0000","last_became_active":"2024-04-24T02:12:04.751676+0000","last_became_peered":"2024-04-24T02:12:04.751676+0000","last_unstale":"2024-04-24T02:15:13.265255+0000","last_undegraded":"2024-04-24T02:15:13.265255+0000","last_fullsized":"2024-04-24T02:15:13.265255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:04:16.078887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805289+0000","last_change":"2024-04-24T02:12:02.756088+0000","last_active":"2024-04-24T02:12:45.805289+0000","last_peered":"2024-04-24T02:12:45.805289+0000","last_clean":"2024-04-24T02:12:45.805289+0000","last_became_active":"2024-04-24T02:12:02.755512+0000","last_became_peered":"2024-04-24T02:12:02.755512+0000","last_unstale":"2024-04-24T02:12:45.805289+0000","last_undegraded":"2024-04-24T02:12:45.805289+0000","last_fullsized":"2024-04-24T02:12:45.805289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:35:57.790455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805191+0000","last_change":"2024-04-24T02:12:06.757421+0000","last_active":"2024-04-24T02:12:45.805191+0000","last_peered":"2024-04-24T02:12:45.805191+0000","last_clean":"2024-04-24T02:12:45.805191+0000","last_became_active":"2024-04-24T02:12:06.756909+0000","last_became_peered":"2024-04-24T02:12:06.756909+0000","last_unstale":"2024-04-24T02:12:45.805191+0000","last_undegraded":"2024-04-24T02:12:45.805191+0000","last_fullsized":"2024-04-24T02:12:45.805191+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:21:46.839438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'60","reported_seq":129,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.327447+0000","last_change":"2024-04-24T02:12:08.770654+0000","last_active":"2024-04-24T02:14:11.327447+0000","last_peered":"2024-04-24T02:14:11.327447+0000","last_clean":"2024-04-24T02:14:11.327447+0000","last_became_active":"2024-04-24T02:12:08.770255+0000","last_became_peered":"2024-04-24T02:12:08.770255+0000","last_unstale":"2024-04-24T02:14:11.327447+0000","last_undegraded":"2024-04-24T02:14:11.327447+0000","last_fullsized":"2024-04-24T02:14:11.327447+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:15:23.890733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":74,"num_read_kb":61,"num_write":42,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804341+0000","last_change":"2024-04-24T02:12:10.786024+0000","last_active":"2024-04-24T02:12:45.804341+0000","last_peered":"2024-04-24T02:12:45.804341+0000","last_clean":"2024-04-24T02:12:45.804341+0000","last_became_active":"2024-04-24T02:12:10.785811+0000","last_became_peered":"2024-04-24T02:12:10.785811+0000","last_unstale":"2024-04-24T02:12:45.804341+0000","last_undegraded":"2024-04-24T02:12:45.804341+0000","last_fullsized":"2024-04-24T02:12:45.804341+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:51:01.712254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804594+0000","last_change":"2024-04-24T02:12:12.799813+0000","last_active":"2024-04-24T02:12:45.804594+0000","last_peered":"2024-04-24T02:12:45.804594+0000","last_clean":"2024-04-24T02:12:45.804594+0000","last_became_active":"2024-04-24T02:12:12.799557+0000","last_became_peered":"2024-04-24T02:12:12.799557+0000","last_unstale":"2024-04-24T02:12:45.804594+0000","last_undegraded":"2024-04-24T02:12:45.804594+0000","last_fullsized":"2024-04-24T02:12:45.804594+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:23:38.168759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'18","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.349395+0000","last_change":"2024-04-24T02:12:04.748652+0000","last_active":"2024-04-24T02:15:13.349395+0000","last_peered":"2024-04-24T02:15:13.349395+0000","last_clean":"2024-04-24T02:15:13.349395+0000","last_became_active":"2024-04-24T02:12:04.748399+0000","last_became_peered":"2024-04-24T02:12:04.748399+0000","last_unstale":"2024-04-24T02:15:13.349395+0000","last_undegraded":"2024-04-24T02:15:13.349395+0000","last_fullsized":"2024-04-24T02:15:13.349395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:11:30.157161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":55,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.812037+0000","last_change":"2024-04-24T02:12:02.761810+0000","last_active":"2024-04-24T02:12:45.812037+0000","last_peered":"2024-04-24T02:12:45.812037+0000","last_clean":"2024-04-24T02:12:45.812037+0000","last_became_active":"2024-04-24T02:12:02.760772+0000","last_became_peered":"2024-04-24T02:12:02.760772+0000","last_unstale":"2024-04-24T02:12:45.812037+0000","last_undegraded":"2024-04-24T02:12:45.812037+0000","last_fullsized":"2024-04-24T02:12:45.812037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:20:25.868325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.808789+0000","last_change":"2024-04-24T02:12:06.765015+0000","last_active":"2024-04-24T02:12:45.808789+0000","last_peered":"2024-04-24T02:12:45.808789+0000","last_clean":"2024-04-24T02:12:45.808789+0000","last_became_active":"2024-04-24T02:12:06.764475+0000","last_became_peered":"2024-04-24T02:12:06.764475+0000","last_unstale":"2024-04-24T02:12:45.808789+0000","last_undegraded":"2024-04-24T02:12:45.808789+0000","last_fullsized":"2024-04-24T02:12:45.808789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:34:43.734495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'37","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.328386+0000","last_change":"2024-04-24T02:12:08.779659+0000","last_active":"2024-04-24T02:14:11.328386+0000","last_peered":"2024-04-24T02:14:11.328386+0000","last_clean":"2024-04-24T02:14:11.328386+0000","last_became_active":"2024-04-24T02:12:08.779447+0000","last_became_peered":"2024-04-24T02:12:08.779447+0000","last_unstale":"2024-04-24T02:14:11.328386+0000","last_undegraded":"2024-04-24T02:14:11.328386+0000","last_fullsized":"2024-04-24T02:14:11.328386+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:47:59.126462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.809971+0000","last_change":"2024-04-24T02:12:10.783395+0000","last_active":"2024-04-24T02:12:45.809971+0000","last_peered":"2024-04-24T02:12:45.809971+0000","last_clean":"2024-04-24T02:12:45.809971+0000","last_became_active":"2024-04-24T02:12:10.782019+0000","last_became_peered":"2024-04-24T02:12:10.782019+0000","last_unstale":"2024-04-24T02:12:45.809971+0000","last_undegraded":"2024-04-24T02:12:45.809971+0000","last_fullsized":"2024-04-24T02:12:45.809971+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:36:51.948849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.811428+0000","last_change":"2024-04-24T02:12:12.797073+0000","last_active":"2024-04-24T02:12:45.811428+0000","last_peered":"2024-04-24T02:12:45.811428+0000","last_clean":"2024-04-24T02:12:45.811428+0000","last_became_active":"2024-04-24T02:12:12.796494+0000","last_became_peered":"2024-04-24T02:12:12.796494+0000","last_unstale":"2024-04-24T02:12:45.811428+0000","last_undegraded":"2024-04-24T02:12:45.811428+0000","last_fullsized":"2024-04-24T02:12:45.811428+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:13.390946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'10","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.349088+0000","last_change":"2024-04-24T02:12:04.763788+0000","last_active":"2024-04-24T02:15:13.349088+0000","last_peered":"2024-04-24T02:15:13.349088+0000","last_clean":"2024-04-24T02:15:13.349088+0000","last_became_active":"2024-04-24T02:12:04.763263+0000","last_became_peered":"2024-04-24T02:12:04.763263+0000","last_unstale":"2024-04-24T02:15:13.349088+0000","last_undegraded":"2024-04-24T02:15:13.349088+0000","last_fullsized":"2024-04-24T02:15:13.349088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:22.258912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:46.550151+0000","last_change":"2024-04-24T02:12:02.745999+0000","last_active":"2024-04-24T02:12:46.550151+0000","last_peered":"2024-04-24T02:12:46.550151+0000","last_clean":"2024-04-24T02:12:46.550151+0000","last_became_active":"2024-04-24T02:12:02.745617+0000","last_became_peered":"2024-04-24T02:12:02.745617+0000","last_unstale":"2024-04-24T02:12:46.550151+0000","last_undegraded":"2024-04-24T02:12:46.550151+0000","last_fullsized":"2024-04-24T02:12:46.550151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:45:43.215829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805756+0000","last_change":"2024-04-24T02:12:06.766022+0000","last_active":"2024-04-24T02:12:45.805756+0000","last_peered":"2024-04-24T02:12:45.805756+0000","last_clean":"2024-04-24T02:12:45.805756+0000","last_became_active":"2024-04-24T02:12:06.765644+0000","last_became_peered":"2024-04-24T02:12:06.765644+0000","last_unstale":"2024-04-24T02:12:45.805756+0000","last_undegraded":"2024-04-24T02:12:45.805756+0000","last_fullsized":"2024-04-24T02:12:45.805756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:22:20.414950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'33","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.352320+0000","last_change":"2024-04-24T02:12:08.780672+0000","last_active":"2024-04-24T02:14:11.352320+0000","last_peered":"2024-04-24T02:14:11.352320+0000","last_clean":"2024-04-24T02:14:11.352320+0000","last_became_active":"2024-04-24T02:12:08.780056+0000","last_became_peered":"2024-04-24T02:12:08.780056+0000","last_unstale":"2024-04-24T02:14:11.352320+0000","last_undegraded":"2024-04-24T02:14:11.352320+0000","last_fullsized":"2024-04-24T02:14:11.352320+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:51:21.271286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":27,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.809863+0000","last_change":"2024-04-24T02:12:10.785977+0000","last_active":"2024-04-24T02:12:45.809863+0000","last_peered":"2024-04-24T02:12:45.809863+0000","last_clean":"2024-04-24T02:12:45.809863+0000","last_became_active":"2024-04-24T02:12:10.785396+0000","last_became_peered":"2024-04-24T02:12:10.785396+0000","last_unstale":"2024-04-24T02:12:45.809863+0000","last_undegraded":"2024-04-24T02:12:45.809863+0000","last_fullsized":"2024-04-24T02:12:45.809863+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:28:39.922824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.362615+0000","last_change":"2024-04-24T02:12:12.794051+0000","last_active":"2024-04-24T02:14:11.362615+0000","last_peered":"2024-04-24T02:14:11.362615+0000","last_clean":"2024-04-24T02:14:11.362615+0000","last_became_active":"2024-04-24T02:12:12.793796+0000","last_became_peered":"2024-04-24T02:12:12.793796+0000","last_unstale":"2024-04-24T02:14:11.362615+0000","last_undegraded":"2024-04-24T02:14:11.362615+0000","last_fullsized":"2024-04-24T02:14:11.362615+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:24:07.897162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'18","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.523119+0000","last_change":"2024-04-24T02:12:04.749487+0000","last_active":"2024-04-24T02:15:13.523119+0000","last_peered":"2024-04-24T02:15:13.523119+0000","last_clean":"2024-04-24T02:15:13.523119+0000","last_became_active":"2024-04-24T02:12:04.749055+0000","last_became_peered":"2024-04-24T02:12:04.749055+0000","last_unstale":"2024-04-24T02:15:13.523119+0000","last_undegraded":"2024-04-24T02:15:13.523119+0000","last_fullsized":"2024-04-24T02:15:13.523119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:22:28.196549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805080+0000","last_change":"2024-04-24T02:12:02.747590+0000","last_active":"2024-04-24T02:12:45.805080+0000","last_peered":"2024-04-24T02:12:45.805080+0000","last_clean":"2024-04-24T02:12:45.805080+0000","last_became_active":"2024-04-24T02:12:02.745895+0000","last_became_peered":"2024-04-24T02:12:02.745895+0000","last_unstale":"2024-04-24T02:12:45.805080+0000","last_undegraded":"2024-04-24T02:12:45.805080+0000","last_fullsized":"2024-04-24T02:12:45.805080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:21:06.907535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'6","reported_seq":228,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.403135+0000","last_change":"2024-04-24T02:12:06.765389+0000","last_active":"2024-04-24T02:14:12.403135+0000","last_peered":"2024-04-24T02:14:12.403135+0000","last_clean":"2024-04-24T02:14:12.403135+0000","last_became_active":"2024-04-24T02:12:06.765096+0000","last_became_peered":"2024-04-24T02:12:06.765096+0000","last_unstale":"2024-04-24T02:14:12.403135+0000","last_undegraded":"2024-04-24T02:14:12.403135+0000","last_fullsized":"2024-04-24T02:14:12.403135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:28:12.528823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'44","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:12.798259+0000","last_change":"2024-04-24T02:12:08.780244+0000","last_active":"2024-04-24T02:15:12.798259+0000","last_peered":"2024-04-24T02:15:12.798259+0000","last_clean":"2024-04-24T02:15:12.798259+0000","last_became_active":"2024-04-24T02:12:08.779892+0000","last_became_peered":"2024-04-24T02:12:08.779892+0000","last_unstale":"2024-04-24T02:15:12.798259+0000","last_undegraded":"2024-04-24T02:15:12.798259+0000","last_fullsized":"2024-04-24T02:15:12.798259+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:53:04.772697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":52,"num_read_kb":46,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804982+0000","last_change":"2024-04-24T02:12:10.781966+0000","last_active":"2024-04-24T02:12:45.804982+0000","last_peered":"2024-04-24T02:12:45.804982+0000","last_clean":"2024-04-24T02:12:45.804982+0000","last_became_active":"2024-04-24T02:12:10.781588+0000","last_became_peered":"2024-04-24T02:12:10.781588+0000","last_unstale":"2024-04-24T02:12:45.804982+0000","last_undegraded":"2024-04-24T02:12:45.804982+0000","last_fullsized":"2024-04-24T02:12:45.804982+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:36:23.742641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'6","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.526045+0000","last_change":"2024-04-24T02:12:12.793599+0000","last_active":"2024-04-24T02:15:13.526045+0000","last_peered":"2024-04-24T02:15:13.526045+0000","last_clean":"2024-04-24T02:15:13.526045+0000","last_became_active":"2024-04-24T02:12:12.793310+0000","last_became_peered":"2024-04-24T02:12:12.793310+0000","last_unstale":"2024-04-24T02:15:13.526045+0000","last_undegraded":"2024-04-24T02:15:13.526045+0000","last_fullsized":"2024-04-24T02:15:13.526045+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:31:25.149659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'4","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.464843+0000","last_change":"2024-04-24T02:12:04.767702+0000","last_active":"2024-04-24T02:15:13.464843+0000","last_peered":"2024-04-24T02:15:13.464843+0000","last_clean":"2024-04-24T02:15:13.464843+0000","last_became_active":"2024-04-24T02:12:04.766869+0000","last_became_peered":"2024-04-24T02:12:04.766869+0000","last_unstale":"2024-04-24T02:15:13.464843+0000","last_undegraded":"2024-04-24T02:15:13.464843+0000","last_fullsized":"2024-04-24T02:15:13.464843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:11:48.404916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805389+0000","last_change":"2024-04-24T02:12:02.750537+0000","last_active":"2024-04-24T02:12:45.805389+0000","last_peered":"2024-04-24T02:12:45.805389+0000","last_clean":"2024-04-24T02:12:45.805389+0000","last_became_active":"2024-04-24T02:12:02.746992+0000","last_became_peered":"2024-04-24T02:12:02.746992+0000","last_unstale":"2024-04-24T02:12:45.805389+0000","last_undegraded":"2024-04-24T02:12:45.805389+0000","last_fullsized":"2024-04-24T02:12:45.805389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:20:45.842023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.774843+0000","last_change":"2024-04-24T02:12:04.749519+0000","last_active":"2024-04-24T02:14:12.774843+0000","last_peered":"2024-04-24T02:14:12.774843+0000","last_clean":"2024-04-24T02:14:12.774843+0000","last_became_active":"2024-04-24T02:12:04.749165+0000","last_became_peered":"2024-04-24T02:12:04.749165+0000","last_unstale":"2024-04-24T02:14:12.774843+0000","last_undegraded":"2024-04-24T02:14:12.774843+0000","last_fullsized":"2024-04-24T02:14:12.774843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:46:52.766018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'6","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.344845+0000","last_change":"2024-04-24T02:12:02.751924+0000","last_active":"2024-04-24T02:15:13.344845+0000","last_peered":"2024-04-24T02:15:13.344845+0000","last_clean":"2024-04-24T02:15:13.344845+0000","last_became_active":"2024-04-24T02:12:02.751613+0000","last_became_peered":"2024-04-24T02:12:02.751613+0000","last_unstale":"2024-04-24T02:15:13.344845+0000","last_undegraded":"2024-04-24T02:15:13.344845+0000","last_fullsized":"2024-04-24T02:15:13.344845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:18:31.392785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.464756+0000","last_change":"2024-04-24T02:12:04.764660+0000","last_active":"2024-04-24T02:15:13.464756+0000","last_peered":"2024-04-24T02:15:13.464756+0000","last_clean":"2024-04-24T02:15:13.464756+0000","last_became_active":"2024-04-24T02:12:04.763819+0000","last_became_peered":"2024-04-24T02:12:04.763819+0000","last_unstale":"2024-04-24T02:15:13.464756+0000","last_undegraded":"2024-04-24T02:15:13.464756+0000","last_fullsized":"2024-04-24T02:15:13.464756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:23:58.698687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.810651+0000","last_change":"2024-04-24T02:12:02.758745+0000","last_active":"2024-04-24T02:12:45.810651+0000","last_peered":"2024-04-24T02:12:45.810651+0000","last_clean":"2024-04-24T02:12:45.810651+0000","last_became_active":"2024-04-24T02:12:02.757017+0000","last_became_peered":"2024-04-24T02:12:02.757017+0000","last_unstale":"2024-04-24T02:12:45.810651+0000","last_undegraded":"2024-04-24T02:12:45.810651+0000","last_fullsized":"2024-04-24T02:12:45.810651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:47:33.899846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'4","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.389055+0000","last_change":"2024-04-24T02:12:04.749624+0000","last_active":"2024-04-24T02:15:13.389055+0000","last_peered":"2024-04-24T02:15:13.389055+0000","last_clean":"2024-04-24T02:15:13.389055+0000","last_became_active":"2024-04-24T02:12:04.749305+0000","last_became_peered":"2024-04-24T02:12:04.749305+0000","last_unstale":"2024-04-24T02:15:13.389055+0000","last_undegraded":"2024-04-24T02:15:13.389055+0000","last_fullsized":"2024-04-24T02:15:13.389055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:12:19.920273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"30'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.806026+0000","last_change":"2024-04-24T02:12:02.741858+0000","last_active":"2024-04-24T02:12:45.806026+0000","last_peered":"2024-04-24T02:12:45.806026+0000","last_clean":"2024-04-24T02:12:45.806026+0000","last_became_active":"2024-04-24T02:12:02.741503+0000","last_became_peered":"2024-04-24T02:12:02.741503+0000","last_unstale":"2024-04-24T02:12:45.806026+0000","last_undegraded":"2024-04-24T02:12:45.806026+0000","last_fullsized":"2024-04-24T02:12:45.806026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:07:39.016614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'6","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.258691+0000","last_change":"2024-04-24T02:12:45.818489+0000","last_active":"2024-04-24T02:15:13.258691+0000","last_peered":"2024-04-24T02:15:13.258691+0000","last_clean":"2024-04-24T02:15:13.258691+0000","last_became_active":"2024-04-24T02:12:45.814356+0000","last_became_peered":"2024-04-24T02:12:45.814356+0000","last_unstale":"2024-04-24T02:15:13.258691+0000","last_undegraded":"2024-04-24T02:15:13.258691+0000","last_fullsized":"2024-04-24T02:15:13.258691+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:04:14.737856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.129792+0000","last_change":"2024-04-24T02:12:02.751995+0000","last_active":"2024-04-24T02:15:13.129792+0000","last_peered":"2024-04-24T02:15:13.129792+0000","last_clean":"2024-04-24T02:15:13.129792+0000","last_became_active":"2024-04-24T02:12:02.751680+0000","last_became_peered":"2024-04-24T02:12:02.751680+0000","last_unstale":"2024-04-24T02:15:13.129792+0000","last_undegraded":"2024-04-24T02:15:13.129792+0000","last_fullsized":"2024-04-24T02:15:13.129792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:31:45.410385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'8","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.391123+0000","last_change":"2024-04-24T02:12:45.817674+0000","last_active":"2024-04-24T02:15:13.391123+0000","last_peered":"2024-04-24T02:15:13.391123+0000","last_clean":"2024-04-24T02:15:13.391123+0000","last_became_active":"2024-04-24T02:12:45.813097+0000","last_became_peered":"2024-04-24T02:12:45.813097+0000","last_unstale":"2024-04-24T02:15:13.391123+0000","last_undegraded":"2024-04-24T02:15:13.391123+0000","last_fullsized":"2024-04-24T02:15:13.391123+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:03:21.634592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"32'1","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:15.038523+0000","last_change":"2024-04-24T02:12:02.754946+0000","last_active":"2024-04-24T02:14:15.038523+0000","last_peered":"2024-04-24T02:14:15.038523+0000","last_clean":"2024-04-24T02:14:15.038523+0000","last_became_active":"2024-04-24T02:12:02.754356+0000","last_became_peered":"2024-04-24T02:12:02.754356+0000","last_unstale":"2024-04-24T02:14:15.038523+0000","last_undegraded":"2024-04-24T02:14:15.038523+0000","last_fullsized":"2024-04-24T02:14:15.038523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:57:48.477966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'5","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.176709+0000","last_change":"2024-04-24T02:12:04.756117+0000","last_active":"2024-04-24T02:15:13.176709+0000","last_peered":"2024-04-24T02:15:13.176709+0000","last_clean":"2024-04-24T02:15:13.176709+0000","last_became_active":"2024-04-24T02:12:04.755738+0000","last_became_peered":"2024-04-24T02:12:04.755738+0000","last_unstale":"2024-04-24T02:15:13.176709+0000","last_undegraded":"2024-04-24T02:15:13.176709+0000","last_fullsized":"2024-04-24T02:15:13.176709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:34:53.394367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"30'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.813069+0000","last_change":"2024-04-24T02:12:02.756723+0000","last_active":"2024-04-24T02:12:45.813069+0000","last_peered":"2024-04-24T02:12:45.813069+0000","last_clean":"2024-04-24T02:12:45.813069+0000","last_became_active":"2024-04-24T02:12:02.755202+0000","last_became_peered":"2024-04-24T02:12:02.755202+0000","last_unstale":"2024-04-24T02:12:45.813069+0000","last_undegraded":"2024-04-24T02:12:45.813069+0000","last_fullsized":"2024-04-24T02:12:45.813069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:35:57.790455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"30'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.803548+0000","last_change":"2024-04-24T02:12:04.756072+0000","last_active":"2024-04-24T02:12:45.803548+0000","last_peered":"2024-04-24T02:12:45.803548+0000","last_clean":"2024-04-24T02:12:45.803548+0000","last_became_active":"2024-04-24T02:12:04.755194+0000","last_became_peered":"2024-04-24T02:12:04.755194+0000","last_unstale":"2024-04-24T02:12:45.803548+0000","last_undegraded":"2024-04-24T02:12:45.803548+0000","last_fullsized":"2024-04-24T02:12:45.803548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:48:16.917007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.459938+0000","last_change":"2024-04-24T02:12:02.752025+0000","last_active":"2024-04-24T02:15:13.459938+0000","last_peered":"2024-04-24T02:15:13.459938+0000","last_clean":"2024-04-24T02:15:13.459938+0000","last_became_active":"2024-04-24T02:12:02.751726+0000","last_became_peered":"2024-04-24T02:12:02.751726+0000","last_unstale":"2024-04-24T02:15:13.459938+0000","last_undegraded":"2024-04-24T02:15:13.459938+0000","last_fullsized":"2024-04-24T02:15:13.459938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:17:15.106316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'6","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.940195+0000","last_change":"2024-04-24T02:12:04.753374+0000","last_active":"2024-04-24T02:12:45.940195+0000","last_peered":"2024-04-24T02:12:45.940195+0000","last_clean":"2024-04-24T02:12:45.940195+0000","last_became_active":"2024-04-24T02:12:04.753074+0000","last_became_peered":"2024-04-24T02:12:04.753074+0000","last_unstale":"2024-04-24T02:12:45.940195+0000","last_undegraded":"2024-04-24T02:12:45.940195+0000","last_fullsized":"2024-04-24T02:12:45.940195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:54:39.701699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:15.038929+0000","last_change":"2024-04-24T02:12:02.755029+0000","last_active":"2024-04-24T02:14:15.038929+0000","last_peered":"2024-04-24T02:14:15.038929+0000","last_clean":"2024-04-24T02:14:15.038929+0000","last_became_active":"2024-04-24T02:12:02.754158+0000","last_became_peered":"2024-04-24T02:12:02.754158+0000","last_unstale":"2024-04-24T02:14:15.038929+0000","last_undegraded":"2024-04-24T02:14:15.038929+0000","last_fullsized":"2024-04-24T02:14:15.038929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:10:56.620635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:29.126199+0000","last_change":"2024-04-24T02:12:04.764100+0000","last_active":"2024-04-24T02:13:29.126199+0000","last_peered":"2024-04-24T02:13:29.126199+0000","last_clean":"2024-04-24T02:13:29.126199+0000","last_became_active":"2024-04-24T02:12:04.763136+0000","last_became_peered":"2024-04-24T02:12:04.763136+0000","last_unstale":"2024-04-24T02:13:29.126199+0000","last_undegraded":"2024-04-24T02:13:29.126199+0000","last_fullsized":"2024-04-24T02:13:29.126199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:52:02.789245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804576+0000","last_change":"2024-04-24T02:12:02.741912+0000","last_active":"2024-04-24T02:12:45.804576+0000","last_peered":"2024-04-24T02:12:45.804576+0000","last_clean":"2024-04-24T02:12:45.804576+0000","last_became_active":"2024-04-24T02:12:02.741543+0000","last_became_peered":"2024-04-24T02:12:02.741543+0000","last_unstale":"2024-04-24T02:12:45.804576+0000","last_undegraded":"2024-04-24T02:12:45.804576+0000","last_fullsized":"2024-04-24T02:12:45.804576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:23:18.903991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:46.564925+0000","last_change":"2024-04-24T02:12:04.760381+0000","last_active":"2024-04-24T02:12:46.564925+0000","last_peered":"2024-04-24T02:12:46.564925+0000","last_clean":"2024-04-24T02:12:46.564925+0000","last_became_active":"2024-04-24T02:12:04.760028+0000","last_became_peered":"2024-04-24T02:12:04.760028+0000","last_unstale":"2024-04-24T02:12:46.564925+0000","last_undegraded":"2024-04-24T02:12:46.564925+0000","last_fullsized":"2024-04-24T02:12:46.564925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:20:21.566094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.336619+0000","last_change":"2024-04-24T02:12:02.750391+0000","last_active":"2024-04-24T02:15:13.336619+0000","last_peered":"2024-04-24T02:15:13.336619+0000","last_clean":"2024-04-24T02:15:13.336619+0000","last_became_active":"2024-04-24T02:12:02.750143+0000","last_became_peered":"2024-04-24T02:12:02.750143+0000","last_unstale":"2024-04-24T02:15:13.336619+0000","last_undegraded":"2024-04-24T02:15:13.336619+0000","last_fullsized":"2024-04-24T02:15:13.336619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:30:58.417438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'8","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.465106+0000","last_change":"2024-04-24T02:12:04.754976+0000","last_active":"2024-04-24T02:15:13.465106+0000","last_peered":"2024-04-24T02:15:13.465106+0000","last_clean":"2024-04-24T02:15:13.465106+0000","last_became_active":"2024-04-24T02:12:04.754738+0000","last_became_peered":"2024-04-24T02:12:04.754738+0000","last_unstale":"2024-04-24T02:15:13.465106+0000","last_undegraded":"2024-04-24T02:15:13.465106+0000","last_fullsized":"2024-04-24T02:15:13.465106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:34:41.727071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804338+0000","last_change":"2024-04-24T02:12:02.746027+0000","last_active":"2024-04-24T02:12:45.804338+0000","last_peered":"2024-04-24T02:12:45.804338+0000","last_clean":"2024-04-24T02:12:45.804338+0000","last_became_active":"2024-04-24T02:12:02.744352+0000","last_became_peered":"2024-04-24T02:12:02.744352+0000","last_unstale":"2024-04-24T02:12:45.804338+0000","last_undegraded":"2024-04-24T02:12:45.804338+0000","last_fullsized":"2024-04-24T02:12:45.804338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:42.734407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'12","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.179236+0000","last_change":"2024-04-24T02:12:45.815138+0000","last_active":"2024-04-24T02:15:13.179236+0000","last_peered":"2024-04-24T02:15:13.179236+0000","last_clean":"2024-04-24T02:15:13.179236+0000","last_became_active":"2024-04-24T02:12:45.808774+0000","last_became_peered":"2024-04-24T02:12:45.808774+0000","last_unstale":"2024-04-24T02:15:13.179236+0000","last_undegraded":"2024-04-24T02:15:13.179236+0000","last_fullsized":"2024-04-24T02:15:13.179236+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:34:31.491770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.811686+0000","last_change":"2024-04-24T02:12:02.758624+0000","last_active":"2024-04-24T02:12:45.811686+0000","last_peered":"2024-04-24T02:12:45.811686+0000","last_clean":"2024-04-24T02:12:45.811686+0000","last_became_active":"2024-04-24T02:12:02.757458+0000","last_became_peered":"2024-04-24T02:12:02.757458+0000","last_unstale":"2024-04-24T02:12:45.811686+0000","last_undegraded":"2024-04-24T02:12:45.811686+0000","last_fullsized":"2024-04-24T02:12:45.811686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:40:47.142152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'14","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.391096+0000","last_change":"2024-04-24T02:12:04.751238+0000","last_active":"2024-04-24T02:15:13.391096+0000","last_peered":"2024-04-24T02:15:13.391096+0000","last_clean":"2024-04-24T02:15:13.391096+0000","last_became_active":"2024-04-24T02:12:04.750973+0000","last_became_peered":"2024-04-24T02:12:04.750973+0000","last_unstale":"2024-04-24T02:15:13.391096+0000","last_undegraded":"2024-04-24T02:15:13.391096+0000","last_fullsized":"2024-04-24T02:15:13.391096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:39:11.735517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.812141+0000","last_change":"2024-04-24T02:12:02.761835+0000","last_active":"2024-04-24T02:12:45.812141+0000","last_peered":"2024-04-24T02:12:45.812141+0000","last_clean":"2024-04-24T02:12:45.812141+0000","last_became_active":"2024-04-24T02:12:02.761235+0000","last_became_peered":"2024-04-24T02:12:02.761235+0000","last_unstale":"2024-04-24T02:12:45.812141+0000","last_undegraded":"2024-04-24T02:12:45.812141+0000","last_fullsized":"2024-04-24T02:12:45.812141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:25:04.505767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.389012+0000","last_change":"2024-04-24T02:12:04.764009+0000","last_active":"2024-04-24T02:15:13.389012+0000","last_peered":"2024-04-24T02:15:13.389012+0000","last_clean":"2024-04-24T02:15:13.389012+0000","last_became_active":"2024-04-24T02:12:04.763517+0000","last_became_peered":"2024-04-24T02:12:04.763517+0000","last_unstale":"2024-04-24T02:15:13.389012+0000","last_undegraded":"2024-04-24T02:15:13.389012+0000","last_fullsized":"2024-04-24T02:15:13.389012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:00:42.696926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.339848+0000","last_change":"2024-04-24T02:12:02.754501+0000","last_active":"2024-04-24T02:15:13.339848+0000","last_peered":"2024-04-24T02:15:13.339848+0000","last_clean":"2024-04-24T02:15:13.339848+0000","last_became_active":"2024-04-24T02:12:02.754227+0000","last_became_peered":"2024-04-24T02:12:02.754227+0000","last_unstale":"2024-04-24T02:15:13.339848+0000","last_undegraded":"2024-04-24T02:15:13.339848+0000","last_fullsized":"2024-04-24T02:15:13.339848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:21:06.907535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.349589+0000","last_change":"2024-04-24T02:12:04.755937+0000","last_active":"2024-04-24T02:15:13.349589+0000","last_peered":"2024-04-24T02:15:13.349589+0000","last_clean":"2024-04-24T02:15:13.349589+0000","last_became_active":"2024-04-24T02:12:04.755661+0000","last_became_peered":"2024-04-24T02:12:04.755661+0000","last_unstale":"2024-04-24T02:15:13.349589+0000","last_undegraded":"2024-04-24T02:15:13.349589+0000","last_fullsized":"2024-04-24T02:15:13.349589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:11:30.157161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.813752+0000","last_change":"2024-04-24T02:12:02.761162+0000","last_active":"2024-04-24T02:12:45.813752+0000","last_peered":"2024-04-24T02:12:45.813752+0000","last_clean":"2024-04-24T02:12:45.813752+0000","last_became_active":"2024-04-24T02:12:02.758855+0000","last_became_peered":"2024-04-24T02:12:02.758855+0000","last_unstale":"2024-04-24T02:12:45.813752+0000","last_undegraded":"2024-04-24T02:12:45.813752+0000","last_fullsized":"2024-04-24T02:12:45.813752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:48:14.910380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.809520+0000","last_change":"2024-04-24T02:12:02.757416+0000","last_active":"2024-04-24T02:12:45.809520+0000","last_peered":"2024-04-24T02:12:45.809520+0000","last_clean":"2024-04-24T02:12:45.809520+0000","last_became_active":"2024-04-24T02:12:02.753545+0000","last_became_peered":"2024-04-24T02:12:02.753545+0000","last_unstale":"2024-04-24T02:12:45.809520+0000","last_undegraded":"2024-04-24T02:12:45.809520+0000","last_fullsized":"2024-04-24T02:12:45.809520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:09.115795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'10","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.171289+0000","last_change":"2024-04-24T02:12:04.758909+0000","last_active":"2024-04-24T02:15:13.171289+0000","last_peered":"2024-04-24T02:15:13.171289+0000","last_clean":"2024-04-24T02:15:13.171289+0000","last_became_active":"2024-04-24T02:12:04.758661+0000","last_became_peered":"2024-04-24T02:12:04.758661+0000","last_unstale":"2024-04-24T02:15:13.171289+0000","last_undegraded":"2024-04-24T02:15:13.171289+0000","last_fullsized":"2024-04-24T02:15:13.171289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:14:26.877561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804307+0000","last_change":"2024-04-24T02:12:02.745737+0000","last_active":"2024-04-24T02:12:45.804307+0000","last_peered":"2024-04-24T02:12:45.804307+0000","last_clean":"2024-04-24T02:12:45.804307+0000","last_became_active":"2024-04-24T02:12:02.745396+0000","last_became_peered":"2024-04-24T02:12:02.745396+0000","last_unstale":"2024-04-24T02:12:45.804307+0000","last_undegraded":"2024-04-24T02:12:45.804307+0000","last_fullsized":"2024-04-24T02:12:45.804307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:11:19.180288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:09.640725+0000","last_change":"2024-04-24T02:12:04.766645+0000","last_active":"2024-04-24T02:14:09.640725+0000","last_peered":"2024-04-24T02:14:09.640725+0000","last_clean":"2024-04-24T02:14:09.640725+0000","last_became_active":"2024-04-24T02:12:04.766344+0000","last_became_peered":"2024-04-24T02:12:04.766344+0000","last_unstale":"2024-04-24T02:14:09.640725+0000","last_undegraded":"2024-04-24T02:14:09.640725+0000","last_fullsized":"2024-04-24T02:14:09.640725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:28:04.437829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1690,"num_read_kb":1444,"num_write":723,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1471,"ondisk_log_size":1471,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1617,"num_read_kb":1507,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":130,"num_read_kb":83,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51617792,"data_stored":51611392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640302,"num_pgs":152,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52796,"kb_used_data":17460,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94319044,"statfs":{"total":96636764160,"available":96582701056,"internally_reserved":0,"allocated":17879040,"data_stored":17552672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640300,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49212,"kb_used_data":13876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94322628,"statfs":{"total":96636764160,"available":96586371072,"internally_reserved":0,"allocated":14209024,"data_stored":13945472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640302,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48616,"kb_used_data":13280,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323224,"statfs":{"total":96636764160,"available":96586981376,"internally_reserved":0,"allocated":13598720,"data_stored":13308671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705710,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48104,"kb_used_data":8608,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323736,"statfs":{"total":96636764160,"available":96587505664,"internally_reserved":0,"allocated":8814592,"data_stored":8523929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13225984,"data_stored":13222784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":17420288,"data_stored":17417088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T02:15:20.850 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-24T02:15:20.850 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T02:15:20.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.972+0000 7f9c93bfb640 1 Processor -- start 2024-04-24T02:15:20.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.972+0000 7f9c93bfb640 1 -- start start 2024-04-24T02:15:20.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.972+0000 7f9c93bfb640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f9c8c06fd50 0x7f9c8c133860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:20.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.972+0000 7f9c93bfb640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c8c133da0 con 0x7f9c8c06f260 2024-04-24T02:15:20.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.972+0000 7f9c93bfb640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f9c8c070bc0 con 0x7f9c8c06fd50 2024-04-24T02:15:20.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.972+0000 7f9c91196640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f9c8c06fd50 0x7f9c8c133860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:20.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.972+0000 7f9c91997640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f9c8c06f260 0x7f9c8c06f640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:46572/0 (socket says 172.21.15.104:46572) 2024-04-24T02:15:20.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.972+0000 7f9c91997640 1 -- 172.21.15.104:0/1077306885 learned_addr learned my addr 172.21.15.104:0/1077306885 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-04-24T02:15:20.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.972+0000 7f9c91196640 1 -- 172.21.15.104:0/1077306885 >> v1:172.21.15.104:6789/0 conn(0x7f9c8c06f260 legacy=0x7f9c8c06f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:20.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.972+0000 7f9c91196640 1 -- 172.21.15.104:0/1077306885 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c8c134f80 con 0x7f9c8c06fd50 2024-04-24T02:15:20.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.972+0000 7f9c90995640 1 -- 172.21.15.104:0/1077306885 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2144817032 0 0) 0x7f9c8c133da0 con 0x7f9c8c06f260 2024-04-24T02:15:20.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.973+0000 7f9c91196640 1 --2- 172.21.15.104:0/1077306885 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c8c06fd50 0x7f9c8c133860 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f9c88009720 tx=0x7f9c8802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd3adf02132631a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:20.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.973+0000 7f9c90995640 1 -- 172.21.15.104:0/1077306885 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c880316d0 con 0x7f9c8c06fd50 2024-04-24T02:15:20.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.973+0000 7f9c90995640 1 -- 172.21.15.104:0/1077306885 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c88037070 con 0x7f9c8c06fd50 2024-04-24T02:15:20.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.973+0000 7f9c90995640 1 -- 172.21.15.104:0/1077306885 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c880319c0 con 0x7f9c8c06fd50 2024-04-24T02:15:20.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.974+0000 7f9c93bfb640 1 -- 172.21.15.104:0/1077306885 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c8c06fd50 msgr2=0x7f9c8c133860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:20.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.974+0000 7f9c93bfb640 1 --2- 172.21.15.104:0/1077306885 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c8c06fd50 0x7f9c8c133860 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f9c88009720 tx=0x7f9c8802b840 comp rx=0 tx=0).stop 2024-04-24T02:15:20.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.974+0000 7f9c93bfb640 1 -- 172.21.15.104:0/1077306885 shutdown_connections 2024-04-24T02:15:20.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.974+0000 7f9c93bfb640 1 --2- 172.21.15.104:0/1077306885 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c8c06fd50 0x7f9c8c133860 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:20.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.974+0000 7f9c93bfb640 1 -- 172.21.15.104:0/1077306885 >> 172.21.15.104:0/1077306885 conn(0x7f9c8c09e170 msgr2=0x7f9c8c06d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:15:20.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.974+0000 7f9c93bfb640 1 -- 172.21.15.104:0/1077306885 shutdown_connections 2024-04-24T02:15:20.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.974+0000 7f9c93bfb640 1 -- 172.21.15.104:0/1077306885 wait complete. 2024-04-24T02:15:20.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.975+0000 7f9c93bfb640 1 Processor -- start 2024-04-24T02:15:20.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.975+0000 7f9c93bfb640 1 -- start start 2024-04-24T02:15:20.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.975+0000 7f9c93bfb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c8c06f260 0x7f9c8c124320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:20.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.975+0000 7f9c93bfb640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9c8c134300 con 0x7f9c8c06f260 2024-04-24T02:15:20.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.975+0000 7f9c91997640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c8c06f260 0x7f9c8c124320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:20.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.975+0000 7f9c91997640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c8c06f260 0x7f9c8c124320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54306/0 (socket says 172.21.15.104:54306) 2024-04-24T02:15:20.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.975+0000 7f9c91997640 1 -- 172.21.15.104:0/783569761 learned_addr learned my addr 172.21.15.104:0/783569761 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:15:20.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.975+0000 7f9c91997640 1 -- 172.21.15.104:0/783569761 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c8c130bf0 con 0x7f9c8c06f260 2024-04-24T02:15:20.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.975+0000 7f9c91997640 1 --2- 172.21.15.104:0/783569761 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c8c06f260 0x7f9c8c124320 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c00c420 tx=0x7f9c7c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:20.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.975+0000 7f9c827fc640 1 -- 172.21.15.104:0/783569761 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c7c018070 con 0x7f9c8c06f260 2024-04-24T02:15:20.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.975+0000 7f9c827fc640 1 -- 172.21.15.104:0/783569761 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c7c0074d0 con 0x7f9c8c06f260 2024-04-24T02:15:20.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.976+0000 7f9c93bfb640 1 -- 172.21.15.104:0/783569761 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c8c1333a0 con 0x7f9c8c06f260 2024-04-24T02:15:20.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.976+0000 7f9c827fc640 1 -- 172.21.15.104:0/783569761 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c7c004950 con 0x7f9c8c06f260 2024-04-24T02:15:20.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.976+0000 7f9c93bfb640 1 -- 172.21.15.104:0/783569761 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c8c1315d0 con 0x7f9c8c06f260 2024-04-24T02:15:20.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.976+0000 7f9c827fc640 1 -- 172.21.15.104:0/783569761 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9c7c01b070 con 0x7f9c8c06f260 2024-04-24T02:15:20.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.977+0000 7f9c93bfb640 1 -- 172.21.15.104:0/783569761 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c8c0a18a0 con 0x7f9c8c06f260 2024-04-24T02:15:20.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.977+0000 7f9c827fc640 1 --2- 172.21.15.104:0/783569761 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9c70038060 0x7f9c7003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:20.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.977+0000 7f9c827fc640 1 -- 172.21.15.104:0/783569761 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f9c7c04ac70 con 0x7f9c8c06f260 2024-04-24T02:15:20.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.977+0000 7f9c91196640 1 --2- 172.21.15.104:0/783569761 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9c70038060 0x7f9c7003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:20.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.977+0000 7f9c91196640 1 --2- 172.21.15.104:0/783569761 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9c70038060 0x7f9c7003a520 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9c88009720 tx=0x7f9c88008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:20.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:20.981+0000 7f9c827fc640 1 -- 172.21.15.104:0/783569761 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f9c8c0a18a0 con 0x7f9c8c06f260 2024-04-24T02:15:21.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.154+0000 7f9c93bfb640 1 -- 172.21.15.104:0/783569761 --> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9c8c062da0 con 0x7f9c70038060 2024-04-24T02:15:21.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.169+0000 7f9c827fc640 1 -- 172.21.15.104:0/783569761 <== mgr.4101 v2:172.21.15.134:6824/3655027977 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665463 (secure 0 0 0) 0x7f9c8c062da0 con 0x7f9c70038060 2024-04-24T02:15:21.209 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:15:21.213 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-04-24T02:15:21.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.174+0000 7f9c93bfb640 1 -- 172.21.15.104:0/783569761 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9c70038060 msgr2=0x7f9c7003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:21.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.174+0000 7f9c93bfb640 1 --2- 172.21.15.104:0/783569761 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9c70038060 0x7f9c7003a520 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9c88009720 tx=0x7f9c88008030 comp rx=0 tx=0).stop 2024-04-24T02:15:21.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.174+0000 7f9c93bfb640 1 -- 172.21.15.104:0/783569761 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c8c06f260 msgr2=0x7f9c8c124320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:21.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.174+0000 7f9c93bfb640 1 --2- 172.21.15.104:0/783569761 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c8c06f260 0x7f9c8c124320 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c00c420 tx=0x7f9c7c00c8e0 comp rx=0 tx=0).stop 2024-04-24T02:15:21.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.174+0000 7f9c93bfb640 1 -- 172.21.15.104:0/783569761 shutdown_connections 2024-04-24T02:15:21.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.174+0000 7f9c93bfb640 1 --2- 172.21.15.104:0/783569761 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9c70038060 0x7f9c7003a520 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:21.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.174+0000 7f9c93bfb640 1 --2- 172.21.15.104:0/783569761 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c8c06f260 0x7f9c8c124320 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:21.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.174+0000 7f9c93bfb640 1 -- 172.21.15.104:0/783569761 >> 172.21.15.104:0/783569761 conn(0x7f9c8c09e170 msgr2=0x7f9c8c09e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:15:21.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.174+0000 7f9c93bfb640 1 -- 172.21.15.104:0/783569761 shutdown_connections 2024-04-24T02:15:21.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.174+0000 7f9c93bfb640 1 -- 172.21.15.104:0/783569761 wait complete. 2024-04-24T02:15:21.222 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":135,"stamp":"2024-04-24T02:15:20.022016+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412790,"num_objects":259,"num_object_clones":0,"num_object_copies":518,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":259,"num_whiteouts":0,"num_read":5169,"num_read_kb":4718,"num_write":2296,"num_write_kb":61372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4672,"ondisk_log_size":4672,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":198728,"kb_used_data":53224,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377288632,"statfs":{"total":386547056640,"available":386343559168,"internally_reserved":0,"allocated":54501376,"data_stored":53330744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25811688,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":452,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004182"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.810958+0000","last_change":"2024-04-24T02:12:02.755215+0000","last_active":"2024-04-24T02:12:45.810958+0000","last_peered":"2024-04-24T02:12:45.810958+0000","last_clean":"2024-04-24T02:12:45.810958+0000","last_became_active":"2024-04-24T02:12:02.754954+0000","last_became_peered":"2024-04-24T02:12:02.754954+0000","last_unstale":"2024-04-24T02:12:45.810958+0000","last_undegraded":"2024-04-24T02:12:45.810958+0000","last_fullsized":"2024-04-24T02:12:45.810958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:57:48.477966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'8","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.464744+0000","last_change":"2024-04-24T02:12:04.754671+0000","last_active":"2024-04-24T02:15:13.464744+0000","last_peered":"2024-04-24T02:15:13.464744+0000","last_clean":"2024-04-24T02:15:13.464744+0000","last_became_active":"2024-04-24T02:12:04.754049+0000","last_became_peered":"2024-04-24T02:12:04.754049+0000","last_unstale":"2024-04-24T02:15:13.464744+0000","last_undegraded":"2024-04-24T02:15:13.464744+0000","last_fullsized":"2024-04-24T02:15:13.464744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:01:31.183580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.806164+0000","last_change":"2024-04-24T02:12:02.746058+0000","last_active":"2024-04-24T02:12:45.806164+0000","last_peered":"2024-04-24T02:12:45.806164+0000","last_clean":"2024-04-24T02:12:45.806164+0000","last_became_active":"2024-04-24T02:12:02.745526+0000","last_became_peered":"2024-04-24T02:12:02.745526+0000","last_unstale":"2024-04-24T02:12:45.806164+0000","last_undegraded":"2024-04-24T02:12:45.806164+0000","last_fullsized":"2024-04-24T02:12:45.806164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:29:06.156277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'12","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.465045+0000","last_change":"2024-04-24T02:12:04.763554+0000","last_active":"2024-04-24T02:15:13.465045+0000","last_peered":"2024-04-24T02:15:13.465045+0000","last_clean":"2024-04-24T02:15:13.465045+0000","last_became_active":"2024-04-24T02:12:04.762967+0000","last_became_peered":"2024-04-24T02:12:04.762967+0000","last_unstale":"2024-04-24T02:15:13.465045+0000","last_undegraded":"2024-04-24T02:15:13.465045+0000","last_fullsized":"2024-04-24T02:15:13.465045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:22:18.407526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":62,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.812393+0000","last_change":"2024-04-24T02:12:02.761596+0000","last_active":"2024-04-24T02:12:45.812393+0000","last_peered":"2024-04-24T02:12:45.812393+0000","last_clean":"2024-04-24T02:12:45.812393+0000","last_became_active":"2024-04-24T02:12:02.758985+0000","last_became_peered":"2024-04-24T02:12:02.758985+0000","last_unstale":"2024-04-24T02:12:45.812393+0000","last_undegraded":"2024-04-24T02:12:45.812393+0000","last_fullsized":"2024-04-24T02:12:45.812393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:31:31.121870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'6","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:29.125840+0000","last_change":"2024-04-24T02:12:04.765577+0000","last_active":"2024-04-24T02:13:29.125840+0000","last_peered":"2024-04-24T02:13:29.125840+0000","last_clean":"2024-04-24T02:13:29.125840+0000","last_became_active":"2024-04-24T02:12:04.765327+0000","last_became_peered":"2024-04-24T02:12:04.765327+0000","last_unstale":"2024-04-24T02:13:29.125840+0000","last_undegraded":"2024-04-24T02:13:29.125840+0000","last_fullsized":"2024-04-24T02:13:29.125840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:25:46.401212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.806962+0000","last_change":"2024-04-24T02:12:02.745643+0000","last_active":"2024-04-24T02:12:45.806962+0000","last_peered":"2024-04-24T02:12:45.806962+0000","last_clean":"2024-04-24T02:12:45.806962+0000","last_became_active":"2024-04-24T02:12:02.744804+0000","last_became_peered":"2024-04-24T02:12:02.744804+0000","last_unstale":"2024-04-24T02:12:45.806962+0000","last_undegraded":"2024-04-24T02:12:45.806962+0000","last_fullsized":"2024-04-24T02:12:45.806962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:05:35.109941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.167795+0000","last_change":"2024-04-24T02:12:04.763357+0000","last_active":"2024-04-24T02:15:13.167795+0000","last_peered":"2024-04-24T02:15:13.167795+0000","last_clean":"2024-04-24T02:15:13.167795+0000","last_became_active":"2024-04-24T02:12:04.763076+0000","last_became_peered":"2024-04-24T02:12:04.763076+0000","last_unstale":"2024-04-24T02:15:13.167795+0000","last_undegraded":"2024-04-24T02:15:13.167795+0000","last_fullsized":"2024-04-24T02:15:13.167795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:48:52.834838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.675276+0000","last_change":"2024-04-24T02:12:02.755265+0000","last_active":"2024-04-24T02:14:12.675276+0000","last_peered":"2024-04-24T02:14:12.675276+0000","last_clean":"2024-04-24T02:14:12.675276+0000","last_became_active":"2024-04-24T02:12:02.754208+0000","last_became_peered":"2024-04-24T02:12:02.754208+0000","last_unstale":"2024-04-24T02:14:12.675276+0000","last_undegraded":"2024-04-24T02:14:12.675276+0000","last_fullsized":"2024-04-24T02:14:12.675276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:34:23.368475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:09.631727+0000","last_change":"2024-04-24T02:12:04.755521+0000","last_active":"2024-04-24T02:14:09.631727+0000","last_peered":"2024-04-24T02:14:09.631727+0000","last_clean":"2024-04-24T02:14:09.631727+0000","last_became_active":"2024-04-24T02:12:04.755248+0000","last_became_peered":"2024-04-24T02:12:04.755248+0000","last_unstale":"2024-04-24T02:14:09.631727+0000","last_undegraded":"2024-04-24T02:14:09.631727+0000","last_fullsized":"2024-04-24T02:14:09.631727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:24:15.406623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:46.543231+0000","last_change":"2024-04-24T02:12:02.741732+0000","last_active":"2024-04-24T02:12:46.543231+0000","last_peered":"2024-04-24T02:12:46.543231+0000","last_clean":"2024-04-24T02:12:46.543231+0000","last_became_active":"2024-04-24T02:12:02.741326+0000","last_became_peered":"2024-04-24T02:12:02.741326+0000","last_unstale":"2024-04-24T02:12:46.543231+0000","last_undegraded":"2024-04-24T02:12:46.543231+0000","last_fullsized":"2024-04-24T02:12:46.543231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:56:56.371880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'4","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:09.640640+0000","last_change":"2024-04-24T02:12:04.763252+0000","last_active":"2024-04-24T02:14:09.640640+0000","last_peered":"2024-04-24T02:14:09.640640+0000","last_clean":"2024-04-24T02:14:09.640640+0000","last_became_active":"2024-04-24T02:12:04.762921+0000","last_became_peered":"2024-04-24T02:12:04.762921+0000","last_unstale":"2024-04-24T02:14:09.640640+0000","last_undegraded":"2024-04-24T02:14:09.640640+0000","last_fullsized":"2024-04-24T02:14:09.640640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:25:06.019153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.811719+0000","last_change":"2024-04-24T02:12:02.755513+0000","last_active":"2024-04-24T02:12:45.811719+0000","last_peered":"2024-04-24T02:12:45.811719+0000","last_clean":"2024-04-24T02:12:45.811719+0000","last_became_active":"2024-04-24T02:12:02.752921+0000","last_became_peered":"2024-04-24T02:12:02.752921+0000","last_unstale":"2024-04-24T02:12:45.811719+0000","last_undegraded":"2024-04-24T02:12:45.811719+0000","last_fullsized":"2024-04-24T02:12:45.811719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:31:26.988642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'12","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.393931+0000","last_change":"2024-04-24T02:12:04.752549+0000","last_active":"2024-04-24T02:15:13.393931+0000","last_peered":"2024-04-24T02:15:13.393931+0000","last_clean":"2024-04-24T02:15:13.393931+0000","last_became_active":"2024-04-24T02:12:04.751655+0000","last_became_peered":"2024-04-24T02:12:04.751655+0000","last_unstale":"2024-04-24T02:15:13.393931+0000","last_undegraded":"2024-04-24T02:15:13.393931+0000","last_fullsized":"2024-04-24T02:15:13.393931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:31:33.128498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804677+0000","last_change":"2024-04-24T02:12:02.752760+0000","last_active":"2024-04-24T02:12:45.804677+0000","last_peered":"2024-04-24T02:12:45.804677+0000","last_clean":"2024-04-24T02:12:45.804677+0000","last_became_active":"2024-04-24T02:12:02.752476+0000","last_became_peered":"2024-04-24T02:12:02.752476+0000","last_unstale":"2024-04-24T02:12:45.804677+0000","last_undegraded":"2024-04-24T02:12:45.804677+0000","last_fullsized":"2024-04-24T02:12:45.804677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:27:51.241688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'18","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:29.126000+0000","last_change":"2024-04-24T02:12:04.766969+0000","last_active":"2024-04-24T02:13:29.126000+0000","last_peered":"2024-04-24T02:13:29.126000+0000","last_clean":"2024-04-24T02:13:29.126000+0000","last_became_active":"2024-04-24T02:12:04.766693+0000","last_became_peered":"2024-04-24T02:12:04.766693+0000","last_unstale":"2024-04-24T02:13:29.126000+0000","last_undegraded":"2024-04-24T02:13:29.126000+0000","last_fullsized":"2024-04-24T02:13:29.126000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:01:31.183580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.811209+0000","last_change":"2024-04-24T02:12:04.764729+0000","last_active":"2024-04-24T02:12:45.811209+0000","last_peered":"2024-04-24T02:12:45.811209+0000","last_clean":"2024-04-24T02:12:45.811209+0000","last_became_active":"2024-04-24T02:12:04.764470+0000","last_became_peered":"2024-04-24T02:12:04.764470+0000","last_unstale":"2024-04-24T02:12:45.811209+0000","last_undegraded":"2024-04-24T02:12:45.811209+0000","last_fullsized":"2024-04-24T02:12:45.811209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:27:54.808025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:29.115642+0000","last_change":"2024-04-24T02:12:02.754017+0000","last_active":"2024-04-24T02:13:29.115642+0000","last_peered":"2024-04-24T02:13:29.115642+0000","last_clean":"2024-04-24T02:13:29.115642+0000","last_became_active":"2024-04-24T02:12:02.753791+0000","last_became_peered":"2024-04-24T02:12:02.753791+0000","last_unstale":"2024-04-24T02:13:29.115642+0000","last_undegraded":"2024-04-24T02:13:29.115642+0000","last_fullsized":"2024-04-24T02:13:29.115642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:05:35.109941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'10","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.356710+0000","last_change":"2024-04-24T02:12:04.751048+0000","last_active":"2024-04-24T02:15:13.356710+0000","last_peered":"2024-04-24T02:15:13.356710+0000","last_clean":"2024-04-24T02:15:13.356710+0000","last_became_active":"2024-04-24T02:12:04.750774+0000","last_became_peered":"2024-04-24T02:12:04.750774+0000","last_unstale":"2024-04-24T02:15:13.356710+0000","last_undegraded":"2024-04-24T02:15:13.356710+0000","last_fullsized":"2024-04-24T02:15:13.356710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:31:33.128498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.813506+0000","last_change":"2024-04-24T02:12:02.755711+0000","last_active":"2024-04-24T02:12:45.813506+0000","last_peered":"2024-04-24T02:12:45.813506+0000","last_clean":"2024-04-24T02:12:45.813506+0000","last_became_active":"2024-04-24T02:12:02.754860+0000","last_became_peered":"2024-04-24T02:12:02.754860+0000","last_unstale":"2024-04-24T02:12:45.813506+0000","last_undegraded":"2024-04-24T02:12:45.813506+0000","last_fullsized":"2024-04-24T02:12:45.813506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:15:49.257695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'8","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:09.640474+0000","last_change":"2024-04-24T02:12:04.751178+0000","last_active":"2024-04-24T02:14:09.640474+0000","last_peered":"2024-04-24T02:14:09.640474+0000","last_clean":"2024-04-24T02:14:09.640474+0000","last_became_active":"2024-04-24T02:12:04.750919+0000","last_became_peered":"2024-04-24T02:12:04.750919+0000","last_unstale":"2024-04-24T02:14:09.640474+0000","last_undegraded":"2024-04-24T02:14:09.640474+0000","last_fullsized":"2024-04-24T02:14:09.640474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:43:59.642115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:30.040831+0000","last_change":"2024-04-24T02:12:02.756671+0000","last_active":"2024-04-24T02:14:30.040831+0000","last_peered":"2024-04-24T02:14:30.040831+0000","last_clean":"2024-04-24T02:14:30.040831+0000","last_became_active":"2024-04-24T02:12:02.756389+0000","last_became_peered":"2024-04-24T02:12:02.756389+0000","last_unstale":"2024-04-24T02:14:30.040831+0000","last_undegraded":"2024-04-24T02:14:30.040831+0000","last_fullsized":"2024-04-24T02:14:30.040831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:51:48.494870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'1","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:33.036816+0000","last_change":"2024-04-24T02:12:04.767195+0000","last_active":"2024-04-24T02:14:33.036816+0000","last_peered":"2024-04-24T02:14:33.036816+0000","last_clean":"2024-04-24T02:14:33.036816+0000","last_became_active":"2024-04-24T02:12:04.766739+0000","last_became_peered":"2024-04-24T02:12:04.766739+0000","last_unstale":"2024-04-24T02:14:33.036816+0000","last_undegraded":"2024-04-24T02:14:33.036816+0000","last_fullsized":"2024-04-24T02:14:33.036816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:21:04.111831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805201+0000","last_change":"2024-04-24T02:12:02.745281+0000","last_active":"2024-04-24T02:12:45.805201+0000","last_peered":"2024-04-24T02:12:45.805201+0000","last_clean":"2024-04-24T02:12:45.805201+0000","last_became_active":"2024-04-24T02:12:02.744763+0000","last_became_peered":"2024-04-24T02:12:02.744763+0000","last_unstale":"2024-04-24T02:12:45.805201+0000","last_undegraded":"2024-04-24T02:12:45.805201+0000","last_fullsized":"2024-04-24T02:12:45.805201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:15:49.257695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'10","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.394017+0000","last_change":"2024-04-24T02:12:04.764907+0000","last_active":"2024-04-24T02:15:13.394017+0000","last_peered":"2024-04-24T02:15:13.394017+0000","last_clean":"2024-04-24T02:15:13.394017+0000","last_became_active":"2024-04-24T02:12:04.764659+0000","last_became_peered":"2024-04-24T02:12:04.764659+0000","last_unstale":"2024-04-24T02:15:13.394017+0000","last_undegraded":"2024-04-24T02:15:13.394017+0000","last_fullsized":"2024-04-24T02:15:13.394017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:02.847691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.806249+0000","last_change":"2024-04-24T02:12:02.742249+0000","last_active":"2024-04-24T02:12:45.806249+0000","last_peered":"2024-04-24T02:12:45.806249+0000","last_clean":"2024-04-24T02:12:45.806249+0000","last_became_active":"2024-04-24T02:12:02.741976+0000","last_became_peered":"2024-04-24T02:12:02.741976+0000","last_unstale":"2024-04-24T02:12:45.806249+0000","last_undegraded":"2024-04-24T02:12:45.806249+0000","last_fullsized":"2024-04-24T02:12:45.806249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:56:59.627386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'10","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:28.945151+0000","last_change":"2024-04-24T02:12:04.755425+0000","last_active":"2024-04-24T02:13:28.945151+0000","last_peered":"2024-04-24T02:13:28.945151+0000","last_clean":"2024-04-24T02:13:28.945151+0000","last_became_active":"2024-04-24T02:12:04.755133+0000","last_became_peered":"2024-04-24T02:12:04.755133+0000","last_unstale":"2024-04-24T02:13:28.945151+0000","last_undegraded":"2024-04-24T02:13:28.945151+0000","last_fullsized":"2024-04-24T02:13:28.945151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:57:46.692802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.810492+0000","last_change":"2024-04-24T02:12:02.758478+0000","last_active":"2024-04-24T02:12:45.810492+0000","last_peered":"2024-04-24T02:12:45.810492+0000","last_clean":"2024-04-24T02:12:45.810492+0000","last_became_active":"2024-04-24T02:12:02.753196+0000","last_became_peered":"2024-04-24T02:12:02.753196+0000","last_unstale":"2024-04-24T02:12:45.810492+0000","last_undegraded":"2024-04-24T02:12:45.810492+0000","last_fullsized":"2024-04-24T02:12:45.810492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:51:50.235295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'35","reported_seq":99,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.370315+0000","last_change":"2024-04-24T02:12:12.798478+0000","last_active":"2024-04-24T02:15:13.370315+0000","last_peered":"2024-04-24T02:15:13.370315+0000","last_clean":"2024-04-24T02:15:13.370315+0000","last_became_active":"2024-04-24T02:12:12.798179+0000","last_became_peered":"2024-04-24T02:12:12.798179+0000","last_unstale":"2024-04-24T02:15:13.370315+0000","last_undegraded":"2024-04-24T02:15:13.370315+0000","last_fullsized":"2024-04-24T02:15:13.370315+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:44:55.926593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'5","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:25.040642+0000","last_change":"2024-04-24T02:12:04.764143+0000","last_active":"2024-04-24T02:14:25.040642+0000","last_peered":"2024-04-24T02:14:25.040642+0000","last_clean":"2024-04-24T02:14:25.040642+0000","last_became_active":"2024-04-24T02:12:04.763725+0000","last_became_peered":"2024-04-24T02:12:04.763725+0000","last_unstale":"2024-04-24T02:14:25.040642+0000","last_undegraded":"2024-04-24T02:14:25.040642+0000","last_fullsized":"2024-04-24T02:14:25.040642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:47:39.917204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:46.554283+0000","last_change":"2024-04-24T02:12:02.756910+0000","last_active":"2024-04-24T02:12:46.554283+0000","last_peered":"2024-04-24T02:12:46.554283+0000","last_clean":"2024-04-24T02:12:46.554283+0000","last_became_active":"2024-04-24T02:12:02.755520+0000","last_became_peered":"2024-04-24T02:12:02.755520+0000","last_unstale":"2024-04-24T02:12:46.554283+0000","last_undegraded":"2024-04-24T02:12:46.554283+0000","last_fullsized":"2024-04-24T02:12:46.554283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:11:28.150533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.811511+0000","last_change":"2024-04-24T02:12:06.759172+0000","last_active":"2024-04-24T02:12:45.811511+0000","last_peered":"2024-04-24T02:12:45.811511+0000","last_clean":"2024-04-24T02:12:45.811511+0000","last_became_active":"2024-04-24T02:12:06.758033+0000","last_became_peered":"2024-04-24T02:12:06.758033+0000","last_unstale":"2024-04-24T02:12:45.811511+0000","last_undegraded":"2024-04-24T02:12:45.811511+0000","last_fullsized":"2024-04-24T02:12:45.811511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:24.367968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'43","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.344978+0000","last_change":"2024-04-24T02:12:08.783964+0000","last_active":"2024-04-24T02:14:11.344978+0000","last_peered":"2024-04-24T02:14:11.344978+0000","last_clean":"2024-04-24T02:14:11.344978+0000","last_became_active":"2024-04-24T02:12:08.783666+0000","last_became_peered":"2024-04-24T02:12:08.783666+0000","last_unstale":"2024-04-24T02:14:11.344978+0000","last_undegraded":"2024-04-24T02:14:11.344978+0000","last_fullsized":"2024-04-24T02:14:11.344978+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:00:42.425055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804631+0000","last_change":"2024-04-24T02:12:10.787426+0000","last_active":"2024-04-24T02:12:45.804631+0000","last_peered":"2024-04-24T02:12:45.804631+0000","last_clean":"2024-04-24T02:12:45.804631+0000","last_became_active":"2024-04-24T02:12:10.786981+0000","last_became_peered":"2024-04-24T02:12:10.786981+0000","last_unstale":"2024-04-24T02:12:45.804631+0000","last_undegraded":"2024-04-24T02:12:45.804631+0000","last_fullsized":"2024-04-24T02:12:45.804631+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:03:55.174622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:28.953239+0000","last_change":"2024-04-24T02:12:12.797648+0000","last_active":"2024-04-24T02:13:28.953239+0000","last_peered":"2024-04-24T02:13:28.953239+0000","last_clean":"2024-04-24T02:13:28.953239+0000","last_became_active":"2024-04-24T02:12:12.796319+0000","last_became_peered":"2024-04-24T02:12:12.796319+0000","last_unstale":"2024-04-24T02:13:28.953239+0000","last_undegraded":"2024-04-24T02:13:28.953239+0000","last_fullsized":"2024-04-24T02:13:28.953239+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:12:52.743479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.812193+0000","last_change":"2024-04-24T02:12:04.764679+0000","last_active":"2024-04-24T02:12:45.812193+0000","last_peered":"2024-04-24T02:12:45.812193+0000","last_clean":"2024-04-24T02:12:45.812193+0000","last_became_active":"2024-04-24T02:12:04.764351+0000","last_became_peered":"2024-04-24T02:12:04.764351+0000","last_unstale":"2024-04-24T02:12:45.812193+0000","last_undegraded":"2024-04-24T02:12:45.812193+0000","last_fullsized":"2024-04-24T02:12:45.812193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:24:09.733301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.806373+0000","last_change":"2024-04-24T02:12:02.748273+0000","last_active":"2024-04-24T02:12:45.806373+0000","last_peered":"2024-04-24T02:12:45.806373+0000","last_clean":"2024-04-24T02:12:45.806373+0000","last_became_active":"2024-04-24T02:12:02.744030+0000","last_became_peered":"2024-04-24T02:12:02.744030+0000","last_unstale":"2024-04-24T02:12:45.806373+0000","last_undegraded":"2024-04-24T02:12:45.806373+0000","last_fullsized":"2024-04-24T02:12:45.806373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:39:43.304402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805313+0000","last_change":"2024-04-24T02:12:06.758854+0000","last_active":"2024-04-24T02:12:45.805313+0000","last_peered":"2024-04-24T02:12:45.805313+0000","last_clean":"2024-04-24T02:12:45.805313+0000","last_became_active":"2024-04-24T02:12:06.758561+0000","last_became_peered":"2024-04-24T02:12:06.758561+0000","last_unstale":"2024-04-24T02:12:45.805313+0000","last_undegraded":"2024-04-24T02:12:45.805313+0000","last_fullsized":"2024-04-24T02:12:45.805313+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:30:27.876817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"30'12","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804944+0000","last_change":"2024-04-24T02:12:08.767804+0000","last_active":"2024-04-24T02:12:45.804944+0000","last_peered":"2024-04-24T02:12:45.804944+0000","last_clean":"2024-04-24T02:12:45.804944+0000","last_became_active":"2024-04-24T02:12:08.767493+0000","last_became_peered":"2024-04-24T02:12:08.767493+0000","last_unstale":"2024-04-24T02:12:45.804944+0000","last_undegraded":"2024-04-24T02:12:45.804944+0000","last_fullsized":"2024-04-24T02:12:45.804944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:21:18.301632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804318+0000","last_change":"2024-04-24T02:12:10.779679+0000","last_active":"2024-04-24T02:12:45.804318+0000","last_peered":"2024-04-24T02:12:45.804318+0000","last_clean":"2024-04-24T02:12:45.804318+0000","last_became_active":"2024-04-24T02:12:10.779231+0000","last_became_peered":"2024-04-24T02:12:10.779231+0000","last_unstale":"2024-04-24T02:12:45.804318+0000","last_undegraded":"2024-04-24T02:12:45.804318+0000","last_fullsized":"2024-04-24T02:12:45.804318+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:38:27.193760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'8","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:29.122978+0000","last_change":"2024-04-24T02:12:12.791754+0000","last_active":"2024-04-24T02:13:29.122978+0000","last_peered":"2024-04-24T02:13:29.122978+0000","last_clean":"2024-04-24T02:13:29.122978+0000","last_became_active":"2024-04-24T02:12:12.791542+0000","last_became_peered":"2024-04-24T02:12:12.791542+0000","last_unstale":"2024-04-24T02:13:29.122978+0000","last_undegraded":"2024-04-24T02:13:29.122978+0000","last_fullsized":"2024-04-24T02:13:29.122978+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:16:45.741077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.349051+0000","last_change":"2024-04-24T02:12:04.764138+0000","last_active":"2024-04-24T02:15:13.349051+0000","last_peered":"2024-04-24T02:15:13.349051+0000","last_clean":"2024-04-24T02:15:13.349051+0000","last_became_active":"2024-04-24T02:12:04.763491+0000","last_became_peered":"2024-04-24T02:12:04.763491+0000","last_unstale":"2024-04-24T02:15:13.349051+0000","last_undegraded":"2024-04-24T02:15:13.349051+0000","last_fullsized":"2024-04-24T02:15:13.349051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:37:41.541077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"30'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.811251+0000","last_change":"2024-04-24T02:12:02.757002+0000","last_active":"2024-04-24T02:12:45.811251+0000","last_peered":"2024-04-24T02:12:45.811251+0000","last_clean":"2024-04-24T02:12:45.811251+0000","last_became_active":"2024-04-24T02:12:02.755636+0000","last_became_peered":"2024-04-24T02:12:02.755636+0000","last_unstale":"2024-04-24T02:12:45.811251+0000","last_undegraded":"2024-04-24T02:12:45.811251+0000","last_fullsized":"2024-04-24T02:12:45.811251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:55:45.693152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.814863+0000","last_change":"2024-04-24T02:12:45.813418+0000","last_active":"2024-04-24T02:12:45.814863+0000","last_peered":"2024-04-24T02:12:45.814863+0000","last_clean":"2024-04-24T02:12:45.814863+0000","last_became_active":"2024-04-24T02:12:45.813038+0000","last_became_peered":"2024-04-24T02:12:45.813038+0000","last_unstale":"2024-04-24T02:12:45.814863+0000","last_undegraded":"2024-04-24T02:12:45.814863+0000","last_fullsized":"2024-04-24T02:12:45.814863+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:24.367968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"30'22","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.808733+0000","last_change":"2024-04-24T02:12:08.783389+0000","last_active":"2024-04-24T02:12:45.808733+0000","last_peered":"2024-04-24T02:12:45.808733+0000","last_clean":"2024-04-24T02:12:45.808733+0000","last_became_active":"2024-04-24T02:12:08.783077+0000","last_became_peered":"2024-04-24T02:12:08.783077+0000","last_unstale":"2024-04-24T02:12:45.808733+0000","last_undegraded":"2024-04-24T02:12:45.808733+0000","last_fullsized":"2024-04-24T02:12:45.808733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:56:15.426387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'282","reported_seq":404,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:11.839479+0000","last_change":"2024-04-24T02:12:10.784037+0000","last_active":"2024-04-24T02:15:11.839479+0000","last_peered":"2024-04-24T02:15:11.839479+0000","last_clean":"2024-04-24T02:15:11.839479+0000","last_became_active":"2024-04-24T02:12:10.783726+0000","last_became_peered":"2024-04-24T02:12:10.783726+0000","last_unstale":"2024-04-24T02:15:11.839479+0000","last_undegraded":"2024-04-24T02:15:11.839479+0000","last_fullsized":"2024-04-24T02:15:11.839479+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:49:38.926049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.808957+0000","last_change":"2024-04-24T02:12:12.801707+0000","last_active":"2024-04-24T02:12:45.808957+0000","last_peered":"2024-04-24T02:12:45.808957+0000","last_clean":"2024-04-24T02:12:45.808957+0000","last_became_active":"2024-04-24T02:12:12.801331+0000","last_became_peered":"2024-04-24T02:12:12.801331+0000","last_unstale":"2024-04-24T02:12:45.808957+0000","last_undegraded":"2024-04-24T02:12:45.808957+0000","last_fullsized":"2024-04-24T02:12:45.808957+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:10:27.748343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'17","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.400977+0000","last_change":"2024-04-24T02:12:04.756301+0000","last_active":"2024-04-24T02:15:13.400977+0000","last_peered":"2024-04-24T02:15:13.400977+0000","last_clean":"2024-04-24T02:15:13.400977+0000","last_became_active":"2024-04-24T02:12:04.756039+0000","last_became_peered":"2024-04-24T02:12:04.756039+0000","last_unstale":"2024-04-24T02:15:13.400977+0000","last_undegraded":"2024-04-24T02:15:13.400977+0000","last_fullsized":"2024-04-24T02:15:13.400977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:44:45.745380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":60,"num_read_kb":52,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.803334+0000","last_change":"2024-04-24T02:12:02.755651+0000","last_active":"2024-04-24T02:12:45.803334+0000","last_peered":"2024-04-24T02:12:45.803334+0000","last_clean":"2024-04-24T02:12:45.803334+0000","last_became_active":"2024-04-24T02:12:02.754852+0000","last_became_peered":"2024-04-24T02:12:02.754852+0000","last_unstale":"2024-04-24T02:12:45.803334+0000","last_undegraded":"2024-04-24T02:12:45.803334+0000","last_fullsized":"2024-04-24T02:12:45.803334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:02:45.311843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.812440+0000","last_change":"2024-04-24T02:12:06.758372+0000","last_active":"2024-04-24T02:12:45.812440+0000","last_peered":"2024-04-24T02:12:45.812440+0000","last_clean":"2024-04-24T02:12:45.812440+0000","last_became_active":"2024-04-24T02:12:06.757883+0000","last_became_peered":"2024-04-24T02:12:06.757883+0000","last_unstale":"2024-04-24T02:12:45.812440+0000","last_undegraded":"2024-04-24T02:12:45.812440+0000","last_fullsized":"2024-04-24T02:12:45.812440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:30:33.127083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'37","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:35.041555+0000","last_change":"2024-04-24T02:12:08.781239+0000","last_active":"2024-04-24T02:14:35.041555+0000","last_peered":"2024-04-24T02:14:35.041555+0000","last_clean":"2024-04-24T02:14:35.041555+0000","last_became_active":"2024-04-24T02:12:08.780950+0000","last_became_peered":"2024-04-24T02:12:08.780950+0000","last_unstale":"2024-04-24T02:14:35.041555+0000","last_undegraded":"2024-04-24T02:14:35.041555+0000","last_fullsized":"2024-04-24T02:14:35.041555+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:22:22.427553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'282","reported_seq":435,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.470327+0000","last_change":"2024-04-24T02:12:10.778536+0000","last_active":"2024-04-24T02:15:13.470327+0000","last_peered":"2024-04-24T02:15:13.470327+0000","last_clean":"2024-04-24T02:15:13.470327+0000","last_became_active":"2024-04-24T02:12:10.778254+0000","last_became_peered":"2024-04-24T02:12:10.778254+0000","last_unstale":"2024-04-24T02:15:13.470327+0000","last_undegraded":"2024-04-24T02:15:13.470327+0000","last_fullsized":"2024-04-24T02:15:13.470327+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:23:53.259197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.349016+0000","last_change":"2024-04-24T02:12:04.768436+0000","last_active":"2024-04-24T02:15:13.349016+0000","last_peered":"2024-04-24T02:15:13.349016+0000","last_clean":"2024-04-24T02:15:13.349016+0000","last_became_active":"2024-04-24T02:12:04.767906+0000","last_became_peered":"2024-04-24T02:12:04.767906+0000","last_unstale":"2024-04-24T02:15:13.349016+0000","last_undegraded":"2024-04-24T02:15:13.349016+0000","last_fullsized":"2024-04-24T02:15:13.349016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:21:44.832014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"32'3","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:28.904559+0000","last_change":"2024-04-24T02:12:02.749142+0000","last_active":"2024-04-24T02:13:28.904559+0000","last_peered":"2024-04-24T02:13:28.904559+0000","last_clean":"2024-04-24T02:13:28.904559+0000","last_became_active":"2024-04-24T02:12:02.748372+0000","last_became_peered":"2024-04-24T02:12:02.748372+0000","last_unstale":"2024-04-24T02:13:28.904559+0000","last_undegraded":"2024-04-24T02:13:28.904559+0000","last_fullsized":"2024-04-24T02:13:28.904559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:59:32.006851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.803560+0000","last_change":"2024-04-24T02:12:06.764649+0000","last_active":"2024-04-24T02:12:45.803560+0000","last_peered":"2024-04-24T02:12:45.803560+0000","last_clean":"2024-04-24T02:12:45.803560+0000","last_became_active":"2024-04-24T02:12:06.764324+0000","last_became_peered":"2024-04-24T02:12:06.764324+0000","last_unstale":"2024-04-24T02:12:45.803560+0000","last_undegraded":"2024-04-24T02:12:45.803560+0000","last_fullsized":"2024-04-24T02:12:45.803560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:24.266336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'46","reported_seq":99,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.349299+0000","last_change":"2024-04-24T02:12:08.771425+0000","last_active":"2024-04-24T02:14:11.349299+0000","last_peered":"2024-04-24T02:14:11.349299+0000","last_clean":"2024-04-24T02:14:11.349299+0000","last_became_active":"2024-04-24T02:12:08.771060+0000","last_became_peered":"2024-04-24T02:12:08.771060+0000","last_unstale":"2024-04-24T02:14:11.349299+0000","last_undegraded":"2024-04-24T02:14:11.349299+0000","last_fullsized":"2024-04-24T02:14:11.349299+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:04:03.080193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804862+0000","last_change":"2024-04-24T02:12:10.777029+0000","last_active":"2024-04-24T02:12:45.804862+0000","last_peered":"2024-04-24T02:12:45.804862+0000","last_clean":"2024-04-24T02:12:45.804862+0000","last_became_active":"2024-04-24T02:12:10.776715+0000","last_became_peered":"2024-04-24T02:12:10.776715+0000","last_unstale":"2024-04-24T02:12:45.804862+0000","last_undegraded":"2024-04-24T02:12:45.804862+0000","last_fullsized":"2024-04-24T02:12:45.804862+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:05:12.120497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'5","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:28.954965+0000","last_change":"2024-04-24T02:12:12.797751+0000","last_active":"2024-04-24T02:13:28.954965+0000","last_peered":"2024-04-24T02:13:28.954965+0000","last_clean":"2024-04-24T02:13:28.954965+0000","last_became_active":"2024-04-24T02:12:12.797405+0000","last_became_peered":"2024-04-24T02:12:12.797405+0000","last_unstale":"2024-04-24T02:13:28.954965+0000","last_undegraded":"2024-04-24T02:13:28.954965+0000","last_fullsized":"2024-04-24T02:13:28.954965+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:54:48.506969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'10","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.464804+0000","last_change":"2024-04-24T02:12:04.754076+0000","last_active":"2024-04-24T02:15:13.464804+0000","last_peered":"2024-04-24T02:15:13.464804+0000","last_clean":"2024-04-24T02:15:13.464804+0000","last_became_active":"2024-04-24T02:12:04.753819+0000","last_became_peered":"2024-04-24T02:12:04.753819+0000","last_unstale":"2024-04-24T02:15:13.464804+0000","last_undegraded":"2024-04-24T02:15:13.464804+0000","last_fullsized":"2024-04-24T02:15:13.464804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:39:00.502785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.813994+0000","last_change":"2024-04-24T02:12:02.743507+0000","last_active":"2024-04-24T02:12:45.813994+0000","last_peered":"2024-04-24T02:12:45.813994+0000","last_clean":"2024-04-24T02:12:45.813994+0000","last_became_active":"2024-04-24T02:12:02.743202+0000","last_became_peered":"2024-04-24T02:12:02.743202+0000","last_unstale":"2024-04-24T02:12:45.813994+0000","last_undegraded":"2024-04-24T02:12:45.813994+0000","last_fullsized":"2024-04-24T02:12:45.813994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:02:45.311843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805195+0000","last_change":"2024-04-24T02:12:06.765949+0000","last_active":"2024-04-24T02:12:45.805195+0000","last_peered":"2024-04-24T02:12:45.805195+0000","last_clean":"2024-04-24T02:12:45.805195+0000","last_became_active":"2024-04-24T02:12:06.765690+0000","last_became_peered":"2024-04-24T02:12:06.765690+0000","last_unstale":"2024-04-24T02:12:45.805195+0000","last_undegraded":"2024-04-24T02:12:45.805195+0000","last_fullsized":"2024-04-24T02:12:45.805195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:20:26.752873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'38","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.358070+0000","last_change":"2024-04-24T02:12:08.780282+0000","last_active":"2024-04-24T02:15:13.358070+0000","last_peered":"2024-04-24T02:15:13.358070+0000","last_clean":"2024-04-24T02:15:13.358070+0000","last_became_active":"2024-04-24T02:12:08.779594+0000","last_became_peered":"2024-04-24T02:12:08.779594+0000","last_unstale":"2024-04-24T02:15:13.358070+0000","last_undegraded":"2024-04-24T02:15:13.358070+0000","last_fullsized":"2024-04-24T02:15:13.358070+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:31:17.615935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804354+0000","last_change":"2024-04-24T02:12:10.785197+0000","last_active":"2024-04-24T02:12:45.804354+0000","last_peered":"2024-04-24T02:12:45.804354+0000","last_clean":"2024-04-24T02:12:45.804354+0000","last_became_active":"2024-04-24T02:12:10.784901+0000","last_became_peered":"2024-04-24T02:12:10.784901+0000","last_unstale":"2024-04-24T02:12:45.804354+0000","last_undegraded":"2024-04-24T02:12:45.804354+0000","last_fullsized":"2024-04-24T02:12:45.804354+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:08:57.130072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'5","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.396389+0000","last_change":"2024-04-24T02:12:12.795959+0000","last_active":"2024-04-24T02:15:13.396389+0000","last_peered":"2024-04-24T02:15:13.396389+0000","last_clean":"2024-04-24T02:15:13.396389+0000","last_became_active":"2024-04-24T02:12:12.795364+0000","last_became_peered":"2024-04-24T02:12:12.795364+0000","last_unstale":"2024-04-24T02:15:13.396389+0000","last_undegraded":"2024-04-24T02:15:13.396389+0000","last_fullsized":"2024-04-24T02:15:13.396389+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:56:16.695108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'8","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.464931+0000","last_change":"2024-04-24T02:12:04.763127+0000","last_active":"2024-04-24T02:15:13.464931+0000","last_peered":"2024-04-24T02:15:13.464931+0000","last_clean":"2024-04-24T02:15:13.464931+0000","last_became_active":"2024-04-24T02:12:04.762869+0000","last_became_peered":"2024-04-24T02:12:04.762869+0000","last_unstale":"2024-04-24T02:15:13.464931+0000","last_undegraded":"2024-04-24T02:15:13.464931+0000","last_fullsized":"2024-04-24T02:15:13.464931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:55:54.502965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.812086+0000","last_change":"2024-04-24T02:12:02.758980+0000","last_active":"2024-04-24T02:12:45.812086+0000","last_peered":"2024-04-24T02:12:45.812086+0000","last_clean":"2024-04-24T02:12:45.812086+0000","last_became_active":"2024-04-24T02:12:02.757488+0000","last_became_peered":"2024-04-24T02:12:02.757488+0000","last_unstale":"2024-04-24T02:12:45.812086+0000","last_undegraded":"2024-04-24T02:12:45.812086+0000","last_fullsized":"2024-04-24T02:12:45.812086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:39:09.728890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.807289+0000","last_change":"2024-04-24T02:12:06.764973+0000","last_active":"2024-04-24T02:12:45.807289+0000","last_peered":"2024-04-24T02:12:45.807289+0000","last_clean":"2024-04-24T02:12:45.807289+0000","last_became_active":"2024-04-24T02:12:06.764339+0000","last_became_peered":"2024-04-24T02:12:06.764339+0000","last_unstale":"2024-04-24T02:12:45.807289+0000","last_undegraded":"2024-04-24T02:12:45.807289+0000","last_fullsized":"2024-04-24T02:12:45.807289+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:48:03.012278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'48","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.351402+0000","last_change":"2024-04-24T02:12:08.781158+0000","last_active":"2024-04-24T02:14:11.351402+0000","last_peered":"2024-04-24T02:14:11.351402+0000","last_clean":"2024-04-24T02:14:11.351402+0000","last_became_active":"2024-04-24T02:12:08.780230+0000","last_became_peered":"2024-04-24T02:12:08.780230+0000","last_unstale":"2024-04-24T02:14:11.351402+0000","last_undegraded":"2024-04-24T02:14:11.351402+0000","last_fullsized":"2024-04-24T02:14:11.351402+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:53:03.292344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'282","reported_seq":397,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.591168+0000","last_change":"2024-04-24T02:12:10.784581+0000","last_active":"2024-04-24T02:15:13.591168+0000","last_peered":"2024-04-24T02:15:13.591168+0000","last_clean":"2024-04-24T02:15:13.591168+0000","last_became_active":"2024-04-24T02:12:10.784278+0000","last_became_peered":"2024-04-24T02:12:10.784278+0000","last_unstale":"2024-04-24T02:15:13.591168+0000","last_undegraded":"2024-04-24T02:15:13.591168+0000","last_fullsized":"2024-04-24T02:15:13.591168+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:21:58.208138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.190002+0000","last_change":"2024-04-24T02:12:12.792876+0000","last_active":"2024-04-24T02:15:13.190002+0000","last_peered":"2024-04-24T02:15:13.190002+0000","last_clean":"2024-04-24T02:15:13.190002+0000","last_became_active":"2024-04-24T02:12:12.792569+0000","last_became_peered":"2024-04-24T02:12:12.792569+0000","last_unstale":"2024-04-24T02:15:13.190002+0000","last_undegraded":"2024-04-24T02:15:13.190002+0000","last_fullsized":"2024-04-24T02:15:13.190002+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:00:24.269543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'26","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.464740+0000","last_change":"2024-04-24T02:12:04.752393+0000","last_active":"2024-04-24T02:15:13.464740+0000","last_peered":"2024-04-24T02:15:13.464740+0000","last_clean":"2024-04-24T02:15:13.464740+0000","last_became_active":"2024-04-24T02:12:04.752075+0000","last_became_peered":"2024-04-24T02:12:04.752075+0000","last_unstale":"2024-04-24T02:15:13.464740+0000","last_undegraded":"2024-04-24T02:15:13.464740+0000","last_fullsized":"2024-04-24T02:15:13.464740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:15:44.431680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":67,"num_write":30,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.811311+0000","last_change":"2024-04-24T02:12:02.755772+0000","last_active":"2024-04-24T02:12:45.811311+0000","last_peered":"2024-04-24T02:12:45.811311+0000","last_clean":"2024-04-24T02:12:45.811311+0000","last_became_active":"2024-04-24T02:12:02.755468+0000","last_became_peered":"2024-04-24T02:12:02.755468+0000","last_unstale":"2024-04-24T02:12:45.811311+0000","last_undegraded":"2024-04-24T02:12:45.811311+0000","last_fullsized":"2024-04-24T02:12:45.811311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:01:29.176953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804833+0000","last_change":"2024-04-24T02:12:06.764717+0000","last_active":"2024-04-24T02:12:45.804833+0000","last_peered":"2024-04-24T02:12:45.804833+0000","last_clean":"2024-04-24T02:12:45.804833+0000","last_became_active":"2024-04-24T02:12:06.764365+0000","last_became_peered":"2024-04-24T02:12:06.764365+0000","last_unstale":"2024-04-24T02:12:45.804833+0000","last_undegraded":"2024-04-24T02:12:45.804833+0000","last_fullsized":"2024-04-24T02:12:45.804833+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:24:11.723447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'69","reported_seq":137,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.353253+0000","last_change":"2024-04-24T02:12:08.780274+0000","last_active":"2024-04-24T02:14:11.353253+0000","last_peered":"2024-04-24T02:14:11.353253+0000","last_clean":"2024-04-24T02:14:11.353253+0000","last_became_active":"2024-04-24T02:12:08.779602+0000","last_became_peered":"2024-04-24T02:12:08.779602+0000","last_unstale":"2024-04-24T02:14:11.353253+0000","last_undegraded":"2024-04-24T02:14:11.353253+0000","last_fullsized":"2024-04-24T02:14:11.353253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:33:01.634520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804983+0000","last_change":"2024-04-24T02:12:10.782388+0000","last_active":"2024-04-24T02:12:45.804983+0000","last_peered":"2024-04-24T02:12:45.804983+0000","last_clean":"2024-04-24T02:12:45.804983+0000","last_became_active":"2024-04-24T02:12:10.782121+0000","last_became_peered":"2024-04-24T02:12:10.782121+0000","last_unstale":"2024-04-24T02:12:45.804983+0000","last_undegraded":"2024-04-24T02:12:45.804983+0000","last_fullsized":"2024-04-24T02:12:45.804983+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:07:26.897678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'20","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.566391+0000","last_change":"2024-04-24T02:12:12.790210+0000","last_active":"2024-04-24T02:15:13.566391+0000","last_peered":"2024-04-24T02:15:13.566391+0000","last_clean":"2024-04-24T02:15:13.566391+0000","last_became_active":"2024-04-24T02:12:12.789799+0000","last_became_peered":"2024-04-24T02:12:12.789799+0000","last_unstale":"2024-04-24T02:15:13.566391+0000","last_undegraded":"2024-04-24T02:15:13.566391+0000","last_fullsized":"2024-04-24T02:15:13.566391+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:13:23.819613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:28.944905+0000","last_change":"2024-04-24T02:12:04.766750+0000","last_active":"2024-04-24T02:13:28.944905+0000","last_peered":"2024-04-24T02:13:28.944905+0000","last_clean":"2024-04-24T02:13:28.944905+0000","last_became_active":"2024-04-24T02:12:04.766495+0000","last_became_peered":"2024-04-24T02:12:04.766495+0000","last_unstale":"2024-04-24T02:13:28.944905+0000","last_undegraded":"2024-04-24T02:13:28.944905+0000","last_fullsized":"2024-04-24T02:13:28.944905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:26:32.311949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805177+0000","last_change":"2024-04-24T02:12:02.743527+0000","last_active":"2024-04-24T02:12:45.805177+0000","last_peered":"2024-04-24T02:12:45.805177+0000","last_clean":"2024-04-24T02:12:45.805177+0000","last_became_active":"2024-04-24T02:12:02.743204+0000","last_became_peered":"2024-04-24T02:12:02.743204+0000","last_unstale":"2024-04-24T02:12:45.805177+0000","last_undegraded":"2024-04-24T02:12:45.805177+0000","last_fullsized":"2024-04-24T02:12:45.805177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:42:26.915246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.807995+0000","last_change":"2024-04-24T02:12:06.765176+0000","last_active":"2024-04-24T02:12:45.807995+0000","last_peered":"2024-04-24T02:12:45.807995+0000","last_clean":"2024-04-24T02:12:45.807995+0000","last_became_active":"2024-04-24T02:12:06.764676+0000","last_became_peered":"2024-04-24T02:12:06.764676+0000","last_unstale":"2024-04-24T02:12:45.807995+0000","last_undegraded":"2024-04-24T02:12:45.807995+0000","last_fullsized":"2024-04-24T02:12:45.807995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:44:01.649539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'38","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.333417+0000","last_change":"2024-04-24T02:12:08.773725+0000","last_active":"2024-04-24T02:14:11.333417+0000","last_peered":"2024-04-24T02:14:11.333417+0000","last_clean":"2024-04-24T02:14:11.333417+0000","last_became_active":"2024-04-24T02:12:08.773355+0000","last_became_peered":"2024-04-24T02:12:08.773355+0000","last_unstale":"2024-04-24T02:14:11.333417+0000","last_undegraded":"2024-04-24T02:14:11.333417+0000","last_fullsized":"2024-04-24T02:14:11.333417+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:38:42.332605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.813546+0000","last_change":"2024-04-24T02:12:10.784747+0000","last_active":"2024-04-24T02:12:45.813546+0000","last_peered":"2024-04-24T02:12:45.813546+0000","last_clean":"2024-04-24T02:12:45.813546+0000","last_became_active":"2024-04-24T02:12:10.783334+0000","last_became_peered":"2024-04-24T02:12:10.783334+0000","last_unstale":"2024-04-24T02:12:45.813546+0000","last_undegraded":"2024-04-24T02:12:45.813546+0000","last_fullsized":"2024-04-24T02:12:45.813546+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:37:24.863362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:15.038882+0000","last_change":"2024-04-24T02:12:12.794851+0000","last_active":"2024-04-24T02:14:15.038882+0000","last_peered":"2024-04-24T02:14:15.038882+0000","last_clean":"2024-04-24T02:14:15.038882+0000","last_became_active":"2024-04-24T02:12:12.794106+0000","last_became_peered":"2024-04-24T02:12:12.794106+0000","last_unstale":"2024-04-24T02:14:15.038882+0000","last_undegraded":"2024-04-24T02:14:15.038882+0000","last_fullsized":"2024-04-24T02:14:15.038882+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:30:12.595419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'4","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:09.640308+0000","last_change":"2024-04-24T02:12:04.768515+0000","last_active":"2024-04-24T02:14:09.640308+0000","last_peered":"2024-04-24T02:14:09.640308+0000","last_clean":"2024-04-24T02:14:09.640308+0000","last_became_active":"2024-04-24T02:12:04.767376+0000","last_became_peered":"2024-04-24T02:12:04.767376+0000","last_unstale":"2024-04-24T02:14:09.640308+0000","last_undegraded":"2024-04-24T02:14:09.640308+0000","last_fullsized":"2024-04-24T02:14:09.640308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:15:19.870705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.752057+0000","last_change":"2024-04-24T02:12:02.761147+0000","last_active":"2024-04-24T02:14:12.752057+0000","last_peered":"2024-04-24T02:14:12.752057+0000","last_clean":"2024-04-24T02:14:12.752057+0000","last_became_active":"2024-04-24T02:12:02.760317+0000","last_became_peered":"2024-04-24T02:12:02.760317+0000","last_unstale":"2024-04-24T02:14:12.752057+0000","last_undegraded":"2024-04-24T02:14:12.752057+0000","last_fullsized":"2024-04-24T02:14:12.752057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:00:21.940276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.815447+0000","last_change":"2024-04-24T02:12:45.814348+0000","last_active":"2024-04-24T02:12:45.815447+0000","last_peered":"2024-04-24T02:12:45.815447+0000","last_clean":"2024-04-24T02:12:45.815447+0000","last_became_active":"2024-04-24T02:12:45.811272+0000","last_became_peered":"2024-04-24T02:12:45.811272+0000","last_unstale":"2024-04-24T02:12:45.815447+0000","last_undegraded":"2024-04-24T02:12:45.815447+0000","last_fullsized":"2024-04-24T02:12:45.815447+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:50:21.355536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"32'37","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.360247+0000","last_change":"2024-04-24T02:12:08.769681+0000","last_active":"2024-04-24T02:14:11.360247+0000","last_peered":"2024-04-24T02:14:11.360247+0000","last_clean":"2024-04-24T02:14:11.360247+0000","last_became_active":"2024-04-24T02:12:08.769307+0000","last_became_peered":"2024-04-24T02:12:08.769307+0000","last_unstale":"2024-04-24T02:14:11.360247+0000","last_undegraded":"2024-04-24T02:14:11.360247+0000","last_fullsized":"2024-04-24T02:14:11.360247+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:28:14.541427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'282","reported_seq":403,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.571049+0000","last_change":"2024-04-24T02:12:10.779255+0000","last_active":"2024-04-24T02:15:13.571049+0000","last_peered":"2024-04-24T02:15:13.571049+0000","last_clean":"2024-04-24T02:15:13.571049+0000","last_became_active":"2024-04-24T02:12:10.778972+0000","last_became_peered":"2024-04-24T02:12:10.778972+0000","last_unstale":"2024-04-24T02:15:13.571049+0000","last_undegraded":"2024-04-24T02:15:13.571049+0000","last_fullsized":"2024-04-24T02:15:13.571049+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:37:47.569074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'12","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:18.034560+0000","last_change":"2024-04-24T02:12:12.790568+0000","last_active":"2024-04-24T02:14:18.034560+0000","last_peered":"2024-04-24T02:14:18.034560+0000","last_clean":"2024-04-24T02:14:18.034560+0000","last_became_active":"2024-04-24T02:12:12.790353+0000","last_became_peered":"2024-04-24T02:12:12.790353+0000","last_unstale":"2024-04-24T02:14:18.034560+0000","last_undegraded":"2024-04-24T02:14:18.034560+0000","last_fullsized":"2024-04-24T02:14:18.034560+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:03:40.609057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'10","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.465025+0000","last_change":"2024-04-24T02:12:04.760283+0000","last_active":"2024-04-24T02:15:13.465025+0000","last_peered":"2024-04-24T02:15:13.465025+0000","last_clean":"2024-04-24T02:15:13.465025+0000","last_became_active":"2024-04-24T02:12:04.760020+0000","last_became_peered":"2024-04-24T02:12:04.760020+0000","last_unstale":"2024-04-24T02:15:13.465025+0000","last_undegraded":"2024-04-24T02:15:13.465025+0000","last_fullsized":"2024-04-24T02:15:13.465025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:20:27.874953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"32'1","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:15.038970+0000","last_change":"2024-04-24T02:12:02.756829+0000","last_active":"2024-04-24T02:14:15.038970+0000","last_peered":"2024-04-24T02:14:15.038970+0000","last_clean":"2024-04-24T02:14:15.038970+0000","last_became_active":"2024-04-24T02:12:02.753593+0000","last_became_peered":"2024-04-24T02:12:02.753593+0000","last_unstale":"2024-04-24T02:14:15.038970+0000","last_undegraded":"2024-04-24T02:14:15.038970+0000","last_fullsized":"2024-04-24T02:14:15.038970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:22:26.189922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'3","reported_seq":413,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.412629+0000","last_change":"2024-04-24T02:12:06.759063+0000","last_active":"2024-04-24T02:14:12.412629+0000","last_peered":"2024-04-24T02:14:12.412629+0000","last_clean":"2024-04-24T02:14:12.412629+0000","last_became_active":"2024-04-24T02:12:06.758759+0000","last_became_peered":"2024-04-24T02:12:06.758759+0000","last_unstale":"2024-04-24T02:14:12.412629+0000","last_undegraded":"2024-04-24T02:14:12.412629+0000","last_fullsized":"2024-04-24T02:14:12.412629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:00:44.704350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"30'11","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.811579+0000","last_change":"2024-04-24T02:12:08.783278+0000","last_active":"2024-04-24T02:12:45.811579+0000","last_peered":"2024-04-24T02:12:45.811579+0000","last_clean":"2024-04-24T02:12:45.811579+0000","last_became_active":"2024-04-24T02:12:08.783011+0000","last_became_peered":"2024-04-24T02:12:08.783011+0000","last_unstale":"2024-04-24T02:12:45.811579+0000","last_undegraded":"2024-04-24T02:12:45.811579+0000","last_fullsized":"2024-04-24T02:12:45.811579+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:34:35.511797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'282","reported_seq":459,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.528202+0000","last_change":"2024-04-24T02:12:10.777668+0000","last_active":"2024-04-24T02:15:13.528202+0000","last_peered":"2024-04-24T02:15:13.528202+0000","last_clean":"2024-04-24T02:15:13.528202+0000","last_became_active":"2024-04-24T02:12:10.777222+0000","last_became_peered":"2024-04-24T02:12:10.777222+0000","last_unstale":"2024-04-24T02:15:13.528202+0000","last_undegraded":"2024-04-24T02:15:13.528202+0000","last_fullsized":"2024-04-24T02:15:13.528202+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:38:54.174398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.545828+0000","last_change":"2024-04-24T02:12:12.795499+0000","last_active":"2024-04-24T02:14:12.545828+0000","last_peered":"2024-04-24T02:14:12.545828+0000","last_clean":"2024-04-24T02:14:12.545828+0000","last_became_active":"2024-04-24T02:12:12.795204+0000","last_became_peered":"2024-04-24T02:12:12.795204+0000","last_unstale":"2024-04-24T02:14:12.545828+0000","last_undegraded":"2024-04-24T02:14:12.545828+0000","last_fullsized":"2024-04-24T02:14:12.545828+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:02:53.179496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.777605+0000","last_change":"2024-04-24T02:12:04.766853+0000","last_active":"2024-04-24T02:14:12.777605+0000","last_peered":"2024-04-24T02:14:12.777605+0000","last_clean":"2024-04-24T02:14:12.777605+0000","last_became_active":"2024-04-24T02:12:04.766540+0000","last_became_peered":"2024-04-24T02:12:04.766540+0000","last_unstale":"2024-04-24T02:14:12.777605+0000","last_undegraded":"2024-04-24T02:14:12.777605+0000","last_fullsized":"2024-04-24T02:14:12.777605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:43:13.413941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"32'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:46.556834+0000","last_change":"2024-04-24T02:12:02.760628+0000","last_active":"2024-04-24T02:12:46.556834+0000","last_peered":"2024-04-24T02:12:46.556834+0000","last_clean":"2024-04-24T02:12:46.556834+0000","last_became_active":"2024-04-24T02:12:02.757717+0000","last_became_peered":"2024-04-24T02:12:02.757717+0000","last_unstale":"2024-04-24T02:12:46.556834+0000","last_undegraded":"2024-04-24T02:12:46.556834+0000","last_fullsized":"2024-04-24T02:12:46.556834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:55:52.496337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.811769+0000","last_change":"2024-04-24T02:12:06.758742+0000","last_active":"2024-04-24T02:12:45.811769+0000","last_peered":"2024-04-24T02:12:45.811769+0000","last_clean":"2024-04-24T02:12:45.811769+0000","last_became_active":"2024-04-24T02:12:06.758452+0000","last_became_peered":"2024-04-24T02:12:06.758452+0000","last_unstale":"2024-04-24T02:12:45.811769+0000","last_undegraded":"2024-04-24T02:12:45.811769+0000","last_fullsized":"2024-04-24T02:12:45.811769+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:54:56.942552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'39","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:25.040028+0000","last_change":"2024-04-24T02:12:08.773650+0000","last_active":"2024-04-24T02:14:25.040028+0000","last_peered":"2024-04-24T02:14:25.040028+0000","last_clean":"2024-04-24T02:14:25.040028+0000","last_became_active":"2024-04-24T02:12:08.773319+0000","last_became_peered":"2024-04-24T02:12:08.773319+0000","last_unstale":"2024-04-24T02:14:25.040028+0000","last_undegraded":"2024-04-24T02:14:25.040028+0000","last_fullsized":"2024-04-24T02:14:25.040028+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:39:13.898594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5807,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":43,"num_read_kb":33,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.807176+0000","last_change":"2024-04-24T02:12:10.787285+0000","last_active":"2024-04-24T02:12:45.807176+0000","last_peered":"2024-04-24T02:12:45.807176+0000","last_clean":"2024-04-24T02:12:45.807176+0000","last_became_active":"2024-04-24T02:12:10.786998+0000","last_became_peered":"2024-04-24T02:12:10.786998+0000","last_unstale":"2024-04-24T02:12:45.807176+0000","last_undegraded":"2024-04-24T02:12:45.807176+0000","last_fullsized":"2024-04-24T02:12:45.807176+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:23:30.529184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'6","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.502555+0000","last_change":"2024-04-24T02:12:12.795209+0000","last_active":"2024-04-24T02:15:13.502555+0000","last_peered":"2024-04-24T02:15:13.502555+0000","last_clean":"2024-04-24T02:15:13.502555+0000","last_became_active":"2024-04-24T02:12:12.793724+0000","last_became_peered":"2024-04-24T02:12:12.793724+0000","last_unstale":"2024-04-24T02:15:13.502555+0000","last_undegraded":"2024-04-24T02:15:13.502555+0000","last_fullsized":"2024-04-24T02:15:13.502555+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:43:28.725420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.766426+0000","last_change":"2024-04-24T02:12:04.764441+0000","last_active":"2024-04-24T02:14:12.766426+0000","last_peered":"2024-04-24T02:14:12.766426+0000","last_clean":"2024-04-24T02:14:12.766426+0000","last_became_active":"2024-04-24T02:12:04.763246+0000","last_became_peered":"2024-04-24T02:12:04.763246+0000","last_unstale":"2024-04-24T02:14:12.766426+0000","last_undegraded":"2024-04-24T02:14:12.766426+0000","last_fullsized":"2024-04-24T02:14:12.766426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:01:31.738903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":199,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.802977+0000","last_change":"2024-04-24T02:11:51.990441+0000","last_active":"2024-04-24T02:12:45.802977+0000","last_peered":"2024-04-24T02:12:45.802977+0000","last_clean":"2024-04-24T02:12:45.802977+0000","last_became_active":"2024-04-24T02:11:51.989479+0000","last_became_peered":"2024-04-24T02:11:51.989479+0000","last_unstale":"2024-04-24T02:12:45.802977+0000","last_undegraded":"2024-04-24T02:12:45.802977+0000","last_fullsized":"2024-04-24T02:12:45.802977+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:50.697037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:50.697037+0000","last_clean_scrub_stamp":"2024-04-24T02:11:50.697037+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:59:33.037844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.810884+0000","last_change":"2024-04-24T02:11:56.724372+0000","last_active":"2024-04-24T02:12:45.810884+0000","last_peered":"2024-04-24T02:12:45.810884+0000","last_clean":"2024-04-24T02:12:45.810884+0000","last_became_active":"2024-04-24T02:11:56.723925+0000","last_became_peered":"2024-04-24T02:11:56.723925+0000","last_unstale":"2024-04-24T02:12:45.810884+0000","last_undegraded":"2024-04-24T02:12:45.810884+0000","last_fullsized":"2024-04-24T02:12:45.810884+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:03:43.918155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.809983+0000","last_change":"2024-04-24T02:12:02.758997+0000","last_active":"2024-04-24T02:12:45.809983+0000","last_peered":"2024-04-24T02:12:45.809983+0000","last_clean":"2024-04-24T02:12:45.809983+0000","last_became_active":"2024-04-24T02:12:02.758653+0000","last_became_peered":"2024-04-24T02:12:02.758653+0000","last_unstale":"2024-04-24T02:12:45.809983+0000","last_undegraded":"2024-04-24T02:12:45.809983+0000","last_fullsized":"2024-04-24T02:12:45.809983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:04:14.072260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"23'1","reported_seq":218,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.412883+0000","last_change":"2024-04-24T02:12:06.757529+0000","last_active":"2024-04-24T02:14:12.412883+0000","last_peered":"2024-04-24T02:14:12.412883+0000","last_clean":"2024-04-24T02:14:12.412883+0000","last_became_active":"2024-04-24T02:12:06.757173+0000","last_became_peered":"2024-04-24T02:12:06.757173+0000","last_unstale":"2024-04-24T02:14:12.412883+0000","last_undegraded":"2024-04-24T02:14:12.412883+0000","last_fullsized":"2024-04-24T02:14:12.412883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:25:48.408637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'82","reported_seq":157,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.357685+0000","last_change":"2024-04-24T02:12:08.781224+0000","last_active":"2024-04-24T02:14:11.357685+0000","last_peered":"2024-04-24T02:14:11.357685+0000","last_clean":"2024-04-24T02:14:11.357685+0000","last_became_active":"2024-04-24T02:12:08.780923+0000","last_became_peered":"2024-04-24T02:12:08.780923+0000","last_unstale":"2024-04-24T02:14:11.357685+0000","last_undegraded":"2024-04-24T02:14:11.357685+0000","last_fullsized":"2024-04-24T02:14:11.357685+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:26:20.925750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.806595+0000","last_change":"2024-04-24T02:12:10.784443+0000","last_active":"2024-04-24T02:12:45.806595+0000","last_peered":"2024-04-24T02:12:45.806595+0000","last_clean":"2024-04-24T02:12:45.806595+0000","last_became_active":"2024-04-24T02:12:10.784101+0000","last_became_peered":"2024-04-24T02:12:10.784101+0000","last_unstale":"2024-04-24T02:12:45.806595+0000","last_undegraded":"2024-04-24T02:12:45.806595+0000","last_fullsized":"2024-04-24T02:12:45.806595+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:41:35.662091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'81","reported_seq":162,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.478759+0000","last_change":"2024-04-24T02:12:12.795520+0000","last_active":"2024-04-24T02:15:13.478759+0000","last_peered":"2024-04-24T02:15:13.478759+0000","last_clean":"2024-04-24T02:15:13.478759+0000","last_became_active":"2024-04-24T02:12:12.795281+0000","last_became_peered":"2024-04-24T02:12:12.795281+0000","last_unstale":"2024-04-24T02:15:13.478759+0000","last_undegraded":"2024-04-24T02:15:13.478759+0000","last_fullsized":"2024-04-24T02:15:13.478759+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:12:13.247301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.349374+0000","last_change":"2024-04-24T02:12:04.764296+0000","last_active":"2024-04-24T02:15:13.349374+0000","last_peered":"2024-04-24T02:15:13.349374+0000","last_clean":"2024-04-24T02:15:13.349374+0000","last_became_active":"2024-04-24T02:12:04.763782+0000","last_became_peered":"2024-04-24T02:12:04.763782+0000","last_unstale":"2024-04-24T02:15:13.349374+0000","last_undegraded":"2024-04-24T02:15:13.349374+0000","last_fullsized":"2024-04-24T02:15:13.349374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:23:24.501187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.808625+0000","last_change":"2024-04-24T02:11:56.724008+0000","last_active":"2024-04-24T02:12:45.808625+0000","last_peered":"2024-04-24T02:12:45.808625+0000","last_clean":"2024-04-24T02:12:45.808625+0000","last_became_active":"2024-04-24T02:11:56.723682+0000","last_became_peered":"2024-04-24T02:11:56.723682+0000","last_unstale":"2024-04-24T02:12:45.808625+0000","last_undegraded":"2024-04-24T02:12:45.808625+0000","last_fullsized":"2024-04-24T02:12:45.808625+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:32:18.958074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"30'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804843+0000","last_change":"2024-04-24T02:12:02.742006+0000","last_active":"2024-04-24T02:12:45.804843+0000","last_peered":"2024-04-24T02:12:45.804843+0000","last_clean":"2024-04-24T02:12:45.804843+0000","last_became_active":"2024-04-24T02:12:02.741610+0000","last_became_peered":"2024-04-24T02:12:02.741610+0000","last_unstale":"2024-04-24T02:12:45.804843+0000","last_undegraded":"2024-04-24T02:12:45.804843+0000","last_fullsized":"2024-04-24T02:12:45.804843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:51:28.003991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.814410+0000","last_change":"2024-04-24T02:12:06.757365+0000","last_active":"2024-04-24T02:12:45.814410+0000","last_peered":"2024-04-24T02:12:45.814410+0000","last_clean":"2024-04-24T02:12:45.814410+0000","last_became_active":"2024-04-24T02:12:06.757052+0000","last_became_peered":"2024-04-24T02:12:06.757052+0000","last_unstale":"2024-04-24T02:12:45.814410+0000","last_undegraded":"2024-04-24T02:12:45.814410+0000","last_fullsized":"2024-04-24T02:12:45.814410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:03:51.154050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'280","reported_seq":489,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:11.839565+0000","last_change":"2024-04-24T02:12:08.780195+0000","last_active":"2024-04-24T02:15:11.839565+0000","last_peered":"2024-04-24T02:15:11.839565+0000","last_clean":"2024-04-24T02:15:11.839565+0000","last_became_active":"2024-04-24T02:12:08.779884+0000","last_became_peered":"2024-04-24T02:12:08.779884+0000","last_unstale":"2024-04-24T02:15:11.839565+0000","last_undegraded":"2024-04-24T02:15:11.839565+0000","last_fullsized":"2024-04-24T02:15:11.839565+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:39:29.226371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":366,"num_read_kb":350,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.811202+0000","last_change":"2024-04-24T02:12:10.784601+0000","last_active":"2024-04-24T02:12:45.811202+0000","last_peered":"2024-04-24T02:12:45.811202+0000","last_clean":"2024-04-24T02:12:45.811202+0000","last_became_active":"2024-04-24T02:12:10.783788+0000","last_became_peered":"2024-04-24T02:12:10.783788+0000","last_unstale":"2024-04-24T02:12:45.811202+0000","last_undegraded":"2024-04-24T02:12:45.811202+0000","last_fullsized":"2024-04-24T02:12:45.811202+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:11:51.847310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:28.951418+0000","last_change":"2024-04-24T02:12:12.796284+0000","last_active":"2024-04-24T02:13:28.951418+0000","last_peered":"2024-04-24T02:13:28.951418+0000","last_clean":"2024-04-24T02:13:28.951418+0000","last_became_active":"2024-04-24T02:12:12.795983+0000","last_became_peered":"2024-04-24T02:12:12.795983+0000","last_unstale":"2024-04-24T02:13:28.951418+0000","last_undegraded":"2024-04-24T02:13:28.951418+0000","last_fullsized":"2024-04-24T02:13:28.951418+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:51:33.324014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'22","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.169911+0000","last_change":"2024-04-24T02:12:04.756013+0000","last_active":"2024-04-24T02:15:13.169911+0000","last_peered":"2024-04-24T02:15:13.169911+0000","last_clean":"2024-04-24T02:15:13.169911+0000","last_became_active":"2024-04-24T02:12:04.755649+0000","last_became_peered":"2024-04-24T02:12:04.755649+0000","last_unstale":"2024-04-24T02:15:13.169911+0000","last_undegraded":"2024-04-24T02:15:13.169911+0000","last_fullsized":"2024-04-24T02:15:13.169911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:57:24.304456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":72,"num_write":29,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805377+0000","last_change":"2024-04-24T02:11:56.724010+0000","last_active":"2024-04-24T02:12:45.805377+0000","last_peered":"2024-04-24T02:12:45.805377+0000","last_clean":"2024-04-24T02:12:45.805377+0000","last_became_active":"2024-04-24T02:11:56.723497+0000","last_became_peered":"2024-04-24T02:11:56.723497+0000","last_unstale":"2024-04-24T02:12:45.805377+0000","last_undegraded":"2024-04-24T02:12:45.805377+0000","last_fullsized":"2024-04-24T02:12:45.805377+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:26:11.265014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'1","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:03.032259+0000","last_change":"2024-04-24T02:12:02.745574+0000","last_active":"2024-04-24T02:14:03.032259+0000","last_peered":"2024-04-24T02:14:03.032259+0000","last_clean":"2024-04-24T02:14:03.032259+0000","last_became_active":"2024-04-24T02:12:02.745238+0000","last_became_peered":"2024-04-24T02:12:02.745238+0000","last_unstale":"2024-04-24T02:14:03.032259+0000","last_undegraded":"2024-04-24T02:14:03.032259+0000","last_fullsized":"2024-04-24T02:14:03.032259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:18:53.552200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.813613+0000","last_change":"2024-04-24T02:12:06.757374+0000","last_active":"2024-04-24T02:12:45.813613+0000","last_peered":"2024-04-24T02:12:45.813613+0000","last_clean":"2024-04-24T02:12:45.813613+0000","last_became_active":"2024-04-24T02:12:06.757009+0000","last_became_peered":"2024-04-24T02:12:06.757009+0000","last_unstale":"2024-04-24T02:12:45.813613+0000","last_undegraded":"2024-04-24T02:12:45.813613+0000","last_fullsized":"2024-04-24T02:12:45.813613+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:26:34.319373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'16","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:11.839804+0000","last_change":"2024-04-24T02:12:08.774513+0000","last_active":"2024-04-24T02:15:11.839804+0000","last_peered":"2024-04-24T02:15:11.839804+0000","last_clean":"2024-04-24T02:15:11.839804+0000","last_became_active":"2024-04-24T02:12:08.774177+0000","last_became_peered":"2024-04-24T02:12:08.774177+0000","last_unstale":"2024-04-24T02:15:11.839804+0000","last_undegraded":"2024-04-24T02:15:11.839804+0000","last_fullsized":"2024-04-24T02:15:11.839804+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:27:58.828052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805416+0000","last_change":"2024-04-24T02:12:10.784579+0000","last_active":"2024-04-24T02:12:45.805416+0000","last_peered":"2024-04-24T02:12:45.805416+0000","last_clean":"2024-04-24T02:12:45.805416+0000","last_became_active":"2024-04-24T02:12:10.784247+0000","last_became_peered":"2024-04-24T02:12:10.784247+0000","last_unstale":"2024-04-24T02:12:45.805416+0000","last_undegraded":"2024-04-24T02:12:45.805416+0000","last_fullsized":"2024-04-24T02:12:45.805416+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:05:36.775186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.772420+0000","last_change":"2024-04-24T02:12:12.794755+0000","last_active":"2024-04-24T02:14:12.772420+0000","last_peered":"2024-04-24T02:14:12.772420+0000","last_clean":"2024-04-24T02:14:12.772420+0000","last_became_active":"2024-04-24T02:12:12.794453+0000","last_became_peered":"2024-04-24T02:12:12.794453+0000","last_unstale":"2024-04-24T02:14:12.772420+0000","last_undegraded":"2024-04-24T02:14:12.772420+0000","last_fullsized":"2024-04-24T02:14:12.772420+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:14:32.909095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'3","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:13.033851+0000","last_change":"2024-04-24T02:12:04.749524+0000","last_active":"2024-04-24T02:14:13.033851+0000","last_peered":"2024-04-24T02:14:13.033851+0000","last_clean":"2024-04-24T02:14:13.033851+0000","last_became_active":"2024-04-24T02:12:04.749173+0000","last_became_peered":"2024-04-24T02:12:04.749173+0000","last_unstale":"2024-04-24T02:14:13.033851+0000","last_undegraded":"2024-04-24T02:14:13.033851+0000","last_fullsized":"2024-04-24T02:14:13.033851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:58:09.943964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.809808+0000","last_change":"2024-04-24T02:11:56.723425+0000","last_active":"2024-04-24T02:12:45.809808+0000","last_peered":"2024-04-24T02:12:45.809808+0000","last_clean":"2024-04-24T02:12:45.809808+0000","last_became_active":"2024-04-24T02:11:56.723125+0000","last_became_peered":"2024-04-24T02:11:56.723125+0000","last_unstale":"2024-04-24T02:12:45.809808+0000","last_undegraded":"2024-04-24T02:12:45.809808+0000","last_fullsized":"2024-04-24T02:12:45.809808+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:48:12.516334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.808101+0000","last_change":"2024-04-24T02:12:02.746939+0000","last_active":"2024-04-24T02:12:45.808101+0000","last_peered":"2024-04-24T02:12:45.808101+0000","last_clean":"2024-04-24T02:12:45.808101+0000","last_became_active":"2024-04-24T02:12:02.746682+0000","last_became_peered":"2024-04-24T02:12:02.746682+0000","last_unstale":"2024-04-24T02:12:45.808101+0000","last_undegraded":"2024-04-24T02:12:45.808101+0000","last_fullsized":"2024-04-24T02:12:45.808101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:51:48.494870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.806518+0000","last_change":"2024-04-24T02:12:06.759484+0000","last_active":"2024-04-24T02:12:45.806518+0000","last_peered":"2024-04-24T02:12:45.806518+0000","last_clean":"2024-04-24T02:12:45.806518+0000","last_became_active":"2024-04-24T02:12:06.759169+0000","last_became_peered":"2024-04-24T02:12:06.759169+0000","last_unstale":"2024-04-24T02:12:45.806518+0000","last_undegraded":"2024-04-24T02:12:45.806518+0000","last_fullsized":"2024-04-24T02:12:45.806518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:44:21.656525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'13","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:12.792900+0000","last_change":"2024-04-24T02:12:08.783178+0000","last_active":"2024-04-24T02:15:12.792900+0000","last_peered":"2024-04-24T02:15:12.792900+0000","last_clean":"2024-04-24T02:15:12.792900+0000","last_became_active":"2024-04-24T02:12:08.782765+0000","last_became_peered":"2024-04-24T02:12:08.782765+0000","last_unstale":"2024-04-24T02:15:12.792900+0000","last_undegraded":"2024-04-24T02:15:12.792900+0000","last_fullsized":"2024-04-24T02:15:12.792900+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:43:33.627490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.813589+0000","last_change":"2024-04-24T02:12:10.785313+0000","last_active":"2024-04-24T02:12:45.813589+0000","last_peered":"2024-04-24T02:12:45.813589+0000","last_clean":"2024-04-24T02:12:45.813589+0000","last_became_active":"2024-04-24T02:12:10.783813+0000","last_became_peered":"2024-04-24T02:12:10.783813+0000","last_unstale":"2024-04-24T02:12:45.813589+0000","last_undegraded":"2024-04-24T02:12:45.813589+0000","last_fullsized":"2024-04-24T02:12:45.813589+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:29:00.483135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.525281+0000","last_change":"2024-04-24T02:12:12.797895+0000","last_active":"2024-04-24T02:14:12.525281+0000","last_peered":"2024-04-24T02:14:12.525281+0000","last_clean":"2024-04-24T02:14:12.525281+0000","last_became_active":"2024-04-24T02:12:12.796507+0000","last_became_peered":"2024-04-24T02:12:12.796507+0000","last_unstale":"2024-04-24T02:14:12.525281+0000","last_undegraded":"2024-04-24T02:14:12.525281+0000","last_fullsized":"2024-04-24T02:14:12.525281+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:24:58.744108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:28.945114+0000","last_change":"2024-04-24T02:12:04.767815+0000","last_active":"2024-04-24T02:13:28.945114+0000","last_peered":"2024-04-24T02:13:28.945114+0000","last_clean":"2024-04-24T02:13:28.945114+0000","last_became_active":"2024-04-24T02:12:04.767221+0000","last_became_peered":"2024-04-24T02:12:04.767221+0000","last_unstale":"2024-04-24T02:13:28.945114+0000","last_undegraded":"2024-04-24T02:13:28.945114+0000","last_fullsized":"2024-04-24T02:13:28.945114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:20:27.874953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.808341+0000","last_change":"2024-04-24T02:12:02.747860+0000","last_active":"2024-04-24T02:12:45.808341+0000","last_peered":"2024-04-24T02:12:45.808341+0000","last_clean":"2024-04-24T02:12:45.808341+0000","last_became_active":"2024-04-24T02:12:02.744161+0000","last_became_peered":"2024-04-24T02:12:02.744161+0000","last_unstale":"2024-04-24T02:12:45.808341+0000","last_undegraded":"2024-04-24T02:12:45.808341+0000","last_fullsized":"2024-04-24T02:12:45.808341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:30:58.417438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805335+0000","last_change":"2024-04-24T02:11:56.723976+0000","last_active":"2024-04-24T02:12:45.805335+0000","last_peered":"2024-04-24T02:12:45.805335+0000","last_clean":"2024-04-24T02:12:45.805335+0000","last_became_active":"2024-04-24T02:11:56.723697+0000","last_became_peered":"2024-04-24T02:11:56.723697+0000","last_unstale":"2024-04-24T02:12:45.805335+0000","last_undegraded":"2024-04-24T02:12:45.805335+0000","last_fullsized":"2024-04-24T02:12:45.805335+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:00:04.661481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'1","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:13.033798+0000","last_change":"2024-04-24T02:12:06.759464+0000","last_active":"2024-04-24T02:14:13.033798+0000","last_peered":"2024-04-24T02:14:13.033798+0000","last_clean":"2024-04-24T02:14:13.033798+0000","last_became_active":"2024-04-24T02:12:06.759160+0000","last_became_peered":"2024-04-24T02:12:06.759160+0000","last_unstale":"2024-04-24T02:14:13.033798+0000","last_undegraded":"2024-04-24T02:14:13.033798+0000","last_fullsized":"2024-04-24T02:14:13.033798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:02:59.130069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'73","reported_seq":144,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.359157+0000","last_change":"2024-04-24T02:12:08.780903+0000","last_active":"2024-04-24T02:14:11.359157+0000","last_peered":"2024-04-24T02:14:11.359157+0000","last_clean":"2024-04-24T02:14:11.359157+0000","last_became_active":"2024-04-24T02:12:08.780688+0000","last_became_peered":"2024-04-24T02:12:08.780688+0000","last_unstale":"2024-04-24T02:14:11.359157+0000","last_undegraded":"2024-04-24T02:14:11.359157+0000","last_fullsized":"2024-04-24T02:14:11.359157+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:25:49.361496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":77,"num_read_kb":63,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.806759+0000","last_change":"2024-04-24T02:12:10.781922+0000","last_active":"2024-04-24T02:12:45.806759+0000","last_peered":"2024-04-24T02:12:45.806759+0000","last_clean":"2024-04-24T02:12:45.806759+0000","last_became_active":"2024-04-24T02:12:10.781586+0000","last_became_peered":"2024-04-24T02:12:10.781586+0000","last_unstale":"2024-04-24T02:12:45.806759+0000","last_undegraded":"2024-04-24T02:12:45.806759+0000","last_fullsized":"2024-04-24T02:12:45.806759+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:24:04.726684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'9","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.708334+0000","last_change":"2024-04-24T02:12:12.798530+0000","last_active":"2024-04-24T02:14:12.708334+0000","last_peered":"2024-04-24T02:14:12.708334+0000","last_clean":"2024-04-24T02:14:12.708334+0000","last_became_active":"2024-04-24T02:12:12.798272+0000","last_became_peered":"2024-04-24T02:12:12.798272+0000","last_unstale":"2024-04-24T02:14:12.708334+0000","last_undegraded":"2024-04-24T02:14:12.708334+0000","last_fullsized":"2024-04-24T02:14:12.708334+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:58:10.660903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'6","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.766875+0000","last_change":"2024-04-24T02:12:04.765396+0000","last_active":"2024-04-24T02:14:12.766875+0000","last_peered":"2024-04-24T02:14:12.766875+0000","last_clean":"2024-04-24T02:14:12.766875+0000","last_became_active":"2024-04-24T02:12:04.765093+0000","last_became_peered":"2024-04-24T02:12:04.765093+0000","last_unstale":"2024-04-24T02:14:12.766875+0000","last_undegraded":"2024-04-24T02:14:12.766875+0000","last_fullsized":"2024-04-24T02:14:12.766875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:25:06.512394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805538+0000","last_change":"2024-04-24T02:12:02.741909+0000","last_active":"2024-04-24T02:12:45.805538+0000","last_peered":"2024-04-24T02:12:45.805538+0000","last_clean":"2024-04-24T02:12:45.805538+0000","last_became_active":"2024-04-24T02:12:02.741565+0000","last_became_peered":"2024-04-24T02:12:02.741565+0000","last_unstale":"2024-04-24T02:12:45.805538+0000","last_undegraded":"2024-04-24T02:12:45.805538+0000","last_fullsized":"2024-04-24T02:12:45.805538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:11:16.086557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.811832+0000","last_change":"2024-04-24T02:11:56.724046+0000","last_active":"2024-04-24T02:12:45.811832+0000","last_peered":"2024-04-24T02:12:45.811832+0000","last_clean":"2024-04-24T02:12:45.811832+0000","last_became_active":"2024-04-24T02:11:56.723673+0000","last_became_peered":"2024-04-24T02:11:56.723673+0000","last_unstale":"2024-04-24T02:12:45.811832+0000","last_undegraded":"2024-04-24T02:12:45.811832+0000","last_fullsized":"2024-04-24T02:12:45.811832+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:24:47.683078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.810339+0000","last_change":"2024-04-24T02:12:06.756068+0000","last_active":"2024-04-24T02:12:45.810339+0000","last_peered":"2024-04-24T02:12:45.810339+0000","last_clean":"2024-04-24T02:12:45.810339+0000","last_became_active":"2024-04-24T02:12:06.755760+0000","last_became_peered":"2024-04-24T02:12:06.755760+0000","last_unstale":"2024-04-24T02:12:45.810339+0000","last_undegraded":"2024-04-24T02:12:45.810339+0000","last_fullsized":"2024-04-24T02:12:45.810339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:53:36.479217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"30'20","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804087+0000","last_change":"2024-04-24T02:12:08.780018+0000","last_active":"2024-04-24T02:12:45.804087+0000","last_peered":"2024-04-24T02:12:45.804087+0000","last_clean":"2024-04-24T02:12:45.804087+0000","last_became_active":"2024-04-24T02:12:08.779698+0000","last_became_peered":"2024-04-24T02:12:08.779698+0000","last_unstale":"2024-04-24T02:12:45.804087+0000","last_undegraded":"2024-04-24T02:12:45.804087+0000","last_fullsized":"2024-04-24T02:12:45.804087+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:24:02.718714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'282","reported_seq":346,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:11.839480+0000","last_change":"2024-04-24T02:12:10.782077+0000","last_active":"2024-04-24T02:15:11.839480+0000","last_peered":"2024-04-24T02:15:11.839480+0000","last_clean":"2024-04-24T02:15:11.839480+0000","last_became_active":"2024-04-24T02:12:10.781799+0000","last_became_peered":"2024-04-24T02:12:10.781799+0000","last_unstale":"2024-04-24T02:15:11.839480+0000","last_undegraded":"2024-04-24T02:15:11.839480+0000","last_fullsized":"2024-04-24T02:15:11.839480+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:22:36.118429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'2","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:46.562672+0000","last_change":"2024-04-24T02:12:12.794164+0000","last_active":"2024-04-24T02:12:46.562672+0000","last_peered":"2024-04-24T02:12:46.562672+0000","last_clean":"2024-04-24T02:12:46.562672+0000","last_became_active":"2024-04-24T02:12:12.792628+0000","last_became_peered":"2024-04-24T02:12:12.792628+0000","last_unstale":"2024-04-24T02:12:46.562672+0000","last_undegraded":"2024-04-24T02:12:46.562672+0000","last_fullsized":"2024-04-24T02:12:46.562672+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:28:32.181565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'19","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.400430+0000","last_change":"2024-04-24T02:12:04.768557+0000","last_active":"2024-04-24T02:15:13.400430+0000","last_peered":"2024-04-24T02:15:13.400430+0000","last_clean":"2024-04-24T02:15:13.400430+0000","last_became_active":"2024-04-24T02:12:04.768066+0000","last_became_peered":"2024-04-24T02:12:04.768066+0000","last_unstale":"2024-04-24T02:15:13.400430+0000","last_undegraded":"2024-04-24T02:15:13.400430+0000","last_fullsized":"2024-04-24T02:15:13.400430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:37:58.075143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":70,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.813780+0000","last_change":"2024-04-24T02:12:02.761644+0000","last_active":"2024-04-24T02:12:45.813780+0000","last_peered":"2024-04-24T02:12:45.813780+0000","last_clean":"2024-04-24T02:12:45.813780+0000","last_became_active":"2024-04-24T02:12:02.760824+0000","last_became_peered":"2024-04-24T02:12:02.760824+0000","last_unstale":"2024-04-24T02:12:45.813780+0000","last_undegraded":"2024-04-24T02:12:45.813780+0000","last_fullsized":"2024-04-24T02:12:45.813780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:24:13.399996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.806050+0000","last_change":"2024-04-24T02:11:56.723499+0000","last_active":"2024-04-24T02:12:45.806050+0000","last_peered":"2024-04-24T02:12:45.806050+0000","last_clean":"2024-04-24T02:12:45.806050+0000","last_became_active":"2024-04-24T02:11:56.723277+0000","last_became_peered":"2024-04-24T02:11:56.723277+0000","last_unstale":"2024-04-24T02:12:45.806050+0000","last_undegraded":"2024-04-24T02:12:45.806050+0000","last_fullsized":"2024-04-24T02:12:45.806050+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:04:46.209999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.812139+0000","last_change":"2024-04-24T02:12:06.754713+0000","last_active":"2024-04-24T02:12:45.812139+0000","last_peered":"2024-04-24T02:12:45.812139+0000","last_clean":"2024-04-24T02:12:45.812139+0000","last_became_active":"2024-04-24T02:12:06.754414+0000","last_became_peered":"2024-04-24T02:12:06.754414+0000","last_unstale":"2024-04-24T02:12:45.812139+0000","last_undegraded":"2024-04-24T02:12:45.812139+0000","last_fullsized":"2024-04-24T02:12:45.812139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:38:23.173188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"30'17","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.810952+0000","last_change":"2024-04-24T02:12:08.780239+0000","last_active":"2024-04-24T02:12:45.810952+0000","last_peered":"2024-04-24T02:12:45.810952+0000","last_clean":"2024-04-24T02:12:45.810952+0000","last_became_active":"2024-04-24T02:12:08.779937+0000","last_became_peered":"2024-04-24T02:12:08.779937+0000","last_unstale":"2024-04-24T02:12:45.810952+0000","last_undegraded":"2024-04-24T02:12:45.810952+0000","last_fullsized":"2024-04-24T02:12:45.810952+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:33:58.011327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'282","reported_seq":389,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.567071+0000","last_change":"2024-04-24T02:12:10.776879+0000","last_active":"2024-04-24T02:15:13.567071+0000","last_peered":"2024-04-24T02:15:13.567071+0000","last_clean":"2024-04-24T02:15:13.567071+0000","last_became_active":"2024-04-24T02:12:10.776594+0000","last_became_peered":"2024-04-24T02:12:10.776594+0000","last_unstale":"2024-04-24T02:15:13.567071+0000","last_undegraded":"2024-04-24T02:15:13.567071+0000","last_fullsized":"2024-04-24T02:15:13.567071+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:11:56.635776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.803952+0000","last_change":"2024-04-24T02:12:12.795629+0000","last_active":"2024-04-24T02:12:45.803952+0000","last_peered":"2024-04-24T02:12:45.803952+0000","last_clean":"2024-04-24T02:12:45.803952+0000","last_became_active":"2024-04-24T02:12:12.795328+0000","last_became_peered":"2024-04-24T02:12:12.795328+0000","last_unstale":"2024-04-24T02:12:45.803952+0000","last_undegraded":"2024-04-24T02:12:45.803952+0000","last_fullsized":"2024-04-24T02:12:45.803952+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:55:23.691414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'3","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.264812+0000","last_change":"2024-04-24T02:12:04.760388+0000","last_active":"2024-04-24T02:15:13.264812+0000","last_peered":"2024-04-24T02:15:13.264812+0000","last_clean":"2024-04-24T02:15:13.264812+0000","last_became_active":"2024-04-24T02:12:04.760099+0000","last_became_peered":"2024-04-24T02:12:04.760099+0000","last_unstale":"2024-04-24T02:15:13.264812+0000","last_undegraded":"2024-04-24T02:15:13.264812+0000","last_fullsized":"2024-04-24T02:15:13.264812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:00:23.946903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'3","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:15.038544+0000","last_change":"2024-04-24T02:12:02.744971+0000","last_active":"2024-04-24T02:14:15.038544+0000","last_peered":"2024-04-24T02:14:15.038544+0000","last_clean":"2024-04-24T02:14:15.038544+0000","last_became_active":"2024-04-24T02:12:02.744454+0000","last_became_peered":"2024-04-24T02:12:02.744454+0000","last_unstale":"2024-04-24T02:14:15.038544+0000","last_undegraded":"2024-04-24T02:14:15.038544+0000","last_fullsized":"2024-04-24T02:14:15.038544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:59:32.006851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.813632+0000","last_change":"2024-04-24T02:11:57.000530+0000","last_active":"2024-04-24T02:12:45.813632+0000","last_peered":"2024-04-24T02:12:45.813632+0000","last_clean":"2024-04-24T02:12:45.813632+0000","last_became_active":"2024-04-24T02:11:57.000197+0000","last_became_peered":"2024-04-24T02:11:57.000197+0000","last_unstale":"2024-04-24T02:12:45.813632+0000","last_undegraded":"2024-04-24T02:12:45.813632+0000","last_fullsized":"2024-04-24T02:12:45.813632+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:42:43.216261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.810434+0000","last_change":"2024-04-24T02:12:06.754527+0000","last_active":"2024-04-24T02:12:45.810434+0000","last_peered":"2024-04-24T02:12:45.810434+0000","last_clean":"2024-04-24T02:12:45.810434+0000","last_became_active":"2024-04-24T02:12:06.754107+0000","last_became_peered":"2024-04-24T02:12:06.754107+0000","last_unstale":"2024-04-24T02:12:45.810434+0000","last_undegraded":"2024-04-24T02:12:45.810434+0000","last_fullsized":"2024-04-24T02:12:45.810434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:43:41.699448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'90","reported_seq":168,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.344060+0000","last_change":"2024-04-24T02:12:08.781379+0000","last_active":"2024-04-24T02:14:11.344060+0000","last_peered":"2024-04-24T02:14:11.344060+0000","last_clean":"2024-04-24T02:14:11.344060+0000","last_became_active":"2024-04-24T02:12:08.780925+0000","last_became_peered":"2024-04-24T02:12:08.780925+0000","last_unstale":"2024-04-24T02:14:11.344060+0000","last_undegraded":"2024-04-24T02:14:11.344060+0000","last_fullsized":"2024-04-24T02:14:11.344060+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:24:18.129044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":90,"num_read_kb":90,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804630+0000","last_change":"2024-04-24T02:12:10.775385+0000","last_active":"2024-04-24T02:12:45.804630+0000","last_peered":"2024-04-24T02:12:45.804630+0000","last_clean":"2024-04-24T02:12:45.804630+0000","last_became_active":"2024-04-24T02:12:10.775165+0000","last_became_peered":"2024-04-24T02:12:10.775165+0000","last_unstale":"2024-04-24T02:12:45.804630+0000","last_undegraded":"2024-04-24T02:12:45.804630+0000","last_fullsized":"2024-04-24T02:12:45.804630+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:26:58.984436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.806618+0000","last_change":"2024-04-24T02:12:12.796696+0000","last_active":"2024-04-24T02:12:45.806618+0000","last_peered":"2024-04-24T02:12:45.806618+0000","last_clean":"2024-04-24T02:12:45.806618+0000","last_became_active":"2024-04-24T02:12:12.796411+0000","last_became_peered":"2024-04-24T02:12:12.796411+0000","last_unstale":"2024-04-24T02:12:45.806618+0000","last_undegraded":"2024-04-24T02:12:45.806618+0000","last_fullsized":"2024-04-24T02:12:45.806618+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:22:38.124687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.808519+0000","last_change":"2024-04-24T02:12:12.801700+0000","last_active":"2024-04-24T02:12:45.808519+0000","last_peered":"2024-04-24T02:12:45.808519+0000","last_clean":"2024-04-24T02:12:45.808519+0000","last_became_active":"2024-04-24T02:12:12.801346+0000","last_became_peered":"2024-04-24T02:12:12.801346+0000","last_unstale":"2024-04-24T02:12:45.808519+0000","last_undegraded":"2024-04-24T02:12:45.808519+0000","last_fullsized":"2024-04-24T02:12:45.808519+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:53:42.506048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:47.053226+0000","last_change":"2024-04-24T02:12:04.764138+0000","last_active":"2024-04-24T02:12:47.053226+0000","last_peered":"2024-04-24T02:12:47.053226+0000","last_clean":"2024-04-24T02:12:47.053226+0000","last_became_active":"2024-04-24T02:12:04.763860+0000","last_became_peered":"2024-04-24T02:12:04.763860+0000","last_unstale":"2024-04-24T02:12:47.053226+0000","last_undegraded":"2024-04-24T02:12:47.053226+0000","last_fullsized":"2024-04-24T02:12:47.053226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:40:49.148779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"32'1","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:25.040623+0000","last_change":"2024-04-24T02:12:02.757073+0000","last_active":"2024-04-24T02:14:25.040623+0000","last_peered":"2024-04-24T02:14:25.040623+0000","last_clean":"2024-04-24T02:14:25.040623+0000","last_became_active":"2024-04-24T02:12:02.753166+0000","last_became_peered":"2024-04-24T02:12:02.753166+0000","last_unstale":"2024-04-24T02:14:25.040623+0000","last_undegraded":"2024-04-24T02:14:25.040623+0000","last_fullsized":"2024-04-24T02:14:25.040623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:00.841064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.803876+0000","last_change":"2024-04-24T02:12:06.758976+0000","last_active":"2024-04-24T02:12:45.803876+0000","last_peered":"2024-04-24T02:12:45.803876+0000","last_clean":"2024-04-24T02:12:45.803876+0000","last_became_active":"2024-04-24T02:12:06.758468+0000","last_became_peered":"2024-04-24T02:12:06.758468+0000","last_unstale":"2024-04-24T02:12:45.803876+0000","last_undegraded":"2024-04-24T02:12:45.803876+0000","last_fullsized":"2024-04-24T02:12:45.803876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:47:41.924628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'38","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.350258+0000","last_change":"2024-04-24T02:12:08.782070+0000","last_active":"2024-04-24T02:14:11.350258+0000","last_peered":"2024-04-24T02:14:11.350258+0000","last_clean":"2024-04-24T02:14:11.350258+0000","last_became_active":"2024-04-24T02:12:08.780353+0000","last_became_peered":"2024-04-24T02:12:08.780353+0000","last_unstale":"2024-04-24T02:14:11.350258+0000","last_undegraded":"2024-04-24T02:14:11.350258+0000","last_fullsized":"2024-04-24T02:14:11.350258+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:00:39.858738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.810326+0000","last_change":"2024-04-24T02:12:10.787091+0000","last_active":"2024-04-24T02:12:45.810326+0000","last_peered":"2024-04-24T02:12:45.810326+0000","last_clean":"2024-04-24T02:12:45.810326+0000","last_became_active":"2024-04-24T02:12:10.786813+0000","last_became_peered":"2024-04-24T02:12:10.786813+0000","last_unstale":"2024-04-24T02:12:45.810326+0000","last_undegraded":"2024-04-24T02:12:45.810326+0000","last_fullsized":"2024-04-24T02:12:45.810326+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:25:58.461531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'9","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:12.872914+0000","last_change":"2024-04-24T02:12:12.796438+0000","last_active":"2024-04-24T02:15:12.872914+0000","last_peered":"2024-04-24T02:15:12.872914+0000","last_clean":"2024-04-24T02:15:12.872914+0000","last_became_active":"2024-04-24T02:12:12.796149+0000","last_became_peered":"2024-04-24T02:12:12.796149+0000","last_unstale":"2024-04-24T02:15:12.872914+0000","last_undegraded":"2024-04-24T02:15:12.872914+0000","last_fullsized":"2024-04-24T02:15:12.872914+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:33:07.219054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.170970+0000","last_change":"2024-04-24T02:12:45.816393+0000","last_active":"2024-04-24T02:15:13.170970+0000","last_peered":"2024-04-24T02:15:13.170970+0000","last_clean":"2024-04-24T02:15:13.170970+0000","last_became_active":"2024-04-24T02:12:45.816009+0000","last_became_peered":"2024-04-24T02:12:45.816009+0000","last_unstale":"2024-04-24T02:15:13.170970+0000","last_undegraded":"2024-04-24T02:15:13.170970+0000","last_fullsized":"2024-04-24T02:15:13.170970+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:00:38.405027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"32'6","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.342215+0000","last_change":"2024-04-24T02:12:02.755246+0000","last_active":"2024-04-24T02:15:13.342215+0000","last_peered":"2024-04-24T02:15:13.342215+0000","last_clean":"2024-04-24T02:15:13.342215+0000","last_became_active":"2024-04-24T02:12:02.754623+0000","last_became_peered":"2024-04-24T02:12:02.754623+0000","last_unstale":"2024-04-24T02:15:13.342215+0000","last_undegraded":"2024-04-24T02:15:13.342215+0000","last_fullsized":"2024-04-24T02:15:13.342215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:42.734407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.811478+0000","last_change":"2024-04-24T02:12:06.757753+0000","last_active":"2024-04-24T02:12:45.811478+0000","last_peered":"2024-04-24T02:12:45.811478+0000","last_clean":"2024-04-24T02:12:45.811478+0000","last_became_active":"2024-04-24T02:12:06.756998+0000","last_became_peered":"2024-04-24T02:12:06.756998+0000","last_unstale":"2024-04-24T02:12:45.811478+0000","last_undegraded":"2024-04-24T02:12:45.811478+0000","last_fullsized":"2024-04-24T02:12:45.811478+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:13:32.253391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'6","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:12.797382+0000","last_change":"2024-04-24T02:12:08.769916+0000","last_active":"2024-04-24T02:15:12.797382+0000","last_peered":"2024-04-24T02:15:12.797382+0000","last_clean":"2024-04-24T02:15:12.797382+0000","last_became_active":"2024-04-24T02:12:08.769610+0000","last_became_peered":"2024-04-24T02:12:08.769610+0000","last_unstale":"2024-04-24T02:15:12.797382+0000","last_undegraded":"2024-04-24T02:15:12.797382+0000","last_fullsized":"2024-04-24T02:15:12.797382+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:53:07.348788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805538+0000","last_change":"2024-04-24T02:12:10.785261+0000","last_active":"2024-04-24T02:12:45.805538+0000","last_peered":"2024-04-24T02:12:45.805538+0000","last_clean":"2024-04-24T02:12:45.805538+0000","last_became_active":"2024-04-24T02:12:10.784955+0000","last_became_peered":"2024-04-24T02:12:10.784955+0000","last_unstale":"2024-04-24T02:12:45.805538+0000","last_undegraded":"2024-04-24T02:12:45.805538+0000","last_fullsized":"2024-04-24T02:12:45.805538+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:52:08.817241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'10","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:47.056982+0000","last_change":"2024-04-24T02:12:12.792872+0000","last_active":"2024-04-24T02:12:47.056982+0000","last_peered":"2024-04-24T02:12:47.056982+0000","last_clean":"2024-04-24T02:12:47.056982+0000","last_became_active":"2024-04-24T02:12:12.792565+0000","last_became_peered":"2024-04-24T02:12:12.792565+0000","last_unstale":"2024-04-24T02:12:47.056982+0000","last_undegraded":"2024-04-24T02:12:47.056982+0000","last_fullsized":"2024-04-24T02:12:47.056982+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:01:51.258319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":60,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'3","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:28.035923+0000","last_change":"2024-04-24T02:12:04.767155+0000","last_active":"2024-04-24T02:14:28.035923+0000","last_peered":"2024-04-24T02:14:28.035923+0000","last_clean":"2024-04-24T02:14:28.035923+0000","last_became_active":"2024-04-24T02:12:04.766700+0000","last_became_peered":"2024-04-24T02:12:04.766700+0000","last_unstale":"2024-04-24T02:14:28.035923+0000","last_undegraded":"2024-04-24T02:14:28.035923+0000","last_fullsized":"2024-04-24T02:14:28.035923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:56:30.404631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.818398+0000","last_change":"2024-04-24T02:12:45.817612+0000","last_active":"2024-04-24T02:12:45.818398+0000","last_peered":"2024-04-24T02:12:45.818398+0000","last_clean":"2024-04-24T02:12:45.818398+0000","last_became_active":"2024-04-24T02:12:45.817240+0000","last_became_peered":"2024-04-24T02:12:45.817240+0000","last_unstale":"2024-04-24T02:12:45.818398+0000","last_undegraded":"2024-04-24T02:12:45.818398+0000","last_fullsized":"2024-04-24T02:12:45.818398+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:23:14.696386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804920+0000","last_change":"2024-04-24T02:12:06.766890+0000","last_active":"2024-04-24T02:12:45.804920+0000","last_peered":"2024-04-24T02:12:45.804920+0000","last_clean":"2024-04-24T02:12:45.804920+0000","last_became_active":"2024-04-24T02:12:06.764776+0000","last_became_peered":"2024-04-24T02:12:06.764776+0000","last_unstale":"2024-04-24T02:12:45.804920+0000","last_undegraded":"2024-04-24T02:12:45.804920+0000","last_fullsized":"2024-04-24T02:12:45.804920+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:57:48.700227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'40","reported_seq":99,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:12.853711+0000","last_change":"2024-04-24T02:12:08.768761+0000","last_active":"2024-04-24T02:15:12.853711+0000","last_peered":"2024-04-24T02:15:12.853711+0000","last_clean":"2024-04-24T02:15:12.853711+0000","last_became_active":"2024-04-24T02:12:08.768499+0000","last_became_peered":"2024-04-24T02:12:08.768499+0000","last_unstale":"2024-04-24T02:15:12.853711+0000","last_undegraded":"2024-04-24T02:15:12.853711+0000","last_fullsized":"2024-04-24T02:15:12.853711+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:50:29.784473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.803282+0000","last_change":"2024-04-24T02:12:10.777246+0000","last_active":"2024-04-24T02:12:45.803282+0000","last_peered":"2024-04-24T02:12:45.803282+0000","last_clean":"2024-04-24T02:12:45.803282+0000","last_became_active":"2024-04-24T02:12:10.776882+0000","last_became_peered":"2024-04-24T02:12:10.776882+0000","last_unstale":"2024-04-24T02:12:45.803282+0000","last_undegraded":"2024-04-24T02:12:45.803282+0000","last_fullsized":"2024-04-24T02:12:45.803282+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:53:40.499789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.377763+0000","last_change":"2024-04-24T02:12:12.794192+0000","last_active":"2024-04-24T02:15:13.377763+0000","last_peered":"2024-04-24T02:15:13.377763+0000","last_clean":"2024-04-24T02:15:13.377763+0000","last_became_active":"2024-04-24T02:12:12.793884+0000","last_became_peered":"2024-04-24T02:12:12.793884+0000","last_unstale":"2024-04-24T02:15:13.377763+0000","last_undegraded":"2024-04-24T02:15:13.377763+0000","last_fullsized":"2024-04-24T02:15:13.377763+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:38:38.919788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.256832+0000","last_change":"2024-04-24T02:12:04.768207+0000","last_active":"2024-04-24T02:15:13.256832+0000","last_peered":"2024-04-24T02:15:13.256832+0000","last_clean":"2024-04-24T02:15:13.256832+0000","last_became_active":"2024-04-24T02:12:04.767431+0000","last_became_peered":"2024-04-24T02:12:04.767431+0000","last_unstale":"2024-04-24T02:15:13.256832+0000","last_undegraded":"2024-04-24T02:15:13.256832+0000","last_fullsized":"2024-04-24T02:15:13.256832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:28:10.521399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:09.629738+0000","last_change":"2024-04-24T02:12:02.754566+0000","last_active":"2024-04-24T02:14:09.629738+0000","last_peered":"2024-04-24T02:14:09.629738+0000","last_clean":"2024-04-24T02:14:09.629738+0000","last_became_active":"2024-04-24T02:12:02.754295+0000","last_became_peered":"2024-04-24T02:12:02.754295+0000","last_unstale":"2024-04-24T02:14:09.629738+0000","last_undegraded":"2024-04-24T02:14:09.629738+0000","last_fullsized":"2024-04-24T02:14:09.629738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:23:23.715876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.812262+0000","last_change":"2024-04-24T02:12:06.758891+0000","last_active":"2024-04-24T02:12:45.812262+0000","last_peered":"2024-04-24T02:12:45.812262+0000","last_clean":"2024-04-24T02:12:45.812262+0000","last_became_active":"2024-04-24T02:12:06.758462+0000","last_became_peered":"2024-04-24T02:12:06.758462+0000","last_unstale":"2024-04-24T02:12:45.812262+0000","last_undegraded":"2024-04-24T02:12:45.812262+0000","last_fullsized":"2024-04-24T02:12:45.812262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:38:50.153825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.335567+0000","last_change":"2024-04-24T02:12:08.769125+0000","last_active":"2024-04-24T02:14:11.335567+0000","last_peered":"2024-04-24T02:14:11.335567+0000","last_clean":"2024-04-24T02:14:11.335567+0000","last_became_active":"2024-04-24T02:12:08.768814+0000","last_became_peered":"2024-04-24T02:12:08.768814+0000","last_unstale":"2024-04-24T02:14:11.335567+0000","last_undegraded":"2024-04-24T02:14:11.335567+0000","last_fullsized":"2024-04-24T02:14:11.335567+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:53:37.011426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.808892+0000","last_change":"2024-04-24T02:12:10.780084+0000","last_active":"2024-04-24T02:12:45.808892+0000","last_peered":"2024-04-24T02:12:45.808892+0000","last_clean":"2024-04-24T02:12:45.808892+0000","last_became_active":"2024-04-24T02:12:10.779734+0000","last_became_peered":"2024-04-24T02:12:10.779734+0000","last_unstale":"2024-04-24T02:12:45.808892+0000","last_undegraded":"2024-04-24T02:12:45.808892+0000","last_fullsized":"2024-04-24T02:12:45.808892+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:39:31.234341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'1","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:10.038390+0000","last_change":"2024-04-24T02:12:04.764834+0000","last_active":"2024-04-24T02:14:10.038390+0000","last_peered":"2024-04-24T02:14:10.038390+0000","last_clean":"2024-04-24T02:14:10.038390+0000","last_became_active":"2024-04-24T02:12:04.764564+0000","last_became_peered":"2024-04-24T02:12:04.764564+0000","last_unstale":"2024-04-24T02:14:10.038390+0000","last_undegraded":"2024-04-24T02:14:10.038390+0000","last_fullsized":"2024-04-24T02:14:10.038390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:39:25.206344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.608026+0000","last_change":"2024-04-24T02:12:45.809612+0000","last_active":"2024-04-24T02:14:12.608026+0000","last_peered":"2024-04-24T02:14:12.608026+0000","last_clean":"2024-04-24T02:14:12.608026+0000","last_became_active":"2024-04-24T02:12:45.809365+0000","last_became_peered":"2024-04-24T02:12:45.809365+0000","last_unstale":"2024-04-24T02:14:12.608026+0000","last_undegraded":"2024-04-24T02:14:12.608026+0000","last_fullsized":"2024-04-24T02:14:12.608026+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:58:04.705635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.816471+0000","last_change":"2024-04-24T02:12:45.815335+0000","last_active":"2024-04-24T02:12:45.816471+0000","last_peered":"2024-04-24T02:12:45.816471+0000","last_clean":"2024-04-24T02:12:45.816471+0000","last_became_active":"2024-04-24T02:12:45.814918+0000","last_became_peered":"2024-04-24T02:12:45.814918+0000","last_unstale":"2024-04-24T02:12:45.816471+0000","last_undegraded":"2024-04-24T02:12:45.816471+0000","last_fullsized":"2024-04-24T02:12:45.816471+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:19:12.091357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"32'62","reported_seq":124,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.781967+0000","last_change":"2024-04-24T02:12:08.769850+0000","last_active":"2024-04-24T02:14:12.781967+0000","last_peered":"2024-04-24T02:14:12.781967+0000","last_clean":"2024-04-24T02:14:12.781967+0000","last_became_active":"2024-04-24T02:12:08.769578+0000","last_became_peered":"2024-04-24T02:12:08.769578+0000","last_unstale":"2024-04-24T02:14:12.781967+0000","last_undegraded":"2024-04-24T02:14:12.781967+0000","last_fullsized":"2024-04-24T02:14:12.781967+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:33:19.698246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":58,"num_read_kb":48,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.808829+0000","last_change":"2024-04-24T02:12:10.780015+0000","last_active":"2024-04-24T02:12:45.808829+0000","last_peered":"2024-04-24T02:12:45.808829+0000","last_clean":"2024-04-24T02:12:45.808829+0000","last_became_active":"2024-04-24T02:12:10.779703+0000","last_became_peered":"2024-04-24T02:12:10.779703+0000","last_unstale":"2024-04-24T02:12:45.808829+0000","last_undegraded":"2024-04-24T02:12:45.808829+0000","last_fullsized":"2024-04-24T02:12:45.808829+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:24:15.761298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'16","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.705023+0000","last_change":"2024-04-24T02:12:12.791870+0000","last_active":"2024-04-24T02:14:12.705023+0000","last_peered":"2024-04-24T02:14:12.705023+0000","last_clean":"2024-04-24T02:14:12.705023+0000","last_became_active":"2024-04-24T02:12:12.791623+0000","last_became_peered":"2024-04-24T02:12:12.791623+0000","last_unstale":"2024-04-24T02:14:12.705023+0000","last_undegraded":"2024-04-24T02:14:12.705023+0000","last_fullsized":"2024-04-24T02:14:12.705023+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:33:17.393684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'10","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:09.632050+0000","last_change":"2024-04-24T02:12:04.755894+0000","last_active":"2024-04-24T02:14:09.632050+0000","last_peered":"2024-04-24T02:14:09.632050+0000","last_clean":"2024-04-24T02:14:09.632050+0000","last_became_active":"2024-04-24T02:12:04.755554+0000","last_became_peered":"2024-04-24T02:12:04.755554+0000","last_unstale":"2024-04-24T02:14:09.632050+0000","last_undegraded":"2024-04-24T02:14:09.632050+0000","last_fullsized":"2024-04-24T02:14:09.632050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:59:47.844020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.803119+0000","last_change":"2024-04-24T02:12:02.752017+0000","last_active":"2024-04-24T02:12:45.803119+0000","last_peered":"2024-04-24T02:12:45.803119+0000","last_clean":"2024-04-24T02:12:45.803119+0000","last_became_active":"2024-04-24T02:12:02.751703+0000","last_became_peered":"2024-04-24T02:12:02.751703+0000","last_unstale":"2024-04-24T02:12:45.803119+0000","last_undegraded":"2024-04-24T02:12:45.803119+0000","last_fullsized":"2024-04-24T02:12:45.803119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:56:56.371880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.808857+0000","last_change":"2024-04-24T02:12:06.756434+0000","last_active":"2024-04-24T02:12:45.808857+0000","last_peered":"2024-04-24T02:12:45.808857+0000","last_clean":"2024-04-24T02:12:45.808857+0000","last_became_active":"2024-04-24T02:12:06.756154+0000","last_became_peered":"2024-04-24T02:12:06.756154+0000","last_unstale":"2024-04-24T02:12:45.808857+0000","last_undegraded":"2024-04-24T02:12:45.808857+0000","last_fullsized":"2024-04-24T02:12:45.808857+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:28:06.445253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'36","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.336595+0000","last_change":"2024-04-24T02:12:08.780969+0000","last_active":"2024-04-24T02:14:11.336595+0000","last_peered":"2024-04-24T02:14:11.336595+0000","last_clean":"2024-04-24T02:14:11.336595+0000","last_became_active":"2024-04-24T02:12:08.780215+0000","last_became_peered":"2024-04-24T02:12:08.780215+0000","last_unstale":"2024-04-24T02:14:11.336595+0000","last_undegraded":"2024-04-24T02:14:11.336595+0000","last_fullsized":"2024-04-24T02:14:11.336595+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:41:43.973694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.806596+0000","last_change":"2024-04-24T02:12:10.786015+0000","last_active":"2024-04-24T02:12:45.806596+0000","last_peered":"2024-04-24T02:12:45.806596+0000","last_clean":"2024-04-24T02:12:45.806596+0000","last_became_active":"2024-04-24T02:12:10.785707+0000","last_became_peered":"2024-04-24T02:12:10.785707+0000","last_unstale":"2024-04-24T02:12:45.806596+0000","last_undegraded":"2024-04-24T02:12:45.806596+0000","last_fullsized":"2024-04-24T02:12:45.806596+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:55:00.963124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.809558+0000","last_change":"2024-04-24T02:12:12.798843+0000","last_active":"2024-04-24T02:12:45.809558+0000","last_peered":"2024-04-24T02:12:45.809558+0000","last_clean":"2024-04-24T02:12:45.809558+0000","last_became_active":"2024-04-24T02:12:12.798498+0000","last_became_peered":"2024-04-24T02:12:12.798498+0000","last_unstale":"2024-04-24T02:12:45.809558+0000","last_undegraded":"2024-04-24T02:12:45.809558+0000","last_fullsized":"2024-04-24T02:12:45.809558+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:03:55.536222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.465088+0000","last_change":"2024-04-24T02:12:04.768687+0000","last_active":"2024-04-24T02:15:13.465088+0000","last_peered":"2024-04-24T02:15:13.465088+0000","last_clean":"2024-04-24T02:15:13.465088+0000","last_became_active":"2024-04-24T02:12:04.768285+0000","last_became_peered":"2024-04-24T02:12:04.768285+0000","last_unstale":"2024-04-24T02:15:13.465088+0000","last_undegraded":"2024-04-24T02:15:13.465088+0000","last_fullsized":"2024-04-24T02:15:13.465088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:38:38.312578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.803505+0000","last_change":"2024-04-24T02:12:02.749703+0000","last_active":"2024-04-24T02:12:45.803505+0000","last_peered":"2024-04-24T02:12:45.803505+0000","last_clean":"2024-04-24T02:12:45.803505+0000","last_became_active":"2024-04-24T02:12:02.749461+0000","last_became_peered":"2024-04-24T02:12:02.749461+0000","last_unstale":"2024-04-24T02:12:45.803505+0000","last_undegraded":"2024-04-24T02:12:45.803505+0000","last_fullsized":"2024-04-24T02:12:45.803505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:39:43.304402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.808573+0000","last_change":"2024-04-24T02:12:06.758054+0000","last_active":"2024-04-24T02:12:45.808573+0000","last_peered":"2024-04-24T02:12:45.808573+0000","last_clean":"2024-04-24T02:12:45.808573+0000","last_became_active":"2024-04-24T02:12:06.757760+0000","last_became_peered":"2024-04-24T02:12:06.757760+0000","last_unstale":"2024-04-24T02:12:45.808573+0000","last_undegraded":"2024-04-24T02:12:45.808573+0000","last_fullsized":"2024-04-24T02:12:45.808573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:03:26.912136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'38","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.354545+0000","last_change":"2024-04-24T02:12:08.779753+0000","last_active":"2024-04-24T02:14:11.354545+0000","last_peered":"2024-04-24T02:14:11.354545+0000","last_clean":"2024-04-24T02:14:11.354545+0000","last_became_active":"2024-04-24T02:12:08.779471+0000","last_became_peered":"2024-04-24T02:12:08.779471+0000","last_unstale":"2024-04-24T02:14:11.354545+0000","last_undegraded":"2024-04-24T02:14:11.354545+0000","last_fullsized":"2024-04-24T02:14:11.354545+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:12:36.613701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.806043+0000","last_change":"2024-04-24T02:12:10.780537+0000","last_active":"2024-04-24T02:12:45.806043+0000","last_peered":"2024-04-24T02:12:45.806043+0000","last_clean":"2024-04-24T02:12:45.806043+0000","last_became_active":"2024-04-24T02:12:10.780272+0000","last_became_peered":"2024-04-24T02:12:10.780272+0000","last_unstale":"2024-04-24T02:12:45.806043+0000","last_undegraded":"2024-04-24T02:12:45.806043+0000","last_fullsized":"2024-04-24T02:12:45.806043+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:13:38.421688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.770870+0000","last_change":"2024-04-24T02:12:12.795264+0000","last_active":"2024-04-24T02:14:12.770870+0000","last_peered":"2024-04-24T02:14:12.770870+0000","last_clean":"2024-04-24T02:14:12.770870+0000","last_became_active":"2024-04-24T02:12:12.794815+0000","last_became_peered":"2024-04-24T02:12:12.794815+0000","last_unstale":"2024-04-24T02:14:12.770870+0000","last_undegraded":"2024-04-24T02:14:12.770870+0000","last_fullsized":"2024-04-24T02:14:12.770870+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:07:13.044978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.464842+0000","last_change":"2024-04-24T02:12:04.750861+0000","last_active":"2024-04-24T02:15:13.464842+0000","last_peered":"2024-04-24T02:15:13.464842+0000","last_clean":"2024-04-24T02:15:13.464842+0000","last_became_active":"2024-04-24T02:12:04.750546+0000","last_became_peered":"2024-04-24T02:12:04.750546+0000","last_unstale":"2024-04-24T02:15:13.464842+0000","last_undegraded":"2024-04-24T02:15:13.464842+0000","last_fullsized":"2024-04-24T02:15:13.464842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:18:49.587013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.810175+0000","last_change":"2024-04-24T02:12:02.758862+0000","last_active":"2024-04-24T02:12:45.810175+0000","last_peered":"2024-04-24T02:12:45.810175+0000","last_clean":"2024-04-24T02:12:45.810175+0000","last_became_active":"2024-04-24T02:12:02.757728+0000","last_became_peered":"2024-04-24T02:12:02.757728+0000","last_unstale":"2024-04-24T02:12:45.810175+0000","last_undegraded":"2024-04-24T02:12:45.810175+0000","last_fullsized":"2024-04-24T02:12:45.810175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:15:42.425053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805610+0000","last_change":"2024-04-24T02:12:06.757498+0000","last_active":"2024-04-24T02:12:45.805610+0000","last_peered":"2024-04-24T02:12:45.805610+0000","last_clean":"2024-04-24T02:12:45.805610+0000","last_became_active":"2024-04-24T02:12:06.757145+0000","last_became_peered":"2024-04-24T02:12:06.757145+0000","last_unstale":"2024-04-24T02:12:45.805610+0000","last_undegraded":"2024-04-24T02:12:45.805610+0000","last_fullsized":"2024-04-24T02:12:45.805610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:48:54.842263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'16","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.812551+0000","last_change":"2024-04-24T02:12:08.782279+0000","last_active":"2024-04-24T02:12:45.812551+0000","last_peered":"2024-04-24T02:12:45.812551+0000","last_clean":"2024-04-24T02:12:45.812551+0000","last_became_active":"2024-04-24T02:12:08.781974+0000","last_became_peered":"2024-04-24T02:12:08.781974+0000","last_unstale":"2024-04-24T02:12:45.812551+0000","last_undegraded":"2024-04-24T02:12:45.812551+0000","last_fullsized":"2024-04-24T02:12:45.812551+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:08:01.406805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'282","reported_seq":370,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.581521+0000","last_change":"2024-04-24T02:12:10.787530+0000","last_active":"2024-04-24T02:15:13.581521+0000","last_peered":"2024-04-24T02:15:13.581521+0000","last_clean":"2024-04-24T02:15:13.581521+0000","last_became_active":"2024-04-24T02:12:10.786972+0000","last_became_peered":"2024-04-24T02:12:10.786972+0000","last_unstale":"2024-04-24T02:15:13.581521+0000","last_undegraded":"2024-04-24T02:15:13.581521+0000","last_fullsized":"2024-04-24T02:15:13.581521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:01:37.766900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'4","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:28.942341+0000","last_change":"2024-04-24T02:12:12.795734+0000","last_active":"2024-04-24T02:13:28.942341+0000","last_peered":"2024-04-24T02:13:28.942341+0000","last_clean":"2024-04-24T02:13:28.942341+0000","last_became_active":"2024-04-24T02:12:12.795013+0000","last_became_peered":"2024-04-24T02:12:12.795013+0000","last_unstale":"2024-04-24T02:13:28.942341+0000","last_undegraded":"2024-04-24T02:13:28.942341+0000","last_fullsized":"2024-04-24T02:13:28.942341+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:00:19.736045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'12","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.265255+0000","last_change":"2024-04-24T02:12:04.752294+0000","last_active":"2024-04-24T02:15:13.265255+0000","last_peered":"2024-04-24T02:15:13.265255+0000","last_clean":"2024-04-24T02:15:13.265255+0000","last_became_active":"2024-04-24T02:12:04.751676+0000","last_became_peered":"2024-04-24T02:12:04.751676+0000","last_unstale":"2024-04-24T02:15:13.265255+0000","last_undegraded":"2024-04-24T02:15:13.265255+0000","last_fullsized":"2024-04-24T02:15:13.265255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:04:16.078887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805289+0000","last_change":"2024-04-24T02:12:02.756088+0000","last_active":"2024-04-24T02:12:45.805289+0000","last_peered":"2024-04-24T02:12:45.805289+0000","last_clean":"2024-04-24T02:12:45.805289+0000","last_became_active":"2024-04-24T02:12:02.755512+0000","last_became_peered":"2024-04-24T02:12:02.755512+0000","last_unstale":"2024-04-24T02:12:45.805289+0000","last_undegraded":"2024-04-24T02:12:45.805289+0000","last_fullsized":"2024-04-24T02:12:45.805289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:35:57.790455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805191+0000","last_change":"2024-04-24T02:12:06.757421+0000","last_active":"2024-04-24T02:12:45.805191+0000","last_peered":"2024-04-24T02:12:45.805191+0000","last_clean":"2024-04-24T02:12:45.805191+0000","last_became_active":"2024-04-24T02:12:06.756909+0000","last_became_peered":"2024-04-24T02:12:06.756909+0000","last_unstale":"2024-04-24T02:12:45.805191+0000","last_undegraded":"2024-04-24T02:12:45.805191+0000","last_fullsized":"2024-04-24T02:12:45.805191+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:21:46.839438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'60","reported_seq":129,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.327447+0000","last_change":"2024-04-24T02:12:08.770654+0000","last_active":"2024-04-24T02:14:11.327447+0000","last_peered":"2024-04-24T02:14:11.327447+0000","last_clean":"2024-04-24T02:14:11.327447+0000","last_became_active":"2024-04-24T02:12:08.770255+0000","last_became_peered":"2024-04-24T02:12:08.770255+0000","last_unstale":"2024-04-24T02:14:11.327447+0000","last_undegraded":"2024-04-24T02:14:11.327447+0000","last_fullsized":"2024-04-24T02:14:11.327447+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:15:23.890733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":74,"num_read_kb":61,"num_write":42,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804341+0000","last_change":"2024-04-24T02:12:10.786024+0000","last_active":"2024-04-24T02:12:45.804341+0000","last_peered":"2024-04-24T02:12:45.804341+0000","last_clean":"2024-04-24T02:12:45.804341+0000","last_became_active":"2024-04-24T02:12:10.785811+0000","last_became_peered":"2024-04-24T02:12:10.785811+0000","last_unstale":"2024-04-24T02:12:45.804341+0000","last_undegraded":"2024-04-24T02:12:45.804341+0000","last_fullsized":"2024-04-24T02:12:45.804341+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:51:01.712254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804594+0000","last_change":"2024-04-24T02:12:12.799813+0000","last_active":"2024-04-24T02:12:45.804594+0000","last_peered":"2024-04-24T02:12:45.804594+0000","last_clean":"2024-04-24T02:12:45.804594+0000","last_became_active":"2024-04-24T02:12:12.799557+0000","last_became_peered":"2024-04-24T02:12:12.799557+0000","last_unstale":"2024-04-24T02:12:45.804594+0000","last_undegraded":"2024-04-24T02:12:45.804594+0000","last_fullsized":"2024-04-24T02:12:45.804594+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:23:38.168759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'18","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.349395+0000","last_change":"2024-04-24T02:12:04.748652+0000","last_active":"2024-04-24T02:15:13.349395+0000","last_peered":"2024-04-24T02:15:13.349395+0000","last_clean":"2024-04-24T02:15:13.349395+0000","last_became_active":"2024-04-24T02:12:04.748399+0000","last_became_peered":"2024-04-24T02:12:04.748399+0000","last_unstale":"2024-04-24T02:15:13.349395+0000","last_undegraded":"2024-04-24T02:15:13.349395+0000","last_fullsized":"2024-04-24T02:15:13.349395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:11:30.157161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":55,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.812037+0000","last_change":"2024-04-24T02:12:02.761810+0000","last_active":"2024-04-24T02:12:45.812037+0000","last_peered":"2024-04-24T02:12:45.812037+0000","last_clean":"2024-04-24T02:12:45.812037+0000","last_became_active":"2024-04-24T02:12:02.760772+0000","last_became_peered":"2024-04-24T02:12:02.760772+0000","last_unstale":"2024-04-24T02:12:45.812037+0000","last_undegraded":"2024-04-24T02:12:45.812037+0000","last_fullsized":"2024-04-24T02:12:45.812037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:20:25.868325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.808789+0000","last_change":"2024-04-24T02:12:06.765015+0000","last_active":"2024-04-24T02:12:45.808789+0000","last_peered":"2024-04-24T02:12:45.808789+0000","last_clean":"2024-04-24T02:12:45.808789+0000","last_became_active":"2024-04-24T02:12:06.764475+0000","last_became_peered":"2024-04-24T02:12:06.764475+0000","last_unstale":"2024-04-24T02:12:45.808789+0000","last_undegraded":"2024-04-24T02:12:45.808789+0000","last_fullsized":"2024-04-24T02:12:45.808789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:34:43.734495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'37","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.328386+0000","last_change":"2024-04-24T02:12:08.779659+0000","last_active":"2024-04-24T02:14:11.328386+0000","last_peered":"2024-04-24T02:14:11.328386+0000","last_clean":"2024-04-24T02:14:11.328386+0000","last_became_active":"2024-04-24T02:12:08.779447+0000","last_became_peered":"2024-04-24T02:12:08.779447+0000","last_unstale":"2024-04-24T02:14:11.328386+0000","last_undegraded":"2024-04-24T02:14:11.328386+0000","last_fullsized":"2024-04-24T02:14:11.328386+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:47:59.126462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.809971+0000","last_change":"2024-04-24T02:12:10.783395+0000","last_active":"2024-04-24T02:12:45.809971+0000","last_peered":"2024-04-24T02:12:45.809971+0000","last_clean":"2024-04-24T02:12:45.809971+0000","last_became_active":"2024-04-24T02:12:10.782019+0000","last_became_peered":"2024-04-24T02:12:10.782019+0000","last_unstale":"2024-04-24T02:12:45.809971+0000","last_undegraded":"2024-04-24T02:12:45.809971+0000","last_fullsized":"2024-04-24T02:12:45.809971+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:36:51.948849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.811428+0000","last_change":"2024-04-24T02:12:12.797073+0000","last_active":"2024-04-24T02:12:45.811428+0000","last_peered":"2024-04-24T02:12:45.811428+0000","last_clean":"2024-04-24T02:12:45.811428+0000","last_became_active":"2024-04-24T02:12:12.796494+0000","last_became_peered":"2024-04-24T02:12:12.796494+0000","last_unstale":"2024-04-24T02:12:45.811428+0000","last_undegraded":"2024-04-24T02:12:45.811428+0000","last_fullsized":"2024-04-24T02:12:45.811428+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:13.390946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'10","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.349088+0000","last_change":"2024-04-24T02:12:04.763788+0000","last_active":"2024-04-24T02:15:13.349088+0000","last_peered":"2024-04-24T02:15:13.349088+0000","last_clean":"2024-04-24T02:15:13.349088+0000","last_became_active":"2024-04-24T02:12:04.763263+0000","last_became_peered":"2024-04-24T02:12:04.763263+0000","last_unstale":"2024-04-24T02:15:13.349088+0000","last_undegraded":"2024-04-24T02:15:13.349088+0000","last_fullsized":"2024-04-24T02:15:13.349088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:22.258912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:46.550151+0000","last_change":"2024-04-24T02:12:02.745999+0000","last_active":"2024-04-24T02:12:46.550151+0000","last_peered":"2024-04-24T02:12:46.550151+0000","last_clean":"2024-04-24T02:12:46.550151+0000","last_became_active":"2024-04-24T02:12:02.745617+0000","last_became_peered":"2024-04-24T02:12:02.745617+0000","last_unstale":"2024-04-24T02:12:46.550151+0000","last_undegraded":"2024-04-24T02:12:46.550151+0000","last_fullsized":"2024-04-24T02:12:46.550151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:45:43.215829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805756+0000","last_change":"2024-04-24T02:12:06.766022+0000","last_active":"2024-04-24T02:12:45.805756+0000","last_peered":"2024-04-24T02:12:45.805756+0000","last_clean":"2024-04-24T02:12:45.805756+0000","last_became_active":"2024-04-24T02:12:06.765644+0000","last_became_peered":"2024-04-24T02:12:06.765644+0000","last_unstale":"2024-04-24T02:12:45.805756+0000","last_undegraded":"2024-04-24T02:12:45.805756+0000","last_fullsized":"2024-04-24T02:12:45.805756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:22:20.414950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'33","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.352320+0000","last_change":"2024-04-24T02:12:08.780672+0000","last_active":"2024-04-24T02:14:11.352320+0000","last_peered":"2024-04-24T02:14:11.352320+0000","last_clean":"2024-04-24T02:14:11.352320+0000","last_became_active":"2024-04-24T02:12:08.780056+0000","last_became_peered":"2024-04-24T02:12:08.780056+0000","last_unstale":"2024-04-24T02:14:11.352320+0000","last_undegraded":"2024-04-24T02:14:11.352320+0000","last_fullsized":"2024-04-24T02:14:11.352320+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:51:21.271286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":27,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.809863+0000","last_change":"2024-04-24T02:12:10.785977+0000","last_active":"2024-04-24T02:12:45.809863+0000","last_peered":"2024-04-24T02:12:45.809863+0000","last_clean":"2024-04-24T02:12:45.809863+0000","last_became_active":"2024-04-24T02:12:10.785396+0000","last_became_peered":"2024-04-24T02:12:10.785396+0000","last_unstale":"2024-04-24T02:12:45.809863+0000","last_undegraded":"2024-04-24T02:12:45.809863+0000","last_fullsized":"2024-04-24T02:12:45.809863+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:28:39.922824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.362615+0000","last_change":"2024-04-24T02:12:12.794051+0000","last_active":"2024-04-24T02:14:11.362615+0000","last_peered":"2024-04-24T02:14:11.362615+0000","last_clean":"2024-04-24T02:14:11.362615+0000","last_became_active":"2024-04-24T02:12:12.793796+0000","last_became_peered":"2024-04-24T02:12:12.793796+0000","last_unstale":"2024-04-24T02:14:11.362615+0000","last_undegraded":"2024-04-24T02:14:11.362615+0000","last_fullsized":"2024-04-24T02:14:11.362615+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:24:07.897162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'18","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.523119+0000","last_change":"2024-04-24T02:12:04.749487+0000","last_active":"2024-04-24T02:15:13.523119+0000","last_peered":"2024-04-24T02:15:13.523119+0000","last_clean":"2024-04-24T02:15:13.523119+0000","last_became_active":"2024-04-24T02:12:04.749055+0000","last_became_peered":"2024-04-24T02:12:04.749055+0000","last_unstale":"2024-04-24T02:15:13.523119+0000","last_undegraded":"2024-04-24T02:15:13.523119+0000","last_fullsized":"2024-04-24T02:15:13.523119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:22:28.196549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805080+0000","last_change":"2024-04-24T02:12:02.747590+0000","last_active":"2024-04-24T02:12:45.805080+0000","last_peered":"2024-04-24T02:12:45.805080+0000","last_clean":"2024-04-24T02:12:45.805080+0000","last_became_active":"2024-04-24T02:12:02.745895+0000","last_became_peered":"2024-04-24T02:12:02.745895+0000","last_unstale":"2024-04-24T02:12:45.805080+0000","last_undegraded":"2024-04-24T02:12:45.805080+0000","last_fullsized":"2024-04-24T02:12:45.805080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:21:06.907535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'6","reported_seq":228,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.403135+0000","last_change":"2024-04-24T02:12:06.765389+0000","last_active":"2024-04-24T02:14:12.403135+0000","last_peered":"2024-04-24T02:14:12.403135+0000","last_clean":"2024-04-24T02:14:12.403135+0000","last_became_active":"2024-04-24T02:12:06.765096+0000","last_became_peered":"2024-04-24T02:12:06.765096+0000","last_unstale":"2024-04-24T02:14:12.403135+0000","last_undegraded":"2024-04-24T02:14:12.403135+0000","last_fullsized":"2024-04-24T02:14:12.403135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:28:12.528823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'44","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:12.798259+0000","last_change":"2024-04-24T02:12:08.780244+0000","last_active":"2024-04-24T02:15:12.798259+0000","last_peered":"2024-04-24T02:15:12.798259+0000","last_clean":"2024-04-24T02:15:12.798259+0000","last_became_active":"2024-04-24T02:12:08.779892+0000","last_became_peered":"2024-04-24T02:12:08.779892+0000","last_unstale":"2024-04-24T02:15:12.798259+0000","last_undegraded":"2024-04-24T02:15:12.798259+0000","last_fullsized":"2024-04-24T02:15:12.798259+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:53:04.772697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":52,"num_read_kb":46,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804982+0000","last_change":"2024-04-24T02:12:10.781966+0000","last_active":"2024-04-24T02:12:45.804982+0000","last_peered":"2024-04-24T02:12:45.804982+0000","last_clean":"2024-04-24T02:12:45.804982+0000","last_became_active":"2024-04-24T02:12:10.781588+0000","last_became_peered":"2024-04-24T02:12:10.781588+0000","last_unstale":"2024-04-24T02:12:45.804982+0000","last_undegraded":"2024-04-24T02:12:45.804982+0000","last_fullsized":"2024-04-24T02:12:45.804982+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:36:23.742641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'6","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.526045+0000","last_change":"2024-04-24T02:12:12.793599+0000","last_active":"2024-04-24T02:15:13.526045+0000","last_peered":"2024-04-24T02:15:13.526045+0000","last_clean":"2024-04-24T02:15:13.526045+0000","last_became_active":"2024-04-24T02:12:12.793310+0000","last_became_peered":"2024-04-24T02:12:12.793310+0000","last_unstale":"2024-04-24T02:15:13.526045+0000","last_undegraded":"2024-04-24T02:15:13.526045+0000","last_fullsized":"2024-04-24T02:15:13.526045+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:31:25.149659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'4","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.464843+0000","last_change":"2024-04-24T02:12:04.767702+0000","last_active":"2024-04-24T02:15:13.464843+0000","last_peered":"2024-04-24T02:15:13.464843+0000","last_clean":"2024-04-24T02:15:13.464843+0000","last_became_active":"2024-04-24T02:12:04.766869+0000","last_became_peered":"2024-04-24T02:12:04.766869+0000","last_unstale":"2024-04-24T02:15:13.464843+0000","last_undegraded":"2024-04-24T02:15:13.464843+0000","last_fullsized":"2024-04-24T02:15:13.464843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:11:48.404916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805389+0000","last_change":"2024-04-24T02:12:02.750537+0000","last_active":"2024-04-24T02:12:45.805389+0000","last_peered":"2024-04-24T02:12:45.805389+0000","last_clean":"2024-04-24T02:12:45.805389+0000","last_became_active":"2024-04-24T02:12:02.746992+0000","last_became_peered":"2024-04-24T02:12:02.746992+0000","last_unstale":"2024-04-24T02:12:45.805389+0000","last_undegraded":"2024-04-24T02:12:45.805389+0000","last_fullsized":"2024-04-24T02:12:45.805389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:20:45.842023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.774843+0000","last_change":"2024-04-24T02:12:04.749519+0000","last_active":"2024-04-24T02:14:12.774843+0000","last_peered":"2024-04-24T02:14:12.774843+0000","last_clean":"2024-04-24T02:14:12.774843+0000","last_became_active":"2024-04-24T02:12:04.749165+0000","last_became_peered":"2024-04-24T02:12:04.749165+0000","last_unstale":"2024-04-24T02:14:12.774843+0000","last_undegraded":"2024-04-24T02:14:12.774843+0000","last_fullsized":"2024-04-24T02:14:12.774843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:46:52.766018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'6","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.344845+0000","last_change":"2024-04-24T02:12:02.751924+0000","last_active":"2024-04-24T02:15:13.344845+0000","last_peered":"2024-04-24T02:15:13.344845+0000","last_clean":"2024-04-24T02:15:13.344845+0000","last_became_active":"2024-04-24T02:12:02.751613+0000","last_became_peered":"2024-04-24T02:12:02.751613+0000","last_unstale":"2024-04-24T02:15:13.344845+0000","last_undegraded":"2024-04-24T02:15:13.344845+0000","last_fullsized":"2024-04-24T02:15:13.344845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:18:31.392785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.464756+0000","last_change":"2024-04-24T02:12:04.764660+0000","last_active":"2024-04-24T02:15:13.464756+0000","last_peered":"2024-04-24T02:15:13.464756+0000","last_clean":"2024-04-24T02:15:13.464756+0000","last_became_active":"2024-04-24T02:12:04.763819+0000","last_became_peered":"2024-04-24T02:12:04.763819+0000","last_unstale":"2024-04-24T02:15:13.464756+0000","last_undegraded":"2024-04-24T02:15:13.464756+0000","last_fullsized":"2024-04-24T02:15:13.464756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:23:58.698687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.810651+0000","last_change":"2024-04-24T02:12:02.758745+0000","last_active":"2024-04-24T02:12:45.810651+0000","last_peered":"2024-04-24T02:12:45.810651+0000","last_clean":"2024-04-24T02:12:45.810651+0000","last_became_active":"2024-04-24T02:12:02.757017+0000","last_became_peered":"2024-04-24T02:12:02.757017+0000","last_unstale":"2024-04-24T02:12:45.810651+0000","last_undegraded":"2024-04-24T02:12:45.810651+0000","last_fullsized":"2024-04-24T02:12:45.810651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:47:33.899846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'4","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.389055+0000","last_change":"2024-04-24T02:12:04.749624+0000","last_active":"2024-04-24T02:15:13.389055+0000","last_peered":"2024-04-24T02:15:13.389055+0000","last_clean":"2024-04-24T02:15:13.389055+0000","last_became_active":"2024-04-24T02:12:04.749305+0000","last_became_peered":"2024-04-24T02:12:04.749305+0000","last_unstale":"2024-04-24T02:15:13.389055+0000","last_undegraded":"2024-04-24T02:15:13.389055+0000","last_fullsized":"2024-04-24T02:15:13.389055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:12:19.920273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"30'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.806026+0000","last_change":"2024-04-24T02:12:02.741858+0000","last_active":"2024-04-24T02:12:45.806026+0000","last_peered":"2024-04-24T02:12:45.806026+0000","last_clean":"2024-04-24T02:12:45.806026+0000","last_became_active":"2024-04-24T02:12:02.741503+0000","last_became_peered":"2024-04-24T02:12:02.741503+0000","last_unstale":"2024-04-24T02:12:45.806026+0000","last_undegraded":"2024-04-24T02:12:45.806026+0000","last_fullsized":"2024-04-24T02:12:45.806026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:07:39.016614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'6","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.258691+0000","last_change":"2024-04-24T02:12:45.818489+0000","last_active":"2024-04-24T02:15:13.258691+0000","last_peered":"2024-04-24T02:15:13.258691+0000","last_clean":"2024-04-24T02:15:13.258691+0000","last_became_active":"2024-04-24T02:12:45.814356+0000","last_became_peered":"2024-04-24T02:12:45.814356+0000","last_unstale":"2024-04-24T02:15:13.258691+0000","last_undegraded":"2024-04-24T02:15:13.258691+0000","last_fullsized":"2024-04-24T02:15:13.258691+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:04:14.737856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.129792+0000","last_change":"2024-04-24T02:12:02.751995+0000","last_active":"2024-04-24T02:15:13.129792+0000","last_peered":"2024-04-24T02:15:13.129792+0000","last_clean":"2024-04-24T02:15:13.129792+0000","last_became_active":"2024-04-24T02:12:02.751680+0000","last_became_peered":"2024-04-24T02:12:02.751680+0000","last_unstale":"2024-04-24T02:15:13.129792+0000","last_undegraded":"2024-04-24T02:15:13.129792+0000","last_fullsized":"2024-04-24T02:15:13.129792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:31:45.410385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'8","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.391123+0000","last_change":"2024-04-24T02:12:45.817674+0000","last_active":"2024-04-24T02:15:13.391123+0000","last_peered":"2024-04-24T02:15:13.391123+0000","last_clean":"2024-04-24T02:15:13.391123+0000","last_became_active":"2024-04-24T02:12:45.813097+0000","last_became_peered":"2024-04-24T02:12:45.813097+0000","last_unstale":"2024-04-24T02:15:13.391123+0000","last_undegraded":"2024-04-24T02:15:13.391123+0000","last_fullsized":"2024-04-24T02:15:13.391123+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:03:21.634592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"32'1","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:15.038523+0000","last_change":"2024-04-24T02:12:02.754946+0000","last_active":"2024-04-24T02:14:15.038523+0000","last_peered":"2024-04-24T02:14:15.038523+0000","last_clean":"2024-04-24T02:14:15.038523+0000","last_became_active":"2024-04-24T02:12:02.754356+0000","last_became_peered":"2024-04-24T02:12:02.754356+0000","last_unstale":"2024-04-24T02:14:15.038523+0000","last_undegraded":"2024-04-24T02:14:15.038523+0000","last_fullsized":"2024-04-24T02:14:15.038523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:57:48.477966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'5","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.176709+0000","last_change":"2024-04-24T02:12:04.756117+0000","last_active":"2024-04-24T02:15:13.176709+0000","last_peered":"2024-04-24T02:15:13.176709+0000","last_clean":"2024-04-24T02:15:13.176709+0000","last_became_active":"2024-04-24T02:12:04.755738+0000","last_became_peered":"2024-04-24T02:12:04.755738+0000","last_unstale":"2024-04-24T02:15:13.176709+0000","last_undegraded":"2024-04-24T02:15:13.176709+0000","last_fullsized":"2024-04-24T02:15:13.176709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:34:53.394367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"30'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.813069+0000","last_change":"2024-04-24T02:12:02.756723+0000","last_active":"2024-04-24T02:12:45.813069+0000","last_peered":"2024-04-24T02:12:45.813069+0000","last_clean":"2024-04-24T02:12:45.813069+0000","last_became_active":"2024-04-24T02:12:02.755202+0000","last_became_peered":"2024-04-24T02:12:02.755202+0000","last_unstale":"2024-04-24T02:12:45.813069+0000","last_undegraded":"2024-04-24T02:12:45.813069+0000","last_fullsized":"2024-04-24T02:12:45.813069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:35:57.790455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"30'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.803548+0000","last_change":"2024-04-24T02:12:04.756072+0000","last_active":"2024-04-24T02:12:45.803548+0000","last_peered":"2024-04-24T02:12:45.803548+0000","last_clean":"2024-04-24T02:12:45.803548+0000","last_became_active":"2024-04-24T02:12:04.755194+0000","last_became_peered":"2024-04-24T02:12:04.755194+0000","last_unstale":"2024-04-24T02:12:45.803548+0000","last_undegraded":"2024-04-24T02:12:45.803548+0000","last_fullsized":"2024-04-24T02:12:45.803548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:48:16.917007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.459938+0000","last_change":"2024-04-24T02:12:02.752025+0000","last_active":"2024-04-24T02:15:13.459938+0000","last_peered":"2024-04-24T02:15:13.459938+0000","last_clean":"2024-04-24T02:15:13.459938+0000","last_became_active":"2024-04-24T02:12:02.751726+0000","last_became_peered":"2024-04-24T02:12:02.751726+0000","last_unstale":"2024-04-24T02:15:13.459938+0000","last_undegraded":"2024-04-24T02:15:13.459938+0000","last_fullsized":"2024-04-24T02:15:13.459938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:17:15.106316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'6","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.940195+0000","last_change":"2024-04-24T02:12:04.753374+0000","last_active":"2024-04-24T02:12:45.940195+0000","last_peered":"2024-04-24T02:12:45.940195+0000","last_clean":"2024-04-24T02:12:45.940195+0000","last_became_active":"2024-04-24T02:12:04.753074+0000","last_became_peered":"2024-04-24T02:12:04.753074+0000","last_unstale":"2024-04-24T02:12:45.940195+0000","last_undegraded":"2024-04-24T02:12:45.940195+0000","last_fullsized":"2024-04-24T02:12:45.940195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:54:39.701699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:15.038929+0000","last_change":"2024-04-24T02:12:02.755029+0000","last_active":"2024-04-24T02:14:15.038929+0000","last_peered":"2024-04-24T02:14:15.038929+0000","last_clean":"2024-04-24T02:14:15.038929+0000","last_became_active":"2024-04-24T02:12:02.754158+0000","last_became_peered":"2024-04-24T02:12:02.754158+0000","last_unstale":"2024-04-24T02:14:15.038929+0000","last_undegraded":"2024-04-24T02:14:15.038929+0000","last_fullsized":"2024-04-24T02:14:15.038929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:10:56.620635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:29.126199+0000","last_change":"2024-04-24T02:12:04.764100+0000","last_active":"2024-04-24T02:13:29.126199+0000","last_peered":"2024-04-24T02:13:29.126199+0000","last_clean":"2024-04-24T02:13:29.126199+0000","last_became_active":"2024-04-24T02:12:04.763136+0000","last_became_peered":"2024-04-24T02:12:04.763136+0000","last_unstale":"2024-04-24T02:13:29.126199+0000","last_undegraded":"2024-04-24T02:13:29.126199+0000","last_fullsized":"2024-04-24T02:13:29.126199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:52:02.789245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804576+0000","last_change":"2024-04-24T02:12:02.741912+0000","last_active":"2024-04-24T02:12:45.804576+0000","last_peered":"2024-04-24T02:12:45.804576+0000","last_clean":"2024-04-24T02:12:45.804576+0000","last_became_active":"2024-04-24T02:12:02.741543+0000","last_became_peered":"2024-04-24T02:12:02.741543+0000","last_unstale":"2024-04-24T02:12:45.804576+0000","last_undegraded":"2024-04-24T02:12:45.804576+0000","last_fullsized":"2024-04-24T02:12:45.804576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:23:18.903991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:46.564925+0000","last_change":"2024-04-24T02:12:04.760381+0000","last_active":"2024-04-24T02:12:46.564925+0000","last_peered":"2024-04-24T02:12:46.564925+0000","last_clean":"2024-04-24T02:12:46.564925+0000","last_became_active":"2024-04-24T02:12:04.760028+0000","last_became_peered":"2024-04-24T02:12:04.760028+0000","last_unstale":"2024-04-24T02:12:46.564925+0000","last_undegraded":"2024-04-24T02:12:46.564925+0000","last_fullsized":"2024-04-24T02:12:46.564925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:20:21.566094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.336619+0000","last_change":"2024-04-24T02:12:02.750391+0000","last_active":"2024-04-24T02:15:13.336619+0000","last_peered":"2024-04-24T02:15:13.336619+0000","last_clean":"2024-04-24T02:15:13.336619+0000","last_became_active":"2024-04-24T02:12:02.750143+0000","last_became_peered":"2024-04-24T02:12:02.750143+0000","last_unstale":"2024-04-24T02:15:13.336619+0000","last_undegraded":"2024-04-24T02:15:13.336619+0000","last_fullsized":"2024-04-24T02:15:13.336619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:30:58.417438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'8","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.465106+0000","last_change":"2024-04-24T02:12:04.754976+0000","last_active":"2024-04-24T02:15:13.465106+0000","last_peered":"2024-04-24T02:15:13.465106+0000","last_clean":"2024-04-24T02:15:13.465106+0000","last_became_active":"2024-04-24T02:12:04.754738+0000","last_became_peered":"2024-04-24T02:12:04.754738+0000","last_unstale":"2024-04-24T02:15:13.465106+0000","last_undegraded":"2024-04-24T02:15:13.465106+0000","last_fullsized":"2024-04-24T02:15:13.465106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:34:41.727071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804338+0000","last_change":"2024-04-24T02:12:02.746027+0000","last_active":"2024-04-24T02:12:45.804338+0000","last_peered":"2024-04-24T02:12:45.804338+0000","last_clean":"2024-04-24T02:12:45.804338+0000","last_became_active":"2024-04-24T02:12:02.744352+0000","last_became_peered":"2024-04-24T02:12:02.744352+0000","last_unstale":"2024-04-24T02:12:45.804338+0000","last_undegraded":"2024-04-24T02:12:45.804338+0000","last_fullsized":"2024-04-24T02:12:45.804338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:42.734407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'12","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.179236+0000","last_change":"2024-04-24T02:12:45.815138+0000","last_active":"2024-04-24T02:15:13.179236+0000","last_peered":"2024-04-24T02:15:13.179236+0000","last_clean":"2024-04-24T02:15:13.179236+0000","last_became_active":"2024-04-24T02:12:45.808774+0000","last_became_peered":"2024-04-24T02:12:45.808774+0000","last_unstale":"2024-04-24T02:15:13.179236+0000","last_undegraded":"2024-04-24T02:15:13.179236+0000","last_fullsized":"2024-04-24T02:15:13.179236+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:34:31.491770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.811686+0000","last_change":"2024-04-24T02:12:02.758624+0000","last_active":"2024-04-24T02:12:45.811686+0000","last_peered":"2024-04-24T02:12:45.811686+0000","last_clean":"2024-04-24T02:12:45.811686+0000","last_became_active":"2024-04-24T02:12:02.757458+0000","last_became_peered":"2024-04-24T02:12:02.757458+0000","last_unstale":"2024-04-24T02:12:45.811686+0000","last_undegraded":"2024-04-24T02:12:45.811686+0000","last_fullsized":"2024-04-24T02:12:45.811686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:40:47.142152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'14","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.391096+0000","last_change":"2024-04-24T02:12:04.751238+0000","last_active":"2024-04-24T02:15:13.391096+0000","last_peered":"2024-04-24T02:15:13.391096+0000","last_clean":"2024-04-24T02:15:13.391096+0000","last_became_active":"2024-04-24T02:12:04.750973+0000","last_became_peered":"2024-04-24T02:12:04.750973+0000","last_unstale":"2024-04-24T02:15:13.391096+0000","last_undegraded":"2024-04-24T02:15:13.391096+0000","last_fullsized":"2024-04-24T02:15:13.391096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:39:11.735517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.812141+0000","last_change":"2024-04-24T02:12:02.761835+0000","last_active":"2024-04-24T02:12:45.812141+0000","last_peered":"2024-04-24T02:12:45.812141+0000","last_clean":"2024-04-24T02:12:45.812141+0000","last_became_active":"2024-04-24T02:12:02.761235+0000","last_became_peered":"2024-04-24T02:12:02.761235+0000","last_unstale":"2024-04-24T02:12:45.812141+0000","last_undegraded":"2024-04-24T02:12:45.812141+0000","last_fullsized":"2024-04-24T02:12:45.812141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:25:04.505767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.389012+0000","last_change":"2024-04-24T02:12:04.764009+0000","last_active":"2024-04-24T02:15:13.389012+0000","last_peered":"2024-04-24T02:15:13.389012+0000","last_clean":"2024-04-24T02:15:13.389012+0000","last_became_active":"2024-04-24T02:12:04.763517+0000","last_became_peered":"2024-04-24T02:12:04.763517+0000","last_unstale":"2024-04-24T02:15:13.389012+0000","last_undegraded":"2024-04-24T02:15:13.389012+0000","last_fullsized":"2024-04-24T02:15:13.389012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:00:42.696926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.339848+0000","last_change":"2024-04-24T02:12:02.754501+0000","last_active":"2024-04-24T02:15:13.339848+0000","last_peered":"2024-04-24T02:15:13.339848+0000","last_clean":"2024-04-24T02:15:13.339848+0000","last_became_active":"2024-04-24T02:12:02.754227+0000","last_became_peered":"2024-04-24T02:12:02.754227+0000","last_unstale":"2024-04-24T02:15:13.339848+0000","last_undegraded":"2024-04-24T02:15:13.339848+0000","last_fullsized":"2024-04-24T02:15:13.339848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:21:06.907535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.349589+0000","last_change":"2024-04-24T02:12:04.755937+0000","last_active":"2024-04-24T02:15:13.349589+0000","last_peered":"2024-04-24T02:15:13.349589+0000","last_clean":"2024-04-24T02:15:13.349589+0000","last_became_active":"2024-04-24T02:12:04.755661+0000","last_became_peered":"2024-04-24T02:12:04.755661+0000","last_unstale":"2024-04-24T02:15:13.349589+0000","last_undegraded":"2024-04-24T02:15:13.349589+0000","last_fullsized":"2024-04-24T02:15:13.349589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:11:30.157161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.813752+0000","last_change":"2024-04-24T02:12:02.761162+0000","last_active":"2024-04-24T02:12:45.813752+0000","last_peered":"2024-04-24T02:12:45.813752+0000","last_clean":"2024-04-24T02:12:45.813752+0000","last_became_active":"2024-04-24T02:12:02.758855+0000","last_became_peered":"2024-04-24T02:12:02.758855+0000","last_unstale":"2024-04-24T02:12:45.813752+0000","last_undegraded":"2024-04-24T02:12:45.813752+0000","last_fullsized":"2024-04-24T02:12:45.813752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:48:14.910380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.809520+0000","last_change":"2024-04-24T02:12:02.757416+0000","last_active":"2024-04-24T02:12:45.809520+0000","last_peered":"2024-04-24T02:12:45.809520+0000","last_clean":"2024-04-24T02:12:45.809520+0000","last_became_active":"2024-04-24T02:12:02.753545+0000","last_became_peered":"2024-04-24T02:12:02.753545+0000","last_unstale":"2024-04-24T02:12:45.809520+0000","last_undegraded":"2024-04-24T02:12:45.809520+0000","last_fullsized":"2024-04-24T02:12:45.809520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:09.115795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'10","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.171289+0000","last_change":"2024-04-24T02:12:04.758909+0000","last_active":"2024-04-24T02:15:13.171289+0000","last_peered":"2024-04-24T02:15:13.171289+0000","last_clean":"2024-04-24T02:15:13.171289+0000","last_became_active":"2024-04-24T02:12:04.758661+0000","last_became_peered":"2024-04-24T02:12:04.758661+0000","last_unstale":"2024-04-24T02:15:13.171289+0000","last_undegraded":"2024-04-24T02:15:13.171289+0000","last_fullsized":"2024-04-24T02:15:13.171289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:14:26.877561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804307+0000","last_change":"2024-04-24T02:12:02.745737+0000","last_active":"2024-04-24T02:12:45.804307+0000","last_peered":"2024-04-24T02:12:45.804307+0000","last_clean":"2024-04-24T02:12:45.804307+0000","last_became_active":"2024-04-24T02:12:02.745396+0000","last_became_peered":"2024-04-24T02:12:02.745396+0000","last_unstale":"2024-04-24T02:12:45.804307+0000","last_undegraded":"2024-04-24T02:12:45.804307+0000","last_fullsized":"2024-04-24T02:12:45.804307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:11:19.180288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:09.640725+0000","last_change":"2024-04-24T02:12:04.766645+0000","last_active":"2024-04-24T02:14:09.640725+0000","last_peered":"2024-04-24T02:14:09.640725+0000","last_clean":"2024-04-24T02:14:09.640725+0000","last_became_active":"2024-04-24T02:12:04.766344+0000","last_became_peered":"2024-04-24T02:12:04.766344+0000","last_unstale":"2024-04-24T02:14:09.640725+0000","last_undegraded":"2024-04-24T02:14:09.640725+0000","last_fullsized":"2024-04-24T02:14:09.640725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:28:04.437829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1690,"num_read_kb":1444,"num_write":723,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1471,"ondisk_log_size":1471,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1617,"num_read_kb":1507,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":130,"num_read_kb":83,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51617792,"data_stored":51611392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640302,"num_pgs":152,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52796,"kb_used_data":17460,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94319044,"statfs":{"total":96636764160,"available":96582701056,"internally_reserved":0,"allocated":17879040,"data_stored":17552672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640300,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49212,"kb_used_data":13876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94322628,"statfs":{"total":96636764160,"available":96586371072,"internally_reserved":0,"allocated":14209024,"data_stored":13945472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640302,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48616,"kb_used_data":13280,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323224,"statfs":{"total":96636764160,"available":96586981376,"internally_reserved":0,"allocated":13598720,"data_stored":13308671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705710,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48104,"kb_used_data":8608,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323736,"statfs":{"total":96636764160,"available":96587505664,"internally_reserved":0,"allocated":8814592,"data_stored":8523929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13225984,"data_stored":13222784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":17420288,"data_stored":17417088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T02:15:21.238 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T02:15:21.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.332+0000 7f6c7ecac640 1 Processor -- start 2024-04-24T02:15:21.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.332+0000 7f6c7ecac640 1 -- start start 2024-04-24T02:15:21.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.332+0000 7f6c7ecac640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6c7806d420 0x7f6c7806d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:21.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.332+0000 7f6c7ecac640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c78098800 con 0x7f6c7806dd40 2024-04-24T02:15:21.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.332+0000 7f6c7ecac640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f6c7806f890 con 0x7f6c7806d420 2024-04-24T02:15:21.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.332+0000 7f6c7ca48640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6c7806d420 0x7f6c7806d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:21.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.332+0000 7f6c77fff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f6c7806dd40 0x7f6c78132910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:46582/0 (socket says 172.21.15.104:46582) 2024-04-24T02:15:21.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.332+0000 7f6c77fff640 1 -- 172.21.15.104:0/198377273 learned_addr learned my addr 172.21.15.104:0/198377273 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-04-24T02:15:21.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.333+0000 7f6c7ca48640 1 -- 172.21.15.104:0/198377273 >> v1:172.21.15.104:6789/0 conn(0x7f6c7806dd40 legacy=0x7f6c78132910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:21.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.333+0000 7f6c7ca48640 1 -- 172.21.15.104:0/198377273 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c7806fac0 con 0x7f6c7806d420 2024-04-24T02:15:21.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.333+0000 7f6c777fe640 1 -- 172.21.15.104:0/198377273 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3057475543 0 0) 0x7f6c78098800 con 0x7f6c7806dd40 2024-04-24T02:15:21.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.333+0000 7f6c7ca48640 1 --2- 172.21.15.104:0/198377273 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c7806d420 0x7f6c7806d800 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c009720 tx=0x7f6c6c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5143ff7cc9662b17 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:21.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.334+0000 7f6c777fe640 1 -- 172.21.15.104:0/198377273 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c6c0316d0 con 0x7f6c7806d420 2024-04-24T02:15:21.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.334+0000 7f6c777fe640 1 -- 172.21.15.104:0/198377273 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c6c037070 con 0x7f6c7806d420 2024-04-24T02:15:21.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.334+0000 7f6c777fe640 1 -- 172.21.15.104:0/198377273 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c6c0319c0 con 0x7f6c7806d420 2024-04-24T02:15:21.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.334+0000 7f6c7ecac640 1 -- 172.21.15.104:0/198377273 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c7806d420 msgr2=0x7f6c7806d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:21.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.334+0000 7f6c7ecac640 1 --2- 172.21.15.104:0/198377273 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c7806d420 0x7f6c7806d800 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c009720 tx=0x7f6c6c02b840 comp rx=0 tx=0).stop 2024-04-24T02:15:21.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.334+0000 7f6c7ecac640 1 -- 172.21.15.104:0/198377273 shutdown_connections 2024-04-24T02:15:21.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.334+0000 7f6c7ecac640 1 --2- 172.21.15.104:0/198377273 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c7806d420 0x7f6c7806d800 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:21.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.334+0000 7f6c7ecac640 1 -- 172.21.15.104:0/198377273 >> 172.21.15.104:0/198377273 conn(0x7f6c78099680 msgr2=0x7f6c78099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:15:21.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.334+0000 7f6c7ecac640 1 -- 172.21.15.104:0/198377273 shutdown_connections 2024-04-24T02:15:21.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.334+0000 7f6c7ecac640 1 -- 172.21.15.104:0/198377273 wait complete. 2024-04-24T02:15:21.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.335+0000 7f6c7ecac640 1 Processor -- start 2024-04-24T02:15:21.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.335+0000 7f6c7ecac640 1 -- start start 2024-04-24T02:15:21.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.335+0000 7f6c7ecac640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c7806d420 0x7f6c78122860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:21.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.335+0000 7f6c7ecac640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f6c780722b0 con 0x7f6c7806d420 2024-04-24T02:15:21.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.335+0000 7f6c7ca48640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c7806d420 0x7f6c78122860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:21.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.335+0000 7f6c7ca48640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c7806d420 0x7f6c78122860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54334/0 (socket says 172.21.15.104:54334) 2024-04-24T02:15:21.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.335+0000 7f6c7ca48640 1 -- 172.21.15.104:0/1509385857 learned_addr learned my addr 172.21.15.104:0/1509385857 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:15:21.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.336+0000 7f6c7ca48640 1 -- 172.21.15.104:0/1509385857 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c78124570 con 0x7f6c7806d420 2024-04-24T02:15:21.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.336+0000 7f6c7ca48640 1 --2- 172.21.15.104:0/1509385857 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c7806d420 0x7f6c78122860 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c009840 tx=0x7f6c6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:21.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.336+0000 7f6c757fa640 1 -- 172.21.15.104:0/1509385857 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c6c032770 con 0x7f6c7806d420 2024-04-24T02:15:21.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.336+0000 7f6c757fa640 1 -- 172.21.15.104:0/1509385857 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c6c032910 con 0x7f6c7806d420 2024-04-24T02:15:21.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.336+0000 7f6c757fa640 1 -- 172.21.15.104:0/1509385857 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c6c032c10 con 0x7f6c7806d420 2024-04-24T02:15:21.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.336+0000 7f6c7ecac640 1 -- 172.21.15.104:0/1509385857 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c781240d0 con 0x7f6c7806d420 2024-04-24T02:15:21.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.336+0000 7f6c7ecac640 1 -- 172.21.15.104:0/1509385857 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c78122da0 con 0x7f6c7806d420 2024-04-24T02:15:21.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.337+0000 7f6c757fa640 1 -- 172.21.15.104:0/1509385857 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6c6c04c060 con 0x7f6c7806d420 2024-04-24T02:15:21.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.337+0000 7f6c757fa640 1 --2- 172.21.15.104:0/1509385857 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6c5c038060 0x7f6c5c03a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:21.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.337+0000 7f6c757fa640 1 -- 172.21.15.104:0/1509385857 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f6c6c02f050 con 0x7f6c7806d420 2024-04-24T02:15:21.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.337+0000 7f6c7ecac640 1 -- 172.21.15.104:0/1509385857 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c78125c90 con 0x7f6c7806d420 2024-04-24T02:15:21.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.337+0000 7f6c77fff640 1 --2- 172.21.15.104:0/1509385857 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6c5c038060 0x7f6c5c03a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:21.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.338+0000 7f6c77fff640 1 --2- 172.21.15.104:0/1509385857 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6c5c038060 0x7f6c5c03a520 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6c64000c00 tx=0x7f6c64007970 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:21.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.342+0000 7f6c757fa640 1 -- 172.21.15.104:0/1509385857 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f6c6c040070 con 0x7f6c7806d420 2024-04-24T02:15:21.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.514+0000 7f6c7ecac640 1 -- 172.21.15.104:0/1509385857 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6c78062da0 con 0x7f6c7806d420 2024-04-24T02:15:21.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.516+0000 7f6c757fa640 1 -- 172.21.15.104:0/1509385857 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+21101 (secure 0 0 0) 0x7f6c6c044df0 con 0x7f6c7806d420 2024-04-24T02:15:21.518 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:15:21.518 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":32,"fsid":"b09461c3-8f3e-4967-89da-98f6945a4445","created":"2024-04-24T02:11:39.732268+0000","modified":"2024-04-24T02:12:45.800019+0000","last_up_change":"2024-04-24T02:11:49.695976+0000","last_in_change":"2024-04-24T02:11:40.809349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T02:11:49.987861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-24T02:11:55.282567+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-04-24T02:12:00.829117+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-04-24T02:12:03.061175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-04-24T02:12:05.030189+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-04-24T02:12:06.843084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-04-24T02:12:08.802180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-04-24T02:12:10.872965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"505e5915-b411-48c8-b47f-9805fabd0c6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":2419146313},{"type":"v1","addr":"172.21.15.104:6801","nonce":2419146313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":2419146313},{"type":"v1","addr":"172.21.15.104:6803","nonce":2419146313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":2419146313},{"type":"v1","addr":"172.21.15.104:6807","nonce":2419146313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":2419146313},{"type":"v1","addr":"172.21.15.104:6805","nonce":2419146313}]},"public_addr":"172.21.15.104:6801/2419146313","cluster_addr":"172.21.15.104:6803/2419146313","heartbeat_back_addr":"172.21.15.104:6807/2419146313","heartbeat_front_addr":"172.21.15.104:6805/2419146313","state":["exists","up"]},{"osd":1,"uuid":"707422f1-aa99-41be-8312-caf9e6b35b46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1487076214},{"type":"v1","addr":"172.21.15.134:6809","nonce":1487076214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1487076214},{"type":"v1","addr":"172.21.15.134:6815","nonce":1487076214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1487076214},{"type":"v1","addr":"172.21.15.134:6823","nonce":1487076214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1487076214},{"type":"v1","addr":"172.21.15.134:6821","nonce":1487076214}]},"public_addr":"172.21.15.134:6809/1487076214","cluster_addr":"172.21.15.134:6815/1487076214","heartbeat_back_addr":"172.21.15.134:6823/1487076214","heartbeat_front_addr":"172.21.15.134:6821/1487076214","state":["exists","up"]},{"osd":2,"uuid":"745c40cd-2485-4701-ab89-5b349ab2198b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":214480313},{"type":"v1","addr":"172.21.15.134:6802","nonce":214480313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6805","nonce":214480313},{"type":"v1","addr":"172.21.15.134:6807","nonce":214480313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":214480313},{"type":"v1","addr":"172.21.15.134:6819","nonce":214480313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":214480313},{"type":"v1","addr":"172.21.15.134:6813","nonce":214480313}]},"public_addr":"172.21.15.134:6802/214480313","cluster_addr":"172.21.15.134:6807/214480313","heartbeat_back_addr":"172.21.15.134:6819/214480313","heartbeat_front_addr":"172.21.15.134:6813/214480313","state":["exists","up"]},{"osd":3,"uuid":"271174d0-434d-424e-9d20-fd0e2b1dac16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6801","nonce":3585115521},{"type":"v1","addr":"172.21.15.134:6803","nonce":3585115521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3585115521},{"type":"v1","addr":"172.21.15.134:6808","nonce":3585115521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":3585115521},{"type":"v1","addr":"172.21.15.134:6820","nonce":3585115521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":3585115521},{"type":"v1","addr":"172.21.15.134:6814","nonce":3585115521}]},"public_addr":"172.21.15.134:6803/3585115521","cluster_addr":"172.21.15.134:6808/3585115521","heartbeat_back_addr":"172.21.15.134:6820/3585115521","heartbeat_front_addr":"172.21.15.134:6814/3585115521","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T02:11:45.883353+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T02:11:45.977825+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T02:11:46.030798+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T02:11:46.006726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":3,"to":1}]},{"pgid":"3.18","mappings":[{"from":3,"to":0}]},{"pgid":"4.12","mappings":[{"from":3,"to":2}]},{"pgid":"4.22","mappings":[{"from":1,"to":2}]},{"pgid":"4.23","mappings":[{"from":3,"to":2}]},{"pgid":"4.2b","mappings":[{"from":3,"to":0}]},{"pgid":"5.c","mappings":[{"from":0,"to":2}]},{"pgid":"5.17","mappings":[{"from":0,"to":2}]},{"pgid":"5.1e","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T02:15:21.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.518+0000 7f6c7ecac640 1 -- 172.21.15.104:0/1509385857 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6c5c038060 msgr2=0x7f6c5c03a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:21.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.518+0000 7f6c7ecac640 1 --2- 172.21.15.104:0/1509385857 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6c5c038060 0x7f6c5c03a520 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6c64000c00 tx=0x7f6c64007970 comp rx=0 tx=0).stop 2024-04-24T02:15:21.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.518+0000 7f6c7ecac640 1 -- 172.21.15.104:0/1509385857 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c7806d420 msgr2=0x7f6c78122860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:21.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.518+0000 7f6c7ecac640 1 --2- 172.21.15.104:0/1509385857 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c7806d420 0x7f6c78122860 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c009840 tx=0x7f6c6c0046c0 comp rx=0 tx=0).stop 2024-04-24T02:15:21.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.518+0000 7f6c7ecac640 1 -- 172.21.15.104:0/1509385857 shutdown_connections 2024-04-24T02:15:21.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.518+0000 7f6c7ecac640 1 --2- 172.21.15.104:0/1509385857 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f6c5c038060 0x7f6c5c03a520 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:21.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.518+0000 7f6c7ecac640 1 --2- 172.21.15.104:0/1509385857 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c7806d420 0x7f6c78122860 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:21.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.518+0000 7f6c7ecac640 1 -- 172.21.15.104:0/1509385857 >> 172.21.15.104:0/1509385857 conn(0x7f6c78099680 msgr2=0x7f6c780903b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:15:21.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.518+0000 7f6c7ecac640 1 -- 172.21.15.104:0/1509385857 shutdown_connections 2024-04-24T02:15:21.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:21.518+0000 7f6c7ecac640 1 -- 172.21.15.104:0/1509385857 wait complete. 2024-04-24T02:15:22.531 INFO:tasks.ceph:Scrubbing osd.0 2024-04-24T02:15:22.532 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-24T02:15:22.558 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-04-24T02:15:22.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.636+0000 7fb8b2bd5640 1 Processor -- start 2024-04-24T02:15:22.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.636+0000 7fb8b2bd5640 1 -- start start 2024-04-24T02:15:22.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.636+0000 7fb8b2bd5640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb8ac12b3d0 0x7fb8ac12b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:22.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.636+0000 7fb8b2bd5640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8ac06eac0 con 0x7fb8ac0701f0 2024-04-24T02:15:22.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.636+0000 7fb8b2bd5640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fb8ac12af80 con 0x7fb8ac12b3d0 2024-04-24T02:15:22.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.636+0000 7fb8b0971640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb8ac12b3d0 0x7fb8ac12b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:22.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.636+0000 7fb8abfff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fb8ac0701f0 0x7fb8ac070630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:46594/0 (socket says 172.21.15.104:46594) 2024-04-24T02:15:22.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.636+0000 7fb8abfff640 1 -- 172.21.15.104:0/3040796414 learned_addr learned my addr 172.21.15.104:0/3040796414 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-04-24T02:15:22.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.637+0000 7fb8b0971640 1 -- 172.21.15.104:0/3040796414 >> v1:172.21.15.104:6789/0 conn(0x7fb8ac0701f0 legacy=0x7fb8ac070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:22.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.637+0000 7fb8b0971640 1 -- 172.21.15.104:0/3040796414 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8ac12b1b0 con 0x7fb8ac12b3d0 2024-04-24T02:15:22.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.637+0000 7fb8ab7fe640 1 -- 172.21.15.104:0/3040796414 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 615439513 0 0) 0x7fb8ac06eac0 con 0x7fb8ac0701f0 2024-04-24T02:15:22.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.637+0000 7fb8b0971640 1 --2- 172.21.15.104:0/3040796414 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8ac12b3d0 0x7fb8ac12b7b0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fb89c009720 tx=0x7fb89c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec791c7c5499b630 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:22.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.637+0000 7fb8ab7fe640 1 -- 172.21.15.104:0/3040796414 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb89c0316d0 con 0x7fb8ac12b3d0 2024-04-24T02:15:22.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.637+0000 7fb8ab7fe640 1 -- 172.21.15.104:0/3040796414 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb89c037070 con 0x7fb8ac12b3d0 2024-04-24T02:15:22.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.637+0000 7fb8ab7fe640 1 -- 172.21.15.104:0/3040796414 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb89c0319c0 con 0x7fb8ac12b3d0 2024-04-24T02:15:22.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.638+0000 7fb8b2bd5640 1 -- 172.21.15.104:0/3040796414 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8ac12b3d0 msgr2=0x7fb8ac12b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:22.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.638+0000 7fb8b2bd5640 1 --2- 172.21.15.104:0/3040796414 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8ac12b3d0 0x7fb8ac12b7b0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fb89c009720 tx=0x7fb89c02b840 comp rx=0 tx=0).stop 2024-04-24T02:15:22.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.638+0000 7fb8b2bd5640 1 -- 172.21.15.104:0/3040796414 shutdown_connections 2024-04-24T02:15:22.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.638+0000 7fb8b2bd5640 1 --2- 172.21.15.104:0/3040796414 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8ac12b3d0 0x7fb8ac12b7b0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:22.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.638+0000 7fb8b2bd5640 1 -- 172.21.15.104:0/3040796414 >> 172.21.15.104:0/3040796414 conn(0x7fb8ac099510 msgr2=0x7fb8ac099920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:15:22.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.638+0000 7fb8b2bd5640 1 -- 172.21.15.104:0/3040796414 shutdown_connections 2024-04-24T02:15:22.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.638+0000 7fb8b2bd5640 1 -- 172.21.15.104:0/3040796414 wait complete. 2024-04-24T02:15:22.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.639+0000 7fb8b2bd5640 1 Processor -- start 2024-04-24T02:15:22.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.639+0000 7fb8b2bd5640 1 -- start start 2024-04-24T02:15:22.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.639+0000 7fb8b2bd5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8ac0701f0 0x7fb8ac1bf130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:22.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.639+0000 7fb8b2bd5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb8ac072480 con 0x7fb8ac0701f0 2024-04-24T02:15:22.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.639+0000 7fb8b0971640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8ac0701f0 0x7fb8ac1bf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:22.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.639+0000 7fb8b0971640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8ac0701f0 0x7fb8ac1bf130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54348/0 (socket says 172.21.15.104:54348) 2024-04-24T02:15:22.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.639+0000 7fb8b0971640 1 -- 172.21.15.104:0/1709164663 learned_addr learned my addr 172.21.15.104:0/1709164663 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:15:22.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.640+0000 7fb8b0971640 1 -- 172.21.15.104:0/1709164663 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8ac12a1b0 con 0x7fb8ac0701f0 2024-04-24T02:15:22.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.640+0000 7fb8b0971640 1 --2- 172.21.15.104:0/1709164663 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8ac0701f0 0x7fb8ac1bf130 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fb89c009840 tx=0x7fb89c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:22.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.640+0000 7fb8a97fa640 1 -- 172.21.15.104:0/1709164663 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb89c004030 con 0x7fb8ac0701f0 2024-04-24T02:15:22.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.640+0000 7fb8a97fa640 1 -- 172.21.15.104:0/1709164663 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb89c0041d0 con 0x7fb8ac0701f0 2024-04-24T02:15:22.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.640+0000 7fb8a97fa640 1 -- 172.21.15.104:0/1709164663 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb89c0044b0 con 0x7fb8ac0701f0 2024-04-24T02:15:22.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.640+0000 7fb8b2bd5640 1 -- 172.21.15.104:0/1709164663 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8ac115c60 con 0x7fb8ac0701f0 2024-04-24T02:15:22.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.640+0000 7fb8b2bd5640 1 -- 172.21.15.104:0/1709164663 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8ac116120 con 0x7fb8ac0701f0 2024-04-24T02:15:22.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.641+0000 7fb8b2bd5640 1 -- 172.21.15.104:0/1709164663 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb8ac062da0 con 0x7fb8ac0701f0 2024-04-24T02:15:22.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.641+0000 7fb8a97fa640 1 -- 172.21.15.104:0/1709164663 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb89c003610 con 0x7fb8ac0701f0 2024-04-24T02:15:22.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.641+0000 7fb8a97fa640 1 --2- 172.21.15.104:0/1709164663 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fb898038060 0x7fb89803a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:22.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.641+0000 7fb8a97fa640 1 -- 172.21.15.104:0/1709164663 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fb89c02f050 con 0x7fb8ac0701f0 2024-04-24T02:15:22.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.641+0000 7fb8a97fa640 1 --2- 172.21.15.104:0/1709164663 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fb898043e60 0x7fb898046300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:22.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.641+0000 7fb8a97fa640 1 -- 172.21.15.104:0/1709164663 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb89c048ec0 con 0x7fb898043e60 2024-04-24T02:15:22.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.641+0000 7fb8a97fa640 1 -- 172.21.15.104:0/1709164663 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb89c074050 con 0x7fb8ac0701f0 2024-04-24T02:15:22.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.641+0000 7fb8b1172640 1 --2- 172.21.15.104:0/1709164663 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fb898043e60 0x7fb898046300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:22.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.641+0000 7fb8abfff640 1 --2- 172.21.15.104:0/1709164663 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fb898038060 0x7fb89803a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:22.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.642+0000 7fb8b1172640 1 --2- 172.21.15.104:0/1709164663 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fb898043e60 0x7fb898046300 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:22.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.642+0000 7fb8abfff640 1 --2- 172.21.15.104:0/1709164663 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fb898038060 0x7fb89803a520 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0000c00 tx=0x7fb8a0007910 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:22.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.642+0000 7fb8a97fa640 1 -- 172.21.15.104:0/1709164663 <== osd.0 v2:172.21.15.104:6800/2419146313 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb89c048ec0 con 0x7fb898043e60 2024-04-24T02:15:22.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.656+0000 7fb8b2bd5640 1 -- 172.21.15.104:0/1709164663 --> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb8ac116c30 con 0x7fb898043e60 2024-04-24T02:15:22.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.656+0000 7fb8a97fa640 1 -- 172.21.15.104:0/1709164663 <== osd.0 v2:172.21.15.104:6800/2419146313 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb8ac116c30 con 0x7fb898043e60 2024-04-24T02:15:22.657 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-24T02:15:22.658 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T02:15:22.658 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-24T02:15:22.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.656+0000 7fb8b2bd5640 1 -- 172.21.15.104:0/1709164663 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fb898043e60 msgr2=0x7fb898046300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:22.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.656+0000 7fb8b2bd5640 1 --2- 172.21.15.104:0/1709164663 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fb898043e60 0x7fb898046300 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:22.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.656+0000 7fb8b2bd5640 1 -- 172.21.15.104:0/1709164663 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fb898038060 msgr2=0x7fb89803a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:22.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.656+0000 7fb8b2bd5640 1 --2- 172.21.15.104:0/1709164663 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fb898038060 0x7fb89803a520 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0000c00 tx=0x7fb8a0007910 comp rx=0 tx=0).stop 2024-04-24T02:15:22.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.656+0000 7fb8b2bd5640 1 -- 172.21.15.104:0/1709164663 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8ac0701f0 msgr2=0x7fb8ac1bf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:22.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.656+0000 7fb8b2bd5640 1 --2- 172.21.15.104:0/1709164663 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8ac0701f0 0x7fb8ac1bf130 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fb89c009840 tx=0x7fb89c0046c0 comp rx=0 tx=0).stop 2024-04-24T02:15:22.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.656+0000 7fb8b2bd5640 1 -- 172.21.15.104:0/1709164663 shutdown_connections 2024-04-24T02:15:22.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.656+0000 7fb8b2bd5640 1 --2- 172.21.15.104:0/1709164663 >> [v2:172.21.15.104:6800/2419146313,v1:172.21.15.104:6801/2419146313] conn(0x7fb898043e60 0x7fb898046300 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:22.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.656+0000 7fb8b2bd5640 1 --2- 172.21.15.104:0/1709164663 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fb898038060 0x7fb89803a520 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:22.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.656+0000 7fb8b2bd5640 1 --2- 172.21.15.104:0/1709164663 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8ac0701f0 0x7fb8ac1bf130 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:22.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.656+0000 7fb8b2bd5640 1 -- 172.21.15.104:0/1709164663 >> 172.21.15.104:0/1709164663 conn(0x7fb8ac099510 msgr2=0x7fb8ac1214f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:15:22.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.656+0000 7fb8b2bd5640 1 -- 172.21.15.104:0/1709164663 shutdown_connections 2024-04-24T02:15:22.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.656+0000 7fb8b2bd5640 1 -- 172.21.15.104:0/1709164663 wait complete. 2024-04-24T02:15:22.668 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-24T02:15:22.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.764+0000 7fe20f2c8640 1 Processor -- start 2024-04-24T02:15:22.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.764+0000 7fe20f2c8640 1 -- start start 2024-04-24T02:15:22.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.764+0000 7fe20f2c8640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe20806fd50 0x7fe208133860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:22.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.764+0000 7fe20f2c8640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe208133da0 con 0x7fe20806f260 2024-04-24T02:15:22.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.764+0000 7fe20f2c8640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fe208070bc0 con 0x7fe20806fd50 2024-04-24T02:15:22.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.764+0000 7fe20c863640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe20806fd50 0x7fe208133860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:22.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.764+0000 7fe20d064640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fe20806f260 0x7fe20806f640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:46606/0 (socket says 172.21.15.104:46606) 2024-04-24T02:15:22.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.764+0000 7fe20d064640 1 -- 172.21.15.104:0/2019593294 learned_addr learned my addr 172.21.15.104:0/2019593294 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-04-24T02:15:22.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.764+0000 7fe20c863640 1 -- 172.21.15.104:0/2019593294 >> v1:172.21.15.104:6789/0 conn(0x7fe20806f260 legacy=0x7fe20806f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:22.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.764+0000 7fe20c863640 1 -- 172.21.15.104:0/2019593294 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe208134f80 con 0x7fe20806fd50 2024-04-24T02:15:22.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.764+0000 7fe1fffff640 1 -- 172.21.15.104:0/2019593294 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1069310934 0 0) 0x7fe208133da0 con 0x7fe20806f260 2024-04-24T02:15:22.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.765+0000 7fe20c863640 1 --2- 172.21.15.104:0/2019593294 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe20806fd50 0x7fe208133860 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fe1f8009720 tx=0x7fe1f802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e31678262410a07 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:22.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.765+0000 7fe1fffff640 1 -- 172.21.15.104:0/2019593294 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1f80316d0 con 0x7fe20806fd50 2024-04-24T02:15:22.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.765+0000 7fe1fffff640 1 -- 172.21.15.104:0/2019593294 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1f8037070 con 0x7fe20806fd50 2024-04-24T02:15:22.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.765+0000 7fe1fffff640 1 -- 172.21.15.104:0/2019593294 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1f80319c0 con 0x7fe20806fd50 2024-04-24T02:15:22.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.765+0000 7fe20f2c8640 1 -- 172.21.15.104:0/2019593294 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe20806fd50 msgr2=0x7fe208133860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:22.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.765+0000 7fe20f2c8640 1 --2- 172.21.15.104:0/2019593294 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe20806fd50 0x7fe208133860 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fe1f8009720 tx=0x7fe1f802b840 comp rx=0 tx=0).stop 2024-04-24T02:15:22.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.766+0000 7fe20f2c8640 1 -- 172.21.15.104:0/2019593294 shutdown_connections 2024-04-24T02:15:22.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.766+0000 7fe20f2c8640 1 --2- 172.21.15.104:0/2019593294 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe20806fd50 0x7fe208133860 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:22.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.766+0000 7fe20f2c8640 1 -- 172.21.15.104:0/2019593294 >> 172.21.15.104:0/2019593294 conn(0x7fe20809e170 msgr2=0x7fe20806d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:15:22.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.766+0000 7fe20f2c8640 1 -- 172.21.15.104:0/2019593294 shutdown_connections 2024-04-24T02:15:22.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.766+0000 7fe20f2c8640 1 -- 172.21.15.104:0/2019593294 wait complete. 2024-04-24T02:15:22.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.766+0000 7fe20f2c8640 1 Processor -- start 2024-04-24T02:15:22.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.766+0000 7fe20f2c8640 1 -- start start 2024-04-24T02:15:22.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.767+0000 7fe20f2c8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe20806f260 0x7fe2081247f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:22.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.767+0000 7fe20f2c8640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe208134300 con 0x7fe20806f260 2024-04-24T02:15:22.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.767+0000 7fe20d064640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe20806f260 0x7fe2081247f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:22.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.767+0000 7fe20d064640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe20806f260 0x7fe2081247f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54364/0 (socket says 172.21.15.104:54364) 2024-04-24T02:15:22.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.767+0000 7fe20d064640 1 -- 172.21.15.104:0/1545996260 learned_addr learned my addr 172.21.15.104:0/1545996260 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:15:22.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.767+0000 7fe20d064640 1 -- 172.21.15.104:0/1545996260 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe208131cf0 con 0x7fe20806f260 2024-04-24T02:15:22.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.767+0000 7fe20d064640 1 --2- 172.21.15.104:0/1545996260 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe20806f260 0x7fe2081247f0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fe20400c420 tx=0x7fe20400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:22.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.767+0000 7fe1fdffb640 1 -- 172.21.15.104:0/1545996260 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe204018070 con 0x7fe20806f260 2024-04-24T02:15:22.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.767+0000 7fe1fdffb640 1 -- 172.21.15.104:0/1545996260 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2040074d0 con 0x7fe20806f260 2024-04-24T02:15:22.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.767+0000 7fe20f2c8640 1 -- 172.21.15.104:0/1545996260 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe208131610 con 0x7fe20806f260 2024-04-24T02:15:22.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.767+0000 7fe1fdffb640 1 -- 172.21.15.104:0/1545996260 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe204004950 con 0x7fe20806f260 2024-04-24T02:15:22.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.768+0000 7fe20f2c8640 1 -- 172.21.15.104:0/1545996260 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe208132eb0 con 0x7fe20806f260 2024-04-24T02:15:22.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.768+0000 7fe1fdffb640 1 -- 172.21.15.104:0/1545996260 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe20401b070 con 0x7fe20806f260 2024-04-24T02:15:22.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.768+0000 7fe1fdffb640 1 --2- 172.21.15.104:0/1545996260 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe1ec038060 0x7fe1ec03a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:22.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.768+0000 7fe1fdffb640 1 -- 172.21.15.104:0/1545996260 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fe20404ac50 con 0x7fe20806f260 2024-04-24T02:15:22.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.769+0000 7fe20f2c8640 1 -- 172.21.15.104:0/1545996260 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe208131ab0 con 0x7fe20806f260 2024-04-24T02:15:22.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.769+0000 7fe20c863640 1 --2- 172.21.15.104:0/1545996260 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe1ec038060 0x7fe1ec03a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:22.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.769+0000 7fe20c863640 1 --2- 172.21.15.104:0/1545996260 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe1ec038060 0x7fe1ec03a520 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe1f8009720 tx=0x7fe1f8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:22.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.773+0000 7fe1fdffb640 1 -- 172.21.15.104:0/1545996260 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7fe204011960 con 0x7fe20806f260 2024-04-24T02:15:22.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.947+0000 7fe20f2c8640 1 -- 172.21.15.104:0/1545996260 --> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fe2080a18a0 con 0x7fe1ec038060 2024-04-24T02:15:22.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.948+0000 7fe1fdffb640 1 -- 172.21.15.104:0/1545996260 <== mgr.4101 v2:172.21.15.134:6824/3655027977 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe2080a18a0 con 0x7fe1ec038060 2024-04-24T02:15:22.950 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 0 to deep-scrub 2024-04-24T02:15:22.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.951+0000 7fe20f2c8640 1 -- 172.21.15.104:0/1545996260 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe1ec038060 msgr2=0x7fe1ec03a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:22.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.951+0000 7fe20f2c8640 1 --2- 172.21.15.104:0/1545996260 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe1ec038060 0x7fe1ec03a520 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe1f8009720 tx=0x7fe1f8008030 comp rx=0 tx=0).stop 2024-04-24T02:15:22.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.951+0000 7fe20f2c8640 1 -- 172.21.15.104:0/1545996260 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe20806f260 msgr2=0x7fe2081247f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:22.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.951+0000 7fe20f2c8640 1 --2- 172.21.15.104:0/1545996260 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe20806f260 0x7fe2081247f0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fe20400c420 tx=0x7fe20400c8e0 comp rx=0 tx=0).stop 2024-04-24T02:15:22.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.951+0000 7fe20f2c8640 1 -- 172.21.15.104:0/1545996260 shutdown_connections 2024-04-24T02:15:22.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.951+0000 7fe20f2c8640 1 --2- 172.21.15.104:0/1545996260 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fe1ec038060 0x7fe1ec03a520 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:22.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.951+0000 7fe20f2c8640 1 --2- 172.21.15.104:0/1545996260 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe20806f260 0x7fe2081247f0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:22.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.951+0000 7fe20f2c8640 1 -- 172.21.15.104:0/1545996260 >> 172.21.15.104:0/1545996260 conn(0x7fe20809e170 msgr2=0x7fe20809e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:15:22.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.951+0000 7fe20f2c8640 1 -- 172.21.15.104:0/1545996260 shutdown_connections 2024-04-24T02:15:22.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:22.951+0000 7fe20f2c8640 1 -- 172.21.15.104:0/1545996260 wait complete. 2024-04-24T02:15:22.964 INFO:tasks.ceph:Scrubbing osd.1 2024-04-24T02:15:22.964 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-24T02:15:23.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.061+0000 7f304f25f640 1 Processor -- start 2024-04-24T02:15:23.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.061+0000 7f304f25f640 1 -- start start 2024-04-24T02:15:23.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.062+0000 7f304f25f640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f304812eff0 0x7f3048133670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:23.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.062+0000 7f304f25f640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f304806db00 con 0x7f304812e350 2024-04-24T02:15:23.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.062+0000 7f304f25f640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f3048093140 con 0x7f304812eff0 2024-04-24T02:15:23.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.062+0000 7f3047fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f304812eff0 0x7f3048133670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:23.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.062+0000 7f304cffb640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f304812e350 0x7f304812e8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:46608/0 (socket says 172.21.15.104:46608) 2024-04-24T02:15:23.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.062+0000 7f304cffb640 1 -- 172.21.15.104:0/4215994397 learned_addr learned my addr 172.21.15.104:0/4215994397 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-04-24T02:15:23.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.062+0000 7f3047fff640 1 -- 172.21.15.104:0/4215994397 >> v1:172.21.15.104:6789/0 conn(0x7f304812e350 legacy=0x7f304812e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:23.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.062+0000 7f3047fff640 1 -- 172.21.15.104:0/4215994397 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f304806dda0 con 0x7f304812eff0 2024-04-24T02:15:23.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.063+0000 7f3047fff640 1 --2- 172.21.15.104:0/4215994397 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f304812eff0 0x7f3048133670 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f303c009720 tx=0x7f303c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72b3449f63f13281 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:23.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.063+0000 7f30477fe640 1 -- 172.21.15.104:0/4215994397 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f303c0316d0 con 0x7f304812eff0 2024-04-24T02:15:23.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.063+0000 7f30477fe640 1 -- 172.21.15.104:0/4215994397 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f303c037070 con 0x7f304812eff0 2024-04-24T02:15:23.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.063+0000 7f30477fe640 1 -- 172.21.15.104:0/4215994397 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f303c0319c0 con 0x7f304812eff0 2024-04-24T02:15:23.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.063+0000 7f304f25f640 1 -- 172.21.15.104:0/4215994397 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f304812eff0 msgr2=0x7f3048133670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:23.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.063+0000 7f304f25f640 1 --2- 172.21.15.104:0/4215994397 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f304812eff0 0x7f3048133670 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f303c009720 tx=0x7f303c02b840 comp rx=0 tx=0).stop 2024-04-24T02:15:23.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.063+0000 7f304f25f640 1 -- 172.21.15.104:0/4215994397 shutdown_connections 2024-04-24T02:15:23.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.063+0000 7f304f25f640 1 --2- 172.21.15.104:0/4215994397 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f304812eff0 0x7f3048133670 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:23.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.064+0000 7f304f25f640 1 -- 172.21.15.104:0/4215994397 >> 172.21.15.104:0/4215994397 conn(0x7f304809fba0 msgr2=0x7f304809ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:15:23.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.064+0000 7f304f25f640 1 -- 172.21.15.104:0/4215994397 shutdown_connections 2024-04-24T02:15:23.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.064+0000 7f304f25f640 1 -- 172.21.15.104:0/4215994397 wait complete. 2024-04-24T02:15:23.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.064+0000 7f304f25f640 1 Processor -- start 2024-04-24T02:15:23.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.064+0000 7f304f25f640 1 -- start start 2024-04-24T02:15:23.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.065+0000 7f304f25f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f304812e350 0x7f3048125b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:23.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.065+0000 7f304f25f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f3048133f40 con 0x7f304812e350 2024-04-24T02:15:23.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.065+0000 7f304cffb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f304812e350 0x7f3048125b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:23.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.065+0000 7f304cffb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f304812e350 0x7f3048125b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54386/0 (socket says 172.21.15.104:54386) 2024-04-24T02:15:23.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.065+0000 7f304cffb640 1 -- 172.21.15.104:0/3958597600 learned_addr learned my addr 172.21.15.104:0/3958597600 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:15:23.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.065+0000 7f304cffb640 1 -- 172.21.15.104:0/3958597600 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3048071f40 con 0x7f304812e350 2024-04-24T02:15:23.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.065+0000 7f304cffb640 1 --2- 172.21.15.104:0/3958597600 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f304812e350 0x7f3048125b10 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f303800c4a0 tx=0x7f303800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:23.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.065+0000 7f30457fa640 1 -- 172.21.15.104:0/3958597600 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3038017070 con 0x7f304812e350 2024-04-24T02:15:23.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.065+0000 7f30457fa640 1 -- 172.21.15.104:0/3958597600 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3038005c10 con 0x7f304812e350 2024-04-24T02:15:23.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.065+0000 7f304f25f640 1 -- 172.21.15.104:0/3958597600 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f304808e9f0 con 0x7f304812e350 2024-04-24T02:15:23.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.065+0000 7f30457fa640 1 -- 172.21.15.104:0/3958597600 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3038007070 con 0x7f304812e350 2024-04-24T02:15:23.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.065+0000 7f304f25f640 1 -- 172.21.15.104:0/3958597600 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3048127470 con 0x7f304812e350 2024-04-24T02:15:23.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.066+0000 7f304f25f640 1 -- 172.21.15.104:0/3958597600 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3048062da0 con 0x7f304812e350 2024-04-24T02:15:23.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.066+0000 7f30457fa640 1 -- 172.21.15.104:0/3958597600 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f303801a070 con 0x7f304812e350 2024-04-24T02:15:23.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.066+0000 7f30457fa640 1 --2- 172.21.15.104:0/3958597600 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3034038060 0x7f303403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:23.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.066+0000 7f30457fa640 1 -- 172.21.15.104:0/3958597600 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f303804abc0 con 0x7f304812e350 2024-04-24T02:15:23.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.067+0000 7f30457fa640 1 --2- 172.21.15.104:0/3958597600 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x7f3034043ec0 0x7f3034046360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:23.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.067+0000 7f30457fa640 1 -- 172.21.15.104:0/3958597600 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3034046a30 con 0x7f3034043ec0 2024-04-24T02:15:23.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.067+0000 7f30457fa640 1 -- 172.21.15.104:0/3958597600 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f303804d270 con 0x7f304812e350 2024-04-24T02:15:23.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.067+0000 7f3047fff640 1 --2- 172.21.15.104:0/3958597600 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3034038060 0x7f303403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:23.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.067+0000 7f304d7fc640 1 --2- 172.21.15.104:0/3958597600 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x7f3034043ec0 0x7f3034046360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:23.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.067+0000 7f3047fff640 1 --2- 172.21.15.104:0/3958597600 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3034038060 0x7f303403a520 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f303c036000 tx=0x7f303c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:23.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.067+0000 7f304d7fc640 1 --2- 172.21.15.104:0/3958597600 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x7f3034043ec0 0x7f3034046360 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:23.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.068+0000 7f30457fa640 1 -- 172.21.15.104:0/3958597600 <== osd.1 v2:172.21.15.134:6804/1487076214 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3034046a30 con 0x7f3034043ec0 2024-04-24T02:15:23.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.082+0000 7f304f25f640 1 -- 172.21.15.104:0/3958597600 --> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3048127d20 con 0x7f3034043ec0 2024-04-24T02:15:23.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.083+0000 7f30457fa640 1 -- 172.21.15.104:0/3958597600 <== osd.1 v2:172.21.15.134:6804/1487076214 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3048127d20 con 0x7f3034043ec0 2024-04-24T02:15:23.084 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-24T02:15:23.084 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T02:15:23.084 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-24T02:15:23.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.083+0000 7f304f25f640 1 -- 172.21.15.104:0/3958597600 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x7f3034043ec0 msgr2=0x7f3034046360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:23.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.083+0000 7f304f25f640 1 --2- 172.21.15.104:0/3958597600 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x7f3034043ec0 0x7f3034046360 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:23.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.083+0000 7f304f25f640 1 -- 172.21.15.104:0/3958597600 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3034038060 msgr2=0x7f303403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:23.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.083+0000 7f304f25f640 1 --2- 172.21.15.104:0/3958597600 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3034038060 0x7f303403a520 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f303c036000 tx=0x7f303c008030 comp rx=0 tx=0).stop 2024-04-24T02:15:23.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.083+0000 7f304f25f640 1 -- 172.21.15.104:0/3958597600 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f304812e350 msgr2=0x7f3048125b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:23.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.083+0000 7f304f25f640 1 --2- 172.21.15.104:0/3958597600 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f304812e350 0x7f3048125b10 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f303800c4a0 tx=0x7f303800c960 comp rx=0 tx=0).stop 2024-04-24T02:15:23.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.083+0000 7f304f25f640 1 -- 172.21.15.104:0/3958597600 shutdown_connections 2024-04-24T02:15:23.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.083+0000 7f304f25f640 1 --2- 172.21.15.104:0/3958597600 >> [v2:172.21.15.134:6804/1487076214,v1:172.21.15.134:6809/1487076214] conn(0x7f3034043ec0 0x7f3034046360 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:23.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.083+0000 7f304f25f640 1 --2- 172.21.15.104:0/3958597600 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3034038060 0x7f303403a520 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:23.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.083+0000 7f304f25f640 1 --2- 172.21.15.104:0/3958597600 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f304812e350 0x7f3048125b10 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:23.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.083+0000 7f304f25f640 1 -- 172.21.15.104:0/3958597600 >> 172.21.15.104:0/3958597600 conn(0x7f304809fba0 msgr2=0x7f304808fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:15:23.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.083+0000 7f304f25f640 1 -- 172.21.15.104:0/3958597600 shutdown_connections 2024-04-24T02:15:23.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.083+0000 7f304f25f640 1 -- 172.21.15.104:0/3958597600 wait complete. 2024-04-24T02:15:23.094 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-24T02:15:23.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.191+0000 7f26ee99f640 1 Processor -- start 2024-04-24T02:15:23.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.191+0000 7f26ee99f640 1 -- start start 2024-04-24T02:15:23.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.191+0000 7f26ee99f640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f26e8071090 0x7f26e8131430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:23.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.191+0000 7f26ee99f640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26e8098800 con 0x7f26e8096430 2024-04-24T02:15:23.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.191+0000 7f26ee99f640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f26e8071930 con 0x7f26e8071090 2024-04-24T02:15:23.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.191+0000 7f26e77fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f26e8071090 0x7f26e8131430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:23.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.191+0000 7f26e7fff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f26e8096430 0x7f26e8096810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:46614/0 (socket says 172.21.15.104:46614) 2024-04-24T02:15:23.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.191+0000 7f26e7fff640 1 -- 172.21.15.104:0/3912444428 learned_addr learned my addr 172.21.15.104:0/3912444428 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-04-24T02:15:23.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.191+0000 7f26e77fe640 1 -- 172.21.15.104:0/3912444428 >> v1:172.21.15.104:6789/0 conn(0x7f26e8096430 legacy=0x7f26e8096810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:23.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.191+0000 7f26e77fe640 1 -- 172.21.15.104:0/3912444428 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26e8071f50 con 0x7f26e8071090 2024-04-24T02:15:23.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.192+0000 7f26e77fe640 1 --2- 172.21.15.104:0/3912444428 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f26e8071090 0x7f26e8131430 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f26dc009720 tx=0x7f26dc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59e32831393ea48 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:23.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.192+0000 7f26e6ffd640 1 -- 172.21.15.104:0/3912444428 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26dc0316d0 con 0x7f26e8071090 2024-04-24T02:15:23.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.192+0000 7f26e6ffd640 1 -- 172.21.15.104:0/3912444428 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26dc037070 con 0x7f26e8071090 2024-04-24T02:15:23.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.192+0000 7f26e6ffd640 1 -- 172.21.15.104:0/3912444428 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26dc0319c0 con 0x7f26e8071090 2024-04-24T02:15:23.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.193+0000 7f26ee99f640 1 -- 172.21.15.104:0/3912444428 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f26e8071090 msgr2=0x7f26e8131430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:23.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.193+0000 7f26ee99f640 1 --2- 172.21.15.104:0/3912444428 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f26e8071090 0x7f26e8131430 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f26dc009720 tx=0x7f26dc02b840 comp rx=0 tx=0).stop 2024-04-24T02:15:23.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.193+0000 7f26ee99f640 1 -- 172.21.15.104:0/3912444428 shutdown_connections 2024-04-24T02:15:23.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.193+0000 7f26ee99f640 1 --2- 172.21.15.104:0/3912444428 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f26e8071090 0x7f26e8131430 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:23.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.193+0000 7f26ee99f640 1 -- 172.21.15.104:0/3912444428 >> 172.21.15.104:0/3912444428 conn(0x7f26e8099680 msgr2=0x7f26e8099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:15:23.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.193+0000 7f26ee99f640 1 -- 172.21.15.104:0/3912444428 shutdown_connections 2024-04-24T02:15:23.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.193+0000 7f26ee99f640 1 -- 172.21.15.104:0/3912444428 wait complete. 2024-04-24T02:15:23.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.194+0000 7f26ee99f640 1 Processor -- start 2024-04-24T02:15:23.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.194+0000 7f26ee99f640 1 -- start start 2024-04-24T02:15:23.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.194+0000 7f26ee99f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f26e8071090 0x7f26e8094a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:23.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.194+0000 7f26ee99f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f26e8131af0 con 0x7f26e8071090 2024-04-24T02:15:23.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.194+0000 7f26e7fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f26e8071090 0x7f26e8094a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:23.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.194+0000 7f26e7fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f26e8071090 0x7f26e8094a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54400/0 (socket says 172.21.15.104:54400) 2024-04-24T02:15:23.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.194+0000 7f26e7fff640 1 -- 172.21.15.104:0/2676736116 learned_addr learned my addr 172.21.15.104:0/2676736116 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:15:23.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.195+0000 7f26e7fff640 1 -- 172.21.15.104:0/2676736116 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26e808a270 con 0x7f26e8071090 2024-04-24T02:15:23.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.195+0000 7f26e7fff640 1 --2- 172.21.15.104:0/2676736116 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f26e8071090 0x7f26e8094a60 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f26d800c4a0 tx=0x7f26d800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:23.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.195+0000 7f26e4ff9640 1 -- 172.21.15.104:0/2676736116 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26d8017070 con 0x7f26e8071090 2024-04-24T02:15:23.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.195+0000 7f26e4ff9640 1 -- 172.21.15.104:0/2676736116 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26d8005c10 con 0x7f26e8071090 2024-04-24T02:15:23.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.195+0000 7f26ee99f640 1 -- 172.21.15.104:0/2676736116 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26e806f5f0 con 0x7f26e8071090 2024-04-24T02:15:23.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.195+0000 7f26e4ff9640 1 -- 172.21.15.104:0/2676736116 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26d8007070 con 0x7f26e8071090 2024-04-24T02:15:23.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.195+0000 7f26ee99f640 1 -- 172.21.15.104:0/2676736116 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26e808a6b0 con 0x7f26e8071090 2024-04-24T02:15:23.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.196+0000 7f26e4ff9640 1 -- 172.21.15.104:0/2676736116 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f26d801a070 con 0x7f26e8071090 2024-04-24T02:15:23.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.196+0000 7f26ee99f640 1 -- 172.21.15.104:0/2676736116 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26e8126490 con 0x7f26e8071090 2024-04-24T02:15:23.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.196+0000 7f26e4ff9640 1 --2- 172.21.15.104:0/2676736116 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f26d4038060 0x7f26d403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:23.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.196+0000 7f26e4ff9640 1 -- 172.21.15.104:0/2676736116 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f26d804abb0 con 0x7f26e8071090 2024-04-24T02:15:23.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.196+0000 7f26e77fe640 1 --2- 172.21.15.104:0/2676736116 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f26d4038060 0x7f26d403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:23.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.197+0000 7f26e77fe640 1 --2- 172.21.15.104:0/2676736116 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f26d4038060 0x7f26d403a520 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f26dc036000 tx=0x7f26dc008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:23.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.201+0000 7f26e4ff9640 1 -- 172.21.15.104:0/2676736116 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f26e808a270 con 0x7f26e8071090 2024-04-24T02:15:23.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.372+0000 7f26ee99f640 1 -- 172.21.15.104:0/2676736116 --> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f26e81311e0 con 0x7f26d4038060 2024-04-24T02:15:23.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.372+0000 7f26e4ff9640 1 -- 172.21.15.104:0/2676736116 <== mgr.4101 v2:172.21.15.134:6824/3655027977 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f26e81311e0 con 0x7f26d4038060 2024-04-24T02:15:23.373 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 1 to deep-scrub 2024-04-24T02:15:23.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.374+0000 7f26ee99f640 1 -- 172.21.15.104:0/2676736116 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f26d4038060 msgr2=0x7f26d403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:23.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.374+0000 7f26ee99f640 1 --2- 172.21.15.104:0/2676736116 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f26d4038060 0x7f26d403a520 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f26dc036000 tx=0x7f26dc008030 comp rx=0 tx=0).stop 2024-04-24T02:15:23.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.374+0000 7f26ee99f640 1 -- 172.21.15.104:0/2676736116 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f26e8071090 msgr2=0x7f26e8094a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:23.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.374+0000 7f26ee99f640 1 --2- 172.21.15.104:0/2676736116 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f26e8071090 0x7f26e8094a60 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f26d800c4a0 tx=0x7f26d800c960 comp rx=0 tx=0).stop 2024-04-24T02:15:23.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.374+0000 7f26ee99f640 1 -- 172.21.15.104:0/2676736116 shutdown_connections 2024-04-24T02:15:23.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.374+0000 7f26ee99f640 1 --2- 172.21.15.104:0/2676736116 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f26d4038060 0x7f26d403a520 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:23.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.374+0000 7f26ee99f640 1 --2- 172.21.15.104:0/2676736116 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f26e8071090 0x7f26e8094a60 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:23.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.374+0000 7f26ee99f640 1 -- 172.21.15.104:0/2676736116 >> 172.21.15.104:0/2676736116 conn(0x7f26e8099680 msgr2=0x7f26e8129ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:15:23.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.374+0000 7f26ee99f640 1 -- 172.21.15.104:0/2676736116 shutdown_connections 2024-04-24T02:15:23.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.374+0000 7f26ee99f640 1 -- 172.21.15.104:0/2676736116 wait complete. 2024-04-24T02:15:23.386 INFO:tasks.ceph:Scrubbing osd.2 2024-04-24T02:15:23.386 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-24T02:15:23.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.485+0000 7f0e4ca96640 1 Processor -- start 2024-04-24T02:15:23.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.485+0000 7f0e4ca96640 1 -- start start 2024-04-24T02:15:23.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.485+0000 7f0e4ca96640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f0e4812b3d0 0x7f0e4812b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:23.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.485+0000 7f0e4ca96640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e4806eac0 con 0x7f0e480701f0 2024-04-24T02:15:23.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.485+0000 7f0e4ca96640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f0e4812af80 con 0x7f0e4812b3d0 2024-04-24T02:15:23.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.485+0000 7f0e4659c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f0e4812b3d0 0x7f0e4812b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:23.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.485+0000 7f0e3ffff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f0e480701f0 0x7f0e48070630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:46620/0 (socket says 172.21.15.104:46620) 2024-04-24T02:15:23.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.485+0000 7f0e3ffff640 1 -- 172.21.15.104:0/4269878453 learned_addr learned my addr 172.21.15.104:0/4269878453 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-04-24T02:15:23.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.485+0000 7f0e4659c640 1 -- 172.21.15.104:0/4269878453 >> v1:172.21.15.104:6789/0 conn(0x7f0e480701f0 legacy=0x7f0e48070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:23.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.485+0000 7f0e4659c640 1 -- 172.21.15.104:0/4269878453 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e4812b1b0 con 0x7f0e4812b3d0 2024-04-24T02:15:23.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.485+0000 7f0e45d9b640 1 -- 172.21.15.104:0/4269878453 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1333155471 0 0) 0x7f0e4806eac0 con 0x7f0e480701f0 2024-04-24T02:15:23.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.486+0000 7f0e4659c640 1 --2- 172.21.15.104:0/4269878453 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0e4812b3d0 0x7f0e4812b7b0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f0e38009720 tx=0x7f0e3802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3f8cabd75acecc9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:23.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.486+0000 7f0e45d9b640 1 -- 172.21.15.104:0/4269878453 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e380316d0 con 0x7f0e4812b3d0 2024-04-24T02:15:23.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.486+0000 7f0e45d9b640 1 -- 172.21.15.104:0/4269878453 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e38037070 con 0x7f0e4812b3d0 2024-04-24T02:15:23.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.486+0000 7f0e45d9b640 1 -- 172.21.15.104:0/4269878453 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e380319c0 con 0x7f0e4812b3d0 2024-04-24T02:15:23.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.487+0000 7f0e4ca96640 1 -- 172.21.15.104:0/4269878453 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0e4812b3d0 msgr2=0x7f0e4812b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:23.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.487+0000 7f0e4ca96640 1 --2- 172.21.15.104:0/4269878453 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0e4812b3d0 0x7f0e4812b7b0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f0e38009720 tx=0x7f0e3802b840 comp rx=0 tx=0).stop 2024-04-24T02:15:23.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.487+0000 7f0e4ca96640 1 -- 172.21.15.104:0/4269878453 shutdown_connections 2024-04-24T02:15:23.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.487+0000 7f0e4ca96640 1 --2- 172.21.15.104:0/4269878453 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0e4812b3d0 0x7f0e4812b7b0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:23.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.487+0000 7f0e4ca96640 1 -- 172.21.15.104:0/4269878453 >> 172.21.15.104:0/4269878453 conn(0x7f0e48099510 msgr2=0x7f0e48099920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:15:23.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.487+0000 7f0e4ca96640 1 -- 172.21.15.104:0/4269878453 shutdown_connections 2024-04-24T02:15:23.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.487+0000 7f0e4ca96640 1 -- 172.21.15.104:0/4269878453 wait complete. 2024-04-24T02:15:23.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.488+0000 7f0e4ca96640 1 Processor -- start 2024-04-24T02:15:23.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.488+0000 7f0e4ca96640 1 -- start start 2024-04-24T02:15:23.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.488+0000 7f0e4ca96640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0e480701f0 0x7f0e481c1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:23.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.488+0000 7f0e4ca96640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0e48072480 con 0x7f0e480701f0 2024-04-24T02:15:23.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.488+0000 7f0e4659c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0e480701f0 0x7f0e481c1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:23.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.488+0000 7f0e4659c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0e480701f0 0x7f0e481c1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54424/0 (socket says 172.21.15.104:54424) 2024-04-24T02:15:23.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.488+0000 7f0e4659c640 1 -- 172.21.15.104:0/1983110507 learned_addr learned my addr 172.21.15.104:0/1983110507 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:15:23.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.488+0000 7f0e4659c640 1 -- 172.21.15.104:0/1983110507 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e48124ad0 con 0x7f0e480701f0 2024-04-24T02:15:23.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.489+0000 7f0e4659c640 1 --2- 172.21.15.104:0/1983110507 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0e480701f0 0x7f0e481c1150 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f0e38034040 tx=0x7f0e380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:23.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.489+0000 7f0e3effd640 1 -- 172.21.15.104:0/1983110507 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e38032640 con 0x7f0e480701f0 2024-04-24T02:15:23.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.489+0000 7f0e3effd640 1 -- 172.21.15.104:0/1983110507 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e380327e0 con 0x7f0e480701f0 2024-04-24T02:15:23.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.489+0000 7f0e4ca96640 1 -- 172.21.15.104:0/1983110507 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e48119670 con 0x7f0e480701f0 2024-04-24T02:15:23.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.489+0000 7f0e3effd640 1 -- 172.21.15.104:0/1983110507 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e38032ae0 con 0x7f0e480701f0 2024-04-24T02:15:23.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.489+0000 7f0e4ca96640 1 -- 172.21.15.104:0/1983110507 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e481c1690 con 0x7f0e480701f0 2024-04-24T02:15:23.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.490+0000 7f0e4ca96640 1 -- 172.21.15.104:0/1983110507 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0e4809c000 con 0x7f0e480701f0 2024-04-24T02:15:23.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.490+0000 7f0e3effd640 1 -- 172.21.15.104:0/1983110507 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0e3804c060 con 0x7f0e480701f0 2024-04-24T02:15:23.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.490+0000 7f0e3effd640 1 --2- 172.21.15.104:0/1983110507 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0e28038060 0x7f0e2803a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:23.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.490+0000 7f0e3effd640 1 -- 172.21.15.104:0/1983110507 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f0e3802f050 con 0x7f0e480701f0 2024-04-24T02:15:23.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.490+0000 7f0e3effd640 1 --2- 172.21.15.104:0/1983110507 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f0e28043ec0 0x7f0e28046360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:23.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.490+0000 7f0e3effd640 1 -- 172.21.15.104:0/1983110507 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0e38039e50 con 0x7f0e28043ec0 2024-04-24T02:15:23.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.490+0000 7f0e3effd640 1 -- 172.21.15.104:0/1983110507 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f0e38074050 con 0x7f0e480701f0 2024-04-24T02:15:23.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.490+0000 7f0e3ffff640 1 --2- 172.21.15.104:0/1983110507 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0e28038060 0x7f0e2803a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:23.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.490+0000 7f0e46d9d640 1 --2- 172.21.15.104:0/1983110507 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f0e28043ec0 0x7f0e28046360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:23.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.491+0000 7f0e46d9d640 1 --2- 172.21.15.104:0/1983110507 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f0e28043ec0 0x7f0e28046360 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:23.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.491+0000 7f0e3ffff640 1 --2- 172.21.15.104:0/1983110507 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0e28038060 0x7f0e2803a520 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0e30000c00 tx=0x7f0e30007970 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:23.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.491+0000 7f0e3effd640 1 -- 172.21.15.104:0/1983110507 <== osd.2 v2:172.21.15.134:6800/214480313 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0e38039e50 con 0x7f0e28043ec0 2024-04-24T02:15:23.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.504+0000 7f0e4ca96640 1 -- 172.21.15.104:0/1983110507 --> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0e48062da0 con 0x7f0e28043ec0 2024-04-24T02:15:23.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.505+0000 7f0e3effd640 1 -- 172.21.15.104:0/1983110507 <== osd.2 v2:172.21.15.134:6800/214480313 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f0e48062da0 con 0x7f0e28043ec0 2024-04-24T02:15:23.506 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-24T02:15:23.506 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T02:15:23.506 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-24T02:15:23.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.505+0000 7f0e4ca96640 1 -- 172.21.15.104:0/1983110507 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f0e28043ec0 msgr2=0x7f0e28046360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:23.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.505+0000 7f0e4ca96640 1 --2- 172.21.15.104:0/1983110507 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f0e28043ec0 0x7f0e28046360 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:23.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.505+0000 7f0e4ca96640 1 -- 172.21.15.104:0/1983110507 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0e28038060 msgr2=0x7f0e2803a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:23.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.505+0000 7f0e4ca96640 1 --2- 172.21.15.104:0/1983110507 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0e28038060 0x7f0e2803a520 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0e30000c00 tx=0x7f0e30007970 comp rx=0 tx=0).stop 2024-04-24T02:15:23.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.505+0000 7f0e4ca96640 1 -- 172.21.15.104:0/1983110507 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0e480701f0 msgr2=0x7f0e481c1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:23.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.505+0000 7f0e4ca96640 1 --2- 172.21.15.104:0/1983110507 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0e480701f0 0x7f0e481c1150 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f0e38034040 tx=0x7f0e380046c0 comp rx=0 tx=0).stop 2024-04-24T02:15:23.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.505+0000 7f0e4ca96640 1 -- 172.21.15.104:0/1983110507 shutdown_connections 2024-04-24T02:15:23.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.505+0000 7f0e4ca96640 1 --2- 172.21.15.104:0/1983110507 >> [v2:172.21.15.134:6800/214480313,v1:172.21.15.134:6802/214480313] conn(0x7f0e28043ec0 0x7f0e28046360 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:23.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.505+0000 7f0e4ca96640 1 --2- 172.21.15.104:0/1983110507 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f0e28038060 0x7f0e2803a520 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:23.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.505+0000 7f0e4ca96640 1 --2- 172.21.15.104:0/1983110507 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0e480701f0 0x7f0e481c1150 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:23.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.505+0000 7f0e4ca96640 1 -- 172.21.15.104:0/1983110507 >> 172.21.15.104:0/1983110507 conn(0x7f0e48099510 msgr2=0x7f0e4806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:15:23.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.505+0000 7f0e4ca96640 1 -- 172.21.15.104:0/1983110507 shutdown_connections 2024-04-24T02:15:23.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.505+0000 7f0e4ca96640 1 -- 172.21.15.104:0/1983110507 wait complete. 2024-04-24T02:15:23.516 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-24T02:15:23.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.612+0000 7fb9fd8c8640 1 Processor -- start 2024-04-24T02:15:23.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.612+0000 7fb9fd8c8640 1 -- start start 2024-04-24T02:15:23.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.613+0000 7fb9fd8c8640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb9f806fd50 0x7fb9f8133860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:23.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.613+0000 7fb9fd8c8640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9f8133da0 con 0x7fb9f806f260 2024-04-24T02:15:23.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.613+0000 7fb9fd8c8640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fb9f8070bc0 con 0x7fb9f806fd50 2024-04-24T02:15:23.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.613+0000 7fb9f67fc640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb9f806fd50 0x7fb9f8133860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:23.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.613+0000 7fb9f6ffd640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fb9f806f260 0x7fb9f806f640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:46628/0 (socket says 172.21.15.104:46628) 2024-04-24T02:15:23.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.613+0000 7fb9f6ffd640 1 -- 172.21.15.104:0/3010226969 learned_addr learned my addr 172.21.15.104:0/3010226969 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-04-24T02:15:23.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.613+0000 7fb9f5ffb640 1 -- 172.21.15.104:0/3010226969 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2254469111 0 0) 0x7fb9f8133da0 con 0x7fb9f806f260 2024-04-24T02:15:23.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.613+0000 7fb9f5ffb640 1 -- 172.21.15.104:0/3010226969 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb9e4003520 con 0x7fb9f806f260 2024-04-24T02:15:23.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.613+0000 7fb9f67fc640 1 -- 172.21.15.104:0/3010226969 >> v1:172.21.15.104:6789/0 conn(0x7fb9f806f260 legacy=0x7fb9f806f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:23.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.613+0000 7fb9f67fc640 1 -- 172.21.15.104:0/3010226969 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9f8134f80 con 0x7fb9f806fd50 2024-04-24T02:15:23.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.614+0000 7fb9f67fc640 1 --2- 172.21.15.104:0/3010226969 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb9f806fd50 0x7fb9f8133860 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0009720 tx=0x7fb9e002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d0b0e73ed98df28 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:23.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.614+0000 7fb9f5ffb640 1 -- 172.21.15.104:0/3010226969 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9e00316d0 con 0x7fb9f806fd50 2024-04-24T02:15:23.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.614+0000 7fb9f5ffb640 1 -- 172.21.15.104:0/3010226969 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9e0037070 con 0x7fb9f806fd50 2024-04-24T02:15:23.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.614+0000 7fb9f5ffb640 1 -- 172.21.15.104:0/3010226969 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9e00319c0 con 0x7fb9f806fd50 2024-04-24T02:15:23.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.614+0000 7fb9fd8c8640 1 -- 172.21.15.104:0/3010226969 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb9f806fd50 msgr2=0x7fb9f8133860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:23.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.614+0000 7fb9fd8c8640 1 --2- 172.21.15.104:0/3010226969 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb9f806fd50 0x7fb9f8133860 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0009720 tx=0x7fb9e002b840 comp rx=0 tx=0).stop 2024-04-24T02:15:23.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.614+0000 7fb9fd8c8640 1 -- 172.21.15.104:0/3010226969 shutdown_connections 2024-04-24T02:15:23.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.614+0000 7fb9fd8c8640 1 --2- 172.21.15.104:0/3010226969 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb9f806fd50 0x7fb9f8133860 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:23.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.614+0000 7fb9fd8c8640 1 -- 172.21.15.104:0/3010226969 >> 172.21.15.104:0/3010226969 conn(0x7fb9f809e170 msgr2=0x7fb9f806d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:15:23.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.614+0000 7fb9fd8c8640 1 -- 172.21.15.104:0/3010226969 shutdown_connections 2024-04-24T02:15:23.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.614+0000 7fb9fd8c8640 1 -- 172.21.15.104:0/3010226969 wait complete. 2024-04-24T02:15:23.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.615+0000 7fb9fd8c8640 1 Processor -- start 2024-04-24T02:15:23.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.615+0000 7fb9fd8c8640 1 -- start start 2024-04-24T02:15:23.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.616+0000 7fb9fd8c8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb9f806f260 0x7fb9f81247f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:23.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.616+0000 7fb9fd8c8640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb9f8134300 con 0x7fb9f806f260 2024-04-24T02:15:23.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.616+0000 7fb9f6ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb9f806f260 0x7fb9f81247f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:23.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.616+0000 7fb9f6ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb9f806f260 0x7fb9f81247f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54430/0 (socket says 172.21.15.104:54430) 2024-04-24T02:15:23.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.616+0000 7fb9f6ffd640 1 -- 172.21.15.104:0/982137627 learned_addr learned my addr 172.21.15.104:0/982137627 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:15:23.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.616+0000 7fb9f6ffd640 1 -- 172.21.15.104:0/982137627 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9f8131cf0 con 0x7fb9f806f260 2024-04-24T02:15:23.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.616+0000 7fb9f6ffd640 1 --2- 172.21.15.104:0/982137627 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb9f806f260 0x7fb9f81247f0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fb9f000c3b0 tx=0x7fb9f000c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:23.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.616+0000 7fb9effff640 1 -- 172.21.15.104:0/982137627 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9f0017070 con 0x7fb9f806f260 2024-04-24T02:15:23.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.616+0000 7fb9effff640 1 -- 172.21.15.104:0/982137627 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9f0005c10 con 0x7fb9f806f260 2024-04-24T02:15:23.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.616+0000 7fb9fd8c8640 1 -- 172.21.15.104:0/982137627 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9f8131610 con 0x7fb9f806f260 2024-04-24T02:15:23.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.616+0000 7fb9effff640 1 -- 172.21.15.104:0/982137627 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9f00070d0 con 0x7fb9f806f260 2024-04-24T02:15:23.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.616+0000 7fb9fd8c8640 1 -- 172.21.15.104:0/982137627 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9f8132eb0 con 0x7fb9f806f260 2024-04-24T02:15:23.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.617+0000 7fb9effff640 1 -- 172.21.15.104:0/982137627 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb9f001a070 con 0x7fb9f806f260 2024-04-24T02:15:23.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.617+0000 7fb9effff640 1 --2- 172.21.15.104:0/982137627 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fb9d8038010 0x7fb9d803a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:23.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.617+0000 7fb9effff640 1 -- 172.21.15.104:0/982137627 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fb9f004ad90 con 0x7fb9f806f260 2024-04-24T02:15:23.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.617+0000 7fb9fd8c8640 1 -- 172.21.15.104:0/982137627 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9f8131ab0 con 0x7fb9f806f260 2024-04-24T02:15:23.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.618+0000 7fb9f67fc640 1 --2- 172.21.15.104:0/982137627 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fb9d8038010 0x7fb9d803a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:23.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.618+0000 7fb9f67fc640 1 --2- 172.21.15.104:0/982137627 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fb9d8038010 0x7fb9d803a4d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0009720 tx=0x7fb9e0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:23.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.622+0000 7fb9effff640 1 -- 172.21.15.104:0/982137627 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7fb9f0019e10 con 0x7fb9f806f260 2024-04-24T02:15:23.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.796+0000 7fb9fd8c8640 1 -- 172.21.15.104:0/982137627 --> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fb9f80a18a0 con 0x7fb9d8038010 2024-04-24T02:15:23.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.797+0000 7fb9effff640 1 -- 172.21.15.104:0/982137627 <== mgr.4101 v2:172.21.15.134:6824/3655027977 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb9f80a18a0 con 0x7fb9d8038010 2024-04-24T02:15:23.798 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 2 to deep-scrub 2024-04-24T02:15:23.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.799+0000 7fb9fd8c8640 1 -- 172.21.15.104:0/982137627 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fb9d8038010 msgr2=0x7fb9d803a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:23.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.799+0000 7fb9fd8c8640 1 --2- 172.21.15.104:0/982137627 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fb9d8038010 0x7fb9d803a4d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0009720 tx=0x7fb9e0008030 comp rx=0 tx=0).stop 2024-04-24T02:15:23.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.799+0000 7fb9fd8c8640 1 -- 172.21.15.104:0/982137627 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb9f806f260 msgr2=0x7fb9f81247f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:23.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.799+0000 7fb9fd8c8640 1 --2- 172.21.15.104:0/982137627 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb9f806f260 0x7fb9f81247f0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fb9f000c3b0 tx=0x7fb9f000c870 comp rx=0 tx=0).stop 2024-04-24T02:15:23.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.799+0000 7fb9fd8c8640 1 -- 172.21.15.104:0/982137627 shutdown_connections 2024-04-24T02:15:23.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.799+0000 7fb9fd8c8640 1 --2- 172.21.15.104:0/982137627 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fb9d8038010 0x7fb9d803a4d0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:23.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.799+0000 7fb9fd8c8640 1 --2- 172.21.15.104:0/982137627 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb9f806f260 0x7fb9f81247f0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:23.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.799+0000 7fb9fd8c8640 1 -- 172.21.15.104:0/982137627 >> 172.21.15.104:0/982137627 conn(0x7fb9f809e170 msgr2=0x7fb9f809e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:15:23.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.799+0000 7fb9fd8c8640 1 -- 172.21.15.104:0/982137627 shutdown_connections 2024-04-24T02:15:23.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.799+0000 7fb9fd8c8640 1 -- 172.21.15.104:0/982137627 wait complete. 2024-04-24T02:15:23.811 INFO:tasks.ceph:Scrubbing osd.3 2024-04-24T02:15:23.811 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-24T02:15:23.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.909+0000 7f365a57a640 1 Processor -- start 2024-04-24T02:15:23.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.909+0000 7f365a57a640 1 -- start start 2024-04-24T02:15:23.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.910+0000 7f365a57a640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f365412eff0 0x7f3654133670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:23.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.910+0000 7f365a57a640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f365406db00 con 0x7f365412e350 2024-04-24T02:15:23.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.910+0000 7f365a57a640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f3654093140 con 0x7f365412eff0 2024-04-24T02:15:23.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.910+0000 7f3653fff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f365412e350 0x7f365412e8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:46636/0 (socket says 172.21.15.104:46636) 2024-04-24T02:15:23.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.910+0000 7f3653fff640 1 -- 172.21.15.104:0/3030559374 learned_addr learned my addr 172.21.15.104:0/3030559374 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-04-24T02:15:23.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.910+0000 7f36537fe640 1 --2- 172.21.15.104:0/3030559374 >> v2:172.21.15.104:3300/0 conn(0x7f365412eff0 0x7f3654133670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:23.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.910+0000 7f3652ffd640 1 -- 172.21.15.104:0/3030559374 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3016088755 0 0) 0x7f365406db00 con 0x7f365412e350 2024-04-24T02:15:23.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.910+0000 7f3652ffd640 1 -- 172.21.15.104:0/3030559374 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f363c003520 con 0x7f365412e350 2024-04-24T02:15:23.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.910+0000 7f36537fe640 1 -- 172.21.15.104:0/3030559374 >> v1:172.21.15.104:6789/0 conn(0x7f365412e350 legacy=0x7f365412e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:23.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.910+0000 7f36537fe640 1 -- 172.21.15.104:0/3030559374 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f365406dda0 con 0x7f365412eff0 2024-04-24T02:15:23.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.911+0000 7f36537fe640 1 --2- 172.21.15.104:0/3030559374 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f365412eff0 0x7f3654133670 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f3648009720 tx=0x7f364802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d65dbcc9eecd6a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:23.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.911+0000 7f3652ffd640 1 -- 172.21.15.104:0/3030559374 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36480316d0 con 0x7f365412eff0 2024-04-24T02:15:23.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.911+0000 7f3652ffd640 1 -- 172.21.15.104:0/3030559374 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3648037070 con 0x7f365412eff0 2024-04-24T02:15:23.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.911+0000 7f3652ffd640 1 -- 172.21.15.104:0/3030559374 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36480319a0 con 0x7f365412eff0 2024-04-24T02:15:23.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.912+0000 7f365a57a640 1 -- 172.21.15.104:0/3030559374 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f365412eff0 msgr2=0x7f3654133670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:23.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.912+0000 7f365a57a640 1 --2- 172.21.15.104:0/3030559374 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f365412eff0 0x7f3654133670 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f3648009720 tx=0x7f364802b840 comp rx=0 tx=0).stop 2024-04-24T02:15:23.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.912+0000 7f365a57a640 1 -- 172.21.15.104:0/3030559374 shutdown_connections 2024-04-24T02:15:23.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.912+0000 7f365a57a640 1 --2- 172.21.15.104:0/3030559374 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f365412eff0 0x7f3654133670 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:23.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.912+0000 7f365a57a640 1 -- 172.21.15.104:0/3030559374 >> 172.21.15.104:0/3030559374 conn(0x7f365409fba0 msgr2=0x7f365409ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:15:23.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.912+0000 7f365a57a640 1 -- 172.21.15.104:0/3030559374 shutdown_connections 2024-04-24T02:15:23.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.912+0000 7f365a57a640 1 -- 172.21.15.104:0/3030559374 wait complete. 2024-04-24T02:15:23.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.912+0000 7f365a57a640 1 Processor -- start 2024-04-24T02:15:23.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.913+0000 7f365a57a640 1 -- start start 2024-04-24T02:15:23.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.913+0000 7f365a57a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f365412e350 0x7f3654071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:23.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.913+0000 7f365a57a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f3654133f40 con 0x7f365412e350 2024-04-24T02:15:23.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.913+0000 7f3653fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f365412e350 0x7f3654071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:23.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.913+0000 7f3653fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f365412e350 0x7f3654071e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54452/0 (socket says 172.21.15.104:54452) 2024-04-24T02:15:23.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.913+0000 7f3653fff640 1 -- 172.21.15.104:0/4199688263 learned_addr learned my addr 172.21.15.104:0/4199688263 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:15:23.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.913+0000 7f3653fff640 1 -- 172.21.15.104:0/4199688263 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36541264f0 con 0x7f365412e350 2024-04-24T02:15:23.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.913+0000 7f3653fff640 1 --2- 172.21.15.104:0/4199688263 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f365412e350 0x7f3654071e40 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f364400c3b0 tx=0x7f364400c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:23.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.914+0000 7f3650ff9640 1 -- 172.21.15.104:0/4199688263 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3644017070 con 0x7f365412e350 2024-04-24T02:15:23.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.914+0000 7f3650ff9640 1 -- 172.21.15.104:0/4199688263 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3644005c10 con 0x7f365412e350 2024-04-24T02:15:23.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.914+0000 7f365a57a640 1 -- 172.21.15.104:0/4199688263 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3654126cc0 con 0x7f365412e350 2024-04-24T02:15:23.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.914+0000 7f3650ff9640 1 -- 172.21.15.104:0/4199688263 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36440070d0 con 0x7f365412e350 2024-04-24T02:15:23.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.914+0000 7f365a57a640 1 -- 172.21.15.104:0/4199688263 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3654127360 con 0x7f365412e350 2024-04-24T02:15:23.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.914+0000 7f365a57a640 1 -- 172.21.15.104:0/4199688263 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3654062da0 con 0x7f365412e350 2024-04-24T02:15:23.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.914+0000 7f3650ff9640 1 -- 172.21.15.104:0/4199688263 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f364401a070 con 0x7f365412e350 2024-04-24T02:15:23.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.915+0000 7f3650ff9640 1 --2- 172.21.15.104:0/4199688263 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3640038060 0x7f364003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:23.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.915+0000 7f3650ff9640 1 -- 172.21.15.104:0/4199688263 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f364404ad80 con 0x7f365412e350 2024-04-24T02:15:23.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.915+0000 7f3650ff9640 1 --2- 172.21.15.104:0/4199688263 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x7f3640043ec0 0x7f3640046360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:23.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.915+0000 7f3650ff9640 1 -- 172.21.15.104:0/4199688263 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3644015e70 con 0x7f3640043ec0 2024-04-24T02:15:23.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.915+0000 7f3650ff9640 1 -- 172.21.15.104:0/4199688263 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f364404d370 con 0x7f365412e350 2024-04-24T02:15:23.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.915+0000 7f36537fe640 1 --2- 172.21.15.104:0/4199688263 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3640038060 0x7f364003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:23.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.915+0000 7f3658b17640 1 --2- 172.21.15.104:0/4199688263 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x7f3640043ec0 0x7f3640046360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:23.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.915+0000 7f3658b17640 1 --2- 172.21.15.104:0/4199688263 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x7f3640043ec0 0x7f3640046360 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:23.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.915+0000 7f36537fe640 1 --2- 172.21.15.104:0/4199688263 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3640038060 0x7f364003a520 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3648036000 tx=0x7f3648008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:23.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.916+0000 7f3650ff9640 1 -- 172.21.15.104:0/4199688263 <== osd.3 v2:172.21.15.134:6801/3585115521 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3644015e70 con 0x7f3640043ec0 2024-04-24T02:15:23.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.929+0000 7f365a57a640 1 -- 172.21.15.104:0/4199688263 --> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3654126070 con 0x7f3640043ec0 2024-04-24T02:15:23.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.930+0000 7f3650ff9640 1 -- 172.21.15.104:0/4199688263 <== osd.3 v2:172.21.15.134:6801/3585115521 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3654126070 con 0x7f3640043ec0 2024-04-24T02:15:23.931 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-24T02:15:23.931 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T02:15:23.931 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-24T02:15:23.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.930+0000 7f365a57a640 1 -- 172.21.15.104:0/4199688263 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x7f3640043ec0 msgr2=0x7f3640046360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:23.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.930+0000 7f365a57a640 1 --2- 172.21.15.104:0/4199688263 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x7f3640043ec0 0x7f3640046360 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:23.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.930+0000 7f365a57a640 1 -- 172.21.15.104:0/4199688263 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3640038060 msgr2=0x7f364003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:23.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.930+0000 7f365a57a640 1 --2- 172.21.15.104:0/4199688263 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3640038060 0x7f364003a520 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3648036000 tx=0x7f3648008030 comp rx=0 tx=0).stop 2024-04-24T02:15:23.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.930+0000 7f365a57a640 1 -- 172.21.15.104:0/4199688263 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f365412e350 msgr2=0x7f3654071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:23.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.930+0000 7f365a57a640 1 --2- 172.21.15.104:0/4199688263 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f365412e350 0x7f3654071e40 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f364400c3b0 tx=0x7f364400c870 comp rx=0 tx=0).stop 2024-04-24T02:15:23.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.930+0000 7f365a57a640 1 -- 172.21.15.104:0/4199688263 shutdown_connections 2024-04-24T02:15:23.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.930+0000 7f365a57a640 1 --2- 172.21.15.104:0/4199688263 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f3640038060 0x7f364003a520 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:23.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.930+0000 7f365a57a640 1 --2- 172.21.15.104:0/4199688263 >> [v2:172.21.15.134:6801/3585115521,v1:172.21.15.134:6803/3585115521] conn(0x7f3640043ec0 0x7f3640046360 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:23.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.930+0000 7f365a57a640 1 --2- 172.21.15.104:0/4199688263 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f365412e350 0x7f3654071e40 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:23.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.930+0000 7f365a57a640 1 -- 172.21.15.104:0/4199688263 >> 172.21.15.104:0/4199688263 conn(0x7f365409fba0 msgr2=0x7f36540905e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:15:23.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.930+0000 7f365a57a640 1 -- 172.21.15.104:0/4199688263 shutdown_connections 2024-04-24T02:15:23.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:23.930+0000 7f365a57a640 1 -- 172.21.15.104:0/4199688263 wait complete. 2024-04-24T02:15:23.941 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-24T02:15:24.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.037+0000 7f2e03bbd640 1 Processor -- start 2024-04-24T02:15:24.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.037+0000 7f2e03bbd640 1 -- start start 2024-04-24T02:15:24.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.038+0000 7f2e03bbd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f2dfc12dae0 0x7f2dfc12fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:24.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.038+0000 7f2e03bbd640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dfc06f0f0 con 0x7f2dfc06d690 2024-04-24T02:15:24.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.038+0000 7f2e03bbd640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f2dfc071a60 con 0x7f2dfc12dae0 2024-04-24T02:15:24.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.038+0000 7f2e01158640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f2dfc12dae0 0x7f2dfc12fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:24.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.038+0000 7f2e01959640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f2dfc06d690 0x7f2dfc06da70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:46644/0 (socket says 172.21.15.104:46644) 2024-04-24T02:15:24.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.038+0000 7f2e01959640 1 -- 172.21.15.104:0/2160702474 learned_addr learned my addr 172.21.15.104:0/2160702474 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-04-24T02:15:24.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.038+0000 7f2e01158640 1 -- 172.21.15.104:0/2160702474 >> v1:172.21.15.104:6789/0 conn(0x7f2dfc06d690 legacy=0x7f2dfc06da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:24.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.038+0000 7f2e01158640 1 -- 172.21.15.104:0/2160702474 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dfc06f8b0 con 0x7f2dfc12dae0 2024-04-24T02:15:24.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.038+0000 7f2e00957640 1 -- 172.21.15.104:0/2160702474 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2791946677 0 0) 0x7f2dfc06f0f0 con 0x7f2dfc06d690 2024-04-24T02:15:24.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.039+0000 7f2e01158640 1 --2- 172.21.15.104:0/2160702474 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2dfc12dae0 0x7f2dfc12fed0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f2dec00a8c0 tx=0x7f2dec02cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c3f063d8a69f6f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:24.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.039+0000 7f2e00957640 1 -- 172.21.15.104:0/2160702474 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dec03a070 con 0x7f2dfc12dae0 2024-04-24T02:15:24.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.039+0000 7f2e00957640 1 -- 172.21.15.104:0/2160702474 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dec02da00 con 0x7f2dfc12dae0 2024-04-24T02:15:24.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.039+0000 7f2e00957640 1 -- 172.21.15.104:0/2160702474 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dec00b040 con 0x7f2dfc12dae0 2024-04-24T02:15:24.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.039+0000 7f2e03bbd640 1 -- 172.21.15.104:0/2160702474 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2dfc12dae0 msgr2=0x7f2dfc12fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:24.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.039+0000 7f2e03bbd640 1 --2- 172.21.15.104:0/2160702474 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2dfc12dae0 0x7f2dfc12fed0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f2dec00a8c0 tx=0x7f2dec02cd20 comp rx=0 tx=0).stop 2024-04-24T02:15:24.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.039+0000 7f2e03bbd640 1 -- 172.21.15.104:0/2160702474 shutdown_connections 2024-04-24T02:15:24.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.039+0000 7f2e03bbd640 1 --2- 172.21.15.104:0/2160702474 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2dfc12dae0 0x7f2dfc12fed0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:24.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.039+0000 7f2e03bbd640 1 -- 172.21.15.104:0/2160702474 >> 172.21.15.104:0/2160702474 conn(0x7f2dfc099680 msgr2=0x7f2dfc099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:15:24.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.040+0000 7f2e03bbd640 1 -- 172.21.15.104:0/2160702474 shutdown_connections 2024-04-24T02:15:24.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.040+0000 7f2e03bbd640 1 -- 172.21.15.104:0/2160702474 wait complete. 2024-04-24T02:15:24.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.040+0000 7f2e03bbd640 1 Processor -- start 2024-04-24T02:15:24.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.040+0000 7f2e03bbd640 1 -- start start 2024-04-24T02:15:24.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.041+0000 7f2e03bbd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2dfc06d690 0x7f2dfc1c0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:24.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.041+0000 7f2e03bbd640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2dfc06e180 con 0x7f2dfc06d690 2024-04-24T02:15:24.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.041+0000 7f2e01959640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2dfc06d690 0x7f2dfc1c0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:24.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.041+0000 7f2e01959640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2dfc06d690 0x7f2dfc1c0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54474/0 (socket says 172.21.15.104:54474) 2024-04-24T02:15:24.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.041+0000 7f2e01959640 1 -- 172.21.15.104:0/3174672719 learned_addr learned my addr 172.21.15.104:0/3174672719 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:15:24.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.041+0000 7f2e01959640 1 -- 172.21.15.104:0/3174672719 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dfc121c20 con 0x7f2dfc06d690 2024-04-24T02:15:24.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.041+0000 7f2e01959640 1 --2- 172.21.15.104:0/3174672719 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2dfc06d690 0x7f2dfc1c0cb0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f2df800c370 tx=0x7f2df800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:24.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.041+0000 7f2df27fc640 1 -- 172.21.15.104:0/3174672719 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2df8007410 con 0x7f2dfc06d690 2024-04-24T02:15:24.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.041+0000 7f2df27fc640 1 -- 172.21.15.104:0/3174672719 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2df80075d0 con 0x7f2dfc06d690 2024-04-24T02:15:24.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.041+0000 7f2e03bbd640 1 -- 172.21.15.104:0/3174672719 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dfc1219e0 con 0x7f2dfc06d690 2024-04-24T02:15:24.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.041+0000 7f2df27fc640 1 -- 172.21.15.104:0/3174672719 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2df8004950 con 0x7f2dfc06d690 2024-04-24T02:15:24.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.041+0000 7f2e03bbd640 1 -- 172.21.15.104:0/3174672719 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dfc1c11f0 con 0x7f2dfc06d690 2024-04-24T02:15:24.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.042+0000 7f2df27fc640 1 -- 172.21.15.104:0/3174672719 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2df8011070 con 0x7f2dfc06d690 2024-04-24T02:15:24.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.042+0000 7f2e03bbd640 1 -- 172.21.15.104:0/3174672719 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dfc062da0 con 0x7f2dfc06d690 2024-04-24T02:15:24.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.042+0000 7f2df27fc640 1 --2- 172.21.15.104:0/3174672719 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f2de0038060 0x7f2de003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:24.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.042+0000 7f2df27fc640 1 -- 172.21.15.104:0/3174672719 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f2df804b4a0 con 0x7f2dfc06d690 2024-04-24T02:15:24.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.042+0000 7f2e01158640 1 --2- 172.21.15.104:0/3174672719 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f2de0038060 0x7f2de003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:24.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.043+0000 7f2e01158640 1 --2- 172.21.15.104:0/3174672719 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f2de0038060 0x7f2de003a520 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f2dec037000 tx=0x7f2dec031000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:24.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.047+0000 7f2df27fc640 1 -- 172.21.15.104:0/3174672719 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f2df8009c30 con 0x7f2dfc06d690 2024-04-24T02:15:24.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.219+0000 7f2e03bbd640 1 -- 172.21.15.104:0/3174672719 --> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f2dfc071660 con 0x7f2de0038060 2024-04-24T02:15:24.221 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.220+0000 7f2df27fc640 1 -- 172.21.15.104:0/3174672719 <== mgr.4101 v2:172.21.15.134:6824/3655027977 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2dfc071660 con 0x7f2de0038060 2024-04-24T02:15:24.221 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 3 to deep-scrub 2024-04-24T02:15:24.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.221+0000 7f2e03bbd640 1 -- 172.21.15.104:0/3174672719 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f2de0038060 msgr2=0x7f2de003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:24.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.221+0000 7f2e03bbd640 1 --2- 172.21.15.104:0/3174672719 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f2de0038060 0x7f2de003a520 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f2dec037000 tx=0x7f2dec031000 comp rx=0 tx=0).stop 2024-04-24T02:15:24.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.221+0000 7f2e03bbd640 1 -- 172.21.15.104:0/3174672719 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2dfc06d690 msgr2=0x7f2dfc1c0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:24.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.221+0000 7f2e03bbd640 1 --2- 172.21.15.104:0/3174672719 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2dfc06d690 0x7f2dfc1c0cb0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f2df800c370 tx=0x7f2df800c830 comp rx=0 tx=0).stop 2024-04-24T02:15:24.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.221+0000 7f2e03bbd640 1 -- 172.21.15.104:0/3174672719 shutdown_connections 2024-04-24T02:15:24.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.221+0000 7f2e03bbd640 1 --2- 172.21.15.104:0/3174672719 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f2de0038060 0x7f2de003a520 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:24.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.221+0000 7f2e03bbd640 1 --2- 172.21.15.104:0/3174672719 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2dfc06d690 0x7f2dfc1c0cb0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:24.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.221+0000 7f2e03bbd640 1 -- 172.21.15.104:0/3174672719 >> 172.21.15.104:0/3174672719 conn(0x7f2dfc099680 msgr2=0x7f2dfc070620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:15:24.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.221+0000 7f2e03bbd640 1 -- 172.21.15.104:0/3174672719 shutdown_connections 2024-04-24T02:15:24.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.221+0000 7f2e03bbd640 1 -- 172.21.15.104:0/3174672719 wait complete. 2024-04-24T02:15:24.233 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T02:15:24.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.326+0000 7f1c87c8c640 1 Processor -- start 2024-04-24T02:15:24.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.326+0000 7f1c87c8c640 1 -- start start 2024-04-24T02:15:24.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.327+0000 7f1c87c8c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f1c8006fd50 0x7f1c80133860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:24.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.327+0000 7f1c87c8c640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c80133da0 con 0x7f1c8006f260 2024-04-24T02:15:24.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.327+0000 7f1c87c8c640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f1c80070bc0 con 0x7f1c8006fd50 2024-04-24T02:15:24.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.327+0000 7f1c85227640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f1c8006fd50 0x7f1c80133860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:24.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.327+0000 7f1c85a28640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f1c8006f260 0x7f1c8006f640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:46654/0 (socket says 172.21.15.104:46654) 2024-04-24T02:15:24.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.327+0000 7f1c85a28640 1 -- 172.21.15.104:0/3200061504 learned_addr learned my addr 172.21.15.104:0/3200061504 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-04-24T02:15:24.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.327+0000 7f1c85227640 1 -- 172.21.15.104:0/3200061504 >> v1:172.21.15.104:6789/0 conn(0x7f1c8006f260 legacy=0x7f1c8006f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:24.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.327+0000 7f1c85227640 1 -- 172.21.15.104:0/3200061504 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c80134f80 con 0x7f1c8006fd50 2024-04-24T02:15:24.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.328+0000 7f1c85227640 1 --2- 172.21.15.104:0/3200061504 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1c8006fd50 0x7f1c80133860 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f1c70009720 tx=0x7f1c7002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a8e485e1c29b41f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:24.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.328+0000 7f1c84a26640 1 -- 172.21.15.104:0/3200061504 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c700316d0 con 0x7f1c8006fd50 2024-04-24T02:15:24.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.328+0000 7f1c84a26640 1 -- 172.21.15.104:0/3200061504 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c70037070 con 0x7f1c8006fd50 2024-04-24T02:15:24.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.328+0000 7f1c84a26640 1 -- 172.21.15.104:0/3200061504 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c700319c0 con 0x7f1c8006fd50 2024-04-24T02:15:24.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.328+0000 7f1c87c8c640 1 -- 172.21.15.104:0/3200061504 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1c8006fd50 msgr2=0x7f1c80133860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:24.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.328+0000 7f1c87c8c640 1 --2- 172.21.15.104:0/3200061504 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1c8006fd50 0x7f1c80133860 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f1c70009720 tx=0x7f1c7002b840 comp rx=0 tx=0).stop 2024-04-24T02:15:24.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.328+0000 7f1c87c8c640 1 -- 172.21.15.104:0/3200061504 shutdown_connections 2024-04-24T02:15:24.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.328+0000 7f1c87c8c640 1 --2- 172.21.15.104:0/3200061504 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1c8006fd50 0x7f1c80133860 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:24.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.328+0000 7f1c87c8c640 1 -- 172.21.15.104:0/3200061504 >> 172.21.15.104:0/3200061504 conn(0x7f1c8009e170 msgr2=0x7f1c8006d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:15:24.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.329+0000 7f1c87c8c640 1 -- 172.21.15.104:0/3200061504 shutdown_connections 2024-04-24T02:15:24.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.329+0000 7f1c87c8c640 1 -- 172.21.15.104:0/3200061504 wait complete. 2024-04-24T02:15:24.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.329+0000 7f1c87c8c640 1 Processor -- start 2024-04-24T02:15:24.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.329+0000 7f1c87c8c640 1 -- start start 2024-04-24T02:15:24.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.330+0000 7f1c87c8c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1c8006f260 0x7f1c8012aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:24.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.330+0000 7f1c87c8c640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f1c80134300 con 0x7f1c8006f260 2024-04-24T02:15:24.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.330+0000 7f1c85a28640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1c8006f260 0x7f1c8012aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:24.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.330+0000 7f1c85a28640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1c8006f260 0x7f1c8012aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54480/0 (socket says 172.21.15.104:54480) 2024-04-24T02:15:24.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.330+0000 7f1c85a28640 1 -- 172.21.15.104:0/2615182804 learned_addr learned my addr 172.21.15.104:0/2615182804 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:15:24.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.330+0000 7f1c85a28640 1 -- 172.21.15.104:0/2615182804 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c8011b5e0 con 0x7f1c8006f260 2024-04-24T02:15:24.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.330+0000 7f1c85a28640 1 --2- 172.21.15.104:0/2615182804 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1c8006f260 0x7f1c8012aa30 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c00ca90 tx=0x7f1c7c00cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:24.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.330+0000 7f1c767fc640 1 -- 172.21.15.104:0/2615182804 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c7c018070 con 0x7f1c8006f260 2024-04-24T02:15:24.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.330+0000 7f1c767fc640 1 -- 172.21.15.104:0/2615182804 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c7c004c90 con 0x7f1c8006f260 2024-04-24T02:15:24.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.330+0000 7f1c767fc640 1 -- 172.21.15.104:0/2615182804 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c7c00aa50 con 0x7f1c8006f260 2024-04-24T02:15:24.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.330+0000 7f1c87c8c640 1 -- 172.21.15.104:0/2615182804 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c8011c250 con 0x7f1c8006f260 2024-04-24T02:15:24.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.330+0000 7f1c87c8c640 1 -- 172.21.15.104:0/2615182804 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c8011c910 con 0x7f1c8006f260 2024-04-24T02:15:24.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.331+0000 7f1c767fc640 1 -- 172.21.15.104:0/2615182804 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1c7c01b070 con 0x7f1c8006f260 2024-04-24T02:15:24.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.331+0000 7f1c87c8c640 1 -- 172.21.15.104:0/2615182804 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c800a18a0 con 0x7f1c8006f260 2024-04-24T02:15:24.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.331+0000 7f1c767fc640 1 --2- 172.21.15.104:0/2615182804 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1c64038060 0x7f1c6403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:24.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.331+0000 7f1c767fc640 1 -- 172.21.15.104:0/2615182804 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f1c7c04b640 con 0x7f1c8006f260 2024-04-24T02:15:24.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.332+0000 7f1c85227640 1 --2- 172.21.15.104:0/2615182804 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1c64038060 0x7f1c6403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:24.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.332+0000 7f1c85227640 1 --2- 172.21.15.104:0/2615182804 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1c64038060 0x7f1c6403a520 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1c70009720 tx=0x7f1c70008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:24.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.336+0000 7f1c767fc640 1 -- 172.21.15.104:0/2615182804 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f1c800a18a0 con 0x7f1c8006f260 2024-04-24T02:15:24.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.506+0000 7f1c87c8c640 1 -- 172.21.15.104:0/2615182804 --> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1c80062da0 con 0x7f1c64038060 2024-04-24T02:15:24.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.521+0000 7f1c767fc640 1 -- 172.21.15.104:0/2615182804 <== mgr.4101 v2:172.21.15.134:6824/3655027977 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+663162 (secure 0 0 0) 0x7f1c80062da0 con 0x7f1c64038060 2024-04-24T02:15:24.535 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:15:24.543 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-04-24T02:15:24.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.526+0000 7f1c87c8c640 1 -- 172.21.15.104:0/2615182804 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1c64038060 msgr2=0x7f1c6403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:24.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.526+0000 7f1c87c8c640 1 --2- 172.21.15.104:0/2615182804 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1c64038060 0x7f1c6403a520 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1c70009720 tx=0x7f1c70008030 comp rx=0 tx=0).stop 2024-04-24T02:15:24.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.526+0000 7f1c87c8c640 1 -- 172.21.15.104:0/2615182804 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1c8006f260 msgr2=0x7f1c8012aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:24.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.526+0000 7f1c87c8c640 1 --2- 172.21.15.104:0/2615182804 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1c8006f260 0x7f1c8012aa30 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c00ca90 tx=0x7f1c7c00cf50 comp rx=0 tx=0).stop 2024-04-24T02:15:24.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.526+0000 7f1c87c8c640 1 -- 172.21.15.104:0/2615182804 shutdown_connections 2024-04-24T02:15:24.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.526+0000 7f1c87c8c640 1 --2- 172.21.15.104:0/2615182804 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f1c64038060 0x7f1c6403a520 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:24.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.526+0000 7f1c87c8c640 1 --2- 172.21.15.104:0/2615182804 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1c8006f260 0x7f1c8012aa30 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:24.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.526+0000 7f1c87c8c640 1 -- 172.21.15.104:0/2615182804 >> 172.21.15.104:0/2615182804 conn(0x7f1c8009e170 msgr2=0x7f1c8012edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:15:24.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.526+0000 7f1c87c8c640 1 -- 172.21.15.104:0/2615182804 shutdown_connections 2024-04-24T02:15:24.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:24.526+0000 7f1c87c8c640 1 -- 172.21.15.104:0/2615182804 wait complete. 2024-04-24T02:15:24.551 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2024-04-24T02:15:24.023387+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":22218486,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":258,"num_whiteouts":0,"num_read":5226,"num_read_kb":4774,"num_write":2311,"num_write_kb":61372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4738,"ondisk_log_size":4738,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":190536,"kb_used_data":45028,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377296824,"statfs":{"total":386547056640,"available":386351947776,"internally_reserved":0,"allocated":46108672,"data_stored":44940425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":21617384,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":554,"num_read_kb":508,"num_write":399,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004266"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.810958+0000","last_change":"2024-04-24T02:12:02.755215+0000","last_active":"2024-04-24T02:12:45.810958+0000","last_peered":"2024-04-24T02:12:45.810958+0000","last_clean":"2024-04-24T02:12:45.810958+0000","last_became_active":"2024-04-24T02:12:02.754954+0000","last_became_peered":"2024-04-24T02:12:02.754954+0000","last_unstale":"2024-04-24T02:12:45.810958+0000","last_undegraded":"2024-04-24T02:12:45.810958+0000","last_fullsized":"2024-04-24T02:12:45.810958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:57:48.477966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'8","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.464744+0000","last_change":"2024-04-24T02:12:04.754671+0000","last_active":"2024-04-24T02:15:13.464744+0000","last_peered":"2024-04-24T02:15:13.464744+0000","last_clean":"2024-04-24T02:15:13.464744+0000","last_became_active":"2024-04-24T02:12:04.754049+0000","last_became_peered":"2024-04-24T02:12:04.754049+0000","last_unstale":"2024-04-24T02:15:13.464744+0000","last_undegraded":"2024-04-24T02:15:13.464744+0000","last_fullsized":"2024-04-24T02:15:13.464744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:01:31.183580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:08.033273+0000","last_change":"2024-04-24T02:12:02.746058+0000","last_active":"2024-04-24T02:14:08.033273+0000","last_peered":"2024-04-24T02:14:08.033273+0000","last_clean":"2024-04-24T02:14:08.033273+0000","last_became_active":"2024-04-24T02:12:02.745526+0000","last_became_peered":"2024-04-24T02:12:02.745526+0000","last_unstale":"2024-04-24T02:14:08.033273+0000","last_undegraded":"2024-04-24T02:14:08.033273+0000","last_fullsized":"2024-04-24T02:14:08.033273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'12","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.465045+0000","last_change":"2024-04-24T02:12:04.763554+0000","last_active":"2024-04-24T02:15:13.465045+0000","last_peered":"2024-04-24T02:15:13.465045+0000","last_clean":"2024-04-24T02:15:13.465045+0000","last_became_active":"2024-04-24T02:12:04.762967+0000","last_became_peered":"2024-04-24T02:12:04.762967+0000","last_unstale":"2024-04-24T02:15:13.465045+0000","last_undegraded":"2024-04-24T02:15:13.465045+0000","last_fullsized":"2024-04-24T02:15:13.465045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:22:18.407526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":62,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.812393+0000","last_change":"2024-04-24T02:12:02.761596+0000","last_active":"2024-04-24T02:12:45.812393+0000","last_peered":"2024-04-24T02:12:45.812393+0000","last_clean":"2024-04-24T02:12:45.812393+0000","last_became_active":"2024-04-24T02:12:02.758985+0000","last_became_peered":"2024-04-24T02:12:02.758985+0000","last_unstale":"2024-04-24T02:12:45.812393+0000","last_undegraded":"2024-04-24T02:12:45.812393+0000","last_fullsized":"2024-04-24T02:12:45.812393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:31:31.121870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'6","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:29.125840+0000","last_change":"2024-04-24T02:12:04.765577+0000","last_active":"2024-04-24T02:13:29.125840+0000","last_peered":"2024-04-24T02:13:29.125840+0000","last_clean":"2024-04-24T02:13:29.125840+0000","last_became_active":"2024-04-24T02:12:04.765327+0000","last_became_peered":"2024-04-24T02:12:04.765327+0000","last_unstale":"2024-04-24T02:13:29.125840+0000","last_undegraded":"2024-04-24T02:13:29.125840+0000","last_fullsized":"2024-04-24T02:13:29.125840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:25:46.401212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.806962+0000","last_change":"2024-04-24T02:12:02.745643+0000","last_active":"2024-04-24T02:12:45.806962+0000","last_peered":"2024-04-24T02:12:45.806962+0000","last_clean":"2024-04-24T02:12:45.806962+0000","last_became_active":"2024-04-24T02:12:02.744804+0000","last_became_peered":"2024-04-24T02:12:02.744804+0000","last_unstale":"2024-04-24T02:12:45.806962+0000","last_undegraded":"2024-04-24T02:12:45.806962+0000","last_fullsized":"2024-04-24T02:12:45.806962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:05:35.109941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.167795+0000","last_change":"2024-04-24T02:12:04.763357+0000","last_active":"2024-04-24T02:15:13.167795+0000","last_peered":"2024-04-24T02:15:13.167795+0000","last_clean":"2024-04-24T02:15:13.167795+0000","last_became_active":"2024-04-24T02:12:04.763076+0000","last_became_peered":"2024-04-24T02:12:04.763076+0000","last_unstale":"2024-04-24T02:15:13.167795+0000","last_undegraded":"2024-04-24T02:15:13.167795+0000","last_fullsized":"2024-04-24T02:15:13.167795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:48:52.834838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.675276+0000","last_change":"2024-04-24T02:12:02.755265+0000","last_active":"2024-04-24T02:14:12.675276+0000","last_peered":"2024-04-24T02:14:12.675276+0000","last_clean":"2024-04-24T02:14:12.675276+0000","last_became_active":"2024-04-24T02:12:02.754208+0000","last_became_peered":"2024-04-24T02:12:02.754208+0000","last_unstale":"2024-04-24T02:14:12.675276+0000","last_undegraded":"2024-04-24T02:14:12.675276+0000","last_fullsized":"2024-04-24T02:14:12.675276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:34:23.368475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:09.631727+0000","last_change":"2024-04-24T02:12:04.755521+0000","last_active":"2024-04-24T02:14:09.631727+0000","last_peered":"2024-04-24T02:14:09.631727+0000","last_clean":"2024-04-24T02:14:09.631727+0000","last_became_active":"2024-04-24T02:12:04.755248+0000","last_became_peered":"2024-04-24T02:12:04.755248+0000","last_unstale":"2024-04-24T02:14:09.631727+0000","last_undegraded":"2024-04-24T02:14:09.631727+0000","last_fullsized":"2024-04-24T02:14:09.631727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:24:15.406623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:46.543231+0000","last_change":"2024-04-24T02:12:02.741732+0000","last_active":"2024-04-24T02:12:46.543231+0000","last_peered":"2024-04-24T02:12:46.543231+0000","last_clean":"2024-04-24T02:12:46.543231+0000","last_became_active":"2024-04-24T02:12:02.741326+0000","last_became_peered":"2024-04-24T02:12:02.741326+0000","last_unstale":"2024-04-24T02:12:46.543231+0000","last_undegraded":"2024-04-24T02:12:46.543231+0000","last_fullsized":"2024-04-24T02:12:46.543231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:56:56.371880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'4","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:09.640640+0000","last_change":"2024-04-24T02:12:04.763252+0000","last_active":"2024-04-24T02:14:09.640640+0000","last_peered":"2024-04-24T02:14:09.640640+0000","last_clean":"2024-04-24T02:14:09.640640+0000","last_became_active":"2024-04-24T02:12:04.762921+0000","last_became_peered":"2024-04-24T02:12:04.762921+0000","last_unstale":"2024-04-24T02:14:09.640640+0000","last_undegraded":"2024-04-24T02:14:09.640640+0000","last_fullsized":"2024-04-24T02:14:09.640640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:25:06.019153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.811719+0000","last_change":"2024-04-24T02:12:02.755513+0000","last_active":"2024-04-24T02:12:45.811719+0000","last_peered":"2024-04-24T02:12:45.811719+0000","last_clean":"2024-04-24T02:12:45.811719+0000","last_became_active":"2024-04-24T02:12:02.752921+0000","last_became_peered":"2024-04-24T02:12:02.752921+0000","last_unstale":"2024-04-24T02:12:45.811719+0000","last_undegraded":"2024-04-24T02:12:45.811719+0000","last_fullsized":"2024-04-24T02:12:45.811719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:31:26.988642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'12","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.393931+0000","last_change":"2024-04-24T02:12:04.752549+0000","last_active":"2024-04-24T02:15:13.393931+0000","last_peered":"2024-04-24T02:15:13.393931+0000","last_clean":"2024-04-24T02:15:13.393931+0000","last_became_active":"2024-04-24T02:12:04.751655+0000","last_became_peered":"2024-04-24T02:12:04.751655+0000","last_unstale":"2024-04-24T02:15:13.393931+0000","last_undegraded":"2024-04-24T02:15:13.393931+0000","last_fullsized":"2024-04-24T02:15:13.393931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:31:33.128498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"30'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:33.036734+0000","last_change":"2024-04-24T02:12:02.752760+0000","last_active":"2024-04-24T02:14:33.036734+0000","last_peered":"2024-04-24T02:14:33.036734+0000","last_clean":"2024-04-24T02:14:33.036734+0000","last_became_active":"2024-04-24T02:12:02.752476+0000","last_became_peered":"2024-04-24T02:12:02.752476+0000","last_unstale":"2024-04-24T02:14:33.036734+0000","last_undegraded":"2024-04-24T02:14:33.036734+0000","last_fullsized":"2024-04-24T02:14:33.036734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'18","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:29.126000+0000","last_change":"2024-04-24T02:12:04.766969+0000","last_active":"2024-04-24T02:13:29.126000+0000","last_peered":"2024-04-24T02:13:29.126000+0000","last_clean":"2024-04-24T02:13:29.126000+0000","last_became_active":"2024-04-24T02:12:04.766693+0000","last_became_peered":"2024-04-24T02:12:04.766693+0000","last_unstale":"2024-04-24T02:13:29.126000+0000","last_undegraded":"2024-04-24T02:13:29.126000+0000","last_fullsized":"2024-04-24T02:13:29.126000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:01:31.183580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.811209+0000","last_change":"2024-04-24T02:12:04.764729+0000","last_active":"2024-04-24T02:12:45.811209+0000","last_peered":"2024-04-24T02:12:45.811209+0000","last_clean":"2024-04-24T02:12:45.811209+0000","last_became_active":"2024-04-24T02:12:04.764470+0000","last_became_peered":"2024-04-24T02:12:04.764470+0000","last_unstale":"2024-04-24T02:12:45.811209+0000","last_undegraded":"2024-04-24T02:12:45.811209+0000","last_fullsized":"2024-04-24T02:12:45.811209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:27:54.808025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:29.115642+0000","last_change":"2024-04-24T02:12:02.754017+0000","last_active":"2024-04-24T02:13:29.115642+0000","last_peered":"2024-04-24T02:13:29.115642+0000","last_clean":"2024-04-24T02:13:29.115642+0000","last_became_active":"2024-04-24T02:12:02.753791+0000","last_became_peered":"2024-04-24T02:12:02.753791+0000","last_unstale":"2024-04-24T02:13:29.115642+0000","last_undegraded":"2024-04-24T02:13:29.115642+0000","last_fullsized":"2024-04-24T02:13:29.115642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:05:35.109941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'10","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.356710+0000","last_change":"2024-04-24T02:12:04.751048+0000","last_active":"2024-04-24T02:15:13.356710+0000","last_peered":"2024-04-24T02:15:13.356710+0000","last_clean":"2024-04-24T02:15:13.356710+0000","last_became_active":"2024-04-24T02:12:04.750774+0000","last_became_peered":"2024-04-24T02:12:04.750774+0000","last_unstale":"2024-04-24T02:15:13.356710+0000","last_undegraded":"2024-04-24T02:15:13.356710+0000","last_fullsized":"2024-04-24T02:15:13.356710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:31:33.128498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.813506+0000","last_change":"2024-04-24T02:12:02.755711+0000","last_active":"2024-04-24T02:12:45.813506+0000","last_peered":"2024-04-24T02:12:45.813506+0000","last_clean":"2024-04-24T02:12:45.813506+0000","last_became_active":"2024-04-24T02:12:02.754860+0000","last_became_peered":"2024-04-24T02:12:02.754860+0000","last_unstale":"2024-04-24T02:12:45.813506+0000","last_undegraded":"2024-04-24T02:12:45.813506+0000","last_fullsized":"2024-04-24T02:12:45.813506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:15:49.257695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'8","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:09.640474+0000","last_change":"2024-04-24T02:12:04.751178+0000","last_active":"2024-04-24T02:14:09.640474+0000","last_peered":"2024-04-24T02:14:09.640474+0000","last_clean":"2024-04-24T02:14:09.640474+0000","last_became_active":"2024-04-24T02:12:04.750919+0000","last_became_peered":"2024-04-24T02:12:04.750919+0000","last_unstale":"2024-04-24T02:14:09.640474+0000","last_undegraded":"2024-04-24T02:14:09.640474+0000","last_fullsized":"2024-04-24T02:14:09.640474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:43:59.642115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:30.040831+0000","last_change":"2024-04-24T02:12:02.756671+0000","last_active":"2024-04-24T02:14:30.040831+0000","last_peered":"2024-04-24T02:14:30.040831+0000","last_clean":"2024-04-24T02:14:30.040831+0000","last_became_active":"2024-04-24T02:12:02.756389+0000","last_became_peered":"2024-04-24T02:12:02.756389+0000","last_unstale":"2024-04-24T02:14:30.040831+0000","last_undegraded":"2024-04-24T02:14:30.040831+0000","last_fullsized":"2024-04-24T02:14:30.040831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:51:48.494870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'1","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.523285+0000","last_change":"2024-04-24T02:12:04.767195+0000","last_active":"2024-04-24T02:15:13.523285+0000","last_peered":"2024-04-24T02:15:13.523285+0000","last_clean":"2024-04-24T02:15:13.523285+0000","last_became_active":"2024-04-24T02:12:04.766739+0000","last_became_peered":"2024-04-24T02:12:04.766739+0000","last_unstale":"2024-04-24T02:15:13.523285+0000","last_undegraded":"2024-04-24T02:15:13.523285+0000","last_fullsized":"2024-04-24T02:15:13.523285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805201+0000","last_change":"2024-04-24T02:12:02.745281+0000","last_active":"2024-04-24T02:12:45.805201+0000","last_peered":"2024-04-24T02:12:45.805201+0000","last_clean":"2024-04-24T02:12:45.805201+0000","last_became_active":"2024-04-24T02:12:02.744763+0000","last_became_peered":"2024-04-24T02:12:02.744763+0000","last_unstale":"2024-04-24T02:12:45.805201+0000","last_undegraded":"2024-04-24T02:12:45.805201+0000","last_fullsized":"2024-04-24T02:12:45.805201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:15:49.257695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'10","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.394017+0000","last_change":"2024-04-24T02:12:04.764907+0000","last_active":"2024-04-24T02:15:13.394017+0000","last_peered":"2024-04-24T02:15:13.394017+0000","last_clean":"2024-04-24T02:15:13.394017+0000","last_became_active":"2024-04-24T02:12:04.764659+0000","last_became_peered":"2024-04-24T02:12:04.764659+0000","last_unstale":"2024-04-24T02:15:13.394017+0000","last_undegraded":"2024-04-24T02:15:13.394017+0000","last_fullsized":"2024-04-24T02:15:13.394017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:02.847691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:28.035991+0000","last_change":"2024-04-24T02:12:02.742249+0000","last_active":"2024-04-24T02:14:28.035991+0000","last_peered":"2024-04-24T02:14:28.035991+0000","last_clean":"2024-04-24T02:14:28.035991+0000","last_became_active":"2024-04-24T02:12:02.741976+0000","last_became_peered":"2024-04-24T02:12:02.741976+0000","last_unstale":"2024-04-24T02:14:28.035991+0000","last_undegraded":"2024-04-24T02:14:28.035991+0000","last_fullsized":"2024-04-24T02:14:28.035991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'10","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:28.945151+0000","last_change":"2024-04-24T02:12:04.755425+0000","last_active":"2024-04-24T02:13:28.945151+0000","last_peered":"2024-04-24T02:13:28.945151+0000","last_clean":"2024-04-24T02:13:28.945151+0000","last_became_active":"2024-04-24T02:12:04.755133+0000","last_became_peered":"2024-04-24T02:12:04.755133+0000","last_unstale":"2024-04-24T02:13:28.945151+0000","last_undegraded":"2024-04-24T02:13:28.945151+0000","last_fullsized":"2024-04-24T02:13:28.945151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:57:46.692802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.810492+0000","last_change":"2024-04-24T02:12:02.758478+0000","last_active":"2024-04-24T02:12:45.810492+0000","last_peered":"2024-04-24T02:12:45.810492+0000","last_clean":"2024-04-24T02:12:45.810492+0000","last_became_active":"2024-04-24T02:12:02.753196+0000","last_became_peered":"2024-04-24T02:12:02.753196+0000","last_unstale":"2024-04-24T02:12:45.810492+0000","last_undegraded":"2024-04-24T02:12:45.810492+0000","last_fullsized":"2024-04-24T02:12:45.810492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:51:50.235295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'35","reported_seq":99,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.370315+0000","last_change":"2024-04-24T02:12:12.798478+0000","last_active":"2024-04-24T02:15:13.370315+0000","last_peered":"2024-04-24T02:15:13.370315+0000","last_clean":"2024-04-24T02:15:13.370315+0000","last_became_active":"2024-04-24T02:12:12.798179+0000","last_became_peered":"2024-04-24T02:12:12.798179+0000","last_unstale":"2024-04-24T02:15:13.370315+0000","last_undegraded":"2024-04-24T02:15:13.370315+0000","last_fullsized":"2024-04-24T02:15:13.370315+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:44:55.926593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'5","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:25.040642+0000","last_change":"2024-04-24T02:12:04.764143+0000","last_active":"2024-04-24T02:14:25.040642+0000","last_peered":"2024-04-24T02:14:25.040642+0000","last_clean":"2024-04-24T02:14:25.040642+0000","last_became_active":"2024-04-24T02:12:04.763725+0000","last_became_peered":"2024-04-24T02:12:04.763725+0000","last_unstale":"2024-04-24T02:14:25.040642+0000","last_undegraded":"2024-04-24T02:14:25.040642+0000","last_fullsized":"2024-04-24T02:14:25.040642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:47:39.917204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:46.554283+0000","last_change":"2024-04-24T02:12:02.756910+0000","last_active":"2024-04-24T02:12:46.554283+0000","last_peered":"2024-04-24T02:12:46.554283+0000","last_clean":"2024-04-24T02:12:46.554283+0000","last_became_active":"2024-04-24T02:12:02.755520+0000","last_became_peered":"2024-04-24T02:12:02.755520+0000","last_unstale":"2024-04-24T02:12:46.554283+0000","last_undegraded":"2024-04-24T02:12:46.554283+0000","last_fullsized":"2024-04-24T02:12:46.554283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:11:28.150533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.811511+0000","last_change":"2024-04-24T02:12:06.759172+0000","last_active":"2024-04-24T02:12:45.811511+0000","last_peered":"2024-04-24T02:12:45.811511+0000","last_clean":"2024-04-24T02:12:45.811511+0000","last_became_active":"2024-04-24T02:12:06.758033+0000","last_became_peered":"2024-04-24T02:12:06.758033+0000","last_unstale":"2024-04-24T02:12:45.811511+0000","last_undegraded":"2024-04-24T02:12:45.811511+0000","last_fullsized":"2024-04-24T02:12:45.811511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:24.367968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'44","reported_seq":98,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:35.042437+0000","last_change":"2024-04-24T02:12:08.783964+0000","last_active":"2024-04-24T02:14:35.042437+0000","last_peered":"2024-04-24T02:14:35.042437+0000","last_clean":"2024-04-24T02:14:35.042437+0000","last_became_active":"2024-04-24T02:12:08.783666+0000","last_became_peered":"2024-04-24T02:12:08.783666+0000","last_unstale":"2024-04-24T02:14:35.042437+0000","last_undegraded":"2024-04-24T02:14:35.042437+0000","last_fullsized":"2024-04-24T02:14:35.042437+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:00:42.425055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804631+0000","last_change":"2024-04-24T02:12:10.787426+0000","last_active":"2024-04-24T02:12:45.804631+0000","last_peered":"2024-04-24T02:12:45.804631+0000","last_clean":"2024-04-24T02:12:45.804631+0000","last_became_active":"2024-04-24T02:12:10.786981+0000","last_became_peered":"2024-04-24T02:12:10.786981+0000","last_unstale":"2024-04-24T02:12:45.804631+0000","last_undegraded":"2024-04-24T02:12:45.804631+0000","last_fullsized":"2024-04-24T02:12:45.804631+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:03:55.174622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:28.953239+0000","last_change":"2024-04-24T02:12:12.797648+0000","last_active":"2024-04-24T02:13:28.953239+0000","last_peered":"2024-04-24T02:13:28.953239+0000","last_clean":"2024-04-24T02:13:28.953239+0000","last_became_active":"2024-04-24T02:12:12.796319+0000","last_became_peered":"2024-04-24T02:12:12.796319+0000","last_unstale":"2024-04-24T02:13:28.953239+0000","last_undegraded":"2024-04-24T02:13:28.953239+0000","last_fullsized":"2024-04-24T02:13:28.953239+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:12:52.743479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.812193+0000","last_change":"2024-04-24T02:12:04.764679+0000","last_active":"2024-04-24T02:12:45.812193+0000","last_peered":"2024-04-24T02:12:45.812193+0000","last_clean":"2024-04-24T02:12:45.812193+0000","last_became_active":"2024-04-24T02:12:04.764351+0000","last_became_peered":"2024-04-24T02:12:04.764351+0000","last_unstale":"2024-04-24T02:12:45.812193+0000","last_undegraded":"2024-04-24T02:12:45.812193+0000","last_fullsized":"2024-04-24T02:12:45.812193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:24:09.733301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.806373+0000","last_change":"2024-04-24T02:12:02.748273+0000","last_active":"2024-04-24T02:12:45.806373+0000","last_peered":"2024-04-24T02:12:45.806373+0000","last_clean":"2024-04-24T02:12:45.806373+0000","last_became_active":"2024-04-24T02:12:02.744030+0000","last_became_peered":"2024-04-24T02:12:02.744030+0000","last_unstale":"2024-04-24T02:12:45.806373+0000","last_undegraded":"2024-04-24T02:12:45.806373+0000","last_fullsized":"2024-04-24T02:12:45.806373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:39:43.304402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:28.036008+0000","last_change":"2024-04-24T02:12:06.758854+0000","last_active":"2024-04-24T02:14:28.036008+0000","last_peered":"2024-04-24T02:14:28.036008+0000","last_clean":"2024-04-24T02:14:28.036008+0000","last_became_active":"2024-04-24T02:12:06.758561+0000","last_became_peered":"2024-04-24T02:12:06.758561+0000","last_unstale":"2024-04-24T02:14:28.036008+0000","last_undegraded":"2024-04-24T02:14:28.036008+0000","last_fullsized":"2024-04-24T02:14:28.036008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"30'12","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804944+0000","last_change":"2024-04-24T02:12:08.767804+0000","last_active":"2024-04-24T02:12:45.804944+0000","last_peered":"2024-04-24T02:12:45.804944+0000","last_clean":"2024-04-24T02:12:45.804944+0000","last_became_active":"2024-04-24T02:12:08.767493+0000","last_became_peered":"2024-04-24T02:12:08.767493+0000","last_unstale":"2024-04-24T02:12:45.804944+0000","last_undegraded":"2024-04-24T02:12:45.804944+0000","last_fullsized":"2024-04-24T02:12:45.804944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:21:18.301632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804318+0000","last_change":"2024-04-24T02:12:10.779679+0000","last_active":"2024-04-24T02:12:45.804318+0000","last_peered":"2024-04-24T02:12:45.804318+0000","last_clean":"2024-04-24T02:12:45.804318+0000","last_became_active":"2024-04-24T02:12:10.779231+0000","last_became_peered":"2024-04-24T02:12:10.779231+0000","last_unstale":"2024-04-24T02:12:45.804318+0000","last_undegraded":"2024-04-24T02:12:45.804318+0000","last_fullsized":"2024-04-24T02:12:45.804318+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:38:27.193760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'8","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:43.038096+0000","last_change":"2024-04-24T02:12:12.791754+0000","last_active":"2024-04-24T02:14:43.038096+0000","last_peered":"2024-04-24T02:14:43.038096+0000","last_clean":"2024-04-24T02:14:43.038096+0000","last_became_active":"2024-04-24T02:12:12.791542+0000","last_became_peered":"2024-04-24T02:12:12.791542+0000","last_unstale":"2024-04-24T02:14:43.038096+0000","last_undegraded":"2024-04-24T02:14:43.038096+0000","last_fullsized":"2024-04-24T02:14:43.038096+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.349051+0000","last_change":"2024-04-24T02:12:04.764138+0000","last_active":"2024-04-24T02:15:13.349051+0000","last_peered":"2024-04-24T02:15:13.349051+0000","last_clean":"2024-04-24T02:15:13.349051+0000","last_became_active":"2024-04-24T02:12:04.763491+0000","last_became_peered":"2024-04-24T02:12:04.763491+0000","last_unstale":"2024-04-24T02:15:13.349051+0000","last_undegraded":"2024-04-24T02:15:13.349051+0000","last_fullsized":"2024-04-24T02:15:13.349051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:37:41.541077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"30'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.811251+0000","last_change":"2024-04-24T02:12:02.757002+0000","last_active":"2024-04-24T02:12:45.811251+0000","last_peered":"2024-04-24T02:12:45.811251+0000","last_clean":"2024-04-24T02:12:45.811251+0000","last_became_active":"2024-04-24T02:12:02.755636+0000","last_became_peered":"2024-04-24T02:12:02.755636+0000","last_unstale":"2024-04-24T02:12:45.811251+0000","last_undegraded":"2024-04-24T02:12:45.811251+0000","last_fullsized":"2024-04-24T02:12:45.811251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:55:45.693152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.814863+0000","last_change":"2024-04-24T02:12:45.813418+0000","last_active":"2024-04-24T02:12:45.814863+0000","last_peered":"2024-04-24T02:12:45.814863+0000","last_clean":"2024-04-24T02:12:45.814863+0000","last_became_active":"2024-04-24T02:12:45.813038+0000","last_became_peered":"2024-04-24T02:12:45.813038+0000","last_unstale":"2024-04-24T02:12:45.814863+0000","last_undegraded":"2024-04-24T02:12:45.814863+0000","last_fullsized":"2024-04-24T02:12:45.814863+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:24.367968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"30'22","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.808733+0000","last_change":"2024-04-24T02:12:08.783389+0000","last_active":"2024-04-24T02:12:45.808733+0000","last_peered":"2024-04-24T02:12:45.808733+0000","last_clean":"2024-04-24T02:12:45.808733+0000","last_became_active":"2024-04-24T02:12:08.783077+0000","last_became_peered":"2024-04-24T02:12:08.783077+0000","last_unstale":"2024-04-24T02:12:45.808733+0000","last_undegraded":"2024-04-24T02:12:45.808733+0000","last_fullsized":"2024-04-24T02:12:45.808733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:56:15.426387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'284","reported_seq":406,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:20.004638+0000","last_change":"2024-04-24T02:12:10.784037+0000","last_active":"2024-04-24T02:15:20.004638+0000","last_peered":"2024-04-24T02:15:20.004638+0000","last_clean":"2024-04-24T02:15:20.004638+0000","last_became_active":"2024-04-24T02:12:10.783726+0000","last_became_peered":"2024-04-24T02:12:10.783726+0000","last_unstale":"2024-04-24T02:15:20.004638+0000","last_undegraded":"2024-04-24T02:15:20.004638+0000","last_fullsized":"2024-04-24T02:15:20.004638+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:49:38.926049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.808957+0000","last_change":"2024-04-24T02:12:12.801707+0000","last_active":"2024-04-24T02:12:45.808957+0000","last_peered":"2024-04-24T02:12:45.808957+0000","last_clean":"2024-04-24T02:12:45.808957+0000","last_became_active":"2024-04-24T02:12:12.801331+0000","last_became_peered":"2024-04-24T02:12:12.801331+0000","last_unstale":"2024-04-24T02:12:45.808957+0000","last_undegraded":"2024-04-24T02:12:45.808957+0000","last_fullsized":"2024-04-24T02:12:45.808957+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:10:27.748343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'17","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.523265+0000","last_change":"2024-04-24T02:12:04.756301+0000","last_active":"2024-04-24T02:15:13.523265+0000","last_peered":"2024-04-24T02:15:13.523265+0000","last_clean":"2024-04-24T02:15:13.523265+0000","last_became_active":"2024-04-24T02:12:04.756039+0000","last_became_peered":"2024-04-24T02:12:04.756039+0000","last_unstale":"2024-04-24T02:15:13.523265+0000","last_undegraded":"2024-04-24T02:15:13.523265+0000","last_fullsized":"2024-04-24T02:15:13.523265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":60,"num_read_kb":52,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.803334+0000","last_change":"2024-04-24T02:12:02.755651+0000","last_active":"2024-04-24T02:12:45.803334+0000","last_peered":"2024-04-24T02:12:45.803334+0000","last_clean":"2024-04-24T02:12:45.803334+0000","last_became_active":"2024-04-24T02:12:02.754852+0000","last_became_peered":"2024-04-24T02:12:02.754852+0000","last_unstale":"2024-04-24T02:12:45.803334+0000","last_undegraded":"2024-04-24T02:12:45.803334+0000","last_fullsized":"2024-04-24T02:12:45.803334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:02:45.311843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.812440+0000","last_change":"2024-04-24T02:12:06.758372+0000","last_active":"2024-04-24T02:12:45.812440+0000","last_peered":"2024-04-24T02:12:45.812440+0000","last_clean":"2024-04-24T02:12:45.812440+0000","last_became_active":"2024-04-24T02:12:06.757883+0000","last_became_peered":"2024-04-24T02:12:06.757883+0000","last_unstale":"2024-04-24T02:12:45.812440+0000","last_undegraded":"2024-04-24T02:12:45.812440+0000","last_fullsized":"2024-04-24T02:12:45.812440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:30:33.127083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'38","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.180488+0000","last_change":"2024-04-24T02:12:08.781239+0000","last_active":"2024-04-24T02:15:13.180488+0000","last_peered":"2024-04-24T02:15:13.180488+0000","last_clean":"2024-04-24T02:15:13.180488+0000","last_became_active":"2024-04-24T02:12:08.780950+0000","last_became_peered":"2024-04-24T02:12:08.780950+0000","last_unstale":"2024-04-24T02:15:13.180488+0000","last_undegraded":"2024-04-24T02:15:13.180488+0000","last_fullsized":"2024-04-24T02:15:13.180488+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:22:22.427553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'285","reported_seq":439,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:20.163858+0000","last_change":"2024-04-24T02:12:10.778536+0000","last_active":"2024-04-24T02:15:20.163858+0000","last_peered":"2024-04-24T02:15:20.163858+0000","last_clean":"2024-04-24T02:15:20.163858+0000","last_became_active":"2024-04-24T02:12:10.778254+0000","last_became_peered":"2024-04-24T02:12:10.778254+0000","last_unstale":"2024-04-24T02:15:20.163858+0000","last_undegraded":"2024-04-24T02:15:20.163858+0000","last_fullsized":"2024-04-24T02:15:20.163858+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.349016+0000","last_change":"2024-04-24T02:12:04.768436+0000","last_active":"2024-04-24T02:15:13.349016+0000","last_peered":"2024-04-24T02:15:13.349016+0000","last_clean":"2024-04-24T02:15:13.349016+0000","last_became_active":"2024-04-24T02:12:04.767906+0000","last_became_peered":"2024-04-24T02:12:04.767906+0000","last_unstale":"2024-04-24T02:15:13.349016+0000","last_undegraded":"2024-04-24T02:15:13.349016+0000","last_fullsized":"2024-04-24T02:15:13.349016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:21:44.832014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"32'3","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:28.904559+0000","last_change":"2024-04-24T02:12:02.749142+0000","last_active":"2024-04-24T02:13:28.904559+0000","last_peered":"2024-04-24T02:13:28.904559+0000","last_clean":"2024-04-24T02:13:28.904559+0000","last_became_active":"2024-04-24T02:12:02.748372+0000","last_became_peered":"2024-04-24T02:12:02.748372+0000","last_unstale":"2024-04-24T02:13:28.904559+0000","last_undegraded":"2024-04-24T02:13:28.904559+0000","last_fullsized":"2024-04-24T02:13:28.904559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:59:32.006851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.803560+0000","last_change":"2024-04-24T02:12:06.764649+0000","last_active":"2024-04-24T02:12:45.803560+0000","last_peered":"2024-04-24T02:12:45.803560+0000","last_clean":"2024-04-24T02:12:45.803560+0000","last_became_active":"2024-04-24T02:12:06.764324+0000","last_became_peered":"2024-04-24T02:12:06.764324+0000","last_unstale":"2024-04-24T02:12:45.803560+0000","last_undegraded":"2024-04-24T02:12:45.803560+0000","last_fullsized":"2024-04-24T02:12:45.803560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:24.266336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'47","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:20.038968+0000","last_change":"2024-04-24T02:12:08.771425+0000","last_active":"2024-04-24T02:14:20.038968+0000","last_peered":"2024-04-24T02:14:20.038968+0000","last_clean":"2024-04-24T02:14:20.038968+0000","last_became_active":"2024-04-24T02:12:08.771060+0000","last_became_peered":"2024-04-24T02:12:08.771060+0000","last_unstale":"2024-04-24T02:14:20.038968+0000","last_undegraded":"2024-04-24T02:14:20.038968+0000","last_fullsized":"2024-04-24T02:14:20.038968+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:04:03.080193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:28.035964+0000","last_change":"2024-04-24T02:12:10.777029+0000","last_active":"2024-04-24T02:14:28.035964+0000","last_peered":"2024-04-24T02:14:28.035964+0000","last_clean":"2024-04-24T02:14:28.035964+0000","last_became_active":"2024-04-24T02:12:10.776715+0000","last_became_peered":"2024-04-24T02:12:10.776715+0000","last_unstale":"2024-04-24T02:14:28.035964+0000","last_undegraded":"2024-04-24T02:14:28.035964+0000","last_fullsized":"2024-04-24T02:14:28.035964+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'5","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:28.954965+0000","last_change":"2024-04-24T02:12:12.797751+0000","last_active":"2024-04-24T02:13:28.954965+0000","last_peered":"2024-04-24T02:13:28.954965+0000","last_clean":"2024-04-24T02:13:28.954965+0000","last_became_active":"2024-04-24T02:12:12.797405+0000","last_became_peered":"2024-04-24T02:12:12.797405+0000","last_unstale":"2024-04-24T02:13:28.954965+0000","last_undegraded":"2024-04-24T02:13:28.954965+0000","last_fullsized":"2024-04-24T02:13:28.954965+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:54:48.506969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'10","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.464804+0000","last_change":"2024-04-24T02:12:04.754076+0000","last_active":"2024-04-24T02:15:13.464804+0000","last_peered":"2024-04-24T02:15:13.464804+0000","last_clean":"2024-04-24T02:15:13.464804+0000","last_became_active":"2024-04-24T02:12:04.753819+0000","last_became_peered":"2024-04-24T02:12:04.753819+0000","last_unstale":"2024-04-24T02:15:13.464804+0000","last_undegraded":"2024-04-24T02:15:13.464804+0000","last_fullsized":"2024-04-24T02:15:13.464804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:39:00.502785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.813994+0000","last_change":"2024-04-24T02:12:02.743507+0000","last_active":"2024-04-24T02:12:45.813994+0000","last_peered":"2024-04-24T02:12:45.813994+0000","last_clean":"2024-04-24T02:12:45.813994+0000","last_became_active":"2024-04-24T02:12:02.743202+0000","last_became_peered":"2024-04-24T02:12:02.743202+0000","last_unstale":"2024-04-24T02:12:45.813994+0000","last_undegraded":"2024-04-24T02:12:45.813994+0000","last_fullsized":"2024-04-24T02:12:45.813994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:02:45.311843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:18.034515+0000","last_change":"2024-04-24T02:12:06.765949+0000","last_active":"2024-04-24T02:14:18.034515+0000","last_peered":"2024-04-24T02:14:18.034515+0000","last_clean":"2024-04-24T02:14:18.034515+0000","last_became_active":"2024-04-24T02:12:06.765690+0000","last_became_peered":"2024-04-24T02:12:06.765690+0000","last_unstale":"2024-04-24T02:14:18.034515+0000","last_undegraded":"2024-04-24T02:14:18.034515+0000","last_fullsized":"2024-04-24T02:14:18.034515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'39","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.477602+0000","last_change":"2024-04-24T02:12:08.780282+0000","last_active":"2024-04-24T02:15:13.477602+0000","last_peered":"2024-04-24T02:15:13.477602+0000","last_clean":"2024-04-24T02:15:13.477602+0000","last_became_active":"2024-04-24T02:12:08.779594+0000","last_became_peered":"2024-04-24T02:12:08.779594+0000","last_unstale":"2024-04-24T02:15:13.477602+0000","last_undegraded":"2024-04-24T02:15:13.477602+0000","last_fullsized":"2024-04-24T02:15:13.477602+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:31:17.615935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:23.035373+0000","last_change":"2024-04-24T02:12:10.785197+0000","last_active":"2024-04-24T02:14:23.035373+0000","last_peered":"2024-04-24T02:14:23.035373+0000","last_clean":"2024-04-24T02:14:23.035373+0000","last_became_active":"2024-04-24T02:12:10.784901+0000","last_became_peered":"2024-04-24T02:12:10.784901+0000","last_unstale":"2024-04-24T02:14:23.035373+0000","last_undegraded":"2024-04-24T02:14:23.035373+0000","last_fullsized":"2024-04-24T02:14:23.035373+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'5","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.396389+0000","last_change":"2024-04-24T02:12:12.795959+0000","last_active":"2024-04-24T02:15:13.396389+0000","last_peered":"2024-04-24T02:15:13.396389+0000","last_clean":"2024-04-24T02:15:13.396389+0000","last_became_active":"2024-04-24T02:12:12.795364+0000","last_became_peered":"2024-04-24T02:12:12.795364+0000","last_unstale":"2024-04-24T02:15:13.396389+0000","last_undegraded":"2024-04-24T02:15:13.396389+0000","last_fullsized":"2024-04-24T02:15:13.396389+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:56:16.695108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'8","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.464931+0000","last_change":"2024-04-24T02:12:04.763127+0000","last_active":"2024-04-24T02:15:13.464931+0000","last_peered":"2024-04-24T02:15:13.464931+0000","last_clean":"2024-04-24T02:15:13.464931+0000","last_became_active":"2024-04-24T02:12:04.762869+0000","last_became_peered":"2024-04-24T02:12:04.762869+0000","last_unstale":"2024-04-24T02:15:13.464931+0000","last_undegraded":"2024-04-24T02:15:13.464931+0000","last_fullsized":"2024-04-24T02:15:13.464931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:55:54.502965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.812086+0000","last_change":"2024-04-24T02:12:02.758980+0000","last_active":"2024-04-24T02:12:45.812086+0000","last_peered":"2024-04-24T02:12:45.812086+0000","last_clean":"2024-04-24T02:12:45.812086+0000","last_became_active":"2024-04-24T02:12:02.757488+0000","last_became_peered":"2024-04-24T02:12:02.757488+0000","last_unstale":"2024-04-24T02:12:45.812086+0000","last_undegraded":"2024-04-24T02:12:45.812086+0000","last_fullsized":"2024-04-24T02:12:45.812086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:39:09.728890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:23.035404+0000","last_change":"2024-04-24T02:12:06.764973+0000","last_active":"2024-04-24T02:14:23.035404+0000","last_peered":"2024-04-24T02:14:23.035404+0000","last_clean":"2024-04-24T02:14:23.035404+0000","last_became_active":"2024-04-24T02:12:06.764339+0000","last_became_peered":"2024-04-24T02:12:06.764339+0000","last_unstale":"2024-04-24T02:14:23.035404+0000","last_undegraded":"2024-04-24T02:14:23.035404+0000","last_fullsized":"2024-04-24T02:14:23.035404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'49","reported_seq":106,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:20.039693+0000","last_change":"2024-04-24T02:12:08.781158+0000","last_active":"2024-04-24T02:14:20.039693+0000","last_peered":"2024-04-24T02:14:20.039693+0000","last_clean":"2024-04-24T02:14:20.039693+0000","last_became_active":"2024-04-24T02:12:08.780230+0000","last_became_peered":"2024-04-24T02:12:08.780230+0000","last_unstale":"2024-04-24T02:14:20.039693+0000","last_undegraded":"2024-04-24T02:14:20.039693+0000","last_fullsized":"2024-04-24T02:14:20.039693+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:53:03.292344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'285","reported_seq":401,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:20.164956+0000","last_change":"2024-04-24T02:12:10.784581+0000","last_active":"2024-04-24T02:15:20.164956+0000","last_peered":"2024-04-24T02:15:20.164956+0000","last_clean":"2024-04-24T02:15:20.164956+0000","last_became_active":"2024-04-24T02:12:10.784278+0000","last_became_peered":"2024-04-24T02:12:10.784278+0000","last_unstale":"2024-04-24T02:15:20.164956+0000","last_undegraded":"2024-04-24T02:15:20.164956+0000","last_fullsized":"2024-04-24T02:15:20.164956+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.353503+0000","last_change":"2024-04-24T02:12:12.792876+0000","last_active":"2024-04-24T02:15:13.353503+0000","last_peered":"2024-04-24T02:15:13.353503+0000","last_clean":"2024-04-24T02:15:13.353503+0000","last_became_active":"2024-04-24T02:12:12.792569+0000","last_became_peered":"2024-04-24T02:12:12.792569+0000","last_unstale":"2024-04-24T02:15:13.353503+0000","last_undegraded":"2024-04-24T02:15:13.353503+0000","last_fullsized":"2024-04-24T02:15:13.353503+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'26","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.464740+0000","last_change":"2024-04-24T02:12:04.752393+0000","last_active":"2024-04-24T02:15:13.464740+0000","last_peered":"2024-04-24T02:15:13.464740+0000","last_clean":"2024-04-24T02:15:13.464740+0000","last_became_active":"2024-04-24T02:12:04.752075+0000","last_became_peered":"2024-04-24T02:12:04.752075+0000","last_unstale":"2024-04-24T02:15:13.464740+0000","last_undegraded":"2024-04-24T02:15:13.464740+0000","last_fullsized":"2024-04-24T02:15:13.464740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:15:44.431680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":67,"num_write":30,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.811311+0000","last_change":"2024-04-24T02:12:02.755772+0000","last_active":"2024-04-24T02:12:45.811311+0000","last_peered":"2024-04-24T02:12:45.811311+0000","last_clean":"2024-04-24T02:12:45.811311+0000","last_became_active":"2024-04-24T02:12:02.755468+0000","last_became_peered":"2024-04-24T02:12:02.755468+0000","last_unstale":"2024-04-24T02:12:45.811311+0000","last_undegraded":"2024-04-24T02:12:45.811311+0000","last_fullsized":"2024-04-24T02:12:45.811311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:01:29.176953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:18.034584+0000","last_change":"2024-04-24T02:12:06.764717+0000","last_active":"2024-04-24T02:14:18.034584+0000","last_peered":"2024-04-24T02:14:18.034584+0000","last_clean":"2024-04-24T02:14:18.034584+0000","last_became_active":"2024-04-24T02:12:06.764365+0000","last_became_peered":"2024-04-24T02:12:06.764365+0000","last_unstale":"2024-04-24T02:14:18.034584+0000","last_undegraded":"2024-04-24T02:14:18.034584+0000","last_fullsized":"2024-04-24T02:14:18.034584+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'71","reported_seq":139,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:20.020950+0000","last_change":"2024-04-24T02:12:08.780274+0000","last_active":"2024-04-24T02:15:20.020950+0000","last_peered":"2024-04-24T02:15:20.020950+0000","last_clean":"2024-04-24T02:15:20.020950+0000","last_became_active":"2024-04-24T02:12:08.779602+0000","last_became_peered":"2024-04-24T02:12:08.779602+0000","last_unstale":"2024-04-24T02:15:20.020950+0000","last_undegraded":"2024-04-24T02:15:20.020950+0000","last_fullsized":"2024-04-24T02:15:20.020950+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:33:01.634520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:23.035316+0000","last_change":"2024-04-24T02:12:10.782388+0000","last_active":"2024-04-24T02:14:23.035316+0000","last_peered":"2024-04-24T02:14:23.035316+0000","last_clean":"2024-04-24T02:14:23.035316+0000","last_became_active":"2024-04-24T02:12:10.782121+0000","last_became_peered":"2024-04-24T02:12:10.782121+0000","last_unstale":"2024-04-24T02:14:23.035316+0000","last_undegraded":"2024-04-24T02:14:23.035316+0000","last_fullsized":"2024-04-24T02:14:23.035316+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'20","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.570501+0000","last_change":"2024-04-24T02:12:12.790210+0000","last_active":"2024-04-24T02:15:13.570501+0000","last_peered":"2024-04-24T02:15:13.570501+0000","last_clean":"2024-04-24T02:15:13.570501+0000","last_became_active":"2024-04-24T02:12:12.789799+0000","last_became_peered":"2024-04-24T02:12:12.789799+0000","last_unstale":"2024-04-24T02:15:13.570501+0000","last_undegraded":"2024-04-24T02:15:13.570501+0000","last_fullsized":"2024-04-24T02:15:13.570501+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:28.944905+0000","last_change":"2024-04-24T02:12:04.766750+0000","last_active":"2024-04-24T02:13:28.944905+0000","last_peered":"2024-04-24T02:13:28.944905+0000","last_clean":"2024-04-24T02:13:28.944905+0000","last_became_active":"2024-04-24T02:12:04.766495+0000","last_became_peered":"2024-04-24T02:12:04.766495+0000","last_unstale":"2024-04-24T02:13:28.944905+0000","last_undegraded":"2024-04-24T02:13:28.944905+0000","last_fullsized":"2024-04-24T02:13:28.944905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:26:32.311949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:18.034606+0000","last_change":"2024-04-24T02:12:02.743527+0000","last_active":"2024-04-24T02:14:18.034606+0000","last_peered":"2024-04-24T02:14:18.034606+0000","last_clean":"2024-04-24T02:14:18.034606+0000","last_became_active":"2024-04-24T02:12:02.743204+0000","last_became_peered":"2024-04-24T02:12:02.743204+0000","last_unstale":"2024-04-24T02:14:18.034606+0000","last_undegraded":"2024-04-24T02:14:18.034606+0000","last_fullsized":"2024-04-24T02:14:18.034606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.807995+0000","last_change":"2024-04-24T02:12:06.765176+0000","last_active":"2024-04-24T02:12:45.807995+0000","last_peered":"2024-04-24T02:12:45.807995+0000","last_clean":"2024-04-24T02:12:45.807995+0000","last_became_active":"2024-04-24T02:12:06.764676+0000","last_became_peered":"2024-04-24T02:12:06.764676+0000","last_unstale":"2024-04-24T02:12:45.807995+0000","last_undegraded":"2024-04-24T02:12:45.807995+0000","last_fullsized":"2024-04-24T02:12:45.807995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:44:01.649539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'39","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:25.040048+0000","last_change":"2024-04-24T02:12:08.773725+0000","last_active":"2024-04-24T02:14:25.040048+0000","last_peered":"2024-04-24T02:14:25.040048+0000","last_clean":"2024-04-24T02:14:25.040048+0000","last_became_active":"2024-04-24T02:12:08.773355+0000","last_became_peered":"2024-04-24T02:12:08.773355+0000","last_unstale":"2024-04-24T02:14:25.040048+0000","last_undegraded":"2024-04-24T02:14:25.040048+0000","last_fullsized":"2024-04-24T02:14:25.040048+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:38:42.332605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.813546+0000","last_change":"2024-04-24T02:12:10.784747+0000","last_active":"2024-04-24T02:12:45.813546+0000","last_peered":"2024-04-24T02:12:45.813546+0000","last_clean":"2024-04-24T02:12:45.813546+0000","last_became_active":"2024-04-24T02:12:10.783334+0000","last_became_peered":"2024-04-24T02:12:10.783334+0000","last_unstale":"2024-04-24T02:12:45.813546+0000","last_undegraded":"2024-04-24T02:12:45.813546+0000","last_fullsized":"2024-04-24T02:12:45.813546+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:37:24.863362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:15.038882+0000","last_change":"2024-04-24T02:12:12.794851+0000","last_active":"2024-04-24T02:14:15.038882+0000","last_peered":"2024-04-24T02:14:15.038882+0000","last_clean":"2024-04-24T02:14:15.038882+0000","last_became_active":"2024-04-24T02:12:12.794106+0000","last_became_peered":"2024-04-24T02:12:12.794106+0000","last_unstale":"2024-04-24T02:14:15.038882+0000","last_undegraded":"2024-04-24T02:14:15.038882+0000","last_fullsized":"2024-04-24T02:14:15.038882+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:30:12.595419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'4","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:09.640308+0000","last_change":"2024-04-24T02:12:04.768515+0000","last_active":"2024-04-24T02:14:09.640308+0000","last_peered":"2024-04-24T02:14:09.640308+0000","last_clean":"2024-04-24T02:14:09.640308+0000","last_became_active":"2024-04-24T02:12:04.767376+0000","last_became_peered":"2024-04-24T02:12:04.767376+0000","last_unstale":"2024-04-24T02:14:09.640308+0000","last_undegraded":"2024-04-24T02:14:09.640308+0000","last_fullsized":"2024-04-24T02:14:09.640308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:15:19.870705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.752057+0000","last_change":"2024-04-24T02:12:02.761147+0000","last_active":"2024-04-24T02:14:12.752057+0000","last_peered":"2024-04-24T02:14:12.752057+0000","last_clean":"2024-04-24T02:14:12.752057+0000","last_became_active":"2024-04-24T02:12:02.760317+0000","last_became_peered":"2024-04-24T02:12:02.760317+0000","last_unstale":"2024-04-24T02:14:12.752057+0000","last_undegraded":"2024-04-24T02:14:12.752057+0000","last_fullsized":"2024-04-24T02:14:12.752057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:00:21.940276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.815447+0000","last_change":"2024-04-24T02:12:45.814348+0000","last_active":"2024-04-24T02:12:45.815447+0000","last_peered":"2024-04-24T02:12:45.815447+0000","last_clean":"2024-04-24T02:12:45.815447+0000","last_became_active":"2024-04-24T02:12:45.811272+0000","last_became_peered":"2024-04-24T02:12:45.811272+0000","last_unstale":"2024-04-24T02:12:45.815447+0000","last_undegraded":"2024-04-24T02:12:45.815447+0000","last_fullsized":"2024-04-24T02:12:45.815447+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:50:21.355536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"32'37","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.360247+0000","last_change":"2024-04-24T02:12:08.769681+0000","last_active":"2024-04-24T02:14:11.360247+0000","last_peered":"2024-04-24T02:14:11.360247+0000","last_clean":"2024-04-24T02:14:11.360247+0000","last_became_active":"2024-04-24T02:12:08.769307+0000","last_became_peered":"2024-04-24T02:12:08.769307+0000","last_unstale":"2024-04-24T02:14:11.360247+0000","last_undegraded":"2024-04-24T02:14:11.360247+0000","last_fullsized":"2024-04-24T02:14:11.360247+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:28:14.541427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'284","reported_seq":405,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:20.005727+0000","last_change":"2024-04-24T02:12:10.779255+0000","last_active":"2024-04-24T02:15:20.005727+0000","last_peered":"2024-04-24T02:15:20.005727+0000","last_clean":"2024-04-24T02:15:20.005727+0000","last_became_active":"2024-04-24T02:12:10.778972+0000","last_became_peered":"2024-04-24T02:12:10.778972+0000","last_unstale":"2024-04-24T02:15:20.005727+0000","last_undegraded":"2024-04-24T02:15:20.005727+0000","last_fullsized":"2024-04-24T02:15:20.005727+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:37:47.569074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'12","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.529612+0000","last_change":"2024-04-24T02:12:12.790568+0000","last_active":"2024-04-24T02:15:13.529612+0000","last_peered":"2024-04-24T02:15:13.529612+0000","last_clean":"2024-04-24T02:15:13.529612+0000","last_became_active":"2024-04-24T02:12:12.790353+0000","last_became_peered":"2024-04-24T02:12:12.790353+0000","last_unstale":"2024-04-24T02:15:13.529612+0000","last_undegraded":"2024-04-24T02:15:13.529612+0000","last_fullsized":"2024-04-24T02:15:13.529612+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'10","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.465025+0000","last_change":"2024-04-24T02:12:04.760283+0000","last_active":"2024-04-24T02:15:13.465025+0000","last_peered":"2024-04-24T02:15:13.465025+0000","last_clean":"2024-04-24T02:15:13.465025+0000","last_became_active":"2024-04-24T02:12:04.760020+0000","last_became_peered":"2024-04-24T02:12:04.760020+0000","last_unstale":"2024-04-24T02:15:13.465025+0000","last_undegraded":"2024-04-24T02:15:13.465025+0000","last_fullsized":"2024-04-24T02:15:13.465025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:20:27.874953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"32'1","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:15.038970+0000","last_change":"2024-04-24T02:12:02.756829+0000","last_active":"2024-04-24T02:14:15.038970+0000","last_peered":"2024-04-24T02:14:15.038970+0000","last_clean":"2024-04-24T02:14:15.038970+0000","last_became_active":"2024-04-24T02:12:02.753593+0000","last_became_peered":"2024-04-24T02:12:02.753593+0000","last_unstale":"2024-04-24T02:14:15.038970+0000","last_undegraded":"2024-04-24T02:14:15.038970+0000","last_fullsized":"2024-04-24T02:14:15.038970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:22:26.189922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'3","reported_seq":417,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:19.988375+0000","last_change":"2024-04-24T02:12:06.759063+0000","last_active":"2024-04-24T02:15:19.988375+0000","last_peered":"2024-04-24T02:15:19.988375+0000","last_clean":"2024-04-24T02:15:19.988375+0000","last_became_active":"2024-04-24T02:12:06.758759+0000","last_became_peered":"2024-04-24T02:12:06.758759+0000","last_unstale":"2024-04-24T02:15:19.988375+0000","last_undegraded":"2024-04-24T02:15:19.988375+0000","last_fullsized":"2024-04-24T02:15:19.988375+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:00:44.704350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"30'11","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.811579+0000","last_change":"2024-04-24T02:12:08.783278+0000","last_active":"2024-04-24T02:12:45.811579+0000","last_peered":"2024-04-24T02:12:45.811579+0000","last_clean":"2024-04-24T02:12:45.811579+0000","last_became_active":"2024-04-24T02:12:08.783011+0000","last_became_peered":"2024-04-24T02:12:08.783011+0000","last_unstale":"2024-04-24T02:12:45.811579+0000","last_undegraded":"2024-04-24T02:12:45.811579+0000","last_fullsized":"2024-04-24T02:12:45.811579+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:34:35.511797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'284","reported_seq":461,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:20.008577+0000","last_change":"2024-04-24T02:12:10.777668+0000","last_active":"2024-04-24T02:15:20.008577+0000","last_peered":"2024-04-24T02:15:20.008577+0000","last_clean":"2024-04-24T02:15:20.008577+0000","last_became_active":"2024-04-24T02:12:10.777222+0000","last_became_peered":"2024-04-24T02:12:10.777222+0000","last_unstale":"2024-04-24T02:15:20.008577+0000","last_undegraded":"2024-04-24T02:15:20.008577+0000","last_fullsized":"2024-04-24T02:15:20.008577+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:38:54.174398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.545828+0000","last_change":"2024-04-24T02:12:12.795499+0000","last_active":"2024-04-24T02:14:12.545828+0000","last_peered":"2024-04-24T02:14:12.545828+0000","last_clean":"2024-04-24T02:14:12.545828+0000","last_became_active":"2024-04-24T02:12:12.795204+0000","last_became_peered":"2024-04-24T02:12:12.795204+0000","last_unstale":"2024-04-24T02:14:12.545828+0000","last_undegraded":"2024-04-24T02:14:12.545828+0000","last_fullsized":"2024-04-24T02:14:12.545828+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:02:53.179496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.777605+0000","last_change":"2024-04-24T02:12:04.766853+0000","last_active":"2024-04-24T02:14:12.777605+0000","last_peered":"2024-04-24T02:14:12.777605+0000","last_clean":"2024-04-24T02:14:12.777605+0000","last_became_active":"2024-04-24T02:12:04.766540+0000","last_became_peered":"2024-04-24T02:12:04.766540+0000","last_unstale":"2024-04-24T02:14:12.777605+0000","last_undegraded":"2024-04-24T02:14:12.777605+0000","last_fullsized":"2024-04-24T02:14:12.777605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:43:13.413941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"32'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:46.556834+0000","last_change":"2024-04-24T02:12:02.760628+0000","last_active":"2024-04-24T02:12:46.556834+0000","last_peered":"2024-04-24T02:12:46.556834+0000","last_clean":"2024-04-24T02:12:46.556834+0000","last_became_active":"2024-04-24T02:12:02.757717+0000","last_became_peered":"2024-04-24T02:12:02.757717+0000","last_unstale":"2024-04-24T02:12:46.556834+0000","last_undegraded":"2024-04-24T02:12:46.556834+0000","last_fullsized":"2024-04-24T02:12:46.556834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:55:52.496337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.811769+0000","last_change":"2024-04-24T02:12:06.758742+0000","last_active":"2024-04-24T02:12:45.811769+0000","last_peered":"2024-04-24T02:12:45.811769+0000","last_clean":"2024-04-24T02:12:45.811769+0000","last_became_active":"2024-04-24T02:12:06.758452+0000","last_became_peered":"2024-04-24T02:12:06.758452+0000","last_unstale":"2024-04-24T02:12:45.811769+0000","last_undegraded":"2024-04-24T02:12:45.811769+0000","last_fullsized":"2024-04-24T02:12:45.811769+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:54:56.942552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'40","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.134731+0000","last_change":"2024-04-24T02:12:08.773650+0000","last_active":"2024-04-24T02:15:13.134731+0000","last_peered":"2024-04-24T02:15:13.134731+0000","last_clean":"2024-04-24T02:15:13.134731+0000","last_became_active":"2024-04-24T02:12:08.773319+0000","last_became_peered":"2024-04-24T02:12:08.773319+0000","last_unstale":"2024-04-24T02:15:13.134731+0000","last_undegraded":"2024-04-24T02:15:13.134731+0000","last_fullsized":"2024-04-24T02:15:13.134731+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:39:13.898594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5807,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":43,"num_read_kb":33,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.807176+0000","last_change":"2024-04-24T02:12:10.787285+0000","last_active":"2024-04-24T02:12:45.807176+0000","last_peered":"2024-04-24T02:12:45.807176+0000","last_clean":"2024-04-24T02:12:45.807176+0000","last_became_active":"2024-04-24T02:12:10.786998+0000","last_became_peered":"2024-04-24T02:12:10.786998+0000","last_unstale":"2024-04-24T02:12:45.807176+0000","last_undegraded":"2024-04-24T02:12:45.807176+0000","last_fullsized":"2024-04-24T02:12:45.807176+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:23:30.529184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'6","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.502555+0000","last_change":"2024-04-24T02:12:12.795209+0000","last_active":"2024-04-24T02:15:13.502555+0000","last_peered":"2024-04-24T02:15:13.502555+0000","last_clean":"2024-04-24T02:15:13.502555+0000","last_became_active":"2024-04-24T02:12:12.793724+0000","last_became_peered":"2024-04-24T02:12:12.793724+0000","last_unstale":"2024-04-24T02:15:13.502555+0000","last_undegraded":"2024-04-24T02:15:13.502555+0000","last_fullsized":"2024-04-24T02:15:13.502555+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:43:28.725420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.766426+0000","last_change":"2024-04-24T02:12:04.764441+0000","last_active":"2024-04-24T02:14:12.766426+0000","last_peered":"2024-04-24T02:14:12.766426+0000","last_clean":"2024-04-24T02:14:12.766426+0000","last_became_active":"2024-04-24T02:12:04.763246+0000","last_became_peered":"2024-04-24T02:12:04.763246+0000","last_unstale":"2024-04-24T02:14:12.766426+0000","last_undegraded":"2024-04-24T02:14:12.766426+0000","last_fullsized":"2024-04-24T02:14:12.766426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:01:31.738903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":199,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.802977+0000","last_change":"2024-04-24T02:11:51.990441+0000","last_active":"2024-04-24T02:12:45.802977+0000","last_peered":"2024-04-24T02:12:45.802977+0000","last_clean":"2024-04-24T02:12:45.802977+0000","last_became_active":"2024-04-24T02:11:51.989479+0000","last_became_peered":"2024-04-24T02:11:51.989479+0000","last_unstale":"2024-04-24T02:12:45.802977+0000","last_undegraded":"2024-04-24T02:12:45.802977+0000","last_fullsized":"2024-04-24T02:12:45.802977+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:50.697037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:50.697037+0000","last_clean_scrub_stamp":"2024-04-24T02:11:50.697037+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:59:33.037844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.810884+0000","last_change":"2024-04-24T02:11:56.724372+0000","last_active":"2024-04-24T02:12:45.810884+0000","last_peered":"2024-04-24T02:12:45.810884+0000","last_clean":"2024-04-24T02:12:45.810884+0000","last_became_active":"2024-04-24T02:11:56.723925+0000","last_became_peered":"2024-04-24T02:11:56.723925+0000","last_unstale":"2024-04-24T02:12:45.810884+0000","last_undegraded":"2024-04-24T02:12:45.810884+0000","last_fullsized":"2024-04-24T02:12:45.810884+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:03:43.918155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.809983+0000","last_change":"2024-04-24T02:12:02.758997+0000","last_active":"2024-04-24T02:12:45.809983+0000","last_peered":"2024-04-24T02:12:45.809983+0000","last_clean":"2024-04-24T02:12:45.809983+0000","last_became_active":"2024-04-24T02:12:02.758653+0000","last_became_peered":"2024-04-24T02:12:02.758653+0000","last_unstale":"2024-04-24T02:12:45.809983+0000","last_undegraded":"2024-04-24T02:12:45.809983+0000","last_fullsized":"2024-04-24T02:12:45.809983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:04:14.072260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"23'1","reported_seq":220,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:19.979597+0000","last_change":"2024-04-24T02:12:06.757529+0000","last_active":"2024-04-24T02:15:19.979597+0000","last_peered":"2024-04-24T02:15:19.979597+0000","last_clean":"2024-04-24T02:15:19.979597+0000","last_became_active":"2024-04-24T02:12:06.757173+0000","last_became_peered":"2024-04-24T02:12:06.757173+0000","last_unstale":"2024-04-24T02:15:19.979597+0000","last_undegraded":"2024-04-24T02:15:19.979597+0000","last_fullsized":"2024-04-24T02:15:19.979597+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:25:48.408637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'85","reported_seq":160,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:20.037571+0000","last_change":"2024-04-24T02:12:08.781224+0000","last_active":"2024-04-24T02:15:20.037571+0000","last_peered":"2024-04-24T02:15:20.037571+0000","last_clean":"2024-04-24T02:15:20.037571+0000","last_became_active":"2024-04-24T02:12:08.780923+0000","last_became_peered":"2024-04-24T02:12:08.780923+0000","last_unstale":"2024-04-24T02:15:20.037571+0000","last_undegraded":"2024-04-24T02:15:20.037571+0000","last_fullsized":"2024-04-24T02:15:20.037571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:26:20.925750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:22.973891+0000","last_change":"2024-04-24T02:15:22.973909+0000","last_active":"2024-04-24T02:15:22.973891+0000","last_peered":"2024-04-24T02:15:22.973891+0000","last_clean":"2024-04-24T02:15:22.973891+0000","last_became_active":"2024-04-24T02:12:10.784101+0000","last_became_peered":"2024-04-24T02:12:10.784101+0000","last_unstale":"2024-04-24T02:15:22.973891+0000","last_undegraded":"2024-04-24T02:15:22.973891+0000","last_fullsized":"2024-04-24T02:15:22.973891+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:22.973820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:22.973820+0000","last_clean_scrub_stamp":"2024-04-24T02:15:22.973820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:09:23.273019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'81","reported_seq":162,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.478759+0000","last_change":"2024-04-24T02:12:12.795520+0000","last_active":"2024-04-24T02:15:13.478759+0000","last_peered":"2024-04-24T02:15:13.478759+0000","last_clean":"2024-04-24T02:15:13.478759+0000","last_became_active":"2024-04-24T02:12:12.795281+0000","last_became_peered":"2024-04-24T02:12:12.795281+0000","last_unstale":"2024-04-24T02:15:13.478759+0000","last_undegraded":"2024-04-24T02:15:13.478759+0000","last_fullsized":"2024-04-24T02:15:13.478759+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:12:13.247301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.349374+0000","last_change":"2024-04-24T02:12:04.764296+0000","last_active":"2024-04-24T02:15:13.349374+0000","last_peered":"2024-04-24T02:15:13.349374+0000","last_clean":"2024-04-24T02:15:13.349374+0000","last_became_active":"2024-04-24T02:12:04.763782+0000","last_became_peered":"2024-04-24T02:12:04.763782+0000","last_unstale":"2024-04-24T02:15:13.349374+0000","last_undegraded":"2024-04-24T02:15:13.349374+0000","last_fullsized":"2024-04-24T02:15:13.349374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:23:24.501187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.808625+0000","last_change":"2024-04-24T02:11:56.724008+0000","last_active":"2024-04-24T02:12:45.808625+0000","last_peered":"2024-04-24T02:12:45.808625+0000","last_clean":"2024-04-24T02:12:45.808625+0000","last_became_active":"2024-04-24T02:11:56.723682+0000","last_became_peered":"2024-04-24T02:11:56.723682+0000","last_unstale":"2024-04-24T02:12:45.808625+0000","last_undegraded":"2024-04-24T02:12:45.808625+0000","last_fullsized":"2024-04-24T02:12:45.808625+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:32:18.958074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:08.033156+0000","last_change":"2024-04-24T02:12:02.742006+0000","last_active":"2024-04-24T02:14:08.033156+0000","last_peered":"2024-04-24T02:14:08.033156+0000","last_clean":"2024-04-24T02:14:08.033156+0000","last_became_active":"2024-04-24T02:12:02.741610+0000","last_became_peered":"2024-04-24T02:12:02.741610+0000","last_unstale":"2024-04-24T02:14:08.033156+0000","last_undegraded":"2024-04-24T02:14:08.033156+0000","last_fullsized":"2024-04-24T02:14:08.033156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.814410+0000","last_change":"2024-04-24T02:12:06.757365+0000","last_active":"2024-04-24T02:12:45.814410+0000","last_peered":"2024-04-24T02:12:45.814410+0000","last_clean":"2024-04-24T02:12:45.814410+0000","last_became_active":"2024-04-24T02:12:06.757052+0000","last_became_peered":"2024-04-24T02:12:06.757052+0000","last_unstale":"2024-04-24T02:12:45.814410+0000","last_undegraded":"2024-04-24T02:12:45.814410+0000","last_fullsized":"2024-04-24T02:12:45.814410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:03:51.154050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'284","reported_seq":494,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:20.030942+0000","last_change":"2024-04-24T02:12:08.780195+0000","last_active":"2024-04-24T02:15:20.030942+0000","last_peered":"2024-04-24T02:15:20.030942+0000","last_clean":"2024-04-24T02:15:20.030942+0000","last_became_active":"2024-04-24T02:12:08.779884+0000","last_became_peered":"2024-04-24T02:12:08.779884+0000","last_unstale":"2024-04-24T02:15:20.030942+0000","last_undegraded":"2024-04-24T02:15:20.030942+0000","last_fullsized":"2024-04-24T02:15:20.030942+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:39:29.226371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":369,"num_read_kb":353,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.811202+0000","last_change":"2024-04-24T02:12:10.784601+0000","last_active":"2024-04-24T02:12:45.811202+0000","last_peered":"2024-04-24T02:12:45.811202+0000","last_clean":"2024-04-24T02:12:45.811202+0000","last_became_active":"2024-04-24T02:12:10.783788+0000","last_became_peered":"2024-04-24T02:12:10.783788+0000","last_unstale":"2024-04-24T02:12:45.811202+0000","last_undegraded":"2024-04-24T02:12:45.811202+0000","last_fullsized":"2024-04-24T02:12:45.811202+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:11:51.847310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:28.951418+0000","last_change":"2024-04-24T02:12:12.796284+0000","last_active":"2024-04-24T02:13:28.951418+0000","last_peered":"2024-04-24T02:13:28.951418+0000","last_clean":"2024-04-24T02:13:28.951418+0000","last_became_active":"2024-04-24T02:12:12.795983+0000","last_became_peered":"2024-04-24T02:12:12.795983+0000","last_unstale":"2024-04-24T02:13:28.951418+0000","last_undegraded":"2024-04-24T02:13:28.951418+0000","last_fullsized":"2024-04-24T02:13:28.951418+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:51:33.324014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'22","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.176666+0000","last_change":"2024-04-24T02:12:04.756013+0000","last_active":"2024-04-24T02:15:13.176666+0000","last_peered":"2024-04-24T02:15:13.176666+0000","last_clean":"2024-04-24T02:15:13.176666+0000","last_became_active":"2024-04-24T02:12:04.755649+0000","last_became_peered":"2024-04-24T02:12:04.755649+0000","last_unstale":"2024-04-24T02:15:13.176666+0000","last_undegraded":"2024-04-24T02:15:13.176666+0000","last_fullsized":"2024-04-24T02:15:13.176666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":72,"num_write":29,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805377+0000","last_change":"2024-04-24T02:11:56.724010+0000","last_active":"2024-04-24T02:12:45.805377+0000","last_peered":"2024-04-24T02:12:45.805377+0000","last_clean":"2024-04-24T02:12:45.805377+0000","last_became_active":"2024-04-24T02:11:56.723497+0000","last_became_peered":"2024-04-24T02:11:56.723497+0000","last_unstale":"2024-04-24T02:12:45.805377+0000","last_undegraded":"2024-04-24T02:12:45.805377+0000","last_fullsized":"2024-04-24T02:12:45.805377+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:26:11.265014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:20.098252+0000","last_change":"2024-04-24T02:12:02.745574+0000","last_active":"2024-04-24T02:15:20.098252+0000","last_peered":"2024-04-24T02:15:20.098252+0000","last_clean":"2024-04-24T02:15:20.098252+0000","last_became_active":"2024-04-24T02:12:02.745238+0000","last_became_peered":"2024-04-24T02:12:02.745238+0000","last_unstale":"2024-04-24T02:15:20.098252+0000","last_undegraded":"2024-04-24T02:15:20.098252+0000","last_fullsized":"2024-04-24T02:15:20.098252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.813613+0000","last_change":"2024-04-24T02:12:06.757374+0000","last_active":"2024-04-24T02:12:45.813613+0000","last_peered":"2024-04-24T02:12:45.813613+0000","last_clean":"2024-04-24T02:12:45.813613+0000","last_became_active":"2024-04-24T02:12:06.757009+0000","last_became_peered":"2024-04-24T02:12:06.757009+0000","last_unstale":"2024-04-24T02:12:45.813613+0000","last_undegraded":"2024-04-24T02:12:45.813613+0000","last_fullsized":"2024-04-24T02:12:45.813613+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:26:34.319373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'16","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:11.839804+0000","last_change":"2024-04-24T02:12:08.774513+0000","last_active":"2024-04-24T02:15:11.839804+0000","last_peered":"2024-04-24T02:15:11.839804+0000","last_clean":"2024-04-24T02:15:11.839804+0000","last_became_active":"2024-04-24T02:12:08.774177+0000","last_became_peered":"2024-04-24T02:12:08.774177+0000","last_unstale":"2024-04-24T02:15:11.839804+0000","last_undegraded":"2024-04-24T02:15:11.839804+0000","last_fullsized":"2024-04-24T02:15:11.839804+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:27:58.828052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:18.034631+0000","last_change":"2024-04-24T02:12:10.784579+0000","last_active":"2024-04-24T02:14:18.034631+0000","last_peered":"2024-04-24T02:14:18.034631+0000","last_clean":"2024-04-24T02:14:18.034631+0000","last_became_active":"2024-04-24T02:12:10.784247+0000","last_became_peered":"2024-04-24T02:12:10.784247+0000","last_unstale":"2024-04-24T02:14:18.034631+0000","last_undegraded":"2024-04-24T02:14:18.034631+0000","last_fullsized":"2024-04-24T02:14:18.034631+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.772420+0000","last_change":"2024-04-24T02:12:12.794755+0000","last_active":"2024-04-24T02:14:12.772420+0000","last_peered":"2024-04-24T02:14:12.772420+0000","last_clean":"2024-04-24T02:14:12.772420+0000","last_became_active":"2024-04-24T02:12:12.794453+0000","last_became_peered":"2024-04-24T02:12:12.794453+0000","last_unstale":"2024-04-24T02:14:12.772420+0000","last_undegraded":"2024-04-24T02:14:12.772420+0000","last_fullsized":"2024-04-24T02:14:12.772420+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:14:32.909095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'3","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.523202+0000","last_change":"2024-04-24T02:12:04.749524+0000","last_active":"2024-04-24T02:15:13.523202+0000","last_peered":"2024-04-24T02:15:13.523202+0000","last_clean":"2024-04-24T02:15:13.523202+0000","last_became_active":"2024-04-24T02:12:04.749173+0000","last_became_peered":"2024-04-24T02:12:04.749173+0000","last_unstale":"2024-04-24T02:15:13.523202+0000","last_undegraded":"2024-04-24T02:15:13.523202+0000","last_fullsized":"2024-04-24T02:15:13.523202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.809808+0000","last_change":"2024-04-24T02:11:56.723425+0000","last_active":"2024-04-24T02:12:45.809808+0000","last_peered":"2024-04-24T02:12:45.809808+0000","last_clean":"2024-04-24T02:12:45.809808+0000","last_became_active":"2024-04-24T02:11:56.723125+0000","last_became_peered":"2024-04-24T02:11:56.723125+0000","last_unstale":"2024-04-24T02:12:45.809808+0000","last_undegraded":"2024-04-24T02:12:45.809808+0000","last_fullsized":"2024-04-24T02:12:45.809808+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:48:12.516334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.808101+0000","last_change":"2024-04-24T02:12:02.746939+0000","last_active":"2024-04-24T02:12:45.808101+0000","last_peered":"2024-04-24T02:12:45.808101+0000","last_clean":"2024-04-24T02:12:45.808101+0000","last_became_active":"2024-04-24T02:12:02.746682+0000","last_became_peered":"2024-04-24T02:12:02.746682+0000","last_unstale":"2024-04-24T02:12:45.808101+0000","last_undegraded":"2024-04-24T02:12:45.808101+0000","last_fullsized":"2024-04-24T02:12:45.808101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:51:48.494870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:13.033872+0000","last_change":"2024-04-24T02:12:06.759484+0000","last_active":"2024-04-24T02:14:13.033872+0000","last_peered":"2024-04-24T02:14:13.033872+0000","last_clean":"2024-04-24T02:14:13.033872+0000","last_became_active":"2024-04-24T02:12:06.759169+0000","last_became_peered":"2024-04-24T02:12:06.759169+0000","last_unstale":"2024-04-24T02:14:13.033872+0000","last_undegraded":"2024-04-24T02:14:13.033872+0000","last_fullsized":"2024-04-24T02:14:13.033872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'13","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:12.792900+0000","last_change":"2024-04-24T02:12:08.783178+0000","last_active":"2024-04-24T02:15:12.792900+0000","last_peered":"2024-04-24T02:15:12.792900+0000","last_clean":"2024-04-24T02:15:12.792900+0000","last_became_active":"2024-04-24T02:12:08.782765+0000","last_became_peered":"2024-04-24T02:12:08.782765+0000","last_unstale":"2024-04-24T02:15:12.792900+0000","last_undegraded":"2024-04-24T02:15:12.792900+0000","last_fullsized":"2024-04-24T02:15:12.792900+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:43:33.627490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.813589+0000","last_change":"2024-04-24T02:12:10.785313+0000","last_active":"2024-04-24T02:12:45.813589+0000","last_peered":"2024-04-24T02:12:45.813589+0000","last_clean":"2024-04-24T02:12:45.813589+0000","last_became_active":"2024-04-24T02:12:10.783813+0000","last_became_peered":"2024-04-24T02:12:10.783813+0000","last_unstale":"2024-04-24T02:12:45.813589+0000","last_undegraded":"2024-04-24T02:12:45.813589+0000","last_fullsized":"2024-04-24T02:12:45.813589+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:29:00.483135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.525281+0000","last_change":"2024-04-24T02:12:12.797895+0000","last_active":"2024-04-24T02:14:12.525281+0000","last_peered":"2024-04-24T02:14:12.525281+0000","last_clean":"2024-04-24T02:14:12.525281+0000","last_became_active":"2024-04-24T02:12:12.796507+0000","last_became_peered":"2024-04-24T02:12:12.796507+0000","last_unstale":"2024-04-24T02:14:12.525281+0000","last_undegraded":"2024-04-24T02:14:12.525281+0000","last_fullsized":"2024-04-24T02:14:12.525281+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:24:58.744108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:28.945114+0000","last_change":"2024-04-24T02:12:04.767815+0000","last_active":"2024-04-24T02:13:28.945114+0000","last_peered":"2024-04-24T02:13:28.945114+0000","last_clean":"2024-04-24T02:13:28.945114+0000","last_became_active":"2024-04-24T02:12:04.767221+0000","last_became_peered":"2024-04-24T02:12:04.767221+0000","last_unstale":"2024-04-24T02:13:28.945114+0000","last_undegraded":"2024-04-24T02:13:28.945114+0000","last_fullsized":"2024-04-24T02:13:28.945114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:20:27.874953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.808341+0000","last_change":"2024-04-24T02:12:02.747860+0000","last_active":"2024-04-24T02:12:45.808341+0000","last_peered":"2024-04-24T02:12:45.808341+0000","last_clean":"2024-04-24T02:12:45.808341+0000","last_became_active":"2024-04-24T02:12:02.744161+0000","last_became_peered":"2024-04-24T02:12:02.744161+0000","last_unstale":"2024-04-24T02:12:45.808341+0000","last_undegraded":"2024-04-24T02:12:45.808341+0000","last_fullsized":"2024-04-24T02:12:45.808341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:30:58.417438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:03.032354+0000","last_change":"2024-04-24T02:11:56.723976+0000","last_active":"2024-04-24T02:14:03.032354+0000","last_peered":"2024-04-24T02:14:03.032354+0000","last_clean":"2024-04-24T02:14:03.032354+0000","last_became_active":"2024-04-24T02:11:56.723697+0000","last_became_peered":"2024-04-24T02:11:56.723697+0000","last_unstale":"2024-04-24T02:14:03.032354+0000","last_undegraded":"2024-04-24T02:14:03.032354+0000","last_fullsized":"2024-04-24T02:14:03.032354+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'1","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:20.000067+0000","last_change":"2024-04-24T02:12:06.759464+0000","last_active":"2024-04-24T02:15:20.000067+0000","last_peered":"2024-04-24T02:15:20.000067+0000","last_clean":"2024-04-24T02:15:20.000067+0000","last_became_active":"2024-04-24T02:12:06.759160+0000","last_became_peered":"2024-04-24T02:12:06.759160+0000","last_unstale":"2024-04-24T02:15:20.000067+0000","last_undegraded":"2024-04-24T02:15:20.000067+0000","last_fullsized":"2024-04-24T02:15:20.000067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'79","reported_seq":159,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:20.137112+0000","last_change":"2024-04-24T02:12:08.780903+0000","last_active":"2024-04-24T02:15:20.137112+0000","last_peered":"2024-04-24T02:15:20.137112+0000","last_clean":"2024-04-24T02:15:20.137112+0000","last_became_active":"2024-04-24T02:12:08.780688+0000","last_became_peered":"2024-04-24T02:12:08.780688+0000","last_unstale":"2024-04-24T02:15:20.137112+0000","last_undegraded":"2024-04-24T02:15:20.137112+0000","last_fullsized":"2024-04-24T02:15:20.137112+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":89,"num_read_kb":75,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.806759+0000","last_change":"2024-04-24T02:12:10.781922+0000","last_active":"2024-04-24T02:12:45.806759+0000","last_peered":"2024-04-24T02:12:45.806759+0000","last_clean":"2024-04-24T02:12:45.806759+0000","last_became_active":"2024-04-24T02:12:10.781586+0000","last_became_peered":"2024-04-24T02:12:10.781586+0000","last_unstale":"2024-04-24T02:12:45.806759+0000","last_undegraded":"2024-04-24T02:12:45.806759+0000","last_fullsized":"2024-04-24T02:12:45.806759+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:24:04.726684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'9","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:28.036038+0000","last_change":"2024-04-24T02:12:12.798530+0000","last_active":"2024-04-24T02:14:28.036038+0000","last_peered":"2024-04-24T02:14:28.036038+0000","last_clean":"2024-04-24T02:14:28.036038+0000","last_became_active":"2024-04-24T02:12:12.798272+0000","last_became_peered":"2024-04-24T02:12:12.798272+0000","last_unstale":"2024-04-24T02:14:28.036038+0000","last_undegraded":"2024-04-24T02:14:28.036038+0000","last_fullsized":"2024-04-24T02:14:28.036038+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'6","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.766875+0000","last_change":"2024-04-24T02:12:04.765396+0000","last_active":"2024-04-24T02:14:12.766875+0000","last_peered":"2024-04-24T02:14:12.766875+0000","last_clean":"2024-04-24T02:14:12.766875+0000","last_became_active":"2024-04-24T02:12:04.765093+0000","last_became_peered":"2024-04-24T02:12:04.765093+0000","last_unstale":"2024-04-24T02:14:12.766875+0000","last_undegraded":"2024-04-24T02:14:12.766875+0000","last_fullsized":"2024-04-24T02:14:12.766875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:25:06.512394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:08.033226+0000","last_change":"2024-04-24T02:12:02.741909+0000","last_active":"2024-04-24T02:14:08.033226+0000","last_peered":"2024-04-24T02:14:08.033226+0000","last_clean":"2024-04-24T02:14:08.033226+0000","last_became_active":"2024-04-24T02:12:02.741565+0000","last_became_peered":"2024-04-24T02:12:02.741565+0000","last_unstale":"2024-04-24T02:14:08.033226+0000","last_undegraded":"2024-04-24T02:14:08.033226+0000","last_fullsized":"2024-04-24T02:14:08.033226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.811832+0000","last_change":"2024-04-24T02:11:56.724046+0000","last_active":"2024-04-24T02:12:45.811832+0000","last_peered":"2024-04-24T02:12:45.811832+0000","last_clean":"2024-04-24T02:12:45.811832+0000","last_became_active":"2024-04-24T02:11:56.723673+0000","last_became_peered":"2024-04-24T02:11:56.723673+0000","last_unstale":"2024-04-24T02:12:45.811832+0000","last_undegraded":"2024-04-24T02:12:45.811832+0000","last_fullsized":"2024-04-24T02:12:45.811832+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:24:47.683078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.810339+0000","last_change":"2024-04-24T02:12:06.756068+0000","last_active":"2024-04-24T02:12:45.810339+0000","last_peered":"2024-04-24T02:12:45.810339+0000","last_clean":"2024-04-24T02:12:45.810339+0000","last_became_active":"2024-04-24T02:12:06.755760+0000","last_became_peered":"2024-04-24T02:12:06.755760+0000","last_unstale":"2024-04-24T02:12:45.810339+0000","last_undegraded":"2024-04-24T02:12:45.810339+0000","last_fullsized":"2024-04-24T02:12:45.810339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:53:36.479217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"30'20","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804087+0000","last_change":"2024-04-24T02:12:08.780018+0000","last_active":"2024-04-24T02:12:45.804087+0000","last_peered":"2024-04-24T02:12:45.804087+0000","last_clean":"2024-04-24T02:12:45.804087+0000","last_became_active":"2024-04-24T02:12:08.779698+0000","last_became_peered":"2024-04-24T02:12:08.779698+0000","last_unstale":"2024-04-24T02:12:45.804087+0000","last_undegraded":"2024-04-24T02:12:45.804087+0000","last_fullsized":"2024-04-24T02:12:45.804087+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:24:02.718714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'284","reported_seq":348,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:20.003243+0000","last_change":"2024-04-24T02:12:10.782077+0000","last_active":"2024-04-24T02:15:20.003243+0000","last_peered":"2024-04-24T02:15:20.003243+0000","last_clean":"2024-04-24T02:15:20.003243+0000","last_became_active":"2024-04-24T02:12:10.781799+0000","last_became_peered":"2024-04-24T02:12:10.781799+0000","last_unstale":"2024-04-24T02:15:20.003243+0000","last_undegraded":"2024-04-24T02:15:20.003243+0000","last_fullsized":"2024-04-24T02:15:20.003243+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:22:36.118429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'2","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:46.562672+0000","last_change":"2024-04-24T02:12:12.794164+0000","last_active":"2024-04-24T02:12:46.562672+0000","last_peered":"2024-04-24T02:12:46.562672+0000","last_clean":"2024-04-24T02:12:46.562672+0000","last_became_active":"2024-04-24T02:12:12.792628+0000","last_became_peered":"2024-04-24T02:12:12.792628+0000","last_unstale":"2024-04-24T02:12:46.562672+0000","last_undegraded":"2024-04-24T02:12:46.562672+0000","last_fullsized":"2024-04-24T02:12:46.562672+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:28:32.181565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'19","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.400430+0000","last_change":"2024-04-24T02:12:04.768557+0000","last_active":"2024-04-24T02:15:13.400430+0000","last_peered":"2024-04-24T02:15:13.400430+0000","last_clean":"2024-04-24T02:15:13.400430+0000","last_became_active":"2024-04-24T02:12:04.768066+0000","last_became_peered":"2024-04-24T02:12:04.768066+0000","last_unstale":"2024-04-24T02:15:13.400430+0000","last_undegraded":"2024-04-24T02:15:13.400430+0000","last_fullsized":"2024-04-24T02:15:13.400430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:37:58.075143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":70,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.813780+0000","last_change":"2024-04-24T02:12:02.761644+0000","last_active":"2024-04-24T02:12:45.813780+0000","last_peered":"2024-04-24T02:12:45.813780+0000","last_clean":"2024-04-24T02:12:45.813780+0000","last_became_active":"2024-04-24T02:12:02.760824+0000","last_became_peered":"2024-04-24T02:12:02.760824+0000","last_unstale":"2024-04-24T02:12:45.813780+0000","last_undegraded":"2024-04-24T02:12:45.813780+0000","last_fullsized":"2024-04-24T02:12:45.813780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:24:13.399996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:08.033261+0000","last_change":"2024-04-24T02:11:56.723499+0000","last_active":"2024-04-24T02:14:08.033261+0000","last_peered":"2024-04-24T02:14:08.033261+0000","last_clean":"2024-04-24T02:14:08.033261+0000","last_became_active":"2024-04-24T02:11:56.723277+0000","last_became_peered":"2024-04-24T02:11:56.723277+0000","last_unstale":"2024-04-24T02:14:08.033261+0000","last_undegraded":"2024-04-24T02:14:08.033261+0000","last_fullsized":"2024-04-24T02:14:08.033261+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.812139+0000","last_change":"2024-04-24T02:12:06.754713+0000","last_active":"2024-04-24T02:12:45.812139+0000","last_peered":"2024-04-24T02:12:45.812139+0000","last_clean":"2024-04-24T02:12:45.812139+0000","last_became_active":"2024-04-24T02:12:06.754414+0000","last_became_peered":"2024-04-24T02:12:06.754414+0000","last_unstale":"2024-04-24T02:12:45.812139+0000","last_undegraded":"2024-04-24T02:12:45.812139+0000","last_fullsized":"2024-04-24T02:12:45.812139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:38:23.173188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"30'17","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.810952+0000","last_change":"2024-04-24T02:12:08.780239+0000","last_active":"2024-04-24T02:12:45.810952+0000","last_peered":"2024-04-24T02:12:45.810952+0000","last_clean":"2024-04-24T02:12:45.810952+0000","last_became_active":"2024-04-24T02:12:08.779937+0000","last_became_peered":"2024-04-24T02:12:08.779937+0000","last_unstale":"2024-04-24T02:12:45.810952+0000","last_undegraded":"2024-04-24T02:12:45.810952+0000","last_fullsized":"2024-04-24T02:12:45.810952+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:33:58.011327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'285","reported_seq":393,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:20.162819+0000","last_change":"2024-04-24T02:12:10.776879+0000","last_active":"2024-04-24T02:15:20.162819+0000","last_peered":"2024-04-24T02:15:20.162819+0000","last_clean":"2024-04-24T02:15:20.162819+0000","last_became_active":"2024-04-24T02:12:10.776594+0000","last_became_peered":"2024-04-24T02:12:10.776594+0000","last_unstale":"2024-04-24T02:15:20.162819+0000","last_undegraded":"2024-04-24T02:15:20.162819+0000","last_fullsized":"2024-04-24T02:15:20.162819+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.803952+0000","last_change":"2024-04-24T02:12:12.795629+0000","last_active":"2024-04-24T02:12:45.803952+0000","last_peered":"2024-04-24T02:12:45.803952+0000","last_clean":"2024-04-24T02:12:45.803952+0000","last_became_active":"2024-04-24T02:12:12.795328+0000","last_became_peered":"2024-04-24T02:12:12.795328+0000","last_unstale":"2024-04-24T02:12:45.803952+0000","last_undegraded":"2024-04-24T02:12:45.803952+0000","last_fullsized":"2024-04-24T02:12:45.803952+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:55:23.691414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'3","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.264812+0000","last_change":"2024-04-24T02:12:04.760388+0000","last_active":"2024-04-24T02:15:13.264812+0000","last_peered":"2024-04-24T02:15:13.264812+0000","last_clean":"2024-04-24T02:15:13.264812+0000","last_became_active":"2024-04-24T02:12:04.760099+0000","last_became_peered":"2024-04-24T02:12:04.760099+0000","last_unstale":"2024-04-24T02:15:13.264812+0000","last_undegraded":"2024-04-24T02:15:13.264812+0000","last_fullsized":"2024-04-24T02:15:13.264812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:00:23.946903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'3","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:15.038544+0000","last_change":"2024-04-24T02:12:02.744971+0000","last_active":"2024-04-24T02:14:15.038544+0000","last_peered":"2024-04-24T02:14:15.038544+0000","last_clean":"2024-04-24T02:14:15.038544+0000","last_became_active":"2024-04-24T02:12:02.744454+0000","last_became_peered":"2024-04-24T02:12:02.744454+0000","last_unstale":"2024-04-24T02:14:15.038544+0000","last_undegraded":"2024-04-24T02:14:15.038544+0000","last_fullsized":"2024-04-24T02:14:15.038544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:59:32.006851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.813632+0000","last_change":"2024-04-24T02:11:57.000530+0000","last_active":"2024-04-24T02:12:45.813632+0000","last_peered":"2024-04-24T02:12:45.813632+0000","last_clean":"2024-04-24T02:12:45.813632+0000","last_became_active":"2024-04-24T02:11:57.000197+0000","last_became_peered":"2024-04-24T02:11:57.000197+0000","last_unstale":"2024-04-24T02:12:45.813632+0000","last_undegraded":"2024-04-24T02:12:45.813632+0000","last_fullsized":"2024-04-24T02:12:45.813632+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:42:43.216261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.810434+0000","last_change":"2024-04-24T02:12:06.754527+0000","last_active":"2024-04-24T02:12:45.810434+0000","last_peered":"2024-04-24T02:12:45.810434+0000","last_clean":"2024-04-24T02:12:45.810434+0000","last_became_active":"2024-04-24T02:12:06.754107+0000","last_became_peered":"2024-04-24T02:12:06.754107+0000","last_unstale":"2024-04-24T02:12:45.810434+0000","last_undegraded":"2024-04-24T02:12:45.810434+0000","last_fullsized":"2024-04-24T02:12:45.810434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:43:41.699448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'93","reported_seq":171,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:20.026339+0000","last_change":"2024-04-24T02:12:08.781379+0000","last_active":"2024-04-24T02:15:20.026339+0000","last_peered":"2024-04-24T02:15:20.026339+0000","last_clean":"2024-04-24T02:15:20.026339+0000","last_became_active":"2024-04-24T02:12:08.780925+0000","last_became_peered":"2024-04-24T02:12:08.780925+0000","last_unstale":"2024-04-24T02:15:20.026339+0000","last_undegraded":"2024-04-24T02:15:20.026339+0000","last_fullsized":"2024-04-24T02:15:20.026339+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:24:18.129044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":90,"num_read_kb":90,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:18.034574+0000","last_change":"2024-04-24T02:12:10.775385+0000","last_active":"2024-04-24T02:14:18.034574+0000","last_peered":"2024-04-24T02:14:18.034574+0000","last_clean":"2024-04-24T02:14:18.034574+0000","last_became_active":"2024-04-24T02:12:10.775165+0000","last_became_peered":"2024-04-24T02:12:10.775165+0000","last_unstale":"2024-04-24T02:14:18.034574+0000","last_undegraded":"2024-04-24T02:14:18.034574+0000","last_fullsized":"2024-04-24T02:14:18.034574+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.806618+0000","last_change":"2024-04-24T02:12:12.796696+0000","last_active":"2024-04-24T02:12:45.806618+0000","last_peered":"2024-04-24T02:12:45.806618+0000","last_clean":"2024-04-24T02:12:45.806618+0000","last_became_active":"2024-04-24T02:12:12.796411+0000","last_became_peered":"2024-04-24T02:12:12.796411+0000","last_unstale":"2024-04-24T02:12:45.806618+0000","last_undegraded":"2024-04-24T02:12:45.806618+0000","last_fullsized":"2024-04-24T02:12:45.806618+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:22:38.124687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.808519+0000","last_change":"2024-04-24T02:12:12.801700+0000","last_active":"2024-04-24T02:12:45.808519+0000","last_peered":"2024-04-24T02:12:45.808519+0000","last_clean":"2024-04-24T02:12:45.808519+0000","last_became_active":"2024-04-24T02:12:12.801346+0000","last_became_peered":"2024-04-24T02:12:12.801346+0000","last_unstale":"2024-04-24T02:12:45.808519+0000","last_undegraded":"2024-04-24T02:12:45.808519+0000","last_fullsized":"2024-04-24T02:12:45.808519+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:53:42.506048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:47.053226+0000","last_change":"2024-04-24T02:12:04.764138+0000","last_active":"2024-04-24T02:12:47.053226+0000","last_peered":"2024-04-24T02:12:47.053226+0000","last_clean":"2024-04-24T02:12:47.053226+0000","last_became_active":"2024-04-24T02:12:04.763860+0000","last_became_peered":"2024-04-24T02:12:04.763860+0000","last_unstale":"2024-04-24T02:12:47.053226+0000","last_undegraded":"2024-04-24T02:12:47.053226+0000","last_fullsized":"2024-04-24T02:12:47.053226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:40:49.148779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"32'1","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:25.040623+0000","last_change":"2024-04-24T02:12:02.757073+0000","last_active":"2024-04-24T02:14:25.040623+0000","last_peered":"2024-04-24T02:14:25.040623+0000","last_clean":"2024-04-24T02:14:25.040623+0000","last_became_active":"2024-04-24T02:12:02.753166+0000","last_became_peered":"2024-04-24T02:12:02.753166+0000","last_unstale":"2024-04-24T02:14:25.040623+0000","last_undegraded":"2024-04-24T02:14:25.040623+0000","last_fullsized":"2024-04-24T02:14:25.040623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:00.841064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.803876+0000","last_change":"2024-04-24T02:12:06.758976+0000","last_active":"2024-04-24T02:12:45.803876+0000","last_peered":"2024-04-24T02:12:45.803876+0000","last_clean":"2024-04-24T02:12:45.803876+0000","last_became_active":"2024-04-24T02:12:06.758468+0000","last_became_peered":"2024-04-24T02:12:06.758468+0000","last_unstale":"2024-04-24T02:12:45.803876+0000","last_undegraded":"2024-04-24T02:12:45.803876+0000","last_fullsized":"2024-04-24T02:12:45.803876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:47:41.924628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'39","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:30.041341+0000","last_change":"2024-04-24T02:12:08.782070+0000","last_active":"2024-04-24T02:14:30.041341+0000","last_peered":"2024-04-24T02:14:30.041341+0000","last_clean":"2024-04-24T02:14:30.041341+0000","last_became_active":"2024-04-24T02:12:08.780353+0000","last_became_peered":"2024-04-24T02:12:08.780353+0000","last_unstale":"2024-04-24T02:14:30.041341+0000","last_undegraded":"2024-04-24T02:14:30.041341+0000","last_fullsized":"2024-04-24T02:14:30.041341+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:00:39.858738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.810326+0000","last_change":"2024-04-24T02:12:10.787091+0000","last_active":"2024-04-24T02:12:45.810326+0000","last_peered":"2024-04-24T02:12:45.810326+0000","last_clean":"2024-04-24T02:12:45.810326+0000","last_became_active":"2024-04-24T02:12:10.786813+0000","last_became_peered":"2024-04-24T02:12:10.786813+0000","last_unstale":"2024-04-24T02:12:45.810326+0000","last_undegraded":"2024-04-24T02:12:45.810326+0000","last_fullsized":"2024-04-24T02:12:45.810326+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:25:58.461531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'9","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.174206+0000","last_change":"2024-04-24T02:12:12.796438+0000","last_active":"2024-04-24T02:15:13.174206+0000","last_peered":"2024-04-24T02:15:13.174206+0000","last_clean":"2024-04-24T02:15:13.174206+0000","last_became_active":"2024-04-24T02:12:12.796149+0000","last_became_peered":"2024-04-24T02:12:12.796149+0000","last_unstale":"2024-04-24T02:15:13.174206+0000","last_undegraded":"2024-04-24T02:15:13.174206+0000","last_fullsized":"2024-04-24T02:15:13.174206+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.170970+0000","last_change":"2024-04-24T02:12:45.816393+0000","last_active":"2024-04-24T02:15:13.170970+0000","last_peered":"2024-04-24T02:15:13.170970+0000","last_clean":"2024-04-24T02:15:13.170970+0000","last_became_active":"2024-04-24T02:12:45.816009+0000","last_became_peered":"2024-04-24T02:12:45.816009+0000","last_unstale":"2024-04-24T02:15:13.170970+0000","last_undegraded":"2024-04-24T02:15:13.170970+0000","last_fullsized":"2024-04-24T02:15:13.170970+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:00:38.405027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"32'6","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.342215+0000","last_change":"2024-04-24T02:12:02.755246+0000","last_active":"2024-04-24T02:15:13.342215+0000","last_peered":"2024-04-24T02:15:13.342215+0000","last_clean":"2024-04-24T02:15:13.342215+0000","last_became_active":"2024-04-24T02:12:02.754623+0000","last_became_peered":"2024-04-24T02:12:02.754623+0000","last_unstale":"2024-04-24T02:15:13.342215+0000","last_undegraded":"2024-04-24T02:15:13.342215+0000","last_fullsized":"2024-04-24T02:15:13.342215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:42.734407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.811478+0000","last_change":"2024-04-24T02:12:06.757753+0000","last_active":"2024-04-24T02:12:45.811478+0000","last_peered":"2024-04-24T02:12:45.811478+0000","last_clean":"2024-04-24T02:12:45.811478+0000","last_became_active":"2024-04-24T02:12:06.756998+0000","last_became_peered":"2024-04-24T02:12:06.756998+0000","last_unstale":"2024-04-24T02:12:45.811478+0000","last_undegraded":"2024-04-24T02:12:45.811478+0000","last_fullsized":"2024-04-24T02:12:45.811478+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:13:32.253391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'6","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:12.813113+0000","last_change":"2024-04-24T02:12:08.769916+0000","last_active":"2024-04-24T02:15:12.813113+0000","last_peered":"2024-04-24T02:15:12.813113+0000","last_clean":"2024-04-24T02:15:12.813113+0000","last_became_active":"2024-04-24T02:12:08.769610+0000","last_became_peered":"2024-04-24T02:12:08.769610+0000","last_unstale":"2024-04-24T02:15:12.813113+0000","last_undegraded":"2024-04-24T02:15:12.813113+0000","last_fullsized":"2024-04-24T02:15:12.813113+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805538+0000","last_change":"2024-04-24T02:12:10.785261+0000","last_active":"2024-04-24T02:12:45.805538+0000","last_peered":"2024-04-24T02:12:45.805538+0000","last_clean":"2024-04-24T02:12:45.805538+0000","last_became_active":"2024-04-24T02:12:10.784955+0000","last_became_peered":"2024-04-24T02:12:10.784955+0000","last_unstale":"2024-04-24T02:12:45.805538+0000","last_undegraded":"2024-04-24T02:12:45.805538+0000","last_fullsized":"2024-04-24T02:12:45.805538+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:52:08.817241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'10","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:43.038159+0000","last_change":"2024-04-24T02:12:12.792872+0000","last_active":"2024-04-24T02:14:43.038159+0000","last_peered":"2024-04-24T02:14:43.038159+0000","last_clean":"2024-04-24T02:14:43.038159+0000","last_became_active":"2024-04-24T02:12:12.792565+0000","last_became_peered":"2024-04-24T02:12:12.792565+0000","last_unstale":"2024-04-24T02:14:43.038159+0000","last_undegraded":"2024-04-24T02:14:43.038159+0000","last_fullsized":"2024-04-24T02:14:43.038159+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":60,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'3","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.523285+0000","last_change":"2024-04-24T02:12:04.767155+0000","last_active":"2024-04-24T02:15:13.523285+0000","last_peered":"2024-04-24T02:15:13.523285+0000","last_clean":"2024-04-24T02:15:13.523285+0000","last_became_active":"2024-04-24T02:12:04.766700+0000","last_became_peered":"2024-04-24T02:12:04.766700+0000","last_unstale":"2024-04-24T02:15:13.523285+0000","last_undegraded":"2024-04-24T02:15:13.523285+0000","last_fullsized":"2024-04-24T02:15:13.523285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.818398+0000","last_change":"2024-04-24T02:12:45.817612+0000","last_active":"2024-04-24T02:12:45.818398+0000","last_peered":"2024-04-24T02:12:45.818398+0000","last_clean":"2024-04-24T02:12:45.818398+0000","last_became_active":"2024-04-24T02:12:45.817240+0000","last_became_peered":"2024-04-24T02:12:45.817240+0000","last_unstale":"2024-04-24T02:12:45.818398+0000","last_undegraded":"2024-04-24T02:12:45.818398+0000","last_fullsized":"2024-04-24T02:12:45.818398+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:23:14.696386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804920+0000","last_change":"2024-04-24T02:12:06.766890+0000","last_active":"2024-04-24T02:12:45.804920+0000","last_peered":"2024-04-24T02:12:45.804920+0000","last_clean":"2024-04-24T02:12:45.804920+0000","last_became_active":"2024-04-24T02:12:06.764776+0000","last_became_peered":"2024-04-24T02:12:06.764776+0000","last_unstale":"2024-04-24T02:12:45.804920+0000","last_undegraded":"2024-04-24T02:12:45.804920+0000","last_fullsized":"2024-04-24T02:12:45.804920+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:57:48.700227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'43","reported_seq":107,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:20.071848+0000","last_change":"2024-04-24T02:12:08.768761+0000","last_active":"2024-04-24T02:15:20.071848+0000","last_peered":"2024-04-24T02:15:20.071848+0000","last_clean":"2024-04-24T02:15:20.071848+0000","last_became_active":"2024-04-24T02:12:08.768499+0000","last_became_peered":"2024-04-24T02:12:08.768499+0000","last_unstale":"2024-04-24T02:15:20.071848+0000","last_undegraded":"2024-04-24T02:15:20.071848+0000","last_fullsized":"2024-04-24T02:15:20.071848+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.803282+0000","last_change":"2024-04-24T02:12:10.777246+0000","last_active":"2024-04-24T02:12:45.803282+0000","last_peered":"2024-04-24T02:12:45.803282+0000","last_clean":"2024-04-24T02:12:45.803282+0000","last_became_active":"2024-04-24T02:12:10.776882+0000","last_became_peered":"2024-04-24T02:12:10.776882+0000","last_unstale":"2024-04-24T02:12:45.803282+0000","last_undegraded":"2024-04-24T02:12:45.803282+0000","last_fullsized":"2024-04-24T02:12:45.803282+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:53:40.499789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.377763+0000","last_change":"2024-04-24T02:12:12.794192+0000","last_active":"2024-04-24T02:15:13.377763+0000","last_peered":"2024-04-24T02:15:13.377763+0000","last_clean":"2024-04-24T02:15:13.377763+0000","last_became_active":"2024-04-24T02:12:12.793884+0000","last_became_peered":"2024-04-24T02:12:12.793884+0000","last_unstale":"2024-04-24T02:15:13.377763+0000","last_undegraded":"2024-04-24T02:15:13.377763+0000","last_fullsized":"2024-04-24T02:15:13.377763+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:38:38.919788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.256832+0000","last_change":"2024-04-24T02:12:04.768207+0000","last_active":"2024-04-24T02:15:13.256832+0000","last_peered":"2024-04-24T02:15:13.256832+0000","last_clean":"2024-04-24T02:15:13.256832+0000","last_became_active":"2024-04-24T02:12:04.767431+0000","last_became_peered":"2024-04-24T02:12:04.767431+0000","last_unstale":"2024-04-24T02:15:13.256832+0000","last_undegraded":"2024-04-24T02:15:13.256832+0000","last_fullsized":"2024-04-24T02:15:13.256832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:28:10.521399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:09.629738+0000","last_change":"2024-04-24T02:12:02.754566+0000","last_active":"2024-04-24T02:14:09.629738+0000","last_peered":"2024-04-24T02:14:09.629738+0000","last_clean":"2024-04-24T02:14:09.629738+0000","last_became_active":"2024-04-24T02:12:02.754295+0000","last_became_peered":"2024-04-24T02:12:02.754295+0000","last_unstale":"2024-04-24T02:14:09.629738+0000","last_undegraded":"2024-04-24T02:14:09.629738+0000","last_fullsized":"2024-04-24T02:14:09.629738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:23:23.715876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.812262+0000","last_change":"2024-04-24T02:12:06.758891+0000","last_active":"2024-04-24T02:12:45.812262+0000","last_peered":"2024-04-24T02:12:45.812262+0000","last_clean":"2024-04-24T02:12:45.812262+0000","last_became_active":"2024-04-24T02:12:06.758462+0000","last_became_peered":"2024-04-24T02:12:06.758462+0000","last_unstale":"2024-04-24T02:12:45.812262+0000","last_undegraded":"2024-04-24T02:12:45.812262+0000","last_fullsized":"2024-04-24T02:12:45.812262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:38:50.153825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'31","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:30.040591+0000","last_change":"2024-04-24T02:12:08.769125+0000","last_active":"2024-04-24T02:14:30.040591+0000","last_peered":"2024-04-24T02:14:30.040591+0000","last_clean":"2024-04-24T02:14:30.040591+0000","last_became_active":"2024-04-24T02:12:08.768814+0000","last_became_peered":"2024-04-24T02:12:08.768814+0000","last_unstale":"2024-04-24T02:14:30.040591+0000","last_undegraded":"2024-04-24T02:14:30.040591+0000","last_fullsized":"2024-04-24T02:14:30.040591+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:53:37.011426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.808892+0000","last_change":"2024-04-24T02:12:10.780084+0000","last_active":"2024-04-24T02:12:45.808892+0000","last_peered":"2024-04-24T02:12:45.808892+0000","last_clean":"2024-04-24T02:12:45.808892+0000","last_became_active":"2024-04-24T02:12:10.779734+0000","last_became_peered":"2024-04-24T02:12:10.779734+0000","last_unstale":"2024-04-24T02:12:45.808892+0000","last_undegraded":"2024-04-24T02:12:45.808892+0000","last_fullsized":"2024-04-24T02:12:45.808892+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:39:31.234341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'1","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:10.038390+0000","last_change":"2024-04-24T02:12:04.764834+0000","last_active":"2024-04-24T02:14:10.038390+0000","last_peered":"2024-04-24T02:14:10.038390+0000","last_clean":"2024-04-24T02:14:10.038390+0000","last_became_active":"2024-04-24T02:12:04.764564+0000","last_became_peered":"2024-04-24T02:12:04.764564+0000","last_unstale":"2024-04-24T02:14:10.038390+0000","last_undegraded":"2024-04-24T02:14:10.038390+0000","last_fullsized":"2024-04-24T02:14:10.038390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:39:25.206344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.041779+0000","last_change":"2024-04-24T02:12:45.809612+0000","last_active":"2024-04-24T02:15:13.041779+0000","last_peered":"2024-04-24T02:15:13.041779+0000","last_clean":"2024-04-24T02:15:13.041779+0000","last_became_active":"2024-04-24T02:12:45.809365+0000","last_became_peered":"2024-04-24T02:12:45.809365+0000","last_unstale":"2024-04-24T02:15:13.041779+0000","last_undegraded":"2024-04-24T02:15:13.041779+0000","last_fullsized":"2024-04-24T02:15:13.041779+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.816471+0000","last_change":"2024-04-24T02:12:45.815335+0000","last_active":"2024-04-24T02:12:45.816471+0000","last_peered":"2024-04-24T02:12:45.816471+0000","last_clean":"2024-04-24T02:12:45.816471+0000","last_became_active":"2024-04-24T02:12:45.814918+0000","last_became_peered":"2024-04-24T02:12:45.814918+0000","last_unstale":"2024-04-24T02:12:45.816471+0000","last_undegraded":"2024-04-24T02:12:45.816471+0000","last_fullsized":"2024-04-24T02:12:45.816471+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:19:12.091357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"32'68","reported_seq":139,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:20.131032+0000","last_change":"2024-04-24T02:12:08.769850+0000","last_active":"2024-04-24T02:15:20.131032+0000","last_peered":"2024-04-24T02:15:20.131032+0000","last_clean":"2024-04-24T02:15:20.131032+0000","last_became_active":"2024-04-24T02:12:08.769578+0000","last_became_peered":"2024-04-24T02:12:08.769578+0000","last_unstale":"2024-04-24T02:15:20.131032+0000","last_undegraded":"2024-04-24T02:15:20.131032+0000","last_fullsized":"2024-04-24T02:15:20.131032+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.808829+0000","last_change":"2024-04-24T02:12:10.780015+0000","last_active":"2024-04-24T02:12:45.808829+0000","last_peered":"2024-04-24T02:12:45.808829+0000","last_clean":"2024-04-24T02:12:45.808829+0000","last_became_active":"2024-04-24T02:12:10.779703+0000","last_became_peered":"2024-04-24T02:12:10.779703+0000","last_unstale":"2024-04-24T02:12:45.808829+0000","last_undegraded":"2024-04-24T02:12:45.808829+0000","last_fullsized":"2024-04-24T02:12:45.808829+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:24:15.761298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'16","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:33.036805+0000","last_change":"2024-04-24T02:12:12.791870+0000","last_active":"2024-04-24T02:14:33.036805+0000","last_peered":"2024-04-24T02:14:33.036805+0000","last_clean":"2024-04-24T02:14:33.036805+0000","last_became_active":"2024-04-24T02:12:12.791623+0000","last_became_peered":"2024-04-24T02:12:12.791623+0000","last_unstale":"2024-04-24T02:14:33.036805+0000","last_undegraded":"2024-04-24T02:14:33.036805+0000","last_fullsized":"2024-04-24T02:14:33.036805+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'10","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:09.640216+0000","last_change":"2024-04-24T02:12:04.755894+0000","last_active":"2024-04-24T02:14:09.640216+0000","last_peered":"2024-04-24T02:14:09.640216+0000","last_clean":"2024-04-24T02:14:09.640216+0000","last_became_active":"2024-04-24T02:12:04.755554+0000","last_became_peered":"2024-04-24T02:12:04.755554+0000","last_unstale":"2024-04-24T02:14:09.640216+0000","last_undegraded":"2024-04-24T02:14:09.640216+0000","last_fullsized":"2024-04-24T02:14:09.640216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.803119+0000","last_change":"2024-04-24T02:12:02.752017+0000","last_active":"2024-04-24T02:12:45.803119+0000","last_peered":"2024-04-24T02:12:45.803119+0000","last_clean":"2024-04-24T02:12:45.803119+0000","last_became_active":"2024-04-24T02:12:02.751703+0000","last_became_peered":"2024-04-24T02:12:02.751703+0000","last_unstale":"2024-04-24T02:12:45.803119+0000","last_undegraded":"2024-04-24T02:12:45.803119+0000","last_fullsized":"2024-04-24T02:12:45.803119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:56:56.371880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.808857+0000","last_change":"2024-04-24T02:12:06.756434+0000","last_active":"2024-04-24T02:12:45.808857+0000","last_peered":"2024-04-24T02:12:45.808857+0000","last_clean":"2024-04-24T02:12:45.808857+0000","last_became_active":"2024-04-24T02:12:06.756154+0000","last_became_peered":"2024-04-24T02:12:06.756154+0000","last_unstale":"2024-04-24T02:12:45.808857+0000","last_undegraded":"2024-04-24T02:12:45.808857+0000","last_fullsized":"2024-04-24T02:12:45.808857+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:28:06.445253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'37","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:40.043083+0000","last_change":"2024-04-24T02:12:08.780969+0000","last_active":"2024-04-24T02:14:40.043083+0000","last_peered":"2024-04-24T02:14:40.043083+0000","last_clean":"2024-04-24T02:14:40.043083+0000","last_became_active":"2024-04-24T02:12:08.780215+0000","last_became_peered":"2024-04-24T02:12:08.780215+0000","last_unstale":"2024-04-24T02:14:40.043083+0000","last_undegraded":"2024-04-24T02:14:40.043083+0000","last_fullsized":"2024-04-24T02:14:40.043083+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:41:43.973694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.806596+0000","last_change":"2024-04-24T02:12:10.786015+0000","last_active":"2024-04-24T02:12:45.806596+0000","last_peered":"2024-04-24T02:12:45.806596+0000","last_clean":"2024-04-24T02:12:45.806596+0000","last_became_active":"2024-04-24T02:12:10.785707+0000","last_became_peered":"2024-04-24T02:12:10.785707+0000","last_unstale":"2024-04-24T02:12:45.806596+0000","last_undegraded":"2024-04-24T02:12:45.806596+0000","last_fullsized":"2024-04-24T02:12:45.806596+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:55:00.963124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.809558+0000","last_change":"2024-04-24T02:12:12.798843+0000","last_active":"2024-04-24T02:12:45.809558+0000","last_peered":"2024-04-24T02:12:45.809558+0000","last_clean":"2024-04-24T02:12:45.809558+0000","last_became_active":"2024-04-24T02:12:12.798498+0000","last_became_peered":"2024-04-24T02:12:12.798498+0000","last_unstale":"2024-04-24T02:12:45.809558+0000","last_undegraded":"2024-04-24T02:12:45.809558+0000","last_fullsized":"2024-04-24T02:12:45.809558+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:03:55.536222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.465088+0000","last_change":"2024-04-24T02:12:04.768687+0000","last_active":"2024-04-24T02:15:13.465088+0000","last_peered":"2024-04-24T02:15:13.465088+0000","last_clean":"2024-04-24T02:15:13.465088+0000","last_became_active":"2024-04-24T02:12:04.768285+0000","last_became_peered":"2024-04-24T02:12:04.768285+0000","last_unstale":"2024-04-24T02:15:13.465088+0000","last_undegraded":"2024-04-24T02:15:13.465088+0000","last_fullsized":"2024-04-24T02:15:13.465088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:38:38.312578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.803505+0000","last_change":"2024-04-24T02:12:02.749703+0000","last_active":"2024-04-24T02:12:45.803505+0000","last_peered":"2024-04-24T02:12:45.803505+0000","last_clean":"2024-04-24T02:12:45.803505+0000","last_became_active":"2024-04-24T02:12:02.749461+0000","last_became_peered":"2024-04-24T02:12:02.749461+0000","last_unstale":"2024-04-24T02:12:45.803505+0000","last_undegraded":"2024-04-24T02:12:45.803505+0000","last_fullsized":"2024-04-24T02:12:45.803505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:39:43.304402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.808573+0000","last_change":"2024-04-24T02:12:06.758054+0000","last_active":"2024-04-24T02:12:45.808573+0000","last_peered":"2024-04-24T02:12:45.808573+0000","last_clean":"2024-04-24T02:12:45.808573+0000","last_became_active":"2024-04-24T02:12:06.757760+0000","last_became_peered":"2024-04-24T02:12:06.757760+0000","last_unstale":"2024-04-24T02:12:45.808573+0000","last_undegraded":"2024-04-24T02:12:45.808573+0000","last_fullsized":"2024-04-24T02:12:45.808573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:03:26.912136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'41","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:20.125228+0000","last_change":"2024-04-24T02:12:08.779753+0000","last_active":"2024-04-24T02:15:20.125228+0000","last_peered":"2024-04-24T02:15:20.125228+0000","last_clean":"2024-04-24T02:15:20.125228+0000","last_became_active":"2024-04-24T02:12:08.779471+0000","last_became_peered":"2024-04-24T02:12:08.779471+0000","last_unstale":"2024-04-24T02:15:20.125228+0000","last_undegraded":"2024-04-24T02:15:20.125228+0000","last_fullsized":"2024-04-24T02:15:20.125228+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:13.033901+0000","last_change":"2024-04-24T02:12:10.780537+0000","last_active":"2024-04-24T02:14:13.033901+0000","last_peered":"2024-04-24T02:14:13.033901+0000","last_clean":"2024-04-24T02:14:13.033901+0000","last_became_active":"2024-04-24T02:12:10.780272+0000","last_became_peered":"2024-04-24T02:12:10.780272+0000","last_unstale":"2024-04-24T02:14:13.033901+0000","last_undegraded":"2024-04-24T02:14:13.033901+0000","last_fullsized":"2024-04-24T02:14:13.033901+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.770870+0000","last_change":"2024-04-24T02:12:12.795264+0000","last_active":"2024-04-24T02:14:12.770870+0000","last_peered":"2024-04-24T02:14:12.770870+0000","last_clean":"2024-04-24T02:14:12.770870+0000","last_became_active":"2024-04-24T02:12:12.794815+0000","last_became_peered":"2024-04-24T02:12:12.794815+0000","last_unstale":"2024-04-24T02:14:12.770870+0000","last_undegraded":"2024-04-24T02:14:12.770870+0000","last_fullsized":"2024-04-24T02:14:12.770870+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:07:13.044978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.472520+0000","last_change":"2024-04-24T02:12:04.750861+0000","last_active":"2024-04-24T02:15:13.472520+0000","last_peered":"2024-04-24T02:15:13.472520+0000","last_clean":"2024-04-24T02:15:13.472520+0000","last_became_active":"2024-04-24T02:12:04.750546+0000","last_became_peered":"2024-04-24T02:12:04.750546+0000","last_unstale":"2024-04-24T02:15:13.472520+0000","last_undegraded":"2024-04-24T02:15:13.472520+0000","last_fullsized":"2024-04-24T02:15:13.472520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.810175+0000","last_change":"2024-04-24T02:12:02.758862+0000","last_active":"2024-04-24T02:12:45.810175+0000","last_peered":"2024-04-24T02:12:45.810175+0000","last_clean":"2024-04-24T02:12:45.810175+0000","last_became_active":"2024-04-24T02:12:02.757728+0000","last_became_peered":"2024-04-24T02:12:02.757728+0000","last_unstale":"2024-04-24T02:12:45.810175+0000","last_undegraded":"2024-04-24T02:12:45.810175+0000","last_fullsized":"2024-04-24T02:12:45.810175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:15:42.425053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805610+0000","last_change":"2024-04-24T02:12:06.757498+0000","last_active":"2024-04-24T02:12:45.805610+0000","last_peered":"2024-04-24T02:12:45.805610+0000","last_clean":"2024-04-24T02:12:45.805610+0000","last_became_active":"2024-04-24T02:12:06.757145+0000","last_became_peered":"2024-04-24T02:12:06.757145+0000","last_unstale":"2024-04-24T02:12:45.805610+0000","last_undegraded":"2024-04-24T02:12:45.805610+0000","last_fullsized":"2024-04-24T02:12:45.805610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:48:54.842263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'16","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.812551+0000","last_change":"2024-04-24T02:12:08.782279+0000","last_active":"2024-04-24T02:12:45.812551+0000","last_peered":"2024-04-24T02:12:45.812551+0000","last_clean":"2024-04-24T02:12:45.812551+0000","last_became_active":"2024-04-24T02:12:08.781974+0000","last_became_peered":"2024-04-24T02:12:08.781974+0000","last_unstale":"2024-04-24T02:12:45.812551+0000","last_undegraded":"2024-04-24T02:12:45.812551+0000","last_fullsized":"2024-04-24T02:12:45.812551+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:08:01.406805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'284","reported_seq":372,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:20.001850+0000","last_change":"2024-04-24T02:12:10.787530+0000","last_active":"2024-04-24T02:15:20.001850+0000","last_peered":"2024-04-24T02:15:20.001850+0000","last_clean":"2024-04-24T02:15:20.001850+0000","last_became_active":"2024-04-24T02:12:10.786972+0000","last_became_peered":"2024-04-24T02:12:10.786972+0000","last_unstale":"2024-04-24T02:15:20.001850+0000","last_undegraded":"2024-04-24T02:15:20.001850+0000","last_fullsized":"2024-04-24T02:15:20.001850+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:01:37.766900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'4","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:28.942341+0000","last_change":"2024-04-24T02:12:12.795734+0000","last_active":"2024-04-24T02:13:28.942341+0000","last_peered":"2024-04-24T02:13:28.942341+0000","last_clean":"2024-04-24T02:13:28.942341+0000","last_became_active":"2024-04-24T02:12:12.795013+0000","last_became_peered":"2024-04-24T02:12:12.795013+0000","last_unstale":"2024-04-24T02:13:28.942341+0000","last_undegraded":"2024-04-24T02:13:28.942341+0000","last_fullsized":"2024-04-24T02:13:28.942341+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:00:19.736045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'12","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.265255+0000","last_change":"2024-04-24T02:12:04.752294+0000","last_active":"2024-04-24T02:15:13.265255+0000","last_peered":"2024-04-24T02:15:13.265255+0000","last_clean":"2024-04-24T02:15:13.265255+0000","last_became_active":"2024-04-24T02:12:04.751676+0000","last_became_peered":"2024-04-24T02:12:04.751676+0000","last_unstale":"2024-04-24T02:15:13.265255+0000","last_undegraded":"2024-04-24T02:15:13.265255+0000","last_fullsized":"2024-04-24T02:15:13.265255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:04:16.078887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805289+0000","last_change":"2024-04-24T02:12:02.756088+0000","last_active":"2024-04-24T02:12:45.805289+0000","last_peered":"2024-04-24T02:12:45.805289+0000","last_clean":"2024-04-24T02:12:45.805289+0000","last_became_active":"2024-04-24T02:12:02.755512+0000","last_became_peered":"2024-04-24T02:12:02.755512+0000","last_unstale":"2024-04-24T02:12:45.805289+0000","last_undegraded":"2024-04-24T02:12:45.805289+0000","last_fullsized":"2024-04-24T02:12:45.805289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:35:57.790455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805191+0000","last_change":"2024-04-24T02:12:06.757421+0000","last_active":"2024-04-24T02:12:45.805191+0000","last_peered":"2024-04-24T02:12:45.805191+0000","last_clean":"2024-04-24T02:12:45.805191+0000","last_became_active":"2024-04-24T02:12:06.756909+0000","last_became_peered":"2024-04-24T02:12:06.756909+0000","last_unstale":"2024-04-24T02:12:45.805191+0000","last_undegraded":"2024-04-24T02:12:45.805191+0000","last_fullsized":"2024-04-24T02:12:45.805191+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:21:46.839438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'61","reported_seq":130,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:35.041591+0000","last_change":"2024-04-24T02:12:08.770654+0000","last_active":"2024-04-24T02:14:35.041591+0000","last_peered":"2024-04-24T02:14:35.041591+0000","last_clean":"2024-04-24T02:14:35.041591+0000","last_became_active":"2024-04-24T02:12:08.770255+0000","last_became_peered":"2024-04-24T02:12:08.770255+0000","last_unstale":"2024-04-24T02:14:35.041591+0000","last_undegraded":"2024-04-24T02:14:35.041591+0000","last_fullsized":"2024-04-24T02:14:35.041591+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:15:23.890733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":74,"num_read_kb":61,"num_write":42,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:38.037385+0000","last_change":"2024-04-24T02:12:10.786024+0000","last_active":"2024-04-24T02:14:38.037385+0000","last_peered":"2024-04-24T02:14:38.037385+0000","last_clean":"2024-04-24T02:14:38.037385+0000","last_became_active":"2024-04-24T02:12:10.785811+0000","last_became_peered":"2024-04-24T02:12:10.785811+0000","last_unstale":"2024-04-24T02:14:38.037385+0000","last_undegraded":"2024-04-24T02:14:38.037385+0000","last_fullsized":"2024-04-24T02:14:38.037385+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804594+0000","last_change":"2024-04-24T02:12:12.799813+0000","last_active":"2024-04-24T02:12:45.804594+0000","last_peered":"2024-04-24T02:12:45.804594+0000","last_clean":"2024-04-24T02:12:45.804594+0000","last_became_active":"2024-04-24T02:12:12.799557+0000","last_became_peered":"2024-04-24T02:12:12.799557+0000","last_unstale":"2024-04-24T02:12:45.804594+0000","last_undegraded":"2024-04-24T02:12:45.804594+0000","last_fullsized":"2024-04-24T02:12:45.804594+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:23:38.168759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'18","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.349395+0000","last_change":"2024-04-24T02:12:04.748652+0000","last_active":"2024-04-24T02:15:13.349395+0000","last_peered":"2024-04-24T02:15:13.349395+0000","last_clean":"2024-04-24T02:15:13.349395+0000","last_became_active":"2024-04-24T02:12:04.748399+0000","last_became_peered":"2024-04-24T02:12:04.748399+0000","last_unstale":"2024-04-24T02:15:13.349395+0000","last_undegraded":"2024-04-24T02:15:13.349395+0000","last_fullsized":"2024-04-24T02:15:13.349395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:11:30.157161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":55,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.812037+0000","last_change":"2024-04-24T02:12:02.761810+0000","last_active":"2024-04-24T02:12:45.812037+0000","last_peered":"2024-04-24T02:12:45.812037+0000","last_clean":"2024-04-24T02:12:45.812037+0000","last_became_active":"2024-04-24T02:12:02.760772+0000","last_became_peered":"2024-04-24T02:12:02.760772+0000","last_unstale":"2024-04-24T02:12:45.812037+0000","last_undegraded":"2024-04-24T02:12:45.812037+0000","last_fullsized":"2024-04-24T02:12:45.812037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:20:25.868325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.808789+0000","last_change":"2024-04-24T02:12:06.765015+0000","last_active":"2024-04-24T02:12:45.808789+0000","last_peered":"2024-04-24T02:12:45.808789+0000","last_clean":"2024-04-24T02:12:45.808789+0000","last_became_active":"2024-04-24T02:12:06.764475+0000","last_became_peered":"2024-04-24T02:12:06.764475+0000","last_unstale":"2024-04-24T02:12:45.808789+0000","last_undegraded":"2024-04-24T02:12:45.808789+0000","last_fullsized":"2024-04-24T02:12:45.808789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:34:43.734495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'40","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:20.146051+0000","last_change":"2024-04-24T02:12:08.779659+0000","last_active":"2024-04-24T02:15:20.146051+0000","last_peered":"2024-04-24T02:15:20.146051+0000","last_clean":"2024-04-24T02:15:20.146051+0000","last_became_active":"2024-04-24T02:12:08.779447+0000","last_became_peered":"2024-04-24T02:12:08.779447+0000","last_unstale":"2024-04-24T02:15:20.146051+0000","last_undegraded":"2024-04-24T02:15:20.146051+0000","last_fullsized":"2024-04-24T02:15:20.146051+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.809971+0000","last_change":"2024-04-24T02:12:10.783395+0000","last_active":"2024-04-24T02:12:45.809971+0000","last_peered":"2024-04-24T02:12:45.809971+0000","last_clean":"2024-04-24T02:12:45.809971+0000","last_became_active":"2024-04-24T02:12:10.782019+0000","last_became_peered":"2024-04-24T02:12:10.782019+0000","last_unstale":"2024-04-24T02:12:45.809971+0000","last_undegraded":"2024-04-24T02:12:45.809971+0000","last_fullsized":"2024-04-24T02:12:45.809971+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:36:51.948849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.811428+0000","last_change":"2024-04-24T02:12:12.797073+0000","last_active":"2024-04-24T02:12:45.811428+0000","last_peered":"2024-04-24T02:12:45.811428+0000","last_clean":"2024-04-24T02:12:45.811428+0000","last_became_active":"2024-04-24T02:12:12.796494+0000","last_became_peered":"2024-04-24T02:12:12.796494+0000","last_unstale":"2024-04-24T02:12:45.811428+0000","last_undegraded":"2024-04-24T02:12:45.811428+0000","last_fullsized":"2024-04-24T02:12:45.811428+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:13.390946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'10","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.349088+0000","last_change":"2024-04-24T02:12:04.763788+0000","last_active":"2024-04-24T02:15:13.349088+0000","last_peered":"2024-04-24T02:15:13.349088+0000","last_clean":"2024-04-24T02:15:13.349088+0000","last_became_active":"2024-04-24T02:12:04.763263+0000","last_became_peered":"2024-04-24T02:12:04.763263+0000","last_unstale":"2024-04-24T02:15:13.349088+0000","last_undegraded":"2024-04-24T02:15:13.349088+0000","last_fullsized":"2024-04-24T02:15:13.349088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:22.258912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:03.032402+0000","last_change":"2024-04-24T02:12:02.745999+0000","last_active":"2024-04-24T02:14:03.032402+0000","last_peered":"2024-04-24T02:14:03.032402+0000","last_clean":"2024-04-24T02:14:03.032402+0000","last_became_active":"2024-04-24T02:12:02.745617+0000","last_became_peered":"2024-04-24T02:12:02.745617+0000","last_unstale":"2024-04-24T02:14:03.032402+0000","last_undegraded":"2024-04-24T02:14:03.032402+0000","last_fullsized":"2024-04-24T02:14:03.032402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805756+0000","last_change":"2024-04-24T02:12:06.766022+0000","last_active":"2024-04-24T02:12:45.805756+0000","last_peered":"2024-04-24T02:12:45.805756+0000","last_clean":"2024-04-24T02:12:45.805756+0000","last_became_active":"2024-04-24T02:12:06.765644+0000","last_became_peered":"2024-04-24T02:12:06.765644+0000","last_unstale":"2024-04-24T02:12:45.805756+0000","last_undegraded":"2024-04-24T02:12:45.805756+0000","last_fullsized":"2024-04-24T02:12:45.805756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:22:20.414950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'34","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:40.043049+0000","last_change":"2024-04-24T02:12:08.780672+0000","last_active":"2024-04-24T02:14:40.043049+0000","last_peered":"2024-04-24T02:14:40.043049+0000","last_clean":"2024-04-24T02:14:40.043049+0000","last_became_active":"2024-04-24T02:12:08.780056+0000","last_became_peered":"2024-04-24T02:12:08.780056+0000","last_unstale":"2024-04-24T02:14:40.043049+0000","last_undegraded":"2024-04-24T02:14:40.043049+0000","last_fullsized":"2024-04-24T02:14:40.043049+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:51:21.271286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":27,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.809863+0000","last_change":"2024-04-24T02:12:10.785977+0000","last_active":"2024-04-24T02:12:45.809863+0000","last_peered":"2024-04-24T02:12:45.809863+0000","last_clean":"2024-04-24T02:12:45.809863+0000","last_became_active":"2024-04-24T02:12:10.785396+0000","last_became_peered":"2024-04-24T02:12:10.785396+0000","last_unstale":"2024-04-24T02:12:45.809863+0000","last_undegraded":"2024-04-24T02:12:45.809863+0000","last_fullsized":"2024-04-24T02:12:45.809863+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:28:39.922824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:11.362615+0000","last_change":"2024-04-24T02:12:12.794051+0000","last_active":"2024-04-24T02:14:11.362615+0000","last_peered":"2024-04-24T02:14:11.362615+0000","last_clean":"2024-04-24T02:14:11.362615+0000","last_became_active":"2024-04-24T02:12:12.793796+0000","last_became_peered":"2024-04-24T02:12:12.793796+0000","last_unstale":"2024-04-24T02:14:11.362615+0000","last_undegraded":"2024-04-24T02:14:11.362615+0000","last_fullsized":"2024-04-24T02:14:11.362615+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:24:07.897162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'18","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.523119+0000","last_change":"2024-04-24T02:12:04.749487+0000","last_active":"2024-04-24T02:15:13.523119+0000","last_peered":"2024-04-24T02:15:13.523119+0000","last_clean":"2024-04-24T02:15:13.523119+0000","last_became_active":"2024-04-24T02:12:04.749055+0000","last_became_peered":"2024-04-24T02:12:04.749055+0000","last_unstale":"2024-04-24T02:15:13.523119+0000","last_undegraded":"2024-04-24T02:15:13.523119+0000","last_fullsized":"2024-04-24T02:15:13.523119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:22:28.196549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805080+0000","last_change":"2024-04-24T02:12:02.747590+0000","last_active":"2024-04-24T02:12:45.805080+0000","last_peered":"2024-04-24T02:12:45.805080+0000","last_clean":"2024-04-24T02:12:45.805080+0000","last_became_active":"2024-04-24T02:12:02.745895+0000","last_became_peered":"2024-04-24T02:12:02.745895+0000","last_unstale":"2024-04-24T02:12:45.805080+0000","last_undegraded":"2024-04-24T02:12:45.805080+0000","last_fullsized":"2024-04-24T02:12:45.805080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:21:06.907535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'6","reported_seq":230,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:19.979028+0000","last_change":"2024-04-24T02:12:06.765389+0000","last_active":"2024-04-24T02:15:19.979028+0000","last_peered":"2024-04-24T02:15:19.979028+0000","last_clean":"2024-04-24T02:15:19.979028+0000","last_became_active":"2024-04-24T02:12:06.765096+0000","last_became_peered":"2024-04-24T02:12:06.765096+0000","last_unstale":"2024-04-24T02:15:19.979028+0000","last_undegraded":"2024-04-24T02:15:19.979028+0000","last_fullsized":"2024-04-24T02:15:19.979028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:28:12.528823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'45","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:12.813785+0000","last_change":"2024-04-24T02:12:08.780244+0000","last_active":"2024-04-24T02:15:12.813785+0000","last_peered":"2024-04-24T02:15:12.813785+0000","last_clean":"2024-04-24T02:15:12.813785+0000","last_became_active":"2024-04-24T02:12:08.779892+0000","last_became_peered":"2024-04-24T02:12:08.779892+0000","last_unstale":"2024-04-24T02:15:12.813785+0000","last_undegraded":"2024-04-24T02:15:12.813785+0000","last_fullsized":"2024-04-24T02:15:12.813785+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:53:04.772697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":52,"num_read_kb":46,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:43.038120+0000","last_change":"2024-04-24T02:12:10.781966+0000","last_active":"2024-04-24T02:14:43.038120+0000","last_peered":"2024-04-24T02:14:43.038120+0000","last_clean":"2024-04-24T02:14:43.038120+0000","last_became_active":"2024-04-24T02:12:10.781588+0000","last_became_peered":"2024-04-24T02:12:10.781588+0000","last_unstale":"2024-04-24T02:14:43.038120+0000","last_undegraded":"2024-04-24T02:14:43.038120+0000","last_fullsized":"2024-04-24T02:14:43.038120+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'6","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.526045+0000","last_change":"2024-04-24T02:12:12.793599+0000","last_active":"2024-04-24T02:15:13.526045+0000","last_peered":"2024-04-24T02:15:13.526045+0000","last_clean":"2024-04-24T02:15:13.526045+0000","last_became_active":"2024-04-24T02:12:12.793310+0000","last_became_peered":"2024-04-24T02:12:12.793310+0000","last_unstale":"2024-04-24T02:15:13.526045+0000","last_undegraded":"2024-04-24T02:15:13.526045+0000","last_fullsized":"2024-04-24T02:15:13.526045+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:31:25.149659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'4","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.464843+0000","last_change":"2024-04-24T02:12:04.767702+0000","last_active":"2024-04-24T02:15:13.464843+0000","last_peered":"2024-04-24T02:15:13.464843+0000","last_clean":"2024-04-24T02:15:13.464843+0000","last_became_active":"2024-04-24T02:12:04.766869+0000","last_became_peered":"2024-04-24T02:12:04.766869+0000","last_unstale":"2024-04-24T02:15:13.464843+0000","last_undegraded":"2024-04-24T02:15:13.464843+0000","last_fullsized":"2024-04-24T02:15:13.464843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:11:48.404916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.805389+0000","last_change":"2024-04-24T02:12:02.750537+0000","last_active":"2024-04-24T02:12:45.805389+0000","last_peered":"2024-04-24T02:12:45.805389+0000","last_clean":"2024-04-24T02:12:45.805389+0000","last_became_active":"2024-04-24T02:12:02.746992+0000","last_became_peered":"2024-04-24T02:12:02.746992+0000","last_unstale":"2024-04-24T02:12:45.805389+0000","last_undegraded":"2024-04-24T02:12:45.805389+0000","last_fullsized":"2024-04-24T02:12:45.805389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:20:45.842023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:18.034674+0000","last_change":"2024-04-24T02:12:04.749519+0000","last_active":"2024-04-24T02:14:18.034674+0000","last_peered":"2024-04-24T02:14:18.034674+0000","last_clean":"2024-04-24T02:14:18.034674+0000","last_became_active":"2024-04-24T02:12:04.749165+0000","last_became_peered":"2024-04-24T02:12:04.749165+0000","last_unstale":"2024-04-24T02:14:18.034674+0000","last_undegraded":"2024-04-24T02:14:18.034674+0000","last_fullsized":"2024-04-24T02:14:18.034674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'6","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.346935+0000","last_change":"2024-04-24T02:12:02.751924+0000","last_active":"2024-04-24T02:15:13.346935+0000","last_peered":"2024-04-24T02:15:13.346935+0000","last_clean":"2024-04-24T02:15:13.346935+0000","last_became_active":"2024-04-24T02:12:02.751613+0000","last_became_peered":"2024-04-24T02:12:02.751613+0000","last_unstale":"2024-04-24T02:15:13.346935+0000","last_undegraded":"2024-04-24T02:15:13.346935+0000","last_fullsized":"2024-04-24T02:15:13.346935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.464756+0000","last_change":"2024-04-24T02:12:04.764660+0000","last_active":"2024-04-24T02:15:13.464756+0000","last_peered":"2024-04-24T02:15:13.464756+0000","last_clean":"2024-04-24T02:15:13.464756+0000","last_became_active":"2024-04-24T02:12:04.763819+0000","last_became_peered":"2024-04-24T02:12:04.763819+0000","last_unstale":"2024-04-24T02:15:13.464756+0000","last_undegraded":"2024-04-24T02:15:13.464756+0000","last_fullsized":"2024-04-24T02:15:13.464756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:23:58.698687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.810651+0000","last_change":"2024-04-24T02:12:02.758745+0000","last_active":"2024-04-24T02:12:45.810651+0000","last_peered":"2024-04-24T02:12:45.810651+0000","last_clean":"2024-04-24T02:12:45.810651+0000","last_became_active":"2024-04-24T02:12:02.757017+0000","last_became_peered":"2024-04-24T02:12:02.757017+0000","last_unstale":"2024-04-24T02:12:45.810651+0000","last_undegraded":"2024-04-24T02:12:45.810651+0000","last_fullsized":"2024-04-24T02:12:45.810651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:47:33.899846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.403654+0000","last_change":"2024-04-24T02:12:04.749624+0000","last_active":"2024-04-24T02:15:13.403654+0000","last_peered":"2024-04-24T02:15:13.403654+0000","last_clean":"2024-04-24T02:15:13.403654+0000","last_became_active":"2024-04-24T02:12:04.749305+0000","last_became_peered":"2024-04-24T02:12:04.749305+0000","last_unstale":"2024-04-24T02:15:13.403654+0000","last_undegraded":"2024-04-24T02:15:13.403654+0000","last_fullsized":"2024-04-24T02:15:13.403654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:08.033192+0000","last_change":"2024-04-24T02:12:02.741858+0000","last_active":"2024-04-24T02:14:08.033192+0000","last_peered":"2024-04-24T02:14:08.033192+0000","last_clean":"2024-04-24T02:14:08.033192+0000","last_became_active":"2024-04-24T02:12:02.741503+0000","last_became_peered":"2024-04-24T02:12:02.741503+0000","last_unstale":"2024-04-24T02:14:08.033192+0000","last_undegraded":"2024-04-24T02:14:08.033192+0000","last_fullsized":"2024-04-24T02:14:08.033192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.264731+0000","last_change":"2024-04-24T02:12:45.818489+0000","last_active":"2024-04-24T02:15:13.264731+0000","last_peered":"2024-04-24T02:15:13.264731+0000","last_clean":"2024-04-24T02:15:13.264731+0000","last_became_active":"2024-04-24T02:12:45.814356+0000","last_became_peered":"2024-04-24T02:12:45.814356+0000","last_unstale":"2024-04-24T02:15:13.264731+0000","last_undegraded":"2024-04-24T02:15:13.264731+0000","last_fullsized":"2024-04-24T02:15:13.264731+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.133232+0000","last_change":"2024-04-24T02:12:02.751995+0000","last_active":"2024-04-24T02:15:13.133232+0000","last_peered":"2024-04-24T02:15:13.133232+0000","last_clean":"2024-04-24T02:15:13.133232+0000","last_became_active":"2024-04-24T02:12:02.751680+0000","last_became_peered":"2024-04-24T02:12:02.751680+0000","last_unstale":"2024-04-24T02:15:13.133232+0000","last_undegraded":"2024-04-24T02:15:13.133232+0000","last_fullsized":"2024-04-24T02:15:13.133232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'8","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.391123+0000","last_change":"2024-04-24T02:12:45.817674+0000","last_active":"2024-04-24T02:15:13.391123+0000","last_peered":"2024-04-24T02:15:13.391123+0000","last_clean":"2024-04-24T02:15:13.391123+0000","last_became_active":"2024-04-24T02:12:45.813097+0000","last_became_peered":"2024-04-24T02:12:45.813097+0000","last_unstale":"2024-04-24T02:15:13.391123+0000","last_undegraded":"2024-04-24T02:15:13.391123+0000","last_fullsized":"2024-04-24T02:15:13.391123+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:03:21.634592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"32'1","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:15.038523+0000","last_change":"2024-04-24T02:12:02.754946+0000","last_active":"2024-04-24T02:14:15.038523+0000","last_peered":"2024-04-24T02:14:15.038523+0000","last_clean":"2024-04-24T02:14:15.038523+0000","last_became_active":"2024-04-24T02:12:02.754356+0000","last_became_peered":"2024-04-24T02:12:02.754356+0000","last_unstale":"2024-04-24T02:14:15.038523+0000","last_undegraded":"2024-04-24T02:14:15.038523+0000","last_fullsized":"2024-04-24T02:14:15.038523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:57:48.477966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'5","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.523238+0000","last_change":"2024-04-24T02:12:04.756117+0000","last_active":"2024-04-24T02:15:13.523238+0000","last_peered":"2024-04-24T02:15:13.523238+0000","last_clean":"2024-04-24T02:15:13.523238+0000","last_became_active":"2024-04-24T02:12:04.755738+0000","last_became_peered":"2024-04-24T02:12:04.755738+0000","last_unstale":"2024-04-24T02:15:13.523238+0000","last_undegraded":"2024-04-24T02:15:13.523238+0000","last_fullsized":"2024-04-24T02:15:13.523238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"30'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.813069+0000","last_change":"2024-04-24T02:12:02.756723+0000","last_active":"2024-04-24T02:12:45.813069+0000","last_peered":"2024-04-24T02:12:45.813069+0000","last_clean":"2024-04-24T02:12:45.813069+0000","last_became_active":"2024-04-24T02:12:02.755202+0000","last_became_peered":"2024-04-24T02:12:02.755202+0000","last_unstale":"2024-04-24T02:12:45.813069+0000","last_undegraded":"2024-04-24T02:12:45.813069+0000","last_fullsized":"2024-04-24T02:12:45.813069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:35:57.790455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"30'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.803548+0000","last_change":"2024-04-24T02:12:04.756072+0000","last_active":"2024-04-24T02:12:45.803548+0000","last_peered":"2024-04-24T02:12:45.803548+0000","last_clean":"2024-04-24T02:12:45.803548+0000","last_became_active":"2024-04-24T02:12:04.755194+0000","last_became_peered":"2024-04-24T02:12:04.755194+0000","last_unstale":"2024-04-24T02:12:45.803548+0000","last_undegraded":"2024-04-24T02:12:45.803548+0000","last_fullsized":"2024-04-24T02:12:45.803548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:48:16.917007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.462625+0000","last_change":"2024-04-24T02:12:02.752025+0000","last_active":"2024-04-24T02:15:13.462625+0000","last_peered":"2024-04-24T02:15:13.462625+0000","last_clean":"2024-04-24T02:15:13.462625+0000","last_became_active":"2024-04-24T02:12:02.751726+0000","last_became_peered":"2024-04-24T02:12:02.751726+0000","last_unstale":"2024-04-24T02:15:13.462625+0000","last_undegraded":"2024-04-24T02:15:13.462625+0000","last_fullsized":"2024-04-24T02:15:13.462625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'6","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.940195+0000","last_change":"2024-04-24T02:12:04.753374+0000","last_active":"2024-04-24T02:12:45.940195+0000","last_peered":"2024-04-24T02:12:45.940195+0000","last_clean":"2024-04-24T02:12:45.940195+0000","last_became_active":"2024-04-24T02:12:04.753074+0000","last_became_peered":"2024-04-24T02:12:04.753074+0000","last_unstale":"2024-04-24T02:12:45.940195+0000","last_undegraded":"2024-04-24T02:12:45.940195+0000","last_fullsized":"2024-04-24T02:12:45.940195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:54:39.701699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:15.038929+0000","last_change":"2024-04-24T02:12:02.755029+0000","last_active":"2024-04-24T02:14:15.038929+0000","last_peered":"2024-04-24T02:14:15.038929+0000","last_clean":"2024-04-24T02:14:15.038929+0000","last_became_active":"2024-04-24T02:12:02.754158+0000","last_became_peered":"2024-04-24T02:12:02.754158+0000","last_unstale":"2024-04-24T02:14:15.038929+0000","last_undegraded":"2024-04-24T02:14:15.038929+0000","last_fullsized":"2024-04-24T02:14:15.038929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:10:56.620635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:29.126199+0000","last_change":"2024-04-24T02:12:04.764100+0000","last_active":"2024-04-24T02:13:29.126199+0000","last_peered":"2024-04-24T02:13:29.126199+0000","last_clean":"2024-04-24T02:13:29.126199+0000","last_became_active":"2024-04-24T02:12:04.763136+0000","last_became_peered":"2024-04-24T02:12:04.763136+0000","last_unstale":"2024-04-24T02:13:29.126199+0000","last_undegraded":"2024-04-24T02:13:29.126199+0000","last_fullsized":"2024-04-24T02:13:29.126199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:52:02.789245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:18.034542+0000","last_change":"2024-04-24T02:12:02.741912+0000","last_active":"2024-04-24T02:14:18.034542+0000","last_peered":"2024-04-24T02:14:18.034542+0000","last_clean":"2024-04-24T02:14:18.034542+0000","last_became_active":"2024-04-24T02:12:02.741543+0000","last_became_peered":"2024-04-24T02:12:02.741543+0000","last_unstale":"2024-04-24T02:14:18.034542+0000","last_undegraded":"2024-04-24T02:14:18.034542+0000","last_fullsized":"2024-04-24T02:14:18.034542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:23.035430+0000","last_change":"2024-04-24T02:12:04.760381+0000","last_active":"2024-04-24T02:14:23.035430+0000","last_peered":"2024-04-24T02:14:23.035430+0000","last_clean":"2024-04-24T02:14:23.035430+0000","last_became_active":"2024-04-24T02:12:04.760028+0000","last_became_peered":"2024-04-24T02:12:04.760028+0000","last_unstale":"2024-04-24T02:14:23.035430+0000","last_undegraded":"2024-04-24T02:14:23.035430+0000","last_fullsized":"2024-04-24T02:14:23.035430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.336619+0000","last_change":"2024-04-24T02:12:02.750391+0000","last_active":"2024-04-24T02:15:13.336619+0000","last_peered":"2024-04-24T02:15:13.336619+0000","last_clean":"2024-04-24T02:15:13.336619+0000","last_became_active":"2024-04-24T02:12:02.750143+0000","last_became_peered":"2024-04-24T02:12:02.750143+0000","last_unstale":"2024-04-24T02:15:13.336619+0000","last_undegraded":"2024-04-24T02:15:13.336619+0000","last_fullsized":"2024-04-24T02:15:13.336619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:30:58.417438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'8","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.465106+0000","last_change":"2024-04-24T02:12:04.754976+0000","last_active":"2024-04-24T02:15:13.465106+0000","last_peered":"2024-04-24T02:15:13.465106+0000","last_clean":"2024-04-24T02:15:13.465106+0000","last_became_active":"2024-04-24T02:12:04.754738+0000","last_became_peered":"2024-04-24T02:12:04.754738+0000","last_unstale":"2024-04-24T02:15:13.465106+0000","last_undegraded":"2024-04-24T02:15:13.465106+0000","last_fullsized":"2024-04-24T02:15:13.465106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:34:41.727071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.804338+0000","last_change":"2024-04-24T02:12:02.746027+0000","last_active":"2024-04-24T02:12:45.804338+0000","last_peered":"2024-04-24T02:12:45.804338+0000","last_clean":"2024-04-24T02:12:45.804338+0000","last_became_active":"2024-04-24T02:12:02.744352+0000","last_became_peered":"2024-04-24T02:12:02.744352+0000","last_unstale":"2024-04-24T02:12:45.804338+0000","last_undegraded":"2024-04-24T02:12:45.804338+0000","last_fullsized":"2024-04-24T02:12:45.804338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:42.734407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'12","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.179236+0000","last_change":"2024-04-24T02:12:45.815138+0000","last_active":"2024-04-24T02:15:13.179236+0000","last_peered":"2024-04-24T02:15:13.179236+0000","last_clean":"2024-04-24T02:15:13.179236+0000","last_became_active":"2024-04-24T02:12:45.808774+0000","last_became_peered":"2024-04-24T02:12:45.808774+0000","last_unstale":"2024-04-24T02:15:13.179236+0000","last_undegraded":"2024-04-24T02:15:13.179236+0000","last_fullsized":"2024-04-24T02:15:13.179236+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:34:31.491770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.811686+0000","last_change":"2024-04-24T02:12:02.758624+0000","last_active":"2024-04-24T02:12:45.811686+0000","last_peered":"2024-04-24T02:12:45.811686+0000","last_clean":"2024-04-24T02:12:45.811686+0000","last_became_active":"2024-04-24T02:12:02.757458+0000","last_became_peered":"2024-04-24T02:12:02.757458+0000","last_unstale":"2024-04-24T02:12:45.811686+0000","last_undegraded":"2024-04-24T02:12:45.811686+0000","last_fullsized":"2024-04-24T02:12:45.811686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:40:47.142152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'14","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.391096+0000","last_change":"2024-04-24T02:12:04.751238+0000","last_active":"2024-04-24T02:15:13.391096+0000","last_peered":"2024-04-24T02:15:13.391096+0000","last_clean":"2024-04-24T02:15:13.391096+0000","last_became_active":"2024-04-24T02:12:04.750973+0000","last_became_peered":"2024-04-24T02:12:04.750973+0000","last_unstale":"2024-04-24T02:15:13.391096+0000","last_undegraded":"2024-04-24T02:15:13.391096+0000","last_fullsized":"2024-04-24T02:15:13.391096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:39:11.735517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.812141+0000","last_change":"2024-04-24T02:12:02.761835+0000","last_active":"2024-04-24T02:12:45.812141+0000","last_peered":"2024-04-24T02:12:45.812141+0000","last_clean":"2024-04-24T02:12:45.812141+0000","last_became_active":"2024-04-24T02:12:02.761235+0000","last_became_peered":"2024-04-24T02:12:02.761235+0000","last_unstale":"2024-04-24T02:12:45.812141+0000","last_undegraded":"2024-04-24T02:12:45.812141+0000","last_fullsized":"2024-04-24T02:12:45.812141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:25:04.505767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.389012+0000","last_change":"2024-04-24T02:12:04.764009+0000","last_active":"2024-04-24T02:15:13.389012+0000","last_peered":"2024-04-24T02:15:13.389012+0000","last_clean":"2024-04-24T02:15:13.389012+0000","last_became_active":"2024-04-24T02:12:04.763517+0000","last_became_peered":"2024-04-24T02:12:04.763517+0000","last_unstale":"2024-04-24T02:15:13.389012+0000","last_undegraded":"2024-04-24T02:15:13.389012+0000","last_fullsized":"2024-04-24T02:15:13.389012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:00:42.696926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.339848+0000","last_change":"2024-04-24T02:12:02.754501+0000","last_active":"2024-04-24T02:15:13.339848+0000","last_peered":"2024-04-24T02:15:13.339848+0000","last_clean":"2024-04-24T02:15:13.339848+0000","last_became_active":"2024-04-24T02:12:02.754227+0000","last_became_peered":"2024-04-24T02:12:02.754227+0000","last_unstale":"2024-04-24T02:15:13.339848+0000","last_undegraded":"2024-04-24T02:15:13.339848+0000","last_fullsized":"2024-04-24T02:15:13.339848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:21:06.907535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.349589+0000","last_change":"2024-04-24T02:12:04.755937+0000","last_active":"2024-04-24T02:15:13.349589+0000","last_peered":"2024-04-24T02:15:13.349589+0000","last_clean":"2024-04-24T02:15:13.349589+0000","last_became_active":"2024-04-24T02:12:04.755661+0000","last_became_peered":"2024-04-24T02:12:04.755661+0000","last_unstale":"2024-04-24T02:15:13.349589+0000","last_undegraded":"2024-04-24T02:15:13.349589+0000","last_fullsized":"2024-04-24T02:15:13.349589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:11:30.157161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.813752+0000","last_change":"2024-04-24T02:12:02.761162+0000","last_active":"2024-04-24T02:12:45.813752+0000","last_peered":"2024-04-24T02:12:45.813752+0000","last_clean":"2024-04-24T02:12:45.813752+0000","last_became_active":"2024-04-24T02:12:02.758855+0000","last_became_peered":"2024-04-24T02:12:02.758855+0000","last_unstale":"2024-04-24T02:12:45.813752+0000","last_undegraded":"2024-04-24T02:12:45.813752+0000","last_fullsized":"2024-04-24T02:12:45.813752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:48:14.910380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:12:45.809520+0000","last_change":"2024-04-24T02:12:02.757416+0000","last_active":"2024-04-24T02:12:45.809520+0000","last_peered":"2024-04-24T02:12:45.809520+0000","last_clean":"2024-04-24T02:12:45.809520+0000","last_became_active":"2024-04-24T02:12:02.753545+0000","last_became_peered":"2024-04-24T02:12:02.753545+0000","last_unstale":"2024-04-24T02:12:45.809520+0000","last_undegraded":"2024-04-24T02:12:45.809520+0000","last_fullsized":"2024-04-24T02:12:45.809520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:09.115795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'10","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.176997+0000","last_change":"2024-04-24T02:12:04.758909+0000","last_active":"2024-04-24T02:15:13.176997+0000","last_peered":"2024-04-24T02:15:13.176997+0000","last_clean":"2024-04-24T02:15:13.176997+0000","last_became_active":"2024-04-24T02:12:04.758661+0000","last_became_peered":"2024-04-24T02:12:04.758661+0000","last_unstale":"2024-04-24T02:15:13.176997+0000","last_undegraded":"2024-04-24T02:15:13.176997+0000","last_fullsized":"2024-04-24T02:15:13.176997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:23.035340+0000","last_change":"2024-04-24T02:12:02.745737+0000","last_active":"2024-04-24T02:14:23.035340+0000","last_peered":"2024-04-24T02:14:23.035340+0000","last_clean":"2024-04-24T02:14:23.035340+0000","last_became_active":"2024-04-24T02:12:02.745396+0000","last_became_peered":"2024-04-24T02:12:02.745396+0000","last_unstale":"2024-04-24T02:14:23.035340+0000","last_undegraded":"2024-04-24T02:14:23.035340+0000","last_fullsized":"2024-04-24T02:14:23.035340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:09.640725+0000","last_change":"2024-04-24T02:12:04.766645+0000","last_active":"2024-04-24T02:14:09.640725+0000","last_peered":"2024-04-24T02:14:09.640725+0000","last_clean":"2024-04-24T02:14:09.640725+0000","last_became_active":"2024-04-24T02:12:04.766344+0000","last_became_peered":"2024-04-24T02:12:04.766344+0000","last_unstale":"2024-04-24T02:14:09.640725+0000","last_undegraded":"2024-04-24T02:14:09.640725+0000","last_fullsized":"2024-04-24T02:14:09.640725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:28:04.437829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2275,"ondisk_log_size":2275,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1735,"num_read_kb":1489,"num_write":737,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":9115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1517,"ondisk_log_size":1517,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1617,"num_read_kb":1507,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":21611392,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":131,"num_read_kb":83,"num_write":310,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":43229184,"data_stored":43222784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":77,"ondisk_log_size":77,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640303,"num_pgs":152,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52796,"kb_used_data":17460,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94319044,"statfs":{"total":96636764160,"available":96582701056,"internally_reserved":0,"allocated":17879040,"data_stored":17552672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640301,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49212,"kb_used_data":13876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94322628,"statfs":{"total":96636764160,"available":96586371072,"internally_reserved":0,"allocated":14209024,"data_stored":13945472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640303,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48616,"kb_used_data":13280,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323224,"statfs":{"total":96636764160,"available":96586981376,"internally_reserved":0,"allocated":13598720,"data_stored":13308671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705711,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39912,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331928,"statfs":{"total":96636764160,"available":96595894272,"internally_reserved":0,"allocated":421888,"data_stored":133610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13225984,"data_stored":13222784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":17420288,"data_stored":17417088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T02:15:24.570 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.570 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.571 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.571 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.571 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.572 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.572 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.572 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.572 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.572 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.572 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.572 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.572 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.572 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.572 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.573 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.573 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.573 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.573 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.573 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.573 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.573 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.573 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.573 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.574 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.574 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.574 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.574 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.574 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.574 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.574 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.574 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.574 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-04-24T02:12:07.752700+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.575 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-04-24T02:12:09.760669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=9, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.575 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.575 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.575 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.575 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.575 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-04-24T02:12:07.752700+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.575 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-04-24T02:12:09.760669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=9, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.575 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.575 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.575 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.576 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.576 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-04-24T02:12:07.752700+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.576 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-04-24T02:12:09.760669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=9, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.576 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.576 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.576 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.576 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.576 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-04-24T02:12:07.752700+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.576 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-04-24T02:12:09.760669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=9, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.577 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.577 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.577 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.577 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-04-24T02:12:07.752700+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.577 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-04-24T02:12:09.760669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=9, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.577 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.577 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.577 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.577 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.577 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-04-24T02:12:07.752700+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.578 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-04-24T02:12:09.760669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=9, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.578 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.578 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.578 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.578 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.578 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-04-24T02:12:07.752700+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.578 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-04-24T02:12:09.760669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=9, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.578 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.578 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.579 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.579 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.579 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-04-24T02:12:07.752700+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.579 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-04-24T02:12:09.760669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=9, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.579 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.579 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.579 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.579 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.579 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-04-24T02:12:07.752700+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.580 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-04-24T02:12:09.760669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=9, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.580 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.580 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.580 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.580 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.580 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-04-24T02:12:07.752700+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.580 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-04-24T02:12:09.760669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=9, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.580 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.580 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.580 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.581 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.581 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-04-24T02:12:07.752700+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.581 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-04-24T02:12:09.760669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=9, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.581 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.581 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.581 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.581 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.581 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-04-24T02:12:07.752700+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.581 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-04-24T02:12:09.760669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=9, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.582 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.582 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.582 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-24T02:11:50.697037+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=11, tm_sec=50, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.582 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-24T02:11:55.711441+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.582 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.582 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.582 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-04-24T02:12:07.752700+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.582 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.582 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.583 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-24T02:11:55.711441+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.583 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.583 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.583 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-04-24T02:12:07.752700+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.583 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-04-24T02:12:09.760669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=9, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.583 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.583 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.583 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-24T02:11:55.711441+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.583 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.584 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.584 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-04-24T02:12:07.752700+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.584 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-04-24T02:12:09.760669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=9, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.584 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.584 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.584 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-24T02:11:55.711441+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.584 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.584 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.584 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-04-24T02:12:07.752700+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.585 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-04-24T02:12:09.760669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=9, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.585 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.585 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.585 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.585 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-24T02:11:55.711441+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.585 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.585 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-04-24T02:12:07.752700+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.585 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-04-24T02:12:09.760669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=9, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.585 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.586 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.586 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.586 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-24T02:11:55.711441+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.586 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.586 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-04-24T02:12:07.752700+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.586 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-04-24T02:12:09.760669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=9, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.586 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.586 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.586 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.586 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-24T02:11:55.711441+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.587 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.587 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-04-24T02:12:07.752700+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.587 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-04-24T02:12:09.760669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=9, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.587 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.587 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.587 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.587 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-24T02:11:55.711441+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.587 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.588 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-04-24T02:12:07.752700+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.588 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-04-24T02:12:09.760669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=9, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.588 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.588 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.588 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.588 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.588 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.588 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-04-24T02:12:07.752700+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.588 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-04-24T02:12:09.760669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=9, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.588 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.589 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.589 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.589 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.589 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-04-24T02:12:07.752700+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.589 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-04-24T02:12:09.760669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=9, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.589 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.589 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.589 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.589 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.590 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-04-24T02:12:07.752700+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.590 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-04-24T02:12:09.760669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=9, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.590 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.590 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.590 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.590 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.590 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-04-24T02:12:07.752700+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.590 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-04-24T02:12:09.760669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=9, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.590 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.591 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.591 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.591 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-04-24T02:12:07.752700+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.591 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-04-24T02:12:09.760669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=9, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.591 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.591 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.591 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.591 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.591 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-04-24T02:12:07.752700+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.592 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-04-24T02:12:09.760669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=9, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.592 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.592 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.592 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.592 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.592 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-04-24T02:12:07.752700+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.592 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-04-24T02:12:09.760669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=9, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.592 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.592 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.592 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.593 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.593 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-04-24T02:12:07.752700+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.593 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-04-24T02:12:09.760669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=9, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.593 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.593 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.593 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.593 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.593 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-04-24T02:12:07.752700+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.593 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-04-24T02:12:09.760669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=9, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.594 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.594 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.594 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.594 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.594 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-04-24T02:12:07.752700+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.594 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-04-24T02:12:09.760669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=9, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.594 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.594 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.594 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.594 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.595 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-04-24T02:12:07.752700+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.595 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-04-24T02:12:09.760669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=9, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.595 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.595 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.595 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.595 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.595 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-04-24T02:12:07.752700+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.595 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-04-24T02:12:09.760669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=9, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.595 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.595 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.596 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.596 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.596 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.596 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.596 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.596 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.596 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.596 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.596 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.597 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.597 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.597 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.597 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.597 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.597 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.597 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.597 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.597 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.597 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.598 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.598 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.598 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.598 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.598 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.598 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.598 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.598 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.598 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.599 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.599 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.599 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.599 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.599 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.599 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.599 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:24.599 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-24T02:15:44.600 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T02:15:44.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.707+0000 7fbd679bd640 1 Processor -- start 2024-04-24T02:15:44.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.708+0000 7fbd679bd640 1 -- start start 2024-04-24T02:15:44.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.708+0000 7fbd679bd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fbd6012e5b0 0x7fbd6012e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:44.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.708+0000 7fbd679bd640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd6006dde0 con 0x7fbd6012eed0 2024-04-24T02:15:44.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.708+0000 7fbd679bd640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fbd6012f360 con 0x7fbd6012e5b0 2024-04-24T02:15:44.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.708+0000 7fbd65759640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fbd6012e5b0 0x7fbd6012e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:44.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.708+0000 7fbd64f58640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fbd6012eed0 0x7fbd6012b290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:51186/0 (socket says 172.21.15.104:51186) 2024-04-24T02:15:44.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.708+0000 7fbd64f58640 1 -- 172.21.15.104:0/2914870632 learned_addr learned my addr 172.21.15.104:0/2914870632 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-04-24T02:15:44.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.708+0000 7fbd65759640 1 -- 172.21.15.104:0/2914870632 >> v1:172.21.15.104:6789/0 conn(0x7fbd6012eed0 legacy=0x7fbd6012b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:44.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.708+0000 7fbd65759640 1 -- 172.21.15.104:0/2914870632 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd60070280 con 0x7fbd6012e5b0 2024-04-24T02:15:44.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.709+0000 7fbd65759640 1 --2- 172.21.15.104:0/2914870632 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd6012e5b0 0x7fbd6012e990 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fbd54009720 tx=0x7fbd5402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a657641ccd9badf server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:44.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.709+0000 7fbd53fff640 1 -- 172.21.15.104:0/2914870632 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd540316d0 con 0x7fbd6012e5b0 2024-04-24T02:15:44.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.709+0000 7fbd53fff640 1 -- 172.21.15.104:0/2914870632 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd54037070 con 0x7fbd6012e5b0 2024-04-24T02:15:44.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.709+0000 7fbd53fff640 1 -- 172.21.15.104:0/2914870632 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd540319c0 con 0x7fbd6012e5b0 2024-04-24T02:15:44.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.710+0000 7fbd679bd640 1 -- 172.21.15.104:0/2914870632 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd6012e5b0 msgr2=0x7fbd6012e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:44.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.710+0000 7fbd679bd640 1 --2- 172.21.15.104:0/2914870632 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd6012e5b0 0x7fbd6012e990 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fbd54009720 tx=0x7fbd5402b840 comp rx=0 tx=0).stop 2024-04-24T02:15:44.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.710+0000 7fbd679bd640 1 -- 172.21.15.104:0/2914870632 shutdown_connections 2024-04-24T02:15:44.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.710+0000 7fbd679bd640 1 --2- 172.21.15.104:0/2914870632 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd6012e5b0 0x7fbd6012e990 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:44.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.710+0000 7fbd679bd640 1 -- 172.21.15.104:0/2914870632 >> 172.21.15.104:0/2914870632 conn(0x7fbd6009c7f0 msgr2=0x7fbd6009cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:15:44.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.710+0000 7fbd679bd640 1 -- 172.21.15.104:0/2914870632 shutdown_connections 2024-04-24T02:15:44.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.710+0000 7fbd679bd640 1 -- 172.21.15.104:0/2914870632 wait complete. 2024-04-24T02:15:44.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.711+0000 7fbd679bd640 1 Processor -- start 2024-04-24T02:15:44.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.711+0000 7fbd679bd640 1 -- start start 2024-04-24T02:15:44.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.711+0000 7fbd679bd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd6012e5b0 0x7fbd6011b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:44.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.711+0000 7fbd679bd640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fbd6006ffc0 con 0x7fbd6012e5b0 2024-04-24T02:15:44.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.711+0000 7fbd65759640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd6012e5b0 0x7fbd6011b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:44.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.711+0000 7fbd65759640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd6012e5b0 0x7fbd6011b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:57448/0 (socket says 172.21.15.104:57448) 2024-04-24T02:15:44.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.711+0000 7fbd65759640 1 -- 172.21.15.104:0/2218340265 learned_addr learned my addr 172.21.15.104:0/2218340265 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:15:44.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.712+0000 7fbd65759640 1 -- 172.21.15.104:0/2218340265 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd6011e9d0 con 0x7fbd6012e5b0 2024-04-24T02:15:44.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.712+0000 7fbd65759640 1 --2- 172.21.15.104:0/2218340265 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd6012e5b0 0x7fbd6011b6d0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fbd54034040 tx=0x7fbd540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:44.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.712+0000 7fbd51ffb640 1 -- 172.21.15.104:0/2218340265 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd54032770 con 0x7fbd6012e5b0 2024-04-24T02:15:44.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.712+0000 7fbd51ffb640 1 -- 172.21.15.104:0/2218340265 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd54032910 con 0x7fbd6012e5b0 2024-04-24T02:15:44.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.712+0000 7fbd679bd640 1 -- 172.21.15.104:0/2218340265 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd6011cf90 con 0x7fbd6012e5b0 2024-04-24T02:15:44.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.712+0000 7fbd51ffb640 1 -- 172.21.15.104:0/2218340265 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd54032c10 con 0x7fbd6012e5b0 2024-04-24T02:15:44.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.712+0000 7fbd679bd640 1 -- 172.21.15.104:0/2218340265 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd6011e2e0 con 0x7fbd6012e5b0 2024-04-24T02:15:44.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.713+0000 7fbd51ffb640 1 -- 172.21.15.104:0/2218340265 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbd5404c060 con 0x7fbd6012e5b0 2024-04-24T02:15:44.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.713+0000 7fbd679bd640 1 -- 172.21.15.104:0/2218340265 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd60062da0 con 0x7fbd6012e5b0 2024-04-24T02:15:44.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.713+0000 7fbd51ffb640 1 --2- 172.21.15.104:0/2218340265 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fbd44038060 0x7fbd4403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:15:44.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.713+0000 7fbd51ffb640 1 -- 172.21.15.104:0/2218340265 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fbd5402f050 con 0x7fbd6012e5b0 2024-04-24T02:15:44.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.714+0000 7fbd64f58640 1 --2- 172.21.15.104:0/2218340265 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fbd44038060 0x7fbd4403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:15:44.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.714+0000 7fbd64f58640 1 --2- 172.21.15.104:0/2218340265 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fbd44038060 0x7fbd4403a520 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c000f60 tx=0x7fbd5c007a80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:15:44.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.718+0000 7fbd51ffb640 1 -- 172.21.15.104:0/2218340265 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7fbd6011e9d0 con 0x7fbd6012e5b0 2024-04-24T02:15:44.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.889+0000 7fbd679bd640 1 -- 172.21.15.104:0/2218340265 --> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbd6012b760 con 0x7fbd44038060 2024-04-24T02:15:44.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.904+0000 7fbd51ffb640 1 -- 172.21.15.104:0/2218340265 <== mgr.4101 v2:172.21.15.134:6824/3655027977 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+658263 (secure 0 0 0) 0x7fbd6012b760 con 0x7fbd44038060 2024-04-24T02:15:44.912 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:15:44.918 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-04-24T02:15:44.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.908+0000 7fbd679bd640 1 -- 172.21.15.104:0/2218340265 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fbd44038060 msgr2=0x7fbd4403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:44.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.908+0000 7fbd679bd640 1 --2- 172.21.15.104:0/2218340265 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fbd44038060 0x7fbd4403a520 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c000f60 tx=0x7fbd5c007a80 comp rx=0 tx=0).stop 2024-04-24T02:15:44.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.908+0000 7fbd679bd640 1 -- 172.21.15.104:0/2218340265 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd6012e5b0 msgr2=0x7fbd6011b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:15:44.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.908+0000 7fbd679bd640 1 --2- 172.21.15.104:0/2218340265 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd6012e5b0 0x7fbd6011b6d0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fbd54034040 tx=0x7fbd540046c0 comp rx=0 tx=0).stop 2024-04-24T02:15:44.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.908+0000 7fbd679bd640 1 -- 172.21.15.104:0/2218340265 shutdown_connections 2024-04-24T02:15:44.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.908+0000 7fbd679bd640 1 --2- 172.21.15.104:0/2218340265 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fbd44038060 0x7fbd4403a520 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:44.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.908+0000 7fbd679bd640 1 --2- 172.21.15.104:0/2218340265 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd6012e5b0 0x7fbd6011b6d0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:15:44.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.908+0000 7fbd679bd640 1 -- 172.21.15.104:0/2218340265 >> 172.21.15.104:0/2218340265 conn(0x7fbd6009c7f0 msgr2=0x7fbd601b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:15:44.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.908+0000 7fbd679bd640 1 -- 172.21.15.104:0/2218340265 shutdown_connections 2024-04-24T02:15:44.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:15:44.908+0000 7fbd679bd640 1 -- 172.21.15.104:0/2218340265 wait complete. 2024-04-24T02:15:44.921 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":147,"stamp":"2024-04-24T02:15:44.030345+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":252,"num_object_clones":0,"num_object_copies":504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":0,"num_read":5385,"num_read_kb":4938,"num_write":2369,"num_write_kb":61373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2342,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4939,"ondisk_log_size":4939,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":156632,"kb_used_data":2808,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377330728,"statfs":{"total":386547056640,"available":386386665472,"internally_reserved":0,"allocated":2875392,"data_stored":1715930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":157476630},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2342,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004173"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:10.037544+0000","last_change":"2024-04-24T02:12:02.755215+0000","last_active":"2024-04-24T02:14:10.037544+0000","last_peered":"2024-04-24T02:14:10.037544+0000","last_clean":"2024-04-24T02:14:10.037544+0000","last_became_active":"2024-04-24T02:12:02.754954+0000","last_became_peered":"2024-04-24T02:12:02.754954+0000","last_unstale":"2024-04-24T02:14:10.037544+0000","last_undegraded":"2024-04-24T02:14:10.037544+0000","last_fullsized":"2024-04-24T02:14:10.037544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.472308+0000","last_change":"2024-04-24T02:12:04.754671+0000","last_active":"2024-04-24T02:15:13.472308+0000","last_peered":"2024-04-24T02:15:13.472308+0000","last_clean":"2024-04-24T02:15:13.472308+0000","last_became_active":"2024-04-24T02:12:04.754049+0000","last_became_peered":"2024-04-24T02:12:04.754049+0000","last_unstale":"2024-04-24T02:15:13.472308+0000","last_undegraded":"2024-04-24T02:15:13.472308+0000","last_fullsized":"2024-04-24T02:15:13.472308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:08.033273+0000","last_change":"2024-04-24T02:12:02.746058+0000","last_active":"2024-04-24T02:14:08.033273+0000","last_peered":"2024-04-24T02:14:08.033273+0000","last_clean":"2024-04-24T02:14:08.033273+0000","last_became_active":"2024-04-24T02:12:02.745526+0000","last_became_peered":"2024-04-24T02:12:02.745526+0000","last_unstale":"2024-04-24T02:14:08.033273+0000","last_undegraded":"2024-04-24T02:14:08.033273+0000","last_fullsized":"2024-04-24T02:14:08.033273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'12","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.472571+0000","last_change":"2024-04-24T02:12:04.763554+0000","last_active":"2024-04-24T02:15:13.472571+0000","last_peered":"2024-04-24T02:15:13.472571+0000","last_clean":"2024-04-24T02:15:13.472571+0000","last_became_active":"2024-04-24T02:12:04.762967+0000","last_became_peered":"2024-04-24T02:12:04.762967+0000","last_unstale":"2024-04-24T02:15:13.472571+0000","last_undegraded":"2024-04-24T02:15:13.472571+0000","last_fullsized":"2024-04-24T02:15:13.472571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":62,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:10.038334+0000","last_change":"2024-04-24T02:12:02.761596+0000","last_active":"2024-04-24T02:14:10.038334+0000","last_peered":"2024-04-24T02:14:10.038334+0000","last_clean":"2024-04-24T02:14:10.038334+0000","last_became_active":"2024-04-24T02:12:02.758985+0000","last_became_peered":"2024-04-24T02:12:02.758985+0000","last_unstale":"2024-04-24T02:14:10.038334+0000","last_undegraded":"2024-04-24T02:14:10.038334+0000","last_fullsized":"2024-04-24T02:14:10.038334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'6","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:35.042248+0000","last_change":"2024-04-24T02:12:04.765577+0000","last_active":"2024-04-24T02:14:35.042248+0000","last_peered":"2024-04-24T02:14:35.042248+0000","last_clean":"2024-04-24T02:14:35.042248+0000","last_became_active":"2024-04-24T02:12:04.765327+0000","last_became_peered":"2024-04-24T02:12:04.765327+0000","last_unstale":"2024-04-24T02:14:35.042248+0000","last_undegraded":"2024-04-24T02:14:35.042248+0000","last_fullsized":"2024-04-24T02:14:35.042248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:05.036788+0000","last_change":"2024-04-24T02:12:02.745643+0000","last_active":"2024-04-24T02:14:05.036788+0000","last_peered":"2024-04-24T02:14:05.036788+0000","last_clean":"2024-04-24T02:14:05.036788+0000","last_became_active":"2024-04-24T02:12:02.744804+0000","last_became_peered":"2024-04-24T02:12:02.744804+0000","last_unstale":"2024-04-24T02:14:05.036788+0000","last_undegraded":"2024-04-24T02:14:05.036788+0000","last_fullsized":"2024-04-24T02:14:05.036788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'6","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.176528+0000","last_change":"2024-04-24T02:12:04.763357+0000","last_active":"2024-04-24T02:15:13.176528+0000","last_peered":"2024-04-24T02:15:13.176528+0000","last_clean":"2024-04-24T02:15:13.176528+0000","last_became_active":"2024-04-24T02:12:04.763076+0000","last_became_peered":"2024-04-24T02:12:04.763076+0000","last_unstale":"2024-04-24T02:15:13.176528+0000","last_undegraded":"2024-04-24T02:15:13.176528+0000","last_fullsized":"2024-04-24T02:15:13.176528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:35.042327+0000","last_change":"2024-04-24T02:12:02.755265+0000","last_active":"2024-04-24T02:14:35.042327+0000","last_peered":"2024-04-24T02:14:35.042327+0000","last_clean":"2024-04-24T02:14:35.042327+0000","last_became_active":"2024-04-24T02:12:02.754208+0000","last_became_peered":"2024-04-24T02:12:02.754208+0000","last_unstale":"2024-04-24T02:14:35.042327+0000","last_undegraded":"2024-04-24T02:14:35.042327+0000","last_fullsized":"2024-04-24T02:14:35.042327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:09.639901+0000","last_change":"2024-04-24T02:12:04.755521+0000","last_active":"2024-04-24T02:14:09.639901+0000","last_peered":"2024-04-24T02:14:09.639901+0000","last_clean":"2024-04-24T02:14:09.639901+0000","last_became_active":"2024-04-24T02:12:04.755248+0000","last_became_peered":"2024-04-24T02:12:04.755248+0000","last_unstale":"2024-04-24T02:14:09.639901+0000","last_undegraded":"2024-04-24T02:14:09.639901+0000","last_fullsized":"2024-04-24T02:14:09.639901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:35.041448+0000","last_change":"2024-04-24T02:12:02.741732+0000","last_active":"2024-04-24T02:14:35.041448+0000","last_peered":"2024-04-24T02:14:35.041448+0000","last_clean":"2024-04-24T02:14:35.041448+0000","last_became_active":"2024-04-24T02:12:02.741326+0000","last_became_peered":"2024-04-24T02:12:02.741326+0000","last_unstale":"2024-04-24T02:14:35.041448+0000","last_undegraded":"2024-04-24T02:14:35.041448+0000","last_fullsized":"2024-04-24T02:14:35.041448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'4","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:10.038288+0000","last_change":"2024-04-24T02:12:04.763252+0000","last_active":"2024-04-24T02:14:10.038288+0000","last_peered":"2024-04-24T02:14:10.038288+0000","last_clean":"2024-04-24T02:14:10.038288+0000","last_became_active":"2024-04-24T02:12:04.762921+0000","last_became_peered":"2024-04-24T02:12:04.762921+0000","last_unstale":"2024-04-24T02:14:10.038288+0000","last_undegraded":"2024-04-24T02:14:10.038288+0000","last_fullsized":"2024-04-24T02:14:10.038288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:35.042178+0000","last_change":"2024-04-24T02:12:02.755513+0000","last_active":"2024-04-24T02:14:35.042178+0000","last_peered":"2024-04-24T02:14:35.042178+0000","last_clean":"2024-04-24T02:14:35.042178+0000","last_became_active":"2024-04-24T02:12:02.752921+0000","last_became_peered":"2024-04-24T02:12:02.752921+0000","last_unstale":"2024-04-24T02:14:35.042178+0000","last_undegraded":"2024-04-24T02:14:35.042178+0000","last_fullsized":"2024-04-24T02:14:35.042178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'12","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.400602+0000","last_change":"2024-04-24T02:12:04.752549+0000","last_active":"2024-04-24T02:15:13.400602+0000","last_peered":"2024-04-24T02:15:13.400602+0000","last_clean":"2024-04-24T02:15:13.400602+0000","last_became_active":"2024-04-24T02:12:04.751655+0000","last_became_peered":"2024-04-24T02:12:04.751655+0000","last_unstale":"2024-04-24T02:15:13.400602+0000","last_undegraded":"2024-04-24T02:15:13.400602+0000","last_fullsized":"2024-04-24T02:15:13.400602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"30'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:33.036734+0000","last_change":"2024-04-24T02:12:02.752760+0000","last_active":"2024-04-24T02:14:33.036734+0000","last_peered":"2024-04-24T02:14:33.036734+0000","last_clean":"2024-04-24T02:14:33.036734+0000","last_became_active":"2024-04-24T02:12:02.752476+0000","last_became_peered":"2024-04-24T02:12:02.752476+0000","last_unstale":"2024-04-24T02:14:33.036734+0000","last_undegraded":"2024-04-24T02:14:33.036734+0000","last_fullsized":"2024-04-24T02:14:33.036734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'18","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:10.037528+0000","last_change":"2024-04-24T02:12:04.766969+0000","last_active":"2024-04-24T02:14:10.037528+0000","last_peered":"2024-04-24T02:14:10.037528+0000","last_clean":"2024-04-24T02:14:10.037528+0000","last_became_active":"2024-04-24T02:12:04.766693+0000","last_became_peered":"2024-04-24T02:12:04.766693+0000","last_unstale":"2024-04-24T02:14:10.037528+0000","last_undegraded":"2024-04-24T02:14:10.037528+0000","last_fullsized":"2024-04-24T02:14:10.037528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"30'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:25.040515+0000","last_change":"2024-04-24T02:12:04.764729+0000","last_active":"2024-04-24T02:14:25.040515+0000","last_peered":"2024-04-24T02:14:25.040515+0000","last_clean":"2024-04-24T02:14:25.040515+0000","last_became_active":"2024-04-24T02:12:04.764470+0000","last_became_peered":"2024-04-24T02:12:04.764470+0000","last_unstale":"2024-04-24T02:14:25.040515+0000","last_undegraded":"2024-04-24T02:14:25.040515+0000","last_fullsized":"2024-04-24T02:14:25.040515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:30.040891+0000","last_change":"2024-04-24T02:12:02.754017+0000","last_active":"2024-04-24T02:14:30.040891+0000","last_peered":"2024-04-24T02:14:30.040891+0000","last_clean":"2024-04-24T02:14:30.040891+0000","last_became_active":"2024-04-24T02:12:02.753791+0000","last_became_peered":"2024-04-24T02:12:02.753791+0000","last_unstale":"2024-04-24T02:14:30.040891+0000","last_undegraded":"2024-04-24T02:14:30.040891+0000","last_fullsized":"2024-04-24T02:14:30.040891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'10","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.356817+0000","last_change":"2024-04-24T02:12:04.751048+0000","last_active":"2024-04-24T02:15:13.356817+0000","last_peered":"2024-04-24T02:15:13.356817+0000","last_clean":"2024-04-24T02:15:13.356817+0000","last_became_active":"2024-04-24T02:12:04.750774+0000","last_became_peered":"2024-04-24T02:12:04.750774+0000","last_unstale":"2024-04-24T02:15:13.356817+0000","last_undegraded":"2024-04-24T02:15:13.356817+0000","last_fullsized":"2024-04-24T02:15:13.356817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:30.040717+0000","last_change":"2024-04-24T02:12:02.755711+0000","last_active":"2024-04-24T02:14:30.040717+0000","last_peered":"2024-04-24T02:14:30.040717+0000","last_clean":"2024-04-24T02:14:30.040717+0000","last_became_active":"2024-04-24T02:12:02.754860+0000","last_became_peered":"2024-04-24T02:12:02.754860+0000","last_unstale":"2024-04-24T02:14:30.040717+0000","last_undegraded":"2024-04-24T02:14:30.040717+0000","last_fullsized":"2024-04-24T02:14:30.040717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'8","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:25.039920+0000","last_change":"2024-04-24T02:12:04.751178+0000","last_active":"2024-04-24T02:14:25.039920+0000","last_peered":"2024-04-24T02:14:25.039920+0000","last_clean":"2024-04-24T02:14:25.039920+0000","last_became_active":"2024-04-24T02:12:04.750919+0000","last_became_peered":"2024-04-24T02:12:04.750919+0000","last_unstale":"2024-04-24T02:14:25.039920+0000","last_undegraded":"2024-04-24T02:14:25.039920+0000","last_fullsized":"2024-04-24T02:14:25.039920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:20.098045+0000","last_change":"2024-04-24T02:12:02.756671+0000","last_active":"2024-04-24T02:15:20.098045+0000","last_peered":"2024-04-24T02:15:20.098045+0000","last_clean":"2024-04-24T02:15:20.098045+0000","last_became_active":"2024-04-24T02:12:02.756389+0000","last_became_peered":"2024-04-24T02:12:02.756389+0000","last_unstale":"2024-04-24T02:15:20.098045+0000","last_undegraded":"2024-04-24T02:15:20.098045+0000","last_fullsized":"2024-04-24T02:15:20.098045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'1","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.523285+0000","last_change":"2024-04-24T02:12:04.767195+0000","last_active":"2024-04-24T02:15:13.523285+0000","last_peered":"2024-04-24T02:15:13.523285+0000","last_clean":"2024-04-24T02:15:13.523285+0000","last_became_active":"2024-04-24T02:12:04.766739+0000","last_became_peered":"2024-04-24T02:12:04.766739+0000","last_unstale":"2024-04-24T02:15:13.523285+0000","last_undegraded":"2024-04-24T02:15:13.523285+0000","last_fullsized":"2024-04-24T02:15:13.523285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:30.040817+0000","last_change":"2024-04-24T02:12:02.745281+0000","last_active":"2024-04-24T02:14:30.040817+0000","last_peered":"2024-04-24T02:14:30.040817+0000","last_clean":"2024-04-24T02:14:30.040817+0000","last_became_active":"2024-04-24T02:12:02.744763+0000","last_became_peered":"2024-04-24T02:12:02.744763+0000","last_unstale":"2024-04-24T02:14:30.040817+0000","last_undegraded":"2024-04-24T02:14:30.040817+0000","last_fullsized":"2024-04-24T02:14:30.040817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'10","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.403373+0000","last_change":"2024-04-24T02:12:04.764907+0000","last_active":"2024-04-24T02:15:13.403373+0000","last_peered":"2024-04-24T02:15:13.403373+0000","last_clean":"2024-04-24T02:15:13.403373+0000","last_became_active":"2024-04-24T02:12:04.764659+0000","last_became_peered":"2024-04-24T02:12:04.764659+0000","last_unstale":"2024-04-24T02:15:13.403373+0000","last_undegraded":"2024-04-24T02:15:13.403373+0000","last_fullsized":"2024-04-24T02:15:13.403373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:28.035991+0000","last_change":"2024-04-24T02:12:02.742249+0000","last_active":"2024-04-24T02:14:28.035991+0000","last_peered":"2024-04-24T02:14:28.035991+0000","last_clean":"2024-04-24T02:14:28.035991+0000","last_became_active":"2024-04-24T02:12:02.741976+0000","last_became_peered":"2024-04-24T02:12:02.741976+0000","last_unstale":"2024-04-24T02:14:28.035991+0000","last_undegraded":"2024-04-24T02:14:28.035991+0000","last_fullsized":"2024-04-24T02:14:28.035991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'10","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:30.040841+0000","last_change":"2024-04-24T02:12:04.755425+0000","last_active":"2024-04-24T02:14:30.040841+0000","last_peered":"2024-04-24T02:14:30.040841+0000","last_clean":"2024-04-24T02:14:30.040841+0000","last_became_active":"2024-04-24T02:12:04.755133+0000","last_became_peered":"2024-04-24T02:12:04.755133+0000","last_unstale":"2024-04-24T02:14:30.040841+0000","last_undegraded":"2024-04-24T02:14:30.040841+0000","last_fullsized":"2024-04-24T02:14:30.040841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:25.040567+0000","last_change":"2024-04-24T02:12:02.758478+0000","last_active":"2024-04-24T02:14:25.040567+0000","last_peered":"2024-04-24T02:14:25.040567+0000","last_clean":"2024-04-24T02:14:25.040567+0000","last_became_active":"2024-04-24T02:12:02.753196+0000","last_became_peered":"2024-04-24T02:12:02.753196+0000","last_unstale":"2024-04-24T02:14:25.040567+0000","last_undegraded":"2024-04-24T02:14:25.040567+0000","last_fullsized":"2024-04-24T02:14:25.040567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'35","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.484556+0000","last_change":"2024-04-24T02:12:12.798478+0000","last_active":"2024-04-24T02:15:13.484556+0000","last_peered":"2024-04-24T02:15:13.484556+0000","last_clean":"2024-04-24T02:15:13.484556+0000","last_became_active":"2024-04-24T02:12:12.798179+0000","last_became_peered":"2024-04-24T02:12:12.798179+0000","last_unstale":"2024-04-24T02:15:13.484556+0000","last_undegraded":"2024-04-24T02:15:13.484556+0000","last_fullsized":"2024-04-24T02:15:13.484556+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'5","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.522894+0000","last_change":"2024-04-24T02:12:04.764143+0000","last_active":"2024-04-24T02:15:13.522894+0000","last_peered":"2024-04-24T02:15:13.522894+0000","last_clean":"2024-04-24T02:15:13.522894+0000","last_became_active":"2024-04-24T02:12:04.763725+0000","last_became_peered":"2024-04-24T02:12:04.763725+0000","last_unstale":"2024-04-24T02:15:13.522894+0000","last_undegraded":"2024-04-24T02:15:13.522894+0000","last_fullsized":"2024-04-24T02:15:13.522894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:25.040598+0000","last_change":"2024-04-24T02:12:02.756910+0000","last_active":"2024-04-24T02:14:25.040598+0000","last_peered":"2024-04-24T02:14:25.040598+0000","last_clean":"2024-04-24T02:14:25.040598+0000","last_became_active":"2024-04-24T02:12:02.755520+0000","last_became_peered":"2024-04-24T02:12:02.755520+0000","last_unstale":"2024-04-24T02:14:25.040598+0000","last_undegraded":"2024-04-24T02:14:25.040598+0000","last_fullsized":"2024-04-24T02:14:25.040598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:28.347085+0000","last_change":"2024-04-24T02:15:28.347111+0000","last_active":"2024-04-24T02:15:28.347085+0000","last_peered":"2024-04-24T02:15:28.347085+0000","last_clean":"2024-04-24T02:15:28.347085+0000","last_became_active":"2024-04-24T02:12:06.758033+0000","last_became_peered":"2024-04-24T02:12:06.758033+0000","last_unstale":"2024-04-24T02:15:28.347085+0000","last_undegraded":"2024-04-24T02:15:28.347085+0000","last_fullsized":"2024-04-24T02:15:28.347085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:28.346988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:28.346988+0000","last_clean_scrub_stamp":"2024-04-24T02:15:28.346988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:48:41.497279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'46","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:20.090485+0000","last_change":"2024-04-24T02:12:08.783964+0000","last_active":"2024-04-24T02:15:20.090485+0000","last_peered":"2024-04-24T02:15:20.090485+0000","last_clean":"2024-04-24T02:15:20.090485+0000","last_became_active":"2024-04-24T02:12:08.783666+0000","last_became_peered":"2024-04-24T02:12:08.783666+0000","last_unstale":"2024-04-24T02:15:20.090485+0000","last_undegraded":"2024-04-24T02:15:20.090485+0000","last_fullsized":"2024-04-24T02:15:20.090485+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:38.404790+0000","last_change":"2024-04-24T02:15:38.404846+0000","last_active":"2024-04-24T02:15:38.404790+0000","last_peered":"2024-04-24T02:15:38.404790+0000","last_clean":"2024-04-24T02:15:38.404790+0000","last_became_active":"2024-04-24T02:12:10.786981+0000","last_became_peered":"2024-04-24T02:12:10.786981+0000","last_unstale":"2024-04-24T02:15:38.404790+0000","last_undegraded":"2024-04-24T02:15:38.404790+0000","last_fullsized":"2024-04-24T02:15:38.404790+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:38.404652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:38.404652+0000","last_clean_scrub_stamp":"2024-04-24T02:15:38.404652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:17:51.653509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:40.042466+0000","last_change":"2024-04-24T02:12:12.797648+0000","last_active":"2024-04-24T02:14:40.042466+0000","last_peered":"2024-04-24T02:14:40.042466+0000","last_clean":"2024-04-24T02:14:40.042466+0000","last_became_active":"2024-04-24T02:12:12.796319+0000","last_became_peered":"2024-04-24T02:12:12.796319+0000","last_unstale":"2024-04-24T02:14:40.042466+0000","last_undegraded":"2024-04-24T02:14:40.042466+0000","last_fullsized":"2024-04-24T02:14:40.042466+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:30.041519+0000","last_change":"2024-04-24T02:12:04.764679+0000","last_active":"2024-04-24T02:14:30.041519+0000","last_peered":"2024-04-24T02:14:30.041519+0000","last_clean":"2024-04-24T02:14:30.041519+0000","last_became_active":"2024-04-24T02:12:04.764351+0000","last_became_peered":"2024-04-24T02:12:04.764351+0000","last_unstale":"2024-04-24T02:14:30.041519+0000","last_undegraded":"2024-04-24T02:14:30.041519+0000","last_fullsized":"2024-04-24T02:14:30.041519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:25.039715+0000","last_change":"2024-04-24T02:12:02.748273+0000","last_active":"2024-04-24T02:14:25.039715+0000","last_peered":"2024-04-24T02:14:25.039715+0000","last_clean":"2024-04-24T02:14:25.039715+0000","last_became_active":"2024-04-24T02:12:02.744030+0000","last_became_peered":"2024-04-24T02:12:02.744030+0000","last_unstale":"2024-04-24T02:14:25.039715+0000","last_undegraded":"2024-04-24T02:14:25.039715+0000","last_fullsized":"2024-04-24T02:14:25.039715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:28.036008+0000","last_change":"2024-04-24T02:12:06.758854+0000","last_active":"2024-04-24T02:14:28.036008+0000","last_peered":"2024-04-24T02:14:28.036008+0000","last_clean":"2024-04-24T02:14:28.036008+0000","last_became_active":"2024-04-24T02:12:06.758561+0000","last_became_peered":"2024-04-24T02:12:06.758561+0000","last_unstale":"2024-04-24T02:14:28.036008+0000","last_undegraded":"2024-04-24T02:14:28.036008+0000","last_fullsized":"2024-04-24T02:14:28.036008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'16","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:32.376409+0000","last_change":"2024-04-24T02:15:32.376443+0000","last_active":"2024-04-24T02:15:32.376409+0000","last_peered":"2024-04-24T02:15:32.376409+0000","last_clean":"2024-04-24T02:15:32.376409+0000","last_became_active":"2024-04-24T02:12:08.767493+0000","last_became_peered":"2024-04-24T02:12:08.767493+0000","last_unstale":"2024-04-24T02:15:32.376409+0000","last_undegraded":"2024-04-24T02:15:32.376409+0000","last_fullsized":"2024-04-24T02:15:32.376409+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-04-24T02:15:32.376317+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-04-24T02:15:32.376317+0000","last_clean_scrub_stamp":"2024-04-24T02:15:32.376317+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:12:17.100634+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:26.334462+0000","last_change":"2024-04-24T02:15:26.334490+0000","last_active":"2024-04-24T02:15:26.334462+0000","last_peered":"2024-04-24T02:15:26.334462+0000","last_clean":"2024-04-24T02:15:26.334462+0000","last_became_active":"2024-04-24T02:12:10.779231+0000","last_became_peered":"2024-04-24T02:12:10.779231+0000","last_unstale":"2024-04-24T02:15:26.334462+0000","last_undegraded":"2024-04-24T02:15:26.334462+0000","last_fullsized":"2024-04-24T02:15:26.334462+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:26.334368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:26.334368+0000","last_clean_scrub_stamp":"2024-04-24T02:15:26.334368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:20:30.421649+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'8","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:43.038096+0000","last_change":"2024-04-24T02:12:12.791754+0000","last_active":"2024-04-24T02:14:43.038096+0000","last_peered":"2024-04-24T02:14:43.038096+0000","last_clean":"2024-04-24T02:14:43.038096+0000","last_became_active":"2024-04-24T02:12:12.791542+0000","last_became_peered":"2024-04-24T02:12:12.791542+0000","last_unstale":"2024-04-24T02:14:43.038096+0000","last_undegraded":"2024-04-24T02:14:43.038096+0000","last_fullsized":"2024-04-24T02:14:43.038096+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'8","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.355830+0000","last_change":"2024-04-24T02:12:04.764138+0000","last_active":"2024-04-24T02:15:13.355830+0000","last_peered":"2024-04-24T02:15:13.355830+0000","last_clean":"2024-04-24T02:15:13.355830+0000","last_became_active":"2024-04-24T02:12:04.763491+0000","last_became_peered":"2024-04-24T02:12:04.763491+0000","last_unstale":"2024-04-24T02:15:13.355830+0000","last_undegraded":"2024-04-24T02:15:13.355830+0000","last_fullsized":"2024-04-24T02:15:13.355830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:25.040536+0000","last_change":"2024-04-24T02:12:02.757002+0000","last_active":"2024-04-24T02:14:25.040536+0000","last_peered":"2024-04-24T02:14:25.040536+0000","last_clean":"2024-04-24T02:14:25.040536+0000","last_became_active":"2024-04-24T02:12:02.755636+0000","last_became_peered":"2024-04-24T02:12:02.755636+0000","last_unstale":"2024-04-24T02:14:25.040536+0000","last_undegraded":"2024-04-24T02:14:25.040536+0000","last_fullsized":"2024-04-24T02:14:25.040536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:10.046752+0000","last_change":"2024-04-24T02:12:45.813418+0000","last_active":"2024-04-24T02:15:10.046752+0000","last_peered":"2024-04-24T02:15:10.046752+0000","last_clean":"2024-04-24T02:15:10.046752+0000","last_became_active":"2024-04-24T02:12:45.813038+0000","last_became_peered":"2024-04-24T02:12:45.813038+0000","last_unstale":"2024-04-24T02:15:10.046752+0000","last_undegraded":"2024-04-24T02:15:10.046752+0000","last_fullsized":"2024-04-24T02:15:10.046752+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"32'29","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:31.495647+0000","last_change":"2024-04-24T02:15:31.495714+0000","last_active":"2024-04-24T02:15:31.495647+0000","last_peered":"2024-04-24T02:15:31.495647+0000","last_clean":"2024-04-24T02:15:31.495647+0000","last_became_active":"2024-04-24T02:12:08.783077+0000","last_became_peered":"2024-04-24T02:12:08.783077+0000","last_unstale":"2024-04-24T02:15:31.495647+0000","last_undegraded":"2024-04-24T02:15:31.495647+0000","last_fullsized":"2024-04-24T02:15:31.495647+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'29","last_scrub_stamp":"2024-04-24T02:15:31.495549+0000","last_deep_scrub":"32'29","last_deep_scrub_stamp":"2024-04-24T02:15:31.495549+0000","last_clean_scrub_stamp":"2024-04-24T02:15:31.495549+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:13:45.684753+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'285","reported_seq":408,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:20.159531+0000","last_change":"2024-04-24T02:12:10.784037+0000","last_active":"2024-04-24T02:15:20.159531+0000","last_peered":"2024-04-24T02:15:20.159531+0000","last_clean":"2024-04-24T02:15:20.159531+0000","last_became_active":"2024-04-24T02:12:10.783726+0000","last_became_peered":"2024-04-24T02:12:10.783726+0000","last_unstale":"2024-04-24T02:15:20.159531+0000","last_undegraded":"2024-04-24T02:15:20.159531+0000","last_fullsized":"2024-04-24T02:15:20.159531+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:45.043101+0000","last_change":"2024-04-24T02:12:12.801707+0000","last_active":"2024-04-24T02:14:45.043101+0000","last_peered":"2024-04-24T02:14:45.043101+0000","last_clean":"2024-04-24T02:14:45.043101+0000","last_became_active":"2024-04-24T02:12:12.801331+0000","last_became_peered":"2024-04-24T02:12:12.801331+0000","last_unstale":"2024-04-24T02:14:45.043101+0000","last_undegraded":"2024-04-24T02:14:45.043101+0000","last_fullsized":"2024-04-24T02:14:45.043101+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'17","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.523265+0000","last_change":"2024-04-24T02:12:04.756301+0000","last_active":"2024-04-24T02:15:13.523265+0000","last_peered":"2024-04-24T02:15:13.523265+0000","last_clean":"2024-04-24T02:15:13.523265+0000","last_became_active":"2024-04-24T02:12:04.756039+0000","last_became_peered":"2024-04-24T02:12:04.756039+0000","last_unstale":"2024-04-24T02:15:13.523265+0000","last_undegraded":"2024-04-24T02:15:13.523265+0000","last_fullsized":"2024-04-24T02:15:13.523265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":60,"num_read_kb":52,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:25.039817+0000","last_change":"2024-04-24T02:12:02.755651+0000","last_active":"2024-04-24T02:14:25.039817+0000","last_peered":"2024-04-24T02:14:25.039817+0000","last_clean":"2024-04-24T02:14:25.039817+0000","last_became_active":"2024-04-24T02:12:02.754852+0000","last_became_peered":"2024-04-24T02:12:02.754852+0000","last_unstale":"2024-04-24T02:14:25.039817+0000","last_undegraded":"2024-04-24T02:14:25.039817+0000","last_fullsized":"2024-04-24T02:14:25.039817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:26.356334+0000","last_change":"2024-04-24T02:15:26.356380+0000","last_active":"2024-04-24T02:15:26.356334+0000","last_peered":"2024-04-24T02:15:26.356334+0000","last_clean":"2024-04-24T02:15:26.356334+0000","last_became_active":"2024-04-24T02:12:06.757883+0000","last_became_peered":"2024-04-24T02:12:06.757883+0000","last_unstale":"2024-04-24T02:15:26.356334+0000","last_undegraded":"2024-04-24T02:15:26.356334+0000","last_fullsized":"2024-04-24T02:15:26.356334+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:26.356206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:26.356206+0000","last_clean_scrub_stamp":"2024-04-24T02:15:26.356206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:34:03.818953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'44","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:33.483208+0000","last_change":"2024-04-24T02:15:33.483248+0000","last_active":"2024-04-24T02:15:33.483208+0000","last_peered":"2024-04-24T02:15:33.483208+0000","last_clean":"2024-04-24T02:15:33.483208+0000","last_became_active":"2024-04-24T02:12:08.780950+0000","last_became_peered":"2024-04-24T02:12:08.780950+0000","last_unstale":"2024-04-24T02:15:33.483208+0000","last_undegraded":"2024-04-24T02:15:33.483208+0000","last_fullsized":"2024-04-24T02:15:33.483208+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'44","last_scrub_stamp":"2024-04-24T02:15:33.483112+0000","last_deep_scrub":"32'44","last_deep_scrub_stamp":"2024-04-24T02:15:33.483112+0000","last_clean_scrub_stamp":"2024-04-24T02:15:33.483112+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:41:28.737400+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'285","reported_seq":447,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:28.021707+0000","last_change":"2024-04-24T02:15:28.021732+0000","last_active":"2024-04-24T02:15:28.021707+0000","last_peered":"2024-04-24T02:15:28.021707+0000","last_clean":"2024-04-24T02:15:28.021707+0000","last_became_active":"2024-04-24T02:12:10.778254+0000","last_became_peered":"2024-04-24T02:12:10.778254+0000","last_unstale":"2024-04-24T02:15:28.021707+0000","last_undegraded":"2024-04-24T02:15:28.021707+0000","last_fullsized":"2024-04-24T02:15:28.021707+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-24T02:15:28.021612+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-24T02:15:28.021612+0000","last_clean_scrub_stamp":"2024-04-24T02:15:28.021612+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:14:08.932379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.356698+0000","last_change":"2024-04-24T02:12:04.768436+0000","last_active":"2024-04-24T02:15:13.356698+0000","last_peered":"2024-04-24T02:15:13.356698+0000","last_clean":"2024-04-24T02:15:13.356698+0000","last_became_active":"2024-04-24T02:12:04.767906+0000","last_became_peered":"2024-04-24T02:12:04.767906+0000","last_unstale":"2024-04-24T02:15:13.356698+0000","last_undegraded":"2024-04-24T02:15:13.356698+0000","last_fullsized":"2024-04-24T02:15:13.356698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"32'3","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:20.039123+0000","last_change":"2024-04-24T02:12:02.749142+0000","last_active":"2024-04-24T02:14:20.039123+0000","last_peered":"2024-04-24T02:14:20.039123+0000","last_clean":"2024-04-24T02:14:20.039123+0000","last_became_active":"2024-04-24T02:12:02.748372+0000","last_became_peered":"2024-04-24T02:12:02.748372+0000","last_unstale":"2024-04-24T02:14:20.039123+0000","last_undegraded":"2024-04-24T02:14:20.039123+0000","last_fullsized":"2024-04-24T02:14:20.039123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:36.460142+0000","last_change":"2024-04-24T02:15:36.460166+0000","last_active":"2024-04-24T02:15:36.460142+0000","last_peered":"2024-04-24T02:15:36.460142+0000","last_clean":"2024-04-24T02:15:36.460142+0000","last_became_active":"2024-04-24T02:12:06.764324+0000","last_became_peered":"2024-04-24T02:12:06.764324+0000","last_unstale":"2024-04-24T02:15:36.460142+0000","last_undegraded":"2024-04-24T02:15:36.460142+0000","last_fullsized":"2024-04-24T02:15:36.460142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:36.460053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:36.460053+0000","last_clean_scrub_stamp":"2024-04-24T02:15:36.460053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:36:31.597092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'58","reported_seq":124,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:36.435099+0000","last_change":"2024-04-24T02:15:36.435151+0000","last_active":"2024-04-24T02:15:36.435099+0000","last_peered":"2024-04-24T02:15:36.435099+0000","last_clean":"2024-04-24T02:15:36.435099+0000","last_became_active":"2024-04-24T02:12:08.771060+0000","last_became_peered":"2024-04-24T02:12:08.771060+0000","last_unstale":"2024-04-24T02:15:36.435099+0000","last_undegraded":"2024-04-24T02:15:36.435099+0000","last_fullsized":"2024-04-24T02:15:36.435099+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'58","last_scrub_stamp":"2024-04-24T02:15:36.435008+0000","last_deep_scrub":"32'58","last_deep_scrub_stamp":"2024-04-24T02:15:36.435008+0000","last_clean_scrub_stamp":"2024-04-24T02:15:36.435008+0000","objects_scrubbed":10,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:51:55.089317+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:29.043595+0000","last_change":"2024-04-24T02:15:29.043636+0000","last_active":"2024-04-24T02:15:29.043595+0000","last_peered":"2024-04-24T02:15:29.043595+0000","last_clean":"2024-04-24T02:15:29.043595+0000","last_became_active":"2024-04-24T02:12:10.776715+0000","last_became_peered":"2024-04-24T02:12:10.776715+0000","last_unstale":"2024-04-24T02:15:29.043595+0000","last_undegraded":"2024-04-24T02:15:29.043595+0000","last_fullsized":"2024-04-24T02:15:29.043595+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:29.043460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:29.043460+0000","last_clean_scrub_stamp":"2024-04-24T02:15:29.043460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:29:47.538838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'5","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:20.039021+0000","last_change":"2024-04-24T02:12:12.797751+0000","last_active":"2024-04-24T02:14:20.039021+0000","last_peered":"2024-04-24T02:14:20.039021+0000","last_clean":"2024-04-24T02:14:20.039021+0000","last_became_active":"2024-04-24T02:12:12.797405+0000","last_became_peered":"2024-04-24T02:12:12.797405+0000","last_unstale":"2024-04-24T02:14:20.039021+0000","last_undegraded":"2024-04-24T02:14:20.039021+0000","last_fullsized":"2024-04-24T02:14:20.039021+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'10","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.472159+0000","last_change":"2024-04-24T02:12:04.754076+0000","last_active":"2024-04-24T02:15:13.472159+0000","last_peered":"2024-04-24T02:15:13.472159+0000","last_clean":"2024-04-24T02:15:13.472159+0000","last_became_active":"2024-04-24T02:12:04.753819+0000","last_became_peered":"2024-04-24T02:12:04.753819+0000","last_unstale":"2024-04-24T02:15:13.472159+0000","last_undegraded":"2024-04-24T02:15:13.472159+0000","last_fullsized":"2024-04-24T02:15:13.472159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:20.039089+0000","last_change":"2024-04-24T02:12:02.743507+0000","last_active":"2024-04-24T02:14:20.039089+0000","last_peered":"2024-04-24T02:14:20.039089+0000","last_clean":"2024-04-24T02:14:20.039089+0000","last_became_active":"2024-04-24T02:12:02.743202+0000","last_became_peered":"2024-04-24T02:12:02.743202+0000","last_unstale":"2024-04-24T02:14:20.039089+0000","last_undegraded":"2024-04-24T02:14:20.039089+0000","last_fullsized":"2024-04-24T02:14:20.039089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:41.008569+0000","last_change":"2024-04-24T02:15:41.008594+0000","last_active":"2024-04-24T02:15:41.008569+0000","last_peered":"2024-04-24T02:15:41.008569+0000","last_clean":"2024-04-24T02:15:41.008569+0000","last_became_active":"2024-04-24T02:12:06.765690+0000","last_became_peered":"2024-04-24T02:12:06.765690+0000","last_unstale":"2024-04-24T02:15:41.008569+0000","last_undegraded":"2024-04-24T02:15:41.008569+0000","last_fullsized":"2024-04-24T02:15:41.008569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:41.008462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:41.008462+0000","last_clean_scrub_stamp":"2024-04-24T02:15:41.008462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:55:16.490485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'45","reported_seq":106,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:36.400148+0000","last_change":"2024-04-24T02:15:36.400192+0000","last_active":"2024-04-24T02:15:36.400148+0000","last_peered":"2024-04-24T02:15:36.400148+0000","last_clean":"2024-04-24T02:15:36.400148+0000","last_became_active":"2024-04-24T02:12:08.779594+0000","last_became_peered":"2024-04-24T02:12:08.779594+0000","last_unstale":"2024-04-24T02:15:36.400148+0000","last_undegraded":"2024-04-24T02:15:36.400148+0000","last_fullsized":"2024-04-24T02:15:36.400148+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'45","last_scrub_stamp":"2024-04-24T02:15:36.400062+0000","last_deep_scrub":"32'45","last_deep_scrub_stamp":"2024-04-24T02:15:36.400062+0000","last_clean_scrub_stamp":"2024-04-24T02:15:36.400062+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:41:55.736741+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:35.000212+0000","last_change":"2024-04-24T02:15:35.000257+0000","last_active":"2024-04-24T02:15:35.000212+0000","last_peered":"2024-04-24T02:15:35.000212+0000","last_clean":"2024-04-24T02:15:35.000212+0000","last_became_active":"2024-04-24T02:12:10.784901+0000","last_became_peered":"2024-04-24T02:12:10.784901+0000","last_unstale":"2024-04-24T02:15:35.000212+0000","last_undegraded":"2024-04-24T02:15:35.000212+0000","last_fullsized":"2024-04-24T02:15:35.000212+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:35.000105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:35.000105+0000","last_clean_scrub_stamp":"2024-04-24T02:15:35.000105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:13:03.366315+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'5","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.406148+0000","last_change":"2024-04-24T02:12:12.795959+0000","last_active":"2024-04-24T02:15:13.406148+0000","last_peered":"2024-04-24T02:15:13.406148+0000","last_clean":"2024-04-24T02:15:13.406148+0000","last_became_active":"2024-04-24T02:12:12.795364+0000","last_became_peered":"2024-04-24T02:12:12.795364+0000","last_unstale":"2024-04-24T02:15:13.406148+0000","last_undegraded":"2024-04-24T02:15:13.406148+0000","last_fullsized":"2024-04-24T02:15:13.406148+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.476501+0000","last_change":"2024-04-24T02:12:04.763127+0000","last_active":"2024-04-24T02:15:13.476501+0000","last_peered":"2024-04-24T02:15:13.476501+0000","last_clean":"2024-04-24T02:15:13.476501+0000","last_became_active":"2024-04-24T02:12:04.762869+0000","last_became_peered":"2024-04-24T02:12:04.762869+0000","last_unstale":"2024-04-24T02:15:13.476501+0000","last_undegraded":"2024-04-24T02:15:13.476501+0000","last_fullsized":"2024-04-24T02:15:13.476501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:20.039868+0000","last_change":"2024-04-24T02:12:02.758980+0000","last_active":"2024-04-24T02:14:20.039868+0000","last_peered":"2024-04-24T02:14:20.039868+0000","last_clean":"2024-04-24T02:14:20.039868+0000","last_became_active":"2024-04-24T02:12:02.757488+0000","last_became_peered":"2024-04-24T02:12:02.757488+0000","last_unstale":"2024-04-24T02:14:20.039868+0000","last_undegraded":"2024-04-24T02:14:20.039868+0000","last_fullsized":"2024-04-24T02:14:20.039868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:41.997895+0000","last_change":"2024-04-24T02:15:41.997919+0000","last_active":"2024-04-24T02:15:41.997895+0000","last_peered":"2024-04-24T02:15:41.997895+0000","last_clean":"2024-04-24T02:15:41.997895+0000","last_became_active":"2024-04-24T02:12:06.764339+0000","last_became_peered":"2024-04-24T02:12:06.764339+0000","last_unstale":"2024-04-24T02:15:41.997895+0000","last_undegraded":"2024-04-24T02:15:41.997895+0000","last_fullsized":"2024-04-24T02:15:41.997895+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:41.997807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:41.997807+0000","last_clean_scrub_stamp":"2024-04-24T02:15:41.997807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:41:46.258937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'51","reported_seq":113,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:20.116152+0000","last_change":"2024-04-24T02:12:08.781158+0000","last_active":"2024-04-24T02:15:20.116152+0000","last_peered":"2024-04-24T02:15:20.116152+0000","last_clean":"2024-04-24T02:15:20.116152+0000","last_became_active":"2024-04-24T02:12:08.780230+0000","last_became_peered":"2024-04-24T02:12:08.780230+0000","last_unstale":"2024-04-24T02:15:20.116152+0000","last_undegraded":"2024-04-24T02:15:20.116152+0000","last_fullsized":"2024-04-24T02:15:20.116152+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'285","reported_seq":409,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:31.050509+0000","last_change":"2024-04-24T02:15:31.050534+0000","last_active":"2024-04-24T02:15:31.050509+0000","last_peered":"2024-04-24T02:15:31.050509+0000","last_clean":"2024-04-24T02:15:31.050509+0000","last_became_active":"2024-04-24T02:12:10.784278+0000","last_became_peered":"2024-04-24T02:12:10.784278+0000","last_unstale":"2024-04-24T02:15:31.050509+0000","last_undegraded":"2024-04-24T02:15:31.050509+0000","last_fullsized":"2024-04-24T02:15:31.050509+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-24T02:15:31.050423+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-24T02:15:31.050423+0000","last_clean_scrub_stamp":"2024-04-24T02:15:31.050423+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:20:42.675691+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.353503+0000","last_change":"2024-04-24T02:12:12.792876+0000","last_active":"2024-04-24T02:15:13.353503+0000","last_peered":"2024-04-24T02:15:13.353503+0000","last_clean":"2024-04-24T02:15:13.353503+0000","last_became_active":"2024-04-24T02:12:12.792569+0000","last_became_peered":"2024-04-24T02:12:12.792569+0000","last_unstale":"2024-04-24T02:15:13.353503+0000","last_undegraded":"2024-04-24T02:15:13.353503+0000","last_fullsized":"2024-04-24T02:15:13.353503+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'26","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.472468+0000","last_change":"2024-04-24T02:12:04.752393+0000","last_active":"2024-04-24T02:15:13.472468+0000","last_peered":"2024-04-24T02:15:13.472468+0000","last_clean":"2024-04-24T02:15:13.472468+0000","last_became_active":"2024-04-24T02:12:04.752075+0000","last_became_peered":"2024-04-24T02:12:04.752075+0000","last_unstale":"2024-04-24T02:15:13.472468+0000","last_undegraded":"2024-04-24T02:15:13.472468+0000","last_fullsized":"2024-04-24T02:15:13.472468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":67,"num_write":30,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:20.039830+0000","last_change":"2024-04-24T02:12:02.755772+0000","last_active":"2024-04-24T02:14:20.039830+0000","last_peered":"2024-04-24T02:14:20.039830+0000","last_clean":"2024-04-24T02:14:20.039830+0000","last_became_active":"2024-04-24T02:12:02.755468+0000","last_became_peered":"2024-04-24T02:12:02.755468+0000","last_unstale":"2024-04-24T02:14:20.039830+0000","last_undegraded":"2024-04-24T02:14:20.039830+0000","last_fullsized":"2024-04-24T02:14:20.039830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:18.034584+0000","last_change":"2024-04-24T02:12:06.764717+0000","last_active":"2024-04-24T02:14:18.034584+0000","last_peered":"2024-04-24T02:14:18.034584+0000","last_clean":"2024-04-24T02:14:18.034584+0000","last_became_active":"2024-04-24T02:12:06.764365+0000","last_became_peered":"2024-04-24T02:12:06.764365+0000","last_unstale":"2024-04-24T02:14:18.034584+0000","last_undegraded":"2024-04-24T02:14:18.034584+0000","last_fullsized":"2024-04-24T02:14:18.034584+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'80","reported_seq":165,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:32.292008+0000","last_change":"2024-04-24T02:15:32.292044+0000","last_active":"2024-04-24T02:15:32.292008+0000","last_peered":"2024-04-24T02:15:32.292008+0000","last_clean":"2024-04-24T02:15:32.292008+0000","last_became_active":"2024-04-24T02:12:08.779602+0000","last_became_peered":"2024-04-24T02:12:08.779602+0000","last_unstale":"2024-04-24T02:15:32.292008+0000","last_undegraded":"2024-04-24T02:15:32.292008+0000","last_fullsized":"2024-04-24T02:15:32.292008+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'80","last_scrub_stamp":"2024-04-24T02:15:32.291896+0000","last_deep_scrub":"32'80","last_deep_scrub_stamp":"2024-04-24T02:15:32.291896+0000","last_clean_scrub_stamp":"2024-04-24T02:15:32.291896+0000","objects_scrubbed":7,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:08:35.878511+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:24.008603+0000","last_change":"2024-04-24T02:15:24.008622+0000","last_active":"2024-04-24T02:15:24.008603+0000","last_peered":"2024-04-24T02:15:24.008603+0000","last_clean":"2024-04-24T02:15:24.008603+0000","last_became_active":"2024-04-24T02:12:10.782121+0000","last_became_peered":"2024-04-24T02:12:10.782121+0000","last_unstale":"2024-04-24T02:15:24.008603+0000","last_undegraded":"2024-04-24T02:15:24.008603+0000","last_fullsized":"2024-04-24T02:15:24.008603+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:24.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:24.008533+0000","last_clean_scrub_stamp":"2024-04-24T02:15:24.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:46:49.817831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'21","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:43.025928+0000","last_change":"2024-04-24T02:15:43.025968+0000","last_active":"2024-04-24T02:15:43.025928+0000","last_peered":"2024-04-24T02:15:43.025928+0000","last_clean":"2024-04-24T02:15:43.025928+0000","last_became_active":"2024-04-24T02:12:12.789799+0000","last_became_peered":"2024-04-24T02:12:12.789799+0000","last_unstale":"2024-04-24T02:15:43.025928+0000","last_undegraded":"2024-04-24T02:15:43.025928+0000","last_fullsized":"2024-04-24T02:15:43.025928+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-04-24T02:15:43.025844+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-04-24T02:15:43.025844+0000","last_clean_scrub_stamp":"2024-04-24T02:15:43.025844+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:56:55.136630+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:20.039277+0000","last_change":"2024-04-24T02:12:04.766750+0000","last_active":"2024-04-24T02:14:20.039277+0000","last_peered":"2024-04-24T02:14:20.039277+0000","last_clean":"2024-04-24T02:14:20.039277+0000","last_became_active":"2024-04-24T02:12:04.766495+0000","last_became_peered":"2024-04-24T02:12:04.766495+0000","last_unstale":"2024-04-24T02:14:20.039277+0000","last_undegraded":"2024-04-24T02:14:20.039277+0000","last_fullsized":"2024-04-24T02:14:20.039277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:18.034606+0000","last_change":"2024-04-24T02:12:02.743527+0000","last_active":"2024-04-24T02:14:18.034606+0000","last_peered":"2024-04-24T02:14:18.034606+0000","last_clean":"2024-04-24T02:14:18.034606+0000","last_became_active":"2024-04-24T02:12:02.743204+0000","last_became_peered":"2024-04-24T02:12:02.743204+0000","last_unstale":"2024-04-24T02:14:18.034606+0000","last_undegraded":"2024-04-24T02:14:18.034606+0000","last_fullsized":"2024-04-24T02:14:18.034606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:25.039819+0000","last_change":"2024-04-24T02:12:06.765176+0000","last_active":"2024-04-24T02:14:25.039819+0000","last_peered":"2024-04-24T02:14:25.039819+0000","last_clean":"2024-04-24T02:14:25.039819+0000","last_became_active":"2024-04-24T02:12:06.764676+0000","last_became_peered":"2024-04-24T02:12:06.764676+0000","last_unstale":"2024-04-24T02:14:25.039819+0000","last_undegraded":"2024-04-24T02:14:25.039819+0000","last_fullsized":"2024-04-24T02:14:25.039819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'46","reported_seq":108,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:28.341944+0000","last_change":"2024-04-24T02:15:28.342006+0000","last_active":"2024-04-24T02:15:28.341944+0000","last_peered":"2024-04-24T02:15:28.341944+0000","last_clean":"2024-04-24T02:15:28.341944+0000","last_became_active":"2024-04-24T02:12:08.773355+0000","last_became_peered":"2024-04-24T02:12:08.773355+0000","last_unstale":"2024-04-24T02:15:28.341944+0000","last_undegraded":"2024-04-24T02:15:28.341944+0000","last_fullsized":"2024-04-24T02:15:28.341944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-04-24T02:15:28.341829+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-04-24T02:15:28.341829+0000","last_clean_scrub_stamp":"2024-04-24T02:15:28.341829+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:44:08.114105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:25.040710+0000","last_change":"2024-04-24T02:12:10.784747+0000","last_active":"2024-04-24T02:14:25.040710+0000","last_peered":"2024-04-24T02:14:25.040710+0000","last_clean":"2024-04-24T02:14:25.040710+0000","last_became_active":"2024-04-24T02:12:10.783334+0000","last_became_peered":"2024-04-24T02:12:10.783334+0000","last_unstale":"2024-04-24T02:14:25.040710+0000","last_undegraded":"2024-04-24T02:14:25.040710+0000","last_fullsized":"2024-04-24T02:14:25.040710+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.527692+0000","last_change":"2024-04-24T02:12:12.794851+0000","last_active":"2024-04-24T02:15:13.527692+0000","last_peered":"2024-04-24T02:15:13.527692+0000","last_clean":"2024-04-24T02:15:13.527692+0000","last_became_active":"2024-04-24T02:12:12.794106+0000","last_became_peered":"2024-04-24T02:12:12.794106+0000","last_unstale":"2024-04-24T02:15:13.527692+0000","last_undegraded":"2024-04-24T02:15:13.527692+0000","last_fullsized":"2024-04-24T02:15:13.527692+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:39.410527+0000","last_change":"2024-04-24T02:15:39.410553+0000","last_active":"2024-04-24T02:15:39.410527+0000","last_peered":"2024-04-24T02:15:39.410527+0000","last_clean":"2024-04-24T02:15:39.410527+0000","last_became_active":"2024-04-24T02:12:04.767376+0000","last_became_peered":"2024-04-24T02:12:04.767376+0000","last_unstale":"2024-04-24T02:15:39.410527+0000","last_undegraded":"2024-04-24T02:15:39.410527+0000","last_fullsized":"2024-04-24T02:15:39.410527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:39.410442+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:39.410442+0000","last_clean_scrub_stamp":"2024-04-24T02:15:39.410442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:46:10.073188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:15.039035+0000","last_change":"2024-04-24T02:12:02.761147+0000","last_active":"2024-04-24T02:14:15.039035+0000","last_peered":"2024-04-24T02:14:15.039035+0000","last_clean":"2024-04-24T02:14:15.039035+0000","last_became_active":"2024-04-24T02:12:02.760317+0000","last_became_peered":"2024-04-24T02:12:02.760317+0000","last_unstale":"2024-04-24T02:14:15.039035+0000","last_undegraded":"2024-04-24T02:14:15.039035+0000","last_fullsized":"2024-04-24T02:14:15.039035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:00.045324+0000","last_change":"2024-04-24T02:12:45.814348+0000","last_active":"2024-04-24T02:15:00.045324+0000","last_peered":"2024-04-24T02:15:00.045324+0000","last_clean":"2024-04-24T02:15:00.045324+0000","last_became_active":"2024-04-24T02:12:45.811272+0000","last_became_peered":"2024-04-24T02:12:45.811272+0000","last_unstale":"2024-04-24T02:15:00.045324+0000","last_undegraded":"2024-04-24T02:15:00.045324+0000","last_fullsized":"2024-04-24T02:15:00.045324+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"32'46","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:37.398289+0000","last_change":"2024-04-24T02:15:37.398336+0000","last_active":"2024-04-24T02:15:37.398289+0000","last_peered":"2024-04-24T02:15:37.398289+0000","last_clean":"2024-04-24T02:15:37.398289+0000","last_became_active":"2024-04-24T02:12:08.769307+0000","last_became_peered":"2024-04-24T02:12:08.769307+0000","last_unstale":"2024-04-24T02:15:37.398289+0000","last_undegraded":"2024-04-24T02:15:37.398289+0000","last_fullsized":"2024-04-24T02:15:37.398289+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-04-24T02:15:37.398209+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-04-24T02:15:37.398209+0000","last_clean_scrub_stamp":"2024-04-24T02:15:37.398209+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:44:17.170485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'285","reported_seq":415,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:29.489040+0000","last_change":"2024-04-24T02:15:29.489068+0000","last_active":"2024-04-24T02:15:29.489040+0000","last_peered":"2024-04-24T02:15:29.489040+0000","last_clean":"2024-04-24T02:15:29.489040+0000","last_became_active":"2024-04-24T02:12:10.778972+0000","last_became_peered":"2024-04-24T02:12:10.778972+0000","last_unstale":"2024-04-24T02:15:29.489040+0000","last_undegraded":"2024-04-24T02:15:29.489040+0000","last_fullsized":"2024-04-24T02:15:29.489040+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-24T02:15:29.488953+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-24T02:15:29.488953+0000","last_clean_scrub_stamp":"2024-04-24T02:15:29.488953+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:12:38.822890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'12","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.529612+0000","last_change":"2024-04-24T02:12:12.790568+0000","last_active":"2024-04-24T02:15:13.529612+0000","last_peered":"2024-04-24T02:15:13.529612+0000","last_clean":"2024-04-24T02:15:13.529612+0000","last_became_active":"2024-04-24T02:12:12.790353+0000","last_became_peered":"2024-04-24T02:12:12.790353+0000","last_unstale":"2024-04-24T02:15:13.529612+0000","last_undegraded":"2024-04-24T02:15:13.529612+0000","last_fullsized":"2024-04-24T02:15:13.529612+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'10","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.474042+0000","last_change":"2024-04-24T02:12:04.760283+0000","last_active":"2024-04-24T02:15:13.474042+0000","last_peered":"2024-04-24T02:15:13.474042+0000","last_clean":"2024-04-24T02:15:13.474042+0000","last_became_active":"2024-04-24T02:12:04.760020+0000","last_became_peered":"2024-04-24T02:12:04.760020+0000","last_unstale":"2024-04-24T02:15:13.474042+0000","last_undegraded":"2024-04-24T02:15:13.474042+0000","last_fullsized":"2024-04-24T02:15:13.474042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:20.098422+0000","last_change":"2024-04-24T02:12:02.756829+0000","last_active":"2024-04-24T02:15:20.098422+0000","last_peered":"2024-04-24T02:15:20.098422+0000","last_clean":"2024-04-24T02:15:20.098422+0000","last_became_active":"2024-04-24T02:12:02.753593+0000","last_became_peered":"2024-04-24T02:12:02.753593+0000","last_unstale":"2024-04-24T02:15:20.098422+0000","last_undegraded":"2024-04-24T02:15:20.098422+0000","last_fullsized":"2024-04-24T02:15:20.098422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'5","reported_seq":428,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:37.435381+0000","last_change":"2024-04-24T02:15:37.435417+0000","last_active":"2024-04-24T02:15:37.435381+0000","last_peered":"2024-04-24T02:15:37.435381+0000","last_clean":"2024-04-24T02:15:37.435381+0000","last_became_active":"2024-04-24T02:12:06.758759+0000","last_became_peered":"2024-04-24T02:12:06.758759+0000","last_unstale":"2024-04-24T02:15:37.435381+0000","last_undegraded":"2024-04-24T02:15:37.435381+0000","last_fullsized":"2024-04-24T02:15:37.435381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-04-24T02:15:37.435273+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-04-24T02:15:37.435273+0000","last_clean_scrub_stamp":"2024-04-24T02:15:37.435273+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:57:22.943957+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"30'11","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:25.040632+0000","last_change":"2024-04-24T02:12:08.783278+0000","last_active":"2024-04-24T02:14:25.040632+0000","last_peered":"2024-04-24T02:14:25.040632+0000","last_clean":"2024-04-24T02:14:25.040632+0000","last_became_active":"2024-04-24T02:12:08.783011+0000","last_became_peered":"2024-04-24T02:12:08.783011+0000","last_unstale":"2024-04-24T02:14:25.040632+0000","last_undegraded":"2024-04-24T02:14:25.040632+0000","last_fullsized":"2024-04-24T02:14:25.040632+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'285","reported_seq":471,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:23.427909+0000","last_change":"2024-04-24T02:15:23.427935+0000","last_active":"2024-04-24T02:15:23.427909+0000","last_peered":"2024-04-24T02:15:23.427909+0000","last_clean":"2024-04-24T02:15:23.427909+0000","last_became_active":"2024-04-24T02:12:10.777222+0000","last_became_peered":"2024-04-24T02:12:10.777222+0000","last_unstale":"2024-04-24T02:15:23.427909+0000","last_undegraded":"2024-04-24T02:15:23.427909+0000","last_fullsized":"2024-04-24T02:15:23.427909+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-24T02:15:23.427820+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-24T02:15:23.427820+0000","last_clean_scrub_stamp":"2024-04-24T02:15:23.427820+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:37:31.031708+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:34.439628+0000","last_change":"2024-04-24T02:15:34.439653+0000","last_active":"2024-04-24T02:15:34.439628+0000","last_peered":"2024-04-24T02:15:34.439628+0000","last_clean":"2024-04-24T02:15:34.439628+0000","last_became_active":"2024-04-24T02:12:12.795204+0000","last_became_peered":"2024-04-24T02:12:12.795204+0000","last_unstale":"2024-04-24T02:15:34.439628+0000","last_undegraded":"2024-04-24T02:15:34.439628+0000","last_fullsized":"2024-04-24T02:15:34.439628+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:34.439501+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:34.439501+0000","last_clean_scrub_stamp":"2024-04-24T02:15:34.439501+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:22:10.202353+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:20.039342+0000","last_change":"2024-04-24T02:12:04.766853+0000","last_active":"2024-04-24T02:14:20.039342+0000","last_peered":"2024-04-24T02:14:20.039342+0000","last_clean":"2024-04-24T02:14:20.039342+0000","last_became_active":"2024-04-24T02:12:04.766540+0000","last_became_peered":"2024-04-24T02:12:04.766540+0000","last_unstale":"2024-04-24T02:14:20.039342+0000","last_undegraded":"2024-04-24T02:14:20.039342+0000","last_fullsized":"2024-04-24T02:14:20.039342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:15.038911+0000","last_change":"2024-04-24T02:12:02.760628+0000","last_active":"2024-04-24T02:14:15.038911+0000","last_peered":"2024-04-24T02:14:15.038911+0000","last_clean":"2024-04-24T02:14:15.038911+0000","last_became_active":"2024-04-24T02:12:02.757717+0000","last_became_peered":"2024-04-24T02:12:02.757717+0000","last_unstale":"2024-04-24T02:14:15.038911+0000","last_undegraded":"2024-04-24T02:14:15.038911+0000","last_fullsized":"2024-04-24T02:14:15.038911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:25.340800+0000","last_change":"2024-04-24T02:15:25.340837+0000","last_active":"2024-04-24T02:15:25.340800+0000","last_peered":"2024-04-24T02:15:25.340800+0000","last_clean":"2024-04-24T02:15:25.340800+0000","last_became_active":"2024-04-24T02:12:06.758452+0000","last_became_peered":"2024-04-24T02:12:06.758452+0000","last_unstale":"2024-04-24T02:15:25.340800+0000","last_undegraded":"2024-04-24T02:15:25.340800+0000","last_fullsized":"2024-04-24T02:15:25.340800+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:25.340704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:25.340704+0000","last_clean_scrub_stamp":"2024-04-24T02:15:25.340704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:51:26.935783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'50","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:29.358708+0000","last_change":"2024-04-24T02:15:29.358770+0000","last_active":"2024-04-24T02:15:29.358708+0000","last_peered":"2024-04-24T02:15:29.358708+0000","last_clean":"2024-04-24T02:15:29.358708+0000","last_became_active":"2024-04-24T02:12:08.773319+0000","last_became_peered":"2024-04-24T02:12:08.773319+0000","last_unstale":"2024-04-24T02:15:29.358708+0000","last_undegraded":"2024-04-24T02:15:29.358708+0000","last_fullsized":"2024-04-24T02:15:29.358708+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'50","last_scrub_stamp":"2024-04-24T02:15:29.358602+0000","last_deep_scrub":"32'50","last_deep_scrub_stamp":"2024-04-24T02:15:29.358602+0000","last_clean_scrub_stamp":"2024-04-24T02:15:29.358602+0000","objects_scrubbed":8,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:42:17.124195+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":52,"num_read_kb":50,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:26.426941+0000","last_change":"2024-04-24T02:15:26.426964+0000","last_active":"2024-04-24T02:15:26.426941+0000","last_peered":"2024-04-24T02:15:26.426941+0000","last_clean":"2024-04-24T02:15:26.426941+0000","last_became_active":"2024-04-24T02:12:10.786998+0000","last_became_peered":"2024-04-24T02:12:10.786998+0000","last_unstale":"2024-04-24T02:15:26.426941+0000","last_undegraded":"2024-04-24T02:15:26.426941+0000","last_fullsized":"2024-04-24T02:15:26.426941+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:26.426853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:26.426853+0000","last_clean_scrub_stamp":"2024-04-24T02:15:26.426853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:33:27.255344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'6","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.568501+0000","last_change":"2024-04-24T02:12:12.795209+0000","last_active":"2024-04-24T02:15:13.568501+0000","last_peered":"2024-04-24T02:15:13.568501+0000","last_clean":"2024-04-24T02:15:13.568501+0000","last_became_active":"2024-04-24T02:12:12.793724+0000","last_became_peered":"2024-04-24T02:12:12.793724+0000","last_unstale":"2024-04-24T02:15:13.568501+0000","last_undegraded":"2024-04-24T02:15:13.568501+0000","last_fullsized":"2024-04-24T02:15:13.568501+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.780167+0000","last_change":"2024-04-24T02:12:04.764441+0000","last_active":"2024-04-24T02:14:12.780167+0000","last_peered":"2024-04-24T02:14:12.780167+0000","last_clean":"2024-04-24T02:14:12.780167+0000","last_became_active":"2024-04-24T02:12:04.763246+0000","last_became_peered":"2024-04-24T02:12:04.763246+0000","last_unstale":"2024-04-24T02:14:12.780167+0000","last_undegraded":"2024-04-24T02:14:12.780167+0000","last_fullsized":"2024-04-24T02:14:12.780167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":200,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:13:55.035743+0000","last_change":"2024-04-24T02:11:51.990441+0000","last_active":"2024-04-24T02:13:55.035743+0000","last_peered":"2024-04-24T02:13:55.035743+0000","last_clean":"2024-04-24T02:13:55.035743+0000","last_became_active":"2024-04-24T02:11:51.989479+0000","last_became_peered":"2024-04-24T02:11:51.989479+0000","last_unstale":"2024-04-24T02:13:55.035743+0000","last_undegraded":"2024-04-24T02:13:55.035743+0000","last_fullsized":"2024-04-24T02:13:55.035743+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:50.697037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:50.697037+0000","last_clean_scrub_stamp":"2024-04-24T02:11:50.697037+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:05.037531+0000","last_change":"2024-04-24T02:11:56.724372+0000","last_active":"2024-04-24T02:14:05.037531+0000","last_peered":"2024-04-24T02:14:05.037531+0000","last_clean":"2024-04-24T02:14:05.037531+0000","last_became_active":"2024-04-24T02:11:56.723925+0000","last_became_peered":"2024-04-24T02:11:56.723925+0000","last_unstale":"2024-04-24T02:14:05.037531+0000","last_undegraded":"2024-04-24T02:14:05.037531+0000","last_fullsized":"2024-04-24T02:14:05.037531+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:10.038205+0000","last_change":"2024-04-24T02:12:02.758997+0000","last_active":"2024-04-24T02:14:10.038205+0000","last_peered":"2024-04-24T02:14:10.038205+0000","last_clean":"2024-04-24T02:14:10.038205+0000","last_became_active":"2024-04-24T02:12:02.758653+0000","last_became_peered":"2024-04-24T02:12:02.758653+0000","last_unstale":"2024-04-24T02:14:10.038205+0000","last_undegraded":"2024-04-24T02:14:10.038205+0000","last_fullsized":"2024-04-24T02:14:10.038205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"23'1","reported_seq":221,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:19.999462+0000","last_change":"2024-04-24T02:12:06.757529+0000","last_active":"2024-04-24T02:15:19.999462+0000","last_peered":"2024-04-24T02:15:19.999462+0000","last_clean":"2024-04-24T02:15:19.999462+0000","last_became_active":"2024-04-24T02:12:06.757173+0000","last_became_peered":"2024-04-24T02:12:06.757173+0000","last_unstale":"2024-04-24T02:15:19.999462+0000","last_undegraded":"2024-04-24T02:15:19.999462+0000","last_fullsized":"2024-04-24T02:15:19.999462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'91","reported_seq":179,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:20.134127+0000","last_change":"2024-04-24T02:12:08.781224+0000","last_active":"2024-04-24T02:15:20.134127+0000","last_peered":"2024-04-24T02:15:20.134127+0000","last_clean":"2024-04-24T02:15:20.134127+0000","last_became_active":"2024-04-24T02:12:08.780923+0000","last_became_peered":"2024-04-24T02:12:08.780923+0000","last_unstale":"2024-04-24T02:15:20.134127+0000","last_undegraded":"2024-04-24T02:15:20.134127+0000","last_fullsized":"2024-04-24T02:15:20.134127+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:22.973891+0000","last_change":"2024-04-24T02:15:22.973909+0000","last_active":"2024-04-24T02:15:22.973891+0000","last_peered":"2024-04-24T02:15:22.973891+0000","last_clean":"2024-04-24T02:15:22.973891+0000","last_became_active":"2024-04-24T02:12:10.784101+0000","last_became_peered":"2024-04-24T02:12:10.784101+0000","last_unstale":"2024-04-24T02:15:22.973891+0000","last_undegraded":"2024-04-24T02:15:22.973891+0000","last_fullsized":"2024-04-24T02:15:22.973891+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:22.973820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:22.973820+0000","last_clean_scrub_stamp":"2024-04-24T02:15:22.973820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:09:23.273019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'81","reported_seq":171,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:38.392097+0000","last_change":"2024-04-24T02:15:38.392125+0000","last_active":"2024-04-24T02:15:38.392097+0000","last_peered":"2024-04-24T02:15:38.392097+0000","last_clean":"2024-04-24T02:15:38.392097+0000","last_became_active":"2024-04-24T02:12:12.795281+0000","last_became_peered":"2024-04-24T02:12:12.795281+0000","last_unstale":"2024-04-24T02:15:38.392097+0000","last_undegraded":"2024-04-24T02:15:38.392097+0000","last_fullsized":"2024-04-24T02:15:38.392097+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'81","last_scrub_stamp":"2024-04-24T02:15:38.392009+0000","last_deep_scrub":"32'81","last_deep_scrub_stamp":"2024-04-24T02:15:38.392009+0000","last_clean_scrub_stamp":"2024-04-24T02:15:38.392009+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:42:26.157602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.356097+0000","last_change":"2024-04-24T02:12:04.764296+0000","last_active":"2024-04-24T02:15:13.356097+0000","last_peered":"2024-04-24T02:15:13.356097+0000","last_clean":"2024-04-24T02:15:13.356097+0000","last_became_active":"2024-04-24T02:12:04.763782+0000","last_became_peered":"2024-04-24T02:12:04.763782+0000","last_unstale":"2024-04-24T02:15:13.356097+0000","last_undegraded":"2024-04-24T02:15:13.356097+0000","last_fullsized":"2024-04-24T02:15:13.356097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:00.036766+0000","last_change":"2024-04-24T02:11:56.724008+0000","last_active":"2024-04-24T02:14:00.036766+0000","last_peered":"2024-04-24T02:14:00.036766+0000","last_clean":"2024-04-24T02:14:00.036766+0000","last_became_active":"2024-04-24T02:11:56.723682+0000","last_became_peered":"2024-04-24T02:11:56.723682+0000","last_unstale":"2024-04-24T02:14:00.036766+0000","last_undegraded":"2024-04-24T02:14:00.036766+0000","last_fullsized":"2024-04-24T02:14:00.036766+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:08.033156+0000","last_change":"2024-04-24T02:12:02.742006+0000","last_active":"2024-04-24T02:14:08.033156+0000","last_peered":"2024-04-24T02:14:08.033156+0000","last_clean":"2024-04-24T02:14:08.033156+0000","last_became_active":"2024-04-24T02:12:02.741610+0000","last_became_peered":"2024-04-24T02:12:02.741610+0000","last_unstale":"2024-04-24T02:14:08.033156+0000","last_undegraded":"2024-04-24T02:14:08.033156+0000","last_fullsized":"2024-04-24T02:14:08.033156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:29.348600+0000","last_change":"2024-04-24T02:15:29.348651+0000","last_active":"2024-04-24T02:15:29.348600+0000","last_peered":"2024-04-24T02:15:29.348600+0000","last_clean":"2024-04-24T02:15:29.348600+0000","last_became_active":"2024-04-24T02:12:06.757052+0000","last_became_peered":"2024-04-24T02:12:06.757052+0000","last_unstale":"2024-04-24T02:15:29.348600+0000","last_undegraded":"2024-04-24T02:15:29.348600+0000","last_fullsized":"2024-04-24T02:15:29.348600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:29.348489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:29.348489+0000","last_clean_scrub_stamp":"2024-04-24T02:15:29.348489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:42:27.569911+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'298","reported_seq":529,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:25.387639+0000","last_change":"2024-04-24T02:15:25.387698+0000","last_active":"2024-04-24T02:15:25.387639+0000","last_peered":"2024-04-24T02:15:25.387639+0000","last_clean":"2024-04-24T02:15:25.387639+0000","last_became_active":"2024-04-24T02:12:08.779884+0000","last_became_peered":"2024-04-24T02:12:08.779884+0000","last_unstale":"2024-04-24T02:15:25.387639+0000","last_undegraded":"2024-04-24T02:15:25.387639+0000","last_fullsized":"2024-04-24T02:15:25.387639+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'298","last_scrub_stamp":"2024-04-24T02:15:25.387551+0000","last_deep_scrub":"32'298","last_deep_scrub_stamp":"2024-04-24T02:15:25.387551+0000","last_clean_scrub_stamp":"2024-04-24T02:15:25.387551+0000","objects_scrubbed":11,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:22:01.150403+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:15.039077+0000","last_change":"2024-04-24T02:12:10.784601+0000","last_active":"2024-04-24T02:14:15.039077+0000","last_peered":"2024-04-24T02:14:15.039077+0000","last_clean":"2024-04-24T02:14:15.039077+0000","last_became_active":"2024-04-24T02:12:10.783788+0000","last_became_peered":"2024-04-24T02:12:10.783788+0000","last_unstale":"2024-04-24T02:14:15.039077+0000","last_undegraded":"2024-04-24T02:14:15.039077+0000","last_fullsized":"2024-04-24T02:14:15.039077+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:25.039960+0000","last_change":"2024-04-24T02:12:12.796284+0000","last_active":"2024-04-24T02:14:25.039960+0000","last_peered":"2024-04-24T02:14:25.039960+0000","last_clean":"2024-04-24T02:14:25.039960+0000","last_became_active":"2024-04-24T02:12:12.795983+0000","last_became_peered":"2024-04-24T02:12:12.795983+0000","last_unstale":"2024-04-24T02:14:25.039960+0000","last_undegraded":"2024-04-24T02:14:25.039960+0000","last_fullsized":"2024-04-24T02:14:25.039960+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'22","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.176666+0000","last_change":"2024-04-24T02:12:04.756013+0000","last_active":"2024-04-24T02:15:13.176666+0000","last_peered":"2024-04-24T02:15:13.176666+0000","last_clean":"2024-04-24T02:15:13.176666+0000","last_became_active":"2024-04-24T02:12:04.755649+0000","last_became_peered":"2024-04-24T02:12:04.755649+0000","last_unstale":"2024-04-24T02:15:13.176666+0000","last_undegraded":"2024-04-24T02:15:13.176666+0000","last_fullsized":"2024-04-24T02:15:13.176666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":72,"num_write":29,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:00.036122+0000","last_change":"2024-04-24T02:11:56.724010+0000","last_active":"2024-04-24T02:14:00.036122+0000","last_peered":"2024-04-24T02:14:00.036122+0000","last_clean":"2024-04-24T02:14:00.036122+0000","last_became_active":"2024-04-24T02:11:56.723497+0000","last_became_peered":"2024-04-24T02:11:56.723497+0000","last_unstale":"2024-04-24T02:14:00.036122+0000","last_undegraded":"2024-04-24T02:14:00.036122+0000","last_fullsized":"2024-04-24T02:14:00.036122+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:20.098252+0000","last_change":"2024-04-24T02:12:02.745574+0000","last_active":"2024-04-24T02:15:20.098252+0000","last_peered":"2024-04-24T02:15:20.098252+0000","last_clean":"2024-04-24T02:15:20.098252+0000","last_became_active":"2024-04-24T02:12:02.745238+0000","last_became_peered":"2024-04-24T02:12:02.745238+0000","last_unstale":"2024-04-24T02:15:20.098252+0000","last_undegraded":"2024-04-24T02:15:20.098252+0000","last_fullsized":"2024-04-24T02:15:20.098252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:20.039074+0000","last_change":"2024-04-24T02:12:06.757374+0000","last_active":"2024-04-24T02:14:20.039074+0000","last_peered":"2024-04-24T02:14:20.039074+0000","last_clean":"2024-04-24T02:14:20.039074+0000","last_became_active":"2024-04-24T02:12:06.757009+0000","last_became_peered":"2024-04-24T02:12:06.757009+0000","last_unstale":"2024-04-24T02:14:20.039074+0000","last_undegraded":"2024-04-24T02:14:20.039074+0000","last_fullsized":"2024-04-24T02:14:20.039074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'23","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:35.426639+0000","last_change":"2024-04-24T02:15:35.426698+0000","last_active":"2024-04-24T02:15:35.426639+0000","last_peered":"2024-04-24T02:15:35.426639+0000","last_clean":"2024-04-24T02:15:35.426639+0000","last_became_active":"2024-04-24T02:12:08.774177+0000","last_became_peered":"2024-04-24T02:12:08.774177+0000","last_unstale":"2024-04-24T02:15:35.426639+0000","last_undegraded":"2024-04-24T02:15:35.426639+0000","last_fullsized":"2024-04-24T02:15:35.426639+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2024-04-24T02:15:35.426543+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2024-04-24T02:15:35.426543+0000","last_clean_scrub_stamp":"2024-04-24T02:15:35.426543+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:20:39.513825+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:27.053482+0000","last_change":"2024-04-24T02:15:27.053503+0000","last_active":"2024-04-24T02:15:27.053482+0000","last_peered":"2024-04-24T02:15:27.053482+0000","last_clean":"2024-04-24T02:15:27.053482+0000","last_became_active":"2024-04-24T02:12:10.784247+0000","last_became_peered":"2024-04-24T02:12:10.784247+0000","last_unstale":"2024-04-24T02:15:27.053482+0000","last_undegraded":"2024-04-24T02:15:27.053482+0000","last_fullsized":"2024-04-24T02:15:27.053482+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:27.053381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:27.053381+0000","last_clean_scrub_stamp":"2024-04-24T02:15:27.053381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:58:59.706713+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:30.041437+0000","last_change":"2024-04-24T02:12:12.794755+0000","last_active":"2024-04-24T02:14:30.041437+0000","last_peered":"2024-04-24T02:14:30.041437+0000","last_clean":"2024-04-24T02:14:30.041437+0000","last_became_active":"2024-04-24T02:12:12.794453+0000","last_became_peered":"2024-04-24T02:12:12.794453+0000","last_unstale":"2024-04-24T02:14:30.041437+0000","last_undegraded":"2024-04-24T02:14:30.041437+0000","last_fullsized":"2024-04-24T02:14:30.041437+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'3","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.523202+0000","last_change":"2024-04-24T02:12:04.749524+0000","last_active":"2024-04-24T02:15:13.523202+0000","last_peered":"2024-04-24T02:15:13.523202+0000","last_clean":"2024-04-24T02:15:13.523202+0000","last_became_active":"2024-04-24T02:12:04.749173+0000","last_became_peered":"2024-04-24T02:12:04.749173+0000","last_unstale":"2024-04-24T02:15:13.523202+0000","last_undegraded":"2024-04-24T02:15:13.523202+0000","last_fullsized":"2024-04-24T02:15:13.523202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:00.036831+0000","last_change":"2024-04-24T02:11:56.723425+0000","last_active":"2024-04-24T02:14:00.036831+0000","last_peered":"2024-04-24T02:14:00.036831+0000","last_clean":"2024-04-24T02:14:00.036831+0000","last_became_active":"2024-04-24T02:11:56.723125+0000","last_became_peered":"2024-04-24T02:11:56.723125+0000","last_unstale":"2024-04-24T02:14:00.036831+0000","last_undegraded":"2024-04-24T02:14:00.036831+0000","last_fullsized":"2024-04-24T02:14:00.036831+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:10.037417+0000","last_change":"2024-04-24T02:12:02.746939+0000","last_active":"2024-04-24T02:14:10.037417+0000","last_peered":"2024-04-24T02:14:10.037417+0000","last_clean":"2024-04-24T02:14:10.037417+0000","last_became_active":"2024-04-24T02:12:02.746682+0000","last_became_peered":"2024-04-24T02:12:02.746682+0000","last_unstale":"2024-04-24T02:14:10.037417+0000","last_undegraded":"2024-04-24T02:14:10.037417+0000","last_fullsized":"2024-04-24T02:14:10.037417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:13.033872+0000","last_change":"2024-04-24T02:12:06.759484+0000","last_active":"2024-04-24T02:14:13.033872+0000","last_peered":"2024-04-24T02:14:13.033872+0000","last_clean":"2024-04-24T02:14:13.033872+0000","last_became_active":"2024-04-24T02:12:06.759169+0000","last_became_peered":"2024-04-24T02:12:06.759169+0000","last_unstale":"2024-04-24T02:14:13.033872+0000","last_undegraded":"2024-04-24T02:14:13.033872+0000","last_fullsized":"2024-04-24T02:14:13.033872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'13","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:12.809100+0000","last_change":"2024-04-24T02:12:08.783178+0000","last_active":"2024-04-24T02:15:12.809100+0000","last_peered":"2024-04-24T02:15:12.809100+0000","last_clean":"2024-04-24T02:15:12.809100+0000","last_became_active":"2024-04-24T02:12:08.782765+0000","last_became_peered":"2024-04-24T02:12:08.782765+0000","last_unstale":"2024-04-24T02:15:12.809100+0000","last_undegraded":"2024-04-24T02:15:12.809100+0000","last_fullsized":"2024-04-24T02:15:12.809100+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:20.039934+0000","last_change":"2024-04-24T02:12:10.785313+0000","last_active":"2024-04-24T02:14:20.039934+0000","last_peered":"2024-04-24T02:14:20.039934+0000","last_clean":"2024-04-24T02:14:20.039934+0000","last_became_active":"2024-04-24T02:12:10.783813+0000","last_became_peered":"2024-04-24T02:12:10.783813+0000","last_unstale":"2024-04-24T02:14:20.039934+0000","last_undegraded":"2024-04-24T02:14:20.039934+0000","last_fullsized":"2024-04-24T02:14:20.039934+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:25.039852+0000","last_change":"2024-04-24T02:12:12.797895+0000","last_active":"2024-04-24T02:14:25.039852+0000","last_peered":"2024-04-24T02:14:25.039852+0000","last_clean":"2024-04-24T02:14:25.039852+0000","last_became_active":"2024-04-24T02:12:12.796507+0000","last_became_peered":"2024-04-24T02:12:12.796507+0000","last_unstale":"2024-04-24T02:14:25.039852+0000","last_undegraded":"2024-04-24T02:14:25.039852+0000","last_fullsized":"2024-04-24T02:14:25.039852+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:10.037724+0000","last_change":"2024-04-24T02:12:04.767815+0000","last_active":"2024-04-24T02:14:10.037724+0000","last_peered":"2024-04-24T02:14:10.037724+0000","last_clean":"2024-04-24T02:14:10.037724+0000","last_became_active":"2024-04-24T02:12:04.767221+0000","last_became_peered":"2024-04-24T02:12:04.767221+0000","last_unstale":"2024-04-24T02:14:10.037724+0000","last_undegraded":"2024-04-24T02:14:10.037724+0000","last_fullsized":"2024-04-24T02:14:10.037724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:10.037472+0000","last_change":"2024-04-24T02:12:02.747860+0000","last_active":"2024-04-24T02:14:10.037472+0000","last_peered":"2024-04-24T02:14:10.037472+0000","last_clean":"2024-04-24T02:14:10.037472+0000","last_became_active":"2024-04-24T02:12:02.744161+0000","last_became_peered":"2024-04-24T02:12:02.744161+0000","last_unstale":"2024-04-24T02:14:10.037472+0000","last_undegraded":"2024-04-24T02:14:10.037472+0000","last_fullsized":"2024-04-24T02:14:10.037472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:03.032354+0000","last_change":"2024-04-24T02:11:56.723976+0000","last_active":"2024-04-24T02:14:03.032354+0000","last_peered":"2024-04-24T02:14:03.032354+0000","last_clean":"2024-04-24T02:14:03.032354+0000","last_became_active":"2024-04-24T02:11:56.723697+0000","last_became_peered":"2024-04-24T02:11:56.723697+0000","last_unstale":"2024-04-24T02:14:03.032354+0000","last_undegraded":"2024-04-24T02:14:03.032354+0000","last_fullsized":"2024-04-24T02:14:03.032354+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'1","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:20.000067+0000","last_change":"2024-04-24T02:12:06.759464+0000","last_active":"2024-04-24T02:15:20.000067+0000","last_peered":"2024-04-24T02:15:20.000067+0000","last_clean":"2024-04-24T02:15:20.000067+0000","last_became_active":"2024-04-24T02:12:06.759160+0000","last_became_peered":"2024-04-24T02:12:06.759160+0000","last_unstale":"2024-04-24T02:15:20.000067+0000","last_undegraded":"2024-04-24T02:15:20.000067+0000","last_fullsized":"2024-04-24T02:15:20.000067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'87","reported_seq":175,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:33.030349+0000","last_change":"2024-04-24T02:15:33.030400+0000","last_active":"2024-04-24T02:15:33.030349+0000","last_peered":"2024-04-24T02:15:33.030349+0000","last_clean":"2024-04-24T02:15:33.030349+0000","last_became_active":"2024-04-24T02:12:08.780688+0000","last_became_peered":"2024-04-24T02:12:08.780688+0000","last_unstale":"2024-04-24T02:15:33.030349+0000","last_undegraded":"2024-04-24T02:15:33.030349+0000","last_fullsized":"2024-04-24T02:15:33.030349+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'87","last_scrub_stamp":"2024-04-24T02:15:33.030249+0000","last_deep_scrub":"32'87","last_deep_scrub_stamp":"2024-04-24T02:15:33.030249+0000","last_clean_scrub_stamp":"2024-04-24T02:15:33.030249+0000","objects_scrubbed":11,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:20:07.673923+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":89,"num_read_kb":75,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:25.419741+0000","last_change":"2024-04-24T02:15:25.419767+0000","last_active":"2024-04-24T02:15:25.419741+0000","last_peered":"2024-04-24T02:15:25.419741+0000","last_clean":"2024-04-24T02:15:25.419741+0000","last_became_active":"2024-04-24T02:12:10.781586+0000","last_became_peered":"2024-04-24T02:12:10.781586+0000","last_unstale":"2024-04-24T02:15:25.419741+0000","last_undegraded":"2024-04-24T02:15:25.419741+0000","last_fullsized":"2024-04-24T02:15:25.419741+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:25.419637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:25.419637+0000","last_clean_scrub_stamp":"2024-04-24T02:15:25.419637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:41:52.572498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'9","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:28.036038+0000","last_change":"2024-04-24T02:12:12.798530+0000","last_active":"2024-04-24T02:14:28.036038+0000","last_peered":"2024-04-24T02:14:28.036038+0000","last_clean":"2024-04-24T02:14:28.036038+0000","last_became_active":"2024-04-24T02:12:12.798272+0000","last_became_peered":"2024-04-24T02:12:12.798272+0000","last_unstale":"2024-04-24T02:14:28.036038+0000","last_undegraded":"2024-04-24T02:14:28.036038+0000","last_fullsized":"2024-04-24T02:14:28.036038+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'6","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.777571+0000","last_change":"2024-04-24T02:12:04.765396+0000","last_active":"2024-04-24T02:14:12.777571+0000","last_peered":"2024-04-24T02:14:12.777571+0000","last_clean":"2024-04-24T02:14:12.777571+0000","last_became_active":"2024-04-24T02:12:04.765093+0000","last_became_peered":"2024-04-24T02:12:04.765093+0000","last_unstale":"2024-04-24T02:14:12.777571+0000","last_undegraded":"2024-04-24T02:14:12.777571+0000","last_fullsized":"2024-04-24T02:14:12.777571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:08.033226+0000","last_change":"2024-04-24T02:12:02.741909+0000","last_active":"2024-04-24T02:14:08.033226+0000","last_peered":"2024-04-24T02:14:08.033226+0000","last_clean":"2024-04-24T02:14:08.033226+0000","last_became_active":"2024-04-24T02:12:02.741565+0000","last_became_peered":"2024-04-24T02:12:02.741565+0000","last_unstale":"2024-04-24T02:14:08.033226+0000","last_undegraded":"2024-04-24T02:14:08.033226+0000","last_fullsized":"2024-04-24T02:14:08.033226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:05.037570+0000","last_change":"2024-04-24T02:11:56.724046+0000","last_active":"2024-04-24T02:14:05.037570+0000","last_peered":"2024-04-24T02:14:05.037570+0000","last_clean":"2024-04-24T02:14:05.037570+0000","last_became_active":"2024-04-24T02:11:56.723673+0000","last_became_peered":"2024-04-24T02:11:56.723673+0000","last_unstale":"2024-04-24T02:14:05.037570+0000","last_undegraded":"2024-04-24T02:14:05.037570+0000","last_fullsized":"2024-04-24T02:14:05.037570+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:31.335556+0000","last_change":"2024-04-24T02:15:31.335580+0000","last_active":"2024-04-24T02:15:31.335556+0000","last_peered":"2024-04-24T02:15:31.335556+0000","last_clean":"2024-04-24T02:15:31.335556+0000","last_became_active":"2024-04-24T02:12:06.755760+0000","last_became_peered":"2024-04-24T02:12:06.755760+0000","last_unstale":"2024-04-24T02:15:31.335556+0000","last_undegraded":"2024-04-24T02:15:31.335556+0000","last_fullsized":"2024-04-24T02:15:31.335556+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:31.335458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:31.335458+0000","last_clean_scrub_stamp":"2024-04-24T02:15:31.335458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:15:39.406302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'28","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:27.368820+0000","last_change":"2024-04-24T02:15:27.368863+0000","last_active":"2024-04-24T02:15:27.368820+0000","last_peered":"2024-04-24T02:15:27.368820+0000","last_clean":"2024-04-24T02:15:27.368820+0000","last_became_active":"2024-04-24T02:12:08.779698+0000","last_became_peered":"2024-04-24T02:12:08.779698+0000","last_unstale":"2024-04-24T02:15:27.368820+0000","last_undegraded":"2024-04-24T02:15:27.368820+0000","last_fullsized":"2024-04-24T02:15:27.368820+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'28","last_scrub_stamp":"2024-04-24T02:15:27.368732+0000","last_deep_scrub":"32'28","last_deep_scrub_stamp":"2024-04-24T02:15:27.368732+0000","last_clean_scrub_stamp":"2024-04-24T02:15:27.368732+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:51:46.023041+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'285","reported_seq":358,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:30.318483+0000","last_change":"2024-04-24T02:15:30.318523+0000","last_active":"2024-04-24T02:15:30.318483+0000","last_peered":"2024-04-24T02:15:30.318483+0000","last_clean":"2024-04-24T02:15:30.318483+0000","last_became_active":"2024-04-24T02:12:10.781799+0000","last_became_peered":"2024-04-24T02:12:10.781799+0000","last_unstale":"2024-04-24T02:15:30.318483+0000","last_undegraded":"2024-04-24T02:15:30.318483+0000","last_fullsized":"2024-04-24T02:15:30.318483+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-24T02:15:30.318394+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-24T02:15:30.318394+0000","last_clean_scrub_stamp":"2024-04-24T02:15:30.318394+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:55:07.242675+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:30.041560+0000","last_change":"2024-04-24T02:12:12.794164+0000","last_active":"2024-04-24T02:14:30.041560+0000","last_peered":"2024-04-24T02:14:30.041560+0000","last_clean":"2024-04-24T02:14:30.041560+0000","last_became_active":"2024-04-24T02:12:12.792628+0000","last_became_peered":"2024-04-24T02:12:12.792628+0000","last_unstale":"2024-04-24T02:14:30.041560+0000","last_undegraded":"2024-04-24T02:14:30.041560+0000","last_fullsized":"2024-04-24T02:14:30.041560+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'19","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:37.364694+0000","last_change":"2024-04-24T02:15:37.364765+0000","last_active":"2024-04-24T02:15:37.364694+0000","last_peered":"2024-04-24T02:15:37.364694+0000","last_clean":"2024-04-24T02:15:37.364694+0000","last_became_active":"2024-04-24T02:12:04.768066+0000","last_became_peered":"2024-04-24T02:12:04.768066+0000","last_unstale":"2024-04-24T02:15:37.364694+0000","last_undegraded":"2024-04-24T02:15:37.364694+0000","last_fullsized":"2024-04-24T02:15:37.364694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'19","last_scrub_stamp":"2024-04-24T02:15:37.364597+0000","last_deep_scrub":"32'19","last_deep_scrub_stamp":"2024-04-24T02:15:37.364597+0000","last_clean_scrub_stamp":"2024-04-24T02:15:37.364597+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:10:16.966259+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":70,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:15.039147+0000","last_change":"2024-04-24T02:12:02.761644+0000","last_active":"2024-04-24T02:14:15.039147+0000","last_peered":"2024-04-24T02:14:15.039147+0000","last_clean":"2024-04-24T02:14:15.039147+0000","last_became_active":"2024-04-24T02:12:02.760824+0000","last_became_peered":"2024-04-24T02:12:02.760824+0000","last_unstale":"2024-04-24T02:14:15.039147+0000","last_undegraded":"2024-04-24T02:14:15.039147+0000","last_fullsized":"2024-04-24T02:14:15.039147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:08.033261+0000","last_change":"2024-04-24T02:11:56.723499+0000","last_active":"2024-04-24T02:14:08.033261+0000","last_peered":"2024-04-24T02:14:08.033261+0000","last_clean":"2024-04-24T02:14:08.033261+0000","last_became_active":"2024-04-24T02:11:56.723277+0000","last_became_peered":"2024-04-24T02:11:56.723277+0000","last_unstale":"2024-04-24T02:14:08.033261+0000","last_undegraded":"2024-04-24T02:14:08.033261+0000","last_fullsized":"2024-04-24T02:14:08.033261+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:33.324096+0000","last_change":"2024-04-24T02:15:33.324119+0000","last_active":"2024-04-24T02:15:33.324096+0000","last_peered":"2024-04-24T02:15:33.324096+0000","last_clean":"2024-04-24T02:15:33.324096+0000","last_became_active":"2024-04-24T02:12:06.754414+0000","last_became_peered":"2024-04-24T02:12:06.754414+0000","last_unstale":"2024-04-24T02:15:33.324096+0000","last_undegraded":"2024-04-24T02:15:33.324096+0000","last_fullsized":"2024-04-24T02:15:33.324096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:33.324008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:33.324008+0000","last_clean_scrub_stamp":"2024-04-24T02:15:33.324008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:33:56.910723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'23","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:38.410159+0000","last_change":"2024-04-24T02:15:38.410200+0000","last_active":"2024-04-24T02:15:38.410159+0000","last_peered":"2024-04-24T02:15:38.410159+0000","last_clean":"2024-04-24T02:15:38.410159+0000","last_became_active":"2024-04-24T02:12:08.779937+0000","last_became_peered":"2024-04-24T02:12:08.779937+0000","last_unstale":"2024-04-24T02:15:38.410159+0000","last_undegraded":"2024-04-24T02:15:38.410159+0000","last_fullsized":"2024-04-24T02:15:38.410159+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2024-04-24T02:15:38.410066+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2024-04-24T02:15:38.410066+0000","last_clean_scrub_stamp":"2024-04-24T02:15:38.410066+0000","objects_scrubbed":6,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:27:43.655638+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'285","reported_seq":401,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:30.014088+0000","last_change":"2024-04-24T02:15:30.014117+0000","last_active":"2024-04-24T02:15:30.014088+0000","last_peered":"2024-04-24T02:15:30.014088+0000","last_clean":"2024-04-24T02:15:30.014088+0000","last_became_active":"2024-04-24T02:12:10.776594+0000","last_became_peered":"2024-04-24T02:12:10.776594+0000","last_unstale":"2024-04-24T02:15:30.014088+0000","last_undegraded":"2024-04-24T02:15:30.014088+0000","last_fullsized":"2024-04-24T02:15:30.014088+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-24T02:15:30.013989+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-24T02:15:30.013989+0000","last_clean_scrub_stamp":"2024-04-24T02:15:30.013989+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:47:15.601895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:30.040793+0000","last_change":"2024-04-24T02:12:12.795629+0000","last_active":"2024-04-24T02:14:30.040793+0000","last_peered":"2024-04-24T02:14:30.040793+0000","last_clean":"2024-04-24T02:14:30.040793+0000","last_became_active":"2024-04-24T02:12:12.795328+0000","last_became_peered":"2024-04-24T02:12:12.795328+0000","last_unstale":"2024-04-24T02:14:30.040793+0000","last_undegraded":"2024-04-24T02:14:30.040793+0000","last_fullsized":"2024-04-24T02:14:30.040793+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'3","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.523222+0000","last_change":"2024-04-24T02:12:04.760388+0000","last_active":"2024-04-24T02:15:13.523222+0000","last_peered":"2024-04-24T02:15:13.523222+0000","last_clean":"2024-04-24T02:15:13.523222+0000","last_became_active":"2024-04-24T02:12:04.760099+0000","last_became_peered":"2024-04-24T02:12:04.760099+0000","last_unstale":"2024-04-24T02:15:13.523222+0000","last_undegraded":"2024-04-24T02:15:13.523222+0000","last_fullsized":"2024-04-24T02:15:13.523222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:20.095255+0000","last_change":"2024-04-24T02:12:02.744971+0000","last_active":"2024-04-24T02:15:20.095255+0000","last_peered":"2024-04-24T02:15:20.095255+0000","last_clean":"2024-04-24T02:15:20.095255+0000","last_became_active":"2024-04-24T02:12:02.744454+0000","last_became_peered":"2024-04-24T02:12:02.744454+0000","last_unstale":"2024-04-24T02:15:20.095255+0000","last_undegraded":"2024-04-24T02:15:20.095255+0000","last_fullsized":"2024-04-24T02:15:20.095255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:05.037613+0000","last_change":"2024-04-24T02:11:57.000530+0000","last_active":"2024-04-24T02:14:05.037613+0000","last_peered":"2024-04-24T02:14:05.037613+0000","last_clean":"2024-04-24T02:14:05.037613+0000","last_became_active":"2024-04-24T02:11:57.000197+0000","last_became_peered":"2024-04-24T02:11:57.000197+0000","last_unstale":"2024-04-24T02:14:05.037613+0000","last_undegraded":"2024-04-24T02:14:05.037613+0000","last_fullsized":"2024-04-24T02:14:05.037613+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:34.371665+0000","last_change":"2024-04-24T02:15:34.371690+0000","last_active":"2024-04-24T02:15:34.371665+0000","last_peered":"2024-04-24T02:15:34.371665+0000","last_clean":"2024-04-24T02:15:34.371665+0000","last_became_active":"2024-04-24T02:12:06.754107+0000","last_became_peered":"2024-04-24T02:12:06.754107+0000","last_unstale":"2024-04-24T02:15:34.371665+0000","last_undegraded":"2024-04-24T02:15:34.371665+0000","last_fullsized":"2024-04-24T02:15:34.371665+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:34.371542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:34.371542+0000","last_clean_scrub_stamp":"2024-04-24T02:15:34.371542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:59:19.687673+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'105","reported_seq":204,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:32.532733+0000","last_change":"2024-04-24T02:15:32.532781+0000","last_active":"2024-04-24T02:15:32.532733+0000","last_peered":"2024-04-24T02:15:32.532733+0000","last_clean":"2024-04-24T02:15:32.532733+0000","last_became_active":"2024-04-24T02:12:08.780925+0000","last_became_peered":"2024-04-24T02:12:08.780925+0000","last_unstale":"2024-04-24T02:15:32.532733+0000","last_undegraded":"2024-04-24T02:15:32.532733+0000","last_fullsized":"2024-04-24T02:15:32.532733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'105","last_scrub_stamp":"2024-04-24T02:15:32.532634+0000","last_deep_scrub":"32'105","last_deep_scrub_stamp":"2024-04-24T02:15:32.532634+0000","last_clean_scrub_stamp":"2024-04-24T02:15:32.532634+0000","objects_scrubbed":9,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:37:40.136523+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":108,"num_read_kb":111,"num_write":44,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:32.071821+0000","last_change":"2024-04-24T02:15:32.071860+0000","last_active":"2024-04-24T02:15:32.071821+0000","last_peered":"2024-04-24T02:15:32.071821+0000","last_clean":"2024-04-24T02:15:32.071821+0000","last_became_active":"2024-04-24T02:12:10.775165+0000","last_became_peered":"2024-04-24T02:12:10.775165+0000","last_unstale":"2024-04-24T02:15:32.071821+0000","last_undegraded":"2024-04-24T02:15:32.071821+0000","last_fullsized":"2024-04-24T02:15:32.071821+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:32.071693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:32.071693+0000","last_clean_scrub_stamp":"2024-04-24T02:15:32.071693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:31:34.757480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"30'2","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:30.040655+0000","last_change":"2024-04-24T02:12:12.796696+0000","last_active":"2024-04-24T02:14:30.040655+0000","last_peered":"2024-04-24T02:14:30.040655+0000","last_clean":"2024-04-24T02:14:30.040655+0000","last_became_active":"2024-04-24T02:12:12.796411+0000","last_became_peered":"2024-04-24T02:12:12.796411+0000","last_unstale":"2024-04-24T02:14:30.040655+0000","last_undegraded":"2024-04-24T02:14:30.040655+0000","last_fullsized":"2024-04-24T02:14:30.040655+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:20.039105+0000","last_change":"2024-04-24T02:12:12.801700+0000","last_active":"2024-04-24T02:14:20.039105+0000","last_peered":"2024-04-24T02:14:20.039105+0000","last_clean":"2024-04-24T02:14:20.039105+0000","last_became_active":"2024-04-24T02:12:12.801346+0000","last_became_peered":"2024-04-24T02:12:12.801346+0000","last_unstale":"2024-04-24T02:14:20.039105+0000","last_undegraded":"2024-04-24T02:14:20.039105+0000","last_fullsized":"2024-04-24T02:14:20.039105+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:25.039749+0000","last_change":"2024-04-24T02:12:04.764138+0000","last_active":"2024-04-24T02:14:25.039749+0000","last_peered":"2024-04-24T02:14:25.039749+0000","last_clean":"2024-04-24T02:14:25.039749+0000","last_became_active":"2024-04-24T02:12:04.763860+0000","last_became_peered":"2024-04-24T02:12:04.763860+0000","last_unstale":"2024-04-24T02:14:25.039749+0000","last_undegraded":"2024-04-24T02:14:25.039749+0000","last_fullsized":"2024-04-24T02:14:25.039749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:20.095672+0000","last_change":"2024-04-24T02:12:02.757073+0000","last_active":"2024-04-24T02:15:20.095672+0000","last_peered":"2024-04-24T02:15:20.095672+0000","last_clean":"2024-04-24T02:15:20.095672+0000","last_became_active":"2024-04-24T02:12:02.753166+0000","last_became_peered":"2024-04-24T02:12:02.753166+0000","last_unstale":"2024-04-24T02:15:20.095672+0000","last_undegraded":"2024-04-24T02:15:20.095672+0000","last_fullsized":"2024-04-24T02:15:20.095672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:39.395350+0000","last_change":"2024-04-24T02:15:39.395376+0000","last_active":"2024-04-24T02:15:39.395350+0000","last_peered":"2024-04-24T02:15:39.395350+0000","last_clean":"2024-04-24T02:15:39.395350+0000","last_became_active":"2024-04-24T02:12:06.758468+0000","last_became_peered":"2024-04-24T02:12:06.758468+0000","last_unstale":"2024-04-24T02:15:39.395350+0000","last_undegraded":"2024-04-24T02:15:39.395350+0000","last_fullsized":"2024-04-24T02:15:39.395350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:39.395252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:39.395252+0000","last_clean_scrub_stamp":"2024-04-24T02:15:39.395252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:56:56.565405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'41","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:20.113283+0000","last_change":"2024-04-24T02:12:08.782070+0000","last_active":"2024-04-24T02:15:20.113283+0000","last_peered":"2024-04-24T02:15:20.113283+0000","last_clean":"2024-04-24T02:15:20.113283+0000","last_became_active":"2024-04-24T02:12:08.780353+0000","last_became_peered":"2024-04-24T02:12:08.780353+0000","last_unstale":"2024-04-24T02:15:20.113283+0000","last_undegraded":"2024-04-24T02:15:20.113283+0000","last_fullsized":"2024-04-24T02:15:20.113283+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:30.041295+0000","last_change":"2024-04-24T02:12:10.787091+0000","last_active":"2024-04-24T02:14:30.041295+0000","last_peered":"2024-04-24T02:14:30.041295+0000","last_clean":"2024-04-24T02:14:30.041295+0000","last_became_active":"2024-04-24T02:12:10.786813+0000","last_became_peered":"2024-04-24T02:12:10.786813+0000","last_unstale":"2024-04-24T02:14:30.041295+0000","last_undegraded":"2024-04-24T02:14:30.041295+0000","last_fullsized":"2024-04-24T02:14:30.041295+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'9","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.174206+0000","last_change":"2024-04-24T02:12:12.796438+0000","last_active":"2024-04-24T02:15:13.174206+0000","last_peered":"2024-04-24T02:15:13.174206+0000","last_clean":"2024-04-24T02:15:13.174206+0000","last_became_active":"2024-04-24T02:12:12.796149+0000","last_became_peered":"2024-04-24T02:12:12.796149+0000","last_unstale":"2024-04-24T02:15:13.174206+0000","last_undegraded":"2024-04-24T02:15:13.174206+0000","last_fullsized":"2024-04-24T02:15:13.174206+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'2","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.176885+0000","last_change":"2024-04-24T02:12:45.816393+0000","last_active":"2024-04-24T02:15:13.176885+0000","last_peered":"2024-04-24T02:15:13.176885+0000","last_clean":"2024-04-24T02:15:13.176885+0000","last_became_active":"2024-04-24T02:12:45.816009+0000","last_became_peered":"2024-04-24T02:12:45.816009+0000","last_unstale":"2024-04-24T02:15:13.176885+0000","last_undegraded":"2024-04-24T02:15:13.176885+0000","last_fullsized":"2024-04-24T02:15:13.176885+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"32'6","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.344358+0000","last_change":"2024-04-24T02:12:02.755246+0000","last_active":"2024-04-24T02:15:13.344358+0000","last_peered":"2024-04-24T02:15:13.344358+0000","last_clean":"2024-04-24T02:15:13.344358+0000","last_became_active":"2024-04-24T02:12:02.754623+0000","last_became_peered":"2024-04-24T02:12:02.754623+0000","last_unstale":"2024-04-24T02:15:13.344358+0000","last_undegraded":"2024-04-24T02:15:13.344358+0000","last_fullsized":"2024-04-24T02:15:13.344358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:27.328721+0000","last_change":"2024-04-24T02:15:27.328746+0000","last_active":"2024-04-24T02:15:27.328721+0000","last_peered":"2024-04-24T02:15:27.328721+0000","last_clean":"2024-04-24T02:15:27.328721+0000","last_became_active":"2024-04-24T02:12:06.756998+0000","last_became_peered":"2024-04-24T02:12:06.756998+0000","last_unstale":"2024-04-24T02:15:27.328721+0000","last_undegraded":"2024-04-24T02:15:27.328721+0000","last_fullsized":"2024-04-24T02:15:27.328721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:27.328635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:27.328635+0000","last_clean_scrub_stamp":"2024-04-24T02:15:27.328635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:13.610015+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'9","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:36.993078+0000","last_change":"2024-04-24T02:15:36.993114+0000","last_active":"2024-04-24T02:15:36.993078+0000","last_peered":"2024-04-24T02:15:36.993078+0000","last_clean":"2024-04-24T02:15:36.993078+0000","last_became_active":"2024-04-24T02:12:08.769610+0000","last_became_peered":"2024-04-24T02:12:08.769610+0000","last_unstale":"2024-04-24T02:15:36.993078+0000","last_undegraded":"2024-04-24T02:15:36.993078+0000","last_fullsized":"2024-04-24T02:15:36.993078+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-24T02:15:36.992984+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-24T02:15:36.992984+0000","last_clean_scrub_stamp":"2024-04-24T02:15:36.992984+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:31:27.219681+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:24.453899+0000","last_change":"2024-04-24T02:15:24.453926+0000","last_active":"2024-04-24T02:15:24.453899+0000","last_peered":"2024-04-24T02:15:24.453899+0000","last_clean":"2024-04-24T02:15:24.453899+0000","last_became_active":"2024-04-24T02:12:10.784955+0000","last_became_peered":"2024-04-24T02:12:10.784955+0000","last_unstale":"2024-04-24T02:15:24.453899+0000","last_undegraded":"2024-04-24T02:15:24.453899+0000","last_fullsized":"2024-04-24T02:15:24.453899+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:24.453808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:24.453808+0000","last_clean_scrub_stamp":"2024-04-24T02:15:24.453808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:10:25.731858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'10","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:43.038159+0000","last_change":"2024-04-24T02:12:12.792872+0000","last_active":"2024-04-24T02:14:43.038159+0000","last_peered":"2024-04-24T02:14:43.038159+0000","last_clean":"2024-04-24T02:14:43.038159+0000","last_became_active":"2024-04-24T02:12:12.792565+0000","last_became_peered":"2024-04-24T02:12:12.792565+0000","last_unstale":"2024-04-24T02:14:43.038159+0000","last_undegraded":"2024-04-24T02:14:43.038159+0000","last_fullsized":"2024-04-24T02:14:43.038159+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":60,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'3","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.523285+0000","last_change":"2024-04-24T02:12:04.767155+0000","last_active":"2024-04-24T02:15:13.523285+0000","last_peered":"2024-04-24T02:15:13.523285+0000","last_clean":"2024-04-24T02:15:13.523285+0000","last_became_active":"2024-04-24T02:12:04.766700+0000","last_became_peered":"2024-04-24T02:12:04.766700+0000","last_unstale":"2024-04-24T02:15:13.523285+0000","last_undegraded":"2024-04-24T02:15:13.523285+0000","last_fullsized":"2024-04-24T02:15:13.523285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:30.040702+0000","last_change":"2024-04-24T02:12:45.817612+0000","last_active":"2024-04-24T02:14:30.040702+0000","last_peered":"2024-04-24T02:14:30.040702+0000","last_clean":"2024-04-24T02:14:30.040702+0000","last_became_active":"2024-04-24T02:12:45.817240+0000","last_became_peered":"2024-04-24T02:12:45.817240+0000","last_unstale":"2024-04-24T02:14:30.040702+0000","last_undegraded":"2024-04-24T02:14:30.040702+0000","last_fullsized":"2024-04-24T02:14:30.040702+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:30.040526+0000","last_change":"2024-04-24T02:12:06.766890+0000","last_active":"2024-04-24T02:14:30.040526+0000","last_peered":"2024-04-24T02:14:30.040526+0000","last_clean":"2024-04-24T02:14:30.040526+0000","last_became_active":"2024-04-24T02:12:06.764776+0000","last_became_peered":"2024-04-24T02:12:06.764776+0000","last_unstale":"2024-04-24T02:14:30.040526+0000","last_undegraded":"2024-04-24T02:14:30.040526+0000","last_fullsized":"2024-04-24T02:14:30.040526+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'47","reported_seq":119,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:39.994683+0000","last_change":"2024-04-24T02:15:39.994717+0000","last_active":"2024-04-24T02:15:39.994683+0000","last_peered":"2024-04-24T02:15:39.994683+0000","last_clean":"2024-04-24T02:15:39.994683+0000","last_became_active":"2024-04-24T02:12:08.768499+0000","last_became_peered":"2024-04-24T02:12:08.768499+0000","last_unstale":"2024-04-24T02:15:39.994683+0000","last_undegraded":"2024-04-24T02:15:39.994683+0000","last_fullsized":"2024-04-24T02:15:39.994683+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'47","last_scrub_stamp":"2024-04-24T02:15:39.994590+0000","last_deep_scrub":"32'47","last_deep_scrub_stamp":"2024-04-24T02:15:39.994590+0000","last_clean_scrub_stamp":"2024-04-24T02:15:39.994590+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:40:40.190436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:24.405718+0000","last_change":"2024-04-24T02:15:24.405740+0000","last_active":"2024-04-24T02:15:24.405718+0000","last_peered":"2024-04-24T02:15:24.405718+0000","last_clean":"2024-04-24T02:15:24.405718+0000","last_became_active":"2024-04-24T02:12:10.776882+0000","last_became_peered":"2024-04-24T02:12:10.776882+0000","last_unstale":"2024-04-24T02:15:24.405718+0000","last_undegraded":"2024-04-24T02:15:24.405718+0000","last_fullsized":"2024-04-24T02:15:24.405718+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:24.405592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:24.405592+0000","last_clean_scrub_stamp":"2024-04-24T02:15:24.405592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:41:19.659879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.469268+0000","last_change":"2024-04-24T02:12:12.794192+0000","last_active":"2024-04-24T02:15:13.469268+0000","last_peered":"2024-04-24T02:15:13.469268+0000","last_clean":"2024-04-24T02:15:13.469268+0000","last_became_active":"2024-04-24T02:12:12.793884+0000","last_became_peered":"2024-04-24T02:12:12.793884+0000","last_unstale":"2024-04-24T02:15:13.469268+0000","last_undegraded":"2024-04-24T02:15:13.469268+0000","last_fullsized":"2024-04-24T02:15:13.469268+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'6","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.264135+0000","last_change":"2024-04-24T02:12:04.768207+0000","last_active":"2024-04-24T02:15:13.264135+0000","last_peered":"2024-04-24T02:15:13.264135+0000","last_clean":"2024-04-24T02:15:13.264135+0000","last_became_active":"2024-04-24T02:12:04.767431+0000","last_became_peered":"2024-04-24T02:12:04.767431+0000","last_unstale":"2024-04-24T02:15:13.264135+0000","last_undegraded":"2024-04-24T02:15:13.264135+0000","last_fullsized":"2024-04-24T02:15:13.264135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:30.040880+0000","last_change":"2024-04-24T02:12:02.754566+0000","last_active":"2024-04-24T02:14:30.040880+0000","last_peered":"2024-04-24T02:14:30.040880+0000","last_clean":"2024-04-24T02:14:30.040880+0000","last_became_active":"2024-04-24T02:12:02.754295+0000","last_became_peered":"2024-04-24T02:12:02.754295+0000","last_unstale":"2024-04-24T02:14:30.040880+0000","last_undegraded":"2024-04-24T02:14:30.040880+0000","last_fullsized":"2024-04-24T02:14:30.040880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:24.382922+0000","last_change":"2024-04-24T02:15:24.382967+0000","last_active":"2024-04-24T02:15:24.382922+0000","last_peered":"2024-04-24T02:15:24.382922+0000","last_clean":"2024-04-24T02:15:24.382922+0000","last_became_active":"2024-04-24T02:12:06.758462+0000","last_became_peered":"2024-04-24T02:12:06.758462+0000","last_unstale":"2024-04-24T02:15:24.382922+0000","last_undegraded":"2024-04-24T02:15:24.382922+0000","last_fullsized":"2024-04-24T02:15:24.382922+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:24.382807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:24.382807+0000","last_clean_scrub_stamp":"2024-04-24T02:15:24.382807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:05:42.611375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'36","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:39.388995+0000","last_change":"2024-04-24T02:15:39.389030+0000","last_active":"2024-04-24T02:15:39.388995+0000","last_peered":"2024-04-24T02:15:39.388995+0000","last_clean":"2024-04-24T02:15:39.388995+0000","last_became_active":"2024-04-24T02:12:08.768814+0000","last_became_peered":"2024-04-24T02:12:08.768814+0000","last_unstale":"2024-04-24T02:15:39.388995+0000","last_undegraded":"2024-04-24T02:15:39.388995+0000","last_fullsized":"2024-04-24T02:15:39.388995+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-04-24T02:15:39.388901+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-04-24T02:15:39.388901+0000","last_clean_scrub_stamp":"2024-04-24T02:15:39.388901+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:55:16.313182+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:27.445785+0000","last_change":"2024-04-24T02:15:27.445811+0000","last_active":"2024-04-24T02:15:27.445785+0000","last_peered":"2024-04-24T02:15:27.445785+0000","last_clean":"2024-04-24T02:15:27.445785+0000","last_became_active":"2024-04-24T02:12:10.779734+0000","last_became_peered":"2024-04-24T02:12:10.779734+0000","last_unstale":"2024-04-24T02:15:27.445785+0000","last_undegraded":"2024-04-24T02:15:27.445785+0000","last_fullsized":"2024-04-24T02:15:27.445785+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:27.445677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:27.445677+0000","last_clean_scrub_stamp":"2024-04-24T02:15:27.445677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:47:29.069695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'1","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.522884+0000","last_change":"2024-04-24T02:12:04.764834+0000","last_active":"2024-04-24T02:15:13.522884+0000","last_peered":"2024-04-24T02:15:13.522884+0000","last_clean":"2024-04-24T02:15:13.522884+0000","last_became_active":"2024-04-24T02:12:04.764564+0000","last_became_peered":"2024-04-24T02:12:04.764564+0000","last_unstale":"2024-04-24T02:15:13.522884+0000","last_undegraded":"2024-04-24T02:15:13.522884+0000","last_fullsized":"2024-04-24T02:15:13.522884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.041779+0000","last_change":"2024-04-24T02:12:45.809612+0000","last_active":"2024-04-24T02:15:13.041779+0000","last_peered":"2024-04-24T02:15:13.041779+0000","last_clean":"2024-04-24T02:15:13.041779+0000","last_became_active":"2024-04-24T02:12:45.809365+0000","last_became_peered":"2024-04-24T02:12:45.809365+0000","last_unstale":"2024-04-24T02:15:13.041779+0000","last_undegraded":"2024-04-24T02:15:13.041779+0000","last_fullsized":"2024-04-24T02:15:13.041779+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:45.043161+0000","last_change":"2024-04-24T02:12:45.815335+0000","last_active":"2024-04-24T02:14:45.043161+0000","last_peered":"2024-04-24T02:14:45.043161+0000","last_clean":"2024-04-24T02:14:45.043161+0000","last_became_active":"2024-04-24T02:12:45.814918+0000","last_became_peered":"2024-04-24T02:12:45.814918+0000","last_unstale":"2024-04-24T02:14:45.043161+0000","last_undegraded":"2024-04-24T02:14:45.043161+0000","last_fullsized":"2024-04-24T02:14:45.043161+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"32'72","reported_seq":151,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:38.006044+0000","last_change":"2024-04-24T02:15:38.006098+0000","last_active":"2024-04-24T02:15:38.006044+0000","last_peered":"2024-04-24T02:15:38.006044+0000","last_clean":"2024-04-24T02:15:38.006044+0000","last_became_active":"2024-04-24T02:12:08.769578+0000","last_became_peered":"2024-04-24T02:12:08.769578+0000","last_unstale":"2024-04-24T02:15:38.006044+0000","last_undegraded":"2024-04-24T02:15:38.006044+0000","last_fullsized":"2024-04-24T02:15:38.006044+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'72","last_scrub_stamp":"2024-04-24T02:15:38.005928+0000","last_deep_scrub":"32'72","last_deep_scrub_stamp":"2024-04-24T02:15:38.005928+0000","last_clean_scrub_stamp":"2024-04-24T02:15:38.005928+0000","objects_scrubbed":6,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:38:25.392507+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:28.440238+0000","last_change":"2024-04-24T02:15:28.440262+0000","last_active":"2024-04-24T02:15:28.440238+0000","last_peered":"2024-04-24T02:15:28.440238+0000","last_clean":"2024-04-24T02:15:28.440238+0000","last_became_active":"2024-04-24T02:12:10.779703+0000","last_became_peered":"2024-04-24T02:12:10.779703+0000","last_unstale":"2024-04-24T02:15:28.440238+0000","last_undegraded":"2024-04-24T02:15:28.440238+0000","last_fullsized":"2024-04-24T02:15:28.440238+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:28.440118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:28.440118+0000","last_clean_scrub_stamp":"2024-04-24T02:15:28.440118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:28:48.467792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'16","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:33.036805+0000","last_change":"2024-04-24T02:12:12.791870+0000","last_active":"2024-04-24T02:14:33.036805+0000","last_peered":"2024-04-24T02:14:33.036805+0000","last_clean":"2024-04-24T02:14:33.036805+0000","last_became_active":"2024-04-24T02:12:12.791623+0000","last_became_peered":"2024-04-24T02:12:12.791623+0000","last_unstale":"2024-04-24T02:14:33.036805+0000","last_undegraded":"2024-04-24T02:14:33.036805+0000","last_fullsized":"2024-04-24T02:14:33.036805+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'10","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:09.640216+0000","last_change":"2024-04-24T02:12:04.755894+0000","last_active":"2024-04-24T02:14:09.640216+0000","last_peered":"2024-04-24T02:14:09.640216+0000","last_clean":"2024-04-24T02:14:09.640216+0000","last_became_active":"2024-04-24T02:12:04.755554+0000","last_became_peered":"2024-04-24T02:12:04.755554+0000","last_unstale":"2024-04-24T02:14:09.640216+0000","last_undegraded":"2024-04-24T02:14:09.640216+0000","last_fullsized":"2024-04-24T02:14:09.640216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:30.040692+0000","last_change":"2024-04-24T02:12:02.752017+0000","last_active":"2024-04-24T02:14:30.040692+0000","last_peered":"2024-04-24T02:14:30.040692+0000","last_clean":"2024-04-24T02:14:30.040692+0000","last_became_active":"2024-04-24T02:12:02.751703+0000","last_became_peered":"2024-04-24T02:12:02.751703+0000","last_unstale":"2024-04-24T02:14:30.040692+0000","last_undegraded":"2024-04-24T02:14:30.040692+0000","last_fullsized":"2024-04-24T02:14:30.040692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:15.038235+0000","last_change":"2024-04-24T02:12:06.756434+0000","last_active":"2024-04-24T02:14:15.038235+0000","last_peered":"2024-04-24T02:14:15.038235+0000","last_clean":"2024-04-24T02:14:15.038235+0000","last_became_active":"2024-04-24T02:12:06.756154+0000","last_became_peered":"2024-04-24T02:12:06.756154+0000","last_unstale":"2024-04-24T02:14:15.038235+0000","last_undegraded":"2024-04-24T02:14:15.038235+0000","last_fullsized":"2024-04-24T02:14:15.038235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'39","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:20.065413+0000","last_change":"2024-04-24T02:12:08.780969+0000","last_active":"2024-04-24T02:15:20.065413+0000","last_peered":"2024-04-24T02:15:20.065413+0000","last_clean":"2024-04-24T02:15:20.065413+0000","last_became_active":"2024-04-24T02:12:08.780215+0000","last_became_peered":"2024-04-24T02:12:08.780215+0000","last_unstale":"2024-04-24T02:15:20.065413+0000","last_undegraded":"2024-04-24T02:15:20.065413+0000","last_fullsized":"2024-04-24T02:15:20.065413+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:34.421645+0000","last_change":"2024-04-24T02:15:34.421669+0000","last_active":"2024-04-24T02:15:34.421645+0000","last_peered":"2024-04-24T02:15:34.421645+0000","last_clean":"2024-04-24T02:15:34.421645+0000","last_became_active":"2024-04-24T02:12:10.785707+0000","last_became_peered":"2024-04-24T02:12:10.785707+0000","last_unstale":"2024-04-24T02:15:34.421645+0000","last_undegraded":"2024-04-24T02:15:34.421645+0000","last_fullsized":"2024-04-24T02:15:34.421645+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:34.421551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:34.421551+0000","last_clean_scrub_stamp":"2024-04-24T02:15:34.421551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:44:00.829320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:35.042215+0000","last_change":"2024-04-24T02:12:12.798843+0000","last_active":"2024-04-24T02:14:35.042215+0000","last_peered":"2024-04-24T02:14:35.042215+0000","last_clean":"2024-04-24T02:14:35.042215+0000","last_became_active":"2024-04-24T02:12:12.798498+0000","last_became_peered":"2024-04-24T02:12:12.798498+0000","last_unstale":"2024-04-24T02:14:35.042215+0000","last_undegraded":"2024-04-24T02:14:35.042215+0000","last_fullsized":"2024-04-24T02:14:35.042215+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:35.413292+0000","last_change":"2024-04-24T02:15:35.413344+0000","last_active":"2024-04-24T02:15:35.413292+0000","last_peered":"2024-04-24T02:15:35.413292+0000","last_clean":"2024-04-24T02:15:35.413292+0000","last_became_active":"2024-04-24T02:12:04.768285+0000","last_became_peered":"2024-04-24T02:12:04.768285+0000","last_unstale":"2024-04-24T02:15:35.413292+0000","last_undegraded":"2024-04-24T02:15:35.413292+0000","last_fullsized":"2024-04-24T02:15:35.413292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:35.413190+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:35.413190+0000","last_clean_scrub_stamp":"2024-04-24T02:15:35.413190+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:52:59.536845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:35.041605+0000","last_change":"2024-04-24T02:12:02.749703+0000","last_active":"2024-04-24T02:14:35.041605+0000","last_peered":"2024-04-24T02:14:35.041605+0000","last_clean":"2024-04-24T02:14:35.041605+0000","last_became_active":"2024-04-24T02:12:02.749461+0000","last_became_peered":"2024-04-24T02:12:02.749461+0000","last_unstale":"2024-04-24T02:14:35.041605+0000","last_undegraded":"2024-04-24T02:14:35.041605+0000","last_fullsized":"2024-04-24T02:14:35.041605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:40.042396+0000","last_change":"2024-04-24T02:12:06.758054+0000","last_active":"2024-04-24T02:14:40.042396+0000","last_peered":"2024-04-24T02:14:40.042396+0000","last_clean":"2024-04-24T02:14:40.042396+0000","last_became_active":"2024-04-24T02:12:06.757760+0000","last_became_peered":"2024-04-24T02:12:06.757760+0000","last_unstale":"2024-04-24T02:14:40.042396+0000","last_undegraded":"2024-04-24T02:14:40.042396+0000","last_fullsized":"2024-04-24T02:14:40.042396+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'46","reported_seq":108,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:34.024624+0000","last_change":"2024-04-24T02:15:34.024663+0000","last_active":"2024-04-24T02:15:34.024624+0000","last_peered":"2024-04-24T02:15:34.024624+0000","last_clean":"2024-04-24T02:15:34.024624+0000","last_became_active":"2024-04-24T02:12:08.779471+0000","last_became_peered":"2024-04-24T02:12:08.779471+0000","last_unstale":"2024-04-24T02:15:34.024624+0000","last_undegraded":"2024-04-24T02:15:34.024624+0000","last_fullsized":"2024-04-24T02:15:34.024624+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-04-24T02:15:34.024534+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-04-24T02:15:34.024534+0000","last_clean_scrub_stamp":"2024-04-24T02:15:34.024534+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:54:19.092809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:26.055779+0000","last_change":"2024-04-24T02:15:26.055802+0000","last_active":"2024-04-24T02:15:26.055779+0000","last_peered":"2024-04-24T02:15:26.055779+0000","last_clean":"2024-04-24T02:15:26.055779+0000","last_became_active":"2024-04-24T02:12:10.780272+0000","last_became_peered":"2024-04-24T02:12:10.780272+0000","last_unstale":"2024-04-24T02:15:26.055779+0000","last_undegraded":"2024-04-24T02:15:26.055779+0000","last_fullsized":"2024-04-24T02:15:26.055779+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:26.055680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:26.055680+0000","last_clean_scrub_stamp":"2024-04-24T02:15:26.055680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:52:00.699214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:35.042130+0000","last_change":"2024-04-24T02:12:12.795264+0000","last_active":"2024-04-24T02:14:35.042130+0000","last_peered":"2024-04-24T02:14:35.042130+0000","last_clean":"2024-04-24T02:14:35.042130+0000","last_became_active":"2024-04-24T02:12:12.794815+0000","last_became_peered":"2024-04-24T02:12:12.794815+0000","last_unstale":"2024-04-24T02:14:35.042130+0000","last_undegraded":"2024-04-24T02:14:35.042130+0000","last_fullsized":"2024-04-24T02:14:35.042130+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.472520+0000","last_change":"2024-04-24T02:12:04.750861+0000","last_active":"2024-04-24T02:15:13.472520+0000","last_peered":"2024-04-24T02:15:13.472520+0000","last_clean":"2024-04-24T02:15:13.472520+0000","last_became_active":"2024-04-24T02:12:04.750546+0000","last_became_peered":"2024-04-24T02:12:04.750546+0000","last_unstale":"2024-04-24T02:15:13.472520+0000","last_undegraded":"2024-04-24T02:15:13.472520+0000","last_fullsized":"2024-04-24T02:15:13.472520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:35.042280+0000","last_change":"2024-04-24T02:12:02.758862+0000","last_active":"2024-04-24T02:14:35.042280+0000","last_peered":"2024-04-24T02:14:35.042280+0000","last_clean":"2024-04-24T02:14:35.042280+0000","last_became_active":"2024-04-24T02:12:02.757728+0000","last_became_peered":"2024-04-24T02:12:02.757728+0000","last_unstale":"2024-04-24T02:14:35.042280+0000","last_undegraded":"2024-04-24T02:14:35.042280+0000","last_fullsized":"2024-04-24T02:14:35.042280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:40.042584+0000","last_change":"2024-04-24T02:12:06.757498+0000","last_active":"2024-04-24T02:14:40.042584+0000","last_peered":"2024-04-24T02:14:40.042584+0000","last_clean":"2024-04-24T02:14:40.042584+0000","last_became_active":"2024-04-24T02:12:06.757145+0000","last_became_peered":"2024-04-24T02:12:06.757145+0000","last_unstale":"2024-04-24T02:14:40.042584+0000","last_undegraded":"2024-04-24T02:14:40.042584+0000","last_fullsized":"2024-04-24T02:14:40.042584+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'16","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:10.038359+0000","last_change":"2024-04-24T02:12:08.782279+0000","last_active":"2024-04-24T02:14:10.038359+0000","last_peered":"2024-04-24T02:14:10.038359+0000","last_clean":"2024-04-24T02:14:10.038359+0000","last_became_active":"2024-04-24T02:12:08.781974+0000","last_became_peered":"2024-04-24T02:12:08.781974+0000","last_unstale":"2024-04-24T02:14:10.038359+0000","last_undegraded":"2024-04-24T02:14:10.038359+0000","last_fullsized":"2024-04-24T02:14:10.038359+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'285","reported_seq":382,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:30.498772+0000","last_change":"2024-04-24T02:15:30.498799+0000","last_active":"2024-04-24T02:15:30.498772+0000","last_peered":"2024-04-24T02:15:30.498772+0000","last_clean":"2024-04-24T02:15:30.498772+0000","last_became_active":"2024-04-24T02:12:10.786972+0000","last_became_peered":"2024-04-24T02:12:10.786972+0000","last_unstale":"2024-04-24T02:15:30.498772+0000","last_undegraded":"2024-04-24T02:15:30.498772+0000","last_fullsized":"2024-04-24T02:15:30.498772+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-24T02:15:30.498687+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-24T02:15:30.498687+0000","last_clean_scrub_stamp":"2024-04-24T02:15:30.498687+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:36:15.522512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'4","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:35.042068+0000","last_change":"2024-04-24T02:12:12.795734+0000","last_active":"2024-04-24T02:14:35.042068+0000","last_peered":"2024-04-24T02:14:35.042068+0000","last_clean":"2024-04-24T02:14:35.042068+0000","last_became_active":"2024-04-24T02:12:12.795013+0000","last_became_peered":"2024-04-24T02:12:12.795013+0000","last_unstale":"2024-04-24T02:14:35.042068+0000","last_undegraded":"2024-04-24T02:14:35.042068+0000","last_fullsized":"2024-04-24T02:14:35.042068+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'12","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.265479+0000","last_change":"2024-04-24T02:12:04.752294+0000","last_active":"2024-04-24T02:15:13.265479+0000","last_peered":"2024-04-24T02:15:13.265479+0000","last_clean":"2024-04-24T02:15:13.265479+0000","last_became_active":"2024-04-24T02:12:04.751676+0000","last_became_peered":"2024-04-24T02:12:04.751676+0000","last_unstale":"2024-04-24T02:15:13.265479+0000","last_undegraded":"2024-04-24T02:15:13.265479+0000","last_fullsized":"2024-04-24T02:15:13.265479+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:35.041646+0000","last_change":"2024-04-24T02:12:02.756088+0000","last_active":"2024-04-24T02:14:35.041646+0000","last_peered":"2024-04-24T02:14:35.041646+0000","last_clean":"2024-04-24T02:14:35.041646+0000","last_became_active":"2024-04-24T02:12:02.755512+0000","last_became_peered":"2024-04-24T02:12:02.755512+0000","last_unstale":"2024-04-24T02:14:35.041646+0000","last_undegraded":"2024-04-24T02:14:35.041646+0000","last_fullsized":"2024-04-24T02:14:35.041646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:40.042525+0000","last_change":"2024-04-24T02:12:06.757421+0000","last_active":"2024-04-24T02:14:40.042525+0000","last_peered":"2024-04-24T02:14:40.042525+0000","last_clean":"2024-04-24T02:14:40.042525+0000","last_became_active":"2024-04-24T02:12:06.756909+0000","last_became_peered":"2024-04-24T02:12:06.756909+0000","last_unstale":"2024-04-24T02:14:40.042525+0000","last_undegraded":"2024-04-24T02:14:40.042525+0000","last_fullsized":"2024-04-24T02:14:40.042525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'73","reported_seq":155,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:31.331803+0000","last_change":"2024-04-24T02:15:31.331846+0000","last_active":"2024-04-24T02:15:31.331803+0000","last_peered":"2024-04-24T02:15:31.331803+0000","last_clean":"2024-04-24T02:15:31.331803+0000","last_became_active":"2024-04-24T02:12:08.770255+0000","last_became_peered":"2024-04-24T02:12:08.770255+0000","last_unstale":"2024-04-24T02:15:31.331803+0000","last_undegraded":"2024-04-24T02:15:31.331803+0000","last_fullsized":"2024-04-24T02:15:31.331803+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'73","last_scrub_stamp":"2024-04-24T02:15:31.331721+0000","last_deep_scrub":"32'73","last_deep_scrub_stamp":"2024-04-24T02:15:31.331721+0000","last_clean_scrub_stamp":"2024-04-24T02:15:31.331721+0000","objects_scrubbed":11,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:04:50.870204+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:39.022379+0000","last_change":"2024-04-24T02:15:39.022402+0000","last_active":"2024-04-24T02:15:39.022379+0000","last_peered":"2024-04-24T02:15:39.022379+0000","last_clean":"2024-04-24T02:15:39.022379+0000","last_became_active":"2024-04-24T02:12:10.785811+0000","last_became_peered":"2024-04-24T02:12:10.785811+0000","last_unstale":"2024-04-24T02:15:39.022379+0000","last_undegraded":"2024-04-24T02:15:39.022379+0000","last_fullsized":"2024-04-24T02:15:39.022379+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:39.022286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:39.022286+0000","last_clean_scrub_stamp":"2024-04-24T02:15:39.022286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:12:21.461638+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:40.042632+0000","last_change":"2024-04-24T02:12:12.799813+0000","last_active":"2024-04-24T02:14:40.042632+0000","last_peered":"2024-04-24T02:14:40.042632+0000","last_clean":"2024-04-24T02:14:40.042632+0000","last_became_active":"2024-04-24T02:12:12.799557+0000","last_became_peered":"2024-04-24T02:12:12.799557+0000","last_unstale":"2024-04-24T02:14:40.042632+0000","last_undegraded":"2024-04-24T02:14:40.042632+0000","last_fullsized":"2024-04-24T02:14:40.042632+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'18","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.356154+0000","last_change":"2024-04-24T02:12:04.748652+0000","last_active":"2024-04-24T02:15:13.356154+0000","last_peered":"2024-04-24T02:15:13.356154+0000","last_clean":"2024-04-24T02:15:13.356154+0000","last_became_active":"2024-04-24T02:12:04.748399+0000","last_became_peered":"2024-04-24T02:12:04.748399+0000","last_unstale":"2024-04-24T02:15:13.356154+0000","last_undegraded":"2024-04-24T02:15:13.356154+0000","last_fullsized":"2024-04-24T02:15:13.356154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":55,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:35.042408+0000","last_change":"2024-04-24T02:12:02.761810+0000","last_active":"2024-04-24T02:14:35.042408+0000","last_peered":"2024-04-24T02:14:35.042408+0000","last_clean":"2024-04-24T02:14:35.042408+0000","last_became_active":"2024-04-24T02:12:02.760772+0000","last_became_peered":"2024-04-24T02:12:02.760772+0000","last_unstale":"2024-04-24T02:14:35.042408+0000","last_undegraded":"2024-04-24T02:14:35.042408+0000","last_fullsized":"2024-04-24T02:14:35.042408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:40.042364+0000","last_change":"2024-04-24T02:12:06.765015+0000","last_active":"2024-04-24T02:14:40.042364+0000","last_peered":"2024-04-24T02:14:40.042364+0000","last_clean":"2024-04-24T02:14:40.042364+0000","last_became_active":"2024-04-24T02:12:06.764475+0000","last_became_peered":"2024-04-24T02:12:06.764475+0000","last_unstale":"2024-04-24T02:14:40.042364+0000","last_undegraded":"2024-04-24T02:14:40.042364+0000","last_fullsized":"2024-04-24T02:14:40.042364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'44","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:36.026642+0000","last_change":"2024-04-24T02:15:36.026681+0000","last_active":"2024-04-24T02:15:36.026642+0000","last_peered":"2024-04-24T02:15:36.026642+0000","last_clean":"2024-04-24T02:15:36.026642+0000","last_became_active":"2024-04-24T02:12:08.779447+0000","last_became_peered":"2024-04-24T02:12:08.779447+0000","last_unstale":"2024-04-24T02:15:36.026642+0000","last_undegraded":"2024-04-24T02:15:36.026642+0000","last_fullsized":"2024-04-24T02:15:36.026642+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'44","last_scrub_stamp":"2024-04-24T02:15:36.026532+0000","last_deep_scrub":"32'44","last_deep_scrub_stamp":"2024-04-24T02:15:36.026532+0000","last_clean_scrub_stamp":"2024-04-24T02:15:36.026532+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:44:38.935524+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:35.042151+0000","last_change":"2024-04-24T02:12:10.783395+0000","last_active":"2024-04-24T02:14:35.042151+0000","last_peered":"2024-04-24T02:14:35.042151+0000","last_clean":"2024-04-24T02:14:35.042151+0000","last_became_active":"2024-04-24T02:12:10.782019+0000","last_became_peered":"2024-04-24T02:12:10.782019+0000","last_unstale":"2024-04-24T02:14:35.042151+0000","last_undegraded":"2024-04-24T02:14:35.042151+0000","last_fullsized":"2024-04-24T02:14:35.042151+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:40.043129+0000","last_change":"2024-04-24T02:12:12.797073+0000","last_active":"2024-04-24T02:14:40.043129+0000","last_peered":"2024-04-24T02:14:40.043129+0000","last_clean":"2024-04-24T02:14:40.043129+0000","last_became_active":"2024-04-24T02:12:12.796494+0000","last_became_peered":"2024-04-24T02:12:12.796494+0000","last_unstale":"2024-04-24T02:14:40.043129+0000","last_undegraded":"2024-04-24T02:14:40.043129+0000","last_fullsized":"2024-04-24T02:14:40.043129+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'10","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.355769+0000","last_change":"2024-04-24T02:12:04.763788+0000","last_active":"2024-04-24T02:15:13.355769+0000","last_peered":"2024-04-24T02:15:13.355769+0000","last_clean":"2024-04-24T02:15:13.355769+0000","last_became_active":"2024-04-24T02:12:04.763263+0000","last_became_peered":"2024-04-24T02:12:04.763263+0000","last_unstale":"2024-04-24T02:15:13.355769+0000","last_undegraded":"2024-04-24T02:15:13.355769+0000","last_fullsized":"2024-04-24T02:15:13.355769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:03.032402+0000","last_change":"2024-04-24T02:12:02.745999+0000","last_active":"2024-04-24T02:14:03.032402+0000","last_peered":"2024-04-24T02:14:03.032402+0000","last_clean":"2024-04-24T02:14:03.032402+0000","last_became_active":"2024-04-24T02:12:02.745617+0000","last_became_peered":"2024-04-24T02:12:02.745617+0000","last_unstale":"2024-04-24T02:14:03.032402+0000","last_undegraded":"2024-04-24T02:14:03.032402+0000","last_fullsized":"2024-04-24T02:14:03.032402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:33.375869+0000","last_change":"2024-04-24T02:15:33.375893+0000","last_active":"2024-04-24T02:15:33.375869+0000","last_peered":"2024-04-24T02:15:33.375869+0000","last_clean":"2024-04-24T02:15:33.375869+0000","last_became_active":"2024-04-24T02:12:06.765644+0000","last_became_peered":"2024-04-24T02:12:06.765644+0000","last_unstale":"2024-04-24T02:15:33.375869+0000","last_undegraded":"2024-04-24T02:15:33.375869+0000","last_fullsized":"2024-04-24T02:15:33.375869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:33.375779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:33.375779+0000","last_clean_scrub_stamp":"2024-04-24T02:15:33.375779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:09:27.434014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'36","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:20.118826+0000","last_change":"2024-04-24T02:12:08.780672+0000","last_active":"2024-04-24T02:15:20.118826+0000","last_peered":"2024-04-24T02:15:20.118826+0000","last_clean":"2024-04-24T02:15:20.118826+0000","last_became_active":"2024-04-24T02:12:08.780056+0000","last_became_peered":"2024-04-24T02:12:08.780056+0000","last_unstale":"2024-04-24T02:15:20.118826+0000","last_undegraded":"2024-04-24T02:15:20.118826+0000","last_fullsized":"2024-04-24T02:15:20.118826+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:07.752700+0000","last_clean_scrub_stamp":"2024-04-24T02:12:07.752700+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:40.043024+0000","last_change":"2024-04-24T02:12:10.785977+0000","last_active":"2024-04-24T02:14:40.043024+0000","last_peered":"2024-04-24T02:14:40.043024+0000","last_clean":"2024-04-24T02:14:40.043024+0000","last_became_active":"2024-04-24T02:12:10.785396+0000","last_became_peered":"2024-04-24T02:12:10.785396+0000","last_unstale":"2024-04-24T02:14:40.043024+0000","last_undegraded":"2024-04-24T02:14:40.043024+0000","last_fullsized":"2024-04-24T02:14:40.043024+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:40.043098+0000","last_change":"2024-04-24T02:12:12.794051+0000","last_active":"2024-04-24T02:14:40.043098+0000","last_peered":"2024-04-24T02:14:40.043098+0000","last_clean":"2024-04-24T02:14:40.043098+0000","last_became_active":"2024-04-24T02:12:12.793796+0000","last_became_peered":"2024-04-24T02:12:12.793796+0000","last_unstale":"2024-04-24T02:14:40.043098+0000","last_undegraded":"2024-04-24T02:14:40.043098+0000","last_fullsized":"2024-04-24T02:14:40.043098+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'18","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.524910+0000","last_change":"2024-04-24T02:12:04.749487+0000","last_active":"2024-04-24T02:15:13.524910+0000","last_peered":"2024-04-24T02:15:13.524910+0000","last_clean":"2024-04-24T02:15:13.524910+0000","last_became_active":"2024-04-24T02:12:04.749055+0000","last_became_peered":"2024-04-24T02:12:04.749055+0000","last_unstale":"2024-04-24T02:15:13.524910+0000","last_undegraded":"2024-04-24T02:15:13.524910+0000","last_fullsized":"2024-04-24T02:15:13.524910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:10.037824+0000","last_change":"2024-04-24T02:12:02.747590+0000","last_active":"2024-04-24T02:14:10.037824+0000","last_peered":"2024-04-24T02:14:10.037824+0000","last_clean":"2024-04-24T02:14:10.037824+0000","last_became_active":"2024-04-24T02:12:02.745895+0000","last_became_peered":"2024-04-24T02:12:02.745895+0000","last_unstale":"2024-04-24T02:14:10.037824+0000","last_undegraded":"2024-04-24T02:14:10.037824+0000","last_fullsized":"2024-04-24T02:14:10.037824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'8","reported_seq":241,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:35.456109+0000","last_change":"2024-04-24T02:15:35.456160+0000","last_active":"2024-04-24T02:15:35.456109+0000","last_peered":"2024-04-24T02:15:35.456109+0000","last_clean":"2024-04-24T02:15:35.456109+0000","last_became_active":"2024-04-24T02:12:06.765096+0000","last_became_peered":"2024-04-24T02:12:06.765096+0000","last_unstale":"2024-04-24T02:15:35.456109+0000","last_undegraded":"2024-04-24T02:15:35.456109+0000","last_fullsized":"2024-04-24T02:15:35.456109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-24T02:15:35.456000+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-24T02:15:35.456000+0000","last_clean_scrub_stamp":"2024-04-24T02:15:35.456000+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:58:11.323688+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'53","reported_seq":122,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:30.313073+0000","last_change":"2024-04-24T02:15:30.313116+0000","last_active":"2024-04-24T02:15:30.313073+0000","last_peered":"2024-04-24T02:15:30.313073+0000","last_clean":"2024-04-24T02:15:30.313073+0000","last_became_active":"2024-04-24T02:12:08.779892+0000","last_became_peered":"2024-04-24T02:12:08.779892+0000","last_unstale":"2024-04-24T02:15:30.313073+0000","last_undegraded":"2024-04-24T02:15:30.313073+0000","last_fullsized":"2024-04-24T02:15:30.313073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'53","last_scrub_stamp":"2024-04-24T02:15:30.312975+0000","last_deep_scrub":"32'53","last_deep_scrub_stamp":"2024-04-24T02:15:30.312975+0000","last_clean_scrub_stamp":"2024-04-24T02:15:30.312975+0000","objects_scrubbed":7,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:50:47.143315+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:25.040176+0000","last_change":"2024-04-24T02:15:25.040213+0000","last_active":"2024-04-24T02:15:25.040176+0000","last_peered":"2024-04-24T02:15:25.040176+0000","last_clean":"2024-04-24T02:15:25.040176+0000","last_became_active":"2024-04-24T02:12:10.781588+0000","last_became_peered":"2024-04-24T02:12:10.781588+0000","last_unstale":"2024-04-24T02:15:25.040176+0000","last_undegraded":"2024-04-24T02:15:25.040176+0000","last_fullsized":"2024-04-24T02:15:25.040176+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:25.040045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:25.040045+0000","last_clean_scrub_stamp":"2024-04-24T02:15:25.040045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:17:46.062684+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'6","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.581009+0000","last_change":"2024-04-24T02:12:12.793599+0000","last_active":"2024-04-24T02:15:13.581009+0000","last_peered":"2024-04-24T02:15:13.581009+0000","last_clean":"2024-04-24T02:15:13.581009+0000","last_became_active":"2024-04-24T02:12:12.793310+0000","last_became_peered":"2024-04-24T02:12:12.793310+0000","last_unstale":"2024-04-24T02:15:13.581009+0000","last_undegraded":"2024-04-24T02:15:13.581009+0000","last_fullsized":"2024-04-24T02:15:13.581009+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'4","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.473987+0000","last_change":"2024-04-24T02:12:04.767702+0000","last_active":"2024-04-24T02:15:13.473987+0000","last_peered":"2024-04-24T02:15:13.473987+0000","last_clean":"2024-04-24T02:15:13.473987+0000","last_became_active":"2024-04-24T02:12:04.766869+0000","last_became_peered":"2024-04-24T02:12:04.766869+0000","last_unstale":"2024-04-24T02:15:13.473987+0000","last_undegraded":"2024-04-24T02:15:13.473987+0000","last_fullsized":"2024-04-24T02:15:13.473987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:10.037353+0000","last_change":"2024-04-24T02:12:02.750537+0000","last_active":"2024-04-24T02:14:10.037353+0000","last_peered":"2024-04-24T02:14:10.037353+0000","last_clean":"2024-04-24T02:14:10.037353+0000","last_became_active":"2024-04-24T02:12:02.746992+0000","last_became_peered":"2024-04-24T02:12:02.746992+0000","last_unstale":"2024-04-24T02:14:10.037353+0000","last_undegraded":"2024-04-24T02:14:10.037353+0000","last_fullsized":"2024-04-24T02:14:10.037353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:18.034674+0000","last_change":"2024-04-24T02:12:04.749519+0000","last_active":"2024-04-24T02:14:18.034674+0000","last_peered":"2024-04-24T02:14:18.034674+0000","last_clean":"2024-04-24T02:14:18.034674+0000","last_became_active":"2024-04-24T02:12:04.749165+0000","last_became_peered":"2024-04-24T02:12:04.749165+0000","last_unstale":"2024-04-24T02:14:18.034674+0000","last_undegraded":"2024-04-24T02:14:18.034674+0000","last_fullsized":"2024-04-24T02:14:18.034674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'6","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.346935+0000","last_change":"2024-04-24T02:12:02.751924+0000","last_active":"2024-04-24T02:15:13.346935+0000","last_peered":"2024-04-24T02:15:13.346935+0000","last_clean":"2024-04-24T02:15:13.346935+0000","last_became_active":"2024-04-24T02:12:02.751613+0000","last_became_peered":"2024-04-24T02:12:02.751613+0000","last_unstale":"2024-04-24T02:15:13.346935+0000","last_undegraded":"2024-04-24T02:15:13.346935+0000","last_fullsized":"2024-04-24T02:15:13.346935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.471986+0000","last_change":"2024-04-24T02:12:04.764660+0000","last_active":"2024-04-24T02:15:13.471986+0000","last_peered":"2024-04-24T02:15:13.471986+0000","last_clean":"2024-04-24T02:15:13.471986+0000","last_became_active":"2024-04-24T02:12:04.763819+0000","last_became_peered":"2024-04-24T02:12:04.763819+0000","last_unstale":"2024-04-24T02:15:13.471986+0000","last_undegraded":"2024-04-24T02:15:13.471986+0000","last_fullsized":"2024-04-24T02:15:13.471986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:10.038224+0000","last_change":"2024-04-24T02:12:02.758745+0000","last_active":"2024-04-24T02:14:10.038224+0000","last_peered":"2024-04-24T02:14:10.038224+0000","last_clean":"2024-04-24T02:14:10.038224+0000","last_became_active":"2024-04-24T02:12:02.757017+0000","last_became_peered":"2024-04-24T02:12:02.757017+0000","last_unstale":"2024-04-24T02:14:10.038224+0000","last_undegraded":"2024-04-24T02:14:10.038224+0000","last_fullsized":"2024-04-24T02:14:10.038224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.403654+0000","last_change":"2024-04-24T02:12:04.749624+0000","last_active":"2024-04-24T02:15:13.403654+0000","last_peered":"2024-04-24T02:15:13.403654+0000","last_clean":"2024-04-24T02:15:13.403654+0000","last_became_active":"2024-04-24T02:12:04.749305+0000","last_became_peered":"2024-04-24T02:12:04.749305+0000","last_unstale":"2024-04-24T02:15:13.403654+0000","last_undegraded":"2024-04-24T02:15:13.403654+0000","last_fullsized":"2024-04-24T02:15:13.403654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:08.033192+0000","last_change":"2024-04-24T02:12:02.741858+0000","last_active":"2024-04-24T02:14:08.033192+0000","last_peered":"2024-04-24T02:14:08.033192+0000","last_clean":"2024-04-24T02:14:08.033192+0000","last_became_active":"2024-04-24T02:12:02.741503+0000","last_became_peered":"2024-04-24T02:12:02.741503+0000","last_unstale":"2024-04-24T02:14:08.033192+0000","last_undegraded":"2024-04-24T02:14:08.033192+0000","last_fullsized":"2024-04-24T02:14:08.033192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.264731+0000","last_change":"2024-04-24T02:12:45.818489+0000","last_active":"2024-04-24T02:15:13.264731+0000","last_peered":"2024-04-24T02:15:13.264731+0000","last_clean":"2024-04-24T02:15:13.264731+0000","last_became_active":"2024-04-24T02:12:45.814356+0000","last_became_peered":"2024-04-24T02:12:45.814356+0000","last_unstale":"2024-04-24T02:15:13.264731+0000","last_undegraded":"2024-04-24T02:15:13.264731+0000","last_fullsized":"2024-04-24T02:15:13.264731+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.133232+0000","last_change":"2024-04-24T02:12:02.751995+0000","last_active":"2024-04-24T02:15:13.133232+0000","last_peered":"2024-04-24T02:15:13.133232+0000","last_clean":"2024-04-24T02:15:13.133232+0000","last_became_active":"2024-04-24T02:12:02.751680+0000","last_became_peered":"2024-04-24T02:12:02.751680+0000","last_unstale":"2024-04-24T02:15:13.133232+0000","last_undegraded":"2024-04-24T02:15:13.133232+0000","last_fullsized":"2024-04-24T02:15:13.133232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'8","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.401073+0000","last_change":"2024-04-24T02:12:45.817674+0000","last_active":"2024-04-24T02:15:13.401073+0000","last_peered":"2024-04-24T02:15:13.401073+0000","last_clean":"2024-04-24T02:15:13.401073+0000","last_became_active":"2024-04-24T02:12:45.813097+0000","last_became_peered":"2024-04-24T02:12:45.813097+0000","last_unstale":"2024-04-24T02:15:13.401073+0000","last_undegraded":"2024-04-24T02:15:13.401073+0000","last_fullsized":"2024-04-24T02:15:13.401073+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:20.096083+0000","last_change":"2024-04-24T02:12:02.754946+0000","last_active":"2024-04-24T02:15:20.096083+0000","last_peered":"2024-04-24T02:15:20.096083+0000","last_clean":"2024-04-24T02:15:20.096083+0000","last_became_active":"2024-04-24T02:12:02.754356+0000","last_became_peered":"2024-04-24T02:12:02.754356+0000","last_unstale":"2024-04-24T02:15:20.096083+0000","last_undegraded":"2024-04-24T02:15:20.096083+0000","last_fullsized":"2024-04-24T02:15:20.096083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'5","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.523238+0000","last_change":"2024-04-24T02:12:04.756117+0000","last_active":"2024-04-24T02:15:13.523238+0000","last_peered":"2024-04-24T02:15:13.523238+0000","last_clean":"2024-04-24T02:15:13.523238+0000","last_became_active":"2024-04-24T02:12:04.755738+0000","last_became_peered":"2024-04-24T02:12:04.755738+0000","last_unstale":"2024-04-24T02:15:13.523238+0000","last_undegraded":"2024-04-24T02:15:13.523238+0000","last_fullsized":"2024-04-24T02:15:13.523238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:15.038201+0000","last_change":"2024-04-24T02:12:02.756723+0000","last_active":"2024-04-24T02:14:15.038201+0000","last_peered":"2024-04-24T02:14:15.038201+0000","last_clean":"2024-04-24T02:14:15.038201+0000","last_became_active":"2024-04-24T02:12:02.755202+0000","last_became_peered":"2024-04-24T02:12:02.755202+0000","last_unstale":"2024-04-24T02:14:15.038201+0000","last_undegraded":"2024-04-24T02:14:15.038201+0000","last_fullsized":"2024-04-24T02:14:15.038201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"30'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:10.037666+0000","last_change":"2024-04-24T02:12:04.756072+0000","last_active":"2024-04-24T02:14:10.037666+0000","last_peered":"2024-04-24T02:14:10.037666+0000","last_clean":"2024-04-24T02:14:10.037666+0000","last_became_active":"2024-04-24T02:12:04.755194+0000","last_became_peered":"2024-04-24T02:12:04.755194+0000","last_unstale":"2024-04-24T02:14:10.037666+0000","last_undegraded":"2024-04-24T02:14:10.037666+0000","last_fullsized":"2024-04-24T02:14:10.037666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.462625+0000","last_change":"2024-04-24T02:12:02.752025+0000","last_active":"2024-04-24T02:15:13.462625+0000","last_peered":"2024-04-24T02:15:13.462625+0000","last_clean":"2024-04-24T02:15:13.462625+0000","last_became_active":"2024-04-24T02:12:02.751726+0000","last_became_peered":"2024-04-24T02:12:02.751726+0000","last_unstale":"2024-04-24T02:15:13.462625+0000","last_undegraded":"2024-04-24T02:15:13.462625+0000","last_fullsized":"2024-04-24T02:15:13.462625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'6","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:25.040097+0000","last_change":"2024-04-24T02:12:04.753374+0000","last_active":"2024-04-24T02:14:25.040097+0000","last_peered":"2024-04-24T02:14:25.040097+0000","last_clean":"2024-04-24T02:14:25.040097+0000","last_became_active":"2024-04-24T02:12:04.753074+0000","last_became_peered":"2024-04-24T02:12:04.753074+0000","last_unstale":"2024-04-24T02:14:25.040097+0000","last_undegraded":"2024-04-24T02:14:25.040097+0000","last_fullsized":"2024-04-24T02:14:25.040097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:20.095628+0000","last_change":"2024-04-24T02:12:02.755029+0000","last_active":"2024-04-24T02:15:20.095628+0000","last_peered":"2024-04-24T02:15:20.095628+0000","last_clean":"2024-04-24T02:15:20.095628+0000","last_became_active":"2024-04-24T02:12:02.754158+0000","last_became_peered":"2024-04-24T02:12:02.754158+0000","last_unstale":"2024-04-24T02:15:20.095628+0000","last_undegraded":"2024-04-24T02:15:20.095628+0000","last_fullsized":"2024-04-24T02:15:20.095628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'8","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:25.040696+0000","last_change":"2024-04-24T02:12:04.764100+0000","last_active":"2024-04-24T02:14:25.040696+0000","last_peered":"2024-04-24T02:14:25.040696+0000","last_clean":"2024-04-24T02:14:25.040696+0000","last_became_active":"2024-04-24T02:12:04.763136+0000","last_became_peered":"2024-04-24T02:12:04.763136+0000","last_unstale":"2024-04-24T02:14:25.040696+0000","last_undegraded":"2024-04-24T02:14:25.040696+0000","last_fullsized":"2024-04-24T02:14:25.040696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:18.034542+0000","last_change":"2024-04-24T02:12:02.741912+0000","last_active":"2024-04-24T02:14:18.034542+0000","last_peered":"2024-04-24T02:14:18.034542+0000","last_clean":"2024-04-24T02:14:18.034542+0000","last_became_active":"2024-04-24T02:12:02.741543+0000","last_became_peered":"2024-04-24T02:12:02.741543+0000","last_unstale":"2024-04-24T02:14:18.034542+0000","last_undegraded":"2024-04-24T02:14:18.034542+0000","last_fullsized":"2024-04-24T02:14:18.034542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:23.035430+0000","last_change":"2024-04-24T02:12:04.760381+0000","last_active":"2024-04-24T02:14:23.035430+0000","last_peered":"2024-04-24T02:14:23.035430+0000","last_clean":"2024-04-24T02:14:23.035430+0000","last_became_active":"2024-04-24T02:12:04.760028+0000","last_became_peered":"2024-04-24T02:12:04.760028+0000","last_unstale":"2024-04-24T02:14:23.035430+0000","last_undegraded":"2024-04-24T02:14:23.035430+0000","last_fullsized":"2024-04-24T02:14:23.035430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.339524+0000","last_change":"2024-04-24T02:12:02.750391+0000","last_active":"2024-04-24T02:15:13.339524+0000","last_peered":"2024-04-24T02:15:13.339524+0000","last_clean":"2024-04-24T02:15:13.339524+0000","last_became_active":"2024-04-24T02:12:02.750143+0000","last_became_peered":"2024-04-24T02:12:02.750143+0000","last_unstale":"2024-04-24T02:15:13.339524+0000","last_undegraded":"2024-04-24T02:15:13.339524+0000","last_fullsized":"2024-04-24T02:15:13.339524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.472554+0000","last_change":"2024-04-24T02:12:04.754976+0000","last_active":"2024-04-24T02:15:13.472554+0000","last_peered":"2024-04-24T02:15:13.472554+0000","last_clean":"2024-04-24T02:15:13.472554+0000","last_became_active":"2024-04-24T02:12:04.754738+0000","last_became_peered":"2024-04-24T02:12:04.754738+0000","last_unstale":"2024-04-24T02:15:13.472554+0000","last_undegraded":"2024-04-24T02:15:13.472554+0000","last_fullsized":"2024-04-24T02:15:13.472554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:20.039252+0000","last_change":"2024-04-24T02:12:02.746027+0000","last_active":"2024-04-24T02:14:20.039252+0000","last_peered":"2024-04-24T02:14:20.039252+0000","last_clean":"2024-04-24T02:14:20.039252+0000","last_became_active":"2024-04-24T02:12:02.744352+0000","last_became_peered":"2024-04-24T02:12:02.744352+0000","last_unstale":"2024-04-24T02:14:20.039252+0000","last_undegraded":"2024-04-24T02:14:20.039252+0000","last_fullsized":"2024-04-24T02:14:20.039252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'12","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.179335+0000","last_change":"2024-04-24T02:12:45.815138+0000","last_active":"2024-04-24T02:15:13.179335+0000","last_peered":"2024-04-24T02:15:13.179335+0000","last_clean":"2024-04-24T02:15:13.179335+0000","last_became_active":"2024-04-24T02:12:45.808774+0000","last_became_peered":"2024-04-24T02:12:45.808774+0000","last_unstale":"2024-04-24T02:15:13.179335+0000","last_undegraded":"2024-04-24T02:15:13.179335+0000","last_fullsized":"2024-04-24T02:15:13.179335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:20.039845+0000","last_change":"2024-04-24T02:12:02.758624+0000","last_active":"2024-04-24T02:14:20.039845+0000","last_peered":"2024-04-24T02:14:20.039845+0000","last_clean":"2024-04-24T02:14:20.039845+0000","last_became_active":"2024-04-24T02:12:02.757458+0000","last_became_peered":"2024-04-24T02:12:02.757458+0000","last_unstale":"2024-04-24T02:14:20.039845+0000","last_undegraded":"2024-04-24T02:14:20.039845+0000","last_fullsized":"2024-04-24T02:14:20.039845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'14","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.400976+0000","last_change":"2024-04-24T02:12:04.751238+0000","last_active":"2024-04-24T02:15:13.400976+0000","last_peered":"2024-04-24T02:15:13.400976+0000","last_clean":"2024-04-24T02:15:13.400976+0000","last_became_active":"2024-04-24T02:12:04.750973+0000","last_became_peered":"2024-04-24T02:12:04.750973+0000","last_unstale":"2024-04-24T02:15:13.400976+0000","last_undegraded":"2024-04-24T02:15:13.400976+0000","last_fullsized":"2024-04-24T02:15:13.400976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:20.039881+0000","last_change":"2024-04-24T02:12:02.761835+0000","last_active":"2024-04-24T02:14:20.039881+0000","last_peered":"2024-04-24T02:14:20.039881+0000","last_clean":"2024-04-24T02:14:20.039881+0000","last_became_active":"2024-04-24T02:12:02.761235+0000","last_became_peered":"2024-04-24T02:12:02.761235+0000","last_unstale":"2024-04-24T02:14:20.039881+0000","last_undegraded":"2024-04-24T02:14:20.039881+0000","last_fullsized":"2024-04-24T02:14:20.039881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'4","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.400669+0000","last_change":"2024-04-24T02:12:04.764009+0000","last_active":"2024-04-24T02:15:13.400669+0000","last_peered":"2024-04-24T02:15:13.400669+0000","last_clean":"2024-04-24T02:15:13.400669+0000","last_became_active":"2024-04-24T02:12:04.763517+0000","last_became_peered":"2024-04-24T02:12:04.763517+0000","last_unstale":"2024-04-24T02:15:13.400669+0000","last_undegraded":"2024-04-24T02:15:13.400669+0000","last_fullsized":"2024-04-24T02:15:13.400669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.341867+0000","last_change":"2024-04-24T02:12:02.754501+0000","last_active":"2024-04-24T02:15:13.341867+0000","last_peered":"2024-04-24T02:15:13.341867+0000","last_clean":"2024-04-24T02:15:13.341867+0000","last_became_active":"2024-04-24T02:12:02.754227+0000","last_became_peered":"2024-04-24T02:12:02.754227+0000","last_unstale":"2024-04-24T02:15:13.341867+0000","last_undegraded":"2024-04-24T02:15:13.341867+0000","last_fullsized":"2024-04-24T02:15:13.341867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.356096+0000","last_change":"2024-04-24T02:12:04.755937+0000","last_active":"2024-04-24T02:15:13.356096+0000","last_peered":"2024-04-24T02:15:13.356096+0000","last_clean":"2024-04-24T02:15:13.356096+0000","last_became_active":"2024-04-24T02:12:04.755661+0000","last_became_peered":"2024-04-24T02:12:04.755661+0000","last_unstale":"2024-04-24T02:15:13.356096+0000","last_undegraded":"2024-04-24T02:15:13.356096+0000","last_fullsized":"2024-04-24T02:15:13.356096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:25.040722+0000","last_change":"2024-04-24T02:12:02.761162+0000","last_active":"2024-04-24T02:14:25.040722+0000","last_peered":"2024-04-24T02:14:25.040722+0000","last_clean":"2024-04-24T02:14:25.040722+0000","last_became_active":"2024-04-24T02:12:02.758855+0000","last_became_peered":"2024-04-24T02:12:02.758855+0000","last_unstale":"2024-04-24T02:14:25.040722+0000","last_undegraded":"2024-04-24T02:14:25.040722+0000","last_fullsized":"2024-04-24T02:14:25.040722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:25.040481+0000","last_change":"2024-04-24T02:12:02.757416+0000","last_active":"2024-04-24T02:14:25.040481+0000","last_peered":"2024-04-24T02:14:25.040481+0000","last_clean":"2024-04-24T02:14:25.040481+0000","last_became_active":"2024-04-24T02:12:02.753545+0000","last_became_peered":"2024-04-24T02:12:02.753545+0000","last_unstale":"2024-04-24T02:14:25.040481+0000","last_undegraded":"2024-04-24T02:14:25.040481+0000","last_fullsized":"2024-04-24T02:14:25.040481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'10","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.176997+0000","last_change":"2024-04-24T02:12:04.758909+0000","last_active":"2024-04-24T02:15:13.176997+0000","last_peered":"2024-04-24T02:15:13.176997+0000","last_clean":"2024-04-24T02:15:13.176997+0000","last_became_active":"2024-04-24T02:12:04.758661+0000","last_became_peered":"2024-04-24T02:12:04.758661+0000","last_unstale":"2024-04-24T02:15:13.176997+0000","last_undegraded":"2024-04-24T02:15:13.176997+0000","last_fullsized":"2024-04-24T02:15:13.176997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:23.035340+0000","last_change":"2024-04-24T02:12:02.745737+0000","last_active":"2024-04-24T02:14:23.035340+0000","last_peered":"2024-04-24T02:14:23.035340+0000","last_clean":"2024-04-24T02:14:23.035340+0000","last_became_active":"2024-04-24T02:12:02.745396+0000","last_became_peered":"2024-04-24T02:12:02.745396+0000","last_unstale":"2024-04-24T02:14:23.035340+0000","last_undegraded":"2024-04-24T02:14:23.035340+0000","last_fullsized":"2024-04-24T02:14:23.035340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:30.040863+0000","last_change":"2024-04-24T02:12:04.766645+0000","last_active":"2024-04-24T02:14:30.040863+0000","last_peered":"2024-04-24T02:14:30.040863+0000","last_clean":"2024-04-24T02:14:30.040863+0000","last_became_active":"2024-04-24T02:12:04.766344+0000","last_became_peered":"2024-04-24T02:12:04.766344+0000","last_unstale":"2024-04-24T02:14:30.040863+0000","last_undegraded":"2024-04-24T02:14:30.040863+0000","last_fullsized":"2024-04-24T02:14:30.040863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1888,"num_read_kb":1653,"num_write":789,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2342,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1702,"ondisk_log_size":1702,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1617,"num_read_kb":1507,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640307,"num_pgs":152,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39944,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331896,"statfs":{"total":96636764160,"available":96595861504,"internally_reserved":0,"allocated":458752,"data_stored":135584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640305,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40456,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331384,"statfs":{"total":96636764160,"available":96595337216,"internally_reserved":0,"allocated":983040,"data_stored":722688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640307,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36324,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335516,"statfs":{"total":96636764160,"available":96599568384,"internally_reserved":0,"allocated":1011712,"data_stored":724048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705715,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39908,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331932,"statfs":{"total":96636764160,"available":96595898368,"internally_reserved":0,"allocated":421888,"data_stored":133610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T02:15:44.975 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.975 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.975 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.975 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.975 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.975 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.976 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.976 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.976 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.976 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.976 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.976 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.976 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.976 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.976 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.977 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.977 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.977 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.977 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.977 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.977 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.977 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.977 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.977 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.978 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.978 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.978 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.978 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.978 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.978 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.978 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.978 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-04-24T02:12:07.752700+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.978 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.979 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.979 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.979 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.979 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.979 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.979 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.979 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.979 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-04-24T02:12:09.760669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=9, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.979 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.979 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.980 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.980 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.980 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.980 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.980 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.980 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.980 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.980 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.981 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.981 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-04-24T02:12:07.752700+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.981 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.981 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.981 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.981 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.981 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.981 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.981 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.982 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-04-24T02:12:09.760669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=9, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.982 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.982 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.982 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.982 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.982 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.982 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.982 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-04-24T02:12:07.752700+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.982 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.983 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.983 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.983 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.983 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-24T02:11:50.697037+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=11, tm_sec=50, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.983 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-24T02:11:55.711441+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.983 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.983 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.983 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-04-24T02:12:07.752700+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.983 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.984 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-24T02:11:55.711441+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.984 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.984 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-04-24T02:12:09.760669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=9, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.984 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.984 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.984 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-24T02:11:55.711441+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.984 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.984 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.984 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.984 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.985 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-24T02:11:55.711441+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.985 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.985 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.985 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-04-24T02:12:07.752700+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.985 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-04-24T02:12:09.760669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=9, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.985 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.985 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.985 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.985 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-24T02:11:55.711441+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.986 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.986 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.986 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.986 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.986 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-24T02:11:55.711441+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.986 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.986 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.986 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-24T02:11:55.711441+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.987 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.987 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.987 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.987 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-24T02:11:55.711441+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.987 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.987 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.987 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.987 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.987 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-04-24T02:12:07.752700+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.987 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-04-24T02:12:09.760669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=9, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.988 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.988 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.988 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.988 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.988 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.988 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.988 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.988 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.989 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.989 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.989 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.989 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.989 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.989 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.989 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.989 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.989 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.990 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-04-24T02:12:07.752700+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.990 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.990 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.990 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.990 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.990 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.990 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.990 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.990 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-04-24T02:12:07.752700+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.991 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.991 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.991 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.991 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.991 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.991 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.991 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.991 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.991 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-04-24T02:12:09.760669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=9, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.991 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.992 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.992 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.992 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-04-24T02:12:07.752700+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.992 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-04-24T02:12:09.760669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=9, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.992 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.992 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.992 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.992 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.993 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.993 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.993 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.993 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.993 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.993 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.993 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.993 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.993 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.994 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.994 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.994 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.994 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.994 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.994 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.994 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.994 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.994 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.994 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.995 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.995 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.995 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.995 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.995 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.995 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.995 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.995 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.995 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.995 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.996 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.996 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.996 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.996 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.996 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.996 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.996 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:15:44.996 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-24T02:16:04.997 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T02:16:05.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.109+0000 7fcea0159640 1 Processor -- start 2024-04-24T02:16:05.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.109+0000 7fcea0159640 1 -- start start 2024-04-24T02:16:05.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.109+0000 7fcea0159640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fce9812dae0 0x7fce9812fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:16:05.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.109+0000 7fcea0159640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce9806f0f0 con 0x7fce9806d690 2024-04-24T02:16:05.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.109+0000 7fcea0159640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fce98071a60 con 0x7fce9812dae0 2024-04-24T02:16:05.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.109+0000 7fce9d6f4640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fce9812dae0 0x7fce9812fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:16:05.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.109+0000 7fce9def5640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fce9806d690 0x7fce9806da70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:45156/0 (socket says 172.21.15.104:45156) 2024-04-24T02:16:05.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.109+0000 7fce9def5640 1 -- 172.21.15.104:0/3651371428 learned_addr learned my addr 172.21.15.104:0/3651371428 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-04-24T02:16:05.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.110+0000 7fce9d6f4640 1 -- 172.21.15.104:0/3651371428 >> v1:172.21.15.104:6789/0 conn(0x7fce9806d690 legacy=0x7fce9806da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:16:05.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.110+0000 7fce9d6f4640 1 -- 172.21.15.104:0/3651371428 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce9806f8b0 con 0x7fce9812dae0 2024-04-24T02:16:05.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.110+0000 7fce9cef3640 1 -- 172.21.15.104:0/3651371428 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 609443201 0 0) 0x7fce9806f0f0 con 0x7fce9806d690 2024-04-24T02:16:05.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.110+0000 7fce9d6f4640 1 --2- 172.21.15.104:0/3651371428 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce9812dae0 0x7fce9812fed0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fce8c00a8c0 tx=0x7fce8c02cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e0463cb6c57625c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:16:05.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.111+0000 7fce9cef3640 1 -- 172.21.15.104:0/3651371428 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce8c03a070 con 0x7fce9812dae0 2024-04-24T02:16:05.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.111+0000 7fce9cef3640 1 -- 172.21.15.104:0/3651371428 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce8c02da00 con 0x7fce9812dae0 2024-04-24T02:16:05.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.111+0000 7fce9cef3640 1 -- 172.21.15.104:0/3651371428 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce8c00b040 con 0x7fce9812dae0 2024-04-24T02:16:05.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.111+0000 7fcea0159640 1 -- 172.21.15.104:0/3651371428 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce9812dae0 msgr2=0x7fce9812fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:16:05.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.111+0000 7fcea0159640 1 --2- 172.21.15.104:0/3651371428 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce9812dae0 0x7fce9812fed0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fce8c00a8c0 tx=0x7fce8c02cd20 comp rx=0 tx=0).stop 2024-04-24T02:16:05.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.111+0000 7fcea0159640 1 -- 172.21.15.104:0/3651371428 shutdown_connections 2024-04-24T02:16:05.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.111+0000 7fcea0159640 1 --2- 172.21.15.104:0/3651371428 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce9812dae0 0x7fce9812fed0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:16:05.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.111+0000 7fcea0159640 1 -- 172.21.15.104:0/3651371428 >> 172.21.15.104:0/3651371428 conn(0x7fce98099680 msgr2=0x7fce98099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:16:05.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.111+0000 7fcea0159640 1 -- 172.21.15.104:0/3651371428 shutdown_connections 2024-04-24T02:16:05.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.111+0000 7fcea0159640 1 -- 172.21.15.104:0/3651371428 wait complete. 2024-04-24T02:16:05.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.112+0000 7fcea0159640 1 Processor -- start 2024-04-24T02:16:05.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.112+0000 7fcea0159640 1 -- start start 2024-04-24T02:16:05.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.112+0000 7fcea0159640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce9806d690 0x7fce98089f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:16:05.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.112+0000 7fcea0159640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fce9806e180 con 0x7fce9806d690 2024-04-24T02:16:05.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.112+0000 7fce9def5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce9806d690 0x7fce98089f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:16:05.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.113+0000 7fce9def5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce9806d690 0x7fce98089f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:46812/0 (socket says 172.21.15.104:46812) 2024-04-24T02:16:05.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.113+0000 7fce9def5640 1 -- 172.21.15.104:0/2663770293 learned_addr learned my addr 172.21.15.104:0/2663770293 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:16:05.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.113+0000 7fce9def5640 1 -- 172.21.15.104:0/2663770293 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce9812d0b0 con 0x7fce9806d690 2024-04-24T02:16:05.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.113+0000 7fce9def5640 1 --2- 172.21.15.104:0/2663770293 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce9806d690 0x7fce98089f90 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fce9400c370 tx=0x7fce9400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:16:05.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.113+0000 7fce8a7fc640 1 -- 172.21.15.104:0/2663770293 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce94007410 con 0x7fce9806d690 2024-04-24T02:16:05.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.113+0000 7fce8a7fc640 1 -- 172.21.15.104:0/2663770293 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce940075d0 con 0x7fce9806d690 2024-04-24T02:16:05.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.113+0000 7fcea0159640 1 -- 172.21.15.104:0/2663770293 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce9808c680 con 0x7fce9806d690 2024-04-24T02:16:05.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.113+0000 7fce8a7fc640 1 -- 172.21.15.104:0/2663770293 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce94004950 con 0x7fce9806d690 2024-04-24T02:16:05.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.113+0000 7fcea0159640 1 -- 172.21.15.104:0/2663770293 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce9812c540 con 0x7fce9806d690 2024-04-24T02:16:05.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.114+0000 7fce8a7fc640 1 -- 172.21.15.104:0/2663770293 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fce94011070 con 0x7fce9806d690 2024-04-24T02:16:05.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.114+0000 7fcea0159640 1 -- 172.21.15.104:0/2663770293 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce98062da0 con 0x7fce9806d690 2024-04-24T02:16:05.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.114+0000 7fce8a7fc640 1 --2- 172.21.15.104:0/2663770293 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fce7c038060 0x7fce7c03a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:16:05.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.114+0000 7fce8a7fc640 1 -- 172.21.15.104:0/2663770293 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fce9404b4a0 con 0x7fce9806d690 2024-04-24T02:16:05.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.114+0000 7fce9d6f4640 1 --2- 172.21.15.104:0/2663770293 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fce7c038060 0x7fce7c03a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:16:05.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.115+0000 7fce9d6f4640 1 --2- 172.21.15.104:0/2663770293 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fce7c038060 0x7fce7c03a520 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fce8c037000 tx=0x7fce8c031000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:16:05.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.119+0000 7fce8a7fc640 1 -- 172.21.15.104:0/2663770293 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7fce9401cbd0 con 0x7fce9806d690 2024-04-24T02:16:05.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.292+0000 7fcea0159640 1 -- 172.21.15.104:0/2663770293 --> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fce98071660 con 0x7fce7c038060 2024-04-24T02:16:05.308 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.307+0000 7fce8a7fc640 1 -- 172.21.15.104:0/2663770293 <== mgr.4101 v2:172.21.15.134:6824/3655027977 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+661358 (secure 0 0 0) 0x7fce98071660 con 0x7fce7c038060 2024-04-24T02:16:05.316 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:16:05.321 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-04-24T02:16:05.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.312+0000 7fcea0159640 1 -- 172.21.15.104:0/2663770293 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fce7c038060 msgr2=0x7fce7c03a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:16:05.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.312+0000 7fcea0159640 1 --2- 172.21.15.104:0/2663770293 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fce7c038060 0x7fce7c03a520 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fce8c037000 tx=0x7fce8c031000 comp rx=0 tx=0).stop 2024-04-24T02:16:05.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.312+0000 7fcea0159640 1 -- 172.21.15.104:0/2663770293 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce9806d690 msgr2=0x7fce98089f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:16:05.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.312+0000 7fcea0159640 1 --2- 172.21.15.104:0/2663770293 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce9806d690 0x7fce98089f90 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fce9400c370 tx=0x7fce9400c830 comp rx=0 tx=0).stop 2024-04-24T02:16:05.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.312+0000 7fcea0159640 1 -- 172.21.15.104:0/2663770293 shutdown_connections 2024-04-24T02:16:05.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.312+0000 7fcea0159640 1 --2- 172.21.15.104:0/2663770293 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fce7c038060 0x7fce7c03a520 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:16:05.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.312+0000 7fcea0159640 1 --2- 172.21.15.104:0/2663770293 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce9806d690 0x7fce98089f90 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:16:05.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.312+0000 7fcea0159640 1 -- 172.21.15.104:0/2663770293 >> 172.21.15.104:0/2663770293 conn(0x7fce98099680 msgr2=0x7fce98125a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:16:05.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.312+0000 7fcea0159640 1 -- 172.21.15.104:0/2663770293 shutdown_connections 2024-04-24T02:16:05.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:05.312+0000 7fcea0159640 1 -- 172.21.15.104:0/2663770293 wait complete. 2024-04-24T02:16:05.325 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":157,"stamp":"2024-04-24T02:16:04.037243+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":252,"num_object_clones":0,"num_object_copies":504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":0,"num_read":5385,"num_read_kb":4938,"num_write":2369,"num_write_kb":61373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5003,"ondisk_log_size":5003,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":156632,"kb_used_data":2808,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377330728,"statfs":{"total":386547056640,"available":386386665472,"internally_reserved":0,"allocated":2875392,"data_stored":1715930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":157476630},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":519,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003978"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:59.430228+0000","last_change":"2024-04-24T02:15:59.430267+0000","last_active":"2024-04-24T02:15:59.430228+0000","last_peered":"2024-04-24T02:15:59.430228+0000","last_clean":"2024-04-24T02:15:59.430228+0000","last_became_active":"2024-04-24T02:12:02.754954+0000","last_became_peered":"2024-04-24T02:12:02.754954+0000","last_unstale":"2024-04-24T02:15:59.430228+0000","last_undegraded":"2024-04-24T02:15:59.430228+0000","last_fullsized":"2024-04-24T02:15:59.430228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:59.430121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:59.430121+0000","last_clean_scrub_stamp":"2024-04-24T02:15:59.430121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:45.711501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'8","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:58.482790+0000","last_change":"2024-04-24T02:15:58.482814+0000","last_active":"2024-04-24T02:15:58.482790+0000","last_peered":"2024-04-24T02:15:58.482790+0000","last_clean":"2024-04-24T02:15:58.482790+0000","last_became_active":"2024-04-24T02:12:04.754049+0000","last_became_peered":"2024-04-24T02:12:04.754049+0000","last_unstale":"2024-04-24T02:15:58.482790+0000","last_undegraded":"2024-04-24T02:15:58.482790+0000","last_fullsized":"2024-04-24T02:15:58.482790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-24T02:15:58.482703+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-24T02:15:58.482703+0000","last_clean_scrub_stamp":"2024-04-24T02:15:58.482703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:53:22.606358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:02.136744+0000","last_change":"2024-04-24T02:16:02.136783+0000","last_active":"2024-04-24T02:16:02.136744+0000","last_peered":"2024-04-24T02:16:02.136744+0000","last_clean":"2024-04-24T02:16:02.136744+0000","last_became_active":"2024-04-24T02:12:02.745526+0000","last_became_peered":"2024-04-24T02:12:02.745526+0000","last_unstale":"2024-04-24T02:16:02.136744+0000","last_undegraded":"2024-04-24T02:16:02.136744+0000","last_fullsized":"2024-04-24T02:16:02.136744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:02.136614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:02.136614+0000","last_clean_scrub_stamp":"2024-04-24T02:16:02.136614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:53.467958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'12","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.472571+0000","last_change":"2024-04-24T02:12:04.763554+0000","last_active":"2024-04-24T02:15:13.472571+0000","last_peered":"2024-04-24T02:15:13.472571+0000","last_clean":"2024-04-24T02:15:13.472571+0000","last_became_active":"2024-04-24T02:12:04.762967+0000","last_became_peered":"2024-04-24T02:12:04.762967+0000","last_unstale":"2024-04-24T02:15:13.472571+0000","last_undegraded":"2024-04-24T02:15:13.472571+0000","last_fullsized":"2024-04-24T02:15:13.472571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":62,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:10.038334+0000","last_change":"2024-04-24T02:12:02.761596+0000","last_active":"2024-04-24T02:14:10.038334+0000","last_peered":"2024-04-24T02:14:10.038334+0000","last_clean":"2024-04-24T02:14:10.038334+0000","last_became_active":"2024-04-24T02:12:02.758985+0000","last_became_peered":"2024-04-24T02:12:02.758985+0000","last_unstale":"2024-04-24T02:14:10.038334+0000","last_undegraded":"2024-04-24T02:14:10.038334+0000","last_fullsized":"2024-04-24T02:14:10.038334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:43.364320+0000","last_change":"2024-04-24T02:15:43.364378+0000","last_active":"2024-04-24T02:15:43.364320+0000","last_peered":"2024-04-24T02:15:43.364320+0000","last_clean":"2024-04-24T02:15:43.364320+0000","last_became_active":"2024-04-24T02:12:04.765327+0000","last_became_peered":"2024-04-24T02:12:04.765327+0000","last_unstale":"2024-04-24T02:15:43.364320+0000","last_undegraded":"2024-04-24T02:15:43.364320+0000","last_fullsized":"2024-04-24T02:15:43.364320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-24T02:15:43.364212+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-24T02:15:43.364212+0000","last_clean_scrub_stamp":"2024-04-24T02:15:43.364212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:05:54.967851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:05.036788+0000","last_change":"2024-04-24T02:12:02.745643+0000","last_active":"2024-04-24T02:14:05.036788+0000","last_peered":"2024-04-24T02:14:05.036788+0000","last_clean":"2024-04-24T02:14:05.036788+0000","last_became_active":"2024-04-24T02:12:02.744804+0000","last_became_peered":"2024-04-24T02:12:02.744804+0000","last_unstale":"2024-04-24T02:14:05.036788+0000","last_undegraded":"2024-04-24T02:14:05.036788+0000","last_fullsized":"2024-04-24T02:14:05.036788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'6","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.176528+0000","last_change":"2024-04-24T02:12:04.763357+0000","last_active":"2024-04-24T02:15:13.176528+0000","last_peered":"2024-04-24T02:15:13.176528+0000","last_clean":"2024-04-24T02:15:13.176528+0000","last_became_active":"2024-04-24T02:12:04.763076+0000","last_became_peered":"2024-04-24T02:12:04.763076+0000","last_unstale":"2024-04-24T02:15:13.176528+0000","last_undegraded":"2024-04-24T02:15:13.176528+0000","last_fullsized":"2024-04-24T02:15:13.176528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:35.042327+0000","last_change":"2024-04-24T02:12:02.755265+0000","last_active":"2024-04-24T02:14:35.042327+0000","last_peered":"2024-04-24T02:14:35.042327+0000","last_clean":"2024-04-24T02:14:35.042327+0000","last_became_active":"2024-04-24T02:12:02.754208+0000","last_became_peered":"2024-04-24T02:12:02.754208+0000","last_unstale":"2024-04-24T02:14:35.042327+0000","last_undegraded":"2024-04-24T02:14:35.042327+0000","last_fullsized":"2024-04-24T02:14:35.042327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:09.639901+0000","last_change":"2024-04-24T02:12:04.755521+0000","last_active":"2024-04-24T02:14:09.639901+0000","last_peered":"2024-04-24T02:14:09.639901+0000","last_clean":"2024-04-24T02:14:09.639901+0000","last_became_active":"2024-04-24T02:12:04.755248+0000","last_became_peered":"2024-04-24T02:12:04.755248+0000","last_unstale":"2024-04-24T02:14:09.639901+0000","last_undegraded":"2024-04-24T02:14:09.639901+0000","last_fullsized":"2024-04-24T02:14:09.639901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:35.041448+0000","last_change":"2024-04-24T02:12:02.741732+0000","last_active":"2024-04-24T02:14:35.041448+0000","last_peered":"2024-04-24T02:14:35.041448+0000","last_clean":"2024-04-24T02:14:35.041448+0000","last_became_active":"2024-04-24T02:12:02.741326+0000","last_became_peered":"2024-04-24T02:12:02.741326+0000","last_unstale":"2024-04-24T02:14:35.041448+0000","last_undegraded":"2024-04-24T02:14:35.041448+0000","last_fullsized":"2024-04-24T02:14:35.041448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'4","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:10.038288+0000","last_change":"2024-04-24T02:12:04.763252+0000","last_active":"2024-04-24T02:14:10.038288+0000","last_peered":"2024-04-24T02:14:10.038288+0000","last_clean":"2024-04-24T02:14:10.038288+0000","last_became_active":"2024-04-24T02:12:04.762921+0000","last_became_peered":"2024-04-24T02:12:04.762921+0000","last_unstale":"2024-04-24T02:14:10.038288+0000","last_undegraded":"2024-04-24T02:14:10.038288+0000","last_fullsized":"2024-04-24T02:14:10.038288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:35.042178+0000","last_change":"2024-04-24T02:12:02.755513+0000","last_active":"2024-04-24T02:14:35.042178+0000","last_peered":"2024-04-24T02:14:35.042178+0000","last_clean":"2024-04-24T02:14:35.042178+0000","last_became_active":"2024-04-24T02:12:02.752921+0000","last_became_peered":"2024-04-24T02:12:02.752921+0000","last_unstale":"2024-04-24T02:14:35.042178+0000","last_undegraded":"2024-04-24T02:14:35.042178+0000","last_fullsized":"2024-04-24T02:14:35.042178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'12","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:52.390862+0000","last_change":"2024-04-24T02:15:52.390885+0000","last_active":"2024-04-24T02:15:52.390862+0000","last_peered":"2024-04-24T02:15:52.390862+0000","last_clean":"2024-04-24T02:15:52.390862+0000","last_became_active":"2024-04-24T02:12:04.751655+0000","last_became_peered":"2024-04-24T02:12:04.751655+0000","last_unstale":"2024-04-24T02:15:52.390862+0000","last_undegraded":"2024-04-24T02:15:52.390862+0000","last_fullsized":"2024-04-24T02:15:52.390862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-04-24T02:15:52.390774+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-04-24T02:15:52.390774+0000","last_clean_scrub_stamp":"2024-04-24T02:15:52.390774+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:04:47.993410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:54.140893+0000","last_change":"2024-04-24T02:15:54.140936+0000","last_active":"2024-04-24T02:15:54.140893+0000","last_peered":"2024-04-24T02:15:54.140893+0000","last_clean":"2024-04-24T02:15:54.140893+0000","last_became_active":"2024-04-24T02:12:02.752476+0000","last_became_peered":"2024-04-24T02:12:02.752476+0000","last_unstale":"2024-04-24T02:15:54.140893+0000","last_undegraded":"2024-04-24T02:15:54.140893+0000","last_fullsized":"2024-04-24T02:15:54.140893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-24T02:15:54.140770+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-24T02:15:54.140770+0000","last_clean_scrub_stamp":"2024-04-24T02:15:54.140770+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:49:51.563159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'18","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:10.037528+0000","last_change":"2024-04-24T02:12:04.766969+0000","last_active":"2024-04-24T02:14:10.037528+0000","last_peered":"2024-04-24T02:14:10.037528+0000","last_clean":"2024-04-24T02:14:10.037528+0000","last_became_active":"2024-04-24T02:12:04.766693+0000","last_became_peered":"2024-04-24T02:12:04.766693+0000","last_unstale":"2024-04-24T02:14:10.037528+0000","last_undegraded":"2024-04-24T02:14:10.037528+0000","last_fullsized":"2024-04-24T02:14:10.037528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:59.112678+0000","last_change":"2024-04-24T02:15:59.112718+0000","last_active":"2024-04-24T02:15:59.112678+0000","last_peered":"2024-04-24T02:15:59.112678+0000","last_clean":"2024-04-24T02:15:59.112678+0000","last_became_active":"2024-04-24T02:12:04.764470+0000","last_became_peered":"2024-04-24T02:12:04.764470+0000","last_unstale":"2024-04-24T02:15:59.112678+0000","last_undegraded":"2024-04-24T02:15:59.112678+0000","last_fullsized":"2024-04-24T02:15:59.112678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-24T02:15:59.112564+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-24T02:15:59.112564+0000","last_clean_scrub_stamp":"2024-04-24T02:15:59.112564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:36:51.262575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:30.040891+0000","last_change":"2024-04-24T02:12:02.754017+0000","last_active":"2024-04-24T02:14:30.040891+0000","last_peered":"2024-04-24T02:14:30.040891+0000","last_clean":"2024-04-24T02:14:30.040891+0000","last_became_active":"2024-04-24T02:12:02.753791+0000","last_became_peered":"2024-04-24T02:12:02.753791+0000","last_unstale":"2024-04-24T02:14:30.040891+0000","last_undegraded":"2024-04-24T02:14:30.040891+0000","last_fullsized":"2024-04-24T02:14:30.040891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'10","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:55.422084+0000","last_change":"2024-04-24T02:15:55.422124+0000","last_active":"2024-04-24T02:15:55.422084+0000","last_peered":"2024-04-24T02:15:55.422084+0000","last_clean":"2024-04-24T02:15:55.422084+0000","last_became_active":"2024-04-24T02:12:04.750774+0000","last_became_peered":"2024-04-24T02:12:04.750774+0000","last_unstale":"2024-04-24T02:15:55.422084+0000","last_undegraded":"2024-04-24T02:15:55.422084+0000","last_fullsized":"2024-04-24T02:15:55.422084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-24T02:15:55.421992+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-24T02:15:55.421992+0000","last_clean_scrub_stamp":"2024-04-24T02:15:55.421992+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:08:59.008607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:57.387526+0000","last_change":"2024-04-24T02:15:57.387551+0000","last_active":"2024-04-24T02:15:57.387526+0000","last_peered":"2024-04-24T02:15:57.387526+0000","last_clean":"2024-04-24T02:15:57.387526+0000","last_became_active":"2024-04-24T02:12:02.754860+0000","last_became_peered":"2024-04-24T02:12:02.754860+0000","last_unstale":"2024-04-24T02:15:57.387526+0000","last_undegraded":"2024-04-24T02:15:57.387526+0000","last_fullsized":"2024-04-24T02:15:57.387526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:57.387439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:57.387439+0000","last_clean_scrub_stamp":"2024-04-24T02:15:57.387439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:51:58.982518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:52.480408+0000","last_change":"2024-04-24T02:15:52.480434+0000","last_active":"2024-04-24T02:15:52.480408+0000","last_peered":"2024-04-24T02:15:52.480408+0000","last_clean":"2024-04-24T02:15:52.480408+0000","last_became_active":"2024-04-24T02:12:04.750919+0000","last_became_peered":"2024-04-24T02:12:04.750919+0000","last_unstale":"2024-04-24T02:15:52.480408+0000","last_undegraded":"2024-04-24T02:15:52.480408+0000","last_fullsized":"2024-04-24T02:15:52.480408+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-24T02:15:52.480323+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-24T02:15:52.480323+0000","last_clean_scrub_stamp":"2024-04-24T02:15:52.480323+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:42:50.701745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'4","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:57.510465+0000","last_change":"2024-04-24T02:15:57.510492+0000","last_active":"2024-04-24T02:15:57.510465+0000","last_peered":"2024-04-24T02:15:57.510465+0000","last_clean":"2024-04-24T02:15:57.510465+0000","last_became_active":"2024-04-24T02:12:02.756389+0000","last_became_peered":"2024-04-24T02:12:02.756389+0000","last_unstale":"2024-04-24T02:15:57.510465+0000","last_undegraded":"2024-04-24T02:15:57.510465+0000","last_fullsized":"2024-04-24T02:15:57.510465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:57.510375+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:57.510375+0000","last_clean_scrub_stamp":"2024-04-24T02:15:57.510375+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:59:42.826506+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:50.155004+0000","last_change":"2024-04-24T02:15:50.155056+0000","last_active":"2024-04-24T02:15:50.155004+0000","last_peered":"2024-04-24T02:15:50.155004+0000","last_clean":"2024-04-24T02:15:50.155004+0000","last_became_active":"2024-04-24T02:12:04.766739+0000","last_became_peered":"2024-04-24T02:12:04.766739+0000","last_unstale":"2024-04-24T02:15:50.155004+0000","last_undegraded":"2024-04-24T02:15:50.155004+0000","last_fullsized":"2024-04-24T02:15:50.155004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:15:50.154864+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:15:50.154864+0000","last_clean_scrub_stamp":"2024-04-24T02:15:50.154864+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:50:10.913324+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:30.040817+0000","last_change":"2024-04-24T02:12:02.745281+0000","last_active":"2024-04-24T02:14:30.040817+0000","last_peered":"2024-04-24T02:14:30.040817+0000","last_clean":"2024-04-24T02:14:30.040817+0000","last_became_active":"2024-04-24T02:12:02.744763+0000","last_became_peered":"2024-04-24T02:12:02.744763+0000","last_unstale":"2024-04-24T02:14:30.040817+0000","last_undegraded":"2024-04-24T02:14:30.040817+0000","last_fullsized":"2024-04-24T02:14:30.040817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'10","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.403373+0000","last_change":"2024-04-24T02:12:04.764907+0000","last_active":"2024-04-24T02:15:13.403373+0000","last_peered":"2024-04-24T02:15:13.403373+0000","last_clean":"2024-04-24T02:15:13.403373+0000","last_became_active":"2024-04-24T02:12:04.764659+0000","last_became_peered":"2024-04-24T02:12:04.764659+0000","last_unstale":"2024-04-24T02:15:13.403373+0000","last_undegraded":"2024-04-24T02:15:13.403373+0000","last_fullsized":"2024-04-24T02:15:13.403373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:28.035991+0000","last_change":"2024-04-24T02:12:02.742249+0000","last_active":"2024-04-24T02:14:28.035991+0000","last_peered":"2024-04-24T02:14:28.035991+0000","last_clean":"2024-04-24T02:14:28.035991+0000","last_became_active":"2024-04-24T02:12:02.741976+0000","last_became_peered":"2024-04-24T02:12:02.741976+0000","last_unstale":"2024-04-24T02:14:28.035991+0000","last_undegraded":"2024-04-24T02:14:28.035991+0000","last_fullsized":"2024-04-24T02:14:28.035991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'10","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:30.040841+0000","last_change":"2024-04-24T02:12:04.755425+0000","last_active":"2024-04-24T02:14:30.040841+0000","last_peered":"2024-04-24T02:14:30.040841+0000","last_clean":"2024-04-24T02:14:30.040841+0000","last_became_active":"2024-04-24T02:12:04.755133+0000","last_became_peered":"2024-04-24T02:12:04.755133+0000","last_unstale":"2024-04-24T02:14:30.040841+0000","last_undegraded":"2024-04-24T02:14:30.040841+0000","last_fullsized":"2024-04-24T02:14:30.040841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:25.040567+0000","last_change":"2024-04-24T02:12:02.758478+0000","last_active":"2024-04-24T02:14:25.040567+0000","last_peered":"2024-04-24T02:14:25.040567+0000","last_clean":"2024-04-24T02:14:25.040567+0000","last_became_active":"2024-04-24T02:12:02.753196+0000","last_became_peered":"2024-04-24T02:12:02.753196+0000","last_unstale":"2024-04-24T02:14:25.040567+0000","last_undegraded":"2024-04-24T02:14:25.040567+0000","last_fullsized":"2024-04-24T02:14:25.040567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'35","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.484556+0000","last_change":"2024-04-24T02:12:12.798478+0000","last_active":"2024-04-24T02:15:13.484556+0000","last_peered":"2024-04-24T02:15:13.484556+0000","last_clean":"2024-04-24T02:15:13.484556+0000","last_became_active":"2024-04-24T02:12:12.798179+0000","last_became_peered":"2024-04-24T02:12:12.798179+0000","last_unstale":"2024-04-24T02:15:13.484556+0000","last_undegraded":"2024-04-24T02:15:13.484556+0000","last_fullsized":"2024-04-24T02:15:13.484556+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'5","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.522894+0000","last_change":"2024-04-24T02:12:04.764143+0000","last_active":"2024-04-24T02:15:13.522894+0000","last_peered":"2024-04-24T02:15:13.522894+0000","last_clean":"2024-04-24T02:15:13.522894+0000","last_became_active":"2024-04-24T02:12:04.763725+0000","last_became_peered":"2024-04-24T02:12:04.763725+0000","last_unstale":"2024-04-24T02:15:13.522894+0000","last_undegraded":"2024-04-24T02:15:13.522894+0000","last_fullsized":"2024-04-24T02:15:13.522894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:25.040598+0000","last_change":"2024-04-24T02:12:02.756910+0000","last_active":"2024-04-24T02:14:25.040598+0000","last_peered":"2024-04-24T02:14:25.040598+0000","last_clean":"2024-04-24T02:14:25.040598+0000","last_became_active":"2024-04-24T02:12:02.755520+0000","last_became_peered":"2024-04-24T02:12:02.755520+0000","last_unstale":"2024-04-24T02:14:25.040598+0000","last_undegraded":"2024-04-24T02:14:25.040598+0000","last_fullsized":"2024-04-24T02:14:25.040598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:28.347085+0000","last_change":"2024-04-24T02:15:28.347111+0000","last_active":"2024-04-24T02:15:28.347085+0000","last_peered":"2024-04-24T02:15:28.347085+0000","last_clean":"2024-04-24T02:15:28.347085+0000","last_became_active":"2024-04-24T02:12:06.758033+0000","last_became_peered":"2024-04-24T02:12:06.758033+0000","last_unstale":"2024-04-24T02:15:28.347085+0000","last_undegraded":"2024-04-24T02:15:28.347085+0000","last_fullsized":"2024-04-24T02:15:28.347085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:28.346988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:28.346988+0000","last_clean_scrub_stamp":"2024-04-24T02:15:28.346988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:48:41.497279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'51","reported_seq":118,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:49.256468+0000","last_change":"2024-04-24T02:15:49.256528+0000","last_active":"2024-04-24T02:15:49.256468+0000","last_peered":"2024-04-24T02:15:49.256468+0000","last_clean":"2024-04-24T02:15:49.256468+0000","last_became_active":"2024-04-24T02:12:08.783666+0000","last_became_peered":"2024-04-24T02:12:08.783666+0000","last_unstale":"2024-04-24T02:15:49.256468+0000","last_undegraded":"2024-04-24T02:15:49.256468+0000","last_fullsized":"2024-04-24T02:15:49.256468+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'51","last_scrub_stamp":"2024-04-24T02:15:49.256366+0000","last_deep_scrub":"32'51","last_deep_scrub_stamp":"2024-04-24T02:15:49.256366+0000","last_clean_scrub_stamp":"2024-04-24T02:15:49.256366+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:04:52.395526+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:38.404790+0000","last_change":"2024-04-24T02:15:38.404846+0000","last_active":"2024-04-24T02:15:38.404790+0000","last_peered":"2024-04-24T02:15:38.404790+0000","last_clean":"2024-04-24T02:15:38.404790+0000","last_became_active":"2024-04-24T02:12:10.786981+0000","last_became_peered":"2024-04-24T02:12:10.786981+0000","last_unstale":"2024-04-24T02:15:38.404790+0000","last_undegraded":"2024-04-24T02:15:38.404790+0000","last_fullsized":"2024-04-24T02:15:38.404790+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:38.404652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:38.404652+0000","last_clean_scrub_stamp":"2024-04-24T02:15:38.404652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:17:51.653509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:40.042466+0000","last_change":"2024-04-24T02:12:12.797648+0000","last_active":"2024-04-24T02:14:40.042466+0000","last_peered":"2024-04-24T02:14:40.042466+0000","last_clean":"2024-04-24T02:14:40.042466+0000","last_became_active":"2024-04-24T02:12:12.796319+0000","last_became_peered":"2024-04-24T02:12:12.796319+0000","last_unstale":"2024-04-24T02:14:40.042466+0000","last_undegraded":"2024-04-24T02:14:40.042466+0000","last_fullsized":"2024-04-24T02:14:40.042466+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:58.158915+0000","last_change":"2024-04-24T02:15:58.158961+0000","last_active":"2024-04-24T02:15:58.158915+0000","last_peered":"2024-04-24T02:15:58.158915+0000","last_clean":"2024-04-24T02:15:58.158915+0000","last_became_active":"2024-04-24T02:12:04.764351+0000","last_became_peered":"2024-04-24T02:12:04.764351+0000","last_unstale":"2024-04-24T02:15:58.158915+0000","last_undegraded":"2024-04-24T02:15:58.158915+0000","last_fullsized":"2024-04-24T02:15:58.158915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:58.158816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:58.158816+0000","last_clean_scrub_stamp":"2024-04-24T02:15:58.158816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:17:50.502415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:25.039715+0000","last_change":"2024-04-24T02:12:02.748273+0000","last_active":"2024-04-24T02:14:25.039715+0000","last_peered":"2024-04-24T02:14:25.039715+0000","last_clean":"2024-04-24T02:14:25.039715+0000","last_became_active":"2024-04-24T02:12:02.744030+0000","last_became_peered":"2024-04-24T02:12:02.744030+0000","last_unstale":"2024-04-24T02:14:25.039715+0000","last_undegraded":"2024-04-24T02:14:25.039715+0000","last_fullsized":"2024-04-24T02:14:25.039715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:48.070304+0000","last_change":"2024-04-24T02:15:48.070327+0000","last_active":"2024-04-24T02:15:48.070304+0000","last_peered":"2024-04-24T02:15:48.070304+0000","last_clean":"2024-04-24T02:15:48.070304+0000","last_became_active":"2024-04-24T02:12:06.758561+0000","last_became_peered":"2024-04-24T02:12:06.758561+0000","last_unstale":"2024-04-24T02:15:48.070304+0000","last_undegraded":"2024-04-24T02:15:48.070304+0000","last_fullsized":"2024-04-24T02:15:48.070304+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:48.070212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:48.070212+0000","last_clean_scrub_stamp":"2024-04-24T02:15:48.070212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:55:00.279301+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'16","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:32.376409+0000","last_change":"2024-04-24T02:15:32.376443+0000","last_active":"2024-04-24T02:15:32.376409+0000","last_peered":"2024-04-24T02:15:32.376409+0000","last_clean":"2024-04-24T02:15:32.376409+0000","last_became_active":"2024-04-24T02:12:08.767493+0000","last_became_peered":"2024-04-24T02:12:08.767493+0000","last_unstale":"2024-04-24T02:15:32.376409+0000","last_undegraded":"2024-04-24T02:15:32.376409+0000","last_fullsized":"2024-04-24T02:15:32.376409+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-04-24T02:15:32.376317+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-04-24T02:15:32.376317+0000","last_clean_scrub_stamp":"2024-04-24T02:15:32.376317+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:12:17.100634+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:26.334462+0000","last_change":"2024-04-24T02:15:26.334490+0000","last_active":"2024-04-24T02:15:26.334462+0000","last_peered":"2024-04-24T02:15:26.334462+0000","last_clean":"2024-04-24T02:15:26.334462+0000","last_became_active":"2024-04-24T02:12:10.779231+0000","last_became_peered":"2024-04-24T02:12:10.779231+0000","last_unstale":"2024-04-24T02:15:26.334462+0000","last_undegraded":"2024-04-24T02:15:26.334462+0000","last_fullsized":"2024-04-24T02:15:26.334462+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:26.334368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:26.334368+0000","last_clean_scrub_stamp":"2024-04-24T02:15:26.334368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:20:30.421649+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'8","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:51.148078+0000","last_change":"2024-04-24T02:15:51.148133+0000","last_active":"2024-04-24T02:15:51.148078+0000","last_peered":"2024-04-24T02:15:51.148078+0000","last_clean":"2024-04-24T02:15:51.148078+0000","last_became_active":"2024-04-24T02:12:12.791542+0000","last_became_peered":"2024-04-24T02:12:12.791542+0000","last_unstale":"2024-04-24T02:15:51.148078+0000","last_undegraded":"2024-04-24T02:15:51.148078+0000","last_fullsized":"2024-04-24T02:15:51.148078+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-24T02:15:51.147969+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-24T02:15:51.147969+0000","last_clean_scrub_stamp":"2024-04-24T02:15:51.147969+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:39:56.492767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'8","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.355830+0000","last_change":"2024-04-24T02:12:04.764138+0000","last_active":"2024-04-24T02:15:13.355830+0000","last_peered":"2024-04-24T02:15:13.355830+0000","last_clean":"2024-04-24T02:15:13.355830+0000","last_became_active":"2024-04-24T02:12:04.763491+0000","last_became_peered":"2024-04-24T02:12:04.763491+0000","last_unstale":"2024-04-24T02:15:13.355830+0000","last_undegraded":"2024-04-24T02:15:13.355830+0000","last_fullsized":"2024-04-24T02:15:13.355830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:25.040536+0000","last_change":"2024-04-24T02:12:02.757002+0000","last_active":"2024-04-24T02:14:25.040536+0000","last_peered":"2024-04-24T02:14:25.040536+0000","last_clean":"2024-04-24T02:14:25.040536+0000","last_became_active":"2024-04-24T02:12:02.755636+0000","last_became_peered":"2024-04-24T02:12:02.755636+0000","last_unstale":"2024-04-24T02:14:25.040536+0000","last_undegraded":"2024-04-24T02:14:25.040536+0000","last_fullsized":"2024-04-24T02:14:25.040536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:10.046752+0000","last_change":"2024-04-24T02:12:45.813418+0000","last_active":"2024-04-24T02:15:10.046752+0000","last_peered":"2024-04-24T02:15:10.046752+0000","last_clean":"2024-04-24T02:15:10.046752+0000","last_became_active":"2024-04-24T02:12:45.813038+0000","last_became_peered":"2024-04-24T02:12:45.813038+0000","last_unstale":"2024-04-24T02:15:10.046752+0000","last_undegraded":"2024-04-24T02:15:10.046752+0000","last_fullsized":"2024-04-24T02:15:10.046752+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"32'29","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:31.495647+0000","last_change":"2024-04-24T02:15:31.495714+0000","last_active":"2024-04-24T02:15:31.495647+0000","last_peered":"2024-04-24T02:15:31.495647+0000","last_clean":"2024-04-24T02:15:31.495647+0000","last_became_active":"2024-04-24T02:12:08.783077+0000","last_became_peered":"2024-04-24T02:12:08.783077+0000","last_unstale":"2024-04-24T02:15:31.495647+0000","last_undegraded":"2024-04-24T02:15:31.495647+0000","last_fullsized":"2024-04-24T02:15:31.495647+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'29","last_scrub_stamp":"2024-04-24T02:15:31.495549+0000","last_deep_scrub":"32'29","last_deep_scrub_stamp":"2024-04-24T02:15:31.495549+0000","last_clean_scrub_stamp":"2024-04-24T02:15:31.495549+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:13:45.684753+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'285","reported_seq":416,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:46.312707+0000","last_change":"2024-04-24T02:15:46.312755+0000","last_active":"2024-04-24T02:15:46.312707+0000","last_peered":"2024-04-24T02:15:46.312707+0000","last_clean":"2024-04-24T02:15:46.312707+0000","last_became_active":"2024-04-24T02:12:10.783726+0000","last_became_peered":"2024-04-24T02:12:10.783726+0000","last_unstale":"2024-04-24T02:15:46.312707+0000","last_undegraded":"2024-04-24T02:15:46.312707+0000","last_fullsized":"2024-04-24T02:15:46.312707+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-24T02:15:46.312603+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-24T02:15:46.312603+0000","last_clean_scrub_stamp":"2024-04-24T02:15:46.312603+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:06:42.364068+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:45.043101+0000","last_change":"2024-04-24T02:12:12.801707+0000","last_active":"2024-04-24T02:14:45.043101+0000","last_peered":"2024-04-24T02:14:45.043101+0000","last_clean":"2024-04-24T02:14:45.043101+0000","last_became_active":"2024-04-24T02:12:12.801331+0000","last_became_peered":"2024-04-24T02:12:12.801331+0000","last_unstale":"2024-04-24T02:14:45.043101+0000","last_undegraded":"2024-04-24T02:14:45.043101+0000","last_fullsized":"2024-04-24T02:14:45.043101+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'17","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.523265+0000","last_change":"2024-04-24T02:12:04.756301+0000","last_active":"2024-04-24T02:15:13.523265+0000","last_peered":"2024-04-24T02:15:13.523265+0000","last_clean":"2024-04-24T02:15:13.523265+0000","last_became_active":"2024-04-24T02:12:04.756039+0000","last_became_peered":"2024-04-24T02:12:04.756039+0000","last_unstale":"2024-04-24T02:15:13.523265+0000","last_undegraded":"2024-04-24T02:15:13.523265+0000","last_fullsized":"2024-04-24T02:15:13.523265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":60,"num_read_kb":52,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:25.039817+0000","last_change":"2024-04-24T02:12:02.755651+0000","last_active":"2024-04-24T02:14:25.039817+0000","last_peered":"2024-04-24T02:14:25.039817+0000","last_clean":"2024-04-24T02:14:25.039817+0000","last_became_active":"2024-04-24T02:12:02.754852+0000","last_became_peered":"2024-04-24T02:12:02.754852+0000","last_unstale":"2024-04-24T02:14:25.039817+0000","last_undegraded":"2024-04-24T02:14:25.039817+0000","last_fullsized":"2024-04-24T02:14:25.039817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:26.356334+0000","last_change":"2024-04-24T02:15:26.356380+0000","last_active":"2024-04-24T02:15:26.356334+0000","last_peered":"2024-04-24T02:15:26.356334+0000","last_clean":"2024-04-24T02:15:26.356334+0000","last_became_active":"2024-04-24T02:12:06.757883+0000","last_became_peered":"2024-04-24T02:12:06.757883+0000","last_unstale":"2024-04-24T02:15:26.356334+0000","last_undegraded":"2024-04-24T02:15:26.356334+0000","last_fullsized":"2024-04-24T02:15:26.356334+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:26.356206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:26.356206+0000","last_clean_scrub_stamp":"2024-04-24T02:15:26.356206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:34:03.818953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'44","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:33.483208+0000","last_change":"2024-04-24T02:15:33.483248+0000","last_active":"2024-04-24T02:15:33.483208+0000","last_peered":"2024-04-24T02:15:33.483208+0000","last_clean":"2024-04-24T02:15:33.483208+0000","last_became_active":"2024-04-24T02:12:08.780950+0000","last_became_peered":"2024-04-24T02:12:08.780950+0000","last_unstale":"2024-04-24T02:15:33.483208+0000","last_undegraded":"2024-04-24T02:15:33.483208+0000","last_fullsized":"2024-04-24T02:15:33.483208+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'44","last_scrub_stamp":"2024-04-24T02:15:33.483112+0000","last_deep_scrub":"32'44","last_deep_scrub_stamp":"2024-04-24T02:15:33.483112+0000","last_clean_scrub_stamp":"2024-04-24T02:15:33.483112+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:41:28.737400+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'285","reported_seq":447,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:28.021707+0000","last_change":"2024-04-24T02:15:28.021732+0000","last_active":"2024-04-24T02:15:28.021707+0000","last_peered":"2024-04-24T02:15:28.021707+0000","last_clean":"2024-04-24T02:15:28.021707+0000","last_became_active":"2024-04-24T02:12:10.778254+0000","last_became_peered":"2024-04-24T02:12:10.778254+0000","last_unstale":"2024-04-24T02:15:28.021707+0000","last_undegraded":"2024-04-24T02:15:28.021707+0000","last_fullsized":"2024-04-24T02:15:28.021707+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-24T02:15:28.021612+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-24T02:15:28.021612+0000","last_clean_scrub_stamp":"2024-04-24T02:15:28.021612+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:14:08.932379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:41.341919+0000","last_change":"2024-04-24T02:15:41.341961+0000","last_active":"2024-04-24T02:15:41.341919+0000","last_peered":"2024-04-24T02:15:41.341919+0000","last_clean":"2024-04-24T02:15:41.341919+0000","last_became_active":"2024-04-24T02:12:04.767906+0000","last_became_peered":"2024-04-24T02:12:04.767906+0000","last_unstale":"2024-04-24T02:15:41.341919+0000","last_undegraded":"2024-04-24T02:15:41.341919+0000","last_fullsized":"2024-04-24T02:15:41.341919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:41.341814+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:41.341814+0000","last_clean_scrub_stamp":"2024-04-24T02:15:41.341814+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:28:20.935646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"32'3","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:20.039123+0000","last_change":"2024-04-24T02:12:02.749142+0000","last_active":"2024-04-24T02:14:20.039123+0000","last_peered":"2024-04-24T02:14:20.039123+0000","last_clean":"2024-04-24T02:14:20.039123+0000","last_became_active":"2024-04-24T02:12:02.748372+0000","last_became_peered":"2024-04-24T02:12:02.748372+0000","last_unstale":"2024-04-24T02:14:20.039123+0000","last_undegraded":"2024-04-24T02:14:20.039123+0000","last_fullsized":"2024-04-24T02:14:20.039123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:36.460142+0000","last_change":"2024-04-24T02:15:36.460166+0000","last_active":"2024-04-24T02:15:36.460142+0000","last_peered":"2024-04-24T02:15:36.460142+0000","last_clean":"2024-04-24T02:15:36.460142+0000","last_became_active":"2024-04-24T02:12:06.764324+0000","last_became_peered":"2024-04-24T02:12:06.764324+0000","last_unstale":"2024-04-24T02:15:36.460142+0000","last_undegraded":"2024-04-24T02:15:36.460142+0000","last_fullsized":"2024-04-24T02:15:36.460142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:36.460053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:36.460053+0000","last_clean_scrub_stamp":"2024-04-24T02:15:36.460053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:36:31.597092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'58","reported_seq":124,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:36.435099+0000","last_change":"2024-04-24T02:15:36.435151+0000","last_active":"2024-04-24T02:15:36.435099+0000","last_peered":"2024-04-24T02:15:36.435099+0000","last_clean":"2024-04-24T02:15:36.435099+0000","last_became_active":"2024-04-24T02:12:08.771060+0000","last_became_peered":"2024-04-24T02:12:08.771060+0000","last_unstale":"2024-04-24T02:15:36.435099+0000","last_undegraded":"2024-04-24T02:15:36.435099+0000","last_fullsized":"2024-04-24T02:15:36.435099+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'58","last_scrub_stamp":"2024-04-24T02:15:36.435008+0000","last_deep_scrub":"32'58","last_deep_scrub_stamp":"2024-04-24T02:15:36.435008+0000","last_clean_scrub_stamp":"2024-04-24T02:15:36.435008+0000","objects_scrubbed":10,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:51:55.089317+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:29.043595+0000","last_change":"2024-04-24T02:15:29.043636+0000","last_active":"2024-04-24T02:15:29.043595+0000","last_peered":"2024-04-24T02:15:29.043595+0000","last_clean":"2024-04-24T02:15:29.043595+0000","last_became_active":"2024-04-24T02:12:10.776715+0000","last_became_peered":"2024-04-24T02:12:10.776715+0000","last_unstale":"2024-04-24T02:15:29.043595+0000","last_undegraded":"2024-04-24T02:15:29.043595+0000","last_fullsized":"2024-04-24T02:15:29.043595+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:29.043460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:29.043460+0000","last_clean_scrub_stamp":"2024-04-24T02:15:29.043460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:29:47.538838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'5","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:46.429961+0000","last_change":"2024-04-24T02:15:46.429992+0000","last_active":"2024-04-24T02:15:46.429961+0000","last_peered":"2024-04-24T02:15:46.429961+0000","last_clean":"2024-04-24T02:15:46.429961+0000","last_became_active":"2024-04-24T02:12:12.797405+0000","last_became_peered":"2024-04-24T02:12:12.797405+0000","last_unstale":"2024-04-24T02:15:46.429961+0000","last_undegraded":"2024-04-24T02:15:46.429961+0000","last_fullsized":"2024-04-24T02:15:46.429961+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-04-24T02:15:46.429875+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-04-24T02:15:46.429875+0000","last_clean_scrub_stamp":"2024-04-24T02:15:46.429875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:57:31.938558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'10","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:56.464554+0000","last_change":"2024-04-24T02:15:56.464583+0000","last_active":"2024-04-24T02:15:56.464554+0000","last_peered":"2024-04-24T02:15:56.464554+0000","last_clean":"2024-04-24T02:15:56.464554+0000","last_became_active":"2024-04-24T02:12:04.753819+0000","last_became_peered":"2024-04-24T02:12:04.753819+0000","last_unstale":"2024-04-24T02:15:56.464554+0000","last_undegraded":"2024-04-24T02:15:56.464554+0000","last_fullsized":"2024-04-24T02:15:56.464554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-24T02:15:56.464457+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-24T02:15:56.464457+0000","last_clean_scrub_stamp":"2024-04-24T02:15:56.464457+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:34:20.051173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:20.039089+0000","last_change":"2024-04-24T02:12:02.743507+0000","last_active":"2024-04-24T02:14:20.039089+0000","last_peered":"2024-04-24T02:14:20.039089+0000","last_clean":"2024-04-24T02:14:20.039089+0000","last_became_active":"2024-04-24T02:12:02.743202+0000","last_became_peered":"2024-04-24T02:12:02.743202+0000","last_unstale":"2024-04-24T02:14:20.039089+0000","last_undegraded":"2024-04-24T02:14:20.039089+0000","last_fullsized":"2024-04-24T02:14:20.039089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:41.008569+0000","last_change":"2024-04-24T02:15:41.008594+0000","last_active":"2024-04-24T02:15:41.008569+0000","last_peered":"2024-04-24T02:15:41.008569+0000","last_clean":"2024-04-24T02:15:41.008569+0000","last_became_active":"2024-04-24T02:12:06.765690+0000","last_became_peered":"2024-04-24T02:12:06.765690+0000","last_unstale":"2024-04-24T02:15:41.008569+0000","last_undegraded":"2024-04-24T02:15:41.008569+0000","last_fullsized":"2024-04-24T02:15:41.008569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:41.008462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:41.008462+0000","last_clean_scrub_stamp":"2024-04-24T02:15:41.008462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:55:16.490485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'45","reported_seq":106,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:36.400148+0000","last_change":"2024-04-24T02:15:36.400192+0000","last_active":"2024-04-24T02:15:36.400148+0000","last_peered":"2024-04-24T02:15:36.400148+0000","last_clean":"2024-04-24T02:15:36.400148+0000","last_became_active":"2024-04-24T02:12:08.779594+0000","last_became_peered":"2024-04-24T02:12:08.779594+0000","last_unstale":"2024-04-24T02:15:36.400148+0000","last_undegraded":"2024-04-24T02:15:36.400148+0000","last_fullsized":"2024-04-24T02:15:36.400148+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'45","last_scrub_stamp":"2024-04-24T02:15:36.400062+0000","last_deep_scrub":"32'45","last_deep_scrub_stamp":"2024-04-24T02:15:36.400062+0000","last_clean_scrub_stamp":"2024-04-24T02:15:36.400062+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:41:55.736741+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:35.000212+0000","last_change":"2024-04-24T02:15:35.000257+0000","last_active":"2024-04-24T02:15:35.000212+0000","last_peered":"2024-04-24T02:15:35.000212+0000","last_clean":"2024-04-24T02:15:35.000212+0000","last_became_active":"2024-04-24T02:12:10.784901+0000","last_became_peered":"2024-04-24T02:12:10.784901+0000","last_unstale":"2024-04-24T02:15:35.000212+0000","last_undegraded":"2024-04-24T02:15:35.000212+0000","last_fullsized":"2024-04-24T02:15:35.000212+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:35.000105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:35.000105+0000","last_clean_scrub_stamp":"2024-04-24T02:15:35.000105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:13:03.366315+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'6","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:50.476283+0000","last_change":"2024-04-24T02:15:50.476327+0000","last_active":"2024-04-24T02:15:50.476283+0000","last_peered":"2024-04-24T02:15:50.476283+0000","last_clean":"2024-04-24T02:15:50.476283+0000","last_became_active":"2024-04-24T02:12:12.795364+0000","last_became_peered":"2024-04-24T02:12:12.795364+0000","last_unstale":"2024-04-24T02:15:50.476283+0000","last_undegraded":"2024-04-24T02:15:50.476283+0000","last_fullsized":"2024-04-24T02:15:50.476283+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-24T02:15:50.476194+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-24T02:15:50.476194+0000","last_clean_scrub_stamp":"2024-04-24T02:15:50.476194+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:36.757574+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'8","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:58.385257+0000","last_change":"2024-04-24T02:15:58.385311+0000","last_active":"2024-04-24T02:15:58.385257+0000","last_peered":"2024-04-24T02:15:58.385257+0000","last_clean":"2024-04-24T02:15:58.385257+0000","last_became_active":"2024-04-24T02:12:04.762869+0000","last_became_peered":"2024-04-24T02:12:04.762869+0000","last_unstale":"2024-04-24T02:15:58.385257+0000","last_undegraded":"2024-04-24T02:15:58.385257+0000","last_fullsized":"2024-04-24T02:15:58.385257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-24T02:15:58.385121+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-24T02:15:58.385121+0000","last_clean_scrub_stamp":"2024-04-24T02:15:58.385121+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:34:35.847868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:20.039868+0000","last_change":"2024-04-24T02:12:02.758980+0000","last_active":"2024-04-24T02:14:20.039868+0000","last_peered":"2024-04-24T02:14:20.039868+0000","last_clean":"2024-04-24T02:14:20.039868+0000","last_became_active":"2024-04-24T02:12:02.757488+0000","last_became_peered":"2024-04-24T02:12:02.757488+0000","last_unstale":"2024-04-24T02:14:20.039868+0000","last_undegraded":"2024-04-24T02:14:20.039868+0000","last_fullsized":"2024-04-24T02:14:20.039868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:41.997895+0000","last_change":"2024-04-24T02:15:41.997919+0000","last_active":"2024-04-24T02:15:41.997895+0000","last_peered":"2024-04-24T02:15:41.997895+0000","last_clean":"2024-04-24T02:15:41.997895+0000","last_became_active":"2024-04-24T02:12:06.764339+0000","last_became_peered":"2024-04-24T02:12:06.764339+0000","last_unstale":"2024-04-24T02:15:41.997895+0000","last_undegraded":"2024-04-24T02:15:41.997895+0000","last_fullsized":"2024-04-24T02:15:41.997895+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:41.997807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:41.997807+0000","last_clean_scrub_stamp":"2024-04-24T02:15:41.997807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:41:46.258937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'60","reported_seq":130,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:55.225350+0000","last_change":"2024-04-24T02:15:55.225430+0000","last_active":"2024-04-24T02:15:55.225350+0000","last_peered":"2024-04-24T02:15:55.225350+0000","last_clean":"2024-04-24T02:15:55.225350+0000","last_became_active":"2024-04-24T02:12:08.780230+0000","last_became_peered":"2024-04-24T02:12:08.780230+0000","last_unstale":"2024-04-24T02:15:55.225350+0000","last_undegraded":"2024-04-24T02:15:55.225350+0000","last_fullsized":"2024-04-24T02:15:55.225350+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'60","last_scrub_stamp":"2024-04-24T02:15:55.225237+0000","last_deep_scrub":"32'60","last_deep_scrub_stamp":"2024-04-24T02:15:55.225237+0000","last_clean_scrub_stamp":"2024-04-24T02:15:55.225237+0000","objects_scrubbed":9,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:37:16.290694+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'285","reported_seq":409,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:31.050509+0000","last_change":"2024-04-24T02:15:31.050534+0000","last_active":"2024-04-24T02:15:31.050509+0000","last_peered":"2024-04-24T02:15:31.050509+0000","last_clean":"2024-04-24T02:15:31.050509+0000","last_became_active":"2024-04-24T02:12:10.784278+0000","last_became_peered":"2024-04-24T02:12:10.784278+0000","last_unstale":"2024-04-24T02:15:31.050509+0000","last_undegraded":"2024-04-24T02:15:31.050509+0000","last_fullsized":"2024-04-24T02:15:31.050509+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-24T02:15:31.050423+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-24T02:15:31.050423+0000","last_clean_scrub_stamp":"2024-04-24T02:15:31.050423+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:20:42.675691+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.353503+0000","last_change":"2024-04-24T02:12:12.792876+0000","last_active":"2024-04-24T02:15:13.353503+0000","last_peered":"2024-04-24T02:15:13.353503+0000","last_clean":"2024-04-24T02:15:13.353503+0000","last_became_active":"2024-04-24T02:12:12.792569+0000","last_became_peered":"2024-04-24T02:12:12.792569+0000","last_unstale":"2024-04-24T02:15:13.353503+0000","last_undegraded":"2024-04-24T02:15:13.353503+0000","last_fullsized":"2024-04-24T02:15:13.353503+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'26","reported_seq":99,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:50.416940+0000","last_change":"2024-04-24T02:15:50.416966+0000","last_active":"2024-04-24T02:15:50.416940+0000","last_peered":"2024-04-24T02:15:50.416940+0000","last_clean":"2024-04-24T02:15:50.416940+0000","last_became_active":"2024-04-24T02:12:04.752075+0000","last_became_peered":"2024-04-24T02:12:04.752075+0000","last_unstale":"2024-04-24T02:15:50.416940+0000","last_undegraded":"2024-04-24T02:15:50.416940+0000","last_fullsized":"2024-04-24T02:15:50.416940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'26","last_scrub_stamp":"2024-04-24T02:15:50.416819+0000","last_deep_scrub":"32'26","last_deep_scrub_stamp":"2024-04-24T02:15:50.416819+0000","last_clean_scrub_stamp":"2024-04-24T02:15:50.416819+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:34:38.445893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":67,"num_write":30,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:20.039830+0000","last_change":"2024-04-24T02:12:02.755772+0000","last_active":"2024-04-24T02:14:20.039830+0000","last_peered":"2024-04-24T02:14:20.039830+0000","last_clean":"2024-04-24T02:14:20.039830+0000","last_became_active":"2024-04-24T02:12:02.755468+0000","last_became_peered":"2024-04-24T02:12:02.755468+0000","last_unstale":"2024-04-24T02:14:20.039830+0000","last_undegraded":"2024-04-24T02:14:20.039830+0000","last_fullsized":"2024-04-24T02:14:20.039830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:44.072962+0000","last_change":"2024-04-24T02:15:44.072993+0000","last_active":"2024-04-24T02:15:44.072962+0000","last_peered":"2024-04-24T02:15:44.072962+0000","last_clean":"2024-04-24T02:15:44.072962+0000","last_became_active":"2024-04-24T02:12:06.764365+0000","last_became_peered":"2024-04-24T02:12:06.764365+0000","last_unstale":"2024-04-24T02:15:44.072962+0000","last_undegraded":"2024-04-24T02:15:44.072962+0000","last_fullsized":"2024-04-24T02:15:44.072962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:44.072858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:44.072858+0000","last_clean_scrub_stamp":"2024-04-24T02:15:44.072858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:57:12.574588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'80","reported_seq":165,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:32.292008+0000","last_change":"2024-04-24T02:15:32.292044+0000","last_active":"2024-04-24T02:15:32.292008+0000","last_peered":"2024-04-24T02:15:32.292008+0000","last_clean":"2024-04-24T02:15:32.292008+0000","last_became_active":"2024-04-24T02:12:08.779602+0000","last_became_peered":"2024-04-24T02:12:08.779602+0000","last_unstale":"2024-04-24T02:15:32.292008+0000","last_undegraded":"2024-04-24T02:15:32.292008+0000","last_fullsized":"2024-04-24T02:15:32.292008+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'80","last_scrub_stamp":"2024-04-24T02:15:32.291896+0000","last_deep_scrub":"32'80","last_deep_scrub_stamp":"2024-04-24T02:15:32.291896+0000","last_clean_scrub_stamp":"2024-04-24T02:15:32.291896+0000","objects_scrubbed":7,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:08:35.878511+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:24.008603+0000","last_change":"2024-04-24T02:15:24.008622+0000","last_active":"2024-04-24T02:15:24.008603+0000","last_peered":"2024-04-24T02:15:24.008603+0000","last_clean":"2024-04-24T02:15:24.008603+0000","last_became_active":"2024-04-24T02:12:10.782121+0000","last_became_peered":"2024-04-24T02:12:10.782121+0000","last_unstale":"2024-04-24T02:15:24.008603+0000","last_undegraded":"2024-04-24T02:15:24.008603+0000","last_fullsized":"2024-04-24T02:15:24.008603+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:24.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:24.008533+0000","last_clean_scrub_stamp":"2024-04-24T02:15:24.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:46:49.817831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'21","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:43.025928+0000","last_change":"2024-04-24T02:15:43.025968+0000","last_active":"2024-04-24T02:15:43.025928+0000","last_peered":"2024-04-24T02:15:43.025928+0000","last_clean":"2024-04-24T02:15:43.025928+0000","last_became_active":"2024-04-24T02:12:12.789799+0000","last_became_peered":"2024-04-24T02:12:12.789799+0000","last_unstale":"2024-04-24T02:15:43.025928+0000","last_undegraded":"2024-04-24T02:15:43.025928+0000","last_fullsized":"2024-04-24T02:15:43.025928+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-04-24T02:15:43.025844+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-04-24T02:15:43.025844+0000","last_clean_scrub_stamp":"2024-04-24T02:15:43.025844+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:56:55.136630+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:48.475015+0000","last_change":"2024-04-24T02:15:48.475041+0000","last_active":"2024-04-24T02:15:48.475015+0000","last_peered":"2024-04-24T02:15:48.475015+0000","last_clean":"2024-04-24T02:15:48.475015+0000","last_became_active":"2024-04-24T02:12:04.766495+0000","last_became_peered":"2024-04-24T02:12:04.766495+0000","last_unstale":"2024-04-24T02:15:48.475015+0000","last_undegraded":"2024-04-24T02:15:48.475015+0000","last_fullsized":"2024-04-24T02:15:48.475015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:48.474931+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:48.474931+0000","last_clean_scrub_stamp":"2024-04-24T02:15:48.474931+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:51:50.070010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:18.034606+0000","last_change":"2024-04-24T02:12:02.743527+0000","last_active":"2024-04-24T02:14:18.034606+0000","last_peered":"2024-04-24T02:14:18.034606+0000","last_clean":"2024-04-24T02:14:18.034606+0000","last_became_active":"2024-04-24T02:12:02.743204+0000","last_became_peered":"2024-04-24T02:12:02.743204+0000","last_unstale":"2024-04-24T02:14:18.034606+0000","last_undegraded":"2024-04-24T02:14:18.034606+0000","last_fullsized":"2024-04-24T02:14:18.034606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:41.423724+0000","last_change":"2024-04-24T02:15:41.423774+0000","last_active":"2024-04-24T02:15:41.423724+0000","last_peered":"2024-04-24T02:15:41.423724+0000","last_clean":"2024-04-24T02:15:41.423724+0000","last_became_active":"2024-04-24T02:12:06.764676+0000","last_became_peered":"2024-04-24T02:12:06.764676+0000","last_unstale":"2024-04-24T02:15:41.423724+0000","last_undegraded":"2024-04-24T02:15:41.423724+0000","last_fullsized":"2024-04-24T02:15:41.423724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:41.423618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:41.423618+0000","last_clean_scrub_stamp":"2024-04-24T02:15:41.423618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:12:26.147935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'46","reported_seq":108,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:28.341944+0000","last_change":"2024-04-24T02:15:28.342006+0000","last_active":"2024-04-24T02:15:28.341944+0000","last_peered":"2024-04-24T02:15:28.341944+0000","last_clean":"2024-04-24T02:15:28.341944+0000","last_became_active":"2024-04-24T02:12:08.773355+0000","last_became_peered":"2024-04-24T02:12:08.773355+0000","last_unstale":"2024-04-24T02:15:28.341944+0000","last_undegraded":"2024-04-24T02:15:28.341944+0000","last_fullsized":"2024-04-24T02:15:28.341944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-04-24T02:15:28.341829+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-04-24T02:15:28.341829+0000","last_clean_scrub_stamp":"2024-04-24T02:15:28.341829+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:44:08.114105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:52.281612+0000","last_change":"2024-04-24T02:15:52.281641+0000","last_active":"2024-04-24T02:15:52.281612+0000","last_peered":"2024-04-24T02:15:52.281612+0000","last_clean":"2024-04-24T02:15:52.281612+0000","last_became_active":"2024-04-24T02:12:10.783334+0000","last_became_peered":"2024-04-24T02:12:10.783334+0000","last_unstale":"2024-04-24T02:15:52.281612+0000","last_undegraded":"2024-04-24T02:15:52.281612+0000","last_fullsized":"2024-04-24T02:15:52.281612+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:52.281509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:52.281509+0000","last_clean_scrub_stamp":"2024-04-24T02:15:52.281509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:49:37.879213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.527692+0000","last_change":"2024-04-24T02:12:12.794851+0000","last_active":"2024-04-24T02:15:13.527692+0000","last_peered":"2024-04-24T02:15:13.527692+0000","last_clean":"2024-04-24T02:15:13.527692+0000","last_became_active":"2024-04-24T02:12:12.794106+0000","last_became_peered":"2024-04-24T02:12:12.794106+0000","last_unstale":"2024-04-24T02:15:13.527692+0000","last_undegraded":"2024-04-24T02:15:13.527692+0000","last_fullsized":"2024-04-24T02:15:13.527692+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:39.410527+0000","last_change":"2024-04-24T02:15:39.410553+0000","last_active":"2024-04-24T02:15:39.410527+0000","last_peered":"2024-04-24T02:15:39.410527+0000","last_clean":"2024-04-24T02:15:39.410527+0000","last_became_active":"2024-04-24T02:12:04.767376+0000","last_became_peered":"2024-04-24T02:12:04.767376+0000","last_unstale":"2024-04-24T02:15:39.410527+0000","last_undegraded":"2024-04-24T02:15:39.410527+0000","last_fullsized":"2024-04-24T02:15:39.410527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:39.410442+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:39.410442+0000","last_clean_scrub_stamp":"2024-04-24T02:15:39.410442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:46:10.073188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:15.039035+0000","last_change":"2024-04-24T02:12:02.761147+0000","last_active":"2024-04-24T02:14:15.039035+0000","last_peered":"2024-04-24T02:14:15.039035+0000","last_clean":"2024-04-24T02:14:15.039035+0000","last_became_active":"2024-04-24T02:12:02.760317+0000","last_became_peered":"2024-04-24T02:12:02.760317+0000","last_unstale":"2024-04-24T02:14:15.039035+0000","last_undegraded":"2024-04-24T02:14:15.039035+0000","last_fullsized":"2024-04-24T02:14:15.039035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:00.045324+0000","last_change":"2024-04-24T02:12:45.814348+0000","last_active":"2024-04-24T02:15:00.045324+0000","last_peered":"2024-04-24T02:15:00.045324+0000","last_clean":"2024-04-24T02:15:00.045324+0000","last_became_active":"2024-04-24T02:12:45.811272+0000","last_became_peered":"2024-04-24T02:12:45.811272+0000","last_unstale":"2024-04-24T02:15:00.045324+0000","last_undegraded":"2024-04-24T02:15:00.045324+0000","last_fullsized":"2024-04-24T02:15:00.045324+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"32'46","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:37.398289+0000","last_change":"2024-04-24T02:15:37.398336+0000","last_active":"2024-04-24T02:15:37.398289+0000","last_peered":"2024-04-24T02:15:37.398289+0000","last_clean":"2024-04-24T02:15:37.398289+0000","last_became_active":"2024-04-24T02:12:08.769307+0000","last_became_peered":"2024-04-24T02:12:08.769307+0000","last_unstale":"2024-04-24T02:15:37.398289+0000","last_undegraded":"2024-04-24T02:15:37.398289+0000","last_fullsized":"2024-04-24T02:15:37.398289+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-04-24T02:15:37.398209+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-04-24T02:15:37.398209+0000","last_clean_scrub_stamp":"2024-04-24T02:15:37.398209+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:44:17.170485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'285","reported_seq":415,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:29.489040+0000","last_change":"2024-04-24T02:15:29.489068+0000","last_active":"2024-04-24T02:15:29.489040+0000","last_peered":"2024-04-24T02:15:29.489040+0000","last_clean":"2024-04-24T02:15:29.489040+0000","last_became_active":"2024-04-24T02:12:10.778972+0000","last_became_peered":"2024-04-24T02:12:10.778972+0000","last_unstale":"2024-04-24T02:15:29.489040+0000","last_undegraded":"2024-04-24T02:15:29.489040+0000","last_fullsized":"2024-04-24T02:15:29.489040+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-24T02:15:29.488953+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-24T02:15:29.488953+0000","last_clean_scrub_stamp":"2024-04-24T02:15:29.488953+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:12:38.822890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'13","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:47.025829+0000","last_change":"2024-04-24T02:15:47.025859+0000","last_active":"2024-04-24T02:15:47.025829+0000","last_peered":"2024-04-24T02:15:47.025829+0000","last_clean":"2024-04-24T02:15:47.025829+0000","last_became_active":"2024-04-24T02:12:12.790353+0000","last_became_peered":"2024-04-24T02:12:12.790353+0000","last_unstale":"2024-04-24T02:15:47.025829+0000","last_undegraded":"2024-04-24T02:15:47.025829+0000","last_fullsized":"2024-04-24T02:15:47.025829+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'13","last_scrub_stamp":"2024-04-24T02:15:47.025741+0000","last_deep_scrub":"32'13","last_deep_scrub_stamp":"2024-04-24T02:15:47.025741+0000","last_clean_scrub_stamp":"2024-04-24T02:15:47.025741+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:19:56.625015+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'10","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:54.425745+0000","last_change":"2024-04-24T02:15:54.425801+0000","last_active":"2024-04-24T02:15:54.425745+0000","last_peered":"2024-04-24T02:15:54.425745+0000","last_clean":"2024-04-24T02:15:54.425745+0000","last_became_active":"2024-04-24T02:12:04.760020+0000","last_became_peered":"2024-04-24T02:12:04.760020+0000","last_unstale":"2024-04-24T02:15:54.425745+0000","last_undegraded":"2024-04-24T02:15:54.425745+0000","last_fullsized":"2024-04-24T02:15:54.425745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-24T02:15:54.425644+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-24T02:15:54.425644+0000","last_clean_scrub_stamp":"2024-04-24T02:15:54.425644+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:03:33.088095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:20.098422+0000","last_change":"2024-04-24T02:12:02.756829+0000","last_active":"2024-04-24T02:15:20.098422+0000","last_peered":"2024-04-24T02:15:20.098422+0000","last_clean":"2024-04-24T02:15:20.098422+0000","last_became_active":"2024-04-24T02:12:02.753593+0000","last_became_peered":"2024-04-24T02:12:02.753593+0000","last_unstale":"2024-04-24T02:15:20.098422+0000","last_undegraded":"2024-04-24T02:15:20.098422+0000","last_fullsized":"2024-04-24T02:15:20.098422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'5","reported_seq":428,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:37.435381+0000","last_change":"2024-04-24T02:15:37.435417+0000","last_active":"2024-04-24T02:15:37.435381+0000","last_peered":"2024-04-24T02:15:37.435381+0000","last_clean":"2024-04-24T02:15:37.435381+0000","last_became_active":"2024-04-24T02:12:06.758759+0000","last_became_peered":"2024-04-24T02:12:06.758759+0000","last_unstale":"2024-04-24T02:15:37.435381+0000","last_undegraded":"2024-04-24T02:15:37.435381+0000","last_fullsized":"2024-04-24T02:15:37.435381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-04-24T02:15:37.435273+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-04-24T02:15:37.435273+0000","last_clean_scrub_stamp":"2024-04-24T02:15:37.435273+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:57:22.943957+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'16","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:50.257195+0000","last_change":"2024-04-24T02:15:50.257229+0000","last_active":"2024-04-24T02:15:50.257195+0000","last_peered":"2024-04-24T02:15:50.257195+0000","last_clean":"2024-04-24T02:15:50.257195+0000","last_became_active":"2024-04-24T02:12:08.783011+0000","last_became_peered":"2024-04-24T02:12:08.783011+0000","last_unstale":"2024-04-24T02:15:50.257195+0000","last_undegraded":"2024-04-24T02:15:50.257195+0000","last_fullsized":"2024-04-24T02:15:50.257195+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-04-24T02:15:50.257112+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-04-24T02:15:50.257112+0000","last_clean_scrub_stamp":"2024-04-24T02:15:50.257112+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:22:29.994017+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'285","reported_seq":471,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:23.427909+0000","last_change":"2024-04-24T02:15:23.427935+0000","last_active":"2024-04-24T02:15:23.427909+0000","last_peered":"2024-04-24T02:15:23.427909+0000","last_clean":"2024-04-24T02:15:23.427909+0000","last_became_active":"2024-04-24T02:12:10.777222+0000","last_became_peered":"2024-04-24T02:12:10.777222+0000","last_unstale":"2024-04-24T02:15:23.427909+0000","last_undegraded":"2024-04-24T02:15:23.427909+0000","last_fullsized":"2024-04-24T02:15:23.427909+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-24T02:15:23.427820+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-24T02:15:23.427820+0000","last_clean_scrub_stamp":"2024-04-24T02:15:23.427820+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:37:31.031708+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:34.439628+0000","last_change":"2024-04-24T02:15:34.439653+0000","last_active":"2024-04-24T02:15:34.439628+0000","last_peered":"2024-04-24T02:15:34.439628+0000","last_clean":"2024-04-24T02:15:34.439628+0000","last_became_active":"2024-04-24T02:12:12.795204+0000","last_became_peered":"2024-04-24T02:12:12.795204+0000","last_unstale":"2024-04-24T02:15:34.439628+0000","last_undegraded":"2024-04-24T02:15:34.439628+0000","last_fullsized":"2024-04-24T02:15:34.439628+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:34.439501+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:34.439501+0000","last_clean_scrub_stamp":"2024-04-24T02:15:34.439501+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:22:10.202353+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:47.428543+0000","last_change":"2024-04-24T02:15:47.428572+0000","last_active":"2024-04-24T02:15:47.428543+0000","last_peered":"2024-04-24T02:15:47.428543+0000","last_clean":"2024-04-24T02:15:47.428543+0000","last_became_active":"2024-04-24T02:12:04.766540+0000","last_became_peered":"2024-04-24T02:12:04.766540+0000","last_unstale":"2024-04-24T02:15:47.428543+0000","last_undegraded":"2024-04-24T02:15:47.428543+0000","last_fullsized":"2024-04-24T02:15:47.428543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:47.428451+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:47.428451+0000","last_clean_scrub_stamp":"2024-04-24T02:15:47.428451+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:03:39.887590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:15.038911+0000","last_change":"2024-04-24T02:12:02.760628+0000","last_active":"2024-04-24T02:14:15.038911+0000","last_peered":"2024-04-24T02:14:15.038911+0000","last_clean":"2024-04-24T02:14:15.038911+0000","last_became_active":"2024-04-24T02:12:02.757717+0000","last_became_peered":"2024-04-24T02:12:02.757717+0000","last_unstale":"2024-04-24T02:14:15.038911+0000","last_undegraded":"2024-04-24T02:14:15.038911+0000","last_fullsized":"2024-04-24T02:14:15.038911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:25.340800+0000","last_change":"2024-04-24T02:15:25.340837+0000","last_active":"2024-04-24T02:15:25.340800+0000","last_peered":"2024-04-24T02:15:25.340800+0000","last_clean":"2024-04-24T02:15:25.340800+0000","last_became_active":"2024-04-24T02:12:06.758452+0000","last_became_peered":"2024-04-24T02:12:06.758452+0000","last_unstale":"2024-04-24T02:15:25.340800+0000","last_undegraded":"2024-04-24T02:15:25.340800+0000","last_fullsized":"2024-04-24T02:15:25.340800+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:25.340704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:25.340704+0000","last_clean_scrub_stamp":"2024-04-24T02:15:25.340704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:51:26.935783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'50","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:29.358708+0000","last_change":"2024-04-24T02:15:29.358770+0000","last_active":"2024-04-24T02:15:29.358708+0000","last_peered":"2024-04-24T02:15:29.358708+0000","last_clean":"2024-04-24T02:15:29.358708+0000","last_became_active":"2024-04-24T02:12:08.773319+0000","last_became_peered":"2024-04-24T02:12:08.773319+0000","last_unstale":"2024-04-24T02:15:29.358708+0000","last_undegraded":"2024-04-24T02:15:29.358708+0000","last_fullsized":"2024-04-24T02:15:29.358708+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'50","last_scrub_stamp":"2024-04-24T02:15:29.358602+0000","last_deep_scrub":"32'50","last_deep_scrub_stamp":"2024-04-24T02:15:29.358602+0000","last_clean_scrub_stamp":"2024-04-24T02:15:29.358602+0000","objects_scrubbed":8,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:42:17.124195+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":52,"num_read_kb":50,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:26.426941+0000","last_change":"2024-04-24T02:15:26.426964+0000","last_active":"2024-04-24T02:15:26.426941+0000","last_peered":"2024-04-24T02:15:26.426941+0000","last_clean":"2024-04-24T02:15:26.426941+0000","last_became_active":"2024-04-24T02:12:10.786998+0000","last_became_peered":"2024-04-24T02:12:10.786998+0000","last_unstale":"2024-04-24T02:15:26.426941+0000","last_undegraded":"2024-04-24T02:15:26.426941+0000","last_fullsized":"2024-04-24T02:15:26.426941+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:26.426853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:26.426853+0000","last_clean_scrub_stamp":"2024-04-24T02:15:26.426853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:33:27.255344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'6","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:42.419582+0000","last_change":"2024-04-24T02:15:42.419648+0000","last_active":"2024-04-24T02:15:42.419582+0000","last_peered":"2024-04-24T02:15:42.419582+0000","last_clean":"2024-04-24T02:15:42.419582+0000","last_became_active":"2024-04-24T02:12:12.793724+0000","last_became_peered":"2024-04-24T02:12:12.793724+0000","last_unstale":"2024-04-24T02:15:42.419582+0000","last_undegraded":"2024-04-24T02:15:42.419582+0000","last_fullsized":"2024-04-24T02:15:42.419582+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-24T02:15:42.419486+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-24T02:15:42.419486+0000","last_clean_scrub_stamp":"2024-04-24T02:15:42.419486+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:57:44.867375+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:12.780167+0000","last_change":"2024-04-24T02:12:04.764441+0000","last_active":"2024-04-24T02:14:12.780167+0000","last_peered":"2024-04-24T02:14:12.780167+0000","last_clean":"2024-04-24T02:14:12.780167+0000","last_became_active":"2024-04-24T02:12:04.763246+0000","last_became_peered":"2024-04-24T02:12:04.763246+0000","last_unstale":"2024-04-24T02:14:12.780167+0000","last_undegraded":"2024-04-24T02:14:12.780167+0000","last_fullsized":"2024-04-24T02:14:12.780167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":201,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:23.373783+0000","last_change":"2024-04-24T02:11:51.990441+0000","last_active":"2024-04-24T02:15:23.373783+0000","last_peered":"2024-04-24T02:15:23.373783+0000","last_clean":"2024-04-24T02:15:23.373783+0000","last_became_active":"2024-04-24T02:11:51.989479+0000","last_became_peered":"2024-04-24T02:11:51.989479+0000","last_unstale":"2024-04-24T02:15:23.373783+0000","last_undegraded":"2024-04-24T02:15:23.373783+0000","last_fullsized":"2024-04-24T02:15:23.373783+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:50.697037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:50.697037+0000","last_clean_scrub_stamp":"2024-04-24T02:11:50.697037+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:05.037531+0000","last_change":"2024-04-24T02:11:56.724372+0000","last_active":"2024-04-24T02:14:05.037531+0000","last_peered":"2024-04-24T02:14:05.037531+0000","last_clean":"2024-04-24T02:14:05.037531+0000","last_became_active":"2024-04-24T02:11:56.723925+0000","last_became_peered":"2024-04-24T02:11:56.723925+0000","last_unstale":"2024-04-24T02:14:05.037531+0000","last_undegraded":"2024-04-24T02:14:05.037531+0000","last_fullsized":"2024-04-24T02:14:05.037531+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:10.038205+0000","last_change":"2024-04-24T02:12:02.758997+0000","last_active":"2024-04-24T02:14:10.038205+0000","last_peered":"2024-04-24T02:14:10.038205+0000","last_clean":"2024-04-24T02:14:10.038205+0000","last_became_active":"2024-04-24T02:12:02.758653+0000","last_became_peered":"2024-04-24T02:12:02.758653+0000","last_unstale":"2024-04-24T02:14:10.038205+0000","last_undegraded":"2024-04-24T02:14:10.038205+0000","last_fullsized":"2024-04-24T02:14:10.038205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"32'2","reported_seq":230,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:40.433726+0000","last_change":"2024-04-24T02:15:40.433788+0000","last_active":"2024-04-24T02:15:40.433726+0000","last_peered":"2024-04-24T02:15:40.433726+0000","last_clean":"2024-04-24T02:15:40.433726+0000","last_became_active":"2024-04-24T02:12:06.757173+0000","last_became_peered":"2024-04-24T02:12:06.757173+0000","last_unstale":"2024-04-24T02:15:40.433726+0000","last_undegraded":"2024-04-24T02:15:40.433726+0000","last_fullsized":"2024-04-24T02:15:40.433726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:15:40.433600+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:15:40.433600+0000","last_clean_scrub_stamp":"2024-04-24T02:15:40.433600+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:15:32.722410+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'97","reported_seq":193,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:57.179496+0000","last_change":"2024-04-24T02:15:57.179565+0000","last_active":"2024-04-24T02:15:57.179496+0000","last_peered":"2024-04-24T02:15:57.179496+0000","last_clean":"2024-04-24T02:15:57.179496+0000","last_became_active":"2024-04-24T02:12:08.780923+0000","last_became_peered":"2024-04-24T02:12:08.780923+0000","last_unstale":"2024-04-24T02:15:57.179496+0000","last_undegraded":"2024-04-24T02:15:57.179496+0000","last_fullsized":"2024-04-24T02:15:57.179496+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'97","last_scrub_stamp":"2024-04-24T02:15:57.179395+0000","last_deep_scrub":"32'97","last_deep_scrub_stamp":"2024-04-24T02:15:57.179395+0000","last_clean_scrub_stamp":"2024-04-24T02:15:57.179395+0000","objects_scrubbed":6,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:43:51.704639+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:22.973891+0000","last_change":"2024-04-24T02:15:22.973909+0000","last_active":"2024-04-24T02:15:22.973891+0000","last_peered":"2024-04-24T02:15:22.973891+0000","last_clean":"2024-04-24T02:15:22.973891+0000","last_became_active":"2024-04-24T02:12:10.784101+0000","last_became_peered":"2024-04-24T02:12:10.784101+0000","last_unstale":"2024-04-24T02:15:22.973891+0000","last_undegraded":"2024-04-24T02:15:22.973891+0000","last_fullsized":"2024-04-24T02:15:22.973891+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:22.973820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:22.973820+0000","last_clean_scrub_stamp":"2024-04-24T02:15:22.973820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:09:23.273019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'81","reported_seq":171,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:38.392097+0000","last_change":"2024-04-24T02:15:38.392125+0000","last_active":"2024-04-24T02:15:38.392097+0000","last_peered":"2024-04-24T02:15:38.392097+0000","last_clean":"2024-04-24T02:15:38.392097+0000","last_became_active":"2024-04-24T02:12:12.795281+0000","last_became_peered":"2024-04-24T02:12:12.795281+0000","last_unstale":"2024-04-24T02:15:38.392097+0000","last_undegraded":"2024-04-24T02:15:38.392097+0000","last_fullsized":"2024-04-24T02:15:38.392097+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'81","last_scrub_stamp":"2024-04-24T02:15:38.392009+0000","last_deep_scrub":"32'81","last_deep_scrub_stamp":"2024-04-24T02:15:38.392009+0000","last_clean_scrub_stamp":"2024-04-24T02:15:38.392009+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:42:26.157602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.356097+0000","last_change":"2024-04-24T02:12:04.764296+0000","last_active":"2024-04-24T02:15:13.356097+0000","last_peered":"2024-04-24T02:15:13.356097+0000","last_clean":"2024-04-24T02:15:13.356097+0000","last_became_active":"2024-04-24T02:12:04.763782+0000","last_became_peered":"2024-04-24T02:12:04.763782+0000","last_unstale":"2024-04-24T02:15:13.356097+0000","last_undegraded":"2024-04-24T02:15:13.356097+0000","last_fullsized":"2024-04-24T02:15:13.356097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:24.221044+0000","last_change":"2024-04-24T02:11:56.724008+0000","last_active":"2024-04-24T02:15:24.221044+0000","last_peered":"2024-04-24T02:15:24.221044+0000","last_clean":"2024-04-24T02:15:24.221044+0000","last_became_active":"2024-04-24T02:11:56.723682+0000","last_became_peered":"2024-04-24T02:11:56.723682+0000","last_unstale":"2024-04-24T02:15:24.221044+0000","last_undegraded":"2024-04-24T02:15:24.221044+0000","last_fullsized":"2024-04-24T02:15:24.221044+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:08.033156+0000","last_change":"2024-04-24T02:12:02.742006+0000","last_active":"2024-04-24T02:14:08.033156+0000","last_peered":"2024-04-24T02:14:08.033156+0000","last_clean":"2024-04-24T02:14:08.033156+0000","last_became_active":"2024-04-24T02:12:02.741610+0000","last_became_peered":"2024-04-24T02:12:02.741610+0000","last_unstale":"2024-04-24T02:14:08.033156+0000","last_undegraded":"2024-04-24T02:14:08.033156+0000","last_fullsized":"2024-04-24T02:14:08.033156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:29.348600+0000","last_change":"2024-04-24T02:15:29.348651+0000","last_active":"2024-04-24T02:15:29.348600+0000","last_peered":"2024-04-24T02:15:29.348600+0000","last_clean":"2024-04-24T02:15:29.348600+0000","last_became_active":"2024-04-24T02:12:06.757052+0000","last_became_peered":"2024-04-24T02:12:06.757052+0000","last_unstale":"2024-04-24T02:15:29.348600+0000","last_undegraded":"2024-04-24T02:15:29.348600+0000","last_fullsized":"2024-04-24T02:15:29.348600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:29.348489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:29.348489+0000","last_clean_scrub_stamp":"2024-04-24T02:15:29.348489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:42:27.569911+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'298","reported_seq":529,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:25.387639+0000","last_change":"2024-04-24T02:15:25.387698+0000","last_active":"2024-04-24T02:15:25.387639+0000","last_peered":"2024-04-24T02:15:25.387639+0000","last_clean":"2024-04-24T02:15:25.387639+0000","last_became_active":"2024-04-24T02:12:08.779884+0000","last_became_peered":"2024-04-24T02:12:08.779884+0000","last_unstale":"2024-04-24T02:15:25.387639+0000","last_undegraded":"2024-04-24T02:15:25.387639+0000","last_fullsized":"2024-04-24T02:15:25.387639+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'298","last_scrub_stamp":"2024-04-24T02:15:25.387551+0000","last_deep_scrub":"32'298","last_deep_scrub_stamp":"2024-04-24T02:15:25.387551+0000","last_clean_scrub_stamp":"2024-04-24T02:15:25.387551+0000","objects_scrubbed":11,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:22:01.150403+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:48.289624+0000","last_change":"2024-04-24T02:15:48.289647+0000","last_active":"2024-04-24T02:15:48.289624+0000","last_peered":"2024-04-24T02:15:48.289624+0000","last_clean":"2024-04-24T02:15:48.289624+0000","last_became_active":"2024-04-24T02:12:10.783788+0000","last_became_peered":"2024-04-24T02:12:10.783788+0000","last_unstale":"2024-04-24T02:15:48.289624+0000","last_undegraded":"2024-04-24T02:15:48.289624+0000","last_fullsized":"2024-04-24T02:15:48.289624+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:48.289533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:48.289533+0000","last_clean_scrub_stamp":"2024-04-24T02:15:48.289533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:38:32.091995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:25.039960+0000","last_change":"2024-04-24T02:12:12.796284+0000","last_active":"2024-04-24T02:14:25.039960+0000","last_peered":"2024-04-24T02:14:25.039960+0000","last_clean":"2024-04-24T02:14:25.039960+0000","last_became_active":"2024-04-24T02:12:12.795983+0000","last_became_peered":"2024-04-24T02:12:12.795983+0000","last_unstale":"2024-04-24T02:14:25.039960+0000","last_undegraded":"2024-04-24T02:14:25.039960+0000","last_fullsized":"2024-04-24T02:14:25.039960+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'22","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.176666+0000","last_change":"2024-04-24T02:12:04.756013+0000","last_active":"2024-04-24T02:15:13.176666+0000","last_peered":"2024-04-24T02:15:13.176666+0000","last_clean":"2024-04-24T02:15:13.176666+0000","last_became_active":"2024-04-24T02:12:04.755649+0000","last_became_peered":"2024-04-24T02:12:04.755649+0000","last_unstale":"2024-04-24T02:15:13.176666+0000","last_undegraded":"2024-04-24T02:15:13.176666+0000","last_fullsized":"2024-04-24T02:15:13.176666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":72,"num_write":29,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:00.036122+0000","last_change":"2024-04-24T02:11:56.724010+0000","last_active":"2024-04-24T02:14:00.036122+0000","last_peered":"2024-04-24T02:14:00.036122+0000","last_clean":"2024-04-24T02:14:00.036122+0000","last_became_active":"2024-04-24T02:11:56.723497+0000","last_became_peered":"2024-04-24T02:11:56.723497+0000","last_unstale":"2024-04-24T02:14:00.036122+0000","last_undegraded":"2024-04-24T02:14:00.036122+0000","last_fullsized":"2024-04-24T02:14:00.036122+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:22.950879+0000","last_change":"2024-04-24T02:12:02.745574+0000","last_active":"2024-04-24T02:15:22.950879+0000","last_peered":"2024-04-24T02:15:22.950879+0000","last_clean":"2024-04-24T02:15:22.950879+0000","last_became_active":"2024-04-24T02:12:02.745238+0000","last_became_peered":"2024-04-24T02:12:02.745238+0000","last_unstale":"2024-04-24T02:15:22.950879+0000","last_undegraded":"2024-04-24T02:15:22.950879+0000","last_fullsized":"2024-04-24T02:15:22.950879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:45.477994+0000","last_change":"2024-04-24T02:15:45.478024+0000","last_active":"2024-04-24T02:15:45.477994+0000","last_peered":"2024-04-24T02:15:45.477994+0000","last_clean":"2024-04-24T02:15:45.477994+0000","last_became_active":"2024-04-24T02:12:06.757009+0000","last_became_peered":"2024-04-24T02:12:06.757009+0000","last_unstale":"2024-04-24T02:15:45.477994+0000","last_undegraded":"2024-04-24T02:15:45.477994+0000","last_fullsized":"2024-04-24T02:15:45.477994+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:15:45.477913+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:15:45.477913+0000","last_clean_scrub_stamp":"2024-04-24T02:15:45.477913+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:36:40.614952+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'23","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:35.426639+0000","last_change":"2024-04-24T02:15:35.426698+0000","last_active":"2024-04-24T02:15:35.426639+0000","last_peered":"2024-04-24T02:15:35.426639+0000","last_clean":"2024-04-24T02:15:35.426639+0000","last_became_active":"2024-04-24T02:12:08.774177+0000","last_became_peered":"2024-04-24T02:12:08.774177+0000","last_unstale":"2024-04-24T02:15:35.426639+0000","last_undegraded":"2024-04-24T02:15:35.426639+0000","last_fullsized":"2024-04-24T02:15:35.426639+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2024-04-24T02:15:35.426543+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2024-04-24T02:15:35.426543+0000","last_clean_scrub_stamp":"2024-04-24T02:15:35.426543+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:20:39.513825+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:27.053482+0000","last_change":"2024-04-24T02:15:27.053503+0000","last_active":"2024-04-24T02:15:27.053482+0000","last_peered":"2024-04-24T02:15:27.053482+0000","last_clean":"2024-04-24T02:15:27.053482+0000","last_became_active":"2024-04-24T02:12:10.784247+0000","last_became_peered":"2024-04-24T02:12:10.784247+0000","last_unstale":"2024-04-24T02:15:27.053482+0000","last_undegraded":"2024-04-24T02:15:27.053482+0000","last_fullsized":"2024-04-24T02:15:27.053482+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:27.053381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:27.053381+0000","last_clean_scrub_stamp":"2024-04-24T02:15:27.053381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:58:59.706713+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:30.041437+0000","last_change":"2024-04-24T02:12:12.794755+0000","last_active":"2024-04-24T02:14:30.041437+0000","last_peered":"2024-04-24T02:14:30.041437+0000","last_clean":"2024-04-24T02:14:30.041437+0000","last_became_active":"2024-04-24T02:12:12.794453+0000","last_became_peered":"2024-04-24T02:12:12.794453+0000","last_unstale":"2024-04-24T02:14:30.041437+0000","last_undegraded":"2024-04-24T02:14:30.041437+0000","last_fullsized":"2024-04-24T02:14:30.041437+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:53.130973+0000","last_change":"2024-04-24T02:15:53.131001+0000","last_active":"2024-04-24T02:15:53.130973+0000","last_peered":"2024-04-24T02:15:53.130973+0000","last_clean":"2024-04-24T02:15:53.130973+0000","last_became_active":"2024-04-24T02:12:04.749173+0000","last_became_peered":"2024-04-24T02:12:04.749173+0000","last_unstale":"2024-04-24T02:15:53.130973+0000","last_undegraded":"2024-04-24T02:15:53.130973+0000","last_fullsized":"2024-04-24T02:15:53.130973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:53.130876+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:53.130876+0000","last_clean_scrub_stamp":"2024-04-24T02:15:53.130876+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:46:26.214015+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:00.036831+0000","last_change":"2024-04-24T02:11:56.723425+0000","last_active":"2024-04-24T02:14:00.036831+0000","last_peered":"2024-04-24T02:14:00.036831+0000","last_clean":"2024-04-24T02:14:00.036831+0000","last_became_active":"2024-04-24T02:11:56.723125+0000","last_became_peered":"2024-04-24T02:11:56.723125+0000","last_unstale":"2024-04-24T02:14:00.036831+0000","last_undegraded":"2024-04-24T02:14:00.036831+0000","last_fullsized":"2024-04-24T02:14:00.036831+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:10.037417+0000","last_change":"2024-04-24T02:12:02.746939+0000","last_active":"2024-04-24T02:14:10.037417+0000","last_peered":"2024-04-24T02:14:10.037417+0000","last_clean":"2024-04-24T02:14:10.037417+0000","last_became_active":"2024-04-24T02:12:02.746682+0000","last_became_peered":"2024-04-24T02:12:02.746682+0000","last_unstale":"2024-04-24T02:14:10.037417+0000","last_undegraded":"2024-04-24T02:14:10.037417+0000","last_fullsized":"2024-04-24T02:14:10.037417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:45.033355+0000","last_change":"2024-04-24T02:15:45.033384+0000","last_active":"2024-04-24T02:15:45.033355+0000","last_peered":"2024-04-24T02:15:45.033355+0000","last_clean":"2024-04-24T02:15:45.033355+0000","last_became_active":"2024-04-24T02:12:06.759169+0000","last_became_peered":"2024-04-24T02:12:06.759169+0000","last_unstale":"2024-04-24T02:15:45.033355+0000","last_undegraded":"2024-04-24T02:15:45.033355+0000","last_fullsized":"2024-04-24T02:15:45.033355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:45.033265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:45.033265+0000","last_clean_scrub_stamp":"2024-04-24T02:15:45.033265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:08:16.728687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'20","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:51.254222+0000","last_change":"2024-04-24T02:15:51.254261+0000","last_active":"2024-04-24T02:15:51.254222+0000","last_peered":"2024-04-24T02:15:51.254222+0000","last_clean":"2024-04-24T02:15:51.254222+0000","last_became_active":"2024-04-24T02:12:08.782765+0000","last_became_peered":"2024-04-24T02:12:08.782765+0000","last_unstale":"2024-04-24T02:15:51.254222+0000","last_undegraded":"2024-04-24T02:15:51.254222+0000","last_fullsized":"2024-04-24T02:15:51.254222+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-04-24T02:15:51.254102+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-04-24T02:15:51.254102+0000","last_clean_scrub_stamp":"2024-04-24T02:15:51.254102+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:26:37.436707+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:56.210447+0000","last_change":"2024-04-24T02:15:56.210473+0000","last_active":"2024-04-24T02:15:56.210447+0000","last_peered":"2024-04-24T02:15:56.210447+0000","last_clean":"2024-04-24T02:15:56.210447+0000","last_became_active":"2024-04-24T02:12:10.783813+0000","last_became_peered":"2024-04-24T02:12:10.783813+0000","last_unstale":"2024-04-24T02:15:56.210447+0000","last_undegraded":"2024-04-24T02:15:56.210447+0000","last_fullsized":"2024-04-24T02:15:56.210447+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:56.210358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:56.210358+0000","last_clean_scrub_stamp":"2024-04-24T02:15:56.210358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:46:40.354519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:25.039852+0000","last_change":"2024-04-24T02:12:12.797895+0000","last_active":"2024-04-24T02:14:25.039852+0000","last_peered":"2024-04-24T02:14:25.039852+0000","last_clean":"2024-04-24T02:14:25.039852+0000","last_became_active":"2024-04-24T02:12:12.796507+0000","last_became_peered":"2024-04-24T02:12:12.796507+0000","last_unstale":"2024-04-24T02:14:25.039852+0000","last_undegraded":"2024-04-24T02:14:25.039852+0000","last_fullsized":"2024-04-24T02:14:25.039852+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:44.357802+0000","last_change":"2024-04-24T02:15:44.357865+0000","last_active":"2024-04-24T02:15:44.357802+0000","last_peered":"2024-04-24T02:15:44.357802+0000","last_clean":"2024-04-24T02:15:44.357802+0000","last_became_active":"2024-04-24T02:12:04.767221+0000","last_became_peered":"2024-04-24T02:12:04.767221+0000","last_unstale":"2024-04-24T02:15:44.357802+0000","last_undegraded":"2024-04-24T02:15:44.357802+0000","last_fullsized":"2024-04-24T02:15:44.357802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:44.357687+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:44.357687+0000","last_clean_scrub_stamp":"2024-04-24T02:15:44.357687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:44:16.884604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:10.037472+0000","last_change":"2024-04-24T02:12:02.747860+0000","last_active":"2024-04-24T02:14:10.037472+0000","last_peered":"2024-04-24T02:14:10.037472+0000","last_clean":"2024-04-24T02:14:10.037472+0000","last_became_active":"2024-04-24T02:12:02.744161+0000","last_became_peered":"2024-04-24T02:12:02.744161+0000","last_unstale":"2024-04-24T02:14:10.037472+0000","last_undegraded":"2024-04-24T02:14:10.037472+0000","last_fullsized":"2024-04-24T02:14:10.037472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:03.032354+0000","last_change":"2024-04-24T02:11:56.723976+0000","last_active":"2024-04-24T02:14:03.032354+0000","last_peered":"2024-04-24T02:14:03.032354+0000","last_clean":"2024-04-24T02:14:03.032354+0000","last_became_active":"2024-04-24T02:11:56.723697+0000","last_became_peered":"2024-04-24T02:11:56.723697+0000","last_unstale":"2024-04-24T02:14:03.032354+0000","last_undegraded":"2024-04-24T02:14:03.032354+0000","last_fullsized":"2024-04-24T02:14:03.032354+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:45.989672+0000","last_change":"2024-04-24T02:15:45.989705+0000","last_active":"2024-04-24T02:15:45.989672+0000","last_peered":"2024-04-24T02:15:45.989672+0000","last_clean":"2024-04-24T02:15:45.989672+0000","last_became_active":"2024-04-24T02:12:06.759160+0000","last_became_peered":"2024-04-24T02:12:06.759160+0000","last_unstale":"2024-04-24T02:15:45.989672+0000","last_undegraded":"2024-04-24T02:15:45.989672+0000","last_fullsized":"2024-04-24T02:15:45.989672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:15:45.989545+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:15:45.989545+0000","last_clean_scrub_stamp":"2024-04-24T02:15:45.989545+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:56:06.540361+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'87","reported_seq":175,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:33.030349+0000","last_change":"2024-04-24T02:15:33.030400+0000","last_active":"2024-04-24T02:15:33.030349+0000","last_peered":"2024-04-24T02:15:33.030349+0000","last_clean":"2024-04-24T02:15:33.030349+0000","last_became_active":"2024-04-24T02:12:08.780688+0000","last_became_peered":"2024-04-24T02:12:08.780688+0000","last_unstale":"2024-04-24T02:15:33.030349+0000","last_undegraded":"2024-04-24T02:15:33.030349+0000","last_fullsized":"2024-04-24T02:15:33.030349+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'87","last_scrub_stamp":"2024-04-24T02:15:33.030249+0000","last_deep_scrub":"32'87","last_deep_scrub_stamp":"2024-04-24T02:15:33.030249+0000","last_clean_scrub_stamp":"2024-04-24T02:15:33.030249+0000","objects_scrubbed":11,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:20:07.673923+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":89,"num_read_kb":75,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:25.419741+0000","last_change":"2024-04-24T02:15:25.419767+0000","last_active":"2024-04-24T02:15:25.419741+0000","last_peered":"2024-04-24T02:15:25.419741+0000","last_clean":"2024-04-24T02:15:25.419741+0000","last_became_active":"2024-04-24T02:12:10.781586+0000","last_became_peered":"2024-04-24T02:12:10.781586+0000","last_unstale":"2024-04-24T02:15:25.419741+0000","last_undegraded":"2024-04-24T02:15:25.419741+0000","last_fullsized":"2024-04-24T02:15:25.419741+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:25.419637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:25.419637+0000","last_clean_scrub_stamp":"2024-04-24T02:15:25.419637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:41:52.572498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'9","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:28.036038+0000","last_change":"2024-04-24T02:12:12.798530+0000","last_active":"2024-04-24T02:14:28.036038+0000","last_peered":"2024-04-24T02:14:28.036038+0000","last_clean":"2024-04-24T02:14:28.036038+0000","last_became_active":"2024-04-24T02:12:12.798272+0000","last_became_peered":"2024-04-24T02:12:12.798272+0000","last_unstale":"2024-04-24T02:14:28.036038+0000","last_undegraded":"2024-04-24T02:14:28.036038+0000","last_fullsized":"2024-04-24T02:14:28.036038+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'6","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:51.465131+0000","last_change":"2024-04-24T02:15:51.465160+0000","last_active":"2024-04-24T02:15:51.465131+0000","last_peered":"2024-04-24T02:15:51.465131+0000","last_clean":"2024-04-24T02:15:51.465131+0000","last_became_active":"2024-04-24T02:12:04.765093+0000","last_became_peered":"2024-04-24T02:12:04.765093+0000","last_unstale":"2024-04-24T02:15:51.465131+0000","last_undegraded":"2024-04-24T02:15:51.465131+0000","last_fullsized":"2024-04-24T02:15:51.465131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-24T02:15:51.465043+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-24T02:15:51.465043+0000","last_clean_scrub_stamp":"2024-04-24T02:15:51.465043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:49:04.615334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:08.033226+0000","last_change":"2024-04-24T02:12:02.741909+0000","last_active":"2024-04-24T02:14:08.033226+0000","last_peered":"2024-04-24T02:14:08.033226+0000","last_clean":"2024-04-24T02:14:08.033226+0000","last_became_active":"2024-04-24T02:12:02.741565+0000","last_became_peered":"2024-04-24T02:12:02.741565+0000","last_unstale":"2024-04-24T02:14:08.033226+0000","last_undegraded":"2024-04-24T02:14:08.033226+0000","last_fullsized":"2024-04-24T02:14:08.033226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:05.037570+0000","last_change":"2024-04-24T02:11:56.724046+0000","last_active":"2024-04-24T02:14:05.037570+0000","last_peered":"2024-04-24T02:14:05.037570+0000","last_clean":"2024-04-24T02:14:05.037570+0000","last_became_active":"2024-04-24T02:11:56.723673+0000","last_became_peered":"2024-04-24T02:11:56.723673+0000","last_unstale":"2024-04-24T02:14:05.037570+0000","last_undegraded":"2024-04-24T02:14:05.037570+0000","last_fullsized":"2024-04-24T02:14:05.037570+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:31.335556+0000","last_change":"2024-04-24T02:15:31.335580+0000","last_active":"2024-04-24T02:15:31.335556+0000","last_peered":"2024-04-24T02:15:31.335556+0000","last_clean":"2024-04-24T02:15:31.335556+0000","last_became_active":"2024-04-24T02:12:06.755760+0000","last_became_peered":"2024-04-24T02:12:06.755760+0000","last_unstale":"2024-04-24T02:15:31.335556+0000","last_undegraded":"2024-04-24T02:15:31.335556+0000","last_fullsized":"2024-04-24T02:15:31.335556+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:31.335458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:31.335458+0000","last_clean_scrub_stamp":"2024-04-24T02:15:31.335458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:15:39.406302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'28","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:27.368820+0000","last_change":"2024-04-24T02:15:27.368863+0000","last_active":"2024-04-24T02:15:27.368820+0000","last_peered":"2024-04-24T02:15:27.368820+0000","last_clean":"2024-04-24T02:15:27.368820+0000","last_became_active":"2024-04-24T02:12:08.779698+0000","last_became_peered":"2024-04-24T02:12:08.779698+0000","last_unstale":"2024-04-24T02:15:27.368820+0000","last_undegraded":"2024-04-24T02:15:27.368820+0000","last_fullsized":"2024-04-24T02:15:27.368820+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'28","last_scrub_stamp":"2024-04-24T02:15:27.368732+0000","last_deep_scrub":"32'28","last_deep_scrub_stamp":"2024-04-24T02:15:27.368732+0000","last_clean_scrub_stamp":"2024-04-24T02:15:27.368732+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:51:46.023041+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'285","reported_seq":358,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:30.318483+0000","last_change":"2024-04-24T02:15:30.318523+0000","last_active":"2024-04-24T02:15:30.318483+0000","last_peered":"2024-04-24T02:15:30.318483+0000","last_clean":"2024-04-24T02:15:30.318483+0000","last_became_active":"2024-04-24T02:12:10.781799+0000","last_became_peered":"2024-04-24T02:12:10.781799+0000","last_unstale":"2024-04-24T02:15:30.318483+0000","last_undegraded":"2024-04-24T02:15:30.318483+0000","last_fullsized":"2024-04-24T02:15:30.318483+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-24T02:15:30.318394+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-24T02:15:30.318394+0000","last_clean_scrub_stamp":"2024-04-24T02:15:30.318394+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:55:07.242675+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:30.041560+0000","last_change":"2024-04-24T02:12:12.794164+0000","last_active":"2024-04-24T02:14:30.041560+0000","last_peered":"2024-04-24T02:14:30.041560+0000","last_clean":"2024-04-24T02:14:30.041560+0000","last_became_active":"2024-04-24T02:12:12.792628+0000","last_became_peered":"2024-04-24T02:12:12.792628+0000","last_unstale":"2024-04-24T02:14:30.041560+0000","last_undegraded":"2024-04-24T02:14:30.041560+0000","last_fullsized":"2024-04-24T02:14:30.041560+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'19","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:37.364694+0000","last_change":"2024-04-24T02:15:37.364765+0000","last_active":"2024-04-24T02:15:37.364694+0000","last_peered":"2024-04-24T02:15:37.364694+0000","last_clean":"2024-04-24T02:15:37.364694+0000","last_became_active":"2024-04-24T02:12:04.768066+0000","last_became_peered":"2024-04-24T02:12:04.768066+0000","last_unstale":"2024-04-24T02:15:37.364694+0000","last_undegraded":"2024-04-24T02:15:37.364694+0000","last_fullsized":"2024-04-24T02:15:37.364694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'19","last_scrub_stamp":"2024-04-24T02:15:37.364597+0000","last_deep_scrub":"32'19","last_deep_scrub_stamp":"2024-04-24T02:15:37.364597+0000","last_clean_scrub_stamp":"2024-04-24T02:15:37.364597+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:10:16.966259+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":70,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:15.039147+0000","last_change":"2024-04-24T02:12:02.761644+0000","last_active":"2024-04-24T02:14:15.039147+0000","last_peered":"2024-04-24T02:14:15.039147+0000","last_clean":"2024-04-24T02:14:15.039147+0000","last_became_active":"2024-04-24T02:12:02.760824+0000","last_became_peered":"2024-04-24T02:12:02.760824+0000","last_unstale":"2024-04-24T02:14:15.039147+0000","last_undegraded":"2024-04-24T02:14:15.039147+0000","last_fullsized":"2024-04-24T02:14:15.039147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:08.033261+0000","last_change":"2024-04-24T02:11:56.723499+0000","last_active":"2024-04-24T02:14:08.033261+0000","last_peered":"2024-04-24T02:14:08.033261+0000","last_clean":"2024-04-24T02:14:08.033261+0000","last_became_active":"2024-04-24T02:11:56.723277+0000","last_became_peered":"2024-04-24T02:11:56.723277+0000","last_unstale":"2024-04-24T02:14:08.033261+0000","last_undegraded":"2024-04-24T02:14:08.033261+0000","last_fullsized":"2024-04-24T02:14:08.033261+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:33.324096+0000","last_change":"2024-04-24T02:15:33.324119+0000","last_active":"2024-04-24T02:15:33.324096+0000","last_peered":"2024-04-24T02:15:33.324096+0000","last_clean":"2024-04-24T02:15:33.324096+0000","last_became_active":"2024-04-24T02:12:06.754414+0000","last_became_peered":"2024-04-24T02:12:06.754414+0000","last_unstale":"2024-04-24T02:15:33.324096+0000","last_undegraded":"2024-04-24T02:15:33.324096+0000","last_fullsized":"2024-04-24T02:15:33.324096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:33.324008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:33.324008+0000","last_clean_scrub_stamp":"2024-04-24T02:15:33.324008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:33:56.910723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'23","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:38.410159+0000","last_change":"2024-04-24T02:15:38.410200+0000","last_active":"2024-04-24T02:15:38.410159+0000","last_peered":"2024-04-24T02:15:38.410159+0000","last_clean":"2024-04-24T02:15:38.410159+0000","last_became_active":"2024-04-24T02:12:08.779937+0000","last_became_peered":"2024-04-24T02:12:08.779937+0000","last_unstale":"2024-04-24T02:15:38.410159+0000","last_undegraded":"2024-04-24T02:15:38.410159+0000","last_fullsized":"2024-04-24T02:15:38.410159+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2024-04-24T02:15:38.410066+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2024-04-24T02:15:38.410066+0000","last_clean_scrub_stamp":"2024-04-24T02:15:38.410066+0000","objects_scrubbed":6,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:27:43.655638+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'285","reported_seq":401,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:30.014088+0000","last_change":"2024-04-24T02:15:30.014117+0000","last_active":"2024-04-24T02:15:30.014088+0000","last_peered":"2024-04-24T02:15:30.014088+0000","last_clean":"2024-04-24T02:15:30.014088+0000","last_became_active":"2024-04-24T02:12:10.776594+0000","last_became_peered":"2024-04-24T02:12:10.776594+0000","last_unstale":"2024-04-24T02:15:30.014088+0000","last_undegraded":"2024-04-24T02:15:30.014088+0000","last_fullsized":"2024-04-24T02:15:30.014088+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-24T02:15:30.013989+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-24T02:15:30.013989+0000","last_clean_scrub_stamp":"2024-04-24T02:15:30.013989+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:47:15.601895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:46.394990+0000","last_change":"2024-04-24T02:15:46.395014+0000","last_active":"2024-04-24T02:15:46.394990+0000","last_peered":"2024-04-24T02:15:46.394990+0000","last_clean":"2024-04-24T02:15:46.394990+0000","last_became_active":"2024-04-24T02:12:12.795328+0000","last_became_peered":"2024-04-24T02:12:12.795328+0000","last_unstale":"2024-04-24T02:15:46.394990+0000","last_undegraded":"2024-04-24T02:15:46.394990+0000","last_fullsized":"2024-04-24T02:15:46.394990+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2024-04-24T02:15:46.394901+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2024-04-24T02:15:46.394901+0000","last_clean_scrub_stamp":"2024-04-24T02:15:46.394901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:06:09.926743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:56.397500+0000","last_change":"2024-04-24T02:15:56.397529+0000","last_active":"2024-04-24T02:15:56.397500+0000","last_peered":"2024-04-24T02:15:56.397500+0000","last_clean":"2024-04-24T02:15:56.397500+0000","last_became_active":"2024-04-24T02:12:04.760099+0000","last_became_peered":"2024-04-24T02:12:04.760099+0000","last_unstale":"2024-04-24T02:15:56.397500+0000","last_undegraded":"2024-04-24T02:15:56.397500+0000","last_fullsized":"2024-04-24T02:15:56.397500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:56.397413+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:56.397413+0000","last_clean_scrub_stamp":"2024-04-24T02:15:56.397413+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:03:48.856552+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:20.095255+0000","last_change":"2024-04-24T02:12:02.744971+0000","last_active":"2024-04-24T02:15:20.095255+0000","last_peered":"2024-04-24T02:15:20.095255+0000","last_clean":"2024-04-24T02:15:20.095255+0000","last_became_active":"2024-04-24T02:12:02.744454+0000","last_became_peered":"2024-04-24T02:12:02.744454+0000","last_unstale":"2024-04-24T02:15:20.095255+0000","last_undegraded":"2024-04-24T02:15:20.095255+0000","last_fullsized":"2024-04-24T02:15:20.095255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:05.037613+0000","last_change":"2024-04-24T02:11:57.000530+0000","last_active":"2024-04-24T02:14:05.037613+0000","last_peered":"2024-04-24T02:14:05.037613+0000","last_clean":"2024-04-24T02:14:05.037613+0000","last_became_active":"2024-04-24T02:11:57.000197+0000","last_became_peered":"2024-04-24T02:11:57.000197+0000","last_unstale":"2024-04-24T02:14:05.037613+0000","last_undegraded":"2024-04-24T02:14:05.037613+0000","last_fullsized":"2024-04-24T02:14:05.037613+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:34.371665+0000","last_change":"2024-04-24T02:15:34.371690+0000","last_active":"2024-04-24T02:15:34.371665+0000","last_peered":"2024-04-24T02:15:34.371665+0000","last_clean":"2024-04-24T02:15:34.371665+0000","last_became_active":"2024-04-24T02:12:06.754107+0000","last_became_peered":"2024-04-24T02:12:06.754107+0000","last_unstale":"2024-04-24T02:15:34.371665+0000","last_undegraded":"2024-04-24T02:15:34.371665+0000","last_fullsized":"2024-04-24T02:15:34.371665+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:34.371542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:34.371542+0000","last_clean_scrub_stamp":"2024-04-24T02:15:34.371542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:59:19.687673+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'105","reported_seq":204,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:32.532733+0000","last_change":"2024-04-24T02:15:32.532781+0000","last_active":"2024-04-24T02:15:32.532733+0000","last_peered":"2024-04-24T02:15:32.532733+0000","last_clean":"2024-04-24T02:15:32.532733+0000","last_became_active":"2024-04-24T02:12:08.780925+0000","last_became_peered":"2024-04-24T02:12:08.780925+0000","last_unstale":"2024-04-24T02:15:32.532733+0000","last_undegraded":"2024-04-24T02:15:32.532733+0000","last_fullsized":"2024-04-24T02:15:32.532733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'105","last_scrub_stamp":"2024-04-24T02:15:32.532634+0000","last_deep_scrub":"32'105","last_deep_scrub_stamp":"2024-04-24T02:15:32.532634+0000","last_clean_scrub_stamp":"2024-04-24T02:15:32.532634+0000","objects_scrubbed":9,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:37:40.136523+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":108,"num_read_kb":111,"num_write":44,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:32.071821+0000","last_change":"2024-04-24T02:15:32.071860+0000","last_active":"2024-04-24T02:15:32.071821+0000","last_peered":"2024-04-24T02:15:32.071821+0000","last_clean":"2024-04-24T02:15:32.071821+0000","last_became_active":"2024-04-24T02:12:10.775165+0000","last_became_peered":"2024-04-24T02:12:10.775165+0000","last_unstale":"2024-04-24T02:15:32.071821+0000","last_undegraded":"2024-04-24T02:15:32.071821+0000","last_fullsized":"2024-04-24T02:15:32.071821+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:32.071693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:32.071693+0000","last_clean_scrub_stamp":"2024-04-24T02:15:32.071693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:31:34.757480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"30'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:42.394026+0000","last_change":"2024-04-24T02:15:42.394068+0000","last_active":"2024-04-24T02:15:42.394026+0000","last_peered":"2024-04-24T02:15:42.394026+0000","last_clean":"2024-04-24T02:15:42.394026+0000","last_became_active":"2024-04-24T02:12:12.796411+0000","last_became_peered":"2024-04-24T02:12:12.796411+0000","last_unstale":"2024-04-24T02:15:42.394026+0000","last_undegraded":"2024-04-24T02:15:42.394026+0000","last_fullsized":"2024-04-24T02:15:42.394026+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-24T02:15:42.393912+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-24T02:15:42.393912+0000","last_clean_scrub_stamp":"2024-04-24T02:15:42.393912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:09:36.452146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:20.039105+0000","last_change":"2024-04-24T02:12:12.801700+0000","last_active":"2024-04-24T02:14:20.039105+0000","last_peered":"2024-04-24T02:14:20.039105+0000","last_clean":"2024-04-24T02:14:20.039105+0000","last_became_active":"2024-04-24T02:12:12.801346+0000","last_became_peered":"2024-04-24T02:12:12.801346+0000","last_unstale":"2024-04-24T02:14:20.039105+0000","last_undegraded":"2024-04-24T02:14:20.039105+0000","last_fullsized":"2024-04-24T02:14:20.039105+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:25.039749+0000","last_change":"2024-04-24T02:12:04.764138+0000","last_active":"2024-04-24T02:14:25.039749+0000","last_peered":"2024-04-24T02:14:25.039749+0000","last_clean":"2024-04-24T02:14:25.039749+0000","last_became_active":"2024-04-24T02:12:04.763860+0000","last_became_peered":"2024-04-24T02:12:04.763860+0000","last_unstale":"2024-04-24T02:14:25.039749+0000","last_undegraded":"2024-04-24T02:14:25.039749+0000","last_fullsized":"2024-04-24T02:14:25.039749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:20.095672+0000","last_change":"2024-04-24T02:12:02.757073+0000","last_active":"2024-04-24T02:15:20.095672+0000","last_peered":"2024-04-24T02:15:20.095672+0000","last_clean":"2024-04-24T02:15:20.095672+0000","last_became_active":"2024-04-24T02:12:02.753166+0000","last_became_peered":"2024-04-24T02:12:02.753166+0000","last_unstale":"2024-04-24T02:15:20.095672+0000","last_undegraded":"2024-04-24T02:15:20.095672+0000","last_fullsized":"2024-04-24T02:15:20.095672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:39.395350+0000","last_change":"2024-04-24T02:15:39.395376+0000","last_active":"2024-04-24T02:15:39.395350+0000","last_peered":"2024-04-24T02:15:39.395350+0000","last_clean":"2024-04-24T02:15:39.395350+0000","last_became_active":"2024-04-24T02:12:06.758468+0000","last_became_peered":"2024-04-24T02:12:06.758468+0000","last_unstale":"2024-04-24T02:15:39.395350+0000","last_undegraded":"2024-04-24T02:15:39.395350+0000","last_fullsized":"2024-04-24T02:15:39.395350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:39.395252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:39.395252+0000","last_clean_scrub_stamp":"2024-04-24T02:15:39.395252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:56:56.565405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'47","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:54.212984+0000","last_change":"2024-04-24T02:15:54.213025+0000","last_active":"2024-04-24T02:15:54.212984+0000","last_peered":"2024-04-24T02:15:54.212984+0000","last_clean":"2024-04-24T02:15:54.212984+0000","last_became_active":"2024-04-24T02:12:08.780353+0000","last_became_peered":"2024-04-24T02:12:08.780353+0000","last_unstale":"2024-04-24T02:15:54.212984+0000","last_undegraded":"2024-04-24T02:15:54.212984+0000","last_fullsized":"2024-04-24T02:15:54.212984+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'47","last_scrub_stamp":"2024-04-24T02:15:54.212901+0000","last_deep_scrub":"32'47","last_deep_scrub_stamp":"2024-04-24T02:15:54.212901+0000","last_clean_scrub_stamp":"2024-04-24T02:15:54.212901+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:55:13.399828+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:30.041295+0000","last_change":"2024-04-24T02:12:10.787091+0000","last_active":"2024-04-24T02:14:30.041295+0000","last_peered":"2024-04-24T02:14:30.041295+0000","last_clean":"2024-04-24T02:14:30.041295+0000","last_became_active":"2024-04-24T02:12:10.786813+0000","last_became_peered":"2024-04-24T02:12:10.786813+0000","last_unstale":"2024-04-24T02:14:30.041295+0000","last_undegraded":"2024-04-24T02:14:30.041295+0000","last_fullsized":"2024-04-24T02:14:30.041295+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'9","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.174206+0000","last_change":"2024-04-24T02:12:12.796438+0000","last_active":"2024-04-24T02:15:13.174206+0000","last_peered":"2024-04-24T02:15:13.174206+0000","last_clean":"2024-04-24T02:15:13.174206+0000","last_became_active":"2024-04-24T02:12:12.796149+0000","last_became_peered":"2024-04-24T02:12:12.796149+0000","last_unstale":"2024-04-24T02:15:13.174206+0000","last_undegraded":"2024-04-24T02:15:13.174206+0000","last_fullsized":"2024-04-24T02:15:13.174206+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'2","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.176885+0000","last_change":"2024-04-24T02:12:45.816393+0000","last_active":"2024-04-24T02:15:13.176885+0000","last_peered":"2024-04-24T02:15:13.176885+0000","last_clean":"2024-04-24T02:15:13.176885+0000","last_became_active":"2024-04-24T02:12:45.816009+0000","last_became_peered":"2024-04-24T02:12:45.816009+0000","last_unstale":"2024-04-24T02:15:13.176885+0000","last_undegraded":"2024-04-24T02:15:13.176885+0000","last_fullsized":"2024-04-24T02:15:13.176885+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:55.440095+0000","last_change":"2024-04-24T02:15:55.440136+0000","last_active":"2024-04-24T02:15:55.440095+0000","last_peered":"2024-04-24T02:15:55.440095+0000","last_clean":"2024-04-24T02:15:55.440095+0000","last_became_active":"2024-04-24T02:12:02.754623+0000","last_became_peered":"2024-04-24T02:12:02.754623+0000","last_unstale":"2024-04-24T02:15:55.440095+0000","last_undegraded":"2024-04-24T02:15:55.440095+0000","last_fullsized":"2024-04-24T02:15:55.440095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-24T02:15:55.439995+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-24T02:15:55.439995+0000","last_clean_scrub_stamp":"2024-04-24T02:15:55.439995+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:06:18.971836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:27.328721+0000","last_change":"2024-04-24T02:15:27.328746+0000","last_active":"2024-04-24T02:15:27.328721+0000","last_peered":"2024-04-24T02:15:27.328721+0000","last_clean":"2024-04-24T02:15:27.328721+0000","last_became_active":"2024-04-24T02:12:06.756998+0000","last_became_peered":"2024-04-24T02:12:06.756998+0000","last_unstale":"2024-04-24T02:15:27.328721+0000","last_undegraded":"2024-04-24T02:15:27.328721+0000","last_fullsized":"2024-04-24T02:15:27.328721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:27.328635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:27.328635+0000","last_clean_scrub_stamp":"2024-04-24T02:15:27.328635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:13.610015+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'9","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:36.993078+0000","last_change":"2024-04-24T02:15:36.993114+0000","last_active":"2024-04-24T02:15:36.993078+0000","last_peered":"2024-04-24T02:15:36.993078+0000","last_clean":"2024-04-24T02:15:36.993078+0000","last_became_active":"2024-04-24T02:12:08.769610+0000","last_became_peered":"2024-04-24T02:12:08.769610+0000","last_unstale":"2024-04-24T02:15:36.993078+0000","last_undegraded":"2024-04-24T02:15:36.993078+0000","last_fullsized":"2024-04-24T02:15:36.993078+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-24T02:15:36.992984+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-24T02:15:36.992984+0000","last_clean_scrub_stamp":"2024-04-24T02:15:36.992984+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:31:27.219681+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:24.453899+0000","last_change":"2024-04-24T02:15:24.453926+0000","last_active":"2024-04-24T02:15:24.453899+0000","last_peered":"2024-04-24T02:15:24.453899+0000","last_clean":"2024-04-24T02:15:24.453899+0000","last_became_active":"2024-04-24T02:12:10.784955+0000","last_became_peered":"2024-04-24T02:12:10.784955+0000","last_unstale":"2024-04-24T02:15:24.453899+0000","last_undegraded":"2024-04-24T02:15:24.453899+0000","last_fullsized":"2024-04-24T02:15:24.453899+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:24.453808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:24.453808+0000","last_clean_scrub_stamp":"2024-04-24T02:15:24.453808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:10:25.731858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'10","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:43.038159+0000","last_change":"2024-04-24T02:12:12.792872+0000","last_active":"2024-04-24T02:14:43.038159+0000","last_peered":"2024-04-24T02:14:43.038159+0000","last_clean":"2024-04-24T02:14:43.038159+0000","last_became_active":"2024-04-24T02:12:12.792565+0000","last_became_peered":"2024-04-24T02:12:12.792565+0000","last_unstale":"2024-04-24T02:14:43.038159+0000","last_undegraded":"2024-04-24T02:14:43.038159+0000","last_fullsized":"2024-04-24T02:14:43.038159+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":60,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:49.117581+0000","last_change":"2024-04-24T02:15:49.117627+0000","last_active":"2024-04-24T02:15:49.117581+0000","last_peered":"2024-04-24T02:15:49.117581+0000","last_clean":"2024-04-24T02:15:49.117581+0000","last_became_active":"2024-04-24T02:12:04.766700+0000","last_became_peered":"2024-04-24T02:12:04.766700+0000","last_unstale":"2024-04-24T02:15:49.117581+0000","last_undegraded":"2024-04-24T02:15:49.117581+0000","last_fullsized":"2024-04-24T02:15:49.117581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:49.117486+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:49.117486+0000","last_clean_scrub_stamp":"2024-04-24T02:15:49.117486+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:35:31.797741+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:30.040702+0000","last_change":"2024-04-24T02:12:45.817612+0000","last_active":"2024-04-24T02:14:30.040702+0000","last_peered":"2024-04-24T02:14:30.040702+0000","last_clean":"2024-04-24T02:14:30.040702+0000","last_became_active":"2024-04-24T02:12:45.817240+0000","last_became_peered":"2024-04-24T02:12:45.817240+0000","last_unstale":"2024-04-24T02:14:30.040702+0000","last_undegraded":"2024-04-24T02:14:30.040702+0000","last_fullsized":"2024-04-24T02:14:30.040702+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:40.427976+0000","last_change":"2024-04-24T02:15:40.428002+0000","last_active":"2024-04-24T02:15:40.427976+0000","last_peered":"2024-04-24T02:15:40.427976+0000","last_clean":"2024-04-24T02:15:40.427976+0000","last_became_active":"2024-04-24T02:12:06.764776+0000","last_became_peered":"2024-04-24T02:12:06.764776+0000","last_unstale":"2024-04-24T02:15:40.427976+0000","last_undegraded":"2024-04-24T02:15:40.427976+0000","last_fullsized":"2024-04-24T02:15:40.427976+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:40.427880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:40.427880+0000","last_clean_scrub_stamp":"2024-04-24T02:15:40.427880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:04:59.966363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'47","reported_seq":119,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:39.994683+0000","last_change":"2024-04-24T02:15:39.994717+0000","last_active":"2024-04-24T02:15:39.994683+0000","last_peered":"2024-04-24T02:15:39.994683+0000","last_clean":"2024-04-24T02:15:39.994683+0000","last_became_active":"2024-04-24T02:12:08.768499+0000","last_became_peered":"2024-04-24T02:12:08.768499+0000","last_unstale":"2024-04-24T02:15:39.994683+0000","last_undegraded":"2024-04-24T02:15:39.994683+0000","last_fullsized":"2024-04-24T02:15:39.994683+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'47","last_scrub_stamp":"2024-04-24T02:15:39.994590+0000","last_deep_scrub":"32'47","last_deep_scrub_stamp":"2024-04-24T02:15:39.994590+0000","last_clean_scrub_stamp":"2024-04-24T02:15:39.994590+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:40:40.190436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:24.405718+0000","last_change":"2024-04-24T02:15:24.405740+0000","last_active":"2024-04-24T02:15:24.405718+0000","last_peered":"2024-04-24T02:15:24.405718+0000","last_clean":"2024-04-24T02:15:24.405718+0000","last_became_active":"2024-04-24T02:12:10.776882+0000","last_became_peered":"2024-04-24T02:12:10.776882+0000","last_unstale":"2024-04-24T02:15:24.405718+0000","last_undegraded":"2024-04-24T02:15:24.405718+0000","last_fullsized":"2024-04-24T02:15:24.405718+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:24.405592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:24.405592+0000","last_clean_scrub_stamp":"2024-04-24T02:15:24.405592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:41:19.659879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.469268+0000","last_change":"2024-04-24T02:12:12.794192+0000","last_active":"2024-04-24T02:15:13.469268+0000","last_peered":"2024-04-24T02:15:13.469268+0000","last_clean":"2024-04-24T02:15:13.469268+0000","last_became_active":"2024-04-24T02:12:12.793884+0000","last_became_peered":"2024-04-24T02:12:12.793884+0000","last_unstale":"2024-04-24T02:15:13.469268+0000","last_undegraded":"2024-04-24T02:15:13.469268+0000","last_fullsized":"2024-04-24T02:15:13.469268+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'6","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:42.377250+0000","last_change":"2024-04-24T02:15:42.377279+0000","last_active":"2024-04-24T02:15:42.377250+0000","last_peered":"2024-04-24T02:15:42.377250+0000","last_clean":"2024-04-24T02:15:42.377250+0000","last_became_active":"2024-04-24T02:12:04.767431+0000","last_became_peered":"2024-04-24T02:12:04.767431+0000","last_unstale":"2024-04-24T02:15:42.377250+0000","last_undegraded":"2024-04-24T02:15:42.377250+0000","last_fullsized":"2024-04-24T02:15:42.377250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-24T02:15:42.377157+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-24T02:15:42.377157+0000","last_clean_scrub_stamp":"2024-04-24T02:15:42.377157+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:22:21.631155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:30.040880+0000","last_change":"2024-04-24T02:12:02.754566+0000","last_active":"2024-04-24T02:14:30.040880+0000","last_peered":"2024-04-24T02:14:30.040880+0000","last_clean":"2024-04-24T02:14:30.040880+0000","last_became_active":"2024-04-24T02:12:02.754295+0000","last_became_peered":"2024-04-24T02:12:02.754295+0000","last_unstale":"2024-04-24T02:14:30.040880+0000","last_undegraded":"2024-04-24T02:14:30.040880+0000","last_fullsized":"2024-04-24T02:14:30.040880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:24.382922+0000","last_change":"2024-04-24T02:15:24.382967+0000","last_active":"2024-04-24T02:15:24.382922+0000","last_peered":"2024-04-24T02:15:24.382922+0000","last_clean":"2024-04-24T02:15:24.382922+0000","last_became_active":"2024-04-24T02:12:06.758462+0000","last_became_peered":"2024-04-24T02:12:06.758462+0000","last_unstale":"2024-04-24T02:15:24.382922+0000","last_undegraded":"2024-04-24T02:15:24.382922+0000","last_fullsized":"2024-04-24T02:15:24.382922+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:24.382807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:24.382807+0000","last_clean_scrub_stamp":"2024-04-24T02:15:24.382807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:05:42.611375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'36","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:39.388995+0000","last_change":"2024-04-24T02:15:39.389030+0000","last_active":"2024-04-24T02:15:39.388995+0000","last_peered":"2024-04-24T02:15:39.388995+0000","last_clean":"2024-04-24T02:15:39.388995+0000","last_became_active":"2024-04-24T02:12:08.768814+0000","last_became_peered":"2024-04-24T02:12:08.768814+0000","last_unstale":"2024-04-24T02:15:39.388995+0000","last_undegraded":"2024-04-24T02:15:39.388995+0000","last_fullsized":"2024-04-24T02:15:39.388995+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-04-24T02:15:39.388901+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-04-24T02:15:39.388901+0000","last_clean_scrub_stamp":"2024-04-24T02:15:39.388901+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:55:16.313182+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:27.445785+0000","last_change":"2024-04-24T02:15:27.445811+0000","last_active":"2024-04-24T02:15:27.445785+0000","last_peered":"2024-04-24T02:15:27.445785+0000","last_clean":"2024-04-24T02:15:27.445785+0000","last_became_active":"2024-04-24T02:12:10.779734+0000","last_became_peered":"2024-04-24T02:12:10.779734+0000","last_unstale":"2024-04-24T02:15:27.445785+0000","last_undegraded":"2024-04-24T02:15:27.445785+0000","last_fullsized":"2024-04-24T02:15:27.445785+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:27.445677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:27.445677+0000","last_clean_scrub_stamp":"2024-04-24T02:15:27.445677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:47:29.069695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:45.317788+0000","last_change":"2024-04-24T02:15:45.317822+0000","last_active":"2024-04-24T02:15:45.317788+0000","last_peered":"2024-04-24T02:15:45.317788+0000","last_clean":"2024-04-24T02:15:45.317788+0000","last_became_active":"2024-04-24T02:12:04.764564+0000","last_became_peered":"2024-04-24T02:12:04.764564+0000","last_unstale":"2024-04-24T02:15:45.317788+0000","last_undegraded":"2024-04-24T02:15:45.317788+0000","last_fullsized":"2024-04-24T02:15:45.317788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:15:45.317697+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:15:45.317697+0000","last_clean_scrub_stamp":"2024-04-24T02:15:45.317697+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:34:45.124130+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.041779+0000","last_change":"2024-04-24T02:12:45.809612+0000","last_active":"2024-04-24T02:15:13.041779+0000","last_peered":"2024-04-24T02:15:13.041779+0000","last_clean":"2024-04-24T02:15:13.041779+0000","last_became_active":"2024-04-24T02:12:45.809365+0000","last_became_peered":"2024-04-24T02:12:45.809365+0000","last_unstale":"2024-04-24T02:15:13.041779+0000","last_undegraded":"2024-04-24T02:15:13.041779+0000","last_fullsized":"2024-04-24T02:15:13.041779+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:45.043161+0000","last_change":"2024-04-24T02:12:45.815335+0000","last_active":"2024-04-24T02:14:45.043161+0000","last_peered":"2024-04-24T02:14:45.043161+0000","last_clean":"2024-04-24T02:14:45.043161+0000","last_became_active":"2024-04-24T02:12:45.814918+0000","last_became_peered":"2024-04-24T02:12:45.814918+0000","last_unstale":"2024-04-24T02:14:45.043161+0000","last_undegraded":"2024-04-24T02:14:45.043161+0000","last_fullsized":"2024-04-24T02:14:45.043161+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:05.740097+0000","last_clean_scrub_stamp":"2024-04-24T02:12:05.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"32'72","reported_seq":151,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:38.006044+0000","last_change":"2024-04-24T02:15:38.006098+0000","last_active":"2024-04-24T02:15:38.006044+0000","last_peered":"2024-04-24T02:15:38.006044+0000","last_clean":"2024-04-24T02:15:38.006044+0000","last_became_active":"2024-04-24T02:12:08.769578+0000","last_became_peered":"2024-04-24T02:12:08.769578+0000","last_unstale":"2024-04-24T02:15:38.006044+0000","last_undegraded":"2024-04-24T02:15:38.006044+0000","last_fullsized":"2024-04-24T02:15:38.006044+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'72","last_scrub_stamp":"2024-04-24T02:15:38.005928+0000","last_deep_scrub":"32'72","last_deep_scrub_stamp":"2024-04-24T02:15:38.005928+0000","last_clean_scrub_stamp":"2024-04-24T02:15:38.005928+0000","objects_scrubbed":6,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:38:25.392507+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:28.440238+0000","last_change":"2024-04-24T02:15:28.440262+0000","last_active":"2024-04-24T02:15:28.440238+0000","last_peered":"2024-04-24T02:15:28.440238+0000","last_clean":"2024-04-24T02:15:28.440238+0000","last_became_active":"2024-04-24T02:12:10.779703+0000","last_became_peered":"2024-04-24T02:12:10.779703+0000","last_unstale":"2024-04-24T02:15:28.440238+0000","last_undegraded":"2024-04-24T02:15:28.440238+0000","last_fullsized":"2024-04-24T02:15:28.440238+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:28.440118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:28.440118+0000","last_clean_scrub_stamp":"2024-04-24T02:15:28.440118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:28:48.467792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'16","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:33.036805+0000","last_change":"2024-04-24T02:12:12.791870+0000","last_active":"2024-04-24T02:14:33.036805+0000","last_peered":"2024-04-24T02:14:33.036805+0000","last_clean":"2024-04-24T02:14:33.036805+0000","last_became_active":"2024-04-24T02:12:12.791623+0000","last_became_peered":"2024-04-24T02:12:12.791623+0000","last_unstale":"2024-04-24T02:14:33.036805+0000","last_undegraded":"2024-04-24T02:14:33.036805+0000","last_fullsized":"2024-04-24T02:14:33.036805+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'10","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:01.115664+0000","last_change":"2024-04-24T02:16:01.115692+0000","last_active":"2024-04-24T02:16:01.115664+0000","last_peered":"2024-04-24T02:16:01.115664+0000","last_clean":"2024-04-24T02:16:01.115664+0000","last_became_active":"2024-04-24T02:12:04.755554+0000","last_became_peered":"2024-04-24T02:12:04.755554+0000","last_unstale":"2024-04-24T02:16:01.115664+0000","last_undegraded":"2024-04-24T02:16:01.115664+0000","last_fullsized":"2024-04-24T02:16:01.115664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-24T02:16:01.115544+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-24T02:16:01.115544+0000","last_clean_scrub_stamp":"2024-04-24T02:16:01.115544+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:30:37.328826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:30.040692+0000","last_change":"2024-04-24T02:12:02.752017+0000","last_active":"2024-04-24T02:14:30.040692+0000","last_peered":"2024-04-24T02:14:30.040692+0000","last_clean":"2024-04-24T02:14:30.040692+0000","last_became_active":"2024-04-24T02:12:02.751703+0000","last_became_peered":"2024-04-24T02:12:02.751703+0000","last_unstale":"2024-04-24T02:14:30.040692+0000","last_undegraded":"2024-04-24T02:14:30.040692+0000","last_fullsized":"2024-04-24T02:14:30.040692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:47.423792+0000","last_change":"2024-04-24T02:15:47.423814+0000","last_active":"2024-04-24T02:15:47.423792+0000","last_peered":"2024-04-24T02:15:47.423792+0000","last_clean":"2024-04-24T02:15:47.423792+0000","last_became_active":"2024-04-24T02:12:06.756154+0000","last_became_peered":"2024-04-24T02:12:06.756154+0000","last_unstale":"2024-04-24T02:15:47.423792+0000","last_undegraded":"2024-04-24T02:15:47.423792+0000","last_fullsized":"2024-04-24T02:15:47.423792+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:47.423687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:47.423687+0000","last_clean_scrub_stamp":"2024-04-24T02:15:47.423687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:18:00.672544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'45","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:44.331369+0000","last_change":"2024-04-24T02:15:44.331428+0000","last_active":"2024-04-24T02:15:44.331369+0000","last_peered":"2024-04-24T02:15:44.331369+0000","last_clean":"2024-04-24T02:15:44.331369+0000","last_became_active":"2024-04-24T02:12:08.780215+0000","last_became_peered":"2024-04-24T02:12:08.780215+0000","last_unstale":"2024-04-24T02:15:44.331369+0000","last_undegraded":"2024-04-24T02:15:44.331369+0000","last_fullsized":"2024-04-24T02:15:44.331369+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'45","last_scrub_stamp":"2024-04-24T02:15:44.331260+0000","last_deep_scrub":"32'45","last_deep_scrub_stamp":"2024-04-24T02:15:44.331260+0000","last_clean_scrub_stamp":"2024-04-24T02:15:44.331260+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:06:04.005763+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:34.421645+0000","last_change":"2024-04-24T02:15:34.421669+0000","last_active":"2024-04-24T02:15:34.421645+0000","last_peered":"2024-04-24T02:15:34.421645+0000","last_clean":"2024-04-24T02:15:34.421645+0000","last_became_active":"2024-04-24T02:12:10.785707+0000","last_became_peered":"2024-04-24T02:12:10.785707+0000","last_unstale":"2024-04-24T02:15:34.421645+0000","last_undegraded":"2024-04-24T02:15:34.421645+0000","last_fullsized":"2024-04-24T02:15:34.421645+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:34.421551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:34.421551+0000","last_clean_scrub_stamp":"2024-04-24T02:15:34.421551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:44:00.829320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:35.042215+0000","last_change":"2024-04-24T02:12:12.798843+0000","last_active":"2024-04-24T02:14:35.042215+0000","last_peered":"2024-04-24T02:14:35.042215+0000","last_clean":"2024-04-24T02:14:35.042215+0000","last_became_active":"2024-04-24T02:12:12.798498+0000","last_became_peered":"2024-04-24T02:12:12.798498+0000","last_unstale":"2024-04-24T02:14:35.042215+0000","last_undegraded":"2024-04-24T02:14:35.042215+0000","last_fullsized":"2024-04-24T02:14:35.042215+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:35.413292+0000","last_change":"2024-04-24T02:15:35.413344+0000","last_active":"2024-04-24T02:15:35.413292+0000","last_peered":"2024-04-24T02:15:35.413292+0000","last_clean":"2024-04-24T02:15:35.413292+0000","last_became_active":"2024-04-24T02:12:04.768285+0000","last_became_peered":"2024-04-24T02:12:04.768285+0000","last_unstale":"2024-04-24T02:15:35.413292+0000","last_undegraded":"2024-04-24T02:15:35.413292+0000","last_fullsized":"2024-04-24T02:15:35.413292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:35.413190+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:35.413190+0000","last_clean_scrub_stamp":"2024-04-24T02:15:35.413190+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:52:59.536845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:35.041605+0000","last_change":"2024-04-24T02:12:02.749703+0000","last_active":"2024-04-24T02:14:35.041605+0000","last_peered":"2024-04-24T02:14:35.041605+0000","last_clean":"2024-04-24T02:14:35.041605+0000","last_became_active":"2024-04-24T02:12:02.749461+0000","last_became_peered":"2024-04-24T02:12:02.749461+0000","last_unstale":"2024-04-24T02:14:35.041605+0000","last_undegraded":"2024-04-24T02:14:35.041605+0000","last_fullsized":"2024-04-24T02:14:35.041605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:44.450336+0000","last_change":"2024-04-24T02:15:44.450359+0000","last_active":"2024-04-24T02:15:44.450336+0000","last_peered":"2024-04-24T02:15:44.450336+0000","last_clean":"2024-04-24T02:15:44.450336+0000","last_became_active":"2024-04-24T02:12:06.757760+0000","last_became_peered":"2024-04-24T02:12:06.757760+0000","last_unstale":"2024-04-24T02:15:44.450336+0000","last_undegraded":"2024-04-24T02:15:44.450336+0000","last_fullsized":"2024-04-24T02:15:44.450336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:44.450238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:44.450238+0000","last_clean_scrub_stamp":"2024-04-24T02:15:44.450238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:58:20.317926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'46","reported_seq":108,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:34.024624+0000","last_change":"2024-04-24T02:15:34.024663+0000","last_active":"2024-04-24T02:15:34.024624+0000","last_peered":"2024-04-24T02:15:34.024624+0000","last_clean":"2024-04-24T02:15:34.024624+0000","last_became_active":"2024-04-24T02:12:08.779471+0000","last_became_peered":"2024-04-24T02:12:08.779471+0000","last_unstale":"2024-04-24T02:15:34.024624+0000","last_undegraded":"2024-04-24T02:15:34.024624+0000","last_fullsized":"2024-04-24T02:15:34.024624+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-04-24T02:15:34.024534+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-04-24T02:15:34.024534+0000","last_clean_scrub_stamp":"2024-04-24T02:15:34.024534+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:54:19.092809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:26.055779+0000","last_change":"2024-04-24T02:15:26.055802+0000","last_active":"2024-04-24T02:15:26.055779+0000","last_peered":"2024-04-24T02:15:26.055779+0000","last_clean":"2024-04-24T02:15:26.055779+0000","last_became_active":"2024-04-24T02:12:10.780272+0000","last_became_peered":"2024-04-24T02:12:10.780272+0000","last_unstale":"2024-04-24T02:15:26.055779+0000","last_undegraded":"2024-04-24T02:15:26.055779+0000","last_fullsized":"2024-04-24T02:15:26.055779+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:26.055680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:26.055680+0000","last_clean_scrub_stamp":"2024-04-24T02:15:26.055680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:52:00.699214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:35.042130+0000","last_change":"2024-04-24T02:12:12.795264+0000","last_active":"2024-04-24T02:14:35.042130+0000","last_peered":"2024-04-24T02:14:35.042130+0000","last_clean":"2024-04-24T02:14:35.042130+0000","last_became_active":"2024-04-24T02:12:12.794815+0000","last_became_peered":"2024-04-24T02:12:12.794815+0000","last_unstale":"2024-04-24T02:14:35.042130+0000","last_undegraded":"2024-04-24T02:14:35.042130+0000","last_fullsized":"2024-04-24T02:14:35.042130+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:59.109645+0000","last_change":"2024-04-24T02:15:59.109671+0000","last_active":"2024-04-24T02:15:59.109645+0000","last_peered":"2024-04-24T02:15:59.109645+0000","last_clean":"2024-04-24T02:15:59.109645+0000","last_became_active":"2024-04-24T02:12:04.750546+0000","last_became_peered":"2024-04-24T02:12:04.750546+0000","last_unstale":"2024-04-24T02:15:59.109645+0000","last_undegraded":"2024-04-24T02:15:59.109645+0000","last_fullsized":"2024-04-24T02:15:59.109645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:15:59.109559+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:15:59.109559+0000","last_clean_scrub_stamp":"2024-04-24T02:15:59.109559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:47:13.514457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:35.042280+0000","last_change":"2024-04-24T02:12:02.758862+0000","last_active":"2024-04-24T02:14:35.042280+0000","last_peered":"2024-04-24T02:14:35.042280+0000","last_clean":"2024-04-24T02:14:35.042280+0000","last_became_active":"2024-04-24T02:12:02.757728+0000","last_became_peered":"2024-04-24T02:12:02.757728+0000","last_unstale":"2024-04-24T02:14:35.042280+0000","last_undegraded":"2024-04-24T02:14:35.042280+0000","last_fullsized":"2024-04-24T02:14:35.042280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:41.398126+0000","last_change":"2024-04-24T02:15:41.398149+0000","last_active":"2024-04-24T02:15:41.398126+0000","last_peered":"2024-04-24T02:15:41.398126+0000","last_clean":"2024-04-24T02:15:41.398126+0000","last_became_active":"2024-04-24T02:12:06.757145+0000","last_became_peered":"2024-04-24T02:12:06.757145+0000","last_unstale":"2024-04-24T02:15:41.398126+0000","last_undegraded":"2024-04-24T02:15:41.398126+0000","last_fullsized":"2024-04-24T02:15:41.398126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:41.398039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:41.398039+0000","last_clean_scrub_stamp":"2024-04-24T02:15:41.398039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:34:29.427113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'22","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:53.240881+0000","last_change":"2024-04-24T02:15:53.240926+0000","last_active":"2024-04-24T02:15:53.240881+0000","last_peered":"2024-04-24T02:15:53.240881+0000","last_clean":"2024-04-24T02:15:53.240881+0000","last_became_active":"2024-04-24T02:12:08.781974+0000","last_became_peered":"2024-04-24T02:12:08.781974+0000","last_unstale":"2024-04-24T02:15:53.240881+0000","last_undegraded":"2024-04-24T02:15:53.240881+0000","last_fullsized":"2024-04-24T02:15:53.240881+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-04-24T02:15:53.240760+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-04-24T02:15:53.240760+0000","last_clean_scrub_stamp":"2024-04-24T02:15:53.240760+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:03:08.965112+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'285","reported_seq":382,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:30.498772+0000","last_change":"2024-04-24T02:15:30.498799+0000","last_active":"2024-04-24T02:15:30.498772+0000","last_peered":"2024-04-24T02:15:30.498772+0000","last_clean":"2024-04-24T02:15:30.498772+0000","last_became_active":"2024-04-24T02:12:10.786972+0000","last_became_peered":"2024-04-24T02:12:10.786972+0000","last_unstale":"2024-04-24T02:15:30.498772+0000","last_undegraded":"2024-04-24T02:15:30.498772+0000","last_fullsized":"2024-04-24T02:15:30.498772+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-24T02:15:30.498687+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-24T02:15:30.498687+0000","last_clean_scrub_stamp":"2024-04-24T02:15:30.498687+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:36:15.522512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'4","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:35.042068+0000","last_change":"2024-04-24T02:12:12.795734+0000","last_active":"2024-04-24T02:14:35.042068+0000","last_peered":"2024-04-24T02:14:35.042068+0000","last_clean":"2024-04-24T02:14:35.042068+0000","last_became_active":"2024-04-24T02:12:12.795013+0000","last_became_peered":"2024-04-24T02:12:12.795013+0000","last_unstale":"2024-04-24T02:14:35.042068+0000","last_undegraded":"2024-04-24T02:14:35.042068+0000","last_fullsized":"2024-04-24T02:14:35.042068+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'12","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:48.389856+0000","last_change":"2024-04-24T02:15:48.389882+0000","last_active":"2024-04-24T02:15:48.389856+0000","last_peered":"2024-04-24T02:15:48.389856+0000","last_clean":"2024-04-24T02:15:48.389856+0000","last_became_active":"2024-04-24T02:12:04.751676+0000","last_became_peered":"2024-04-24T02:12:04.751676+0000","last_unstale":"2024-04-24T02:15:48.389856+0000","last_undegraded":"2024-04-24T02:15:48.389856+0000","last_fullsized":"2024-04-24T02:15:48.389856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-04-24T02:15:48.389766+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-04-24T02:15:48.389766+0000","last_clean_scrub_stamp":"2024-04-24T02:15:48.389766+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:57:05.559919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:59.519596+0000","last_change":"2024-04-24T02:15:59.519617+0000","last_active":"2024-04-24T02:15:59.519596+0000","last_peered":"2024-04-24T02:15:59.519596+0000","last_clean":"2024-04-24T02:15:59.519596+0000","last_became_active":"2024-04-24T02:12:02.755512+0000","last_became_peered":"2024-04-24T02:12:02.755512+0000","last_unstale":"2024-04-24T02:15:59.519596+0000","last_undegraded":"2024-04-24T02:15:59.519596+0000","last_fullsized":"2024-04-24T02:15:59.519596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:59.519514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:59.519514+0000","last_clean_scrub_stamp":"2024-04-24T02:15:59.519514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:42:18.856192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:43.382322+0000","last_change":"2024-04-24T02:15:43.382348+0000","last_active":"2024-04-24T02:15:43.382322+0000","last_peered":"2024-04-24T02:15:43.382322+0000","last_clean":"2024-04-24T02:15:43.382322+0000","last_became_active":"2024-04-24T02:12:06.756909+0000","last_became_peered":"2024-04-24T02:12:06.756909+0000","last_unstale":"2024-04-24T02:15:43.382322+0000","last_undegraded":"2024-04-24T02:15:43.382322+0000","last_fullsized":"2024-04-24T02:15:43.382322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:43.382200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:43.382200+0000","last_clean_scrub_stamp":"2024-04-24T02:15:43.382200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:04:38.984836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'73","reported_seq":155,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:31.331803+0000","last_change":"2024-04-24T02:15:31.331846+0000","last_active":"2024-04-24T02:15:31.331803+0000","last_peered":"2024-04-24T02:15:31.331803+0000","last_clean":"2024-04-24T02:15:31.331803+0000","last_became_active":"2024-04-24T02:12:08.770255+0000","last_became_peered":"2024-04-24T02:12:08.770255+0000","last_unstale":"2024-04-24T02:15:31.331803+0000","last_undegraded":"2024-04-24T02:15:31.331803+0000","last_fullsized":"2024-04-24T02:15:31.331803+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'73","last_scrub_stamp":"2024-04-24T02:15:31.331721+0000","last_deep_scrub":"32'73","last_deep_scrub_stamp":"2024-04-24T02:15:31.331721+0000","last_clean_scrub_stamp":"2024-04-24T02:15:31.331721+0000","objects_scrubbed":11,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:04:50.870204+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:39.022379+0000","last_change":"2024-04-24T02:15:39.022402+0000","last_active":"2024-04-24T02:15:39.022379+0000","last_peered":"2024-04-24T02:15:39.022379+0000","last_clean":"2024-04-24T02:15:39.022379+0000","last_became_active":"2024-04-24T02:12:10.785811+0000","last_became_peered":"2024-04-24T02:12:10.785811+0000","last_unstale":"2024-04-24T02:15:39.022379+0000","last_undegraded":"2024-04-24T02:15:39.022379+0000","last_fullsized":"2024-04-24T02:15:39.022379+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:39.022286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:39.022286+0000","last_clean_scrub_stamp":"2024-04-24T02:15:39.022286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:12:21.461638+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:40.042632+0000","last_change":"2024-04-24T02:12:12.799813+0000","last_active":"2024-04-24T02:14:40.042632+0000","last_peered":"2024-04-24T02:14:40.042632+0000","last_clean":"2024-04-24T02:14:40.042632+0000","last_became_active":"2024-04-24T02:12:12.799557+0000","last_became_peered":"2024-04-24T02:12:12.799557+0000","last_unstale":"2024-04-24T02:14:40.042632+0000","last_undegraded":"2024-04-24T02:14:40.042632+0000","last_fullsized":"2024-04-24T02:14:40.042632+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'18","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:51.411880+0000","last_change":"2024-04-24T02:15:51.411902+0000","last_active":"2024-04-24T02:15:51.411880+0000","last_peered":"2024-04-24T02:15:51.411880+0000","last_clean":"2024-04-24T02:15:51.411880+0000","last_became_active":"2024-04-24T02:12:04.748399+0000","last_became_peered":"2024-04-24T02:12:04.748399+0000","last_unstale":"2024-04-24T02:15:51.411880+0000","last_undegraded":"2024-04-24T02:15:51.411880+0000","last_fullsized":"2024-04-24T02:15:51.411880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-04-24T02:15:51.411793+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-04-24T02:15:51.411793+0000","last_clean_scrub_stamp":"2024-04-24T02:15:51.411793+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:57:53.859681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":55,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:35.042408+0000","last_change":"2024-04-24T02:12:02.761810+0000","last_active":"2024-04-24T02:14:35.042408+0000","last_peered":"2024-04-24T02:14:35.042408+0000","last_clean":"2024-04-24T02:14:35.042408+0000","last_became_active":"2024-04-24T02:12:02.760772+0000","last_became_peered":"2024-04-24T02:12:02.760772+0000","last_unstale":"2024-04-24T02:14:35.042408+0000","last_undegraded":"2024-04-24T02:14:35.042408+0000","last_fullsized":"2024-04-24T02:14:35.042408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:43.411197+0000","last_change":"2024-04-24T02:15:43.411223+0000","last_active":"2024-04-24T02:15:43.411197+0000","last_peered":"2024-04-24T02:15:43.411197+0000","last_clean":"2024-04-24T02:15:43.411197+0000","last_became_active":"2024-04-24T02:12:06.764475+0000","last_became_peered":"2024-04-24T02:12:06.764475+0000","last_unstale":"2024-04-24T02:15:43.411197+0000","last_undegraded":"2024-04-24T02:15:43.411197+0000","last_fullsized":"2024-04-24T02:15:43.411197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:43.411113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:43.411113+0000","last_clean_scrub_stamp":"2024-04-24T02:15:43.411113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:44:09.818882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'44","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:36.026642+0000","last_change":"2024-04-24T02:15:36.026681+0000","last_active":"2024-04-24T02:15:36.026642+0000","last_peered":"2024-04-24T02:15:36.026642+0000","last_clean":"2024-04-24T02:15:36.026642+0000","last_became_active":"2024-04-24T02:12:08.779447+0000","last_became_peered":"2024-04-24T02:12:08.779447+0000","last_unstale":"2024-04-24T02:15:36.026642+0000","last_undegraded":"2024-04-24T02:15:36.026642+0000","last_fullsized":"2024-04-24T02:15:36.026642+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'44","last_scrub_stamp":"2024-04-24T02:15:36.026532+0000","last_deep_scrub":"32'44","last_deep_scrub_stamp":"2024-04-24T02:15:36.026532+0000","last_clean_scrub_stamp":"2024-04-24T02:15:36.026532+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:44:38.935524+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:47.335589+0000","last_change":"2024-04-24T02:15:47.335614+0000","last_active":"2024-04-24T02:15:47.335589+0000","last_peered":"2024-04-24T02:15:47.335589+0000","last_clean":"2024-04-24T02:15:47.335589+0000","last_became_active":"2024-04-24T02:12:10.782019+0000","last_became_peered":"2024-04-24T02:12:10.782019+0000","last_unstale":"2024-04-24T02:15:47.335589+0000","last_undegraded":"2024-04-24T02:15:47.335589+0000","last_fullsized":"2024-04-24T02:15:47.335589+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:47.335498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:47.335498+0000","last_clean_scrub_stamp":"2024-04-24T02:15:47.335498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:09:16.493400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:40.043129+0000","last_change":"2024-04-24T02:12:12.797073+0000","last_active":"2024-04-24T02:14:40.043129+0000","last_peered":"2024-04-24T02:14:40.043129+0000","last_clean":"2024-04-24T02:14:40.043129+0000","last_became_active":"2024-04-24T02:12:12.796494+0000","last_became_peered":"2024-04-24T02:12:12.796494+0000","last_unstale":"2024-04-24T02:14:40.043129+0000","last_undegraded":"2024-04-24T02:14:40.043129+0000","last_fullsized":"2024-04-24T02:14:40.043129+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'10","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.355769+0000","last_change":"2024-04-24T02:12:04.763788+0000","last_active":"2024-04-24T02:15:13.355769+0000","last_peered":"2024-04-24T02:15:13.355769+0000","last_clean":"2024-04-24T02:15:13.355769+0000","last_became_active":"2024-04-24T02:12:04.763263+0000","last_became_peered":"2024-04-24T02:12:04.763263+0000","last_unstale":"2024-04-24T02:15:13.355769+0000","last_undegraded":"2024-04-24T02:15:13.355769+0000","last_fullsized":"2024-04-24T02:15:13.355769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:22.950928+0000","last_change":"2024-04-24T02:12:02.745999+0000","last_active":"2024-04-24T02:15:22.950928+0000","last_peered":"2024-04-24T02:15:22.950928+0000","last_clean":"2024-04-24T02:15:22.950928+0000","last_became_active":"2024-04-24T02:12:02.745617+0000","last_became_peered":"2024-04-24T02:12:02.745617+0000","last_unstale":"2024-04-24T02:15:22.950928+0000","last_undegraded":"2024-04-24T02:15:22.950928+0000","last_fullsized":"2024-04-24T02:15:22.950928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:33.375869+0000","last_change":"2024-04-24T02:15:33.375893+0000","last_active":"2024-04-24T02:15:33.375869+0000","last_peered":"2024-04-24T02:15:33.375869+0000","last_clean":"2024-04-24T02:15:33.375869+0000","last_became_active":"2024-04-24T02:12:06.765644+0000","last_became_peered":"2024-04-24T02:12:06.765644+0000","last_unstale":"2024-04-24T02:15:33.375869+0000","last_undegraded":"2024-04-24T02:15:33.375869+0000","last_fullsized":"2024-04-24T02:15:33.375869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:33.375779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:33.375779+0000","last_clean_scrub_stamp":"2024-04-24T02:15:33.375779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:09:27.434014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'38","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:40.363423+0000","last_change":"2024-04-24T02:15:40.363468+0000","last_active":"2024-04-24T02:15:40.363423+0000","last_peered":"2024-04-24T02:15:40.363423+0000","last_clean":"2024-04-24T02:15:40.363423+0000","last_became_active":"2024-04-24T02:12:08.780056+0000","last_became_peered":"2024-04-24T02:12:08.780056+0000","last_unstale":"2024-04-24T02:15:40.363423+0000","last_undegraded":"2024-04-24T02:15:40.363423+0000","last_fullsized":"2024-04-24T02:15:40.363423+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'38","last_scrub_stamp":"2024-04-24T02:15:40.363331+0000","last_deep_scrub":"32'38","last_deep_scrub_stamp":"2024-04-24T02:15:40.363331+0000","last_clean_scrub_stamp":"2024-04-24T02:15:40.363331+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:29:10.489979+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:40.043024+0000","last_change":"2024-04-24T02:12:10.785977+0000","last_active":"2024-04-24T02:14:40.043024+0000","last_peered":"2024-04-24T02:14:40.043024+0000","last_clean":"2024-04-24T02:14:40.043024+0000","last_became_active":"2024-04-24T02:12:10.785396+0000","last_became_peered":"2024-04-24T02:12:10.785396+0000","last_unstale":"2024-04-24T02:14:40.043024+0000","last_undegraded":"2024-04-24T02:14:40.043024+0000","last_fullsized":"2024-04-24T02:14:40.043024+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:09.760669+0000","last_clean_scrub_stamp":"2024-04-24T02:12:09.760669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:40.043098+0000","last_change":"2024-04-24T02:12:12.794051+0000","last_active":"2024-04-24T02:14:40.043098+0000","last_peered":"2024-04-24T02:14:40.043098+0000","last_clean":"2024-04-24T02:14:40.043098+0000","last_became_active":"2024-04-24T02:12:12.793796+0000","last_became_peered":"2024-04-24T02:12:12.793796+0000","last_unstale":"2024-04-24T02:14:40.043098+0000","last_undegraded":"2024-04-24T02:14:40.043098+0000","last_fullsized":"2024-04-24T02:14:40.043098+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'20","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:49.413443+0000","last_change":"2024-04-24T02:15:49.413494+0000","last_active":"2024-04-24T02:15:49.413443+0000","last_peered":"2024-04-24T02:15:49.413443+0000","last_clean":"2024-04-24T02:15:49.413443+0000","last_became_active":"2024-04-24T02:12:04.749055+0000","last_became_peered":"2024-04-24T02:12:04.749055+0000","last_unstale":"2024-04-24T02:15:49.413443+0000","last_undegraded":"2024-04-24T02:15:49.413443+0000","last_fullsized":"2024-04-24T02:15:49.413443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-04-24T02:15:49.413342+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-04-24T02:15:49.413342+0000","last_clean_scrub_stamp":"2024-04-24T02:15:49.413342+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:15:41.702152+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:10.037824+0000","last_change":"2024-04-24T02:12:02.747590+0000","last_active":"2024-04-24T02:14:10.037824+0000","last_peered":"2024-04-24T02:14:10.037824+0000","last_clean":"2024-04-24T02:14:10.037824+0000","last_became_active":"2024-04-24T02:12:02.745895+0000","last_became_peered":"2024-04-24T02:12:02.745895+0000","last_unstale":"2024-04-24T02:14:10.037824+0000","last_undegraded":"2024-04-24T02:14:10.037824+0000","last_fullsized":"2024-04-24T02:14:10.037824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'8","reported_seq":241,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:35.456109+0000","last_change":"2024-04-24T02:15:35.456160+0000","last_active":"2024-04-24T02:15:35.456109+0000","last_peered":"2024-04-24T02:15:35.456109+0000","last_clean":"2024-04-24T02:15:35.456109+0000","last_became_active":"2024-04-24T02:12:06.765096+0000","last_became_peered":"2024-04-24T02:12:06.765096+0000","last_unstale":"2024-04-24T02:15:35.456109+0000","last_undegraded":"2024-04-24T02:15:35.456109+0000","last_fullsized":"2024-04-24T02:15:35.456109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-24T02:15:35.456000+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-24T02:15:35.456000+0000","last_clean_scrub_stamp":"2024-04-24T02:15:35.456000+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:58:11.323688+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'53","reported_seq":122,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:30.313073+0000","last_change":"2024-04-24T02:15:30.313116+0000","last_active":"2024-04-24T02:15:30.313073+0000","last_peered":"2024-04-24T02:15:30.313073+0000","last_clean":"2024-04-24T02:15:30.313073+0000","last_became_active":"2024-04-24T02:12:08.779892+0000","last_became_peered":"2024-04-24T02:12:08.779892+0000","last_unstale":"2024-04-24T02:15:30.313073+0000","last_undegraded":"2024-04-24T02:15:30.313073+0000","last_fullsized":"2024-04-24T02:15:30.313073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'53","last_scrub_stamp":"2024-04-24T02:15:30.312975+0000","last_deep_scrub":"32'53","last_deep_scrub_stamp":"2024-04-24T02:15:30.312975+0000","last_clean_scrub_stamp":"2024-04-24T02:15:30.312975+0000","objects_scrubbed":7,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:50:47.143315+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:25.040176+0000","last_change":"2024-04-24T02:15:25.040213+0000","last_active":"2024-04-24T02:15:25.040176+0000","last_peered":"2024-04-24T02:15:25.040176+0000","last_clean":"2024-04-24T02:15:25.040176+0000","last_became_active":"2024-04-24T02:12:10.781588+0000","last_became_peered":"2024-04-24T02:12:10.781588+0000","last_unstale":"2024-04-24T02:15:25.040176+0000","last_undegraded":"2024-04-24T02:15:25.040176+0000","last_fullsized":"2024-04-24T02:15:25.040176+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:25.040045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:25.040045+0000","last_clean_scrub_stamp":"2024-04-24T02:15:25.040045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:17:46.062684+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'6","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.581009+0000","last_change":"2024-04-24T02:12:12.793599+0000","last_active":"2024-04-24T02:15:13.581009+0000","last_peered":"2024-04-24T02:15:13.581009+0000","last_clean":"2024-04-24T02:15:13.581009+0000","last_became_active":"2024-04-24T02:12:12.793310+0000","last_became_peered":"2024-04-24T02:12:12.793310+0000","last_unstale":"2024-04-24T02:15:13.581009+0000","last_undegraded":"2024-04-24T02:15:13.581009+0000","last_fullsized":"2024-04-24T02:15:13.581009+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:45.345178+0000","last_change":"2024-04-24T02:15:45.345220+0000","last_active":"2024-04-24T02:15:45.345178+0000","last_peered":"2024-04-24T02:15:45.345178+0000","last_clean":"2024-04-24T02:15:45.345178+0000","last_became_active":"2024-04-24T02:12:04.766869+0000","last_became_peered":"2024-04-24T02:12:04.766869+0000","last_unstale":"2024-04-24T02:15:45.345178+0000","last_undegraded":"2024-04-24T02:15:45.345178+0000","last_fullsized":"2024-04-24T02:15:45.345178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:45.345090+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:45.345090+0000","last_clean_scrub_stamp":"2024-04-24T02:15:45.345090+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:03:24.007542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:10.037353+0000","last_change":"2024-04-24T02:12:02.750537+0000","last_active":"2024-04-24T02:14:10.037353+0000","last_peered":"2024-04-24T02:14:10.037353+0000","last_clean":"2024-04-24T02:14:10.037353+0000","last_became_active":"2024-04-24T02:12:02.746992+0000","last_became_peered":"2024-04-24T02:12:02.746992+0000","last_unstale":"2024-04-24T02:14:10.037353+0000","last_undegraded":"2024-04-24T02:14:10.037353+0000","last_fullsized":"2024-04-24T02:14:10.037353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:55.103606+0000","last_change":"2024-04-24T02:15:55.103631+0000","last_active":"2024-04-24T02:15:55.103606+0000","last_peered":"2024-04-24T02:15:55.103606+0000","last_clean":"2024-04-24T02:15:55.103606+0000","last_became_active":"2024-04-24T02:12:04.749165+0000","last_became_peered":"2024-04-24T02:12:04.749165+0000","last_unstale":"2024-04-24T02:15:55.103606+0000","last_undegraded":"2024-04-24T02:15:55.103606+0000","last_fullsized":"2024-04-24T02:15:55.103606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:55.103514+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:55.103514+0000","last_clean_scrub_stamp":"2024-04-24T02:15:55.103514+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:12:47.755623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:00.117497+0000","last_change":"2024-04-24T02:16:00.117523+0000","last_active":"2024-04-24T02:16:00.117497+0000","last_peered":"2024-04-24T02:16:00.117497+0000","last_clean":"2024-04-24T02:16:00.117497+0000","last_became_active":"2024-04-24T02:12:02.751613+0000","last_became_peered":"2024-04-24T02:12:02.751613+0000","last_unstale":"2024-04-24T02:16:00.117497+0000","last_undegraded":"2024-04-24T02:16:00.117497+0000","last_fullsized":"2024-04-24T02:16:00.117497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-24T02:16:00.117409+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-24T02:16:00.117409+0000","last_clean_scrub_stamp":"2024-04-24T02:16:00.117409+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:51:24.121602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.471986+0000","last_change":"2024-04-24T02:12:04.764660+0000","last_active":"2024-04-24T02:15:13.471986+0000","last_peered":"2024-04-24T02:15:13.471986+0000","last_clean":"2024-04-24T02:15:13.471986+0000","last_became_active":"2024-04-24T02:12:04.763819+0000","last_became_peered":"2024-04-24T02:12:04.763819+0000","last_unstale":"2024-04-24T02:15:13.471986+0000","last_undegraded":"2024-04-24T02:15:13.471986+0000","last_fullsized":"2024-04-24T02:15:13.471986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:10.038224+0000","last_change":"2024-04-24T02:12:02.758745+0000","last_active":"2024-04-24T02:14:10.038224+0000","last_peered":"2024-04-24T02:14:10.038224+0000","last_clean":"2024-04-24T02:14:10.038224+0000","last_became_active":"2024-04-24T02:12:02.757017+0000","last_became_peered":"2024-04-24T02:12:02.757017+0000","last_unstale":"2024-04-24T02:14:10.038224+0000","last_undegraded":"2024-04-24T02:14:10.038224+0000","last_fullsized":"2024-04-24T02:14:10.038224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'4","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:57.094426+0000","last_change":"2024-04-24T02:15:57.094452+0000","last_active":"2024-04-24T02:15:57.094426+0000","last_peered":"2024-04-24T02:15:57.094426+0000","last_clean":"2024-04-24T02:15:57.094426+0000","last_became_active":"2024-04-24T02:12:04.749305+0000","last_became_peered":"2024-04-24T02:12:04.749305+0000","last_unstale":"2024-04-24T02:15:57.094426+0000","last_undegraded":"2024-04-24T02:15:57.094426+0000","last_fullsized":"2024-04-24T02:15:57.094426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:57.094303+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:57.094303+0000","last_clean_scrub_stamp":"2024-04-24T02:15:57.094303+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:28:38.930212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:08.033192+0000","last_change":"2024-04-24T02:12:02.741858+0000","last_active":"2024-04-24T02:14:08.033192+0000","last_peered":"2024-04-24T02:14:08.033192+0000","last_clean":"2024-04-24T02:14:08.033192+0000","last_became_active":"2024-04-24T02:12:02.741503+0000","last_became_peered":"2024-04-24T02:12:02.741503+0000","last_unstale":"2024-04-24T02:14:08.033192+0000","last_undegraded":"2024-04-24T02:14:08.033192+0000","last_fullsized":"2024-04-24T02:14:08.033192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.264731+0000","last_change":"2024-04-24T02:12:45.818489+0000","last_active":"2024-04-24T02:15:13.264731+0000","last_peered":"2024-04-24T02:15:13.264731+0000","last_clean":"2024-04-24T02:15:13.264731+0000","last_became_active":"2024-04-24T02:12:45.814356+0000","last_became_peered":"2024-04-24T02:12:45.814356+0000","last_unstale":"2024-04-24T02:15:13.264731+0000","last_undegraded":"2024-04-24T02:15:13.264731+0000","last_fullsized":"2024-04-24T02:15:13.264731+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:58.137709+0000","last_change":"2024-04-24T02:15:58.137753+0000","last_active":"2024-04-24T02:15:58.137709+0000","last_peered":"2024-04-24T02:15:58.137709+0000","last_clean":"2024-04-24T02:15:58.137709+0000","last_became_active":"2024-04-24T02:12:02.751680+0000","last_became_peered":"2024-04-24T02:12:02.751680+0000","last_unstale":"2024-04-24T02:15:58.137709+0000","last_undegraded":"2024-04-24T02:15:58.137709+0000","last_fullsized":"2024-04-24T02:15:58.137709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:15:58.137599+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:15:58.137599+0000","last_clean_scrub_stamp":"2024-04-24T02:15:58.137599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:14:26.157218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'8","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.401073+0000","last_change":"2024-04-24T02:12:45.817674+0000","last_active":"2024-04-24T02:15:13.401073+0000","last_peered":"2024-04-24T02:15:13.401073+0000","last_clean":"2024-04-24T02:15:13.401073+0000","last_became_active":"2024-04-24T02:12:45.813097+0000","last_became_peered":"2024-04-24T02:12:45.813097+0000","last_unstale":"2024-04-24T02:15:13.401073+0000","last_undegraded":"2024-04-24T02:15:13.401073+0000","last_fullsized":"2024-04-24T02:15:13.401073+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:20.096083+0000","last_change":"2024-04-24T02:12:02.754946+0000","last_active":"2024-04-24T02:15:20.096083+0000","last_peered":"2024-04-24T02:15:20.096083+0000","last_clean":"2024-04-24T02:15:20.096083+0000","last_became_active":"2024-04-24T02:12:02.754356+0000","last_became_peered":"2024-04-24T02:12:02.754356+0000","last_unstale":"2024-04-24T02:15:20.096083+0000","last_undegraded":"2024-04-24T02:15:20.096083+0000","last_fullsized":"2024-04-24T02:15:20.096083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'5","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.523238+0000","last_change":"2024-04-24T02:12:04.756117+0000","last_active":"2024-04-24T02:15:13.523238+0000","last_peered":"2024-04-24T02:15:13.523238+0000","last_clean":"2024-04-24T02:15:13.523238+0000","last_became_active":"2024-04-24T02:12:04.755738+0000","last_became_peered":"2024-04-24T02:12:04.755738+0000","last_unstale":"2024-04-24T02:15:13.523238+0000","last_undegraded":"2024-04-24T02:15:13.523238+0000","last_fullsized":"2024-04-24T02:15:13.523238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"30'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:53.400491+0000","last_change":"2024-04-24T02:15:53.400534+0000","last_active":"2024-04-24T02:15:53.400491+0000","last_peered":"2024-04-24T02:15:53.400491+0000","last_clean":"2024-04-24T02:15:53.400491+0000","last_became_active":"2024-04-24T02:12:02.755202+0000","last_became_peered":"2024-04-24T02:12:02.755202+0000","last_unstale":"2024-04-24T02:15:53.400491+0000","last_undegraded":"2024-04-24T02:15:53.400491+0000","last_fullsized":"2024-04-24T02:15:53.400491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-24T02:15:53.400367+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-24T02:15:53.400367+0000","last_clean_scrub_stamp":"2024-04-24T02:15:53.400367+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:44:25.927284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"30'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:10.037666+0000","last_change":"2024-04-24T02:12:04.756072+0000","last_active":"2024-04-24T02:14:10.037666+0000","last_peered":"2024-04-24T02:14:10.037666+0000","last_clean":"2024-04-24T02:14:10.037666+0000","last_became_active":"2024-04-24T02:12:04.755194+0000","last_became_peered":"2024-04-24T02:12:04.755194+0000","last_unstale":"2024-04-24T02:14:10.037666+0000","last_undegraded":"2024-04-24T02:14:10.037666+0000","last_fullsized":"2024-04-24T02:14:10.037666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:56.120052+0000","last_change":"2024-04-24T02:15:56.120098+0000","last_active":"2024-04-24T02:15:56.120052+0000","last_peered":"2024-04-24T02:15:56.120052+0000","last_clean":"2024-04-24T02:15:56.120052+0000","last_became_active":"2024-04-24T02:12:02.751726+0000","last_became_peered":"2024-04-24T02:12:02.751726+0000","last_unstale":"2024-04-24T02:15:56.120052+0000","last_undegraded":"2024-04-24T02:15:56.120052+0000","last_fullsized":"2024-04-24T02:15:56.120052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:56.119931+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:56.119931+0000","last_clean_scrub_stamp":"2024-04-24T02:15:56.119931+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:52:08.946224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'6","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:54.454622+0000","last_change":"2024-04-24T02:15:54.454652+0000","last_active":"2024-04-24T02:15:54.454622+0000","last_peered":"2024-04-24T02:15:54.454622+0000","last_clean":"2024-04-24T02:15:54.454622+0000","last_became_active":"2024-04-24T02:12:04.753074+0000","last_became_peered":"2024-04-24T02:12:04.753074+0000","last_unstale":"2024-04-24T02:15:54.454622+0000","last_undegraded":"2024-04-24T02:15:54.454622+0000","last_fullsized":"2024-04-24T02:15:54.454622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-24T02:15:54.454534+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-24T02:15:54.454534+0000","last_clean_scrub_stamp":"2024-04-24T02:15:54.454534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:16:02.525378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:20.095628+0000","last_change":"2024-04-24T02:12:02.755029+0000","last_active":"2024-04-24T02:15:20.095628+0000","last_peered":"2024-04-24T02:15:20.095628+0000","last_clean":"2024-04-24T02:15:20.095628+0000","last_became_active":"2024-04-24T02:12:02.754158+0000","last_became_peered":"2024-04-24T02:12:02.754158+0000","last_unstale":"2024-04-24T02:15:20.095628+0000","last_undegraded":"2024-04-24T02:15:20.095628+0000","last_fullsized":"2024-04-24T02:15:20.095628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'8","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:25.040696+0000","last_change":"2024-04-24T02:12:04.764100+0000","last_active":"2024-04-24T02:14:25.040696+0000","last_peered":"2024-04-24T02:14:25.040696+0000","last_clean":"2024-04-24T02:14:25.040696+0000","last_became_active":"2024-04-24T02:12:04.763136+0000","last_became_peered":"2024-04-24T02:12:04.763136+0000","last_unstale":"2024-04-24T02:14:25.040696+0000","last_undegraded":"2024-04-24T02:14:25.040696+0000","last_fullsized":"2024-04-24T02:14:25.040696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:18.034542+0000","last_change":"2024-04-24T02:12:02.741912+0000","last_active":"2024-04-24T02:14:18.034542+0000","last_peered":"2024-04-24T02:14:18.034542+0000","last_clean":"2024-04-24T02:14:18.034542+0000","last_became_active":"2024-04-24T02:12:02.741543+0000","last_became_peered":"2024-04-24T02:12:02.741543+0000","last_unstale":"2024-04-24T02:14:18.034542+0000","last_undegraded":"2024-04-24T02:14:18.034542+0000","last_fullsized":"2024-04-24T02:14:18.034542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:52.099921+0000","last_change":"2024-04-24T02:15:52.099971+0000","last_active":"2024-04-24T02:15:52.099921+0000","last_peered":"2024-04-24T02:15:52.099921+0000","last_clean":"2024-04-24T02:15:52.099921+0000","last_became_active":"2024-04-24T02:12:04.760028+0000","last_became_peered":"2024-04-24T02:12:04.760028+0000","last_unstale":"2024-04-24T02:15:52.099921+0000","last_undegraded":"2024-04-24T02:15:52.099921+0000","last_fullsized":"2024-04-24T02:15:52.099921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:15:52.099774+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:15:52.099774+0000","last_clean_scrub_stamp":"2024-04-24T02:15:52.099774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:55:18.068142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.339524+0000","last_change":"2024-04-24T02:12:02.750391+0000","last_active":"2024-04-24T02:15:13.339524+0000","last_peered":"2024-04-24T02:15:13.339524+0000","last_clean":"2024-04-24T02:15:13.339524+0000","last_became_active":"2024-04-24T02:12:02.750143+0000","last_became_peered":"2024-04-24T02:12:02.750143+0000","last_unstale":"2024-04-24T02:15:13.339524+0000","last_undegraded":"2024-04-24T02:15:13.339524+0000","last_fullsized":"2024-04-24T02:15:13.339524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.472554+0000","last_change":"2024-04-24T02:12:04.754976+0000","last_active":"2024-04-24T02:15:13.472554+0000","last_peered":"2024-04-24T02:15:13.472554+0000","last_clean":"2024-04-24T02:15:13.472554+0000","last_became_active":"2024-04-24T02:12:04.754738+0000","last_became_peered":"2024-04-24T02:12:04.754738+0000","last_unstale":"2024-04-24T02:15:13.472554+0000","last_undegraded":"2024-04-24T02:15:13.472554+0000","last_fullsized":"2024-04-24T02:15:13.472554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:20.039252+0000","last_change":"2024-04-24T02:12:02.746027+0000","last_active":"2024-04-24T02:14:20.039252+0000","last_peered":"2024-04-24T02:14:20.039252+0000","last_clean":"2024-04-24T02:14:20.039252+0000","last_became_active":"2024-04-24T02:12:02.744352+0000","last_became_peered":"2024-04-24T02:12:02.744352+0000","last_unstale":"2024-04-24T02:14:20.039252+0000","last_undegraded":"2024-04-24T02:14:20.039252+0000","last_fullsized":"2024-04-24T02:14:20.039252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'12","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.179335+0000","last_change":"2024-04-24T02:12:45.815138+0000","last_active":"2024-04-24T02:15:13.179335+0000","last_peered":"2024-04-24T02:15:13.179335+0000","last_clean":"2024-04-24T02:15:13.179335+0000","last_became_active":"2024-04-24T02:12:45.808774+0000","last_became_peered":"2024-04-24T02:12:45.808774+0000","last_unstale":"2024-04-24T02:15:13.179335+0000","last_undegraded":"2024-04-24T02:15:13.179335+0000","last_fullsized":"2024-04-24T02:15:13.179335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:20.039845+0000","last_change":"2024-04-24T02:12:02.758624+0000","last_active":"2024-04-24T02:14:20.039845+0000","last_peered":"2024-04-24T02:14:20.039845+0000","last_clean":"2024-04-24T02:14:20.039845+0000","last_became_active":"2024-04-24T02:12:02.757458+0000","last_became_peered":"2024-04-24T02:12:02.757458+0000","last_unstale":"2024-04-24T02:14:20.039845+0000","last_undegraded":"2024-04-24T02:14:20.039845+0000","last_fullsized":"2024-04-24T02:14:20.039845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'14","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:53.446024+0000","last_change":"2024-04-24T02:15:53.446051+0000","last_active":"2024-04-24T02:15:53.446024+0000","last_peered":"2024-04-24T02:15:53.446024+0000","last_clean":"2024-04-24T02:15:53.446024+0000","last_became_active":"2024-04-24T02:12:04.750973+0000","last_became_peered":"2024-04-24T02:12:04.750973+0000","last_unstale":"2024-04-24T02:15:53.446024+0000","last_undegraded":"2024-04-24T02:15:53.446024+0000","last_fullsized":"2024-04-24T02:15:53.446024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-04-24T02:15:53.445932+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-04-24T02:15:53.445932+0000","last_clean_scrub_stamp":"2024-04-24T02:15:53.445932+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:51:10.276272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:20.039881+0000","last_change":"2024-04-24T02:12:02.761835+0000","last_active":"2024-04-24T02:14:20.039881+0000","last_peered":"2024-04-24T02:14:20.039881+0000","last_clean":"2024-04-24T02:14:20.039881+0000","last_became_active":"2024-04-24T02:12:02.761235+0000","last_became_peered":"2024-04-24T02:12:02.761235+0000","last_unstale":"2024-04-24T02:14:20.039881+0000","last_undegraded":"2024-04-24T02:14:20.039881+0000","last_fullsized":"2024-04-24T02:14:20.039881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'4","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.400669+0000","last_change":"2024-04-24T02:12:04.764009+0000","last_active":"2024-04-24T02:15:13.400669+0000","last_peered":"2024-04-24T02:15:13.400669+0000","last_clean":"2024-04-24T02:15:13.400669+0000","last_became_active":"2024-04-24T02:12:04.763517+0000","last_became_peered":"2024-04-24T02:12:04.763517+0000","last_unstale":"2024-04-24T02:15:13.400669+0000","last_undegraded":"2024-04-24T02:15:13.400669+0000","last_fullsized":"2024-04-24T02:15:13.400669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.341867+0000","last_change":"2024-04-24T02:12:02.754501+0000","last_active":"2024-04-24T02:15:13.341867+0000","last_peered":"2024-04-24T02:15:13.341867+0000","last_clean":"2024-04-24T02:15:13.341867+0000","last_became_active":"2024-04-24T02:12:02.754227+0000","last_became_peered":"2024-04-24T02:12:02.754227+0000","last_unstale":"2024-04-24T02:15:13.341867+0000","last_undegraded":"2024-04-24T02:15:13.341867+0000","last_fullsized":"2024-04-24T02:15:13.341867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.356096+0000","last_change":"2024-04-24T02:12:04.755937+0000","last_active":"2024-04-24T02:15:13.356096+0000","last_peered":"2024-04-24T02:15:13.356096+0000","last_clean":"2024-04-24T02:15:13.356096+0000","last_became_active":"2024-04-24T02:12:04.755661+0000","last_became_peered":"2024-04-24T02:12:04.755661+0000","last_unstale":"2024-04-24T02:15:13.356096+0000","last_undegraded":"2024-04-24T02:15:13.356096+0000","last_fullsized":"2024-04-24T02:15:13.356096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:25.040722+0000","last_change":"2024-04-24T02:12:02.761162+0000","last_active":"2024-04-24T02:14:25.040722+0000","last_peered":"2024-04-24T02:14:25.040722+0000","last_clean":"2024-04-24T02:14:25.040722+0000","last_became_active":"2024-04-24T02:12:02.758855+0000","last_became_peered":"2024-04-24T02:12:02.758855+0000","last_unstale":"2024-04-24T02:14:25.040722+0000","last_undegraded":"2024-04-24T02:14:25.040722+0000","last_fullsized":"2024-04-24T02:14:25.040722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:25.040481+0000","last_change":"2024-04-24T02:12:02.757416+0000","last_active":"2024-04-24T02:14:25.040481+0000","last_peered":"2024-04-24T02:14:25.040481+0000","last_clean":"2024-04-24T02:14:25.040481+0000","last_became_active":"2024-04-24T02:12:02.753545+0000","last_became_peered":"2024-04-24T02:12:02.753545+0000","last_unstale":"2024-04-24T02:14:25.040481+0000","last_undegraded":"2024-04-24T02:14:25.040481+0000","last_fullsized":"2024-04-24T02:14:25.040481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'10","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.176997+0000","last_change":"2024-04-24T02:12:04.758909+0000","last_active":"2024-04-24T02:15:13.176997+0000","last_peered":"2024-04-24T02:15:13.176997+0000","last_clean":"2024-04-24T02:15:13.176997+0000","last_became_active":"2024-04-24T02:12:04.758661+0000","last_became_peered":"2024-04-24T02:12:04.758661+0000","last_unstale":"2024-04-24T02:15:13.176997+0000","last_undegraded":"2024-04-24T02:15:13.176997+0000","last_fullsized":"2024-04-24T02:15:13.176997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:23.035340+0000","last_change":"2024-04-24T02:12:02.745737+0000","last_active":"2024-04-24T02:14:23.035340+0000","last_peered":"2024-04-24T02:14:23.035340+0000","last_clean":"2024-04-24T02:14:23.035340+0000","last_became_active":"2024-04-24T02:12:02.745396+0000","last_became_peered":"2024-04-24T02:12:02.745396+0000","last_unstale":"2024-04-24T02:14:23.035340+0000","last_undegraded":"2024-04-24T02:14:23.035340+0000","last_fullsized":"2024-04-24T02:14:23.035340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:49.477876+0000","last_change":"2024-04-24T02:15:49.477905+0000","last_active":"2024-04-24T02:15:49.477876+0000","last_peered":"2024-04-24T02:15:49.477876+0000","last_clean":"2024-04-24T02:15:49.477876+0000","last_became_active":"2024-04-24T02:12:04.766344+0000","last_became_peered":"2024-04-24T02:12:04.766344+0000","last_unstale":"2024-04-24T02:15:49.477876+0000","last_undegraded":"2024-04-24T02:15:49.477876+0000","last_fullsized":"2024-04-24T02:15:49.477876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:15:49.477787+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:15:49.477787+0000","last_clean_scrub_stamp":"2024-04-24T02:15:49.477787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:34:26.940534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":270,"ondisk_log_size":270,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1888,"num_read_kb":1653,"num_write":789,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1754,"ondisk_log_size":1754,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1617,"num_read_kb":1507,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":480,"ondisk_log_size":480,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640311,"num_pgs":152,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39944,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331896,"statfs":{"total":96636764160,"available":96595861504,"internally_reserved":0,"allocated":458752,"data_stored":135584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640309,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40456,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331384,"statfs":{"total":96636764160,"available":96595337216,"internally_reserved":0,"allocated":983040,"data_stored":722688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640311,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36324,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335516,"statfs":{"total":96636764160,"available":96599568384,"internally_reserved":0,"allocated":1011712,"data_stored":724048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705719,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39908,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331932,"statfs":{"total":96636764160,"available":96595898368,"internally_reserved":0,"allocated":421888,"data_stored":133610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T02:16:05.337 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.337 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.337 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.337 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.337 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.337 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.338 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.338 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.338 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.338 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.338 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.338 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.338 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.339 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.339 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.339 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.339 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.339 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.339 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.339 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.339 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.340 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.340 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.340 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.340 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.340 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.340 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.340 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.340 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.341 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.341 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.341 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.341 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.341 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.342 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.342 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.342 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.342 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.342 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.342 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-24T02:11:50.697037+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=11, tm_sec=50, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.342 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-24T02:11:55.711441+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.342 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.343 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.343 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-24T02:11:55.711441+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.343 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.343 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.343 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.343 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-24T02:11:55.711441+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.343 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.344 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.344 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-24T02:11:55.711441+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.344 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.344 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.344 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.344 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-24T02:11:55.711441+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.344 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.344 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.345 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-24T02:11:55.711441+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.345 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.345 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.345 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-24T02:11:55.711441+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.345 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.345 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-24T02:11:55.711441+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.345 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.345 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.346 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.346 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-04-24T02:12:09.760669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=9, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.346 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.346 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.346 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.346 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.346 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.347 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.347 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.347 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-04-24T02:12:05.740097+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.347 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.347 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.347 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.347 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.348 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.348 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.348 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.348 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.348 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.348 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.348 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.348 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.349 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-04-24T02:12:09.760669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=9, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.349 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.349 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.349 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.349 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.349 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.349 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.349 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.350 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.350 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.350 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.350 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.350 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.350 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.351 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.351 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.351 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.351 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.351 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.351 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.351 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.352 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.352 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.352 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.352 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.352 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.352 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.352 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.352 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:05.353 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-24T02:16:25.354 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T02:16:25.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.461+0000 7f92aa874640 1 Processor -- start 2024-04-24T02:16:25.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.461+0000 7f92aa874640 1 -- start start 2024-04-24T02:16:25.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.461+0000 7f92aa874640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f92a4127ce0 0x7f92a41280c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:16:25.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.461+0000 7f92aa874640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92a4127b00 con 0x7f92a4070100 2024-04-24T02:16:25.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.461+0000 7f92aa874640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f92a40708e0 con 0x7f92a4127ce0 2024-04-24T02:16:25.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.461+0000 7f92a3fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f92a4127ce0 0x7f92a41280c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:16:25.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.461+0000 7f92a37fe640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f92a4070100 0x7f92a412b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:55326/0 (socket says 172.21.15.104:55326) 2024-04-24T02:16:25.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.462+0000 7f92a37fe640 1 -- 172.21.15.104:0/826516666 learned_addr learned my addr 172.21.15.104:0/826516666 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-04-24T02:16:25.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.462+0000 7f92a3fff640 1 -- 172.21.15.104:0/826516666 >> v1:172.21.15.104:6789/0 conn(0x7f92a4070100 legacy=0x7f92a412b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:16:25.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.462+0000 7f92a3fff640 1 -- 172.21.15.104:0/826516666 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92a4098800 con 0x7f92a4127ce0 2024-04-24T02:16:25.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.462+0000 7f92a2ffd640 1 -- 172.21.15.104:0/826516666 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1708314930 0 0) 0x7f9298001110 con 0x7f92a4070100 2024-04-24T02:16:25.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.463+0000 7f92a3fff640 1 --2- 172.21.15.104:0/826516666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92a4127ce0 0x7f92a41280c0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f9294009720 tx=0x7f929402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2c4fba1d9b85da server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:16:25.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.463+0000 7f92a2ffd640 1 -- 172.21.15.104:0/826516666 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92940316d0 con 0x7f92a4127ce0 2024-04-24T02:16:25.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.463+0000 7f92a2ffd640 1 -- 172.21.15.104:0/826516666 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9294037070 con 0x7f92a4127ce0 2024-04-24T02:16:25.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.463+0000 7f92a2ffd640 1 -- 172.21.15.104:0/826516666 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92940319c0 con 0x7f92a4127ce0 2024-04-24T02:16:25.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.463+0000 7f92aa874640 1 -- 172.21.15.104:0/826516666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92a4127ce0 msgr2=0x7f92a41280c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:16:25.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.463+0000 7f92aa874640 1 --2- 172.21.15.104:0/826516666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92a4127ce0 0x7f92a41280c0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f9294009720 tx=0x7f929402b840 comp rx=0 tx=0).stop 2024-04-24T02:16:25.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.463+0000 7f92aa874640 1 -- 172.21.15.104:0/826516666 shutdown_connections 2024-04-24T02:16:25.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.463+0000 7f92aa874640 1 --2- 172.21.15.104:0/826516666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92a4127ce0 0x7f92a41280c0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:16:25.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.463+0000 7f92aa874640 1 -- 172.21.15.104:0/826516666 >> 172.21.15.104:0/826516666 conn(0x7f92a4099680 msgr2=0x7f92a4099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:16:25.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.463+0000 7f92aa874640 1 -- 172.21.15.104:0/826516666 shutdown_connections 2024-04-24T02:16:25.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.463+0000 7f92aa874640 1 -- 172.21.15.104:0/826516666 wait complete. 2024-04-24T02:16:25.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.464+0000 7f92aa874640 1 Processor -- start 2024-04-24T02:16:25.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.464+0000 7f92aa874640 1 -- start start 2024-04-24T02:16:25.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.465+0000 7f92aa874640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92a4070100 0x7f92a4122bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:16:25.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.465+0000 7f92aa874640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f92a4128780 con 0x7f92a4070100 2024-04-24T02:16:25.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.465+0000 7f92a3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92a4070100 0x7f92a4122bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:16:25.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.465+0000 7f92a3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92a4070100 0x7f92a4122bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:59372/0 (socket says 172.21.15.104:59372) 2024-04-24T02:16:25.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.465+0000 7f92a3fff640 1 -- 172.21.15.104:0/2531588441 learned_addr learned my addr 172.21.15.104:0/2531588441 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:16:25.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.465+0000 7f92a3fff640 1 -- 172.21.15.104:0/2531588441 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92a41258b0 con 0x7f92a4070100 2024-04-24T02:16:25.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.465+0000 7f92a3fff640 1 --2- 172.21.15.104:0/2531588441 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92a4070100 0x7f92a4122bd0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f9294009720 tx=0x7f92940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:16:25.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.465+0000 7f92a0ff9640 1 -- 172.21.15.104:0/2531588441 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9294004160 con 0x7f92a4070100 2024-04-24T02:16:25.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.465+0000 7f92a0ff9640 1 -- 172.21.15.104:0/2531588441 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9294004320 con 0x7f92a4070100 2024-04-24T02:16:25.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.465+0000 7f92aa874640 1 -- 172.21.15.104:0/2531588441 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92a406de50 con 0x7f92a4070100 2024-04-24T02:16:25.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.465+0000 7f92a0ff9640 1 -- 172.21.15.104:0/2531588441 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9294032640 con 0x7f92a4070100 2024-04-24T02:16:25.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.465+0000 7f92aa874640 1 -- 172.21.15.104:0/2531588441 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92a406d420 con 0x7f92a4070100 2024-04-24T02:16:25.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.466+0000 7f92a0ff9640 1 -- 172.21.15.104:0/2531588441 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f92940327e0 con 0x7f92a4070100 2024-04-24T02:16:25.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.466+0000 7f92aa874640 1 -- 172.21.15.104:0/2531588441 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92a4071cf0 con 0x7f92a4070100 2024-04-24T02:16:25.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.466+0000 7f92a0ff9640 1 --2- 172.21.15.104:0/2531588441 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9290038090 0x7f929003a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:16:25.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.466+0000 7f92a0ff9640 1 -- 172.21.15.104:0/2531588441 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f929402f050 con 0x7f92a4070100 2024-04-24T02:16:25.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.467+0000 7f92a37fe640 1 --2- 172.21.15.104:0/2531588441 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9290038090 0x7f929003a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:16:25.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.467+0000 7f92a37fe640 1 --2- 172.21.15.104:0/2531588441 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9290038090 0x7f929003a550 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f9298000c00 tx=0x7f9298001310 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:16:25.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.471+0000 7f92a0ff9640 1 -- 172.21.15.104:0/2531588441 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f92a4071cf0 con 0x7f92a4070100 2024-04-24T02:16:25.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.641+0000 7f92aa874640 1 -- 172.21.15.104:0/2531588441 --> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f92a4124740 con 0x7f9290038090 2024-04-24T02:16:25.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.656+0000 7f92a0ff9640 1 -- 172.21.15.104:0/2531588441 <== mgr.4101 v2:172.21.15.134:6824/3655027977 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+664475 (secure 0 0 0) 0x7f92a4124740 con 0x7f9290038090 2024-04-24T02:16:25.671 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:16:25.678 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-04-24T02:16:25.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.661+0000 7f92aa874640 1 -- 172.21.15.104:0/2531588441 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9290038090 msgr2=0x7f929003a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:16:25.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.661+0000 7f92aa874640 1 --2- 172.21.15.104:0/2531588441 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9290038090 0x7f929003a550 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f9298000c00 tx=0x7f9298001310 comp rx=0 tx=0).stop 2024-04-24T02:16:25.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.661+0000 7f92aa874640 1 -- 172.21.15.104:0/2531588441 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92a4070100 msgr2=0x7f92a4122bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:16:25.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.661+0000 7f92aa874640 1 --2- 172.21.15.104:0/2531588441 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92a4070100 0x7f92a4122bd0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f9294009720 tx=0x7f92940046c0 comp rx=0 tx=0).stop 2024-04-24T02:16:25.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.661+0000 7f92aa874640 1 -- 172.21.15.104:0/2531588441 shutdown_connections 2024-04-24T02:16:25.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.661+0000 7f92aa874640 1 --2- 172.21.15.104:0/2531588441 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9290038090 0x7f929003a550 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:16:25.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.661+0000 7f92aa874640 1 --2- 172.21.15.104:0/2531588441 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92a4070100 0x7f92a4122bd0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:16:25.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.661+0000 7f92aa874640 1 -- 172.21.15.104:0/2531588441 >> 172.21.15.104:0/2531588441 conn(0x7f92a4099680 msgr2=0x7f92a406e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:16:25.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.661+0000 7f92aa874640 1 -- 172.21.15.104:0/2531588441 shutdown_connections 2024-04-24T02:16:25.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:25.661+0000 7f92aa874640 1 -- 172.21.15.104:0/2531588441 wait complete. 2024-04-24T02:16:25.685 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":167,"stamp":"2024-04-24T02:16:24.044130+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":252,"num_object_clones":0,"num_object_copies":504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":0,"num_read":5385,"num_read_kb":4938,"num_write":2369,"num_write_kb":61373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5009,"ondisk_log_size":5009,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":156632,"kb_used_data":2808,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377330728,"statfs":{"total":386547056640,"available":386386665472,"internally_reserved":0,"allocated":2875392,"data_stored":1715930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":157476630},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004328"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:59.430267+0000","last_change":"2024-04-24T02:15:59.430267+0000","last_active":"2024-04-24T02:15:59.430267+0000","last_peered":"2024-04-24T02:15:59.430267+0000","last_clean":"2024-04-24T02:15:59.430267+0000","last_became_active":"2024-04-24T02:12:02.754954+0000","last_became_peered":"2024-04-24T02:12:02.754954+0000","last_unstale":"2024-04-24T02:15:59.430267+0000","last_undegraded":"2024-04-24T02:15:59.430267+0000","last_fullsized":"2024-04-24T02:15:59.430267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:59.430121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:59.430121+0000","last_clean_scrub_stamp":"2024-04-24T02:15:59.430121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:45.711501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'8","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:58.482790+0000","last_change":"2024-04-24T02:15:58.482814+0000","last_active":"2024-04-24T02:15:58.482790+0000","last_peered":"2024-04-24T02:15:58.482790+0000","last_clean":"2024-04-24T02:15:58.482790+0000","last_became_active":"2024-04-24T02:12:04.754049+0000","last_became_peered":"2024-04-24T02:12:04.754049+0000","last_unstale":"2024-04-24T02:15:58.482790+0000","last_undegraded":"2024-04-24T02:15:58.482790+0000","last_fullsized":"2024-04-24T02:15:58.482790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-24T02:15:58.482703+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-24T02:15:58.482703+0000","last_clean_scrub_stamp":"2024-04-24T02:15:58.482703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:53:22.606358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:02.136783+0000","last_change":"2024-04-24T02:16:02.136783+0000","last_active":"2024-04-24T02:16:02.136783+0000","last_peered":"2024-04-24T02:16:02.136783+0000","last_clean":"2024-04-24T02:16:02.136783+0000","last_became_active":"2024-04-24T02:12:02.745526+0000","last_became_peered":"2024-04-24T02:12:02.745526+0000","last_unstale":"2024-04-24T02:16:02.136783+0000","last_undegraded":"2024-04-24T02:16:02.136783+0000","last_fullsized":"2024-04-24T02:16:02.136783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:02.136614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:02.136614+0000","last_clean_scrub_stamp":"2024-04-24T02:16:02.136614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:53.467958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'12","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:11.034375+0000","last_change":"2024-04-24T02:16:11.034405+0000","last_active":"2024-04-24T02:16:11.034375+0000","last_peered":"2024-04-24T02:16:11.034375+0000","last_clean":"2024-04-24T02:16:11.034375+0000","last_became_active":"2024-04-24T02:12:04.762967+0000","last_became_peered":"2024-04-24T02:12:04.762967+0000","last_unstale":"2024-04-24T02:16:11.034375+0000","last_undegraded":"2024-04-24T02:16:11.034375+0000","last_fullsized":"2024-04-24T02:16:11.034375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-04-24T02:16:11.034280+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-04-24T02:16:11.034280+0000","last_clean_scrub_stamp":"2024-04-24T02:16:11.034280+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:23:21.593953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":62,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:24.221546+0000","last_change":"2024-04-24T02:12:02.761596+0000","last_active":"2024-04-24T02:15:24.221546+0000","last_peered":"2024-04-24T02:15:24.221546+0000","last_clean":"2024-04-24T02:15:24.221546+0000","last_became_active":"2024-04-24T02:12:02.758985+0000","last_became_peered":"2024-04-24T02:12:02.758985+0000","last_unstale":"2024-04-24T02:15:24.221546+0000","last_undegraded":"2024-04-24T02:15:24.221546+0000","last_fullsized":"2024-04-24T02:15:24.221546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:43.364320+0000","last_change":"2024-04-24T02:15:43.364378+0000","last_active":"2024-04-24T02:15:43.364320+0000","last_peered":"2024-04-24T02:15:43.364320+0000","last_clean":"2024-04-24T02:15:43.364320+0000","last_became_active":"2024-04-24T02:12:04.765327+0000","last_became_peered":"2024-04-24T02:12:04.765327+0000","last_unstale":"2024-04-24T02:15:43.364320+0000","last_undegraded":"2024-04-24T02:15:43.364320+0000","last_fullsized":"2024-04-24T02:15:43.364320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-24T02:15:43.364212+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-24T02:15:43.364212+0000","last_clean_scrub_stamp":"2024-04-24T02:15:43.364212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:05:54.967851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:07.469203+0000","last_change":"2024-04-24T02:16:07.469227+0000","last_active":"2024-04-24T02:16:07.469203+0000","last_peered":"2024-04-24T02:16:07.469203+0000","last_clean":"2024-04-24T02:16:07.469203+0000","last_became_active":"2024-04-24T02:12:02.744804+0000","last_became_peered":"2024-04-24T02:12:02.744804+0000","last_unstale":"2024-04-24T02:16:07.469203+0000","last_undegraded":"2024-04-24T02:16:07.469203+0000","last_fullsized":"2024-04-24T02:16:07.469203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:07.469103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:07.469103+0000","last_clean_scrub_stamp":"2024-04-24T02:16:07.469103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:53:31.592758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'6","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:12.958194+0000","last_change":"2024-04-24T02:16:12.958220+0000","last_active":"2024-04-24T02:16:12.958194+0000","last_peered":"2024-04-24T02:16:12.958194+0000","last_clean":"2024-04-24T02:16:12.958194+0000","last_became_active":"2024-04-24T02:12:04.763076+0000","last_became_peered":"2024-04-24T02:12:04.763076+0000","last_unstale":"2024-04-24T02:16:12.958194+0000","last_undegraded":"2024-04-24T02:16:12.958194+0000","last_fullsized":"2024-04-24T02:16:12.958194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-24T02:16:12.958105+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-24T02:16:12.958105+0000","last_clean_scrub_stamp":"2024-04-24T02:16:12.958105+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:12:38.863390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:35.042327+0000","last_change":"2024-04-24T02:12:02.755265+0000","last_active":"2024-04-24T02:14:35.042327+0000","last_peered":"2024-04-24T02:14:35.042327+0000","last_clean":"2024-04-24T02:14:35.042327+0000","last_became_active":"2024-04-24T02:12:02.754208+0000","last_became_peered":"2024-04-24T02:12:02.754208+0000","last_unstale":"2024-04-24T02:14:35.042327+0000","last_undegraded":"2024-04-24T02:14:35.042327+0000","last_fullsized":"2024-04-24T02:14:35.042327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:04.423664+0000","last_change":"2024-04-24T02:16:04.423664+0000","last_active":"2024-04-24T02:16:04.423664+0000","last_peered":"2024-04-24T02:16:04.423664+0000","last_clean":"2024-04-24T02:16:04.423664+0000","last_became_active":"2024-04-24T02:12:04.755248+0000","last_became_peered":"2024-04-24T02:12:04.755248+0000","last_unstale":"2024-04-24T02:16:04.423664+0000","last_undegraded":"2024-04-24T02:16:04.423664+0000","last_fullsized":"2024-04-24T02:16:04.423664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:16:04.423535+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:16:04.423535+0000","last_clean_scrub_stamp":"2024-04-24T02:16:04.423535+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:28:44.017367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:05.445107+0000","last_change":"2024-04-24T02:16:05.445133+0000","last_active":"2024-04-24T02:16:05.445107+0000","last_peered":"2024-04-24T02:16:05.445107+0000","last_clean":"2024-04-24T02:16:05.445107+0000","last_became_active":"2024-04-24T02:12:02.741326+0000","last_became_peered":"2024-04-24T02:12:02.741326+0000","last_unstale":"2024-04-24T02:16:05.445107+0000","last_undegraded":"2024-04-24T02:16:05.445107+0000","last_fullsized":"2024-04-24T02:16:05.445107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:16:05.444999+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:16:05.444999+0000","last_clean_scrub_stamp":"2024-04-24T02:16:05.444999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:34:29.031714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:14.007277+0000","last_change":"2024-04-24T02:16:14.007277+0000","last_active":"2024-04-24T02:16:14.007277+0000","last_peered":"2024-04-24T02:16:14.007277+0000","last_clean":"2024-04-24T02:16:14.007277+0000","last_became_active":"2024-04-24T02:12:04.762921+0000","last_became_peered":"2024-04-24T02:12:04.762921+0000","last_unstale":"2024-04-24T02:16:14.007277+0000","last_undegraded":"2024-04-24T02:16:14.007277+0000","last_fullsized":"2024-04-24T02:16:14.007277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:16:14.007159+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:16:14.007159+0000","last_clean_scrub_stamp":"2024-04-24T02:16:14.007159+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:54:00.213102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:35.042178+0000","last_change":"2024-04-24T02:12:02.755513+0000","last_active":"2024-04-24T02:14:35.042178+0000","last_peered":"2024-04-24T02:14:35.042178+0000","last_clean":"2024-04-24T02:14:35.042178+0000","last_became_active":"2024-04-24T02:12:02.752921+0000","last_became_peered":"2024-04-24T02:12:02.752921+0000","last_unstale":"2024-04-24T02:14:35.042178+0000","last_undegraded":"2024-04-24T02:14:35.042178+0000","last_fullsized":"2024-04-24T02:14:35.042178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'12","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:52.390885+0000","last_change":"2024-04-24T02:15:52.390885+0000","last_active":"2024-04-24T02:15:52.390885+0000","last_peered":"2024-04-24T02:15:52.390885+0000","last_clean":"2024-04-24T02:15:52.390885+0000","last_became_active":"2024-04-24T02:12:04.751655+0000","last_became_peered":"2024-04-24T02:12:04.751655+0000","last_unstale":"2024-04-24T02:15:52.390885+0000","last_undegraded":"2024-04-24T02:15:52.390885+0000","last_fullsized":"2024-04-24T02:15:52.390885+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-04-24T02:15:52.390774+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-04-24T02:15:52.390774+0000","last_clean_scrub_stamp":"2024-04-24T02:15:52.390774+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:04:47.993410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:54.140893+0000","last_change":"2024-04-24T02:15:54.140936+0000","last_active":"2024-04-24T02:15:54.140893+0000","last_peered":"2024-04-24T02:15:54.140893+0000","last_clean":"2024-04-24T02:15:54.140893+0000","last_became_active":"2024-04-24T02:12:02.752476+0000","last_became_peered":"2024-04-24T02:12:02.752476+0000","last_unstale":"2024-04-24T02:15:54.140893+0000","last_undegraded":"2024-04-24T02:15:54.140893+0000","last_fullsized":"2024-04-24T02:15:54.140893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-24T02:15:54.140770+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-24T02:15:54.140770+0000","last_clean_scrub_stamp":"2024-04-24T02:15:54.140770+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:49:51.563159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'18","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:12.548196+0000","last_change":"2024-04-24T02:16:12.548196+0000","last_active":"2024-04-24T02:16:12.548196+0000","last_peered":"2024-04-24T02:16:12.548196+0000","last_clean":"2024-04-24T02:16:12.548196+0000","last_became_active":"2024-04-24T02:12:04.766693+0000","last_became_peered":"2024-04-24T02:12:04.766693+0000","last_unstale":"2024-04-24T02:16:12.548196+0000","last_undegraded":"2024-04-24T02:16:12.548196+0000","last_fullsized":"2024-04-24T02:16:12.548196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-04-24T02:16:12.548082+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-04-24T02:16:12.548082+0000","last_clean_scrub_stamp":"2024-04-24T02:16:12.548082+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:29:42.674730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:59.112678+0000","last_change":"2024-04-24T02:15:59.112718+0000","last_active":"2024-04-24T02:15:59.112678+0000","last_peered":"2024-04-24T02:15:59.112678+0000","last_clean":"2024-04-24T02:15:59.112678+0000","last_became_active":"2024-04-24T02:12:04.764470+0000","last_became_peered":"2024-04-24T02:12:04.764470+0000","last_unstale":"2024-04-24T02:15:59.112678+0000","last_undegraded":"2024-04-24T02:15:59.112678+0000","last_fullsized":"2024-04-24T02:15:59.112678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-24T02:15:59.112564+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-24T02:15:59.112564+0000","last_clean_scrub_stamp":"2024-04-24T02:15:59.112564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:36:51.262575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:07.472799+0000","last_change":"2024-04-24T02:16:07.472840+0000","last_active":"2024-04-24T02:16:07.472799+0000","last_peered":"2024-04-24T02:16:07.472799+0000","last_clean":"2024-04-24T02:16:07.472799+0000","last_became_active":"2024-04-24T02:12:02.753791+0000","last_became_peered":"2024-04-24T02:12:02.753791+0000","last_unstale":"2024-04-24T02:16:07.472799+0000","last_undegraded":"2024-04-24T02:16:07.472799+0000","last_fullsized":"2024-04-24T02:16:07.472799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:16:07.472691+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:16:07.472691+0000","last_clean_scrub_stamp":"2024-04-24T02:16:07.472691+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:06:27.147194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'10","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:55.422084+0000","last_change":"2024-04-24T02:15:55.422124+0000","last_active":"2024-04-24T02:15:55.422084+0000","last_peered":"2024-04-24T02:15:55.422084+0000","last_clean":"2024-04-24T02:15:55.422084+0000","last_became_active":"2024-04-24T02:12:04.750774+0000","last_became_peered":"2024-04-24T02:12:04.750774+0000","last_unstale":"2024-04-24T02:15:55.422084+0000","last_undegraded":"2024-04-24T02:15:55.422084+0000","last_fullsized":"2024-04-24T02:15:55.422084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-24T02:15:55.421992+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-24T02:15:55.421992+0000","last_clean_scrub_stamp":"2024-04-24T02:15:55.421992+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:08:59.008607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:57.387526+0000","last_change":"2024-04-24T02:15:57.387551+0000","last_active":"2024-04-24T02:15:57.387526+0000","last_peered":"2024-04-24T02:15:57.387526+0000","last_clean":"2024-04-24T02:15:57.387526+0000","last_became_active":"2024-04-24T02:12:02.754860+0000","last_became_peered":"2024-04-24T02:12:02.754860+0000","last_unstale":"2024-04-24T02:15:57.387526+0000","last_undegraded":"2024-04-24T02:15:57.387526+0000","last_fullsized":"2024-04-24T02:15:57.387526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:57.387439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:57.387439+0000","last_clean_scrub_stamp":"2024-04-24T02:15:57.387439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:51:58.982518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:52.480408+0000","last_change":"2024-04-24T02:15:52.480434+0000","last_active":"2024-04-24T02:15:52.480408+0000","last_peered":"2024-04-24T02:15:52.480408+0000","last_clean":"2024-04-24T02:15:52.480408+0000","last_became_active":"2024-04-24T02:12:04.750919+0000","last_became_peered":"2024-04-24T02:12:04.750919+0000","last_unstale":"2024-04-24T02:15:52.480408+0000","last_undegraded":"2024-04-24T02:15:52.480408+0000","last_fullsized":"2024-04-24T02:15:52.480408+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-24T02:15:52.480323+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-24T02:15:52.480323+0000","last_clean_scrub_stamp":"2024-04-24T02:15:52.480323+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:42:50.701745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'4","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:57.510465+0000","last_change":"2024-04-24T02:15:57.510492+0000","last_active":"2024-04-24T02:15:57.510465+0000","last_peered":"2024-04-24T02:15:57.510465+0000","last_clean":"2024-04-24T02:15:57.510465+0000","last_became_active":"2024-04-24T02:12:02.756389+0000","last_became_peered":"2024-04-24T02:12:02.756389+0000","last_unstale":"2024-04-24T02:15:57.510465+0000","last_undegraded":"2024-04-24T02:15:57.510465+0000","last_fullsized":"2024-04-24T02:15:57.510465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:57.510375+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:57.510375+0000","last_clean_scrub_stamp":"2024-04-24T02:15:57.510375+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:59:42.826506+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:50.155004+0000","last_change":"2024-04-24T02:15:50.155056+0000","last_active":"2024-04-24T02:15:50.155004+0000","last_peered":"2024-04-24T02:15:50.155004+0000","last_clean":"2024-04-24T02:15:50.155004+0000","last_became_active":"2024-04-24T02:12:04.766739+0000","last_became_peered":"2024-04-24T02:12:04.766739+0000","last_unstale":"2024-04-24T02:15:50.155004+0000","last_undegraded":"2024-04-24T02:15:50.155004+0000","last_fullsized":"2024-04-24T02:15:50.155004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:15:50.154864+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:15:50.154864+0000","last_clean_scrub_stamp":"2024-04-24T02:15:50.154864+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:50:10.913324+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:10.508954+0000","last_change":"2024-04-24T02:16:10.508998+0000","last_active":"2024-04-24T02:16:10.508954+0000","last_peered":"2024-04-24T02:16:10.508954+0000","last_clean":"2024-04-24T02:16:10.508954+0000","last_became_active":"2024-04-24T02:12:02.744763+0000","last_became_peered":"2024-04-24T02:12:02.744763+0000","last_unstale":"2024-04-24T02:16:10.508954+0000","last_undegraded":"2024-04-24T02:16:10.508954+0000","last_fullsized":"2024-04-24T02:16:10.508954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:10.508823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:10.508823+0000","last_clean_scrub_stamp":"2024-04-24T02:16:10.508823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:09:39.666724+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'10","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:02.403771+0000","last_change":"2024-04-24T02:16:02.403810+0000","last_active":"2024-04-24T02:16:02.403771+0000","last_peered":"2024-04-24T02:16:02.403771+0000","last_clean":"2024-04-24T02:16:02.403771+0000","last_became_active":"2024-04-24T02:12:04.764659+0000","last_became_peered":"2024-04-24T02:12:04.764659+0000","last_unstale":"2024-04-24T02:16:02.403771+0000","last_undegraded":"2024-04-24T02:16:02.403771+0000","last_fullsized":"2024-04-24T02:16:02.403771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-24T02:16:02.403666+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-24T02:16:02.403666+0000","last_clean_scrub_stamp":"2024-04-24T02:16:02.403666+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:51:19.234006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:15.120084+0000","last_change":"2024-04-24T02:16:15.120108+0000","last_active":"2024-04-24T02:16:15.120084+0000","last_peered":"2024-04-24T02:16:15.120084+0000","last_clean":"2024-04-24T02:16:15.120084+0000","last_became_active":"2024-04-24T02:12:02.741976+0000","last_became_peered":"2024-04-24T02:12:02.741976+0000","last_unstale":"2024-04-24T02:16:15.120084+0000","last_undegraded":"2024-04-24T02:16:15.120084+0000","last_fullsized":"2024-04-24T02:16:15.120084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:15.119977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:15.119977+0000","last_clean_scrub_stamp":"2024-04-24T02:16:15.119977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:58:41.992666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'10","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:02.459018+0000","last_change":"2024-04-24T02:16:02.459044+0000","last_active":"2024-04-24T02:16:02.459018+0000","last_peered":"2024-04-24T02:16:02.459018+0000","last_clean":"2024-04-24T02:16:02.459018+0000","last_became_active":"2024-04-24T02:12:04.755133+0000","last_became_peered":"2024-04-24T02:12:04.755133+0000","last_unstale":"2024-04-24T02:16:02.459018+0000","last_undegraded":"2024-04-24T02:16:02.459018+0000","last_fullsized":"2024-04-24T02:16:02.459018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-24T02:16:02.458930+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-24T02:16:02.458930+0000","last_clean_scrub_stamp":"2024-04-24T02:16:02.458930+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:46:33.121676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:25.040567+0000","last_change":"2024-04-24T02:12:02.758478+0000","last_active":"2024-04-24T02:14:25.040567+0000","last_peered":"2024-04-24T02:14:25.040567+0000","last_clean":"2024-04-24T02:14:25.040567+0000","last_became_active":"2024-04-24T02:12:02.753196+0000","last_became_peered":"2024-04-24T02:12:02.753196+0000","last_unstale":"2024-04-24T02:14:25.040567+0000","last_undegraded":"2024-04-24T02:14:25.040567+0000","last_fullsized":"2024-04-24T02:14:25.040567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'35","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.484556+0000","last_change":"2024-04-24T02:12:12.798478+0000","last_active":"2024-04-24T02:15:13.484556+0000","last_peered":"2024-04-24T02:15:13.484556+0000","last_clean":"2024-04-24T02:15:13.484556+0000","last_became_active":"2024-04-24T02:12:12.798179+0000","last_became_peered":"2024-04-24T02:12:12.798179+0000","last_unstale":"2024-04-24T02:15:13.484556+0000","last_undegraded":"2024-04-24T02:15:13.484556+0000","last_fullsized":"2024-04-24T02:15:13.484556+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:05.033123+0000","last_change":"2024-04-24T02:16:05.033188+0000","last_active":"2024-04-24T02:16:05.033123+0000","last_peered":"2024-04-24T02:16:05.033123+0000","last_clean":"2024-04-24T02:16:05.033123+0000","last_became_active":"2024-04-24T02:12:04.763725+0000","last_became_peered":"2024-04-24T02:12:04.763725+0000","last_unstale":"2024-04-24T02:16:05.033123+0000","last_undegraded":"2024-04-24T02:16:05.033123+0000","last_fullsized":"2024-04-24T02:16:05.033123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-24T02:16:05.033002+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-24T02:16:05.033002+0000","last_clean_scrub_stamp":"2024-04-24T02:16:05.033002+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:02:20.198278+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:25.040598+0000","last_change":"2024-04-24T02:12:02.756910+0000","last_active":"2024-04-24T02:14:25.040598+0000","last_peered":"2024-04-24T02:14:25.040598+0000","last_clean":"2024-04-24T02:14:25.040598+0000","last_became_active":"2024-04-24T02:12:02.755520+0000","last_became_peered":"2024-04-24T02:12:02.755520+0000","last_unstale":"2024-04-24T02:14:25.040598+0000","last_undegraded":"2024-04-24T02:14:25.040598+0000","last_fullsized":"2024-04-24T02:14:25.040598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:28.347085+0000","last_change":"2024-04-24T02:15:28.347111+0000","last_active":"2024-04-24T02:15:28.347085+0000","last_peered":"2024-04-24T02:15:28.347085+0000","last_clean":"2024-04-24T02:15:28.347085+0000","last_became_active":"2024-04-24T02:12:06.758033+0000","last_became_peered":"2024-04-24T02:12:06.758033+0000","last_unstale":"2024-04-24T02:15:28.347085+0000","last_undegraded":"2024-04-24T02:15:28.347085+0000","last_fullsized":"2024-04-24T02:15:28.347085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:28.346988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:28.346988+0000","last_clean_scrub_stamp":"2024-04-24T02:15:28.346988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:48:41.497279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'51","reported_seq":118,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:49.256468+0000","last_change":"2024-04-24T02:15:49.256528+0000","last_active":"2024-04-24T02:15:49.256468+0000","last_peered":"2024-04-24T02:15:49.256468+0000","last_clean":"2024-04-24T02:15:49.256468+0000","last_became_active":"2024-04-24T02:12:08.783666+0000","last_became_peered":"2024-04-24T02:12:08.783666+0000","last_unstale":"2024-04-24T02:15:49.256468+0000","last_undegraded":"2024-04-24T02:15:49.256468+0000","last_fullsized":"2024-04-24T02:15:49.256468+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'51","last_scrub_stamp":"2024-04-24T02:15:49.256366+0000","last_deep_scrub":"32'51","last_deep_scrub_stamp":"2024-04-24T02:15:49.256366+0000","last_clean_scrub_stamp":"2024-04-24T02:15:49.256366+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:04:52.395526+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:38.404790+0000","last_change":"2024-04-24T02:15:38.404846+0000","last_active":"2024-04-24T02:15:38.404790+0000","last_peered":"2024-04-24T02:15:38.404790+0000","last_clean":"2024-04-24T02:15:38.404790+0000","last_became_active":"2024-04-24T02:12:10.786981+0000","last_became_peered":"2024-04-24T02:12:10.786981+0000","last_unstale":"2024-04-24T02:15:38.404790+0000","last_undegraded":"2024-04-24T02:15:38.404790+0000","last_fullsized":"2024-04-24T02:15:38.404790+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:38.404652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:38.404652+0000","last_clean_scrub_stamp":"2024-04-24T02:15:38.404652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:17:51.653509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:18.381271+0000","last_change":"2024-04-24T02:16:18.381296+0000","last_active":"2024-04-24T02:16:18.381271+0000","last_peered":"2024-04-24T02:16:18.381271+0000","last_clean":"2024-04-24T02:16:18.381271+0000","last_became_active":"2024-04-24T02:12:12.796319+0000","last_became_peered":"2024-04-24T02:12:12.796319+0000","last_unstale":"2024-04-24T02:16:18.381271+0000","last_undegraded":"2024-04-24T02:16:18.381271+0000","last_fullsized":"2024-04-24T02:16:18.381271+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-04-24T02:16:18.381185+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-04-24T02:16:18.381185+0000","last_clean_scrub_stamp":"2024-04-24T02:16:18.381185+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:37:39.446642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:58.158915+0000","last_change":"2024-04-24T02:15:58.158961+0000","last_active":"2024-04-24T02:15:58.158915+0000","last_peered":"2024-04-24T02:15:58.158915+0000","last_clean":"2024-04-24T02:15:58.158915+0000","last_became_active":"2024-04-24T02:12:04.764351+0000","last_became_peered":"2024-04-24T02:12:04.764351+0000","last_unstale":"2024-04-24T02:15:58.158915+0000","last_undegraded":"2024-04-24T02:15:58.158915+0000","last_fullsized":"2024-04-24T02:15:58.158915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:58.158816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:58.158816+0000","last_clean_scrub_stamp":"2024-04-24T02:15:58.158816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:17:50.502415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:10.527205+0000","last_change":"2024-04-24T02:16:10.527257+0000","last_active":"2024-04-24T02:16:10.527205+0000","last_peered":"2024-04-24T02:16:10.527205+0000","last_clean":"2024-04-24T02:16:10.527205+0000","last_became_active":"2024-04-24T02:12:02.744030+0000","last_became_peered":"2024-04-24T02:12:02.744030+0000","last_unstale":"2024-04-24T02:16:10.527205+0000","last_undegraded":"2024-04-24T02:16:10.527205+0000","last_fullsized":"2024-04-24T02:16:10.527205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:10.527107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:10.527107+0000","last_clean_scrub_stamp":"2024-04-24T02:16:10.527107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:28:15.772679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:48.070304+0000","last_change":"2024-04-24T02:15:48.070327+0000","last_active":"2024-04-24T02:15:48.070304+0000","last_peered":"2024-04-24T02:15:48.070304+0000","last_clean":"2024-04-24T02:15:48.070304+0000","last_became_active":"2024-04-24T02:12:06.758561+0000","last_became_peered":"2024-04-24T02:12:06.758561+0000","last_unstale":"2024-04-24T02:15:48.070304+0000","last_undegraded":"2024-04-24T02:15:48.070304+0000","last_fullsized":"2024-04-24T02:15:48.070304+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:48.070212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:48.070212+0000","last_clean_scrub_stamp":"2024-04-24T02:15:48.070212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:55:00.279301+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'16","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:32.376409+0000","last_change":"2024-04-24T02:15:32.376443+0000","last_active":"2024-04-24T02:15:32.376409+0000","last_peered":"2024-04-24T02:15:32.376409+0000","last_clean":"2024-04-24T02:15:32.376409+0000","last_became_active":"2024-04-24T02:12:08.767493+0000","last_became_peered":"2024-04-24T02:12:08.767493+0000","last_unstale":"2024-04-24T02:15:32.376409+0000","last_undegraded":"2024-04-24T02:15:32.376409+0000","last_fullsized":"2024-04-24T02:15:32.376409+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-04-24T02:15:32.376317+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-04-24T02:15:32.376317+0000","last_clean_scrub_stamp":"2024-04-24T02:15:32.376317+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:12:17.100634+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:26.334462+0000","last_change":"2024-04-24T02:15:26.334490+0000","last_active":"2024-04-24T02:15:26.334462+0000","last_peered":"2024-04-24T02:15:26.334462+0000","last_clean":"2024-04-24T02:15:26.334462+0000","last_became_active":"2024-04-24T02:12:10.779231+0000","last_became_peered":"2024-04-24T02:12:10.779231+0000","last_unstale":"2024-04-24T02:15:26.334462+0000","last_undegraded":"2024-04-24T02:15:26.334462+0000","last_fullsized":"2024-04-24T02:15:26.334462+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:26.334368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:26.334368+0000","last_clean_scrub_stamp":"2024-04-24T02:15:26.334368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:20:30.421649+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'8","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:51.148078+0000","last_change":"2024-04-24T02:15:51.148133+0000","last_active":"2024-04-24T02:15:51.148078+0000","last_peered":"2024-04-24T02:15:51.148078+0000","last_clean":"2024-04-24T02:15:51.148078+0000","last_became_active":"2024-04-24T02:12:12.791542+0000","last_became_peered":"2024-04-24T02:12:12.791542+0000","last_unstale":"2024-04-24T02:15:51.148078+0000","last_undegraded":"2024-04-24T02:15:51.148078+0000","last_fullsized":"2024-04-24T02:15:51.148078+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-24T02:15:51.147969+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-24T02:15:51.147969+0000","last_clean_scrub_stamp":"2024-04-24T02:15:51.147969+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:39:56.492767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:06.023830+0000","last_change":"2024-04-24T02:16:06.023890+0000","last_active":"2024-04-24T02:16:06.023830+0000","last_peered":"2024-04-24T02:16:06.023830+0000","last_clean":"2024-04-24T02:16:06.023830+0000","last_became_active":"2024-04-24T02:12:04.763491+0000","last_became_peered":"2024-04-24T02:12:04.763491+0000","last_unstale":"2024-04-24T02:16:06.023830+0000","last_undegraded":"2024-04-24T02:16:06.023830+0000","last_fullsized":"2024-04-24T02:16:06.023830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-24T02:16:06.023706+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-24T02:16:06.023706+0000","last_clean_scrub_stamp":"2024-04-24T02:16:06.023706+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:20:06.723214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:25.040536+0000","last_change":"2024-04-24T02:12:02.757002+0000","last_active":"2024-04-24T02:14:25.040536+0000","last_peered":"2024-04-24T02:14:25.040536+0000","last_clean":"2024-04-24T02:14:25.040536+0000","last_became_active":"2024-04-24T02:12:02.755636+0000","last_became_peered":"2024-04-24T02:12:02.755636+0000","last_unstale":"2024-04-24T02:14:25.040536+0000","last_undegraded":"2024-04-24T02:14:25.040536+0000","last_fullsized":"2024-04-24T02:14:25.040536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:15.646908+0000","last_change":"2024-04-24T02:16:15.646931+0000","last_active":"2024-04-24T02:16:15.646908+0000","last_peered":"2024-04-24T02:16:15.646908+0000","last_clean":"2024-04-24T02:16:15.646908+0000","last_became_active":"2024-04-24T02:12:45.813038+0000","last_became_peered":"2024-04-24T02:12:45.813038+0000","last_unstale":"2024-04-24T02:16:15.646908+0000","last_undegraded":"2024-04-24T02:16:15.646908+0000","last_fullsized":"2024-04-24T02:16:15.646908+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:15.646820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:15.646820+0000","last_clean_scrub_stamp":"2024-04-24T02:16:15.646820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:06:27.250459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"32'29","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:31.495647+0000","last_change":"2024-04-24T02:15:31.495714+0000","last_active":"2024-04-24T02:15:31.495647+0000","last_peered":"2024-04-24T02:15:31.495647+0000","last_clean":"2024-04-24T02:15:31.495647+0000","last_became_active":"2024-04-24T02:12:08.783077+0000","last_became_peered":"2024-04-24T02:12:08.783077+0000","last_unstale":"2024-04-24T02:15:31.495647+0000","last_undegraded":"2024-04-24T02:15:31.495647+0000","last_fullsized":"2024-04-24T02:15:31.495647+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'29","last_scrub_stamp":"2024-04-24T02:15:31.495549+0000","last_deep_scrub":"32'29","last_deep_scrub_stamp":"2024-04-24T02:15:31.495549+0000","last_clean_scrub_stamp":"2024-04-24T02:15:31.495549+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:13:45.684753+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'285","reported_seq":416,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:46.312707+0000","last_change":"2024-04-24T02:15:46.312755+0000","last_active":"2024-04-24T02:15:46.312707+0000","last_peered":"2024-04-24T02:15:46.312707+0000","last_clean":"2024-04-24T02:15:46.312707+0000","last_became_active":"2024-04-24T02:12:10.783726+0000","last_became_peered":"2024-04-24T02:12:10.783726+0000","last_unstale":"2024-04-24T02:15:46.312707+0000","last_undegraded":"2024-04-24T02:15:46.312707+0000","last_fullsized":"2024-04-24T02:15:46.312707+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-24T02:15:46.312603+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-24T02:15:46.312603+0000","last_clean_scrub_stamp":"2024-04-24T02:15:46.312603+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:06:42.364068+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:13.570766+0000","last_change":"2024-04-24T02:16:13.570786+0000","last_active":"2024-04-24T02:16:13.570766+0000","last_peered":"2024-04-24T02:16:13.570766+0000","last_clean":"2024-04-24T02:16:13.570766+0000","last_became_active":"2024-04-24T02:12:12.801331+0000","last_became_peered":"2024-04-24T02:12:12.801331+0000","last_unstale":"2024-04-24T02:16:13.570766+0000","last_undegraded":"2024-04-24T02:16:13.570766+0000","last_fullsized":"2024-04-24T02:16:13.570766+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:13.570666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:13.570666+0000","last_clean_scrub_stamp":"2024-04-24T02:16:13.570666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:28:53.164498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'18","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:07.145297+0000","last_change":"2024-04-24T02:16:07.145357+0000","last_active":"2024-04-24T02:16:07.145297+0000","last_peered":"2024-04-24T02:16:07.145297+0000","last_clean":"2024-04-24T02:16:07.145297+0000","last_became_active":"2024-04-24T02:12:04.756039+0000","last_became_peered":"2024-04-24T02:12:04.756039+0000","last_unstale":"2024-04-24T02:16:07.145297+0000","last_undegraded":"2024-04-24T02:16:07.145297+0000","last_fullsized":"2024-04-24T02:16:07.145297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-04-24T02:16:07.145185+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-04-24T02:16:07.145185+0000","last_clean_scrub_stamp":"2024-04-24T02:16:07.145185+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:09:45.496387+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":60,"num_read_kb":52,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"30'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:01.452966+0000","last_change":"2024-04-24T02:16:01.453009+0000","last_active":"2024-04-24T02:16:01.452966+0000","last_peered":"2024-04-24T02:16:01.452966+0000","last_clean":"2024-04-24T02:16:01.452966+0000","last_became_active":"2024-04-24T02:12:02.754852+0000","last_became_peered":"2024-04-24T02:12:02.754852+0000","last_unstale":"2024-04-24T02:16:01.452966+0000","last_undegraded":"2024-04-24T02:16:01.452966+0000","last_fullsized":"2024-04-24T02:16:01.452966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-24T02:16:01.452852+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-24T02:16:01.452852+0000","last_clean_scrub_stamp":"2024-04-24T02:16:01.452852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:28:06.698424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:26.356334+0000","last_change":"2024-04-24T02:15:26.356380+0000","last_active":"2024-04-24T02:15:26.356334+0000","last_peered":"2024-04-24T02:15:26.356334+0000","last_clean":"2024-04-24T02:15:26.356334+0000","last_became_active":"2024-04-24T02:12:06.757883+0000","last_became_peered":"2024-04-24T02:12:06.757883+0000","last_unstale":"2024-04-24T02:15:26.356334+0000","last_undegraded":"2024-04-24T02:15:26.356334+0000","last_fullsized":"2024-04-24T02:15:26.356334+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:26.356206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:26.356206+0000","last_clean_scrub_stamp":"2024-04-24T02:15:26.356206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:34:03.818953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'44","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:33.483208+0000","last_change":"2024-04-24T02:15:33.483248+0000","last_active":"2024-04-24T02:15:33.483208+0000","last_peered":"2024-04-24T02:15:33.483208+0000","last_clean":"2024-04-24T02:15:33.483208+0000","last_became_active":"2024-04-24T02:12:08.780950+0000","last_became_peered":"2024-04-24T02:12:08.780950+0000","last_unstale":"2024-04-24T02:15:33.483208+0000","last_undegraded":"2024-04-24T02:15:33.483208+0000","last_fullsized":"2024-04-24T02:15:33.483208+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'44","last_scrub_stamp":"2024-04-24T02:15:33.483112+0000","last_deep_scrub":"32'44","last_deep_scrub_stamp":"2024-04-24T02:15:33.483112+0000","last_clean_scrub_stamp":"2024-04-24T02:15:33.483112+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:41:28.737400+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'285","reported_seq":447,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:28.021707+0000","last_change":"2024-04-24T02:15:28.021732+0000","last_active":"2024-04-24T02:15:28.021707+0000","last_peered":"2024-04-24T02:15:28.021707+0000","last_clean":"2024-04-24T02:15:28.021707+0000","last_became_active":"2024-04-24T02:12:10.778254+0000","last_became_peered":"2024-04-24T02:12:10.778254+0000","last_unstale":"2024-04-24T02:15:28.021707+0000","last_undegraded":"2024-04-24T02:15:28.021707+0000","last_fullsized":"2024-04-24T02:15:28.021707+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-24T02:15:28.021612+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-24T02:15:28.021612+0000","last_clean_scrub_stamp":"2024-04-24T02:15:28.021612+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:14:08.932379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:41.341919+0000","last_change":"2024-04-24T02:15:41.341961+0000","last_active":"2024-04-24T02:15:41.341919+0000","last_peered":"2024-04-24T02:15:41.341919+0000","last_clean":"2024-04-24T02:15:41.341919+0000","last_became_active":"2024-04-24T02:12:04.767906+0000","last_became_peered":"2024-04-24T02:12:04.767906+0000","last_unstale":"2024-04-24T02:15:41.341919+0000","last_undegraded":"2024-04-24T02:15:41.341919+0000","last_fullsized":"2024-04-24T02:15:41.341919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:41.341814+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:41.341814+0000","last_clean_scrub_stamp":"2024-04-24T02:15:41.341814+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:28:20.935646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"32'3","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:11.548202+0000","last_change":"2024-04-24T02:16:11.548242+0000","last_active":"2024-04-24T02:16:11.548202+0000","last_peered":"2024-04-24T02:16:11.548202+0000","last_clean":"2024-04-24T02:16:11.548202+0000","last_became_active":"2024-04-24T02:12:02.748372+0000","last_became_peered":"2024-04-24T02:12:02.748372+0000","last_unstale":"2024-04-24T02:16:11.548202+0000","last_undegraded":"2024-04-24T02:16:11.548202+0000","last_fullsized":"2024-04-24T02:16:11.548202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-04-24T02:16:11.548067+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-04-24T02:16:11.548067+0000","last_clean_scrub_stamp":"2024-04-24T02:16:11.548067+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:46:42.210813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:36.460142+0000","last_change":"2024-04-24T02:15:36.460166+0000","last_active":"2024-04-24T02:15:36.460142+0000","last_peered":"2024-04-24T02:15:36.460142+0000","last_clean":"2024-04-24T02:15:36.460142+0000","last_became_active":"2024-04-24T02:12:06.764324+0000","last_became_peered":"2024-04-24T02:12:06.764324+0000","last_unstale":"2024-04-24T02:15:36.460142+0000","last_undegraded":"2024-04-24T02:15:36.460142+0000","last_fullsized":"2024-04-24T02:15:36.460142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:36.460053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:36.460053+0000","last_clean_scrub_stamp":"2024-04-24T02:15:36.460053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:36:31.597092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'58","reported_seq":124,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:36.435099+0000","last_change":"2024-04-24T02:15:36.435151+0000","last_active":"2024-04-24T02:15:36.435099+0000","last_peered":"2024-04-24T02:15:36.435099+0000","last_clean":"2024-04-24T02:15:36.435099+0000","last_became_active":"2024-04-24T02:12:08.771060+0000","last_became_peered":"2024-04-24T02:12:08.771060+0000","last_unstale":"2024-04-24T02:15:36.435099+0000","last_undegraded":"2024-04-24T02:15:36.435099+0000","last_fullsized":"2024-04-24T02:15:36.435099+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'58","last_scrub_stamp":"2024-04-24T02:15:36.435008+0000","last_deep_scrub":"32'58","last_deep_scrub_stamp":"2024-04-24T02:15:36.435008+0000","last_clean_scrub_stamp":"2024-04-24T02:15:36.435008+0000","objects_scrubbed":10,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:51:55.089317+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:29.043595+0000","last_change":"2024-04-24T02:15:29.043636+0000","last_active":"2024-04-24T02:15:29.043595+0000","last_peered":"2024-04-24T02:15:29.043595+0000","last_clean":"2024-04-24T02:15:29.043595+0000","last_became_active":"2024-04-24T02:12:10.776715+0000","last_became_peered":"2024-04-24T02:12:10.776715+0000","last_unstale":"2024-04-24T02:15:29.043595+0000","last_undegraded":"2024-04-24T02:15:29.043595+0000","last_fullsized":"2024-04-24T02:15:29.043595+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:29.043460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:29.043460+0000","last_clean_scrub_stamp":"2024-04-24T02:15:29.043460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:29:47.538838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'5","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:46.429961+0000","last_change":"2024-04-24T02:15:46.429992+0000","last_active":"2024-04-24T02:15:46.429961+0000","last_peered":"2024-04-24T02:15:46.429961+0000","last_clean":"2024-04-24T02:15:46.429961+0000","last_became_active":"2024-04-24T02:12:12.797405+0000","last_became_peered":"2024-04-24T02:12:12.797405+0000","last_unstale":"2024-04-24T02:15:46.429961+0000","last_undegraded":"2024-04-24T02:15:46.429961+0000","last_fullsized":"2024-04-24T02:15:46.429961+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-04-24T02:15:46.429875+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-04-24T02:15:46.429875+0000","last_clean_scrub_stamp":"2024-04-24T02:15:46.429875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:57:31.938558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'10","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:56.464554+0000","last_change":"2024-04-24T02:15:56.464583+0000","last_active":"2024-04-24T02:15:56.464554+0000","last_peered":"2024-04-24T02:15:56.464554+0000","last_clean":"2024-04-24T02:15:56.464554+0000","last_became_active":"2024-04-24T02:12:04.753819+0000","last_became_peered":"2024-04-24T02:12:04.753819+0000","last_unstale":"2024-04-24T02:15:56.464554+0000","last_undegraded":"2024-04-24T02:15:56.464554+0000","last_fullsized":"2024-04-24T02:15:56.464554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-24T02:15:56.464457+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-24T02:15:56.464457+0000","last_clean_scrub_stamp":"2024-04-24T02:15:56.464457+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:34:20.051173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:06.433168+0000","last_change":"2024-04-24T02:16:06.433190+0000","last_active":"2024-04-24T02:16:06.433168+0000","last_peered":"2024-04-24T02:16:06.433168+0000","last_clean":"2024-04-24T02:16:06.433168+0000","last_became_active":"2024-04-24T02:12:02.743202+0000","last_became_peered":"2024-04-24T02:12:02.743202+0000","last_unstale":"2024-04-24T02:16:06.433168+0000","last_undegraded":"2024-04-24T02:16:06.433168+0000","last_fullsized":"2024-04-24T02:16:06.433168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:06.433087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:06.433087+0000","last_clean_scrub_stamp":"2024-04-24T02:16:06.433087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:59:51.749218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:41.008569+0000","last_change":"2024-04-24T02:15:41.008594+0000","last_active":"2024-04-24T02:15:41.008569+0000","last_peered":"2024-04-24T02:15:41.008569+0000","last_clean":"2024-04-24T02:15:41.008569+0000","last_became_active":"2024-04-24T02:12:06.765690+0000","last_became_peered":"2024-04-24T02:12:06.765690+0000","last_unstale":"2024-04-24T02:15:41.008569+0000","last_undegraded":"2024-04-24T02:15:41.008569+0000","last_fullsized":"2024-04-24T02:15:41.008569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:41.008462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:41.008462+0000","last_clean_scrub_stamp":"2024-04-24T02:15:41.008462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:55:16.490485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'45","reported_seq":106,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:36.400148+0000","last_change":"2024-04-24T02:15:36.400192+0000","last_active":"2024-04-24T02:15:36.400148+0000","last_peered":"2024-04-24T02:15:36.400148+0000","last_clean":"2024-04-24T02:15:36.400148+0000","last_became_active":"2024-04-24T02:12:08.779594+0000","last_became_peered":"2024-04-24T02:12:08.779594+0000","last_unstale":"2024-04-24T02:15:36.400148+0000","last_undegraded":"2024-04-24T02:15:36.400148+0000","last_fullsized":"2024-04-24T02:15:36.400148+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'45","last_scrub_stamp":"2024-04-24T02:15:36.400062+0000","last_deep_scrub":"32'45","last_deep_scrub_stamp":"2024-04-24T02:15:36.400062+0000","last_clean_scrub_stamp":"2024-04-24T02:15:36.400062+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:41:55.736741+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:35.000212+0000","last_change":"2024-04-24T02:15:35.000257+0000","last_active":"2024-04-24T02:15:35.000212+0000","last_peered":"2024-04-24T02:15:35.000212+0000","last_clean":"2024-04-24T02:15:35.000212+0000","last_became_active":"2024-04-24T02:12:10.784901+0000","last_became_peered":"2024-04-24T02:12:10.784901+0000","last_unstale":"2024-04-24T02:15:35.000212+0000","last_undegraded":"2024-04-24T02:15:35.000212+0000","last_fullsized":"2024-04-24T02:15:35.000212+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:35.000105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:35.000105+0000","last_clean_scrub_stamp":"2024-04-24T02:15:35.000105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:13:03.366315+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'6","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:50.476283+0000","last_change":"2024-04-24T02:15:50.476327+0000","last_active":"2024-04-24T02:15:50.476283+0000","last_peered":"2024-04-24T02:15:50.476283+0000","last_clean":"2024-04-24T02:15:50.476283+0000","last_became_active":"2024-04-24T02:12:12.795364+0000","last_became_peered":"2024-04-24T02:12:12.795364+0000","last_unstale":"2024-04-24T02:15:50.476283+0000","last_undegraded":"2024-04-24T02:15:50.476283+0000","last_fullsized":"2024-04-24T02:15:50.476283+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-24T02:15:50.476194+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-24T02:15:50.476194+0000","last_clean_scrub_stamp":"2024-04-24T02:15:50.476194+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:36.757574+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'8","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:58.385257+0000","last_change":"2024-04-24T02:15:58.385311+0000","last_active":"2024-04-24T02:15:58.385257+0000","last_peered":"2024-04-24T02:15:58.385257+0000","last_clean":"2024-04-24T02:15:58.385257+0000","last_became_active":"2024-04-24T02:12:04.762869+0000","last_became_peered":"2024-04-24T02:12:04.762869+0000","last_unstale":"2024-04-24T02:15:58.385257+0000","last_undegraded":"2024-04-24T02:15:58.385257+0000","last_fullsized":"2024-04-24T02:15:58.385257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-24T02:15:58.385121+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-24T02:15:58.385121+0000","last_clean_scrub_stamp":"2024-04-24T02:15:58.385121+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:34:35.847868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:20.039868+0000","last_change":"2024-04-24T02:12:02.758980+0000","last_active":"2024-04-24T02:14:20.039868+0000","last_peered":"2024-04-24T02:14:20.039868+0000","last_clean":"2024-04-24T02:14:20.039868+0000","last_became_active":"2024-04-24T02:12:02.757488+0000","last_became_peered":"2024-04-24T02:12:02.757488+0000","last_unstale":"2024-04-24T02:14:20.039868+0000","last_undegraded":"2024-04-24T02:14:20.039868+0000","last_fullsized":"2024-04-24T02:14:20.039868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:41.997895+0000","last_change":"2024-04-24T02:15:41.997919+0000","last_active":"2024-04-24T02:15:41.997895+0000","last_peered":"2024-04-24T02:15:41.997895+0000","last_clean":"2024-04-24T02:15:41.997895+0000","last_became_active":"2024-04-24T02:12:06.764339+0000","last_became_peered":"2024-04-24T02:12:06.764339+0000","last_unstale":"2024-04-24T02:15:41.997895+0000","last_undegraded":"2024-04-24T02:15:41.997895+0000","last_fullsized":"2024-04-24T02:15:41.997895+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:41.997807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:41.997807+0000","last_clean_scrub_stamp":"2024-04-24T02:15:41.997807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:41:46.258937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'60","reported_seq":130,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:55.225350+0000","last_change":"2024-04-24T02:15:55.225430+0000","last_active":"2024-04-24T02:15:55.225350+0000","last_peered":"2024-04-24T02:15:55.225350+0000","last_clean":"2024-04-24T02:15:55.225350+0000","last_became_active":"2024-04-24T02:12:08.780230+0000","last_became_peered":"2024-04-24T02:12:08.780230+0000","last_unstale":"2024-04-24T02:15:55.225350+0000","last_undegraded":"2024-04-24T02:15:55.225350+0000","last_fullsized":"2024-04-24T02:15:55.225350+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'60","last_scrub_stamp":"2024-04-24T02:15:55.225237+0000","last_deep_scrub":"32'60","last_deep_scrub_stamp":"2024-04-24T02:15:55.225237+0000","last_clean_scrub_stamp":"2024-04-24T02:15:55.225237+0000","objects_scrubbed":9,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:37:16.290694+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'285","reported_seq":409,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:31.050509+0000","last_change":"2024-04-24T02:15:31.050534+0000","last_active":"2024-04-24T02:15:31.050509+0000","last_peered":"2024-04-24T02:15:31.050509+0000","last_clean":"2024-04-24T02:15:31.050509+0000","last_became_active":"2024-04-24T02:12:10.784278+0000","last_became_peered":"2024-04-24T02:12:10.784278+0000","last_unstale":"2024-04-24T02:15:31.050509+0000","last_undegraded":"2024-04-24T02:15:31.050509+0000","last_fullsized":"2024-04-24T02:15:31.050509+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-24T02:15:31.050423+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-24T02:15:31.050423+0000","last_clean_scrub_stamp":"2024-04-24T02:15:31.050423+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:20:42.675691+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"32'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:20.089960+0000","last_change":"2024-04-24T02:16:20.089986+0000","last_active":"2024-04-24T02:16:20.089960+0000","last_peered":"2024-04-24T02:16:20.089960+0000","last_clean":"2024-04-24T02:16:20.089960+0000","last_became_active":"2024-04-24T02:12:12.792569+0000","last_became_peered":"2024-04-24T02:12:12.792569+0000","last_unstale":"2024-04-24T02:16:20.089960+0000","last_undegraded":"2024-04-24T02:16:20.089960+0000","last_fullsized":"2024-04-24T02:16:20.089960+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:16:20.089856+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:16:20.089856+0000","last_clean_scrub_stamp":"2024-04-24T02:16:20.089856+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:47:36.197137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'26","reported_seq":99,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:50.416940+0000","last_change":"2024-04-24T02:15:50.416966+0000","last_active":"2024-04-24T02:15:50.416940+0000","last_peered":"2024-04-24T02:15:50.416940+0000","last_clean":"2024-04-24T02:15:50.416940+0000","last_became_active":"2024-04-24T02:12:04.752075+0000","last_became_peered":"2024-04-24T02:12:04.752075+0000","last_unstale":"2024-04-24T02:15:50.416940+0000","last_undegraded":"2024-04-24T02:15:50.416940+0000","last_fullsized":"2024-04-24T02:15:50.416940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'26","last_scrub_stamp":"2024-04-24T02:15:50.416819+0000","last_deep_scrub":"32'26","last_deep_scrub_stamp":"2024-04-24T02:15:50.416819+0000","last_clean_scrub_stamp":"2024-04-24T02:15:50.416819+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:34:38.445893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":67,"num_write":30,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:20.039830+0000","last_change":"2024-04-24T02:12:02.755772+0000","last_active":"2024-04-24T02:14:20.039830+0000","last_peered":"2024-04-24T02:14:20.039830+0000","last_clean":"2024-04-24T02:14:20.039830+0000","last_became_active":"2024-04-24T02:12:02.755468+0000","last_became_peered":"2024-04-24T02:12:02.755468+0000","last_unstale":"2024-04-24T02:14:20.039830+0000","last_undegraded":"2024-04-24T02:14:20.039830+0000","last_fullsized":"2024-04-24T02:14:20.039830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:44.072962+0000","last_change":"2024-04-24T02:15:44.072993+0000","last_active":"2024-04-24T02:15:44.072962+0000","last_peered":"2024-04-24T02:15:44.072962+0000","last_clean":"2024-04-24T02:15:44.072962+0000","last_became_active":"2024-04-24T02:12:06.764365+0000","last_became_peered":"2024-04-24T02:12:06.764365+0000","last_unstale":"2024-04-24T02:15:44.072962+0000","last_undegraded":"2024-04-24T02:15:44.072962+0000","last_fullsized":"2024-04-24T02:15:44.072962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:44.072858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:44.072858+0000","last_clean_scrub_stamp":"2024-04-24T02:15:44.072858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:57:12.574588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'80","reported_seq":165,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:32.292008+0000","last_change":"2024-04-24T02:15:32.292044+0000","last_active":"2024-04-24T02:15:32.292008+0000","last_peered":"2024-04-24T02:15:32.292008+0000","last_clean":"2024-04-24T02:15:32.292008+0000","last_became_active":"2024-04-24T02:12:08.779602+0000","last_became_peered":"2024-04-24T02:12:08.779602+0000","last_unstale":"2024-04-24T02:15:32.292008+0000","last_undegraded":"2024-04-24T02:15:32.292008+0000","last_fullsized":"2024-04-24T02:15:32.292008+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'80","last_scrub_stamp":"2024-04-24T02:15:32.291896+0000","last_deep_scrub":"32'80","last_deep_scrub_stamp":"2024-04-24T02:15:32.291896+0000","last_clean_scrub_stamp":"2024-04-24T02:15:32.291896+0000","objects_scrubbed":7,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:08:35.878511+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:24.008603+0000","last_change":"2024-04-24T02:15:24.008622+0000","last_active":"2024-04-24T02:15:24.008603+0000","last_peered":"2024-04-24T02:15:24.008603+0000","last_clean":"2024-04-24T02:15:24.008603+0000","last_became_active":"2024-04-24T02:12:10.782121+0000","last_became_peered":"2024-04-24T02:12:10.782121+0000","last_unstale":"2024-04-24T02:15:24.008603+0000","last_undegraded":"2024-04-24T02:15:24.008603+0000","last_fullsized":"2024-04-24T02:15:24.008603+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:24.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:24.008533+0000","last_clean_scrub_stamp":"2024-04-24T02:15:24.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:46:49.817831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'21","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:43.025928+0000","last_change":"2024-04-24T02:15:43.025968+0000","last_active":"2024-04-24T02:15:43.025928+0000","last_peered":"2024-04-24T02:15:43.025928+0000","last_clean":"2024-04-24T02:15:43.025928+0000","last_became_active":"2024-04-24T02:12:12.789799+0000","last_became_peered":"2024-04-24T02:12:12.789799+0000","last_unstale":"2024-04-24T02:15:43.025928+0000","last_undegraded":"2024-04-24T02:15:43.025928+0000","last_fullsized":"2024-04-24T02:15:43.025928+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-04-24T02:15:43.025844+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-04-24T02:15:43.025844+0000","last_clean_scrub_stamp":"2024-04-24T02:15:43.025844+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:56:55.136630+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:48.475015+0000","last_change":"2024-04-24T02:15:48.475041+0000","last_active":"2024-04-24T02:15:48.475015+0000","last_peered":"2024-04-24T02:15:48.475015+0000","last_clean":"2024-04-24T02:15:48.475015+0000","last_became_active":"2024-04-24T02:12:04.766495+0000","last_became_peered":"2024-04-24T02:12:04.766495+0000","last_unstale":"2024-04-24T02:15:48.475015+0000","last_undegraded":"2024-04-24T02:15:48.475015+0000","last_fullsized":"2024-04-24T02:15:48.475015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:48.474931+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:48.474931+0000","last_clean_scrub_stamp":"2024-04-24T02:15:48.474931+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:51:50.070010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:16.107127+0000","last_change":"2024-04-24T02:16:16.107152+0000","last_active":"2024-04-24T02:16:16.107127+0000","last_peered":"2024-04-24T02:16:16.107127+0000","last_clean":"2024-04-24T02:16:16.107127+0000","last_became_active":"2024-04-24T02:12:02.743204+0000","last_became_peered":"2024-04-24T02:12:02.743204+0000","last_unstale":"2024-04-24T02:16:16.107127+0000","last_undegraded":"2024-04-24T02:16:16.107127+0000","last_fullsized":"2024-04-24T02:16:16.107127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:16.107037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:16.107037+0000","last_clean_scrub_stamp":"2024-04-24T02:16:16.107037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:31:36.700177+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:41.423724+0000","last_change":"2024-04-24T02:15:41.423774+0000","last_active":"2024-04-24T02:15:41.423724+0000","last_peered":"2024-04-24T02:15:41.423724+0000","last_clean":"2024-04-24T02:15:41.423724+0000","last_became_active":"2024-04-24T02:12:06.764676+0000","last_became_peered":"2024-04-24T02:12:06.764676+0000","last_unstale":"2024-04-24T02:15:41.423724+0000","last_undegraded":"2024-04-24T02:15:41.423724+0000","last_fullsized":"2024-04-24T02:15:41.423724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:41.423618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:41.423618+0000","last_clean_scrub_stamp":"2024-04-24T02:15:41.423618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:12:26.147935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'46","reported_seq":108,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:28.341944+0000","last_change":"2024-04-24T02:15:28.342006+0000","last_active":"2024-04-24T02:15:28.341944+0000","last_peered":"2024-04-24T02:15:28.341944+0000","last_clean":"2024-04-24T02:15:28.341944+0000","last_became_active":"2024-04-24T02:12:08.773355+0000","last_became_peered":"2024-04-24T02:12:08.773355+0000","last_unstale":"2024-04-24T02:15:28.341944+0000","last_undegraded":"2024-04-24T02:15:28.341944+0000","last_fullsized":"2024-04-24T02:15:28.341944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-04-24T02:15:28.341829+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-04-24T02:15:28.341829+0000","last_clean_scrub_stamp":"2024-04-24T02:15:28.341829+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:44:08.114105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:52.281612+0000","last_change":"2024-04-24T02:15:52.281641+0000","last_active":"2024-04-24T02:15:52.281612+0000","last_peered":"2024-04-24T02:15:52.281612+0000","last_clean":"2024-04-24T02:15:52.281612+0000","last_became_active":"2024-04-24T02:12:10.783334+0000","last_became_peered":"2024-04-24T02:12:10.783334+0000","last_unstale":"2024-04-24T02:15:52.281612+0000","last_undegraded":"2024-04-24T02:15:52.281612+0000","last_fullsized":"2024-04-24T02:15:52.281612+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:52.281509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:52.281509+0000","last_clean_scrub_stamp":"2024-04-24T02:15:52.281509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:49:37.879213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:24.222520+0000","last_change":"2024-04-24T02:12:12.794851+0000","last_active":"2024-04-24T02:15:24.222520+0000","last_peered":"2024-04-24T02:15:24.222520+0000","last_clean":"2024-04-24T02:15:24.222520+0000","last_became_active":"2024-04-24T02:12:12.794106+0000","last_became_peered":"2024-04-24T02:12:12.794106+0000","last_unstale":"2024-04-24T02:15:24.222520+0000","last_undegraded":"2024-04-24T02:15:24.222520+0000","last_fullsized":"2024-04-24T02:15:24.222520+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:39.410527+0000","last_change":"2024-04-24T02:15:39.410553+0000","last_active":"2024-04-24T02:15:39.410527+0000","last_peered":"2024-04-24T02:15:39.410527+0000","last_clean":"2024-04-24T02:15:39.410527+0000","last_became_active":"2024-04-24T02:12:04.767376+0000","last_became_peered":"2024-04-24T02:12:04.767376+0000","last_unstale":"2024-04-24T02:15:39.410527+0000","last_undegraded":"2024-04-24T02:15:39.410527+0000","last_fullsized":"2024-04-24T02:15:39.410527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:39.410442+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:39.410442+0000","last_clean_scrub_stamp":"2024-04-24T02:15:39.410442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:46:10.073188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:15.039035+0000","last_change":"2024-04-24T02:12:02.761147+0000","last_active":"2024-04-24T02:14:15.039035+0000","last_peered":"2024-04-24T02:14:15.039035+0000","last_clean":"2024-04-24T02:14:15.039035+0000","last_became_active":"2024-04-24T02:12:02.760317+0000","last_became_peered":"2024-04-24T02:12:02.760317+0000","last_unstale":"2024-04-24T02:14:15.039035+0000","last_undegraded":"2024-04-24T02:14:15.039035+0000","last_fullsized":"2024-04-24T02:14:15.039035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:16.633686+0000","last_change":"2024-04-24T02:16:16.633710+0000","last_active":"2024-04-24T02:16:16.633686+0000","last_peered":"2024-04-24T02:16:16.633686+0000","last_clean":"2024-04-24T02:16:16.633686+0000","last_became_active":"2024-04-24T02:12:45.811272+0000","last_became_peered":"2024-04-24T02:12:45.811272+0000","last_unstale":"2024-04-24T02:16:16.633686+0000","last_undegraded":"2024-04-24T02:16:16.633686+0000","last_fullsized":"2024-04-24T02:16:16.633686+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:16.633597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:16.633597+0000","last_clean_scrub_stamp":"2024-04-24T02:16:16.633597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:06:36.308100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"32'46","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:37.398289+0000","last_change":"2024-04-24T02:15:37.398336+0000","last_active":"2024-04-24T02:15:37.398289+0000","last_peered":"2024-04-24T02:15:37.398289+0000","last_clean":"2024-04-24T02:15:37.398289+0000","last_became_active":"2024-04-24T02:12:08.769307+0000","last_became_peered":"2024-04-24T02:12:08.769307+0000","last_unstale":"2024-04-24T02:15:37.398289+0000","last_undegraded":"2024-04-24T02:15:37.398289+0000","last_fullsized":"2024-04-24T02:15:37.398289+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-04-24T02:15:37.398209+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-04-24T02:15:37.398209+0000","last_clean_scrub_stamp":"2024-04-24T02:15:37.398209+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:44:17.170485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'285","reported_seq":415,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:29.489040+0000","last_change":"2024-04-24T02:15:29.489068+0000","last_active":"2024-04-24T02:15:29.489040+0000","last_peered":"2024-04-24T02:15:29.489040+0000","last_clean":"2024-04-24T02:15:29.489040+0000","last_became_active":"2024-04-24T02:12:10.778972+0000","last_became_peered":"2024-04-24T02:12:10.778972+0000","last_unstale":"2024-04-24T02:15:29.489040+0000","last_undegraded":"2024-04-24T02:15:29.489040+0000","last_fullsized":"2024-04-24T02:15:29.489040+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-24T02:15:29.488953+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-24T02:15:29.488953+0000","last_clean_scrub_stamp":"2024-04-24T02:15:29.488953+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:12:38.822890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'13","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:47.025859+0000","last_change":"2024-04-24T02:15:47.025859+0000","last_active":"2024-04-24T02:15:47.025859+0000","last_peered":"2024-04-24T02:15:47.025859+0000","last_clean":"2024-04-24T02:15:47.025859+0000","last_became_active":"2024-04-24T02:12:12.790353+0000","last_became_peered":"2024-04-24T02:12:12.790353+0000","last_unstale":"2024-04-24T02:15:47.025859+0000","last_undegraded":"2024-04-24T02:15:47.025859+0000","last_fullsized":"2024-04-24T02:15:47.025859+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'13","last_scrub_stamp":"2024-04-24T02:15:47.025741+0000","last_deep_scrub":"32'13","last_deep_scrub_stamp":"2024-04-24T02:15:47.025741+0000","last_clean_scrub_stamp":"2024-04-24T02:15:47.025741+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:19:56.625015+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'10","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:54.425745+0000","last_change":"2024-04-24T02:15:54.425801+0000","last_active":"2024-04-24T02:15:54.425745+0000","last_peered":"2024-04-24T02:15:54.425745+0000","last_clean":"2024-04-24T02:15:54.425745+0000","last_became_active":"2024-04-24T02:12:04.760020+0000","last_became_peered":"2024-04-24T02:12:04.760020+0000","last_unstale":"2024-04-24T02:15:54.425745+0000","last_undegraded":"2024-04-24T02:15:54.425745+0000","last_fullsized":"2024-04-24T02:15:54.425745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-24T02:15:54.425644+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-24T02:15:54.425644+0000","last_clean_scrub_stamp":"2024-04-24T02:15:54.425644+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:03:33.088095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:20.098422+0000","last_change":"2024-04-24T02:12:02.756829+0000","last_active":"2024-04-24T02:15:20.098422+0000","last_peered":"2024-04-24T02:15:20.098422+0000","last_clean":"2024-04-24T02:15:20.098422+0000","last_became_active":"2024-04-24T02:12:02.753593+0000","last_became_peered":"2024-04-24T02:12:02.753593+0000","last_unstale":"2024-04-24T02:15:20.098422+0000","last_undegraded":"2024-04-24T02:15:20.098422+0000","last_fullsized":"2024-04-24T02:15:20.098422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'5","reported_seq":428,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:37.435381+0000","last_change":"2024-04-24T02:15:37.435417+0000","last_active":"2024-04-24T02:15:37.435381+0000","last_peered":"2024-04-24T02:15:37.435381+0000","last_clean":"2024-04-24T02:15:37.435381+0000","last_became_active":"2024-04-24T02:12:06.758759+0000","last_became_peered":"2024-04-24T02:12:06.758759+0000","last_unstale":"2024-04-24T02:15:37.435381+0000","last_undegraded":"2024-04-24T02:15:37.435381+0000","last_fullsized":"2024-04-24T02:15:37.435381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-04-24T02:15:37.435273+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-04-24T02:15:37.435273+0000","last_clean_scrub_stamp":"2024-04-24T02:15:37.435273+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:57:22.943957+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'16","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:50.257195+0000","last_change":"2024-04-24T02:15:50.257229+0000","last_active":"2024-04-24T02:15:50.257195+0000","last_peered":"2024-04-24T02:15:50.257195+0000","last_clean":"2024-04-24T02:15:50.257195+0000","last_became_active":"2024-04-24T02:12:08.783011+0000","last_became_peered":"2024-04-24T02:12:08.783011+0000","last_unstale":"2024-04-24T02:15:50.257195+0000","last_undegraded":"2024-04-24T02:15:50.257195+0000","last_fullsized":"2024-04-24T02:15:50.257195+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-04-24T02:15:50.257112+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-04-24T02:15:50.257112+0000","last_clean_scrub_stamp":"2024-04-24T02:15:50.257112+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:22:29.994017+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'285","reported_seq":471,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:23.427909+0000","last_change":"2024-04-24T02:15:23.427935+0000","last_active":"2024-04-24T02:15:23.427909+0000","last_peered":"2024-04-24T02:15:23.427909+0000","last_clean":"2024-04-24T02:15:23.427909+0000","last_became_active":"2024-04-24T02:12:10.777222+0000","last_became_peered":"2024-04-24T02:12:10.777222+0000","last_unstale":"2024-04-24T02:15:23.427909+0000","last_undegraded":"2024-04-24T02:15:23.427909+0000","last_fullsized":"2024-04-24T02:15:23.427909+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-24T02:15:23.427820+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-24T02:15:23.427820+0000","last_clean_scrub_stamp":"2024-04-24T02:15:23.427820+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:37:31.031708+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:34.439628+0000","last_change":"2024-04-24T02:15:34.439653+0000","last_active":"2024-04-24T02:15:34.439628+0000","last_peered":"2024-04-24T02:15:34.439628+0000","last_clean":"2024-04-24T02:15:34.439628+0000","last_became_active":"2024-04-24T02:12:12.795204+0000","last_became_peered":"2024-04-24T02:12:12.795204+0000","last_unstale":"2024-04-24T02:15:34.439628+0000","last_undegraded":"2024-04-24T02:15:34.439628+0000","last_fullsized":"2024-04-24T02:15:34.439628+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:34.439501+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:34.439501+0000","last_clean_scrub_stamp":"2024-04-24T02:15:34.439501+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:22:10.202353+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:47.428543+0000","last_change":"2024-04-24T02:15:47.428572+0000","last_active":"2024-04-24T02:15:47.428543+0000","last_peered":"2024-04-24T02:15:47.428543+0000","last_clean":"2024-04-24T02:15:47.428543+0000","last_became_active":"2024-04-24T02:12:04.766540+0000","last_became_peered":"2024-04-24T02:12:04.766540+0000","last_unstale":"2024-04-24T02:15:47.428543+0000","last_undegraded":"2024-04-24T02:15:47.428543+0000","last_fullsized":"2024-04-24T02:15:47.428543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:47.428451+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:47.428451+0000","last_clean_scrub_stamp":"2024-04-24T02:15:47.428451+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:03:39.887590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:15.038911+0000","last_change":"2024-04-24T02:12:02.760628+0000","last_active":"2024-04-24T02:14:15.038911+0000","last_peered":"2024-04-24T02:14:15.038911+0000","last_clean":"2024-04-24T02:14:15.038911+0000","last_became_active":"2024-04-24T02:12:02.757717+0000","last_became_peered":"2024-04-24T02:12:02.757717+0000","last_unstale":"2024-04-24T02:14:15.038911+0000","last_undegraded":"2024-04-24T02:14:15.038911+0000","last_fullsized":"2024-04-24T02:14:15.038911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:25.340800+0000","last_change":"2024-04-24T02:15:25.340837+0000","last_active":"2024-04-24T02:15:25.340800+0000","last_peered":"2024-04-24T02:15:25.340800+0000","last_clean":"2024-04-24T02:15:25.340800+0000","last_became_active":"2024-04-24T02:12:06.758452+0000","last_became_peered":"2024-04-24T02:12:06.758452+0000","last_unstale":"2024-04-24T02:15:25.340800+0000","last_undegraded":"2024-04-24T02:15:25.340800+0000","last_fullsized":"2024-04-24T02:15:25.340800+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:25.340704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:25.340704+0000","last_clean_scrub_stamp":"2024-04-24T02:15:25.340704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:51:26.935783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'50","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:29.358708+0000","last_change":"2024-04-24T02:15:29.358770+0000","last_active":"2024-04-24T02:15:29.358708+0000","last_peered":"2024-04-24T02:15:29.358708+0000","last_clean":"2024-04-24T02:15:29.358708+0000","last_became_active":"2024-04-24T02:12:08.773319+0000","last_became_peered":"2024-04-24T02:12:08.773319+0000","last_unstale":"2024-04-24T02:15:29.358708+0000","last_undegraded":"2024-04-24T02:15:29.358708+0000","last_fullsized":"2024-04-24T02:15:29.358708+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'50","last_scrub_stamp":"2024-04-24T02:15:29.358602+0000","last_deep_scrub":"32'50","last_deep_scrub_stamp":"2024-04-24T02:15:29.358602+0000","last_clean_scrub_stamp":"2024-04-24T02:15:29.358602+0000","objects_scrubbed":8,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:42:17.124195+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":52,"num_read_kb":50,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:26.426941+0000","last_change":"2024-04-24T02:15:26.426964+0000","last_active":"2024-04-24T02:15:26.426941+0000","last_peered":"2024-04-24T02:15:26.426941+0000","last_clean":"2024-04-24T02:15:26.426941+0000","last_became_active":"2024-04-24T02:12:10.786998+0000","last_became_peered":"2024-04-24T02:12:10.786998+0000","last_unstale":"2024-04-24T02:15:26.426941+0000","last_undegraded":"2024-04-24T02:15:26.426941+0000","last_fullsized":"2024-04-24T02:15:26.426941+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:26.426853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:26.426853+0000","last_clean_scrub_stamp":"2024-04-24T02:15:26.426853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:33:27.255344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'6","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:42.419582+0000","last_change":"2024-04-24T02:15:42.419648+0000","last_active":"2024-04-24T02:15:42.419582+0000","last_peered":"2024-04-24T02:15:42.419582+0000","last_clean":"2024-04-24T02:15:42.419582+0000","last_became_active":"2024-04-24T02:12:12.793724+0000","last_became_peered":"2024-04-24T02:12:12.793724+0000","last_unstale":"2024-04-24T02:15:42.419582+0000","last_undegraded":"2024-04-24T02:15:42.419582+0000","last_fullsized":"2024-04-24T02:15:42.419582+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-24T02:15:42.419486+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-24T02:15:42.419486+0000","last_clean_scrub_stamp":"2024-04-24T02:15:42.419486+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:57:44.867375+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'4","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:02.059158+0000","last_change":"2024-04-24T02:16:02.059158+0000","last_active":"2024-04-24T02:16:02.059158+0000","last_peered":"2024-04-24T02:16:02.059158+0000","last_clean":"2024-04-24T02:16:02.059158+0000","last_became_active":"2024-04-24T02:12:04.763246+0000","last_became_peered":"2024-04-24T02:12:04.763246+0000","last_unstale":"2024-04-24T02:16:02.059158+0000","last_undegraded":"2024-04-24T02:16:02.059158+0000","last_fullsized":"2024-04-24T02:16:02.059158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:16:02.059045+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:16:02.059045+0000","last_clean_scrub_stamp":"2024-04-24T02:16:02.059045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:09:22.494946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"32'119","reported_seq":211,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:08.489843+0000","last_change":"2024-04-24T02:16:08.489878+0000","last_active":"2024-04-24T02:16:08.489843+0000","last_peered":"2024-04-24T02:16:08.489843+0000","last_clean":"2024-04-24T02:16:08.489843+0000","last_became_active":"2024-04-24T02:11:51.989479+0000","last_became_peered":"2024-04-24T02:11:51.989479+0000","last_unstale":"2024-04-24T02:16:08.489843+0000","last_undegraded":"2024-04-24T02:16:08.489843+0000","last_fullsized":"2024-04-24T02:16:08.489843+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2024-04-24T02:16:08.489759+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2024-04-24T02:16:08.489759+0000","last_clean_scrub_stamp":"2024-04-24T02:16:08.489759+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:35:08.296192+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:24.221060+0000","last_change":"2024-04-24T02:11:56.724372+0000","last_active":"2024-04-24T02:15:24.221060+0000","last_peered":"2024-04-24T02:15:24.221060+0000","last_clean":"2024-04-24T02:15:24.221060+0000","last_became_active":"2024-04-24T02:11:56.723925+0000","last_became_peered":"2024-04-24T02:11:56.723925+0000","last_unstale":"2024-04-24T02:15:24.221060+0000","last_undegraded":"2024-04-24T02:15:24.221060+0000","last_fullsized":"2024-04-24T02:15:24.221060+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:24.221090+0000","last_change":"2024-04-24T02:12:02.758997+0000","last_active":"2024-04-24T02:15:24.221090+0000","last_peered":"2024-04-24T02:15:24.221090+0000","last_clean":"2024-04-24T02:15:24.221090+0000","last_became_active":"2024-04-24T02:12:02.758653+0000","last_became_peered":"2024-04-24T02:12:02.758653+0000","last_unstale":"2024-04-24T02:15:24.221090+0000","last_undegraded":"2024-04-24T02:15:24.221090+0000","last_fullsized":"2024-04-24T02:15:24.221090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"32'2","reported_seq":231,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:40.433788+0000","last_change":"2024-04-24T02:15:40.433788+0000","last_active":"2024-04-24T02:15:40.433788+0000","last_peered":"2024-04-24T02:15:40.433788+0000","last_clean":"2024-04-24T02:15:40.433788+0000","last_became_active":"2024-04-24T02:12:06.757173+0000","last_became_peered":"2024-04-24T02:12:06.757173+0000","last_unstale":"2024-04-24T02:15:40.433788+0000","last_undegraded":"2024-04-24T02:15:40.433788+0000","last_fullsized":"2024-04-24T02:15:40.433788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:15:40.433600+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:15:40.433600+0000","last_clean_scrub_stamp":"2024-04-24T02:15:40.433600+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:15:32.722410+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'97","reported_seq":193,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:57.179496+0000","last_change":"2024-04-24T02:15:57.179565+0000","last_active":"2024-04-24T02:15:57.179496+0000","last_peered":"2024-04-24T02:15:57.179496+0000","last_clean":"2024-04-24T02:15:57.179496+0000","last_became_active":"2024-04-24T02:12:08.780923+0000","last_became_peered":"2024-04-24T02:12:08.780923+0000","last_unstale":"2024-04-24T02:15:57.179496+0000","last_undegraded":"2024-04-24T02:15:57.179496+0000","last_fullsized":"2024-04-24T02:15:57.179496+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'97","last_scrub_stamp":"2024-04-24T02:15:57.179395+0000","last_deep_scrub":"32'97","last_deep_scrub_stamp":"2024-04-24T02:15:57.179395+0000","last_clean_scrub_stamp":"2024-04-24T02:15:57.179395+0000","objects_scrubbed":6,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:43:51.704639+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:22.973891+0000","last_change":"2024-04-24T02:15:22.973909+0000","last_active":"2024-04-24T02:15:22.973891+0000","last_peered":"2024-04-24T02:15:22.973891+0000","last_clean":"2024-04-24T02:15:22.973891+0000","last_became_active":"2024-04-24T02:12:10.784101+0000","last_became_peered":"2024-04-24T02:12:10.784101+0000","last_unstale":"2024-04-24T02:15:22.973891+0000","last_undegraded":"2024-04-24T02:15:22.973891+0000","last_fullsized":"2024-04-24T02:15:22.973891+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:22.973820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:22.973820+0000","last_clean_scrub_stamp":"2024-04-24T02:15:22.973820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:09:23.273019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'81","reported_seq":171,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:38.392097+0000","last_change":"2024-04-24T02:15:38.392125+0000","last_active":"2024-04-24T02:15:38.392097+0000","last_peered":"2024-04-24T02:15:38.392097+0000","last_clean":"2024-04-24T02:15:38.392097+0000","last_became_active":"2024-04-24T02:12:12.795281+0000","last_became_peered":"2024-04-24T02:12:12.795281+0000","last_unstale":"2024-04-24T02:15:38.392097+0000","last_undegraded":"2024-04-24T02:15:38.392097+0000","last_fullsized":"2024-04-24T02:15:38.392097+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'81","last_scrub_stamp":"2024-04-24T02:15:38.392009+0000","last_deep_scrub":"32'81","last_deep_scrub_stamp":"2024-04-24T02:15:38.392009+0000","last_clean_scrub_stamp":"2024-04-24T02:15:38.392009+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:42:26.157602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:03.023346+0000","last_change":"2024-04-24T02:16:03.023374+0000","last_active":"2024-04-24T02:16:03.023346+0000","last_peered":"2024-04-24T02:16:03.023346+0000","last_clean":"2024-04-24T02:16:03.023346+0000","last_became_active":"2024-04-24T02:12:04.763782+0000","last_became_peered":"2024-04-24T02:12:04.763782+0000","last_unstale":"2024-04-24T02:16:03.023346+0000","last_undegraded":"2024-04-24T02:16:03.023346+0000","last_fullsized":"2024-04-24T02:16:03.023346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-24T02:16:03.023245+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-24T02:16:03.023245+0000","last_clean_scrub_stamp":"2024-04-24T02:16:03.023245+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:51:33.505831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:24.221044+0000","last_change":"2024-04-24T02:11:56.724008+0000","last_active":"2024-04-24T02:15:24.221044+0000","last_peered":"2024-04-24T02:15:24.221044+0000","last_clean":"2024-04-24T02:15:24.221044+0000","last_became_active":"2024-04-24T02:11:56.723682+0000","last_became_peered":"2024-04-24T02:11:56.723682+0000","last_unstale":"2024-04-24T02:15:24.221044+0000","last_undegraded":"2024-04-24T02:15:24.221044+0000","last_fullsized":"2024-04-24T02:15:24.221044+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"30'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:14.122870+0000","last_change":"2024-04-24T02:16:14.122898+0000","last_active":"2024-04-24T02:16:14.122870+0000","last_peered":"2024-04-24T02:16:14.122870+0000","last_clean":"2024-04-24T02:16:14.122870+0000","last_became_active":"2024-04-24T02:12:02.741610+0000","last_became_peered":"2024-04-24T02:12:02.741610+0000","last_unstale":"2024-04-24T02:16:14.122870+0000","last_undegraded":"2024-04-24T02:16:14.122870+0000","last_fullsized":"2024-04-24T02:16:14.122870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-24T02:16:14.122778+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-24T02:16:14.122778+0000","last_clean_scrub_stamp":"2024-04-24T02:16:14.122778+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:48:58.800845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:29.348600+0000","last_change":"2024-04-24T02:15:29.348651+0000","last_active":"2024-04-24T02:15:29.348600+0000","last_peered":"2024-04-24T02:15:29.348600+0000","last_clean":"2024-04-24T02:15:29.348600+0000","last_became_active":"2024-04-24T02:12:06.757052+0000","last_became_peered":"2024-04-24T02:12:06.757052+0000","last_unstale":"2024-04-24T02:15:29.348600+0000","last_undegraded":"2024-04-24T02:15:29.348600+0000","last_fullsized":"2024-04-24T02:15:29.348600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:29.348489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:29.348489+0000","last_clean_scrub_stamp":"2024-04-24T02:15:29.348489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:42:27.569911+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'298","reported_seq":530,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:25.387698+0000","last_change":"2024-04-24T02:15:25.387698+0000","last_active":"2024-04-24T02:15:25.387698+0000","last_peered":"2024-04-24T02:15:25.387698+0000","last_clean":"2024-04-24T02:15:25.387698+0000","last_became_active":"2024-04-24T02:12:08.779884+0000","last_became_peered":"2024-04-24T02:12:08.779884+0000","last_unstale":"2024-04-24T02:15:25.387698+0000","last_undegraded":"2024-04-24T02:15:25.387698+0000","last_fullsized":"2024-04-24T02:15:25.387698+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'298","last_scrub_stamp":"2024-04-24T02:15:25.387551+0000","last_deep_scrub":"32'298","last_deep_scrub_stamp":"2024-04-24T02:15:25.387551+0000","last_clean_scrub_stamp":"2024-04-24T02:15:25.387551+0000","objects_scrubbed":11,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:22:01.150403+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:48.289647+0000","last_change":"2024-04-24T02:15:48.289647+0000","last_active":"2024-04-24T02:15:48.289647+0000","last_peered":"2024-04-24T02:15:48.289647+0000","last_clean":"2024-04-24T02:15:48.289647+0000","last_became_active":"2024-04-24T02:12:10.783788+0000","last_became_peered":"2024-04-24T02:12:10.783788+0000","last_unstale":"2024-04-24T02:15:48.289647+0000","last_undegraded":"2024-04-24T02:15:48.289647+0000","last_fullsized":"2024-04-24T02:15:48.289647+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:48.289533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:48.289533+0000","last_clean_scrub_stamp":"2024-04-24T02:15:48.289533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:38:32.091995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:17.354403+0000","last_change":"2024-04-24T02:16:17.354428+0000","last_active":"2024-04-24T02:16:17.354403+0000","last_peered":"2024-04-24T02:16:17.354403+0000","last_clean":"2024-04-24T02:16:17.354403+0000","last_became_active":"2024-04-24T02:12:12.795983+0000","last_became_peered":"2024-04-24T02:12:12.795983+0000","last_unstale":"2024-04-24T02:16:17.354403+0000","last_undegraded":"2024-04-24T02:16:17.354403+0000","last_fullsized":"2024-04-24T02:16:17.354403+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-04-24T02:16:17.354318+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-04-24T02:16:17.354318+0000","last_clean_scrub_stamp":"2024-04-24T02:16:17.354318+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:55:36.541244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'22","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:03.109215+0000","last_change":"2024-04-24T02:16:03.109255+0000","last_active":"2024-04-24T02:16:03.109215+0000","last_peered":"2024-04-24T02:16:03.109215+0000","last_clean":"2024-04-24T02:16:03.109215+0000","last_became_active":"2024-04-24T02:12:04.755649+0000","last_became_peered":"2024-04-24T02:12:04.755649+0000","last_unstale":"2024-04-24T02:16:03.109215+0000","last_undegraded":"2024-04-24T02:16:03.109215+0000","last_fullsized":"2024-04-24T02:16:03.109215+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-04-24T02:16:03.109129+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-04-24T02:16:03.109129+0000","last_clean_scrub_stamp":"2024-04-24T02:16:03.109129+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:48:56.829580+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":72,"num_write":29,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:04.417966+0000","last_change":"2024-04-24T02:16:04.417966+0000","last_active":"2024-04-24T02:16:04.417966+0000","last_peered":"2024-04-24T02:16:04.417966+0000","last_clean":"2024-04-24T02:16:04.417966+0000","last_became_active":"2024-04-24T02:11:56.723497+0000","last_became_peered":"2024-04-24T02:11:56.723497+0000","last_unstale":"2024-04-24T02:16:04.417966+0000","last_undegraded":"2024-04-24T02:16:04.417966+0000","last_fullsized":"2024-04-24T02:16:04.417966+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:04.417852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:04.417852+0000","last_clean_scrub_stamp":"2024-04-24T02:16:04.417852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:09:08.004466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:08.119846+0000","last_change":"2024-04-24T02:16:08.119873+0000","last_active":"2024-04-24T02:16:08.119846+0000","last_peered":"2024-04-24T02:16:08.119846+0000","last_clean":"2024-04-24T02:16:08.119846+0000","last_became_active":"2024-04-24T02:12:02.745238+0000","last_became_peered":"2024-04-24T02:12:02.745238+0000","last_unstale":"2024-04-24T02:16:08.119846+0000","last_undegraded":"2024-04-24T02:16:08.119846+0000","last_fullsized":"2024-04-24T02:16:08.119846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:16:08.119755+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:16:08.119755+0000","last_clean_scrub_stamp":"2024-04-24T02:16:08.119755+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:39:50.616597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:45.477994+0000","last_change":"2024-04-24T02:15:45.478024+0000","last_active":"2024-04-24T02:15:45.477994+0000","last_peered":"2024-04-24T02:15:45.477994+0000","last_clean":"2024-04-24T02:15:45.477994+0000","last_became_active":"2024-04-24T02:12:06.757009+0000","last_became_peered":"2024-04-24T02:12:06.757009+0000","last_unstale":"2024-04-24T02:15:45.477994+0000","last_undegraded":"2024-04-24T02:15:45.477994+0000","last_fullsized":"2024-04-24T02:15:45.477994+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:15:45.477913+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:15:45.477913+0000","last_clean_scrub_stamp":"2024-04-24T02:15:45.477913+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:36:40.614952+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'23","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:35.426698+0000","last_change":"2024-04-24T02:15:35.426698+0000","last_active":"2024-04-24T02:15:35.426698+0000","last_peered":"2024-04-24T02:15:35.426698+0000","last_clean":"2024-04-24T02:15:35.426698+0000","last_became_active":"2024-04-24T02:12:08.774177+0000","last_became_peered":"2024-04-24T02:12:08.774177+0000","last_unstale":"2024-04-24T02:15:35.426698+0000","last_undegraded":"2024-04-24T02:15:35.426698+0000","last_fullsized":"2024-04-24T02:15:35.426698+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2024-04-24T02:15:35.426543+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2024-04-24T02:15:35.426543+0000","last_clean_scrub_stamp":"2024-04-24T02:15:35.426543+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:20:39.513825+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:27.053503+0000","last_change":"2024-04-24T02:15:27.053503+0000","last_active":"2024-04-24T02:15:27.053503+0000","last_peered":"2024-04-24T02:15:27.053503+0000","last_clean":"2024-04-24T02:15:27.053503+0000","last_became_active":"2024-04-24T02:12:10.784247+0000","last_became_peered":"2024-04-24T02:12:10.784247+0000","last_unstale":"2024-04-24T02:15:27.053503+0000","last_undegraded":"2024-04-24T02:15:27.053503+0000","last_fullsized":"2024-04-24T02:15:27.053503+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:27.053381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:27.053381+0000","last_clean_scrub_stamp":"2024-04-24T02:15:27.053381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:58:59.706713+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:30.041437+0000","last_change":"2024-04-24T02:12:12.794755+0000","last_active":"2024-04-24T02:14:30.041437+0000","last_peered":"2024-04-24T02:14:30.041437+0000","last_clean":"2024-04-24T02:14:30.041437+0000","last_became_active":"2024-04-24T02:12:12.794453+0000","last_became_peered":"2024-04-24T02:12:12.794453+0000","last_unstale":"2024-04-24T02:14:30.041437+0000","last_undegraded":"2024-04-24T02:14:30.041437+0000","last_fullsized":"2024-04-24T02:14:30.041437+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:53.131001+0000","last_change":"2024-04-24T02:15:53.131001+0000","last_active":"2024-04-24T02:15:53.131001+0000","last_peered":"2024-04-24T02:15:53.131001+0000","last_clean":"2024-04-24T02:15:53.131001+0000","last_became_active":"2024-04-24T02:12:04.749173+0000","last_became_peered":"2024-04-24T02:12:04.749173+0000","last_unstale":"2024-04-24T02:15:53.131001+0000","last_undegraded":"2024-04-24T02:15:53.131001+0000","last_fullsized":"2024-04-24T02:15:53.131001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:53.130876+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:53.130876+0000","last_clean_scrub_stamp":"2024-04-24T02:15:53.130876+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:46:26.214015+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:24.221051+0000","last_change":"2024-04-24T02:11:56.723425+0000","last_active":"2024-04-24T02:15:24.221051+0000","last_peered":"2024-04-24T02:15:24.221051+0000","last_clean":"2024-04-24T02:15:24.221051+0000","last_became_active":"2024-04-24T02:11:56.723125+0000","last_became_peered":"2024-04-24T02:11:56.723125+0000","last_unstale":"2024-04-24T02:15:24.221051+0000","last_undegraded":"2024-04-24T02:15:24.221051+0000","last_fullsized":"2024-04-24T02:15:24.221051+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:08.463784+0000","last_change":"2024-04-24T02:16:08.463784+0000","last_active":"2024-04-24T02:16:08.463784+0000","last_peered":"2024-04-24T02:16:08.463784+0000","last_clean":"2024-04-24T02:16:08.463784+0000","last_became_active":"2024-04-24T02:12:02.746682+0000","last_became_peered":"2024-04-24T02:12:02.746682+0000","last_unstale":"2024-04-24T02:16:08.463784+0000","last_undegraded":"2024-04-24T02:16:08.463784+0000","last_fullsized":"2024-04-24T02:16:08.463784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:08.463630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:08.463630+0000","last_clean_scrub_stamp":"2024-04-24T02:16:08.463630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:42:27.800308+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:45.033384+0000","last_change":"2024-04-24T02:15:45.033384+0000","last_active":"2024-04-24T02:15:45.033384+0000","last_peered":"2024-04-24T02:15:45.033384+0000","last_clean":"2024-04-24T02:15:45.033384+0000","last_became_active":"2024-04-24T02:12:06.759169+0000","last_became_peered":"2024-04-24T02:12:06.759169+0000","last_unstale":"2024-04-24T02:15:45.033384+0000","last_undegraded":"2024-04-24T02:15:45.033384+0000","last_fullsized":"2024-04-24T02:15:45.033384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:45.033265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:45.033265+0000","last_clean_scrub_stamp":"2024-04-24T02:15:45.033265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:08:16.728687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'20","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:51.254222+0000","last_change":"2024-04-24T02:15:51.254261+0000","last_active":"2024-04-24T02:15:51.254222+0000","last_peered":"2024-04-24T02:15:51.254222+0000","last_clean":"2024-04-24T02:15:51.254222+0000","last_became_active":"2024-04-24T02:12:08.782765+0000","last_became_peered":"2024-04-24T02:12:08.782765+0000","last_unstale":"2024-04-24T02:15:51.254222+0000","last_undegraded":"2024-04-24T02:15:51.254222+0000","last_fullsized":"2024-04-24T02:15:51.254222+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-04-24T02:15:51.254102+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-04-24T02:15:51.254102+0000","last_clean_scrub_stamp":"2024-04-24T02:15:51.254102+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:26:37.436707+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:56.210447+0000","last_change":"2024-04-24T02:15:56.210473+0000","last_active":"2024-04-24T02:15:56.210447+0000","last_peered":"2024-04-24T02:15:56.210447+0000","last_clean":"2024-04-24T02:15:56.210447+0000","last_became_active":"2024-04-24T02:12:10.783813+0000","last_became_peered":"2024-04-24T02:12:10.783813+0000","last_unstale":"2024-04-24T02:15:56.210447+0000","last_undegraded":"2024-04-24T02:15:56.210447+0000","last_fullsized":"2024-04-24T02:15:56.210447+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:56.210358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:56.210358+0000","last_clean_scrub_stamp":"2024-04-24T02:15:56.210358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:46:40.354519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:19.411319+0000","last_change":"2024-04-24T02:16:19.411350+0000","last_active":"2024-04-24T02:16:19.411319+0000","last_peered":"2024-04-24T02:16:19.411319+0000","last_clean":"2024-04-24T02:16:19.411319+0000","last_became_active":"2024-04-24T02:12:12.796507+0000","last_became_peered":"2024-04-24T02:12:12.796507+0000","last_unstale":"2024-04-24T02:16:19.411319+0000","last_undegraded":"2024-04-24T02:16:19.411319+0000","last_fullsized":"2024-04-24T02:16:19.411319+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:16:19.411223+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:16:19.411223+0000","last_clean_scrub_stamp":"2024-04-24T02:16:19.411223+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:47:03.555384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:44.357865+0000","last_change":"2024-04-24T02:15:44.357865+0000","last_active":"2024-04-24T02:15:44.357865+0000","last_peered":"2024-04-24T02:15:44.357865+0000","last_clean":"2024-04-24T02:15:44.357865+0000","last_became_active":"2024-04-24T02:12:04.767221+0000","last_became_peered":"2024-04-24T02:12:04.767221+0000","last_unstale":"2024-04-24T02:15:44.357865+0000","last_undegraded":"2024-04-24T02:15:44.357865+0000","last_fullsized":"2024-04-24T02:15:44.357865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:44.357687+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:44.357687+0000","last_clean_scrub_stamp":"2024-04-24T02:15:44.357687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:44:16.884604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:09.511028+0000","last_change":"2024-04-24T02:16:09.511028+0000","last_active":"2024-04-24T02:16:09.511028+0000","last_peered":"2024-04-24T02:16:09.511028+0000","last_clean":"2024-04-24T02:16:09.511028+0000","last_became_active":"2024-04-24T02:12:02.744161+0000","last_became_peered":"2024-04-24T02:12:02.744161+0000","last_unstale":"2024-04-24T02:16:09.511028+0000","last_undegraded":"2024-04-24T02:16:09.511028+0000","last_fullsized":"2024-04-24T02:16:09.511028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:09.510908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:09.510908+0000","last_clean_scrub_stamp":"2024-04-24T02:16:09.510908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:10:49.112570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:10.053515+0000","last_change":"2024-04-24T02:16:10.053540+0000","last_active":"2024-04-24T02:16:10.053515+0000","last_peered":"2024-04-24T02:16:10.053515+0000","last_clean":"2024-04-24T02:16:10.053515+0000","last_became_active":"2024-04-24T02:11:56.723697+0000","last_became_peered":"2024-04-24T02:11:56.723697+0000","last_unstale":"2024-04-24T02:16:10.053515+0000","last_undegraded":"2024-04-24T02:16:10.053515+0000","last_fullsized":"2024-04-24T02:16:10.053515+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:10.053432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:10.053432+0000","last_clean_scrub_stamp":"2024-04-24T02:16:10.053432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:38:15.927351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:45.989705+0000","last_change":"2024-04-24T02:15:45.989705+0000","last_active":"2024-04-24T02:15:45.989705+0000","last_peered":"2024-04-24T02:15:45.989705+0000","last_clean":"2024-04-24T02:15:45.989705+0000","last_became_active":"2024-04-24T02:12:06.759160+0000","last_became_peered":"2024-04-24T02:12:06.759160+0000","last_unstale":"2024-04-24T02:15:45.989705+0000","last_undegraded":"2024-04-24T02:15:45.989705+0000","last_fullsized":"2024-04-24T02:15:45.989705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:15:45.989545+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:15:45.989545+0000","last_clean_scrub_stamp":"2024-04-24T02:15:45.989545+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:56:06.540361+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'87","reported_seq":176,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:33.030400+0000","last_change":"2024-04-24T02:15:33.030400+0000","last_active":"2024-04-24T02:15:33.030400+0000","last_peered":"2024-04-24T02:15:33.030400+0000","last_clean":"2024-04-24T02:15:33.030400+0000","last_became_active":"2024-04-24T02:12:08.780688+0000","last_became_peered":"2024-04-24T02:12:08.780688+0000","last_unstale":"2024-04-24T02:15:33.030400+0000","last_undegraded":"2024-04-24T02:15:33.030400+0000","last_fullsized":"2024-04-24T02:15:33.030400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'87","last_scrub_stamp":"2024-04-24T02:15:33.030249+0000","last_deep_scrub":"32'87","last_deep_scrub_stamp":"2024-04-24T02:15:33.030249+0000","last_clean_scrub_stamp":"2024-04-24T02:15:33.030249+0000","objects_scrubbed":11,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:20:07.673923+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":89,"num_read_kb":75,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:25.419767+0000","last_change":"2024-04-24T02:15:25.419767+0000","last_active":"2024-04-24T02:15:25.419767+0000","last_peered":"2024-04-24T02:15:25.419767+0000","last_clean":"2024-04-24T02:15:25.419767+0000","last_became_active":"2024-04-24T02:12:10.781586+0000","last_became_peered":"2024-04-24T02:12:10.781586+0000","last_unstale":"2024-04-24T02:15:25.419767+0000","last_undegraded":"2024-04-24T02:15:25.419767+0000","last_fullsized":"2024-04-24T02:15:25.419767+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:25.419637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:25.419637+0000","last_clean_scrub_stamp":"2024-04-24T02:15:25.419637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:41:52.572498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'9","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:22.072176+0000","last_change":"2024-04-24T02:16:22.072224+0000","last_active":"2024-04-24T02:16:22.072176+0000","last_peered":"2024-04-24T02:16:22.072176+0000","last_clean":"2024-04-24T02:16:22.072176+0000","last_became_active":"2024-04-24T02:12:12.798272+0000","last_became_peered":"2024-04-24T02:12:12.798272+0000","last_unstale":"2024-04-24T02:16:22.072176+0000","last_undegraded":"2024-04-24T02:16:22.072176+0000","last_fullsized":"2024-04-24T02:16:22.072176+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-24T02:16:22.072073+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-24T02:16:22.072073+0000","last_clean_scrub_stamp":"2024-04-24T02:16:22.072073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:04:34.957697+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'6","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:51.465160+0000","last_change":"2024-04-24T02:15:51.465160+0000","last_active":"2024-04-24T02:15:51.465160+0000","last_peered":"2024-04-24T02:15:51.465160+0000","last_clean":"2024-04-24T02:15:51.465160+0000","last_became_active":"2024-04-24T02:12:04.765093+0000","last_became_peered":"2024-04-24T02:12:04.765093+0000","last_unstale":"2024-04-24T02:15:51.465160+0000","last_undegraded":"2024-04-24T02:15:51.465160+0000","last_fullsized":"2024-04-24T02:15:51.465160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-24T02:15:51.465043+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-24T02:15:51.465043+0000","last_clean_scrub_stamp":"2024-04-24T02:15:51.465043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:49:04.615334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:13.104282+0000","last_change":"2024-04-24T02:16:13.104305+0000","last_active":"2024-04-24T02:16:13.104282+0000","last_peered":"2024-04-24T02:16:13.104282+0000","last_clean":"2024-04-24T02:16:13.104282+0000","last_became_active":"2024-04-24T02:12:02.741565+0000","last_became_peered":"2024-04-24T02:12:02.741565+0000","last_unstale":"2024-04-24T02:16:13.104282+0000","last_undegraded":"2024-04-24T02:16:13.104282+0000","last_fullsized":"2024-04-24T02:16:13.104282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:13.104195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:13.104195+0000","last_clean_scrub_stamp":"2024-04-24T02:16:13.104195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:58.546027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:24.221053+0000","last_change":"2024-04-24T02:11:56.724046+0000","last_active":"2024-04-24T02:15:24.221053+0000","last_peered":"2024-04-24T02:15:24.221053+0000","last_clean":"2024-04-24T02:15:24.221053+0000","last_became_active":"2024-04-24T02:11:56.723673+0000","last_became_peered":"2024-04-24T02:11:56.723673+0000","last_unstale":"2024-04-24T02:15:24.221053+0000","last_undegraded":"2024-04-24T02:15:24.221053+0000","last_fullsized":"2024-04-24T02:15:24.221053+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:31.335580+0000","last_change":"2024-04-24T02:15:31.335580+0000","last_active":"2024-04-24T02:15:31.335580+0000","last_peered":"2024-04-24T02:15:31.335580+0000","last_clean":"2024-04-24T02:15:31.335580+0000","last_became_active":"2024-04-24T02:12:06.755760+0000","last_became_peered":"2024-04-24T02:12:06.755760+0000","last_unstale":"2024-04-24T02:15:31.335580+0000","last_undegraded":"2024-04-24T02:15:31.335580+0000","last_fullsized":"2024-04-24T02:15:31.335580+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:31.335458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:31.335458+0000","last_clean_scrub_stamp":"2024-04-24T02:15:31.335458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:15:39.406302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'28","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:27.368863+0000","last_change":"2024-04-24T02:15:27.368863+0000","last_active":"2024-04-24T02:15:27.368863+0000","last_peered":"2024-04-24T02:15:27.368863+0000","last_clean":"2024-04-24T02:15:27.368863+0000","last_became_active":"2024-04-24T02:12:08.779698+0000","last_became_peered":"2024-04-24T02:12:08.779698+0000","last_unstale":"2024-04-24T02:15:27.368863+0000","last_undegraded":"2024-04-24T02:15:27.368863+0000","last_fullsized":"2024-04-24T02:15:27.368863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'28","last_scrub_stamp":"2024-04-24T02:15:27.368732+0000","last_deep_scrub":"32'28","last_deep_scrub_stamp":"2024-04-24T02:15:27.368732+0000","last_clean_scrub_stamp":"2024-04-24T02:15:27.368732+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:51:46.023041+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'285","reported_seq":359,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:30.318523+0000","last_change":"2024-04-24T02:15:30.318523+0000","last_active":"2024-04-24T02:15:30.318523+0000","last_peered":"2024-04-24T02:15:30.318523+0000","last_clean":"2024-04-24T02:15:30.318523+0000","last_became_active":"2024-04-24T02:12:10.781799+0000","last_became_peered":"2024-04-24T02:12:10.781799+0000","last_unstale":"2024-04-24T02:15:30.318523+0000","last_undegraded":"2024-04-24T02:15:30.318523+0000","last_fullsized":"2024-04-24T02:15:30.318523+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-24T02:15:30.318394+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-24T02:15:30.318394+0000","last_clean_scrub_stamp":"2024-04-24T02:15:30.318394+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:55:07.242675+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'2","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:15.994766+0000","last_change":"2024-04-24T02:16:15.994793+0000","last_active":"2024-04-24T02:16:15.994766+0000","last_peered":"2024-04-24T02:16:15.994766+0000","last_clean":"2024-04-24T02:16:15.994766+0000","last_became_active":"2024-04-24T02:12:12.792628+0000","last_became_peered":"2024-04-24T02:12:12.792628+0000","last_unstale":"2024-04-24T02:16:15.994766+0000","last_undegraded":"2024-04-24T02:16:15.994766+0000","last_fullsized":"2024-04-24T02:16:15.994766+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:16:15.994673+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:16:15.994673+0000","last_clean_scrub_stamp":"2024-04-24T02:16:15.994673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:11:12.521455+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'19","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:37.364765+0000","last_change":"2024-04-24T02:15:37.364765+0000","last_active":"2024-04-24T02:15:37.364765+0000","last_peered":"2024-04-24T02:15:37.364765+0000","last_clean":"2024-04-24T02:15:37.364765+0000","last_became_active":"2024-04-24T02:12:04.768066+0000","last_became_peered":"2024-04-24T02:12:04.768066+0000","last_unstale":"2024-04-24T02:15:37.364765+0000","last_undegraded":"2024-04-24T02:15:37.364765+0000","last_fullsized":"2024-04-24T02:15:37.364765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'19","last_scrub_stamp":"2024-04-24T02:15:37.364597+0000","last_deep_scrub":"32'19","last_deep_scrub_stamp":"2024-04-24T02:15:37.364597+0000","last_clean_scrub_stamp":"2024-04-24T02:15:37.364597+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:10:16.966259+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":70,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:15.039147+0000","last_change":"2024-04-24T02:12:02.761644+0000","last_active":"2024-04-24T02:14:15.039147+0000","last_peered":"2024-04-24T02:14:15.039147+0000","last_clean":"2024-04-24T02:14:15.039147+0000","last_became_active":"2024-04-24T02:12:02.760824+0000","last_became_peered":"2024-04-24T02:12:02.760824+0000","last_unstale":"2024-04-24T02:14:15.039147+0000","last_undegraded":"2024-04-24T02:14:15.039147+0000","last_fullsized":"2024-04-24T02:14:15.039147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:09.079679+0000","last_change":"2024-04-24T02:16:09.079679+0000","last_active":"2024-04-24T02:16:09.079679+0000","last_peered":"2024-04-24T02:16:09.079679+0000","last_clean":"2024-04-24T02:16:09.079679+0000","last_became_active":"2024-04-24T02:11:56.723277+0000","last_became_peered":"2024-04-24T02:11:56.723277+0000","last_unstale":"2024-04-24T02:16:09.079679+0000","last_undegraded":"2024-04-24T02:16:09.079679+0000","last_fullsized":"2024-04-24T02:16:09.079679+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:09.079531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:09.079531+0000","last_clean_scrub_stamp":"2024-04-24T02:16:09.079531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:25:33.117562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:33.324119+0000","last_change":"2024-04-24T02:15:33.324119+0000","last_active":"2024-04-24T02:15:33.324119+0000","last_peered":"2024-04-24T02:15:33.324119+0000","last_clean":"2024-04-24T02:15:33.324119+0000","last_became_active":"2024-04-24T02:12:06.754414+0000","last_became_peered":"2024-04-24T02:12:06.754414+0000","last_unstale":"2024-04-24T02:15:33.324119+0000","last_undegraded":"2024-04-24T02:15:33.324119+0000","last_fullsized":"2024-04-24T02:15:33.324119+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:33.324008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:33.324008+0000","last_clean_scrub_stamp":"2024-04-24T02:15:33.324008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:33:56.910723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'23","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:38.410200+0000","last_change":"2024-04-24T02:15:38.410200+0000","last_active":"2024-04-24T02:15:38.410200+0000","last_peered":"2024-04-24T02:15:38.410200+0000","last_clean":"2024-04-24T02:15:38.410200+0000","last_became_active":"2024-04-24T02:12:08.779937+0000","last_became_peered":"2024-04-24T02:12:08.779937+0000","last_unstale":"2024-04-24T02:15:38.410200+0000","last_undegraded":"2024-04-24T02:15:38.410200+0000","last_fullsized":"2024-04-24T02:15:38.410200+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2024-04-24T02:15:38.410066+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2024-04-24T02:15:38.410066+0000","last_clean_scrub_stamp":"2024-04-24T02:15:38.410066+0000","objects_scrubbed":6,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:27:43.655638+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'285","reported_seq":402,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:30.014117+0000","last_change":"2024-04-24T02:15:30.014117+0000","last_active":"2024-04-24T02:15:30.014117+0000","last_peered":"2024-04-24T02:15:30.014117+0000","last_clean":"2024-04-24T02:15:30.014117+0000","last_became_active":"2024-04-24T02:12:10.776594+0000","last_became_peered":"2024-04-24T02:12:10.776594+0000","last_unstale":"2024-04-24T02:15:30.014117+0000","last_undegraded":"2024-04-24T02:15:30.014117+0000","last_fullsized":"2024-04-24T02:15:30.014117+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-24T02:15:30.013989+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-24T02:15:30.013989+0000","last_clean_scrub_stamp":"2024-04-24T02:15:30.013989+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:47:15.601895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:46.394990+0000","last_change":"2024-04-24T02:15:46.395014+0000","last_active":"2024-04-24T02:15:46.394990+0000","last_peered":"2024-04-24T02:15:46.394990+0000","last_clean":"2024-04-24T02:15:46.394990+0000","last_became_active":"2024-04-24T02:12:12.795328+0000","last_became_peered":"2024-04-24T02:12:12.795328+0000","last_unstale":"2024-04-24T02:15:46.394990+0000","last_undegraded":"2024-04-24T02:15:46.394990+0000","last_fullsized":"2024-04-24T02:15:46.394990+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2024-04-24T02:15:46.394901+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2024-04-24T02:15:46.394901+0000","last_clean_scrub_stamp":"2024-04-24T02:15:46.394901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:06:09.926743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:56.397529+0000","last_change":"2024-04-24T02:15:56.397529+0000","last_active":"2024-04-24T02:15:56.397529+0000","last_peered":"2024-04-24T02:15:56.397529+0000","last_clean":"2024-04-24T02:15:56.397529+0000","last_became_active":"2024-04-24T02:12:04.760099+0000","last_became_peered":"2024-04-24T02:12:04.760099+0000","last_unstale":"2024-04-24T02:15:56.397529+0000","last_undegraded":"2024-04-24T02:15:56.397529+0000","last_fullsized":"2024-04-24T02:15:56.397529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:56.397413+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:56.397413+0000","last_clean_scrub_stamp":"2024-04-24T02:15:56.397413+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:03:48.856552+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:09.532335+0000","last_change":"2024-04-24T02:16:09.532361+0000","last_active":"2024-04-24T02:16:09.532335+0000","last_peered":"2024-04-24T02:16:09.532335+0000","last_clean":"2024-04-24T02:16:09.532335+0000","last_became_active":"2024-04-24T02:12:02.744454+0000","last_became_peered":"2024-04-24T02:12:02.744454+0000","last_unstale":"2024-04-24T02:16:09.532335+0000","last_undegraded":"2024-04-24T02:16:09.532335+0000","last_fullsized":"2024-04-24T02:16:09.532335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:16:09.532231+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:16:09.532231+0000","last_clean_scrub_stamp":"2024-04-24T02:16:09.532231+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:07:05.583696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:24.221059+0000","last_change":"2024-04-24T02:11:57.000530+0000","last_active":"2024-04-24T02:15:24.221059+0000","last_peered":"2024-04-24T02:15:24.221059+0000","last_clean":"2024-04-24T02:15:24.221059+0000","last_became_active":"2024-04-24T02:11:57.000197+0000","last_became_peered":"2024-04-24T02:11:57.000197+0000","last_unstale":"2024-04-24T02:15:24.221059+0000","last_undegraded":"2024-04-24T02:15:24.221059+0000","last_fullsized":"2024-04-24T02:15:24.221059+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:11:55.711441+0000","last_clean_scrub_stamp":"2024-04-24T02:11:55.711441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:34.371690+0000","last_change":"2024-04-24T02:15:34.371690+0000","last_active":"2024-04-24T02:15:34.371690+0000","last_peered":"2024-04-24T02:15:34.371690+0000","last_clean":"2024-04-24T02:15:34.371690+0000","last_became_active":"2024-04-24T02:12:06.754107+0000","last_became_peered":"2024-04-24T02:12:06.754107+0000","last_unstale":"2024-04-24T02:15:34.371690+0000","last_undegraded":"2024-04-24T02:15:34.371690+0000","last_fullsized":"2024-04-24T02:15:34.371690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:34.371542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:34.371542+0000","last_clean_scrub_stamp":"2024-04-24T02:15:34.371542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:59:19.687673+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'105","reported_seq":205,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:32.532781+0000","last_change":"2024-04-24T02:15:32.532781+0000","last_active":"2024-04-24T02:15:32.532781+0000","last_peered":"2024-04-24T02:15:32.532781+0000","last_clean":"2024-04-24T02:15:32.532781+0000","last_became_active":"2024-04-24T02:12:08.780925+0000","last_became_peered":"2024-04-24T02:12:08.780925+0000","last_unstale":"2024-04-24T02:15:32.532781+0000","last_undegraded":"2024-04-24T02:15:32.532781+0000","last_fullsized":"2024-04-24T02:15:32.532781+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'105","last_scrub_stamp":"2024-04-24T02:15:32.532634+0000","last_deep_scrub":"32'105","last_deep_scrub_stamp":"2024-04-24T02:15:32.532634+0000","last_clean_scrub_stamp":"2024-04-24T02:15:32.532634+0000","objects_scrubbed":9,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:37:40.136523+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":108,"num_read_kb":111,"num_write":44,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:32.071860+0000","last_change":"2024-04-24T02:15:32.071860+0000","last_active":"2024-04-24T02:15:32.071860+0000","last_peered":"2024-04-24T02:15:32.071860+0000","last_clean":"2024-04-24T02:15:32.071860+0000","last_became_active":"2024-04-24T02:12:10.775165+0000","last_became_peered":"2024-04-24T02:12:10.775165+0000","last_unstale":"2024-04-24T02:15:32.071860+0000","last_undegraded":"2024-04-24T02:15:32.071860+0000","last_fullsized":"2024-04-24T02:15:32.071860+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:32.071693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:32.071693+0000","last_clean_scrub_stamp":"2024-04-24T02:15:32.071693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:31:34.757480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"30'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:42.394026+0000","last_change":"2024-04-24T02:15:42.394068+0000","last_active":"2024-04-24T02:15:42.394026+0000","last_peered":"2024-04-24T02:15:42.394026+0000","last_clean":"2024-04-24T02:15:42.394026+0000","last_became_active":"2024-04-24T02:12:12.796411+0000","last_became_peered":"2024-04-24T02:12:12.796411+0000","last_unstale":"2024-04-24T02:15:42.394026+0000","last_undegraded":"2024-04-24T02:15:42.394026+0000","last_fullsized":"2024-04-24T02:15:42.394026+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-24T02:15:42.393912+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-24T02:15:42.393912+0000","last_clean_scrub_stamp":"2024-04-24T02:15:42.393912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:09:36.452146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:14.620350+0000","last_change":"2024-04-24T02:16:14.620377+0000","last_active":"2024-04-24T02:16:14.620350+0000","last_peered":"2024-04-24T02:16:14.620350+0000","last_clean":"2024-04-24T02:16:14.620350+0000","last_became_active":"2024-04-24T02:12:12.801346+0000","last_became_peered":"2024-04-24T02:12:12.801346+0000","last_unstale":"2024-04-24T02:16:14.620350+0000","last_undegraded":"2024-04-24T02:16:14.620350+0000","last_fullsized":"2024-04-24T02:16:14.620350+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:14.620247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:14.620247+0000","last_clean_scrub_stamp":"2024-04-24T02:16:14.620247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:22:53.874245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:00.417737+0000","last_change":"2024-04-24T02:16:00.417766+0000","last_active":"2024-04-24T02:16:00.417737+0000","last_peered":"2024-04-24T02:16:00.417737+0000","last_clean":"2024-04-24T02:16:00.417737+0000","last_became_active":"2024-04-24T02:12:04.763860+0000","last_became_peered":"2024-04-24T02:12:04.763860+0000","last_unstale":"2024-04-24T02:16:00.417737+0000","last_undegraded":"2024-04-24T02:16:00.417737+0000","last_fullsized":"2024-04-24T02:16:00.417737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:16:00.417625+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:16:00.417625+0000","last_clean_scrub_stamp":"2024-04-24T02:16:00.417625+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:49:13.567916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:20.095672+0000","last_change":"2024-04-24T02:12:02.757073+0000","last_active":"2024-04-24T02:15:20.095672+0000","last_peered":"2024-04-24T02:15:20.095672+0000","last_clean":"2024-04-24T02:15:20.095672+0000","last_became_active":"2024-04-24T02:12:02.753166+0000","last_became_peered":"2024-04-24T02:12:02.753166+0000","last_unstale":"2024-04-24T02:15:20.095672+0000","last_undegraded":"2024-04-24T02:15:20.095672+0000","last_fullsized":"2024-04-24T02:15:20.095672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:39.395350+0000","last_change":"2024-04-24T02:15:39.395376+0000","last_active":"2024-04-24T02:15:39.395350+0000","last_peered":"2024-04-24T02:15:39.395350+0000","last_clean":"2024-04-24T02:15:39.395350+0000","last_became_active":"2024-04-24T02:12:06.758468+0000","last_became_peered":"2024-04-24T02:12:06.758468+0000","last_unstale":"2024-04-24T02:15:39.395350+0000","last_undegraded":"2024-04-24T02:15:39.395350+0000","last_fullsized":"2024-04-24T02:15:39.395350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:39.395252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:39.395252+0000","last_clean_scrub_stamp":"2024-04-24T02:15:39.395252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:56:56.565405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'47","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:54.212984+0000","last_change":"2024-04-24T02:15:54.213025+0000","last_active":"2024-04-24T02:15:54.212984+0000","last_peered":"2024-04-24T02:15:54.212984+0000","last_clean":"2024-04-24T02:15:54.212984+0000","last_became_active":"2024-04-24T02:12:08.780353+0000","last_became_peered":"2024-04-24T02:12:08.780353+0000","last_unstale":"2024-04-24T02:15:54.212984+0000","last_undegraded":"2024-04-24T02:15:54.212984+0000","last_fullsized":"2024-04-24T02:15:54.212984+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'47","last_scrub_stamp":"2024-04-24T02:15:54.212901+0000","last_deep_scrub":"32'47","last_deep_scrub_stamp":"2024-04-24T02:15:54.212901+0000","last_clean_scrub_stamp":"2024-04-24T02:15:54.212901+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:55:13.399828+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:04.017044+0000","last_change":"2024-04-24T02:16:04.017088+0000","last_active":"2024-04-24T02:16:04.017044+0000","last_peered":"2024-04-24T02:16:04.017044+0000","last_clean":"2024-04-24T02:16:04.017044+0000","last_became_active":"2024-04-24T02:12:10.786813+0000","last_became_peered":"2024-04-24T02:12:10.786813+0000","last_unstale":"2024-04-24T02:16:04.017044+0000","last_undegraded":"2024-04-24T02:16:04.017044+0000","last_fullsized":"2024-04-24T02:16:04.017044+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:04.016948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:04.016948+0000","last_clean_scrub_stamp":"2024-04-24T02:16:04.016948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:28:33.584520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'9","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:21.106208+0000","last_change":"2024-04-24T02:16:21.106256+0000","last_active":"2024-04-24T02:16:21.106208+0000","last_peered":"2024-04-24T02:16:21.106208+0000","last_clean":"2024-04-24T02:16:21.106208+0000","last_became_active":"2024-04-24T02:12:12.796149+0000","last_became_peered":"2024-04-24T02:12:12.796149+0000","last_unstale":"2024-04-24T02:16:21.106208+0000","last_undegraded":"2024-04-24T02:16:21.106208+0000","last_fullsized":"2024-04-24T02:16:21.106208+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-24T02:16:21.106107+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-24T02:16:21.106107+0000","last_clean_scrub_stamp":"2024-04-24T02:16:21.106107+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:05:51.119381+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'2","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.176885+0000","last_change":"2024-04-24T02:12:45.816393+0000","last_active":"2024-04-24T02:15:13.176885+0000","last_peered":"2024-04-24T02:15:13.176885+0000","last_clean":"2024-04-24T02:15:13.176885+0000","last_became_active":"2024-04-24T02:12:45.816009+0000","last_became_peered":"2024-04-24T02:12:45.816009+0000","last_unstale":"2024-04-24T02:15:13.176885+0000","last_undegraded":"2024-04-24T02:15:13.176885+0000","last_fullsized":"2024-04-24T02:15:13.176885+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:55.440095+0000","last_change":"2024-04-24T02:15:55.440136+0000","last_active":"2024-04-24T02:15:55.440095+0000","last_peered":"2024-04-24T02:15:55.440095+0000","last_clean":"2024-04-24T02:15:55.440095+0000","last_became_active":"2024-04-24T02:12:02.754623+0000","last_became_peered":"2024-04-24T02:12:02.754623+0000","last_unstale":"2024-04-24T02:15:55.440095+0000","last_undegraded":"2024-04-24T02:15:55.440095+0000","last_fullsized":"2024-04-24T02:15:55.440095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-24T02:15:55.439995+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-24T02:15:55.439995+0000","last_clean_scrub_stamp":"2024-04-24T02:15:55.439995+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:06:18.971836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:27.328721+0000","last_change":"2024-04-24T02:15:27.328746+0000","last_active":"2024-04-24T02:15:27.328721+0000","last_peered":"2024-04-24T02:15:27.328721+0000","last_clean":"2024-04-24T02:15:27.328721+0000","last_became_active":"2024-04-24T02:12:06.756998+0000","last_became_peered":"2024-04-24T02:12:06.756998+0000","last_unstale":"2024-04-24T02:15:27.328721+0000","last_undegraded":"2024-04-24T02:15:27.328721+0000","last_fullsized":"2024-04-24T02:15:27.328721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:27.328635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:27.328635+0000","last_clean_scrub_stamp":"2024-04-24T02:15:27.328635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:13.610015+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'9","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:36.993078+0000","last_change":"2024-04-24T02:15:36.993114+0000","last_active":"2024-04-24T02:15:36.993078+0000","last_peered":"2024-04-24T02:15:36.993078+0000","last_clean":"2024-04-24T02:15:36.993078+0000","last_became_active":"2024-04-24T02:12:08.769610+0000","last_became_peered":"2024-04-24T02:12:08.769610+0000","last_unstale":"2024-04-24T02:15:36.993078+0000","last_undegraded":"2024-04-24T02:15:36.993078+0000","last_fullsized":"2024-04-24T02:15:36.993078+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-24T02:15:36.992984+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-24T02:15:36.992984+0000","last_clean_scrub_stamp":"2024-04-24T02:15:36.992984+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:31:27.219681+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:24.453899+0000","last_change":"2024-04-24T02:15:24.453926+0000","last_active":"2024-04-24T02:15:24.453899+0000","last_peered":"2024-04-24T02:15:24.453899+0000","last_clean":"2024-04-24T02:15:24.453899+0000","last_became_active":"2024-04-24T02:12:10.784955+0000","last_became_peered":"2024-04-24T02:12:10.784955+0000","last_unstale":"2024-04-24T02:15:24.453899+0000","last_undegraded":"2024-04-24T02:15:24.453899+0000","last_fullsized":"2024-04-24T02:15:24.453899+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:24.453808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:24.453808+0000","last_clean_scrub_stamp":"2024-04-24T02:15:24.453808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:10:25.731858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'10","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:19.052760+0000","last_change":"2024-04-24T02:16:19.052803+0000","last_active":"2024-04-24T02:16:19.052760+0000","last_peered":"2024-04-24T02:16:19.052760+0000","last_clean":"2024-04-24T02:16:19.052760+0000","last_became_active":"2024-04-24T02:12:12.792565+0000","last_became_peered":"2024-04-24T02:12:12.792565+0000","last_unstale":"2024-04-24T02:16:19.052760+0000","last_undegraded":"2024-04-24T02:16:19.052760+0000","last_fullsized":"2024-04-24T02:16:19.052760+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-24T02:16:19.052635+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-24T02:16:19.052635+0000","last_clean_scrub_stamp":"2024-04-24T02:16:19.052635+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:43:57.416005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":60,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:49.117581+0000","last_change":"2024-04-24T02:15:49.117627+0000","last_active":"2024-04-24T02:15:49.117581+0000","last_peered":"2024-04-24T02:15:49.117581+0000","last_clean":"2024-04-24T02:15:49.117581+0000","last_became_active":"2024-04-24T02:12:04.766700+0000","last_became_peered":"2024-04-24T02:12:04.766700+0000","last_unstale":"2024-04-24T02:15:49.117581+0000","last_undegraded":"2024-04-24T02:15:49.117581+0000","last_fullsized":"2024-04-24T02:15:49.117581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:49.117486+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:49.117486+0000","last_clean_scrub_stamp":"2024-04-24T02:15:49.117486+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:35:31.797741+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:18.562745+0000","last_change":"2024-04-24T02:16:18.562784+0000","last_active":"2024-04-24T02:16:18.562745+0000","last_peered":"2024-04-24T02:16:18.562745+0000","last_clean":"2024-04-24T02:16:18.562745+0000","last_became_active":"2024-04-24T02:12:45.817240+0000","last_became_peered":"2024-04-24T02:12:45.817240+0000","last_unstale":"2024-04-24T02:16:18.562745+0000","last_undegraded":"2024-04-24T02:16:18.562745+0000","last_fullsized":"2024-04-24T02:16:18.562745+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:18.562640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:18.562640+0000","last_clean_scrub_stamp":"2024-04-24T02:16:18.562640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:07:14.614105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:40.427976+0000","last_change":"2024-04-24T02:15:40.428002+0000","last_active":"2024-04-24T02:15:40.427976+0000","last_peered":"2024-04-24T02:15:40.427976+0000","last_clean":"2024-04-24T02:15:40.427976+0000","last_became_active":"2024-04-24T02:12:06.764776+0000","last_became_peered":"2024-04-24T02:12:06.764776+0000","last_unstale":"2024-04-24T02:15:40.427976+0000","last_undegraded":"2024-04-24T02:15:40.427976+0000","last_fullsized":"2024-04-24T02:15:40.427976+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:40.427880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:40.427880+0000","last_clean_scrub_stamp":"2024-04-24T02:15:40.427880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:04:59.966363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'47","reported_seq":119,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:39.994683+0000","last_change":"2024-04-24T02:15:39.994717+0000","last_active":"2024-04-24T02:15:39.994683+0000","last_peered":"2024-04-24T02:15:39.994683+0000","last_clean":"2024-04-24T02:15:39.994683+0000","last_became_active":"2024-04-24T02:12:08.768499+0000","last_became_peered":"2024-04-24T02:12:08.768499+0000","last_unstale":"2024-04-24T02:15:39.994683+0000","last_undegraded":"2024-04-24T02:15:39.994683+0000","last_fullsized":"2024-04-24T02:15:39.994683+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'47","last_scrub_stamp":"2024-04-24T02:15:39.994590+0000","last_deep_scrub":"32'47","last_deep_scrub_stamp":"2024-04-24T02:15:39.994590+0000","last_clean_scrub_stamp":"2024-04-24T02:15:39.994590+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:40:40.190436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:24.405718+0000","last_change":"2024-04-24T02:15:24.405740+0000","last_active":"2024-04-24T02:15:24.405718+0000","last_peered":"2024-04-24T02:15:24.405718+0000","last_clean":"2024-04-24T02:15:24.405718+0000","last_became_active":"2024-04-24T02:12:10.776882+0000","last_became_peered":"2024-04-24T02:12:10.776882+0000","last_unstale":"2024-04-24T02:15:24.405718+0000","last_undegraded":"2024-04-24T02:15:24.405718+0000","last_fullsized":"2024-04-24T02:15:24.405718+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:24.405592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:24.405592+0000","last_clean_scrub_stamp":"2024-04-24T02:15:24.405592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:41:19.659879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.469268+0000","last_change":"2024-04-24T02:12:12.794192+0000","last_active":"2024-04-24T02:15:13.469268+0000","last_peered":"2024-04-24T02:15:13.469268+0000","last_clean":"2024-04-24T02:15:13.469268+0000","last_became_active":"2024-04-24T02:12:12.793884+0000","last_became_peered":"2024-04-24T02:12:12.793884+0000","last_unstale":"2024-04-24T02:15:13.469268+0000","last_undegraded":"2024-04-24T02:15:13.469268+0000","last_fullsized":"2024-04-24T02:15:13.469268+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'6","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:42.377250+0000","last_change":"2024-04-24T02:15:42.377279+0000","last_active":"2024-04-24T02:15:42.377250+0000","last_peered":"2024-04-24T02:15:42.377250+0000","last_clean":"2024-04-24T02:15:42.377250+0000","last_became_active":"2024-04-24T02:12:04.767431+0000","last_became_peered":"2024-04-24T02:12:04.767431+0000","last_unstale":"2024-04-24T02:15:42.377250+0000","last_undegraded":"2024-04-24T02:15:42.377250+0000","last_fullsized":"2024-04-24T02:15:42.377250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-24T02:15:42.377157+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-24T02:15:42.377157+0000","last_clean_scrub_stamp":"2024-04-24T02:15:42.377157+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:22:21.631155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:05.464439+0000","last_change":"2024-04-24T02:16:05.464469+0000","last_active":"2024-04-24T02:16:05.464439+0000","last_peered":"2024-04-24T02:16:05.464439+0000","last_clean":"2024-04-24T02:16:05.464439+0000","last_became_active":"2024-04-24T02:12:02.754295+0000","last_became_peered":"2024-04-24T02:12:02.754295+0000","last_unstale":"2024-04-24T02:16:05.464439+0000","last_undegraded":"2024-04-24T02:16:05.464439+0000","last_fullsized":"2024-04-24T02:16:05.464439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:16:05.464356+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:16:05.464356+0000","last_clean_scrub_stamp":"2024-04-24T02:16:05.464356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:22:44.718355+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:24.382922+0000","last_change":"2024-04-24T02:15:24.382967+0000","last_active":"2024-04-24T02:15:24.382922+0000","last_peered":"2024-04-24T02:15:24.382922+0000","last_clean":"2024-04-24T02:15:24.382922+0000","last_became_active":"2024-04-24T02:12:06.758462+0000","last_became_peered":"2024-04-24T02:12:06.758462+0000","last_unstale":"2024-04-24T02:15:24.382922+0000","last_undegraded":"2024-04-24T02:15:24.382922+0000","last_fullsized":"2024-04-24T02:15:24.382922+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:24.382807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:24.382807+0000","last_clean_scrub_stamp":"2024-04-24T02:15:24.382807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:05:42.611375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'36","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:39.388995+0000","last_change":"2024-04-24T02:15:39.389030+0000","last_active":"2024-04-24T02:15:39.388995+0000","last_peered":"2024-04-24T02:15:39.388995+0000","last_clean":"2024-04-24T02:15:39.388995+0000","last_became_active":"2024-04-24T02:12:08.768814+0000","last_became_peered":"2024-04-24T02:12:08.768814+0000","last_unstale":"2024-04-24T02:15:39.388995+0000","last_undegraded":"2024-04-24T02:15:39.388995+0000","last_fullsized":"2024-04-24T02:15:39.388995+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-04-24T02:15:39.388901+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-04-24T02:15:39.388901+0000","last_clean_scrub_stamp":"2024-04-24T02:15:39.388901+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:55:16.313182+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:27.445785+0000","last_change":"2024-04-24T02:15:27.445811+0000","last_active":"2024-04-24T02:15:27.445785+0000","last_peered":"2024-04-24T02:15:27.445785+0000","last_clean":"2024-04-24T02:15:27.445785+0000","last_became_active":"2024-04-24T02:12:10.779734+0000","last_became_peered":"2024-04-24T02:12:10.779734+0000","last_unstale":"2024-04-24T02:15:27.445785+0000","last_undegraded":"2024-04-24T02:15:27.445785+0000","last_fullsized":"2024-04-24T02:15:27.445785+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:27.445677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:27.445677+0000","last_clean_scrub_stamp":"2024-04-24T02:15:27.445677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:47:29.069695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'2","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:45.317822+0000","last_change":"2024-04-24T02:15:45.317822+0000","last_active":"2024-04-24T02:15:45.317822+0000","last_peered":"2024-04-24T02:15:45.317822+0000","last_clean":"2024-04-24T02:15:45.317822+0000","last_became_active":"2024-04-24T02:12:04.764564+0000","last_became_peered":"2024-04-24T02:12:04.764564+0000","last_unstale":"2024-04-24T02:15:45.317822+0000","last_undegraded":"2024-04-24T02:15:45.317822+0000","last_fullsized":"2024-04-24T02:15:45.317822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:15:45.317697+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:15:45.317697+0000","last_clean_scrub_stamp":"2024-04-24T02:15:45.317697+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:34:45.124130+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.041779+0000","last_change":"2024-04-24T02:12:45.809612+0000","last_active":"2024-04-24T02:15:13.041779+0000","last_peered":"2024-04-24T02:15:13.041779+0000","last_clean":"2024-04-24T02:15:13.041779+0000","last_became_active":"2024-04-24T02:12:45.809365+0000","last_became_peered":"2024-04-24T02:12:45.809365+0000","last_unstale":"2024-04-24T02:15:13.041779+0000","last_undegraded":"2024-04-24T02:15:13.041779+0000","last_fullsized":"2024-04-24T02:15:13.041779+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:17.596076+0000","last_change":"2024-04-24T02:16:17.596104+0000","last_active":"2024-04-24T02:16:17.596076+0000","last_peered":"2024-04-24T02:16:17.596076+0000","last_clean":"2024-04-24T02:16:17.596076+0000","last_became_active":"2024-04-24T02:12:45.814918+0000","last_became_peered":"2024-04-24T02:12:45.814918+0000","last_unstale":"2024-04-24T02:16:17.596076+0000","last_undegraded":"2024-04-24T02:16:17.596076+0000","last_fullsized":"2024-04-24T02:16:17.596076+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:17.595991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:17.595991+0000","last_clean_scrub_stamp":"2024-04-24T02:16:17.595991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:35:17.402424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"32'72","reported_seq":151,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:38.006044+0000","last_change":"2024-04-24T02:15:38.006098+0000","last_active":"2024-04-24T02:15:38.006044+0000","last_peered":"2024-04-24T02:15:38.006044+0000","last_clean":"2024-04-24T02:15:38.006044+0000","last_became_active":"2024-04-24T02:12:08.769578+0000","last_became_peered":"2024-04-24T02:12:08.769578+0000","last_unstale":"2024-04-24T02:15:38.006044+0000","last_undegraded":"2024-04-24T02:15:38.006044+0000","last_fullsized":"2024-04-24T02:15:38.006044+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'72","last_scrub_stamp":"2024-04-24T02:15:38.005928+0000","last_deep_scrub":"32'72","last_deep_scrub_stamp":"2024-04-24T02:15:38.005928+0000","last_clean_scrub_stamp":"2024-04-24T02:15:38.005928+0000","objects_scrubbed":6,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:38:25.392507+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:28.440238+0000","last_change":"2024-04-24T02:15:28.440262+0000","last_active":"2024-04-24T02:15:28.440238+0000","last_peered":"2024-04-24T02:15:28.440238+0000","last_clean":"2024-04-24T02:15:28.440238+0000","last_became_active":"2024-04-24T02:12:10.779703+0000","last_became_peered":"2024-04-24T02:12:10.779703+0000","last_unstale":"2024-04-24T02:15:28.440238+0000","last_undegraded":"2024-04-24T02:15:28.440238+0000","last_fullsized":"2024-04-24T02:15:28.440238+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:28.440118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:28.440118+0000","last_clean_scrub_stamp":"2024-04-24T02:15:28.440118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:28:48.467792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'16","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:18.060368+0000","last_change":"2024-04-24T02:16:18.060394+0000","last_active":"2024-04-24T02:16:18.060368+0000","last_peered":"2024-04-24T02:16:18.060368+0000","last_clean":"2024-04-24T02:16:18.060368+0000","last_became_active":"2024-04-24T02:12:12.791623+0000","last_became_peered":"2024-04-24T02:12:12.791623+0000","last_unstale":"2024-04-24T02:16:18.060368+0000","last_undegraded":"2024-04-24T02:16:18.060368+0000","last_fullsized":"2024-04-24T02:16:18.060368+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-04-24T02:16:18.060282+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-04-24T02:16:18.060282+0000","last_clean_scrub_stamp":"2024-04-24T02:16:18.060282+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:03:39.271033+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'10","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:01.115692+0000","last_change":"2024-04-24T02:16:01.115692+0000","last_active":"2024-04-24T02:16:01.115692+0000","last_peered":"2024-04-24T02:16:01.115692+0000","last_clean":"2024-04-24T02:16:01.115692+0000","last_became_active":"2024-04-24T02:12:04.755554+0000","last_became_peered":"2024-04-24T02:12:04.755554+0000","last_unstale":"2024-04-24T02:16:01.115692+0000","last_undegraded":"2024-04-24T02:16:01.115692+0000","last_fullsized":"2024-04-24T02:16:01.115692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-24T02:16:01.115544+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-24T02:16:01.115544+0000","last_clean_scrub_stamp":"2024-04-24T02:16:01.115544+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:30:37.328826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:15.402109+0000","last_change":"2024-04-24T02:16:15.402139+0000","last_active":"2024-04-24T02:16:15.402109+0000","last_peered":"2024-04-24T02:16:15.402109+0000","last_clean":"2024-04-24T02:16:15.402109+0000","last_became_active":"2024-04-24T02:12:02.751703+0000","last_became_peered":"2024-04-24T02:12:02.751703+0000","last_unstale":"2024-04-24T02:16:15.402109+0000","last_undegraded":"2024-04-24T02:16:15.402109+0000","last_fullsized":"2024-04-24T02:16:15.402109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:15.402014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:15.402014+0000","last_clean_scrub_stamp":"2024-04-24T02:16:15.402014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:50:00.999718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:47.423814+0000","last_change":"2024-04-24T02:15:47.423814+0000","last_active":"2024-04-24T02:15:47.423814+0000","last_peered":"2024-04-24T02:15:47.423814+0000","last_clean":"2024-04-24T02:15:47.423814+0000","last_became_active":"2024-04-24T02:12:06.756154+0000","last_became_peered":"2024-04-24T02:12:06.756154+0000","last_unstale":"2024-04-24T02:15:47.423814+0000","last_undegraded":"2024-04-24T02:15:47.423814+0000","last_fullsized":"2024-04-24T02:15:47.423814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:47.423687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:47.423687+0000","last_clean_scrub_stamp":"2024-04-24T02:15:47.423687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:18:00.672544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'45","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:44.331369+0000","last_change":"2024-04-24T02:15:44.331428+0000","last_active":"2024-04-24T02:15:44.331369+0000","last_peered":"2024-04-24T02:15:44.331369+0000","last_clean":"2024-04-24T02:15:44.331369+0000","last_became_active":"2024-04-24T02:12:08.780215+0000","last_became_peered":"2024-04-24T02:12:08.780215+0000","last_unstale":"2024-04-24T02:15:44.331369+0000","last_undegraded":"2024-04-24T02:15:44.331369+0000","last_fullsized":"2024-04-24T02:15:44.331369+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'45","last_scrub_stamp":"2024-04-24T02:15:44.331260+0000","last_deep_scrub":"32'45","last_deep_scrub_stamp":"2024-04-24T02:15:44.331260+0000","last_clean_scrub_stamp":"2024-04-24T02:15:44.331260+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:06:04.005763+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:34.421645+0000","last_change":"2024-04-24T02:15:34.421669+0000","last_active":"2024-04-24T02:15:34.421645+0000","last_peered":"2024-04-24T02:15:34.421645+0000","last_clean":"2024-04-24T02:15:34.421645+0000","last_became_active":"2024-04-24T02:12:10.785707+0000","last_became_peered":"2024-04-24T02:12:10.785707+0000","last_unstale":"2024-04-24T02:15:34.421645+0000","last_undegraded":"2024-04-24T02:15:34.421645+0000","last_fullsized":"2024-04-24T02:15:34.421645+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:34.421551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:34.421551+0000","last_clean_scrub_stamp":"2024-04-24T02:15:34.421551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:44:00.829320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:35.042215+0000","last_change":"2024-04-24T02:12:12.798843+0000","last_active":"2024-04-24T02:14:35.042215+0000","last_peered":"2024-04-24T02:14:35.042215+0000","last_clean":"2024-04-24T02:14:35.042215+0000","last_became_active":"2024-04-24T02:12:12.798498+0000","last_became_peered":"2024-04-24T02:12:12.798498+0000","last_unstale":"2024-04-24T02:14:35.042215+0000","last_undegraded":"2024-04-24T02:14:35.042215+0000","last_fullsized":"2024-04-24T02:14:35.042215+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:35.413292+0000","last_change":"2024-04-24T02:15:35.413344+0000","last_active":"2024-04-24T02:15:35.413292+0000","last_peered":"2024-04-24T02:15:35.413292+0000","last_clean":"2024-04-24T02:15:35.413292+0000","last_became_active":"2024-04-24T02:12:04.768285+0000","last_became_peered":"2024-04-24T02:12:04.768285+0000","last_unstale":"2024-04-24T02:15:35.413292+0000","last_undegraded":"2024-04-24T02:15:35.413292+0000","last_fullsized":"2024-04-24T02:15:35.413292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:35.413190+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:35.413190+0000","last_clean_scrub_stamp":"2024-04-24T02:15:35.413190+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:52:59.536845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:13.455217+0000","last_change":"2024-04-24T02:16:13.455264+0000","last_active":"2024-04-24T02:16:13.455217+0000","last_peered":"2024-04-24T02:16:13.455217+0000","last_clean":"2024-04-24T02:16:13.455217+0000","last_became_active":"2024-04-24T02:12:02.749461+0000","last_became_peered":"2024-04-24T02:12:02.749461+0000","last_unstale":"2024-04-24T02:16:13.455217+0000","last_undegraded":"2024-04-24T02:16:13.455217+0000","last_fullsized":"2024-04-24T02:16:13.455217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:13.455104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:13.455104+0000","last_clean_scrub_stamp":"2024-04-24T02:16:13.455104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:22:53.192009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:44.450336+0000","last_change":"2024-04-24T02:15:44.450359+0000","last_active":"2024-04-24T02:15:44.450336+0000","last_peered":"2024-04-24T02:15:44.450336+0000","last_clean":"2024-04-24T02:15:44.450336+0000","last_became_active":"2024-04-24T02:12:06.757760+0000","last_became_peered":"2024-04-24T02:12:06.757760+0000","last_unstale":"2024-04-24T02:15:44.450336+0000","last_undegraded":"2024-04-24T02:15:44.450336+0000","last_fullsized":"2024-04-24T02:15:44.450336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:44.450238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:44.450238+0000","last_clean_scrub_stamp":"2024-04-24T02:15:44.450238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:58:20.317926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'46","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:34.024663+0000","last_change":"2024-04-24T02:15:34.024663+0000","last_active":"2024-04-24T02:15:34.024663+0000","last_peered":"2024-04-24T02:15:34.024663+0000","last_clean":"2024-04-24T02:15:34.024663+0000","last_became_active":"2024-04-24T02:12:08.779471+0000","last_became_peered":"2024-04-24T02:12:08.779471+0000","last_unstale":"2024-04-24T02:15:34.024663+0000","last_undegraded":"2024-04-24T02:15:34.024663+0000","last_fullsized":"2024-04-24T02:15:34.024663+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-04-24T02:15:34.024534+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-04-24T02:15:34.024534+0000","last_clean_scrub_stamp":"2024-04-24T02:15:34.024534+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:54:19.092809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:26.055802+0000","last_change":"2024-04-24T02:15:26.055802+0000","last_active":"2024-04-24T02:15:26.055802+0000","last_peered":"2024-04-24T02:15:26.055802+0000","last_clean":"2024-04-24T02:15:26.055802+0000","last_became_active":"2024-04-24T02:12:10.780272+0000","last_became_peered":"2024-04-24T02:12:10.780272+0000","last_unstale":"2024-04-24T02:15:26.055802+0000","last_undegraded":"2024-04-24T02:15:26.055802+0000","last_fullsized":"2024-04-24T02:15:26.055802+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:26.055680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:26.055680+0000","last_clean_scrub_stamp":"2024-04-24T02:15:26.055680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:52:00.699214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:35.042130+0000","last_change":"2024-04-24T02:12:12.795264+0000","last_active":"2024-04-24T02:14:35.042130+0000","last_peered":"2024-04-24T02:14:35.042130+0000","last_clean":"2024-04-24T02:14:35.042130+0000","last_became_active":"2024-04-24T02:12:12.794815+0000","last_became_peered":"2024-04-24T02:12:12.794815+0000","last_unstale":"2024-04-24T02:14:35.042130+0000","last_undegraded":"2024-04-24T02:14:35.042130+0000","last_fullsized":"2024-04-24T02:14:35.042130+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:59.109645+0000","last_change":"2024-04-24T02:15:59.109671+0000","last_active":"2024-04-24T02:15:59.109645+0000","last_peered":"2024-04-24T02:15:59.109645+0000","last_clean":"2024-04-24T02:15:59.109645+0000","last_became_active":"2024-04-24T02:12:04.750546+0000","last_became_peered":"2024-04-24T02:12:04.750546+0000","last_unstale":"2024-04-24T02:15:59.109645+0000","last_undegraded":"2024-04-24T02:15:59.109645+0000","last_fullsized":"2024-04-24T02:15:59.109645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:15:59.109559+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:15:59.109559+0000","last_clean_scrub_stamp":"2024-04-24T02:15:59.109559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:47:13.514457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:19.965054+0000","last_change":"2024-04-24T02:16:19.965108+0000","last_active":"2024-04-24T02:16:19.965054+0000","last_peered":"2024-04-24T02:16:19.965054+0000","last_clean":"2024-04-24T02:16:19.965054+0000","last_became_active":"2024-04-24T02:12:02.757728+0000","last_became_peered":"2024-04-24T02:12:02.757728+0000","last_unstale":"2024-04-24T02:16:19.965054+0000","last_undegraded":"2024-04-24T02:16:19.965054+0000","last_fullsized":"2024-04-24T02:16:19.965054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:19.964939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:19.964939+0000","last_clean_scrub_stamp":"2024-04-24T02:16:19.964939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:43:32.114177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:41.398126+0000","last_change":"2024-04-24T02:15:41.398149+0000","last_active":"2024-04-24T02:15:41.398126+0000","last_peered":"2024-04-24T02:15:41.398126+0000","last_clean":"2024-04-24T02:15:41.398126+0000","last_became_active":"2024-04-24T02:12:06.757145+0000","last_became_peered":"2024-04-24T02:12:06.757145+0000","last_unstale":"2024-04-24T02:15:41.398126+0000","last_undegraded":"2024-04-24T02:15:41.398126+0000","last_fullsized":"2024-04-24T02:15:41.398126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:41.398039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:41.398039+0000","last_clean_scrub_stamp":"2024-04-24T02:15:41.398039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:34:29.427113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'22","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:53.240926+0000","last_change":"2024-04-24T02:15:53.240926+0000","last_active":"2024-04-24T02:15:53.240926+0000","last_peered":"2024-04-24T02:15:53.240926+0000","last_clean":"2024-04-24T02:15:53.240926+0000","last_became_active":"2024-04-24T02:12:08.781974+0000","last_became_peered":"2024-04-24T02:12:08.781974+0000","last_unstale":"2024-04-24T02:15:53.240926+0000","last_undegraded":"2024-04-24T02:15:53.240926+0000","last_fullsized":"2024-04-24T02:15:53.240926+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-04-24T02:15:53.240760+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-04-24T02:15:53.240760+0000","last_clean_scrub_stamp":"2024-04-24T02:15:53.240760+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:03:08.965112+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'285","reported_seq":383,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:30.498799+0000","last_change":"2024-04-24T02:15:30.498799+0000","last_active":"2024-04-24T02:15:30.498799+0000","last_peered":"2024-04-24T02:15:30.498799+0000","last_clean":"2024-04-24T02:15:30.498799+0000","last_became_active":"2024-04-24T02:12:10.786972+0000","last_became_peered":"2024-04-24T02:12:10.786972+0000","last_unstale":"2024-04-24T02:15:30.498799+0000","last_undegraded":"2024-04-24T02:15:30.498799+0000","last_fullsized":"2024-04-24T02:15:30.498799+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-24T02:15:30.498687+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-24T02:15:30.498687+0000","last_clean_scrub_stamp":"2024-04-24T02:15:30.498687+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:36:15.522512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'4","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:35.042068+0000","last_change":"2024-04-24T02:12:12.795734+0000","last_active":"2024-04-24T02:14:35.042068+0000","last_peered":"2024-04-24T02:14:35.042068+0000","last_clean":"2024-04-24T02:14:35.042068+0000","last_became_active":"2024-04-24T02:12:12.795013+0000","last_became_peered":"2024-04-24T02:12:12.795013+0000","last_unstale":"2024-04-24T02:14:35.042068+0000","last_undegraded":"2024-04-24T02:14:35.042068+0000","last_fullsized":"2024-04-24T02:14:35.042068+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'12","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:48.389856+0000","last_change":"2024-04-24T02:15:48.389882+0000","last_active":"2024-04-24T02:15:48.389856+0000","last_peered":"2024-04-24T02:15:48.389856+0000","last_clean":"2024-04-24T02:15:48.389856+0000","last_became_active":"2024-04-24T02:12:04.751676+0000","last_became_peered":"2024-04-24T02:12:04.751676+0000","last_unstale":"2024-04-24T02:15:48.389856+0000","last_undegraded":"2024-04-24T02:15:48.389856+0000","last_fullsized":"2024-04-24T02:15:48.389856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-04-24T02:15:48.389766+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-04-24T02:15:48.389766+0000","last_clean_scrub_stamp":"2024-04-24T02:15:48.389766+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:57:05.559919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:59.519596+0000","last_change":"2024-04-24T02:15:59.519617+0000","last_active":"2024-04-24T02:15:59.519596+0000","last_peered":"2024-04-24T02:15:59.519596+0000","last_clean":"2024-04-24T02:15:59.519596+0000","last_became_active":"2024-04-24T02:12:02.755512+0000","last_became_peered":"2024-04-24T02:12:02.755512+0000","last_unstale":"2024-04-24T02:15:59.519596+0000","last_undegraded":"2024-04-24T02:15:59.519596+0000","last_fullsized":"2024-04-24T02:15:59.519596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:59.519514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:59.519514+0000","last_clean_scrub_stamp":"2024-04-24T02:15:59.519514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:42:18.856192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:43.382322+0000","last_change":"2024-04-24T02:15:43.382348+0000","last_active":"2024-04-24T02:15:43.382322+0000","last_peered":"2024-04-24T02:15:43.382322+0000","last_clean":"2024-04-24T02:15:43.382322+0000","last_became_active":"2024-04-24T02:12:06.756909+0000","last_became_peered":"2024-04-24T02:12:06.756909+0000","last_unstale":"2024-04-24T02:15:43.382322+0000","last_undegraded":"2024-04-24T02:15:43.382322+0000","last_fullsized":"2024-04-24T02:15:43.382322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:43.382200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:43.382200+0000","last_clean_scrub_stamp":"2024-04-24T02:15:43.382200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:04:38.984836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'73","reported_seq":155,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:31.331803+0000","last_change":"2024-04-24T02:15:31.331846+0000","last_active":"2024-04-24T02:15:31.331803+0000","last_peered":"2024-04-24T02:15:31.331803+0000","last_clean":"2024-04-24T02:15:31.331803+0000","last_became_active":"2024-04-24T02:12:08.770255+0000","last_became_peered":"2024-04-24T02:12:08.770255+0000","last_unstale":"2024-04-24T02:15:31.331803+0000","last_undegraded":"2024-04-24T02:15:31.331803+0000","last_fullsized":"2024-04-24T02:15:31.331803+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'73","last_scrub_stamp":"2024-04-24T02:15:31.331721+0000","last_deep_scrub":"32'73","last_deep_scrub_stamp":"2024-04-24T02:15:31.331721+0000","last_clean_scrub_stamp":"2024-04-24T02:15:31.331721+0000","objects_scrubbed":11,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:04:50.870204+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:39.022379+0000","last_change":"2024-04-24T02:15:39.022402+0000","last_active":"2024-04-24T02:15:39.022379+0000","last_peered":"2024-04-24T02:15:39.022379+0000","last_clean":"2024-04-24T02:15:39.022379+0000","last_became_active":"2024-04-24T02:12:10.785811+0000","last_became_peered":"2024-04-24T02:12:10.785811+0000","last_unstale":"2024-04-24T02:15:39.022379+0000","last_undegraded":"2024-04-24T02:15:39.022379+0000","last_fullsized":"2024-04-24T02:15:39.022379+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:39.022286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:39.022286+0000","last_clean_scrub_stamp":"2024-04-24T02:15:39.022286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:12:21.461638+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:40.042632+0000","last_change":"2024-04-24T02:12:12.799813+0000","last_active":"2024-04-24T02:14:40.042632+0000","last_peered":"2024-04-24T02:14:40.042632+0000","last_clean":"2024-04-24T02:14:40.042632+0000","last_became_active":"2024-04-24T02:12:12.799557+0000","last_became_peered":"2024-04-24T02:12:12.799557+0000","last_unstale":"2024-04-24T02:14:40.042632+0000","last_undegraded":"2024-04-24T02:14:40.042632+0000","last_fullsized":"2024-04-24T02:14:40.042632+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'18","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:51.411880+0000","last_change":"2024-04-24T02:15:51.411902+0000","last_active":"2024-04-24T02:15:51.411880+0000","last_peered":"2024-04-24T02:15:51.411880+0000","last_clean":"2024-04-24T02:15:51.411880+0000","last_became_active":"2024-04-24T02:12:04.748399+0000","last_became_peered":"2024-04-24T02:12:04.748399+0000","last_unstale":"2024-04-24T02:15:51.411880+0000","last_undegraded":"2024-04-24T02:15:51.411880+0000","last_fullsized":"2024-04-24T02:15:51.411880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-04-24T02:15:51.411793+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-04-24T02:15:51.411793+0000","last_clean_scrub_stamp":"2024-04-24T02:15:51.411793+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:57:53.859681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":55,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:16.952527+0000","last_change":"2024-04-24T02:16:16.952565+0000","last_active":"2024-04-24T02:16:16.952527+0000","last_peered":"2024-04-24T02:16:16.952527+0000","last_clean":"2024-04-24T02:16:16.952527+0000","last_became_active":"2024-04-24T02:12:02.760772+0000","last_became_peered":"2024-04-24T02:12:02.760772+0000","last_unstale":"2024-04-24T02:16:16.952527+0000","last_undegraded":"2024-04-24T02:16:16.952527+0000","last_fullsized":"2024-04-24T02:16:16.952527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:16.952429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:16.952429+0000","last_clean_scrub_stamp":"2024-04-24T02:16:16.952429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:47:23.767080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:43.411197+0000","last_change":"2024-04-24T02:15:43.411223+0000","last_active":"2024-04-24T02:15:43.411197+0000","last_peered":"2024-04-24T02:15:43.411197+0000","last_clean":"2024-04-24T02:15:43.411197+0000","last_became_active":"2024-04-24T02:12:06.764475+0000","last_became_peered":"2024-04-24T02:12:06.764475+0000","last_unstale":"2024-04-24T02:15:43.411197+0000","last_undegraded":"2024-04-24T02:15:43.411197+0000","last_fullsized":"2024-04-24T02:15:43.411197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:43.411113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:43.411113+0000","last_clean_scrub_stamp":"2024-04-24T02:15:43.411113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:44:09.818882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'44","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:36.026642+0000","last_change":"2024-04-24T02:15:36.026681+0000","last_active":"2024-04-24T02:15:36.026642+0000","last_peered":"2024-04-24T02:15:36.026642+0000","last_clean":"2024-04-24T02:15:36.026642+0000","last_became_active":"2024-04-24T02:12:08.779447+0000","last_became_peered":"2024-04-24T02:12:08.779447+0000","last_unstale":"2024-04-24T02:15:36.026642+0000","last_undegraded":"2024-04-24T02:15:36.026642+0000","last_fullsized":"2024-04-24T02:15:36.026642+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'44","last_scrub_stamp":"2024-04-24T02:15:36.026532+0000","last_deep_scrub":"32'44","last_deep_scrub_stamp":"2024-04-24T02:15:36.026532+0000","last_clean_scrub_stamp":"2024-04-24T02:15:36.026532+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:44:38.935524+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:47.335589+0000","last_change":"2024-04-24T02:15:47.335614+0000","last_active":"2024-04-24T02:15:47.335589+0000","last_peered":"2024-04-24T02:15:47.335589+0000","last_clean":"2024-04-24T02:15:47.335589+0000","last_became_active":"2024-04-24T02:12:10.782019+0000","last_became_peered":"2024-04-24T02:12:10.782019+0000","last_unstale":"2024-04-24T02:15:47.335589+0000","last_undegraded":"2024-04-24T02:15:47.335589+0000","last_fullsized":"2024-04-24T02:15:47.335589+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:47.335498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:47.335498+0000","last_clean_scrub_stamp":"2024-04-24T02:15:47.335498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:09:16.493400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:40.043129+0000","last_change":"2024-04-24T02:12:12.797073+0000","last_active":"2024-04-24T02:14:40.043129+0000","last_peered":"2024-04-24T02:14:40.043129+0000","last_clean":"2024-04-24T02:14:40.043129+0000","last_became_active":"2024-04-24T02:12:12.796494+0000","last_became_peered":"2024-04-24T02:12:12.796494+0000","last_unstale":"2024-04-24T02:14:40.043129+0000","last_undegraded":"2024-04-24T02:14:40.043129+0000","last_fullsized":"2024-04-24T02:14:40.043129+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'10","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:10.005082+0000","last_change":"2024-04-24T02:16:10.005108+0000","last_active":"2024-04-24T02:16:10.005082+0000","last_peered":"2024-04-24T02:16:10.005082+0000","last_clean":"2024-04-24T02:16:10.005082+0000","last_became_active":"2024-04-24T02:12:04.763263+0000","last_became_peered":"2024-04-24T02:12:04.763263+0000","last_unstale":"2024-04-24T02:16:10.005082+0000","last_undegraded":"2024-04-24T02:16:10.005082+0000","last_fullsized":"2024-04-24T02:16:10.005082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-24T02:16:10.004960+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-24T02:16:10.004960+0000","last_clean_scrub_stamp":"2024-04-24T02:16:10.004960+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:13:22.857543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:04.117008+0000","last_change":"2024-04-24T02:16:04.117035+0000","last_active":"2024-04-24T02:16:04.117008+0000","last_peered":"2024-04-24T02:16:04.117008+0000","last_clean":"2024-04-24T02:16:04.117008+0000","last_became_active":"2024-04-24T02:12:02.745617+0000","last_became_peered":"2024-04-24T02:12:02.745617+0000","last_unstale":"2024-04-24T02:16:04.117008+0000","last_undegraded":"2024-04-24T02:16:04.117008+0000","last_fullsized":"2024-04-24T02:16:04.117008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:16:04.116904+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:16:04.116904+0000","last_clean_scrub_stamp":"2024-04-24T02:16:04.116904+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:59:21.604473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:33.375869+0000","last_change":"2024-04-24T02:15:33.375893+0000","last_active":"2024-04-24T02:15:33.375869+0000","last_peered":"2024-04-24T02:15:33.375869+0000","last_clean":"2024-04-24T02:15:33.375869+0000","last_became_active":"2024-04-24T02:12:06.765644+0000","last_became_peered":"2024-04-24T02:12:06.765644+0000","last_unstale":"2024-04-24T02:15:33.375869+0000","last_undegraded":"2024-04-24T02:15:33.375869+0000","last_fullsized":"2024-04-24T02:15:33.375869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:33.375779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:33.375779+0000","last_clean_scrub_stamp":"2024-04-24T02:15:33.375779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:09:27.434014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'38","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:40.363423+0000","last_change":"2024-04-24T02:15:40.363468+0000","last_active":"2024-04-24T02:15:40.363423+0000","last_peered":"2024-04-24T02:15:40.363423+0000","last_clean":"2024-04-24T02:15:40.363423+0000","last_became_active":"2024-04-24T02:12:08.780056+0000","last_became_peered":"2024-04-24T02:12:08.780056+0000","last_unstale":"2024-04-24T02:15:40.363423+0000","last_undegraded":"2024-04-24T02:15:40.363423+0000","last_fullsized":"2024-04-24T02:15:40.363423+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'38","last_scrub_stamp":"2024-04-24T02:15:40.363331+0000","last_deep_scrub":"32'38","last_deep_scrub_stamp":"2024-04-24T02:15:40.363331+0000","last_clean_scrub_stamp":"2024-04-24T02:15:40.363331+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:29:10.489979+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:00.072224+0000","last_change":"2024-04-24T02:16:00.072260+0000","last_active":"2024-04-24T02:16:00.072224+0000","last_peered":"2024-04-24T02:16:00.072224+0000","last_clean":"2024-04-24T02:16:00.072224+0000","last_became_active":"2024-04-24T02:12:10.785396+0000","last_became_peered":"2024-04-24T02:12:10.785396+0000","last_unstale":"2024-04-24T02:16:00.072224+0000","last_undegraded":"2024-04-24T02:16:00.072224+0000","last_fullsized":"2024-04-24T02:16:00.072224+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:00.072127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:00.072127+0000","last_clean_scrub_stamp":"2024-04-24T02:16:00.072127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:49:41.610677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:11.993788+0000","last_change":"2024-04-24T02:16:11.993815+0000","last_active":"2024-04-24T02:16:11.993788+0000","last_peered":"2024-04-24T02:16:11.993788+0000","last_clean":"2024-04-24T02:16:11.993788+0000","last_became_active":"2024-04-24T02:12:12.793796+0000","last_became_peered":"2024-04-24T02:12:12.793796+0000","last_unstale":"2024-04-24T02:16:11.993788+0000","last_undegraded":"2024-04-24T02:16:11.993788+0000","last_fullsized":"2024-04-24T02:16:11.993788+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:16:11.993699+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:16:11.993699+0000","last_clean_scrub_stamp":"2024-04-24T02:16:11.993699+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:44:14.703404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'20","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:49.413443+0000","last_change":"2024-04-24T02:15:49.413494+0000","last_active":"2024-04-24T02:15:49.413443+0000","last_peered":"2024-04-24T02:15:49.413443+0000","last_clean":"2024-04-24T02:15:49.413443+0000","last_became_active":"2024-04-24T02:12:04.749055+0000","last_became_peered":"2024-04-24T02:12:04.749055+0000","last_unstale":"2024-04-24T02:15:49.413443+0000","last_undegraded":"2024-04-24T02:15:49.413443+0000","last_fullsized":"2024-04-24T02:15:49.413443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-04-24T02:15:49.413342+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-04-24T02:15:49.413342+0000","last_clean_scrub_stamp":"2024-04-24T02:15:49.413342+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:15:41.702152+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:12.479147+0000","last_change":"2024-04-24T02:16:12.479147+0000","last_active":"2024-04-24T02:16:12.479147+0000","last_peered":"2024-04-24T02:16:12.479147+0000","last_clean":"2024-04-24T02:16:12.479147+0000","last_became_active":"2024-04-24T02:12:02.745895+0000","last_became_peered":"2024-04-24T02:12:02.745895+0000","last_unstale":"2024-04-24T02:16:12.479147+0000","last_undegraded":"2024-04-24T02:16:12.479147+0000","last_fullsized":"2024-04-24T02:16:12.479147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:12.479035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:12.479035+0000","last_clean_scrub_stamp":"2024-04-24T02:16:12.479035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:05:15.618195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'8","reported_seq":241,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:35.456109+0000","last_change":"2024-04-24T02:15:35.456160+0000","last_active":"2024-04-24T02:15:35.456109+0000","last_peered":"2024-04-24T02:15:35.456109+0000","last_clean":"2024-04-24T02:15:35.456109+0000","last_became_active":"2024-04-24T02:12:06.765096+0000","last_became_peered":"2024-04-24T02:12:06.765096+0000","last_unstale":"2024-04-24T02:15:35.456109+0000","last_undegraded":"2024-04-24T02:15:35.456109+0000","last_fullsized":"2024-04-24T02:15:35.456109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-24T02:15:35.456000+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-24T02:15:35.456000+0000","last_clean_scrub_stamp":"2024-04-24T02:15:35.456000+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:58:11.323688+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'53","reported_seq":122,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:30.313073+0000","last_change":"2024-04-24T02:15:30.313116+0000","last_active":"2024-04-24T02:15:30.313073+0000","last_peered":"2024-04-24T02:15:30.313073+0000","last_clean":"2024-04-24T02:15:30.313073+0000","last_became_active":"2024-04-24T02:12:08.779892+0000","last_became_peered":"2024-04-24T02:12:08.779892+0000","last_unstale":"2024-04-24T02:15:30.313073+0000","last_undegraded":"2024-04-24T02:15:30.313073+0000","last_fullsized":"2024-04-24T02:15:30.313073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'53","last_scrub_stamp":"2024-04-24T02:15:30.312975+0000","last_deep_scrub":"32'53","last_deep_scrub_stamp":"2024-04-24T02:15:30.312975+0000","last_clean_scrub_stamp":"2024-04-24T02:15:30.312975+0000","objects_scrubbed":7,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:50:47.143315+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:25.040176+0000","last_change":"2024-04-24T02:15:25.040213+0000","last_active":"2024-04-24T02:15:25.040176+0000","last_peered":"2024-04-24T02:15:25.040176+0000","last_clean":"2024-04-24T02:15:25.040176+0000","last_became_active":"2024-04-24T02:12:10.781588+0000","last_became_peered":"2024-04-24T02:12:10.781588+0000","last_unstale":"2024-04-24T02:15:25.040176+0000","last_undegraded":"2024-04-24T02:15:25.040176+0000","last_fullsized":"2024-04-24T02:15:25.040176+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:25.040045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:25.040045+0000","last_clean_scrub_stamp":"2024-04-24T02:15:25.040045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:17:46.062684+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'7","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:07.987422+0000","last_change":"2024-04-24T02:16:07.987454+0000","last_active":"2024-04-24T02:16:07.987422+0000","last_peered":"2024-04-24T02:16:07.987422+0000","last_clean":"2024-04-24T02:16:07.987422+0000","last_became_active":"2024-04-24T02:12:12.793310+0000","last_became_peered":"2024-04-24T02:12:12.793310+0000","last_unstale":"2024-04-24T02:16:07.987422+0000","last_undegraded":"2024-04-24T02:16:07.987422+0000","last_fullsized":"2024-04-24T02:16:07.987422+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-04-24T02:16:07.987322+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-04-24T02:16:07.987322+0000","last_clean_scrub_stamp":"2024-04-24T02:16:07.987322+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:15:09.700497+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:45.345178+0000","last_change":"2024-04-24T02:15:45.345220+0000","last_active":"2024-04-24T02:15:45.345178+0000","last_peered":"2024-04-24T02:15:45.345178+0000","last_clean":"2024-04-24T02:15:45.345178+0000","last_became_active":"2024-04-24T02:12:04.766869+0000","last_became_peered":"2024-04-24T02:12:04.766869+0000","last_unstale":"2024-04-24T02:15:45.345178+0000","last_undegraded":"2024-04-24T02:15:45.345178+0000","last_fullsized":"2024-04-24T02:15:45.345178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:45.345090+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:45.345090+0000","last_clean_scrub_stamp":"2024-04-24T02:15:45.345090+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:03:24.007542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:03.430790+0000","last_change":"2024-04-24T02:16:03.430790+0000","last_active":"2024-04-24T02:16:03.430790+0000","last_peered":"2024-04-24T02:16:03.430790+0000","last_clean":"2024-04-24T02:16:03.430790+0000","last_became_active":"2024-04-24T02:12:02.746992+0000","last_became_peered":"2024-04-24T02:12:02.746992+0000","last_unstale":"2024-04-24T02:16:03.430790+0000","last_undegraded":"2024-04-24T02:16:03.430790+0000","last_fullsized":"2024-04-24T02:16:03.430790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:03.430671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:03.430671+0000","last_clean_scrub_stamp":"2024-04-24T02:16:03.430671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:16:11.501515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:55.103606+0000","last_change":"2024-04-24T02:15:55.103631+0000","last_active":"2024-04-24T02:15:55.103606+0000","last_peered":"2024-04-24T02:15:55.103606+0000","last_clean":"2024-04-24T02:15:55.103606+0000","last_became_active":"2024-04-24T02:12:04.749165+0000","last_became_peered":"2024-04-24T02:12:04.749165+0000","last_unstale":"2024-04-24T02:15:55.103606+0000","last_undegraded":"2024-04-24T02:15:55.103606+0000","last_fullsized":"2024-04-24T02:15:55.103606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:55.103514+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:55.103514+0000","last_clean_scrub_stamp":"2024-04-24T02:15:55.103514+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:12:47.755623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'6","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:00.117523+0000","last_change":"2024-04-24T02:16:00.117523+0000","last_active":"2024-04-24T02:16:00.117523+0000","last_peered":"2024-04-24T02:16:00.117523+0000","last_clean":"2024-04-24T02:16:00.117523+0000","last_became_active":"2024-04-24T02:12:02.751613+0000","last_became_peered":"2024-04-24T02:12:02.751613+0000","last_unstale":"2024-04-24T02:16:00.117523+0000","last_undegraded":"2024-04-24T02:16:00.117523+0000","last_fullsized":"2024-04-24T02:16:00.117523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-24T02:16:00.117409+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-24T02:16:00.117409+0000","last_clean_scrub_stamp":"2024-04-24T02:16:00.117409+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:51:24.121602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:01.029519+0000","last_change":"2024-04-24T02:16:01.029548+0000","last_active":"2024-04-24T02:16:01.029519+0000","last_peered":"2024-04-24T02:16:01.029519+0000","last_clean":"2024-04-24T02:16:01.029519+0000","last_became_active":"2024-04-24T02:12:04.763819+0000","last_became_peered":"2024-04-24T02:12:04.763819+0000","last_unstale":"2024-04-24T02:16:01.029519+0000","last_undegraded":"2024-04-24T02:16:01.029519+0000","last_fullsized":"2024-04-24T02:16:01.029519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:16:01.029417+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:16:01.029417+0000","last_clean_scrub_stamp":"2024-04-24T02:16:01.029417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:21.330095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:17.917467+0000","last_change":"2024-04-24T02:16:17.917491+0000","last_active":"2024-04-24T02:16:17.917467+0000","last_peered":"2024-04-24T02:16:17.917467+0000","last_clean":"2024-04-24T02:16:17.917467+0000","last_became_active":"2024-04-24T02:12:02.757017+0000","last_became_peered":"2024-04-24T02:12:02.757017+0000","last_unstale":"2024-04-24T02:16:17.917467+0000","last_undegraded":"2024-04-24T02:16:17.917467+0000","last_fullsized":"2024-04-24T02:16:17.917467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:17.917380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:17.917380+0000","last_clean_scrub_stamp":"2024-04-24T02:16:17.917380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:33:14.097750+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'4","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:57.094426+0000","last_change":"2024-04-24T02:15:57.094452+0000","last_active":"2024-04-24T02:15:57.094426+0000","last_peered":"2024-04-24T02:15:57.094426+0000","last_clean":"2024-04-24T02:15:57.094426+0000","last_became_active":"2024-04-24T02:12:04.749305+0000","last_became_peered":"2024-04-24T02:12:04.749305+0000","last_unstale":"2024-04-24T02:15:57.094426+0000","last_undegraded":"2024-04-24T02:15:57.094426+0000","last_fullsized":"2024-04-24T02:15:57.094426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:57.094303+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:57.094303+0000","last_clean_scrub_stamp":"2024-04-24T02:15:57.094303+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:28:38.930212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"30'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:11.099959+0000","last_change":"2024-04-24T02:16:11.099959+0000","last_active":"2024-04-24T02:16:11.099959+0000","last_peered":"2024-04-24T02:16:11.099959+0000","last_clean":"2024-04-24T02:16:11.099959+0000","last_became_active":"2024-04-24T02:12:02.741503+0000","last_became_peered":"2024-04-24T02:12:02.741503+0000","last_unstale":"2024-04-24T02:16:11.099959+0000","last_undegraded":"2024-04-24T02:16:11.099959+0000","last_fullsized":"2024-04-24T02:16:11.099959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-24T02:16:11.099811+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-24T02:16:11.099811+0000","last_clean_scrub_stamp":"2024-04-24T02:16:11.099811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:43:30.505061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'6","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:22.951319+0000","last_change":"2024-04-24T02:12:45.818489+0000","last_active":"2024-04-24T02:15:22.951319+0000","last_peered":"2024-04-24T02:15:22.951319+0000","last_clean":"2024-04-24T02:15:22.951319+0000","last_became_active":"2024-04-24T02:12:45.814356+0000","last_became_peered":"2024-04-24T02:12:45.814356+0000","last_unstale":"2024-04-24T02:15:22.951319+0000","last_undegraded":"2024-04-24T02:15:22.951319+0000","last_fullsized":"2024-04-24T02:15:22.951319+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:58.137753+0000","last_change":"2024-04-24T02:15:58.137753+0000","last_active":"2024-04-24T02:15:58.137753+0000","last_peered":"2024-04-24T02:15:58.137753+0000","last_clean":"2024-04-24T02:15:58.137753+0000","last_became_active":"2024-04-24T02:12:02.751680+0000","last_became_peered":"2024-04-24T02:12:02.751680+0000","last_unstale":"2024-04-24T02:15:58.137753+0000","last_undegraded":"2024-04-24T02:15:58.137753+0000","last_fullsized":"2024-04-24T02:15:58.137753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:15:58.137599+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:15:58.137599+0000","last_clean_scrub_stamp":"2024-04-24T02:15:58.137599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:14:26.157218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'8","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:19.606138+0000","last_change":"2024-04-24T02:16:19.606162+0000","last_active":"2024-04-24T02:16:19.606138+0000","last_peered":"2024-04-24T02:16:19.606138+0000","last_clean":"2024-04-24T02:16:19.606138+0000","last_became_active":"2024-04-24T02:12:45.813097+0000","last_became_peered":"2024-04-24T02:12:45.813097+0000","last_unstale":"2024-04-24T02:16:19.606138+0000","last_undegraded":"2024-04-24T02:16:19.606138+0000","last_fullsized":"2024-04-24T02:16:19.606138+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-24T02:16:19.606029+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-24T02:16:19.606029+0000","last_clean_scrub_stamp":"2024-04-24T02:16:19.606029+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:09:48.763930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:03.422907+0000","last_change":"2024-04-24T02:16:03.422937+0000","last_active":"2024-04-24T02:16:03.422907+0000","last_peered":"2024-04-24T02:16:03.422907+0000","last_clean":"2024-04-24T02:16:03.422907+0000","last_became_active":"2024-04-24T02:12:02.754356+0000","last_became_peered":"2024-04-24T02:12:02.754356+0000","last_unstale":"2024-04-24T02:16:03.422907+0000","last_undegraded":"2024-04-24T02:16:03.422907+0000","last_fullsized":"2024-04-24T02:16:03.422907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:16:03.422793+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:16:03.422793+0000","last_clean_scrub_stamp":"2024-04-24T02:16:03.422793+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:29:33.549441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'6","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:05.162202+0000","last_change":"2024-04-24T02:16:05.162202+0000","last_active":"2024-04-24T02:16:05.162202+0000","last_peered":"2024-04-24T02:16:05.162202+0000","last_clean":"2024-04-24T02:16:05.162202+0000","last_became_active":"2024-04-24T02:12:04.755738+0000","last_became_peered":"2024-04-24T02:12:04.755738+0000","last_unstale":"2024-04-24T02:16:05.162202+0000","last_undegraded":"2024-04-24T02:16:05.162202+0000","last_fullsized":"2024-04-24T02:16:05.162202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-24T02:16:05.162069+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-24T02:16:05.162069+0000","last_clean_scrub_stamp":"2024-04-24T02:16:05.162069+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:50:33.643248+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"30'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:53.400491+0000","last_change":"2024-04-24T02:15:53.400534+0000","last_active":"2024-04-24T02:15:53.400491+0000","last_peered":"2024-04-24T02:15:53.400491+0000","last_clean":"2024-04-24T02:15:53.400491+0000","last_became_active":"2024-04-24T02:12:02.755202+0000","last_became_peered":"2024-04-24T02:12:02.755202+0000","last_unstale":"2024-04-24T02:15:53.400491+0000","last_undegraded":"2024-04-24T02:15:53.400491+0000","last_fullsized":"2024-04-24T02:15:53.400491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-24T02:15:53.400367+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-24T02:15:53.400367+0000","last_clean_scrub_stamp":"2024-04-24T02:15:53.400367+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:44:25.927284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"30'4","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:16.373027+0000","last_change":"2024-04-24T02:16:16.373051+0000","last_active":"2024-04-24T02:16:16.373027+0000","last_peered":"2024-04-24T02:16:16.373027+0000","last_clean":"2024-04-24T02:16:16.373027+0000","last_became_active":"2024-04-24T02:12:04.755194+0000","last_became_peered":"2024-04-24T02:12:04.755194+0000","last_unstale":"2024-04-24T02:16:16.373027+0000","last_undegraded":"2024-04-24T02:16:16.373027+0000","last_fullsized":"2024-04-24T02:16:16.373027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-04-24T02:16:16.372898+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-04-24T02:16:16.372898+0000","last_clean_scrub_stamp":"2024-04-24T02:16:16.372898+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:03:32.097250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:56.120098+0000","last_change":"2024-04-24T02:15:56.120098+0000","last_active":"2024-04-24T02:15:56.120098+0000","last_peered":"2024-04-24T02:15:56.120098+0000","last_clean":"2024-04-24T02:15:56.120098+0000","last_became_active":"2024-04-24T02:12:02.751726+0000","last_became_peered":"2024-04-24T02:12:02.751726+0000","last_unstale":"2024-04-24T02:15:56.120098+0000","last_undegraded":"2024-04-24T02:15:56.120098+0000","last_fullsized":"2024-04-24T02:15:56.120098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:56.119931+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:56.119931+0000","last_clean_scrub_stamp":"2024-04-24T02:15:56.119931+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:52:08.946224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'6","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:54.454622+0000","last_change":"2024-04-24T02:15:54.454652+0000","last_active":"2024-04-24T02:15:54.454622+0000","last_peered":"2024-04-24T02:15:54.454622+0000","last_clean":"2024-04-24T02:15:54.454622+0000","last_became_active":"2024-04-24T02:12:04.753074+0000","last_became_peered":"2024-04-24T02:12:04.753074+0000","last_unstale":"2024-04-24T02:15:54.454622+0000","last_undegraded":"2024-04-24T02:15:54.454622+0000","last_fullsized":"2024-04-24T02:15:54.454622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-24T02:15:54.454534+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-24T02:15:54.454534+0000","last_clean_scrub_stamp":"2024-04-24T02:15:54.454534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:16:02.525378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:20.095628+0000","last_change":"2024-04-24T02:12:02.755029+0000","last_active":"2024-04-24T02:15:20.095628+0000","last_peered":"2024-04-24T02:15:20.095628+0000","last_clean":"2024-04-24T02:15:20.095628+0000","last_became_active":"2024-04-24T02:12:02.754158+0000","last_became_peered":"2024-04-24T02:12:02.754158+0000","last_unstale":"2024-04-24T02:15:20.095628+0000","last_undegraded":"2024-04-24T02:15:20.095628+0000","last_fullsized":"2024-04-24T02:15:20.095628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'8","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:07.007656+0000","last_change":"2024-04-24T02:16:07.007685+0000","last_active":"2024-04-24T02:16:07.007656+0000","last_peered":"2024-04-24T02:16:07.007656+0000","last_clean":"2024-04-24T02:16:07.007656+0000","last_became_active":"2024-04-24T02:12:04.763136+0000","last_became_peered":"2024-04-24T02:12:04.763136+0000","last_unstale":"2024-04-24T02:16:07.007656+0000","last_undegraded":"2024-04-24T02:16:07.007656+0000","last_fullsized":"2024-04-24T02:16:07.007656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-24T02:16:07.007563+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-24T02:16:07.007563+0000","last_clean_scrub_stamp":"2024-04-24T02:16:07.007563+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:48:31.489105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:12.115490+0000","last_change":"2024-04-24T02:16:12.115548+0000","last_active":"2024-04-24T02:16:12.115490+0000","last_peered":"2024-04-24T02:16:12.115490+0000","last_clean":"2024-04-24T02:16:12.115490+0000","last_became_active":"2024-04-24T02:12:02.741543+0000","last_became_peered":"2024-04-24T02:12:02.741543+0000","last_unstale":"2024-04-24T02:16:12.115490+0000","last_undegraded":"2024-04-24T02:16:12.115490+0000","last_fullsized":"2024-04-24T02:16:12.115490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:12.115366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:12.115366+0000","last_clean_scrub_stamp":"2024-04-24T02:16:12.115366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:58:03.367670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:52.099921+0000","last_change":"2024-04-24T02:15:52.099971+0000","last_active":"2024-04-24T02:15:52.099921+0000","last_peered":"2024-04-24T02:15:52.099921+0000","last_clean":"2024-04-24T02:15:52.099921+0000","last_became_active":"2024-04-24T02:12:04.760028+0000","last_became_peered":"2024-04-24T02:12:04.760028+0000","last_unstale":"2024-04-24T02:15:52.099921+0000","last_undegraded":"2024-04-24T02:15:52.099921+0000","last_fullsized":"2024-04-24T02:15:52.099921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:15:52.099774+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:15:52.099774+0000","last_clean_scrub_stamp":"2024-04-24T02:15:52.099774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:55:18.068142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:14.449790+0000","last_change":"2024-04-24T02:16:14.449831+0000","last_active":"2024-04-24T02:16:14.449790+0000","last_peered":"2024-04-24T02:16:14.449790+0000","last_clean":"2024-04-24T02:16:14.449790+0000","last_became_active":"2024-04-24T02:12:02.750143+0000","last_became_peered":"2024-04-24T02:12:02.750143+0000","last_unstale":"2024-04-24T02:16:14.449790+0000","last_undegraded":"2024-04-24T02:16:14.449790+0000","last_fullsized":"2024-04-24T02:16:14.449790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:16:14.449684+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:16:14.449684+0000","last_clean_scrub_stamp":"2024-04-24T02:16:14.449684+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:27:00.632289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'8","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:00.498098+0000","last_change":"2024-04-24T02:16:00.498124+0000","last_active":"2024-04-24T02:16:00.498098+0000","last_peered":"2024-04-24T02:16:00.498098+0000","last_clean":"2024-04-24T02:16:00.498098+0000","last_became_active":"2024-04-24T02:12:04.754738+0000","last_became_peered":"2024-04-24T02:12:04.754738+0000","last_unstale":"2024-04-24T02:16:00.498098+0000","last_undegraded":"2024-04-24T02:16:00.498098+0000","last_fullsized":"2024-04-24T02:16:00.498098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-24T02:16:00.498013+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-24T02:16:00.498013+0000","last_clean_scrub_stamp":"2024-04-24T02:16:00.498013+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:10:40.099675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:11.512760+0000","last_change":"2024-04-24T02:16:11.512820+0000","last_active":"2024-04-24T02:16:11.512760+0000","last_peered":"2024-04-24T02:16:11.512760+0000","last_clean":"2024-04-24T02:16:11.512760+0000","last_became_active":"2024-04-24T02:12:02.744352+0000","last_became_peered":"2024-04-24T02:12:02.744352+0000","last_unstale":"2024-04-24T02:16:11.512760+0000","last_undegraded":"2024-04-24T02:16:11.512760+0000","last_fullsized":"2024-04-24T02:16:11.512760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:11.512653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:11.512653+0000","last_clean_scrub_stamp":"2024-04-24T02:16:11.512653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:38:55.315115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'12","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.179335+0000","last_change":"2024-04-24T02:12:45.815138+0000","last_active":"2024-04-24T02:15:13.179335+0000","last_peered":"2024-04-24T02:15:13.179335+0000","last_clean":"2024-04-24T02:15:13.179335+0000","last_became_active":"2024-04-24T02:12:45.808774+0000","last_became_peered":"2024-04-24T02:12:45.808774+0000","last_unstale":"2024-04-24T02:15:13.179335+0000","last_undegraded":"2024-04-24T02:15:13.179335+0000","last_fullsized":"2024-04-24T02:15:13.179335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:03.732672+0000","last_clean_scrub_stamp":"2024-04-24T02:12:03.732672+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:18.947169+0000","last_change":"2024-04-24T02:16:18.947207+0000","last_active":"2024-04-24T02:16:18.947169+0000","last_peered":"2024-04-24T02:16:18.947169+0000","last_clean":"2024-04-24T02:16:18.947169+0000","last_became_active":"2024-04-24T02:12:02.757458+0000","last_became_peered":"2024-04-24T02:12:02.757458+0000","last_unstale":"2024-04-24T02:16:18.947169+0000","last_undegraded":"2024-04-24T02:16:18.947169+0000","last_fullsized":"2024-04-24T02:16:18.947169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:18.947060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:18.947060+0000","last_clean_scrub_stamp":"2024-04-24T02:16:18.947060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:34:14.365119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'14","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:53.446024+0000","last_change":"2024-04-24T02:15:53.446051+0000","last_active":"2024-04-24T02:15:53.446024+0000","last_peered":"2024-04-24T02:15:53.446024+0000","last_clean":"2024-04-24T02:15:53.446024+0000","last_became_active":"2024-04-24T02:12:04.750973+0000","last_became_peered":"2024-04-24T02:12:04.750973+0000","last_unstale":"2024-04-24T02:15:53.446024+0000","last_undegraded":"2024-04-24T02:15:53.446024+0000","last_fullsized":"2024-04-24T02:15:53.446024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-04-24T02:15:53.445932+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-04-24T02:15:53.445932+0000","last_clean_scrub_stamp":"2024-04-24T02:15:53.445932+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:51:10.276272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:14.981981+0000","last_change":"2024-04-24T02:16:14.982027+0000","last_active":"2024-04-24T02:16:14.981981+0000","last_peered":"2024-04-24T02:16:14.981981+0000","last_clean":"2024-04-24T02:16:14.981981+0000","last_became_active":"2024-04-24T02:12:02.761235+0000","last_became_peered":"2024-04-24T02:12:02.761235+0000","last_unstale":"2024-04-24T02:16:14.981981+0000","last_undegraded":"2024-04-24T02:16:14.981981+0000","last_fullsized":"2024-04-24T02:16:14.981981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:14.981885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:14.981885+0000","last_clean_scrub_stamp":"2024-04-24T02:16:14.981885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:11:24.014498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:09.007966+0000","last_change":"2024-04-24T02:16:09.008011+0000","last_active":"2024-04-24T02:16:09.007966+0000","last_peered":"2024-04-24T02:16:09.007966+0000","last_clean":"2024-04-24T02:16:09.007966+0000","last_became_active":"2024-04-24T02:12:04.763517+0000","last_became_peered":"2024-04-24T02:12:04.763517+0000","last_unstale":"2024-04-24T02:16:09.007966+0000","last_undegraded":"2024-04-24T02:16:09.007966+0000","last_fullsized":"2024-04-24T02:16:09.007966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:16:09.007831+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:16:09.007831+0000","last_clean_scrub_stamp":"2024-04-24T02:16:09.007831+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:45:54.865186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:01.414746+0000","last_change":"2024-04-24T02:16:01.414787+0000","last_active":"2024-04-24T02:16:01.414746+0000","last_peered":"2024-04-24T02:16:01.414746+0000","last_clean":"2024-04-24T02:16:01.414746+0000","last_became_active":"2024-04-24T02:12:02.754227+0000","last_became_peered":"2024-04-24T02:12:02.754227+0000","last_unstale":"2024-04-24T02:16:01.414746+0000","last_undegraded":"2024-04-24T02:16:01.414746+0000","last_fullsized":"2024-04-24T02:16:01.414746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:16:01.414641+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:16:01.414641+0000","last_clean_scrub_stamp":"2024-04-24T02:16:01.414641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:42:59.636063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:06.480418+0000","last_change":"2024-04-24T02:16:06.480442+0000","last_active":"2024-04-24T02:16:06.480418+0000","last_peered":"2024-04-24T02:16:06.480418+0000","last_clean":"2024-04-24T02:16:06.480418+0000","last_became_active":"2024-04-24T02:12:04.755661+0000","last_became_peered":"2024-04-24T02:12:04.755661+0000","last_unstale":"2024-04-24T02:16:06.480418+0000","last_undegraded":"2024-04-24T02:16:06.480418+0000","last_fullsized":"2024-04-24T02:16:06.480418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:16:06.480334+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:16:06.480334+0000","last_clean_scrub_stamp":"2024-04-24T02:16:06.480334+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:06:18.083972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:25.040722+0000","last_change":"2024-04-24T02:12:02.761162+0000","last_active":"2024-04-24T02:14:25.040722+0000","last_peered":"2024-04-24T02:14:25.040722+0000","last_clean":"2024-04-24T02:14:25.040722+0000","last_became_active":"2024-04-24T02:12:02.758855+0000","last_became_peered":"2024-04-24T02:12:02.758855+0000","last_unstale":"2024-04-24T02:14:25.040722+0000","last_undegraded":"2024-04-24T02:14:25.040722+0000","last_fullsized":"2024-04-24T02:14:25.040722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:25.040481+0000","last_change":"2024-04-24T02:12:02.757416+0000","last_active":"2024-04-24T02:14:25.040481+0000","last_peered":"2024-04-24T02:14:25.040481+0000","last_clean":"2024-04-24T02:14:25.040481+0000","last_became_active":"2024-04-24T02:12:02.753545+0000","last_became_peered":"2024-04-24T02:12:02.753545+0000","last_unstale":"2024-04-24T02:14:25.040481+0000","last_undegraded":"2024-04-24T02:14:25.040481+0000","last_fullsized":"2024-04-24T02:14:25.040481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'10","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:17.082520+0000","last_change":"2024-04-24T02:16:17.082559+0000","last_active":"2024-04-24T02:16:17.082520+0000","last_peered":"2024-04-24T02:16:17.082520+0000","last_clean":"2024-04-24T02:16:17.082520+0000","last_became_active":"2024-04-24T02:12:04.758661+0000","last_became_peered":"2024-04-24T02:12:04.758661+0000","last_unstale":"2024-04-24T02:16:17.082520+0000","last_undegraded":"2024-04-24T02:16:17.082520+0000","last_fullsized":"2024-04-24T02:16:17.082520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-24T02:16:17.082421+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-24T02:16:17.082421+0000","last_clean_scrub_stamp":"2024-04-24T02:16:17.082421+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:51:19.331390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:06.148445+0000","last_change":"2024-04-24T02:16:06.148493+0000","last_active":"2024-04-24T02:16:06.148445+0000","last_peered":"2024-04-24T02:16:06.148445+0000","last_clean":"2024-04-24T02:16:06.148445+0000","last_became_active":"2024-04-24T02:12:02.745396+0000","last_became_peered":"2024-04-24T02:12:02.745396+0000","last_unstale":"2024-04-24T02:16:06.148445+0000","last_undegraded":"2024-04-24T02:16:06.148445+0000","last_fullsized":"2024-04-24T02:16:06.148445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:06.148341+0000","last_clean_scrub_stamp":"2024-04-24T02:16:06.148341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:39:08.794896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:49.477876+0000","last_change":"2024-04-24T02:15:49.477905+0000","last_active":"2024-04-24T02:15:49.477876+0000","last_peered":"2024-04-24T02:15:49.477876+0000","last_clean":"2024-04-24T02:15:49.477876+0000","last_became_active":"2024-04-24T02:12:04.766344+0000","last_became_peered":"2024-04-24T02:12:04.766344+0000","last_unstale":"2024-04-24T02:15:49.477876+0000","last_undegraded":"2024-04-24T02:15:49.477876+0000","last_fullsized":"2024-04-24T02:15:49.477876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:15:49.477787+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:15:49.477787+0000","last_clean_scrub_stamp":"2024-04-24T02:15:49.477787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:34:26.940534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1888,"num_read_kb":1653,"num_write":789,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1754,"ondisk_log_size":1754,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1617,"num_read_kb":1507,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":483,"ondisk_log_size":483,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640315,"num_pgs":152,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39944,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331896,"statfs":{"total":96636764160,"available":96595861504,"internally_reserved":0,"allocated":458752,"data_stored":135584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640313,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40456,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331384,"statfs":{"total":96636764160,"available":96595337216,"internally_reserved":0,"allocated":983040,"data_stored":722688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640315,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36324,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335516,"statfs":{"total":96636764160,"available":96599568384,"internally_reserved":0,"allocated":1011712,"data_stored":724048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705723,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39908,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331932,"statfs":{"total":96636764160,"available":96595898368,"internally_reserved":0,"allocated":421888,"data_stored":133610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T02:16:25.695 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:25.696 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:25.696 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:25.696 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:25.696 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:25.696 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:25.697 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:25.697 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:25.697 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:25.697 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:25.697 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:25.698 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:25.698 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:25.698 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-24T02:11:55.711441+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:25.698 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:25.698 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-24T02:11:55.711441+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:25.699 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:25.699 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-24T02:11:55.711441+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:25.699 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-24T02:11:55.711441+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:25.699 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:25.699 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-24T02:11:55.711441+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:25.700 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:25.700 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:25.700 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:25.700 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:25.700 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:25.700 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:25.701 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:25.701 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:25.701 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:25.701 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:25.702 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:25.702 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-24T02:12:03.732672+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:25.702 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:25.702 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:25.702 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-24T02:16:45.704 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T02:16:45.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:45.810+0000 7f7ee16f2640 1 Processor -- start 2024-04-24T02:16:45.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:45.810+0000 7f7ee16f2640 1 -- start start 2024-04-24T02:16:45.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:45.811+0000 7f7ee16f2640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f7edc094ee0 0x7f7edc0952f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:16:45.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:45.811+0000 7f7ee16f2640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7edc093600 con 0x7f7edc0970d0 2024-04-24T02:16:45.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:45.811+0000 7f7ee16f2640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f7edc073490 con 0x7f7edc094ee0 2024-04-24T02:16:45.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:45.811+0000 7f7eda7fc640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f7edc094ee0 0x7f7edc0952f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:16:45.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:45.811+0000 7f7edaffd640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f7edc0970d0 0x7f7edc0947d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:44864/0 (socket says 172.21.15.104:44864) 2024-04-24T02:16:45.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:45.811+0000 7f7edaffd640 1 -- 172.21.15.104:0/3151372854 learned_addr learned my addr 172.21.15.104:0/3151372854 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-04-24T02:16:45.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:45.811+0000 7f7eda7fc640 1 -- 172.21.15.104:0/3151372854 >> v1:172.21.15.104:6789/0 conn(0x7f7edc0970d0 legacy=0x7f7edc0947d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:16:45.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:45.811+0000 7f7eda7fc640 1 -- 172.21.15.104:0/3151372854 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7edc06b3d0 con 0x7f7edc094ee0 2024-04-24T02:16:45.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:45.812+0000 7f7eda7fc640 1 --2- 172.21.15.104:0/3151372854 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7edc094ee0 0x7f7edc0952f0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f7ec4009720 tx=0x7f7ec402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e378b61a861d0fa server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:16:45.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:45.812+0000 7f7ed9ffb640 1 -- 172.21.15.104:0/3151372854 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ec40316d0 con 0x7f7edc094ee0 2024-04-24T02:16:45.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:45.812+0000 7f7ed9ffb640 1 -- 172.21.15.104:0/3151372854 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ec4037070 con 0x7f7edc094ee0 2024-04-24T02:16:45.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:45.812+0000 7f7ed9ffb640 1 -- 172.21.15.104:0/3151372854 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ec40319c0 con 0x7f7edc094ee0 2024-04-24T02:16:45.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:45.813+0000 7f7ee16f2640 1 -- 172.21.15.104:0/3151372854 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7edc094ee0 msgr2=0x7f7edc0952f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:16:45.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:45.813+0000 7f7ee16f2640 1 --2- 172.21.15.104:0/3151372854 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7edc094ee0 0x7f7edc0952f0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f7ec4009720 tx=0x7f7ec402b840 comp rx=0 tx=0).stop 2024-04-24T02:16:45.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:45.813+0000 7f7ee16f2640 1 -- 172.21.15.104:0/3151372854 shutdown_connections 2024-04-24T02:16:45.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:45.813+0000 7f7ee16f2640 1 --2- 172.21.15.104:0/3151372854 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7edc094ee0 0x7f7edc0952f0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:16:45.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:45.813+0000 7f7ee16f2640 1 -- 172.21.15.104:0/3151372854 >> 172.21.15.104:0/3151372854 conn(0x7f7edc09b1d0 msgr2=0x7f7edc09b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:16:45.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:45.813+0000 7f7ee16f2640 1 -- 172.21.15.104:0/3151372854 shutdown_connections 2024-04-24T02:16:45.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:45.813+0000 7f7ee16f2640 1 -- 172.21.15.104:0/3151372854 wait complete. 2024-04-24T02:16:45.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:45.814+0000 7f7ee16f2640 1 Processor -- start 2024-04-24T02:16:45.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:45.814+0000 7f7ee16f2640 1 -- start start 2024-04-24T02:16:45.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:45.814+0000 7f7ee16f2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7edc094ee0 0x7f7edc12e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:16:45.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:45.814+0000 7f7ee16f2640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f7edc1341f0 con 0x7f7edc094ee0 2024-04-24T02:16:45.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:45.814+0000 7f7edaffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7edc094ee0 0x7f7edc12e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:16:45.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:45.814+0000 7f7edaffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7edc094ee0 0x7f7edc12e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:35540/0 (socket says 172.21.15.104:35540) 2024-04-24T02:16:45.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:45.814+0000 7f7edaffd640 1 -- 172.21.15.104:0/841154030 learned_addr learned my addr 172.21.15.104:0/841154030 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:16:45.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:45.815+0000 7f7edaffd640 1 -- 172.21.15.104:0/841154030 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7edc071eb0 con 0x7f7edc094ee0 2024-04-24T02:16:45.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:45.815+0000 7f7edaffd640 1 --2- 172.21.15.104:0/841154030 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7edc094ee0 0x7f7edc12e2a0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc00cb30 tx=0x7f7ecc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:16:45.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:45.815+0000 7f7ed37fe640 1 -- 172.21.15.104:0/841154030 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ecc017070 con 0x7f7edc094ee0 2024-04-24T02:16:45.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:45.815+0000 7f7ed37fe640 1 -- 172.21.15.104:0/841154030 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ecc00abf0 con 0x7f7edc094ee0 2024-04-24T02:16:45.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:45.815+0000 7f7ee16f2640 1 -- 172.21.15.104:0/841154030 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7edc12e7e0 con 0x7f7edc094ee0 2024-04-24T02:16:45.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:45.815+0000 7f7ed37fe640 1 -- 172.21.15.104:0/841154030 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ecc012400 con 0x7f7edc094ee0 2024-04-24T02:16:45.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:45.815+0000 7f7ee16f2640 1 -- 172.21.15.104:0/841154030 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7edc12ecb0 con 0x7f7edc094ee0 2024-04-24T02:16:45.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:45.816+0000 7f7ed37fe640 1 -- 172.21.15.104:0/841154030 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7ecc01a070 con 0x7f7edc094ee0 2024-04-24T02:16:45.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:45.816+0000 7f7ee16f2640 1 -- 172.21.15.104:0/841154030 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7edc062da0 con 0x7f7edc094ee0 2024-04-24T02:16:45.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:45.816+0000 7f7ed37fe640 1 --2- 172.21.15.104:0/841154030 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7ebc038060 0x7f7ebc03a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:16:45.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:45.816+0000 7f7ed37fe640 1 -- 172.21.15.104:0/841154030 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f7ecc04b610 con 0x7f7edc094ee0 2024-04-24T02:16:45.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:45.816+0000 7f7eda7fc640 1 --2- 172.21.15.104:0/841154030 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7ebc038060 0x7f7ebc03a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:16:45.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:45.817+0000 7f7eda7fc640 1 --2- 172.21.15.104:0/841154030 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7ebc038060 0x7f7ebc03a520 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7ec4036000 tx=0x7f7ec4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:16:45.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:45.821+0000 7f7ed37fe640 1 -- 172.21.15.104:0/841154030 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f7ecc01a360 con 0x7f7edc094ee0 2024-04-24T02:16:45.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:45.989+0000 7f7ee16f2640 1 -- 172.21.15.104:0/841154030 --> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7edc0720e0 con 0x7f7ebc038060 2024-04-24T02:16:46.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:46.005+0000 7f7ed37fe640 1 -- 172.21.15.104:0/841154030 <== mgr.4101 v2:172.21.15.134:6824/3655027977 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665469 (secure 0 0 0) 0x7f7edc0720e0 con 0x7f7ebc038060 2024-04-24T02:16:46.015 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:16:46.020 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-04-24T02:16:46.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:46.010+0000 7f7ee16f2640 1 -- 172.21.15.104:0/841154030 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7ebc038060 msgr2=0x7f7ebc03a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:16:46.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:46.010+0000 7f7ee16f2640 1 --2- 172.21.15.104:0/841154030 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7ebc038060 0x7f7ebc03a520 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7ec4036000 tx=0x7f7ec4008030 comp rx=0 tx=0).stop 2024-04-24T02:16:46.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:46.010+0000 7f7ee16f2640 1 -- 172.21.15.104:0/841154030 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7edc094ee0 msgr2=0x7f7edc12e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:16:46.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:46.010+0000 7f7ee16f2640 1 --2- 172.21.15.104:0/841154030 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7edc094ee0 0x7f7edc12e2a0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc00cb30 tx=0x7f7ecc00a060 comp rx=0 tx=0).stop 2024-04-24T02:16:46.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:46.010+0000 7f7ee16f2640 1 -- 172.21.15.104:0/841154030 shutdown_connections 2024-04-24T02:16:46.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:46.010+0000 7f7ee16f2640 1 --2- 172.21.15.104:0/841154030 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f7ebc038060 0x7f7ebc03a520 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:16:46.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:46.010+0000 7f7ee16f2640 1 --2- 172.21.15.104:0/841154030 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7edc094ee0 0x7f7edc12e2a0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:16:46.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:46.010+0000 7f7ee16f2640 1 -- 172.21.15.104:0/841154030 >> 172.21.15.104:0/841154030 conn(0x7f7edc09b1d0 msgr2=0x7f7edc0978b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:16:46.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:46.010+0000 7f7ee16f2640 1 -- 172.21.15.104:0/841154030 shutdown_connections 2024-04-24T02:16:46.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:16:46.010+0000 7f7ee16f2640 1 -- 172.21.15.104:0/841154030 wait complete. 2024-04-24T02:16:46.025 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":177,"stamp":"2024-04-24T02:16:44.051089+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":252,"num_object_clones":0,"num_object_copies":504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":0,"num_read":5385,"num_read_kb":4938,"num_write":2369,"num_write_kb":61373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5010,"ondisk_log_size":5010,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":156632,"kb_used_data":2808,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377330728,"statfs":{"total":386547056640,"available":386386665472,"internally_reserved":0,"allocated":2875392,"data_stored":1715930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":157476630},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004238"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:59.430267+0000","last_change":"2024-04-24T02:15:59.430267+0000","last_active":"2024-04-24T02:15:59.430267+0000","last_peered":"2024-04-24T02:15:59.430267+0000","last_clean":"2024-04-24T02:15:59.430267+0000","last_became_active":"2024-04-24T02:12:02.754954+0000","last_became_peered":"2024-04-24T02:12:02.754954+0000","last_unstale":"2024-04-24T02:15:59.430267+0000","last_undegraded":"2024-04-24T02:15:59.430267+0000","last_fullsized":"2024-04-24T02:15:59.430267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:59.430121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:59.430121+0000","last_clean_scrub_stamp":"2024-04-24T02:15:59.430121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:45.711501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'8","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:58.482790+0000","last_change":"2024-04-24T02:15:58.482814+0000","last_active":"2024-04-24T02:15:58.482790+0000","last_peered":"2024-04-24T02:15:58.482790+0000","last_clean":"2024-04-24T02:15:58.482790+0000","last_became_active":"2024-04-24T02:12:04.754049+0000","last_became_peered":"2024-04-24T02:12:04.754049+0000","last_unstale":"2024-04-24T02:15:58.482790+0000","last_undegraded":"2024-04-24T02:15:58.482790+0000","last_fullsized":"2024-04-24T02:15:58.482790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-24T02:15:58.482703+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-24T02:15:58.482703+0000","last_clean_scrub_stamp":"2024-04-24T02:15:58.482703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:53:22.606358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:02.136783+0000","last_change":"2024-04-24T02:16:02.136783+0000","last_active":"2024-04-24T02:16:02.136783+0000","last_peered":"2024-04-24T02:16:02.136783+0000","last_clean":"2024-04-24T02:16:02.136783+0000","last_became_active":"2024-04-24T02:12:02.745526+0000","last_became_peered":"2024-04-24T02:12:02.745526+0000","last_unstale":"2024-04-24T02:16:02.136783+0000","last_undegraded":"2024-04-24T02:16:02.136783+0000","last_fullsized":"2024-04-24T02:16:02.136783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:02.136614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:02.136614+0000","last_clean_scrub_stamp":"2024-04-24T02:16:02.136614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:53.467958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'12","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:11.034375+0000","last_change":"2024-04-24T02:16:11.034405+0000","last_active":"2024-04-24T02:16:11.034375+0000","last_peered":"2024-04-24T02:16:11.034375+0000","last_clean":"2024-04-24T02:16:11.034375+0000","last_became_active":"2024-04-24T02:12:04.762967+0000","last_became_peered":"2024-04-24T02:12:04.762967+0000","last_unstale":"2024-04-24T02:16:11.034375+0000","last_undegraded":"2024-04-24T02:16:11.034375+0000","last_fullsized":"2024-04-24T02:16:11.034375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-04-24T02:16:11.034280+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-04-24T02:16:11.034280+0000","last_clean_scrub_stamp":"2024-04-24T02:16:11.034280+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:23:21.593953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":62,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:31.981832+0000","last_change":"2024-04-24T02:16:31.981858+0000","last_active":"2024-04-24T02:16:31.981832+0000","last_peered":"2024-04-24T02:16:31.981832+0000","last_clean":"2024-04-24T02:16:31.981832+0000","last_became_active":"2024-04-24T02:12:02.758985+0000","last_became_peered":"2024-04-24T02:12:02.758985+0000","last_unstale":"2024-04-24T02:16:31.981832+0000","last_undegraded":"2024-04-24T02:16:31.981832+0000","last_fullsized":"2024-04-24T02:16:31.981832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:31.981743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:31.981743+0000","last_clean_scrub_stamp":"2024-04-24T02:16:31.981743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:00:08.436641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:43.364320+0000","last_change":"2024-04-24T02:15:43.364378+0000","last_active":"2024-04-24T02:15:43.364320+0000","last_peered":"2024-04-24T02:15:43.364320+0000","last_clean":"2024-04-24T02:15:43.364320+0000","last_became_active":"2024-04-24T02:12:04.765327+0000","last_became_peered":"2024-04-24T02:12:04.765327+0000","last_unstale":"2024-04-24T02:15:43.364320+0000","last_undegraded":"2024-04-24T02:15:43.364320+0000","last_fullsized":"2024-04-24T02:15:43.364320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-24T02:15:43.364212+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-24T02:15:43.364212+0000","last_clean_scrub_stamp":"2024-04-24T02:15:43.364212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:05:54.967851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:07.469203+0000","last_change":"2024-04-24T02:16:07.469227+0000","last_active":"2024-04-24T02:16:07.469203+0000","last_peered":"2024-04-24T02:16:07.469203+0000","last_clean":"2024-04-24T02:16:07.469203+0000","last_became_active":"2024-04-24T02:12:02.744804+0000","last_became_peered":"2024-04-24T02:12:02.744804+0000","last_unstale":"2024-04-24T02:16:07.469203+0000","last_undegraded":"2024-04-24T02:16:07.469203+0000","last_fullsized":"2024-04-24T02:16:07.469203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:07.469103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:07.469103+0000","last_clean_scrub_stamp":"2024-04-24T02:16:07.469103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:53:31.592758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'6","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:12.958194+0000","last_change":"2024-04-24T02:16:12.958220+0000","last_active":"2024-04-24T02:16:12.958194+0000","last_peered":"2024-04-24T02:16:12.958194+0000","last_clean":"2024-04-24T02:16:12.958194+0000","last_became_active":"2024-04-24T02:12:04.763076+0000","last_became_peered":"2024-04-24T02:12:04.763076+0000","last_unstale":"2024-04-24T02:16:12.958194+0000","last_undegraded":"2024-04-24T02:16:12.958194+0000","last_fullsized":"2024-04-24T02:16:12.958194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-24T02:16:12.958105+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-24T02:16:12.958105+0000","last_clean_scrub_stamp":"2024-04-24T02:16:12.958105+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:12:38.863390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:39.991022+0000","last_change":"2024-04-24T02:16:39.991050+0000","last_active":"2024-04-24T02:16:39.991022+0000","last_peered":"2024-04-24T02:16:39.991022+0000","last_clean":"2024-04-24T02:16:39.991022+0000","last_became_active":"2024-04-24T02:12:02.754208+0000","last_became_peered":"2024-04-24T02:12:02.754208+0000","last_unstale":"2024-04-24T02:16:39.991022+0000","last_undegraded":"2024-04-24T02:16:39.991022+0000","last_fullsized":"2024-04-24T02:16:39.991022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:16:39.990933+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:16:39.990933+0000","last_clean_scrub_stamp":"2024-04-24T02:16:39.990933+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:52:54.925511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:04.423664+0000","last_change":"2024-04-24T02:16:04.423664+0000","last_active":"2024-04-24T02:16:04.423664+0000","last_peered":"2024-04-24T02:16:04.423664+0000","last_clean":"2024-04-24T02:16:04.423664+0000","last_became_active":"2024-04-24T02:12:04.755248+0000","last_became_peered":"2024-04-24T02:12:04.755248+0000","last_unstale":"2024-04-24T02:16:04.423664+0000","last_undegraded":"2024-04-24T02:16:04.423664+0000","last_fullsized":"2024-04-24T02:16:04.423664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:16:04.423535+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:16:04.423535+0000","last_clean_scrub_stamp":"2024-04-24T02:16:04.423535+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:28:44.017367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:05.445107+0000","last_change":"2024-04-24T02:16:05.445133+0000","last_active":"2024-04-24T02:16:05.445107+0000","last_peered":"2024-04-24T02:16:05.445107+0000","last_clean":"2024-04-24T02:16:05.445107+0000","last_became_active":"2024-04-24T02:12:02.741326+0000","last_became_peered":"2024-04-24T02:12:02.741326+0000","last_unstale":"2024-04-24T02:16:05.445107+0000","last_undegraded":"2024-04-24T02:16:05.445107+0000","last_fullsized":"2024-04-24T02:16:05.445107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:16:05.444999+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:16:05.444999+0000","last_clean_scrub_stamp":"2024-04-24T02:16:05.444999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:34:29.031714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:14.007277+0000","last_change":"2024-04-24T02:16:14.007277+0000","last_active":"2024-04-24T02:16:14.007277+0000","last_peered":"2024-04-24T02:16:14.007277+0000","last_clean":"2024-04-24T02:16:14.007277+0000","last_became_active":"2024-04-24T02:12:04.762921+0000","last_became_peered":"2024-04-24T02:12:04.762921+0000","last_unstale":"2024-04-24T02:16:14.007277+0000","last_undegraded":"2024-04-24T02:16:14.007277+0000","last_fullsized":"2024-04-24T02:16:14.007277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:16:14.007159+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:16:14.007159+0000","last_clean_scrub_stamp":"2024-04-24T02:16:14.007159+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:54:00.213102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:35.042178+0000","last_change":"2024-04-24T02:12:02.755513+0000","last_active":"2024-04-24T02:14:35.042178+0000","last_peered":"2024-04-24T02:14:35.042178+0000","last_clean":"2024-04-24T02:14:35.042178+0000","last_became_active":"2024-04-24T02:12:02.752921+0000","last_became_peered":"2024-04-24T02:12:02.752921+0000","last_unstale":"2024-04-24T02:14:35.042178+0000","last_undegraded":"2024-04-24T02:14:35.042178+0000","last_fullsized":"2024-04-24T02:14:35.042178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'12","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:52.390885+0000","last_change":"2024-04-24T02:15:52.390885+0000","last_active":"2024-04-24T02:15:52.390885+0000","last_peered":"2024-04-24T02:15:52.390885+0000","last_clean":"2024-04-24T02:15:52.390885+0000","last_became_active":"2024-04-24T02:12:04.751655+0000","last_became_peered":"2024-04-24T02:12:04.751655+0000","last_unstale":"2024-04-24T02:15:52.390885+0000","last_undegraded":"2024-04-24T02:15:52.390885+0000","last_fullsized":"2024-04-24T02:15:52.390885+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-04-24T02:15:52.390774+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-04-24T02:15:52.390774+0000","last_clean_scrub_stamp":"2024-04-24T02:15:52.390774+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:04:47.993410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:54.140893+0000","last_change":"2024-04-24T02:15:54.140936+0000","last_active":"2024-04-24T02:15:54.140893+0000","last_peered":"2024-04-24T02:15:54.140893+0000","last_clean":"2024-04-24T02:15:54.140893+0000","last_became_active":"2024-04-24T02:12:02.752476+0000","last_became_peered":"2024-04-24T02:12:02.752476+0000","last_unstale":"2024-04-24T02:15:54.140893+0000","last_undegraded":"2024-04-24T02:15:54.140893+0000","last_fullsized":"2024-04-24T02:15:54.140893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-24T02:15:54.140770+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-24T02:15:54.140770+0000","last_clean_scrub_stamp":"2024-04-24T02:15:54.140770+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:49:51.563159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'18","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:12.548196+0000","last_change":"2024-04-24T02:16:12.548196+0000","last_active":"2024-04-24T02:16:12.548196+0000","last_peered":"2024-04-24T02:16:12.548196+0000","last_clean":"2024-04-24T02:16:12.548196+0000","last_became_active":"2024-04-24T02:12:04.766693+0000","last_became_peered":"2024-04-24T02:12:04.766693+0000","last_unstale":"2024-04-24T02:16:12.548196+0000","last_undegraded":"2024-04-24T02:16:12.548196+0000","last_fullsized":"2024-04-24T02:16:12.548196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-04-24T02:16:12.548082+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-04-24T02:16:12.548082+0000","last_clean_scrub_stamp":"2024-04-24T02:16:12.548082+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:29:42.674730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:59.112678+0000","last_change":"2024-04-24T02:15:59.112718+0000","last_active":"2024-04-24T02:15:59.112678+0000","last_peered":"2024-04-24T02:15:59.112678+0000","last_clean":"2024-04-24T02:15:59.112678+0000","last_became_active":"2024-04-24T02:12:04.764470+0000","last_became_peered":"2024-04-24T02:12:04.764470+0000","last_unstale":"2024-04-24T02:15:59.112678+0000","last_undegraded":"2024-04-24T02:15:59.112678+0000","last_fullsized":"2024-04-24T02:15:59.112678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-24T02:15:59.112564+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-24T02:15:59.112564+0000","last_clean_scrub_stamp":"2024-04-24T02:15:59.112564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:36:51.262575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:07.472799+0000","last_change":"2024-04-24T02:16:07.472840+0000","last_active":"2024-04-24T02:16:07.472799+0000","last_peered":"2024-04-24T02:16:07.472799+0000","last_clean":"2024-04-24T02:16:07.472799+0000","last_became_active":"2024-04-24T02:12:02.753791+0000","last_became_peered":"2024-04-24T02:12:02.753791+0000","last_unstale":"2024-04-24T02:16:07.472799+0000","last_undegraded":"2024-04-24T02:16:07.472799+0000","last_fullsized":"2024-04-24T02:16:07.472799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:16:07.472691+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:16:07.472691+0000","last_clean_scrub_stamp":"2024-04-24T02:16:07.472691+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:06:27.147194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'10","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:55.422084+0000","last_change":"2024-04-24T02:15:55.422124+0000","last_active":"2024-04-24T02:15:55.422084+0000","last_peered":"2024-04-24T02:15:55.422084+0000","last_clean":"2024-04-24T02:15:55.422084+0000","last_became_active":"2024-04-24T02:12:04.750774+0000","last_became_peered":"2024-04-24T02:12:04.750774+0000","last_unstale":"2024-04-24T02:15:55.422084+0000","last_undegraded":"2024-04-24T02:15:55.422084+0000","last_fullsized":"2024-04-24T02:15:55.422084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-24T02:15:55.421992+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-24T02:15:55.421992+0000","last_clean_scrub_stamp":"2024-04-24T02:15:55.421992+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:08:59.008607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:57.387526+0000","last_change":"2024-04-24T02:15:57.387551+0000","last_active":"2024-04-24T02:15:57.387526+0000","last_peered":"2024-04-24T02:15:57.387526+0000","last_clean":"2024-04-24T02:15:57.387526+0000","last_became_active":"2024-04-24T02:12:02.754860+0000","last_became_peered":"2024-04-24T02:12:02.754860+0000","last_unstale":"2024-04-24T02:15:57.387526+0000","last_undegraded":"2024-04-24T02:15:57.387526+0000","last_fullsized":"2024-04-24T02:15:57.387526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:57.387439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:57.387439+0000","last_clean_scrub_stamp":"2024-04-24T02:15:57.387439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:51:58.982518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:52.480408+0000","last_change":"2024-04-24T02:15:52.480434+0000","last_active":"2024-04-24T02:15:52.480408+0000","last_peered":"2024-04-24T02:15:52.480408+0000","last_clean":"2024-04-24T02:15:52.480408+0000","last_became_active":"2024-04-24T02:12:04.750919+0000","last_became_peered":"2024-04-24T02:12:04.750919+0000","last_unstale":"2024-04-24T02:15:52.480408+0000","last_undegraded":"2024-04-24T02:15:52.480408+0000","last_fullsized":"2024-04-24T02:15:52.480408+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-24T02:15:52.480323+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-24T02:15:52.480323+0000","last_clean_scrub_stamp":"2024-04-24T02:15:52.480323+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:42:50.701745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'4","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:57.510465+0000","last_change":"2024-04-24T02:15:57.510492+0000","last_active":"2024-04-24T02:15:57.510465+0000","last_peered":"2024-04-24T02:15:57.510465+0000","last_clean":"2024-04-24T02:15:57.510465+0000","last_became_active":"2024-04-24T02:12:02.756389+0000","last_became_peered":"2024-04-24T02:12:02.756389+0000","last_unstale":"2024-04-24T02:15:57.510465+0000","last_undegraded":"2024-04-24T02:15:57.510465+0000","last_fullsized":"2024-04-24T02:15:57.510465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:57.510375+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:57.510375+0000","last_clean_scrub_stamp":"2024-04-24T02:15:57.510375+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:59:42.826506+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:50.155004+0000","last_change":"2024-04-24T02:15:50.155056+0000","last_active":"2024-04-24T02:15:50.155004+0000","last_peered":"2024-04-24T02:15:50.155004+0000","last_clean":"2024-04-24T02:15:50.155004+0000","last_became_active":"2024-04-24T02:12:04.766739+0000","last_became_peered":"2024-04-24T02:12:04.766739+0000","last_unstale":"2024-04-24T02:15:50.155004+0000","last_undegraded":"2024-04-24T02:15:50.155004+0000","last_fullsized":"2024-04-24T02:15:50.155004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:15:50.154864+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:15:50.154864+0000","last_clean_scrub_stamp":"2024-04-24T02:15:50.154864+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:50:10.913324+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:10.508954+0000","last_change":"2024-04-24T02:16:10.508998+0000","last_active":"2024-04-24T02:16:10.508954+0000","last_peered":"2024-04-24T02:16:10.508954+0000","last_clean":"2024-04-24T02:16:10.508954+0000","last_became_active":"2024-04-24T02:12:02.744763+0000","last_became_peered":"2024-04-24T02:12:02.744763+0000","last_unstale":"2024-04-24T02:16:10.508954+0000","last_undegraded":"2024-04-24T02:16:10.508954+0000","last_fullsized":"2024-04-24T02:16:10.508954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:10.508823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:10.508823+0000","last_clean_scrub_stamp":"2024-04-24T02:16:10.508823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:09:39.666724+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'10","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:02.403771+0000","last_change":"2024-04-24T02:16:02.403810+0000","last_active":"2024-04-24T02:16:02.403771+0000","last_peered":"2024-04-24T02:16:02.403771+0000","last_clean":"2024-04-24T02:16:02.403771+0000","last_became_active":"2024-04-24T02:12:04.764659+0000","last_became_peered":"2024-04-24T02:12:04.764659+0000","last_unstale":"2024-04-24T02:16:02.403771+0000","last_undegraded":"2024-04-24T02:16:02.403771+0000","last_fullsized":"2024-04-24T02:16:02.403771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-24T02:16:02.403666+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-24T02:16:02.403666+0000","last_clean_scrub_stamp":"2024-04-24T02:16:02.403666+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:51:19.234006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:15.120084+0000","last_change":"2024-04-24T02:16:15.120108+0000","last_active":"2024-04-24T02:16:15.120084+0000","last_peered":"2024-04-24T02:16:15.120084+0000","last_clean":"2024-04-24T02:16:15.120084+0000","last_became_active":"2024-04-24T02:12:02.741976+0000","last_became_peered":"2024-04-24T02:12:02.741976+0000","last_unstale":"2024-04-24T02:16:15.120084+0000","last_undegraded":"2024-04-24T02:16:15.120084+0000","last_fullsized":"2024-04-24T02:16:15.120084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:15.119977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:15.119977+0000","last_clean_scrub_stamp":"2024-04-24T02:16:15.119977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:58:41.992666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'10","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:02.459018+0000","last_change":"2024-04-24T02:16:02.459044+0000","last_active":"2024-04-24T02:16:02.459018+0000","last_peered":"2024-04-24T02:16:02.459018+0000","last_clean":"2024-04-24T02:16:02.459018+0000","last_became_active":"2024-04-24T02:12:04.755133+0000","last_became_peered":"2024-04-24T02:12:04.755133+0000","last_unstale":"2024-04-24T02:16:02.459018+0000","last_undegraded":"2024-04-24T02:16:02.459018+0000","last_fullsized":"2024-04-24T02:16:02.459018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-24T02:16:02.458930+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-24T02:16:02.458930+0000","last_clean_scrub_stamp":"2024-04-24T02:16:02.458930+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:46:33.121676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:20.946932+0000","last_change":"2024-04-24T02:16:20.946977+0000","last_active":"2024-04-24T02:16:20.946932+0000","last_peered":"2024-04-24T02:16:20.946932+0000","last_clean":"2024-04-24T02:16:20.946932+0000","last_became_active":"2024-04-24T02:12:02.753196+0000","last_became_peered":"2024-04-24T02:12:02.753196+0000","last_unstale":"2024-04-24T02:16:20.946932+0000","last_undegraded":"2024-04-24T02:16:20.946932+0000","last_fullsized":"2024-04-24T02:16:20.946932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:20.946817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:20.946817+0000","last_clean_scrub_stamp":"2024-04-24T02:16:20.946817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:42:34.809229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'36","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:20.451486+0000","last_change":"2024-04-24T02:16:20.451514+0000","last_active":"2024-04-24T02:16:20.451486+0000","last_peered":"2024-04-24T02:16:20.451486+0000","last_clean":"2024-04-24T02:16:20.451486+0000","last_became_active":"2024-04-24T02:12:12.798179+0000","last_became_peered":"2024-04-24T02:12:12.798179+0000","last_unstale":"2024-04-24T02:16:20.451486+0000","last_undegraded":"2024-04-24T02:16:20.451486+0000","last_fullsized":"2024-04-24T02:16:20.451486+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-04-24T02:16:20.451404+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-04-24T02:16:20.451404+0000","last_clean_scrub_stamp":"2024-04-24T02:16:20.451404+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:44:14.976647+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:05.033123+0000","last_change":"2024-04-24T02:16:05.033188+0000","last_active":"2024-04-24T02:16:05.033123+0000","last_peered":"2024-04-24T02:16:05.033123+0000","last_clean":"2024-04-24T02:16:05.033123+0000","last_became_active":"2024-04-24T02:12:04.763725+0000","last_became_peered":"2024-04-24T02:12:04.763725+0000","last_unstale":"2024-04-24T02:16:05.033123+0000","last_undegraded":"2024-04-24T02:16:05.033123+0000","last_fullsized":"2024-04-24T02:16:05.033123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-24T02:16:05.033002+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-24T02:16:05.033002+0000","last_clean_scrub_stamp":"2024-04-24T02:16:05.033002+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:02:20.198278+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'4","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:33.022242+0000","last_change":"2024-04-24T02:16:33.022271+0000","last_active":"2024-04-24T02:16:33.022242+0000","last_peered":"2024-04-24T02:16:33.022242+0000","last_clean":"2024-04-24T02:16:33.022242+0000","last_became_active":"2024-04-24T02:12:02.755520+0000","last_became_peered":"2024-04-24T02:12:02.755520+0000","last_unstale":"2024-04-24T02:16:33.022242+0000","last_undegraded":"2024-04-24T02:16:33.022242+0000","last_fullsized":"2024-04-24T02:16:33.022242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:16:33.022152+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:16:33.022152+0000","last_clean_scrub_stamp":"2024-04-24T02:16:33.022152+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:11.682310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:28.347085+0000","last_change":"2024-04-24T02:15:28.347111+0000","last_active":"2024-04-24T02:15:28.347085+0000","last_peered":"2024-04-24T02:15:28.347085+0000","last_clean":"2024-04-24T02:15:28.347085+0000","last_became_active":"2024-04-24T02:12:06.758033+0000","last_became_peered":"2024-04-24T02:12:06.758033+0000","last_unstale":"2024-04-24T02:15:28.347085+0000","last_undegraded":"2024-04-24T02:15:28.347085+0000","last_fullsized":"2024-04-24T02:15:28.347085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:28.346988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:28.346988+0000","last_clean_scrub_stamp":"2024-04-24T02:15:28.346988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:48:41.497279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'51","reported_seq":118,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:49.256468+0000","last_change":"2024-04-24T02:15:49.256528+0000","last_active":"2024-04-24T02:15:49.256468+0000","last_peered":"2024-04-24T02:15:49.256468+0000","last_clean":"2024-04-24T02:15:49.256468+0000","last_became_active":"2024-04-24T02:12:08.783666+0000","last_became_peered":"2024-04-24T02:12:08.783666+0000","last_unstale":"2024-04-24T02:15:49.256468+0000","last_undegraded":"2024-04-24T02:15:49.256468+0000","last_fullsized":"2024-04-24T02:15:49.256468+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'51","last_scrub_stamp":"2024-04-24T02:15:49.256366+0000","last_deep_scrub":"32'51","last_deep_scrub_stamp":"2024-04-24T02:15:49.256366+0000","last_clean_scrub_stamp":"2024-04-24T02:15:49.256366+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:04:52.395526+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:38.404790+0000","last_change":"2024-04-24T02:15:38.404846+0000","last_active":"2024-04-24T02:15:38.404790+0000","last_peered":"2024-04-24T02:15:38.404790+0000","last_clean":"2024-04-24T02:15:38.404790+0000","last_became_active":"2024-04-24T02:12:10.786981+0000","last_became_peered":"2024-04-24T02:12:10.786981+0000","last_unstale":"2024-04-24T02:15:38.404790+0000","last_undegraded":"2024-04-24T02:15:38.404790+0000","last_fullsized":"2024-04-24T02:15:38.404790+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:38.404652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:38.404652+0000","last_clean_scrub_stamp":"2024-04-24T02:15:38.404652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:17:51.653509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:18.381271+0000","last_change":"2024-04-24T02:16:18.381296+0000","last_active":"2024-04-24T02:16:18.381271+0000","last_peered":"2024-04-24T02:16:18.381271+0000","last_clean":"2024-04-24T02:16:18.381271+0000","last_became_active":"2024-04-24T02:12:12.796319+0000","last_became_peered":"2024-04-24T02:12:12.796319+0000","last_unstale":"2024-04-24T02:16:18.381271+0000","last_undegraded":"2024-04-24T02:16:18.381271+0000","last_fullsized":"2024-04-24T02:16:18.381271+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-04-24T02:16:18.381185+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-04-24T02:16:18.381185+0000","last_clean_scrub_stamp":"2024-04-24T02:16:18.381185+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:37:39.446642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:58.158915+0000","last_change":"2024-04-24T02:15:58.158961+0000","last_active":"2024-04-24T02:15:58.158915+0000","last_peered":"2024-04-24T02:15:58.158915+0000","last_clean":"2024-04-24T02:15:58.158915+0000","last_became_active":"2024-04-24T02:12:04.764351+0000","last_became_peered":"2024-04-24T02:12:04.764351+0000","last_unstale":"2024-04-24T02:15:58.158915+0000","last_undegraded":"2024-04-24T02:15:58.158915+0000","last_fullsized":"2024-04-24T02:15:58.158915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:58.158816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:58.158816+0000","last_clean_scrub_stamp":"2024-04-24T02:15:58.158816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:17:50.502415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:10.527205+0000","last_change":"2024-04-24T02:16:10.527257+0000","last_active":"2024-04-24T02:16:10.527205+0000","last_peered":"2024-04-24T02:16:10.527205+0000","last_clean":"2024-04-24T02:16:10.527205+0000","last_became_active":"2024-04-24T02:12:02.744030+0000","last_became_peered":"2024-04-24T02:12:02.744030+0000","last_unstale":"2024-04-24T02:16:10.527205+0000","last_undegraded":"2024-04-24T02:16:10.527205+0000","last_fullsized":"2024-04-24T02:16:10.527205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:10.527107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:10.527107+0000","last_clean_scrub_stamp":"2024-04-24T02:16:10.527107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:28:15.772679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:48.070304+0000","last_change":"2024-04-24T02:15:48.070327+0000","last_active":"2024-04-24T02:15:48.070304+0000","last_peered":"2024-04-24T02:15:48.070304+0000","last_clean":"2024-04-24T02:15:48.070304+0000","last_became_active":"2024-04-24T02:12:06.758561+0000","last_became_peered":"2024-04-24T02:12:06.758561+0000","last_unstale":"2024-04-24T02:15:48.070304+0000","last_undegraded":"2024-04-24T02:15:48.070304+0000","last_fullsized":"2024-04-24T02:15:48.070304+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:48.070212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:48.070212+0000","last_clean_scrub_stamp":"2024-04-24T02:15:48.070212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:55:00.279301+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'16","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:32.376409+0000","last_change":"2024-04-24T02:15:32.376443+0000","last_active":"2024-04-24T02:15:32.376409+0000","last_peered":"2024-04-24T02:15:32.376409+0000","last_clean":"2024-04-24T02:15:32.376409+0000","last_became_active":"2024-04-24T02:12:08.767493+0000","last_became_peered":"2024-04-24T02:12:08.767493+0000","last_unstale":"2024-04-24T02:15:32.376409+0000","last_undegraded":"2024-04-24T02:15:32.376409+0000","last_fullsized":"2024-04-24T02:15:32.376409+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-04-24T02:15:32.376317+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-04-24T02:15:32.376317+0000","last_clean_scrub_stamp":"2024-04-24T02:15:32.376317+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:12:17.100634+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:26.334462+0000","last_change":"2024-04-24T02:15:26.334490+0000","last_active":"2024-04-24T02:15:26.334462+0000","last_peered":"2024-04-24T02:15:26.334462+0000","last_clean":"2024-04-24T02:15:26.334462+0000","last_became_active":"2024-04-24T02:12:10.779231+0000","last_became_peered":"2024-04-24T02:12:10.779231+0000","last_unstale":"2024-04-24T02:15:26.334462+0000","last_undegraded":"2024-04-24T02:15:26.334462+0000","last_fullsized":"2024-04-24T02:15:26.334462+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:26.334368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:26.334368+0000","last_clean_scrub_stamp":"2024-04-24T02:15:26.334368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:20:30.421649+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'8","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:51.148078+0000","last_change":"2024-04-24T02:15:51.148133+0000","last_active":"2024-04-24T02:15:51.148078+0000","last_peered":"2024-04-24T02:15:51.148078+0000","last_clean":"2024-04-24T02:15:51.148078+0000","last_became_active":"2024-04-24T02:12:12.791542+0000","last_became_peered":"2024-04-24T02:12:12.791542+0000","last_unstale":"2024-04-24T02:15:51.148078+0000","last_undegraded":"2024-04-24T02:15:51.148078+0000","last_fullsized":"2024-04-24T02:15:51.148078+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-24T02:15:51.147969+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-24T02:15:51.147969+0000","last_clean_scrub_stamp":"2024-04-24T02:15:51.147969+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:39:56.492767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:06.023830+0000","last_change":"2024-04-24T02:16:06.023890+0000","last_active":"2024-04-24T02:16:06.023830+0000","last_peered":"2024-04-24T02:16:06.023830+0000","last_clean":"2024-04-24T02:16:06.023830+0000","last_became_active":"2024-04-24T02:12:04.763491+0000","last_became_peered":"2024-04-24T02:12:04.763491+0000","last_unstale":"2024-04-24T02:16:06.023830+0000","last_undegraded":"2024-04-24T02:16:06.023830+0000","last_fullsized":"2024-04-24T02:16:06.023830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-24T02:16:06.023706+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-24T02:16:06.023706+0000","last_clean_scrub_stamp":"2024-04-24T02:16:06.023706+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:20:06.723214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"30'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:28.942276+0000","last_change":"2024-04-24T02:16:28.942332+0000","last_active":"2024-04-24T02:16:28.942276+0000","last_peered":"2024-04-24T02:16:28.942276+0000","last_clean":"2024-04-24T02:16:28.942276+0000","last_became_active":"2024-04-24T02:12:02.755636+0000","last_became_peered":"2024-04-24T02:12:02.755636+0000","last_unstale":"2024-04-24T02:16:28.942276+0000","last_undegraded":"2024-04-24T02:16:28.942276+0000","last_fullsized":"2024-04-24T02:16:28.942276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-24T02:16:28.942143+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-24T02:16:28.942143+0000","last_clean_scrub_stamp":"2024-04-24T02:16:28.942143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:04:36.488733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:15.646908+0000","last_change":"2024-04-24T02:16:15.646931+0000","last_active":"2024-04-24T02:16:15.646908+0000","last_peered":"2024-04-24T02:16:15.646908+0000","last_clean":"2024-04-24T02:16:15.646908+0000","last_became_active":"2024-04-24T02:12:45.813038+0000","last_became_peered":"2024-04-24T02:12:45.813038+0000","last_unstale":"2024-04-24T02:16:15.646908+0000","last_undegraded":"2024-04-24T02:16:15.646908+0000","last_fullsized":"2024-04-24T02:16:15.646908+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:15.646820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:15.646820+0000","last_clean_scrub_stamp":"2024-04-24T02:16:15.646820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:06:27.250459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"32'29","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:31.495647+0000","last_change":"2024-04-24T02:15:31.495714+0000","last_active":"2024-04-24T02:15:31.495647+0000","last_peered":"2024-04-24T02:15:31.495647+0000","last_clean":"2024-04-24T02:15:31.495647+0000","last_became_active":"2024-04-24T02:12:08.783077+0000","last_became_peered":"2024-04-24T02:12:08.783077+0000","last_unstale":"2024-04-24T02:15:31.495647+0000","last_undegraded":"2024-04-24T02:15:31.495647+0000","last_fullsized":"2024-04-24T02:15:31.495647+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'29","last_scrub_stamp":"2024-04-24T02:15:31.495549+0000","last_deep_scrub":"32'29","last_deep_scrub_stamp":"2024-04-24T02:15:31.495549+0000","last_clean_scrub_stamp":"2024-04-24T02:15:31.495549+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:13:45.684753+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'285","reported_seq":416,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:46.312707+0000","last_change":"2024-04-24T02:15:46.312755+0000","last_active":"2024-04-24T02:15:46.312707+0000","last_peered":"2024-04-24T02:15:46.312707+0000","last_clean":"2024-04-24T02:15:46.312707+0000","last_became_active":"2024-04-24T02:12:10.783726+0000","last_became_peered":"2024-04-24T02:12:10.783726+0000","last_unstale":"2024-04-24T02:15:46.312707+0000","last_undegraded":"2024-04-24T02:15:46.312707+0000","last_fullsized":"2024-04-24T02:15:46.312707+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-24T02:15:46.312603+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-24T02:15:46.312603+0000","last_clean_scrub_stamp":"2024-04-24T02:15:46.312603+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:06:42.364068+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:13.570766+0000","last_change":"2024-04-24T02:16:13.570786+0000","last_active":"2024-04-24T02:16:13.570766+0000","last_peered":"2024-04-24T02:16:13.570766+0000","last_clean":"2024-04-24T02:16:13.570766+0000","last_became_active":"2024-04-24T02:12:12.801331+0000","last_became_peered":"2024-04-24T02:12:12.801331+0000","last_unstale":"2024-04-24T02:16:13.570766+0000","last_undegraded":"2024-04-24T02:16:13.570766+0000","last_fullsized":"2024-04-24T02:16:13.570766+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:13.570666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:13.570666+0000","last_clean_scrub_stamp":"2024-04-24T02:16:13.570666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:28:53.164498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'18","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:07.145297+0000","last_change":"2024-04-24T02:16:07.145357+0000","last_active":"2024-04-24T02:16:07.145297+0000","last_peered":"2024-04-24T02:16:07.145297+0000","last_clean":"2024-04-24T02:16:07.145297+0000","last_became_active":"2024-04-24T02:12:04.756039+0000","last_became_peered":"2024-04-24T02:12:04.756039+0000","last_unstale":"2024-04-24T02:16:07.145297+0000","last_undegraded":"2024-04-24T02:16:07.145297+0000","last_fullsized":"2024-04-24T02:16:07.145297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-04-24T02:16:07.145185+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-04-24T02:16:07.145185+0000","last_clean_scrub_stamp":"2024-04-24T02:16:07.145185+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:09:45.496387+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":60,"num_read_kb":52,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"30'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:01.452966+0000","last_change":"2024-04-24T02:16:01.453009+0000","last_active":"2024-04-24T02:16:01.452966+0000","last_peered":"2024-04-24T02:16:01.452966+0000","last_clean":"2024-04-24T02:16:01.452966+0000","last_became_active":"2024-04-24T02:12:02.754852+0000","last_became_peered":"2024-04-24T02:12:02.754852+0000","last_unstale":"2024-04-24T02:16:01.452966+0000","last_undegraded":"2024-04-24T02:16:01.452966+0000","last_fullsized":"2024-04-24T02:16:01.452966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-24T02:16:01.452852+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-24T02:16:01.452852+0000","last_clean_scrub_stamp":"2024-04-24T02:16:01.452852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:28:06.698424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:26.356334+0000","last_change":"2024-04-24T02:15:26.356380+0000","last_active":"2024-04-24T02:15:26.356334+0000","last_peered":"2024-04-24T02:15:26.356334+0000","last_clean":"2024-04-24T02:15:26.356334+0000","last_became_active":"2024-04-24T02:12:06.757883+0000","last_became_peered":"2024-04-24T02:12:06.757883+0000","last_unstale":"2024-04-24T02:15:26.356334+0000","last_undegraded":"2024-04-24T02:15:26.356334+0000","last_fullsized":"2024-04-24T02:15:26.356334+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:26.356206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:26.356206+0000","last_clean_scrub_stamp":"2024-04-24T02:15:26.356206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:34:03.818953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'44","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:33.483208+0000","last_change":"2024-04-24T02:15:33.483248+0000","last_active":"2024-04-24T02:15:33.483208+0000","last_peered":"2024-04-24T02:15:33.483208+0000","last_clean":"2024-04-24T02:15:33.483208+0000","last_became_active":"2024-04-24T02:12:08.780950+0000","last_became_peered":"2024-04-24T02:12:08.780950+0000","last_unstale":"2024-04-24T02:15:33.483208+0000","last_undegraded":"2024-04-24T02:15:33.483208+0000","last_fullsized":"2024-04-24T02:15:33.483208+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'44","last_scrub_stamp":"2024-04-24T02:15:33.483112+0000","last_deep_scrub":"32'44","last_deep_scrub_stamp":"2024-04-24T02:15:33.483112+0000","last_clean_scrub_stamp":"2024-04-24T02:15:33.483112+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:41:28.737400+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'285","reported_seq":447,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:28.021707+0000","last_change":"2024-04-24T02:15:28.021732+0000","last_active":"2024-04-24T02:15:28.021707+0000","last_peered":"2024-04-24T02:15:28.021707+0000","last_clean":"2024-04-24T02:15:28.021707+0000","last_became_active":"2024-04-24T02:12:10.778254+0000","last_became_peered":"2024-04-24T02:12:10.778254+0000","last_unstale":"2024-04-24T02:15:28.021707+0000","last_undegraded":"2024-04-24T02:15:28.021707+0000","last_fullsized":"2024-04-24T02:15:28.021707+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-24T02:15:28.021612+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-24T02:15:28.021612+0000","last_clean_scrub_stamp":"2024-04-24T02:15:28.021612+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:14:08.932379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:41.341961+0000","last_change":"2024-04-24T02:15:41.341961+0000","last_active":"2024-04-24T02:15:41.341961+0000","last_peered":"2024-04-24T02:15:41.341961+0000","last_clean":"2024-04-24T02:15:41.341961+0000","last_became_active":"2024-04-24T02:12:04.767906+0000","last_became_peered":"2024-04-24T02:12:04.767906+0000","last_unstale":"2024-04-24T02:15:41.341961+0000","last_undegraded":"2024-04-24T02:15:41.341961+0000","last_fullsized":"2024-04-24T02:15:41.341961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:41.341814+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:41.341814+0000","last_clean_scrub_stamp":"2024-04-24T02:15:41.341814+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:28:20.935646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"32'3","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:11.548242+0000","last_change":"2024-04-24T02:16:11.548242+0000","last_active":"2024-04-24T02:16:11.548242+0000","last_peered":"2024-04-24T02:16:11.548242+0000","last_clean":"2024-04-24T02:16:11.548242+0000","last_became_active":"2024-04-24T02:12:02.748372+0000","last_became_peered":"2024-04-24T02:12:02.748372+0000","last_unstale":"2024-04-24T02:16:11.548242+0000","last_undegraded":"2024-04-24T02:16:11.548242+0000","last_fullsized":"2024-04-24T02:16:11.548242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-04-24T02:16:11.548067+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-04-24T02:16:11.548067+0000","last_clean_scrub_stamp":"2024-04-24T02:16:11.548067+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:46:42.210813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:36.460166+0000","last_change":"2024-04-24T02:15:36.460166+0000","last_active":"2024-04-24T02:15:36.460166+0000","last_peered":"2024-04-24T02:15:36.460166+0000","last_clean":"2024-04-24T02:15:36.460166+0000","last_became_active":"2024-04-24T02:12:06.764324+0000","last_became_peered":"2024-04-24T02:12:06.764324+0000","last_unstale":"2024-04-24T02:15:36.460166+0000","last_undegraded":"2024-04-24T02:15:36.460166+0000","last_fullsized":"2024-04-24T02:15:36.460166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:36.460053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:36.460053+0000","last_clean_scrub_stamp":"2024-04-24T02:15:36.460053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:36:31.597092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'58","reported_seq":125,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:36.435151+0000","last_change":"2024-04-24T02:15:36.435151+0000","last_active":"2024-04-24T02:15:36.435151+0000","last_peered":"2024-04-24T02:15:36.435151+0000","last_clean":"2024-04-24T02:15:36.435151+0000","last_became_active":"2024-04-24T02:12:08.771060+0000","last_became_peered":"2024-04-24T02:12:08.771060+0000","last_unstale":"2024-04-24T02:15:36.435151+0000","last_undegraded":"2024-04-24T02:15:36.435151+0000","last_fullsized":"2024-04-24T02:15:36.435151+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'58","last_scrub_stamp":"2024-04-24T02:15:36.435008+0000","last_deep_scrub":"32'58","last_deep_scrub_stamp":"2024-04-24T02:15:36.435008+0000","last_clean_scrub_stamp":"2024-04-24T02:15:36.435008+0000","objects_scrubbed":10,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:51:55.089317+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:29.043636+0000","last_change":"2024-04-24T02:15:29.043636+0000","last_active":"2024-04-24T02:15:29.043636+0000","last_peered":"2024-04-24T02:15:29.043636+0000","last_clean":"2024-04-24T02:15:29.043636+0000","last_became_active":"2024-04-24T02:12:10.776715+0000","last_became_peered":"2024-04-24T02:12:10.776715+0000","last_unstale":"2024-04-24T02:15:29.043636+0000","last_undegraded":"2024-04-24T02:15:29.043636+0000","last_fullsized":"2024-04-24T02:15:29.043636+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:29.043460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:29.043460+0000","last_clean_scrub_stamp":"2024-04-24T02:15:29.043460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:29:47.538838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'5","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:46.429992+0000","last_change":"2024-04-24T02:15:46.429992+0000","last_active":"2024-04-24T02:15:46.429992+0000","last_peered":"2024-04-24T02:15:46.429992+0000","last_clean":"2024-04-24T02:15:46.429992+0000","last_became_active":"2024-04-24T02:12:12.797405+0000","last_became_peered":"2024-04-24T02:12:12.797405+0000","last_unstale":"2024-04-24T02:15:46.429992+0000","last_undegraded":"2024-04-24T02:15:46.429992+0000","last_fullsized":"2024-04-24T02:15:46.429992+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-04-24T02:15:46.429875+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-04-24T02:15:46.429875+0000","last_clean_scrub_stamp":"2024-04-24T02:15:46.429875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:57:31.938558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'10","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:56.464583+0000","last_change":"2024-04-24T02:15:56.464583+0000","last_active":"2024-04-24T02:15:56.464583+0000","last_peered":"2024-04-24T02:15:56.464583+0000","last_clean":"2024-04-24T02:15:56.464583+0000","last_became_active":"2024-04-24T02:12:04.753819+0000","last_became_peered":"2024-04-24T02:12:04.753819+0000","last_unstale":"2024-04-24T02:15:56.464583+0000","last_undegraded":"2024-04-24T02:15:56.464583+0000","last_fullsized":"2024-04-24T02:15:56.464583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-24T02:15:56.464457+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-24T02:15:56.464457+0000","last_clean_scrub_stamp":"2024-04-24T02:15:56.464457+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:34:20.051173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:06.433190+0000","last_change":"2024-04-24T02:16:06.433190+0000","last_active":"2024-04-24T02:16:06.433190+0000","last_peered":"2024-04-24T02:16:06.433190+0000","last_clean":"2024-04-24T02:16:06.433190+0000","last_became_active":"2024-04-24T02:12:02.743202+0000","last_became_peered":"2024-04-24T02:12:02.743202+0000","last_unstale":"2024-04-24T02:16:06.433190+0000","last_undegraded":"2024-04-24T02:16:06.433190+0000","last_fullsized":"2024-04-24T02:16:06.433190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:06.433087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:06.433087+0000","last_clean_scrub_stamp":"2024-04-24T02:16:06.433087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:59:51.749218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:41.008594+0000","last_change":"2024-04-24T02:15:41.008594+0000","last_active":"2024-04-24T02:15:41.008594+0000","last_peered":"2024-04-24T02:15:41.008594+0000","last_clean":"2024-04-24T02:15:41.008594+0000","last_became_active":"2024-04-24T02:12:06.765690+0000","last_became_peered":"2024-04-24T02:12:06.765690+0000","last_unstale":"2024-04-24T02:15:41.008594+0000","last_undegraded":"2024-04-24T02:15:41.008594+0000","last_fullsized":"2024-04-24T02:15:41.008594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:41.008462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:41.008462+0000","last_clean_scrub_stamp":"2024-04-24T02:15:41.008462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:55:16.490485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'45","reported_seq":107,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:36.400192+0000","last_change":"2024-04-24T02:15:36.400192+0000","last_active":"2024-04-24T02:15:36.400192+0000","last_peered":"2024-04-24T02:15:36.400192+0000","last_clean":"2024-04-24T02:15:36.400192+0000","last_became_active":"2024-04-24T02:12:08.779594+0000","last_became_peered":"2024-04-24T02:12:08.779594+0000","last_unstale":"2024-04-24T02:15:36.400192+0000","last_undegraded":"2024-04-24T02:15:36.400192+0000","last_fullsized":"2024-04-24T02:15:36.400192+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'45","last_scrub_stamp":"2024-04-24T02:15:36.400062+0000","last_deep_scrub":"32'45","last_deep_scrub_stamp":"2024-04-24T02:15:36.400062+0000","last_clean_scrub_stamp":"2024-04-24T02:15:36.400062+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:41:55.736741+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:35.000257+0000","last_change":"2024-04-24T02:15:35.000257+0000","last_active":"2024-04-24T02:15:35.000257+0000","last_peered":"2024-04-24T02:15:35.000257+0000","last_clean":"2024-04-24T02:15:35.000257+0000","last_became_active":"2024-04-24T02:12:10.784901+0000","last_became_peered":"2024-04-24T02:12:10.784901+0000","last_unstale":"2024-04-24T02:15:35.000257+0000","last_undegraded":"2024-04-24T02:15:35.000257+0000","last_fullsized":"2024-04-24T02:15:35.000257+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:35.000105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:35.000105+0000","last_clean_scrub_stamp":"2024-04-24T02:15:35.000105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:13:03.366315+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'6","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:50.476327+0000","last_change":"2024-04-24T02:15:50.476327+0000","last_active":"2024-04-24T02:15:50.476327+0000","last_peered":"2024-04-24T02:15:50.476327+0000","last_clean":"2024-04-24T02:15:50.476327+0000","last_became_active":"2024-04-24T02:12:12.795364+0000","last_became_peered":"2024-04-24T02:12:12.795364+0000","last_unstale":"2024-04-24T02:15:50.476327+0000","last_undegraded":"2024-04-24T02:15:50.476327+0000","last_fullsized":"2024-04-24T02:15:50.476327+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-24T02:15:50.476194+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-24T02:15:50.476194+0000","last_clean_scrub_stamp":"2024-04-24T02:15:50.476194+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:36.757574+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'8","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:58.385311+0000","last_change":"2024-04-24T02:15:58.385311+0000","last_active":"2024-04-24T02:15:58.385311+0000","last_peered":"2024-04-24T02:15:58.385311+0000","last_clean":"2024-04-24T02:15:58.385311+0000","last_became_active":"2024-04-24T02:12:04.762869+0000","last_became_peered":"2024-04-24T02:12:04.762869+0000","last_unstale":"2024-04-24T02:15:58.385311+0000","last_undegraded":"2024-04-24T02:15:58.385311+0000","last_fullsized":"2024-04-24T02:15:58.385311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-24T02:15:58.385121+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-24T02:15:58.385121+0000","last_clean_scrub_stamp":"2024-04-24T02:15:58.385121+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:34:35.847868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:21.909175+0000","last_change":"2024-04-24T02:16:21.909175+0000","last_active":"2024-04-24T02:16:21.909175+0000","last_peered":"2024-04-24T02:16:21.909175+0000","last_clean":"2024-04-24T02:16:21.909175+0000","last_became_active":"2024-04-24T02:12:02.757488+0000","last_became_peered":"2024-04-24T02:12:02.757488+0000","last_unstale":"2024-04-24T02:16:21.909175+0000","last_undegraded":"2024-04-24T02:16:21.909175+0000","last_fullsized":"2024-04-24T02:16:21.909175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:21.909066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:21.909066+0000","last_clean_scrub_stamp":"2024-04-24T02:16:21.909066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:41:28.743431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:41.997919+0000","last_change":"2024-04-24T02:15:41.997919+0000","last_active":"2024-04-24T02:15:41.997919+0000","last_peered":"2024-04-24T02:15:41.997919+0000","last_clean":"2024-04-24T02:15:41.997919+0000","last_became_active":"2024-04-24T02:12:06.764339+0000","last_became_peered":"2024-04-24T02:12:06.764339+0000","last_unstale":"2024-04-24T02:15:41.997919+0000","last_undegraded":"2024-04-24T02:15:41.997919+0000","last_fullsized":"2024-04-24T02:15:41.997919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:41.997807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:41.997807+0000","last_clean_scrub_stamp":"2024-04-24T02:15:41.997807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:41:46.258937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'60","reported_seq":131,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:55.225430+0000","last_change":"2024-04-24T02:15:55.225430+0000","last_active":"2024-04-24T02:15:55.225430+0000","last_peered":"2024-04-24T02:15:55.225430+0000","last_clean":"2024-04-24T02:15:55.225430+0000","last_became_active":"2024-04-24T02:12:08.780230+0000","last_became_peered":"2024-04-24T02:12:08.780230+0000","last_unstale":"2024-04-24T02:15:55.225430+0000","last_undegraded":"2024-04-24T02:15:55.225430+0000","last_fullsized":"2024-04-24T02:15:55.225430+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'60","last_scrub_stamp":"2024-04-24T02:15:55.225237+0000","last_deep_scrub":"32'60","last_deep_scrub_stamp":"2024-04-24T02:15:55.225237+0000","last_clean_scrub_stamp":"2024-04-24T02:15:55.225237+0000","objects_scrubbed":9,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:37:16.290694+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'285","reported_seq":410,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:31.050534+0000","last_change":"2024-04-24T02:15:31.050534+0000","last_active":"2024-04-24T02:15:31.050534+0000","last_peered":"2024-04-24T02:15:31.050534+0000","last_clean":"2024-04-24T02:15:31.050534+0000","last_became_active":"2024-04-24T02:12:10.784278+0000","last_became_peered":"2024-04-24T02:12:10.784278+0000","last_unstale":"2024-04-24T02:15:31.050534+0000","last_undegraded":"2024-04-24T02:15:31.050534+0000","last_fullsized":"2024-04-24T02:15:31.050534+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-24T02:15:31.050423+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-24T02:15:31.050423+0000","last_clean_scrub_stamp":"2024-04-24T02:15:31.050423+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:20:42.675691+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"32'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:20.089986+0000","last_change":"2024-04-24T02:16:20.089986+0000","last_active":"2024-04-24T02:16:20.089986+0000","last_peered":"2024-04-24T02:16:20.089986+0000","last_clean":"2024-04-24T02:16:20.089986+0000","last_became_active":"2024-04-24T02:12:12.792569+0000","last_became_peered":"2024-04-24T02:12:12.792569+0000","last_unstale":"2024-04-24T02:16:20.089986+0000","last_undegraded":"2024-04-24T02:16:20.089986+0000","last_fullsized":"2024-04-24T02:16:20.089986+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:16:20.089856+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:16:20.089856+0000","last_clean_scrub_stamp":"2024-04-24T02:16:20.089856+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:47:36.197137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'26","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:50.416966+0000","last_change":"2024-04-24T02:15:50.416966+0000","last_active":"2024-04-24T02:15:50.416966+0000","last_peered":"2024-04-24T02:15:50.416966+0000","last_clean":"2024-04-24T02:15:50.416966+0000","last_became_active":"2024-04-24T02:12:04.752075+0000","last_became_peered":"2024-04-24T02:12:04.752075+0000","last_unstale":"2024-04-24T02:15:50.416966+0000","last_undegraded":"2024-04-24T02:15:50.416966+0000","last_fullsized":"2024-04-24T02:15:50.416966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'26","last_scrub_stamp":"2024-04-24T02:15:50.416819+0000","last_deep_scrub":"32'26","last_deep_scrub_stamp":"2024-04-24T02:15:50.416819+0000","last_clean_scrub_stamp":"2024-04-24T02:15:50.416819+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:34:38.445893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":67,"num_write":30,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:24.951494+0000","last_change":"2024-04-24T02:16:24.951494+0000","last_active":"2024-04-24T02:16:24.951494+0000","last_peered":"2024-04-24T02:16:24.951494+0000","last_clean":"2024-04-24T02:16:24.951494+0000","last_became_active":"2024-04-24T02:12:02.755468+0000","last_became_peered":"2024-04-24T02:12:02.755468+0000","last_unstale":"2024-04-24T02:16:24.951494+0000","last_undegraded":"2024-04-24T02:16:24.951494+0000","last_fullsized":"2024-04-24T02:16:24.951494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:24.951328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:24.951328+0000","last_clean_scrub_stamp":"2024-04-24T02:16:24.951328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:38:40.755222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:44.072993+0000","last_change":"2024-04-24T02:15:44.072993+0000","last_active":"2024-04-24T02:15:44.072993+0000","last_peered":"2024-04-24T02:15:44.072993+0000","last_clean":"2024-04-24T02:15:44.072993+0000","last_became_active":"2024-04-24T02:12:06.764365+0000","last_became_peered":"2024-04-24T02:12:06.764365+0000","last_unstale":"2024-04-24T02:15:44.072993+0000","last_undegraded":"2024-04-24T02:15:44.072993+0000","last_fullsized":"2024-04-24T02:15:44.072993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:44.072858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:44.072858+0000","last_clean_scrub_stamp":"2024-04-24T02:15:44.072858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:57:12.574588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'80","reported_seq":166,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:32.292044+0000","last_change":"2024-04-24T02:15:32.292044+0000","last_active":"2024-04-24T02:15:32.292044+0000","last_peered":"2024-04-24T02:15:32.292044+0000","last_clean":"2024-04-24T02:15:32.292044+0000","last_became_active":"2024-04-24T02:12:08.779602+0000","last_became_peered":"2024-04-24T02:12:08.779602+0000","last_unstale":"2024-04-24T02:15:32.292044+0000","last_undegraded":"2024-04-24T02:15:32.292044+0000","last_fullsized":"2024-04-24T02:15:32.292044+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'80","last_scrub_stamp":"2024-04-24T02:15:32.291896+0000","last_deep_scrub":"32'80","last_deep_scrub_stamp":"2024-04-24T02:15:32.291896+0000","last_clean_scrub_stamp":"2024-04-24T02:15:32.291896+0000","objects_scrubbed":7,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:08:35.878511+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:24.008622+0000","last_change":"2024-04-24T02:15:24.008622+0000","last_active":"2024-04-24T02:15:24.008622+0000","last_peered":"2024-04-24T02:15:24.008622+0000","last_clean":"2024-04-24T02:15:24.008622+0000","last_became_active":"2024-04-24T02:12:10.782121+0000","last_became_peered":"2024-04-24T02:12:10.782121+0000","last_unstale":"2024-04-24T02:15:24.008622+0000","last_undegraded":"2024-04-24T02:15:24.008622+0000","last_fullsized":"2024-04-24T02:15:24.008622+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:24.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:24.008533+0000","last_clean_scrub_stamp":"2024-04-24T02:15:24.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:46:49.817831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'21","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:43.025968+0000","last_change":"2024-04-24T02:15:43.025968+0000","last_active":"2024-04-24T02:15:43.025968+0000","last_peered":"2024-04-24T02:15:43.025968+0000","last_clean":"2024-04-24T02:15:43.025968+0000","last_became_active":"2024-04-24T02:12:12.789799+0000","last_became_peered":"2024-04-24T02:12:12.789799+0000","last_unstale":"2024-04-24T02:15:43.025968+0000","last_undegraded":"2024-04-24T02:15:43.025968+0000","last_fullsized":"2024-04-24T02:15:43.025968+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-04-24T02:15:43.025844+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-04-24T02:15:43.025844+0000","last_clean_scrub_stamp":"2024-04-24T02:15:43.025844+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:56:55.136630+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'4","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:48.475041+0000","last_change":"2024-04-24T02:15:48.475041+0000","last_active":"2024-04-24T02:15:48.475041+0000","last_peered":"2024-04-24T02:15:48.475041+0000","last_clean":"2024-04-24T02:15:48.475041+0000","last_became_active":"2024-04-24T02:12:04.766495+0000","last_became_peered":"2024-04-24T02:12:04.766495+0000","last_unstale":"2024-04-24T02:15:48.475041+0000","last_undegraded":"2024-04-24T02:15:48.475041+0000","last_fullsized":"2024-04-24T02:15:48.475041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:48.474931+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:48.474931+0000","last_clean_scrub_stamp":"2024-04-24T02:15:48.474931+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:51:50.070010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:16.107152+0000","last_change":"2024-04-24T02:16:16.107152+0000","last_active":"2024-04-24T02:16:16.107152+0000","last_peered":"2024-04-24T02:16:16.107152+0000","last_clean":"2024-04-24T02:16:16.107152+0000","last_became_active":"2024-04-24T02:12:02.743204+0000","last_became_peered":"2024-04-24T02:12:02.743204+0000","last_unstale":"2024-04-24T02:16:16.107152+0000","last_undegraded":"2024-04-24T02:16:16.107152+0000","last_fullsized":"2024-04-24T02:16:16.107152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:16.107037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:16.107037+0000","last_clean_scrub_stamp":"2024-04-24T02:16:16.107037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:31:36.700177+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:41.423774+0000","last_change":"2024-04-24T02:15:41.423774+0000","last_active":"2024-04-24T02:15:41.423774+0000","last_peered":"2024-04-24T02:15:41.423774+0000","last_clean":"2024-04-24T02:15:41.423774+0000","last_became_active":"2024-04-24T02:12:06.764676+0000","last_became_peered":"2024-04-24T02:12:06.764676+0000","last_unstale":"2024-04-24T02:15:41.423774+0000","last_undegraded":"2024-04-24T02:15:41.423774+0000","last_fullsized":"2024-04-24T02:15:41.423774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:41.423618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:41.423618+0000","last_clean_scrub_stamp":"2024-04-24T02:15:41.423618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:12:26.147935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'46","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:28.342006+0000","last_change":"2024-04-24T02:15:28.342006+0000","last_active":"2024-04-24T02:15:28.342006+0000","last_peered":"2024-04-24T02:15:28.342006+0000","last_clean":"2024-04-24T02:15:28.342006+0000","last_became_active":"2024-04-24T02:12:08.773355+0000","last_became_peered":"2024-04-24T02:12:08.773355+0000","last_unstale":"2024-04-24T02:15:28.342006+0000","last_undegraded":"2024-04-24T02:15:28.342006+0000","last_fullsized":"2024-04-24T02:15:28.342006+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-04-24T02:15:28.341829+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-04-24T02:15:28.341829+0000","last_clean_scrub_stamp":"2024-04-24T02:15:28.341829+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:44:08.114105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:52.281641+0000","last_change":"2024-04-24T02:15:52.281641+0000","last_active":"2024-04-24T02:15:52.281641+0000","last_peered":"2024-04-24T02:15:52.281641+0000","last_clean":"2024-04-24T02:15:52.281641+0000","last_became_active":"2024-04-24T02:12:10.783334+0000","last_became_peered":"2024-04-24T02:12:10.783334+0000","last_unstale":"2024-04-24T02:15:52.281641+0000","last_undegraded":"2024-04-24T02:15:52.281641+0000","last_fullsized":"2024-04-24T02:15:52.281641+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:52.281509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:52.281509+0000","last_clean_scrub_stamp":"2024-04-24T02:15:52.281509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:49:37.879213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:24.222520+0000","last_change":"2024-04-24T02:12:12.794851+0000","last_active":"2024-04-24T02:15:24.222520+0000","last_peered":"2024-04-24T02:15:24.222520+0000","last_clean":"2024-04-24T02:15:24.222520+0000","last_became_active":"2024-04-24T02:12:12.794106+0000","last_became_peered":"2024-04-24T02:12:12.794106+0000","last_unstale":"2024-04-24T02:15:24.222520+0000","last_undegraded":"2024-04-24T02:15:24.222520+0000","last_fullsized":"2024-04-24T02:15:24.222520+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:39.410553+0000","last_change":"2024-04-24T02:15:39.410553+0000","last_active":"2024-04-24T02:15:39.410553+0000","last_peered":"2024-04-24T02:15:39.410553+0000","last_clean":"2024-04-24T02:15:39.410553+0000","last_became_active":"2024-04-24T02:12:04.767376+0000","last_became_peered":"2024-04-24T02:12:04.767376+0000","last_unstale":"2024-04-24T02:15:39.410553+0000","last_undegraded":"2024-04-24T02:15:39.410553+0000","last_fullsized":"2024-04-24T02:15:39.410553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:39.410442+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:39.410442+0000","last_clean_scrub_stamp":"2024-04-24T02:15:39.410442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:46:10.073188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:27.973694+0000","last_change":"2024-04-24T02:16:27.973723+0000","last_active":"2024-04-24T02:16:27.973694+0000","last_peered":"2024-04-24T02:16:27.973694+0000","last_clean":"2024-04-24T02:16:27.973694+0000","last_became_active":"2024-04-24T02:12:02.760317+0000","last_became_peered":"2024-04-24T02:12:02.760317+0000","last_unstale":"2024-04-24T02:16:27.973694+0000","last_undegraded":"2024-04-24T02:16:27.973694+0000","last_fullsized":"2024-04-24T02:16:27.973694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:16:27.973596+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:16:27.973596+0000","last_clean_scrub_stamp":"2024-04-24T02:16:27.973596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:49:23.050957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:16.633686+0000","last_change":"2024-04-24T02:16:16.633710+0000","last_active":"2024-04-24T02:16:16.633686+0000","last_peered":"2024-04-24T02:16:16.633686+0000","last_clean":"2024-04-24T02:16:16.633686+0000","last_became_active":"2024-04-24T02:12:45.811272+0000","last_became_peered":"2024-04-24T02:12:45.811272+0000","last_unstale":"2024-04-24T02:16:16.633686+0000","last_undegraded":"2024-04-24T02:16:16.633686+0000","last_fullsized":"2024-04-24T02:16:16.633686+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:16.633597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:16.633597+0000","last_clean_scrub_stamp":"2024-04-24T02:16:16.633597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:06:36.308100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"32'46","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:37.398336+0000","last_change":"2024-04-24T02:15:37.398336+0000","last_active":"2024-04-24T02:15:37.398336+0000","last_peered":"2024-04-24T02:15:37.398336+0000","last_clean":"2024-04-24T02:15:37.398336+0000","last_became_active":"2024-04-24T02:12:08.769307+0000","last_became_peered":"2024-04-24T02:12:08.769307+0000","last_unstale":"2024-04-24T02:15:37.398336+0000","last_undegraded":"2024-04-24T02:15:37.398336+0000","last_fullsized":"2024-04-24T02:15:37.398336+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-04-24T02:15:37.398209+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-04-24T02:15:37.398209+0000","last_clean_scrub_stamp":"2024-04-24T02:15:37.398209+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:44:17.170485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'285","reported_seq":416,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:29.489068+0000","last_change":"2024-04-24T02:15:29.489068+0000","last_active":"2024-04-24T02:15:29.489068+0000","last_peered":"2024-04-24T02:15:29.489068+0000","last_clean":"2024-04-24T02:15:29.489068+0000","last_became_active":"2024-04-24T02:12:10.778972+0000","last_became_peered":"2024-04-24T02:12:10.778972+0000","last_unstale":"2024-04-24T02:15:29.489068+0000","last_undegraded":"2024-04-24T02:15:29.489068+0000","last_fullsized":"2024-04-24T02:15:29.489068+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-24T02:15:29.488953+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-24T02:15:29.488953+0000","last_clean_scrub_stamp":"2024-04-24T02:15:29.488953+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:12:38.822890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'13","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:47.025859+0000","last_change":"2024-04-24T02:15:47.025859+0000","last_active":"2024-04-24T02:15:47.025859+0000","last_peered":"2024-04-24T02:15:47.025859+0000","last_clean":"2024-04-24T02:15:47.025859+0000","last_became_active":"2024-04-24T02:12:12.790353+0000","last_became_peered":"2024-04-24T02:12:12.790353+0000","last_unstale":"2024-04-24T02:15:47.025859+0000","last_undegraded":"2024-04-24T02:15:47.025859+0000","last_fullsized":"2024-04-24T02:15:47.025859+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'13","last_scrub_stamp":"2024-04-24T02:15:47.025741+0000","last_deep_scrub":"32'13","last_deep_scrub_stamp":"2024-04-24T02:15:47.025741+0000","last_clean_scrub_stamp":"2024-04-24T02:15:47.025741+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:19:56.625015+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'10","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:54.425801+0000","last_change":"2024-04-24T02:15:54.425801+0000","last_active":"2024-04-24T02:15:54.425801+0000","last_peered":"2024-04-24T02:15:54.425801+0000","last_clean":"2024-04-24T02:15:54.425801+0000","last_became_active":"2024-04-24T02:12:04.760020+0000","last_became_peered":"2024-04-24T02:12:04.760020+0000","last_unstale":"2024-04-24T02:15:54.425801+0000","last_undegraded":"2024-04-24T02:15:54.425801+0000","last_fullsized":"2024-04-24T02:15:54.425801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-24T02:15:54.425644+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-24T02:15:54.425644+0000","last_clean_scrub_stamp":"2024-04-24T02:15:54.425644+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:03:33.088095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:30.937125+0000","last_change":"2024-04-24T02:16:30.937150+0000","last_active":"2024-04-24T02:16:30.937125+0000","last_peered":"2024-04-24T02:16:30.937125+0000","last_clean":"2024-04-24T02:16:30.937125+0000","last_became_active":"2024-04-24T02:12:02.753593+0000","last_became_peered":"2024-04-24T02:12:02.753593+0000","last_unstale":"2024-04-24T02:16:30.937125+0000","last_undegraded":"2024-04-24T02:16:30.937125+0000","last_fullsized":"2024-04-24T02:16:30.937125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:16:30.937034+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:16:30.937034+0000","last_clean_scrub_stamp":"2024-04-24T02:16:30.937034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:51:39.470869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'5","reported_seq":429,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:37.435417+0000","last_change":"2024-04-24T02:15:37.435417+0000","last_active":"2024-04-24T02:15:37.435417+0000","last_peered":"2024-04-24T02:15:37.435417+0000","last_clean":"2024-04-24T02:15:37.435417+0000","last_became_active":"2024-04-24T02:12:06.758759+0000","last_became_peered":"2024-04-24T02:12:06.758759+0000","last_unstale":"2024-04-24T02:15:37.435417+0000","last_undegraded":"2024-04-24T02:15:37.435417+0000","last_fullsized":"2024-04-24T02:15:37.435417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-04-24T02:15:37.435273+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-04-24T02:15:37.435273+0000","last_clean_scrub_stamp":"2024-04-24T02:15:37.435273+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:57:22.943957+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'16","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:50.257229+0000","last_change":"2024-04-24T02:15:50.257229+0000","last_active":"2024-04-24T02:15:50.257229+0000","last_peered":"2024-04-24T02:15:50.257229+0000","last_clean":"2024-04-24T02:15:50.257229+0000","last_became_active":"2024-04-24T02:12:08.783011+0000","last_became_peered":"2024-04-24T02:12:08.783011+0000","last_unstale":"2024-04-24T02:15:50.257229+0000","last_undegraded":"2024-04-24T02:15:50.257229+0000","last_fullsized":"2024-04-24T02:15:50.257229+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-04-24T02:15:50.257112+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-04-24T02:15:50.257112+0000","last_clean_scrub_stamp":"2024-04-24T02:15:50.257112+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:22:29.994017+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'285","reported_seq":472,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:23.427935+0000","last_change":"2024-04-24T02:15:23.427935+0000","last_active":"2024-04-24T02:15:23.427935+0000","last_peered":"2024-04-24T02:15:23.427935+0000","last_clean":"2024-04-24T02:15:23.427935+0000","last_became_active":"2024-04-24T02:12:10.777222+0000","last_became_peered":"2024-04-24T02:12:10.777222+0000","last_unstale":"2024-04-24T02:15:23.427935+0000","last_undegraded":"2024-04-24T02:15:23.427935+0000","last_fullsized":"2024-04-24T02:15:23.427935+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-24T02:15:23.427820+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-24T02:15:23.427820+0000","last_clean_scrub_stamp":"2024-04-24T02:15:23.427820+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:37:31.031708+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:34.439653+0000","last_change":"2024-04-24T02:15:34.439653+0000","last_active":"2024-04-24T02:15:34.439653+0000","last_peered":"2024-04-24T02:15:34.439653+0000","last_clean":"2024-04-24T02:15:34.439653+0000","last_became_active":"2024-04-24T02:12:12.795204+0000","last_became_peered":"2024-04-24T02:12:12.795204+0000","last_unstale":"2024-04-24T02:15:34.439653+0000","last_undegraded":"2024-04-24T02:15:34.439653+0000","last_fullsized":"2024-04-24T02:15:34.439653+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:34.439501+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:34.439501+0000","last_clean_scrub_stamp":"2024-04-24T02:15:34.439501+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:22:10.202353+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'4","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:47.428572+0000","last_change":"2024-04-24T02:15:47.428572+0000","last_active":"2024-04-24T02:15:47.428572+0000","last_peered":"2024-04-24T02:15:47.428572+0000","last_clean":"2024-04-24T02:15:47.428572+0000","last_became_active":"2024-04-24T02:12:04.766540+0000","last_became_peered":"2024-04-24T02:12:04.766540+0000","last_unstale":"2024-04-24T02:15:47.428572+0000","last_undegraded":"2024-04-24T02:15:47.428572+0000","last_fullsized":"2024-04-24T02:15:47.428572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:47.428451+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:47.428451+0000","last_clean_scrub_stamp":"2024-04-24T02:15:47.428451+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:03:39.887590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"32'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:25.969192+0000","last_change":"2024-04-24T02:16:25.969231+0000","last_active":"2024-04-24T02:16:25.969192+0000","last_peered":"2024-04-24T02:16:25.969192+0000","last_clean":"2024-04-24T02:16:25.969192+0000","last_became_active":"2024-04-24T02:12:02.757717+0000","last_became_peered":"2024-04-24T02:12:02.757717+0000","last_unstale":"2024-04-24T02:16:25.969192+0000","last_undegraded":"2024-04-24T02:16:25.969192+0000","last_fullsized":"2024-04-24T02:16:25.969192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:16:25.969097+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:16:25.969097+0000","last_clean_scrub_stamp":"2024-04-24T02:16:25.969097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:51:04.996035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:25.340837+0000","last_change":"2024-04-24T02:15:25.340837+0000","last_active":"2024-04-24T02:15:25.340837+0000","last_peered":"2024-04-24T02:15:25.340837+0000","last_clean":"2024-04-24T02:15:25.340837+0000","last_became_active":"2024-04-24T02:12:06.758452+0000","last_became_peered":"2024-04-24T02:12:06.758452+0000","last_unstale":"2024-04-24T02:15:25.340837+0000","last_undegraded":"2024-04-24T02:15:25.340837+0000","last_fullsized":"2024-04-24T02:15:25.340837+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:25.340704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:25.340704+0000","last_clean_scrub_stamp":"2024-04-24T02:15:25.340704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:51:26.935783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'50","reported_seq":110,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:29.358770+0000","last_change":"2024-04-24T02:15:29.358770+0000","last_active":"2024-04-24T02:15:29.358770+0000","last_peered":"2024-04-24T02:15:29.358770+0000","last_clean":"2024-04-24T02:15:29.358770+0000","last_became_active":"2024-04-24T02:12:08.773319+0000","last_became_peered":"2024-04-24T02:12:08.773319+0000","last_unstale":"2024-04-24T02:15:29.358770+0000","last_undegraded":"2024-04-24T02:15:29.358770+0000","last_fullsized":"2024-04-24T02:15:29.358770+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'50","last_scrub_stamp":"2024-04-24T02:15:29.358602+0000","last_deep_scrub":"32'50","last_deep_scrub_stamp":"2024-04-24T02:15:29.358602+0000","last_clean_scrub_stamp":"2024-04-24T02:15:29.358602+0000","objects_scrubbed":8,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:42:17.124195+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":52,"num_read_kb":50,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:26.426964+0000","last_change":"2024-04-24T02:15:26.426964+0000","last_active":"2024-04-24T02:15:26.426964+0000","last_peered":"2024-04-24T02:15:26.426964+0000","last_clean":"2024-04-24T02:15:26.426964+0000","last_became_active":"2024-04-24T02:12:10.786998+0000","last_became_peered":"2024-04-24T02:12:10.786998+0000","last_unstale":"2024-04-24T02:15:26.426964+0000","last_undegraded":"2024-04-24T02:15:26.426964+0000","last_fullsized":"2024-04-24T02:15:26.426964+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:26.426853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:26.426853+0000","last_clean_scrub_stamp":"2024-04-24T02:15:26.426853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:33:27.255344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'6","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:42.419648+0000","last_change":"2024-04-24T02:15:42.419648+0000","last_active":"2024-04-24T02:15:42.419648+0000","last_peered":"2024-04-24T02:15:42.419648+0000","last_clean":"2024-04-24T02:15:42.419648+0000","last_became_active":"2024-04-24T02:12:12.793724+0000","last_became_peered":"2024-04-24T02:12:12.793724+0000","last_unstale":"2024-04-24T02:15:42.419648+0000","last_undegraded":"2024-04-24T02:15:42.419648+0000","last_fullsized":"2024-04-24T02:15:42.419648+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-24T02:15:42.419486+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-24T02:15:42.419486+0000","last_clean_scrub_stamp":"2024-04-24T02:15:42.419486+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:57:44.867375+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'4","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:02.059158+0000","last_change":"2024-04-24T02:16:02.059158+0000","last_active":"2024-04-24T02:16:02.059158+0000","last_peered":"2024-04-24T02:16:02.059158+0000","last_clean":"2024-04-24T02:16:02.059158+0000","last_became_active":"2024-04-24T02:12:04.763246+0000","last_became_peered":"2024-04-24T02:12:04.763246+0000","last_unstale":"2024-04-24T02:16:02.059158+0000","last_undegraded":"2024-04-24T02:16:02.059158+0000","last_fullsized":"2024-04-24T02:16:02.059158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:16:02.059045+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:16:02.059045+0000","last_clean_scrub_stamp":"2024-04-24T02:16:02.059045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:09:22.494946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"32'119","reported_seq":211,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:08.489843+0000","last_change":"2024-04-24T02:16:08.489878+0000","last_active":"2024-04-24T02:16:08.489843+0000","last_peered":"2024-04-24T02:16:08.489843+0000","last_clean":"2024-04-24T02:16:08.489843+0000","last_became_active":"2024-04-24T02:11:51.989479+0000","last_became_peered":"2024-04-24T02:11:51.989479+0000","last_unstale":"2024-04-24T02:16:08.489843+0000","last_undegraded":"2024-04-24T02:16:08.489843+0000","last_fullsized":"2024-04-24T02:16:08.489843+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2024-04-24T02:16:08.489759+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2024-04-24T02:16:08.489759+0000","last_clean_scrub_stamp":"2024-04-24T02:16:08.489759+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:35:08.296192+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:37.054573+0000","last_change":"2024-04-24T02:16:37.054600+0000","last_active":"2024-04-24T02:16:37.054573+0000","last_peered":"2024-04-24T02:16:37.054573+0000","last_clean":"2024-04-24T02:16:37.054573+0000","last_became_active":"2024-04-24T02:11:56.723925+0000","last_became_peered":"2024-04-24T02:11:56.723925+0000","last_unstale":"2024-04-24T02:16:37.054573+0000","last_undegraded":"2024-04-24T02:16:37.054573+0000","last_fullsized":"2024-04-24T02:16:37.054573+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:37.054479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:37.054479+0000","last_clean_scrub_stamp":"2024-04-24T02:16:37.054479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:34:04.723510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:23.921165+0000","last_change":"2024-04-24T02:16:23.921193+0000","last_active":"2024-04-24T02:16:23.921165+0000","last_peered":"2024-04-24T02:16:23.921165+0000","last_clean":"2024-04-24T02:16:23.921165+0000","last_became_active":"2024-04-24T02:12:02.758653+0000","last_became_peered":"2024-04-24T02:12:02.758653+0000","last_unstale":"2024-04-24T02:16:23.921165+0000","last_undegraded":"2024-04-24T02:16:23.921165+0000","last_fullsized":"2024-04-24T02:16:23.921165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:23.921070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:23.921070+0000","last_clean_scrub_stamp":"2024-04-24T02:16:23.921070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:52:22.520467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"32'2","reported_seq":231,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:40.433788+0000","last_change":"2024-04-24T02:15:40.433788+0000","last_active":"2024-04-24T02:15:40.433788+0000","last_peered":"2024-04-24T02:15:40.433788+0000","last_clean":"2024-04-24T02:15:40.433788+0000","last_became_active":"2024-04-24T02:12:06.757173+0000","last_became_peered":"2024-04-24T02:12:06.757173+0000","last_unstale":"2024-04-24T02:15:40.433788+0000","last_undegraded":"2024-04-24T02:15:40.433788+0000","last_fullsized":"2024-04-24T02:15:40.433788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:15:40.433600+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:15:40.433600+0000","last_clean_scrub_stamp":"2024-04-24T02:15:40.433600+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:15:32.722410+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'97","reported_seq":194,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:57.179565+0000","last_change":"2024-04-24T02:15:57.179565+0000","last_active":"2024-04-24T02:15:57.179565+0000","last_peered":"2024-04-24T02:15:57.179565+0000","last_clean":"2024-04-24T02:15:57.179565+0000","last_became_active":"2024-04-24T02:12:08.780923+0000","last_became_peered":"2024-04-24T02:12:08.780923+0000","last_unstale":"2024-04-24T02:15:57.179565+0000","last_undegraded":"2024-04-24T02:15:57.179565+0000","last_fullsized":"2024-04-24T02:15:57.179565+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'97","last_scrub_stamp":"2024-04-24T02:15:57.179395+0000","last_deep_scrub":"32'97","last_deep_scrub_stamp":"2024-04-24T02:15:57.179395+0000","last_clean_scrub_stamp":"2024-04-24T02:15:57.179395+0000","objects_scrubbed":6,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:43:51.704639+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:22.973909+0000","last_change":"2024-04-24T02:15:22.973909+0000","last_active":"2024-04-24T02:15:22.973909+0000","last_peered":"2024-04-24T02:15:22.973909+0000","last_clean":"2024-04-24T02:15:22.973909+0000","last_became_active":"2024-04-24T02:12:10.784101+0000","last_became_peered":"2024-04-24T02:12:10.784101+0000","last_unstale":"2024-04-24T02:15:22.973909+0000","last_undegraded":"2024-04-24T02:15:22.973909+0000","last_fullsized":"2024-04-24T02:15:22.973909+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:22.973820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:22.973820+0000","last_clean_scrub_stamp":"2024-04-24T02:15:22.973820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:09:23.273019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'81","reported_seq":172,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:38.392125+0000","last_change":"2024-04-24T02:15:38.392125+0000","last_active":"2024-04-24T02:15:38.392125+0000","last_peered":"2024-04-24T02:15:38.392125+0000","last_clean":"2024-04-24T02:15:38.392125+0000","last_became_active":"2024-04-24T02:12:12.795281+0000","last_became_peered":"2024-04-24T02:12:12.795281+0000","last_unstale":"2024-04-24T02:15:38.392125+0000","last_undegraded":"2024-04-24T02:15:38.392125+0000","last_fullsized":"2024-04-24T02:15:38.392125+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'81","last_scrub_stamp":"2024-04-24T02:15:38.392009+0000","last_deep_scrub":"32'81","last_deep_scrub_stamp":"2024-04-24T02:15:38.392009+0000","last_clean_scrub_stamp":"2024-04-24T02:15:38.392009+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:42:26.157602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'6","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:03.023374+0000","last_change":"2024-04-24T02:16:03.023374+0000","last_active":"2024-04-24T02:16:03.023374+0000","last_peered":"2024-04-24T02:16:03.023374+0000","last_clean":"2024-04-24T02:16:03.023374+0000","last_became_active":"2024-04-24T02:12:04.763782+0000","last_became_peered":"2024-04-24T02:12:04.763782+0000","last_unstale":"2024-04-24T02:16:03.023374+0000","last_undegraded":"2024-04-24T02:16:03.023374+0000","last_fullsized":"2024-04-24T02:16:03.023374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-24T02:16:03.023245+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-24T02:16:03.023245+0000","last_clean_scrub_stamp":"2024-04-24T02:16:03.023245+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:51:33.505831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:34.999730+0000","last_change":"2024-04-24T02:16:34.999787+0000","last_active":"2024-04-24T02:16:34.999730+0000","last_peered":"2024-04-24T02:16:34.999730+0000","last_clean":"2024-04-24T02:16:34.999730+0000","last_became_active":"2024-04-24T02:11:56.723682+0000","last_became_peered":"2024-04-24T02:11:56.723682+0000","last_unstale":"2024-04-24T02:16:34.999730+0000","last_undegraded":"2024-04-24T02:16:34.999730+0000","last_fullsized":"2024-04-24T02:16:34.999730+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:34.999622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:34.999622+0000","last_clean_scrub_stamp":"2024-04-24T02:16:34.999622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:41:54.118931+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"30'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:14.122870+0000","last_change":"2024-04-24T02:16:14.122898+0000","last_active":"2024-04-24T02:16:14.122870+0000","last_peered":"2024-04-24T02:16:14.122870+0000","last_clean":"2024-04-24T02:16:14.122870+0000","last_became_active":"2024-04-24T02:12:02.741610+0000","last_became_peered":"2024-04-24T02:12:02.741610+0000","last_unstale":"2024-04-24T02:16:14.122870+0000","last_undegraded":"2024-04-24T02:16:14.122870+0000","last_fullsized":"2024-04-24T02:16:14.122870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-24T02:16:14.122778+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-24T02:16:14.122778+0000","last_clean_scrub_stamp":"2024-04-24T02:16:14.122778+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:48:58.800845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:29.348651+0000","last_change":"2024-04-24T02:15:29.348651+0000","last_active":"2024-04-24T02:15:29.348651+0000","last_peered":"2024-04-24T02:15:29.348651+0000","last_clean":"2024-04-24T02:15:29.348651+0000","last_became_active":"2024-04-24T02:12:06.757052+0000","last_became_peered":"2024-04-24T02:12:06.757052+0000","last_unstale":"2024-04-24T02:15:29.348651+0000","last_undegraded":"2024-04-24T02:15:29.348651+0000","last_fullsized":"2024-04-24T02:15:29.348651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:29.348489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:29.348489+0000","last_clean_scrub_stamp":"2024-04-24T02:15:29.348489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:42:27.569911+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'298","reported_seq":530,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:25.387698+0000","last_change":"2024-04-24T02:15:25.387698+0000","last_active":"2024-04-24T02:15:25.387698+0000","last_peered":"2024-04-24T02:15:25.387698+0000","last_clean":"2024-04-24T02:15:25.387698+0000","last_became_active":"2024-04-24T02:12:08.779884+0000","last_became_peered":"2024-04-24T02:12:08.779884+0000","last_unstale":"2024-04-24T02:15:25.387698+0000","last_undegraded":"2024-04-24T02:15:25.387698+0000","last_fullsized":"2024-04-24T02:15:25.387698+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'298","last_scrub_stamp":"2024-04-24T02:15:25.387551+0000","last_deep_scrub":"32'298","last_deep_scrub_stamp":"2024-04-24T02:15:25.387551+0000","last_clean_scrub_stamp":"2024-04-24T02:15:25.387551+0000","objects_scrubbed":11,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:22:01.150403+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:48.289647+0000","last_change":"2024-04-24T02:15:48.289647+0000","last_active":"2024-04-24T02:15:48.289647+0000","last_peered":"2024-04-24T02:15:48.289647+0000","last_clean":"2024-04-24T02:15:48.289647+0000","last_became_active":"2024-04-24T02:12:10.783788+0000","last_became_peered":"2024-04-24T02:12:10.783788+0000","last_unstale":"2024-04-24T02:15:48.289647+0000","last_undegraded":"2024-04-24T02:15:48.289647+0000","last_fullsized":"2024-04-24T02:15:48.289647+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:48.289533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:48.289533+0000","last_clean_scrub_stamp":"2024-04-24T02:15:48.289533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:38:32.091995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:17.354428+0000","last_change":"2024-04-24T02:16:17.354428+0000","last_active":"2024-04-24T02:16:17.354428+0000","last_peered":"2024-04-24T02:16:17.354428+0000","last_clean":"2024-04-24T02:16:17.354428+0000","last_became_active":"2024-04-24T02:12:12.795983+0000","last_became_peered":"2024-04-24T02:12:12.795983+0000","last_unstale":"2024-04-24T02:16:17.354428+0000","last_undegraded":"2024-04-24T02:16:17.354428+0000","last_fullsized":"2024-04-24T02:16:17.354428+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-04-24T02:16:17.354318+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-04-24T02:16:17.354318+0000","last_clean_scrub_stamp":"2024-04-24T02:16:17.354318+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:55:36.541244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'22","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:03.109255+0000","last_change":"2024-04-24T02:16:03.109255+0000","last_active":"2024-04-24T02:16:03.109255+0000","last_peered":"2024-04-24T02:16:03.109255+0000","last_clean":"2024-04-24T02:16:03.109255+0000","last_became_active":"2024-04-24T02:12:04.755649+0000","last_became_peered":"2024-04-24T02:12:04.755649+0000","last_unstale":"2024-04-24T02:16:03.109255+0000","last_undegraded":"2024-04-24T02:16:03.109255+0000","last_fullsized":"2024-04-24T02:16:03.109255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-04-24T02:16:03.109129+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-04-24T02:16:03.109129+0000","last_clean_scrub_stamp":"2024-04-24T02:16:03.109129+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:48:56.829580+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":72,"num_write":29,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:04.417966+0000","last_change":"2024-04-24T02:16:04.417966+0000","last_active":"2024-04-24T02:16:04.417966+0000","last_peered":"2024-04-24T02:16:04.417966+0000","last_clean":"2024-04-24T02:16:04.417966+0000","last_became_active":"2024-04-24T02:11:56.723497+0000","last_became_peered":"2024-04-24T02:11:56.723497+0000","last_unstale":"2024-04-24T02:16:04.417966+0000","last_undegraded":"2024-04-24T02:16:04.417966+0000","last_fullsized":"2024-04-24T02:16:04.417966+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:04.417852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:04.417852+0000","last_clean_scrub_stamp":"2024-04-24T02:16:04.417852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:09:08.004466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:08.119846+0000","last_change":"2024-04-24T02:16:08.119873+0000","last_active":"2024-04-24T02:16:08.119846+0000","last_peered":"2024-04-24T02:16:08.119846+0000","last_clean":"2024-04-24T02:16:08.119846+0000","last_became_active":"2024-04-24T02:12:02.745238+0000","last_became_peered":"2024-04-24T02:12:02.745238+0000","last_unstale":"2024-04-24T02:16:08.119846+0000","last_undegraded":"2024-04-24T02:16:08.119846+0000","last_fullsized":"2024-04-24T02:16:08.119846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:16:08.119755+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:16:08.119755+0000","last_clean_scrub_stamp":"2024-04-24T02:16:08.119755+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:39:50.616597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:45.478024+0000","last_change":"2024-04-24T02:15:45.478024+0000","last_active":"2024-04-24T02:15:45.478024+0000","last_peered":"2024-04-24T02:15:45.478024+0000","last_clean":"2024-04-24T02:15:45.478024+0000","last_became_active":"2024-04-24T02:12:06.757009+0000","last_became_peered":"2024-04-24T02:12:06.757009+0000","last_unstale":"2024-04-24T02:15:45.478024+0000","last_undegraded":"2024-04-24T02:15:45.478024+0000","last_fullsized":"2024-04-24T02:15:45.478024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:15:45.477913+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:15:45.477913+0000","last_clean_scrub_stamp":"2024-04-24T02:15:45.477913+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:36:40.614952+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'23","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:35.426698+0000","last_change":"2024-04-24T02:15:35.426698+0000","last_active":"2024-04-24T02:15:35.426698+0000","last_peered":"2024-04-24T02:15:35.426698+0000","last_clean":"2024-04-24T02:15:35.426698+0000","last_became_active":"2024-04-24T02:12:08.774177+0000","last_became_peered":"2024-04-24T02:12:08.774177+0000","last_unstale":"2024-04-24T02:15:35.426698+0000","last_undegraded":"2024-04-24T02:15:35.426698+0000","last_fullsized":"2024-04-24T02:15:35.426698+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2024-04-24T02:15:35.426543+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2024-04-24T02:15:35.426543+0000","last_clean_scrub_stamp":"2024-04-24T02:15:35.426543+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:20:39.513825+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:27.053503+0000","last_change":"2024-04-24T02:15:27.053503+0000","last_active":"2024-04-24T02:15:27.053503+0000","last_peered":"2024-04-24T02:15:27.053503+0000","last_clean":"2024-04-24T02:15:27.053503+0000","last_became_active":"2024-04-24T02:12:10.784247+0000","last_became_peered":"2024-04-24T02:12:10.784247+0000","last_unstale":"2024-04-24T02:15:27.053503+0000","last_undegraded":"2024-04-24T02:15:27.053503+0000","last_fullsized":"2024-04-24T02:15:27.053503+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:27.053381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:27.053381+0000","last_clean_scrub_stamp":"2024-04-24T02:15:27.053381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:58:59.706713+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:30.041437+0000","last_change":"2024-04-24T02:12:12.794755+0000","last_active":"2024-04-24T02:14:30.041437+0000","last_peered":"2024-04-24T02:14:30.041437+0000","last_clean":"2024-04-24T02:14:30.041437+0000","last_became_active":"2024-04-24T02:12:12.794453+0000","last_became_peered":"2024-04-24T02:12:12.794453+0000","last_unstale":"2024-04-24T02:14:30.041437+0000","last_undegraded":"2024-04-24T02:14:30.041437+0000","last_fullsized":"2024-04-24T02:14:30.041437+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:53.131001+0000","last_change":"2024-04-24T02:15:53.131001+0000","last_active":"2024-04-24T02:15:53.131001+0000","last_peered":"2024-04-24T02:15:53.131001+0000","last_clean":"2024-04-24T02:15:53.131001+0000","last_became_active":"2024-04-24T02:12:04.749173+0000","last_became_peered":"2024-04-24T02:12:04.749173+0000","last_unstale":"2024-04-24T02:15:53.131001+0000","last_undegraded":"2024-04-24T02:15:53.131001+0000","last_fullsized":"2024-04-24T02:15:53.131001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:53.130876+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:53.130876+0000","last_clean_scrub_stamp":"2024-04-24T02:15:53.130876+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:46:26.214015+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:34.019344+0000","last_change":"2024-04-24T02:16:34.019399+0000","last_active":"2024-04-24T02:16:34.019344+0000","last_peered":"2024-04-24T02:16:34.019344+0000","last_clean":"2024-04-24T02:16:34.019344+0000","last_became_active":"2024-04-24T02:11:56.723125+0000","last_became_peered":"2024-04-24T02:11:56.723125+0000","last_unstale":"2024-04-24T02:16:34.019344+0000","last_undegraded":"2024-04-24T02:16:34.019344+0000","last_fullsized":"2024-04-24T02:16:34.019344+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:34.019242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:34.019242+0000","last_clean_scrub_stamp":"2024-04-24T02:16:34.019242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:15:39.276159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:08.463784+0000","last_change":"2024-04-24T02:16:08.463784+0000","last_active":"2024-04-24T02:16:08.463784+0000","last_peered":"2024-04-24T02:16:08.463784+0000","last_clean":"2024-04-24T02:16:08.463784+0000","last_became_active":"2024-04-24T02:12:02.746682+0000","last_became_peered":"2024-04-24T02:12:02.746682+0000","last_unstale":"2024-04-24T02:16:08.463784+0000","last_undegraded":"2024-04-24T02:16:08.463784+0000","last_fullsized":"2024-04-24T02:16:08.463784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:08.463630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:08.463630+0000","last_clean_scrub_stamp":"2024-04-24T02:16:08.463630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:42:27.800308+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:45.033384+0000","last_change":"2024-04-24T02:15:45.033384+0000","last_active":"2024-04-24T02:15:45.033384+0000","last_peered":"2024-04-24T02:15:45.033384+0000","last_clean":"2024-04-24T02:15:45.033384+0000","last_became_active":"2024-04-24T02:12:06.759169+0000","last_became_peered":"2024-04-24T02:12:06.759169+0000","last_unstale":"2024-04-24T02:15:45.033384+0000","last_undegraded":"2024-04-24T02:15:45.033384+0000","last_fullsized":"2024-04-24T02:15:45.033384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:45.033265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:45.033265+0000","last_clean_scrub_stamp":"2024-04-24T02:15:45.033265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:08:16.728687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'20","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:51.254261+0000","last_change":"2024-04-24T02:15:51.254261+0000","last_active":"2024-04-24T02:15:51.254261+0000","last_peered":"2024-04-24T02:15:51.254261+0000","last_clean":"2024-04-24T02:15:51.254261+0000","last_became_active":"2024-04-24T02:12:08.782765+0000","last_became_peered":"2024-04-24T02:12:08.782765+0000","last_unstale":"2024-04-24T02:15:51.254261+0000","last_undegraded":"2024-04-24T02:15:51.254261+0000","last_fullsized":"2024-04-24T02:15:51.254261+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-04-24T02:15:51.254102+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-04-24T02:15:51.254102+0000","last_clean_scrub_stamp":"2024-04-24T02:15:51.254102+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:26:37.436707+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:56.210473+0000","last_change":"2024-04-24T02:15:56.210473+0000","last_active":"2024-04-24T02:15:56.210473+0000","last_peered":"2024-04-24T02:15:56.210473+0000","last_clean":"2024-04-24T02:15:56.210473+0000","last_became_active":"2024-04-24T02:12:10.783813+0000","last_became_peered":"2024-04-24T02:12:10.783813+0000","last_unstale":"2024-04-24T02:15:56.210473+0000","last_undegraded":"2024-04-24T02:15:56.210473+0000","last_fullsized":"2024-04-24T02:15:56.210473+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:56.210358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:56.210358+0000","last_clean_scrub_stamp":"2024-04-24T02:15:56.210358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:46:40.354519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:19.411350+0000","last_change":"2024-04-24T02:16:19.411350+0000","last_active":"2024-04-24T02:16:19.411350+0000","last_peered":"2024-04-24T02:16:19.411350+0000","last_clean":"2024-04-24T02:16:19.411350+0000","last_became_active":"2024-04-24T02:12:12.796507+0000","last_became_peered":"2024-04-24T02:12:12.796507+0000","last_unstale":"2024-04-24T02:16:19.411350+0000","last_undegraded":"2024-04-24T02:16:19.411350+0000","last_fullsized":"2024-04-24T02:16:19.411350+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:16:19.411223+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:16:19.411223+0000","last_clean_scrub_stamp":"2024-04-24T02:16:19.411223+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:47:03.555384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:44.357865+0000","last_change":"2024-04-24T02:15:44.357865+0000","last_active":"2024-04-24T02:15:44.357865+0000","last_peered":"2024-04-24T02:15:44.357865+0000","last_clean":"2024-04-24T02:15:44.357865+0000","last_became_active":"2024-04-24T02:12:04.767221+0000","last_became_peered":"2024-04-24T02:12:04.767221+0000","last_unstale":"2024-04-24T02:15:44.357865+0000","last_undegraded":"2024-04-24T02:15:44.357865+0000","last_fullsized":"2024-04-24T02:15:44.357865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:44.357687+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:44.357687+0000","last_clean_scrub_stamp":"2024-04-24T02:15:44.357687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:44:16.884604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:09.511028+0000","last_change":"2024-04-24T02:16:09.511028+0000","last_active":"2024-04-24T02:16:09.511028+0000","last_peered":"2024-04-24T02:16:09.511028+0000","last_clean":"2024-04-24T02:16:09.511028+0000","last_became_active":"2024-04-24T02:12:02.744161+0000","last_became_peered":"2024-04-24T02:12:02.744161+0000","last_unstale":"2024-04-24T02:16:09.511028+0000","last_undegraded":"2024-04-24T02:16:09.511028+0000","last_fullsized":"2024-04-24T02:16:09.511028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:09.510908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:09.510908+0000","last_clean_scrub_stamp":"2024-04-24T02:16:09.510908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:10:49.112570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:10.053515+0000","last_change":"2024-04-24T02:16:10.053540+0000","last_active":"2024-04-24T02:16:10.053515+0000","last_peered":"2024-04-24T02:16:10.053515+0000","last_clean":"2024-04-24T02:16:10.053515+0000","last_became_active":"2024-04-24T02:11:56.723697+0000","last_became_peered":"2024-04-24T02:11:56.723697+0000","last_unstale":"2024-04-24T02:16:10.053515+0000","last_undegraded":"2024-04-24T02:16:10.053515+0000","last_fullsized":"2024-04-24T02:16:10.053515+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:10.053432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:10.053432+0000","last_clean_scrub_stamp":"2024-04-24T02:16:10.053432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:38:15.927351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:45.989705+0000","last_change":"2024-04-24T02:15:45.989705+0000","last_active":"2024-04-24T02:15:45.989705+0000","last_peered":"2024-04-24T02:15:45.989705+0000","last_clean":"2024-04-24T02:15:45.989705+0000","last_became_active":"2024-04-24T02:12:06.759160+0000","last_became_peered":"2024-04-24T02:12:06.759160+0000","last_unstale":"2024-04-24T02:15:45.989705+0000","last_undegraded":"2024-04-24T02:15:45.989705+0000","last_fullsized":"2024-04-24T02:15:45.989705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:15:45.989545+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:15:45.989545+0000","last_clean_scrub_stamp":"2024-04-24T02:15:45.989545+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:56:06.540361+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'87","reported_seq":176,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:33.030400+0000","last_change":"2024-04-24T02:15:33.030400+0000","last_active":"2024-04-24T02:15:33.030400+0000","last_peered":"2024-04-24T02:15:33.030400+0000","last_clean":"2024-04-24T02:15:33.030400+0000","last_became_active":"2024-04-24T02:12:08.780688+0000","last_became_peered":"2024-04-24T02:12:08.780688+0000","last_unstale":"2024-04-24T02:15:33.030400+0000","last_undegraded":"2024-04-24T02:15:33.030400+0000","last_fullsized":"2024-04-24T02:15:33.030400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'87","last_scrub_stamp":"2024-04-24T02:15:33.030249+0000","last_deep_scrub":"32'87","last_deep_scrub_stamp":"2024-04-24T02:15:33.030249+0000","last_clean_scrub_stamp":"2024-04-24T02:15:33.030249+0000","objects_scrubbed":11,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:20:07.673923+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":89,"num_read_kb":75,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:25.419767+0000","last_change":"2024-04-24T02:15:25.419767+0000","last_active":"2024-04-24T02:15:25.419767+0000","last_peered":"2024-04-24T02:15:25.419767+0000","last_clean":"2024-04-24T02:15:25.419767+0000","last_became_active":"2024-04-24T02:12:10.781586+0000","last_became_peered":"2024-04-24T02:12:10.781586+0000","last_unstale":"2024-04-24T02:15:25.419767+0000","last_undegraded":"2024-04-24T02:15:25.419767+0000","last_fullsized":"2024-04-24T02:15:25.419767+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:25.419637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:25.419637+0000","last_clean_scrub_stamp":"2024-04-24T02:15:25.419637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:41:52.572498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'9","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:22.072224+0000","last_change":"2024-04-24T02:16:22.072224+0000","last_active":"2024-04-24T02:16:22.072224+0000","last_peered":"2024-04-24T02:16:22.072224+0000","last_clean":"2024-04-24T02:16:22.072224+0000","last_became_active":"2024-04-24T02:12:12.798272+0000","last_became_peered":"2024-04-24T02:12:12.798272+0000","last_unstale":"2024-04-24T02:16:22.072224+0000","last_undegraded":"2024-04-24T02:16:22.072224+0000","last_fullsized":"2024-04-24T02:16:22.072224+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-24T02:16:22.072073+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-24T02:16:22.072073+0000","last_clean_scrub_stamp":"2024-04-24T02:16:22.072073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:04:34.957697+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'6","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:51.465160+0000","last_change":"2024-04-24T02:15:51.465160+0000","last_active":"2024-04-24T02:15:51.465160+0000","last_peered":"2024-04-24T02:15:51.465160+0000","last_clean":"2024-04-24T02:15:51.465160+0000","last_became_active":"2024-04-24T02:12:04.765093+0000","last_became_peered":"2024-04-24T02:12:04.765093+0000","last_unstale":"2024-04-24T02:15:51.465160+0000","last_undegraded":"2024-04-24T02:15:51.465160+0000","last_fullsized":"2024-04-24T02:15:51.465160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-24T02:15:51.465043+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-24T02:15:51.465043+0000","last_clean_scrub_stamp":"2024-04-24T02:15:51.465043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:49:04.615334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:13.104282+0000","last_change":"2024-04-24T02:16:13.104305+0000","last_active":"2024-04-24T02:16:13.104282+0000","last_peered":"2024-04-24T02:16:13.104282+0000","last_clean":"2024-04-24T02:16:13.104282+0000","last_became_active":"2024-04-24T02:12:02.741565+0000","last_became_peered":"2024-04-24T02:12:02.741565+0000","last_unstale":"2024-04-24T02:16:13.104282+0000","last_undegraded":"2024-04-24T02:16:13.104282+0000","last_fullsized":"2024-04-24T02:16:13.104282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:13.104195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:13.104195+0000","last_clean_scrub_stamp":"2024-04-24T02:16:13.104195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:58.546027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:36.044227+0000","last_change":"2024-04-24T02:16:36.044261+0000","last_active":"2024-04-24T02:16:36.044227+0000","last_peered":"2024-04-24T02:16:36.044227+0000","last_clean":"2024-04-24T02:16:36.044227+0000","last_became_active":"2024-04-24T02:11:56.723673+0000","last_became_peered":"2024-04-24T02:11:56.723673+0000","last_unstale":"2024-04-24T02:16:36.044227+0000","last_undegraded":"2024-04-24T02:16:36.044227+0000","last_fullsized":"2024-04-24T02:16:36.044227+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:36.044130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:36.044130+0000","last_clean_scrub_stamp":"2024-04-24T02:16:36.044130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:33:36.460969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:31.335580+0000","last_change":"2024-04-24T02:15:31.335580+0000","last_active":"2024-04-24T02:15:31.335580+0000","last_peered":"2024-04-24T02:15:31.335580+0000","last_clean":"2024-04-24T02:15:31.335580+0000","last_became_active":"2024-04-24T02:12:06.755760+0000","last_became_peered":"2024-04-24T02:12:06.755760+0000","last_unstale":"2024-04-24T02:15:31.335580+0000","last_undegraded":"2024-04-24T02:15:31.335580+0000","last_fullsized":"2024-04-24T02:15:31.335580+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:31.335458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:31.335458+0000","last_clean_scrub_stamp":"2024-04-24T02:15:31.335458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:15:39.406302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'28","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:27.368863+0000","last_change":"2024-04-24T02:15:27.368863+0000","last_active":"2024-04-24T02:15:27.368863+0000","last_peered":"2024-04-24T02:15:27.368863+0000","last_clean":"2024-04-24T02:15:27.368863+0000","last_became_active":"2024-04-24T02:12:08.779698+0000","last_became_peered":"2024-04-24T02:12:08.779698+0000","last_unstale":"2024-04-24T02:15:27.368863+0000","last_undegraded":"2024-04-24T02:15:27.368863+0000","last_fullsized":"2024-04-24T02:15:27.368863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'28","last_scrub_stamp":"2024-04-24T02:15:27.368732+0000","last_deep_scrub":"32'28","last_deep_scrub_stamp":"2024-04-24T02:15:27.368732+0000","last_clean_scrub_stamp":"2024-04-24T02:15:27.368732+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:51:46.023041+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'285","reported_seq":359,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:30.318523+0000","last_change":"2024-04-24T02:15:30.318523+0000","last_active":"2024-04-24T02:15:30.318523+0000","last_peered":"2024-04-24T02:15:30.318523+0000","last_clean":"2024-04-24T02:15:30.318523+0000","last_became_active":"2024-04-24T02:12:10.781799+0000","last_became_peered":"2024-04-24T02:12:10.781799+0000","last_unstale":"2024-04-24T02:15:30.318523+0000","last_undegraded":"2024-04-24T02:15:30.318523+0000","last_fullsized":"2024-04-24T02:15:30.318523+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-24T02:15:30.318394+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-24T02:15:30.318394+0000","last_clean_scrub_stamp":"2024-04-24T02:15:30.318394+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:55:07.242675+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'2","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:15.994766+0000","last_change":"2024-04-24T02:16:15.994793+0000","last_active":"2024-04-24T02:16:15.994766+0000","last_peered":"2024-04-24T02:16:15.994766+0000","last_clean":"2024-04-24T02:16:15.994766+0000","last_became_active":"2024-04-24T02:12:12.792628+0000","last_became_peered":"2024-04-24T02:12:12.792628+0000","last_unstale":"2024-04-24T02:16:15.994766+0000","last_undegraded":"2024-04-24T02:16:15.994766+0000","last_fullsized":"2024-04-24T02:16:15.994766+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:16:15.994673+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:16:15.994673+0000","last_clean_scrub_stamp":"2024-04-24T02:16:15.994673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:11:12.521455+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'19","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:37.364765+0000","last_change":"2024-04-24T02:15:37.364765+0000","last_active":"2024-04-24T02:15:37.364765+0000","last_peered":"2024-04-24T02:15:37.364765+0000","last_clean":"2024-04-24T02:15:37.364765+0000","last_became_active":"2024-04-24T02:12:04.768066+0000","last_became_peered":"2024-04-24T02:12:04.768066+0000","last_unstale":"2024-04-24T02:15:37.364765+0000","last_undegraded":"2024-04-24T02:15:37.364765+0000","last_fullsized":"2024-04-24T02:15:37.364765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'19","last_scrub_stamp":"2024-04-24T02:15:37.364597+0000","last_deep_scrub":"32'19","last_deep_scrub_stamp":"2024-04-24T02:15:37.364597+0000","last_clean_scrub_stamp":"2024-04-24T02:15:37.364597+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:10:16.966259+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":70,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:24.221146+0000","last_change":"2024-04-24T02:12:02.761644+0000","last_active":"2024-04-24T02:15:24.221146+0000","last_peered":"2024-04-24T02:15:24.221146+0000","last_clean":"2024-04-24T02:15:24.221146+0000","last_became_active":"2024-04-24T02:12:02.760824+0000","last_became_peered":"2024-04-24T02:12:02.760824+0000","last_unstale":"2024-04-24T02:15:24.221146+0000","last_undegraded":"2024-04-24T02:15:24.221146+0000","last_fullsized":"2024-04-24T02:15:24.221146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:01.726045+0000","last_clean_scrub_stamp":"2024-04-24T02:12:01.726045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:09.079679+0000","last_change":"2024-04-24T02:16:09.079679+0000","last_active":"2024-04-24T02:16:09.079679+0000","last_peered":"2024-04-24T02:16:09.079679+0000","last_clean":"2024-04-24T02:16:09.079679+0000","last_became_active":"2024-04-24T02:11:56.723277+0000","last_became_peered":"2024-04-24T02:11:56.723277+0000","last_unstale":"2024-04-24T02:16:09.079679+0000","last_undegraded":"2024-04-24T02:16:09.079679+0000","last_fullsized":"2024-04-24T02:16:09.079679+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:09.079531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:09.079531+0000","last_clean_scrub_stamp":"2024-04-24T02:16:09.079531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:25:33.117562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:33.324119+0000","last_change":"2024-04-24T02:15:33.324119+0000","last_active":"2024-04-24T02:15:33.324119+0000","last_peered":"2024-04-24T02:15:33.324119+0000","last_clean":"2024-04-24T02:15:33.324119+0000","last_became_active":"2024-04-24T02:12:06.754414+0000","last_became_peered":"2024-04-24T02:12:06.754414+0000","last_unstale":"2024-04-24T02:15:33.324119+0000","last_undegraded":"2024-04-24T02:15:33.324119+0000","last_fullsized":"2024-04-24T02:15:33.324119+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:33.324008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:33.324008+0000","last_clean_scrub_stamp":"2024-04-24T02:15:33.324008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:33:56.910723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'23","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:38.410200+0000","last_change":"2024-04-24T02:15:38.410200+0000","last_active":"2024-04-24T02:15:38.410200+0000","last_peered":"2024-04-24T02:15:38.410200+0000","last_clean":"2024-04-24T02:15:38.410200+0000","last_became_active":"2024-04-24T02:12:08.779937+0000","last_became_peered":"2024-04-24T02:12:08.779937+0000","last_unstale":"2024-04-24T02:15:38.410200+0000","last_undegraded":"2024-04-24T02:15:38.410200+0000","last_fullsized":"2024-04-24T02:15:38.410200+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2024-04-24T02:15:38.410066+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2024-04-24T02:15:38.410066+0000","last_clean_scrub_stamp":"2024-04-24T02:15:38.410066+0000","objects_scrubbed":6,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:27:43.655638+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'285","reported_seq":402,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:30.014117+0000","last_change":"2024-04-24T02:15:30.014117+0000","last_active":"2024-04-24T02:15:30.014117+0000","last_peered":"2024-04-24T02:15:30.014117+0000","last_clean":"2024-04-24T02:15:30.014117+0000","last_became_active":"2024-04-24T02:12:10.776594+0000","last_became_peered":"2024-04-24T02:12:10.776594+0000","last_unstale":"2024-04-24T02:15:30.014117+0000","last_undegraded":"2024-04-24T02:15:30.014117+0000","last_fullsized":"2024-04-24T02:15:30.014117+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-24T02:15:30.013989+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-24T02:15:30.013989+0000","last_clean_scrub_stamp":"2024-04-24T02:15:30.013989+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:47:15.601895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:46.394990+0000","last_change":"2024-04-24T02:15:46.395014+0000","last_active":"2024-04-24T02:15:46.394990+0000","last_peered":"2024-04-24T02:15:46.394990+0000","last_clean":"2024-04-24T02:15:46.394990+0000","last_became_active":"2024-04-24T02:12:12.795328+0000","last_became_peered":"2024-04-24T02:12:12.795328+0000","last_unstale":"2024-04-24T02:15:46.394990+0000","last_undegraded":"2024-04-24T02:15:46.394990+0000","last_fullsized":"2024-04-24T02:15:46.394990+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2024-04-24T02:15:46.394901+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2024-04-24T02:15:46.394901+0000","last_clean_scrub_stamp":"2024-04-24T02:15:46.394901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:06:09.926743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:56.397529+0000","last_change":"2024-04-24T02:15:56.397529+0000","last_active":"2024-04-24T02:15:56.397529+0000","last_peered":"2024-04-24T02:15:56.397529+0000","last_clean":"2024-04-24T02:15:56.397529+0000","last_became_active":"2024-04-24T02:12:04.760099+0000","last_became_peered":"2024-04-24T02:12:04.760099+0000","last_unstale":"2024-04-24T02:15:56.397529+0000","last_undegraded":"2024-04-24T02:15:56.397529+0000","last_fullsized":"2024-04-24T02:15:56.397529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:56.397413+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:56.397413+0000","last_clean_scrub_stamp":"2024-04-24T02:15:56.397413+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:03:48.856552+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'4","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:09.532361+0000","last_change":"2024-04-24T02:16:09.532361+0000","last_active":"2024-04-24T02:16:09.532361+0000","last_peered":"2024-04-24T02:16:09.532361+0000","last_clean":"2024-04-24T02:16:09.532361+0000","last_became_active":"2024-04-24T02:12:02.744454+0000","last_became_peered":"2024-04-24T02:12:02.744454+0000","last_unstale":"2024-04-24T02:16:09.532361+0000","last_undegraded":"2024-04-24T02:16:09.532361+0000","last_fullsized":"2024-04-24T02:16:09.532361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:16:09.532231+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:16:09.532231+0000","last_clean_scrub_stamp":"2024-04-24T02:16:09.532231+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:07:05.583696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:38.028817+0000","last_change":"2024-04-24T02:16:38.028845+0000","last_active":"2024-04-24T02:16:38.028817+0000","last_peered":"2024-04-24T02:16:38.028817+0000","last_clean":"2024-04-24T02:16:38.028817+0000","last_became_active":"2024-04-24T02:11:57.000197+0000","last_became_peered":"2024-04-24T02:11:57.000197+0000","last_unstale":"2024-04-24T02:16:38.028817+0000","last_undegraded":"2024-04-24T02:16:38.028817+0000","last_fullsized":"2024-04-24T02:16:38.028817+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:38.028716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:38.028716+0000","last_clean_scrub_stamp":"2024-04-24T02:16:38.028716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:13:55.467169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:34.371690+0000","last_change":"2024-04-24T02:15:34.371690+0000","last_active":"2024-04-24T02:15:34.371690+0000","last_peered":"2024-04-24T02:15:34.371690+0000","last_clean":"2024-04-24T02:15:34.371690+0000","last_became_active":"2024-04-24T02:12:06.754107+0000","last_became_peered":"2024-04-24T02:12:06.754107+0000","last_unstale":"2024-04-24T02:15:34.371690+0000","last_undegraded":"2024-04-24T02:15:34.371690+0000","last_fullsized":"2024-04-24T02:15:34.371690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:34.371542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:34.371542+0000","last_clean_scrub_stamp":"2024-04-24T02:15:34.371542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:59:19.687673+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'105","reported_seq":205,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:32.532781+0000","last_change":"2024-04-24T02:15:32.532781+0000","last_active":"2024-04-24T02:15:32.532781+0000","last_peered":"2024-04-24T02:15:32.532781+0000","last_clean":"2024-04-24T02:15:32.532781+0000","last_became_active":"2024-04-24T02:12:08.780925+0000","last_became_peered":"2024-04-24T02:12:08.780925+0000","last_unstale":"2024-04-24T02:15:32.532781+0000","last_undegraded":"2024-04-24T02:15:32.532781+0000","last_fullsized":"2024-04-24T02:15:32.532781+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'105","last_scrub_stamp":"2024-04-24T02:15:32.532634+0000","last_deep_scrub":"32'105","last_deep_scrub_stamp":"2024-04-24T02:15:32.532634+0000","last_clean_scrub_stamp":"2024-04-24T02:15:32.532634+0000","objects_scrubbed":9,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:37:40.136523+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":108,"num_read_kb":111,"num_write":44,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:32.071860+0000","last_change":"2024-04-24T02:15:32.071860+0000","last_active":"2024-04-24T02:15:32.071860+0000","last_peered":"2024-04-24T02:15:32.071860+0000","last_clean":"2024-04-24T02:15:32.071860+0000","last_became_active":"2024-04-24T02:12:10.775165+0000","last_became_peered":"2024-04-24T02:12:10.775165+0000","last_unstale":"2024-04-24T02:15:32.071860+0000","last_undegraded":"2024-04-24T02:15:32.071860+0000","last_fullsized":"2024-04-24T02:15:32.071860+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:32.071693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:32.071693+0000","last_clean_scrub_stamp":"2024-04-24T02:15:32.071693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:31:34.757480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"30'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:42.394026+0000","last_change":"2024-04-24T02:15:42.394068+0000","last_active":"2024-04-24T02:15:42.394026+0000","last_peered":"2024-04-24T02:15:42.394026+0000","last_clean":"2024-04-24T02:15:42.394026+0000","last_became_active":"2024-04-24T02:12:12.796411+0000","last_became_peered":"2024-04-24T02:12:12.796411+0000","last_unstale":"2024-04-24T02:15:42.394026+0000","last_undegraded":"2024-04-24T02:15:42.394026+0000","last_fullsized":"2024-04-24T02:15:42.394026+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-24T02:15:42.393912+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-24T02:15:42.393912+0000","last_clean_scrub_stamp":"2024-04-24T02:15:42.393912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:09:36.452146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:14.620377+0000","last_change":"2024-04-24T02:16:14.620377+0000","last_active":"2024-04-24T02:16:14.620377+0000","last_peered":"2024-04-24T02:16:14.620377+0000","last_clean":"2024-04-24T02:16:14.620377+0000","last_became_active":"2024-04-24T02:12:12.801346+0000","last_became_peered":"2024-04-24T02:12:12.801346+0000","last_unstale":"2024-04-24T02:16:14.620377+0000","last_undegraded":"2024-04-24T02:16:14.620377+0000","last_fullsized":"2024-04-24T02:16:14.620377+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:14.620247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:14.620247+0000","last_clean_scrub_stamp":"2024-04-24T02:16:14.620247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:22:53.874245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:00.417737+0000","last_change":"2024-04-24T02:16:00.417766+0000","last_active":"2024-04-24T02:16:00.417737+0000","last_peered":"2024-04-24T02:16:00.417737+0000","last_clean":"2024-04-24T02:16:00.417737+0000","last_became_active":"2024-04-24T02:12:04.763860+0000","last_became_peered":"2024-04-24T02:12:04.763860+0000","last_unstale":"2024-04-24T02:16:00.417737+0000","last_undegraded":"2024-04-24T02:16:00.417737+0000","last_fullsized":"2024-04-24T02:16:00.417737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:16:00.417625+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:16:00.417625+0000","last_clean_scrub_stamp":"2024-04-24T02:16:00.417625+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:49:13.567916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:27.018176+0000","last_change":"2024-04-24T02:16:27.018204+0000","last_active":"2024-04-24T02:16:27.018176+0000","last_peered":"2024-04-24T02:16:27.018176+0000","last_clean":"2024-04-24T02:16:27.018176+0000","last_became_active":"2024-04-24T02:12:02.753166+0000","last_became_peered":"2024-04-24T02:12:02.753166+0000","last_unstale":"2024-04-24T02:16:27.018176+0000","last_undegraded":"2024-04-24T02:16:27.018176+0000","last_fullsized":"2024-04-24T02:16:27.018176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:16:27.018084+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:16:27.018084+0000","last_clean_scrub_stamp":"2024-04-24T02:16:27.018084+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:06:34.350850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:39.395350+0000","last_change":"2024-04-24T02:15:39.395376+0000","last_active":"2024-04-24T02:15:39.395350+0000","last_peered":"2024-04-24T02:15:39.395350+0000","last_clean":"2024-04-24T02:15:39.395350+0000","last_became_active":"2024-04-24T02:12:06.758468+0000","last_became_peered":"2024-04-24T02:12:06.758468+0000","last_unstale":"2024-04-24T02:15:39.395350+0000","last_undegraded":"2024-04-24T02:15:39.395350+0000","last_fullsized":"2024-04-24T02:15:39.395350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:39.395252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:39.395252+0000","last_clean_scrub_stamp":"2024-04-24T02:15:39.395252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:56:56.565405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'47","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:54.212984+0000","last_change":"2024-04-24T02:15:54.213025+0000","last_active":"2024-04-24T02:15:54.212984+0000","last_peered":"2024-04-24T02:15:54.212984+0000","last_clean":"2024-04-24T02:15:54.212984+0000","last_became_active":"2024-04-24T02:12:08.780353+0000","last_became_peered":"2024-04-24T02:12:08.780353+0000","last_unstale":"2024-04-24T02:15:54.212984+0000","last_undegraded":"2024-04-24T02:15:54.212984+0000","last_fullsized":"2024-04-24T02:15:54.212984+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'47","last_scrub_stamp":"2024-04-24T02:15:54.212901+0000","last_deep_scrub":"32'47","last_deep_scrub_stamp":"2024-04-24T02:15:54.212901+0000","last_clean_scrub_stamp":"2024-04-24T02:15:54.212901+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:55:13.399828+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:04.017044+0000","last_change":"2024-04-24T02:16:04.017088+0000","last_active":"2024-04-24T02:16:04.017044+0000","last_peered":"2024-04-24T02:16:04.017044+0000","last_clean":"2024-04-24T02:16:04.017044+0000","last_became_active":"2024-04-24T02:12:10.786813+0000","last_became_peered":"2024-04-24T02:12:10.786813+0000","last_unstale":"2024-04-24T02:16:04.017044+0000","last_undegraded":"2024-04-24T02:16:04.017044+0000","last_fullsized":"2024-04-24T02:16:04.017044+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:04.016948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:04.016948+0000","last_clean_scrub_stamp":"2024-04-24T02:16:04.016948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:28:33.584520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'9","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:21.106208+0000","last_change":"2024-04-24T02:16:21.106256+0000","last_active":"2024-04-24T02:16:21.106208+0000","last_peered":"2024-04-24T02:16:21.106208+0000","last_clean":"2024-04-24T02:16:21.106208+0000","last_became_active":"2024-04-24T02:12:12.796149+0000","last_became_peered":"2024-04-24T02:12:12.796149+0000","last_unstale":"2024-04-24T02:16:21.106208+0000","last_undegraded":"2024-04-24T02:16:21.106208+0000","last_fullsized":"2024-04-24T02:16:21.106208+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-24T02:16:21.106107+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-24T02:16:21.106107+0000","last_clean_scrub_stamp":"2024-04-24T02:16:21.106107+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:05:51.119381+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'2","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:23.481356+0000","last_change":"2024-04-24T02:16:23.481398+0000","last_active":"2024-04-24T02:16:23.481356+0000","last_peered":"2024-04-24T02:16:23.481356+0000","last_clean":"2024-04-24T02:16:23.481356+0000","last_became_active":"2024-04-24T02:12:45.816009+0000","last_became_peered":"2024-04-24T02:12:45.816009+0000","last_unstale":"2024-04-24T02:16:23.481356+0000","last_undegraded":"2024-04-24T02:16:23.481356+0000","last_fullsized":"2024-04-24T02:16:23.481356+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:16:23.481244+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:16:23.481244+0000","last_clean_scrub_stamp":"2024-04-24T02:16:23.481244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:50:05.019794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:55.440095+0000","last_change":"2024-04-24T02:15:55.440136+0000","last_active":"2024-04-24T02:15:55.440095+0000","last_peered":"2024-04-24T02:15:55.440095+0000","last_clean":"2024-04-24T02:15:55.440095+0000","last_became_active":"2024-04-24T02:12:02.754623+0000","last_became_peered":"2024-04-24T02:12:02.754623+0000","last_unstale":"2024-04-24T02:15:55.440095+0000","last_undegraded":"2024-04-24T02:15:55.440095+0000","last_fullsized":"2024-04-24T02:15:55.440095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-24T02:15:55.439995+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-24T02:15:55.439995+0000","last_clean_scrub_stamp":"2024-04-24T02:15:55.439995+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:06:18.971836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:27.328721+0000","last_change":"2024-04-24T02:15:27.328746+0000","last_active":"2024-04-24T02:15:27.328721+0000","last_peered":"2024-04-24T02:15:27.328721+0000","last_clean":"2024-04-24T02:15:27.328721+0000","last_became_active":"2024-04-24T02:12:06.756998+0000","last_became_peered":"2024-04-24T02:12:06.756998+0000","last_unstale":"2024-04-24T02:15:27.328721+0000","last_undegraded":"2024-04-24T02:15:27.328721+0000","last_fullsized":"2024-04-24T02:15:27.328721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:27.328635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:27.328635+0000","last_clean_scrub_stamp":"2024-04-24T02:15:27.328635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:13.610015+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'9","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:36.993078+0000","last_change":"2024-04-24T02:15:36.993114+0000","last_active":"2024-04-24T02:15:36.993078+0000","last_peered":"2024-04-24T02:15:36.993078+0000","last_clean":"2024-04-24T02:15:36.993078+0000","last_became_active":"2024-04-24T02:12:08.769610+0000","last_became_peered":"2024-04-24T02:12:08.769610+0000","last_unstale":"2024-04-24T02:15:36.993078+0000","last_undegraded":"2024-04-24T02:15:36.993078+0000","last_fullsized":"2024-04-24T02:15:36.993078+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-24T02:15:36.992984+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-24T02:15:36.992984+0000","last_clean_scrub_stamp":"2024-04-24T02:15:36.992984+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:31:27.219681+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:24.453899+0000","last_change":"2024-04-24T02:15:24.453926+0000","last_active":"2024-04-24T02:15:24.453899+0000","last_peered":"2024-04-24T02:15:24.453899+0000","last_clean":"2024-04-24T02:15:24.453899+0000","last_became_active":"2024-04-24T02:12:10.784955+0000","last_became_peered":"2024-04-24T02:12:10.784955+0000","last_unstale":"2024-04-24T02:15:24.453899+0000","last_undegraded":"2024-04-24T02:15:24.453899+0000","last_fullsized":"2024-04-24T02:15:24.453899+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:24.453808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:24.453808+0000","last_clean_scrub_stamp":"2024-04-24T02:15:24.453808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:10:25.731858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'10","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:19.052760+0000","last_change":"2024-04-24T02:16:19.052803+0000","last_active":"2024-04-24T02:16:19.052760+0000","last_peered":"2024-04-24T02:16:19.052760+0000","last_clean":"2024-04-24T02:16:19.052760+0000","last_became_active":"2024-04-24T02:12:12.792565+0000","last_became_peered":"2024-04-24T02:12:12.792565+0000","last_unstale":"2024-04-24T02:16:19.052760+0000","last_undegraded":"2024-04-24T02:16:19.052760+0000","last_fullsized":"2024-04-24T02:16:19.052760+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-24T02:16:19.052635+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-24T02:16:19.052635+0000","last_clean_scrub_stamp":"2024-04-24T02:16:19.052635+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:43:57.416005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":60,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:49.117581+0000","last_change":"2024-04-24T02:15:49.117627+0000","last_active":"2024-04-24T02:15:49.117581+0000","last_peered":"2024-04-24T02:15:49.117581+0000","last_clean":"2024-04-24T02:15:49.117581+0000","last_became_active":"2024-04-24T02:12:04.766700+0000","last_became_peered":"2024-04-24T02:12:04.766700+0000","last_unstale":"2024-04-24T02:15:49.117581+0000","last_undegraded":"2024-04-24T02:15:49.117581+0000","last_fullsized":"2024-04-24T02:15:49.117581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:49.117486+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:49.117486+0000","last_clean_scrub_stamp":"2024-04-24T02:15:49.117486+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:35:31.797741+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:18.562745+0000","last_change":"2024-04-24T02:16:18.562784+0000","last_active":"2024-04-24T02:16:18.562745+0000","last_peered":"2024-04-24T02:16:18.562745+0000","last_clean":"2024-04-24T02:16:18.562745+0000","last_became_active":"2024-04-24T02:12:45.817240+0000","last_became_peered":"2024-04-24T02:12:45.817240+0000","last_unstale":"2024-04-24T02:16:18.562745+0000","last_undegraded":"2024-04-24T02:16:18.562745+0000","last_fullsized":"2024-04-24T02:16:18.562745+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:18.562640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:18.562640+0000","last_clean_scrub_stamp":"2024-04-24T02:16:18.562640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:07:14.614105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:40.427976+0000","last_change":"2024-04-24T02:15:40.428002+0000","last_active":"2024-04-24T02:15:40.427976+0000","last_peered":"2024-04-24T02:15:40.427976+0000","last_clean":"2024-04-24T02:15:40.427976+0000","last_became_active":"2024-04-24T02:12:06.764776+0000","last_became_peered":"2024-04-24T02:12:06.764776+0000","last_unstale":"2024-04-24T02:15:40.427976+0000","last_undegraded":"2024-04-24T02:15:40.427976+0000","last_fullsized":"2024-04-24T02:15:40.427976+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:40.427880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:40.427880+0000","last_clean_scrub_stamp":"2024-04-24T02:15:40.427880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:04:59.966363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'47","reported_seq":119,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:39.994683+0000","last_change":"2024-04-24T02:15:39.994717+0000","last_active":"2024-04-24T02:15:39.994683+0000","last_peered":"2024-04-24T02:15:39.994683+0000","last_clean":"2024-04-24T02:15:39.994683+0000","last_became_active":"2024-04-24T02:12:08.768499+0000","last_became_peered":"2024-04-24T02:12:08.768499+0000","last_unstale":"2024-04-24T02:15:39.994683+0000","last_undegraded":"2024-04-24T02:15:39.994683+0000","last_fullsized":"2024-04-24T02:15:39.994683+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'47","last_scrub_stamp":"2024-04-24T02:15:39.994590+0000","last_deep_scrub":"32'47","last_deep_scrub_stamp":"2024-04-24T02:15:39.994590+0000","last_clean_scrub_stamp":"2024-04-24T02:15:39.994590+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:40:40.190436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:24.405718+0000","last_change":"2024-04-24T02:15:24.405740+0000","last_active":"2024-04-24T02:15:24.405718+0000","last_peered":"2024-04-24T02:15:24.405718+0000","last_clean":"2024-04-24T02:15:24.405718+0000","last_became_active":"2024-04-24T02:12:10.776882+0000","last_became_peered":"2024-04-24T02:12:10.776882+0000","last_unstale":"2024-04-24T02:15:24.405718+0000","last_undegraded":"2024-04-24T02:15:24.405718+0000","last_fullsized":"2024-04-24T02:15:24.405718+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:24.405592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:24.405592+0000","last_clean_scrub_stamp":"2024-04-24T02:15:24.405592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:41:19.659879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:13.469268+0000","last_change":"2024-04-24T02:12:12.794192+0000","last_active":"2024-04-24T02:15:13.469268+0000","last_peered":"2024-04-24T02:15:13.469268+0000","last_clean":"2024-04-24T02:15:13.469268+0000","last_became_active":"2024-04-24T02:12:12.793884+0000","last_became_peered":"2024-04-24T02:12:12.793884+0000","last_unstale":"2024-04-24T02:15:13.469268+0000","last_undegraded":"2024-04-24T02:15:13.469268+0000","last_fullsized":"2024-04-24T02:15:13.469268+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'6","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:42.377250+0000","last_change":"2024-04-24T02:15:42.377279+0000","last_active":"2024-04-24T02:15:42.377250+0000","last_peered":"2024-04-24T02:15:42.377250+0000","last_clean":"2024-04-24T02:15:42.377250+0000","last_became_active":"2024-04-24T02:12:04.767431+0000","last_became_peered":"2024-04-24T02:12:04.767431+0000","last_unstale":"2024-04-24T02:15:42.377250+0000","last_undegraded":"2024-04-24T02:15:42.377250+0000","last_fullsized":"2024-04-24T02:15:42.377250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-24T02:15:42.377157+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-24T02:15:42.377157+0000","last_clean_scrub_stamp":"2024-04-24T02:15:42.377157+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:22:21.631155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:05.464439+0000","last_change":"2024-04-24T02:16:05.464469+0000","last_active":"2024-04-24T02:16:05.464439+0000","last_peered":"2024-04-24T02:16:05.464439+0000","last_clean":"2024-04-24T02:16:05.464439+0000","last_became_active":"2024-04-24T02:12:02.754295+0000","last_became_peered":"2024-04-24T02:12:02.754295+0000","last_unstale":"2024-04-24T02:16:05.464439+0000","last_undegraded":"2024-04-24T02:16:05.464439+0000","last_fullsized":"2024-04-24T02:16:05.464439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:16:05.464356+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:16:05.464356+0000","last_clean_scrub_stamp":"2024-04-24T02:16:05.464356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:22:44.718355+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:24.382922+0000","last_change":"2024-04-24T02:15:24.382967+0000","last_active":"2024-04-24T02:15:24.382922+0000","last_peered":"2024-04-24T02:15:24.382922+0000","last_clean":"2024-04-24T02:15:24.382922+0000","last_became_active":"2024-04-24T02:12:06.758462+0000","last_became_peered":"2024-04-24T02:12:06.758462+0000","last_unstale":"2024-04-24T02:15:24.382922+0000","last_undegraded":"2024-04-24T02:15:24.382922+0000","last_fullsized":"2024-04-24T02:15:24.382922+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:24.382807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:24.382807+0000","last_clean_scrub_stamp":"2024-04-24T02:15:24.382807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:05:42.611375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'36","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:39.388995+0000","last_change":"2024-04-24T02:15:39.389030+0000","last_active":"2024-04-24T02:15:39.388995+0000","last_peered":"2024-04-24T02:15:39.388995+0000","last_clean":"2024-04-24T02:15:39.388995+0000","last_became_active":"2024-04-24T02:12:08.768814+0000","last_became_peered":"2024-04-24T02:12:08.768814+0000","last_unstale":"2024-04-24T02:15:39.388995+0000","last_undegraded":"2024-04-24T02:15:39.388995+0000","last_fullsized":"2024-04-24T02:15:39.388995+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-04-24T02:15:39.388901+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-04-24T02:15:39.388901+0000","last_clean_scrub_stamp":"2024-04-24T02:15:39.388901+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:55:16.313182+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:27.445785+0000","last_change":"2024-04-24T02:15:27.445811+0000","last_active":"2024-04-24T02:15:27.445785+0000","last_peered":"2024-04-24T02:15:27.445785+0000","last_clean":"2024-04-24T02:15:27.445785+0000","last_became_active":"2024-04-24T02:12:10.779734+0000","last_became_peered":"2024-04-24T02:12:10.779734+0000","last_unstale":"2024-04-24T02:15:27.445785+0000","last_undegraded":"2024-04-24T02:15:27.445785+0000","last_fullsized":"2024-04-24T02:15:27.445785+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:27.445677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:27.445677+0000","last_clean_scrub_stamp":"2024-04-24T02:15:27.445677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:47:29.069695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'2","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:45.317822+0000","last_change":"2024-04-24T02:15:45.317822+0000","last_active":"2024-04-24T02:15:45.317822+0000","last_peered":"2024-04-24T02:15:45.317822+0000","last_clean":"2024-04-24T02:15:45.317822+0000","last_became_active":"2024-04-24T02:12:04.764564+0000","last_became_peered":"2024-04-24T02:12:04.764564+0000","last_unstale":"2024-04-24T02:15:45.317822+0000","last_undegraded":"2024-04-24T02:15:45.317822+0000","last_fullsized":"2024-04-24T02:15:45.317822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:15:45.317697+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:15:45.317697+0000","last_clean_scrub_stamp":"2024-04-24T02:15:45.317697+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:34:45.124130+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:23.093038+0000","last_change":"2024-04-24T02:16:23.093064+0000","last_active":"2024-04-24T02:16:23.093038+0000","last_peered":"2024-04-24T02:16:23.093038+0000","last_clean":"2024-04-24T02:16:23.093038+0000","last_became_active":"2024-04-24T02:12:45.809365+0000","last_became_peered":"2024-04-24T02:12:45.809365+0000","last_unstale":"2024-04-24T02:16:23.093038+0000","last_undegraded":"2024-04-24T02:16:23.093038+0000","last_fullsized":"2024-04-24T02:16:23.093038+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:16:23.092935+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:16:23.092935+0000","last_clean_scrub_stamp":"2024-04-24T02:16:23.092935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:16:06.034273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:17.596076+0000","last_change":"2024-04-24T02:16:17.596104+0000","last_active":"2024-04-24T02:16:17.596076+0000","last_peered":"2024-04-24T02:16:17.596076+0000","last_clean":"2024-04-24T02:16:17.596076+0000","last_became_active":"2024-04-24T02:12:45.814918+0000","last_became_peered":"2024-04-24T02:12:45.814918+0000","last_unstale":"2024-04-24T02:16:17.596076+0000","last_undegraded":"2024-04-24T02:16:17.596076+0000","last_fullsized":"2024-04-24T02:16:17.596076+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:17.595991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:17.595991+0000","last_clean_scrub_stamp":"2024-04-24T02:16:17.595991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:35:17.402424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"32'72","reported_seq":151,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:38.006044+0000","last_change":"2024-04-24T02:15:38.006098+0000","last_active":"2024-04-24T02:15:38.006044+0000","last_peered":"2024-04-24T02:15:38.006044+0000","last_clean":"2024-04-24T02:15:38.006044+0000","last_became_active":"2024-04-24T02:12:08.769578+0000","last_became_peered":"2024-04-24T02:12:08.769578+0000","last_unstale":"2024-04-24T02:15:38.006044+0000","last_undegraded":"2024-04-24T02:15:38.006044+0000","last_fullsized":"2024-04-24T02:15:38.006044+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'72","last_scrub_stamp":"2024-04-24T02:15:38.005928+0000","last_deep_scrub":"32'72","last_deep_scrub_stamp":"2024-04-24T02:15:38.005928+0000","last_clean_scrub_stamp":"2024-04-24T02:15:38.005928+0000","objects_scrubbed":6,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:38:25.392507+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:28.440238+0000","last_change":"2024-04-24T02:15:28.440262+0000","last_active":"2024-04-24T02:15:28.440238+0000","last_peered":"2024-04-24T02:15:28.440238+0000","last_clean":"2024-04-24T02:15:28.440238+0000","last_became_active":"2024-04-24T02:12:10.779703+0000","last_became_peered":"2024-04-24T02:12:10.779703+0000","last_unstale":"2024-04-24T02:15:28.440238+0000","last_undegraded":"2024-04-24T02:15:28.440238+0000","last_fullsized":"2024-04-24T02:15:28.440238+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:28.440118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:28.440118+0000","last_clean_scrub_stamp":"2024-04-24T02:15:28.440118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:28:48.467792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'16","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:18.060368+0000","last_change":"2024-04-24T02:16:18.060394+0000","last_active":"2024-04-24T02:16:18.060368+0000","last_peered":"2024-04-24T02:16:18.060368+0000","last_clean":"2024-04-24T02:16:18.060368+0000","last_became_active":"2024-04-24T02:12:12.791623+0000","last_became_peered":"2024-04-24T02:12:12.791623+0000","last_unstale":"2024-04-24T02:16:18.060368+0000","last_undegraded":"2024-04-24T02:16:18.060368+0000","last_fullsized":"2024-04-24T02:16:18.060368+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-04-24T02:16:18.060282+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-04-24T02:16:18.060282+0000","last_clean_scrub_stamp":"2024-04-24T02:16:18.060282+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:03:39.271033+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'10","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:01.115692+0000","last_change":"2024-04-24T02:16:01.115692+0000","last_active":"2024-04-24T02:16:01.115692+0000","last_peered":"2024-04-24T02:16:01.115692+0000","last_clean":"2024-04-24T02:16:01.115692+0000","last_became_active":"2024-04-24T02:12:04.755554+0000","last_became_peered":"2024-04-24T02:12:04.755554+0000","last_unstale":"2024-04-24T02:16:01.115692+0000","last_undegraded":"2024-04-24T02:16:01.115692+0000","last_fullsized":"2024-04-24T02:16:01.115692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-24T02:16:01.115544+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-24T02:16:01.115544+0000","last_clean_scrub_stamp":"2024-04-24T02:16:01.115544+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:30:37.328826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:15.402109+0000","last_change":"2024-04-24T02:16:15.402139+0000","last_active":"2024-04-24T02:16:15.402109+0000","last_peered":"2024-04-24T02:16:15.402109+0000","last_clean":"2024-04-24T02:16:15.402109+0000","last_became_active":"2024-04-24T02:12:02.751703+0000","last_became_peered":"2024-04-24T02:12:02.751703+0000","last_unstale":"2024-04-24T02:16:15.402109+0000","last_undegraded":"2024-04-24T02:16:15.402109+0000","last_fullsized":"2024-04-24T02:16:15.402109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:15.402014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:15.402014+0000","last_clean_scrub_stamp":"2024-04-24T02:16:15.402014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:50:00.999718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:47.423814+0000","last_change":"2024-04-24T02:15:47.423814+0000","last_active":"2024-04-24T02:15:47.423814+0000","last_peered":"2024-04-24T02:15:47.423814+0000","last_clean":"2024-04-24T02:15:47.423814+0000","last_became_active":"2024-04-24T02:12:06.756154+0000","last_became_peered":"2024-04-24T02:12:06.756154+0000","last_unstale":"2024-04-24T02:15:47.423814+0000","last_undegraded":"2024-04-24T02:15:47.423814+0000","last_fullsized":"2024-04-24T02:15:47.423814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:47.423687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:47.423687+0000","last_clean_scrub_stamp":"2024-04-24T02:15:47.423687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:18:00.672544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'45","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:44.331369+0000","last_change":"2024-04-24T02:15:44.331428+0000","last_active":"2024-04-24T02:15:44.331369+0000","last_peered":"2024-04-24T02:15:44.331369+0000","last_clean":"2024-04-24T02:15:44.331369+0000","last_became_active":"2024-04-24T02:12:08.780215+0000","last_became_peered":"2024-04-24T02:12:08.780215+0000","last_unstale":"2024-04-24T02:15:44.331369+0000","last_undegraded":"2024-04-24T02:15:44.331369+0000","last_fullsized":"2024-04-24T02:15:44.331369+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'45","last_scrub_stamp":"2024-04-24T02:15:44.331260+0000","last_deep_scrub":"32'45","last_deep_scrub_stamp":"2024-04-24T02:15:44.331260+0000","last_clean_scrub_stamp":"2024-04-24T02:15:44.331260+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:06:04.005763+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:34.421645+0000","last_change":"2024-04-24T02:15:34.421669+0000","last_active":"2024-04-24T02:15:34.421645+0000","last_peered":"2024-04-24T02:15:34.421645+0000","last_clean":"2024-04-24T02:15:34.421645+0000","last_became_active":"2024-04-24T02:12:10.785707+0000","last_became_peered":"2024-04-24T02:12:10.785707+0000","last_unstale":"2024-04-24T02:15:34.421645+0000","last_undegraded":"2024-04-24T02:15:34.421645+0000","last_fullsized":"2024-04-24T02:15:34.421645+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:34.421551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:34.421551+0000","last_clean_scrub_stamp":"2024-04-24T02:15:34.421551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:44:00.829320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:35.042215+0000","last_change":"2024-04-24T02:12:12.798843+0000","last_active":"2024-04-24T02:14:35.042215+0000","last_peered":"2024-04-24T02:14:35.042215+0000","last_clean":"2024-04-24T02:14:35.042215+0000","last_became_active":"2024-04-24T02:12:12.798498+0000","last_became_peered":"2024-04-24T02:12:12.798498+0000","last_unstale":"2024-04-24T02:14:35.042215+0000","last_undegraded":"2024-04-24T02:14:35.042215+0000","last_fullsized":"2024-04-24T02:14:35.042215+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:35.413292+0000","last_change":"2024-04-24T02:15:35.413344+0000","last_active":"2024-04-24T02:15:35.413292+0000","last_peered":"2024-04-24T02:15:35.413292+0000","last_clean":"2024-04-24T02:15:35.413292+0000","last_became_active":"2024-04-24T02:12:04.768285+0000","last_became_peered":"2024-04-24T02:12:04.768285+0000","last_unstale":"2024-04-24T02:15:35.413292+0000","last_undegraded":"2024-04-24T02:15:35.413292+0000","last_fullsized":"2024-04-24T02:15:35.413292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:35.413190+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:35.413190+0000","last_clean_scrub_stamp":"2024-04-24T02:15:35.413190+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:52:59.536845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:13.455217+0000","last_change":"2024-04-24T02:16:13.455264+0000","last_active":"2024-04-24T02:16:13.455217+0000","last_peered":"2024-04-24T02:16:13.455217+0000","last_clean":"2024-04-24T02:16:13.455217+0000","last_became_active":"2024-04-24T02:12:02.749461+0000","last_became_peered":"2024-04-24T02:12:02.749461+0000","last_unstale":"2024-04-24T02:16:13.455217+0000","last_undegraded":"2024-04-24T02:16:13.455217+0000","last_fullsized":"2024-04-24T02:16:13.455217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:13.455104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:13.455104+0000","last_clean_scrub_stamp":"2024-04-24T02:16:13.455104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:22:53.192009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:44.450336+0000","last_change":"2024-04-24T02:15:44.450359+0000","last_active":"2024-04-24T02:15:44.450336+0000","last_peered":"2024-04-24T02:15:44.450336+0000","last_clean":"2024-04-24T02:15:44.450336+0000","last_became_active":"2024-04-24T02:12:06.757760+0000","last_became_peered":"2024-04-24T02:12:06.757760+0000","last_unstale":"2024-04-24T02:15:44.450336+0000","last_undegraded":"2024-04-24T02:15:44.450336+0000","last_fullsized":"2024-04-24T02:15:44.450336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:44.450238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:44.450238+0000","last_clean_scrub_stamp":"2024-04-24T02:15:44.450238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:58:20.317926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'46","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:34.024663+0000","last_change":"2024-04-24T02:15:34.024663+0000","last_active":"2024-04-24T02:15:34.024663+0000","last_peered":"2024-04-24T02:15:34.024663+0000","last_clean":"2024-04-24T02:15:34.024663+0000","last_became_active":"2024-04-24T02:12:08.779471+0000","last_became_peered":"2024-04-24T02:12:08.779471+0000","last_unstale":"2024-04-24T02:15:34.024663+0000","last_undegraded":"2024-04-24T02:15:34.024663+0000","last_fullsized":"2024-04-24T02:15:34.024663+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-04-24T02:15:34.024534+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-04-24T02:15:34.024534+0000","last_clean_scrub_stamp":"2024-04-24T02:15:34.024534+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:54:19.092809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:26.055802+0000","last_change":"2024-04-24T02:15:26.055802+0000","last_active":"2024-04-24T02:15:26.055802+0000","last_peered":"2024-04-24T02:15:26.055802+0000","last_clean":"2024-04-24T02:15:26.055802+0000","last_became_active":"2024-04-24T02:12:10.780272+0000","last_became_peered":"2024-04-24T02:12:10.780272+0000","last_unstale":"2024-04-24T02:15:26.055802+0000","last_undegraded":"2024-04-24T02:15:26.055802+0000","last_fullsized":"2024-04-24T02:15:26.055802+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:26.055680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:26.055680+0000","last_clean_scrub_stamp":"2024-04-24T02:15:26.055680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:52:00.699214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:35.042130+0000","last_change":"2024-04-24T02:12:12.795264+0000","last_active":"2024-04-24T02:14:35.042130+0000","last_peered":"2024-04-24T02:14:35.042130+0000","last_clean":"2024-04-24T02:14:35.042130+0000","last_became_active":"2024-04-24T02:12:12.794815+0000","last_became_peered":"2024-04-24T02:12:12.794815+0000","last_unstale":"2024-04-24T02:14:35.042130+0000","last_undegraded":"2024-04-24T02:14:35.042130+0000","last_fullsized":"2024-04-24T02:14:35.042130+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:59.109645+0000","last_change":"2024-04-24T02:15:59.109671+0000","last_active":"2024-04-24T02:15:59.109645+0000","last_peered":"2024-04-24T02:15:59.109645+0000","last_clean":"2024-04-24T02:15:59.109645+0000","last_became_active":"2024-04-24T02:12:04.750546+0000","last_became_peered":"2024-04-24T02:12:04.750546+0000","last_unstale":"2024-04-24T02:15:59.109645+0000","last_undegraded":"2024-04-24T02:15:59.109645+0000","last_fullsized":"2024-04-24T02:15:59.109645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:15:59.109559+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:15:59.109559+0000","last_clean_scrub_stamp":"2024-04-24T02:15:59.109559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:47:13.514457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:19.965054+0000","last_change":"2024-04-24T02:16:19.965108+0000","last_active":"2024-04-24T02:16:19.965054+0000","last_peered":"2024-04-24T02:16:19.965054+0000","last_clean":"2024-04-24T02:16:19.965054+0000","last_became_active":"2024-04-24T02:12:02.757728+0000","last_became_peered":"2024-04-24T02:12:02.757728+0000","last_unstale":"2024-04-24T02:16:19.965054+0000","last_undegraded":"2024-04-24T02:16:19.965054+0000","last_fullsized":"2024-04-24T02:16:19.965054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:19.964939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:19.964939+0000","last_clean_scrub_stamp":"2024-04-24T02:16:19.964939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:43:32.114177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:41.398126+0000","last_change":"2024-04-24T02:15:41.398149+0000","last_active":"2024-04-24T02:15:41.398126+0000","last_peered":"2024-04-24T02:15:41.398126+0000","last_clean":"2024-04-24T02:15:41.398126+0000","last_became_active":"2024-04-24T02:12:06.757145+0000","last_became_peered":"2024-04-24T02:12:06.757145+0000","last_unstale":"2024-04-24T02:15:41.398126+0000","last_undegraded":"2024-04-24T02:15:41.398126+0000","last_fullsized":"2024-04-24T02:15:41.398126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:41.398039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:41.398039+0000","last_clean_scrub_stamp":"2024-04-24T02:15:41.398039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:34:29.427113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'22","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:53.240926+0000","last_change":"2024-04-24T02:15:53.240926+0000","last_active":"2024-04-24T02:15:53.240926+0000","last_peered":"2024-04-24T02:15:53.240926+0000","last_clean":"2024-04-24T02:15:53.240926+0000","last_became_active":"2024-04-24T02:12:08.781974+0000","last_became_peered":"2024-04-24T02:12:08.781974+0000","last_unstale":"2024-04-24T02:15:53.240926+0000","last_undegraded":"2024-04-24T02:15:53.240926+0000","last_fullsized":"2024-04-24T02:15:53.240926+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-04-24T02:15:53.240760+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-04-24T02:15:53.240760+0000","last_clean_scrub_stamp":"2024-04-24T02:15:53.240760+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:03:08.965112+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'285","reported_seq":383,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:30.498799+0000","last_change":"2024-04-24T02:15:30.498799+0000","last_active":"2024-04-24T02:15:30.498799+0000","last_peered":"2024-04-24T02:15:30.498799+0000","last_clean":"2024-04-24T02:15:30.498799+0000","last_became_active":"2024-04-24T02:12:10.786972+0000","last_became_peered":"2024-04-24T02:12:10.786972+0000","last_unstale":"2024-04-24T02:15:30.498799+0000","last_undegraded":"2024-04-24T02:15:30.498799+0000","last_fullsized":"2024-04-24T02:15:30.498799+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-24T02:15:30.498687+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-24T02:15:30.498687+0000","last_clean_scrub_stamp":"2024-04-24T02:15:30.498687+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:36:15.522512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'4","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:35.042068+0000","last_change":"2024-04-24T02:12:12.795734+0000","last_active":"2024-04-24T02:14:35.042068+0000","last_peered":"2024-04-24T02:14:35.042068+0000","last_clean":"2024-04-24T02:14:35.042068+0000","last_became_active":"2024-04-24T02:12:12.795013+0000","last_became_peered":"2024-04-24T02:12:12.795013+0000","last_unstale":"2024-04-24T02:14:35.042068+0000","last_undegraded":"2024-04-24T02:14:35.042068+0000","last_fullsized":"2024-04-24T02:14:35.042068+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'12","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:48.389856+0000","last_change":"2024-04-24T02:15:48.389882+0000","last_active":"2024-04-24T02:15:48.389856+0000","last_peered":"2024-04-24T02:15:48.389856+0000","last_clean":"2024-04-24T02:15:48.389856+0000","last_became_active":"2024-04-24T02:12:04.751676+0000","last_became_peered":"2024-04-24T02:12:04.751676+0000","last_unstale":"2024-04-24T02:15:48.389856+0000","last_undegraded":"2024-04-24T02:15:48.389856+0000","last_fullsized":"2024-04-24T02:15:48.389856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-04-24T02:15:48.389766+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-04-24T02:15:48.389766+0000","last_clean_scrub_stamp":"2024-04-24T02:15:48.389766+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:57:05.559919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:59.519596+0000","last_change":"2024-04-24T02:15:59.519617+0000","last_active":"2024-04-24T02:15:59.519596+0000","last_peered":"2024-04-24T02:15:59.519596+0000","last_clean":"2024-04-24T02:15:59.519596+0000","last_became_active":"2024-04-24T02:12:02.755512+0000","last_became_peered":"2024-04-24T02:12:02.755512+0000","last_unstale":"2024-04-24T02:15:59.519596+0000","last_undegraded":"2024-04-24T02:15:59.519596+0000","last_fullsized":"2024-04-24T02:15:59.519596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:59.519514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:59.519514+0000","last_clean_scrub_stamp":"2024-04-24T02:15:59.519514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:42:18.856192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:43.382322+0000","last_change":"2024-04-24T02:15:43.382348+0000","last_active":"2024-04-24T02:15:43.382322+0000","last_peered":"2024-04-24T02:15:43.382322+0000","last_clean":"2024-04-24T02:15:43.382322+0000","last_became_active":"2024-04-24T02:12:06.756909+0000","last_became_peered":"2024-04-24T02:12:06.756909+0000","last_unstale":"2024-04-24T02:15:43.382322+0000","last_undegraded":"2024-04-24T02:15:43.382322+0000","last_fullsized":"2024-04-24T02:15:43.382322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:43.382200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:43.382200+0000","last_clean_scrub_stamp":"2024-04-24T02:15:43.382200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:04:38.984836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'73","reported_seq":155,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:31.331803+0000","last_change":"2024-04-24T02:15:31.331846+0000","last_active":"2024-04-24T02:15:31.331803+0000","last_peered":"2024-04-24T02:15:31.331803+0000","last_clean":"2024-04-24T02:15:31.331803+0000","last_became_active":"2024-04-24T02:12:08.770255+0000","last_became_peered":"2024-04-24T02:12:08.770255+0000","last_unstale":"2024-04-24T02:15:31.331803+0000","last_undegraded":"2024-04-24T02:15:31.331803+0000","last_fullsized":"2024-04-24T02:15:31.331803+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'73","last_scrub_stamp":"2024-04-24T02:15:31.331721+0000","last_deep_scrub":"32'73","last_deep_scrub_stamp":"2024-04-24T02:15:31.331721+0000","last_clean_scrub_stamp":"2024-04-24T02:15:31.331721+0000","objects_scrubbed":11,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:04:50.870204+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:39.022379+0000","last_change":"2024-04-24T02:15:39.022402+0000","last_active":"2024-04-24T02:15:39.022379+0000","last_peered":"2024-04-24T02:15:39.022379+0000","last_clean":"2024-04-24T02:15:39.022379+0000","last_became_active":"2024-04-24T02:12:10.785811+0000","last_became_peered":"2024-04-24T02:12:10.785811+0000","last_unstale":"2024-04-24T02:15:39.022379+0000","last_undegraded":"2024-04-24T02:15:39.022379+0000","last_fullsized":"2024-04-24T02:15:39.022379+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:39.022286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:39.022286+0000","last_clean_scrub_stamp":"2024-04-24T02:15:39.022286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:12:21.461638+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:21.490537+0000","last_change":"2024-04-24T02:16:21.490561+0000","last_active":"2024-04-24T02:16:21.490537+0000","last_peered":"2024-04-24T02:16:21.490537+0000","last_clean":"2024-04-24T02:16:21.490537+0000","last_became_active":"2024-04-24T02:12:12.799557+0000","last_became_peered":"2024-04-24T02:12:12.799557+0000","last_unstale":"2024-04-24T02:16:21.490537+0000","last_undegraded":"2024-04-24T02:16:21.490537+0000","last_fullsized":"2024-04-24T02:16:21.490537+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:21.490452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:21.490452+0000","last_clean_scrub_stamp":"2024-04-24T02:16:21.490452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:18:13.834051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'18","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:51.411880+0000","last_change":"2024-04-24T02:15:51.411902+0000","last_active":"2024-04-24T02:15:51.411880+0000","last_peered":"2024-04-24T02:15:51.411880+0000","last_clean":"2024-04-24T02:15:51.411880+0000","last_became_active":"2024-04-24T02:12:04.748399+0000","last_became_peered":"2024-04-24T02:12:04.748399+0000","last_unstale":"2024-04-24T02:15:51.411880+0000","last_undegraded":"2024-04-24T02:15:51.411880+0000","last_fullsized":"2024-04-24T02:15:51.411880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-04-24T02:15:51.411793+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-04-24T02:15:51.411793+0000","last_clean_scrub_stamp":"2024-04-24T02:15:51.411793+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:57:53.859681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":55,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:16.952527+0000","last_change":"2024-04-24T02:16:16.952565+0000","last_active":"2024-04-24T02:16:16.952527+0000","last_peered":"2024-04-24T02:16:16.952527+0000","last_clean":"2024-04-24T02:16:16.952527+0000","last_became_active":"2024-04-24T02:12:02.760772+0000","last_became_peered":"2024-04-24T02:12:02.760772+0000","last_unstale":"2024-04-24T02:16:16.952527+0000","last_undegraded":"2024-04-24T02:16:16.952527+0000","last_fullsized":"2024-04-24T02:16:16.952527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:16.952429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:16.952429+0000","last_clean_scrub_stamp":"2024-04-24T02:16:16.952429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:47:23.767080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:43.411197+0000","last_change":"2024-04-24T02:15:43.411223+0000","last_active":"2024-04-24T02:15:43.411197+0000","last_peered":"2024-04-24T02:15:43.411197+0000","last_clean":"2024-04-24T02:15:43.411197+0000","last_became_active":"2024-04-24T02:12:06.764475+0000","last_became_peered":"2024-04-24T02:12:06.764475+0000","last_unstale":"2024-04-24T02:15:43.411197+0000","last_undegraded":"2024-04-24T02:15:43.411197+0000","last_fullsized":"2024-04-24T02:15:43.411197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:43.411113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:43.411113+0000","last_clean_scrub_stamp":"2024-04-24T02:15:43.411113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:44:09.818882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'44","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:36.026642+0000","last_change":"2024-04-24T02:15:36.026681+0000","last_active":"2024-04-24T02:15:36.026642+0000","last_peered":"2024-04-24T02:15:36.026642+0000","last_clean":"2024-04-24T02:15:36.026642+0000","last_became_active":"2024-04-24T02:12:08.779447+0000","last_became_peered":"2024-04-24T02:12:08.779447+0000","last_unstale":"2024-04-24T02:15:36.026642+0000","last_undegraded":"2024-04-24T02:15:36.026642+0000","last_fullsized":"2024-04-24T02:15:36.026642+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'44","last_scrub_stamp":"2024-04-24T02:15:36.026532+0000","last_deep_scrub":"32'44","last_deep_scrub_stamp":"2024-04-24T02:15:36.026532+0000","last_clean_scrub_stamp":"2024-04-24T02:15:36.026532+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:44:38.935524+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:47.335589+0000","last_change":"2024-04-24T02:15:47.335614+0000","last_active":"2024-04-24T02:15:47.335589+0000","last_peered":"2024-04-24T02:15:47.335589+0000","last_clean":"2024-04-24T02:15:47.335589+0000","last_became_active":"2024-04-24T02:12:10.782019+0000","last_became_peered":"2024-04-24T02:12:10.782019+0000","last_unstale":"2024-04-24T02:15:47.335589+0000","last_undegraded":"2024-04-24T02:15:47.335589+0000","last_fullsized":"2024-04-24T02:15:47.335589+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:47.335498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:47.335498+0000","last_clean_scrub_stamp":"2024-04-24T02:15:47.335498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:09:16.493400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:14:40.043129+0000","last_change":"2024-04-24T02:12:12.797073+0000","last_active":"2024-04-24T02:14:40.043129+0000","last_peered":"2024-04-24T02:14:40.043129+0000","last_clean":"2024-04-24T02:14:40.043129+0000","last_became_active":"2024-04-24T02:12:12.796494+0000","last_became_peered":"2024-04-24T02:12:12.796494+0000","last_unstale":"2024-04-24T02:14:40.043129+0000","last_undegraded":"2024-04-24T02:14:40.043129+0000","last_fullsized":"2024-04-24T02:14:40.043129+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:12:11.766928+0000","last_clean_scrub_stamp":"2024-04-24T02:12:11.766928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'10","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:10.005082+0000","last_change":"2024-04-24T02:16:10.005108+0000","last_active":"2024-04-24T02:16:10.005082+0000","last_peered":"2024-04-24T02:16:10.005082+0000","last_clean":"2024-04-24T02:16:10.005082+0000","last_became_active":"2024-04-24T02:12:04.763263+0000","last_became_peered":"2024-04-24T02:12:04.763263+0000","last_unstale":"2024-04-24T02:16:10.005082+0000","last_undegraded":"2024-04-24T02:16:10.005082+0000","last_fullsized":"2024-04-24T02:16:10.005082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-24T02:16:10.004960+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-24T02:16:10.004960+0000","last_clean_scrub_stamp":"2024-04-24T02:16:10.004960+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:13:22.857543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:04.117008+0000","last_change":"2024-04-24T02:16:04.117035+0000","last_active":"2024-04-24T02:16:04.117008+0000","last_peered":"2024-04-24T02:16:04.117008+0000","last_clean":"2024-04-24T02:16:04.117008+0000","last_became_active":"2024-04-24T02:12:02.745617+0000","last_became_peered":"2024-04-24T02:12:02.745617+0000","last_unstale":"2024-04-24T02:16:04.117008+0000","last_undegraded":"2024-04-24T02:16:04.117008+0000","last_fullsized":"2024-04-24T02:16:04.117008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:16:04.116904+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:16:04.116904+0000","last_clean_scrub_stamp":"2024-04-24T02:16:04.116904+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:59:21.604473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:33.375869+0000","last_change":"2024-04-24T02:15:33.375893+0000","last_active":"2024-04-24T02:15:33.375869+0000","last_peered":"2024-04-24T02:15:33.375869+0000","last_clean":"2024-04-24T02:15:33.375869+0000","last_became_active":"2024-04-24T02:12:06.765644+0000","last_became_peered":"2024-04-24T02:12:06.765644+0000","last_unstale":"2024-04-24T02:15:33.375869+0000","last_undegraded":"2024-04-24T02:15:33.375869+0000","last_fullsized":"2024-04-24T02:15:33.375869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:33.375779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:33.375779+0000","last_clean_scrub_stamp":"2024-04-24T02:15:33.375779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:09:27.434014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'38","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:40.363423+0000","last_change":"2024-04-24T02:15:40.363468+0000","last_active":"2024-04-24T02:15:40.363423+0000","last_peered":"2024-04-24T02:15:40.363423+0000","last_clean":"2024-04-24T02:15:40.363423+0000","last_became_active":"2024-04-24T02:12:08.780056+0000","last_became_peered":"2024-04-24T02:12:08.780056+0000","last_unstale":"2024-04-24T02:15:40.363423+0000","last_undegraded":"2024-04-24T02:15:40.363423+0000","last_fullsized":"2024-04-24T02:15:40.363423+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'38","last_scrub_stamp":"2024-04-24T02:15:40.363331+0000","last_deep_scrub":"32'38","last_deep_scrub_stamp":"2024-04-24T02:15:40.363331+0000","last_clean_scrub_stamp":"2024-04-24T02:15:40.363331+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:29:10.489979+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:00.072224+0000","last_change":"2024-04-24T02:16:00.072260+0000","last_active":"2024-04-24T02:16:00.072224+0000","last_peered":"2024-04-24T02:16:00.072224+0000","last_clean":"2024-04-24T02:16:00.072224+0000","last_became_active":"2024-04-24T02:12:10.785396+0000","last_became_peered":"2024-04-24T02:12:10.785396+0000","last_unstale":"2024-04-24T02:16:00.072224+0000","last_undegraded":"2024-04-24T02:16:00.072224+0000","last_fullsized":"2024-04-24T02:16:00.072224+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:00.072127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:00.072127+0000","last_clean_scrub_stamp":"2024-04-24T02:16:00.072127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:49:41.610677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:11.993788+0000","last_change":"2024-04-24T02:16:11.993815+0000","last_active":"2024-04-24T02:16:11.993788+0000","last_peered":"2024-04-24T02:16:11.993788+0000","last_clean":"2024-04-24T02:16:11.993788+0000","last_became_active":"2024-04-24T02:12:12.793796+0000","last_became_peered":"2024-04-24T02:12:12.793796+0000","last_unstale":"2024-04-24T02:16:11.993788+0000","last_undegraded":"2024-04-24T02:16:11.993788+0000","last_fullsized":"2024-04-24T02:16:11.993788+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:16:11.993699+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:16:11.993699+0000","last_clean_scrub_stamp":"2024-04-24T02:16:11.993699+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:44:14.703404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'20","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:49.413443+0000","last_change":"2024-04-24T02:15:49.413494+0000","last_active":"2024-04-24T02:15:49.413443+0000","last_peered":"2024-04-24T02:15:49.413443+0000","last_clean":"2024-04-24T02:15:49.413443+0000","last_became_active":"2024-04-24T02:12:04.749055+0000","last_became_peered":"2024-04-24T02:12:04.749055+0000","last_unstale":"2024-04-24T02:15:49.413443+0000","last_undegraded":"2024-04-24T02:15:49.413443+0000","last_fullsized":"2024-04-24T02:15:49.413443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-04-24T02:15:49.413342+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-04-24T02:15:49.413342+0000","last_clean_scrub_stamp":"2024-04-24T02:15:49.413342+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:15:41.702152+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:12.479147+0000","last_change":"2024-04-24T02:16:12.479147+0000","last_active":"2024-04-24T02:16:12.479147+0000","last_peered":"2024-04-24T02:16:12.479147+0000","last_clean":"2024-04-24T02:16:12.479147+0000","last_became_active":"2024-04-24T02:12:02.745895+0000","last_became_peered":"2024-04-24T02:12:02.745895+0000","last_unstale":"2024-04-24T02:16:12.479147+0000","last_undegraded":"2024-04-24T02:16:12.479147+0000","last_fullsized":"2024-04-24T02:16:12.479147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:12.479035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:12.479035+0000","last_clean_scrub_stamp":"2024-04-24T02:16:12.479035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:05:15.618195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'8","reported_seq":241,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:35.456109+0000","last_change":"2024-04-24T02:15:35.456160+0000","last_active":"2024-04-24T02:15:35.456109+0000","last_peered":"2024-04-24T02:15:35.456109+0000","last_clean":"2024-04-24T02:15:35.456109+0000","last_became_active":"2024-04-24T02:12:06.765096+0000","last_became_peered":"2024-04-24T02:12:06.765096+0000","last_unstale":"2024-04-24T02:15:35.456109+0000","last_undegraded":"2024-04-24T02:15:35.456109+0000","last_fullsized":"2024-04-24T02:15:35.456109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-24T02:15:35.456000+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-24T02:15:35.456000+0000","last_clean_scrub_stamp":"2024-04-24T02:15:35.456000+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:58:11.323688+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'53","reported_seq":122,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:30.313073+0000","last_change":"2024-04-24T02:15:30.313116+0000","last_active":"2024-04-24T02:15:30.313073+0000","last_peered":"2024-04-24T02:15:30.313073+0000","last_clean":"2024-04-24T02:15:30.313073+0000","last_became_active":"2024-04-24T02:12:08.779892+0000","last_became_peered":"2024-04-24T02:12:08.779892+0000","last_unstale":"2024-04-24T02:15:30.313073+0000","last_undegraded":"2024-04-24T02:15:30.313073+0000","last_fullsized":"2024-04-24T02:15:30.313073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'53","last_scrub_stamp":"2024-04-24T02:15:30.312975+0000","last_deep_scrub":"32'53","last_deep_scrub_stamp":"2024-04-24T02:15:30.312975+0000","last_clean_scrub_stamp":"2024-04-24T02:15:30.312975+0000","objects_scrubbed":7,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:50:47.143315+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:25.040176+0000","last_change":"2024-04-24T02:15:25.040213+0000","last_active":"2024-04-24T02:15:25.040176+0000","last_peered":"2024-04-24T02:15:25.040176+0000","last_clean":"2024-04-24T02:15:25.040176+0000","last_became_active":"2024-04-24T02:12:10.781588+0000","last_became_peered":"2024-04-24T02:12:10.781588+0000","last_unstale":"2024-04-24T02:15:25.040176+0000","last_undegraded":"2024-04-24T02:15:25.040176+0000","last_fullsized":"2024-04-24T02:15:25.040176+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:25.040045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:25.040045+0000","last_clean_scrub_stamp":"2024-04-24T02:15:25.040045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:17:46.062684+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'7","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:07.987422+0000","last_change":"2024-04-24T02:16:07.987454+0000","last_active":"2024-04-24T02:16:07.987422+0000","last_peered":"2024-04-24T02:16:07.987422+0000","last_clean":"2024-04-24T02:16:07.987422+0000","last_became_active":"2024-04-24T02:12:12.793310+0000","last_became_peered":"2024-04-24T02:12:12.793310+0000","last_unstale":"2024-04-24T02:16:07.987422+0000","last_undegraded":"2024-04-24T02:16:07.987422+0000","last_fullsized":"2024-04-24T02:16:07.987422+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-04-24T02:16:07.987322+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-04-24T02:16:07.987322+0000","last_clean_scrub_stamp":"2024-04-24T02:16:07.987322+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:15:09.700497+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:45.345220+0000","last_change":"2024-04-24T02:15:45.345220+0000","last_active":"2024-04-24T02:15:45.345220+0000","last_peered":"2024-04-24T02:15:45.345220+0000","last_clean":"2024-04-24T02:15:45.345220+0000","last_became_active":"2024-04-24T02:12:04.766869+0000","last_became_peered":"2024-04-24T02:12:04.766869+0000","last_unstale":"2024-04-24T02:15:45.345220+0000","last_undegraded":"2024-04-24T02:15:45.345220+0000","last_fullsized":"2024-04-24T02:15:45.345220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:45.345090+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:45.345090+0000","last_clean_scrub_stamp":"2024-04-24T02:15:45.345090+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:03:24.007542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:03.430790+0000","last_change":"2024-04-24T02:16:03.430790+0000","last_active":"2024-04-24T02:16:03.430790+0000","last_peered":"2024-04-24T02:16:03.430790+0000","last_clean":"2024-04-24T02:16:03.430790+0000","last_became_active":"2024-04-24T02:12:02.746992+0000","last_became_peered":"2024-04-24T02:12:02.746992+0000","last_unstale":"2024-04-24T02:16:03.430790+0000","last_undegraded":"2024-04-24T02:16:03.430790+0000","last_fullsized":"2024-04-24T02:16:03.430790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:03.430671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:03.430671+0000","last_clean_scrub_stamp":"2024-04-24T02:16:03.430671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:16:11.501515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:55.103631+0000","last_change":"2024-04-24T02:15:55.103631+0000","last_active":"2024-04-24T02:15:55.103631+0000","last_peered":"2024-04-24T02:15:55.103631+0000","last_clean":"2024-04-24T02:15:55.103631+0000","last_became_active":"2024-04-24T02:12:04.749165+0000","last_became_peered":"2024-04-24T02:12:04.749165+0000","last_unstale":"2024-04-24T02:15:55.103631+0000","last_undegraded":"2024-04-24T02:15:55.103631+0000","last_fullsized":"2024-04-24T02:15:55.103631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:55.103514+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:55.103514+0000","last_clean_scrub_stamp":"2024-04-24T02:15:55.103514+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:12:47.755623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'6","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:00.117523+0000","last_change":"2024-04-24T02:16:00.117523+0000","last_active":"2024-04-24T02:16:00.117523+0000","last_peered":"2024-04-24T02:16:00.117523+0000","last_clean":"2024-04-24T02:16:00.117523+0000","last_became_active":"2024-04-24T02:12:02.751613+0000","last_became_peered":"2024-04-24T02:12:02.751613+0000","last_unstale":"2024-04-24T02:16:00.117523+0000","last_undegraded":"2024-04-24T02:16:00.117523+0000","last_fullsized":"2024-04-24T02:16:00.117523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-24T02:16:00.117409+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-24T02:16:00.117409+0000","last_clean_scrub_stamp":"2024-04-24T02:16:00.117409+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:51:24.121602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:01.029548+0000","last_change":"2024-04-24T02:16:01.029548+0000","last_active":"2024-04-24T02:16:01.029548+0000","last_peered":"2024-04-24T02:16:01.029548+0000","last_clean":"2024-04-24T02:16:01.029548+0000","last_became_active":"2024-04-24T02:12:04.763819+0000","last_became_peered":"2024-04-24T02:12:04.763819+0000","last_unstale":"2024-04-24T02:16:01.029548+0000","last_undegraded":"2024-04-24T02:16:01.029548+0000","last_fullsized":"2024-04-24T02:16:01.029548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:16:01.029417+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:16:01.029417+0000","last_clean_scrub_stamp":"2024-04-24T02:16:01.029417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:21.330095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:17.917467+0000","last_change":"2024-04-24T02:16:17.917491+0000","last_active":"2024-04-24T02:16:17.917467+0000","last_peered":"2024-04-24T02:16:17.917467+0000","last_clean":"2024-04-24T02:16:17.917467+0000","last_became_active":"2024-04-24T02:12:02.757017+0000","last_became_peered":"2024-04-24T02:12:02.757017+0000","last_unstale":"2024-04-24T02:16:17.917467+0000","last_undegraded":"2024-04-24T02:16:17.917467+0000","last_fullsized":"2024-04-24T02:16:17.917467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:17.917380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:17.917380+0000","last_clean_scrub_stamp":"2024-04-24T02:16:17.917380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:33:14.097750+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'4","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:57.094452+0000","last_change":"2024-04-24T02:15:57.094452+0000","last_active":"2024-04-24T02:15:57.094452+0000","last_peered":"2024-04-24T02:15:57.094452+0000","last_clean":"2024-04-24T02:15:57.094452+0000","last_became_active":"2024-04-24T02:12:04.749305+0000","last_became_peered":"2024-04-24T02:12:04.749305+0000","last_unstale":"2024-04-24T02:15:57.094452+0000","last_undegraded":"2024-04-24T02:15:57.094452+0000","last_fullsized":"2024-04-24T02:15:57.094452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:57.094303+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:57.094303+0000","last_clean_scrub_stamp":"2024-04-24T02:15:57.094303+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:28:38.930212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"30'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:11.099959+0000","last_change":"2024-04-24T02:16:11.099959+0000","last_active":"2024-04-24T02:16:11.099959+0000","last_peered":"2024-04-24T02:16:11.099959+0000","last_clean":"2024-04-24T02:16:11.099959+0000","last_became_active":"2024-04-24T02:12:02.741503+0000","last_became_peered":"2024-04-24T02:12:02.741503+0000","last_unstale":"2024-04-24T02:16:11.099959+0000","last_undegraded":"2024-04-24T02:16:11.099959+0000","last_fullsized":"2024-04-24T02:16:11.099959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-24T02:16:11.099811+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-24T02:16:11.099811+0000","last_clean_scrub_stamp":"2024-04-24T02:16:11.099811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:43:30.505061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'6","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:24.136315+0000","last_change":"2024-04-24T02:16:24.136353+0000","last_active":"2024-04-24T02:16:24.136315+0000","last_peered":"2024-04-24T02:16:24.136315+0000","last_clean":"2024-04-24T02:16:24.136315+0000","last_became_active":"2024-04-24T02:12:45.814356+0000","last_became_peered":"2024-04-24T02:12:45.814356+0000","last_unstale":"2024-04-24T02:16:24.136315+0000","last_undegraded":"2024-04-24T02:16:24.136315+0000","last_fullsized":"2024-04-24T02:16:24.136315+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-24T02:16:24.136212+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-24T02:16:24.136212+0000","last_clean_scrub_stamp":"2024-04-24T02:16:24.136212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:46:29.560693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:58.137753+0000","last_change":"2024-04-24T02:15:58.137753+0000","last_active":"2024-04-24T02:15:58.137753+0000","last_peered":"2024-04-24T02:15:58.137753+0000","last_clean":"2024-04-24T02:15:58.137753+0000","last_became_active":"2024-04-24T02:12:02.751680+0000","last_became_peered":"2024-04-24T02:12:02.751680+0000","last_unstale":"2024-04-24T02:15:58.137753+0000","last_undegraded":"2024-04-24T02:15:58.137753+0000","last_fullsized":"2024-04-24T02:15:58.137753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:15:58.137599+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:15:58.137599+0000","last_clean_scrub_stamp":"2024-04-24T02:15:58.137599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:14:26.157218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'8","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:19.606138+0000","last_change":"2024-04-24T02:16:19.606162+0000","last_active":"2024-04-24T02:16:19.606138+0000","last_peered":"2024-04-24T02:16:19.606138+0000","last_clean":"2024-04-24T02:16:19.606138+0000","last_became_active":"2024-04-24T02:12:45.813097+0000","last_became_peered":"2024-04-24T02:12:45.813097+0000","last_unstale":"2024-04-24T02:16:19.606138+0000","last_undegraded":"2024-04-24T02:16:19.606138+0000","last_fullsized":"2024-04-24T02:16:19.606138+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-24T02:16:19.606029+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-24T02:16:19.606029+0000","last_clean_scrub_stamp":"2024-04-24T02:16:19.606029+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:09:48.763930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:03.422937+0000","last_change":"2024-04-24T02:16:03.422937+0000","last_active":"2024-04-24T02:16:03.422937+0000","last_peered":"2024-04-24T02:16:03.422937+0000","last_clean":"2024-04-24T02:16:03.422937+0000","last_became_active":"2024-04-24T02:12:02.754356+0000","last_became_peered":"2024-04-24T02:12:02.754356+0000","last_unstale":"2024-04-24T02:16:03.422937+0000","last_undegraded":"2024-04-24T02:16:03.422937+0000","last_fullsized":"2024-04-24T02:16:03.422937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:16:03.422793+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:16:03.422793+0000","last_clean_scrub_stamp":"2024-04-24T02:16:03.422793+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:29:33.549441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'6","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:05.162202+0000","last_change":"2024-04-24T02:16:05.162202+0000","last_active":"2024-04-24T02:16:05.162202+0000","last_peered":"2024-04-24T02:16:05.162202+0000","last_clean":"2024-04-24T02:16:05.162202+0000","last_became_active":"2024-04-24T02:12:04.755738+0000","last_became_peered":"2024-04-24T02:12:04.755738+0000","last_unstale":"2024-04-24T02:16:05.162202+0000","last_undegraded":"2024-04-24T02:16:05.162202+0000","last_fullsized":"2024-04-24T02:16:05.162202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-24T02:16:05.162069+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-24T02:16:05.162069+0000","last_clean_scrub_stamp":"2024-04-24T02:16:05.162069+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:50:33.643248+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"30'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:53.400534+0000","last_change":"2024-04-24T02:15:53.400534+0000","last_active":"2024-04-24T02:15:53.400534+0000","last_peered":"2024-04-24T02:15:53.400534+0000","last_clean":"2024-04-24T02:15:53.400534+0000","last_became_active":"2024-04-24T02:12:02.755202+0000","last_became_peered":"2024-04-24T02:12:02.755202+0000","last_unstale":"2024-04-24T02:15:53.400534+0000","last_undegraded":"2024-04-24T02:15:53.400534+0000","last_fullsized":"2024-04-24T02:15:53.400534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-24T02:15:53.400367+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-24T02:15:53.400367+0000","last_clean_scrub_stamp":"2024-04-24T02:15:53.400367+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:44:25.927284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"30'4","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:16.373027+0000","last_change":"2024-04-24T02:16:16.373051+0000","last_active":"2024-04-24T02:16:16.373027+0000","last_peered":"2024-04-24T02:16:16.373027+0000","last_clean":"2024-04-24T02:16:16.373027+0000","last_became_active":"2024-04-24T02:12:04.755194+0000","last_became_peered":"2024-04-24T02:12:04.755194+0000","last_unstale":"2024-04-24T02:16:16.373027+0000","last_undegraded":"2024-04-24T02:16:16.373027+0000","last_fullsized":"2024-04-24T02:16:16.373027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-04-24T02:16:16.372898+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-04-24T02:16:16.372898+0000","last_clean_scrub_stamp":"2024-04-24T02:16:16.372898+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:03:32.097250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:56.120098+0000","last_change":"2024-04-24T02:15:56.120098+0000","last_active":"2024-04-24T02:15:56.120098+0000","last_peered":"2024-04-24T02:15:56.120098+0000","last_clean":"2024-04-24T02:15:56.120098+0000","last_became_active":"2024-04-24T02:12:02.751726+0000","last_became_peered":"2024-04-24T02:12:02.751726+0000","last_unstale":"2024-04-24T02:15:56.120098+0000","last_undegraded":"2024-04-24T02:15:56.120098+0000","last_fullsized":"2024-04-24T02:15:56.120098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:56.119931+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:56.119931+0000","last_clean_scrub_stamp":"2024-04-24T02:15:56.119931+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:52:08.946224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'6","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:54.454622+0000","last_change":"2024-04-24T02:15:54.454652+0000","last_active":"2024-04-24T02:15:54.454622+0000","last_peered":"2024-04-24T02:15:54.454622+0000","last_clean":"2024-04-24T02:15:54.454622+0000","last_became_active":"2024-04-24T02:12:04.753074+0000","last_became_peered":"2024-04-24T02:12:04.753074+0000","last_unstale":"2024-04-24T02:15:54.454622+0000","last_undegraded":"2024-04-24T02:15:54.454622+0000","last_fullsized":"2024-04-24T02:15:54.454622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-24T02:15:54.454534+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-24T02:15:54.454534+0000","last_clean_scrub_stamp":"2024-04-24T02:15:54.454534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:16:02.525378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:39.031195+0000","last_change":"2024-04-24T02:16:39.031218+0000","last_active":"2024-04-24T02:16:39.031195+0000","last_peered":"2024-04-24T02:16:39.031195+0000","last_clean":"2024-04-24T02:16:39.031195+0000","last_became_active":"2024-04-24T02:12:02.754158+0000","last_became_peered":"2024-04-24T02:12:02.754158+0000","last_unstale":"2024-04-24T02:16:39.031195+0000","last_undegraded":"2024-04-24T02:16:39.031195+0000","last_fullsized":"2024-04-24T02:16:39.031195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:16:39.031106+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:16:39.031106+0000","last_clean_scrub_stamp":"2024-04-24T02:16:39.031106+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:12:39.435691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'8","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:07.007656+0000","last_change":"2024-04-24T02:16:07.007685+0000","last_active":"2024-04-24T02:16:07.007656+0000","last_peered":"2024-04-24T02:16:07.007656+0000","last_clean":"2024-04-24T02:16:07.007656+0000","last_became_active":"2024-04-24T02:12:04.763136+0000","last_became_peered":"2024-04-24T02:12:04.763136+0000","last_unstale":"2024-04-24T02:16:07.007656+0000","last_undegraded":"2024-04-24T02:16:07.007656+0000","last_fullsized":"2024-04-24T02:16:07.007656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-24T02:16:07.007563+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-24T02:16:07.007563+0000","last_clean_scrub_stamp":"2024-04-24T02:16:07.007563+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:48:31.489105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:12.115548+0000","last_change":"2024-04-24T02:16:12.115548+0000","last_active":"2024-04-24T02:16:12.115548+0000","last_peered":"2024-04-24T02:16:12.115548+0000","last_clean":"2024-04-24T02:16:12.115548+0000","last_became_active":"2024-04-24T02:12:02.741543+0000","last_became_peered":"2024-04-24T02:12:02.741543+0000","last_unstale":"2024-04-24T02:16:12.115548+0000","last_undegraded":"2024-04-24T02:16:12.115548+0000","last_fullsized":"2024-04-24T02:16:12.115548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:12.115366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:12.115366+0000","last_clean_scrub_stamp":"2024-04-24T02:16:12.115366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:58:03.367670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:52.099971+0000","last_change":"2024-04-24T02:15:52.099971+0000","last_active":"2024-04-24T02:15:52.099971+0000","last_peered":"2024-04-24T02:15:52.099971+0000","last_clean":"2024-04-24T02:15:52.099971+0000","last_became_active":"2024-04-24T02:12:04.760028+0000","last_became_peered":"2024-04-24T02:12:04.760028+0000","last_unstale":"2024-04-24T02:15:52.099971+0000","last_undegraded":"2024-04-24T02:15:52.099971+0000","last_fullsized":"2024-04-24T02:15:52.099971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:15:52.099774+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:15:52.099774+0000","last_clean_scrub_stamp":"2024-04-24T02:15:52.099774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:55:18.068142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:14.449831+0000","last_change":"2024-04-24T02:16:14.449831+0000","last_active":"2024-04-24T02:16:14.449831+0000","last_peered":"2024-04-24T02:16:14.449831+0000","last_clean":"2024-04-24T02:16:14.449831+0000","last_became_active":"2024-04-24T02:12:02.750143+0000","last_became_peered":"2024-04-24T02:12:02.750143+0000","last_unstale":"2024-04-24T02:16:14.449831+0000","last_undegraded":"2024-04-24T02:16:14.449831+0000","last_fullsized":"2024-04-24T02:16:14.449831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:16:14.449684+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:16:14.449684+0000","last_clean_scrub_stamp":"2024-04-24T02:16:14.449684+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:27:00.632289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:00.498124+0000","last_change":"2024-04-24T02:16:00.498124+0000","last_active":"2024-04-24T02:16:00.498124+0000","last_peered":"2024-04-24T02:16:00.498124+0000","last_clean":"2024-04-24T02:16:00.498124+0000","last_became_active":"2024-04-24T02:12:04.754738+0000","last_became_peered":"2024-04-24T02:12:04.754738+0000","last_unstale":"2024-04-24T02:16:00.498124+0000","last_undegraded":"2024-04-24T02:16:00.498124+0000","last_fullsized":"2024-04-24T02:16:00.498124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-24T02:16:00.498013+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-24T02:16:00.498013+0000","last_clean_scrub_stamp":"2024-04-24T02:16:00.498013+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:10:40.099675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:11.512820+0000","last_change":"2024-04-24T02:16:11.512820+0000","last_active":"2024-04-24T02:16:11.512820+0000","last_peered":"2024-04-24T02:16:11.512820+0000","last_clean":"2024-04-24T02:16:11.512820+0000","last_became_active":"2024-04-24T02:12:02.744352+0000","last_became_peered":"2024-04-24T02:12:02.744352+0000","last_unstale":"2024-04-24T02:16:11.512820+0000","last_undegraded":"2024-04-24T02:16:11.512820+0000","last_fullsized":"2024-04-24T02:16:11.512820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:11.512653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:11.512653+0000","last_clean_scrub_stamp":"2024-04-24T02:16:11.512653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:38:55.315115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'12","reported_seq":102,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:22.450176+0000","last_change":"2024-04-24T02:16:22.450176+0000","last_active":"2024-04-24T02:16:22.450176+0000","last_peered":"2024-04-24T02:16:22.450176+0000","last_clean":"2024-04-24T02:16:22.450176+0000","last_became_active":"2024-04-24T02:12:45.808774+0000","last_became_peered":"2024-04-24T02:12:45.808774+0000","last_unstale":"2024-04-24T02:16:22.450176+0000","last_undegraded":"2024-04-24T02:16:22.450176+0000","last_fullsized":"2024-04-24T02:16:22.450176+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-04-24T02:16:22.450009+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-04-24T02:16:22.450009+0000","last_clean_scrub_stamp":"2024-04-24T02:16:22.450009+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:37:14.600020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:18.947207+0000","last_change":"2024-04-24T02:16:18.947207+0000","last_active":"2024-04-24T02:16:18.947207+0000","last_peered":"2024-04-24T02:16:18.947207+0000","last_clean":"2024-04-24T02:16:18.947207+0000","last_became_active":"2024-04-24T02:12:02.757458+0000","last_became_peered":"2024-04-24T02:12:02.757458+0000","last_unstale":"2024-04-24T02:16:18.947207+0000","last_undegraded":"2024-04-24T02:16:18.947207+0000","last_fullsized":"2024-04-24T02:16:18.947207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:18.947060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:18.947060+0000","last_clean_scrub_stamp":"2024-04-24T02:16:18.947060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:34:14.365119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'14","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:53.446051+0000","last_change":"2024-04-24T02:15:53.446051+0000","last_active":"2024-04-24T02:15:53.446051+0000","last_peered":"2024-04-24T02:15:53.446051+0000","last_clean":"2024-04-24T02:15:53.446051+0000","last_became_active":"2024-04-24T02:12:04.750973+0000","last_became_peered":"2024-04-24T02:12:04.750973+0000","last_unstale":"2024-04-24T02:15:53.446051+0000","last_undegraded":"2024-04-24T02:15:53.446051+0000","last_fullsized":"2024-04-24T02:15:53.446051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-04-24T02:15:53.445932+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-04-24T02:15:53.445932+0000","last_clean_scrub_stamp":"2024-04-24T02:15:53.445932+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:51:10.276272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:14.982027+0000","last_change":"2024-04-24T02:16:14.982027+0000","last_active":"2024-04-24T02:16:14.982027+0000","last_peered":"2024-04-24T02:16:14.982027+0000","last_clean":"2024-04-24T02:16:14.982027+0000","last_became_active":"2024-04-24T02:12:02.761235+0000","last_became_peered":"2024-04-24T02:12:02.761235+0000","last_unstale":"2024-04-24T02:16:14.982027+0000","last_undegraded":"2024-04-24T02:16:14.982027+0000","last_fullsized":"2024-04-24T02:16:14.982027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:14.981885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:14.981885+0000","last_clean_scrub_stamp":"2024-04-24T02:16:14.981885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:11:24.014498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:09.008011+0000","last_change":"2024-04-24T02:16:09.008011+0000","last_active":"2024-04-24T02:16:09.008011+0000","last_peered":"2024-04-24T02:16:09.008011+0000","last_clean":"2024-04-24T02:16:09.008011+0000","last_became_active":"2024-04-24T02:12:04.763517+0000","last_became_peered":"2024-04-24T02:12:04.763517+0000","last_unstale":"2024-04-24T02:16:09.008011+0000","last_undegraded":"2024-04-24T02:16:09.008011+0000","last_fullsized":"2024-04-24T02:16:09.008011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:16:09.007831+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:16:09.007831+0000","last_clean_scrub_stamp":"2024-04-24T02:16:09.007831+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:45:54.865186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:01.414746+0000","last_change":"2024-04-24T02:16:01.414787+0000","last_active":"2024-04-24T02:16:01.414746+0000","last_peered":"2024-04-24T02:16:01.414746+0000","last_clean":"2024-04-24T02:16:01.414746+0000","last_became_active":"2024-04-24T02:12:02.754227+0000","last_became_peered":"2024-04-24T02:12:02.754227+0000","last_unstale":"2024-04-24T02:16:01.414746+0000","last_undegraded":"2024-04-24T02:16:01.414746+0000","last_fullsized":"2024-04-24T02:16:01.414746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:16:01.414641+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:16:01.414641+0000","last_clean_scrub_stamp":"2024-04-24T02:16:01.414641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:42:59.636063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:06.480442+0000","last_change":"2024-04-24T02:16:06.480442+0000","last_active":"2024-04-24T02:16:06.480442+0000","last_peered":"2024-04-24T02:16:06.480442+0000","last_clean":"2024-04-24T02:16:06.480442+0000","last_became_active":"2024-04-24T02:12:04.755661+0000","last_became_peered":"2024-04-24T02:12:04.755661+0000","last_unstale":"2024-04-24T02:16:06.480442+0000","last_undegraded":"2024-04-24T02:16:06.480442+0000","last_fullsized":"2024-04-24T02:16:06.480442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:16:06.480334+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:16:06.480334+0000","last_clean_scrub_stamp":"2024-04-24T02:16:06.480334+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:06:18.083972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:29.899048+0000","last_change":"2024-04-24T02:16:29.899069+0000","last_active":"2024-04-24T02:16:29.899048+0000","last_peered":"2024-04-24T02:16:29.899048+0000","last_clean":"2024-04-24T02:16:29.899048+0000","last_became_active":"2024-04-24T02:12:02.758855+0000","last_became_peered":"2024-04-24T02:12:02.758855+0000","last_unstale":"2024-04-24T02:16:29.899048+0000","last_undegraded":"2024-04-24T02:16:29.899048+0000","last_fullsized":"2024-04-24T02:16:29.899048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:29.898955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:29.898955+0000","last_clean_scrub_stamp":"2024-04-24T02:16:29.898955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:47:15.652651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:22.892080+0000","last_change":"2024-04-24T02:16:22.892102+0000","last_active":"2024-04-24T02:16:22.892080+0000","last_peered":"2024-04-24T02:16:22.892080+0000","last_clean":"2024-04-24T02:16:22.892080+0000","last_became_active":"2024-04-24T02:12:02.753545+0000","last_became_peered":"2024-04-24T02:12:02.753545+0000","last_unstale":"2024-04-24T02:16:22.892080+0000","last_undegraded":"2024-04-24T02:16:22.892080+0000","last_fullsized":"2024-04-24T02:16:22.892080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:22.891992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:22.891992+0000","last_clean_scrub_stamp":"2024-04-24T02:16:22.891992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:05:46.554685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'10","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:17.082520+0000","last_change":"2024-04-24T02:16:17.082559+0000","last_active":"2024-04-24T02:16:17.082520+0000","last_peered":"2024-04-24T02:16:17.082520+0000","last_clean":"2024-04-24T02:16:17.082520+0000","last_became_active":"2024-04-24T02:12:04.758661+0000","last_became_peered":"2024-04-24T02:12:04.758661+0000","last_unstale":"2024-04-24T02:16:17.082520+0000","last_undegraded":"2024-04-24T02:16:17.082520+0000","last_fullsized":"2024-04-24T02:16:17.082520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-24T02:16:17.082421+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-24T02:16:17.082421+0000","last_clean_scrub_stamp":"2024-04-24T02:16:17.082421+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:51:19.331390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:06.148493+0000","last_change":"2024-04-24T02:16:06.148493+0000","last_active":"2024-04-24T02:16:06.148493+0000","last_peered":"2024-04-24T02:16:06.148493+0000","last_clean":"2024-04-24T02:16:06.148493+0000","last_became_active":"2024-04-24T02:12:02.745396+0000","last_became_peered":"2024-04-24T02:12:02.745396+0000","last_unstale":"2024-04-24T02:16:06.148493+0000","last_undegraded":"2024-04-24T02:16:06.148493+0000","last_fullsized":"2024-04-24T02:16:06.148493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:06.148341+0000","last_clean_scrub_stamp":"2024-04-24T02:16:06.148341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:39:08.794896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:49.477876+0000","last_change":"2024-04-24T02:15:49.477905+0000","last_active":"2024-04-24T02:15:49.477876+0000","last_peered":"2024-04-24T02:15:49.477876+0000","last_clean":"2024-04-24T02:15:49.477876+0000","last_became_active":"2024-04-24T02:12:04.766344+0000","last_became_peered":"2024-04-24T02:12:04.766344+0000","last_unstale":"2024-04-24T02:15:49.477876+0000","last_undegraded":"2024-04-24T02:15:49.477876+0000","last_fullsized":"2024-04-24T02:15:49.477876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:15:49.477787+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:15:49.477787+0000","last_clean_scrub_stamp":"2024-04-24T02:15:49.477787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:34:26.940534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":272,"ondisk_log_size":272,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1888,"num_read_kb":1653,"num_write":789,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1754,"ondisk_log_size":1754,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1617,"num_read_kb":1507,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":483,"ondisk_log_size":483,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640319,"num_pgs":152,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39944,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331896,"statfs":{"total":96636764160,"available":96595861504,"internally_reserved":0,"allocated":458752,"data_stored":135584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640317,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40456,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331384,"statfs":{"total":96636764160,"available":96595337216,"internally_reserved":0,"allocated":983040,"data_stored":722688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640319,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36324,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335516,"statfs":{"total":96636764160,"available":96599568384,"internally_reserved":0,"allocated":1011712,"data_stored":724048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705727,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39908,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331932,"statfs":{"total":96636764160,"available":96595898368,"internally_reserved":0,"allocated":421888,"data_stored":133610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T02:16:46.036 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:46.037 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:46.037 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:46.037 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-24T02:12:01.726045+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:46.038 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:46.038 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:46.038 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:46.039 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:46.039 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-04-24T02:12:11.766928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=15, tm_sec=21, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:16:46.040 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-24T02:17:06.040 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T02:17:06.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.146+0000 7fd7a6375640 1 Processor -- start 2024-04-24T02:17:06.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.146+0000 7fd7a6375640 1 -- start start 2024-04-24T02:17:06.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.147+0000 7fd7a6375640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fd7a006d7d0 0x7fd7a006dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:17:06.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.147+0000 7fd7a6375640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7a00a08a0 con 0x7fd7a006e0f0 2024-04-24T02:17:06.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.147+0000 7fd7a6375640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fd7a006e560 con 0x7fd7a006d7d0 2024-04-24T02:17:06.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.147+0000 7fd79ffff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fd7a006d7d0 0x7fd7a006dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:17:06.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.147+0000 7fd79f7fe640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fd7a006e0f0 0x7fd7a012e320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:52758/0 (socket says 172.21.15.104:52758) 2024-04-24T02:17:06.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.147+0000 7fd79f7fe640 1 -- 172.21.15.104:0/3619222617 learned_addr learned my addr 172.21.15.104:0/3619222617 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-04-24T02:17:06.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.147+0000 7fd79ffff640 1 -- 172.21.15.104:0/3619222617 >> v1:172.21.15.104:6789/0 conn(0x7fd7a006e0f0 legacy=0x7fd7a012e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:17:06.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.147+0000 7fd79ffff640 1 -- 172.21.15.104:0/3619222617 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7a006f6d0 con 0x7fd7a006d7d0 2024-04-24T02:17:06.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.147+0000 7fd79effd640 1 -- 172.21.15.104:0/3619222617 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4267671423 0 0) 0x7fd7a00a08a0 con 0x7fd7a006e0f0 2024-04-24T02:17:06.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.148+0000 7fd79ffff640 1 --2- 172.21.15.104:0/3619222617 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7a006d7d0 0x7fd7a006dbb0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fd790009750 tx=0x7fd79002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d671eb4c487ec52 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:17:06.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.148+0000 7fd79effd640 1 -- 172.21.15.104:0/3619222617 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd790035020 con 0x7fd7a006d7d0 2024-04-24T02:17:06.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.148+0000 7fd79effd640 1 -- 172.21.15.104:0/3619222617 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd790031760 con 0x7fd7a006d7d0 2024-04-24T02:17:06.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.148+0000 7fd79effd640 1 -- 172.21.15.104:0/3619222617 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd790031a60 con 0x7fd7a006d7d0 2024-04-24T02:17:06.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.149+0000 7fd7a6375640 1 -- 172.21.15.104:0/3619222617 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7a006d7d0 msgr2=0x7fd7a006dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:17:06.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.149+0000 7fd7a6375640 1 --2- 172.21.15.104:0/3619222617 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7a006d7d0 0x7fd7a006dbb0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fd790009750 tx=0x7fd79002b8d0 comp rx=0 tx=0).stop 2024-04-24T02:17:06.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.149+0000 7fd7a6375640 1 -- 172.21.15.104:0/3619222617 shutdown_connections 2024-04-24T02:17:06.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.149+0000 7fd7a6375640 1 --2- 172.21.15.104:0/3619222617 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7a006d7d0 0x7fd7a006dbb0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:17:06.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.149+0000 7fd7a6375640 1 -- 172.21.15.104:0/3619222617 >> 172.21.15.104:0/3619222617 conn(0x7fd7a009ea70 msgr2=0x7fd7a009ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:17:06.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.149+0000 7fd7a6375640 1 -- 172.21.15.104:0/3619222617 shutdown_connections 2024-04-24T02:17:06.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.149+0000 7fd7a6375640 1 -- 172.21.15.104:0/3619222617 wait complete. 2024-04-24T02:17:06.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.149+0000 7fd7a6375640 1 Processor -- start 2024-04-24T02:17:06.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.150+0000 7fd7a6375640 1 -- start start 2024-04-24T02:17:06.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.150+0000 7fd7a6375640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7a006d7d0 0x7fd7a01c3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:17:06.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.150+0000 7fd7a6375640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a012ebb0 con 0x7fd7a006d7d0 2024-04-24T02:17:06.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.150+0000 7fd79ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7a006d7d0 0x7fd7a01c3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:17:06.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.150+0000 7fd79ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7a006d7d0 0x7fd7a01c3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52646/0 (socket says 172.21.15.104:52646) 2024-04-24T02:17:06.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.150+0000 7fd79ffff640 1 -- 172.21.15.104:0/648921882 learned_addr learned my addr 172.21.15.104:0/648921882 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:17:06.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.150+0000 7fd79ffff640 1 -- 172.21.15.104:0/648921882 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7a0091ae0 con 0x7fd7a006d7d0 2024-04-24T02:17:06.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.150+0000 7fd79ffff640 1 --2- 172.21.15.104:0/648921882 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7a006d7d0 0x7fd7a01c3310 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fd790009750 tx=0x7fd7900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:17:06.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.151+0000 7fd79cff9640 1 -- 172.21.15.104:0/648921882 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd79003b980 con 0x7fd7a006d7d0 2024-04-24T02:17:06.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.151+0000 7fd79cff9640 1 -- 172.21.15.104:0/648921882 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd79003bb40 con 0x7fd7a006d7d0 2024-04-24T02:17:06.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.151+0000 7fd7a6375640 1 -- 172.21.15.104:0/648921882 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7a0091340 con 0x7fd7a006d7d0 2024-04-24T02:17:06.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.151+0000 7fd79cff9640 1 -- 172.21.15.104:0/648921882 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd79003be60 con 0x7fd7a006d7d0 2024-04-24T02:17:06.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.151+0000 7fd7a6375640 1 -- 172.21.15.104:0/648921882 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7a01c3850 con 0x7fd7a006d7d0 2024-04-24T02:17:06.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.151+0000 7fd79cff9640 1 -- 172.21.15.104:0/648921882 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd79004c060 con 0x7fd7a006d7d0 2024-04-24T02:17:06.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.152+0000 7fd79cff9640 1 --2- 172.21.15.104:0/648921882 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd78c038060 0x7fd78c03a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:17:06.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.152+0000 7fd79cff9640 1 -- 172.21.15.104:0/648921882 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fd79006d620 con 0x7fd7a006d7d0 2024-04-24T02:17:06.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.152+0000 7fd7a6375640 1 -- 172.21.15.104:0/648921882 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7a0062da0 con 0x7fd7a006d7d0 2024-04-24T02:17:06.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.152+0000 7fd79f7fe640 1 --2- 172.21.15.104:0/648921882 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd78c038060 0x7fd78c03a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:17:06.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.153+0000 7fd79f7fe640 1 --2- 172.21.15.104:0/648921882 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd78c038060 0x7fd78c03a520 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd794000c00 tx=0x7fd794007970 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:17:06.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.157+0000 7fd79cff9640 1 -- 172.21.15.104:0/648921882 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7fd790040070 con 0x7fd7a006d7d0 2024-04-24T02:17:06.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.325+0000 7fd7a6375640 1 -- 172.21.15.104:0/648921882 --> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd7a0071c50 con 0x7fd78c038060 2024-04-24T02:17:06.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.340+0000 7fd79cff9640 1 -- 172.21.15.104:0/648921882 <== mgr.4101 v2:172.21.15.134:6824/3655027977 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665812 (secure 0 0 0) 0x7fd7a0071c50 con 0x7fd78c038060 2024-04-24T02:17:06.348 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-24T02:17:06.354 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-04-24T02:17:06.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.345+0000 7fd7a6375640 1 -- 172.21.15.104:0/648921882 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd78c038060 msgr2=0x7fd78c03a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:17:06.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.345+0000 7fd7a6375640 1 --2- 172.21.15.104:0/648921882 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd78c038060 0x7fd78c03a520 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd794000c00 tx=0x7fd794007970 comp rx=0 tx=0).stop 2024-04-24T02:17:06.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.345+0000 7fd7a6375640 1 -- 172.21.15.104:0/648921882 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7a006d7d0 msgr2=0x7fd7a01c3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:17:06.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.345+0000 7fd7a6375640 1 --2- 172.21.15.104:0/648921882 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7a006d7d0 0x7fd7a01c3310 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fd790009750 tx=0x7fd7900046c0 comp rx=0 tx=0).stop 2024-04-24T02:17:06.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.345+0000 7fd7a6375640 1 -- 172.21.15.104:0/648921882 shutdown_connections 2024-04-24T02:17:06.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.345+0000 7fd7a6375640 1 --2- 172.21.15.104:0/648921882 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7fd78c038060 0x7fd78c03a520 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:17:06.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.345+0000 7fd7a6375640 1 --2- 172.21.15.104:0/648921882 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7a006d7d0 0x7fd7a01c3310 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:17:06.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.345+0000 7fd7a6375640 1 -- 172.21.15.104:0/648921882 >> 172.21.15.104:0/648921882 conn(0x7fd7a009ea70 msgr2=0x7fd7a009c350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:17:06.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.345+0000 7fd7a6375640 1 -- 172.21.15.104:0/648921882 shutdown_connections 2024-04-24T02:17:06.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.345+0000 7fd7a6375640 1 -- 172.21.15.104:0/648921882 wait complete. 2024-04-24T02:17:06.358 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":188,"stamp":"2024-04-24T02:17:06.058190+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":252,"num_object_clones":0,"num_object_copies":504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":0,"num_read":5385,"num_read_kb":4938,"num_write":2369,"num_write_kb":61373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5011,"ondisk_log_size":5011,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":156632,"kb_used_data":2808,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377330728,"statfs":{"total":386547056640,"available":386386665472,"internally_reserved":0,"allocated":2875392,"data_stored":1715930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":157476630},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003797"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:59.430267+0000","last_change":"2024-04-24T02:15:59.430267+0000","last_active":"2024-04-24T02:15:59.430267+0000","last_peered":"2024-04-24T02:15:59.430267+0000","last_clean":"2024-04-24T02:15:59.430267+0000","last_became_active":"2024-04-24T02:12:02.754954+0000","last_became_peered":"2024-04-24T02:12:02.754954+0000","last_unstale":"2024-04-24T02:15:59.430267+0000","last_undegraded":"2024-04-24T02:15:59.430267+0000","last_fullsized":"2024-04-24T02:15:59.430267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:59.430121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:59.430121+0000","last_clean_scrub_stamp":"2024-04-24T02:15:59.430121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:45.711501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'8","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:58.482814+0000","last_change":"2024-04-24T02:15:58.482814+0000","last_active":"2024-04-24T02:15:58.482814+0000","last_peered":"2024-04-24T02:15:58.482814+0000","last_clean":"2024-04-24T02:15:58.482814+0000","last_became_active":"2024-04-24T02:12:04.754049+0000","last_became_peered":"2024-04-24T02:12:04.754049+0000","last_unstale":"2024-04-24T02:15:58.482814+0000","last_undegraded":"2024-04-24T02:15:58.482814+0000","last_fullsized":"2024-04-24T02:15:58.482814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-24T02:15:58.482703+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-24T02:15:58.482703+0000","last_clean_scrub_stamp":"2024-04-24T02:15:58.482703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:53:22.606358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:02.136783+0000","last_change":"2024-04-24T02:16:02.136783+0000","last_active":"2024-04-24T02:16:02.136783+0000","last_peered":"2024-04-24T02:16:02.136783+0000","last_clean":"2024-04-24T02:16:02.136783+0000","last_became_active":"2024-04-24T02:12:02.745526+0000","last_became_peered":"2024-04-24T02:12:02.745526+0000","last_unstale":"2024-04-24T02:16:02.136783+0000","last_undegraded":"2024-04-24T02:16:02.136783+0000","last_fullsized":"2024-04-24T02:16:02.136783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:02.136614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:02.136614+0000","last_clean_scrub_stamp":"2024-04-24T02:16:02.136614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:53.467958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'12","reported_seq":98,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:11.034405+0000","last_change":"2024-04-24T02:16:11.034405+0000","last_active":"2024-04-24T02:16:11.034405+0000","last_peered":"2024-04-24T02:16:11.034405+0000","last_clean":"2024-04-24T02:16:11.034405+0000","last_became_active":"2024-04-24T02:12:04.762967+0000","last_became_peered":"2024-04-24T02:12:04.762967+0000","last_unstale":"2024-04-24T02:16:11.034405+0000","last_undegraded":"2024-04-24T02:16:11.034405+0000","last_fullsized":"2024-04-24T02:16:11.034405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-04-24T02:16:11.034280+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-04-24T02:16:11.034280+0000","last_clean_scrub_stamp":"2024-04-24T02:16:11.034280+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:23:21.593953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":62,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:31.981832+0000","last_change":"2024-04-24T02:16:31.981858+0000","last_active":"2024-04-24T02:16:31.981832+0000","last_peered":"2024-04-24T02:16:31.981832+0000","last_clean":"2024-04-24T02:16:31.981832+0000","last_became_active":"2024-04-24T02:12:02.758985+0000","last_became_peered":"2024-04-24T02:12:02.758985+0000","last_unstale":"2024-04-24T02:16:31.981832+0000","last_undegraded":"2024-04-24T02:16:31.981832+0000","last_fullsized":"2024-04-24T02:16:31.981832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:31.981743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:31.981743+0000","last_clean_scrub_stamp":"2024-04-24T02:16:31.981743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:00:08.436641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:43.364378+0000","last_change":"2024-04-24T02:15:43.364378+0000","last_active":"2024-04-24T02:15:43.364378+0000","last_peered":"2024-04-24T02:15:43.364378+0000","last_clean":"2024-04-24T02:15:43.364378+0000","last_became_active":"2024-04-24T02:12:04.765327+0000","last_became_peered":"2024-04-24T02:12:04.765327+0000","last_unstale":"2024-04-24T02:15:43.364378+0000","last_undegraded":"2024-04-24T02:15:43.364378+0000","last_fullsized":"2024-04-24T02:15:43.364378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-24T02:15:43.364212+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-24T02:15:43.364212+0000","last_clean_scrub_stamp":"2024-04-24T02:15:43.364212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:05:54.967851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:07.469203+0000","last_change":"2024-04-24T02:16:07.469227+0000","last_active":"2024-04-24T02:16:07.469203+0000","last_peered":"2024-04-24T02:16:07.469203+0000","last_clean":"2024-04-24T02:16:07.469203+0000","last_became_active":"2024-04-24T02:12:02.744804+0000","last_became_peered":"2024-04-24T02:12:02.744804+0000","last_unstale":"2024-04-24T02:16:07.469203+0000","last_undegraded":"2024-04-24T02:16:07.469203+0000","last_fullsized":"2024-04-24T02:16:07.469203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:07.469103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:07.469103+0000","last_clean_scrub_stamp":"2024-04-24T02:16:07.469103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:53:31.592758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'6","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:12.958220+0000","last_change":"2024-04-24T02:16:12.958220+0000","last_active":"2024-04-24T02:16:12.958220+0000","last_peered":"2024-04-24T02:16:12.958220+0000","last_clean":"2024-04-24T02:16:12.958220+0000","last_became_active":"2024-04-24T02:12:04.763076+0000","last_became_peered":"2024-04-24T02:12:04.763076+0000","last_unstale":"2024-04-24T02:16:12.958220+0000","last_undegraded":"2024-04-24T02:16:12.958220+0000","last_fullsized":"2024-04-24T02:16:12.958220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-24T02:16:12.958105+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-24T02:16:12.958105+0000","last_clean_scrub_stamp":"2024-04-24T02:16:12.958105+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:12:38.863390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:39.991050+0000","last_change":"2024-04-24T02:16:39.991050+0000","last_active":"2024-04-24T02:16:39.991050+0000","last_peered":"2024-04-24T02:16:39.991050+0000","last_clean":"2024-04-24T02:16:39.991050+0000","last_became_active":"2024-04-24T02:12:02.754208+0000","last_became_peered":"2024-04-24T02:12:02.754208+0000","last_unstale":"2024-04-24T02:16:39.991050+0000","last_undegraded":"2024-04-24T02:16:39.991050+0000","last_fullsized":"2024-04-24T02:16:39.991050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:16:39.990933+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:16:39.990933+0000","last_clean_scrub_stamp":"2024-04-24T02:16:39.990933+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:52:54.925511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:04.423664+0000","last_change":"2024-04-24T02:16:04.423664+0000","last_active":"2024-04-24T02:16:04.423664+0000","last_peered":"2024-04-24T02:16:04.423664+0000","last_clean":"2024-04-24T02:16:04.423664+0000","last_became_active":"2024-04-24T02:12:04.755248+0000","last_became_peered":"2024-04-24T02:12:04.755248+0000","last_unstale":"2024-04-24T02:16:04.423664+0000","last_undegraded":"2024-04-24T02:16:04.423664+0000","last_fullsized":"2024-04-24T02:16:04.423664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:16:04.423535+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:16:04.423535+0000","last_clean_scrub_stamp":"2024-04-24T02:16:04.423535+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:28:44.017367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:05.445133+0000","last_change":"2024-04-24T02:16:05.445133+0000","last_active":"2024-04-24T02:16:05.445133+0000","last_peered":"2024-04-24T02:16:05.445133+0000","last_clean":"2024-04-24T02:16:05.445133+0000","last_became_active":"2024-04-24T02:12:02.741326+0000","last_became_peered":"2024-04-24T02:12:02.741326+0000","last_unstale":"2024-04-24T02:16:05.445133+0000","last_undegraded":"2024-04-24T02:16:05.445133+0000","last_fullsized":"2024-04-24T02:16:05.445133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:16:05.444999+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:16:05.444999+0000","last_clean_scrub_stamp":"2024-04-24T02:16:05.444999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:34:29.031714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:14.007277+0000","last_change":"2024-04-24T02:16:14.007277+0000","last_active":"2024-04-24T02:16:14.007277+0000","last_peered":"2024-04-24T02:16:14.007277+0000","last_clean":"2024-04-24T02:16:14.007277+0000","last_became_active":"2024-04-24T02:12:04.762921+0000","last_became_peered":"2024-04-24T02:12:04.762921+0000","last_unstale":"2024-04-24T02:16:14.007277+0000","last_undegraded":"2024-04-24T02:16:14.007277+0000","last_fullsized":"2024-04-24T02:16:14.007277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:16:14.007159+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:16:14.007159+0000","last_clean_scrub_stamp":"2024-04-24T02:16:14.007159+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:54:00.213102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:40.983823+0000","last_change":"2024-04-24T02:16:40.983823+0000","last_active":"2024-04-24T02:16:40.983823+0000","last_peered":"2024-04-24T02:16:40.983823+0000","last_clean":"2024-04-24T02:16:40.983823+0000","last_became_active":"2024-04-24T02:12:02.752921+0000","last_became_peered":"2024-04-24T02:12:02.752921+0000","last_unstale":"2024-04-24T02:16:40.983823+0000","last_undegraded":"2024-04-24T02:16:40.983823+0000","last_fullsized":"2024-04-24T02:16:40.983823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:40.983631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:40.983631+0000","last_clean_scrub_stamp":"2024-04-24T02:16:40.983631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:45:27.139844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'12","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:52.390885+0000","last_change":"2024-04-24T02:15:52.390885+0000","last_active":"2024-04-24T02:15:52.390885+0000","last_peered":"2024-04-24T02:15:52.390885+0000","last_clean":"2024-04-24T02:15:52.390885+0000","last_became_active":"2024-04-24T02:12:04.751655+0000","last_became_peered":"2024-04-24T02:12:04.751655+0000","last_unstale":"2024-04-24T02:15:52.390885+0000","last_undegraded":"2024-04-24T02:15:52.390885+0000","last_fullsized":"2024-04-24T02:15:52.390885+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-04-24T02:15:52.390774+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-04-24T02:15:52.390774+0000","last_clean_scrub_stamp":"2024-04-24T02:15:52.390774+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:04:47.993410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"30'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:54.140936+0000","last_change":"2024-04-24T02:15:54.140936+0000","last_active":"2024-04-24T02:15:54.140936+0000","last_peered":"2024-04-24T02:15:54.140936+0000","last_clean":"2024-04-24T02:15:54.140936+0000","last_became_active":"2024-04-24T02:12:02.752476+0000","last_became_peered":"2024-04-24T02:12:02.752476+0000","last_unstale":"2024-04-24T02:15:54.140936+0000","last_undegraded":"2024-04-24T02:15:54.140936+0000","last_fullsized":"2024-04-24T02:15:54.140936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-24T02:15:54.140770+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-24T02:15:54.140770+0000","last_clean_scrub_stamp":"2024-04-24T02:15:54.140770+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:49:51.563159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'18","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:12.548196+0000","last_change":"2024-04-24T02:16:12.548196+0000","last_active":"2024-04-24T02:16:12.548196+0000","last_peered":"2024-04-24T02:16:12.548196+0000","last_clean":"2024-04-24T02:16:12.548196+0000","last_became_active":"2024-04-24T02:12:04.766693+0000","last_became_peered":"2024-04-24T02:12:04.766693+0000","last_unstale":"2024-04-24T02:16:12.548196+0000","last_undegraded":"2024-04-24T02:16:12.548196+0000","last_fullsized":"2024-04-24T02:16:12.548196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-04-24T02:16:12.548082+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-04-24T02:16:12.548082+0000","last_clean_scrub_stamp":"2024-04-24T02:16:12.548082+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:29:42.674730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"30'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:59.112718+0000","last_change":"2024-04-24T02:15:59.112718+0000","last_active":"2024-04-24T02:15:59.112718+0000","last_peered":"2024-04-24T02:15:59.112718+0000","last_clean":"2024-04-24T02:15:59.112718+0000","last_became_active":"2024-04-24T02:12:04.764470+0000","last_became_peered":"2024-04-24T02:12:04.764470+0000","last_unstale":"2024-04-24T02:15:59.112718+0000","last_undegraded":"2024-04-24T02:15:59.112718+0000","last_fullsized":"2024-04-24T02:15:59.112718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-24T02:15:59.112564+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-24T02:15:59.112564+0000","last_clean_scrub_stamp":"2024-04-24T02:15:59.112564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:36:51.262575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:07.472840+0000","last_change":"2024-04-24T02:16:07.472840+0000","last_active":"2024-04-24T02:16:07.472840+0000","last_peered":"2024-04-24T02:16:07.472840+0000","last_clean":"2024-04-24T02:16:07.472840+0000","last_became_active":"2024-04-24T02:12:02.753791+0000","last_became_peered":"2024-04-24T02:12:02.753791+0000","last_unstale":"2024-04-24T02:16:07.472840+0000","last_undegraded":"2024-04-24T02:16:07.472840+0000","last_fullsized":"2024-04-24T02:16:07.472840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:16:07.472691+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:16:07.472691+0000","last_clean_scrub_stamp":"2024-04-24T02:16:07.472691+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:06:27.147194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'10","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:55.422124+0000","last_change":"2024-04-24T02:15:55.422124+0000","last_active":"2024-04-24T02:15:55.422124+0000","last_peered":"2024-04-24T02:15:55.422124+0000","last_clean":"2024-04-24T02:15:55.422124+0000","last_became_active":"2024-04-24T02:12:04.750774+0000","last_became_peered":"2024-04-24T02:12:04.750774+0000","last_unstale":"2024-04-24T02:15:55.422124+0000","last_undegraded":"2024-04-24T02:15:55.422124+0000","last_fullsized":"2024-04-24T02:15:55.422124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-24T02:15:55.421992+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-24T02:15:55.421992+0000","last_clean_scrub_stamp":"2024-04-24T02:15:55.421992+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:08:59.008607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:57.387551+0000","last_change":"2024-04-24T02:15:57.387551+0000","last_active":"2024-04-24T02:15:57.387551+0000","last_peered":"2024-04-24T02:15:57.387551+0000","last_clean":"2024-04-24T02:15:57.387551+0000","last_became_active":"2024-04-24T02:12:02.754860+0000","last_became_peered":"2024-04-24T02:12:02.754860+0000","last_unstale":"2024-04-24T02:15:57.387551+0000","last_undegraded":"2024-04-24T02:15:57.387551+0000","last_fullsized":"2024-04-24T02:15:57.387551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:57.387439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:57.387439+0000","last_clean_scrub_stamp":"2024-04-24T02:15:57.387439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:51:58.982518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'8","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:52.480434+0000","last_change":"2024-04-24T02:15:52.480434+0000","last_active":"2024-04-24T02:15:52.480434+0000","last_peered":"2024-04-24T02:15:52.480434+0000","last_clean":"2024-04-24T02:15:52.480434+0000","last_became_active":"2024-04-24T02:12:04.750919+0000","last_became_peered":"2024-04-24T02:12:04.750919+0000","last_unstale":"2024-04-24T02:15:52.480434+0000","last_undegraded":"2024-04-24T02:15:52.480434+0000","last_fullsized":"2024-04-24T02:15:52.480434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-24T02:15:52.480323+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-24T02:15:52.480323+0000","last_clean_scrub_stamp":"2024-04-24T02:15:52.480323+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:42:50.701745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:57.510492+0000","last_change":"2024-04-24T02:15:57.510492+0000","last_active":"2024-04-24T02:15:57.510492+0000","last_peered":"2024-04-24T02:15:57.510492+0000","last_clean":"2024-04-24T02:15:57.510492+0000","last_became_active":"2024-04-24T02:12:02.756389+0000","last_became_peered":"2024-04-24T02:12:02.756389+0000","last_unstale":"2024-04-24T02:15:57.510492+0000","last_undegraded":"2024-04-24T02:15:57.510492+0000","last_fullsized":"2024-04-24T02:15:57.510492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:57.510375+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:57.510375+0000","last_clean_scrub_stamp":"2024-04-24T02:15:57.510375+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:59:42.826506+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'2","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:50.155056+0000","last_change":"2024-04-24T02:15:50.155056+0000","last_active":"2024-04-24T02:15:50.155056+0000","last_peered":"2024-04-24T02:15:50.155056+0000","last_clean":"2024-04-24T02:15:50.155056+0000","last_became_active":"2024-04-24T02:12:04.766739+0000","last_became_peered":"2024-04-24T02:12:04.766739+0000","last_unstale":"2024-04-24T02:15:50.155056+0000","last_undegraded":"2024-04-24T02:15:50.155056+0000","last_fullsized":"2024-04-24T02:15:50.155056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:15:50.154864+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:15:50.154864+0000","last_clean_scrub_stamp":"2024-04-24T02:15:50.154864+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:50:10.913324+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:10.508998+0000","last_change":"2024-04-24T02:16:10.508998+0000","last_active":"2024-04-24T02:16:10.508998+0000","last_peered":"2024-04-24T02:16:10.508998+0000","last_clean":"2024-04-24T02:16:10.508998+0000","last_became_active":"2024-04-24T02:12:02.744763+0000","last_became_peered":"2024-04-24T02:12:02.744763+0000","last_unstale":"2024-04-24T02:16:10.508998+0000","last_undegraded":"2024-04-24T02:16:10.508998+0000","last_fullsized":"2024-04-24T02:16:10.508998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:10.508823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:10.508823+0000","last_clean_scrub_stamp":"2024-04-24T02:16:10.508823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:09:39.666724+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'10","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:02.403810+0000","last_change":"2024-04-24T02:16:02.403810+0000","last_active":"2024-04-24T02:16:02.403810+0000","last_peered":"2024-04-24T02:16:02.403810+0000","last_clean":"2024-04-24T02:16:02.403810+0000","last_became_active":"2024-04-24T02:12:04.764659+0000","last_became_peered":"2024-04-24T02:12:04.764659+0000","last_unstale":"2024-04-24T02:16:02.403810+0000","last_undegraded":"2024-04-24T02:16:02.403810+0000","last_fullsized":"2024-04-24T02:16:02.403810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-24T02:16:02.403666+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-24T02:16:02.403666+0000","last_clean_scrub_stamp":"2024-04-24T02:16:02.403666+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:51:19.234006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:15.120108+0000","last_change":"2024-04-24T02:16:15.120108+0000","last_active":"2024-04-24T02:16:15.120108+0000","last_peered":"2024-04-24T02:16:15.120108+0000","last_clean":"2024-04-24T02:16:15.120108+0000","last_became_active":"2024-04-24T02:12:02.741976+0000","last_became_peered":"2024-04-24T02:12:02.741976+0000","last_unstale":"2024-04-24T02:16:15.120108+0000","last_undegraded":"2024-04-24T02:16:15.120108+0000","last_fullsized":"2024-04-24T02:16:15.120108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:15.119977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:15.119977+0000","last_clean_scrub_stamp":"2024-04-24T02:16:15.119977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:58:41.992666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'10","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:02.459044+0000","last_change":"2024-04-24T02:16:02.459044+0000","last_active":"2024-04-24T02:16:02.459044+0000","last_peered":"2024-04-24T02:16:02.459044+0000","last_clean":"2024-04-24T02:16:02.459044+0000","last_became_active":"2024-04-24T02:12:04.755133+0000","last_became_peered":"2024-04-24T02:12:04.755133+0000","last_unstale":"2024-04-24T02:16:02.459044+0000","last_undegraded":"2024-04-24T02:16:02.459044+0000","last_fullsized":"2024-04-24T02:16:02.459044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-24T02:16:02.458930+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-24T02:16:02.458930+0000","last_clean_scrub_stamp":"2024-04-24T02:16:02.458930+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:46:33.121676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:20.946977+0000","last_change":"2024-04-24T02:16:20.946977+0000","last_active":"2024-04-24T02:16:20.946977+0000","last_peered":"2024-04-24T02:16:20.946977+0000","last_clean":"2024-04-24T02:16:20.946977+0000","last_became_active":"2024-04-24T02:12:02.753196+0000","last_became_peered":"2024-04-24T02:12:02.753196+0000","last_unstale":"2024-04-24T02:16:20.946977+0000","last_undegraded":"2024-04-24T02:16:20.946977+0000","last_fullsized":"2024-04-24T02:16:20.946977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:20.946817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:20.946817+0000","last_clean_scrub_stamp":"2024-04-24T02:16:20.946817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:42:34.809229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'36","reported_seq":110,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:20.451514+0000","last_change":"2024-04-24T02:16:20.451514+0000","last_active":"2024-04-24T02:16:20.451514+0000","last_peered":"2024-04-24T02:16:20.451514+0000","last_clean":"2024-04-24T02:16:20.451514+0000","last_became_active":"2024-04-24T02:12:12.798179+0000","last_became_peered":"2024-04-24T02:12:12.798179+0000","last_unstale":"2024-04-24T02:16:20.451514+0000","last_undegraded":"2024-04-24T02:16:20.451514+0000","last_fullsized":"2024-04-24T02:16:20.451514+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-04-24T02:16:20.451404+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-04-24T02:16:20.451404+0000","last_clean_scrub_stamp":"2024-04-24T02:16:20.451404+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:44:14.976647+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:05.033188+0000","last_change":"2024-04-24T02:16:05.033188+0000","last_active":"2024-04-24T02:16:05.033188+0000","last_peered":"2024-04-24T02:16:05.033188+0000","last_clean":"2024-04-24T02:16:05.033188+0000","last_became_active":"2024-04-24T02:12:04.763725+0000","last_became_peered":"2024-04-24T02:12:04.763725+0000","last_unstale":"2024-04-24T02:16:05.033188+0000","last_undegraded":"2024-04-24T02:16:05.033188+0000","last_fullsized":"2024-04-24T02:16:05.033188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-24T02:16:05.033002+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-24T02:16:05.033002+0000","last_clean_scrub_stamp":"2024-04-24T02:16:05.033002+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:02:20.198278+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:33.022271+0000","last_change":"2024-04-24T02:16:33.022271+0000","last_active":"2024-04-24T02:16:33.022271+0000","last_peered":"2024-04-24T02:16:33.022271+0000","last_clean":"2024-04-24T02:16:33.022271+0000","last_became_active":"2024-04-24T02:12:02.755520+0000","last_became_peered":"2024-04-24T02:12:02.755520+0000","last_unstale":"2024-04-24T02:16:33.022271+0000","last_undegraded":"2024-04-24T02:16:33.022271+0000","last_fullsized":"2024-04-24T02:16:33.022271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:16:33.022152+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:16:33.022152+0000","last_clean_scrub_stamp":"2024-04-24T02:16:33.022152+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:11.682310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:28.347111+0000","last_change":"2024-04-24T02:15:28.347111+0000","last_active":"2024-04-24T02:15:28.347111+0000","last_peered":"2024-04-24T02:15:28.347111+0000","last_clean":"2024-04-24T02:15:28.347111+0000","last_became_active":"2024-04-24T02:12:06.758033+0000","last_became_peered":"2024-04-24T02:12:06.758033+0000","last_unstale":"2024-04-24T02:15:28.347111+0000","last_undegraded":"2024-04-24T02:15:28.347111+0000","last_fullsized":"2024-04-24T02:15:28.347111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:28.346988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:28.346988+0000","last_clean_scrub_stamp":"2024-04-24T02:15:28.346988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:48:41.497279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'51","reported_seq":119,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:49.256528+0000","last_change":"2024-04-24T02:15:49.256528+0000","last_active":"2024-04-24T02:15:49.256528+0000","last_peered":"2024-04-24T02:15:49.256528+0000","last_clean":"2024-04-24T02:15:49.256528+0000","last_became_active":"2024-04-24T02:12:08.783666+0000","last_became_peered":"2024-04-24T02:12:08.783666+0000","last_unstale":"2024-04-24T02:15:49.256528+0000","last_undegraded":"2024-04-24T02:15:49.256528+0000","last_fullsized":"2024-04-24T02:15:49.256528+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'51","last_scrub_stamp":"2024-04-24T02:15:49.256366+0000","last_deep_scrub":"32'51","last_deep_scrub_stamp":"2024-04-24T02:15:49.256366+0000","last_clean_scrub_stamp":"2024-04-24T02:15:49.256366+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:04:52.395526+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:38.404846+0000","last_change":"2024-04-24T02:15:38.404846+0000","last_active":"2024-04-24T02:15:38.404846+0000","last_peered":"2024-04-24T02:15:38.404846+0000","last_clean":"2024-04-24T02:15:38.404846+0000","last_became_active":"2024-04-24T02:12:10.786981+0000","last_became_peered":"2024-04-24T02:12:10.786981+0000","last_unstale":"2024-04-24T02:15:38.404846+0000","last_undegraded":"2024-04-24T02:15:38.404846+0000","last_fullsized":"2024-04-24T02:15:38.404846+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:38.404652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:38.404652+0000","last_clean_scrub_stamp":"2024-04-24T02:15:38.404652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:17:51.653509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:18.381296+0000","last_change":"2024-04-24T02:16:18.381296+0000","last_active":"2024-04-24T02:16:18.381296+0000","last_peered":"2024-04-24T02:16:18.381296+0000","last_clean":"2024-04-24T02:16:18.381296+0000","last_became_active":"2024-04-24T02:12:12.796319+0000","last_became_peered":"2024-04-24T02:12:12.796319+0000","last_unstale":"2024-04-24T02:16:18.381296+0000","last_undegraded":"2024-04-24T02:16:18.381296+0000","last_fullsized":"2024-04-24T02:16:18.381296+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-04-24T02:16:18.381185+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-04-24T02:16:18.381185+0000","last_clean_scrub_stamp":"2024-04-24T02:16:18.381185+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:37:39.446642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:58.158961+0000","last_change":"2024-04-24T02:15:58.158961+0000","last_active":"2024-04-24T02:15:58.158961+0000","last_peered":"2024-04-24T02:15:58.158961+0000","last_clean":"2024-04-24T02:15:58.158961+0000","last_became_active":"2024-04-24T02:12:04.764351+0000","last_became_peered":"2024-04-24T02:12:04.764351+0000","last_unstale":"2024-04-24T02:15:58.158961+0000","last_undegraded":"2024-04-24T02:15:58.158961+0000","last_fullsized":"2024-04-24T02:15:58.158961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:58.158816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:58.158816+0000","last_clean_scrub_stamp":"2024-04-24T02:15:58.158816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:17:50.502415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:10.527257+0000","last_change":"2024-04-24T02:16:10.527257+0000","last_active":"2024-04-24T02:16:10.527257+0000","last_peered":"2024-04-24T02:16:10.527257+0000","last_clean":"2024-04-24T02:16:10.527257+0000","last_became_active":"2024-04-24T02:12:02.744030+0000","last_became_peered":"2024-04-24T02:12:02.744030+0000","last_unstale":"2024-04-24T02:16:10.527257+0000","last_undegraded":"2024-04-24T02:16:10.527257+0000","last_fullsized":"2024-04-24T02:16:10.527257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:10.527107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:10.527107+0000","last_clean_scrub_stamp":"2024-04-24T02:16:10.527107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:28:15.772679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:48.070327+0000","last_change":"2024-04-24T02:15:48.070327+0000","last_active":"2024-04-24T02:15:48.070327+0000","last_peered":"2024-04-24T02:15:48.070327+0000","last_clean":"2024-04-24T02:15:48.070327+0000","last_became_active":"2024-04-24T02:12:06.758561+0000","last_became_peered":"2024-04-24T02:12:06.758561+0000","last_unstale":"2024-04-24T02:15:48.070327+0000","last_undegraded":"2024-04-24T02:15:48.070327+0000","last_fullsized":"2024-04-24T02:15:48.070327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:48.070212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:48.070212+0000","last_clean_scrub_stamp":"2024-04-24T02:15:48.070212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:55:00.279301+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'16","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:32.376443+0000","last_change":"2024-04-24T02:15:32.376443+0000","last_active":"2024-04-24T02:15:32.376443+0000","last_peered":"2024-04-24T02:15:32.376443+0000","last_clean":"2024-04-24T02:15:32.376443+0000","last_became_active":"2024-04-24T02:12:08.767493+0000","last_became_peered":"2024-04-24T02:12:08.767493+0000","last_unstale":"2024-04-24T02:15:32.376443+0000","last_undegraded":"2024-04-24T02:15:32.376443+0000","last_fullsized":"2024-04-24T02:15:32.376443+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-04-24T02:15:32.376317+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-04-24T02:15:32.376317+0000","last_clean_scrub_stamp":"2024-04-24T02:15:32.376317+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:12:17.100634+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:26.334490+0000","last_change":"2024-04-24T02:15:26.334490+0000","last_active":"2024-04-24T02:15:26.334490+0000","last_peered":"2024-04-24T02:15:26.334490+0000","last_clean":"2024-04-24T02:15:26.334490+0000","last_became_active":"2024-04-24T02:12:10.779231+0000","last_became_peered":"2024-04-24T02:12:10.779231+0000","last_unstale":"2024-04-24T02:15:26.334490+0000","last_undegraded":"2024-04-24T02:15:26.334490+0000","last_fullsized":"2024-04-24T02:15:26.334490+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:26.334368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:26.334368+0000","last_clean_scrub_stamp":"2024-04-24T02:15:26.334368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:20:30.421649+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'8","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:51.148078+0000","last_change":"2024-04-24T02:15:51.148133+0000","last_active":"2024-04-24T02:15:51.148078+0000","last_peered":"2024-04-24T02:15:51.148078+0000","last_clean":"2024-04-24T02:15:51.148078+0000","last_became_active":"2024-04-24T02:12:12.791542+0000","last_became_peered":"2024-04-24T02:12:12.791542+0000","last_unstale":"2024-04-24T02:15:51.148078+0000","last_undegraded":"2024-04-24T02:15:51.148078+0000","last_fullsized":"2024-04-24T02:15:51.148078+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-24T02:15:51.147969+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-24T02:15:51.147969+0000","last_clean_scrub_stamp":"2024-04-24T02:15:51.147969+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:39:56.492767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'8","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:06.023890+0000","last_change":"2024-04-24T02:16:06.023890+0000","last_active":"2024-04-24T02:16:06.023890+0000","last_peered":"2024-04-24T02:16:06.023890+0000","last_clean":"2024-04-24T02:16:06.023890+0000","last_became_active":"2024-04-24T02:12:04.763491+0000","last_became_peered":"2024-04-24T02:12:04.763491+0000","last_unstale":"2024-04-24T02:16:06.023890+0000","last_undegraded":"2024-04-24T02:16:06.023890+0000","last_fullsized":"2024-04-24T02:16:06.023890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-24T02:16:06.023706+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-24T02:16:06.023706+0000","last_clean_scrub_stamp":"2024-04-24T02:16:06.023706+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:20:06.723214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"30'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:28.942332+0000","last_change":"2024-04-24T02:16:28.942332+0000","last_active":"2024-04-24T02:16:28.942332+0000","last_peered":"2024-04-24T02:16:28.942332+0000","last_clean":"2024-04-24T02:16:28.942332+0000","last_became_active":"2024-04-24T02:12:02.755636+0000","last_became_peered":"2024-04-24T02:12:02.755636+0000","last_unstale":"2024-04-24T02:16:28.942332+0000","last_undegraded":"2024-04-24T02:16:28.942332+0000","last_fullsized":"2024-04-24T02:16:28.942332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-24T02:16:28.942143+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-24T02:16:28.942143+0000","last_clean_scrub_stamp":"2024-04-24T02:16:28.942143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:04:36.488733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:15.646908+0000","last_change":"2024-04-24T02:16:15.646931+0000","last_active":"2024-04-24T02:16:15.646908+0000","last_peered":"2024-04-24T02:16:15.646908+0000","last_clean":"2024-04-24T02:16:15.646908+0000","last_became_active":"2024-04-24T02:12:45.813038+0000","last_became_peered":"2024-04-24T02:12:45.813038+0000","last_unstale":"2024-04-24T02:16:15.646908+0000","last_undegraded":"2024-04-24T02:16:15.646908+0000","last_fullsized":"2024-04-24T02:16:15.646908+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:15.646820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:15.646820+0000","last_clean_scrub_stamp":"2024-04-24T02:16:15.646820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:06:27.250459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"32'29","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:31.495714+0000","last_change":"2024-04-24T02:15:31.495714+0000","last_active":"2024-04-24T02:15:31.495714+0000","last_peered":"2024-04-24T02:15:31.495714+0000","last_clean":"2024-04-24T02:15:31.495714+0000","last_became_active":"2024-04-24T02:12:08.783077+0000","last_became_peered":"2024-04-24T02:12:08.783077+0000","last_unstale":"2024-04-24T02:15:31.495714+0000","last_undegraded":"2024-04-24T02:15:31.495714+0000","last_fullsized":"2024-04-24T02:15:31.495714+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'29","last_scrub_stamp":"2024-04-24T02:15:31.495549+0000","last_deep_scrub":"32'29","last_deep_scrub_stamp":"2024-04-24T02:15:31.495549+0000","last_clean_scrub_stamp":"2024-04-24T02:15:31.495549+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:13:45.684753+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'285","reported_seq":417,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:46.312755+0000","last_change":"2024-04-24T02:15:46.312755+0000","last_active":"2024-04-24T02:15:46.312755+0000","last_peered":"2024-04-24T02:15:46.312755+0000","last_clean":"2024-04-24T02:15:46.312755+0000","last_became_active":"2024-04-24T02:12:10.783726+0000","last_became_peered":"2024-04-24T02:12:10.783726+0000","last_unstale":"2024-04-24T02:15:46.312755+0000","last_undegraded":"2024-04-24T02:15:46.312755+0000","last_fullsized":"2024-04-24T02:15:46.312755+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-24T02:15:46.312603+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-24T02:15:46.312603+0000","last_clean_scrub_stamp":"2024-04-24T02:15:46.312603+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:06:42.364068+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:13.570766+0000","last_change":"2024-04-24T02:16:13.570786+0000","last_active":"2024-04-24T02:16:13.570766+0000","last_peered":"2024-04-24T02:16:13.570766+0000","last_clean":"2024-04-24T02:16:13.570766+0000","last_became_active":"2024-04-24T02:12:12.801331+0000","last_became_peered":"2024-04-24T02:12:12.801331+0000","last_unstale":"2024-04-24T02:16:13.570766+0000","last_undegraded":"2024-04-24T02:16:13.570766+0000","last_fullsized":"2024-04-24T02:16:13.570766+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:13.570666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:13.570666+0000","last_clean_scrub_stamp":"2024-04-24T02:16:13.570666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:28:53.164498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'18","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:07.145357+0000","last_change":"2024-04-24T02:16:07.145357+0000","last_active":"2024-04-24T02:16:07.145357+0000","last_peered":"2024-04-24T02:16:07.145357+0000","last_clean":"2024-04-24T02:16:07.145357+0000","last_became_active":"2024-04-24T02:12:04.756039+0000","last_became_peered":"2024-04-24T02:12:04.756039+0000","last_unstale":"2024-04-24T02:16:07.145357+0000","last_undegraded":"2024-04-24T02:16:07.145357+0000","last_fullsized":"2024-04-24T02:16:07.145357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-04-24T02:16:07.145185+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-04-24T02:16:07.145185+0000","last_clean_scrub_stamp":"2024-04-24T02:16:07.145185+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:09:45.496387+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":60,"num_read_kb":52,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:01.453009+0000","last_change":"2024-04-24T02:16:01.453009+0000","last_active":"2024-04-24T02:16:01.453009+0000","last_peered":"2024-04-24T02:16:01.453009+0000","last_clean":"2024-04-24T02:16:01.453009+0000","last_became_active":"2024-04-24T02:12:02.754852+0000","last_became_peered":"2024-04-24T02:12:02.754852+0000","last_unstale":"2024-04-24T02:16:01.453009+0000","last_undegraded":"2024-04-24T02:16:01.453009+0000","last_fullsized":"2024-04-24T02:16:01.453009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-24T02:16:01.452852+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-24T02:16:01.452852+0000","last_clean_scrub_stamp":"2024-04-24T02:16:01.452852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:28:06.698424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:26.356380+0000","last_change":"2024-04-24T02:15:26.356380+0000","last_active":"2024-04-24T02:15:26.356380+0000","last_peered":"2024-04-24T02:15:26.356380+0000","last_clean":"2024-04-24T02:15:26.356380+0000","last_became_active":"2024-04-24T02:12:06.757883+0000","last_became_peered":"2024-04-24T02:12:06.757883+0000","last_unstale":"2024-04-24T02:15:26.356380+0000","last_undegraded":"2024-04-24T02:15:26.356380+0000","last_fullsized":"2024-04-24T02:15:26.356380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:26.356206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:26.356206+0000","last_clean_scrub_stamp":"2024-04-24T02:15:26.356206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:34:03.818953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'44","reported_seq":106,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:33.483248+0000","last_change":"2024-04-24T02:15:33.483248+0000","last_active":"2024-04-24T02:15:33.483248+0000","last_peered":"2024-04-24T02:15:33.483248+0000","last_clean":"2024-04-24T02:15:33.483248+0000","last_became_active":"2024-04-24T02:12:08.780950+0000","last_became_peered":"2024-04-24T02:12:08.780950+0000","last_unstale":"2024-04-24T02:15:33.483248+0000","last_undegraded":"2024-04-24T02:15:33.483248+0000","last_fullsized":"2024-04-24T02:15:33.483248+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'44","last_scrub_stamp":"2024-04-24T02:15:33.483112+0000","last_deep_scrub":"32'44","last_deep_scrub_stamp":"2024-04-24T02:15:33.483112+0000","last_clean_scrub_stamp":"2024-04-24T02:15:33.483112+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:41:28.737400+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'285","reported_seq":448,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:28.021732+0000","last_change":"2024-04-24T02:15:28.021732+0000","last_active":"2024-04-24T02:15:28.021732+0000","last_peered":"2024-04-24T02:15:28.021732+0000","last_clean":"2024-04-24T02:15:28.021732+0000","last_became_active":"2024-04-24T02:12:10.778254+0000","last_became_peered":"2024-04-24T02:12:10.778254+0000","last_unstale":"2024-04-24T02:15:28.021732+0000","last_undegraded":"2024-04-24T02:15:28.021732+0000","last_fullsized":"2024-04-24T02:15:28.021732+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-24T02:15:28.021612+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-24T02:15:28.021612+0000","last_clean_scrub_stamp":"2024-04-24T02:15:28.021612+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:14:08.932379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:41.341961+0000","last_change":"2024-04-24T02:15:41.341961+0000","last_active":"2024-04-24T02:15:41.341961+0000","last_peered":"2024-04-24T02:15:41.341961+0000","last_clean":"2024-04-24T02:15:41.341961+0000","last_became_active":"2024-04-24T02:12:04.767906+0000","last_became_peered":"2024-04-24T02:12:04.767906+0000","last_unstale":"2024-04-24T02:15:41.341961+0000","last_undegraded":"2024-04-24T02:15:41.341961+0000","last_fullsized":"2024-04-24T02:15:41.341961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:41.341814+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:41.341814+0000","last_clean_scrub_stamp":"2024-04-24T02:15:41.341814+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:28:20.935646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"32'3","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:11.548242+0000","last_change":"2024-04-24T02:16:11.548242+0000","last_active":"2024-04-24T02:16:11.548242+0000","last_peered":"2024-04-24T02:16:11.548242+0000","last_clean":"2024-04-24T02:16:11.548242+0000","last_became_active":"2024-04-24T02:12:02.748372+0000","last_became_peered":"2024-04-24T02:12:02.748372+0000","last_unstale":"2024-04-24T02:16:11.548242+0000","last_undegraded":"2024-04-24T02:16:11.548242+0000","last_fullsized":"2024-04-24T02:16:11.548242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-04-24T02:16:11.548067+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-04-24T02:16:11.548067+0000","last_clean_scrub_stamp":"2024-04-24T02:16:11.548067+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:46:42.210813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:36.460166+0000","last_change":"2024-04-24T02:15:36.460166+0000","last_active":"2024-04-24T02:15:36.460166+0000","last_peered":"2024-04-24T02:15:36.460166+0000","last_clean":"2024-04-24T02:15:36.460166+0000","last_became_active":"2024-04-24T02:12:06.764324+0000","last_became_peered":"2024-04-24T02:12:06.764324+0000","last_unstale":"2024-04-24T02:15:36.460166+0000","last_undegraded":"2024-04-24T02:15:36.460166+0000","last_fullsized":"2024-04-24T02:15:36.460166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:36.460053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:36.460053+0000","last_clean_scrub_stamp":"2024-04-24T02:15:36.460053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:36:31.597092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'58","reported_seq":125,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:36.435151+0000","last_change":"2024-04-24T02:15:36.435151+0000","last_active":"2024-04-24T02:15:36.435151+0000","last_peered":"2024-04-24T02:15:36.435151+0000","last_clean":"2024-04-24T02:15:36.435151+0000","last_became_active":"2024-04-24T02:12:08.771060+0000","last_became_peered":"2024-04-24T02:12:08.771060+0000","last_unstale":"2024-04-24T02:15:36.435151+0000","last_undegraded":"2024-04-24T02:15:36.435151+0000","last_fullsized":"2024-04-24T02:15:36.435151+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'58","last_scrub_stamp":"2024-04-24T02:15:36.435008+0000","last_deep_scrub":"32'58","last_deep_scrub_stamp":"2024-04-24T02:15:36.435008+0000","last_clean_scrub_stamp":"2024-04-24T02:15:36.435008+0000","objects_scrubbed":10,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:51:55.089317+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:29.043636+0000","last_change":"2024-04-24T02:15:29.043636+0000","last_active":"2024-04-24T02:15:29.043636+0000","last_peered":"2024-04-24T02:15:29.043636+0000","last_clean":"2024-04-24T02:15:29.043636+0000","last_became_active":"2024-04-24T02:12:10.776715+0000","last_became_peered":"2024-04-24T02:12:10.776715+0000","last_unstale":"2024-04-24T02:15:29.043636+0000","last_undegraded":"2024-04-24T02:15:29.043636+0000","last_fullsized":"2024-04-24T02:15:29.043636+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:29.043460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:29.043460+0000","last_clean_scrub_stamp":"2024-04-24T02:15:29.043460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:29:47.538838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'5","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:46.429992+0000","last_change":"2024-04-24T02:15:46.429992+0000","last_active":"2024-04-24T02:15:46.429992+0000","last_peered":"2024-04-24T02:15:46.429992+0000","last_clean":"2024-04-24T02:15:46.429992+0000","last_became_active":"2024-04-24T02:12:12.797405+0000","last_became_peered":"2024-04-24T02:12:12.797405+0000","last_unstale":"2024-04-24T02:15:46.429992+0000","last_undegraded":"2024-04-24T02:15:46.429992+0000","last_fullsized":"2024-04-24T02:15:46.429992+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-04-24T02:15:46.429875+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-04-24T02:15:46.429875+0000","last_clean_scrub_stamp":"2024-04-24T02:15:46.429875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:57:31.938558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'10","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:56.464583+0000","last_change":"2024-04-24T02:15:56.464583+0000","last_active":"2024-04-24T02:15:56.464583+0000","last_peered":"2024-04-24T02:15:56.464583+0000","last_clean":"2024-04-24T02:15:56.464583+0000","last_became_active":"2024-04-24T02:12:04.753819+0000","last_became_peered":"2024-04-24T02:12:04.753819+0000","last_unstale":"2024-04-24T02:15:56.464583+0000","last_undegraded":"2024-04-24T02:15:56.464583+0000","last_fullsized":"2024-04-24T02:15:56.464583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-24T02:15:56.464457+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-24T02:15:56.464457+0000","last_clean_scrub_stamp":"2024-04-24T02:15:56.464457+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:34:20.051173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:06.433190+0000","last_change":"2024-04-24T02:16:06.433190+0000","last_active":"2024-04-24T02:16:06.433190+0000","last_peered":"2024-04-24T02:16:06.433190+0000","last_clean":"2024-04-24T02:16:06.433190+0000","last_became_active":"2024-04-24T02:12:02.743202+0000","last_became_peered":"2024-04-24T02:12:02.743202+0000","last_unstale":"2024-04-24T02:16:06.433190+0000","last_undegraded":"2024-04-24T02:16:06.433190+0000","last_fullsized":"2024-04-24T02:16:06.433190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:06.433087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:06.433087+0000","last_clean_scrub_stamp":"2024-04-24T02:16:06.433087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:59:51.749218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:41.008594+0000","last_change":"2024-04-24T02:15:41.008594+0000","last_active":"2024-04-24T02:15:41.008594+0000","last_peered":"2024-04-24T02:15:41.008594+0000","last_clean":"2024-04-24T02:15:41.008594+0000","last_became_active":"2024-04-24T02:12:06.765690+0000","last_became_peered":"2024-04-24T02:12:06.765690+0000","last_unstale":"2024-04-24T02:15:41.008594+0000","last_undegraded":"2024-04-24T02:15:41.008594+0000","last_fullsized":"2024-04-24T02:15:41.008594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:41.008462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:41.008462+0000","last_clean_scrub_stamp":"2024-04-24T02:15:41.008462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:55:16.490485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'45","reported_seq":107,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:36.400192+0000","last_change":"2024-04-24T02:15:36.400192+0000","last_active":"2024-04-24T02:15:36.400192+0000","last_peered":"2024-04-24T02:15:36.400192+0000","last_clean":"2024-04-24T02:15:36.400192+0000","last_became_active":"2024-04-24T02:12:08.779594+0000","last_became_peered":"2024-04-24T02:12:08.779594+0000","last_unstale":"2024-04-24T02:15:36.400192+0000","last_undegraded":"2024-04-24T02:15:36.400192+0000","last_fullsized":"2024-04-24T02:15:36.400192+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'45","last_scrub_stamp":"2024-04-24T02:15:36.400062+0000","last_deep_scrub":"32'45","last_deep_scrub_stamp":"2024-04-24T02:15:36.400062+0000","last_clean_scrub_stamp":"2024-04-24T02:15:36.400062+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:41:55.736741+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:35.000257+0000","last_change":"2024-04-24T02:15:35.000257+0000","last_active":"2024-04-24T02:15:35.000257+0000","last_peered":"2024-04-24T02:15:35.000257+0000","last_clean":"2024-04-24T02:15:35.000257+0000","last_became_active":"2024-04-24T02:12:10.784901+0000","last_became_peered":"2024-04-24T02:12:10.784901+0000","last_unstale":"2024-04-24T02:15:35.000257+0000","last_undegraded":"2024-04-24T02:15:35.000257+0000","last_fullsized":"2024-04-24T02:15:35.000257+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:35.000105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:35.000105+0000","last_clean_scrub_stamp":"2024-04-24T02:15:35.000105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:13:03.366315+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'6","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:50.476327+0000","last_change":"2024-04-24T02:15:50.476327+0000","last_active":"2024-04-24T02:15:50.476327+0000","last_peered":"2024-04-24T02:15:50.476327+0000","last_clean":"2024-04-24T02:15:50.476327+0000","last_became_active":"2024-04-24T02:12:12.795364+0000","last_became_peered":"2024-04-24T02:12:12.795364+0000","last_unstale":"2024-04-24T02:15:50.476327+0000","last_undegraded":"2024-04-24T02:15:50.476327+0000","last_fullsized":"2024-04-24T02:15:50.476327+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-24T02:15:50.476194+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-24T02:15:50.476194+0000","last_clean_scrub_stamp":"2024-04-24T02:15:50.476194+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:36.757574+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'8","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:58.385311+0000","last_change":"2024-04-24T02:15:58.385311+0000","last_active":"2024-04-24T02:15:58.385311+0000","last_peered":"2024-04-24T02:15:58.385311+0000","last_clean":"2024-04-24T02:15:58.385311+0000","last_became_active":"2024-04-24T02:12:04.762869+0000","last_became_peered":"2024-04-24T02:12:04.762869+0000","last_unstale":"2024-04-24T02:15:58.385311+0000","last_undegraded":"2024-04-24T02:15:58.385311+0000","last_fullsized":"2024-04-24T02:15:58.385311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-24T02:15:58.385121+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-24T02:15:58.385121+0000","last_clean_scrub_stamp":"2024-04-24T02:15:58.385121+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:34:35.847868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:21.909175+0000","last_change":"2024-04-24T02:16:21.909175+0000","last_active":"2024-04-24T02:16:21.909175+0000","last_peered":"2024-04-24T02:16:21.909175+0000","last_clean":"2024-04-24T02:16:21.909175+0000","last_became_active":"2024-04-24T02:12:02.757488+0000","last_became_peered":"2024-04-24T02:12:02.757488+0000","last_unstale":"2024-04-24T02:16:21.909175+0000","last_undegraded":"2024-04-24T02:16:21.909175+0000","last_fullsized":"2024-04-24T02:16:21.909175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:21.909066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:21.909066+0000","last_clean_scrub_stamp":"2024-04-24T02:16:21.909066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:41:28.743431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:41.997919+0000","last_change":"2024-04-24T02:15:41.997919+0000","last_active":"2024-04-24T02:15:41.997919+0000","last_peered":"2024-04-24T02:15:41.997919+0000","last_clean":"2024-04-24T02:15:41.997919+0000","last_became_active":"2024-04-24T02:12:06.764339+0000","last_became_peered":"2024-04-24T02:12:06.764339+0000","last_unstale":"2024-04-24T02:15:41.997919+0000","last_undegraded":"2024-04-24T02:15:41.997919+0000","last_fullsized":"2024-04-24T02:15:41.997919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:41.997807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:41.997807+0000","last_clean_scrub_stamp":"2024-04-24T02:15:41.997807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:41:46.258937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'60","reported_seq":131,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:55.225430+0000","last_change":"2024-04-24T02:15:55.225430+0000","last_active":"2024-04-24T02:15:55.225430+0000","last_peered":"2024-04-24T02:15:55.225430+0000","last_clean":"2024-04-24T02:15:55.225430+0000","last_became_active":"2024-04-24T02:12:08.780230+0000","last_became_peered":"2024-04-24T02:12:08.780230+0000","last_unstale":"2024-04-24T02:15:55.225430+0000","last_undegraded":"2024-04-24T02:15:55.225430+0000","last_fullsized":"2024-04-24T02:15:55.225430+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'60","last_scrub_stamp":"2024-04-24T02:15:55.225237+0000","last_deep_scrub":"32'60","last_deep_scrub_stamp":"2024-04-24T02:15:55.225237+0000","last_clean_scrub_stamp":"2024-04-24T02:15:55.225237+0000","objects_scrubbed":9,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:37:16.290694+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'285","reported_seq":410,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:31.050534+0000","last_change":"2024-04-24T02:15:31.050534+0000","last_active":"2024-04-24T02:15:31.050534+0000","last_peered":"2024-04-24T02:15:31.050534+0000","last_clean":"2024-04-24T02:15:31.050534+0000","last_became_active":"2024-04-24T02:12:10.784278+0000","last_became_peered":"2024-04-24T02:12:10.784278+0000","last_unstale":"2024-04-24T02:15:31.050534+0000","last_undegraded":"2024-04-24T02:15:31.050534+0000","last_fullsized":"2024-04-24T02:15:31.050534+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-24T02:15:31.050423+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-24T02:15:31.050423+0000","last_clean_scrub_stamp":"2024-04-24T02:15:31.050423+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:20:42.675691+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"32'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:20.089986+0000","last_change":"2024-04-24T02:16:20.089986+0000","last_active":"2024-04-24T02:16:20.089986+0000","last_peered":"2024-04-24T02:16:20.089986+0000","last_clean":"2024-04-24T02:16:20.089986+0000","last_became_active":"2024-04-24T02:12:12.792569+0000","last_became_peered":"2024-04-24T02:12:12.792569+0000","last_unstale":"2024-04-24T02:16:20.089986+0000","last_undegraded":"2024-04-24T02:16:20.089986+0000","last_fullsized":"2024-04-24T02:16:20.089986+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:16:20.089856+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:16:20.089856+0000","last_clean_scrub_stamp":"2024-04-24T02:16:20.089856+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:47:36.197137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'26","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:50.416966+0000","last_change":"2024-04-24T02:15:50.416966+0000","last_active":"2024-04-24T02:15:50.416966+0000","last_peered":"2024-04-24T02:15:50.416966+0000","last_clean":"2024-04-24T02:15:50.416966+0000","last_became_active":"2024-04-24T02:12:04.752075+0000","last_became_peered":"2024-04-24T02:12:04.752075+0000","last_unstale":"2024-04-24T02:15:50.416966+0000","last_undegraded":"2024-04-24T02:15:50.416966+0000","last_fullsized":"2024-04-24T02:15:50.416966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'26","last_scrub_stamp":"2024-04-24T02:15:50.416819+0000","last_deep_scrub":"32'26","last_deep_scrub_stamp":"2024-04-24T02:15:50.416819+0000","last_clean_scrub_stamp":"2024-04-24T02:15:50.416819+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:34:38.445893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":67,"num_write":30,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:24.951494+0000","last_change":"2024-04-24T02:16:24.951494+0000","last_active":"2024-04-24T02:16:24.951494+0000","last_peered":"2024-04-24T02:16:24.951494+0000","last_clean":"2024-04-24T02:16:24.951494+0000","last_became_active":"2024-04-24T02:12:02.755468+0000","last_became_peered":"2024-04-24T02:12:02.755468+0000","last_unstale":"2024-04-24T02:16:24.951494+0000","last_undegraded":"2024-04-24T02:16:24.951494+0000","last_fullsized":"2024-04-24T02:16:24.951494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:24.951328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:24.951328+0000","last_clean_scrub_stamp":"2024-04-24T02:16:24.951328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:38:40.755222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:44.072993+0000","last_change":"2024-04-24T02:15:44.072993+0000","last_active":"2024-04-24T02:15:44.072993+0000","last_peered":"2024-04-24T02:15:44.072993+0000","last_clean":"2024-04-24T02:15:44.072993+0000","last_became_active":"2024-04-24T02:12:06.764365+0000","last_became_peered":"2024-04-24T02:12:06.764365+0000","last_unstale":"2024-04-24T02:15:44.072993+0000","last_undegraded":"2024-04-24T02:15:44.072993+0000","last_fullsized":"2024-04-24T02:15:44.072993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:44.072858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:44.072858+0000","last_clean_scrub_stamp":"2024-04-24T02:15:44.072858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:57:12.574588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'80","reported_seq":166,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:32.292044+0000","last_change":"2024-04-24T02:15:32.292044+0000","last_active":"2024-04-24T02:15:32.292044+0000","last_peered":"2024-04-24T02:15:32.292044+0000","last_clean":"2024-04-24T02:15:32.292044+0000","last_became_active":"2024-04-24T02:12:08.779602+0000","last_became_peered":"2024-04-24T02:12:08.779602+0000","last_unstale":"2024-04-24T02:15:32.292044+0000","last_undegraded":"2024-04-24T02:15:32.292044+0000","last_fullsized":"2024-04-24T02:15:32.292044+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'80","last_scrub_stamp":"2024-04-24T02:15:32.291896+0000","last_deep_scrub":"32'80","last_deep_scrub_stamp":"2024-04-24T02:15:32.291896+0000","last_clean_scrub_stamp":"2024-04-24T02:15:32.291896+0000","objects_scrubbed":7,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:08:35.878511+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:24.008622+0000","last_change":"2024-04-24T02:15:24.008622+0000","last_active":"2024-04-24T02:15:24.008622+0000","last_peered":"2024-04-24T02:15:24.008622+0000","last_clean":"2024-04-24T02:15:24.008622+0000","last_became_active":"2024-04-24T02:12:10.782121+0000","last_became_peered":"2024-04-24T02:12:10.782121+0000","last_unstale":"2024-04-24T02:15:24.008622+0000","last_undegraded":"2024-04-24T02:15:24.008622+0000","last_fullsized":"2024-04-24T02:15:24.008622+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:24.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:24.008533+0000","last_clean_scrub_stamp":"2024-04-24T02:15:24.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:46:49.817831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'21","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:43.025968+0000","last_change":"2024-04-24T02:15:43.025968+0000","last_active":"2024-04-24T02:15:43.025968+0000","last_peered":"2024-04-24T02:15:43.025968+0000","last_clean":"2024-04-24T02:15:43.025968+0000","last_became_active":"2024-04-24T02:12:12.789799+0000","last_became_peered":"2024-04-24T02:12:12.789799+0000","last_unstale":"2024-04-24T02:15:43.025968+0000","last_undegraded":"2024-04-24T02:15:43.025968+0000","last_fullsized":"2024-04-24T02:15:43.025968+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-04-24T02:15:43.025844+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-04-24T02:15:43.025844+0000","last_clean_scrub_stamp":"2024-04-24T02:15:43.025844+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:56:55.136630+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'4","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:48.475041+0000","last_change":"2024-04-24T02:15:48.475041+0000","last_active":"2024-04-24T02:15:48.475041+0000","last_peered":"2024-04-24T02:15:48.475041+0000","last_clean":"2024-04-24T02:15:48.475041+0000","last_became_active":"2024-04-24T02:12:04.766495+0000","last_became_peered":"2024-04-24T02:12:04.766495+0000","last_unstale":"2024-04-24T02:15:48.475041+0000","last_undegraded":"2024-04-24T02:15:48.475041+0000","last_fullsized":"2024-04-24T02:15:48.475041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:48.474931+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:48.474931+0000","last_clean_scrub_stamp":"2024-04-24T02:15:48.474931+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:51:50.070010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:16.107152+0000","last_change":"2024-04-24T02:16:16.107152+0000","last_active":"2024-04-24T02:16:16.107152+0000","last_peered":"2024-04-24T02:16:16.107152+0000","last_clean":"2024-04-24T02:16:16.107152+0000","last_became_active":"2024-04-24T02:12:02.743204+0000","last_became_peered":"2024-04-24T02:12:02.743204+0000","last_unstale":"2024-04-24T02:16:16.107152+0000","last_undegraded":"2024-04-24T02:16:16.107152+0000","last_fullsized":"2024-04-24T02:16:16.107152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:16.107037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:16.107037+0000","last_clean_scrub_stamp":"2024-04-24T02:16:16.107037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:31:36.700177+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:41.423774+0000","last_change":"2024-04-24T02:15:41.423774+0000","last_active":"2024-04-24T02:15:41.423774+0000","last_peered":"2024-04-24T02:15:41.423774+0000","last_clean":"2024-04-24T02:15:41.423774+0000","last_became_active":"2024-04-24T02:12:06.764676+0000","last_became_peered":"2024-04-24T02:12:06.764676+0000","last_unstale":"2024-04-24T02:15:41.423774+0000","last_undegraded":"2024-04-24T02:15:41.423774+0000","last_fullsized":"2024-04-24T02:15:41.423774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:41.423618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:41.423618+0000","last_clean_scrub_stamp":"2024-04-24T02:15:41.423618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:12:26.147935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'46","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:28.342006+0000","last_change":"2024-04-24T02:15:28.342006+0000","last_active":"2024-04-24T02:15:28.342006+0000","last_peered":"2024-04-24T02:15:28.342006+0000","last_clean":"2024-04-24T02:15:28.342006+0000","last_became_active":"2024-04-24T02:12:08.773355+0000","last_became_peered":"2024-04-24T02:12:08.773355+0000","last_unstale":"2024-04-24T02:15:28.342006+0000","last_undegraded":"2024-04-24T02:15:28.342006+0000","last_fullsized":"2024-04-24T02:15:28.342006+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-04-24T02:15:28.341829+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-04-24T02:15:28.341829+0000","last_clean_scrub_stamp":"2024-04-24T02:15:28.341829+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:44:08.114105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:52.281641+0000","last_change":"2024-04-24T02:15:52.281641+0000","last_active":"2024-04-24T02:15:52.281641+0000","last_peered":"2024-04-24T02:15:52.281641+0000","last_clean":"2024-04-24T02:15:52.281641+0000","last_became_active":"2024-04-24T02:12:10.783334+0000","last_became_peered":"2024-04-24T02:12:10.783334+0000","last_unstale":"2024-04-24T02:15:52.281641+0000","last_undegraded":"2024-04-24T02:15:52.281641+0000","last_fullsized":"2024-04-24T02:15:52.281641+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:52.281509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:52.281509+0000","last_clean_scrub_stamp":"2024-04-24T02:15:52.281509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:49:37.879213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:44.842414+0000","last_change":"2024-04-24T02:16:44.842443+0000","last_active":"2024-04-24T02:16:44.842414+0000","last_peered":"2024-04-24T02:16:44.842414+0000","last_clean":"2024-04-24T02:16:44.842414+0000","last_became_active":"2024-04-24T02:12:12.794106+0000","last_became_peered":"2024-04-24T02:12:12.794106+0000","last_unstale":"2024-04-24T02:16:44.842414+0000","last_undegraded":"2024-04-24T02:16:44.842414+0000","last_fullsized":"2024-04-24T02:16:44.842414+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:16:44.842328+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:16:44.842328+0000","last_clean_scrub_stamp":"2024-04-24T02:16:44.842328+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:28:36.141341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:39.410553+0000","last_change":"2024-04-24T02:15:39.410553+0000","last_active":"2024-04-24T02:15:39.410553+0000","last_peered":"2024-04-24T02:15:39.410553+0000","last_clean":"2024-04-24T02:15:39.410553+0000","last_became_active":"2024-04-24T02:12:04.767376+0000","last_became_peered":"2024-04-24T02:12:04.767376+0000","last_unstale":"2024-04-24T02:15:39.410553+0000","last_undegraded":"2024-04-24T02:15:39.410553+0000","last_fullsized":"2024-04-24T02:15:39.410553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:39.410442+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:39.410442+0000","last_clean_scrub_stamp":"2024-04-24T02:15:39.410442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:46:10.073188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:27.973694+0000","last_change":"2024-04-24T02:16:27.973723+0000","last_active":"2024-04-24T02:16:27.973694+0000","last_peered":"2024-04-24T02:16:27.973694+0000","last_clean":"2024-04-24T02:16:27.973694+0000","last_became_active":"2024-04-24T02:12:02.760317+0000","last_became_peered":"2024-04-24T02:12:02.760317+0000","last_unstale":"2024-04-24T02:16:27.973694+0000","last_undegraded":"2024-04-24T02:16:27.973694+0000","last_fullsized":"2024-04-24T02:16:27.973694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:16:27.973596+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:16:27.973596+0000","last_clean_scrub_stamp":"2024-04-24T02:16:27.973596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:49:23.050957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:16.633686+0000","last_change":"2024-04-24T02:16:16.633710+0000","last_active":"2024-04-24T02:16:16.633686+0000","last_peered":"2024-04-24T02:16:16.633686+0000","last_clean":"2024-04-24T02:16:16.633686+0000","last_became_active":"2024-04-24T02:12:45.811272+0000","last_became_peered":"2024-04-24T02:12:45.811272+0000","last_unstale":"2024-04-24T02:16:16.633686+0000","last_undegraded":"2024-04-24T02:16:16.633686+0000","last_fullsized":"2024-04-24T02:16:16.633686+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:16.633597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:16.633597+0000","last_clean_scrub_stamp":"2024-04-24T02:16:16.633597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:06:36.308100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"32'46","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:37.398336+0000","last_change":"2024-04-24T02:15:37.398336+0000","last_active":"2024-04-24T02:15:37.398336+0000","last_peered":"2024-04-24T02:15:37.398336+0000","last_clean":"2024-04-24T02:15:37.398336+0000","last_became_active":"2024-04-24T02:12:08.769307+0000","last_became_peered":"2024-04-24T02:12:08.769307+0000","last_unstale":"2024-04-24T02:15:37.398336+0000","last_undegraded":"2024-04-24T02:15:37.398336+0000","last_fullsized":"2024-04-24T02:15:37.398336+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-04-24T02:15:37.398209+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-04-24T02:15:37.398209+0000","last_clean_scrub_stamp":"2024-04-24T02:15:37.398209+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:44:17.170485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'285","reported_seq":416,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:29.489068+0000","last_change":"2024-04-24T02:15:29.489068+0000","last_active":"2024-04-24T02:15:29.489068+0000","last_peered":"2024-04-24T02:15:29.489068+0000","last_clean":"2024-04-24T02:15:29.489068+0000","last_became_active":"2024-04-24T02:12:10.778972+0000","last_became_peered":"2024-04-24T02:12:10.778972+0000","last_unstale":"2024-04-24T02:15:29.489068+0000","last_undegraded":"2024-04-24T02:15:29.489068+0000","last_fullsized":"2024-04-24T02:15:29.489068+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-24T02:15:29.488953+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-24T02:15:29.488953+0000","last_clean_scrub_stamp":"2024-04-24T02:15:29.488953+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:12:38.822890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'13","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:47.025859+0000","last_change":"2024-04-24T02:15:47.025859+0000","last_active":"2024-04-24T02:15:47.025859+0000","last_peered":"2024-04-24T02:15:47.025859+0000","last_clean":"2024-04-24T02:15:47.025859+0000","last_became_active":"2024-04-24T02:12:12.790353+0000","last_became_peered":"2024-04-24T02:12:12.790353+0000","last_unstale":"2024-04-24T02:15:47.025859+0000","last_undegraded":"2024-04-24T02:15:47.025859+0000","last_fullsized":"2024-04-24T02:15:47.025859+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'13","last_scrub_stamp":"2024-04-24T02:15:47.025741+0000","last_deep_scrub":"32'13","last_deep_scrub_stamp":"2024-04-24T02:15:47.025741+0000","last_clean_scrub_stamp":"2024-04-24T02:15:47.025741+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:19:56.625015+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'10","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:54.425801+0000","last_change":"2024-04-24T02:15:54.425801+0000","last_active":"2024-04-24T02:15:54.425801+0000","last_peered":"2024-04-24T02:15:54.425801+0000","last_clean":"2024-04-24T02:15:54.425801+0000","last_became_active":"2024-04-24T02:12:04.760020+0000","last_became_peered":"2024-04-24T02:12:04.760020+0000","last_unstale":"2024-04-24T02:15:54.425801+0000","last_undegraded":"2024-04-24T02:15:54.425801+0000","last_fullsized":"2024-04-24T02:15:54.425801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-24T02:15:54.425644+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-24T02:15:54.425644+0000","last_clean_scrub_stamp":"2024-04-24T02:15:54.425644+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:03:33.088095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:30.937125+0000","last_change":"2024-04-24T02:16:30.937150+0000","last_active":"2024-04-24T02:16:30.937125+0000","last_peered":"2024-04-24T02:16:30.937125+0000","last_clean":"2024-04-24T02:16:30.937125+0000","last_became_active":"2024-04-24T02:12:02.753593+0000","last_became_peered":"2024-04-24T02:12:02.753593+0000","last_unstale":"2024-04-24T02:16:30.937125+0000","last_undegraded":"2024-04-24T02:16:30.937125+0000","last_fullsized":"2024-04-24T02:16:30.937125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:16:30.937034+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:16:30.937034+0000","last_clean_scrub_stamp":"2024-04-24T02:16:30.937034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:51:39.470869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'5","reported_seq":429,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:37.435417+0000","last_change":"2024-04-24T02:15:37.435417+0000","last_active":"2024-04-24T02:15:37.435417+0000","last_peered":"2024-04-24T02:15:37.435417+0000","last_clean":"2024-04-24T02:15:37.435417+0000","last_became_active":"2024-04-24T02:12:06.758759+0000","last_became_peered":"2024-04-24T02:12:06.758759+0000","last_unstale":"2024-04-24T02:15:37.435417+0000","last_undegraded":"2024-04-24T02:15:37.435417+0000","last_fullsized":"2024-04-24T02:15:37.435417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-04-24T02:15:37.435273+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-04-24T02:15:37.435273+0000","last_clean_scrub_stamp":"2024-04-24T02:15:37.435273+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:57:22.943957+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'16","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:50.257229+0000","last_change":"2024-04-24T02:15:50.257229+0000","last_active":"2024-04-24T02:15:50.257229+0000","last_peered":"2024-04-24T02:15:50.257229+0000","last_clean":"2024-04-24T02:15:50.257229+0000","last_became_active":"2024-04-24T02:12:08.783011+0000","last_became_peered":"2024-04-24T02:12:08.783011+0000","last_unstale":"2024-04-24T02:15:50.257229+0000","last_undegraded":"2024-04-24T02:15:50.257229+0000","last_fullsized":"2024-04-24T02:15:50.257229+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-04-24T02:15:50.257112+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-04-24T02:15:50.257112+0000","last_clean_scrub_stamp":"2024-04-24T02:15:50.257112+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:22:29.994017+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'285","reported_seq":472,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:23.427935+0000","last_change":"2024-04-24T02:15:23.427935+0000","last_active":"2024-04-24T02:15:23.427935+0000","last_peered":"2024-04-24T02:15:23.427935+0000","last_clean":"2024-04-24T02:15:23.427935+0000","last_became_active":"2024-04-24T02:12:10.777222+0000","last_became_peered":"2024-04-24T02:12:10.777222+0000","last_unstale":"2024-04-24T02:15:23.427935+0000","last_undegraded":"2024-04-24T02:15:23.427935+0000","last_fullsized":"2024-04-24T02:15:23.427935+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-24T02:15:23.427820+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-24T02:15:23.427820+0000","last_clean_scrub_stamp":"2024-04-24T02:15:23.427820+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:37:31.031708+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:34.439653+0000","last_change":"2024-04-24T02:15:34.439653+0000","last_active":"2024-04-24T02:15:34.439653+0000","last_peered":"2024-04-24T02:15:34.439653+0000","last_clean":"2024-04-24T02:15:34.439653+0000","last_became_active":"2024-04-24T02:12:12.795204+0000","last_became_peered":"2024-04-24T02:12:12.795204+0000","last_unstale":"2024-04-24T02:15:34.439653+0000","last_undegraded":"2024-04-24T02:15:34.439653+0000","last_fullsized":"2024-04-24T02:15:34.439653+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:34.439501+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:34.439501+0000","last_clean_scrub_stamp":"2024-04-24T02:15:34.439501+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:22:10.202353+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'4","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:47.428572+0000","last_change":"2024-04-24T02:15:47.428572+0000","last_active":"2024-04-24T02:15:47.428572+0000","last_peered":"2024-04-24T02:15:47.428572+0000","last_clean":"2024-04-24T02:15:47.428572+0000","last_became_active":"2024-04-24T02:12:04.766540+0000","last_became_peered":"2024-04-24T02:12:04.766540+0000","last_unstale":"2024-04-24T02:15:47.428572+0000","last_undegraded":"2024-04-24T02:15:47.428572+0000","last_fullsized":"2024-04-24T02:15:47.428572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:47.428451+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:47.428451+0000","last_clean_scrub_stamp":"2024-04-24T02:15:47.428451+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:03:39.887590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"32'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:25.969192+0000","last_change":"2024-04-24T02:16:25.969231+0000","last_active":"2024-04-24T02:16:25.969192+0000","last_peered":"2024-04-24T02:16:25.969192+0000","last_clean":"2024-04-24T02:16:25.969192+0000","last_became_active":"2024-04-24T02:12:02.757717+0000","last_became_peered":"2024-04-24T02:12:02.757717+0000","last_unstale":"2024-04-24T02:16:25.969192+0000","last_undegraded":"2024-04-24T02:16:25.969192+0000","last_fullsized":"2024-04-24T02:16:25.969192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:16:25.969097+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:16:25.969097+0000","last_clean_scrub_stamp":"2024-04-24T02:16:25.969097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:51:04.996035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:25.340837+0000","last_change":"2024-04-24T02:15:25.340837+0000","last_active":"2024-04-24T02:15:25.340837+0000","last_peered":"2024-04-24T02:15:25.340837+0000","last_clean":"2024-04-24T02:15:25.340837+0000","last_became_active":"2024-04-24T02:12:06.758452+0000","last_became_peered":"2024-04-24T02:12:06.758452+0000","last_unstale":"2024-04-24T02:15:25.340837+0000","last_undegraded":"2024-04-24T02:15:25.340837+0000","last_fullsized":"2024-04-24T02:15:25.340837+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:25.340704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:25.340704+0000","last_clean_scrub_stamp":"2024-04-24T02:15:25.340704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:51:26.935783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'50","reported_seq":110,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:29.358770+0000","last_change":"2024-04-24T02:15:29.358770+0000","last_active":"2024-04-24T02:15:29.358770+0000","last_peered":"2024-04-24T02:15:29.358770+0000","last_clean":"2024-04-24T02:15:29.358770+0000","last_became_active":"2024-04-24T02:12:08.773319+0000","last_became_peered":"2024-04-24T02:12:08.773319+0000","last_unstale":"2024-04-24T02:15:29.358770+0000","last_undegraded":"2024-04-24T02:15:29.358770+0000","last_fullsized":"2024-04-24T02:15:29.358770+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'50","last_scrub_stamp":"2024-04-24T02:15:29.358602+0000","last_deep_scrub":"32'50","last_deep_scrub_stamp":"2024-04-24T02:15:29.358602+0000","last_clean_scrub_stamp":"2024-04-24T02:15:29.358602+0000","objects_scrubbed":8,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:42:17.124195+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":52,"num_read_kb":50,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:26.426964+0000","last_change":"2024-04-24T02:15:26.426964+0000","last_active":"2024-04-24T02:15:26.426964+0000","last_peered":"2024-04-24T02:15:26.426964+0000","last_clean":"2024-04-24T02:15:26.426964+0000","last_became_active":"2024-04-24T02:12:10.786998+0000","last_became_peered":"2024-04-24T02:12:10.786998+0000","last_unstale":"2024-04-24T02:15:26.426964+0000","last_undegraded":"2024-04-24T02:15:26.426964+0000","last_fullsized":"2024-04-24T02:15:26.426964+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:26.426853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:26.426853+0000","last_clean_scrub_stamp":"2024-04-24T02:15:26.426853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:33:27.255344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'6","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:42.419648+0000","last_change":"2024-04-24T02:15:42.419648+0000","last_active":"2024-04-24T02:15:42.419648+0000","last_peered":"2024-04-24T02:15:42.419648+0000","last_clean":"2024-04-24T02:15:42.419648+0000","last_became_active":"2024-04-24T02:12:12.793724+0000","last_became_peered":"2024-04-24T02:12:12.793724+0000","last_unstale":"2024-04-24T02:15:42.419648+0000","last_undegraded":"2024-04-24T02:15:42.419648+0000","last_fullsized":"2024-04-24T02:15:42.419648+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-24T02:15:42.419486+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-24T02:15:42.419486+0000","last_clean_scrub_stamp":"2024-04-24T02:15:42.419486+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:57:44.867375+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'4","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:02.059158+0000","last_change":"2024-04-24T02:16:02.059158+0000","last_active":"2024-04-24T02:16:02.059158+0000","last_peered":"2024-04-24T02:16:02.059158+0000","last_clean":"2024-04-24T02:16:02.059158+0000","last_became_active":"2024-04-24T02:12:04.763246+0000","last_became_peered":"2024-04-24T02:12:04.763246+0000","last_unstale":"2024-04-24T02:16:02.059158+0000","last_undegraded":"2024-04-24T02:16:02.059158+0000","last_fullsized":"2024-04-24T02:16:02.059158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:16:02.059045+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:16:02.059045+0000","last_clean_scrub_stamp":"2024-04-24T02:16:02.059045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:09:22.494946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"32'119","reported_seq":211,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:08.489843+0000","last_change":"2024-04-24T02:16:08.489878+0000","last_active":"2024-04-24T02:16:08.489843+0000","last_peered":"2024-04-24T02:16:08.489843+0000","last_clean":"2024-04-24T02:16:08.489843+0000","last_became_active":"2024-04-24T02:11:51.989479+0000","last_became_peered":"2024-04-24T02:11:51.989479+0000","last_unstale":"2024-04-24T02:16:08.489843+0000","last_undegraded":"2024-04-24T02:16:08.489843+0000","last_fullsized":"2024-04-24T02:16:08.489843+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2024-04-24T02:16:08.489759+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2024-04-24T02:16:08.489759+0000","last_clean_scrub_stamp":"2024-04-24T02:16:08.489759+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:35:08.296192+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:37.054573+0000","last_change":"2024-04-24T02:16:37.054600+0000","last_active":"2024-04-24T02:16:37.054573+0000","last_peered":"2024-04-24T02:16:37.054573+0000","last_clean":"2024-04-24T02:16:37.054573+0000","last_became_active":"2024-04-24T02:11:56.723925+0000","last_became_peered":"2024-04-24T02:11:56.723925+0000","last_unstale":"2024-04-24T02:16:37.054573+0000","last_undegraded":"2024-04-24T02:16:37.054573+0000","last_fullsized":"2024-04-24T02:16:37.054573+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:37.054479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:37.054479+0000","last_clean_scrub_stamp":"2024-04-24T02:16:37.054479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:34:04.723510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:23.921165+0000","last_change":"2024-04-24T02:16:23.921193+0000","last_active":"2024-04-24T02:16:23.921165+0000","last_peered":"2024-04-24T02:16:23.921165+0000","last_clean":"2024-04-24T02:16:23.921165+0000","last_became_active":"2024-04-24T02:12:02.758653+0000","last_became_peered":"2024-04-24T02:12:02.758653+0000","last_unstale":"2024-04-24T02:16:23.921165+0000","last_undegraded":"2024-04-24T02:16:23.921165+0000","last_fullsized":"2024-04-24T02:16:23.921165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:23.921070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:23.921070+0000","last_clean_scrub_stamp":"2024-04-24T02:16:23.921070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:52:22.520467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"32'2","reported_seq":231,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:40.433788+0000","last_change":"2024-04-24T02:15:40.433788+0000","last_active":"2024-04-24T02:15:40.433788+0000","last_peered":"2024-04-24T02:15:40.433788+0000","last_clean":"2024-04-24T02:15:40.433788+0000","last_became_active":"2024-04-24T02:12:06.757173+0000","last_became_peered":"2024-04-24T02:12:06.757173+0000","last_unstale":"2024-04-24T02:15:40.433788+0000","last_undegraded":"2024-04-24T02:15:40.433788+0000","last_fullsized":"2024-04-24T02:15:40.433788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:15:40.433600+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:15:40.433600+0000","last_clean_scrub_stamp":"2024-04-24T02:15:40.433600+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:15:32.722410+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'97","reported_seq":194,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:57.179565+0000","last_change":"2024-04-24T02:15:57.179565+0000","last_active":"2024-04-24T02:15:57.179565+0000","last_peered":"2024-04-24T02:15:57.179565+0000","last_clean":"2024-04-24T02:15:57.179565+0000","last_became_active":"2024-04-24T02:12:08.780923+0000","last_became_peered":"2024-04-24T02:12:08.780923+0000","last_unstale":"2024-04-24T02:15:57.179565+0000","last_undegraded":"2024-04-24T02:15:57.179565+0000","last_fullsized":"2024-04-24T02:15:57.179565+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'97","last_scrub_stamp":"2024-04-24T02:15:57.179395+0000","last_deep_scrub":"32'97","last_deep_scrub_stamp":"2024-04-24T02:15:57.179395+0000","last_clean_scrub_stamp":"2024-04-24T02:15:57.179395+0000","objects_scrubbed":6,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:43:51.704639+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:22.973909+0000","last_change":"2024-04-24T02:15:22.973909+0000","last_active":"2024-04-24T02:15:22.973909+0000","last_peered":"2024-04-24T02:15:22.973909+0000","last_clean":"2024-04-24T02:15:22.973909+0000","last_became_active":"2024-04-24T02:12:10.784101+0000","last_became_peered":"2024-04-24T02:12:10.784101+0000","last_unstale":"2024-04-24T02:15:22.973909+0000","last_undegraded":"2024-04-24T02:15:22.973909+0000","last_fullsized":"2024-04-24T02:15:22.973909+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:22.973820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:22.973820+0000","last_clean_scrub_stamp":"2024-04-24T02:15:22.973820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:09:23.273019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'81","reported_seq":172,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:38.392125+0000","last_change":"2024-04-24T02:15:38.392125+0000","last_active":"2024-04-24T02:15:38.392125+0000","last_peered":"2024-04-24T02:15:38.392125+0000","last_clean":"2024-04-24T02:15:38.392125+0000","last_became_active":"2024-04-24T02:12:12.795281+0000","last_became_peered":"2024-04-24T02:12:12.795281+0000","last_unstale":"2024-04-24T02:15:38.392125+0000","last_undegraded":"2024-04-24T02:15:38.392125+0000","last_fullsized":"2024-04-24T02:15:38.392125+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'81","last_scrub_stamp":"2024-04-24T02:15:38.392009+0000","last_deep_scrub":"32'81","last_deep_scrub_stamp":"2024-04-24T02:15:38.392009+0000","last_clean_scrub_stamp":"2024-04-24T02:15:38.392009+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:42:26.157602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'6","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:03.023374+0000","last_change":"2024-04-24T02:16:03.023374+0000","last_active":"2024-04-24T02:16:03.023374+0000","last_peered":"2024-04-24T02:16:03.023374+0000","last_clean":"2024-04-24T02:16:03.023374+0000","last_became_active":"2024-04-24T02:12:04.763782+0000","last_became_peered":"2024-04-24T02:12:04.763782+0000","last_unstale":"2024-04-24T02:16:03.023374+0000","last_undegraded":"2024-04-24T02:16:03.023374+0000","last_fullsized":"2024-04-24T02:16:03.023374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-24T02:16:03.023245+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-24T02:16:03.023245+0000","last_clean_scrub_stamp":"2024-04-24T02:16:03.023245+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:51:33.505831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:34.999730+0000","last_change":"2024-04-24T02:16:34.999787+0000","last_active":"2024-04-24T02:16:34.999730+0000","last_peered":"2024-04-24T02:16:34.999730+0000","last_clean":"2024-04-24T02:16:34.999730+0000","last_became_active":"2024-04-24T02:11:56.723682+0000","last_became_peered":"2024-04-24T02:11:56.723682+0000","last_unstale":"2024-04-24T02:16:34.999730+0000","last_undegraded":"2024-04-24T02:16:34.999730+0000","last_fullsized":"2024-04-24T02:16:34.999730+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:34.999622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:34.999622+0000","last_clean_scrub_stamp":"2024-04-24T02:16:34.999622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:41:54.118931+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"30'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:14.122870+0000","last_change":"2024-04-24T02:16:14.122898+0000","last_active":"2024-04-24T02:16:14.122870+0000","last_peered":"2024-04-24T02:16:14.122870+0000","last_clean":"2024-04-24T02:16:14.122870+0000","last_became_active":"2024-04-24T02:12:02.741610+0000","last_became_peered":"2024-04-24T02:12:02.741610+0000","last_unstale":"2024-04-24T02:16:14.122870+0000","last_undegraded":"2024-04-24T02:16:14.122870+0000","last_fullsized":"2024-04-24T02:16:14.122870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-24T02:16:14.122778+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-24T02:16:14.122778+0000","last_clean_scrub_stamp":"2024-04-24T02:16:14.122778+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:48:58.800845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:29.348651+0000","last_change":"2024-04-24T02:15:29.348651+0000","last_active":"2024-04-24T02:15:29.348651+0000","last_peered":"2024-04-24T02:15:29.348651+0000","last_clean":"2024-04-24T02:15:29.348651+0000","last_became_active":"2024-04-24T02:12:06.757052+0000","last_became_peered":"2024-04-24T02:12:06.757052+0000","last_unstale":"2024-04-24T02:15:29.348651+0000","last_undegraded":"2024-04-24T02:15:29.348651+0000","last_fullsized":"2024-04-24T02:15:29.348651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:29.348489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:29.348489+0000","last_clean_scrub_stamp":"2024-04-24T02:15:29.348489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:42:27.569911+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'298","reported_seq":530,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:25.387698+0000","last_change":"2024-04-24T02:15:25.387698+0000","last_active":"2024-04-24T02:15:25.387698+0000","last_peered":"2024-04-24T02:15:25.387698+0000","last_clean":"2024-04-24T02:15:25.387698+0000","last_became_active":"2024-04-24T02:12:08.779884+0000","last_became_peered":"2024-04-24T02:12:08.779884+0000","last_unstale":"2024-04-24T02:15:25.387698+0000","last_undegraded":"2024-04-24T02:15:25.387698+0000","last_fullsized":"2024-04-24T02:15:25.387698+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'298","last_scrub_stamp":"2024-04-24T02:15:25.387551+0000","last_deep_scrub":"32'298","last_deep_scrub_stamp":"2024-04-24T02:15:25.387551+0000","last_clean_scrub_stamp":"2024-04-24T02:15:25.387551+0000","objects_scrubbed":11,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:22:01.150403+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:48.289647+0000","last_change":"2024-04-24T02:15:48.289647+0000","last_active":"2024-04-24T02:15:48.289647+0000","last_peered":"2024-04-24T02:15:48.289647+0000","last_clean":"2024-04-24T02:15:48.289647+0000","last_became_active":"2024-04-24T02:12:10.783788+0000","last_became_peered":"2024-04-24T02:12:10.783788+0000","last_unstale":"2024-04-24T02:15:48.289647+0000","last_undegraded":"2024-04-24T02:15:48.289647+0000","last_fullsized":"2024-04-24T02:15:48.289647+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:48.289533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:48.289533+0000","last_clean_scrub_stamp":"2024-04-24T02:15:48.289533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:38:32.091995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:17.354428+0000","last_change":"2024-04-24T02:16:17.354428+0000","last_active":"2024-04-24T02:16:17.354428+0000","last_peered":"2024-04-24T02:16:17.354428+0000","last_clean":"2024-04-24T02:16:17.354428+0000","last_became_active":"2024-04-24T02:12:12.795983+0000","last_became_peered":"2024-04-24T02:12:12.795983+0000","last_unstale":"2024-04-24T02:16:17.354428+0000","last_undegraded":"2024-04-24T02:16:17.354428+0000","last_fullsized":"2024-04-24T02:16:17.354428+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-04-24T02:16:17.354318+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-04-24T02:16:17.354318+0000","last_clean_scrub_stamp":"2024-04-24T02:16:17.354318+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:55:36.541244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'22","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:03.109255+0000","last_change":"2024-04-24T02:16:03.109255+0000","last_active":"2024-04-24T02:16:03.109255+0000","last_peered":"2024-04-24T02:16:03.109255+0000","last_clean":"2024-04-24T02:16:03.109255+0000","last_became_active":"2024-04-24T02:12:04.755649+0000","last_became_peered":"2024-04-24T02:12:04.755649+0000","last_unstale":"2024-04-24T02:16:03.109255+0000","last_undegraded":"2024-04-24T02:16:03.109255+0000","last_fullsized":"2024-04-24T02:16:03.109255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-04-24T02:16:03.109129+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-04-24T02:16:03.109129+0000","last_clean_scrub_stamp":"2024-04-24T02:16:03.109129+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:48:56.829580+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":72,"num_write":29,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:04.417966+0000","last_change":"2024-04-24T02:16:04.417966+0000","last_active":"2024-04-24T02:16:04.417966+0000","last_peered":"2024-04-24T02:16:04.417966+0000","last_clean":"2024-04-24T02:16:04.417966+0000","last_became_active":"2024-04-24T02:11:56.723497+0000","last_became_peered":"2024-04-24T02:11:56.723497+0000","last_unstale":"2024-04-24T02:16:04.417966+0000","last_undegraded":"2024-04-24T02:16:04.417966+0000","last_fullsized":"2024-04-24T02:16:04.417966+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:04.417852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:04.417852+0000","last_clean_scrub_stamp":"2024-04-24T02:16:04.417852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:09:08.004466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:08.119846+0000","last_change":"2024-04-24T02:16:08.119873+0000","last_active":"2024-04-24T02:16:08.119846+0000","last_peered":"2024-04-24T02:16:08.119846+0000","last_clean":"2024-04-24T02:16:08.119846+0000","last_became_active":"2024-04-24T02:12:02.745238+0000","last_became_peered":"2024-04-24T02:12:02.745238+0000","last_unstale":"2024-04-24T02:16:08.119846+0000","last_undegraded":"2024-04-24T02:16:08.119846+0000","last_fullsized":"2024-04-24T02:16:08.119846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:16:08.119755+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:16:08.119755+0000","last_clean_scrub_stamp":"2024-04-24T02:16:08.119755+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:39:50.616597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:45.478024+0000","last_change":"2024-04-24T02:15:45.478024+0000","last_active":"2024-04-24T02:15:45.478024+0000","last_peered":"2024-04-24T02:15:45.478024+0000","last_clean":"2024-04-24T02:15:45.478024+0000","last_became_active":"2024-04-24T02:12:06.757009+0000","last_became_peered":"2024-04-24T02:12:06.757009+0000","last_unstale":"2024-04-24T02:15:45.478024+0000","last_undegraded":"2024-04-24T02:15:45.478024+0000","last_fullsized":"2024-04-24T02:15:45.478024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:15:45.477913+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:15:45.477913+0000","last_clean_scrub_stamp":"2024-04-24T02:15:45.477913+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:36:40.614952+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'23","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:35.426698+0000","last_change":"2024-04-24T02:15:35.426698+0000","last_active":"2024-04-24T02:15:35.426698+0000","last_peered":"2024-04-24T02:15:35.426698+0000","last_clean":"2024-04-24T02:15:35.426698+0000","last_became_active":"2024-04-24T02:12:08.774177+0000","last_became_peered":"2024-04-24T02:12:08.774177+0000","last_unstale":"2024-04-24T02:15:35.426698+0000","last_undegraded":"2024-04-24T02:15:35.426698+0000","last_fullsized":"2024-04-24T02:15:35.426698+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2024-04-24T02:15:35.426543+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2024-04-24T02:15:35.426543+0000","last_clean_scrub_stamp":"2024-04-24T02:15:35.426543+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:20:39.513825+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:27.053503+0000","last_change":"2024-04-24T02:15:27.053503+0000","last_active":"2024-04-24T02:15:27.053503+0000","last_peered":"2024-04-24T02:15:27.053503+0000","last_clean":"2024-04-24T02:15:27.053503+0000","last_became_active":"2024-04-24T02:12:10.784247+0000","last_became_peered":"2024-04-24T02:12:10.784247+0000","last_unstale":"2024-04-24T02:15:27.053503+0000","last_undegraded":"2024-04-24T02:15:27.053503+0000","last_fullsized":"2024-04-24T02:15:27.053503+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:27.053381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:27.053381+0000","last_clean_scrub_stamp":"2024-04-24T02:15:27.053381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:58:59.706713+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"32'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:43.866414+0000","last_change":"2024-04-24T02:16:43.866414+0000","last_active":"2024-04-24T02:16:43.866414+0000","last_peered":"2024-04-24T02:16:43.866414+0000","last_clean":"2024-04-24T02:16:43.866414+0000","last_became_active":"2024-04-24T02:12:12.794453+0000","last_became_peered":"2024-04-24T02:12:12.794453+0000","last_unstale":"2024-04-24T02:16:43.866414+0000","last_undegraded":"2024-04-24T02:16:43.866414+0000","last_fullsized":"2024-04-24T02:16:43.866414+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:16:43.866285+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:16:43.866285+0000","last_clean_scrub_stamp":"2024-04-24T02:16:43.866285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:19:58.472668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:53.131001+0000","last_change":"2024-04-24T02:15:53.131001+0000","last_active":"2024-04-24T02:15:53.131001+0000","last_peered":"2024-04-24T02:15:53.131001+0000","last_clean":"2024-04-24T02:15:53.131001+0000","last_became_active":"2024-04-24T02:12:04.749173+0000","last_became_peered":"2024-04-24T02:12:04.749173+0000","last_unstale":"2024-04-24T02:15:53.131001+0000","last_undegraded":"2024-04-24T02:15:53.131001+0000","last_fullsized":"2024-04-24T02:15:53.131001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:53.130876+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:53.130876+0000","last_clean_scrub_stamp":"2024-04-24T02:15:53.130876+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:46:26.214015+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:34.019344+0000","last_change":"2024-04-24T02:16:34.019399+0000","last_active":"2024-04-24T02:16:34.019344+0000","last_peered":"2024-04-24T02:16:34.019344+0000","last_clean":"2024-04-24T02:16:34.019344+0000","last_became_active":"2024-04-24T02:11:56.723125+0000","last_became_peered":"2024-04-24T02:11:56.723125+0000","last_unstale":"2024-04-24T02:16:34.019344+0000","last_undegraded":"2024-04-24T02:16:34.019344+0000","last_fullsized":"2024-04-24T02:16:34.019344+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:34.019242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:34.019242+0000","last_clean_scrub_stamp":"2024-04-24T02:16:34.019242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:15:39.276159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:08.463784+0000","last_change":"2024-04-24T02:16:08.463784+0000","last_active":"2024-04-24T02:16:08.463784+0000","last_peered":"2024-04-24T02:16:08.463784+0000","last_clean":"2024-04-24T02:16:08.463784+0000","last_became_active":"2024-04-24T02:12:02.746682+0000","last_became_peered":"2024-04-24T02:12:02.746682+0000","last_unstale":"2024-04-24T02:16:08.463784+0000","last_undegraded":"2024-04-24T02:16:08.463784+0000","last_fullsized":"2024-04-24T02:16:08.463784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:08.463630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:08.463630+0000","last_clean_scrub_stamp":"2024-04-24T02:16:08.463630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:42:27.800308+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:45.033384+0000","last_change":"2024-04-24T02:15:45.033384+0000","last_active":"2024-04-24T02:15:45.033384+0000","last_peered":"2024-04-24T02:15:45.033384+0000","last_clean":"2024-04-24T02:15:45.033384+0000","last_became_active":"2024-04-24T02:12:06.759169+0000","last_became_peered":"2024-04-24T02:12:06.759169+0000","last_unstale":"2024-04-24T02:15:45.033384+0000","last_undegraded":"2024-04-24T02:15:45.033384+0000","last_fullsized":"2024-04-24T02:15:45.033384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:45.033265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:45.033265+0000","last_clean_scrub_stamp":"2024-04-24T02:15:45.033265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:08:16.728687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'20","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:51.254261+0000","last_change":"2024-04-24T02:15:51.254261+0000","last_active":"2024-04-24T02:15:51.254261+0000","last_peered":"2024-04-24T02:15:51.254261+0000","last_clean":"2024-04-24T02:15:51.254261+0000","last_became_active":"2024-04-24T02:12:08.782765+0000","last_became_peered":"2024-04-24T02:12:08.782765+0000","last_unstale":"2024-04-24T02:15:51.254261+0000","last_undegraded":"2024-04-24T02:15:51.254261+0000","last_fullsized":"2024-04-24T02:15:51.254261+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-04-24T02:15:51.254102+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-04-24T02:15:51.254102+0000","last_clean_scrub_stamp":"2024-04-24T02:15:51.254102+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:26:37.436707+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:56.210473+0000","last_change":"2024-04-24T02:15:56.210473+0000","last_active":"2024-04-24T02:15:56.210473+0000","last_peered":"2024-04-24T02:15:56.210473+0000","last_clean":"2024-04-24T02:15:56.210473+0000","last_became_active":"2024-04-24T02:12:10.783813+0000","last_became_peered":"2024-04-24T02:12:10.783813+0000","last_unstale":"2024-04-24T02:15:56.210473+0000","last_undegraded":"2024-04-24T02:15:56.210473+0000","last_fullsized":"2024-04-24T02:15:56.210473+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:56.210358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:56.210358+0000","last_clean_scrub_stamp":"2024-04-24T02:15:56.210358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:46:40.354519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:19.411350+0000","last_change":"2024-04-24T02:16:19.411350+0000","last_active":"2024-04-24T02:16:19.411350+0000","last_peered":"2024-04-24T02:16:19.411350+0000","last_clean":"2024-04-24T02:16:19.411350+0000","last_became_active":"2024-04-24T02:12:12.796507+0000","last_became_peered":"2024-04-24T02:12:12.796507+0000","last_unstale":"2024-04-24T02:16:19.411350+0000","last_undegraded":"2024-04-24T02:16:19.411350+0000","last_fullsized":"2024-04-24T02:16:19.411350+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:16:19.411223+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:16:19.411223+0000","last_clean_scrub_stamp":"2024-04-24T02:16:19.411223+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:47:03.555384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:44.357865+0000","last_change":"2024-04-24T02:15:44.357865+0000","last_active":"2024-04-24T02:15:44.357865+0000","last_peered":"2024-04-24T02:15:44.357865+0000","last_clean":"2024-04-24T02:15:44.357865+0000","last_became_active":"2024-04-24T02:12:04.767221+0000","last_became_peered":"2024-04-24T02:12:04.767221+0000","last_unstale":"2024-04-24T02:15:44.357865+0000","last_undegraded":"2024-04-24T02:15:44.357865+0000","last_fullsized":"2024-04-24T02:15:44.357865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:44.357687+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:44.357687+0000","last_clean_scrub_stamp":"2024-04-24T02:15:44.357687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:44:16.884604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:09.511028+0000","last_change":"2024-04-24T02:16:09.511028+0000","last_active":"2024-04-24T02:16:09.511028+0000","last_peered":"2024-04-24T02:16:09.511028+0000","last_clean":"2024-04-24T02:16:09.511028+0000","last_became_active":"2024-04-24T02:12:02.744161+0000","last_became_peered":"2024-04-24T02:12:02.744161+0000","last_unstale":"2024-04-24T02:16:09.511028+0000","last_undegraded":"2024-04-24T02:16:09.511028+0000","last_fullsized":"2024-04-24T02:16:09.511028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:09.510908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:09.510908+0000","last_clean_scrub_stamp":"2024-04-24T02:16:09.510908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:10:49.112570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:10.053515+0000","last_change":"2024-04-24T02:16:10.053540+0000","last_active":"2024-04-24T02:16:10.053515+0000","last_peered":"2024-04-24T02:16:10.053515+0000","last_clean":"2024-04-24T02:16:10.053515+0000","last_became_active":"2024-04-24T02:11:56.723697+0000","last_became_peered":"2024-04-24T02:11:56.723697+0000","last_unstale":"2024-04-24T02:16:10.053515+0000","last_undegraded":"2024-04-24T02:16:10.053515+0000","last_fullsized":"2024-04-24T02:16:10.053515+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:10.053432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:10.053432+0000","last_clean_scrub_stamp":"2024-04-24T02:16:10.053432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:38:15.927351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:45.989705+0000","last_change":"2024-04-24T02:15:45.989705+0000","last_active":"2024-04-24T02:15:45.989705+0000","last_peered":"2024-04-24T02:15:45.989705+0000","last_clean":"2024-04-24T02:15:45.989705+0000","last_became_active":"2024-04-24T02:12:06.759160+0000","last_became_peered":"2024-04-24T02:12:06.759160+0000","last_unstale":"2024-04-24T02:15:45.989705+0000","last_undegraded":"2024-04-24T02:15:45.989705+0000","last_fullsized":"2024-04-24T02:15:45.989705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:15:45.989545+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:15:45.989545+0000","last_clean_scrub_stamp":"2024-04-24T02:15:45.989545+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:56:06.540361+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'87","reported_seq":176,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:33.030400+0000","last_change":"2024-04-24T02:15:33.030400+0000","last_active":"2024-04-24T02:15:33.030400+0000","last_peered":"2024-04-24T02:15:33.030400+0000","last_clean":"2024-04-24T02:15:33.030400+0000","last_became_active":"2024-04-24T02:12:08.780688+0000","last_became_peered":"2024-04-24T02:12:08.780688+0000","last_unstale":"2024-04-24T02:15:33.030400+0000","last_undegraded":"2024-04-24T02:15:33.030400+0000","last_fullsized":"2024-04-24T02:15:33.030400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'87","last_scrub_stamp":"2024-04-24T02:15:33.030249+0000","last_deep_scrub":"32'87","last_deep_scrub_stamp":"2024-04-24T02:15:33.030249+0000","last_clean_scrub_stamp":"2024-04-24T02:15:33.030249+0000","objects_scrubbed":11,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:20:07.673923+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":89,"num_read_kb":75,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:25.419767+0000","last_change":"2024-04-24T02:15:25.419767+0000","last_active":"2024-04-24T02:15:25.419767+0000","last_peered":"2024-04-24T02:15:25.419767+0000","last_clean":"2024-04-24T02:15:25.419767+0000","last_became_active":"2024-04-24T02:12:10.781586+0000","last_became_peered":"2024-04-24T02:12:10.781586+0000","last_unstale":"2024-04-24T02:15:25.419767+0000","last_undegraded":"2024-04-24T02:15:25.419767+0000","last_fullsized":"2024-04-24T02:15:25.419767+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:25.419637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:25.419637+0000","last_clean_scrub_stamp":"2024-04-24T02:15:25.419637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:41:52.572498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'9","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:22.072224+0000","last_change":"2024-04-24T02:16:22.072224+0000","last_active":"2024-04-24T02:16:22.072224+0000","last_peered":"2024-04-24T02:16:22.072224+0000","last_clean":"2024-04-24T02:16:22.072224+0000","last_became_active":"2024-04-24T02:12:12.798272+0000","last_became_peered":"2024-04-24T02:12:12.798272+0000","last_unstale":"2024-04-24T02:16:22.072224+0000","last_undegraded":"2024-04-24T02:16:22.072224+0000","last_fullsized":"2024-04-24T02:16:22.072224+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-24T02:16:22.072073+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-24T02:16:22.072073+0000","last_clean_scrub_stamp":"2024-04-24T02:16:22.072073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:04:34.957697+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'6","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:51.465160+0000","last_change":"2024-04-24T02:15:51.465160+0000","last_active":"2024-04-24T02:15:51.465160+0000","last_peered":"2024-04-24T02:15:51.465160+0000","last_clean":"2024-04-24T02:15:51.465160+0000","last_became_active":"2024-04-24T02:12:04.765093+0000","last_became_peered":"2024-04-24T02:12:04.765093+0000","last_unstale":"2024-04-24T02:15:51.465160+0000","last_undegraded":"2024-04-24T02:15:51.465160+0000","last_fullsized":"2024-04-24T02:15:51.465160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-24T02:15:51.465043+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-24T02:15:51.465043+0000","last_clean_scrub_stamp":"2024-04-24T02:15:51.465043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:49:04.615334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:13.104282+0000","last_change":"2024-04-24T02:16:13.104305+0000","last_active":"2024-04-24T02:16:13.104282+0000","last_peered":"2024-04-24T02:16:13.104282+0000","last_clean":"2024-04-24T02:16:13.104282+0000","last_became_active":"2024-04-24T02:12:02.741565+0000","last_became_peered":"2024-04-24T02:12:02.741565+0000","last_unstale":"2024-04-24T02:16:13.104282+0000","last_undegraded":"2024-04-24T02:16:13.104282+0000","last_fullsized":"2024-04-24T02:16:13.104282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:13.104195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:13.104195+0000","last_clean_scrub_stamp":"2024-04-24T02:16:13.104195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:58.546027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:36.044227+0000","last_change":"2024-04-24T02:16:36.044261+0000","last_active":"2024-04-24T02:16:36.044227+0000","last_peered":"2024-04-24T02:16:36.044227+0000","last_clean":"2024-04-24T02:16:36.044227+0000","last_became_active":"2024-04-24T02:11:56.723673+0000","last_became_peered":"2024-04-24T02:11:56.723673+0000","last_unstale":"2024-04-24T02:16:36.044227+0000","last_undegraded":"2024-04-24T02:16:36.044227+0000","last_fullsized":"2024-04-24T02:16:36.044227+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:36.044130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:36.044130+0000","last_clean_scrub_stamp":"2024-04-24T02:16:36.044130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:33:36.460969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:31.335580+0000","last_change":"2024-04-24T02:15:31.335580+0000","last_active":"2024-04-24T02:15:31.335580+0000","last_peered":"2024-04-24T02:15:31.335580+0000","last_clean":"2024-04-24T02:15:31.335580+0000","last_became_active":"2024-04-24T02:12:06.755760+0000","last_became_peered":"2024-04-24T02:12:06.755760+0000","last_unstale":"2024-04-24T02:15:31.335580+0000","last_undegraded":"2024-04-24T02:15:31.335580+0000","last_fullsized":"2024-04-24T02:15:31.335580+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:31.335458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:31.335458+0000","last_clean_scrub_stamp":"2024-04-24T02:15:31.335458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:15:39.406302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'28","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:27.368863+0000","last_change":"2024-04-24T02:15:27.368863+0000","last_active":"2024-04-24T02:15:27.368863+0000","last_peered":"2024-04-24T02:15:27.368863+0000","last_clean":"2024-04-24T02:15:27.368863+0000","last_became_active":"2024-04-24T02:12:08.779698+0000","last_became_peered":"2024-04-24T02:12:08.779698+0000","last_unstale":"2024-04-24T02:15:27.368863+0000","last_undegraded":"2024-04-24T02:15:27.368863+0000","last_fullsized":"2024-04-24T02:15:27.368863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'28","last_scrub_stamp":"2024-04-24T02:15:27.368732+0000","last_deep_scrub":"32'28","last_deep_scrub_stamp":"2024-04-24T02:15:27.368732+0000","last_clean_scrub_stamp":"2024-04-24T02:15:27.368732+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:51:46.023041+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'285","reported_seq":359,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:30.318523+0000","last_change":"2024-04-24T02:15:30.318523+0000","last_active":"2024-04-24T02:15:30.318523+0000","last_peered":"2024-04-24T02:15:30.318523+0000","last_clean":"2024-04-24T02:15:30.318523+0000","last_became_active":"2024-04-24T02:12:10.781799+0000","last_became_peered":"2024-04-24T02:12:10.781799+0000","last_unstale":"2024-04-24T02:15:30.318523+0000","last_undegraded":"2024-04-24T02:15:30.318523+0000","last_fullsized":"2024-04-24T02:15:30.318523+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-24T02:15:30.318394+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-24T02:15:30.318394+0000","last_clean_scrub_stamp":"2024-04-24T02:15:30.318394+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:55:07.242675+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'2","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:15.994793+0000","last_change":"2024-04-24T02:16:15.994793+0000","last_active":"2024-04-24T02:16:15.994793+0000","last_peered":"2024-04-24T02:16:15.994793+0000","last_clean":"2024-04-24T02:16:15.994793+0000","last_became_active":"2024-04-24T02:12:12.792628+0000","last_became_peered":"2024-04-24T02:12:12.792628+0000","last_unstale":"2024-04-24T02:16:15.994793+0000","last_undegraded":"2024-04-24T02:16:15.994793+0000","last_fullsized":"2024-04-24T02:16:15.994793+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:16:15.994673+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:16:15.994673+0000","last_clean_scrub_stamp":"2024-04-24T02:16:15.994673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:11:12.521455+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'19","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:37.364765+0000","last_change":"2024-04-24T02:15:37.364765+0000","last_active":"2024-04-24T02:15:37.364765+0000","last_peered":"2024-04-24T02:15:37.364765+0000","last_clean":"2024-04-24T02:15:37.364765+0000","last_became_active":"2024-04-24T02:12:04.768066+0000","last_became_peered":"2024-04-24T02:12:04.768066+0000","last_unstale":"2024-04-24T02:15:37.364765+0000","last_undegraded":"2024-04-24T02:15:37.364765+0000","last_fullsized":"2024-04-24T02:15:37.364765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'19","last_scrub_stamp":"2024-04-24T02:15:37.364597+0000","last_deep_scrub":"32'19","last_deep_scrub_stamp":"2024-04-24T02:15:37.364597+0000","last_clean_scrub_stamp":"2024-04-24T02:15:37.364597+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:10:16.966259+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":70,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:41.939688+0000","last_change":"2024-04-24T02:16:41.939711+0000","last_active":"2024-04-24T02:16:41.939688+0000","last_peered":"2024-04-24T02:16:41.939688+0000","last_clean":"2024-04-24T02:16:41.939688+0000","last_became_active":"2024-04-24T02:12:02.760824+0000","last_became_peered":"2024-04-24T02:12:02.760824+0000","last_unstale":"2024-04-24T02:16:41.939688+0000","last_undegraded":"2024-04-24T02:16:41.939688+0000","last_fullsized":"2024-04-24T02:16:41.939688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:41.939564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:41.939564+0000","last_clean_scrub_stamp":"2024-04-24T02:16:41.939564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:21:17.322691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:09.079679+0000","last_change":"2024-04-24T02:16:09.079679+0000","last_active":"2024-04-24T02:16:09.079679+0000","last_peered":"2024-04-24T02:16:09.079679+0000","last_clean":"2024-04-24T02:16:09.079679+0000","last_became_active":"2024-04-24T02:11:56.723277+0000","last_became_peered":"2024-04-24T02:11:56.723277+0000","last_unstale":"2024-04-24T02:16:09.079679+0000","last_undegraded":"2024-04-24T02:16:09.079679+0000","last_fullsized":"2024-04-24T02:16:09.079679+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:09.079531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:09.079531+0000","last_clean_scrub_stamp":"2024-04-24T02:16:09.079531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:25:33.117562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:33.324119+0000","last_change":"2024-04-24T02:15:33.324119+0000","last_active":"2024-04-24T02:15:33.324119+0000","last_peered":"2024-04-24T02:15:33.324119+0000","last_clean":"2024-04-24T02:15:33.324119+0000","last_became_active":"2024-04-24T02:12:06.754414+0000","last_became_peered":"2024-04-24T02:12:06.754414+0000","last_unstale":"2024-04-24T02:15:33.324119+0000","last_undegraded":"2024-04-24T02:15:33.324119+0000","last_fullsized":"2024-04-24T02:15:33.324119+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:33.324008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:33.324008+0000","last_clean_scrub_stamp":"2024-04-24T02:15:33.324008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:33:56.910723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'23","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:38.410200+0000","last_change":"2024-04-24T02:15:38.410200+0000","last_active":"2024-04-24T02:15:38.410200+0000","last_peered":"2024-04-24T02:15:38.410200+0000","last_clean":"2024-04-24T02:15:38.410200+0000","last_became_active":"2024-04-24T02:12:08.779937+0000","last_became_peered":"2024-04-24T02:12:08.779937+0000","last_unstale":"2024-04-24T02:15:38.410200+0000","last_undegraded":"2024-04-24T02:15:38.410200+0000","last_fullsized":"2024-04-24T02:15:38.410200+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2024-04-24T02:15:38.410066+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2024-04-24T02:15:38.410066+0000","last_clean_scrub_stamp":"2024-04-24T02:15:38.410066+0000","objects_scrubbed":6,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:27:43.655638+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'285","reported_seq":402,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:30.014117+0000","last_change":"2024-04-24T02:15:30.014117+0000","last_active":"2024-04-24T02:15:30.014117+0000","last_peered":"2024-04-24T02:15:30.014117+0000","last_clean":"2024-04-24T02:15:30.014117+0000","last_became_active":"2024-04-24T02:12:10.776594+0000","last_became_peered":"2024-04-24T02:12:10.776594+0000","last_unstale":"2024-04-24T02:15:30.014117+0000","last_undegraded":"2024-04-24T02:15:30.014117+0000","last_fullsized":"2024-04-24T02:15:30.014117+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-24T02:15:30.013989+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-24T02:15:30.013989+0000","last_clean_scrub_stamp":"2024-04-24T02:15:30.013989+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:47:15.601895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:46.395014+0000","last_change":"2024-04-24T02:15:46.395014+0000","last_active":"2024-04-24T02:15:46.395014+0000","last_peered":"2024-04-24T02:15:46.395014+0000","last_clean":"2024-04-24T02:15:46.395014+0000","last_became_active":"2024-04-24T02:12:12.795328+0000","last_became_peered":"2024-04-24T02:12:12.795328+0000","last_unstale":"2024-04-24T02:15:46.395014+0000","last_undegraded":"2024-04-24T02:15:46.395014+0000","last_fullsized":"2024-04-24T02:15:46.395014+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2024-04-24T02:15:46.394901+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2024-04-24T02:15:46.394901+0000","last_clean_scrub_stamp":"2024-04-24T02:15:46.394901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:06:09.926743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:56.397529+0000","last_change":"2024-04-24T02:15:56.397529+0000","last_active":"2024-04-24T02:15:56.397529+0000","last_peered":"2024-04-24T02:15:56.397529+0000","last_clean":"2024-04-24T02:15:56.397529+0000","last_became_active":"2024-04-24T02:12:04.760099+0000","last_became_peered":"2024-04-24T02:12:04.760099+0000","last_unstale":"2024-04-24T02:15:56.397529+0000","last_undegraded":"2024-04-24T02:15:56.397529+0000","last_fullsized":"2024-04-24T02:15:56.397529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:56.397413+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:56.397413+0000","last_clean_scrub_stamp":"2024-04-24T02:15:56.397413+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:03:48.856552+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'4","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:09.532361+0000","last_change":"2024-04-24T02:16:09.532361+0000","last_active":"2024-04-24T02:16:09.532361+0000","last_peered":"2024-04-24T02:16:09.532361+0000","last_clean":"2024-04-24T02:16:09.532361+0000","last_became_active":"2024-04-24T02:12:02.744454+0000","last_became_peered":"2024-04-24T02:12:02.744454+0000","last_unstale":"2024-04-24T02:16:09.532361+0000","last_undegraded":"2024-04-24T02:16:09.532361+0000","last_fullsized":"2024-04-24T02:16:09.532361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:16:09.532231+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:16:09.532231+0000","last_clean_scrub_stamp":"2024-04-24T02:16:09.532231+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:07:05.583696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:38.028817+0000","last_change":"2024-04-24T02:16:38.028845+0000","last_active":"2024-04-24T02:16:38.028817+0000","last_peered":"2024-04-24T02:16:38.028817+0000","last_clean":"2024-04-24T02:16:38.028817+0000","last_became_active":"2024-04-24T02:11:57.000197+0000","last_became_peered":"2024-04-24T02:11:57.000197+0000","last_unstale":"2024-04-24T02:16:38.028817+0000","last_undegraded":"2024-04-24T02:16:38.028817+0000","last_fullsized":"2024-04-24T02:16:38.028817+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:38.028716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:38.028716+0000","last_clean_scrub_stamp":"2024-04-24T02:16:38.028716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:13:55.467169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:34.371690+0000","last_change":"2024-04-24T02:15:34.371690+0000","last_active":"2024-04-24T02:15:34.371690+0000","last_peered":"2024-04-24T02:15:34.371690+0000","last_clean":"2024-04-24T02:15:34.371690+0000","last_became_active":"2024-04-24T02:12:06.754107+0000","last_became_peered":"2024-04-24T02:12:06.754107+0000","last_unstale":"2024-04-24T02:15:34.371690+0000","last_undegraded":"2024-04-24T02:15:34.371690+0000","last_fullsized":"2024-04-24T02:15:34.371690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:34.371542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:34.371542+0000","last_clean_scrub_stamp":"2024-04-24T02:15:34.371542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:59:19.687673+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'105","reported_seq":205,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:32.532781+0000","last_change":"2024-04-24T02:15:32.532781+0000","last_active":"2024-04-24T02:15:32.532781+0000","last_peered":"2024-04-24T02:15:32.532781+0000","last_clean":"2024-04-24T02:15:32.532781+0000","last_became_active":"2024-04-24T02:12:08.780925+0000","last_became_peered":"2024-04-24T02:12:08.780925+0000","last_unstale":"2024-04-24T02:15:32.532781+0000","last_undegraded":"2024-04-24T02:15:32.532781+0000","last_fullsized":"2024-04-24T02:15:32.532781+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'105","last_scrub_stamp":"2024-04-24T02:15:32.532634+0000","last_deep_scrub":"32'105","last_deep_scrub_stamp":"2024-04-24T02:15:32.532634+0000","last_clean_scrub_stamp":"2024-04-24T02:15:32.532634+0000","objects_scrubbed":9,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:37:40.136523+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":108,"num_read_kb":111,"num_write":44,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:32.071860+0000","last_change":"2024-04-24T02:15:32.071860+0000","last_active":"2024-04-24T02:15:32.071860+0000","last_peered":"2024-04-24T02:15:32.071860+0000","last_clean":"2024-04-24T02:15:32.071860+0000","last_became_active":"2024-04-24T02:12:10.775165+0000","last_became_peered":"2024-04-24T02:12:10.775165+0000","last_unstale":"2024-04-24T02:15:32.071860+0000","last_undegraded":"2024-04-24T02:15:32.071860+0000","last_fullsized":"2024-04-24T02:15:32.071860+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:32.071693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:32.071693+0000","last_clean_scrub_stamp":"2024-04-24T02:15:32.071693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:31:34.757480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"30'2","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:42.394068+0000","last_change":"2024-04-24T02:15:42.394068+0000","last_active":"2024-04-24T02:15:42.394068+0000","last_peered":"2024-04-24T02:15:42.394068+0000","last_clean":"2024-04-24T02:15:42.394068+0000","last_became_active":"2024-04-24T02:12:12.796411+0000","last_became_peered":"2024-04-24T02:12:12.796411+0000","last_unstale":"2024-04-24T02:15:42.394068+0000","last_undegraded":"2024-04-24T02:15:42.394068+0000","last_fullsized":"2024-04-24T02:15:42.394068+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-24T02:15:42.393912+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-24T02:15:42.393912+0000","last_clean_scrub_stamp":"2024-04-24T02:15:42.393912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:09:36.452146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:14.620377+0000","last_change":"2024-04-24T02:16:14.620377+0000","last_active":"2024-04-24T02:16:14.620377+0000","last_peered":"2024-04-24T02:16:14.620377+0000","last_clean":"2024-04-24T02:16:14.620377+0000","last_became_active":"2024-04-24T02:12:12.801346+0000","last_became_peered":"2024-04-24T02:12:12.801346+0000","last_unstale":"2024-04-24T02:16:14.620377+0000","last_undegraded":"2024-04-24T02:16:14.620377+0000","last_fullsized":"2024-04-24T02:16:14.620377+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:14.620247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:14.620247+0000","last_clean_scrub_stamp":"2024-04-24T02:16:14.620247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:22:53.874245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:00.417766+0000","last_change":"2024-04-24T02:16:00.417766+0000","last_active":"2024-04-24T02:16:00.417766+0000","last_peered":"2024-04-24T02:16:00.417766+0000","last_clean":"2024-04-24T02:16:00.417766+0000","last_became_active":"2024-04-24T02:12:04.763860+0000","last_became_peered":"2024-04-24T02:12:04.763860+0000","last_unstale":"2024-04-24T02:16:00.417766+0000","last_undegraded":"2024-04-24T02:16:00.417766+0000","last_fullsized":"2024-04-24T02:16:00.417766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:16:00.417625+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:16:00.417625+0000","last_clean_scrub_stamp":"2024-04-24T02:16:00.417625+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:49:13.567916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:27.018204+0000","last_change":"2024-04-24T02:16:27.018204+0000","last_active":"2024-04-24T02:16:27.018204+0000","last_peered":"2024-04-24T02:16:27.018204+0000","last_clean":"2024-04-24T02:16:27.018204+0000","last_became_active":"2024-04-24T02:12:02.753166+0000","last_became_peered":"2024-04-24T02:12:02.753166+0000","last_unstale":"2024-04-24T02:16:27.018204+0000","last_undegraded":"2024-04-24T02:16:27.018204+0000","last_fullsized":"2024-04-24T02:16:27.018204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:16:27.018084+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:16:27.018084+0000","last_clean_scrub_stamp":"2024-04-24T02:16:27.018084+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:06:34.350850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:39.395376+0000","last_change":"2024-04-24T02:15:39.395376+0000","last_active":"2024-04-24T02:15:39.395376+0000","last_peered":"2024-04-24T02:15:39.395376+0000","last_clean":"2024-04-24T02:15:39.395376+0000","last_became_active":"2024-04-24T02:12:06.758468+0000","last_became_peered":"2024-04-24T02:12:06.758468+0000","last_unstale":"2024-04-24T02:15:39.395376+0000","last_undegraded":"2024-04-24T02:15:39.395376+0000","last_fullsized":"2024-04-24T02:15:39.395376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:39.395252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:39.395252+0000","last_clean_scrub_stamp":"2024-04-24T02:15:39.395252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:56:56.565405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'47","reported_seq":110,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:54.213025+0000","last_change":"2024-04-24T02:15:54.213025+0000","last_active":"2024-04-24T02:15:54.213025+0000","last_peered":"2024-04-24T02:15:54.213025+0000","last_clean":"2024-04-24T02:15:54.213025+0000","last_became_active":"2024-04-24T02:12:08.780353+0000","last_became_peered":"2024-04-24T02:12:08.780353+0000","last_unstale":"2024-04-24T02:15:54.213025+0000","last_undegraded":"2024-04-24T02:15:54.213025+0000","last_fullsized":"2024-04-24T02:15:54.213025+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'47","last_scrub_stamp":"2024-04-24T02:15:54.212901+0000","last_deep_scrub":"32'47","last_deep_scrub_stamp":"2024-04-24T02:15:54.212901+0000","last_clean_scrub_stamp":"2024-04-24T02:15:54.212901+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:55:13.399828+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:04.017088+0000","last_change":"2024-04-24T02:16:04.017088+0000","last_active":"2024-04-24T02:16:04.017088+0000","last_peered":"2024-04-24T02:16:04.017088+0000","last_clean":"2024-04-24T02:16:04.017088+0000","last_became_active":"2024-04-24T02:12:10.786813+0000","last_became_peered":"2024-04-24T02:12:10.786813+0000","last_unstale":"2024-04-24T02:16:04.017088+0000","last_undegraded":"2024-04-24T02:16:04.017088+0000","last_fullsized":"2024-04-24T02:16:04.017088+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:04.016948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:04.016948+0000","last_clean_scrub_stamp":"2024-04-24T02:16:04.016948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:28:33.584520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'9","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:21.106208+0000","last_change":"2024-04-24T02:16:21.106256+0000","last_active":"2024-04-24T02:16:21.106208+0000","last_peered":"2024-04-24T02:16:21.106208+0000","last_clean":"2024-04-24T02:16:21.106208+0000","last_became_active":"2024-04-24T02:12:12.796149+0000","last_became_peered":"2024-04-24T02:12:12.796149+0000","last_unstale":"2024-04-24T02:16:21.106208+0000","last_undegraded":"2024-04-24T02:16:21.106208+0000","last_fullsized":"2024-04-24T02:16:21.106208+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-24T02:16:21.106107+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-24T02:16:21.106107+0000","last_clean_scrub_stamp":"2024-04-24T02:16:21.106107+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:05:51.119381+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'2","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:23.481398+0000","last_change":"2024-04-24T02:16:23.481398+0000","last_active":"2024-04-24T02:16:23.481398+0000","last_peered":"2024-04-24T02:16:23.481398+0000","last_clean":"2024-04-24T02:16:23.481398+0000","last_became_active":"2024-04-24T02:12:45.816009+0000","last_became_peered":"2024-04-24T02:12:45.816009+0000","last_unstale":"2024-04-24T02:16:23.481398+0000","last_undegraded":"2024-04-24T02:16:23.481398+0000","last_fullsized":"2024-04-24T02:16:23.481398+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:16:23.481244+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:16:23.481244+0000","last_clean_scrub_stamp":"2024-04-24T02:16:23.481244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:50:05.019794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"32'6","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:55.440136+0000","last_change":"2024-04-24T02:15:55.440136+0000","last_active":"2024-04-24T02:15:55.440136+0000","last_peered":"2024-04-24T02:15:55.440136+0000","last_clean":"2024-04-24T02:15:55.440136+0000","last_became_active":"2024-04-24T02:12:02.754623+0000","last_became_peered":"2024-04-24T02:12:02.754623+0000","last_unstale":"2024-04-24T02:15:55.440136+0000","last_undegraded":"2024-04-24T02:15:55.440136+0000","last_fullsized":"2024-04-24T02:15:55.440136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-24T02:15:55.439995+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-24T02:15:55.439995+0000","last_clean_scrub_stamp":"2024-04-24T02:15:55.439995+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:06:18.971836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:27.328746+0000","last_change":"2024-04-24T02:15:27.328746+0000","last_active":"2024-04-24T02:15:27.328746+0000","last_peered":"2024-04-24T02:15:27.328746+0000","last_clean":"2024-04-24T02:15:27.328746+0000","last_became_active":"2024-04-24T02:12:06.756998+0000","last_became_peered":"2024-04-24T02:12:06.756998+0000","last_unstale":"2024-04-24T02:15:27.328746+0000","last_undegraded":"2024-04-24T02:15:27.328746+0000","last_fullsized":"2024-04-24T02:15:27.328746+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:27.328635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:27.328635+0000","last_clean_scrub_stamp":"2024-04-24T02:15:27.328635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:13.610015+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'9","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:36.993114+0000","last_change":"2024-04-24T02:15:36.993114+0000","last_active":"2024-04-24T02:15:36.993114+0000","last_peered":"2024-04-24T02:15:36.993114+0000","last_clean":"2024-04-24T02:15:36.993114+0000","last_became_active":"2024-04-24T02:12:08.769610+0000","last_became_peered":"2024-04-24T02:12:08.769610+0000","last_unstale":"2024-04-24T02:15:36.993114+0000","last_undegraded":"2024-04-24T02:15:36.993114+0000","last_fullsized":"2024-04-24T02:15:36.993114+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-24T02:15:36.992984+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-24T02:15:36.992984+0000","last_clean_scrub_stamp":"2024-04-24T02:15:36.992984+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:31:27.219681+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:24.453926+0000","last_change":"2024-04-24T02:15:24.453926+0000","last_active":"2024-04-24T02:15:24.453926+0000","last_peered":"2024-04-24T02:15:24.453926+0000","last_clean":"2024-04-24T02:15:24.453926+0000","last_became_active":"2024-04-24T02:12:10.784955+0000","last_became_peered":"2024-04-24T02:12:10.784955+0000","last_unstale":"2024-04-24T02:15:24.453926+0000","last_undegraded":"2024-04-24T02:15:24.453926+0000","last_fullsized":"2024-04-24T02:15:24.453926+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:24.453808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:24.453808+0000","last_clean_scrub_stamp":"2024-04-24T02:15:24.453808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:10:25.731858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'10","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:19.052760+0000","last_change":"2024-04-24T02:16:19.052803+0000","last_active":"2024-04-24T02:16:19.052760+0000","last_peered":"2024-04-24T02:16:19.052760+0000","last_clean":"2024-04-24T02:16:19.052760+0000","last_became_active":"2024-04-24T02:12:12.792565+0000","last_became_peered":"2024-04-24T02:12:12.792565+0000","last_unstale":"2024-04-24T02:16:19.052760+0000","last_undegraded":"2024-04-24T02:16:19.052760+0000","last_fullsized":"2024-04-24T02:16:19.052760+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-24T02:16:19.052635+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-24T02:16:19.052635+0000","last_clean_scrub_stamp":"2024-04-24T02:16:19.052635+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:43:57.416005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":60,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:49.117627+0000","last_change":"2024-04-24T02:15:49.117627+0000","last_active":"2024-04-24T02:15:49.117627+0000","last_peered":"2024-04-24T02:15:49.117627+0000","last_clean":"2024-04-24T02:15:49.117627+0000","last_became_active":"2024-04-24T02:12:04.766700+0000","last_became_peered":"2024-04-24T02:12:04.766700+0000","last_unstale":"2024-04-24T02:15:49.117627+0000","last_undegraded":"2024-04-24T02:15:49.117627+0000","last_fullsized":"2024-04-24T02:15:49.117627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:49.117486+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:49.117486+0000","last_clean_scrub_stamp":"2024-04-24T02:15:49.117486+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:35:31.797741+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:18.562784+0000","last_change":"2024-04-24T02:16:18.562784+0000","last_active":"2024-04-24T02:16:18.562784+0000","last_peered":"2024-04-24T02:16:18.562784+0000","last_clean":"2024-04-24T02:16:18.562784+0000","last_became_active":"2024-04-24T02:12:45.817240+0000","last_became_peered":"2024-04-24T02:12:45.817240+0000","last_unstale":"2024-04-24T02:16:18.562784+0000","last_undegraded":"2024-04-24T02:16:18.562784+0000","last_fullsized":"2024-04-24T02:16:18.562784+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:18.562640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:18.562640+0000","last_clean_scrub_stamp":"2024-04-24T02:16:18.562640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:07:14.614105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:40.428002+0000","last_change":"2024-04-24T02:15:40.428002+0000","last_active":"2024-04-24T02:15:40.428002+0000","last_peered":"2024-04-24T02:15:40.428002+0000","last_clean":"2024-04-24T02:15:40.428002+0000","last_became_active":"2024-04-24T02:12:06.764776+0000","last_became_peered":"2024-04-24T02:12:06.764776+0000","last_unstale":"2024-04-24T02:15:40.428002+0000","last_undegraded":"2024-04-24T02:15:40.428002+0000","last_fullsized":"2024-04-24T02:15:40.428002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:40.427880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:40.427880+0000","last_clean_scrub_stamp":"2024-04-24T02:15:40.427880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:04:59.966363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'47","reported_seq":120,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:39.994717+0000","last_change":"2024-04-24T02:15:39.994717+0000","last_active":"2024-04-24T02:15:39.994717+0000","last_peered":"2024-04-24T02:15:39.994717+0000","last_clean":"2024-04-24T02:15:39.994717+0000","last_became_active":"2024-04-24T02:12:08.768499+0000","last_became_peered":"2024-04-24T02:12:08.768499+0000","last_unstale":"2024-04-24T02:15:39.994717+0000","last_undegraded":"2024-04-24T02:15:39.994717+0000","last_fullsized":"2024-04-24T02:15:39.994717+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'47","last_scrub_stamp":"2024-04-24T02:15:39.994590+0000","last_deep_scrub":"32'47","last_deep_scrub_stamp":"2024-04-24T02:15:39.994590+0000","last_clean_scrub_stamp":"2024-04-24T02:15:39.994590+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:40:40.190436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:24.405740+0000","last_change":"2024-04-24T02:15:24.405740+0000","last_active":"2024-04-24T02:15:24.405740+0000","last_peered":"2024-04-24T02:15:24.405740+0000","last_clean":"2024-04-24T02:15:24.405740+0000","last_became_active":"2024-04-24T02:12:10.776882+0000","last_became_peered":"2024-04-24T02:12:10.776882+0000","last_unstale":"2024-04-24T02:15:24.405740+0000","last_undegraded":"2024-04-24T02:15:24.405740+0000","last_fullsized":"2024-04-24T02:15:24.405740+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:24.405592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:24.405592+0000","last_clean_scrub_stamp":"2024-04-24T02:15:24.405592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:41:19.659879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:42.912551+0000","last_change":"2024-04-24T02:16:42.912606+0000","last_active":"2024-04-24T02:16:42.912551+0000","last_peered":"2024-04-24T02:16:42.912551+0000","last_clean":"2024-04-24T02:16:42.912551+0000","last_became_active":"2024-04-24T02:12:12.793884+0000","last_became_peered":"2024-04-24T02:12:12.793884+0000","last_unstale":"2024-04-24T02:16:42.912551+0000","last_undegraded":"2024-04-24T02:16:42.912551+0000","last_fullsized":"2024-04-24T02:16:42.912551+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:16:42.912435+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:16:42.912435+0000","last_clean_scrub_stamp":"2024-04-24T02:16:42.912435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:52:04.049257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'6","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:42.377279+0000","last_change":"2024-04-24T02:15:42.377279+0000","last_active":"2024-04-24T02:15:42.377279+0000","last_peered":"2024-04-24T02:15:42.377279+0000","last_clean":"2024-04-24T02:15:42.377279+0000","last_became_active":"2024-04-24T02:12:04.767431+0000","last_became_peered":"2024-04-24T02:12:04.767431+0000","last_unstale":"2024-04-24T02:15:42.377279+0000","last_undegraded":"2024-04-24T02:15:42.377279+0000","last_fullsized":"2024-04-24T02:15:42.377279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-24T02:15:42.377157+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-24T02:15:42.377157+0000","last_clean_scrub_stamp":"2024-04-24T02:15:42.377157+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:22:21.631155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:05.464469+0000","last_change":"2024-04-24T02:16:05.464469+0000","last_active":"2024-04-24T02:16:05.464469+0000","last_peered":"2024-04-24T02:16:05.464469+0000","last_clean":"2024-04-24T02:16:05.464469+0000","last_became_active":"2024-04-24T02:12:02.754295+0000","last_became_peered":"2024-04-24T02:12:02.754295+0000","last_unstale":"2024-04-24T02:16:05.464469+0000","last_undegraded":"2024-04-24T02:16:05.464469+0000","last_fullsized":"2024-04-24T02:16:05.464469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:16:05.464356+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:16:05.464356+0000","last_clean_scrub_stamp":"2024-04-24T02:16:05.464356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:22:44.718355+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:24.382967+0000","last_change":"2024-04-24T02:15:24.382967+0000","last_active":"2024-04-24T02:15:24.382967+0000","last_peered":"2024-04-24T02:15:24.382967+0000","last_clean":"2024-04-24T02:15:24.382967+0000","last_became_active":"2024-04-24T02:12:06.758462+0000","last_became_peered":"2024-04-24T02:12:06.758462+0000","last_unstale":"2024-04-24T02:15:24.382967+0000","last_undegraded":"2024-04-24T02:15:24.382967+0000","last_fullsized":"2024-04-24T02:15:24.382967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:24.382807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:24.382807+0000","last_clean_scrub_stamp":"2024-04-24T02:15:24.382807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:05:42.611375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'36","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:39.389030+0000","last_change":"2024-04-24T02:15:39.389030+0000","last_active":"2024-04-24T02:15:39.389030+0000","last_peered":"2024-04-24T02:15:39.389030+0000","last_clean":"2024-04-24T02:15:39.389030+0000","last_became_active":"2024-04-24T02:12:08.768814+0000","last_became_peered":"2024-04-24T02:12:08.768814+0000","last_unstale":"2024-04-24T02:15:39.389030+0000","last_undegraded":"2024-04-24T02:15:39.389030+0000","last_fullsized":"2024-04-24T02:15:39.389030+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-04-24T02:15:39.388901+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-04-24T02:15:39.388901+0000","last_clean_scrub_stamp":"2024-04-24T02:15:39.388901+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:55:16.313182+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:27.445811+0000","last_change":"2024-04-24T02:15:27.445811+0000","last_active":"2024-04-24T02:15:27.445811+0000","last_peered":"2024-04-24T02:15:27.445811+0000","last_clean":"2024-04-24T02:15:27.445811+0000","last_became_active":"2024-04-24T02:12:10.779734+0000","last_became_peered":"2024-04-24T02:12:10.779734+0000","last_unstale":"2024-04-24T02:15:27.445811+0000","last_undegraded":"2024-04-24T02:15:27.445811+0000","last_fullsized":"2024-04-24T02:15:27.445811+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:27.445677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:27.445677+0000","last_clean_scrub_stamp":"2024-04-24T02:15:27.445677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:47:29.069695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'2","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:45.317822+0000","last_change":"2024-04-24T02:15:45.317822+0000","last_active":"2024-04-24T02:15:45.317822+0000","last_peered":"2024-04-24T02:15:45.317822+0000","last_clean":"2024-04-24T02:15:45.317822+0000","last_became_active":"2024-04-24T02:12:04.764564+0000","last_became_peered":"2024-04-24T02:12:04.764564+0000","last_unstale":"2024-04-24T02:15:45.317822+0000","last_undegraded":"2024-04-24T02:15:45.317822+0000","last_fullsized":"2024-04-24T02:15:45.317822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:15:45.317697+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:15:45.317697+0000","last_clean_scrub_stamp":"2024-04-24T02:15:45.317697+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:34:45.124130+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:23.093038+0000","last_change":"2024-04-24T02:16:23.093064+0000","last_active":"2024-04-24T02:16:23.093038+0000","last_peered":"2024-04-24T02:16:23.093038+0000","last_clean":"2024-04-24T02:16:23.093038+0000","last_became_active":"2024-04-24T02:12:45.809365+0000","last_became_peered":"2024-04-24T02:12:45.809365+0000","last_unstale":"2024-04-24T02:16:23.093038+0000","last_undegraded":"2024-04-24T02:16:23.093038+0000","last_fullsized":"2024-04-24T02:16:23.093038+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:16:23.092935+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:16:23.092935+0000","last_clean_scrub_stamp":"2024-04-24T02:16:23.092935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:16:06.034273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:17.596104+0000","last_change":"2024-04-24T02:16:17.596104+0000","last_active":"2024-04-24T02:16:17.596104+0000","last_peered":"2024-04-24T02:16:17.596104+0000","last_clean":"2024-04-24T02:16:17.596104+0000","last_became_active":"2024-04-24T02:12:45.814918+0000","last_became_peered":"2024-04-24T02:12:45.814918+0000","last_unstale":"2024-04-24T02:16:17.596104+0000","last_undegraded":"2024-04-24T02:16:17.596104+0000","last_fullsized":"2024-04-24T02:16:17.596104+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:17.595991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:17.595991+0000","last_clean_scrub_stamp":"2024-04-24T02:16:17.595991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:35:17.402424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"32'72","reported_seq":151,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:38.006044+0000","last_change":"2024-04-24T02:15:38.006098+0000","last_active":"2024-04-24T02:15:38.006044+0000","last_peered":"2024-04-24T02:15:38.006044+0000","last_clean":"2024-04-24T02:15:38.006044+0000","last_became_active":"2024-04-24T02:12:08.769578+0000","last_became_peered":"2024-04-24T02:12:08.769578+0000","last_unstale":"2024-04-24T02:15:38.006044+0000","last_undegraded":"2024-04-24T02:15:38.006044+0000","last_fullsized":"2024-04-24T02:15:38.006044+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'72","last_scrub_stamp":"2024-04-24T02:15:38.005928+0000","last_deep_scrub":"32'72","last_deep_scrub_stamp":"2024-04-24T02:15:38.005928+0000","last_clean_scrub_stamp":"2024-04-24T02:15:38.005928+0000","objects_scrubbed":6,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:38:25.392507+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:28.440238+0000","last_change":"2024-04-24T02:15:28.440262+0000","last_active":"2024-04-24T02:15:28.440238+0000","last_peered":"2024-04-24T02:15:28.440238+0000","last_clean":"2024-04-24T02:15:28.440238+0000","last_became_active":"2024-04-24T02:12:10.779703+0000","last_became_peered":"2024-04-24T02:12:10.779703+0000","last_unstale":"2024-04-24T02:15:28.440238+0000","last_undegraded":"2024-04-24T02:15:28.440238+0000","last_fullsized":"2024-04-24T02:15:28.440238+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:28.440118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:28.440118+0000","last_clean_scrub_stamp":"2024-04-24T02:15:28.440118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:28:48.467792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'16","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:18.060394+0000","last_change":"2024-04-24T02:16:18.060394+0000","last_active":"2024-04-24T02:16:18.060394+0000","last_peered":"2024-04-24T02:16:18.060394+0000","last_clean":"2024-04-24T02:16:18.060394+0000","last_became_active":"2024-04-24T02:12:12.791623+0000","last_became_peered":"2024-04-24T02:12:12.791623+0000","last_unstale":"2024-04-24T02:16:18.060394+0000","last_undegraded":"2024-04-24T02:16:18.060394+0000","last_fullsized":"2024-04-24T02:16:18.060394+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-04-24T02:16:18.060282+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-04-24T02:16:18.060282+0000","last_clean_scrub_stamp":"2024-04-24T02:16:18.060282+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:03:39.271033+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'10","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:01.115692+0000","last_change":"2024-04-24T02:16:01.115692+0000","last_active":"2024-04-24T02:16:01.115692+0000","last_peered":"2024-04-24T02:16:01.115692+0000","last_clean":"2024-04-24T02:16:01.115692+0000","last_became_active":"2024-04-24T02:12:04.755554+0000","last_became_peered":"2024-04-24T02:12:04.755554+0000","last_unstale":"2024-04-24T02:16:01.115692+0000","last_undegraded":"2024-04-24T02:16:01.115692+0000","last_fullsized":"2024-04-24T02:16:01.115692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-24T02:16:01.115544+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-24T02:16:01.115544+0000","last_clean_scrub_stamp":"2024-04-24T02:16:01.115544+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:30:37.328826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:15.402139+0000","last_change":"2024-04-24T02:16:15.402139+0000","last_active":"2024-04-24T02:16:15.402139+0000","last_peered":"2024-04-24T02:16:15.402139+0000","last_clean":"2024-04-24T02:16:15.402139+0000","last_became_active":"2024-04-24T02:12:02.751703+0000","last_became_peered":"2024-04-24T02:12:02.751703+0000","last_unstale":"2024-04-24T02:16:15.402139+0000","last_undegraded":"2024-04-24T02:16:15.402139+0000","last_fullsized":"2024-04-24T02:16:15.402139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:15.402014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:15.402014+0000","last_clean_scrub_stamp":"2024-04-24T02:16:15.402014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:50:00.999718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:47.423814+0000","last_change":"2024-04-24T02:15:47.423814+0000","last_active":"2024-04-24T02:15:47.423814+0000","last_peered":"2024-04-24T02:15:47.423814+0000","last_clean":"2024-04-24T02:15:47.423814+0000","last_became_active":"2024-04-24T02:12:06.756154+0000","last_became_peered":"2024-04-24T02:12:06.756154+0000","last_unstale":"2024-04-24T02:15:47.423814+0000","last_undegraded":"2024-04-24T02:15:47.423814+0000","last_fullsized":"2024-04-24T02:15:47.423814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:47.423687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:47.423687+0000","last_clean_scrub_stamp":"2024-04-24T02:15:47.423687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:18:00.672544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'45","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:44.331369+0000","last_change":"2024-04-24T02:15:44.331428+0000","last_active":"2024-04-24T02:15:44.331369+0000","last_peered":"2024-04-24T02:15:44.331369+0000","last_clean":"2024-04-24T02:15:44.331369+0000","last_became_active":"2024-04-24T02:12:08.780215+0000","last_became_peered":"2024-04-24T02:12:08.780215+0000","last_unstale":"2024-04-24T02:15:44.331369+0000","last_undegraded":"2024-04-24T02:15:44.331369+0000","last_fullsized":"2024-04-24T02:15:44.331369+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'45","last_scrub_stamp":"2024-04-24T02:15:44.331260+0000","last_deep_scrub":"32'45","last_deep_scrub_stamp":"2024-04-24T02:15:44.331260+0000","last_clean_scrub_stamp":"2024-04-24T02:15:44.331260+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:06:04.005763+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:34.421645+0000","last_change":"2024-04-24T02:15:34.421669+0000","last_active":"2024-04-24T02:15:34.421645+0000","last_peered":"2024-04-24T02:15:34.421645+0000","last_clean":"2024-04-24T02:15:34.421645+0000","last_became_active":"2024-04-24T02:12:10.785707+0000","last_became_peered":"2024-04-24T02:12:10.785707+0000","last_unstale":"2024-04-24T02:15:34.421645+0000","last_undegraded":"2024-04-24T02:15:34.421645+0000","last_fullsized":"2024-04-24T02:15:34.421645+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:34.421551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:34.421551+0000","last_clean_scrub_stamp":"2024-04-24T02:15:34.421551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:44:00.829320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:48.895125+0000","last_change":"2024-04-24T02:16:48.895125+0000","last_active":"2024-04-24T02:16:48.895125+0000","last_peered":"2024-04-24T02:16:48.895125+0000","last_clean":"2024-04-24T02:16:48.895125+0000","last_became_active":"2024-04-24T02:12:12.798498+0000","last_became_peered":"2024-04-24T02:12:12.798498+0000","last_unstale":"2024-04-24T02:16:48.895125+0000","last_undegraded":"2024-04-24T02:16:48.895125+0000","last_fullsized":"2024-04-24T02:16:48.895125+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:48.895003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:48.895003+0000","last_clean_scrub_stamp":"2024-04-24T02:16:48.895003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:08:39.031027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:35.413344+0000","last_change":"2024-04-24T02:15:35.413344+0000","last_active":"2024-04-24T02:15:35.413344+0000","last_peered":"2024-04-24T02:15:35.413344+0000","last_clean":"2024-04-24T02:15:35.413344+0000","last_became_active":"2024-04-24T02:12:04.768285+0000","last_became_peered":"2024-04-24T02:12:04.768285+0000","last_unstale":"2024-04-24T02:15:35.413344+0000","last_undegraded":"2024-04-24T02:15:35.413344+0000","last_fullsized":"2024-04-24T02:15:35.413344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:35.413190+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:35.413190+0000","last_clean_scrub_stamp":"2024-04-24T02:15:35.413190+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:52:59.536845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:13.455264+0000","last_change":"2024-04-24T02:16:13.455264+0000","last_active":"2024-04-24T02:16:13.455264+0000","last_peered":"2024-04-24T02:16:13.455264+0000","last_clean":"2024-04-24T02:16:13.455264+0000","last_became_active":"2024-04-24T02:12:02.749461+0000","last_became_peered":"2024-04-24T02:12:02.749461+0000","last_unstale":"2024-04-24T02:16:13.455264+0000","last_undegraded":"2024-04-24T02:16:13.455264+0000","last_fullsized":"2024-04-24T02:16:13.455264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:13.455104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:13.455104+0000","last_clean_scrub_stamp":"2024-04-24T02:16:13.455104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:22:53.192009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:44.450336+0000","last_change":"2024-04-24T02:15:44.450359+0000","last_active":"2024-04-24T02:15:44.450336+0000","last_peered":"2024-04-24T02:15:44.450336+0000","last_clean":"2024-04-24T02:15:44.450336+0000","last_became_active":"2024-04-24T02:12:06.757760+0000","last_became_peered":"2024-04-24T02:12:06.757760+0000","last_unstale":"2024-04-24T02:15:44.450336+0000","last_undegraded":"2024-04-24T02:15:44.450336+0000","last_fullsized":"2024-04-24T02:15:44.450336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:44.450238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:44.450238+0000","last_clean_scrub_stamp":"2024-04-24T02:15:44.450238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:58:20.317926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'46","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:34.024663+0000","last_change":"2024-04-24T02:15:34.024663+0000","last_active":"2024-04-24T02:15:34.024663+0000","last_peered":"2024-04-24T02:15:34.024663+0000","last_clean":"2024-04-24T02:15:34.024663+0000","last_became_active":"2024-04-24T02:12:08.779471+0000","last_became_peered":"2024-04-24T02:12:08.779471+0000","last_unstale":"2024-04-24T02:15:34.024663+0000","last_undegraded":"2024-04-24T02:15:34.024663+0000","last_fullsized":"2024-04-24T02:15:34.024663+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-04-24T02:15:34.024534+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-04-24T02:15:34.024534+0000","last_clean_scrub_stamp":"2024-04-24T02:15:34.024534+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:54:19.092809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:26.055802+0000","last_change":"2024-04-24T02:15:26.055802+0000","last_active":"2024-04-24T02:15:26.055802+0000","last_peered":"2024-04-24T02:15:26.055802+0000","last_clean":"2024-04-24T02:15:26.055802+0000","last_became_active":"2024-04-24T02:12:10.780272+0000","last_became_peered":"2024-04-24T02:12:10.780272+0000","last_unstale":"2024-04-24T02:15:26.055802+0000","last_undegraded":"2024-04-24T02:15:26.055802+0000","last_fullsized":"2024-04-24T02:15:26.055802+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:26.055680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:26.055680+0000","last_clean_scrub_stamp":"2024-04-24T02:15:26.055680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:52:00.699214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'3","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:45.886765+0000","last_change":"2024-04-24T02:16:45.886765+0000","last_active":"2024-04-24T02:16:45.886765+0000","last_peered":"2024-04-24T02:16:45.886765+0000","last_clean":"2024-04-24T02:16:45.886765+0000","last_became_active":"2024-04-24T02:12:12.794815+0000","last_became_peered":"2024-04-24T02:12:12.794815+0000","last_unstale":"2024-04-24T02:16:45.886765+0000","last_undegraded":"2024-04-24T02:16:45.886765+0000","last_fullsized":"2024-04-24T02:16:45.886765+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-04-24T02:16:45.886620+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-04-24T02:16:45.886620+0000","last_clean_scrub_stamp":"2024-04-24T02:16:45.886620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:59:42.023351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:59.109645+0000","last_change":"2024-04-24T02:15:59.109671+0000","last_active":"2024-04-24T02:15:59.109645+0000","last_peered":"2024-04-24T02:15:59.109645+0000","last_clean":"2024-04-24T02:15:59.109645+0000","last_became_active":"2024-04-24T02:12:04.750546+0000","last_became_peered":"2024-04-24T02:12:04.750546+0000","last_unstale":"2024-04-24T02:15:59.109645+0000","last_undegraded":"2024-04-24T02:15:59.109645+0000","last_fullsized":"2024-04-24T02:15:59.109645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:15:59.109559+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:15:59.109559+0000","last_clean_scrub_stamp":"2024-04-24T02:15:59.109559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:47:13.514457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:19.965108+0000","last_change":"2024-04-24T02:16:19.965108+0000","last_active":"2024-04-24T02:16:19.965108+0000","last_peered":"2024-04-24T02:16:19.965108+0000","last_clean":"2024-04-24T02:16:19.965108+0000","last_became_active":"2024-04-24T02:12:02.757728+0000","last_became_peered":"2024-04-24T02:12:02.757728+0000","last_unstale":"2024-04-24T02:16:19.965108+0000","last_undegraded":"2024-04-24T02:16:19.965108+0000","last_fullsized":"2024-04-24T02:16:19.965108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:19.964939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:19.964939+0000","last_clean_scrub_stamp":"2024-04-24T02:16:19.964939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:43:32.114177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:41.398126+0000","last_change":"2024-04-24T02:15:41.398149+0000","last_active":"2024-04-24T02:15:41.398126+0000","last_peered":"2024-04-24T02:15:41.398126+0000","last_clean":"2024-04-24T02:15:41.398126+0000","last_became_active":"2024-04-24T02:12:06.757145+0000","last_became_peered":"2024-04-24T02:12:06.757145+0000","last_unstale":"2024-04-24T02:15:41.398126+0000","last_undegraded":"2024-04-24T02:15:41.398126+0000","last_fullsized":"2024-04-24T02:15:41.398126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:41.398039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:41.398039+0000","last_clean_scrub_stamp":"2024-04-24T02:15:41.398039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:34:29.427113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'22","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:53.240926+0000","last_change":"2024-04-24T02:15:53.240926+0000","last_active":"2024-04-24T02:15:53.240926+0000","last_peered":"2024-04-24T02:15:53.240926+0000","last_clean":"2024-04-24T02:15:53.240926+0000","last_became_active":"2024-04-24T02:12:08.781974+0000","last_became_peered":"2024-04-24T02:12:08.781974+0000","last_unstale":"2024-04-24T02:15:53.240926+0000","last_undegraded":"2024-04-24T02:15:53.240926+0000","last_fullsized":"2024-04-24T02:15:53.240926+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-04-24T02:15:53.240760+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-04-24T02:15:53.240760+0000","last_clean_scrub_stamp":"2024-04-24T02:15:53.240760+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:03:08.965112+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'285","reported_seq":383,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:30.498799+0000","last_change":"2024-04-24T02:15:30.498799+0000","last_active":"2024-04-24T02:15:30.498799+0000","last_peered":"2024-04-24T02:15:30.498799+0000","last_clean":"2024-04-24T02:15:30.498799+0000","last_became_active":"2024-04-24T02:12:10.786972+0000","last_became_peered":"2024-04-24T02:12:10.786972+0000","last_unstale":"2024-04-24T02:15:30.498799+0000","last_undegraded":"2024-04-24T02:15:30.498799+0000","last_fullsized":"2024-04-24T02:15:30.498799+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-24T02:15:30.498687+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-24T02:15:30.498687+0000","last_clean_scrub_stamp":"2024-04-24T02:15:30.498687+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:36:15.522512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'4","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:46.894459+0000","last_change":"2024-04-24T02:16:46.894459+0000","last_active":"2024-04-24T02:16:46.894459+0000","last_peered":"2024-04-24T02:16:46.894459+0000","last_clean":"2024-04-24T02:16:46.894459+0000","last_became_active":"2024-04-24T02:12:12.795013+0000","last_became_peered":"2024-04-24T02:12:12.795013+0000","last_unstale":"2024-04-24T02:16:46.894459+0000","last_undegraded":"2024-04-24T02:16:46.894459+0000","last_fullsized":"2024-04-24T02:16:46.894459+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:16:46.894321+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:16:46.894321+0000","last_clean_scrub_stamp":"2024-04-24T02:16:46.894321+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:06:15.413233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'12","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:48.389882+0000","last_change":"2024-04-24T02:15:48.389882+0000","last_active":"2024-04-24T02:15:48.389882+0000","last_peered":"2024-04-24T02:15:48.389882+0000","last_clean":"2024-04-24T02:15:48.389882+0000","last_became_active":"2024-04-24T02:12:04.751676+0000","last_became_peered":"2024-04-24T02:12:04.751676+0000","last_unstale":"2024-04-24T02:15:48.389882+0000","last_undegraded":"2024-04-24T02:15:48.389882+0000","last_fullsized":"2024-04-24T02:15:48.389882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-04-24T02:15:48.389766+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-04-24T02:15:48.389766+0000","last_clean_scrub_stamp":"2024-04-24T02:15:48.389766+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:57:05.559919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:59.519617+0000","last_change":"2024-04-24T02:15:59.519617+0000","last_active":"2024-04-24T02:15:59.519617+0000","last_peered":"2024-04-24T02:15:59.519617+0000","last_clean":"2024-04-24T02:15:59.519617+0000","last_became_active":"2024-04-24T02:12:02.755512+0000","last_became_peered":"2024-04-24T02:12:02.755512+0000","last_unstale":"2024-04-24T02:15:59.519617+0000","last_undegraded":"2024-04-24T02:15:59.519617+0000","last_fullsized":"2024-04-24T02:15:59.519617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:59.519514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:59.519514+0000","last_clean_scrub_stamp":"2024-04-24T02:15:59.519514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:42:18.856192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:43.382322+0000","last_change":"2024-04-24T02:15:43.382348+0000","last_active":"2024-04-24T02:15:43.382322+0000","last_peered":"2024-04-24T02:15:43.382322+0000","last_clean":"2024-04-24T02:15:43.382322+0000","last_became_active":"2024-04-24T02:12:06.756909+0000","last_became_peered":"2024-04-24T02:12:06.756909+0000","last_unstale":"2024-04-24T02:15:43.382322+0000","last_undegraded":"2024-04-24T02:15:43.382322+0000","last_fullsized":"2024-04-24T02:15:43.382322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:43.382200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:43.382200+0000","last_clean_scrub_stamp":"2024-04-24T02:15:43.382200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:04:38.984836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'73","reported_seq":156,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:31.331846+0000","last_change":"2024-04-24T02:15:31.331846+0000","last_active":"2024-04-24T02:15:31.331846+0000","last_peered":"2024-04-24T02:15:31.331846+0000","last_clean":"2024-04-24T02:15:31.331846+0000","last_became_active":"2024-04-24T02:12:08.770255+0000","last_became_peered":"2024-04-24T02:12:08.770255+0000","last_unstale":"2024-04-24T02:15:31.331846+0000","last_undegraded":"2024-04-24T02:15:31.331846+0000","last_fullsized":"2024-04-24T02:15:31.331846+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'73","last_scrub_stamp":"2024-04-24T02:15:31.331721+0000","last_deep_scrub":"32'73","last_deep_scrub_stamp":"2024-04-24T02:15:31.331721+0000","last_clean_scrub_stamp":"2024-04-24T02:15:31.331721+0000","objects_scrubbed":11,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:04:50.870204+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:39.022402+0000","last_change":"2024-04-24T02:15:39.022402+0000","last_active":"2024-04-24T02:15:39.022402+0000","last_peered":"2024-04-24T02:15:39.022402+0000","last_clean":"2024-04-24T02:15:39.022402+0000","last_became_active":"2024-04-24T02:12:10.785811+0000","last_became_peered":"2024-04-24T02:12:10.785811+0000","last_unstale":"2024-04-24T02:15:39.022402+0000","last_undegraded":"2024-04-24T02:15:39.022402+0000","last_fullsized":"2024-04-24T02:15:39.022402+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:39.022286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:39.022286+0000","last_clean_scrub_stamp":"2024-04-24T02:15:39.022286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:12:21.461638+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:21.490561+0000","last_change":"2024-04-24T02:16:21.490561+0000","last_active":"2024-04-24T02:16:21.490561+0000","last_peered":"2024-04-24T02:16:21.490561+0000","last_clean":"2024-04-24T02:16:21.490561+0000","last_became_active":"2024-04-24T02:12:12.799557+0000","last_became_peered":"2024-04-24T02:12:12.799557+0000","last_unstale":"2024-04-24T02:16:21.490561+0000","last_undegraded":"2024-04-24T02:16:21.490561+0000","last_fullsized":"2024-04-24T02:16:21.490561+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:21.490452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:21.490452+0000","last_clean_scrub_stamp":"2024-04-24T02:16:21.490452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:18:13.834051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'18","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:51.411902+0000","last_change":"2024-04-24T02:15:51.411902+0000","last_active":"2024-04-24T02:15:51.411902+0000","last_peered":"2024-04-24T02:15:51.411902+0000","last_clean":"2024-04-24T02:15:51.411902+0000","last_became_active":"2024-04-24T02:12:04.748399+0000","last_became_peered":"2024-04-24T02:12:04.748399+0000","last_unstale":"2024-04-24T02:15:51.411902+0000","last_undegraded":"2024-04-24T02:15:51.411902+0000","last_fullsized":"2024-04-24T02:15:51.411902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-04-24T02:15:51.411793+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-04-24T02:15:51.411793+0000","last_clean_scrub_stamp":"2024-04-24T02:15:51.411793+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:57:53.859681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":55,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:16.952565+0000","last_change":"2024-04-24T02:16:16.952565+0000","last_active":"2024-04-24T02:16:16.952565+0000","last_peered":"2024-04-24T02:16:16.952565+0000","last_clean":"2024-04-24T02:16:16.952565+0000","last_became_active":"2024-04-24T02:12:02.760772+0000","last_became_peered":"2024-04-24T02:12:02.760772+0000","last_unstale":"2024-04-24T02:16:16.952565+0000","last_undegraded":"2024-04-24T02:16:16.952565+0000","last_fullsized":"2024-04-24T02:16:16.952565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:16.952429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:16.952429+0000","last_clean_scrub_stamp":"2024-04-24T02:16:16.952429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:47:23.767080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:43.411197+0000","last_change":"2024-04-24T02:15:43.411223+0000","last_active":"2024-04-24T02:15:43.411197+0000","last_peered":"2024-04-24T02:15:43.411197+0000","last_clean":"2024-04-24T02:15:43.411197+0000","last_became_active":"2024-04-24T02:12:06.764475+0000","last_became_peered":"2024-04-24T02:12:06.764475+0000","last_unstale":"2024-04-24T02:15:43.411197+0000","last_undegraded":"2024-04-24T02:15:43.411197+0000","last_fullsized":"2024-04-24T02:15:43.411197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:43.411113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:43.411113+0000","last_clean_scrub_stamp":"2024-04-24T02:15:43.411113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:44:09.818882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'44","reported_seq":106,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:36.026681+0000","last_change":"2024-04-24T02:15:36.026681+0000","last_active":"2024-04-24T02:15:36.026681+0000","last_peered":"2024-04-24T02:15:36.026681+0000","last_clean":"2024-04-24T02:15:36.026681+0000","last_became_active":"2024-04-24T02:12:08.779447+0000","last_became_peered":"2024-04-24T02:12:08.779447+0000","last_unstale":"2024-04-24T02:15:36.026681+0000","last_undegraded":"2024-04-24T02:15:36.026681+0000","last_fullsized":"2024-04-24T02:15:36.026681+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'44","last_scrub_stamp":"2024-04-24T02:15:36.026532+0000","last_deep_scrub":"32'44","last_deep_scrub_stamp":"2024-04-24T02:15:36.026532+0000","last_clean_scrub_stamp":"2024-04-24T02:15:36.026532+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:44:38.935524+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:47.335614+0000","last_change":"2024-04-24T02:15:47.335614+0000","last_active":"2024-04-24T02:15:47.335614+0000","last_peered":"2024-04-24T02:15:47.335614+0000","last_clean":"2024-04-24T02:15:47.335614+0000","last_became_active":"2024-04-24T02:12:10.782019+0000","last_became_peered":"2024-04-24T02:12:10.782019+0000","last_unstale":"2024-04-24T02:15:47.335614+0000","last_undegraded":"2024-04-24T02:15:47.335614+0000","last_fullsized":"2024-04-24T02:15:47.335614+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:47.335498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:47.335498+0000","last_clean_scrub_stamp":"2024-04-24T02:15:47.335498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:09:16.493400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:47.894277+0000","last_change":"2024-04-24T02:16:47.894277+0000","last_active":"2024-04-24T02:16:47.894277+0000","last_peered":"2024-04-24T02:16:47.894277+0000","last_clean":"2024-04-24T02:16:47.894277+0000","last_became_active":"2024-04-24T02:12:12.796494+0000","last_became_peered":"2024-04-24T02:12:12.796494+0000","last_unstale":"2024-04-24T02:16:47.894277+0000","last_undegraded":"2024-04-24T02:16:47.894277+0000","last_fullsized":"2024-04-24T02:16:47.894277+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:47.894138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:47.894138+0000","last_clean_scrub_stamp":"2024-04-24T02:16:47.894138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:26:38.362854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'10","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:10.005108+0000","last_change":"2024-04-24T02:16:10.005108+0000","last_active":"2024-04-24T02:16:10.005108+0000","last_peered":"2024-04-24T02:16:10.005108+0000","last_clean":"2024-04-24T02:16:10.005108+0000","last_became_active":"2024-04-24T02:12:04.763263+0000","last_became_peered":"2024-04-24T02:12:04.763263+0000","last_unstale":"2024-04-24T02:16:10.005108+0000","last_undegraded":"2024-04-24T02:16:10.005108+0000","last_fullsized":"2024-04-24T02:16:10.005108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-24T02:16:10.004960+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-24T02:16:10.004960+0000","last_clean_scrub_stamp":"2024-04-24T02:16:10.004960+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:13:22.857543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:04.117008+0000","last_change":"2024-04-24T02:16:04.117035+0000","last_active":"2024-04-24T02:16:04.117008+0000","last_peered":"2024-04-24T02:16:04.117008+0000","last_clean":"2024-04-24T02:16:04.117008+0000","last_became_active":"2024-04-24T02:12:02.745617+0000","last_became_peered":"2024-04-24T02:12:02.745617+0000","last_unstale":"2024-04-24T02:16:04.117008+0000","last_undegraded":"2024-04-24T02:16:04.117008+0000","last_fullsized":"2024-04-24T02:16:04.117008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:16:04.116904+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:16:04.116904+0000","last_clean_scrub_stamp":"2024-04-24T02:16:04.116904+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:59:21.604473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:33.375893+0000","last_change":"2024-04-24T02:15:33.375893+0000","last_active":"2024-04-24T02:15:33.375893+0000","last_peered":"2024-04-24T02:15:33.375893+0000","last_clean":"2024-04-24T02:15:33.375893+0000","last_became_active":"2024-04-24T02:12:06.765644+0000","last_became_peered":"2024-04-24T02:12:06.765644+0000","last_unstale":"2024-04-24T02:15:33.375893+0000","last_undegraded":"2024-04-24T02:15:33.375893+0000","last_fullsized":"2024-04-24T02:15:33.375893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:33.375779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:33.375779+0000","last_clean_scrub_stamp":"2024-04-24T02:15:33.375779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:09:27.434014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'38","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:40.363423+0000","last_change":"2024-04-24T02:15:40.363468+0000","last_active":"2024-04-24T02:15:40.363423+0000","last_peered":"2024-04-24T02:15:40.363423+0000","last_clean":"2024-04-24T02:15:40.363423+0000","last_became_active":"2024-04-24T02:12:08.780056+0000","last_became_peered":"2024-04-24T02:12:08.780056+0000","last_unstale":"2024-04-24T02:15:40.363423+0000","last_undegraded":"2024-04-24T02:15:40.363423+0000","last_fullsized":"2024-04-24T02:15:40.363423+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'38","last_scrub_stamp":"2024-04-24T02:15:40.363331+0000","last_deep_scrub":"32'38","last_deep_scrub_stamp":"2024-04-24T02:15:40.363331+0000","last_clean_scrub_stamp":"2024-04-24T02:15:40.363331+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:29:10.489979+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:00.072224+0000","last_change":"2024-04-24T02:16:00.072260+0000","last_active":"2024-04-24T02:16:00.072224+0000","last_peered":"2024-04-24T02:16:00.072224+0000","last_clean":"2024-04-24T02:16:00.072224+0000","last_became_active":"2024-04-24T02:12:10.785396+0000","last_became_peered":"2024-04-24T02:12:10.785396+0000","last_unstale":"2024-04-24T02:16:00.072224+0000","last_undegraded":"2024-04-24T02:16:00.072224+0000","last_fullsized":"2024-04-24T02:16:00.072224+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:00.072127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:00.072127+0000","last_clean_scrub_stamp":"2024-04-24T02:16:00.072127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:49:41.610677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:11.993815+0000","last_change":"2024-04-24T02:16:11.993815+0000","last_active":"2024-04-24T02:16:11.993815+0000","last_peered":"2024-04-24T02:16:11.993815+0000","last_clean":"2024-04-24T02:16:11.993815+0000","last_became_active":"2024-04-24T02:12:12.793796+0000","last_became_peered":"2024-04-24T02:12:12.793796+0000","last_unstale":"2024-04-24T02:16:11.993815+0000","last_undegraded":"2024-04-24T02:16:11.993815+0000","last_fullsized":"2024-04-24T02:16:11.993815+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:16:11.993699+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:16:11.993699+0000","last_clean_scrub_stamp":"2024-04-24T02:16:11.993699+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:44:14.703404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'20","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:49.413494+0000","last_change":"2024-04-24T02:15:49.413494+0000","last_active":"2024-04-24T02:15:49.413494+0000","last_peered":"2024-04-24T02:15:49.413494+0000","last_clean":"2024-04-24T02:15:49.413494+0000","last_became_active":"2024-04-24T02:12:04.749055+0000","last_became_peered":"2024-04-24T02:12:04.749055+0000","last_unstale":"2024-04-24T02:15:49.413494+0000","last_undegraded":"2024-04-24T02:15:49.413494+0000","last_fullsized":"2024-04-24T02:15:49.413494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-04-24T02:15:49.413342+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-04-24T02:15:49.413342+0000","last_clean_scrub_stamp":"2024-04-24T02:15:49.413342+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:15:41.702152+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:12.479147+0000","last_change":"2024-04-24T02:16:12.479147+0000","last_active":"2024-04-24T02:16:12.479147+0000","last_peered":"2024-04-24T02:16:12.479147+0000","last_clean":"2024-04-24T02:16:12.479147+0000","last_became_active":"2024-04-24T02:12:02.745895+0000","last_became_peered":"2024-04-24T02:12:02.745895+0000","last_unstale":"2024-04-24T02:16:12.479147+0000","last_undegraded":"2024-04-24T02:16:12.479147+0000","last_fullsized":"2024-04-24T02:16:12.479147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:12.479035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:12.479035+0000","last_clean_scrub_stamp":"2024-04-24T02:16:12.479035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:05:15.618195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'8","reported_seq":242,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:35.456160+0000","last_change":"2024-04-24T02:15:35.456160+0000","last_active":"2024-04-24T02:15:35.456160+0000","last_peered":"2024-04-24T02:15:35.456160+0000","last_clean":"2024-04-24T02:15:35.456160+0000","last_became_active":"2024-04-24T02:12:06.765096+0000","last_became_peered":"2024-04-24T02:12:06.765096+0000","last_unstale":"2024-04-24T02:15:35.456160+0000","last_undegraded":"2024-04-24T02:15:35.456160+0000","last_fullsized":"2024-04-24T02:15:35.456160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-24T02:15:35.456000+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-24T02:15:35.456000+0000","last_clean_scrub_stamp":"2024-04-24T02:15:35.456000+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:58:11.323688+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'53","reported_seq":122,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:30.313073+0000","last_change":"2024-04-24T02:15:30.313116+0000","last_active":"2024-04-24T02:15:30.313073+0000","last_peered":"2024-04-24T02:15:30.313073+0000","last_clean":"2024-04-24T02:15:30.313073+0000","last_became_active":"2024-04-24T02:12:08.779892+0000","last_became_peered":"2024-04-24T02:12:08.779892+0000","last_unstale":"2024-04-24T02:15:30.313073+0000","last_undegraded":"2024-04-24T02:15:30.313073+0000","last_fullsized":"2024-04-24T02:15:30.313073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'53","last_scrub_stamp":"2024-04-24T02:15:30.312975+0000","last_deep_scrub":"32'53","last_deep_scrub_stamp":"2024-04-24T02:15:30.312975+0000","last_clean_scrub_stamp":"2024-04-24T02:15:30.312975+0000","objects_scrubbed":7,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:50:47.143315+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:25.040176+0000","last_change":"2024-04-24T02:15:25.040213+0000","last_active":"2024-04-24T02:15:25.040176+0000","last_peered":"2024-04-24T02:15:25.040176+0000","last_clean":"2024-04-24T02:15:25.040176+0000","last_became_active":"2024-04-24T02:12:10.781588+0000","last_became_peered":"2024-04-24T02:12:10.781588+0000","last_unstale":"2024-04-24T02:15:25.040176+0000","last_undegraded":"2024-04-24T02:15:25.040176+0000","last_fullsized":"2024-04-24T02:15:25.040176+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:15:25.040045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:15:25.040045+0000","last_clean_scrub_stamp":"2024-04-24T02:15:25.040045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:17:46.062684+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'7","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:07.987454+0000","last_change":"2024-04-24T02:16:07.987454+0000","last_active":"2024-04-24T02:16:07.987454+0000","last_peered":"2024-04-24T02:16:07.987454+0000","last_clean":"2024-04-24T02:16:07.987454+0000","last_became_active":"2024-04-24T02:12:12.793310+0000","last_became_peered":"2024-04-24T02:12:12.793310+0000","last_unstale":"2024-04-24T02:16:07.987454+0000","last_undegraded":"2024-04-24T02:16:07.987454+0000","last_fullsized":"2024-04-24T02:16:07.987454+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-04-24T02:16:07.987322+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-04-24T02:16:07.987322+0000","last_clean_scrub_stamp":"2024-04-24T02:16:07.987322+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:15:09.700497+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:45.345220+0000","last_change":"2024-04-24T02:15:45.345220+0000","last_active":"2024-04-24T02:15:45.345220+0000","last_peered":"2024-04-24T02:15:45.345220+0000","last_clean":"2024-04-24T02:15:45.345220+0000","last_became_active":"2024-04-24T02:12:04.766869+0000","last_became_peered":"2024-04-24T02:12:04.766869+0000","last_unstale":"2024-04-24T02:15:45.345220+0000","last_undegraded":"2024-04-24T02:15:45.345220+0000","last_fullsized":"2024-04-24T02:15:45.345220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:45.345090+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:45.345090+0000","last_clean_scrub_stamp":"2024-04-24T02:15:45.345090+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:03:24.007542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:03.430790+0000","last_change":"2024-04-24T02:16:03.430790+0000","last_active":"2024-04-24T02:16:03.430790+0000","last_peered":"2024-04-24T02:16:03.430790+0000","last_clean":"2024-04-24T02:16:03.430790+0000","last_became_active":"2024-04-24T02:12:02.746992+0000","last_became_peered":"2024-04-24T02:12:02.746992+0000","last_unstale":"2024-04-24T02:16:03.430790+0000","last_undegraded":"2024-04-24T02:16:03.430790+0000","last_fullsized":"2024-04-24T02:16:03.430790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:03.430671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:03.430671+0000","last_clean_scrub_stamp":"2024-04-24T02:16:03.430671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:16:11.501515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:55.103631+0000","last_change":"2024-04-24T02:15:55.103631+0000","last_active":"2024-04-24T02:15:55.103631+0000","last_peered":"2024-04-24T02:15:55.103631+0000","last_clean":"2024-04-24T02:15:55.103631+0000","last_became_active":"2024-04-24T02:12:04.749165+0000","last_became_peered":"2024-04-24T02:12:04.749165+0000","last_unstale":"2024-04-24T02:15:55.103631+0000","last_undegraded":"2024-04-24T02:15:55.103631+0000","last_fullsized":"2024-04-24T02:15:55.103631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:55.103514+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:55.103514+0000","last_clean_scrub_stamp":"2024-04-24T02:15:55.103514+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:12:47.755623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'6","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:00.117523+0000","last_change":"2024-04-24T02:16:00.117523+0000","last_active":"2024-04-24T02:16:00.117523+0000","last_peered":"2024-04-24T02:16:00.117523+0000","last_clean":"2024-04-24T02:16:00.117523+0000","last_became_active":"2024-04-24T02:12:02.751613+0000","last_became_peered":"2024-04-24T02:12:02.751613+0000","last_unstale":"2024-04-24T02:16:00.117523+0000","last_undegraded":"2024-04-24T02:16:00.117523+0000","last_fullsized":"2024-04-24T02:16:00.117523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-24T02:16:00.117409+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-24T02:16:00.117409+0000","last_clean_scrub_stamp":"2024-04-24T02:16:00.117409+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:51:24.121602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:01.029548+0000","last_change":"2024-04-24T02:16:01.029548+0000","last_active":"2024-04-24T02:16:01.029548+0000","last_peered":"2024-04-24T02:16:01.029548+0000","last_clean":"2024-04-24T02:16:01.029548+0000","last_became_active":"2024-04-24T02:12:04.763819+0000","last_became_peered":"2024-04-24T02:12:04.763819+0000","last_unstale":"2024-04-24T02:16:01.029548+0000","last_undegraded":"2024-04-24T02:16:01.029548+0000","last_fullsized":"2024-04-24T02:16:01.029548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:16:01.029417+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:16:01.029417+0000","last_clean_scrub_stamp":"2024-04-24T02:16:01.029417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:21.330095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:17.917467+0000","last_change":"2024-04-24T02:16:17.917491+0000","last_active":"2024-04-24T02:16:17.917467+0000","last_peered":"2024-04-24T02:16:17.917467+0000","last_clean":"2024-04-24T02:16:17.917467+0000","last_became_active":"2024-04-24T02:12:02.757017+0000","last_became_peered":"2024-04-24T02:12:02.757017+0000","last_unstale":"2024-04-24T02:16:17.917467+0000","last_undegraded":"2024-04-24T02:16:17.917467+0000","last_fullsized":"2024-04-24T02:16:17.917467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:17.917380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:17.917380+0000","last_clean_scrub_stamp":"2024-04-24T02:16:17.917380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:33:14.097750+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'4","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:57.094452+0000","last_change":"2024-04-24T02:15:57.094452+0000","last_active":"2024-04-24T02:15:57.094452+0000","last_peered":"2024-04-24T02:15:57.094452+0000","last_clean":"2024-04-24T02:15:57.094452+0000","last_became_active":"2024-04-24T02:12:04.749305+0000","last_became_peered":"2024-04-24T02:12:04.749305+0000","last_unstale":"2024-04-24T02:15:57.094452+0000","last_undegraded":"2024-04-24T02:15:57.094452+0000","last_fullsized":"2024-04-24T02:15:57.094452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:57.094303+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:57.094303+0000","last_clean_scrub_stamp":"2024-04-24T02:15:57.094303+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:28:38.930212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"30'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:11.099959+0000","last_change":"2024-04-24T02:16:11.099959+0000","last_active":"2024-04-24T02:16:11.099959+0000","last_peered":"2024-04-24T02:16:11.099959+0000","last_clean":"2024-04-24T02:16:11.099959+0000","last_became_active":"2024-04-24T02:12:02.741503+0000","last_became_peered":"2024-04-24T02:12:02.741503+0000","last_unstale":"2024-04-24T02:16:11.099959+0000","last_undegraded":"2024-04-24T02:16:11.099959+0000","last_fullsized":"2024-04-24T02:16:11.099959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-24T02:16:11.099811+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-24T02:16:11.099811+0000","last_clean_scrub_stamp":"2024-04-24T02:16:11.099811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:43:30.505061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'6","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:24.136315+0000","last_change":"2024-04-24T02:16:24.136353+0000","last_active":"2024-04-24T02:16:24.136315+0000","last_peered":"2024-04-24T02:16:24.136315+0000","last_clean":"2024-04-24T02:16:24.136315+0000","last_became_active":"2024-04-24T02:12:45.814356+0000","last_became_peered":"2024-04-24T02:12:45.814356+0000","last_unstale":"2024-04-24T02:16:24.136315+0000","last_undegraded":"2024-04-24T02:16:24.136315+0000","last_fullsized":"2024-04-24T02:16:24.136315+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-24T02:16:24.136212+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-24T02:16:24.136212+0000","last_clean_scrub_stamp":"2024-04-24T02:16:24.136212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:46:29.560693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:58.137753+0000","last_change":"2024-04-24T02:15:58.137753+0000","last_active":"2024-04-24T02:15:58.137753+0000","last_peered":"2024-04-24T02:15:58.137753+0000","last_clean":"2024-04-24T02:15:58.137753+0000","last_became_active":"2024-04-24T02:12:02.751680+0000","last_became_peered":"2024-04-24T02:12:02.751680+0000","last_unstale":"2024-04-24T02:15:58.137753+0000","last_undegraded":"2024-04-24T02:15:58.137753+0000","last_fullsized":"2024-04-24T02:15:58.137753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:15:58.137599+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:15:58.137599+0000","last_clean_scrub_stamp":"2024-04-24T02:15:58.137599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:14:26.157218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'8","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:19.606162+0000","last_change":"2024-04-24T02:16:19.606162+0000","last_active":"2024-04-24T02:16:19.606162+0000","last_peered":"2024-04-24T02:16:19.606162+0000","last_clean":"2024-04-24T02:16:19.606162+0000","last_became_active":"2024-04-24T02:12:45.813097+0000","last_became_peered":"2024-04-24T02:12:45.813097+0000","last_unstale":"2024-04-24T02:16:19.606162+0000","last_undegraded":"2024-04-24T02:16:19.606162+0000","last_fullsized":"2024-04-24T02:16:19.606162+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-24T02:16:19.606029+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-24T02:16:19.606029+0000","last_clean_scrub_stamp":"2024-04-24T02:16:19.606029+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:09:48.763930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:03.422937+0000","last_change":"2024-04-24T02:16:03.422937+0000","last_active":"2024-04-24T02:16:03.422937+0000","last_peered":"2024-04-24T02:16:03.422937+0000","last_clean":"2024-04-24T02:16:03.422937+0000","last_became_active":"2024-04-24T02:12:02.754356+0000","last_became_peered":"2024-04-24T02:12:02.754356+0000","last_unstale":"2024-04-24T02:16:03.422937+0000","last_undegraded":"2024-04-24T02:16:03.422937+0000","last_fullsized":"2024-04-24T02:16:03.422937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:16:03.422793+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:16:03.422793+0000","last_clean_scrub_stamp":"2024-04-24T02:16:03.422793+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:29:33.549441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'6","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:05.162202+0000","last_change":"2024-04-24T02:16:05.162202+0000","last_active":"2024-04-24T02:16:05.162202+0000","last_peered":"2024-04-24T02:16:05.162202+0000","last_clean":"2024-04-24T02:16:05.162202+0000","last_became_active":"2024-04-24T02:12:04.755738+0000","last_became_peered":"2024-04-24T02:12:04.755738+0000","last_unstale":"2024-04-24T02:16:05.162202+0000","last_undegraded":"2024-04-24T02:16:05.162202+0000","last_fullsized":"2024-04-24T02:16:05.162202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-24T02:16:05.162069+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-24T02:16:05.162069+0000","last_clean_scrub_stamp":"2024-04-24T02:16:05.162069+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:50:33.643248+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"30'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:53.400534+0000","last_change":"2024-04-24T02:15:53.400534+0000","last_active":"2024-04-24T02:15:53.400534+0000","last_peered":"2024-04-24T02:15:53.400534+0000","last_clean":"2024-04-24T02:15:53.400534+0000","last_became_active":"2024-04-24T02:12:02.755202+0000","last_became_peered":"2024-04-24T02:12:02.755202+0000","last_unstale":"2024-04-24T02:15:53.400534+0000","last_undegraded":"2024-04-24T02:15:53.400534+0000","last_fullsized":"2024-04-24T02:15:53.400534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-24T02:15:53.400367+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-24T02:15:53.400367+0000","last_clean_scrub_stamp":"2024-04-24T02:15:53.400367+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:44:25.927284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"30'4","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:16.373027+0000","last_change":"2024-04-24T02:16:16.373051+0000","last_active":"2024-04-24T02:16:16.373027+0000","last_peered":"2024-04-24T02:16:16.373027+0000","last_clean":"2024-04-24T02:16:16.373027+0000","last_became_active":"2024-04-24T02:12:04.755194+0000","last_became_peered":"2024-04-24T02:12:04.755194+0000","last_unstale":"2024-04-24T02:16:16.373027+0000","last_undegraded":"2024-04-24T02:16:16.373027+0000","last_fullsized":"2024-04-24T02:16:16.373027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-04-24T02:16:16.372898+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-04-24T02:16:16.372898+0000","last_clean_scrub_stamp":"2024-04-24T02:16:16.372898+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:03:32.097250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:56.120098+0000","last_change":"2024-04-24T02:15:56.120098+0000","last_active":"2024-04-24T02:15:56.120098+0000","last_peered":"2024-04-24T02:15:56.120098+0000","last_clean":"2024-04-24T02:15:56.120098+0000","last_became_active":"2024-04-24T02:12:02.751726+0000","last_became_peered":"2024-04-24T02:12:02.751726+0000","last_unstale":"2024-04-24T02:15:56.120098+0000","last_undegraded":"2024-04-24T02:15:56.120098+0000","last_fullsized":"2024-04-24T02:15:56.120098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:15:56.119931+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:15:56.119931+0000","last_clean_scrub_stamp":"2024-04-24T02:15:56.119931+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:52:08.946224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'6","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:54.454652+0000","last_change":"2024-04-24T02:15:54.454652+0000","last_active":"2024-04-24T02:15:54.454652+0000","last_peered":"2024-04-24T02:15:54.454652+0000","last_clean":"2024-04-24T02:15:54.454652+0000","last_became_active":"2024-04-24T02:12:04.753074+0000","last_became_peered":"2024-04-24T02:12:04.753074+0000","last_unstale":"2024-04-24T02:15:54.454652+0000","last_undegraded":"2024-04-24T02:15:54.454652+0000","last_fullsized":"2024-04-24T02:15:54.454652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-24T02:15:54.454534+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-24T02:15:54.454534+0000","last_clean_scrub_stamp":"2024-04-24T02:15:54.454534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:16:02.525378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:39.031195+0000","last_change":"2024-04-24T02:16:39.031218+0000","last_active":"2024-04-24T02:16:39.031195+0000","last_peered":"2024-04-24T02:16:39.031195+0000","last_clean":"2024-04-24T02:16:39.031195+0000","last_became_active":"2024-04-24T02:12:02.754158+0000","last_became_peered":"2024-04-24T02:12:02.754158+0000","last_unstale":"2024-04-24T02:16:39.031195+0000","last_undegraded":"2024-04-24T02:16:39.031195+0000","last_fullsized":"2024-04-24T02:16:39.031195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:16:39.031106+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:16:39.031106+0000","last_clean_scrub_stamp":"2024-04-24T02:16:39.031106+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:12:39.435691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'8","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:07.007685+0000","last_change":"2024-04-24T02:16:07.007685+0000","last_active":"2024-04-24T02:16:07.007685+0000","last_peered":"2024-04-24T02:16:07.007685+0000","last_clean":"2024-04-24T02:16:07.007685+0000","last_became_active":"2024-04-24T02:12:04.763136+0000","last_became_peered":"2024-04-24T02:12:04.763136+0000","last_unstale":"2024-04-24T02:16:07.007685+0000","last_undegraded":"2024-04-24T02:16:07.007685+0000","last_fullsized":"2024-04-24T02:16:07.007685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-24T02:16:07.007563+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-24T02:16:07.007563+0000","last_clean_scrub_stamp":"2024-04-24T02:16:07.007563+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:48:31.489105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:12.115548+0000","last_change":"2024-04-24T02:16:12.115548+0000","last_active":"2024-04-24T02:16:12.115548+0000","last_peered":"2024-04-24T02:16:12.115548+0000","last_clean":"2024-04-24T02:16:12.115548+0000","last_became_active":"2024-04-24T02:12:02.741543+0000","last_became_peered":"2024-04-24T02:12:02.741543+0000","last_unstale":"2024-04-24T02:16:12.115548+0000","last_undegraded":"2024-04-24T02:16:12.115548+0000","last_fullsized":"2024-04-24T02:16:12.115548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:12.115366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:12.115366+0000","last_clean_scrub_stamp":"2024-04-24T02:16:12.115366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:58:03.367670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:52.099971+0000","last_change":"2024-04-24T02:15:52.099971+0000","last_active":"2024-04-24T02:15:52.099971+0000","last_peered":"2024-04-24T02:15:52.099971+0000","last_clean":"2024-04-24T02:15:52.099971+0000","last_became_active":"2024-04-24T02:12:04.760028+0000","last_became_peered":"2024-04-24T02:12:04.760028+0000","last_unstale":"2024-04-24T02:15:52.099971+0000","last_undegraded":"2024-04-24T02:15:52.099971+0000","last_fullsized":"2024-04-24T02:15:52.099971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:15:52.099774+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:15:52.099774+0000","last_clean_scrub_stamp":"2024-04-24T02:15:52.099774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:55:18.068142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:14.449831+0000","last_change":"2024-04-24T02:16:14.449831+0000","last_active":"2024-04-24T02:16:14.449831+0000","last_peered":"2024-04-24T02:16:14.449831+0000","last_clean":"2024-04-24T02:16:14.449831+0000","last_became_active":"2024-04-24T02:12:02.750143+0000","last_became_peered":"2024-04-24T02:12:02.750143+0000","last_unstale":"2024-04-24T02:16:14.449831+0000","last_undegraded":"2024-04-24T02:16:14.449831+0000","last_fullsized":"2024-04-24T02:16:14.449831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:16:14.449684+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:16:14.449684+0000","last_clean_scrub_stamp":"2024-04-24T02:16:14.449684+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:27:00.632289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:00.498124+0000","last_change":"2024-04-24T02:16:00.498124+0000","last_active":"2024-04-24T02:16:00.498124+0000","last_peered":"2024-04-24T02:16:00.498124+0000","last_clean":"2024-04-24T02:16:00.498124+0000","last_became_active":"2024-04-24T02:12:04.754738+0000","last_became_peered":"2024-04-24T02:12:04.754738+0000","last_unstale":"2024-04-24T02:16:00.498124+0000","last_undegraded":"2024-04-24T02:16:00.498124+0000","last_fullsized":"2024-04-24T02:16:00.498124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-24T02:16:00.498013+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-24T02:16:00.498013+0000","last_clean_scrub_stamp":"2024-04-24T02:16:00.498013+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:10:40.099675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:11.512820+0000","last_change":"2024-04-24T02:16:11.512820+0000","last_active":"2024-04-24T02:16:11.512820+0000","last_peered":"2024-04-24T02:16:11.512820+0000","last_clean":"2024-04-24T02:16:11.512820+0000","last_became_active":"2024-04-24T02:12:02.744352+0000","last_became_peered":"2024-04-24T02:12:02.744352+0000","last_unstale":"2024-04-24T02:16:11.512820+0000","last_undegraded":"2024-04-24T02:16:11.512820+0000","last_fullsized":"2024-04-24T02:16:11.512820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:11.512653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:11.512653+0000","last_clean_scrub_stamp":"2024-04-24T02:16:11.512653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:38:55.315115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'12","reported_seq":102,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:22.450176+0000","last_change":"2024-04-24T02:16:22.450176+0000","last_active":"2024-04-24T02:16:22.450176+0000","last_peered":"2024-04-24T02:16:22.450176+0000","last_clean":"2024-04-24T02:16:22.450176+0000","last_became_active":"2024-04-24T02:12:45.808774+0000","last_became_peered":"2024-04-24T02:12:45.808774+0000","last_unstale":"2024-04-24T02:16:22.450176+0000","last_undegraded":"2024-04-24T02:16:22.450176+0000","last_fullsized":"2024-04-24T02:16:22.450176+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-04-24T02:16:22.450009+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-04-24T02:16:22.450009+0000","last_clean_scrub_stamp":"2024-04-24T02:16:22.450009+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:37:14.600020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:18.947207+0000","last_change":"2024-04-24T02:16:18.947207+0000","last_active":"2024-04-24T02:16:18.947207+0000","last_peered":"2024-04-24T02:16:18.947207+0000","last_clean":"2024-04-24T02:16:18.947207+0000","last_became_active":"2024-04-24T02:12:02.757458+0000","last_became_peered":"2024-04-24T02:12:02.757458+0000","last_unstale":"2024-04-24T02:16:18.947207+0000","last_undegraded":"2024-04-24T02:16:18.947207+0000","last_fullsized":"2024-04-24T02:16:18.947207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:18.947060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:18.947060+0000","last_clean_scrub_stamp":"2024-04-24T02:16:18.947060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:34:14.365119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'14","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:53.446051+0000","last_change":"2024-04-24T02:15:53.446051+0000","last_active":"2024-04-24T02:15:53.446051+0000","last_peered":"2024-04-24T02:15:53.446051+0000","last_clean":"2024-04-24T02:15:53.446051+0000","last_became_active":"2024-04-24T02:12:04.750973+0000","last_became_peered":"2024-04-24T02:12:04.750973+0000","last_unstale":"2024-04-24T02:15:53.446051+0000","last_undegraded":"2024-04-24T02:15:53.446051+0000","last_fullsized":"2024-04-24T02:15:53.446051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-04-24T02:15:53.445932+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-04-24T02:15:53.445932+0000","last_clean_scrub_stamp":"2024-04-24T02:15:53.445932+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:51:10.276272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:14.982027+0000","last_change":"2024-04-24T02:16:14.982027+0000","last_active":"2024-04-24T02:16:14.982027+0000","last_peered":"2024-04-24T02:16:14.982027+0000","last_clean":"2024-04-24T02:16:14.982027+0000","last_became_active":"2024-04-24T02:12:02.761235+0000","last_became_peered":"2024-04-24T02:12:02.761235+0000","last_unstale":"2024-04-24T02:16:14.982027+0000","last_undegraded":"2024-04-24T02:16:14.982027+0000","last_fullsized":"2024-04-24T02:16:14.982027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:14.981885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:14.981885+0000","last_clean_scrub_stamp":"2024-04-24T02:16:14.981885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:11:24.014498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:09.008011+0000","last_change":"2024-04-24T02:16:09.008011+0000","last_active":"2024-04-24T02:16:09.008011+0000","last_peered":"2024-04-24T02:16:09.008011+0000","last_clean":"2024-04-24T02:16:09.008011+0000","last_became_active":"2024-04-24T02:12:04.763517+0000","last_became_peered":"2024-04-24T02:12:04.763517+0000","last_unstale":"2024-04-24T02:16:09.008011+0000","last_undegraded":"2024-04-24T02:16:09.008011+0000","last_fullsized":"2024-04-24T02:16:09.008011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:16:09.007831+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:16:09.007831+0000","last_clean_scrub_stamp":"2024-04-24T02:16:09.007831+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:45:54.865186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:01.414787+0000","last_change":"2024-04-24T02:16:01.414787+0000","last_active":"2024-04-24T02:16:01.414787+0000","last_peered":"2024-04-24T02:16:01.414787+0000","last_clean":"2024-04-24T02:16:01.414787+0000","last_became_active":"2024-04-24T02:12:02.754227+0000","last_became_peered":"2024-04-24T02:12:02.754227+0000","last_unstale":"2024-04-24T02:16:01.414787+0000","last_undegraded":"2024-04-24T02:16:01.414787+0000","last_fullsized":"2024-04-24T02:16:01.414787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:16:01.414641+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:16:01.414641+0000","last_clean_scrub_stamp":"2024-04-24T02:16:01.414641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:42:59.636063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:06.480442+0000","last_change":"2024-04-24T02:16:06.480442+0000","last_active":"2024-04-24T02:16:06.480442+0000","last_peered":"2024-04-24T02:16:06.480442+0000","last_clean":"2024-04-24T02:16:06.480442+0000","last_became_active":"2024-04-24T02:12:04.755661+0000","last_became_peered":"2024-04-24T02:12:04.755661+0000","last_unstale":"2024-04-24T02:16:06.480442+0000","last_undegraded":"2024-04-24T02:16:06.480442+0000","last_fullsized":"2024-04-24T02:16:06.480442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-24T02:16:06.480334+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-24T02:16:06.480334+0000","last_clean_scrub_stamp":"2024-04-24T02:16:06.480334+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:06:18.083972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:29.899069+0000","last_change":"2024-04-24T02:16:29.899069+0000","last_active":"2024-04-24T02:16:29.899069+0000","last_peered":"2024-04-24T02:16:29.899069+0000","last_clean":"2024-04-24T02:16:29.899069+0000","last_became_active":"2024-04-24T02:12:02.758855+0000","last_became_peered":"2024-04-24T02:12:02.758855+0000","last_unstale":"2024-04-24T02:16:29.899069+0000","last_undegraded":"2024-04-24T02:16:29.899069+0000","last_fullsized":"2024-04-24T02:16:29.899069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:29.898955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:29.898955+0000","last_clean_scrub_stamp":"2024-04-24T02:16:29.898955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:47:15.652651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:22.892102+0000","last_change":"2024-04-24T02:16:22.892102+0000","last_active":"2024-04-24T02:16:22.892102+0000","last_peered":"2024-04-24T02:16:22.892102+0000","last_clean":"2024-04-24T02:16:22.892102+0000","last_became_active":"2024-04-24T02:12:02.753545+0000","last_became_peered":"2024-04-24T02:12:02.753545+0000","last_unstale":"2024-04-24T02:16:22.892102+0000","last_undegraded":"2024-04-24T02:16:22.892102+0000","last_fullsized":"2024-04-24T02:16:22.892102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:22.891992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:22.891992+0000","last_clean_scrub_stamp":"2024-04-24T02:16:22.891992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:05:46.554685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'10","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:17.082559+0000","last_change":"2024-04-24T02:16:17.082559+0000","last_active":"2024-04-24T02:16:17.082559+0000","last_peered":"2024-04-24T02:16:17.082559+0000","last_clean":"2024-04-24T02:16:17.082559+0000","last_became_active":"2024-04-24T02:12:04.758661+0000","last_became_peered":"2024-04-24T02:12:04.758661+0000","last_unstale":"2024-04-24T02:16:17.082559+0000","last_undegraded":"2024-04-24T02:16:17.082559+0000","last_fullsized":"2024-04-24T02:16:17.082559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-24T02:16:17.082421+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-24T02:16:17.082421+0000","last_clean_scrub_stamp":"2024-04-24T02:16:17.082421+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:51:19.331390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:16:06.148493+0000","last_change":"2024-04-24T02:16:06.148493+0000","last_active":"2024-04-24T02:16:06.148493+0000","last_peered":"2024-04-24T02:16:06.148493+0000","last_clean":"2024-04-24T02:16:06.148493+0000","last_became_active":"2024-04-24T02:12:02.745396+0000","last_became_peered":"2024-04-24T02:12:02.745396+0000","last_unstale":"2024-04-24T02:16:06.148493+0000","last_undegraded":"2024-04-24T02:16:06.148493+0000","last_fullsized":"2024-04-24T02:16:06.148493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:16:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:16:06.148341+0000","last_clean_scrub_stamp":"2024-04-24T02:16:06.148341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:39:08.794896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T02:15:49.477905+0000","last_change":"2024-04-24T02:15:49.477905+0000","last_active":"2024-04-24T02:15:49.477905+0000","last_peered":"2024-04-24T02:15:49.477905+0000","last_clean":"2024-04-24T02:15:49.477905+0000","last_became_active":"2024-04-24T02:12:04.766344+0000","last_became_peered":"2024-04-24T02:12:04.766344+0000","last_unstale":"2024-04-24T02:15:49.477905+0000","last_undegraded":"2024-04-24T02:15:49.477905+0000","last_fullsized":"2024-04-24T02:15:49.477905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T02:15:49.477787+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T02:15:49.477787+0000","last_clean_scrub_stamp":"2024-04-24T02:15:49.477787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:34:26.940534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":273,"ondisk_log_size":273,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1888,"num_read_kb":1653,"num_write":789,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1754,"ondisk_log_size":1754,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1617,"num_read_kb":1507,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":483,"ondisk_log_size":483,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640324,"num_pgs":152,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39944,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331896,"statfs":{"total":96636764160,"available":96595861504,"internally_reserved":0,"allocated":458752,"data_stored":135584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640322,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40456,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331384,"statfs":{"total":96636764160,"available":96595337216,"internally_reserved":0,"allocated":983040,"data_stored":722688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640324,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36324,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335516,"statfs":{"total":96636764160,"available":96599568384,"internally_reserved":0,"allocated":1011712,"data_stored":724048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705731,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39908,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331932,"statfs":{"total":96636764160,"available":96595898368,"internally_reserved":0,"allocated":421888,"data_stored":133610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T02:17:06.372 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-24T02:17:06.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.492+0000 7f9fd8dc7640 1 Processor -- start 2024-04-24T02:17:06.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.492+0000 7f9fd8dc7640 1 -- start start 2024-04-24T02:17:06.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.492+0000 7f9fd8dc7640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f9fd4127cb0 0x7f9fd4128090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:17:06.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.492+0000 7f9fd8dc7640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fd4128a00 con 0x7f9fd41285d0 2024-04-24T02:17:06.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.492+0000 7f9fd8dc7640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f9fd4127b00 con 0x7f9fd4127cb0 2024-04-24T02:17:06.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.492+0000 7f9fd259c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f9fd4127cb0 0x7f9fd4128090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:17:06.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.492+0000 7f9fcbfff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f9fd41285d0 0x7f9fd406e530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:52768/0 (socket says 172.21.15.104:52768) 2024-04-24T02:17:06.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.492+0000 7f9fcbfff640 1 -- 172.21.15.104:0/3006009731 learned_addr learned my addr 172.21.15.104:0/3006009731 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-04-24T02:17:06.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.493+0000 7f9fd259c640 1 -- 172.21.15.104:0/3006009731 >> v1:172.21.15.104:6789/0 conn(0x7f9fd41285d0 legacy=0x7f9fd406e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:17:06.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.493+0000 7f9fd259c640 1 -- 172.21.15.104:0/3006009731 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fd4098800 con 0x7f9fd4127cb0 2024-04-24T02:17:06.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.493+0000 7f9fd259c640 1 --2- 172.21.15.104:0/3006009731 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9fd4127cb0 0x7f9fd4128090 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f9fc4009750 tx=0x7f9fc402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d05a6cecffe429b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:17:06.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.493+0000 7f9fd1d9b640 1 -- 172.21.15.104:0/3006009731 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fc40316d0 con 0x7f9fd4127cb0 2024-04-24T02:17:06.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.494+0000 7f9fd1d9b640 1 -- 172.21.15.104:0/3006009731 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fc4037070 con 0x7f9fd4127cb0 2024-04-24T02:17:06.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.494+0000 7f9fd1d9b640 1 -- 172.21.15.104:0/3006009731 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fc40319c0 con 0x7f9fd4127cb0 2024-04-24T02:17:06.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.494+0000 7f9fd8dc7640 1 -- 172.21.15.104:0/3006009731 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9fd4127cb0 msgr2=0x7f9fd4128090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:17:06.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.494+0000 7f9fd8dc7640 1 --2- 172.21.15.104:0/3006009731 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9fd4127cb0 0x7f9fd4128090 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f9fc4009750 tx=0x7f9fc402b840 comp rx=0 tx=0).stop 2024-04-24T02:17:06.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.494+0000 7f9fd8dc7640 1 -- 172.21.15.104:0/3006009731 shutdown_connections 2024-04-24T02:17:06.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.494+0000 7f9fd8dc7640 1 --2- 172.21.15.104:0/3006009731 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9fd4127cb0 0x7f9fd4128090 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:17:06.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.494+0000 7f9fd8dc7640 1 -- 172.21.15.104:0/3006009731 >> 172.21.15.104:0/3006009731 conn(0x7f9fd4099680 msgr2=0x7f9fd4099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:17:06.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.494+0000 7f9fd8dc7640 1 -- 172.21.15.104:0/3006009731 shutdown_connections 2024-04-24T02:17:06.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.494+0000 7f9fd8dc7640 1 -- 172.21.15.104:0/3006009731 wait complete. 2024-04-24T02:17:06.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.495+0000 7f9fd8dc7640 1 Processor -- start 2024-04-24T02:17:06.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.495+0000 7f9fd8dc7640 1 -- start start 2024-04-24T02:17:06.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.495+0000 7f9fd8dc7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9fd4127cb0 0x7f9fd4128e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:17:06.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.495+0000 7f9fd8dc7640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd40701f0 con 0x7f9fd4127cb0 2024-04-24T02:17:06.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.496+0000 7f9fd259c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9fd4127cb0 0x7f9fd4128e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:17:06.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.496+0000 7f9fd259c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9fd4127cb0 0x7f9fd4128e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52666/0 (socket says 172.21.15.104:52666) 2024-04-24T02:17:06.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.496+0000 7f9fd259c640 1 -- 172.21.15.104:0/2772914378 learned_addr learned my addr 172.21.15.104:0/2772914378 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-24T02:17:06.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.496+0000 7f9fd259c640 1 -- 172.21.15.104:0/2772914378 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fd4090070 con 0x7f9fd4127cb0 2024-04-24T02:17:06.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.496+0000 7f9fd259c640 1 --2- 172.21.15.104:0/2772914378 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9fd4127cb0 0x7f9fd4128e20 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f9fc402b880 tx=0x7f9fc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:17:06.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.496+0000 7f9fcaffd640 1 -- 172.21.15.104:0/2772914378 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fc4032770 con 0x7f9fd4127cb0 2024-04-24T02:17:06.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.496+0000 7f9fcaffd640 1 -- 172.21.15.104:0/2772914378 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fc4032910 con 0x7f9fd4127cb0 2024-04-24T02:17:06.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.496+0000 7f9fd8dc7640 1 -- 172.21.15.104:0/2772914378 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fd412a8c0 con 0x7f9fd4127cb0 2024-04-24T02:17:06.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.496+0000 7f9fcaffd640 1 -- 172.21.15.104:0/2772914378 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fc4032c10 con 0x7f9fd4127cb0 2024-04-24T02:17:06.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.496+0000 7f9fd8dc7640 1 -- 172.21.15.104:0/2772914378 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fd4091030 con 0x7f9fd4127cb0 2024-04-24T02:17:06.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.497+0000 7f9fcaffd640 1 -- 172.21.15.104:0/2772914378 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9fc404c060 con 0x7f9fd4127cb0 2024-04-24T02:17:06.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.497+0000 7f9fd8dc7640 1 -- 172.21.15.104:0/2772914378 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fd4062da0 con 0x7f9fd4127cb0 2024-04-24T02:17:06.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.497+0000 7f9fcaffd640 1 --2- 172.21.15.104:0/2772914378 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9fb4038060 0x7f9fb403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:17:06.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.497+0000 7f9fcaffd640 1 -- 172.21.15.104:0/2772914378 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f9fc402f050 con 0x7f9fd4127cb0 2024-04-24T02:17:06.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.497+0000 7f9fcbfff640 1 --2- 172.21.15.104:0/2772914378 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9fb4038060 0x7f9fb403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:17:06.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.498+0000 7f9fcbfff640 1 --2- 172.21.15.104:0/2772914378 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9fb4038060 0x7f9fb403a520 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc007fd0 tx=0x7f9fbc007ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:17:06.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.502+0000 7f9fcaffd640 1 -- 172.21.15.104:0/2772914378 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f9fc4040070 con 0x7f9fd4127cb0 2024-04-24T02:17:06.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.672+0000 7f9fd8dc7640 1 -- 172.21.15.104:0/2772914378 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f9fd4071f80 con 0x7f9fd4127cb0 2024-04-24T02:17:06.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.674+0000 7f9fcaffd640 1 -- 172.21.15.104:0/2772914378 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7f9fc4039310 con 0x7f9fd4127cb0 2024-04-24T02:17:06.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.675+0000 7f9fcaffd640 1 -- 172.21.15.104:0/2772914378 <== mon.0 v2:172.21.15.104:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9fc40370c0 con 0x7f9fd4127cb0 2024-04-24T02:17:06.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.676+0000 7f9fd8dc7640 1 -- 172.21.15.104:0/2772914378 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9fb4038060 msgr2=0x7f9fb403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:17:06.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.676+0000 7f9fd8dc7640 1 --2- 172.21.15.104:0/2772914378 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9fb4038060 0x7f9fb403a520 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc007fd0 tx=0x7f9fbc007ac0 comp rx=0 tx=0).stop 2024-04-24T02:17:06.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.676+0000 7f9fd8dc7640 1 -- 172.21.15.104:0/2772914378 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9fd4127cb0 msgr2=0x7f9fd4128e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:17:06.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.676+0000 7f9fd8dc7640 1 --2- 172.21.15.104:0/2772914378 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9fd4127cb0 0x7f9fd4128e20 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f9fc402b880 tx=0x7f9fc40046c0 comp rx=0 tx=0).stop 2024-04-24T02:17:06.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.676+0000 7f9fd8dc7640 1 -- 172.21.15.104:0/2772914378 shutdown_connections 2024-04-24T02:17:06.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.676+0000 7f9fd8dc7640 1 --2- 172.21.15.104:0/2772914378 >> [v2:172.21.15.134:6824/3655027977,v1:172.21.15.134:6825/3655027977] conn(0x7f9fb4038060 0x7f9fb403a520 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:17:06.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.676+0000 7f9fd8dc7640 1 --2- 172.21.15.104:0/2772914378 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9fd4127cb0 0x7f9fd4128e20 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:17:06.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.676+0000 7f9fd8dc7640 1 -- 172.21.15.104:0/2772914378 >> 172.21.15.104:0/2772914378 conn(0x7f9fd4099680 msgr2=0x7f9fd412b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:17:06.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.676+0000 7f9fd8dc7640 1 -- 172.21.15.104:0/2772914378 shutdown_connections 2024-04-24T02:17:06.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-24T02:17:06.676+0000 7f9fd8dc7640 1 -- 172.21.15.104:0/2772914378 wait complete. 2024-04-24T02:17:06.687 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-24T02:17:06.688 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-24T02:17:06.688 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-24T02:17:06.688 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T02:17:06.721 INFO:tasks.ceph.osd.0:Stopped 2024-04-24T02:17:06.722 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-24T02:17:06.722 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T02:17:06.761 INFO:tasks.ceph.osd.1:Stopped 2024-04-24T02:17:06.761 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-24T02:17:06.761 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T02:17:06.829 INFO:tasks.ceph.osd.2:Stopped 2024-04-24T02:17:06.829 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-24T02:17:06.829 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T02:17:06.900 INFO:tasks.ceph.osd.3:Stopped 2024-04-24T02:17:06.900 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-24T02:17:06.901 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-24T02:17:06.901 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T02:17:06.969 INFO:tasks.ceph.mgr.x:Stopped 2024-04-24T02:17:06.969 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-24T02:17:06.970 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-24T02:17:06.970 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T02:17:06.980 INFO:tasks.ceph.mon.a:Stopped 2024-04-24T02:17:06.980 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-24T02:17:06.981 DEBUG:teuthology.orchestra.run.smithi104:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-04-24T02:17:07.047 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi104.front.sepia.ceph.com 2024-04-24T02:17:07.048 DEBUG:teuthology.orchestra.run.smithi104:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-24T02:17:07.245 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi134.front.sepia.ceph.com 2024-04-24T02:17:07.245 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-24T02:17:07.335 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi134.front.sepia.ceph.com 2024-04-24T02:17:07.335 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-24T02:17:07.406 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi134.front.sepia.ceph.com 2024-04-24T02:17:07.407 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-24T02:17:07.465 INFO:tasks.ceph:Archiving mon data... 2024-04-24T02:17:07.466 DEBUG:teuthology.misc:Transferring archived files from smithi104:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-23_21:40:02-rgw-squid-distro-default-smithi/7670635/data/mon.a.tgz 2024-04-24T02:17:07.466 DEBUG:teuthology.orchestra.run.smithi104:> mktemp 2024-04-24T02:17:07.481 INFO:teuthology.orchestra.run.smithi104.stdout:/tmp/tmp.hnNDuQm1qg 2024-04-24T02:17:07.481 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.hnNDuQm1qg 2024-04-24T02:17:07.629 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 0666 /tmp/tmp.hnNDuQm1qg 2024-04-24T02:17:07.709 DEBUG:teuthology.orchestra.remote:smithi104:/tmp/tmp.hnNDuQm1qg is 269KB 2024-04-24T02:17:07.805 DEBUG:teuthology.orchestra.run.smithi104:> rm -fr /tmp/tmp.hnNDuQm1qg 2024-04-24T02:17:07.819 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-24T02:17:07.819 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-24T02:17:07.861 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-24T02:17:07.936 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-24T02:17:07.953 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-24T02:17:07.953 INFO:tasks.ceph:Archiving crash dumps... 2024-04-24T02:17:07.955 DEBUG:teuthology.misc:Transferring archived files from smithi104:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-23_21:40:02-rgw-squid-distro-default-smithi/7670635/remote/smithi104/crash 2024-04-24T02:17:07.956 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-24T02:17:08.000 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-23_21:40:02-rgw-squid-distro-default-smithi/7670635/remote/smithi134/crash 2024-04-24T02:17:08.000 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-24T02:17:08.038 INFO:tasks.ceph:Compressing logs... 2024-04-24T02:17:08.038 DEBUG:teuthology.orchestra.run.smithi104:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-24T02:17:08.044 DEBUG:teuthology.orchestra.run.smithi134:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-24T02:17:08.080 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30013.log 2024-04-24T02:17:08.080 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31060.log 2024-04-24T02:17:08.080 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30891.log 2024-04-24T02:17:08.080 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.31060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29464.log 2024-04-24T02:17:08.080 INFO:teuthology.orchestra.run.smithi104.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.30013.log.gz 2024-04-24T02:17:08.080 INFO:teuthology.orchestra.run.smithi104.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.31060.log.gz 2024-04-24T02:17:08.081 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29846.log 2024-04-24T02:17:08.081 INFO:teuthology.orchestra.run.smithi104.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.30891.log.gz 2024-04-24T02:17:08.081 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.29464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30123.log 2024-04-24T02:17:08.081 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.29846.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-24T02:17:08.081 INFO:teuthology.orchestra.run.smithi104.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.29464.log.gz 2024-04-24T02:17:08.081 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30123.log: gzip 87.7% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.29846.log.gz 2024-04-24T02:17:08.081 INFO:teuthology.orchestra.run.smithi104.stderr: -- /var/log/ceph/ceph-client.admin.30014.log 2024-04-24T02:17:08.081 INFO:teuthology.orchestra.run.smithi104.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.30123.log.gz 2024-04-24T02:17:08.081 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30471.log 2024-04-24T02:17:08.081 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30014.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.25844.log 2024-04-24T02:17:08.081 INFO:teuthology.orchestra.run.smithi104.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.30014.log.gz 2024-04-24T02:17:08.081 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30181.log 2024-04-24T02:17:08.081 INFO:teuthology.orchestra.run.smithi104.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.30471.log.gz 2024-04-24T02:17:08.081 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph.tmp-client.admin.25844.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph.tmp-client.admin.25844.log.gz /var/log/ceph/ceph-client.admin.30375.log 2024-04-24T02:17:08.082 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-04-24T02:17:08.082 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29845.log 2024-04-24T02:17:08.082 INFO:teuthology.orchestra.run.smithi104.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.30181.log.gz 2024-04-24T02:17:08.082 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30375.log: 86.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-24T02:17:08.082 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30849.log 2024-04-24T02:17:08.082 INFO:teuthology.orchestra.run.smithi104.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.30375.log.gz 2024-04-24T02:17:08.082 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.29845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29521.log 2024-04-24T02:17:08.082 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30849.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.29845.log.gz 2024-04-24T02:17:08.082 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-24T02:17:08.082 INFO:teuthology.orchestra.run.smithi104.stderr: 86.8%/var/log/ceph/ceph-client.admin.29521.log: -- replaced with /var/log/ceph/ceph-client.admin.30849.log.gz 2024-04-24T02:17:08.082 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31102.log 2024-04-24T02:17:08.082 INFO:teuthology.orchestra.run.smithi104.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.29521.log.gz 2024-04-24T02:17:08.082 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29745.log 2024-04-24T02:17:08.083 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.31102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30765.log 2024-04-24T02:17:08.083 INFO:teuthology.orchestra.run.smithi104.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.31102.log.gz 2024-04-24T02:17:08.083 INFO:teuthology.orchestra.run.smithi104.stderr: 88.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-24T02:17:08.083 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.29745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30597.log 2024-04-24T02:17:08.083 INFO:teuthology.orchestra.run.smithi104.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.29745.log.gz 2024-04-24T02:17:08.083 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31018.log 2024-04-24T02:17:08.083 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30597.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.30765.log.gz 2024-04-24T02:17:08.083 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29703.log 2024-04-24T02:17:08.083 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.31018.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.30597.log.gz 2024-04-24T02:17:08.083 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30291.log 2024-04-24T02:17:08.083 INFO:teuthology.orchestra.run.smithi104.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.31018.log.gz 2024-04-24T02:17:08.083 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.29703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30333.log 2024-04-24T02:17:08.083 INFO:teuthology.orchestra.run.smithi104.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.29703.log.gz/var/log/ceph/ceph-client.admin.30291.log: 2024-04-24T02:17:08.083 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-24T02:17:08.084 INFO:teuthology.orchestra.run.smithi104.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.30291.log.gz 2024-04-24T02:17:08.084 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31184.log 2024-04-24T02:17:08.084 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30513.log 2024-04-24T02:17:08.084 INFO:teuthology.orchestra.run.smithi104.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.30333.log.gz 2024-04-24T02:17:08.084 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.31184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30555.log 2024-04-24T02:17:08.084 INFO:teuthology.orchestra.run.smithi104.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.31184.log.gz 2024-04-24T02:17:08.084 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29847.log 2024-04-24T02:17:08.084 INFO:teuthology.orchestra.run.smithi104.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.30513.log.gz 2024-04-24T02:17:08.084 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30555.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-24T02:17:08.084 INFO:teuthology.orchestra.run.smithi104.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.30555.log.gz 2024-04-24T02:17:08.084 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.29847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30012.log 2024-04-24T02:17:08.084 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.29847.log.gz 2024-04-24T02:17:08.084 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27705.log 2024-04-24T02:17:08.084 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29619.log 2024-04-24T02:17:08.085 INFO:teuthology.orchestra.run.smithi104.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.30012.log.gz 2024-04-24T02:17:08.085 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.27705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27546.log 2024-04-24T02:17:08.085 INFO:teuthology.orchestra.run.smithi104.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.27705.log.gz 2024-04-24T02:17:08.085 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30183.log 2024-04-24T02:17:08.085 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.29619.log: /var/log/ceph/ceph-client.admin.27546.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.29619.log.gz 2024-04-24T02:17:08.085 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30975.log 2024-04-24T02:17:08.085 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30183.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.27546.log.gz 2024-04-24T02:17:08.085 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30723.log 2024-04-24T02:17:08.085 INFO:teuthology.orchestra.run.smithi104.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.30183.log.gz 2024-04-24T02:17:08.085 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29577.log 2024-04-24T02:17:08.085 INFO:teuthology.orchestra.run.smithi104.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.30975.log.gz 2024-04-24T02:17:08.085 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30933.log 2024-04-24T02:17:08.085 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30723.log: /var/log/ceph/ceph-client.admin.29577.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.30723.log.gz 2024-04-24T02:17:08.085 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31144.log 2024-04-24T02:17:08.086 INFO:teuthology.orchestra.run.smithi104.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.29577.log.gz 2024-04-24T02:17:08.086 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27664.log 2024-04-24T02:17:08.086 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30933.log: /var/log/ceph/ceph-client.admin.31144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30807.log 2024-04-24T02:17:08.086 INFO:teuthology.orchestra.run.smithi104.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.30933.log.gz 2024-04-24T02:17:08.086 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.27664.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.31144.log.gz 2024-04-24T02:17:08.086 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29844.log 2024-04-24T02:17:08.086 INFO:teuthology.orchestra.run.smithi104.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.27664.log.gz 2024-04-24T02:17:08.086 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30639.log 2024-04-24T02:17:08.086 INFO:teuthology.orchestra.run.smithi104.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.30807.log.gz 2024-04-24T02:17:08.086 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.29844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30182.log 2024-04-24T02:17:08.086 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.29844.log.gz 2024-04-24T02:17:08.086 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30015.log 2024-04-24T02:17:08.086 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30639.log: /var/log/ceph/ceph-client.admin.30182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29661.log 2024-04-24T02:17:08.087 INFO:teuthology.orchestra.run.smithi104.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.30639.log.gz 2024-04-24T02:17:08.087 INFO:teuthology.orchestra.run.smithi104.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.30182.log.gz 2024-04-24T02:17:08.087 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30681.log 2024-04-24T02:17:08.087 INFO:teuthology.orchestra.run.smithi104.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.30015.log.gz 2024-04-24T02:17:08.087 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30429.log 2024-04-24T02:17:08.087 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.29661.log: /var/log/ceph/ceph-client.admin.30681.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.29661.log.gz 2024-04-24T02:17:08.087 INFO:teuthology.orchestra.run.smithi104.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.30681.log.gz 2024-04-24T02:17:08.087 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30429.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.30429.log.gz 2024-04-24T02:17:08.114 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63701.log 2024-04-24T02:17:08.114 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64306.log 2024-04-24T02:17:08.114 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.63701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93921.log 2024-04-24T02:17:08.114 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.64306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58256.log 2024-04-24T02:17:08.114 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.93921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45551.log 2024-04-24T02:17:08.119 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.58256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54021.log 2024-04-24T02:17:08.119 INFO:teuthology.orchestra.run.smithi134.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.63701.log.gz 2024-04-24T02:17:08.119 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.45551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89081.log 2024-04-24T02:17:08.119 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79431.log 2024-04-24T02:17:08.119 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.54021.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.93921.log.gz 2024-04-24T02:17:08.120 INFO:teuthology.orchestra.run.smithi134.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.64306.log.gz 2024-04-24T02:17:08.120 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.89081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41316.log 2024-04-24T02:17:08.120 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91501.log 2024-04-24T02:17:08.120 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.79431.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.58256.log.gz 2024-04-24T02:17:08.120 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.41316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42526.log 2024-04-24T02:17:08.120 INFO:teuthology.orchestra.run.smithi134.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.45551.log.gz 2024-04-24T02:17:08.120 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.91501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44341.log 2024-04-24T02:17:08.120 INFO:teuthology.orchestra.run.smithi134.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.54021.log.gz 2024-04-24T02:17:08.120 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.42526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75801.log 2024-04-24T02:17:08.120 INFO:teuthology.orchestra.run.smithi134.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.89081.log.gz 2024-04-24T02:17:08.120 INFO:teuthology.orchestra.run.smithi134.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.41316.log.gz 2024-04-24T02:17:08.120 INFO:teuthology.orchestra.run.smithi134.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.79431.log.gz 2024-04-24T02:17:08.120 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.44341.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-24T02:17:08.120 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43736.log 2024-04-24T02:17:08.121 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.75801.log: /var/log/ceph/ceph-osd.2.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.91501.log.gz 2024-04-24T02:17:08.121 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72171.log 2024-04-24T02:17:08.121 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.43736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30041.log 2024-04-24T02:17:08.121 INFO:teuthology.orchestra.run.smithi134.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.42526.log.gz 2024-04-24T02:17:08.121 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.72171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90896.log 2024-04-24T02:17:08.121 INFO:teuthology.orchestra.run.smithi134.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.44341.log.gz 2024-04-24T02:17:08.121 INFO:teuthology.orchestra.run.smithi134.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.75801.log.gz 2024-04-24T02:17:08.121 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.30041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48576.log 2024-04-24T02:17:08.121 INFO:teuthology.orchestra.run.smithi134.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.30041.log.gz 2024-04-24T02:17:08.121 INFO:teuthology.orchestra.run.smithi134.stderr: 91.4%/var/log/ceph/ceph-client.0.90896.log: -- replaced with /var/log/ceph/ceph-client.0.43736.log.gz 2024-04-24T02:17:08.121 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66726.log 2024-04-24T02:17:08.148 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.48576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35272.log 2024-04-24T02:17:08.148 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.66726.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.72171.log.gz 2024-04-24T02:17:08.148 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47971.log 2024-04-24T02:17:08.148 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.35272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39501.log 2024-04-24T02:17:08.148 INFO:teuthology.orchestra.run.smithi134.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.90896.log.gz 2024-04-24T02:17:08.149 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.47971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34479.log 2024-04-24T02:17:08.149 INFO:teuthology.orchestra.run.smithi134.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.48576.log.gz 2024-04-24T02:17:08.149 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.39501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34399.log 2024-04-24T02:17:08.149 INFO:teuthology.orchestra.run.smithi134.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.66726.log.gz 2024-04-24T02:17:08.149 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.34479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89686.log 2024-04-24T02:17:08.149 INFO:teuthology.orchestra.run.smithi134.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.34479.log.gz 2024-04-24T02:17:08.149 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.34399.log: 92.0% -- replaced with /var/log/ceph/ceph-client.0.35272.log.gz 2024-04-24T02:17:08.149 INFO:teuthology.orchestra.run.smithi134.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.47971.log.gz 2024-04-24T02:17:08.149 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78826.log 2024-04-24T02:17:08.149 INFO:teuthology.orchestra.run.smithi134.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.34399.log.gz 2024-04-24T02:17:08.149 INFO:teuthology.orchestra.run.smithi134.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.39501.log.gz 2024-04-24T02:17:08.149 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80036.log 2024-04-24T02:17:08.149 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.89686.log: /var/log/ceph/ceph-client.0.78826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44946.log 2024-04-24T02:17:08.150 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.80036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37692.log 2024-04-24T02:17:08.150 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.44946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69751.log 2024-04-24T02:17:08.150 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.37692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88476.log 2024-04-24T02:17:08.150 INFO:teuthology.orchestra.run.smithi134.stderr: 91.3%/var/log/ceph/ceph-client.0.69751.log: -- replaced with /var/log/ceph/ceph-client.0.89686.log.gz 2024-04-24T02:17:08.150 INFO:teuthology.orchestra.run.smithi134.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.78826.log.gz 2024-04-24T02:17:08.150 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70961.log 2024-04-24T02:17:08.150 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.88476.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.44946.log.gz 2024-04-24T02:17:08.150 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73986.log 2024-04-24T02:17:08.150 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.70961.log: gzip 91.5% -- replaced with /var/log/ceph/ceph-client.0.37692.log.gz 2024-04-24T02:17:08.150 INFO:teuthology.orchestra.run.smithi134.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.80036.log.gz 2024-04-24T02:17:08.150 INFO:teuthology.orchestra.run.smithi134.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.71566.log 2024-04-24T02:17:08.150 INFO:teuthology.orchestra.run.smithi134.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.69751.log.gz 2024-04-24T02:17:08.150 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.73986.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-24T02:17:08.151 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.71566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53416.log 2024-04-24T02:17:08.151 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose 91.3% -- replaced with /var/log/ceph/ceph-client.0.88476.log.gz 2024-04-24T02:17:08.151 INFO:teuthology.orchestra.run.smithi134.stderr: -- /var/log/ceph/ceph-client.0.70356.log 2024-04-24T02:17:08.151 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.53416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40106.log 2024-04-24T02:17:08.151 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.70356.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.73986.log.gzgzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-04-24T02:17:08.151 INFO:teuthology.orchestra.run.smithi134.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.71566.log.gz 2024-04-24T02:17:08.151 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-04-24T02:17:08.151 INFO:teuthology.orchestra.run.smithi134.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.70961.log.gz 2024-04-24T02:17:08.151 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56441.log 2024-04-24T02:17:08.151 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.40106.log: gzip/var/log/ceph/ops-log-ceph-client.0.log: -5 --verbose -- /var/log/ceph/ceph-client.0.90291.log 92.0% -- replaced with /var/log/ceph/ceph-client.0.53416.log.gz 2024-04-24T02:17:08.151 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-04-24T02:17:08.151 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.56441.log: 91.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60676.log 2024-04-24T02:17:08.152 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.0.70356.log.gz 2024-04-24T02:17:08.152 INFO:teuthology.orchestra.run.smithi134.stderr: 91.7% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-04-24T02:17:08.152 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.90291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50996.log 2024-04-24T02:17:08.152 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.60676.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.40106.log.gz 2024-04-24T02:17:08.152 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-04-24T02:17:08.152 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.50996.log: 91.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47366.log 2024-04-24T02:17:08.152 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.0.56441.log.gz 2024-04-24T02:17:08.152 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-24T02:17:08.152 INFO:teuthology.orchestra.run.smithi134.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.90291.log.gz 2024-04-24T02:17:08.152 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36482.log 2024-04-24T02:17:08.152 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.47366.log: /var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52811.log 2024-04-24T02:17:08.152 INFO:teuthology.orchestra.run.smithi134.stderr: 91.1% 91.2% -- replaced with /var/log/ceph/ceph-client.0.60676.log.gz 2024-04-24T02:17:08.152 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.0.50996.log.gz 2024-04-24T02:17:08.153 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.36482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55231.log 2024-04-24T02:17:08.153 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.52811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58861.log 2024-04-24T02:17:08.153 INFO:teuthology.orchestra.run.smithi134.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.47366.log.gz 2024-04-24T02:17:08.153 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.55231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95183.log 2024-04-24T02:17:08.153 INFO:teuthology.orchestra.run.smithi134.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.36482.log.gz 2024-04-24T02:17:08.153 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.58861.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.52811.log.gz 2024-04-24T02:17:08.153 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-24T02:17:08.153 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.95183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38297.log 2024-04-24T02:17:08.153 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-mgr.x.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.55231.log.gz 2024-04-24T02:17:08.153 INFO:teuthology.orchestra.run.smithi134.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.58861.log.gz 2024-04-24T02:17:08.153 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92711.log 2024-04-24T02:17:08.153 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82456.log 2024-04-24T02:17:08.153 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.92711.log: /var/log/ceph/ceph-client.0.38297.log: 90.4% -- replaced with /var/log/ceph/ceph-client.0.38297.log.gz 2024-04-24T02:17:08.154 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34439.log 2024-04-24T02:17:08.154 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.82456.log: 93.3% -- replaced with /var/log/ceph/ceph-client.0.95183.log.gz 2024-04-24T02:17:08.154 INFO:teuthology.orchestra.run.smithi134.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.92711.log.gz 2024-04-24T02:17:08.154 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64911.log 2024-04-24T02:17:08.154 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.34439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57046.log 2024-04-24T02:17:08.154 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.64911.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.34439.log.gz 2024-04-24T02:17:08.154 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77616.log 2024-04-24T02:17:08.154 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.57046.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.64911.log.gz 2024-04-24T02:17:08.154 INFO:teuthology.orchestra.run.smithi134.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.82456.log.gz 2024-04-24T02:17:08.154 INFO:teuthology.orchestra.run.smithi134.stderr: 91.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80641.log 2024-04-24T02:17:08.154 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.0.57046.log.gz 2024-04-24T02:17:08.154 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.77616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94526.log 2024-04-24T02:17:08.154 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.80641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38896.log 2024-04-24T02:17:08.154 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.94526.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.77616.log.gz 2024-04-24T02:17:08.155 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87266.log 2024-04-24T02:17:08.155 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.38896.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.94526.log.gz 2024-04-24T02:17:08.155 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37087.log 2024-04-24T02:17:08.155 INFO:teuthology.orchestra.run.smithi134.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.80641.log.gz 2024-04-24T02:17:08.155 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.87266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74591.log 2024-04-24T02:17:08.155 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.37087.log: 91.8% -- replaced with /var/log/ceph/ceph-client.0.38896.log.gz 2024-04-24T02:17:08.155 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81246.log 2024-04-24T02:17:08.155 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.74591.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.87266.log.gz 2024-04-24T02:17:08.155 INFO:teuthology.orchestra.run.smithi134.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.37087.log.gz 2024-04-24T02:17:08.155 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30001.log 2024-04-24T02:17:08.155 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5/var/log/ceph/ceph-client.0.81246.log: --verbose -- /var/log/ceph/ceph-client.0.35877.log 2024-04-24T02:17:08.155 INFO:teuthology.orchestra.run.smithi134.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.74591.log.gz 2024-04-24T02:17:08.155 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.30001.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.30001.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.55836.log 2024-04-24T02:17:08.155 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-04-24T02:17:08.156 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.35877.log: gzip 91.2% -- replaced with /var/log/ceph/ceph-client.0.81246.log.gz -5 2024-04-24T02:17:08.156 INFO:teuthology.orchestra.run.smithi134.stderr: --verbose -- /var/log/ceph/ceph-client.0.69146.log 2024-04-24T02:17:08.156 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83666.log 2024-04-24T02:17:08.181 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.55836.log: /var/log/ceph/ceph-client.0.69146.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.35877.log.gz 2024-04-24T02:17:08.181 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34359.log 2024-04-24T02:17:08.181 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.83666.log: 91.4% 91.5% -- replaced with /var/log/ceph/ceph-client.0.55836.log.gz 2024-04-24T02:17:08.181 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.0.69146.log.gz 2024-04-24T02:17:08.181 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30081.log 2024-04-24T02:17:08.181 INFO:teuthology.orchestra.run.smithi134.stderr: 90.4%/var/log/ceph/ceph-client.admin.34359.log: -- replaced with /var/log/ceph/ceph-client.0.83666.log.gz 2024-04-24T02:17:08.182 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40711.log 2024-04-24T02:17:08.182 INFO:teuthology.orchestra.run.smithi134.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.34359.log.gz 2024-04-24T02:17:08.182 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.30081.log: /var/log/ceph/ceph-client.0.86062.log 2024-04-24T02:17:08.182 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.40711.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.30081.log.gz 2024-04-24T02:17:08.182 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57651.log 2024-04-24T02:17:08.182 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59466.log 2024-04-24T02:17:08.182 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.86062.log: /var/log/ceph/ceph-client.0.57651.log: 90.4% -- replaced with /var/log/ceph/ceph-client.0.86062.log.gz 2024-04-24T02:17:08.182 INFO:teuthology.orchestra.run.smithi134.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.40711.log.gz 2024-04-24T02:17:08.182 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51601.log 2024-04-24T02:17:08.182 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.59466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41921.log 2024-04-24T02:17:08.182 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.51601.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.57651.log.gz 2024-04-24T02:17:08.182 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63096.log 2024-04-24T02:17:08.182 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.41921.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.59466.log.gz 2024-04-24T02:17:08.183 INFO:teuthology.orchestra.run.smithi134.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.51601.log.gz 2024-04-24T02:17:08.183 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66121.log 2024-04-24T02:17:08.183 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.63096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65516.log 2024-04-24T02:17:08.183 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.66121.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.41921.log.gz 2024-04-24T02:17:08.183 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49181.log 2024-04-24T02:17:08.183 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.65516.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.63096.log.gz 2024-04-24T02:17:08.183 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72776.log 2024-04-24T02:17:08.183 INFO:teuthology.orchestra.run.smithi134.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.66121.log.gz/var/log/ceph/ceph-client.0.49181.log: 2024-04-24T02:17:08.183 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73381.log 2024-04-24T02:17:08.183 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.72776.log: 91.8% -- replaced with /var/log/ceph/ceph-client.0.65516.log.gz 2024-04-24T02:17:08.183 INFO:teuthology.orchestra.run.smithi134.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.49181.log.gz 2024-04-24T02:17:08.183 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43131.log 2024-04-24T02:17:08.183 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.73381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46156.log 2024-04-24T02:17:08.183 INFO:teuthology.orchestra.run.smithi134.stderr: 91.4%/var/log/ceph/ceph-client.0.43131.log: -- replaced with /var/log/ceph/ceph-client.0.72776.log.gz 2024-04-24T02:17:08.184 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84265.log 2024-04-24T02:17:08.184 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.46156.log: 91.8% -- replaced with /var/log/ceph/ceph-client.0.73381.log.gz 2024-04-24T02:17:08.184 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46761.log 2024-04-24T02:17:08.184 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.84265.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.43131.log.gz 2024-04-24T02:17:08.184 INFO:teuthology.orchestra.run.smithi134.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.46156.log.gz 2024-04-24T02:17:08.184 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52206.log 2024-04-24T02:17:08.184 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76406.log 2024-04-24T02:17:08.184 INFO:teuthology.orchestra.run.smithi134.stderr: 91.7%/var/log/ceph/ceph-client.0.46761.log: -- replaced with /var/log/ceph/ceph-client.0.84265.log.gz 2024-04-24T02:17:08.184 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.52206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54626.log 2024-04-24T02:17:08.184 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.76406.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.46761.log.gz 2024-04-24T02:17:08.184 INFO:teuthology.orchestra.run.smithi134.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.52206.log.gz 2024-04-24T02:17:08.184 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61886.log 2024-04-24T02:17:08.184 INFO:teuthology.orchestra.run.smithi134.stderr: 91.3%/var/log/ceph/ceph-client.0.54626.log: -- replaced with /var/log/ceph/ceph-client.0.76406.log.gz 2024-04-24T02:17:08.184 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75196.log 2024-04-24T02:17:08.185 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50391.log 2024-04-24T02:17:08.185 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.61886.log: /var/log/ceph/ceph-client.0.75196.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.54626.log.gz 2024-04-24T02:17:08.185 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84864.log 2024-04-24T02:17:08.185 INFO:teuthology.orchestra.run.smithi134.stderr: 91.3%/var/log/ceph/ceph-client.0.50391.log: -- replaced with /var/log/ceph/ceph-client.0.75196.log.gz 2024-04-24T02:17:08.185 INFO:teuthology.orchestra.run.smithi134.stderr: 91.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61281.log 2024-04-24T02:17:08.185 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.0.61886.log.gz 2024-04-24T02:17:08.185 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.84864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77011.log 2024-04-24T02:17:08.185 INFO:teuthology.orchestra.run.smithi134.stderr: 91.1% 90.3% -- replaced with /var/log/ceph/ceph-client.0.50391.log.gz 2024-04-24T02:17:08.185 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.61281.log: -- replaced with /var/log/ceph/ceph-client.0.84864.log.gz 2024-04-24T02:17:08.185 INFO:teuthology.orchestra.run.smithi134.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.61281.log.gz 2024-04-24T02:17:08.185 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67936.log 2024-04-24T02:17:08.185 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.77011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49786.log 2024-04-24T02:17:08.185 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.67936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60071.log 2024-04-24T02:17:08.186 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.49786.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.77011.log.gz 2024-04-24T02:17:08.186 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85463.log 2024-04-24T02:17:08.186 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.60071.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.49786.log.gz 2024-04-24T02:17:08.186 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83061.log 2024-04-24T02:17:08.186 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.85463.log: 93.4% -- replaced with /var/log/ceph/ceph-client.0.67936.log.gz 91.0% -- replaced with /var/log/ceph/ceph-client.0.60071.log.gz 2024-04-24T02:17:08.186 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-04-24T02:17:08.186 INFO:teuthology.orchestra.run.smithi134.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.0.85463.log.gz 2024-04-24T02:17:08.186 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87871.log 2024-04-24T02:17:08.186 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.83061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93316.log 2024-04-24T02:17:08.186 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29961.log 2024-04-24T02:17:08.186 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.87871.log: /var/log/ceph/ceph-client.0.93316.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.83061.log.gz 2024-04-24T02:17:08.186 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81851.log 2024-04-24T02:17:08.186 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.29961.log: 91.2% 85.4% -- replaced with /var/log/ceph/ceph-client.admin.29961.log.gz 2024-04-24T02:17:08.186 INFO:teuthology.orchestra.run.smithi134.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.93316.log.gz 2024-04-24T02:17:08.187 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.0.87871.log.gz 2024-04-24T02:17:08.187 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67331.log 2024-04-24T02:17:08.187 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.81851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92106.log 2024-04-24T02:17:08.187 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.67331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68541.log 2024-04-24T02:17:08.187 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.92106.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.81851.log.gz 2024-04-24T02:17:08.187 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62491.log 2024-04-24T02:17:08.187 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.68541.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.92106.log.gz 2024-04-24T02:17:08.187 INFO:teuthology.orchestra.run.smithi134.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.0.67331.log.gz 2024-04-24T02:17:08.187 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78221.log 2024-04-24T02:17:08.187 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86661.log 2024-04-24T02:17:08.189 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.62491.log: /var/log/ceph/ceph-client.0.78221.log: 92.7% -- replaced with /var/log/ceph/ceph-client.0.68541.log.gz 2024-04-24T02:17:08.189 INFO:teuthology.orchestra.run.smithi134.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.62491.log.gz 2024-04-24T02:17:08.189 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.86661.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.78221.log.gz 2024-04-24T02:17:08.189 INFO:teuthology.orchestra.run.smithi134.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.86661.log.gz 2024-04-24T02:17:08.189 INFO:teuthology.orchestra.run.smithi134.stderr: 92.2% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-04-24T02:17:08.196 INFO:teuthology.orchestra.run.smithi134.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-24T02:17:08.244 INFO:teuthology.orchestra.run.smithi104.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-24T02:17:08.941 INFO:teuthology.orchestra.run.smithi134.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-24T02:17:08.962 INFO:teuthology.orchestra.run.smithi104.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-24T02:17:08.964 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-04-24T02:17:08.964 INFO:teuthology.orchestra.run.smithi104.stderr:real 0m0.909s 2024-04-24T02:17:08.964 INFO:teuthology.orchestra.run.smithi104.stderr:user 0m1.045s 2024-04-24T02:17:08.964 INFO:teuthology.orchestra.run.smithi104.stderr:sys 0m0.077s 2024-04-24T02:17:09.075 INFO:teuthology.orchestra.run.smithi134.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-24T02:17:09.104 INFO:teuthology.orchestra.run.smithi134.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-24T02:17:09.106 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-04-24T02:17:09.106 INFO:teuthology.orchestra.run.smithi134.stderr:real 0m1.004s 2024-04-24T02:17:09.107 INFO:teuthology.orchestra.run.smithi134.stderr:user 0m2.916s 2024-04-24T02:17:09.107 INFO:teuthology.orchestra.run.smithi134.stderr:sys 0m0.199s 2024-04-24T02:17:09.107 INFO:tasks.ceph:Archiving logs... 2024-04-24T02:17:09.107 DEBUG:teuthology.misc:Transferring archived files from smithi104:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-23_21:40:02-rgw-squid-distro-default-smithi/7670635/remote/smithi104/log 2024-04-24T02:17:09.108 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-24T02:17:09.338 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-23_21:40:02-rgw-squid-distro-default-smithi/7670635/remote/smithi134/log 2024-04-24T02:17:09.339 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-24T02:17:09.882 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-24T02:17:09.898 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-24T02:17:09.898 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-24T02:17:09.901 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-24T02:17:09.976 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-24T02:17:09.985 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-24T02:17:09.985 DEBUG:teuthology.orchestra.run.smithi104:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-24T02:17:09.988 DEBUG:teuthology.orchestra.run.smithi134:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-24T02:17:10.000 INFO:teuthology.orchestra.run.smithi104.stderr:bash: line 1: ntpq: command not found 2024-04-24T02:17:10.003 INFO:teuthology.orchestra.run.smithi134.stderr:bash: line 1: ntpq: command not found 2024-04-24T02:17:10.005 INFO:teuthology.orchestra.run.smithi104.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-24T02:17:10.005 INFO:teuthology.orchestra.run.smithi104.stdout:=============================================================================== 2024-04-24T02:17:10.005 INFO:teuthology.orchestra.run.smithi104.stdout:^- hv01.front.sepia.ceph.com 2 6 377 1 +1301us[+1301us] +/- 597ms 2024-04-24T02:17:10.005 INFO:teuthology.orchestra.run.smithi104.stdout:^* hv02.front.sepia.ceph.com 3 6 377 2 -611us[ -595us] +/- 76ms 2024-04-24T02:17:10.005 INFO:teuthology.orchestra.run.smithi104.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 2 +769us[ +786us] +/- 87ms 2024-04-24T02:17:10.005 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T02:17:10.007 INFO:teuthology.orchestra.run.smithi134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-24T02:17:10.008 INFO:teuthology.orchestra.run.smithi134.stdout:=============================================================================== 2024-04-24T02:17:10.008 INFO:teuthology.orchestra.run.smithi134.stdout:^- hv01.front.sepia.ceph.com 2 6 377 2 +1307us[+1307us] +/- 597ms 2024-04-24T02:17:10.008 INFO:teuthology.orchestra.run.smithi134.stdout:^* hv02.front.sepia.ceph.com 3 6 377 65 -604us[ -596us] +/- 75ms 2024-04-24T02:17:10.008 INFO:teuthology.orchestra.run.smithi134.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 3 +774us[ +774us] +/- 87ms 2024-04-24T02:17:10.008 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T02:17:10.008 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-24T02:17:10.023 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-24T02:17:10.023 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-24T02:17:10.054 DEBUG:teuthology.orchestra.run.smithi104:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-24T02:17:10.112 DEBUG:teuthology.orchestra.run.smithi134:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-24T02:17:10.171 DEBUG:teuthology.orchestra.run.smithi104:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-24T02:17:10.196 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T02:17:10.197 DEBUG:teuthology.orchestra.run.smithi134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-24T02:17:10.223 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T02:17:10.223 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-24T02:17:10.232 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-24T02:17:10.272 INFO:teuthology.task.internal:Duration was 733.686343 seconds 2024-04-24T02:17:10.272 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-24T02:17:10.307 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-24T02:17:10.307 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-24T02:17:10.310 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-24T02:17:10.343 INFO:teuthology.orchestra.run.smithi104.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-24T02:17:10.346 INFO:teuthology.orchestra.run.smithi134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-24T02:17:10.705 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-24T02:17:10.705 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi104.front.sepia.ceph.com 2024-04-24T02:17:10.706 DEBUG:teuthology.orchestra.run.smithi104:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-24T02:17:10.764 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi134.front.sepia.ceph.com 2024-04-24T02:17:10.765 DEBUG:teuthology.orchestra.run.smithi134:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-24T02:17:10.796 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-24T02:17:10.797 DEBUG:teuthology.orchestra.run.smithi104:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-24T02:17:10.807 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-24T02:17:10.862 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-24T02:17:10.862 DEBUG:teuthology.orchestra.run.smithi104:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-24T02:17:10.871 DEBUG:teuthology.orchestra.run.smithi134:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-24T02:17:10.994 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-24T02:17:11.005 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-24T02:17:11.006 DEBUG:teuthology.orchestra.run.smithi104:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-24T02:17:11.029 DEBUG:teuthology.orchestra.run.smithi134:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-24T02:17:11.053 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-24T02:17:11.065 DEBUG:teuthology.orchestra.run.smithi104:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-24T02:17:11.072 DEBUG:teuthology.orchestra.run.smithi134:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-24T02:17:11.091 INFO:teuthology.orchestra.run.smithi104.stdout:kernel.core_pattern = core 2024-04-24T02:17:11.116 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = core 2024-04-24T02:17:11.138 DEBUG:teuthology.orchestra.run.smithi104:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-24T02:17:11.178 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T02:17:11.179 DEBUG:teuthology.orchestra.run.smithi134:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-24T02:17:11.193 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T02:17:11.193 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-24T02:17:11.203 INFO:teuthology.task.internal:Transferring archived files... 2024-04-24T02:17:11.204 DEBUG:teuthology.misc:Transferring archived files from smithi104:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-23_21:40:02-rgw-squid-distro-default-smithi/7670635/remote/smithi104 2024-04-24T02:17:11.204 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-24T02:17:11.251 DEBUG:teuthology.misc:Transferring archived files from smithi134:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-23_21:40:02-rgw-squid-distro-default-smithi/7670635/remote/smithi134 2024-04-24T02:17:11.251 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-24T02:17:11.282 INFO:teuthology.task.internal:Removing archive directory... 2024-04-24T02:17:11.283 DEBUG:teuthology.orchestra.run.smithi104:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-24T02:17:11.288 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-24T02:17:11.333 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-24T02:17:11.346 INFO:teuthology.task.internal:Not uploading archives. 2024-04-24T02:17:11.346 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-24T02:17:11.371 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-24T02:17:11.372 DEBUG:teuthology.orchestra.run.smithi104:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-24T02:17:11.374 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-24T02:17:11.386 INFO:teuthology.orchestra.run.smithi104.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 24 02:17 /home/ubuntu/cephtest 2024-04-24T02:17:11.388 INFO:teuthology.orchestra.run.smithi134.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 24 02:17 /home/ubuntu/cephtest 2024-04-24T02:17:11.389 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-24T02:17:11.403 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-24T02:17:11.475 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{centos_latest}} duration: 733.6863431930542 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-04-24T02:17:11.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-24T02:17:11.561 INFO:teuthology.run:pass